2024-08-19T00:28:01.207 INFO:root:teuthology version: 1.2.0 2024-08-19T00:28:01.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-19T00:28:01.323 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/damage} email: ceph-qa@ceph.com first_in_suite: false job_id: '7860074' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - Error loading MDS rank - missing journal object - Error recovering journal - error decoding table object - failed to read JournalPointer - Corrupt directory entry - Corrupt fnode header - corrupt sessionmap header - Corrupt dentry - Scrub error on inode - Metadata damage detected - MDS_READ_ONLY - force file system read-only - with standby daemon mds - MDS abort because newly corrupt dentry sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1664 sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 sleep_before_teardown: 0 subset: 36/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGbFzDy5TnXTACNYbYlvoL0mwDc+X5YJGoH4CPSExO5QHjRP+TqPnv/+sd/Yb6AaXIV5Si6/IrTyMLw0F/Yhxbg= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYPsFxUbN8l7yO9/DG3bMD5/tGhfGX2QGOhzVjbMlwWhebN9MCsq9EpIR+4itKf2pC7yqFiO18KU+qk6h9eRso= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_damage teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-19T00:28:01.323 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa; will attempt to use it 2024-08-19T00:28:01.324 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks 2024-08-19T00:28:01.324 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-19T00:28:01.325 INFO:teuthology.task.internal:Checking packages... 2024-08-19T00:28:01.346 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'de09dd018de4baddfa6ca4d43bc8fb784cf75833' 2024-08-19T00:28:01.346 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:28:01.346 INFO:teuthology.packaging:ref: None 2024-08-19T00:28:01.346 INFO:teuthology.packaging:tag: None 2024-08-19T00:28:01.347 INFO:teuthology.packaging:branch: squid 2024-08-19T00:28:01.347 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:28:01.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-19T00:28:01.544 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1386.g78215f5a 2024-08-19T00:28:01.546 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-19T00:28:01.552 INFO:teuthology.task.internal:no buildpackages task found 2024-08-19T00:28:01.552 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-19T00:28:01.568 INFO:teuthology.task.internal:Saving configuration 2024-08-19T00:28:01.584 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-19T00:28:01.591 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-19T00:28:01.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-19 00:22:43.148469', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGbFzDy5TnXTACNYbYlvoL0mwDc+X5YJGoH4CPSExO5QHjRP+TqPnv/+sd/Yb6AaXIV5Si6/IrTyMLw0F/Yhxbg='} 2024-08-19T00:28:01.639 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-19 00:22:43.149679', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYPsFxUbN8l7yO9/DG3bMD5/tGhfGX2QGOhzVjbMlwWhebN9MCsq9EpIR+4itKf2pC7yqFiO18KU+qk6h9eRso='} 2024-08-19T00:28:01.639 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-19T00:28:01.645 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-19T00:28:01.646 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-19T00:28:01.646 INFO:teuthology.run_tasks:Running task console_log... 2024-08-19T00:28:01.704 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f182e38fbe0>, signals=[15]) 2024-08-19T00:28:01.704 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-19T00:28:01.711 INFO:teuthology.task.internal:Opening connections... 2024-08-19T00:28:01.711 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:28:01.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:28:01.787 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:28:01.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:28:01.864 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-19T00:28:01.870 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-08-19T00:28:01.888 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-08-19T00:28:01.889 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-08-19T00:28:01.946 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-19T00:28:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-19T00:28:01.948 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-19T00:28:01.948 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-08-19T00:28:01.968 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-08-19T00:28:01.987 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-08-19T00:28:01.987 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-08-19T00:28:02.045 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-08-19T00:28:02.045 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-19T00:28:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-19T00:28:02.047 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-08-19T00:28:02.068 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-19T00:28:02.077 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-19T00:28:02.082 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-19T00:28:02.082 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-08-19T00:28:02.088 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-08-19T00:28:02.104 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-19T00:28:02.110 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-19T00:28:02.110 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-08-19T00:28:02.144 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-08-19T00:28:02.167 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-19T00:28:02.224 INFO:teuthology.run_tasks:Running task kernel... 2024-08-19T00:28:02.238 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-19T00:28:02.238 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-19T00:28:02.239 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-19T00:28:02.239 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-19T00:28:02.239 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-19T00:28:02.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:28:02.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:28:02.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-19T00:28:02.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-19T00:28:02.421 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-19T00:28:02.421 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-19T00:28:02.422 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-08-19T00:28:02.425 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-19T00:28:02.425 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-19T00:28:02.425 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-08-19T00:28:02.440 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-480.el9.x86_64 2024-08-19T00:28:02.440 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-19T00:28:02.440 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-19T00:28:02.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum upgrade -y linux-firmware 2024-08-19T00:28:02.442 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-480.el9.x86_64 2024-08-19T00:28:02.443 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-19T00:28:02.443 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-19T00:28:02.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum upgrade -y linux-firmware 2024-08-19T00:28:04.955 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-19T00:28:06.739 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-19T00:28:06.982 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-08-19T00:28:08.967 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-19T00:28:11.415 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.6 MB 00:00 2024-08-19T00:28:13.099 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 18 kB 00:00 2024-08-19T00:28:13.217 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-19T00:28:13.912 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 33 MB/s | 22 MB 00:00 2024-08-19T00:28:14.892 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 18 kB 00:00 2024-08-19T00:28:15.621 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 37 MB/s | 22 MB 00:00 2024-08-19T00:28:19.542 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-19T00:28:21.019 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-08-19T00:28:21.212 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:01 ago on Mon 19 Aug 2024 12:28:20 AM UTC. 2024-08-19T00:28:21.764 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-08-19T00:28:21.766 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2024-08-19T00:28:21.766 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-08-19T00:28:21.865 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-19T00:28:21.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-19T00:28:22.011 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-19T00:28:22.012 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-19T00:28:22.015 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi007.front.sepia.ceph.com to complete... 2024-08-19T00:28:23.020 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-08-19T00:28:23.021 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-08-19T00:28:23.021 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-08-19T00:28:23.139 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-19T00:28:23.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-19T00:28:23.285 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-19T00:28:23.285 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-19T00:28:23.288 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi162.front.sepia.ceph.com to complete... 2024-08-19T00:28:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19 00:28:35 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-19T00:28:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:FINISHED --2024-08-19 00:28:35-- 2024-08-19T00:28:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:Total wall clock time: 13s 2024-08-19T00:28:35.380 INFO:teuthology.orchestra.run.smithi007.stderr:Downloaded: 1 files, 344M in 13s (26.5 MB/s) 2024-08-19T00:28:35.387 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-19T00:28:35.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-19T00:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying... ######################################## 2024-08-19T00:28:37.739 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing... ######################################## 2024-08-19T00:28:37.876 INFO:teuthology.orchestra.run.smithi007.stdout:Updating / installing... 2024-08-19T00:28:43.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19 00:28:43 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-19T00:28:43.134 INFO:teuthology.orchestra.run.smithi162.stderr:FINISHED --2024-08-19 00:28:43-- 2024-08-19T00:28:43.134 INFO:teuthology.orchestra.run.smithi162.stderr:Total wall clock time: 20s 2024-08-19T00:28:43.134 INFO:teuthology.orchestra.run.smithi162.stderr:Downloaded: 1 files, 344M in 19s (17.7 MB/s) 2024-08-19T00:28:43.137 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-19T00:28:43.137 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-19T00:28:45.346 INFO:teuthology.orchestra.run.smithi162.stdout:Verifying... ######################################## 2024-08-19T00:28:45.504 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing... ######################################## 2024-08-19T00:28:45.606 INFO:teuthology.orchestra.run.smithi162.stdout:Updating / installing... 2024-08-19T00:28:46.194 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-19T00:28:53.549 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-19T00:29:26.551 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-19T00:29:26.551 DEBUG:teuthology.orchestra.run.smithi007:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-19T00:29:26.644 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.644 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.644 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-19T00:29:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-19T00:29:26.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-19T00:29:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-19T00:29:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-19T00:29:26.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-19T00:29:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-19T00:29:26.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-19T00:29:26.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-19T00:29:26.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-19T00:29:26.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-19T00:29:26.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-19T00:29:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-19T00:29:26.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-19T00:29:26.658 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-19T00:29:26.659 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-19T00:29:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-19T00:29:26.661 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-19T00:29:26.662 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-19T00:29:26.663 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-19T00:29:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-19T00:29:26.665 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-19T00:29:26.666 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-19T00:29:26.667 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-19T00:29:26.668 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-19T00:29:26.669 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-19T00:29:26.670 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-19T00:29:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-19T00:29:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-19T00:29:26.673 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-19T00:29:26.674 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-19T00:29:26.675 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-19T00:29:26.676 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-19T00:29:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-19T00:29:26.678 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-19T00:29:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-19T00:29:26.680 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-19T00:29:26.681 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-19T00:29:26.682 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-19T00:29:26.683 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-19T00:29:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-19T00:29:26.685 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-19T00:29:26.686 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-19T00:29:26.687 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-19T00:29:26.688 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-19T00:29:26.689 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-19T00:29:26.690 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-19T00:29:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-19T00:29:26.692 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-19T00:29:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-19T00:29:26.694 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-19T00:29:26.695 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-19T00:29:26.696 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-19T00:29:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-19T00:29:26.698 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-19T00:29:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-19T00:29:26.700 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-19T00:29:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-19T00:29:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-19T00:29:26.703 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-19T00:29:26.704 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-19T00:29:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-19T00:29:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-19T00:29:26.707 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-19T00:29:26.708 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-19T00:29:26.709 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-19T00:29:26.710 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-19T00:29:26.711 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-19T00:29:26.712 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-19T00:29:26.713 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-19T00:29:26.714 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-19T00:29:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-19T00:29:26.716 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-19T00:29:26.717 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-19T00:29:26.718 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-19T00:29:26.719 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-19T00:29:26.720 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-19T00:29:26.721 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-19T00:29:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-19T00:29:26.723 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-19T00:29:26.724 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-19T00:29:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-19T00:29:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-19T00:29:26.727 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-19T00:29:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-19T00:29:26.729 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-19T00:29:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-19T00:29:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-19T00:29:26.732 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-19T00:29:26.733 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-19T00:29:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-19T00:29:26.735 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-19T00:29:26.736 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-19T00:29:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-19T00:29:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-19T00:29:26.739 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-19T00:29:26.739 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-19T00:29:26.739 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-19T00:29:26.739 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-19T00:29:26.739 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-19T00:29:26.741 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-19T00:29:26.741 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-19T00:29:26.741 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-19T00:29:26.741 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-19T00:29:26.741 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-19T00:29:26.741 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-19T00:29:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-19T00:29:26.743 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-19T00:29:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-19T00:29:26.745 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-19T00:29:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-19T00:29:26.747 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-19T00:29:26.748 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-19T00:29:26.749 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-19T00:29:26.750 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-19T00:29:26.751 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-19T00:29:26.752 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-19T00:29:26.753 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-19T00:29:26.754 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-19T00:29:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-19T00:29:26.756 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-19T00:29:26.757 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-19T00:29:26.758 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-19T00:29:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-19T00:29:26.760 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-19T00:29:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-19T00:29:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-19T00:29:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-19T00:29:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-19T00:29:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-19T00:29:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-19T00:29:26.767 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-19T00:29:26.768 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-19T00:29:26.769 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-19T00:29:26.770 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-19T00:29:26.771 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-19T00:29:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-19T00:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-19T00:29:26.774 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-19T00:29:26.775 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-19T00:29:26.776 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-19T00:29:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-19T00:29:26.778 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-19T00:29:26.779 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-19T00:29:26.780 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-19T00:29:26.781 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-19T00:29:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-19T00:29:26.783 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-19T00:29:26.784 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-19T00:29:26.785 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-19T00:29:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-19T00:29:26.787 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-19T00:29:26.788 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-19T00:29:26.789 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-19T00:29:26.790 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-19T00:29:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-19T00:29:26.792 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-19T00:29:26.793 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-19T00:29:26.797 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.798 DEBUG:teuthology.orchestra.run.smithi007:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout:postinstall scriptlet (using /bin/sh): 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout:for file in vmlinuz System.map config; do 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: fi 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-19T00:29:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.823 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-08-19T00:29:26.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-08-19T00:29:26.897 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-08-19T00:29:26.897 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-08-19T00:29:26.897 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-08-19T00:29:26.897 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 82.el9 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Sun 18 Aug 2024 08:28:07 PM UTC 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8274670 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-19T00:29:26.898 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:29:26.899 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-08-19T00:29:26.900 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-19T00:29:26.900 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:26.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-19T00:29:27.576 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-08-19T00:29:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-19T00:29:28.986 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-08-19T00:29:28.989 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-08-19T00:29:29.004 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.LJu3yWfzyb 2024-08-19T00:29:29.004 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LJu3yWfzyb 2024-08-19T00:29:29.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.LJu3yWfzyb 2024-08-19T00:29:29.212 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.LJu3yWfzyb is 6KB 2024-08-19T00:29:29.312 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.LJu3yWfzyb 2024-08-19T00:29:29.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-08-19T00:29:29.395 INFO:teuthology.orchestra.run.smithi007.stdout:fde2fbf59b46438eaea4e94a04206310-0-rescue.conf 2024-08-19T00:29:29.395 INFO:teuthology.orchestra.run.smithi007.stdout:fde2fbf59b46438eaea4e94a04206310-5.14.0-239.el9.x86_64.conf 2024-08-19T00:29:29.396 INFO:teuthology.orchestra.run.smithi007.stdout:fde2fbf59b46438eaea4e94a04206310-5.14.0-480.el9.x86_64.conf 2024-08-19T00:29:29.396 INFO:teuthology.orchestra.run.smithi007.stdout:fde2fbf59b46438eaea4e94a04206310-6.11.0-rc3-g7503b862ff5b.conf 2024-08-19T00:29:29.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default fde2fbf59b46438eaea4e94a04206310-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:29.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-08-19T00:29:33.536 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-19T00:29:33.536 DEBUG:teuthology.orchestra.run.smithi162:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-19T00:29:33.642 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-19T00:29:33.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-19T00:29:33.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-19T00:29:33.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-19T00:29:33.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-19T00:29:33.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-19T00:29:33.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-19T00:29:33.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-19T00:29:33.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-19T00:29:33.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-19T00:29:33.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-19T00:29:33.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-19T00:29:33.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-19T00:29:33.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-19T00:29:33.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-19T00:29:33.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-19T00:29:33.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-19T00:29:33.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-19T00:29:33.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-19T00:29:33.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-19T00:29:33.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-19T00:29:33.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-19T00:29:33.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-19T00:29:33.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-19T00:29:33.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-19T00:29:33.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-19T00:29:33.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-19T00:29:33.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-19T00:29:33.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-19T00:29:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-19T00:29:33.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-19T00:29:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-19T00:29:33.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-19T00:29:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-19T00:29:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-19T00:29:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-19T00:29:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-19T00:29:33.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-19T00:29:33.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-19T00:29:33.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-19T00:29:33.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-19T00:29:33.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-19T00:29:33.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-19T00:29:33.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-19T00:29:33.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-19T00:29:33.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-19T00:29:33.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-19T00:29:33.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-19T00:29:33.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-19T00:29:33.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-19T00:29:33.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-19T00:29:33.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-19T00:29:33.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-19T00:29:33.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-19T00:29:33.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-19T00:29:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-19T00:29:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-19T00:29:33.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-19T00:29:33.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-19T00:29:33.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-19T00:29:33.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-19T00:29:33.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-19T00:29:33.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-19T00:29:33.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-19T00:29:33.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-19T00:29:33.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-19T00:29:33.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-19T00:29:33.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-19T00:29:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-19T00:29:33.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-19T00:29:33.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-19T00:29:33.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-19T00:29:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-19T00:29:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-19T00:29:33.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-19T00:29:33.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-19T00:29:33.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-19T00:29:33.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-19T00:29:33.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-19T00:29:33.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-19T00:29:33.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-19T00:29:33.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-19T00:29:33.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-19T00:29:33.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-19T00:29:33.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-19T00:29:33.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-19T00:29:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-19T00:29:33.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-19T00:29:33.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-19T00:29:33.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-19T00:29:33.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-19T00:29:33.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-19T00:29:33.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-19T00:29:33.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-19T00:29:33.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-19T00:29:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-19T00:29:33.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-19T00:29:33.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-19T00:29:33.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-19T00:29:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-19T00:29:33.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-19T00:29:33.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-19T00:29:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-19T00:29:33.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-19T00:29:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-19T00:29:33.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-19T00:29:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-19T00:29:33.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-19T00:29:33.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-19T00:29:33.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-19T00:29:33.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-19T00:29:33.747 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-19T00:29:33.748 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-19T00:29:33.749 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-19T00:29:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-19T00:29:33.751 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-19T00:29:33.752 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-19T00:29:33.753 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-19T00:29:33.754 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-19T00:29:33.755 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-19T00:29:33.756 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-19T00:29:33.757 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-19T00:29:33.758 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-19T00:29:33.759 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-19T00:29:33.760 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-19T00:29:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-19T00:29:33.762 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-19T00:29:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-19T00:29:33.764 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-19T00:29:33.765 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-19T00:29:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-19T00:29:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-19T00:29:33.768 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-19T00:29:33.769 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-19T00:29:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-19T00:29:33.771 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-19T00:29:33.772 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-19T00:29:33.773 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-19T00:29:33.774 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-19T00:29:33.775 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-19T00:29:33.776 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-19T00:29:33.777 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-19T00:29:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-19T00:29:33.779 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-19T00:29:33.780 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-19T00:29:33.781 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-19T00:29:33.782 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-19T00:29:33.783 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-19T00:29:33.784 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-19T00:29:33.785 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-19T00:29:33.786 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-19T00:29:33.787 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-19T00:29:33.788 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-19T00:29:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-19T00:29:33.790 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-19T00:29:33.791 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-19T00:29:33.792 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-19T00:29:33.793 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-19T00:29:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-19T00:29:33.795 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-19T00:29:33.796 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-19T00:29:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-19T00:29:33.798 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-19T00:29:33.799 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-19T00:29:33.799 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-19T00:29:33.799 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-19T00:29:33.799 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-19T00:29:33.799 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-19T00:29:33.799 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-19T00:29:33.799 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-19T00:29:33.802 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.802 DEBUG:teuthology.orchestra.run.smithi162:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-19T00:29:33.825 INFO:teuthology.orchestra.run.smithi162.stdout:postinstall scriptlet (using /bin/sh): 2024-08-19T00:29:33.825 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout:for file in vmlinuz System.map config; do 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout: fi 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout:done 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-19T00:29:33.826 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-19T00:29:33.827 INFO:teuthology.orchestra.run.smithi162.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-19T00:29:33.827 INFO:teuthology.orchestra.run.smithi162.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.827 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-19T00:29:33.827 INFO:teuthology.orchestra.run.smithi162.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-19T00:29:33.827 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-19T00:29:33.827 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.827 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-19T00:29:33.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-08-19T00:29:33.900 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-08-19T00:29:33.900 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-08-19T00:29:33.900 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-08-19T00:29:33.900 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-08-19T00:29:33.900 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Sun 18 Aug 2024 08:28:07 PM UTC 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-08-19T00:29:33.901 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:29:33.902 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-19T00:29:33.902 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-19T00:29:33.902 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-19T00:29:33.902 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-08-19T00:29:33.902 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:29:33.902 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-08-19T00:29:33.903 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-19T00:29:33.903 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:33.903 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-19T00:29:34.514 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-08-19T00:29:35.831 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-19T00:29:35.860 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-08-19T00:29:35.862 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-08-19T00:29:35.881 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.JCjWz8OjAK 2024-08-19T00:29:35.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JCjWz8OjAK 2024-08-19T00:29:35.949 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.JCjWz8OjAK 2024-08-19T00:29:36.091 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.JCjWz8OjAK is 6KB 2024-08-19T00:29:36.139 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.JCjWz8OjAK 2024-08-19T00:29:36.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-08-19T00:29:36.217 INFO:teuthology.orchestra.run.smithi162.stdout:fde2fbf59b46438eaea4e94a04206310-0-rescue.conf 2024-08-19T00:29:36.218 INFO:teuthology.orchestra.run.smithi162.stdout:fde2fbf59b46438eaea4e94a04206310-5.14.0-239.el9.x86_64.conf 2024-08-19T00:29:36.218 INFO:teuthology.orchestra.run.smithi162.stdout:fde2fbf59b46438eaea4e94a04206310-5.14.0-480.el9.x86_64.conf 2024-08-19T00:29:36.218 INFO:teuthology.orchestra.run.smithi162.stdout:fde2fbf59b46438eaea4e94a04206310-6.11.0-rc3-g7503b862ff5b.conf 2024-08-19T00:29:36.219 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fde2fbf59b46438eaea4e94a04206310-6.11.0-rc3-g7503b862ff5b 2024-08-19T00:29:36.361 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-08-19T00:29:59.592 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-19T00:29:59.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-08-19T00:29:59.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:30:06.371 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-19T00:30:06.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-19T00:30:06.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:30:40.867 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-08-19T00:30:49.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-19T00:30:49.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:30:59.604 DEBUG:teuthology.orchestra.remote:timed out 2024-08-19T00:31:08.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-08-19T00:31:08.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:31:09.034 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-08-19T00:31:09.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-08-19T00:31:09.673 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-19T00:31:09.673 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-08-19T00:31:09.708 INFO:teuthology.orchestra.run.smithi007.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-19T00:31:09.709 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:31:09.709 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-19T00:31:09.709 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-19T00:31:10.713 DEBUG:teuthology.parallel:result is None 2024-08-19T00:31:49.928 DEBUG:teuthology.orchestra.remote:timed out 2024-08-19T00:32:01.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-19T00:32:01.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:32:02.227 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-08-19T00:32:02.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-19T00:32:02.749 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-19T00:32:02.750 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-08-19T00:32:02.785 INFO:teuthology.orchestra.run.smithi162.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-19T00:32:02.785 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-19T00:32:02.785 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-19T00:32:02.786 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-19T00:32:03.787 DEBUG:teuthology.parallel:result is None 2024-08-19T00:32:03.788 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-19T00:32:03.794 INFO:teuthology.task.internal:Creating test directory... 2024-08-19T00:32:03.794 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-19T00:32:03.799 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-19T00:32:03.838 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-19T00:32:03.880 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-19T00:32:03.888 INFO:teuthology.task.internal:Creating archive directory... 2024-08-19T00:32:03.888 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-19T00:32:03.892 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-19T00:32:03.953 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-19T00:32:03.959 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-19T00:32:03.960 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-19T00:32:03.964 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-19T00:32:04.086 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:32:04.095 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:32:04.114 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:32:04.123 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:32:04.126 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-19T00:32:04.133 INFO:teuthology.task.internal:Configuring sudo... 2024-08-19T00:32:04.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-19T00:32:04.137 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-19T00:32:04.194 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-19T00:32:04.203 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-19T00:32:04.203 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-19T00:32:04.207 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-19T00:32:04.242 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:32:04.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:32:04.416 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:32:04.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:32:04.549 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:32:04.549 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-19T00:32:04.604 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:32:04.666 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:32:04.758 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:32:04.819 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:32:04.891 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:32:04.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-19T00:32:04.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-08-19T00:32:04.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-08-19T00:32:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:32:05.071 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:32:05.532 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-19T00:32:05.540 INFO:teuthology.task.internal:Starting timer... 2024-08-19T00:32:05.540 INFO:teuthology.run_tasks:Running task pcp... 2024-08-19T00:32:05.558 INFO:teuthology.run_tasks:Running task selinux... 2024-08-19T00:32:05.567 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-08-19T00:32:05.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-08-19T00:32:05.672 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-08-19T00:32:05.676 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-08-19T00:32:05.776 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-08-19T00:32:05.780 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-19T00:32:05.780 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-08-19T00:32:05.820 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-08-19T00:32:05.820 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-08-19T00:32:05.865 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-08-19T00:32:05.865 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-08-19T00:32:05.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:32:05.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:32:05.924 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:32:05.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:32:05.983 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-19T00:32:05.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-08-19T00:32:06.040 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-08-19T00:32:06.098 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-19T00:32:06.108 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-19T00:32:06.119 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-19T00:32:06.120 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-19T00:34:11.723 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-08-19T00:34:11.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-08-19T00:34:11.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:34:11.813 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-08-19T00:34:11.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-08-19T00:34:11.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-19T00:34:11.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:34:12.016 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-08-19T00:34:12.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-19T00:34:12.128 INFO:teuthology.run_tasks:Running task clock... 2024-08-19T00:34:12.139 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-19T00:34:12.139 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T00:34:12.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:34:12.144 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T00:34:12.144 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:34:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T00:34:12.230 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T00:34:12.232 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T00:34:12.259 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T00:34:12.283 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-08-19T00:34:12.307 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-08-19T00:34:12.310 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-08-19T00:34:12.333 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-08-19T00:34:12.337 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T00:34:12.362 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T00:34:12.367 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T00:34:12.391 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T00:34:12.461 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:34:12.468 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:34:12.468 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-08-19T00:34:12.468 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.468 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.468 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.468 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.492 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:34:12.499 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:34:12.499 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-08-19T00:34:12.499 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.499 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.499 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.499 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:34:12.500 INFO:teuthology.run_tasks:Running task install... 2024-08-19T00:34:12.507 DEBUG:teuthology.task.install:project ceph 2024-08-19T00:34:12.508 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}} 2024-08-19T00:34:12.508 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-19T00:34:12.508 INFO:teuthology.task.install:Using flavor: default 2024-08-19T00:34:12.513 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-19T00:34:12.513 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-19T00:34:12.514 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-19T00:34:12.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:34:12.516 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-19T00:34:12.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:34:12.655 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-19T00:34:12.655 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-19T00:34:12.664 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-19T00:34:12.664 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-19T00:34:12.766 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T00:34:12.766 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:34:12.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T00:34:12.775 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T00:34:12.776 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:34:12.776 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T00:34:12.824 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-19T00:34:12.824 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T00:34:12.833 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-19T00:34:12.833 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T00:34:12.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T00:34:12.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T00:34:13.001 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T00:34:13.010 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T00:34:13.056 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-08-19T00:34:13.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-08-19T00:34:13.065 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-08-19T00:34:13.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-08-19T00:34:13.333 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-08-19T00:34:13.352 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-08-19T00:34:13.365 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-19T00:34:13.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-19T00:34:14.056 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 282 kB/s | 84 kB 00:00 2024-08-19T00:34:14.072 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-08-19T00:34:14.349 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-08-19T00:34:14.355 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-08-19T00:34:14.624 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-19T00:34:15.823 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 1.3 kB/s | 1.9 kB 00:01 2024-08-19T00:34:17.531 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-08-19T00:34:17.688 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-08-19T00:34:19.390 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-08-19T00:34:19.659 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-08-19T00:34:23.983 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.6 MB 00:00 2024-08-19T00:34:24.176 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-19T00:34:25.567 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 18 kB 00:00 2024-08-19T00:34:25.726 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 18 kB 00:00 2024-08-19T00:34:26.429 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-19T00:34:26.580 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-19T00:34:32.878 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-19T00:34:32.952 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-08-19T00:34:35.373 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:34:35.373 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:34:35.385 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-19T00:34:35.386 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-19T00:34:35.387 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-19T00:34:35.387 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-19T00:34:35.389 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-19T00:34:35.392 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-19T00:34:35.393 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-19T00:34:35.397 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:34:35.398 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:34:35.410 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-19T00:34:35.411 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-19T00:34:35.412 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-19T00:34:35.412 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-19T00:34:35.414 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-19T00:34:35.416 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-19T00:34:35.418 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-19T00:34:35.455 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-08-19T00:34:35.470 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-08-19T00:34:35.470 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-19T00:34:35.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-19T00:34:35.472 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-19T00:34:35.473 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-19T00:34:35.474 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T00:34:35.475 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:34:35.476 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-19T00:34:35.477 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T00:34:35.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T00:34:35.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T00:34:35.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T00:34:35.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T00:34:35.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-19T00:34:35.483 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 2 Packages 2024-08-19T00:34:35.484 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:34:35.485 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-08-19T00:34:35.485 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 218 M 2024-08-19T00:34:35.485 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-08-19T00:34:35.505 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-08-19T00:34:35.505 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-08-19T00:34:35.505 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-19T00:34:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-19T00:34:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-19T00:34:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-19T00:34:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T00:34:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-19T00:34:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-19T00:34:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-19T00:34:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T00:34:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T00:34:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-19T00:34:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:34:35.517 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-08-19T00:34:35.518 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-08-19T00:34:35.518 INFO:teuthology.orchestra.run.smithi007.stdout:Install 148 Packages 2024-08-19T00:34:35.518 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 2 Packages 2024-08-19T00:34:35.518 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:34:35.518 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 218 M 2024-08-19T00:34:35.518 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-08-19T00:34:36.004 INFO:teuthology.orchestra.run.smithi162.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-08-19T00:34:36.070 INFO:teuthology.orchestra.run.smithi007.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-08-19T00:34:36.187 INFO:teuthology.orchestra.run.smithi162.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 4.8 MB/s | 896 kB 00:00 2024-08-19T00:34:36.254 INFO:teuthology.orchestra.run.smithi162.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 2.1 MB/s | 145 kB 00:00 2024-08-19T00:34:36.436 INFO:teuthology.orchestra.run.smithi007.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 2.4 MB/s | 896 kB 00:00 2024-08-19T00:34:36.488 INFO:teuthology.orchestra.run.smithi162.stdout:(4/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 8.6 MB/s | 5.4 MB 00:00 2024-08-19T00:34:36.512 INFO:teuthology.orchestra.run.smithi007.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 1.9 MB/s | 145 kB 00:00 2024-08-19T00:34:36.555 INFO:teuthology.orchestra.run.smithi162.stdout:(5/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 7.9 MB/s | 2.4 MB 00:00 2024-08-19T00:34:36.630 INFO:teuthology.orchestra.run.smithi162.stdout:(6/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 11 MB/s | 1.5 MB 00:00 2024-08-19T00:34:37.253 INFO:teuthology.orchestra.run.smithi007.stdout:(4/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 4.1 MB/s | 5.4 MB 00:01 2024-08-19T00:34:37.328 INFO:teuthology.orchestra.run.smithi007.stdout:(5/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 2.9 MB/s | 2.4 MB 00:00 2024-08-19T00:34:37.446 INFO:teuthology.orchestra.run.smithi007.stdout:(6/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 7.9 MB/s | 1.5 MB 00:00 2024-08-19T00:34:37.472 INFO:teuthology.orchestra.run.smithi162.stdout:(7/150): ceph-common-19.1.0-1382.gde09dd01.el9. 13 MB/s | 21 MB 00:01 2024-08-19T00:34:37.556 INFO:teuthology.orchestra.run.smithi162.stdout:(8/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 4.7 MB/s | 4.7 MB 00:01 2024-08-19T00:34:37.615 INFO:teuthology.orchestra.run.smithi162.stdout:(9/150): ceph-selinux-19.1.0-1382.gde09dd01.el9 433 kB/s | 25 kB 00:00 2024-08-19T00:34:37.915 INFO:teuthology.orchestra.run.smithi162.stdout:(10/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x8 13 MB/s | 17 MB 00:01 2024-08-19T00:34:37.954 INFO:teuthology.orchestra.run.smithi007.stdout:(7/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 7.5 MB/s | 4.7 MB 00:00 2024-08-19T00:34:37.982 INFO:teuthology.orchestra.run.smithi162.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 3.3 MB/s | 225 kB 00:00 2024-08-19T00:34:38.065 INFO:teuthology.orchestra.run.smithi162.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 326 kB/s | 27 kB 00:00 2024-08-19T00:34:38.240 INFO:teuthology.orchestra.run.smithi162.stdout:(13/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 14 MB/s | 11 MB 00:00 2024-08-19T00:34:38.265 INFO:teuthology.orchestra.run.smithi162.stdout:(14/150): libcephfs-devel-19.1.0-1382.gde09dd01 158 kB/s | 32 kB 00:00 2024-08-19T00:34:38.357 INFO:teuthology.orchestra.run.smithi162.stdout:(15/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 6.3 MB/s | 753 kB 00:00 2024-08-19T00:34:38.458 INFO:teuthology.orchestra.run.smithi162.stdout:(16/150): librados-devel-19.1.0-1382.gde09dd01. 1.2 MB/s | 127 kB 00:00 2024-08-19T00:34:38.583 INFO:teuthology.orchestra.run.smithi162.stdout:(17/150): libradosstriper1-19.1.0-1382.gde09dd0 4.0 MB/s | 507 kB 00:00 2024-08-19T00:34:38.738 INFO:teuthology.orchestra.run.smithi007.stdout:(8/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x86 13 MB/s | 17 MB 00:01 2024-08-19T00:34:38.813 INFO:teuthology.orchestra.run.smithi007.stdout:(9/150): ceph-selinux-19.1.0-1382.gde09dd01.el9 337 kB/s | 25 kB 00:00 2024-08-19T00:34:38.875 INFO:teuthology.orchestra.run.smithi162.stdout:(18/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 18 MB/s | 5.4 MB 00:00 2024-08-19T00:34:38.900 INFO:teuthology.orchestra.run.smithi162.stdout:(19/150): libcephsqlite-19.1.0-1382.gde09dd01.e 257 kB/s | 163 kB 00:00 2024-08-19T00:34:38.926 INFO:teuthology.orchestra.run.smithi162.stdout:(20/150): python3-ceph-argparse-19.1.0-1382.gde 902 kB/s | 45 kB 00:00 2024-08-19T00:34:38.968 INFO:teuthology.orchestra.run.smithi162.stdout:(21/150): python3-ceph-common-19.1.0-1382.gde09 2.0 MB/s | 136 kB 00:00 2024-08-19T00:34:38.972 INFO:teuthology.orchestra.run.smithi007.stdout:(10/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 10 MB/s | 11 MB 00:01 2024-08-19T00:34:38.993 INFO:teuthology.orchestra.run.smithi162.stdout:(22/150): python3-cephfs-19.1.0-1382.gde09dd01. 2.8 MB/s | 188 kB 00:00 2024-08-19T00:34:39.034 INFO:teuthology.orchestra.run.smithi162.stdout:(23/150): python3-rados-19.1.0-1382.gde09dd01.e 5.4 MB/s | 369 kB 00:00 2024-08-19T00:34:39.039 INFO:teuthology.orchestra.run.smithi007.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 3.3 MB/s | 225 kB 00:00 2024-08-19T00:34:39.068 INFO:teuthology.orchestra.run.smithi162.stdout:(24/150): python3-rbd-19.1.0-1382.gde09dd01.el9 4.5 MB/s | 350 kB 00:00 2024-08-19T00:34:39.094 INFO:teuthology.orchestra.run.smithi162.stdout:(25/150): python3-rgw-19.1.0-1382.gde09dd01.el9 1.9 MB/s | 117 kB 00:00 2024-08-19T00:34:39.097 INFO:teuthology.orchestra.run.smithi007.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 464 kB/s | 27 kB 00:00 2024-08-19T00:34:39.128 INFO:teuthology.orchestra.run.smithi162.stdout:(26/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-19T00:34:39.164 INFO:teuthology.orchestra.run.smithi007.stdout:(13/150): libcephfs-devel-19.1.0-1382.gde09dd01 478 kB/s | 32 kB 00:00 2024-08-19T00:34:39.194 INFO:teuthology.orchestra.run.smithi162.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 2.5 MB/s | 170 kB 00:00 2024-08-19T00:34:39.256 INFO:teuthology.orchestra.run.smithi007.stdout:(14/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 8.0 MB/s | 753 kB 00:00 2024-08-19T00:34:39.278 INFO:teuthology.orchestra.run.smithi162.stdout:(28/150): ceph-grafana-dashboards-19.1.0-1382.g 383 kB/s | 32 kB 00:00 2024-08-19T00:34:39.315 INFO:teuthology.orchestra.run.smithi007.stdout:(15/150): libcephsqlite-19.1.0-1382.gde09dd01.e 2.8 MB/s | 163 kB 00:00 2024-08-19T00:34:39.336 INFO:teuthology.orchestra.run.smithi162.stdout:(29/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 2.5 MB/s | 146 kB 00:00 2024-08-19T00:34:39.418 INFO:teuthology.orchestra.run.smithi162.stdout:(30/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 9.6 MB/s | 3.1 MB 00:00 2024-08-19T00:34:39.532 INFO:teuthology.orchestra.run.smithi007.stdout:(16/150): ceph-common-19.1.0-1382.gde09dd01.el9 5.9 MB/s | 21 MB 00:03 2024-08-19T00:34:39.557 INFO:teuthology.orchestra.run.smithi007.stdout:(17/150): librados-devel-19.1.0-1382.gde09dd01. 524 kB/s | 127 kB 00:00 2024-08-19T00:34:39.587 INFO:teuthology.orchestra.run.smithi162.stdout:(31/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 14 MB/s | 3.6 MB 00:00 2024-08-19T00:34:39.649 INFO:teuthology.orchestra.run.smithi007.stdout:(18/150): libradosstriper1-19.1.0-1382.gde09dd0 4.2 MB/s | 507 kB 00:00 2024-08-19T00:34:39.687 INFO:teuthology.orchestra.run.smithi162.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 2.4 MB/s | 249 kB 00:00 2024-08-19T00:34:39.732 INFO:teuthology.orchestra.run.smithi007.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 543 kB/s | 45 kB 00:00 2024-08-19T00:34:39.788 INFO:teuthology.orchestra.run.smithi162.stdout:(33/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 492 kB/s | 49 kB 00:00 2024-08-19T00:34:39.849 INFO:teuthology.orchestra.run.smithi007.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 1.1 MB/s | 136 kB 00:00 2024-08-19T00:34:39.872 INFO:teuthology.orchestra.run.smithi162.stdout:(34/150): ceph-prometheus-alerts-19.1.0-1382.gd 198 kB/s | 16 kB 00:00 2024-08-19T00:34:39.930 INFO:teuthology.orchestra.run.smithi162.stdout:(35/150): ceph-volume-19.1.0-1382.gde09dd01.el9 4.8 MB/s | 285 kB 00:00 2024-08-19T00:34:39.933 INFO:teuthology.orchestra.run.smithi007.stdout:(21/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 14 MB/s | 5.4 MB 00:00 2024-08-19T00:34:39.958 INFO:teuthology.orchestra.run.smithi007.stdout:(22/150): python3-cephfs-19.1.0-1382.gde09dd01. 1.7 MB/s | 188 kB 00:00 2024-08-19T00:34:40.006 INFO:teuthology.orchestra.run.smithi162.stdout:(36/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 10 MB/s | 766 kB 00:00 2024-08-19T00:34:40.025 INFO:teuthology.orchestra.run.smithi007.stdout:(23/150): python3-rados-19.1.0-1382.gde09dd01.e 3.9 MB/s | 369 kB 00:00 2024-08-19T00:34:40.075 INFO:teuthology.orchestra.run.smithi007.stdout:(24/150): python3-rbd-19.1.0-1382.gde09dd01.el9 2.9 MB/s | 350 kB 00:00 2024-08-19T00:34:40.097 INFO:teuthology.orchestra.run.smithi162.stdout:(37/150): ceph-mgr-diskprediction-local-19.1.0- 11 MB/s | 7.4 MB 00:00 2024-08-19T00:34:40.101 INFO:teuthology.orchestra.run.smithi007.stdout:(25/150): python3-rgw-19.1.0-1382.gde09dd01.el9 1.5 MB/s | 117 kB 00:00 2024-08-19T00:34:40.114 INFO:teuthology.orchestra.run.smithi162.stdout:(38/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 168 kB/s | 18 kB 00:00 2024-08-19T00:34:40.134 INFO:teuthology.orchestra.run.smithi007.stdout:(26/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-19T00:34:40.218 INFO:teuthology.orchestra.run.smithi007.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 2.0 MB/s | 170 kB 00:00 2024-08-19T00:34:40.265 INFO:teuthology.orchestra.run.smithi162.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-08-19T00:34:40.301 INFO:teuthology.orchestra.run.smithi007.stdout:(28/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 15 MB/s | 3.1 MB 00:00 2024-08-19T00:34:40.327 INFO:teuthology.orchestra.run.smithi007.stdout:(29/150): ceph-grafana-dashboards-19.1.0-1382.g 293 kB/s | 32 kB 00:00 2024-08-19T00:34:40.352 INFO:teuthology.orchestra.run.smithi007.stdout:(30/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 2.8 MB/s | 146 kB 00:00 2024-08-19T00:34:40.357 INFO:teuthology.orchestra.run.smithi162.stdout:(40/150): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-08-19T00:34:40.432 INFO:teuthology.orchestra.run.smithi162.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-08-19T00:34:40.524 INFO:teuthology.orchestra.run.smithi162.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-08-19T00:34:40.674 INFO:teuthology.orchestra.run.smithi162.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-08-19T00:34:40.699 INFO:teuthology.orchestra.run.smithi162.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 608 kB/s | 106 kB 00:00 2024-08-19T00:34:40.744 INFO:teuthology.orchestra.run.smithi007.stdout:(31/150): ceph-mgr-diskprediction-local-19.1.0- 19 MB/s | 7.4 MB 00:00 2024-08-19T00:34:40.811 INFO:teuthology.orchestra.run.smithi007.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 3.7 MB/s | 249 kB 00:00 2024-08-19T00:34:40.825 INFO:teuthology.orchestra.run.smithi162.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 901 kB/s | 135 kB 00:00 2024-08-19T00:34:40.850 INFO:teuthology.orchestra.run.smithi162.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 831 kB/s | 125 kB 00:00 2024-08-19T00:34:40.861 INFO:teuthology.orchestra.run.smithi007.stdout:(33/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 992 kB/s | 49 kB 00:00 2024-08-19T00:34:40.970 INFO:teuthology.orchestra.run.smithi007.stdout:(34/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 5.5 MB/s | 3.6 MB 00:00 2024-08-19T00:34:40.995 INFO:teuthology.orchestra.run.smithi007.stdout:(35/150): ceph-prometheus-alerts-19.1.0-1382.gd 123 kB/s | 16 kB 00:00 2024-08-19T00:34:41.000 INFO:teuthology.orchestra.run.smithi162.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.2 MB/s | 215 kB 00:00 2024-08-19T00:34:41.037 INFO:teuthology.orchestra.run.smithi007.stdout:(36/150): ceph-volume-19.1.0-1382.gde09dd01.el9 4.2 MB/s | 285 kB 00:00 2024-08-19T00:34:41.079 INFO:teuthology.orchestra.run.smithi007.stdout:(37/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 8.9 MB/s | 766 kB 00:00 2024-08-19T00:34:41.104 INFO:teuthology.orchestra.run.smithi007.stdout:(38/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 273 kB/s | 18 kB 00:00 2024-08-19T00:34:41.159 INFO:teuthology.orchestra.run.smithi162.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-08-19T00:34:41.218 INFO:teuthology.orchestra.run.smithi162.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-08-19T00:34:41.588 INFO:teuthology.orchestra.run.smithi007.stdout:(39/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 18 MB/s | 49 MB 00:02 2024-08-19T00:34:41.613 INFO:teuthology.orchestra.run.smithi007.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 149 kB/s | 80 kB 00:00 2024-08-19T00:34:41.685 INFO:teuthology.orchestra.run.smithi162.stdout:(50/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 12 MB/s | 49 MB 00:04 2024-08-19T00:34:41.697 INFO:teuthology.orchestra.run.smithi007.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-08-19T00:34:41.710 INFO:teuthology.orchestra.run.smithi162.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 44 kB/s | 22 kB 00:00 2024-08-19T00:34:41.722 INFO:teuthology.orchestra.run.smithi007.stdout:(42/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-08-19T00:34:41.744 INFO:teuthology.orchestra.run.smithi162.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-08-19T00:34:41.747 INFO:teuthology.orchestra.run.smithi007.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-08-19T00:34:41.769 INFO:teuthology.orchestra.run.smithi162.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-08-19T00:34:41.773 INFO:teuthology.orchestra.run.smithi007.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-19T00:34:41.798 INFO:teuthology.orchestra.run.smithi007.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-19T00:34:41.819 INFO:teuthology.orchestra.run.smithi162.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-19T00:34:41.823 INFO:teuthology.orchestra.run.smithi007.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-19T00:34:41.848 INFO:teuthology.orchestra.run.smithi007.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-19T00:34:41.869 INFO:teuthology.orchestra.run.smithi162.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-08-19T00:34:41.882 INFO:teuthology.orchestra.run.smithi007.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-08-19T00:34:41.945 INFO:teuthology.orchestra.run.smithi162.stdout:(56/150): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-08-19T00:34:41.970 INFO:teuthology.orchestra.run.smithi162.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-08-19T00:34:41.995 INFO:teuthology.orchestra.run.smithi162.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-08-19T00:34:42.008 INFO:teuthology.orchestra.run.smithi007.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 851 kB/s | 107 kB 00:00 2024-08-19T00:34:42.041 INFO:teuthology.orchestra.run.smithi007.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-08-19T00:34:42.066 INFO:teuthology.orchestra.run.smithi007.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 377 kB/s | 22 kB 00:00 2024-08-19T00:34:42.070 INFO:teuthology.orchestra.run.smithi162.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-08-19T00:34:42.100 INFO:teuthology.orchestra.run.smithi007.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-08-19T00:34:42.121 INFO:teuthology.orchestra.run.smithi162.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-08-19T00:34:42.125 INFO:teuthology.orchestra.run.smithi007.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-08-19T00:34:42.146 INFO:teuthology.orchestra.run.smithi162.stdout:(61/150): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-08-19T00:34:42.150 INFO:teuthology.orchestra.run.smithi007.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-08-19T00:34:42.171 INFO:teuthology.orchestra.run.smithi162.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-08-19T00:34:42.175 INFO:teuthology.orchestra.run.smithi007.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-08-19T00:34:42.201 INFO:teuthology.orchestra.run.smithi007.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-19T00:34:42.205 INFO:teuthology.orchestra.run.smithi162.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-19T00:34:42.239 INFO:teuthology.orchestra.run.smithi162.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-08-19T00:34:42.243 INFO:teuthology.orchestra.run.smithi007.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-19T00:34:42.264 INFO:teuthology.orchestra.run.smithi162.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-08-19T00:34:42.268 INFO:teuthology.orchestra.run.smithi007.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-08-19T00:34:42.377 INFO:teuthology.orchestra.run.smithi007.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-08-19T00:34:42.419 INFO:teuthology.orchestra.run.smithi007.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 616 kB/s | 25 kB 00:00 2024-08-19T00:34:42.444 INFO:teuthology.orchestra.run.smithi007.stdout:(61/150): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-08-19T00:34:42.469 INFO:teuthology.orchestra.run.smithi007.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-08-19T00:34:42.544 INFO:teuthology.orchestra.run.smithi007.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-08-19T00:34:42.570 INFO:teuthology.orchestra.run.smithi007.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-08-19T00:34:42.595 INFO:teuthology.orchestra.run.smithi007.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-08-19T00:34:42.798 INFO:teuthology.orchestra.run.smithi162.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-08-19T00:34:42.853 INFO:teuthology.orchestra.run.smithi007.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-08-19T00:34:42.954 INFO:teuthology.orchestra.run.smithi007.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-08-19T00:34:43.021 INFO:teuthology.orchestra.run.smithi007.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 13 MB/s | 911 kB 00:00 2024-08-19T00:34:43.071 INFO:teuthology.orchestra.run.smithi007.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 2.6 MB/s | 133 kB 00:00 2024-08-19T00:34:43.221 INFO:teuthology.orchestra.run.smithi007.stdout:(70/150): postgresql-server-13.14-1.el9.x86_64. 39 MB/s | 5.8 MB 00:00 2024-08-19T00:34:43.223 INFO:teuthology.orchestra.run.smithi162.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-08-19T00:34:43.280 INFO:teuthology.orchestra.run.smithi007.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-08-19T00:34:43.322 INFO:teuthology.orchestra.run.smithi007.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-08-19T00:34:43.472 INFO:teuthology.orchestra.run.smithi007.stdout:(73/150): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-08-19T00:34:43.514 INFO:teuthology.orchestra.run.smithi007.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-19T00:34:43.556 INFO:teuthology.orchestra.run.smithi007.stdout:(75/150): python3-devel-3.9.19-4.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-08-19T00:34:43.598 INFO:teuthology.orchestra.run.smithi007.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 5.9 MB/s | 248 kB 00:00 2024-08-19T00:34:43.640 INFO:teuthology.orchestra.run.smithi007.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-08-19T00:34:43.682 INFO:teuthology.orchestra.run.smithi007.stdout:(78/150): postgresql-13.14-1.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2024-08-19T00:34:43.706 INFO:teuthology.orchestra.run.smithi162.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 1.8 MB/s | 911 kB 00:00 2024-08-19T00:34:43.707 INFO:teuthology.orchestra.run.smithi007.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-08-19T00:34:43.732 INFO:teuthology.orchestra.run.smithi007.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-19T00:34:43.757 INFO:teuthology.orchestra.run.smithi007.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-08-19T00:34:43.824 INFO:teuthology.orchestra.run.smithi007.stdout:(82/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-08-19T00:34:43.840 INFO:teuthology.orchestra.run.smithi162.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-08-19T00:34:43.858 INFO:teuthology.orchestra.run.smithi007.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-08-19T00:34:43.950 INFO:teuthology.orchestra.run.smithi007.stdout:(84/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-08-19T00:34:43.975 INFO:teuthology.orchestra.run.smithi007.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 660 kB/s | 77 kB 00:00 2024-08-19T00:34:44.001 INFO:teuthology.orchestra.run.smithi007.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-08-19T00:34:44.026 INFO:teuthology.orchestra.run.smithi007.stdout:(87/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-08-19T00:34:44.051 INFO:teuthology.orchestra.run.smithi007.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-08-19T00:34:44.076 INFO:teuthology.orchestra.run.smithi007.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-08-19T00:34:44.102 INFO:teuthology.orchestra.run.smithi007.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-19T00:34:44.127 INFO:teuthology.orchestra.run.smithi007.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-19T00:34:44.194 INFO:teuthology.orchestra.run.smithi007.stdout:(92/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-08-19T00:34:44.219 INFO:teuthology.orchestra.run.smithi007.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-08-19T00:34:44.244 INFO:teuthology.orchestra.run.smithi007.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-08-19T00:34:44.290 INFO:teuthology.orchestra.run.smithi162.stdout:(70/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:02 2024-08-19T00:34:44.294 INFO:teuthology.orchestra.run.smithi007.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 724 kB/s | 36 kB 00:00 2024-08-19T00:34:44.320 INFO:teuthology.orchestra.run.smithi007.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-08-19T00:34:44.345 INFO:teuthology.orchestra.run.smithi007.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 939 kB/s | 47 kB 00:00 2024-08-19T00:34:44.387 INFO:teuthology.orchestra.run.smithi007.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-08-19T00:34:44.437 INFO:teuthology.orchestra.run.smithi007.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-08-19T00:34:44.440 INFO:teuthology.orchestra.run.smithi162.stdout:(71/150): openblas-openmp-0.3.21-2.el9.x86_64.r 2.2 MB/s | 4.7 MB 00:02 2024-08-19T00:34:44.456 INFO:teuthology.orchestra.run.smithi007.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-08-19T00:34:44.524 INFO:teuthology.orchestra.run.smithi162.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-08-19T00:34:44.640 INFO:teuthology.orchestra.run.smithi007.stdout:(101/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-08-19T00:34:44.657 INFO:teuthology.orchestra.run.smithi007.stdout:(102/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 290 kB/s | 64 kB 00:00 2024-08-19T00:34:44.674 INFO:teuthology.orchestra.run.smithi007.stdout:(103/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 206 kB/s | 45 kB 00:00 2024-08-19T00:34:44.699 INFO:teuthology.orchestra.run.smithi007.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-08-19T00:34:44.741 INFO:teuthology.orchestra.run.smithi007.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-08-19T00:34:44.758 INFO:teuthology.orchestra.run.smithi007.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-08-19T00:34:44.800 INFO:teuthology.orchestra.run.smithi007.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.1 MB/s | 309 kB 00:00 2024-08-19T00:34:44.834 INFO:teuthology.orchestra.run.smithi007.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-08-19T00:34:44.867 INFO:teuthology.orchestra.run.smithi007.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-08-19T00:34:44.875 INFO:teuthology.orchestra.run.smithi162.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-08-19T00:34:44.909 INFO:teuthology.orchestra.run.smithi007.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-08-19T00:34:44.933 INFO:teuthology.orchestra.run.smithi162.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-08-19T00:34:44.943 INFO:teuthology.orchestra.run.smithi007.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-08-19T00:34:44.968 INFO:teuthology.orchestra.run.smithi007.stdout:(112/150): liboath-2.6.7-2.el9.x86_64.rpm 362 kB/s | 49 kB 00:00 2024-08-19T00:34:45.010 INFO:teuthology.orchestra.run.smithi007.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-08-19T00:34:45.035 INFO:teuthology.orchestra.run.smithi007.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-19T00:34:45.061 INFO:teuthology.orchestra.run.smithi007.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-19T00:34:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:(75/150): python3-devel-3.9.19-4.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-08-19T00:34:45.086 INFO:teuthology.orchestra.run.smithi007.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-08-19T00:34:45.128 INFO:teuthology.orchestra.run.smithi007.stdout:(117/150): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-08-19T00:34:45.153 INFO:teuthology.orchestra.run.smithi007.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-08-19T00:34:45.187 INFO:teuthology.orchestra.run.smithi007.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-08-19T00:34:45.212 INFO:teuthology.orchestra.run.smithi007.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-08-19T00:34:45.234 INFO:teuthology.orchestra.run.smithi162.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-08-19T00:34:45.276 INFO:teuthology.orchestra.run.smithi007.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 2.4 MB/s | 220 kB 00:00 2024-08-19T00:34:45.309 INFO:teuthology.orchestra.run.smithi162.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 342 kB/s | 26 kB 00:00 2024-08-19T00:34:45.359 INFO:teuthology.orchestra.run.smithi162.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-08-19T00:34:45.374 INFO:teuthology.orchestra.run.smithi007.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-08-19T00:34:45.405 INFO:teuthology.orchestra.run.smithi007.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 349 kB/s | 11 kB 00:00 2024-08-19T00:34:45.430 INFO:teuthology.orchestra.run.smithi007.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-08-19T00:34:45.455 INFO:teuthology.orchestra.run.smithi007.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-08-19T00:34:45.476 INFO:teuthology.orchestra.run.smithi162.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-08-19T00:34:45.480 INFO:teuthology.orchestra.run.smithi007.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-08-19T00:34:45.506 INFO:teuthology.orchestra.run.smithi007.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-08-19T00:34:45.527 INFO:teuthology.orchestra.run.smithi162.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-08-19T00:34:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:(128/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-08-19T00:34:45.607 INFO:teuthology.orchestra.run.smithi007.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-19T00:34:45.623 INFO:teuthology.orchestra.run.smithi007.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-08-19T00:34:45.657 INFO:teuthology.orchestra.run.smithi007.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-08-19T00:34:45.699 INFO:teuthology.orchestra.run.smithi007.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-08-19T00:34:45.725 INFO:teuthology.orchestra.run.smithi007.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-08-19T00:34:45.750 INFO:teuthology.orchestra.run.smithi007.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-08-19T00:34:45.775 INFO:teuthology.orchestra.run.smithi007.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-19T00:34:45.802 INFO:teuthology.orchestra.run.smithi007.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-19T00:34:45.817 INFO:teuthology.orchestra.run.smithi007.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2024-08-19T00:34:45.834 INFO:teuthology.orchestra.run.smithi007.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-08-19T00:34:45.851 INFO:teuthology.orchestra.run.smithi007.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-08-19T00:34:45.893 INFO:teuthology.orchestra.run.smithi007.stdout:(140/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-08-19T00:34:45.918 INFO:teuthology.orchestra.run.smithi007.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-08-19T00:34:45.994 INFO:teuthology.orchestra.run.smithi007.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 524 kB/s | 74 kB 00:00 2024-08-19T00:34:46.019 INFO:teuthology.orchestra.run.smithi007.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 897 kB/s | 90 kB 00:00 2024-08-19T00:34:46.044 INFO:teuthology.orchestra.run.smithi007.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-08-19T00:34:46.069 INFO:teuthology.orchestra.run.smithi007.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-08-19T00:34:46.103 INFO:teuthology.orchestra.run.smithi007.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 5.6 MB/s | 192 kB 00:00 2024-08-19T00:34:46.128 INFO:teuthology.orchestra.run.smithi007.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-19T00:34:46.179 INFO:teuthology.orchestra.run.smithi007.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-19T00:34:46.379 INFO:teuthology.orchestra.run.smithi007.stdout:(149/150): librados2-19.1.0-1382.gde09dd01.el9. 12 MB/s | 3.4 MB 00:00 2024-08-19T00:34:46.437 INFO:teuthology.orchestra.run.smithi007.stdout:(150/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 10 MB/s | 3.2 MB 00:00 2024-08-19T00:34:46.443 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:34:46.443 INFO:teuthology.orchestra.run.smithi007.stdout:Total 20 MB/s | 218 MB 00:10 2024-08-19T00:34:46.835 INFO:teuthology.orchestra.run.smithi162.stdout:(81/150): postgresql-server-13.14-1.el9.x86_64. 1.9 MB/s | 5.8 MB 00:02 2024-08-19T00:34:46.985 INFO:teuthology.orchestra.run.smithi162.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-08-19T00:34:47.127 INFO:teuthology.orchestra.run.smithi162.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-08-19T00:34:47.211 INFO:teuthology.orchestra.run.smithi162.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 927 kB/s | 77 kB 00:00 2024-08-19T00:34:47.261 INFO:teuthology.orchestra.run.smithi162.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 848 kB/s | 42 kB 00:00 2024-08-19T00:34:47.429 INFO:teuthology.orchestra.run.smithi162.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-08-19T00:34:47.562 INFO:teuthology.orchestra.run.smithi162.stdout:(87/150): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:03 2024-08-19T00:34:47.587 INFO:teuthology.orchestra.run.smithi162.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-08-19T00:34:47.638 INFO:teuthology.orchestra.run.smithi162.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-19T00:34:47.688 INFO:teuthology.orchestra.run.smithi162.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-19T00:34:47.746 INFO:teuthology.orchestra.run.smithi162.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-08-19T00:34:47.813 INFO:teuthology.orchestra.run.smithi162.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-08-19T00:34:47.864 INFO:teuthology.orchestra.run.smithi162.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-08-19T00:34:48.006 INFO:teuthology.orchestra.run.smithi162.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-08-19T00:34:48.056 INFO:teuthology.orchestra.run.smithi162.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 722 kB/s | 36 kB 00:00 2024-08-19T00:34:48.106 INFO:teuthology.orchestra.run.smithi162.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-08-19T00:34:48.173 INFO:teuthology.orchestra.run.smithi162.stdout:(97/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-08-19T00:34:48.223 INFO:teuthology.orchestra.run.smithi162.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-19T00:34:48.307 INFO:teuthology.orchestra.run.smithi162.stdout:(99/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-08-19T00:34:48.332 INFO:teuthology.orchestra.run.smithi162.stdout:(100/150): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-08-19T00:34:48.336 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-08-19T00:34:48.374 INFO:teuthology.orchestra.run.smithi162.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-19T00:34:48.391 INFO:teuthology.orchestra.run.smithi162.stdout:(102/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 760 kB/s | 64 kB 00:00 2024-08-19T00:34:48.416 INFO:teuthology.orchestra.run.smithi162.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 530 kB/s | 22 kB 00:00 2024-08-19T00:34:48.483 INFO:teuthology.orchestra.run.smithi162.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-08-19T00:34:48.514 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-08-19T00:34:48.514 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-08-19T00:34:48.517 INFO:teuthology.orchestra.run.smithi162.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-19T00:34:48.542 INFO:teuthology.orchestra.run.smithi162.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-08-19T00:34:48.668 INFO:teuthology.orchestra.run.smithi162.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-08-19T00:34:48.693 INFO:teuthology.orchestra.run.smithi162.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-19T00:34:48.718 INFO:teuthology.orchestra.run.smithi162.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-19T00:34:48.743 INFO:teuthology.orchestra.run.smithi162.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-19T00:34:48.769 INFO:teuthology.orchestra.run.smithi162.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-19T00:34:48.883 INFO:teuthology.orchestra.run.smithi162.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.2 MB/s | 839 kB 00:00 2024-08-19T00:34:48.920 INFO:teuthology.orchestra.run.smithi162.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-08-19T00:34:48.945 INFO:teuthology.orchestra.run.smithi162.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-19T00:34:48.971 INFO:teuthology.orchestra.run.smithi162.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-19T00:34:48.996 INFO:teuthology.orchestra.run.smithi162.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-08-19T00:34:49.021 INFO:teuthology.orchestra.run.smithi162.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-19T00:34:49.063 INFO:teuthology.orchestra.run.smithi162.stdout:(118/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-08-19T00:34:49.105 INFO:teuthology.orchestra.run.smithi162.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-08-19T00:34:49.139 INFO:teuthology.orchestra.run.smithi162.stdout:(120/150): python3-google-auth-2.33.0-1.el9.noa 6.8 MB/s | 220 kB 00:00 2024-08-19T00:34:49.172 INFO:teuthology.orchestra.run.smithi162.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-08-19T00:34:49.206 INFO:teuthology.orchestra.run.smithi162.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-19T00:34:49.232 INFO:teuthology.orchestra.run.smithi162.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 424 kB/s | 11 kB 00:00 2024-08-19T00:34:49.257 INFO:teuthology.orchestra.run.smithi162.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-08-19T00:34:49.282 INFO:teuthology.orchestra.run.smithi162.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-08-19T00:34:49.307 INFO:teuthology.orchestra.run.smithi162.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-08-19T00:34:49.333 INFO:teuthology.orchestra.run.smithi162.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-08-19T00:34:49.374 INFO:teuthology.orchestra.run.smithi162.stdout:(128/150): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-08-19T00:34:49.399 INFO:teuthology.orchestra.run.smithi162.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-19T00:34:49.425 INFO:teuthology.orchestra.run.smithi162.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-19T00:34:49.467 INFO:teuthology.orchestra.run.smithi162.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-08-19T00:34:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-19T00:34:49.535 INFO:teuthology.orchestra.run.smithi162.stdout:(133/150): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-08-19T00:34:49.560 INFO:teuthology.orchestra.run.smithi162.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-08-19T00:34:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-08-19T00:34:49.602 INFO:teuthology.orchestra.run.smithi162.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 679 kB/s | 28 kB 00:00 2024-08-19T00:34:49.627 INFO:teuthology.orchestra.run.smithi162.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-19T00:34:49.652 INFO:teuthology.orchestra.run.smithi162.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-19T00:34:49.677 INFO:teuthology.orchestra.run.smithi162.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-19T00:34:49.694 INFO:teuthology.orchestra.run.smithi162.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 859 kB/s | 36 kB 00:00 2024-08-19T00:34:49.720 INFO:teuthology.orchestra.run.smithi162.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-08-19T00:34:49.745 INFO:teuthology.orchestra.run.smithi162.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-19T00:34:49.770 INFO:teuthology.orchestra.run.smithi162.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-19T00:34:49.796 INFO:teuthology.orchestra.run.smithi162.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-08-19T00:34:49.831 INFO:teuthology.orchestra.run.smithi162.stdout:(145/150): re2-20211101-3.el9.x86_64.rpm 5.3 MB/s | 192 kB 00:00 2024-08-19T00:34:49.863 INFO:teuthology.orchestra.run.smithi162.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-08-19T00:34:49.914 INFO:teuthology.orchestra.run.smithi162.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-19T00:34:50.147 INFO:teuthology.orchestra.run.smithi162.stdout:(148/150): librados2-19.1.0-1382.gde09dd01.el9. 12 MB/s | 3.4 MB 00:00 2024-08-19T00:34:50.214 INFO:teuthology.orchestra.run.smithi162.stdout:(149/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 11 MB/s | 3.2 MB 00:00 2024-08-19T00:34:50.935 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-08-19T00:34:50.935 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-08-19T00:34:52.347 INFO:teuthology.orchestra.run.smithi162.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.5 MB/s | 16 MB 00:04 2024-08-19T00:34:52.352 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:34:52.352 INFO:teuthology.orchestra.run.smithi162.stdout:Total 13 MB/s | 218 MB 00:16 2024-08-19T00:34:54.225 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-08-19T00:34:54.382 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-08-19T00:34:54.382 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-08-19T00:34:56.731 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-08-19T00:34:56.731 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-08-19T00:34:57.121 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-08-19T00:34:57.201 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-19T00:34:57.407 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-19T00:34:57.604 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-19T00:34:58.008 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-19T00:34:58.158 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:34:58.324 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:34:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:34:58.470 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:34:58.524 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:34:58.557 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-19T00:34:58.590 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-19T00:34:58.849 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-19T00:34:58.920 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-19T00:34:58.948 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:34:59.078 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:34:59.107 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:34:59.191 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:34:59.217 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:34:59.257 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:34:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:34:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:34:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-19T00:34:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-19T00:34:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-19T00:35:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-19T00:35:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-19T00:35:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-19T00:35:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-19T00:35:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-19T00:35:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-19T00:35:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-19T00:35:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-19T00:35:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-19T00:35:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-19T00:35:00.640 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-19T00:35:00.741 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-19T00:35:00.780 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-19T00:35:00.827 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-19T00:35:00.860 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-19T00:35:00.963 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-19T00:35:01.022 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-19T00:35:01.118 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-19T00:35:01.291 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-19T00:35:01.352 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-19T00:35:02.039 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-19T00:35:02.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-19T00:35:02.195 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-19T00:35:02.239 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-19T00:35:02.277 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-19T00:35:02.318 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-19T00:35:02.380 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-19T00:35:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-19T00:35:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-19T00:35:02.548 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-19T00:35:02.608 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-19T00:35:02.647 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-19T00:35:02.718 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-19T00:35:02.910 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-19T00:35:03.038 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-08-19T00:35:03.092 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-19T00:35:03.110 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-19T00:35:03.143 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-19T00:35:03.187 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-19T00:35:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-19T00:35:03.338 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-19T00:35:03.359 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-19T00:35:03.402 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-19T00:35:03.431 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-19T00:35:03.456 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-19T00:35:03.580 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-19T00:35:03.613 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-19T00:35:03.750 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-19T00:35:03.793 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-19T00:35:03.818 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-19T00:35:03.858 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-19T00:35:03.916 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-19T00:35:03.961 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-19T00:35:03.994 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-19T00:35:04.000 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-19T00:35:04.037 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-19T00:35:04.072 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-19T00:35:04.105 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-19T00:35:04.108 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:35:04.149 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-19T00:35:04.172 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-19T00:35:04.253 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:35:04.278 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-19T00:35:04.284 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:35:04.332 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-19T00:35:04.368 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-19T00:35:04.402 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:35:04.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:35:04.490 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-19T00:35:04.498 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-19T00:35:04.524 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-19T00:35:04.565 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-19T00:35:04.791 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-19T00:35:04.854 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-19T00:35:04.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:35:05.000 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:35:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:35:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:35:05.152 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:35:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:35:05.524 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-19T00:35:05.583 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-19T00:35:05.613 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:35:05.617 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-19T00:35:05.662 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:35:05.741 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-19T00:35:05.795 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-19T00:35:05.801 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-19T00:35:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-19T00:35:05.906 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-19T00:35:05.944 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-19T00:35:05.964 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-19T00:35:05.988 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-19T00:35:06.002 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-19T00:35:06.071 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-19T00:35:06.123 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-19T00:35:06.162 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-19T00:35:06.217 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-19T00:35:06.240 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-19T00:35:06.264 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-19T00:35:06.282 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-19T00:35:06.298 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-19T00:35:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-19T00:35:06.387 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-19T00:35:06.450 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-19T00:35:06.494 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-19T00:35:06.540 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-19T00:35:06.621 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-19T00:35:06.655 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-19T00:35:06.702 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-19T00:35:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-19T00:35:06.820 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-19T00:35:06.871 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-19T00:35:06.964 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-19T00:35:07.122 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-19T00:35:07.182 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-19T00:35:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-19T00:35:07.411 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-19T00:35:07.815 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-19T00:35:07.942 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-19T00:35:07.977 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-19T00:35:08.020 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-19T00:35:08.059 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-19T00:35:08.100 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-19T00:35:08.161 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-19T00:35:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-19T00:35:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-19T00:35:08.354 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-19T00:35:08.412 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-19T00:35:08.454 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-19T00:35:08.499 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-19T00:35:08.549 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-19T00:35:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-19T00:35:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-19T00:35:08.808 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-19T00:35:08.926 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-19T00:35:08.965 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-19T00:35:09.008 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-19T00:35:09.037 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-19T00:35:09.062 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-19T00:35:09.097 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-19T00:35:09.190 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-19T00:35:09.230 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:35:09.260 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-19T00:35:09.292 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-19T00:35:09.349 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-19T00:35:09.395 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-19T00:35:09.432 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-19T00:35:09.475 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-19T00:35:09.530 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-19T00:35:09.582 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-19T00:35:09.621 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-19T00:35:09.646 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-19T00:35:09.658 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-19T00:35:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:35:09.693 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-19T00:35:09.726 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-19T00:35:09.770 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-19T00:35:09.802 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-19T00:35:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:35:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-19T00:35:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-19T00:35:09.903 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-19T00:35:09.961 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-19T00:35:09.997 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-19T00:35:10.113 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-19T00:35:10.177 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-19T00:35:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-19T00:35:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:35:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:35:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-19T00:35:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-19T00:35:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-19T00:35:11.170 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-19T00:35:11.314 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-19T00:35:11.379 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-19T00:35:11.432 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-19T00:35:11.537 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-19T00:35:11.572 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-19T00:35:11.790 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-19T00:35:11.819 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-19T00:35:11.923 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-19T00:35:12.745 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-19T00:35:12.902 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-19T00:35:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:35:13.305 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:35:13.980 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:35:14.026 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:35:14.167 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:35:14.167 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T00:35:14.167 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T00:35:14.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:14.218 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:35:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-19T00:35:14.790 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:35:14.829 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-19T00:35:14.860 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-19T00:35:15.196 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-19T00:35:15.238 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:35:15.354 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:35:15.402 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-19T00:35:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-19T00:35:15.961 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-19T00:35:15.991 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:35:16.084 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:35:16.109 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-19T00:35:18.769 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:35:18.815 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:35:19.455 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:35:19.501 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:35:19.646 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:35:19.646 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T00:35:19.646 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T00:35:19.646 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:19.686 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:35:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:35:27.422 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-08-19T00:35:27.423 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-08-19T00:35:27.423 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-08-19T00:35:27.423 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-08-19T00:35:27.423 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-08-19T00:35:27.423 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-08-19T00:35:27.423 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-08-19T00:35:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:35:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:35:27.689 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:27.689 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-19T00:35:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:29.336 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:35:29.396 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:35:29.396 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:29.396 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T00:35:29.396 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:35:29.397 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:35:29.397 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:35:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:35:29.706 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:29.706 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T00:35:29.706 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:35:29.706 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:35:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:30.237 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:35:30.289 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:35:30.289 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:30.289 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T00:35:30.289 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:35:30.289 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:35:30.289 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:30.421 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-19T00:35:30.482 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-19T00:35:30.558 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-19T00:35:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-19T00:35:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-19T00:35:30.955 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-19T00:35:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-19T00:35:31.242 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-19T00:35:31.302 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-19T00:35:31.340 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-19T00:35:31.373 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-19T00:35:31.941 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:35:31.973 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:35:32.015 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-19T00:35:32.082 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:35:32.082 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-08-19T00:35:32.082 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-08-19T00:35:32.082 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-08-19T00:35:32.082 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-08-19T00:35:32.082 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-08-19T00:35:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-08-19T00:35:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-08-19T00:35:32.083 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:32.126 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-19T00:35:32.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:35:32.287 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:35:32.324 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:35:32.324 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:32.324 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-19T00:35:32.324 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:35:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:35:33.915 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:35:33.973 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:35:33.973 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:33.973 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T00:35:33.974 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:35:33.974 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:35:33.974 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:34.223 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:35:34.274 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:35:34.274 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:34.274 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T00:35:34.274 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:35:34.274 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:35:34.274 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:34.640 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:35:34.664 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:35:34.757 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:35:34.807 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:35:34.807 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:34.808 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T00:35:34.808 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:35:34.808 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:35:34.808 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:34.810 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:35:34.988 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-19T00:35:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-19T00:35:35.025 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:35:35.051 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-19T00:35:35.078 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:35:35.078 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:35.078 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T00:35:35.078 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:35:35.079 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:35:35.079 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-19T00:35:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:35:35.161 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:35:35.271 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-19T00:35:35.337 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-19T00:35:35.366 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-19T00:35:35.419 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-19T00:35:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-19T00:35:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-19T00:35:35.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-19T00:35:35.837 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-19T00:35:35.875 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-19T00:35:35.909 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-19T00:35:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-19T00:35:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:35:36.433 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:35:36.466 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:35:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:35:36.473 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:36.473 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T00:35:36.473 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:35:36.473 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:35:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:36.499 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-19T00:35:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:35:36.567 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-19T00:35:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:35:36.580 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:36.580 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T00:35:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:36.628 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:35:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:35:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:35:36.691 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:36.691 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-19T00:35:36.691 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:35:36.691 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:35:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:35:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:35:37.108 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:37.108 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T00:35:37.108 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:35:37.109 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:35:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:37.850 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:35:37.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:35:38.979 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:35:39.007 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:35:39.145 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:35:39.322 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-19T00:35:39.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:35:39.403 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:35:39.403 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:39.403 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T00:35:39.403 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:35:39.403 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:35:39.403 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:39.462 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:35:39.487 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:35:39.592 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-19T00:35:39.652 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-19T00:35:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-19T00:35:40.670 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:35:40.722 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:35:40.722 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:40.722 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T00:35:40.722 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:35:40.722 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:35:40.722 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:40.791 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:35:40.841 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:35:40.841 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:40.841 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T00:35:40.841 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:40.889 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:35:40.940 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:35:40.940 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:40.940 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-19T00:35:40.940 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:35:40.940 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:35:40.940 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:41.289 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:35:41.340 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:35:41.340 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:35:41.341 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T00:35:41.341 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:35:41.341 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:35:41.341 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-19T00:35:42.387 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-19T00:35:42.446 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-19T00:35:42.484 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-19T00:35:42.519 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-19T00:35:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-19T00:35:42.841 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-19T00:35:42.869 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-19T00:35:43.629 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:35:43.703 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:35:43.745 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:35:45.125 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-19T00:35:45.232 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-19T00:35:45.294 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-19T00:35:45.415 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-19T00:35:45.463 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-19T00:35:45.463 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:35:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:35:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:35:46.285 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-19T00:35:46.314 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:35:46.314 INFO:teuthology.orchestra.run.smithi007.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-19T00:35:46.314 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:46.326 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-19T00:35:46.378 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-19T00:35:46.416 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-19T00:35:46.451 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-19T00:35:46.677 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-19T00:35:46.731 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-19T00:35:46.760 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-19T00:35:47.522 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:35:47.574 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:35:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:35:48.882 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-19T00:35:48.979 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-19T00:35:49.037 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-19T00:35:49.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-19T00:35:49.192 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-19T00:35:49.193 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:35:49.325 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:35:49.325 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:35:49.705 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:35:49.706 INFO:teuthology.orchestra.run.smithi162.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-19T00:35:49.706 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:51.869 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-19T00:35:51.869 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-19T00:35:51.869 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-19T00:35:51.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-19T00:35:51.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-19T00:35:51.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:35:51.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:35:51.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-19T00:35:51.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-19T00:35:51.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-19T00:35:51.873 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-19T00:35:51.873 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:35:51.873 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-19T00:35:51.873 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-19T00:35:51.873 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-19T00:35:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-19T00:35:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-19T00:35:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-19T00:35:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-19T00:35:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-19T00:35:51.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-19T00:35:51.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-19T00:35:51.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-19T00:35:51.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-19T00:35:51.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-19T00:35:51.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-19T00:35:51.893 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-19T00:35:51.894 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-19T00:35:51.895 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-19T00:35:54.276 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:35:54.276 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:54.276 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-19T00:35:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-19T00:35:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.14-1.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T00:35:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T00:35:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T00:35:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T00:35:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T00:35:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-19T00:35:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:35:54.289 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-08-19T00:35:54.851 DEBUG:teuthology.parallel:result is None 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-19T00:35:55.391 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-19T00:35:55.392 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-19T00:35:55.393 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-19T00:35:55.393 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-19T00:35:55.393 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-19T00:35:55.393 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-19T00:35:55.403 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-19T00:35:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-19T00:35:55.405 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-19T00:35:55.406 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-19T00:35:55.407 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-19T00:35:55.408 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-19T00:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-19T00:35:55.410 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-19T00:35:55.411 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-19T00:35:55.412 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-19T00:35:55.413 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-19T00:35:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:35:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:57.882 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-08-19T00:35:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-19T00:35:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T00:35:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-19T00:35:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.14-1.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T00:35:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T00:35:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T00:35:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-19T00:35:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T00:35:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-19T00:35:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-19T00:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T00:35:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-19T00:35:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:35:57.895 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-08-19T00:35:58.368 DEBUG:teuthology.parallel:result is None 2024-08-19T00:35:58.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:35:58.529 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T00:35:58.575 INFO:teuthology.orchestra.run.smithi007.stdout:19.1.0-1382.gde09dd01.el9 2024-08-19T00:35:58.576 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-19T00:35:58.576 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-19T00:35:58.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:35:58.727 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T00:35:58.772 INFO:teuthology.orchestra.run.smithi162.stdout:19.1.0-1382.gde09dd01.el9 2024-08-19T00:35:58.773 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-19T00:35:58.773 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-19T00:35:58.775 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-19T00:35:58.775 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:35:58.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T00:35:58.835 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:35:58.835 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T00:35:58.895 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-19T00:35:58.895 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:35:58.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T00:35:58.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T00:35:59.053 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:35:59.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T00:35:59.108 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T00:35:59.206 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-19T00:35:59.207 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:35:59.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T00:35:59.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T00:35:59.371 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:35:59.371 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T00:35:59.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T00:35:59.522 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-19T00:35:59.522 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:35:59.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T00:35:59.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T00:35:59.684 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:35:59.684 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T00:35:59.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T00:35:59.839 INFO:teuthology.run_tasks:Running task ceph... 2024-08-19T00:35:59.919 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-19T00:35:59.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2024-08-19T00:35:59.923 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-08-19T00:35:59.980 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-19T00:35:59.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-19T00:35:59.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-19T00:36:00.042 INFO:tasks.ceph:Creating extra log directories... 2024-08-19T00:36:00.042 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-19T00:36:00.047 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-19T00:36:00.113 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-19T00:36:00.113 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-19T00:36:00.113 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-19T00:36:00.113 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:00.113 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-19T00:36:00.149 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-19T00:36:00.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-19T00:36:00.387 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:00.387 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-19T00:36:00.422 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-19T00:36:00.601 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-19T00:36:00.663 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-19T00:36:00.664 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds', 'MDS abort because newly corrupt dentry'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-19T00:36:00.664 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/damage}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7860074', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds', 'MDS abort because newly corrupt dentry'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '78215f5a1cf5eaf321d506a66539942e12851f34'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1664, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'sleep_before_teardown': 0, 'subset': '36/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '78215f5a1cf5eaf321d506a66539942e12851f34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGbFzDy5TnXTACNYbYlvoL0mwDc+X5YJGoH4CPSExO5QHjRP+TqPnv/+sd/Yb6AaXIV5Si6/IrTyMLw0F/Yhxbg=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYPsFxUbN8l7yO9/DG3bMD5/tGhfGX2QGOhzVjbMlwWhebN9MCsq9EpIR+4itKf2pC7yqFiO18KU+qk6h9eRso='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds', 'MDS abort because newly corrupt dentry'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_damage']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-18_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-19T00:36:00.664 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-19T00:36:00.670 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-19T00:36:00.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2024-08-19T00:36:00.747 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-08-19T00:36:00.808 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:00.808 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T00:36:00.843 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T00:36:00.843 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-08-19T00:36:00.918 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T00:36:00.918 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:00.918 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-08-19T00:36:00.919 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:00.919 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:00.919 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-19 00:35:46.688878073 +0000 2024-08-19T00:36:00.919 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-19 00:33:48.257940100 +0000 2024-08-19T00:36:00.919 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-19 00:33:48.257940100 +0000 2024-08-19T00:36:00.919 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-19 00:33:48.257940100 +0000 2024-08-19T00:36:00.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T00:36:01.011 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-19T00:36:01.012 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-19T00:36:01.012 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000213457 s, 2.4 MB/s 2024-08-19T00:36:01.014 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T00:36:01.051 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-08-19T00:36:01.126 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T00:36:01.126 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:01.127 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-08-19T00:36:01.127 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:01.127 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:01.127 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-19 00:35:46.688878073 +0000 2024-08-19T00:36:01.127 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-19 00:33:48.723933290 +0000 2024-08-19T00:36:01.127 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-19 00:33:48.723933290 +0000 2024-08-19T00:36:01.127 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-19 00:33:48.723933290 +0000 2024-08-19T00:36:01.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T00:36:01.220 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-19T00:36:01.220 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-19T00:36:01.220 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000177102 s, 2.9 MB/s 2024-08-19T00:36:01.222 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T00:36:01.259 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-19 00:35:46.689878058 +0000 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-19 00:33:49.184926553 +0000 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-19 00:33:49.184926553 +0000 2024-08-19T00:36:01.336 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-19 00:33:49.184926553 +0000 2024-08-19T00:36:01.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T00:36:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-19T00:36:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-19T00:36:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000176302 s, 2.9 MB/s 2024-08-19T00:36:01.432 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T00:36:01.469 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-19 00:35:46.690878043 +0000 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-19 00:33:49.673919407 +0000 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-19 00:33:49.673919407 +0000 2024-08-19T00:36:01.545 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-19 00:33:49.673919407 +0000 2024-08-19T00:36:01.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T00:36:01.639 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-19T00:36:01.639 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-19T00:36:01.639 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000175397 s, 2.9 MB/s 2024-08-19T00:36:01.642 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T00:36:01.678 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:01.678 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:01.678 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T00:36:01.714 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T00:36:01.714 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-08-19T00:36:01.790 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T00:36:01.790 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:01.790 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-08-19T00:36:01.790 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:01.790 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:01.790 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-19 00:35:50.127648446 +0000 2024-08-19T00:36:01.791 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-19 00:33:48.238969968 +0000 2024-08-19T00:36:01.791 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-19 00:33:48.238969968 +0000 2024-08-19T00:36:01.791 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-19 00:33:48.238969968 +0000 2024-08-19T00:36:01.791 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T00:36:01.886 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-19T00:36:01.886 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-19T00:36:01.886 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000370173 s, 1.4 MB/s 2024-08-19T00:36:01.890 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T00:36:01.928 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-08-19T00:36:02.006 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-19 00:35:50.128648426 +0000 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-19 00:33:48.727960510 +0000 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-19 00:33:48.727960510 +0000 2024-08-19T00:36:02.007 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-19 00:33:48.727960510 +0000 2024-08-19T00:36:02.007 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T00:36:02.104 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-19T00:36:02.104 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-19T00:36:02.104 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000270171 s, 1.9 MB/s 2024-08-19T00:36:02.107 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T00:36:02.144 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-08-19T00:36:02.222 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T00:36:02.222 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:02.223 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-08-19T00:36:02.223 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:02.223 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:02.223 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-19 00:35:50.129648407 +0000 2024-08-19T00:36:02.223 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-19 00:33:49.195951462 +0000 2024-08-19T00:36:02.223 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-19 00:33:49.195951462 +0000 2024-08-19T00:36:02.223 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-19 00:33:49.195951462 +0000 2024-08-19T00:36:02.223 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T00:36:02.317 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-19T00:36:02.317 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-19T00:36:02.317 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000267955 s, 1.9 MB/s 2024-08-19T00:36:02.321 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T00:36:02.359 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-08-19T00:36:02.436 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T00:36:02.436 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:36:02.436 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-08-19T00:36:02.436 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:36:02.436 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:36:02.437 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-19 00:35:50.129648407 +0000 2024-08-19T00:36:02.437 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-19 00:33:49.655942567 +0000 2024-08-19T00:36:02.437 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-19 00:33:49.655942567 +0000 2024-08-19T00:36:02.437 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-19 00:33:49.655942567 +0000 2024-08-19T00:36:02.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T00:36:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-19T00:36:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-19T00:36:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000438891 s, 1.2 MB/s 2024-08-19T00:36:02.534 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T00:36:02.570 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:02.571 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-19T00:36:02.571 INFO:tasks.ceph:Generating config... 2024-08-19T00:36:02.572 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-19T00:36:02.572 INFO:tasks.ceph:[client] debug client = 20 2024-08-19T00:36:02.572 INFO:tasks.ceph:[client] debug ms = 1 2024-08-19T00:36:02.572 INFO:tasks.ceph:[client] pid file = 2024-08-19T00:36:02.572 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-19T00:36:02.572 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-19T00:36:02.573 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-19T00:36:02.573 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-19T00:36:02.574 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-19T00:36:02.574 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-19T00:36:02.574 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-19T00:36:02.574 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-08-19T00:36:02.574 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-19T00:36:02.574 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-08-19T00:36:02.574 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-19T00:36:02.574 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-19T00:36:02.574 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-19T00:36:02.574 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-19T00:36:02.574 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-19T00:36:02.574 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-19T00:36:02.574 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-19T00:36:02.575 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-19T00:36:02.575 INFO:tasks.ceph:Setting up mon.a... 2024-08-19T00:36:02.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-19T00:36:02.663 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2024-08-19T00:36:02.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-19T00:36:02.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-19T00:36:02.811 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2024-08-19T00:36:02.812 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-19T00:36:02.813 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:02.813 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-19T00:36:02.847 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:02.966 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:02.966 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid bd35d026-e259-45a6-99d5-e8ea5afa8a60 2024-08-19T00:36:02.966 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-08-19T00:36:02.966 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2024-08-19T00:36:02.966 INFO:teuthology.orchestra.run.smithi007.stdout:fsid bd35d026-e259-45a6-99d5-e8ea5afa8a60 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2024-08-19T00:36:02.965466+0000 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-08-19T00:36:02.965466+0000 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 17 (quincy) 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2024-08-19T00:36:02.967 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-19T00:36:02.969 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-19T00:36:03.004 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bd35d026-e259-45a6-99d5-e8ea5afa8a60... 2024-08-19T00:36:03.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-19T00:36:03.048 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-19T00:36:03.143 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-08-19T00:36:03.143 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-08-19T00:36:03.143 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-19T00:36:03.143 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-08-19T00:36:03.143 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.143 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-08-19T00:36:03.143 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-19T00:36:03.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.145 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = bd35d026-e259-45a6-99d5-e8ea5afa8a60 2024-08-19T00:36:03.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-08-19T00:36:03.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.148 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: bdev async discard = True 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: bdev enable discard = True 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore allocator = bitmap 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 1/20 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 1/20 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 4/10 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-08-19T00:36:03.149 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-08-19T00:36:03.150 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-19T00:36:03.151 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon down mkfs grace = 300 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on pool no app = False 2024-08-19T00:36:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-08-19T00:36:03.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds balancer = 20 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-08-19T00:36:03.154 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-08-19T00:36:03.155 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-08-19T00:36:03.156 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-08-19T00:36:03.157 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.7,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = bd35d026-e259-45a6-99d5-e8ea5afa8a60 2024-08-19T00:36:03.158 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-08-19T00:36:03.159 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.160 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-08-19T00:36:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-08-19T00:36:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-19T00:36:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: mon down mkfs grace = 300 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on pool no app = False 2024-08-19T00:36:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-08-19T00:36:03.165 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-08-19T00:36:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-08-19T00:36:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-08-19T00:36:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-08-19T00:36:03.179 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-19T00:36:03.179 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-19T00:36:03.277 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-19T00:36:03.277 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:03.277 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-19T00:36:03.312 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:03.312 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-19T00:36:03.387 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:36:03.387 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:03.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-19T00:36:03.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-19T00:36:03.505 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:03.505 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:03.581 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:36:03.582 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:03.582 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-19T00:36:03.582 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-19T00:36:03.667 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:03.667 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:03.745 INFO:tasks.ceph:Setting up mon nodes... 2024-08-19T00:36:03.745 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-19T00:36:03.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-19T00:36:03.850 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-19T00:36:03.856 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-19T00:36:03.999 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-19T00:36:04.005 INFO:tasks.ceph:Setting up mds nodes... 2024-08-19T00:36:04.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-19T00:36:04.111 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-19T00:36:04.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-19T00:36:04.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-19T00:36:04.277 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-19T00:36:04.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-19T00:36:04.338 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-19T00:36:04.444 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-19T00:36:04.451 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-19T00:36:04.506 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-19T00:36:04.609 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-19T00:36:04.614 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-19T00:36:04.671 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-19T00:36:04.671 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-19T00:36:04.754 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-19T00:36:04.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-19T00:36:04.864 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-19T00:36:04.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-19T00:36:04.974 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-19T00:36:05.001 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-19T00:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-19T00:36:05.110 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-19T00:36:05.111 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-19T00:36:05.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-19T00:36:05.170 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:05.170 INFO:tasks.ceph:role: osd.0 2024-08-19T00:36:05.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:36:05.171 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:05.227 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:05.259 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-08-19T00:36:05.263 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-08-19T00:36:05.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-19T00:36:05.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-19T00:36:05.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-19T00:36:05.463 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:05.463 INFO:tasks.ceph:role: osd.1 2024-08-19T00:36:05.463 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:36:05.464 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-19T00:36:05.519 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:05.520 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:05.520 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:05.520 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:05.520 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:05.520 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:05.520 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:05.521 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:05.521 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:05.521 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:05.551 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-08-19T00:36:05.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-08-19T00:36:05.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-19T00:36:05.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-19T00:36:05.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-19T00:36:05.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:05.756 INFO:tasks.ceph:role: osd.2 2024-08-19T00:36:05.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:36:05.756 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:05.811 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:05.812 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:05.812 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:05.844 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-08-19T00:36:05.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-08-19T00:36:05.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-19T00:36:05.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-19T00:36:05.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-19T00:36:06.047 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:06.048 INFO:tasks.ceph:role: osd.3 2024-08-19T00:36:06.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:36:06.048 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-19T00:36:06.103 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:06.103 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:06.103 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:06.103 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:06.103 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:06.103 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:06.103 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:06.104 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:06.104 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:06.104 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:06.137 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-08-19T00:36:06.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-08-19T00:36:06.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-19T00:36:06.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-19T00:36:06.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:06.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:06.389+0000 7fe03de9c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-19T00:36:06.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:06.390+0000 7fe03de9c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-19T00:36:06.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:06.390+0000 7fe03de9c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-19T00:36:06.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:06.390+0000 7fe03de9c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-19T00:36:06.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:06.390+0000 7fe03de9c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-19T00:36:06.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:06.393+0000 7fe03de9c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-19T00:36:09.311 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-19T00:36:09.371 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:09.461+0000 7fa6430e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-19T00:36:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:09.461+0000 7fa6430e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-19T00:36:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:09.461+0000 7fa6430e8640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-19T00:36:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:09.461+0000 7fa6430e8640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-19T00:36:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:09.461+0000 7fa6430e8640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-19T00:36:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:09.463+0000 7fa6430e8640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-19T00:36:12.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-19T00:36:12.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:12.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:12.539+0000 7f7f9331d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-19T00:36:12.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:12.540+0000 7f7f9331d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-19T00:36:12.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:12.540+0000 7f7f9331d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-19T00:36:12.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:12.540+0000 7f7f9331d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-19T00:36:12.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:12.540+0000 7f7f9331d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-19T00:36:12.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:12.541+0000 7f7f9331d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-19T00:36:15.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-19T00:36:15.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:15.623+0000 7f0ee3a86640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-19T00:36:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:15.623+0000 7f0ee3a86640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-19T00:36:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:15.623+0000 7f0ee3a86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-19T00:36:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:15.623+0000 7f0ee3a86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-19T00:36:15.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:15.623+0000 7f0ee3a86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-19T00:36:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:15.625+0000 7f0ee3a86640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-19T00:36:18.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-19T00:36:18.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-19T00:36:18.696 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:18.696 INFO:tasks.ceph:role: osd.4 2024-08-19T00:36:18.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:36:18.697 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:18.763 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:19.168 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-19T00:36:19.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-19T00:36:19.172 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-19T00:36:19.284 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-19T00:36:19.352 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-19T00:36:19.408 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:19.408 INFO:tasks.ceph:role: osd.5 2024-08-19T00:36:19.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:36:19.409 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-19T00:36:19.472 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:19.472 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:19.472 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:19.472 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:19.473 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:19.473 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:19.473 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:19.473 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:19.473 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:19.473 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:19.830 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-19T00:36:19.835 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-19T00:36:19.835 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-19T00:36:19.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-19T00:36:19.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-19T00:36:20.040 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:20.040 INFO:tasks.ceph:role: osd.6 2024-08-19T00:36:20.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:36:20.040 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-19T00:36:20.103 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:20.104 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:20.487 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-19T00:36:20.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-19T00:36:20.491 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-19T00:36:20.593 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-19T00:36:20.656 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-19T00:36:20.711 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-19T00:36:20.711 INFO:tasks.ceph:role: osd.7 2024-08-19T00:36:20.711 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:36:20.711 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T00:36:20.776 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T00:36:21.170 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-19T00:36:21.174 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-19T00:36:21.174 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-19T00:36:21.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-19T00:36:21.371 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:21.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:21.499+0000 7f515ec32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-19T00:36:21.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:21.505+0000 7f515ec32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-19T00:36:21.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:21.505+0000 7f515ec32640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-19T00:36:21.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:21.505+0000 7f515ec32640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-19T00:36:21.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:21.505+0000 7f515ec32640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-19T00:36:21.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:21.508+0000 7f515ec32640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-19T00:36:24.441 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-19T00:36:24.499 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:24.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:24.588+0000 7f808c81c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-19T00:36:24.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:24.588+0000 7f808c81c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-19T00:36:24.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:24.588+0000 7f808c81c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-19T00:36:24.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:24.589+0000 7f808c81c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-19T00:36:24.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:24.589+0000 7f808c81c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-19T00:36:24.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:24.591+0000 7f808c81c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-19T00:36:27.526 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-19T00:36:27.584 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:27.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:27.672+0000 7fa87ec0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-19T00:36:27.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:27.672+0000 7fa87ec0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-19T00:36:27.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:27.672+0000 7fa87ec0c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-19T00:36:27.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:27.672+0000 7fa87ec0c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-19T00:36:27.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:27.673+0000 7fa87ec0c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-19T00:36:27.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:27.674+0000 7fa87ec0c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-19T00:36:30.603 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-19T00:36:30.660 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:30.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:36:30.671 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:36:30.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:30.748+0000 7fdf81a14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-19T00:36:30.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:30.749+0000 7fdf81a14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-19T00:36:30.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:30.749+0000 7fdf81a14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-19T00:36:30.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:30.749+0000 7fdf81a14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-19T00:36:30.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:30.749+0000 7fdf81a14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-19T00:36:30.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:30.751+0000 7fdf81a14640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-19T00:36:33.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-19T00:36:33.726 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-19T00:36:33.726 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:33.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-19T00:36:33.789 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:33.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-19T00:36:33.890 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:33.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-19T00:36:33.988 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:33.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-19T00:36:34.084 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:34.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-19T00:36:34.180 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:34.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-19T00:36:34.275 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:34.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-19T00:36:34.371 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:34.371 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-19T00:36:34.430 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:34.430 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-19T00:36:34.526 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:34.526 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-19T00:36:34.621 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:34.621 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-19T00:36:34.716 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:34.716 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-19T00:36:34.811 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:34.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-19T00:36:34.907 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:34.907 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-19T00:36:35.002 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:35.002 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-19T00:36:35.040 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:35.040 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-19T00:36:35.117 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:35.117 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-19T00:36:35.152 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:35.152 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-19T00:36:35.226 INFO:tasks.ceph:Adding keys to all mons... 2024-08-19T00:36:35.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-19T00:36:35.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-19T00:36:35.283 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2024-08-19T00:36:35.283 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg== 2024-08-19T00:36:35.283 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-08-19T00:36:35.283 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g== 2024-08-19T00:36:35.283 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-08-19T00:36:35.283 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ== 2024-08-19T00:36:35.283 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA== 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ== 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ== 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w== 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ== 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA== 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-08-19T00:36:35.284 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA== 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg== 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ== 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA== 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA== 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout:[client.2] 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ== 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout:[client.1] 2024-08-19T00:36:35.285 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA== 2024-08-19T00:36:35.286 INFO:teuthology.orchestra.run.smithi007.stdout:[client.3] 2024-08-19T00:36:35.286 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg== 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg== 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g== 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ== 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA== 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ== 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-08-19T00:36:35.319 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ== 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w== 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ== 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA== 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA== 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg== 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ== 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-08-19T00:36:35.320 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA== 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA== 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ== 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA== 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2024-08-19T00:36:35.321 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg== 2024-08-19T00:36:35.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-19T00:36:35.332 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-19T00:36:35.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:35.459 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:35.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:35.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:35.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:35.660 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:35.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:35.756 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:35.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:35.854 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:35.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:35.952 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-19T00:36:36.049 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-19T00:36:36.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:36.146 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:36.243 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:36.247 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-19T00:36:36.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.348 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.446 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.543 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T00:36:36.734 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:36.738 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:36.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:36.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:36.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:36.942 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:37.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:37.042 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T00:36:37.139 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-19T00:36:37.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-19T00:36:37.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T00:36:37.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-19T00:36:37.359 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-19T00:36:37.415 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T00:36:37.523 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-19T00:36:37.578 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-19T00:36:37.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T00:36:37.741 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-19T00:36:37.796 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:37.800 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-19T00:36:37.835 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-19T00:36:37.836 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-19T00:36:37.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-19T00:36:37.878 INFO:tasks.ceph.mon.a:Started 2024-08-19T00:36:37.878 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-19T00:36:37.878 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-19T00:36:37.882 INFO:tasks.ceph.mon.b:Started 2024-08-19T00:36:37.882 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-19T00:36:37.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-19T00:36:37.886 INFO:tasks.ceph.mon.c:Started 2024-08-19T00:36:37.886 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-19T00:36:37.887 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-19T00:36:37.887 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-19T00:36:37.890 INFO:tasks.ceph.mgr.y:Started 2024-08-19T00:36:37.891 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-19T00:36:37.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-19T00:36:37.894 INFO:tasks.ceph.mgr.x:Started 2024-08-19T00:36:37.895 INFO:tasks.ceph:Setting crush tunables to default 2024-08-19T00:36:37.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2024-08-19T00:36:38.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.050+0000 7f166e000640 1 Processor -- start 2024-08-19T00:36:38.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.050+0000 7f166e000640 1 -- start start 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.051+0000 7f166e000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.051+0000 7f166e000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.051+0000 7f166e000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16680d2750 con 0x7f166815e4c0 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.051+0000 7f166e000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f16680d53e0 con 0x7f16680d3170 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.051+0000 7f166e000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f16680d1610 con 0x7f166815e8a0 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1666a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1666a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:45270/0 (socket says 172.21.15.7:45270) 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1666a00640 1 -- 172.21.15.7:0/4102833566 learned_addr learned my addr 172.21.15.7:0/4102833566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1666a00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 msgr2=0x7f16680d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1666a00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 msgr2=0x7f16680d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:36:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1666a00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:36:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1666a00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:36:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 msgr2=0x7f16680d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T00:36:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 msgr2=0x7f16680d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:36:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:36:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.052+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:36:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1666a00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 msgr2=0x7f16680d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T00:36:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 msgr2=0x7f16680d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:36:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:36:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:36:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1666a00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 msgr2=0x7f16680d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T00:36:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1666a00640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 msgr2=0x7f16680d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:36:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1666a00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:36:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.253+0000 7f1666a00640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:36:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.257+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184697801 0 0) 0x7f16680d2750 con 0x7f166815e4c0 2024-08-19T00:36:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.257+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f164c003520 con 0x7f166815e4c0 2024-08-19T00:36:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3013548695 0 0) 0x7f164c003520 con 0x7f166815e4c0 2024-08-19T00:36:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 msgr2=0x7f16680d2050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T00:36:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.162:3300/0 conn(0x7f166815e8a0 0x7f16680d2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 msgr2=0x7f16680d4ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T00:36:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 --2- 172.21.15.7:0/4102833566 >> v2:172.21.15.7:3300/0 conn(0x7f16680d3170 0x7f16680d4ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16680d0ce0 con 0x7f166815e4c0 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f1658001670 con 0x7f166815e4c0 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 >> v1:172.21.15.7:6789/0 conn(0x7f166815e4c0 legacy=0x7f16680d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0039b0 0x7f164c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164c004800 0x7f164c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f164c0051c0 0x7f164c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16680d53e0 con 0x7f164c0051c0 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16680d1610 con 0x7f164c004800 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f164c00c0c0 con 0x7f164c0039b0 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f164c0051c0 0x7f164c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.258+0000 7f1666a00640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164c004800 0x7f164c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.259+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0039b0 msgr2=0x7f164c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.259+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0039b0 0x7f164c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.259+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164c004800 msgr2=0x7f164c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.259+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164c004800 0x7f164c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.259+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16680d0ce0 con 0x7f164c0051c0 2024-08-19T00:36:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.260+0000 7f1667e00640 1 -- 172.21.15.7:0/4102833566 reap_dead start 2024-08-19T00:36:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.260+0000 7f1667e00640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f164c0051c0 0x7f164c00b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f16680cea80 tx=0x7f164c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2644b510b88472d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.260+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660009ba0 con 0x7f164c0051c0 2024-08-19T00:36:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166002c650 con 0x7f164c0051c0 2024-08-19T00:36:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f1666000640 1 -- 172.21.15.7:0/4102833566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166002ca20 con 0x7f164c0051c0 2024-08-19T00:36:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f166e000640 1 -- 172.21.15.7:0/4102833566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f164c0051c0 msgr2=0x7f164c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f166e000640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f164c0051c0 0x7f164c00b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f16680cea80 tx=0x7f164c005830 comp rx=0 tx=0).stop 2024-08-19T00:36:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f166e000640 1 -- 172.21.15.7:0/4102833566 shutdown_connections 2024-08-19T00:36:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f166e000640 1 --2- 172.21.15.7:0/4102833566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f164c0051c0 0x7f164c00b9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f166e000640 1 -- 172.21.15.7:0/4102833566 >> 172.21.15.7:0/4102833566 conn(0x7f166809d730 msgr2=0x7f16680d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f166e000640 1 -- 172.21.15.7:0/4102833566 shutdown_connections 2024-08-19T00:36:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.261+0000 7f166e000640 1 -- 172.21.15.7:0/4102833566 wait complete. 2024-08-19T00:36:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.263+0000 7f166e000640 1 Processor -- start 2024-08-19T00:36:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.263+0000 7f166e000640 1 -- start start 2024-08-19T00:36:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f166e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0051c0 0x7f1668157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f166e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16680caaf0 0x7f166806db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f166e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16680cb550 0x7f16680cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f166e000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16680d4ea0 con 0x7f16680caaf0 2024-08-19T00:36:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f166e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16680d12a0 con 0x7f16680cb550 2024-08-19T00:36:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f166e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16680d5020 con 0x7f164c0051c0 2024-08-19T00:36:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f1666a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16680caaf0 0x7f166806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.264+0000 7f1666a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16680caaf0 0x7f166806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35266/0 (socket says 172.21.15.7:35266) 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1666a00640 1 -- 172.21.15.7:0/3563317994 learned_addr learned my addr 172.21.15.7:0/3563317994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1667400640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0051c0 0x7f1668157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1667e00640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16680cb550 0x7f16680cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1666a00640 1 -- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0051c0 msgr2=0x7f1668157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1666a00640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0051c0 0x7f1668157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1666a00640 1 -- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16680cb550 msgr2=0x7f16680cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1666a00640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16680cb550 0x7f16680cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1666a00640 1 -- 172.21.15.7:0/3563317994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16680ce5c0 con 0x7f16680caaf0 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1667400640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0051c0 0x7f1668157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:36:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1667e00640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16680cb550 0x7f16680cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.265+0000 7f1666a00640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16680caaf0 0x7f166806db80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1654012910 tx=0x7f1654012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.266+0000 7f165f400640 1 -- 172.21.15.7:0/3563317994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165401b070 con 0x7f16680caaf0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.266+0000 7f165f400640 1 -- 172.21.15.7:0/3563317994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1654004220 con 0x7f16680caaf0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.266+0000 7f165f400640 1 -- 172.21.15.7:0/3563317994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165400f040 con 0x7f16680caaf0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.266+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166806cae0 con 0x7f16680caaf0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.266+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166806d0a0 con 0x7f16680caaf0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.266+0000 7f165f400640 1 -- 172.21.15.7:0/3563317994 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f165400ecf0 con 0x7f16680caaf0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.266+0000 7f165f400640 1 -- 172.21.15.7:0/3563317994 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f165401f730 con 0x7f16680caaf0 2024-08-19T00:36:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.267+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16680d2050 con 0x7f16680caaf0 2024-08-19T00:36:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.270+0000 7f165f400640 1 -- 172.21.15.7:0/3563317994 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f165401f9e0 con 0x7f16680caaf0 2024-08-19T00:36:38.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.337+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f166806e7b0 con 0x7f16680caaf0 2024-08-19T00:36:38.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.339+0000 7f165f400640 1 -- 172.21.15.7:0/3563317994 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f165401fbc0 con 0x7f16680caaf0 2024-08-19T00:36:38.340 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-08-19T00:36:38.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16680caaf0 msgr2=0x7f166806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16680caaf0 0x7f166806db80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1654012910 tx=0x7f1654012dd0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 shutdown_connections 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16680cb550 0x7f16680cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16680caaf0 0x7f166806db80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 --2- 172.21.15.7:0/3563317994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164c0051c0 0x7f1668157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 >> 172.21.15.7:0/3563317994 conn(0x7f166809d730 msgr2=0x7f16680b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 shutdown_connections 2024-08-19T00:36:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:38.340+0000 7f166e000640 1 -- 172.21.15.7:0/3563317994 wait complete. 2024-08-19T00:36:38.357 INFO:tasks.ceph:check_enable_crimson: False 2024-08-19T00:36:38.358 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-19T00:36:38.358 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:38.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-19T00:36:38.420 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:38.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-19T00:36:38.513 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:38.511+0000 7f5715932040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:36:38.517 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:38.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-19T00:36:38.534 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:38.533+0000 7fc21e798040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:36:38.571 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:38.569+0000 7f5715932040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:36:38.593 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:36:38.593 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-19T00:36:38.600 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:38.598+0000 7fc21e798040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:36:38.656 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:38.657 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-19T00:36:38.696 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:38.694+0000 7f5715932040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:36:38.714 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:38.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-19T00:36:38.729 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:38.727+0000 7fc21e798040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:36:38.811 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:38.811 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-19T00:36:38.844 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:38.842+0000 7f5715932040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:36:38.874 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:38.873+0000 7fc21e798040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:36:38.903 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:36:38.903 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-19T00:36:39.004 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc 0 2024-08-19T00:36:39.005 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:39.003+0000 7f5715932040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:36:39.029 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:39.027+0000 7fc21e798040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:36:39.127 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:39.124+0000 7f5715932040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:36:39.145 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:39.144+0000 7fc21e798040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:36:39.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.156+0000 7fb819600640 1 Processor -- start 2024-08-19T00:36:39.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.156+0000 7fb819600640 1 -- start start 2024-08-19T00:36:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.157+0000 7fb819600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb8140b5130 0x7fb8140aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.157+0000 7fb819600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb81415c390 0x7fb8140af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.157+0000 7fb819600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8140acef0 con 0x7fb81415bfb0 2024-08-19T00:36:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.157+0000 7fb819600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb8140af650 con 0x7fb81415c390 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.157+0000 7fb819600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb8140ad790 con 0x7fb8140b5130 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.158+0000 7fb812000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb8140b5130 0x7fb8140aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.158+0000 7fb812000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb8140b5130 0x7fb8140aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45426/0 (socket says 172.21.15.162:45426) 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.158+0000 7fb812000640 1 -- 172.21.15.162:0/4046645453 learned_addr learned my addr 172.21.15.162:0/4046645453 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.158+0000 7fb813400640 1 --2- 172.21.15.162:0/4046645453 >> v2:172.21.15.7:3300/0 conn(0x7fb81415c390 0x7fb8140af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.158+0000 7fb811600640 1 -- 172.21.15.162:0/4046645453 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976470742 0 0) 0x7fb8140acef0 con 0x7fb81415bfb0 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.158+0000 7fb811600640 1 -- 172.21.15.162:0/4046645453 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f8003520 con 0x7fb81415bfb0 2024-08-19T00:36:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.158+0000 7fb813400640 1 -- 172.21.15.162:0/4046645453 >> v2:172.21.15.162:3300/0 conn(0x7fb8140b5130 msgr2=0x7fb8140aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:39.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.159+0000 7fb813400640 1 --2- 172.21.15.162:0/4046645453 >> v2:172.21.15.162:3300/0 conn(0x7fb8140b5130 0x7fb8140aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.159+0000 7fb813400640 1 -- 172.21.15.162:0/4046645453 >> v1:172.21.15.162:6789/0 conn(0x7fb81415bfb0 legacy=0x7fb8140b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.159+0000 7fb813400640 1 -- 172.21.15.162:0/4046645453 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8140ad1d0 con 0x7fb81415c390 2024-08-19T00:36:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.160+0000 7fb813400640 1 --2- 172.21.15.162:0/4046645453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415c390 0x7fb8140af110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8140b4710 tx=0x7fb80c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c477092c341d84bb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.160+0000 7fb811600640 1 -- 172.21.15.162:0/4046645453 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c007740 con 0x7fb81415c390 2024-08-19T00:36:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.160+0000 7fb811600640 1 -- 172.21.15.162:0/4046645453 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c0078e0 con 0x7fb81415c390 2024-08-19T00:36:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.160+0000 7fb811600640 1 -- 172.21.15.162:0/4046645453 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c007cb0 con 0x7fb81415c390 2024-08-19T00:36:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 -- 172.21.15.162:0/4046645453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415c390 msgr2=0x7fb8140af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 --2- 172.21.15.162:0/4046645453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415c390 0x7fb8140af110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8140b4710 tx=0x7fb80c02a680 comp rx=0 tx=0).stop 2024-08-19T00:36:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 -- 172.21.15.162:0/4046645453 shutdown_connections 2024-08-19T00:36:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 --2- 172.21.15.162:0/4046645453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415c390 0x7fb8140af110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 --2- 172.21.15.162:0/4046645453 >> v2:172.21.15.162:3300/0 conn(0x7fb8140b5130 0x7fb8140aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 -- 172.21.15.162:0/4046645453 >> 172.21.15.162:0/4046645453 conn(0x7fb8140b2300 msgr2=0x7fb81406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 -- 172.21.15.162:0/4046645453 shutdown_connections 2024-08-19T00:36:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.161+0000 7fb819600640 1 -- 172.21.15.162:0/4046645453 wait complete. 2024-08-19T00:36:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.162+0000 7fb819600640 1 Processor -- start 2024-08-19T00:36:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.162+0000 7fb819600640 1 -- start start 2024-08-19T00:36:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.163+0000 7fb819600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8140b5130 0x7fb8140b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.163+0000 7fb819600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415bfb0 0x7fb81415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.163+0000 7fb819600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb81415c390 0x7fb81414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.163+0000 7fb819600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb814072040 con 0x7fb81415bfb0 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.163+0000 7fb819600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb814071b20 con 0x7fb81415c390 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.163+0000 7fb819600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8140721c0 con 0x7fb8140b5130 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb812a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8140b5130 0x7fb8140b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb81415c390 0x7fb81414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb81415c390 0x7fb81414f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45432/0 (socket says 172.21.15.162:45432) 2024-08-19T00:36:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb812a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8140b5130 0x7fb8140b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:33880/0 (socket says 172.21.15.162:33880) 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 -- 172.21.15.162:0/2793253252 learned_addr learned my addr 172.21.15.162:0/2793253252 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb812000640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415bfb0 0x7fb81415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 -- 172.21.15.162:0/2793253252 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8140b5130 msgr2=0x7fb8140b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8140b5130 0x7fb8140b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 -- 172.21.15.162:0/2793253252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415bfb0 msgr2=0x7fb81415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415bfb0 0x7fb81415efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 -- 172.21.15.162:0/2793253252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81415e230 con 0x7fb81415c390 2024-08-19T00:36:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb812000640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415bfb0 0x7fb81415efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.164+0000 7fb813400640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb81415c390 0x7fb81414f9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02ac70 tx=0x7fb80c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.165+0000 7fb80aa00640 1 -- 172.21.15.162:0/2793253252 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c03f070 con 0x7fb81415c390 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.165+0000 7fb80aa00640 1 -- 172.21.15.162:0/2793253252 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c031bc0 con 0x7fb81415c390 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.165+0000 7fb80aa00640 1 -- 172.21.15.162:0/2793253252 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c009450 con 0x7fb81415c390 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.165+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81415e4d0 con 0x7fb81415c390 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.165+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81415c7c0 con 0x7fb81415c390 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.165+0000 7fb80aa00640 1 -- 172.21.15.162:0/2793253252 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb80c044460 con 0x7fb81415c390 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.165+0000 7fb80aa00640 1 -- 172.21.15.162:0/2793253252 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb80c03b410 con 0x7fb81415c390 2024-08-19T00:36:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.166+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8140b3e00 con 0x7fb81415c390 2024-08-19T00:36:39.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.169+0000 7fb80aa00640 1 -- 172.21.15.162:0/2793253252 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fb80c03b610 con 0x7fb81415c390 2024-08-19T00:36:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.241+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc", "id": 0} v 0) -- 0x7fb814157830 con 0x7fb81415c390 2024-08-19T00:36:39.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.248+0000 7fb80aa00640 1 -- 172.21.15.162:0/2793253252 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb80c044930 con 0x7fb81415c390 2024-08-19T00:36:39.251 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-08-19T00:36:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.249+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb81415c390 msgr2=0x7fb81414f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.249+0000 7fb819600640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb81415c390 0x7fb81414f9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02ac70 tx=0x7fb80c004a40 comp rx=0 tx=0).stop 2024-08-19T00:36:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.249+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 shutdown_connections 2024-08-19T00:36:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.249+0000 7fb819600640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb81415c390 0x7fb81414f9c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.249+0000 7fb819600640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb81415bfb0 0x7fb81415efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.249+0000 7fb819600640 1 --2- 172.21.15.162:0/2793253252 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8140b5130 0x7fb8140b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.249+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 >> 172.21.15.162:0/2793253252 conn(0x7fb8140b2300 msgr2=0x7fb814156aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:39.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.250+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 shutdown_connections 2024-08-19T00:36:39.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.250+0000 7fb819600640 1 -- 172.21.15.162:0/2793253252 wait complete. 2024-08-19T00:36:39.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 37a20e1a-8471-471a-986e-1d0baa51e986 1 2024-08-19T00:36:39.326 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:39.325+0000 7fc21e798040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:36:39.329 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:39.327+0000 7f5715932040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:36:39.378 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:39.376+0000 7fc21e798040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:36:39.382 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:39.380+0000 7f5715932040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:36:39.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.416+0000 7efe86a00640 1 Processor -- start 2024-08-19T00:36:39.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.417+0000 7efe86a00640 1 -- start start 2024-08-19T00:36:39.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe800b4f40 0x7efe800d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe800cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe800cee00 con 0x7efe800d4180 2024-08-19T00:36:39.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7efe800cf6d0 con 0x7efe800b4f40 2024-08-19T00:36:39.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe800d3020 con 0x7efe800b0e80 2024-08-19T00:36:39.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe85600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7efe800d4180 0x7efe800d4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41510/0 (socket says 172.21.15.162:41510) 2024-08-19T00:36:39.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe85600640 1 -- 172.21.15.162:0/1557829592 learned_addr learned my addr 172.21.15.162:0/1557829592 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-19T00:36:39.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86000640 1 --2- 172.21.15.162:0/1557829592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe800cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe84c00640 1 --2- 172.21.15.162:0/1557829592 >> v2:172.21.15.7:3300/0 conn(0x7efe800b4f40 0x7efe800d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe7fe00640 1 -- 172.21.15.162:0/1557829592 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166641646 0 0) 0x7efe74001110 con 0x7efe800d4180 2024-08-19T00:36:39.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86000640 1 -- 172.21.15.162:0/1557829592 >> v2:172.21.15.7:3300/0 conn(0x7efe800b4f40 msgr2=0x7efe800d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:39.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86000640 1 --2- 172.21.15.162:0/1557829592 >> v2:172.21.15.7:3300/0 conn(0x7efe800b4f40 0x7efe800d27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.418+0000 7efe86000640 1 -- 172.21.15.162:0/1557829592 >> v1:172.21.15.162:6789/0 conn(0x7efe800d4180 legacy=0x7efe800d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.419+0000 7efe86000640 1 -- 172.21.15.162:0/1557829592 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe800cf080 con 0x7efe800b0e80 2024-08-19T00:36:39.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.419+0000 7efe84c00640 1 --2- 172.21.15.162:0/1557829592 >> v2:172.21.15.7:3300/0 conn(0x7efe800b4f40 0x7efe800d27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:39.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.420+0000 7efe86000640 1 --2- 172.21.15.162:0/1557829592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe800cfb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe78009d90 tx=0x7efe7802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=959aab91e483b334 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.420+0000 7efe7fe00640 1 -- 172.21.15.162:0/1557829592 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78007740 con 0x7efe800b0e80 2024-08-19T00:36:39.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.420+0000 7efe7fe00640 1 -- 172.21.15.162:0/1557829592 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe780078e0 con 0x7efe800b0e80 2024-08-19T00:36:39.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.420+0000 7efe7fe00640 1 -- 172.21.15.162:0/1557829592 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78007cb0 con 0x7efe800b0e80 2024-08-19T00:36:39.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 -- 172.21.15.162:0/1557829592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 msgr2=0x7efe800cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 --2- 172.21.15.162:0/1557829592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe800cfb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe78009d90 tx=0x7efe7802a660 comp rx=0 tx=0).stop 2024-08-19T00:36:39.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 -- 172.21.15.162:0/1557829592 shutdown_connections 2024-08-19T00:36:39.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 --2- 172.21.15.162:0/1557829592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe800cfb60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 --2- 172.21.15.162:0/1557829592 >> v2:172.21.15.7:3300/0 conn(0x7efe800b4f40 0x7efe800d27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 -- 172.21.15.162:0/1557829592 >> 172.21.15.162:0/1557829592 conn(0x7efe8008dc00 msgr2=0x7efe8009d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:39.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 -- 172.21.15.162:0/1557829592 shutdown_connections 2024-08-19T00:36:39.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.421+0000 7efe86a00640 1 -- 172.21.15.162:0/1557829592 wait complete. 2024-08-19T00:36:39.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.423+0000 7efe86a00640 1 Processor -- start 2024-08-19T00:36:39.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.423+0000 7efe86a00640 1 -- start start 2024-08-19T00:36:39.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe86a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe80155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe86a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800b4f40 0x7efe801574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe86a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe800d4180 0x7efe80157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe86a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe8015e730 con 0x7efe800b4f40 2024-08-19T00:36:39.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe86a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe800d2d10 con 0x7efe800d4180 2024-08-19T00:36:39.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe86a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe800b1310 con 0x7efe800b0e80 2024-08-19T00:36:39.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe85600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe80155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe85600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe80155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:33896/0 (socket says 172.21.15.162:33896) 2024-08-19T00:36:39.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe85600640 1 -- 172.21.15.162:0/1119485791 learned_addr learned my addr 172.21.15.162:0/1119485791 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:39.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe84c00640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800b4f40 0x7efe801574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe86000640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe800d4180 0x7efe80157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe85600640 1 -- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe800d4180 msgr2=0x7efe80157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe85600640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe800d4180 0x7efe80157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe85600640 1 -- 172.21.15.162:0/1119485791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800b4f40 msgr2=0x7efe801574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.424+0000 7efe85600640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800b4f40 0x7efe801574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe85600640 1 -- 172.21.15.162:0/1119485791 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe800b7ee0 con 0x7efe800b0e80 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe84c00640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800b4f40 0x7efe801574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:39.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe85600640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe80155570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c430 tx=0x7efe7400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe7d600640 1 -- 172.21.15.162:0/1119485791 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe740074e0 con 0x7efe800b0e80 2024-08-19T00:36:39.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe7d600640 1 -- 172.21.15.162:0/1119485791 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe740047e0 con 0x7efe800b0e80 2024-08-19T00:36:39.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe800b8420 con 0x7efe800b0e80 2024-08-19T00:36:39.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe7d600640 1 -- 172.21.15.162:0/1119485791 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74004bd0 con 0x7efe800b0e80 2024-08-19T00:36:39.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe800b89e0 con 0x7efe800b0e80 2024-08-19T00:36:39.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.425+0000 7efe7d600640 1 -- 172.21.15.162:0/1119485791 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe74011070 con 0x7efe800b0e80 2024-08-19T00:36:39.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.426+0000 7efe7d600640 1 -- 172.21.15.162:0/1119485791 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efe74013770 con 0x7efe800b0e80 2024-08-19T00:36:39.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.426+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe800d27d0 con 0x7efe800b0e80 2024-08-19T00:36:39.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.429+0000 7efe7d600640 1 -- 172.21.15.162:0/1119485791 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7efe800cee00 con 0x7efe800b0e80 2024-08-19T00:36:39.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.501+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "37a20e1a-8471-471a-986e-1d0baa51e986", "id": 1} v 0) -- 0x7efe800b8e00 con 0x7efe800b0e80 2024-08-19T00:36:39.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.504+0000 7efe7d600640 1 -- 172.21.15.162:0/1119485791 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37a20e1a-8471-471a-986e-1d0baa51e986", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efe74013970 con 0x7efe800b0e80 2024-08-19T00:36:39.507 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.505+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 msgr2=0x7efe80155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.505+0000 7efe86a00640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe80155570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c430 tx=0x7efe7400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.506+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 shutdown_connections 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.506+0000 7efe86a00640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe800d4180 0x7efe80157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.506+0000 7efe86a00640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800b4f40 0x7efe801574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.506+0000 7efe86a00640 1 --2- 172.21.15.162:0/1119485791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe800b0e80 0x7efe80155570 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.506+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 >> 172.21.15.162:0/1119485791 conn(0x7efe8008dc00 msgr2=0x7efe800d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:39.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.506+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 shutdown_connections 2024-08-19T00:36:39.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.506+0000 7efe86a00640 1 -- 172.21.15.162:0/1119485791 wait complete. 2024-08-19T00:36:39.523 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new ff5da9bd-3c2b-4158-8eb1-30991bc3337f 2 2024-08-19T00:36:39.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.671+0000 7fee5f200640 1 Processor -- start 2024-08-19T00:36:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.671+0000 7fee5f200640 1 -- start start 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee6015e3e0 0x7fee600b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fee600d27b0 0x7fee600d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5f200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee600b4df0 con 0x7fee600b4150 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fee600d3140 con 0x7fee6015e3e0 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fee600b50d0 con 0x7fee600d27b0 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee57e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fee600d27b0 0x7fee600d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5e800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fee600b4150 0x7fee600b45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41518/0 (socket says 172.21.15.162:41518) 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee57e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fee600d27b0 0x7fee600d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45448/0 (socket says 172.21.15.162:45448) 2024-08-19T00:36:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5e800640 1 -- 172.21.15.162:0/1093238794 learned_addr learned my addr 172.21.15.162:0/1093238794 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.672+0000 7fee5de00640 1 --2- 172.21.15.162:0/1093238794 >> v2:172.21.15.7:3300/0 conn(0x7fee6015e3e0 0x7fee600b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.673+0000 7fee57e00640 1 -- 172.21.15.162:0/1093238794 >> v2:172.21.15.7:3300/0 conn(0x7fee6015e3e0 msgr2=0x7fee600b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.673+0000 7fee57e00640 1 --2- 172.21.15.162:0/1093238794 >> v2:172.21.15.7:3300/0 conn(0x7fee6015e3e0 0x7fee600b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.673+0000 7fee57e00640 1 -- 172.21.15.162:0/1093238794 >> v1:172.21.15.162:6789/0 conn(0x7fee600b4150 legacy=0x7fee600b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.673+0000 7fee57e00640 1 -- 172.21.15.162:0/1093238794 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee600cf1e0 con 0x7fee600d27b0 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.673+0000 7fee5d400640 1 -- 172.21.15.162:0/1093238794 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987200772 0 0) 0x7fee600b4df0 con 0x7fee600b4150 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.674+0000 7fee57e00640 1 --2- 172.21.15.162:0/1093238794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee600d27b0 0x7fee600d2c00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee480097a0 tx=0x7fee4802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c8b52892b83ae2f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5d400640 1 -- 172.21.15.162:0/1093238794 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48037070 con 0x7fee600d27b0 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5d400640 1 -- 172.21.15.162:0/1093238794 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee48032440 con 0x7fee600d27b0 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5d400640 1 -- 172.21.15.162:0/1093238794 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48032810 con 0x7fee600d27b0 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 -- 172.21.15.162:0/1093238794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee600d27b0 msgr2=0x7fee600d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 --2- 172.21.15.162:0/1093238794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee600d27b0 0x7fee600d2c00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee480097a0 tx=0x7fee4802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 -- 172.21.15.162:0/1093238794 shutdown_connections 2024-08-19T00:36:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 --2- 172.21.15.162:0/1093238794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee600d27b0 0x7fee600d2c00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 --2- 172.21.15.162:0/1093238794 >> v2:172.21.15.7:3300/0 conn(0x7fee6015e3e0 0x7fee600b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 -- 172.21.15.162:0/1093238794 >> 172.21.15.162:0/1093238794 conn(0x7fee6008dbe0 msgr2=0x7fee6009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 -- 172.21.15.162:0/1093238794 shutdown_connections 2024-08-19T00:36:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.675+0000 7fee5f200640 1 -- 172.21.15.162:0/1093238794 wait complete. 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.677+0000 7fee5f200640 1 Processor -- start 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.677+0000 7fee5f200640 1 -- start start 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee600b4150 0x7fee6015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee600d27b0 0x7fee600cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6015e3e0 0x7fee60152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee600b13a0 con 0x7fee600b4150 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee600cee90 con 0x7fee6015e3e0 2024-08-19T00:36:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee600cf9e0 con 0x7fee600d27b0 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee57e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee600d27b0 0x7fee600cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6015e3e0 0x7fee60152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee5de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee600b4150 0x7fee6015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee57e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee600d27b0 0x7fee600cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:33910/0 (socket says 172.21.15.162:33910) 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.678+0000 7fee57e00640 1 -- 172.21.15.162:0/3576137774 learned_addr learned my addr 172.21.15.162:0/3576137774 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee57e00640 1 -- 172.21.15.162:0/3576137774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6015e3e0 msgr2=0x7fee60152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee57e00640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6015e3e0 0x7fee60152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee57e00640 1 -- 172.21.15.162:0/3576137774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee600b4150 msgr2=0x7fee6015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee57e00640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee600b4150 0x7fee6015fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee57e00640 1 -- 172.21.15.162:0/3576137774 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee600cb9a0 con 0x7fee600d27b0 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee5de00640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee600b4150 0x7fee6015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee57e00640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee600d27b0 0x7fee600cb2a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee480098c0 tx=0x7fee480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee56000640 1 -- 172.21.15.162:0/3576137774 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48037040 con 0x7fee600d27b0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee56000640 1 -- 172.21.15.162:0/3576137774 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee48030500 con 0x7fee600d27b0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee56000640 1 -- 172.21.15.162:0/3576137774 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480308d0 con 0x7fee600d27b0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee600cbc80 con 0x7fee600d27b0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.679+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee600ccc40 con 0x7fee600d27b0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.680+0000 7fee56000640 1 -- 172.21.15.162:0/3576137774 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee48044020 con 0x7fee600d27b0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.680+0000 7fee56000640 1 -- 172.21.15.162:0/3576137774 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fee48030e00 con 0x7fee600d27b0 2024-08-19T00:36:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.680+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee600cce40 con 0x7fee600d27b0 2024-08-19T00:36:39.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.683+0000 7fee56000640 1 -- 172.21.15.162:0/3576137774 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fee600cce40 con 0x7fee600d27b0 2024-08-19T00:36:39.738 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:39.737+0000 7fc21e798040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:36:39.753 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:39.751+0000 7f5715932040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:36:39.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.752+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ff5da9bd-3c2b-4158-8eb1-30991bc3337f", "id": 2} v 0) -- 0x7fee600d2c00 con 0x7fee600d27b0 2024-08-19T00:36:39.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.756+0000 7fee56000640 1 -- 172.21.15.162:0/3576137774 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff5da9bd-3c2b-4158-8eb1-30991bc3337f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fee4803bb60 con 0x7fee600d27b0 2024-08-19T00:36:39.759 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee600d27b0 msgr2=0x7fee600cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee600d27b0 0x7fee600cb2a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee480098c0 tx=0x7fee480046c0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 shutdown_connections 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6015e3e0 0x7fee60152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee600d27b0 0x7fee600cb2a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 --2- 172.21.15.162:0/3576137774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee600b4150 0x7fee6015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 >> 172.21.15.162:0/3576137774 conn(0x7fee6008dbe0 msgr2=0x7fee600b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.757+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 shutdown_connections 2024-08-19T00:36:39.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.758+0000 7fee5f200640 1 -- 172.21.15.162:0/3576137774 wait complete. 2024-08-19T00:36:39.774 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new e9997f2b-63c5-4954-ae2f-487458ffe118 3 2024-08-19T00:36:39.796 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:39.795+0000 7fc21e798040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:36:39.813 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:39.811+0000 7f5715932040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:36:39.861 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:39.859+0000 7fc21e798040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:36:39.880 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:39.878+0000 7f5715932040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:36:39.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.923+0000 7f6c99200640 1 Processor -- start 2024-08-19T00:36:39.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.923+0000 7f6c99200640 1 -- start start 2024-08-19T00:36:39.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.924+0000 7f6c99200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c940b0e80 0x7f6c940cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.924+0000 7f6c99200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c940cee00 con 0x7f6c940b4f40 2024-08-19T00:36:39.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.924+0000 7f6c99200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c940d3020 con 0x7f6c940d4180 2024-08-19T00:36:39.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.924+0000 7f6c99200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6c940cf6d0 con 0x7f6c940b0e80 2024-08-19T00:36:39.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.924+0000 7f6c93400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6c940d4180 0x7f6c940d4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41534/0 (socket says 172.21.15.162:41534) 2024-08-19T00:36:39.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.924+0000 7f6c93400640 1 -- 172.21.15.162:0/596059357 learned_addr learned my addr 172.21.15.162:0/596059357 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-19T00:36:39.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.924+0000 7f6c93e00640 1 --2- 172.21.15.162:0/596059357 >> v2:172.21.15.7:3300/0 conn(0x7f6c940b0e80 0x7f6c940cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.925+0000 7f6c92000640 1 -- 172.21.15.162:0/596059357 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093955835 0 0) 0x7f6c940d3020 con 0x7f6c940d4180 2024-08-19T00:36:39.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.925+0000 7f6c92000640 1 -- 172.21.15.162:0/596059357 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c78003520 con 0x7f6c940d4180 2024-08-19T00:36:39.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.925+0000 7f6c93e00640 1 -- 172.21.15.162:0/596059357 >> v1:172.21.15.162:6789/0 conn(0x7f6c940d4180 legacy=0x7f6c940d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.925+0000 7f6c93e00640 1 -- 172.21.15.162:0/596059357 >> v1:172.21.15.7:6789/0 conn(0x7f6c940b4f40 legacy=0x7f6c940d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.925+0000 7f6c92000640 1 -- 172.21.15.162:0/596059357 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50594247 0 0) 0x7f6c80001110 con 0x7f6c940b4f40 2024-08-19T00:36:39.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.925+0000 7f6c93e00640 1 -- 172.21.15.162:0/596059357 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c940cf080 con 0x7f6c940b0e80 2024-08-19T00:36:39.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.927+0000 7f6c93e00640 1 --2- 172.21.15.162:0/596059357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c940cfb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009d90 tx=0x7f6c8c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662ea3b6674325aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.927+0000 7f6c92000640 1 -- 172.21.15.162:0/596059357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c007740 con 0x7f6c940b0e80 2024-08-19T00:36:39.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.927+0000 7f6c92000640 1 -- 172.21.15.162:0/596059357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c0078e0 con 0x7f6c940b0e80 2024-08-19T00:36:39.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.927+0000 7f6c92000640 1 -- 172.21.15.162:0/596059357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c007cb0 con 0x7f6c940b0e80 2024-08-19T00:36:39.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.928+0000 7f6c99200640 1 -- 172.21.15.162:0/596059357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 msgr2=0x7f6c940cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.928+0000 7f6c99200640 1 --2- 172.21.15.162:0/596059357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c940cfb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009d90 tx=0x7f6c8c02a6f0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.928+0000 7f6c99200640 1 -- 172.21.15.162:0/596059357 shutdown_connections 2024-08-19T00:36:39.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.928+0000 7f6c99200640 1 --2- 172.21.15.162:0/596059357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c940cfb60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.928+0000 7f6c99200640 1 -- 172.21.15.162:0/596059357 >> 172.21.15.162:0/596059357 conn(0x7f6c9408dc00 msgr2=0x7f6c9409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:39.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.928+0000 7f6c99200640 1 -- 172.21.15.162:0/596059357 shutdown_connections 2024-08-19T00:36:39.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.928+0000 7f6c99200640 1 -- 172.21.15.162:0/596059357 wait complete. 2024-08-19T00:36:39.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.929+0000 7f6c99200640 1 Processor -- start 2024-08-19T00:36:39.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.930+0000 7f6c99200640 1 -- start start 2024-08-19T00:36:39.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.930+0000 7f6c99200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c94157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c99200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c940b4f40 0x7f6c941582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c99200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c940d4180 0x7f6c940ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:39.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c99200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940b1310 con 0x7f6c940b0e80 2024-08-19T00:36:39.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c99200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9415e730 con 0x7f6c940b4f40 2024-08-19T00:36:39.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c99200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c940b1490 con 0x7f6c940d4180 2024-08-19T00:36:39.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c92a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c940b4f40 0x7f6c941582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c93400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c94157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c93400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c94157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.162:35848/0 (socket says 172.21.15.162:35848) 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c93400640 1 -- 172.21.15.162:0/3510902892 learned_addr learned my addr 172.21.15.162:0/3510902892 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c92a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c940b4f40 0x7f6c941582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45468/0 (socket says 172.21.15.162:45468) 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c93e00640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c940d4180 0x7f6c940ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c92a00640 1 -- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c940d4180 msgr2=0x7f6c940ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c92a00640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c940d4180 0x7f6c940ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c92a00640 1 -- 172.21.15.162:0/3510902892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 msgr2=0x7f6c94157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c92a00640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c94157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:39.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c92a00640 1 -- 172.21.15.162:0/3510902892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c940cadc0 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.931+0000 7f6c93400640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c94157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c92a00640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c940b4f40 0x7f6c941582c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c750 tx=0x7f6c8000cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c8b400640 1 -- 172.21.15.162:0/3510902892 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80017070 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c8b400640 1 -- 172.21.15.162:0/3510902892 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c80005070 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c8b400640 1 -- 172.21.15.162:0/3510902892 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000a640 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c940b9860 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c94157870 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c8b400640 1 -- 172.21.15.162:0/3510902892 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c8001a070 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.932+0000 7f6c8b400640 1 -- 172.21.15.162:0/3510902892 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6c80003da0 con 0x7f6c940b4f40 2024-08-19T00:36:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.933+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c940d27d0 con 0x7f6c940b4f40 2024-08-19T00:36:39.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:39.938+0000 7f6c8b400640 1 -- 172.21.15.162:0/3510902892 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f6c80021070 con 0x7f6c940b4f40 2024-08-19T00:36:40.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.009+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e9997f2b-63c5-4954-ae2f-487458ffe118", "id": 3} v 0) -- 0x7f6c940b5ac0 con 0x7f6c940b4f40 2024-08-19T00:36:40.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.013+0000 7f6c8b400640 1 -- 172.21.15.162:0/3510902892 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9997f2b-63c5-4954-ae2f-487458ffe118", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6c940cee00 con 0x7f6c940b4f40 2024-08-19T00:36:40.019 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-08-19T00:36:40.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.014+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c940b4f40 msgr2=0x7f6c941582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.014+0000 7f6c99200640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c940b4f40 0x7f6c941582c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c750 tx=0x7f6c8000cc10 comp rx=0 tx=0).stop 2024-08-19T00:36:40.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.014+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 shutdown_connections 2024-08-19T00:36:40.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.014+0000 7f6c99200640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c940d4180 0x7f6c940ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.014+0000 7f6c99200640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c940b4f40 0x7f6c941582c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.014+0000 7f6c99200640 1 --2- 172.21.15.162:0/3510902892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c940b0e80 0x7f6c94157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.014+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 >> 172.21.15.162:0/3510902892 conn(0x7f6c9408dc00 msgr2=0x7f6c940cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.015+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 shutdown_connections 2024-08-19T00:36:40.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.015+0000 7f6c99200640 1 -- 172.21.15.162:0/3510902892 wait complete. 2024-08-19T00:36:40.030 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.029+0000 7fc21e798040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:36:40.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new a2f296b5-5e28-4a5d-8cb0-baa5a74c56da 4 2024-08-19T00:36:40.055 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.053+0000 7f5715932040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:36:40.085 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.084+0000 7fc21e798040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:36:40.112 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.110+0000 7f5715932040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:36:40.147 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.146+0000 7fc21e798040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:36:40.176 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.174+0000 7f5715932040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:36:40.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.204+0000 7ff2cfe00640 1 Processor -- start 2024-08-19T00:36:40.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.205+0000 7ff2cfe00640 1 -- start start 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c8158cd0 0x7ff2c8072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff2c8072ff0 0x7ff2c80add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cfe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c80aeae0 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c8073430 con 0x7ff2c8072ff0 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cfe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c80aedc0 con 0x7ff2c8158cd0 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c8158cd0 0x7ff2c8072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c8158cd0 0x7ff2c8072ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:33924/0 (socket says 172.21.15.162:33924) 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cd400640 1 -- 172.21.15.162:0/3645741823 learned_addr learned my addr 172.21.15.162:0/3645741823 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.206+0000 7ff2cca00640 1 --2- 172.21.15.162:0/3645741823 >> v2:172.21.15.162:3300/0 conn(0x7ff2c8072ff0 0x7ff2c80add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.207+0000 7ff2cd400640 1 -- 172.21.15.162:0/3645741823 >> v2:172.21.15.162:3300/0 conn(0x7ff2c8072ff0 msgr2=0x7ff2c80add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.207+0000 7ff2cd400640 1 --2- 172.21.15.162:0/3645741823 >> v2:172.21.15.162:3300/0 conn(0x7ff2c8072ff0 0x7ff2c80add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.207+0000 7ff2cd400640 1 -- 172.21.15.162:0/3645741823 >> v1:172.21.15.162:6789/0 conn(0x7ff2c80ae2b0 legacy=0x7ff2c815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.207+0000 7ff2cd400640 1 -- 172.21.15.162:0/3645741823 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c80af0a0 con 0x7ff2c8158cd0 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.208+0000 7ff2cd400640 1 --2- 172.21.15.162:0/3645741823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c8158cd0 0x7ff2c8072ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80735b0 tx=0x7ff2bc02a120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5875e3afe5cd992 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.208+0000 7ff2c7e00640 1 -- 172.21.15.162:0/3645741823 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc037070 con 0x7ff2c8158cd0 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.208+0000 7ff2c7e00640 1 -- 172.21.15.162:0/3645741823 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc032440 con 0x7ff2c8158cd0 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.208+0000 7ff2c7e00640 1 -- 172.21.15.162:0/3645741823 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc032810 con 0x7ff2c8158cd0 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 -- 172.21.15.162:0/3645741823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c8158cd0 msgr2=0x7ff2c8072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 --2- 172.21.15.162:0/3645741823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c8158cd0 0x7ff2c8072ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80735b0 tx=0x7ff2bc02a120 comp rx=0 tx=0).stop 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 -- 172.21.15.162:0/3645741823 shutdown_connections 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 --2- 172.21.15.162:0/3645741823 >> v2:172.21.15.162:3300/0 conn(0x7ff2c8072ff0 0x7ff2c80add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 --2- 172.21.15.162:0/3645741823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c8158cd0 0x7ff2c8072ab0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 -- 172.21.15.162:0/3645741823 >> 172.21.15.162:0/3645741823 conn(0x7ff2c80b2300 msgr2=0x7ff2c806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 -- 172.21.15.162:0/3645741823 shutdown_connections 2024-08-19T00:36:40.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.209+0000 7ff2cfe00640 1 -- 172.21.15.162:0/3645741823 wait complete. 2024-08-19T00:36:40.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.210+0000 7ff2cfe00640 1 Processor -- start 2024-08-19T00:36:40.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.210+0000 7ff2cfe00640 1 -- start start 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.211+0000 7ff2cfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c8072ff0 0x7ff2c809c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.211+0000 7ff2cfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c80ae2b0 0x7ff2c80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.211+0000 7ff2cfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c809c590 0x7ff2c80cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.211+0000 7ff2cfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c80ae700 con 0x7ff2c8072ff0 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.211+0000 7ff2cfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c80af660 con 0x7ff2c809c590 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.211+0000 7ff2cfe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c80ae880 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c80ae2b0 0x7ff2c80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c80ae2b0 0x7ff2c80cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:33928/0 (socket says 172.21.15.162:33928) 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 -- 172.21.15.162:0/1065504630 learned_addr learned my addr 172.21.15.162:0/1065504630 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:40.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cd400640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c8072ff0 0x7ff2c809c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cde00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c809c590 0x7ff2c80cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 -- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c809c590 msgr2=0x7ff2c80cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c809c590 0x7ff2c80cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 -- 172.21.15.162:0/1065504630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c8072ff0 msgr2=0x7ff2c809c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c8072ff0 0x7ff2c809c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 -- 172.21.15.162:0/1065504630 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c809daf0 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.212+0000 7ff2cca00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c80ae2b0 0x7ff2c80cd9c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400e9e0 tx=0x7ff2b400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.213+0000 7ff2c5600640 1 -- 172.21.15.162:0/1065504630 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4017070 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.213+0000 7ff2c5600640 1 -- 172.21.15.162:0/1065504630 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b400c9d0 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.213+0000 7ff2c5600640 1 -- 172.21.15.162:0/1065504630 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400cdc0 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.213+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c809ca50 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.213+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c809d010 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.213+0000 7ff2c5600640 1 -- 172.21.15.162:0/1065504630 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2b401a070 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.213+0000 7ff2c5600640 1 -- 172.21.15.162:0/1065504630 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff2b4006660 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.214+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c80b41f0 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.216+0000 7ff2c5600640 1 -- 172.21.15.162:0/1065504630 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7ff2b4006020 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.291+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2f296b5-5e28-4a5d-8cb0-baa5a74c56da", "id": 4} v 0) -- 0x7ff2c80cfd30 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.294+0000 7ff2c5600640 1 -- 172.21.15.162:0/1065504630 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2f296b5-5e28-4a5d-8cb0-baa5a74c56da", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff2b4005990 con 0x7ff2c80ae2b0 2024-08-19T00:36:40.297 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-08-19T00:36:40.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.295+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c80ae2b0 msgr2=0x7ff2c80cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.295+0000 7ff2cfe00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c80ae2b0 0x7ff2c80cd9c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400e9e0 tx=0x7ff2b400eea0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.295+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 shutdown_connections 2024-08-19T00:36:40.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.295+0000 7ff2cfe00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c809c590 0x7ff2c80cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.295+0000 7ff2cfe00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c80ae2b0 0x7ff2c80cd9c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.295+0000 7ff2cfe00640 1 --2- 172.21.15.162:0/1065504630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c8072ff0 0x7ff2c809c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.295+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 >> 172.21.15.162:0/1065504630 conn(0x7ff2c80b2300 msgr2=0x7ff2c80afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.296+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 shutdown_connections 2024-08-19T00:36:40.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.296+0000 7ff2cfe00640 1 -- 172.21.15.162:0/1065504630 wait complete. 2024-08-19T00:36:40.312 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 359ca72a-0433-4537-9118-0cdd55860290 5 2024-08-19T00:36:40.328 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.326+0000 7fc21e798040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:36:40.359 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.357+0000 7f5715932040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:36:40.399 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.398+0000 7fc21e798040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:36:40.432 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.429+0000 7f5715932040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:36:40.454 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.453+0000 7fc21e798040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:36:40.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.461+0000 7f0dcd800640 1 Processor -- start 2024-08-19T00:36:40.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.461+0000 7f0dcd800640 1 -- start start 2024-08-19T00:36:40.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dcd800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc80d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dcd800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0dc80b0e80 0x7f0dc80cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dcd800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc80cee00 con 0x7f0dc80d4180 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dcd800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc80cf6d0 con 0x7f0dc80b0e80 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dcd800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc80d3020 con 0x7f0dc80b4f40 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dc7e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0dc80d4180 0x7f0dc80d4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41544/0 (socket says 172.21.15.162:41544) 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dc7e00640 1 -- 172.21.15.162:0/3973164706 learned_addr learned my addr 172.21.15.162:0/3973164706 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dbfe00640 1 --2- 172.21.15.162:0/3973164706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc80d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dcce00640 1 --2- 172.21.15.162:0/3973164706 >> v2:172.21.15.7:3300/0 conn(0x7f0dc80b0e80 0x7f0dc80cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dc7400640 1 -- 172.21.15.162:0/3973164706 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272951390 0 0) 0x7f0db8001110 con 0x7f0dc80d4180 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dbfe00640 1 -- 172.21.15.162:0/3973164706 >> v2:172.21.15.7:3300/0 conn(0x7f0dc80b0e80 msgr2=0x7f0dc80cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:40.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dbfe00640 1 --2- 172.21.15.162:0/3973164706 >> v2:172.21.15.7:3300/0 conn(0x7f0dc80b0e80 0x7f0dc80cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dbfe00640 1 -- 172.21.15.162:0/3973164706 >> v1:172.21.15.162:6789/0 conn(0x7f0dc80d4180 legacy=0x7f0dc80d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.463+0000 7f0dbfe00640 1 -- 172.21.15.162:0/3973164706 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc80cf080 con 0x7f0dc80b4f40 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.464+0000 7f0dbfe00640 1 --2- 172.21.15.162:0/3973164706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc80d27d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0db00097a0 tx=0x7f0db002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1523e2c579a8809 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dc7400640 1 -- 172.21.15.162:0/3973164706 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0037070 con 0x7f0dc80b4f40 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dc7400640 1 -- 172.21.15.162:0/3973164706 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db0032440 con 0x7f0dc80b4f40 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dc7400640 1 -- 172.21.15.162:0/3973164706 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0032810 con 0x7f0dc80b4f40 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dcd800640 1 -- 172.21.15.162:0/3973164706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 msgr2=0x7f0dc80d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dcd800640 1 --2- 172.21.15.162:0/3973164706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc80d27d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0db00097a0 tx=0x7f0db002a180 comp rx=0 tx=0).stop 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dcd800640 1 -- 172.21.15.162:0/3973164706 shutdown_connections 2024-08-19T00:36:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dcd800640 1 --2- 172.21.15.162:0/3973164706 >> v2:172.21.15.7:3300/0 conn(0x7f0dc80b0e80 0x7f0dc80cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dcd800640 1 --2- 172.21.15.162:0/3973164706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc80d27d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.465+0000 7f0dcd800640 1 -- 172.21.15.162:0/3973164706 >> 172.21.15.162:0/3973164706 conn(0x7f0dc808dc00 msgr2=0x7f0dc809d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.466+0000 7f0dcd800640 1 -- 172.21.15.162:0/3973164706 shutdown_connections 2024-08-19T00:36:40.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.466+0000 7f0dcd800640 1 -- 172.21.15.162:0/3973164706 wait complete. 2024-08-19T00:36:40.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.467+0000 7f0dcd800640 1 Processor -- start 2024-08-19T00:36:40.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.467+0000 7f0dcd800640 1 -- start start 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dcd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dc80b0e80 0x7f0dc80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dcd800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc8154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dcd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc80d4180 0x7f0dc80cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dcd800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc815e730 con 0x7f0dc80b0e80 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dcd800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc80d2d10 con 0x7f0dc80d4180 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dcd800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc80b1330 con 0x7f0dc80b4f40 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dbfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc8154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dbfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc8154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:33958/0 (socket says 172.21.15.162:33958) 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.468+0000 7f0dbfe00640 1 -- 172.21.15.162:0/2012225741 learned_addr learned my addr 172.21.15.162:0/2012225741 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dc7e00640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dc80b0e80 0x7f0dc80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dcce00640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc80d4180 0x7f0dc80cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dbfe00640 1 -- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc80d4180 msgr2=0x7f0dc80cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dbfe00640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc80d4180 0x7f0dc80cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dbfe00640 1 -- 172.21.15.162:0/2012225741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dc80b0e80 msgr2=0x7f0dc80b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dbfe00640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dc80b0e80 0x7f0dc80b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dbfe00640 1 -- 172.21.15.162:0/2012225741 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc8153ef0 con 0x7f0dc80b4f40 2024-08-19T00:36:40.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dbfe00640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc8154560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0db0035040 tx=0x7f0db00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.469+0000 7f0dc4c00640 1 -- 172.21.15.162:0/2012225741 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0037040 con 0x7f0dc80b4f40 2024-08-19T00:36:40.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.470+0000 7f0dc4c00640 1 -- 172.21.15.162:0/2012225741 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db0030500 con 0x7f0dc80b4f40 2024-08-19T00:36:40.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.470+0000 7f0dc4c00640 1 -- 172.21.15.162:0/2012225741 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0030910 con 0x7f0dc80b4f40 2024-08-19T00:36:40.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.470+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc80cddb0 con 0x7f0dc80b4f40 2024-08-19T00:36:40.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.470+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc80b8cf0 con 0x7f0dc80b4f40 2024-08-19T00:36:40.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.470+0000 7f0dc4c00640 1 -- 172.21.15.162:0/2012225741 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0db0044020 con 0x7f0dc80b4f40 2024-08-19T00:36:40.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.470+0000 7f0dc4c00640 1 -- 172.21.15.162:0/2012225741 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0db003b9b0 con 0x7f0dc80b4f40 2024-08-19T00:36:40.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.471+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc80d27d0 con 0x7f0dc80b4f40 2024-08-19T00:36:40.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.473+0000 7f0dc4c00640 1 -- 172.21.15.162:0/2012225741 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f0db003b430 con 0x7f0dc80b4f40 2024-08-19T00:36:40.490 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.488+0000 7f5715932040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:36:40.524 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.523+0000 7fc21e798040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:36:40.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.545+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "359ca72a-0433-4537-9118-0cdd55860290", "id": 5} v 0) -- 0x7f0dc80b5ac0 con 0x7f0dc80b4f40 2024-08-19T00:36:40.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.549+0000 7f0dc4c00640 1 -- 172.21.15.162:0/2012225741 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "359ca72a-0433-4537-9118-0cdd55860290", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0db003b610 con 0x7f0dc80b4f40 2024-08-19T00:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-08-19T00:36:40.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 msgr2=0x7f0dc8154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc8154560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0db0035040 tx=0x7f0db00046c0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 shutdown_connections 2024-08-19T00:36:40.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc80d4180 0x7f0dc80cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc80b4f40 0x7f0dc8154560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 --2- 172.21.15.162:0/2012225741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dc80b0e80 0x7f0dc80b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 >> 172.21.15.162:0/2012225741 conn(0x7f0dc808dc00 msgr2=0x7f0dc80d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 shutdown_connections 2024-08-19T00:36:40.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.550+0000 7f0dcd800640 1 -- 172.21.15.162:0/2012225741 wait complete. 2024-08-19T00:36:40.566 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20 6 2024-08-19T00:36:40.570 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.567+0000 7f5715932040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:36:40.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.713+0000 7ffab7e00640 1 Processor -- start 2024-08-19T00:36:40.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.714+0000 7ffab7e00640 1 -- start start 2024-08-19T00:36:40.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffab80d27b0 0x7ffab80d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab80b4150 0x7ffab80b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab80b4b20 con 0x7ffab815e3e0 2024-08-19T00:36:40.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab7e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ffab80d3140 con 0x7ffab80d27b0 2024-08-19T00:36:40.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab7e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80b4df0 con 0x7ffab80b4150 2024-08-19T00:36:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffaafe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffab80d27b0 0x7ffab80d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab7400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab80b4150 0x7ffab80b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab6a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ffab815e3e0 0x7ffab80b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41556/0 (socket says 172.21.15.162:41556) 2024-08-19T00:36:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffab6a00640 1 -- 172.21.15.162:0/2367221053 learned_addr learned my addr 172.21.15.162:0/2367221053 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-19T00:36:40.718 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.716+0000 7fc21e798040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:36:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffaafe00640 1 -- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab80b4150 msgr2=0x7ffab80b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffaafe00640 1 --2- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab80b4150 0x7ffab80b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.715+0000 7ffaafe00640 1 -- 172.21.15.162:0/2367221053 >> v1:172.21.15.162:6789/0 conn(0x7ffab815e3e0 legacy=0x7ffab80b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.716+0000 7ffaafe00640 1 -- 172.21.15.162:0/2367221053 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80b50d0 con 0x7ffab80d27b0 2024-08-19T00:36:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.716+0000 7ffab6000640 1 -- 172.21.15.162:0/2367221053 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365130416 0 0) 0x7ffab80b4b20 con 0x7ffab815e3e0 2024-08-19T00:36:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.716+0000 7ffab7400640 1 --2- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab80b4150 0x7ffab80b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.717+0000 7ffaafe00640 1 --2- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80d27b0 0x7ffab80d2c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00097d0 tx=0x7ffaa002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e91500151f20864a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.717+0000 7ffab6000640 1 -- 172.21.15.162:0/2367221053 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0037070 con 0x7ffab80d27b0 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.717+0000 7ffab6000640 1 -- 172.21.15.162:0/2367221053 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa0032440 con 0x7ffab80d27b0 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.717+0000 7ffab6000640 1 -- 172.21.15.162:0/2367221053 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0032810 con 0x7ffab80d27b0 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 -- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80d27b0 msgr2=0x7ffab80d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 --2- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80d27b0 0x7ffab80d2c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00097d0 tx=0x7ffaa002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 -- 172.21.15.162:0/2367221053 shutdown_connections 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 --2- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab80b4150 0x7ffab80b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 --2- 172.21.15.162:0/2367221053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80d27b0 0x7ffab80d2c00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 -- 172.21.15.162:0/2367221053 >> 172.21.15.162:0/2367221053 conn(0x7ffab808dbe0 msgr2=0x7ffab809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 -- 172.21.15.162:0/2367221053 shutdown_connections 2024-08-19T00:36:40.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.718+0000 7ffab7e00640 1 -- 172.21.15.162:0/2367221053 wait complete. 2024-08-19T00:36:40.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.720+0000 7ffab7e00640 1 Processor -- start 2024-08-19T00:36:40.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.720+0000 7ffab7e00640 1 -- start start 2024-08-19T00:36:40.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80b4150 0x7ffab80b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab80d27b0 0x7ffab814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab815e3e0 0x7ffab8160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80cee90 con 0x7ffab80d27b0 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80cf4c0 con 0x7ffab80b4150 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab7e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80cf9e0 con 0x7ffab815e3e0 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80b4150 0x7ffab80b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80b4150 0x7ffab80b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45510/0 (socket says 172.21.15.162:45510) 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 -- 172.21.15.162:0/2633803700 learned_addr learned my addr 172.21.15.162:0/2633803700 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab7400640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab815e3e0 0x7ffab8160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffaafe00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab80d27b0 0x7ffab814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 -- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab815e3e0 msgr2=0x7ffab8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab815e3e0 0x7ffab8160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 -- 172.21.15.162:0/2633803700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab80d27b0 msgr2=0x7ffab814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab80d27b0 0x7ffab814e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.721+0000 7ffab6a00640 1 -- 172.21.15.162:0/2633803700 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80cbeb0 con 0x7ffab80b4150 2024-08-19T00:36:40.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffab6a00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80b4150 0x7ffab80b9bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800c430 tx=0x7ffaa800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffaaf400640 1 -- 172.21.15.162:0/2633803700 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80074e0 con 0x7ffab80b4150 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffaaf400640 1 -- 172.21.15.162:0/2633803700 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa80047e0 con 0x7ffab80b4150 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab80b7b60 con 0x7ffab80b4150 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffaaf400640 1 -- 172.21.15.162:0/2633803700 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8004bd0 con 0x7ffab80b4150 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab80cc190 con 0x7ffab80b4150 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffaaf400640 1 -- 172.21.15.162:0/2633803700 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffaa8011070 con 0x7ffab80b4150 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.722+0000 7ffaaf400640 1 -- 172.21.15.162:0/2633803700 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7ffaa8004d70 con 0x7ffab80b4150 2024-08-19T00:36:40.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.724+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab80d2c00 con 0x7ffab80b4150 2024-08-19T00:36:40.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.726+0000 7ffaaf400640 1 -- 172.21.15.162:0/2633803700 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7ffaa801d3f0 con 0x7ffab80b4150 2024-08-19T00:36:40.768 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.766+0000 7f5715932040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:36:40.772 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.770+0000 7fc21e798040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:36:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.797+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20", "id": 6} v 0) -- 0x7ffab80b2db0 con 0x7ffab80b4150 2024-08-19T00:36:40.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.801+0000 7ffaaf400640 1 -- 172.21.15.162:0/2633803700 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7ffaa801d5d0 con 0x7ffab80b4150 2024-08-19T00:36:40.804 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-08-19T00:36:40.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80b4150 msgr2=0x7ffab80b9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80b4150 0x7ffab80b9bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800c430 tx=0x7ffaa800c830 comp rx=0 tx=0).stop 2024-08-19T00:36:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 shutdown_connections 2024-08-19T00:36:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab815e3e0 0x7ffab8160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab80d27b0 0x7ffab814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 --2- 172.21.15.162:0/2633803700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab80b4150 0x7ffab80b9bc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 >> 172.21.15.162:0/2633803700 conn(0x7ffab808dbe0 msgr2=0x7ffab80b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 shutdown_connections 2024-08-19T00:36:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.803+0000 7ffab7e00640 1 -- 172.21.15.162:0/2633803700 wait complete. 2024-08-19T00:36:40.825 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 0cab8784-a187-4554-839b-cafdd13963f4 7 2024-08-19T00:36:40.831 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:40.829+0000 7f5715932040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:36:40.973 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:40.972+0000 7fc21e798040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:36:40.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.975+0000 7f412dc00640 1 Processor -- start 2024-08-19T00:36:40.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.975+0000 7f412dc00640 1 -- start start 2024-08-19T00:36:40.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f412815bd70 0x7f4128072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f412806dd10 0x7f412815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41280733f0 con 0x7f4128072f70 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412dc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f41280736d0 con 0x7f412815bd70 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41280739b0 con 0x7f412806dd10 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f412806dd10 0x7f412815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f4127e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f412815bd70 0x7f4128072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f412806dd10 0x7f412815cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:51596/0 (socket says 172.21.15.162:51596) 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f412d200640 1 -- 172.21.15.162:0/2766176059 learned_addr learned my addr 172.21.15.162:0/2766176059 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.976+0000 7f4127400640 1 --1- 172.21.15.162:0/2766176059 >> v1:172.21.15.7:6789/0 conn(0x7f4128072f70 0x7f412806d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.162:55362/0 (socket says 172.21.15.162:55362) 2024-08-19T00:36:40.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.977+0000 7f412d200640 1 -- 172.21.15.162:0/2766176059 >> v2:172.21.15.7:3300/0 conn(0x7f412815bd70 msgr2=0x7f4128072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:40.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.977+0000 7f412d200640 1 --2- 172.21.15.162:0/2766176059 >> v2:172.21.15.7:3300/0 conn(0x7f412815bd70 0x7f4128072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.977+0000 7f412d200640 1 -- 172.21.15.162:0/2766176059 >> v1:172.21.15.7:6789/0 conn(0x7f4128072f70 legacy=0x7f412806d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.977+0000 7f412d200640 1 -- 172.21.15.162:0/2766176059 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412815c4a0 con 0x7f412806dd10 2024-08-19T00:36:40.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.977+0000 7f4126a00640 1 -- 172.21.15.162:0/2766176059 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106755207 0 0) 0x7f41280733f0 con 0x7f4128072f70 2024-08-19T00:36:40.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.978+0000 7f412d200640 1 --2- 172.21.15.162:0/2766176059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f412806dd10 0x7f412815cca0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4120009e50 tx=0x7f412002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf003187cf69ba6c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f4126a00640 1 -- 172.21.15.162:0/2766176059 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120036070 con 0x7f412806dd10 2024-08-19T00:36:40.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f4126a00640 1 -- 172.21.15.162:0/2766176059 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4120031600 con 0x7f412806dd10 2024-08-19T00:36:40.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f4126a00640 1 -- 172.21.15.162:0/2766176059 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200319d0 con 0x7f412806dd10 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f412dc00640 1 -- 172.21.15.162:0/2766176059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f412806dd10 msgr2=0x7f412815cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f412dc00640 1 --2- 172.21.15.162:0/2766176059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f412806dd10 0x7f412815cca0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4120009e50 tx=0x7f412002a710 comp rx=0 tx=0).stop 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f412dc00640 1 -- 172.21.15.162:0/2766176059 shutdown_connections 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f412dc00640 1 --2- 172.21.15.162:0/2766176059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f412806dd10 0x7f412815cca0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f412dc00640 1 --2- 172.21.15.162:0/2766176059 >> v2:172.21.15.7:3300/0 conn(0x7f412815bd70 0x7f4128072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f412dc00640 1 -- 172.21.15.162:0/2766176059 >> 172.21.15.162:0/2766176059 conn(0x7f412806b850 msgr2=0x7f412806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.979+0000 7f412dc00640 1 -- 172.21.15.162:0/2766176059 shutdown_connections 2024-08-19T00:36:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.980+0000 7f412dc00640 1 -- 172.21.15.162:0/2766176059 wait complete. 2024-08-19T00:36:40.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.981+0000 7f412dc00640 1 Processor -- start 2024-08-19T00:36:40.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.981+0000 7f412dc00640 1 -- start start 2024-08-19T00:36:40.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f412806dd10 0x7f4128152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4128072f70 0x7f4128157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412815bd70 0x7f41280b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:40.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f412806e3a0 con 0x7f412806dd10 2024-08-19T00:36:40.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f412815c150 con 0x7f412815bd70 2024-08-19T00:36:40.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f412806e520 con 0x7f4128072f70 2024-08-19T00:36:40.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f4127400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4128072f70 0x7f4128157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f4127e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f412806dd10 0x7f4128152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412815bd70 0x7f41280b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f4127e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f412806dd10 0x7f4128152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.162:36108/0 (socket says 172.21.15.162:36108) 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f412d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412815bd70 0x7f41280b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:50784/0 (socket says 172.21.15.162:50784) 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.982+0000 7f4127e00640 1 -- 172.21.15.162:0/3812321011 learned_addr learned my addr 172.21.15.162:0/3812321011 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f4127e00640 1 -- 172.21.15.162:0/3812321011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4128072f70 msgr2=0x7f4128157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f4127e00640 1 --2- 172.21.15.162:0/3812321011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4128072f70 0x7f4128157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f4127e00640 1 -- 172.21.15.162:0/3812321011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412815bd70 msgr2=0x7f41280b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f4127e00640 1 --2- 172.21.15.162:0/3812321011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412815bd70 0x7f41280b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f4127e00640 1 -- 172.21.15.162:0/3812321011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41281f3560 con 0x7f412806dd10 2024-08-19T00:36:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f4127e00640 1 --2- 172.21.15.162:0/3812321011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f412806dd10 0x7f4128152ae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f411800e9e0 tx=0x7f411800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f411fe00640 1 -- 172.21.15.162:0/3812321011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118017070 con 0x7f412806dd10 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f411fe00640 1 -- 172.21.15.162:0/3812321011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411800c9d0 con 0x7f412806dd10 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f411fe00640 1 -- 172.21.15.162:0/3812321011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411800cdc0 con 0x7f412806dd10 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.983+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281f37f0 con 0x7f412806dd10 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.984+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281f3db0 con 0x7f412806dd10 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.984+0000 7f411fe00640 1 -- 172.21.15.162:0/3812321011 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f411801a070 con 0x7f412806dd10 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.984+0000 7f411fe00640 1 -- 172.21.15.162:0/3812321011 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f4118006660 con 0x7f412806dd10 2024-08-19T00:36:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.985+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41281f44d0 con 0x7f412806dd10 2024-08-19T00:36:40.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:40.987+0000 7f411fe00640 1 -- 172.21.15.162:0/3812321011 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f4118005990 con 0x7f412806dd10 2024-08-19T00:36:41.040 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:41.038+0000 7f5715932040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:36:41.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.058+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0cab8784-a187-4554-839b-cafdd13963f4", "id": 7} v 0) -- 0x7f412806c860 con 0x7f412806dd10 2024-08-19T00:36:41.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.061+0000 7f411fe00640 1 -- 172.21.15.162:0/3812321011 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cab8784-a187-4554-839b-cafdd13963f4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f4118005b70 con 0x7f412806dd10 2024-08-19T00:36:41.063 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-08-19T00:36:41.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f412806dd10 msgr2=0x7f4128152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:41.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 --2- 172.21.15.162:0/3812321011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f412806dd10 0x7f4128152ae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f411800e9e0 tx=0x7f411800eea0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 shutdown_connections 2024-08-19T00:36:41.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 --2- 172.21.15.162:0/3812321011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412815bd70 0x7f41280b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 --2- 172.21.15.162:0/3812321011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4128072f70 0x7f4128157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 --2- 172.21.15.162:0/3812321011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f412806dd10 0x7f4128152ae0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 >> 172.21.15.162:0/3812321011 conn(0x7f412806b850 msgr2=0x7f41281591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:41.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 shutdown_connections 2024-08-19T00:36:41.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:36:41.062+0000 7f412dc00640 1 -- 172.21.15.162:0/3812321011 wait complete. 2024-08-19T00:36:41.079 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-19T00:36:41.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-19T00:36:41.083 INFO:tasks.ceph.osd.0:Started 2024-08-19T00:36:41.083 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-19T00:36:41.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-19T00:36:41.087 INFO:tasks.ceph.osd.1:Started 2024-08-19T00:36:41.087 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-19T00:36:41.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-19T00:36:41.091 INFO:tasks.ceph.osd.2:Started 2024-08-19T00:36:41.091 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-19T00:36:41.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-19T00:36:41.096 INFO:tasks.ceph.osd.3:Started 2024-08-19T00:36:41.096 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-19T00:36:41.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-19T00:36:41.123 INFO:tasks.ceph.osd.4:Started 2024-08-19T00:36:41.123 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-19T00:36:41.124 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-19T00:36:41.129 INFO:tasks.ceph.osd.5:Started 2024-08-19T00:36:41.129 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-19T00:36:41.129 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-19T00:36:41.133 INFO:tasks.ceph.osd.6:Started 2024-08-19T00:36:41.133 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-19T00:36:41.133 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-19T00:36:41.138 INFO:tasks.ceph.osd.7:Started 2024-08-19T00:36:41.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:36:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.346+0000 7f3926e00640 1 Processor -- start 2024-08-19T00:36:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.346+0000 7f3926e00640 1 -- start start 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3926e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3920140640 0x7f392006d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3926e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f39200ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3926e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392015e930 con 0x7f392013dc30 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3926e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f39201413f0 con 0x7f3920140640 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3926e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f392015ec10 con 0x7f392006db40 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3925a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f392013dc30 0x7f3920140ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33096/0 (socket says 172.21.15.7:33096) 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3925a00640 1 -- 172.21.15.7:0/4253421689 learned_addr learned my addr 172.21.15.7:0/4253421689 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3925000640 1 --2- 172.21.15.7:0/4253421689 >> v2:172.21.15.162:3300/0 conn(0x7f3920140640 0x7f392006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.347+0000 7f3926400640 1 --2- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f39200ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:41.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.348+0000 7f3925000640 1 -- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 msgr2=0x7f39200ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:41.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.348+0000 7f3925000640 1 --2- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f39200ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.348+0000 7f391fe00640 1 -- 172.21.15.7:0/4253421689 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193645472 0 0) 0x7f392015e930 con 0x7f392013dc30 2024-08-19T00:36:41.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.348+0000 7f3925000640 1 -- 172.21.15.7:0/4253421689 >> v1:172.21.15.7:6789/0 conn(0x7f392013dc30 legacy=0x7f3920140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:41.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.348+0000 7f3925000640 1 -- 172.21.15.7:0/4253421689 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392015eef0 con 0x7f3920140640 2024-08-19T00:36:41.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.349+0000 7f3925000640 1 --2- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 0x7f392006d600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f390c0097a0 tx=0x7f390c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d87a38491e3ca65 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:41.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.349+0000 7f391fe00640 1 -- 172.21.15.7:0/4253421689 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c037070 con 0x7f3920140640 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.349+0000 7f391fe00640 1 -- 172.21.15.7:0/4253421689 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c032440 con 0x7f3920140640 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.349+0000 7f391fe00640 1 -- 172.21.15.7:0/4253421689 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c032810 con 0x7f3920140640 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 -- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 msgr2=0x7f392006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 --2- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 0x7f392006d600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f390c0097a0 tx=0x7f390c02a180 comp rx=0 tx=0).stop 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 -- 172.21.15.7:0/4253421689 shutdown_connections 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 --2- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f39200ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 --2- 172.21.15.7:0/4253421689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 0x7f392006d600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 -- 172.21.15.7:0/4253421689 >> 172.21.15.7:0/4253421689 conn(0x7f392006b850 msgr2=0x7f392006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 -- 172.21.15.7:0/4253421689 shutdown_connections 2024-08-19T00:36:41.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.350+0000 7f3926e00640 1 -- 172.21.15.7:0/4253421689 wait complete. 2024-08-19T00:36:41.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.352+0000 7f3926e00640 1 Processor -- start 2024-08-19T00:36:41.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.352+0000 7f3926e00640 1 -- start start 2024-08-19T00:36:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3926e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f392013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3926e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392013dc30 0x7f39200aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3926e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 0x7f39201ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3926e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f392013e010 con 0x7f392013dc30 2024-08-19T00:36:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3926e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f392015f4b0 con 0x7f3920140640 2024-08-19T00:36:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3926e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f392013e190 con 0x7f392006db40 2024-08-19T00:36:41.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392013dc30 0x7f39200aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f392013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392013dc30 0x7f39200aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35280/0 (socket says 172.21.15.7:35280) 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925000640 1 -- 172.21.15.7:0/985587972 learned_addr learned my addr 172.21.15.7:0/985587972 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3926400640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 0x7f39201ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925a00640 1 -- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 msgr2=0x7f39201ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925a00640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 0x7f39201ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925a00640 1 -- 172.21.15.7:0/985587972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392013dc30 msgr2=0x7f39200aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925a00640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392013dc30 0x7f39200aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.353+0000 7f3925a00640 1 -- 172.21.15.7:0/985587972 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200b32c0 con 0x7f392006db40 2024-08-19T00:36:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.354+0000 7f3925a00640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f392013cea0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f391400c450 tx=0x7f391400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.354+0000 7f391d600640 1 -- 172.21.15.7:0/985587972 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914018070 con 0x7f392006db40 2024-08-19T00:36:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.354+0000 7f391d600640 1 -- 172.21.15.7:0/985587972 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39140074e0 con 0x7f392006db40 2024-08-19T00:36:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.354+0000 7f391d600640 1 -- 172.21.15.7:0/985587972 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914004a20 con 0x7f392006db40 2024-08-19T00:36:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.354+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39200a9850 con 0x7f392006db40 2024-08-19T00:36:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.354+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f392013d3e0 con 0x7f392006db40 2024-08-19T00:36:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.354+0000 7f391d600640 1 -- 172.21.15.7:0/985587972 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3914004bc0 con 0x7f392006db40 2024-08-19T00:36:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.355+0000 7f391d600640 1 -- 172.21.15.7:0/985587972 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f391401ba30 con 0x7f392006db40 2024-08-19T00:36:41.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.355+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39200ce820 con 0x7f392006db40 2024-08-19T00:36:41.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.358+0000 7f391d600640 1 -- 172.21.15.7:0/985587972 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f391401bcd0 con 0x7f392006db40 2024-08-19T00:36:41.360 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:41.358+0000 7fc21e798040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:36:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.421+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f392006e520 con 0x7f392006db40 2024-08-19T00:36:41.423 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:41.421+0000 7f5715932040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:36:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.422+0000 7f391d600640 1 -- 172.21.15.7:0/985587972 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f391401b360 con 0x7f392006db40 2024-08-19T00:36:41.424 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:41.424 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:36:41.060811+0000","last_up_change":"0.000000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 msgr2=0x7f392013cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f392013cea0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f391400c450 tx=0x7f391400c910 comp rx=0 tx=0).stop 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 shutdown_connections 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3920140640 0x7f39201ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392013dc30 0x7f39200aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 --2- 172.21.15.7:0/985587972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392006db40 0x7f392013cea0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 >> 172.21.15.7:0/985587972 conn(0x7f392006b850 msgr2=0x7f39200afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 shutdown_connections 2024-08-19T00:36:41.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:41.423+0000 7f3926e00640 1 -- 172.21.15.7:0/985587972 wait complete. 2024-08-19T00:36:41.439 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-19T00:36:41.439 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-19T00:36:41.786 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-08-19T00:36:41.785+0000 7f72e820f640 -1 Falling back to public interface 2024-08-19T00:36:41.787 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-08-19T00:36:41.785+0000 7ffbdfa10640 -1 Falling back to public interface 2024-08-19T00:36:41.795 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-08-19T00:36:41.794+0000 7fbf5d2f0640 -1 Falling back to public interface 2024-08-19T00:36:41.797 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-08-19T00:36:41.795+0000 7f648eefd640 -1 Falling back to public interface 2024-08-19T00:36:41.803 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-19T00:36:41.801+0000 7f06f6b50640 -1 Falling back to public interface 2024-08-19T00:36:41.804 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-19T00:36:41.802+0000 7f340aa63640 -1 Falling back to public interface 2024-08-19T00:36:41.821 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:41.820+0000 7fc21e798040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:36:41.844 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-19T00:36:41.842+0000 7f93e9414640 -1 Falling back to public interface 2024-08-19T00:36:41.852 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-19T00:36:41.850+0000 7fe5a8223640 -1 Falling back to public interface 2024-08-19T00:36:41.866 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:41.864+0000 7f5715932040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:36:41.871 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:41.869+0000 7fc21e798040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:36:41.915 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:41.913+0000 7f5715932040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:36:41.924 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:41.923+0000 7fc21e798040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:36:41.967 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-19T00:36:41.965+0000 7f5715932040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:36:42.246 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-19T00:36:42.387 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.386+0000 7f91e7200640 1 Processor -- start 2024-08-19T00:36:42.388 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.386+0000 7f91e7200640 1 -- start start 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.387+0000 7f91e7200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91e00add10 0x7f91e00ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.387+0000 7f91e7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e00ccd50 0x7f91e00cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.387+0000 7f91e7200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e006e920 con 0x7f91e015c090 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.387+0000 7f91e7200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f91e00ae6a0 con 0x7f91e00add10 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.387+0000 7f91e7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91e00b3cd0 con 0x7f91e00ccd50 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91d7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91e00add10 0x7f91e00ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91d7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91e00add10 0x7f91e00ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35290/0 (socket says 172.21.15.7:35290) 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91d7e00640 1 -- 172.21.15.7:0/2547569371 learned_addr learned my addr 172.21.15.7:0/2547569371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91e5200640 1 --2- 172.21.15.7:0/2547569371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e00ccd50 0x7f91e00cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91d7e00640 1 -- 172.21.15.7:0/2547569371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e00ccd50 msgr2=0x7f91e00cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:42.390 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91d7e00640 1 --2- 172.21.15.7:0/2547569371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e00ccd50 0x7f91e00cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.391 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91d7e00640 1 -- 172.21.15.7:0/2547569371 >> v1:172.21.15.162:6789/0 conn(0x7f91e015c090 legacy=0x7f91e006e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:42.391 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91d7e00640 1 -- 172.21.15.7:0/2547569371 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e00b3fb0 con 0x7f91e00add10 2024-08-19T00:36:42.391 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.388+0000 7f91df400640 1 -- 172.21.15.7:0/2547569371 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640612873 0 0) 0x7f91e006e920 con 0x7f91e015c090 2024-08-19T00:36:42.392 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.389+0000 7f91d7e00640 1 --2- 172.21.15.7:0/2547569371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00add10 0x7f91e00ae160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009870 tx=0x7f91c802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0172a9e2184e3ab server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:42.392 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.389+0000 7f91df400640 1 -- 172.21.15.7:0/2547569371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8037070 con 0x7f91e00add10 2024-08-19T00:36:42.392 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91df400640 1 -- 172.21.15.7:0/2547569371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c8032440 con 0x7f91e00add10 2024-08-19T00:36:42.392 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91df400640 1 -- 172.21.15.7:0/2547569371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8032810 con 0x7f91e00add10 2024-08-19T00:36:42.392 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 -- 172.21.15.7:0/2547569371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00add10 msgr2=0x7f91e00ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:42.392 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 --2- 172.21.15.7:0/2547569371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00add10 0x7f91e00ae160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009870 tx=0x7f91c802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.392 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 -- 172.21.15.7:0/2547569371 shutdown_connections 2024-08-19T00:36:42.393 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 --2- 172.21.15.7:0/2547569371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e00ccd50 0x7f91e00cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.393 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 --2- 172.21.15.7:0/2547569371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00add10 0x7f91e00ae160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.393 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 -- 172.21.15.7:0/2547569371 >> 172.21.15.7:0/2547569371 conn(0x7f91e00b2070 msgr2=0x7f91e00b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:42.393 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 -- 172.21.15.7:0/2547569371 shutdown_connections 2024-08-19T00:36:42.393 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.390+0000 7f91e7200640 1 -- 172.21.15.7:0/2547569371 wait complete. 2024-08-19T00:36:42.393 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.392+0000 7f91e7200640 1 Processor -- start 2024-08-19T00:36:42.393 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.392+0000 7f91e7200640 1 -- start start 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91e7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e00add10 0x7f91e00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91e7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00ccd50 0x7f91e00c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91e7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e015c090 0x7f91e00c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91e7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f91e00b4850 con 0x7f91e00ccd50 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91e7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91e00b4570 con 0x7f91e00add10 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91e7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91e015c470 con 0x7f91e015c090 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00ccd50 0x7f91e00c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00ccd50 0x7f91e00c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35306/0 (socket says 172.21.15.7:35306) 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91d7e00640 1 -- 172.21.15.7:0/2360977636 learned_addr learned my addr 172.21.15.7:0/2360977636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:42.396 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91dfe00640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e00add10 0x7f91e00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.393+0000 7f91e5200640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e015c090 0x7f91e00c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91d7e00640 1 -- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e015c090 msgr2=0x7f91e00c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91d7e00640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e015c090 0x7f91e00c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91d7e00640 1 -- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e00add10 msgr2=0x7f91e00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91d7e00640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e00add10 0x7f91e00ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91d7e00640 1 -- 172.21.15.7:0/2360977636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e00cae60 con 0x7f91e00ccd50 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91d7e00640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00ccd50 0x7f91e00c9510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91c8000c00 tx=0x7f91c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91dcc00640 1 -- 172.21.15.7:0/2360977636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8037040 con 0x7f91e00ccd50 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91dcc00640 1 -- 172.21.15.7:0/2360977636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c8042070 con 0x7f91e00ccd50 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91dcc00640 1 -- 172.21.15.7:0/2360977636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8030880 con 0x7f91e00ccd50 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e00ceaa0 con 0x7f91e00ccd50 2024-08-19T00:36:42.397 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.394+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e00ca660 con 0x7f91e00ccd50 2024-08-19T00:36:42.398 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.395+0000 7f91dcc00640 1 -- 172.21.15.7:0/2360977636 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f91c802ad10 con 0x7f91e00ccd50 2024-08-19T00:36:42.398 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.395+0000 7f91dcc00640 1 -- 172.21.15.7:0/2360977636 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f91c8030a20 con 0x7f91e00ccd50 2024-08-19T00:36:42.398 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.396+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e00ad330 con 0x7f91e00ccd50 2024-08-19T00:36:42.400 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.398+0000 7f91dcc00640 1 -- 172.21.15.7:0/2360977636 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f91c8047460 con 0x7f91e00ccd50 2024-08-19T00:36:42.462 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.460+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91e00cf8f0 con 0x7f91e00ccd50 2024-08-19T00:36:42.462 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.461+0000 7f91dcc00640 1 -- 172.21.15.7:0/2360977636 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f91c8030d40 con 0x7f91e00ccd50 2024-08-19T00:36:42.463 INFO:teuthology.misc.health.smithi007.stdout: 2024-08-19T00:36:42.463 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:36:41.060811+0000","last_up_change":"0.000000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00ccd50 msgr2=0x7f91e00c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00ccd50 0x7f91e00c9510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91c8000c00 tx=0x7f91c80046c0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 shutdown_connections 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91e015c090 0x7f91e00c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e00ccd50 0x7f91e00c9510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 --2- 172.21.15.7:0/2360977636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e00add10 0x7f91e00ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 >> 172.21.15.7:0/2360977636 conn(0x7f91e00b2070 msgr2=0x7f91e01593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 shutdown_connections 2024-08-19T00:36:42.464 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:42.462+0000 7f91e7200640 1 -- 172.21.15.7:0/2360977636 wait complete. 2024-08-19T00:36:42.476 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-19T00:36:44.278 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:44.276+0000 7fc1bec00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-19T00:36:44.279 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-08-19T00:36:44.278+0000 7fc1bec00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-19T00:36:45.380 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-19T00:36:45.377+0000 7f06f6b50640 -1 osd.5 0 log_to_monitors true 2024-08-19T00:36:45.389 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-08-19T00:36:45.388+0000 7f72e820f640 -1 osd.1 0 log_to_monitors true 2024-08-19T00:36:45.402 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-19T00:36:45.400+0000 7f340aa63640 -1 osd.4 0 log_to_monitors true 2024-08-19T00:36:45.412 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-08-19T00:36:45.411+0000 7ffbdfa10640 -1 osd.0 0 log_to_monitors true 2024-08-19T00:36:45.458 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-19T00:36:45.456+0000 7fe5a8223640 -1 osd.7 0 log_to_monitors true 2024-08-19T00:36:45.460 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-19T00:36:45.458+0000 7f93e9414640 -1 osd.6 0 log_to_monitors true 2024-08-19T00:36:45.611 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-08-19T00:36:45.609+0000 7fbf5d2f0640 -1 osd.2 0 log_to_monitors true 2024-08-19T00:36:45.656 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-08-19T00:36:45.655+0000 7f648eefd640 -1 osd.3 0 log_to_monitors true 2024-08-19T00:36:48.996 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-08-19T00:36:48.994+0000 7ffbd9800640 -1 osd.0 0 waiting for initial osdmap 2024-08-19T00:36:49.004 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-08-19T00:36:49.001+0000 7ffbd0200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.009 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-08-19T00:36:49.007+0000 7f72e2200640 -1 osd.1 0 waiting for initial osdmap 2024-08-19T00:36:49.017 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-08-19T00:36:49.014+0000 7f72d8c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.028 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-08-19T00:36:49.025+0000 7f6489400640 -1 osd.3 0 waiting for initial osdmap 2024-08-19T00:36:49.033 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-08-19T00:36:49.031+0000 7f647fe00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.044 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-08-19T00:36:49.042+0000 7fbf59600640 -1 osd.2 0 waiting for initial osdmap 2024-08-19T00:36:49.054 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-08-19T00:36:49.052+0000 7fbf4e200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.282 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-19T00:36:49.423 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.420+0000 7f97e2a00640 1 Processor -- start 2024-08-19T00:36:49.423 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.421+0000 7f97e2a00640 1 -- start start 2024-08-19T00:36:49.424 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97e2a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc15e360 0x7f97dc0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97e2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97dc06f5a0 0x7f97dc0adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97e2a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97dc06f1d0 con 0x7f97dc0ae130 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97e2a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f97dc06ef80 con 0x7f97dc06f5a0 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97e2a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97dc0b3db0 con 0x7f97dc15e360 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97d3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97dc06f5a0 0x7f97dc0adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97d3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97dc06f5a0 0x7f97dc0adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37216/0 (socket says 172.21.15.7:37216) 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97d3e00640 1 -- 172.21.15.7:0/1156852028 learned_addr learned my addr 172.21.15.7:0/1156852028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:49.425 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97dbe00640 1 --2- 172.21.15.7:0/1156852028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc15e360 0x7f97dc0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:49.428 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97d3e00640 1 -- 172.21.15.7:0/1156852028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc15e360 msgr2=0x7f97dc0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:49.428 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97d3e00640 1 --2- 172.21.15.7:0/1156852028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc15e360 0x7f97dc0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.428 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97d3e00640 1 -- 172.21.15.7:0/1156852028 >> v1:172.21.15.162:6789/0 conn(0x7f97dc0ae130 legacy=0x7f97dc161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:49.429 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.422+0000 7f97d3e00640 1 -- 172.21.15.7:0/1156852028 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc0b4090 con 0x7f97dc06f5a0 2024-08-19T00:36:49.429 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.423+0000 7f97d3e00640 1 --2- 172.21.15.7:0/1156852028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc0adbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009870 tx=0x7f97c402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb724dc58cf4776 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:49.429 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97db400640 1 -- 172.21.15.7:0/1156852028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4037070 con 0x7f97dc06f5a0 2024-08-19T00:36:49.429 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97db400640 1 -- 172.21.15.7:0/1156852028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c4032440 con 0x7f97dc06f5a0 2024-08-19T00:36:49.429 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97db400640 1 -- 172.21.15.7:0/1156852028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4032810 con 0x7f97dc06f5a0 2024-08-19T00:36:49.429 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97e2a00640 1 -- 172.21.15.7:0/1156852028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 msgr2=0x7f97dc0adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:49.430 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97e2a00640 1 --2- 172.21.15.7:0/1156852028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc0adbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009870 tx=0x7f97c402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.430 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97e2a00640 1 -- 172.21.15.7:0/1156852028 shutdown_connections 2024-08-19T00:36:49.430 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97e2a00640 1 --2- 172.21.15.7:0/1156852028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc0adbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.430 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97e2a00640 1 --2- 172.21.15.7:0/1156852028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc15e360 0x7f97dc0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.430 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97e2a00640 1 -- 172.21.15.7:0/1156852028 >> 172.21.15.7:0/1156852028 conn(0x7f97dc0b2070 msgr2=0x7f97dc0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:49.430 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.424+0000 7f97e2a00640 1 -- 172.21.15.7:0/1156852028 shutdown_connections 2024-08-19T00:36:49.431 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.425+0000 7f97e2a00640 1 -- 172.21.15.7:0/1156852028 wait complete. 2024-08-19T00:36:49.435 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.426+0000 7f97e2a00640 1 Processor -- start 2024-08-19T00:36:49.435 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.426+0000 7f97e2a00640 1 -- start start 2024-08-19T00:36:49.436 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc14ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:49.436 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97e2a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc0ae130 0x7f97dc15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:49.436 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97e2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc15e360 0x7f97dc152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:49.436 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97e2a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0ae720 con 0x7f97dc06f5a0 2024-08-19T00:36:49.436 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97e2a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0ae5a0 con 0x7f97dc15e360 2024-08-19T00:36:49.436 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97e2a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97dc0734c0 con 0x7f97dc0ae130 2024-08-19T00:36:49.436 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc14ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:49.437 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc14ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37228/0 (socket says 172.21.15.7:37228) 2024-08-19T00:36:49.437 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97dbe00640 1 -- 172.21.15.7:0/740662058 learned_addr learned my addr 172.21.15.7:0/740662058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:49.437 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.427+0000 7f97d3e00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc0ae130 0x7f97dc15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:49.437 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97e0a00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc15e360 0x7f97dc152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:49.437 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97dbe00640 1 -- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc0ae130 msgr2=0x7f97dc15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:49.437 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97dbe00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc0ae130 0x7f97dc15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.437 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97dbe00640 1 -- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc15e360 msgr2=0x7f97dc152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:49.438 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97dbe00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc15e360 0x7f97dc152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.438 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97dbe00640 1 -- 172.21.15.7:0/740662058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc15bea0 con 0x7f97dc06f5a0 2024-08-19T00:36:49.438 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97dbe00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc14ad70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00e9b0 tx=0x7f97cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:49.438 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97d8c00640 1 -- 172.21.15.7:0/740662058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc017070 con 0x7f97dc06f5a0 2024-08-19T00:36:49.438 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97d8c00640 1 -- 172.21.15.7:0/740662058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc00c9a0 con 0x7f97dc06f5a0 2024-08-19T00:36:49.439 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc15c180 con 0x7f97dc06f5a0 2024-08-19T00:36:49.439 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97d8c00640 1 -- 172.21.15.7:0/740662058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00cd90 con 0x7f97dc06f5a0 2024-08-19T00:36:49.439 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.428+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc15c740 con 0x7f97dc06f5a0 2024-08-19T00:36:49.439 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.430+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97dc0adbf0 con 0x7f97dc06f5a0 2024-08-19T00:36:49.439 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.430+0000 7f97d8c00640 1 -- 172.21.15.7:0/740662058 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f97cc01a070 con 0x7f97dc06f5a0 2024-08-19T00:36:49.439 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.431+0000 7f97d8c00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f97b806bdf0 0x7f97b806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:49.440 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.431+0000 7f97d8c00640 1 -- 172.21.15.7:0/740662058 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f97cc08a210 con 0x7f97dc06f5a0 2024-08-19T00:36:49.440 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.431+0000 7f97d3e00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f97b806bdf0 0x7f97b806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:49.440 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.432+0000 7f97d3e00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f97b806bdf0 0x7f97b806e2b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f97c4034000 tx=0x7f97c402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:49.441 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.436+0000 7f97d8c00640 1 -- 172.21.15.7:0/740662058 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f97cc059450 con 0x7f97dc06f5a0 2024-08-19T00:36:49.546 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-19T00:36:49.544+0000 7f3406e00640 -1 osd.4 0 waiting for initial osdmap 2024-08-19T00:36:49.555 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-19T00:36:49.553+0000 7f33fba00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.601 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-19T00:36:49.599+0000 7f93e3200640 -1 osd.6 0 waiting for initial osdmap 2024-08-19T00:36:49.604 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-19T00:36:49.602+0000 7fe5a2600640 -1 osd.7 0 waiting for initial osdmap 2024-08-19T00:36:49.606 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-19T00:36:49.604+0000 7f06f1000640 -1 osd.5 0 waiting for initial osdmap 2024-08-19T00:36:49.607 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-19T00:36:49.605+0000 7f93d9c00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.609 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-19T00:36:49.607+0000 7fe599000640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.621 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-19T00:36:49.619+0000 7f06e7a00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:36:49.629 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.627+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97dc14b530 con 0x7f97dc06f5a0 2024-08-19T00:36:49.630 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.627+0000 7f97d8c00640 1 -- 172.21.15.7:0/740662058 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f97cc05d750 con 0x7f97dc06f5a0 2024-08-19T00:36:49.630 INFO:teuthology.misc.health.smithi007.stdout: 2024-08-19T00:36:49.630 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":12,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:36:47.283293+0000","last_up_change":"0.000000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f97b806bdf0 msgr2=0x7f97b806e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f97b806bdf0 0x7f97b806e2b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f97c4034000 tx=0x7f97c402e000 comp rx=0 tx=0).stop 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 msgr2=0x7f97dc14ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc14ad70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00e9b0 tx=0x7f97cc00ee70 comp rx=0 tx=0).stop 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 shutdown_connections 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f97b806bdf0 0x7f97b806e2b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc15e360 0x7f97dc152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97dc0ae130 0x7f97dc15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 --2- 172.21.15.7:0/740662058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97dc06f5a0 0x7f97dc14ad70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 >> 172.21.15.7:0/740662058 conn(0x7f97dc0b2070 msgr2=0x7f97dc0af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 shutdown_connections 2024-08-19T00:36:49.633 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:49.630+0000 7f97e2a00640 1 -- 172.21.15.7:0/740662058 wait complete. 2024-08-19T00:36:49.646 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-19T00:36:56.452 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-19T00:36:56.600 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.598+0000 7f669ce00640 1 Processor -- start 2024-08-19T00:36:56.601 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.598+0000 7f669ce00640 1 -- start start 2024-08-19T00:36:56.601 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f669ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f66980b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:56.601 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f669ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66980d2060 0x7f66980d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:56.601 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f669ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66980d2e10 con 0x7f669815e390 2024-08-19T00:36:56.602 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f669ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6698162e40 con 0x7f66980d2060 2024-08-19T00:36:56.602 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f669ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66980cf500 con 0x7f66980d4660 2024-08-19T00:36:56.602 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f6697e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66980d2060 0x7f66980d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:56.603 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f6697e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66980d2060 0x7f66980d2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50216/0 (socket says 172.21.15.7:50216) 2024-08-19T00:36:56.603 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f6697e00640 1 -- 172.21.15.7:0/1119197733 learned_addr learned my addr 172.21.15.7:0/1119197733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:56.603 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.599+0000 7f668fe00640 1 --2- 172.21.15.7:0/1119197733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f66980b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:56.603 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.600+0000 7f6697e00640 1 -- 172.21.15.7:0/1119197733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 msgr2=0x7f66980b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:56.603 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.600+0000 7f6697e00640 1 --2- 172.21.15.7:0/1119197733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f66980b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.603 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.600+0000 7f6697e00640 1 -- 172.21.15.7:0/1119197733 >> v1:172.21.15.162:6789/0 conn(0x7f669815e390 legacy=0x7f66980d3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:56.603 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.600+0000 7f6697e00640 1 -- 172.21.15.7:0/1119197733 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66980d30f0 con 0x7f66980d2060 2024-08-19T00:36:56.604 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.601+0000 7f6697e00640 1 --2- 172.21.15.7:0/1119197733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66980d2060 0x7f66980d2510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6690009e50 tx=0x7f669002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a5eff43fc3e146 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:56.604 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.601+0000 7f6696a00640 1 -- 172.21.15.7:0/1119197733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690036070 con 0x7f66980d2060 2024-08-19T00:36:56.604 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.601+0000 7f6696a00640 1 -- 172.21.15.7:0/1119197733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6690031600 con 0x7f66980d2060 2024-08-19T00:36:56.604 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.601+0000 7f6696a00640 1 -- 172.21.15.7:0/1119197733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900319d0 con 0x7f66980d2060 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 -- 172.21.15.7:0/1119197733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66980d2060 msgr2=0x7f66980d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 --2- 172.21.15.7:0/1119197733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66980d2060 0x7f66980d2510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6690009e50 tx=0x7f669002a710 comp rx=0 tx=0).stop 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 -- 172.21.15.7:0/1119197733 shutdown_connections 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 --2- 172.21.15.7:0/1119197733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66980d2060 0x7f66980d2510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 --2- 172.21.15.7:0/1119197733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f66980b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 -- 172.21.15.7:0/1119197733 >> 172.21.15.7:0/1119197733 conn(0x7f669808dc50 msgr2=0x7f669809d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 -- 172.21.15.7:0/1119197733 shutdown_connections 2024-08-19T00:36:56.605 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.602+0000 7f669ce00640 1 -- 172.21.15.7:0/1119197733 wait complete. 2024-08-19T00:36:56.606 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.603+0000 7f669ce00640 1 Processor -- start 2024-08-19T00:36:56.606 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.604+0000 7f669ce00640 1 -- start start 2024-08-19T00:36:56.607 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.604+0000 7f669ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66980d2060 0x7f66980cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.604+0000 7f669ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f6698156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.604+0000 7f669ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669815e390 0x7f669806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.604+0000 7f669ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66980d2a50 con 0x7f669815e390 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.604+0000 7f669ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f669815e770 con 0x7f66980d2060 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.604+0000 7f669ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66980d2bd0 con 0x7f66980d4660 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669815e390 0x7f669806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669815e390 0x7f669806d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50222/0 (socket says 172.21.15.7:50222) 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 -- 172.21.15.7:0/760592586 learned_addr learned my addr 172.21.15.7:0/760592586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f668fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f6698156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697400640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66980d2060 0x7f66980cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 -- 172.21.15.7:0/760592586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 msgr2=0x7f6698156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:56.608 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f6698156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.609 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 -- 172.21.15.7:0/760592586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66980d2060 msgr2=0x7f66980cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:56.609 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66980d2060 0x7f66980cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.609 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 -- 172.21.15.7:0/760592586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66980b7690 con 0x7f669815e390 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.605+0000 7f6697e00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669815e390 0x7f669806d7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6690034040 tx=0x7f6690004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.606+0000 7f668f400640 1 -- 172.21.15.7:0/760592586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690036050 con 0x7f669815e390 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.606+0000 7f668f400640 1 -- 172.21.15.7:0/760592586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6690042070 con 0x7f669815e390 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.606+0000 7f668f400640 1 -- 172.21.15.7:0/760592586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690009510 con 0x7f669815e390 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.606+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66980b7970 con 0x7f669815e390 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.606+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66980b7f30 con 0x7f669815e390 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.607+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66980ceed0 con 0x7f669815e390 2024-08-19T00:36:56.610 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.608+0000 7f668f400640 1 -- 172.21.15.7:0/760592586 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6690007bf0 con 0x7f669815e390 2024-08-19T00:36:56.611 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.609+0000 7f668f400640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f667406be30 0x7f667406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:56.611 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.609+0000 7f668f400640 1 -- 172.21.15.7:0/760592586 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f66900ab7c0 con 0x7f669815e390 2024-08-19T00:36:56.611 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.609+0000 7f6697400640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f667406be30 0x7f667406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:56.612 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.610+0000 7f6697400640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f667406be30 0x7f667406e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f66980b5210 tx=0x7f6688009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:56.616 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.614+0000 7f668f400640 1 -- 172.21.15.7:0/760592586 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6690079e60 con 0x7f669815e390 2024-08-19T00:36:56.801 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.799+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f669815fd90 con 0x7f669815e390 2024-08-19T00:36:56.802 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.800+0000 7f668f400640 1 -- 172.21.15.7:0/760592586 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7f669007e160 con 0x7f669815e390 2024-08-19T00:36:56.802 INFO:teuthology.misc.health.smithi007.stdout: 2024-08-19T00:36:56.803 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":17,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:36:54.020580+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:36:56.804 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f667406be30 msgr2=0x7f667406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f667406be30 0x7f667406e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f66980b5210 tx=0x7f6688009040 comp rx=0 tx=0).stop 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669815e390 msgr2=0x7f669806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669815e390 0x7f669806d7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6690034040 tx=0x7f6690004a40 comp rx=0 tx=0).stop 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 shutdown_connections 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f667406be30 0x7f667406e2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669815e390 0x7f669806d7a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66980d4660 0x7f6698156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 --2- 172.21.15.7:0/760592586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66980d2060 0x7f66980cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 >> 172.21.15.7:0/760592586 conn(0x7f669808dc50 msgr2=0x7f66980d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 shutdown_connections 2024-08-19T00:36:56.805 INFO:teuthology.misc.health.smithi007.stderr:2024-08-19T00:36:56.802+0000 7f669ce00640 1 -- 172.21.15.7:0/760592586 wait complete. 2024-08-19T00:36:56.817 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-19T00:36:56.817 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-19T00:36:56.818 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:36:56.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:36:56.822 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:36:56.822 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:36:56.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:36:56.826 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:36:56.826 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-19T00:36:56.826 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-19T00:36:56.830 INFO:tasks.ceph.mds.b:Started 2024-08-19T00:36:56.830 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-19T00:36:56.830 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-19T00:36:56.834 INFO:tasks.ceph.mds.d:Started 2024-08-19T00:36:56.835 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-19T00:36:56.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:36:56.954 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:36:56.955 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:36:56.969 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:36:56.969 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:36:56.970 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-08-19T00:36:56.969+0000 7fe4dbc00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-08-19T00:36:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.997+0000 7fc5cbc00640 1 Processor -- start 2024-08-19T00:36:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.998+0000 7fc5cbc00640 1 -- start start 2024-08-19T00:36:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.999+0000 7fc5cbc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5c406d960 0x7fc5c40b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.999+0000 7fc5cbc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c40d5240 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.999+0000 7fc5cbc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c40b39c0 con 0x7fc5c4161ba0 2024-08-19T00:36:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.999+0000 7fc5cbc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c40b36e0 con 0x7fc5c406d960 2024-08-19T00:36:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.999+0000 7fc5c9c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc5c40d2ba0 0x7fc5c40b2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40470/0 (socket says 172.21.15.7:40470) 2024-08-19T00:36:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.999+0000 7fc5c9c00640 1 -- 172.21.15.7:0/103904087 learned_addr learned my addr 172.21.15.7:0/103904087 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:36:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:56.999+0000 7fc5c3e00640 1 --2- 172.21.15.7:0/103904087 >> v2:172.21.15.162:3300/0 conn(0x7fc5c406d960 0x7fc5c40b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:57.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.000+0000 7fc5c3e00640 1 -- 172.21.15.7:0/103904087 >> v1:172.21.15.162:6789/0 conn(0x7fc5c4161ba0 legacy=0x7fc5c40d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:57.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.000+0000 7fc5c3e00640 1 -- 172.21.15.7:0/103904087 >> v1:172.21.15.7:6789/0 conn(0x7fc5c40d2ba0 legacy=0x7fc5c40b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:57.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.000+0000 7fc5c3e00640 1 -- 172.21.15.7:0/103904087 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c406e3a0 con 0x7fc5c406d960 2024-08-19T00:36:57.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.000+0000 7fc5c3400640 1 -- 172.21.15.7:0/103904087 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046368300 0 0) 0x7fc5c40b39c0 con 0x7fc5c4161ba0 2024-08-19T00:36:57.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.001+0000 7fc5c3e00640 1 --2- 172.21.15.7:0/103904087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40b2100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00097a0 tx=0x7fc5b002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cbe7f12ea192c48 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:57.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.001+0000 7fc5c3400640 1 -- 172.21.15.7:0/103904087 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0037070 con 0x7fc5c406d960 2024-08-19T00:36:57.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.001+0000 7fc5c3400640 1 -- 172.21.15.7:0/103904087 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b002adc0 con 0x7fc5c406d960 2024-08-19T00:36:57.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.001+0000 7fc5c3400640 1 -- 172.21.15.7:0/103904087 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0032660 con 0x7fc5c406d960 2024-08-19T00:36:57.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.001+0000 7fc5cbc00640 1 -- 172.21.15.7:0/103904087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 msgr2=0x7fc5c40b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:57.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.001+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/103904087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40b2100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00097a0 tx=0x7fc5b002a130 comp rx=0 tx=0).stop 2024-08-19T00:36:57.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.002+0000 7fc5cbc00640 1 -- 172.21.15.7:0/103904087 shutdown_connections 2024-08-19T00:36:57.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.002+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/103904087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40b2100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.002+0000 7fc5cbc00640 1 -- 172.21.15.7:0/103904087 >> 172.21.15.7:0/103904087 conn(0x7fc5c408c000 msgr2=0x7fc5c40d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:57.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.002+0000 7fc5cbc00640 1 -- 172.21.15.7:0/103904087 shutdown_connections 2024-08-19T00:36:57.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.002+0000 7fc5cbc00640 1 -- 172.21.15.7:0/103904087 wait complete. 2024-08-19T00:36:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.003+0000 7fc5cbc00640 1 Processor -- start 2024-08-19T00:36:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.003+0000 7fc5cbc00640 1 -- start start 2024-08-19T00:36:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.004+0000 7fc5cbc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.004+0000 7fc5cbc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c40d2ba0 0x7fc5c40b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.004+0000 7fc5cbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5c4161ba0 0x7fc5c40b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.004+0000 7fc5cbc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c4161f80 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.004+0000 7fc5cbc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c40b1be0 con 0x7fc5c406d960 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.004+0000 7fc5cbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c4162100 con 0x7fc5c4161ba0 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c40d2ba0 0x7fc5c40b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c9c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5c4161ba0 0x7fc5c40b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c40d2ba0 0x7fc5c40b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50250/0 (socket says 172.21.15.7:50250) 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 -- 172.21.15.7:0/1243312596 learned_addr learned my addr 172.21.15.7:0/1243312596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 -- 172.21.15.7:0/1243312596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5c4161ba0 msgr2=0x7fc5c40b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5c4161ba0 0x7fc5c40b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 -- 172.21.15.7:0/1243312596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 msgr2=0x7fc5c40d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 -- 172.21.15.7:0/1243312596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c4158140 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c9200640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.005+0000 7fc5c3e00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c40d2ba0 0x7fc5c40b7320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0035040 tx=0x7fc5b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.006+0000 7fc5c0c00640 1 -- 172.21.15.7:0/1243312596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0037040 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.006+0000 7fc5c0c00640 1 -- 172.21.15.7:0/1243312596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0004030 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.006+0000 7fc5c0c00640 1 -- 172.21.15.7:0/1243312596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0004440 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.006+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c40b8170 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.006+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c40b8730 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.007+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c40d4b30 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.008+0000 7fc5c0c00640 1 -- 172.21.15.7:0/1243312596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5b003a070 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.008+0000 7fc5c0c00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5a406be30 0x7fc5a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.009+0000 7fc5c0c00640 1 -- 172.21.15.7:0/1243312596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc5b00aaec0 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.009+0000 7fc5c9200640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5a406be30 0x7fc5a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:57.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.009+0000 7fc5c9200640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5a406be30 0x7fc5a406e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8000f60 tx=0x7fc5b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.013+0000 7fc5c0c00640 1 -- 172.21.15.7:0/1243312596 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc5b0041020 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.237+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5c40b7e90 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.237+0000 7fc5c0c00640 1 -- 172.21.15.7:0/1243312596 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7fc5c40b7e90 con 0x7fc5c40d2ba0 2024-08-19T00:36:57.240 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:57.240 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"btime":"2024-08-19T00:36:56:960814+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-19T00:36:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-08-19T00:36:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5a406be30 msgr2=0x7fc5a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5a406be30 0x7fc5a406e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8000f60 tx=0x7fc5b8009040 comp rx=0 tx=0).stop 2024-08-19T00:36:57.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c40d2ba0 msgr2=0x7fc5c40b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c40d2ba0 0x7fc5c40b7320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0035040 tx=0x7fc5b00046c0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 shutdown_connections 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5a406be30 0x7fc5a406e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5c4161ba0 0x7fc5c40b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c40d2ba0 0x7fc5c40b7320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.239+0000 7fc5cbc00640 1 --2- 172.21.15.7:0/1243312596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c406d960 0x7fc5c40d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.240+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 >> 172.21.15.7:0/1243312596 conn(0x7fc5c408c000 msgr2=0x7fc5c40b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.240+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 shutdown_connections 2024-08-19T00:36:57.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:57.240+0000 7fc5cbc00640 1 -- 172.21.15.7:0/1243312596 wait complete. 2024-08-19T00:36:59.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:36:59.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.426+0000 7f541b200640 1 Processor -- start 2024-08-19T00:36:59.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.426+0000 7f541b200640 1 -- start start 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.427+0000 7f541b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f541c161960 0x7f541c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.427+0000 7f541b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f541c0d1920 0x7f541c0b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.427+0000 7f541b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f541c0d28c0 con 0x7f541c0cf2b0 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.427+0000 7f541b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f541c0b7150 con 0x7f541c161960 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.427+0000 7f541b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f541c0d2ba0 con 0x7f541c0d1920 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.427+0000 7f5419e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f541c161960 0x7f541c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.428+0000 7f5419e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f541c161960 0x7f541c0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50258/0 (socket says 172.21.15.7:50258) 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.428+0000 7f5419e00640 1 -- 172.21.15.7:0/261415618 learned_addr learned my addr 172.21.15.7:0/261415618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.428+0000 7f541a800640 1 --2- 172.21.15.7:0/261415618 >> v2:172.21.15.162:3300/0 conn(0x7f541c0d1920 0x7f541c0b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.428+0000 7f5419e00640 1 -- 172.21.15.7:0/261415618 >> v2:172.21.15.162:3300/0 conn(0x7f541c0d1920 msgr2=0x7f541c0b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.428+0000 7f5419e00640 1 --2- 172.21.15.7:0/261415618 >> v2:172.21.15.162:3300/0 conn(0x7f541c0d1920 0x7f541c0b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.428+0000 7f5419e00640 1 -- 172.21.15.7:0/261415618 >> v1:172.21.15.162:6789/0 conn(0x7f541c0cf2b0 legacy=0x7f541c0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.428+0000 7f5419e00640 1 -- 172.21.15.7:0/261415618 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c0d2e80 con 0x7f541c161960 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.429+0000 7f5419e00640 1 --2- 172.21.15.7:0/261415618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c161960 0x7f541c0ced70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f541c0d06b0 tx=0x7f540c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c61afbcb12cef96 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.429+0000 7f5418a00640 1 -- 172.21.15.7:0/261415618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c037070 con 0x7f541c161960 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.429+0000 7f5418a00640 1 -- 172.21.15.7:0/261415618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540c02ae50 con 0x7f541c161960 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.429+0000 7f5418a00640 1 -- 172.21.15.7:0/261415618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c032860 con 0x7f541c161960 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 -- 172.21.15.7:0/261415618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c161960 msgr2=0x7f541c0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 --2- 172.21.15.7:0/261415618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c161960 0x7f541c0ced70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f541c0d06b0 tx=0x7f540c02a300 comp rx=0 tx=0).stop 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 -- 172.21.15.7:0/261415618 shutdown_connections 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 --2- 172.21.15.7:0/261415618 >> v2:172.21.15.162:3300/0 conn(0x7f541c0d1920 0x7f541c0b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 --2- 172.21.15.7:0/261415618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c161960 0x7f541c0ced70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 -- 172.21.15.7:0/261415618 >> 172.21.15.7:0/261415618 conn(0x7f541c09d500 msgr2=0x7f541c0d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:59.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 -- 172.21.15.7:0/261415618 shutdown_connections 2024-08-19T00:36:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.430+0000 7f541b200640 1 -- 172.21.15.7:0/261415618 wait complete. 2024-08-19T00:36:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.432+0000 7f541b200640 1 Processor -- start 2024-08-19T00:36:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.432+0000 7f541b200640 1 -- start start 2024-08-19T00:36:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f541b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c0cf2b0 0x7f541c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f541b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c0d1920 0x7f541c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f541b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541c161960 0x7f541c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f541b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0d4e30 con 0x7f541c0d1920 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f541b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0d4cb0 con 0x7f541c0cf2b0 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f541b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f541c161d40 con 0x7f541c161960 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c0d1920 0x7f541c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c0d1920 0x7f541c15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50274/0 (socket says 172.21.15.7:50274) 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419400640 1 -- 172.21.15.7:0/1523962867 learned_addr learned my addr 172.21.15.7:0/1523962867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419e00640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c0cf2b0 0x7f541c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f541a800640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541c161960 0x7f541c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419400640 1 -- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541c161960 msgr2=0x7f541c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419400640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541c161960 0x7f541c0ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419400640 1 -- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c0cf2b0 msgr2=0x7f541c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.433+0000 7f5419400640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c0cf2b0 0x7f541c15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f5419400640 1 -- 172.21.15.7:0/1523962867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c15e3b0 con 0x7f541c0d1920 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f5419e00640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c0cf2b0 0x7f541c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f5419400640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c0d1920 0x7f541c15b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f540800c400 tx=0x7f540800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f5412000640 1 -- 172.21.15.7:0/1523962867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080052d0 con 0x7f541c0d1920 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f5412000640 1 -- 172.21.15.7:0/1523962867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5408005490 con 0x7f541c0d1920 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f5412000640 1 -- 172.21.15.7:0/1523962867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408007260 con 0x7f541c0d1920 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541c15db10 con 0x7f541c0d1920 2024-08-19T00:36:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.434+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f541c15e0d0 con 0x7f541c0d1920 2024-08-19T00:36:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.436+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f541c0ced70 con 0x7f541c0d1920 2024-08-19T00:36:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.437+0000 7f5412000640 1 -- 172.21.15.7:0/1523962867 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5408007400 con 0x7f541c0d1920 2024-08-19T00:36:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.437+0000 7f5412000640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53fc06be30 0x7f53fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.438+0000 7f5412000640 1 -- 172.21.15.7:0/1523962867 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5408089fe0 con 0x7f541c0d1920 2024-08-19T00:36:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.438+0000 7f5419e00640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53fc06be30 0x7f53fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.438+0000 7f5419e00640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53fc06be30 0x7f53fc06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f540c034000 tx=0x7f540c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.442+0000 7f5412000640 1 -- 172.21.15.7:0/1523962867 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5408058650 con 0x7f541c0d1920 2024-08-19T00:36:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.661+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f541c161130 con 0x7f541c0d1920 2024-08-19T00:36:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.662+0000 7f5412000640 1 -- 172.21.15.7:0/1523962867 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3900 (secure 0 0 0) 0x7f540805c950 con 0x7f541c0d1920 2024-08-19T00:36:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:36:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"btime":"2024-08-19T00:36:57:962199+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-19T00:36:59.665 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53fc06be30 msgr2=0x7f53fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53fc06be30 0x7f53fc06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f540c034000 tx=0x7f540c02e000 comp rx=0 tx=0).stop 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c0d1920 msgr2=0x7f541c15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c0d1920 0x7f541c15b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f540800c400 tx=0x7f540800c8c0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 shutdown_connections 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53fc06be30 0x7f53fc06e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541c161960 0x7f541c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f541c0d1920 0x7f541c15b080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 --2- 172.21.15.7:0/1523962867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c0cf2b0 0x7f541c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 >> 172.21.15.7:0/1523962867 conn(0x7f541c09d500 msgr2=0x7f541c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 shutdown_connections 2024-08-19T00:36:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.664+0000 7f541b200640 1 -- 172.21.15.7:0/1523962867 wait complete. 2024-08-19T00:36:59.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-19T00:36:59.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.835+0000 7f5e35a00640 1 Processor -- start 2024-08-19T00:36:59.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.836+0000 7f5e35a00640 1 -- start start 2024-08-19T00:36:59.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e35a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5e3006d960 0x7f5e300b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e35a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e300d2ba0 0x7f5e300b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e35a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e300d5240 con 0x7f5e30161ba0 2024-08-19T00:36:59.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e35a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5e300b39c0 con 0x7f5e300d2ba0 2024-08-19T00:36:59.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e35a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5e300b36e0 con 0x7f5e3006d960 2024-08-19T00:36:59.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e2ea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5e30161ba0 0x7f5e300d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40482/0 (socket says 172.21.15.7:40482) 2024-08-19T00:36:59.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e2ea00640 1 -- 172.21.15.7:0/1339866671 learned_addr learned my addr 172.21.15.7:0/1339866671 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e2f400640 1 --2- 172.21.15.7:0/1339866671 >> v2:172.21.15.7:3300/0 conn(0x7f5e300d2ba0 0x7f5e300b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e27e00640 1 --2- 172.21.15.7:0/1339866671 >> v2:172.21.15.162:3300/0 conn(0x7f5e3006d960 0x7f5e300b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e2e000640 1 -- 172.21.15.7:0/1339866671 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743675775 0 0) 0x7f5e300d5240 con 0x7f5e30161ba0 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e2e000640 1 -- 172.21.15.7:0/1339866671 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e14003520 con 0x7f5e30161ba0 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e2f400640 1 -- 172.21.15.7:0/1339866671 >> v2:172.21.15.162:3300/0 conn(0x7f5e3006d960 msgr2=0x7f5e300b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.837+0000 7f5e2f400640 1 --2- 172.21.15.7:0/1339866671 >> v2:172.21.15.162:3300/0 conn(0x7f5e3006d960 0x7f5e300b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.838+0000 7f5e2f400640 1 -- 172.21.15.7:0/1339866671 >> v1:172.21.15.7:6789/0 conn(0x7f5e30161ba0 legacy=0x7f5e300d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.838+0000 7f5e2f400640 1 -- 172.21.15.7:0/1339866671 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3006e3a0 con 0x7f5e300d2ba0 2024-08-19T00:36:59.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e2f400640 1 --2- 172.21.15.7:0/1339866671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300b2640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e300ce8a0 tx=0x7f5e2802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da57c02a04b67a98 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e2e000640 1 -- 172.21.15.7:0/1339866671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28007740 con 0x7f5e300d2ba0 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e2e000640 1 -- 172.21.15.7:0/1339866671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e280078e0 con 0x7f5e300d2ba0 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e2e000640 1 -- 172.21.15.7:0/1339866671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28007cb0 con 0x7f5e300d2ba0 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e35a00640 1 -- 172.21.15.7:0/1339866671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 msgr2=0x7f5e300b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e35a00640 1 --2- 172.21.15.7:0/1339866671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300b2640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e300ce8a0 tx=0x7f5e2802a680 comp rx=0 tx=0).stop 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e35a00640 1 -- 172.21.15.7:0/1339866671 shutdown_connections 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e35a00640 1 --2- 172.21.15.7:0/1339866671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300b2640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e35a00640 1 --2- 172.21.15.7:0/1339866671 >> v2:172.21.15.162:3300/0 conn(0x7f5e3006d960 0x7f5e300b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.839+0000 7f5e35a00640 1 -- 172.21.15.7:0/1339866671 >> 172.21.15.7:0/1339866671 conn(0x7f5e3008c000 msgr2=0x7f5e300d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.840+0000 7f5e35a00640 1 -- 172.21.15.7:0/1339866671 shutdown_connections 2024-08-19T00:36:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.840+0000 7f5e35a00640 1 -- 172.21.15.7:0/1339866671 wait complete. 2024-08-19T00:36:59.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.841+0000 7f5e35a00640 1 Processor -- start 2024-08-19T00:36:59.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.841+0000 7f5e35a00640 1 -- start start 2024-08-19T00:36:59.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e35a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3006d960 0x7f5e301f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e35a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e35a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e30161ba0 0x7f5e301f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e35a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30161f80 con 0x7f5e300d2ba0 2024-08-19T00:36:59.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e35a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e300b1be0 con 0x7f5e30161ba0 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e35a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5e30162100 con 0x7f5e3006d960 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50286/0 (socket says 172.21.15.7:50286) 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.842+0000 7f5e27e00640 1 -- 172.21.15.7:0/2741354353 learned_addr learned my addr 172.21.15.7:0/2741354353 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e2f400640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e30161ba0 0x7f5e301f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e2ea00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3006d960 0x7f5e301f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e27e00640 1 -- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3006d960 msgr2=0x7f5e301f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e27e00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3006d960 0x7f5e301f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e27e00640 1 -- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e30161ba0 msgr2=0x7f5e301f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e27e00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e30161ba0 0x7f5e301f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:36:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e27e00640 1 -- 172.21.15.7:0/2741354353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e301f7190 con 0x7f5e300d2ba0 2024-08-19T00:36:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e27e00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300c99b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800e9b0 tx=0x7f5e1800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.843+0000 7f5e26a00640 1 -- 172.21.15.7:0/2741354353 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18017070 con 0x7f5e300d2ba0 2024-08-19T00:36:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.844+0000 7f5e26a00640 1 -- 172.21.15.7:0/2741354353 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1800c9a0 con 0x7f5e300d2ba0 2024-08-19T00:36:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.844+0000 7f5e26a00640 1 -- 172.21.15.7:0/2741354353 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800cd90 con 0x7f5e300d2ba0 2024-08-19T00:36:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.844+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e300ca920 con 0x7f5e300d2ba0 2024-08-19T00:36:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.844+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e301f4640 con 0x7f5e300d2ba0 2024-08-19T00:36:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.845+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e300d4b30 con 0x7f5e300d2ba0 2024-08-19T00:36:59.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.846+0000 7f5e26a00640 1 -- 172.21.15.7:0/2741354353 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e1801a070 con 0x7f5e300d2ba0 2024-08-19T00:36:59.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.847+0000 7f5e26a00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5e0c06be80 0x7f5e0c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:36:59.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.847+0000 7f5e26a00640 1 -- 172.21.15.7:0/2741354353 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5e1808aab0 con 0x7f5e300d2ba0 2024-08-19T00:36:59.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.847+0000 7f5e2ea00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5e0c06be80 0x7f5e0c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:36:59.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.847+0000 7f5e2ea00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5e0c06be80 0x7f5e0c06e340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e20007fd0 tx=0x7f5e20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:36:59.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:36:59.851+0000 7f5e26a00640 1 -- 172.21.15.7:0/2741354353 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5e301f7190 con 0x7f5e300d2ba0 2024-08-19T00:37:00.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.037+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5e300b8a40 con 0x7f5e300d2ba0 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.037+0000 7f5e26a00640 1 -- 172.21.15.7:0/2741354353 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f5e18059140 con 0x7f5e300d2ba0 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:00.040 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.039+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5e0c06be80 msgr2=0x7f5e0c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.039+0000 7f5e35a00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5e0c06be80 0x7f5e0c06e340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e20007fd0 tx=0x7f5e20009040 comp rx=0 tx=0).stop 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 msgr2=0x7f5e300c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300c99b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800e9b0 tx=0x7f5e1800ee70 comp rx=0 tx=0).stop 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 shutdown_connections 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5e0c06be80 0x7f5e0c06e340 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e30161ba0 0x7f5e301f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e300d2ba0 0x7f5e300c99b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 --2- 172.21.15.7:0/2741354353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3006d960 0x7f5e301f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 >> 172.21.15.7:0/2741354353 conn(0x7f5e3008c000 msgr2=0x7f5e300b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 shutdown_connections 2024-08-19T00:37:00.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.040+0000 7f5e35a00640 1 -- 172.21.15.7:0/2741354353 wait complete. 2024-08-19T00:37:00.058 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:37:00.058 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:37:00.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.217+0000 7fbd11200640 1 Processor -- start 2024-08-19T00:37:00.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.217+0000 7fbd11200640 1 -- start start 2024-08-19T00:37:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.218+0000 7fbd11200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd0c15e260 0x7fbd0c162900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.218+0000 7fbd11200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c070250 0x7fbd0c15e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.218+0000 7fbd11200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd0c06e340 con 0x7fbd0c062530 2024-08-19T00:37:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.218+0000 7fbd11200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbd0c0cd250 con 0x7fbd0c15e260 2024-08-19T00:37:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.218+0000 7fbd11200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0c06e600 con 0x7fbd0c070250 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.218+0000 7fbd03e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbd0c062530 0x7fbd0c06fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40486/0 (socket says 172.21.15.7:40486) 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.218+0000 7fbd03e00640 1 -- 172.21.15.7:0/2754427162 learned_addr learned my addr 172.21.15.7:0/2754427162 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09e00640 1 --2- 172.21.15.7:0/2754427162 >> v2:172.21.15.162:3300/0 conn(0x7fbd0c15e260 0x7fbd0c162900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd0a800640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c070250 0x7fbd0c15e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104580689 0 0) 0x7fbd0c06e340 con 0x7fbd0c062530 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcf0003520 con 0x7fbd0c062530 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2798861083 0 0) 0x7fbcf0003520 con 0x7fbd0c062530 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c070250 msgr2=0x7fbd0c15e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c070250 0x7fbd0c15e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 >> v2:172.21.15.162:3300/0 conn(0x7fbd0c15e260 msgr2=0x7fbd0c162900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:00.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 --2- 172.21.15.7:0/2754427162 >> v2:172.21.15.162:3300/0 conn(0x7fbd0c15e260 0x7fbd0c162900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c06e8e0 con 0x7fbd0c062530 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fbcf4001670 con 0x7fbd0c062530 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09e00640 1 --2- 172.21.15.7:0/2754427162 >> v2:172.21.15.162:3300/0 conn(0x7fbd0c15e260 0x7fbd0c162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 >> v1:172.21.15.7:6789/0 conn(0x7fbd0c062530 legacy=0x7fbd0c06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf00039b0 0x7fbcf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf0004800 0x7fbcf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbcf000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c0cd250 con 0x7fbcf00051c0 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c06e600 con 0x7fbcf0004800 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf000bf00 con 0x7fbcf00039b0 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.219+0000 7fbd0a800640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c070250 0x7fbd0c15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd03e00640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf0004800 0x7fbcf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd0a800640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbcf000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd09e00640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf00039b0 0x7fbcf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd0a800640 1 -- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf00039b0 msgr2=0x7fbcf0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd0a800640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf00039b0 0x7fbcf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd0a800640 1 -- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf0004800 msgr2=0x7fbcf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd0a800640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf0004800 0x7fbcf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd0a800640 1 -- 172.21.15.7:0/2754427162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf0003520 con 0x7fbcf00051c0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.220+0000 7fbd03e00640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf0004800 0x7fbcf0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.221+0000 7fbd0a800640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbcf000b9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400e220 tx=0x7fbcf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3353824091cb6017 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.221+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04009d40 con 0x7fbcf00051c0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.221+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd04035070 con 0x7fbcf00051c0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.221+0000 7fbd09400640 1 -- 172.21.15.7:0/2754427162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0402c040 con 0x7fbcf00051c0 2024-08-19T00:37:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.222+0000 7fbd11200640 1 -- 172.21.15.7:0/2754427162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 msgr2=0x7fbcf000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:00.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.222+0000 7fbd11200640 1 --2- 172.21.15.7:0/2754427162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbcf000b9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400e220 tx=0x7fbcf0005830 comp rx=0 tx=0).stop 2024-08-19T00:37:00.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.222+0000 7fbd0a800640 1 -- 172.21.15.7:0/2754427162 reap_dead start 2024-08-19T00:37:00.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.222+0000 7fbd11200640 1 -- 172.21.15.7:0/2754427162 shutdown_connections 2024-08-19T00:37:00.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.222+0000 7fbd11200640 1 -- 172.21.15.7:0/2754427162 >> 172.21.15.7:0/2754427162 conn(0x7fbd0c0730c0 msgr2=0x7fbd0c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:00.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.222+0000 7fbd11200640 1 -- 172.21.15.7:0/2754427162 shutdown_connections 2024-08-19T00:37:00.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.222+0000 7fbd11200640 1 -- 172.21.15.7:0/2754427162 wait complete. 2024-08-19T00:37:00.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.224+0000 7fbd11200640 1 Processor -- start 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.224+0000 7fbd11200640 1 -- start start 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbd0c13f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd11200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd0c14fe70 0x7fbd0c1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd11200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c1522b0 0x7fbd0c152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd11200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c06f3c0 con 0x7fbcf00051c0 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd11200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c06eea0 con 0x7fbd0c14fe70 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd11200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0c0af890 con 0x7fbd0c1522b0 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbd0c13f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbd0c13f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50304/0 (socket says 172.21.15.7:50304) 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 -- 172.21.15.7:0/393719007 learned_addr learned my addr 172.21.15.7:0/393719007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd0a800640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c1522b0 0x7fbd0c152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd03e00640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd0c14fe70 0x7fbd0c1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 -- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c1522b0 msgr2=0x7fbd0c152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c1522b0 0x7fbd0c152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 -- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd0c14fe70 msgr2=0x7fbd0c1502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd0c14fe70 0x7fbd0c1502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.225+0000 7fbd09e00640 1 -- 172.21.15.7:0/393719007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c152fe0 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.226+0000 7fbd09e00640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbd0c13f040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc011d00 tx=0x7fbcfc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.226+0000 7fbd02000640 1 -- 172.21.15.7:0/393719007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00fcc0 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.226+0000 7fbd02000640 1 -- 172.21.15.7:0/393719007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcfc00fe60 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.226+0000 7fbd02000640 1 -- 172.21.15.7:0/393719007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc004240 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.226+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0c0b41a0 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.226+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0c0b4760 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.227+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd0c162900 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.228+0000 7fbd02000640 1 -- 172.21.15.7:0/393719007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcfc012040 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.229+0000 7fbd02000640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbce806be60 0x7fbce806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.229+0000 7fbd02000640 1 -- 172.21.15.7:0/393719007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbcfc08b070 con 0x7fbcf00051c0 2024-08-19T00:37:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.229+0000 7fbd03e00640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbce806be60 0x7fbce806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:00.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.230+0000 7fbd03e00640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbce806be60 0x7fbce806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4001030 tx=0x7fbcf4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:00.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.233+0000 7fbd02000640 1 -- 172.21.15.7:0/393719007 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbcfc019030 con 0x7fbcf00051c0 2024-08-19T00:37:00.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:00.421+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbd0c156a10 con 0x7fbcf00051c0 2024-08-19T00:37:00.802 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:37:00.806 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:37:01.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.331+0000 7fbd02000640 1 -- 172.21.15.7:0/393719007 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fbcfc059cd0 con 0x7fbcf00051c0 2024-08-19T00:37:01.334 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-08-19T00:37:01.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbce806be60 msgr2=0x7fbce806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbce806be60 0x7fbce806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4001030 tx=0x7fbcf4009040 comp rx=0 tx=0).stop 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 msgr2=0x7fbd0c13f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbd0c13f040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc011d00 tx=0x7fbcfc00f610 comp rx=0 tx=0).stop 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 shutdown_connections 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbce806be60 0x7fbce806e320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd0c1522b0 0x7fbd0c152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd0c14fe70 0x7fbd0c1502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 --2- 172.21.15.7:0/393719007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf00051c0 0x7fbd0c13f040 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc011d00 tx=0x7fbcfc00f610 comp rx=0 tx=0).stop 2024-08-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.335+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 >> 172.21.15.7:0/393719007 conn(0x7fbd0c0730c0 msgr2=0x7fbd0c158620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:01.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.336+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 shutdown_connections 2024-08-19T00:37:01.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.336+0000 7fbd11200640 1 -- 172.21.15.7:0/393719007 wait complete. 2024-08-19T00:37:01.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:37:01.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.531+0000 7f3631000640 1 Processor -- start 2024-08-19T00:37:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.531+0000 7f3631000640 1 -- start start 2024-08-19T00:37:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.532+0000 7f3631000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f362c158cd0 0x7f362c072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.532+0000 7f3631000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0aeae0 con 0x7f362c0ae480 2024-08-19T00:37:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.532+0000 7f3631000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0aedc0 con 0x7f362c072ff0 2024-08-19T00:37:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.532+0000 7f3631000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f362c073460 con 0x7f362c158cd0 2024-08-19T00:37:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.532+0000 7f3629e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f362c158cd0 0x7f362c072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.533+0000 7f3629e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f362c158cd0 0x7f362c072ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50314/0 (socket says 172.21.15.7:50314) 2024-08-19T00:37:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.533+0000 7f3629e00640 1 -- 172.21.15.7:0/4104676510 learned_addr learned my addr 172.21.15.7:0/4104676510 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.533+0000 7f362a800640 1 --1- 172.21.15.7:0/4104676510 >> v1:172.21.15.7:6789/0 conn(0x7f362c0ae480 0x7f362c0b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40500/0 (socket says 172.21.15.7:40500) 2024-08-19T00:37:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.533+0000 7f3629e00640 1 -- 172.21.15.7:0/4104676510 >> v1:172.21.15.162:6789/0 conn(0x7f362c072ff0 legacy=0x7f362c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.533+0000 7f3629e00640 1 -- 172.21.15.7:0/4104676510 >> v1:172.21.15.7:6789/0 conn(0x7f362c0ae480 legacy=0x7f362c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.533+0000 7f3629e00640 1 -- 172.21.15.7:0/4104676510 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c0af0a0 con 0x7f362c158cd0 2024-08-19T00:37:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.534+0000 7f3629e00640 1 --2- 172.21.15.7:0/4104676510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c158cd0 0x7f362c072ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f361c00bb10 tx=0x7f361c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591ddacd8999c9e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.534+0000 7f3628a00640 1 -- 172.21.15.7:0/4104676510 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c033640 con 0x7f362c158cd0 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.534+0000 7f3628a00640 1 -- 172.21.15.7:0/4104676510 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c038070 con 0x7f362c158cd0 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.534+0000 7f3628a00640 1 -- 172.21.15.7:0/4104676510 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c033a00 con 0x7f362c158cd0 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.535+0000 7f3631000640 1 -- 172.21.15.7:0/4104676510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c158cd0 msgr2=0x7f362c072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.535+0000 7f3631000640 1 --2- 172.21.15.7:0/4104676510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c158cd0 0x7f362c072ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f361c00bb10 tx=0x7f361c02c8b0 comp rx=0 tx=0).stop 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.535+0000 7f3631000640 1 -- 172.21.15.7:0/4104676510 shutdown_connections 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.535+0000 7f3631000640 1 --2- 172.21.15.7:0/4104676510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c158cd0 0x7f362c072ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.535+0000 7f3631000640 1 -- 172.21.15.7:0/4104676510 >> 172.21.15.7:0/4104676510 conn(0x7f362c0b2300 msgr2=0x7f362c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.535+0000 7f3631000640 1 -- 172.21.15.7:0/4104676510 shutdown_connections 2024-08-19T00:37:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.535+0000 7f3631000640 1 -- 172.21.15.7:0/4104676510 wait complete. 2024-08-19T00:37:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.537+0000 7f3631000640 1 Processor -- start 2024-08-19T00:37:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.537+0000 7f3631000640 1 -- start start 2024-08-19T00:37:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3631000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362c072ff0 0x7f362c157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3631000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f362c0ae480 0x7f362c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3631000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c14c820 0x7f362c09b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3631000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f362c0b3860 con 0x7f362c14c820 2024-08-19T00:37:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3631000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f362c0af660 con 0x7f362c0ae480 2024-08-19T00:37:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3631000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f362c0b39e0 con 0x7f362c072ff0 2024-08-19T00:37:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c14c820 0x7f362c09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c14c820 0x7f362c09b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50318/0 (socket says 172.21.15.7:50318) 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 -- 172.21.15.7:0/3913817378 learned_addr learned my addr 172.21.15.7:0/3913817378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3629400640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f362c0ae480 0x7f362c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3629e00640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362c072ff0 0x7f362c157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 -- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362c072ff0 msgr2=0x7f362c157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362c072ff0 0x7f362c157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 -- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f362c0ae480 msgr2=0x7f362c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f362c0ae480 0x7f362c09aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f362a800640 1 -- 172.21.15.7:0/3913817378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c15b760 con 0x7f362c14c820 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.538+0000 7f3629e00640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362c072ff0 0x7f362c157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.539+0000 7f362a800640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c14c820 0x7f362c09b720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f362400c780 tx=0x7f362400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.539+0000 7f3622000640 1 -- 172.21.15.7:0/3913817378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624017070 con 0x7f362c14c820 2024-08-19T00:37:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.539+0000 7f3622000640 1 -- 172.21.15.7:0/3913817378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362400a640 con 0x7f362c14c820 2024-08-19T00:37:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.539+0000 7f3622000640 1 -- 172.21.15.7:0/3913817378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362400aa30 con 0x7f362c14c820 2024-08-19T00:37:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.539+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362c15ba40 con 0x7f362c14c820 2024-08-19T00:37:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.539+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362c15c000 con 0x7f362c14c820 2024-08-19T00:37:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.540+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362c0add70 con 0x7f362c14c820 2024-08-19T00:37:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.541+0000 7f3622000640 1 -- 172.21.15.7:0/3913817378 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f362401a070 con 0x7f362c14c820 2024-08-19T00:37:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.542+0000 7f3622000640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f360c06be30 0x7f360c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.542+0000 7f3622000640 1 -- 172.21.15.7:0/3913817378 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f362408a1d0 con 0x7f362c14c820 2024-08-19T00:37:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.543+0000 7f3629e00640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f360c06be30 0x7f360c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.543+0000 7f3629e00640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f360c06be30 0x7f360c06e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f361c037000 tx=0x7f361c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.547+0000 7f3622000640 1 -- 172.21.15.7:0/3913817378 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3624058710 con 0x7f362c14c820 2024-08-19T00:37:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:01.732+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f362c0cfd30 con 0x7f362c14c820 2024-08-19T00:37:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.334+0000 7f3622000640 1 -- 172.21.15.7:0/3913817378 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f362405ca10 con 0x7f362c14c820 2024-08-19T00:37:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-08-19T00:37:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.339+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f360c06be30 msgr2=0x7f360c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.339+0000 7f3631000640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f360c06be30 0x7f360c06e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f361c037000 tx=0x7f361c032000 comp rx=0 tx=0).stop 2024-08-19T00:37:02.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.339+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c14c820 msgr2=0x7f362c09b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:02.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.339+0000 7f3631000640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c14c820 0x7f362c09b720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f362400c780 tx=0x7f362400cc40 comp rx=0 tx=0).stop 2024-08-19T00:37:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.340+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 shutdown_connections 2024-08-19T00:37:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.340+0000 7f3631000640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f360c06be30 0x7f360c06e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.340+0000 7f3631000640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f362c14c820 0x7f362c09b720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.340+0000 7f3631000640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f362c0ae480 0x7f362c09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.340+0000 7f3631000640 1 --2- 172.21.15.7:0/3913817378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362c072ff0 0x7f362c157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.340+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 >> 172.21.15.7:0/3913817378 conn(0x7f362c0b2300 msgr2=0x7f362c14d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:02.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.342+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 shutdown_connections 2024-08-19T00:37:02.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.343+0000 7f3631000640 1 -- 172.21.15.7:0/3913817378 wait complete. 2024-08-19T00:37:02.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:37:02.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.538+0000 7f7e0a800640 1 Processor -- start 2024-08-19T00:37:02.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.538+0000 7f7e0a800640 1 -- start start 2024-08-19T00:37:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e0a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7e0415e4c0 0x7f7e040d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e0a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7e0415e8a0 0x7f7e040d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e0a800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e040d2750 con 0x7f7e040d2a60 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e0a800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7e040d53e0 con 0x7f7e0415e4c0 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e0a800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7e040d1610 con 0x7f7e0415e8a0 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e03400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7e0415e4c0 0x7f7e040d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e03e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7e040d2a60 0x7f7e04162180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40510/0 (socket says 172.21.15.7:40510) 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e03e00640 1 -- 172.21.15.7:0/1271008342 learned_addr learned my addr 172.21.15.7:0/1271008342 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.539+0000 7f7e02a00640 1 --2- 172.21.15.7:0/1271008342 >> v2:172.21.15.162:3300/0 conn(0x7f7e0415e8a0 0x7f7e040d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.540+0000 7f7e03400640 1 -- 172.21.15.7:0/1271008342 >> v2:172.21.15.162:3300/0 conn(0x7f7e0415e8a0 msgr2=0x7f7e040d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.540+0000 7f7e03400640 1 --2- 172.21.15.7:0/1271008342 >> v2:172.21.15.162:3300/0 conn(0x7f7e0415e8a0 0x7f7e040d4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.540+0000 7f7e03400640 1 -- 172.21.15.7:0/1271008342 >> v1:172.21.15.7:6789/0 conn(0x7f7e040d2a60 legacy=0x7f7e04162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:02.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.540+0000 7f7e03400640 1 -- 172.21.15.7:0/1271008342 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e040d0ce0 con 0x7f7e0415e4c0 2024-08-19T00:37:02.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.540+0000 7f7e02000640 1 -- 172.21.15.7:0/1271008342 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060998822 0 0) 0x7f7e040d2750 con 0x7f7e040d2a60 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.541+0000 7f7e03400640 1 --2- 172.21.15.7:0/1271008342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 0x7f7e040d2050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e040d4450 tx=0x7f7df402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e50c07875d6a343 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.541+0000 7f7e02000640 1 -- 172.21.15.7:0/1271008342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4037070 con 0x7f7e0415e4c0 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.541+0000 7f7e02000640 1 -- 172.21.15.7:0/1271008342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df4032440 con 0x7f7e0415e4c0 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.541+0000 7f7e02000640 1 -- 172.21.15.7:0/1271008342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4032810 con 0x7f7e0415e4c0 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 -- 172.21.15.7:0/1271008342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 msgr2=0x7f7e040d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 --2- 172.21.15.7:0/1271008342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 0x7f7e040d2050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e040d4450 tx=0x7f7df402a1a0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 -- 172.21.15.7:0/1271008342 shutdown_connections 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 --2- 172.21.15.7:0/1271008342 >> v2:172.21.15.162:3300/0 conn(0x7f7e0415e8a0 0x7f7e040d4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 --2- 172.21.15.7:0/1271008342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 0x7f7e040d2050 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 -- 172.21.15.7:0/1271008342 >> 172.21.15.7:0/1271008342 conn(0x7f7e0409d730 msgr2=0x7f7e040d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:02.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 -- 172.21.15.7:0/1271008342 shutdown_connections 2024-08-19T00:37:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.542+0000 7f7e0a800640 1 -- 172.21.15.7:0/1271008342 wait complete. 2024-08-19T00:37:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.544+0000 7f7e0a800640 1 Processor -- start 2024-08-19T00:37:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.544+0000 7f7e0a800640 1 -- start start 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e0a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d2a60 0x7f7e041508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e0a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 0x7f7e040b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e0a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0415e8a0 0x7f7e040b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e0a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e040d0150 con 0x7f7e0415e4c0 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e0a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e040d12a0 con 0x7f7e0415e8a0 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e0a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e040d02d0 con 0x7f7e040d2a60 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e03e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0415e8a0 0x7f7e040b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e03400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d2a60 0x7f7e041508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e03e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0415e8a0 0x7f7e040b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:51714/0 (socket says 172.21.15.7:51714) 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e03e00640 1 -- 172.21.15.7:0/4228474948 learned_addr learned my addr 172.21.15.7:0/4228474948 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.545+0000 7f7e02a00640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 0x7f7e040b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:02.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e03e00640 1 -- 172.21.15.7:0/4228474948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d2a60 msgr2=0x7f7e041508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e03e00640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d2a60 0x7f7e041508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e03e00640 1 -- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 msgr2=0x7f7e040b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e03e00640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 0x7f7e040b85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e03e00640 1 -- 172.21.15.7:0/4228474948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e04150e20 con 0x7f7e0415e8a0 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e03e00640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0415e8a0 0x7f7e040b9bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00c7a0 tx=0x7f7dfc00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7dfb400640 1 -- 172.21.15.7:0/4228474948 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc018070 con 0x7f7e0415e8a0 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7dfb400640 1 -- 172.21.15.7:0/4228474948 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dfc00a640 con 0x7f7e0415e8a0 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7dfb400640 1 -- 172.21.15.7:0/4228474948 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00aa70 con 0x7f7e0415e8a0 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e040b72b0 con 0x7f7e0415e8a0 2024-08-19T00:37:02.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.546+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e040b7550 con 0x7f7e0415e8a0 2024-08-19T00:37:02.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.547+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e040d4ea0 con 0x7f7e0415e8a0 2024-08-19T00:37:02.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.548+0000 7f7dfb400640 1 -- 172.21.15.7:0/4228474948 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7dfc00ac10 con 0x7f7e0415e8a0 2024-08-19T00:37:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.549+0000 7f7dfb400640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7de406be30 0x7f7de406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.549+0000 7f7dfb400640 1 -- 172.21.15.7:0/4228474948 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f7dfc08a4b0 con 0x7f7e0415e8a0 2024-08-19T00:37:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.549+0000 7f7e03400640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7de406be30 0x7f7de406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.550+0000 7f7e03400640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7de406be30 0x7f7de406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7df4034000 tx=0x7f7df402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:02.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.555+0000 7f7dfb400640 1 -- 172.21.15.7:0/4228474948 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7e04150e20 con 0x7f7e0415e8a0 2024-08-19T00:37:02.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:02.778+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7e040d1be0 con 0x7f7e0415e8a0 2024-08-19T00:37:03.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.365+0000 7f7dfb400640 1 -- 172.21.15.7:0/4228474948 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f7dfc0587d0 con 0x7f7e0415e8a0 2024-08-19T00:37:03.371 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-08-19T00:37:03.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.370+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7de406be30 msgr2=0x7f7de406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.370+0000 7f7e0a800640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7de406be30 0x7f7de406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7df4034000 tx=0x7f7df402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:03.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.370+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0415e8a0 msgr2=0x7f7e040b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.370+0000 7f7e0a800640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0415e8a0 0x7f7e040b9bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00c7a0 tx=0x7f7dfc00cc60 comp rx=0 tx=0).stop 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.371+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 shutdown_connections 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.371+0000 7f7e0a800640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7de406be30 0x7f7de406e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.371+0000 7f7e0a800640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0415e8a0 0x7f7e040b9bb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.371+0000 7f7e0a800640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0415e4c0 0x7f7e040b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.371+0000 7f7e0a800640 1 --2- 172.21.15.7:0/4228474948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d2a60 0x7f7e041508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.371+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 >> 172.21.15.7:0/4228474948 conn(0x7f7e0409d730 msgr2=0x7f7e040b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.371+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 shutdown_connections 2024-08-19T00:37:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.372+0000 7f7e0a800640 1 -- 172.21.15.7:0/4228474948 wait complete. 2024-08-19T00:37:03.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.556+0000 7f129a400640 1 Processor -- start 2024-08-19T00:37:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.556+0000 7f129a400640 1 -- start start 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f129a400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f129415e360 0x7f129415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f129a400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f12940d2af0 0x7f12940d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f129a400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f129415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f129a400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f12940b3ab0 con 0x7f12940d2af0 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f129a400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f129415f460 con 0x7f129415e360 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f129a400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f129415f740 con 0x7f129415e740 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f1293e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f12940d2af0 0x7f12940d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f1299000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f129415e360 0x7f129415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f1299a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f129415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f1293e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f12940d2af0 0x7f12940d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50338/0 (socket says 172.21.15.7:50338) 2024-08-19T00:37:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f1299000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f129415e360 0x7f129415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:51720/0 (socket says 172.21.15.7:51720) 2024-08-19T00:37:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f1293e00640 1 -- 172.21.15.7:0/251412388 learned_addr learned my addr 172.21.15.7:0/251412388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.557+0000 7f1299a00640 1 --2- 172.21.15.7:0/251412388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f129415ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:36922/0 (socket says 172.21.15.7:36922) 2024-08-19T00:37:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.558+0000 7f1293e00640 1 -- 172.21.15.7:0/251412388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 msgr2=0x7f129415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.558+0000 7f1293e00640 1 --2- 172.21.15.7:0/251412388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f129415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.558+0000 7f1293e00640 1 -- 172.21.15.7:0/251412388 >> v2:172.21.15.162:3300/0 conn(0x7f129415e360 msgr2=0x7f129415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.558+0000 7f1293e00640 1 --2- 172.21.15.7:0/251412388 >> v2:172.21.15.162:3300/0 conn(0x7f129415e360 0x7f129415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.558+0000 7f1293e00640 1 -- 172.21.15.7:0/251412388 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12940b3d60 con 0x7f12940d2af0 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.559+0000 7f1293e00640 1 --2- 172.21.15.7:0/251412388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f12940d2f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f129408e8a0 tx=0x7f128002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9afaeb4733198ec server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.559+0000 7f1293400640 1 -- 172.21.15.7:0/251412388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280037070 con 0x7f12940d2af0 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.559+0000 7f1293400640 1 -- 172.21.15.7:0/251412388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1280032440 con 0x7f12940d2af0 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.559+0000 7f1293400640 1 -- 172.21.15.7:0/251412388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280032810 con 0x7f12940d2af0 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 -- 172.21.15.7:0/251412388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 msgr2=0x7f12940d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 --2- 172.21.15.7:0/251412388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f12940d2f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f129408e8a0 tx=0x7f128002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 -- 172.21.15.7:0/251412388 shutdown_connections 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 --2- 172.21.15.7:0/251412388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f129415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 --2- 172.21.15.7:0/251412388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f12940d2f80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 --2- 172.21.15.7:0/251412388 >> v2:172.21.15.162:3300/0 conn(0x7f129415e360 0x7f129415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 -- 172.21.15.7:0/251412388 >> 172.21.15.7:0/251412388 conn(0x7f129408dbf0 msgr2=0x7f129409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 -- 172.21.15.7:0/251412388 shutdown_connections 2024-08-19T00:37:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.560+0000 7f129a400640 1 -- 172.21.15.7:0/251412388 wait complete. 2024-08-19T00:37:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.561+0000 7f129a400640 1 Processor -- start 2024-08-19T00:37:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.562+0000 7f129a400640 1 -- start start 2024-08-19T00:37:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.562+0000 7f129a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f1294156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.562+0000 7f129a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f129415e360 0x7f12940d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.562+0000 7f129a400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f1294158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f129a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f129415f0f0 con 0x7f12940d2af0 2024-08-19T00:37:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f129a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12940d2300 con 0x7f129415e360 2024-08-19T00:37:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f129a400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f12940b4560 con 0x7f129415e740 2024-08-19T00:37:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f1294156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f1294156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50344/0 (socket says 172.21.15.7:50344) 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 -- 172.21.15.7:0/3178237832 learned_addr learned my addr 172.21.15.7:0/3178237832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299a00640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f1294158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1293e00640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f129415e360 0x7f12940d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 -- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 msgr2=0x7f1294158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f1294158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 -- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f129415e360 msgr2=0x7f12940d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f129415e360 0x7f12940d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 -- 172.21.15.7:0/3178237832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1294156af0 con 0x7f12940d2af0 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1293e00640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f129415e360 0x7f12940d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.563+0000 7f1299000640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f1294156020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f128800e890 tx=0x7f128800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.564+0000 7f1290c00640 1 -- 172.21.15.7:0/3178237832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288017070 con 0x7f12940d2af0 2024-08-19T00:37:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.564+0000 7f1290c00640 1 -- 172.21.15.7:0/3178237832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128800c940 con 0x7f12940d2af0 2024-08-19T00:37:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.564+0000 7f1290c00640 1 -- 172.21.15.7:0/3178237832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128800cd10 con 0x7f12940d2af0 2024-08-19T00:37:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.564+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1294157660 con 0x7f12940d2af0 2024-08-19T00:37:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.564+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1294157f00 con 0x7f12940d2af0 2024-08-19T00:37:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.565+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1294157a50 con 0x7f12940d2af0 2024-08-19T00:37:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.566+0000 7f1290c00640 1 -- 172.21.15.7:0/3178237832 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f128801a070 con 0x7f12940d2af0 2024-08-19T00:37:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.567+0000 7f1290c00640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f127406be60 0x7f127406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.567+0000 7f1290c00640 1 -- 172.21.15.7:0/3178237832 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f128808ad70 con 0x7f12940d2af0 2024-08-19T00:37:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.567+0000 7f1293e00640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f127406be60 0x7f127406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.568+0000 7f1293e00640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f127406be60 0x7f127406e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1280034000 tx=0x7f128002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:03.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.572+0000 7f1290c00640 1 -- 172.21.15.7:0/3178237832 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1294156af0 con 0x7f12940d2af0 2024-08-19T00:37:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.758+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f129415ebb0 con 0x7f12940d2af0 2024-08-19T00:37:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.759+0000 7f1290c00640 1 -- 172.21.15.7:0/3178237832 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16586 (secure 0 0 0) 0x7f12880590c0 con 0x7f12940d2af0 2024-08-19T00:37:03.762 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:03.762 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:02.781284+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f127406be60 msgr2=0x7f127406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f127406be60 0x7f127406e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1280034000 tx=0x7f128002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 msgr2=0x7f1294156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f1294156020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f128800e890 tx=0x7f128800ed50 comp rx=0 tx=0).stop 2024-08-19T00:37:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 shutdown_connections 2024-08-19T00:37:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f127406be60 0x7f127406e320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f129415e740 0x7f1294158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f129415e360 0x7f12940d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 --2- 172.21.15.7:0/3178237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12940d2af0 0x7f1294156020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 >> 172.21.15.7:0/3178237832 conn(0x7f129408dbf0 msgr2=0x7f1294162840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 shutdown_connections 2024-08-19T00:37:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.761+0000 7f129a400640 1 -- 172.21.15.7:0/3178237832 wait complete. 2024-08-19T00:37:03.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.933+0000 7fde31c00640 1 Processor -- start 2024-08-19T00:37:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.933+0000 7fde31c00640 1 -- start start 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.934+0000 7fde31c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.934+0000 7fde31c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fde2c0d03c0 0x7fde2c0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde31c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2c06f7f0 con 0x7fde2c159bf0 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde31c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fde2c0cee80 con 0x7fde2c0d03c0 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde31c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde2c0d0d70 con 0x7fde2c0ce500 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde2b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fde2c0d03c0 0x7fde2c0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde2b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fde2c0d03c0 0x7fde2c0d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35174/0 (socket says 172.21.15.7:35174) 2024-08-19T00:37:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde2b400640 1 -- 172.21.15.7:0/1030990832 learned_addr learned my addr 172.21.15.7:0/1030990832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde23e00640 1 --2- 172.21.15.7:0/1030990832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde2b400640 1 -- 172.21.15.7:0/1030990832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 msgr2=0x7fde2c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde2b400640 1 --2- 172.21.15.7:0/1030990832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde2b400640 1 -- 172.21.15.7:0/1030990832 >> v1:172.21.15.162:6789/0 conn(0x7fde2c159bf0 legacy=0x7fde2c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde2b400640 1 -- 172.21.15.7:0/1030990832 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c06f510 con 0x7fde2c0d03c0 2024-08-19T00:37:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.935+0000 7fde23e00640 1 --2- 172.21.15.7:0/1030990832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.936+0000 7fde2b400640 1 --2- 172.21.15.7:0/1030990832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c0d0830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde24009e50 tx=0x7fde2402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59763cd0dd4de9c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde2a000640 1 -- 172.21.15.7:0/1030990832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24036070 con 0x7fde2c0d03c0 2024-08-19T00:37:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde2a000640 1 -- 172.21.15.7:0/1030990832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24031600 con 0x7fde2c0d03c0 2024-08-19T00:37:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde2a000640 1 -- 172.21.15.7:0/1030990832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240319d0 con 0x7fde2c0d03c0 2024-08-19T00:37:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 -- 172.21.15.7:0/1030990832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 msgr2=0x7fde2c0d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 --2- 172.21.15.7:0/1030990832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c0d0830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde24009e50 tx=0x7fde2402a680 comp rx=0 tx=0).stop 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 -- 172.21.15.7:0/1030990832 shutdown_connections 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 --2- 172.21.15.7:0/1030990832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c0d0830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 --2- 172.21.15.7:0/1030990832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 -- 172.21.15.7:0/1030990832 >> 172.21.15.7:0/1030990832 conn(0x7fde2c06bc70 msgr2=0x7fde2c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 -- 172.21.15.7:0/1030990832 shutdown_connections 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.937+0000 7fde31c00640 1 -- 172.21.15.7:0/1030990832 wait complete. 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.939+0000 7fde31c00640 1 Processor -- start 2024-08-19T00:37:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.939+0000 7fde31c00640 1 -- start start 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde31c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c1e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde31c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c1e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde31c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c159bf0 0x7fde2c151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde31c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c072f40 con 0x7fde2c0d03c0 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde31c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c072c60 con 0x7fde2c159bf0 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde31c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde2c073b70 con 0x7fde2c0ce500 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c1e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c1e5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35182/0 (socket says 172.21.15.7:35182) 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde23e00640 1 -- 172.21.15.7:0/3230348246 learned_addr learned my addr 172.21.15.7:0/3230348246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde2aa00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c1e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.940+0000 7fde2b400640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c159bf0 0x7fde2c151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde23e00640 1 -- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 msgr2=0x7fde2c1e7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde23e00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c1e7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde23e00640 1 -- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c159bf0 msgr2=0x7fde2c151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde23e00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c159bf0 0x7fde2c151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde23e00640 1 -- 172.21.15.7:0/3230348246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c14ddf0 con 0x7fde2c0d03c0 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde2aa00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c1e7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde2b400640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c159bf0 0x7fde2c151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde23e00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c1e5b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde1400d7d0 tx=0x7fde1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde22a00640 1 -- 172.21.15.7:0/3230348246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1400b6c0 con 0x7fde2c0d03c0 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde22a00640 1 -- 172.21.15.7:0/3230348246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde14019070 con 0x7fde2c0d03c0 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde22a00640 1 -- 172.21.15.7:0/3230348246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1400baa0 con 0x7fde2c0d03c0 2024-08-19T00:37:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c1e80c0 con 0x7fde2c0d03c0 2024-08-19T00:37:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.941+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c1e8680 con 0x7fde2c0d03c0 2024-08-19T00:37:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.942+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2c159fd0 con 0x7fde2c0d03c0 2024-08-19T00:37:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.943+0000 7fde22a00640 1 -- 172.21.15.7:0/3230348246 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde1400bc40 con 0x7fde2c0d03c0 2024-08-19T00:37:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.944+0000 7fde22a00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde0806be60 0x7fde0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.944+0000 7fde22a00640 1 -- 172.21.15.7:0/3230348246 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fde1408b2d0 con 0x7fde2c0d03c0 2024-08-19T00:37:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.944+0000 7fde2aa00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde0806be60 0x7fde0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.945+0000 7fde2aa00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde0806be60 0x7fde0806e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001700 tx=0x7fde1c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:03.949+0000 7fde22a00640 1 -- 172.21.15.7:0/3230348246 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fde2c14ddf0 con 0x7fde2c0d03c0 2024-08-19T00:37:04.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.133+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde2c15ed30 con 0x7fde2c0d03c0 2024-08-19T00:37:04.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.134+0000 7fde22a00640 1 -- 172.21.15.7:0/3230348246 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16586 (secure 0 0 0) 0x7fde14059be0 con 0x7fde2c0d03c0 2024-08-19T00:37:04.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:04.137 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:02.781284+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:04.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde0806be60 msgr2=0x7fde0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:04.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde0806be60 0x7fde0806e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001700 tx=0x7fde1c009040 comp rx=0 tx=0).stop 2024-08-19T00:37:04.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 msgr2=0x7fde2c1e5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:04.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c1e5b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde1400d7d0 tx=0x7fde1400dc90 comp rx=0 tx=0).stop 2024-08-19T00:37:04.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 shutdown_connections 2024-08-19T00:37:04.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde0806be60 0x7fde0806e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c159bf0 0x7fde2c151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde2c0d03c0 0x7fde2c1e5b90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 --2- 172.21.15.7:0/3230348246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde2c0ce500 0x7fde2c1e7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 >> 172.21.15.7:0/3230348246 conn(0x7fde2c06bc70 msgr2=0x7fde2c15e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:04.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 shutdown_connections 2024-08-19T00:37:04.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.137+0000 7fde31c00640 1 -- 172.21.15.7:0/3230348246 wait complete. 2024-08-19T00:37:04.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:37:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.313+0000 7f0cf0a00640 1 Processor -- start 2024-08-19T00:37:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.314+0000 7f0cf0a00640 1 -- start start 2024-08-19T00:37:04.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0cf0a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0cec15c390 0x7f0cec166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0cf0a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cec0acef0 con 0x7f0cec15bfb0 2024-08-19T00:37:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0cf0a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cec0ad1d0 con 0x7f0cec0b5130 2024-08-19T00:37:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0cf0a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0cec0ad790 con 0x7f0cec15c390 2024-08-19T00:37:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0ce9e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0cec15bfb0 0x7f0cec0b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46202/0 (socket says 172.21.15.7:46202) 2024-08-19T00:37:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0ce9e00640 1 -- 172.21.15.7:0/779163659 learned_addr learned my addr 172.21.15.7:0/779163659 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0cea800640 1 --2- 172.21.15.7:0/779163659 >> v2:172.21.15.162:3300/0 conn(0x7f0cec15c390 0x7f0cec166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624844700 0 0) 0x7f0cec0acef0 con 0x7f0cec15bfb0 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.315+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cd0003520 con 0x7f0cec15bfb0 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4245604682 0 0) 0x7f0cd0003520 con 0x7f0cec15bfb0 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 >> v2:172.21.15.162:3300/0 conn(0x7f0cec15c390 msgr2=0x7f0cec166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 --2- 172.21.15.7:0/779163659 >> v2:172.21.15.162:3300/0 conn(0x7f0cec15c390 0x7f0cec166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 >> v1:172.21.15.162:6789/0 conn(0x7f0cec0b5130 legacy=0x7f0cec0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec0ad4b0 con 0x7f0cec15bfb0 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f0cdc001670 con 0x7f0cec15bfb0 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 >> v1:172.21.15.7:6789/0 conn(0x7f0cec15bfb0 legacy=0x7f0cec0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd00039b0 0x7f0cd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd00051c0 0x7f0cd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec0ad790 con 0x7f0cd0004800 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd000c060 con 0x7f0cd00051c0 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd000c260 con 0x7f0cd00039b0 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0cea800640 1 --2- 172.21.15.7:0/779163659 >> v2:172.21.15.162:3300/0 conn(0x7f0cec15c390 0x7f0cec166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce3e00640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0ce9e00640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd00039b0 0x7f0cd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.316+0000 7f0cea800640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd00051c0 0x7f0cd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.317+0000 7f0ce3e00640 1 -- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd00039b0 msgr2=0x7f0cd0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.317+0000 7f0ce3e00640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd00039b0 0x7f0cd0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.317+0000 7f0ce3e00640 1 -- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd00051c0 msgr2=0x7f0cd000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.317+0000 7f0ce3e00640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd00051c0 0x7f0cd000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.317+0000 7f0ce3e00640 1 -- 172.21.15.7:0/779163659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd0003520 con 0x7f0cd0004800 2024-08-19T00:37:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.317+0000 7f0cea800640 1 -- 172.21.15.7:0/779163659 reap_dead start 2024-08-19T00:37:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0ce3e00640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cd0004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4001750 tx=0x7f0cd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38917195c72b54af server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4001370 con 0x7f0cd0004800 2024-08-19T00:37:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd40052d0 con 0x7f0cd0004800 2024-08-19T00:37:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0ce9400640 1 -- 172.21.15.7:0/779163659 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd402abc0 con 0x7f0cd0004800 2024-08-19T00:37:04.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0cf0a00640 1 -- 172.21.15.7:0/779163659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 msgr2=0x7f0cd0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:04.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cd0004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4001750 tx=0x7f0cd0005830 comp rx=0 tx=0).stop 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0cf0a00640 1 -- 172.21.15.7:0/779163659 shutdown_connections 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/779163659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cd0004c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0cf0a00640 1 -- 172.21.15.7:0/779163659 >> 172.21.15.7:0/779163659 conn(0x7f0cec0b2300 msgr2=0x7f0cec06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0cf0a00640 1 -- 172.21.15.7:0/779163659 shutdown_connections 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.318+0000 7f0cf0a00640 1 -- 172.21.15.7:0/779163659 wait complete. 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.320+0000 7f0cf0a00640 1 Processor -- start 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.320+0000 7f0cf0a00640 1 -- start start 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0cf0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cec1f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0cf0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cec15b260 0x7f0cec1f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0cf0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cec1558a0 0x7f0cec155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0cf0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec0b3f80 con 0x7f0cd0004800 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0cf0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec0b3e00 con 0x7f0cec15b260 2024-08-19T00:37:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0cf0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cec0b4100 con 0x7f0cec1558a0 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0ce9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cec1f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0ce9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cec1f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35200/0 (socket says 172.21.15.7:35200) 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.321+0000 7f0ce9e00640 1 -- 172.21.15.7:0/1768086404 learned_addr learned my addr 172.21.15.7:0/1768086404 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce3e00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cec15b260 0x7f0cec1f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0cea800640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cec1558a0 0x7f0cec155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce9e00640 1 -- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cec1558a0 msgr2=0x7f0cec155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce9e00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cec1558a0 0x7f0cec155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce9e00640 1 -- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cec15b260 msgr2=0x7f0cec1f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce9e00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cec15b260 0x7f0cec1f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce9e00640 1 -- 172.21.15.7:0/1768086404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec1f4130 con 0x7f0cd0004800 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce9e00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cec1f7f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc007290 tx=0x7f0cdc007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce2000640 1 -- 172.21.15.7:0/1768086404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00f9c0 con 0x7f0cd0004800 2024-08-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce2000640 1 -- 172.21.15.7:0/1768086404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cdc018070 con 0x7f0cd0004800 2024-08-19T00:37:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec1f4410 con 0x7f0cd0004800 2024-08-19T00:37:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.322+0000 7f0ce2000640 1 -- 172.21.15.7:0/1768086404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00fda0 con 0x7f0cd0004800 2024-08-19T00:37:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.323+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec1f49d0 con 0x7f0cd0004800 2024-08-19T00:37:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.324+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cec0aebd0 con 0x7f0cd0004800 2024-08-19T00:37:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.325+0000 7f0ce2000640 1 -- 172.21.15.7:0/1768086404 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0cdc01d460 con 0x7f0cd0004800 2024-08-19T00:37:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.326+0000 7f0ce2000640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cc806be30 0x7f0cc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.326+0000 7f0ce2000640 1 -- 172.21.15.7:0/1768086404 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0cdc08aee0 con 0x7f0cd0004800 2024-08-19T00:37:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.326+0000 7f0ce3e00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cc806be30 0x7f0cc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.327+0000 7f0ce3e00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cc806be30 0x7f0cc806e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4032000 tx=0x7f0cd402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.330+0000 7f0ce2000640 1 -- 172.21.15.7:0/1768086404 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0cdc059880 con 0x7f0cd0004800 2024-08-19T00:37:04.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:04.555+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0cec073250 con 0x7f0cd0004800 2024-08-19T00:37:05.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.374+0000 7f0ce2000640 1 -- 172.21.15.7:0/1768086404 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f0cdc059180 con 0x7f0cd0004800 2024-08-19T00:37:05.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cc806be30 msgr2=0x7f0cc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:05.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cc806be30 0x7f0cc806e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4032000 tx=0x7f0cd402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:05.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 msgr2=0x7f0cec1f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:05.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cec1f7f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc007290 tx=0x7f0cdc007750 comp rx=0 tx=0).stop 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 shutdown_connections 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cc806be30 0x7f0cc806e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cec1558a0 0x7f0cec155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cec15b260 0x7f0cec1f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.377+0000 7f0cf0a00640 1 --2- 172.21.15.7:0/1768086404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd0004800 0x7f0cec1f7f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.378+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 >> 172.21.15.7:0/1768086404 conn(0x7f0cec0b2300 msgr2=0x7f0cec0afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.378+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 shutdown_connections 2024-08-19T00:37:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.378+0000 7f0cf0a00640 1 -- 172.21.15.7:0/1768086404 wait complete. 2024-08-19T00:37:05.398 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-19T00:37:05.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-19T00:37:05.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.560+0000 7fa705e00640 1 Processor -- start 2024-08-19T00:37:05.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.560+0000 7fa705e00640 1 -- start start 2024-08-19T00:37:05.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.561+0000 7fa705e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa700158cd0 0x7fa700072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.561+0000 7fa705e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7000aeae0 con 0x7fa700072ff0 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.561+0000 7fa705e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7000aedc0 con 0x7fa7000ae480 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.561+0000 7fa705e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa700073430 con 0x7fa700158cd0 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.561+0000 7fa6f6000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa700072ff0 0x7fa7000add70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46218/0 (socket says 172.21.15.7:46218) 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.561+0000 7fa6f6000640 1 -- 172.21.15.7:0/2309571410 learned_addr learned my addr 172.21.15.7:0/2309571410 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.561+0000 7fa6fea00640 1 --2- 172.21.15.7:0/2309571410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa700158cd0 0x7fa700072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.562+0000 7fa6fe000640 1 -- 172.21.15.7:0/2309571410 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899470159 0 0) 0x7fa7000aeae0 con 0x7fa700072ff0 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.562+0000 7fa6fe000640 1 -- 172.21.15.7:0/2309571410 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e4005730 con 0x7fa700072ff0 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.562+0000 7fa6fe000640 1 -- 172.21.15.7:0/2309571410 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075576942 0 0) 0x7fa7000aedc0 con 0x7fa7000ae480 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.562+0000 7fa6fe000640 1 -- 172.21.15.7:0/2309571410 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7000aeae0 con 0x7fa7000ae480 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.562+0000 7fa6fea00640 1 -- 172.21.15.7:0/2309571410 >> v1:172.21.15.162:6789/0 conn(0x7fa7000ae480 legacy=0x7fa7000b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.562+0000 7fa6fea00640 1 -- 172.21.15.7:0/2309571410 >> v1:172.21.15.7:6789/0 conn(0x7fa700072ff0 legacy=0x7fa7000add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:05.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.562+0000 7fa6fea00640 1 -- 172.21.15.7:0/2309571410 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7000af0a0 con 0x7fa700158cd0 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.563+0000 7fa6fea00640 1 --2- 172.21.15.7:0/2309571410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa700158cd0 0x7fa700072ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00097d0 tx=0x7fa6f002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0fc33be9765297b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.563+0000 7fa6fe000640 1 -- 172.21.15.7:0/2309571410 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0037070 con 0x7fa700158cd0 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.563+0000 7fa6fe000640 1 -- 172.21.15.7:0/2309571410 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f002ae40 con 0x7fa700158cd0 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.563+0000 7fa6fe000640 1 -- 172.21.15.7:0/2309571410 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0032660 con 0x7fa700158cd0 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.564+0000 7fa705e00640 1 -- 172.21.15.7:0/2309571410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa700158cd0 msgr2=0x7fa700072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.564+0000 7fa705e00640 1 --2- 172.21.15.7:0/2309571410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa700158cd0 0x7fa700072ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00097d0 tx=0x7fa6f002a0f0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.564+0000 7fa705e00640 1 -- 172.21.15.7:0/2309571410 shutdown_connections 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.564+0000 7fa705e00640 1 --2- 172.21.15.7:0/2309571410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa700158cd0 0x7fa700072ab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.564+0000 7fa705e00640 1 -- 172.21.15.7:0/2309571410 >> 172.21.15.7:0/2309571410 conn(0x7fa7000b2300 msgr2=0x7fa70006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.564+0000 7fa705e00640 1 -- 172.21.15.7:0/2309571410 shutdown_connections 2024-08-19T00:37:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.564+0000 7fa705e00640 1 -- 172.21.15.7:0/2309571410 wait complete. 2024-08-19T00:37:05.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.565+0000 7fa705e00640 1 Processor -- start 2024-08-19T00:37:05.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.566+0000 7fa705e00640 1 -- start start 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.566+0000 7fa705e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa700072ff0 0x7fa7000cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.566+0000 7fa705e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7000ae480 0x7fa70014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.566+0000 7fa705e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7000ca310 0x7fa70014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa705e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7000b3860 con 0x7fa700072ff0 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa705e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7000af660 con 0x7fa7000ae480 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa705e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7000b39e0 con 0x7fa7000ca310 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa700072ff0 0x7fa7000cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa700072ff0 0x7fa7000cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35206/0 (socket says 172.21.15.7:35206) 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 -- 172.21.15.7:0/3928679523 learned_addr learned my addr 172.21.15.7:0/3928679523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:05.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6f6000640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7000ae480 0x7fa70014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6ff400640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7000ca310 0x7fa70014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 -- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7000ca310 msgr2=0x7fa70014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7000ca310 0x7fa70014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 -- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7000ae480 msgr2=0x7fa70014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7000ae480 0x7fa70014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6fea00640 1 -- 172.21.15.7:0/3928679523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7000caeb0 con 0x7fa700072ff0 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6ff400640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7000ca310 0x7fa70014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.567+0000 7fa6f6000640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7000ae480 0x7fa70014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:05.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.568+0000 7fa6fea00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa700072ff0 0x7fa7000cdcb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00098f0 tx=0x7fa6f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.568+0000 7fa6f7e00640 1 -- 172.21.15.7:0/3928679523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0041020 con 0x7fa700072ff0 2024-08-19T00:37:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.568+0000 7fa6f7e00640 1 -- 172.21.15.7:0/3928679523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f003c670 con 0x7fa700072ff0 2024-08-19T00:37:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.568+0000 7fa6f7e00640 1 -- 172.21.15.7:0/3928679523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0037040 con 0x7fa700072ff0 2024-08-19T00:37:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.568+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7000cb190 con 0x7fa700072ff0 2024-08-19T00:37:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.568+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7000cb750 con 0x7fa700072ff0 2024-08-19T00:37:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.569+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7000add70 con 0x7fa700072ff0 2024-08-19T00:37:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.570+0000 7fa6f7e00640 1 -- 172.21.15.7:0/3928679523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6f0044020 con 0x7fa700072ff0 2024-08-19T00:37:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.571+0000 7fa6f7e00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6dc06be30 0x7fa6dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.571+0000 7fa6f7e00640 1 -- 172.21.15.7:0/3928679523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa6f00ab540 con 0x7fa700072ff0 2024-08-19T00:37:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.571+0000 7fa6f6000640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6dc06be30 0x7fa6dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.572+0000 7fa6f6000640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6dc06be30 0x7fa6dc06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8007fd0 tx=0x7fa6e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:05.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.575+0000 7fa6f7e00640 1 -- 172.21.15.7:0/3928679523 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa6f004b030 con 0x7fa700072ff0 2024-08-19T00:37:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:05.794+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa7000cfd30 con 0x7fa700072ff0 2024-08-19T00:37:06.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.376+0000 7fa6f7e00640 1 -- 172.21.15.7:0/3928679523 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fa6f0079ee0 con 0x7fa700072ff0 2024-08-19T00:37:06.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.379+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6dc06be30 msgr2=0x7fa6dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.379+0000 7fa705e00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6dc06be30 0x7fa6dc06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8007fd0 tx=0x7fa6e8009040 comp rx=0 tx=0).stop 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.379+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa700072ff0 msgr2=0x7fa7000cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.379+0000 7fa705e00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa700072ff0 0x7fa7000cdcb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00098f0 tx=0x7fa6f00046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 shutdown_connections 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6dc06be30 0x7fa6dc06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7000ca310 0x7fa70014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7000ae480 0x7fa70014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 --2- 172.21.15.7:0/3928679523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa700072ff0 0x7fa7000cdcb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 >> 172.21.15.7:0/3928679523 conn(0x7fa7000b2300 msgr2=0x7fa7000b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 shutdown_connections 2024-08-19T00:37:06.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.380+0000 7fa705e00640 1 -- 172.21.15.7:0/3928679523 wait complete. 2024-08-19T00:37:06.400 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-19T00:37:06.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.557+0000 7f158a200640 1 Processor -- start 2024-08-19T00:37:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.557+0000 7f158a200640 1 -- start start 2024-08-19T00:37:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f158a200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f1584071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f158a200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f158406e710 0x7f15840d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f158a200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15840b3750 0x7f15840cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f158a200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f15840cebc0 con 0x7f15840b3750 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f158a200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f15840d0ce0 con 0x7f158406e710 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f158a200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15840cdfb0 con 0x7f15840d03c0 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f1583e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15840b3750 0x7f15840cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f1583e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15840b3750 0x7f15840cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35212/0 (socket says 172.21.15.7:35212) 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f1583e00640 1 -- 172.21.15.7:0/1095865563 learned_addr learned my addr 172.21.15.7:0/1095865563 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f1583400640 1 --2- 172.21.15.7:0/1095865563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f1584071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.558+0000 7f1582a00640 1 --2- 172.21.15.7:0/1095865563 >> v2:172.21.15.162:3300/0 conn(0x7f158406e710 0x7f15840d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.559+0000 7f1583e00640 1 -- 172.21.15.7:0/1095865563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 msgr2=0x7f1584071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.559+0000 7f1583e00640 1 --2- 172.21.15.7:0/1095865563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f1584071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.559+0000 7f1583e00640 1 -- 172.21.15.7:0/1095865563 >> v2:172.21.15.162:3300/0 conn(0x7f158406e710 msgr2=0x7f15840d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.559+0000 7f1583e00640 1 --2- 172.21.15.7:0/1095865563 >> v2:172.21.15.162:3300/0 conn(0x7f158406e710 0x7f15840d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.559+0000 7f1583e00640 1 -- 172.21.15.7:0/1095865563 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15840ce290 con 0x7f15840b3750 2024-08-19T00:37:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.559+0000 7f1582a00640 1 --2- 172.21.15.7:0/1095865563 >> v2:172.21.15.162:3300/0 conn(0x7f158406e710 0x7f15840d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.560+0000 7f1583e00640 1 --2- 172.21.15.7:0/1095865563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15840b3750 0x7f15840cf050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15840cdbc0 tx=0x7f157c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0e58f887ae4868 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.560+0000 7f1582000640 1 -- 172.21.15.7:0/1095865563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c036070 con 0x7f15840b3750 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.560+0000 7f1582000640 1 -- 172.21.15.7:0/1095865563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c031600 con 0x7f15840b3750 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.560+0000 7f1582000640 1 -- 172.21.15.7:0/1095865563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0319d0 con 0x7f15840b3750 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 -- 172.21.15.7:0/1095865563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15840b3750 msgr2=0x7f15840cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 --2- 172.21.15.7:0/1095865563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15840b3750 0x7f15840cf050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15840cdbc0 tx=0x7f157c02a6a0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 -- 172.21.15.7:0/1095865563 shutdown_connections 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 --2- 172.21.15.7:0/1095865563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15840b3750 0x7f15840cf050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 --2- 172.21.15.7:0/1095865563 >> v2:172.21.15.162:3300/0 conn(0x7f158406e710 0x7f15840d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 --2- 172.21.15.7:0/1095865563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f1584071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 -- 172.21.15.7:0/1095865563 >> 172.21.15.7:0/1095865563 conn(0x7f158406bc70 msgr2=0x7f158406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:06.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 -- 172.21.15.7:0/1095865563 shutdown_connections 2024-08-19T00:37:06.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.561+0000 7f158a200640 1 -- 172.21.15.7:0/1095865563 wait complete. 2024-08-19T00:37:06.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.562+0000 7f158a200640 1 Processor -- start 2024-08-19T00:37:06.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.562+0000 7f158a200640 1 -- start start 2024-08-19T00:37:06.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.563+0000 7f158a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158406e710 0x7f1584152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.563+0000 7f158a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15840b3750 0x7f158415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.563+0000 7f158a200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f158415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.563+0000 7f158a200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1584073ae0 con 0x7f158406e710 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.563+0000 7f158a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15840ce850 con 0x7f15840b3750 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.563+0000 7f158a200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1584073c60 con 0x7f15840d03c0 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158406e710 0x7f1584152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158406e710 0x7f1584152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35224/0 (socket says 172.21.15.7:35224) 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 -- 172.21.15.7:0/4273894674 learned_addr learned my addr 172.21.15.7:0/4273894674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583e00640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f158415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1582a00640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15840b3750 0x7f158415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 -- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 msgr2=0x7f158415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f158415dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 -- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15840b3750 msgr2=0x7f158415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15840b3750 0x7f158415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 -- 172.21.15.7:0/4273894674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1584152fe0 con 0x7f158406e710 2024-08-19T00:37:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.564+0000 7f1583400640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158406e710 0x7f1584152aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f157400e9e0 tx=0x7f157400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.565+0000 7f157b400640 1 -- 172.21.15.7:0/4273894674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574017070 con 0x7f158406e710 2024-08-19T00:37:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.565+0000 7f157b400640 1 -- 172.21.15.7:0/4273894674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157400c9d0 con 0x7f158406e710 2024-08-19T00:37:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.565+0000 7f157b400640 1 -- 172.21.15.7:0/4273894674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157400cdc0 con 0x7f158406e710 2024-08-19T00:37:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.565+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158415cac0 con 0x7f158406e710 2024-08-19T00:37:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.565+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15840b0cd0 con 0x7f158406e710 2024-08-19T00:37:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.566+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15840b3be0 con 0x7f158406e710 2024-08-19T00:37:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.567+0000 7f157b400640 1 -- 172.21.15.7:0/4273894674 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f157401a070 con 0x7f158406e710 2024-08-19T00:37:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.568+0000 7f157b400640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f156406be30 0x7f156406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.568+0000 7f157b400640 1 -- 172.21.15.7:0/4273894674 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f157408b1d0 con 0x7f158406e710 2024-08-19T00:37:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.568+0000 7f1582a00640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f156406be30 0x7f156406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.568+0000 7f1582a00640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f156406be30 0x7f156406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f158409a070 tx=0x7f1570008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.572+0000 7f157b400640 1 -- 172.21.15.7:0/4273894674 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1574059490 con 0x7f158406e710 2024-08-19T00:37:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.793+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1584167d20 con 0x7f158406e710 2024-08-19T00:37:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.794+0000 7f157b400640 1 -- 172.21.15.7:0/4273894674 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f157405d790 con 0x7f158406e710 2024-08-19T00:37:06.796 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:06.797 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f156406be30 msgr2=0x7f156406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f156406be30 0x7f156406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f158409a070 tx=0x7f1570008040 comp rx=0 tx=0).stop 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158406e710 msgr2=0x7f1584152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158406e710 0x7f1584152aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f157400e9e0 tx=0x7f157400eea0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 shutdown_connections 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f156406be30 0x7f156406e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15840d03c0 0x7f158415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15840b3750 0x7f158415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 --2- 172.21.15.7:0/4273894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f158406e710 0x7f1584152aa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 >> 172.21.15.7:0/4273894674 conn(0x7f158406bc70 msgr2=0x7f1584071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 shutdown_connections 2024-08-19T00:37:06.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.796+0000 7f158a200640 1 -- 172.21.15.7:0/4273894674 wait complete. 2024-08-19T00:37:06.814 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:06.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.966+0000 7f07f9e00640 1 Processor -- start 2024-08-19T00:37:06.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.966+0000 7f07f9e00640 1 -- start start 2024-08-19T00:37:06.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.967+0000 7f07f9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f409aa70 0x7f07f409ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.967+0000 7f07f9e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f07f40d0290 0x7f07f40d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.967+0000 7f07f9e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07f409b390 con 0x7f07f409b730 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.967+0000 7f07f9e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f07f415ec30 con 0x7f07f409aa70 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.967+0000 7f07f9e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f07f415ef10 con 0x7f07f40d0290 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.967+0000 7f07f2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f409aa70 0x7f07f409ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f409aa70 0x7f07f409ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35232/0 (socket says 172.21.15.7:35232) 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f2a00640 1 -- 172.21.15.7:0/2329585104 learned_addr learned my addr 172.21.15.7:0/2329585104 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f3400640 1 --2- 172.21.15.7:0/2329585104 >> v2:172.21.15.162:3300/0 conn(0x7f07f40d0290 0x7f07f40d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f2a00640 1 -- 172.21.15.7:0/2329585104 >> v2:172.21.15.162:3300/0 conn(0x7f07f40d0290 msgr2=0x7f07f40d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f2a00640 1 --2- 172.21.15.7:0/2329585104 >> v2:172.21.15.162:3300/0 conn(0x7f07f40d0290 0x7f07f40d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f2a00640 1 -- 172.21.15.7:0/2329585104 >> v1:172.21.15.162:6789/0 conn(0x7f07f409b730 legacy=0x7f07f406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f2a00640 1 -- 172.21.15.7:0/2329585104 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f415f1f0 con 0x7f07f409aa70 2024-08-19T00:37:06.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.968+0000 7f07f3400640 1 --2- 172.21.15.7:0/2329585104 >> v2:172.21.15.162:3300/0 conn(0x7f07f40d0290 0x7f07f40d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.969+0000 7f07f2a00640 1 --2- 172.21.15.7:0/2329585104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f409ae50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07f40730f0 tx=0x7f07e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495563e3e4cdddba server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.969+0000 7f07f1600640 1 -- 172.21.15.7:0/2329585104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4037070 con 0x7f07f409aa70 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.969+0000 7f07f1600640 1 -- 172.21.15.7:0/2329585104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e4032440 con 0x7f07f409aa70 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.969+0000 7f07f1600640 1 -- 172.21.15.7:0/2329585104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4032810 con 0x7f07f409aa70 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 -- 172.21.15.7:0/2329585104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 msgr2=0x7f07f409ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 --2- 172.21.15.7:0/2329585104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f409ae50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07f40730f0 tx=0x7f07e402a270 comp rx=0 tx=0).stop 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 -- 172.21.15.7:0/2329585104 shutdown_connections 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 --2- 172.21.15.7:0/2329585104 >> v2:172.21.15.162:3300/0 conn(0x7f07f40d0290 0x7f07f40d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 --2- 172.21.15.7:0/2329585104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f409ae50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 -- 172.21.15.7:0/2329585104 >> 172.21.15.7:0/2329585104 conn(0x7f07f40d2190 msgr2=0x7f07f40d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:06.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 -- 172.21.15.7:0/2329585104 shutdown_connections 2024-08-19T00:37:06.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.970+0000 7f07f9e00640 1 -- 172.21.15.7:0/2329585104 wait complete. 2024-08-19T00:37:06.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.971+0000 7f07f9e00640 1 Processor -- start 2024-08-19T00:37:06.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.972+0000 7f07f9e00640 1 -- start start 2024-08-19T00:37:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.972+0000 7f07f9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f4160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.972+0000 7f07f9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07f409b730 0x7f07f40b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.972+0000 7f07f9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07f40d0290 0x7f07f40b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.972+0000 7f07f9e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40d0c60 con 0x7f07f409aa70 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.972+0000 7f07f9e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07f415e8f0 con 0x7f07f409b730 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.972+0000 7f07f9e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07f40d0de0 con 0x7f07f40d0290 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f4160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f4160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35242/0 (socket says 172.21.15.7:35242) 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 -- 172.21.15.7:0/234261376 learned_addr learned my addr 172.21.15.7:0/234261376 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f3400640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07f40d0290 0x7f07f40b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2000640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07f409b730 0x7f07f40b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 -- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07f40d0290 msgr2=0x7f07f40b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07f40d0290 0x7f07f40b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 -- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07f409b730 msgr2=0x7f07f40b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07f409b730 0x7f07f40b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 -- 172.21.15.7:0/234261376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f4160a60 con 0x7f07f409aa70 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2000640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07f409b730 0x7f07f40b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.973+0000 7f07f2a00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f4160520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000c00 tx=0x7f07e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.974+0000 7f07eb400640 1 -- 172.21.15.7:0/234261376 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4041070 con 0x7f07f409aa70 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.974+0000 7f07eb400640 1 -- 172.21.15.7:0/234261376 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e403c870 con 0x7f07f409aa70 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.974+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f40b5bd0 con 0x7f07f409aa70 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.974+0000 7f07eb400640 1 -- 172.21.15.7:0/234261376 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4037040 con 0x7f07f409aa70 2024-08-19T00:37:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.974+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f40b25c0 con 0x7f07f409aa70 2024-08-19T00:37:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.975+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f409ae50 con 0x7f07f409aa70 2024-08-19T00:37:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.976+0000 7f07eb400640 1 -- 172.21.15.7:0/234261376 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07e4044070 con 0x7f07f409aa70 2024-08-19T00:37:06.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.977+0000 7f07eb400640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d406be30 0x7f07d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:06.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.977+0000 7f07eb400640 1 -- 172.21.15.7:0/234261376 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f07e40ab920 con 0x7f07f409aa70 2024-08-19T00:37:06.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.977+0000 7f07f2000640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d406be30 0x7f07d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:06.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.977+0000 7f07f2000640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d406be30 0x7f07d406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07f4161ce0 tx=0x7f07e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:06.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:06.981+0000 7f07eb400640 1 -- 172.21.15.7:0/234261376 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f07e407a3e0 con 0x7f07f409aa70 2024-08-19T00:37:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.164+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07f4160300 con 0x7f07f409aa70 2024-08-19T00:37:07.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.165+0000 7f07eb400640 1 -- 172.21.15.7:0/234261376 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16573 (secure 0 0 0) 0x7f07e4079ce0 con 0x7f07f409aa70 2024-08-19T00:37:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:07.168 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:04.356113+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.167+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d406be30 msgr2=0x7f07d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.167+0000 7f07f9e00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d406be30 0x7f07d406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07f4161ce0 tx=0x7f07e0009040 comp rx=0 tx=0).stop 2024-08-19T00:37:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.167+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 msgr2=0x7f07f4160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.167+0000 7f07f9e00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f4160520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000c00 tx=0x7f07e40046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 shutdown_connections 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d406be30 0x7f07d406e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07f40d0290 0x7f07f40b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07f409b730 0x7f07f40b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 --2- 172.21.15.7:0/234261376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f409aa70 0x7f07f4160520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 >> 172.21.15.7:0/234261376 conn(0x7f07f40d2190 msgr2=0x7f07f406db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 shutdown_connections 2024-08-19T00:37:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.168+0000 7f07f9e00640 1 -- 172.21.15.7:0/234261376 wait complete. 2024-08-19T00:37:07.187 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:37:07.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:37:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.343+0000 7f6c15200640 1 Processor -- start 2024-08-19T00:37:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.343+0000 7f6c15200640 1 -- start start 2024-08-19T00:37:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.344+0000 7f6c15200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c10071980 0x7f6c100cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.344+0000 7f6c15200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c100cdfb0 con 0x7f6c1006e710 2024-08-19T00:37:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.344+0000 7f6c15200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c100ce290 con 0x7f6c100d03c0 2024-08-19T00:37:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.344+0000 7f6c15200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6c100cebc0 con 0x7f6c10071980 2024-08-19T00:37:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.344+0000 7f6c05400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6c1006e710 0x7f6c100b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46220/0 (socket says 172.21.15.7:46220) 2024-08-19T00:37:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.344+0000 7f6c05400640 1 -- 172.21.15.7:0/3580561437 learned_addr learned my addr 172.21.15.7:0/3580561437 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.344+0000 7f6c0e800640 1 --2- 172.21.15.7:0/3580561437 >> v2:172.21.15.162:3300/0 conn(0x7f6c10071980 0x7f6c100cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.345+0000 7f6c0d400640 1 -- 172.21.15.7:0/3580561437 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998808032 0 0) 0x7f6c100cdfb0 con 0x7f6c1006e710 2024-08-19T00:37:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.345+0000 7f6c0d400640 1 -- 172.21.15.7:0/3580561437 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bf4003520 con 0x7f6c1006e710 2024-08-19T00:37:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.345+0000 7f6c0e800640 1 -- 172.21.15.7:0/3580561437 >> v1:172.21.15.162:6789/0 conn(0x7f6c100d03c0 legacy=0x7f6c100d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.345+0000 7f6c0e800640 1 -- 172.21.15.7:0/3580561437 >> v1:172.21.15.7:6789/0 conn(0x7f6c1006e710 legacy=0x7f6c100b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.345+0000 7f6c0e800640 1 -- 172.21.15.7:0/3580561437 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c100ce570 con 0x7f6c10071980 2024-08-19T00:37:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.346+0000 7f6c0e800640 1 --2- 172.21.15.7:0/3580561437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 0x7f6c100cf050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009dc0 tx=0x7f6c0802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ac99073832f8b13 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.346+0000 7f6c0d400640 1 -- 172.21.15.7:0/3580561437 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08007740 con 0x7f6c10071980 2024-08-19T00:37:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.346+0000 7f6c0d400640 1 -- 172.21.15.7:0/3580561437 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c080078e0 con 0x7f6c10071980 2024-08-19T00:37:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.346+0000 7f6c0d400640 1 -- 172.21.15.7:0/3580561437 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08007c90 con 0x7f6c10071980 2024-08-19T00:37:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.347+0000 7f6c15200640 1 -- 172.21.15.7:0/3580561437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 msgr2=0x7f6c100cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.347+0000 7f6c15200640 1 --2- 172.21.15.7:0/3580561437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 0x7f6c100cf050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009dc0 tx=0x7f6c0802a730 comp rx=0 tx=0).stop 2024-08-19T00:37:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.347+0000 7f6c15200640 1 -- 172.21.15.7:0/3580561437 shutdown_connections 2024-08-19T00:37:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.347+0000 7f6c15200640 1 --2- 172.21.15.7:0/3580561437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 0x7f6c100cf050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.347+0000 7f6c15200640 1 -- 172.21.15.7:0/3580561437 >> 172.21.15.7:0/3580561437 conn(0x7f6c1006bc70 msgr2=0x7f6c1006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.347+0000 7f6c15200640 1 -- 172.21.15.7:0/3580561437 shutdown_connections 2024-08-19T00:37:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.347+0000 7f6c15200640 1 -- 172.21.15.7:0/3580561437 wait complete. 2024-08-19T00:37:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.349+0000 7f6c15200640 1 Processor -- start 2024-08-19T00:37:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.349+0000 7f6c15200640 1 -- start start 2024-08-19T00:37:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c15200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c1006e710 0x7f6c101f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c15200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 0x7f6c100c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c15200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c100d03c0 0x7f6c10159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c15200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10073c60 con 0x7f6c100d03c0 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c15200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10073ae0 con 0x7f6c10071980 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c15200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c100cf590 con 0x7f6c1006e710 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c0e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c100d03c0 0x7f6c10159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c0e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c100d03c0 0x7f6c10159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35260/0 (socket says 172.21.15.7:35260) 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c0e800640 1 -- 172.21.15.7:0/4148589706 learned_addr learned my addr 172.21.15.7:0/4148589706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c0de00640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c1006e710 0x7f6c101f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.350+0000 7f6c05400640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 0x7f6c100c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c0e800640 1 -- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c1006e710 msgr2=0x7f6c101f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c0e800640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c1006e710 0x7f6c101f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c0e800640 1 -- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 msgr2=0x7f6c100c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c0e800640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 0x7f6c100c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c0e800640 1 -- 172.21.15.7:0/4148589706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1015cb20 con 0x7f6c100d03c0 2024-08-19T00:37:07.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c0e800640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c100d03c0 0x7f6c10159400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009ee0 tx=0x7f6c08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:07.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c06a00640 1 -- 172.21.15.7:0/4148589706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08040070 con 0x7f6c100d03c0 2024-08-19T00:37:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c06a00640 1 -- 172.21.15.7:0/4148589706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c08031c40 con 0x7f6c100d03c0 2024-08-19T00:37:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c06a00640 1 -- 172.21.15.7:0/4148589706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08009450 con 0x7f6c100d03c0 2024-08-19T00:37:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c100c98d0 con 0x7f6c100d03c0 2024-08-19T00:37:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.351+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1015cd90 con 0x7f6c100d03c0 2024-08-19T00:37:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.353+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c100cf050 con 0x7f6c100d03c0 2024-08-19T00:37:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.354+0000 7f6c06a00640 1 -- 172.21.15.7:0/4148589706 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c08039040 con 0x7f6c100d03c0 2024-08-19T00:37:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.354+0000 7f6c06a00640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bec06be30 0x7f6bec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.355+0000 7f6c06a00640 1 -- 172.21.15.7:0/4148589706 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6c080abf80 con 0x7f6c100d03c0 2024-08-19T00:37:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.355+0000 7f6c0de00640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bec06be30 0x7f6bec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.355+0000 7f6c0de00640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bec06be30 0x7f6bec06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c100cb5a0 tx=0x7f6c00009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:07.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.359+0000 7f6c06a00640 1 -- 172.21.15.7:0/4148589706 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6c0807a2d0 con 0x7f6c100d03c0 2024-08-19T00:37:07.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.539+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c10071f70 con 0x7f6bec06be30 2024-08-19T00:37:07.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.547+0000 7f6c06a00640 1 -- 172.21.15.7:0/4148589706 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7f6c10071f70 con 0x7f6bec06be30 2024-08-19T00:37:07.552 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:37:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bec06be30 msgr2=0x7f6bec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bec06be30 0x7f6bec06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c100cb5a0 tx=0x7f6c00009040 comp rx=0 tx=0).stop 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c100d03c0 msgr2=0x7f6c10159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c100d03c0 0x7f6c10159400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009ee0 tx=0x7f6c08004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 shutdown_connections 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bec06be30 0x7f6bec06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c100d03c0 0x7f6c10159400 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071980 0x7f6c100c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 --2- 172.21.15.7:0/4148589706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c1006e710 0x7f6c101f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 >> 172.21.15.7:0/4148589706 conn(0x7f6c1006bc70 msgr2=0x7f6c10074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 shutdown_connections 2024-08-19T00:37:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.551+0000 7f6c15200640 1 -- 172.21.15.7:0/4148589706 wait complete. 2024-08-19T00:37:07.569 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-19T00:37:07.255960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235732,"kb_used_data":2908,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738988,"statfs":{"total":773094113280,"available":772852723712,"internally_reserved":0,"allocated":2977792,"data_stored":1784096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.922704"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384036+0000","last_change":"2024-08-19T00:37:03.384522+0000","last_active":"2024-08-19T00:37:04.384036+0000","last_peered":"2024-08-19T00:37:04.384036+0000","last_clean":"2024-08-19T00:37:04.384036+0000","last_became_active":"2024-08-19T00:37:03.378809+0000","last_became_peered":"2024-08-19T00:37:03.378809+0000","last_unstale":"2024-08-19T00:37:04.384036+0000","last_undegraded":"2024-08-19T00:37:04.384036+0000","last_fullsized":"2024-08-19T00:37:04.384036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368586+0000","last_change":"2024-08-19T00:37:03.375782+0000","last_active":"2024-08-19T00:37:04.368586+0000","last_peered":"2024-08-19T00:37:04.368586+0000","last_clean":"2024-08-19T00:37:04.368586+0000","last_became_active":"2024-08-19T00:37:03.375533+0000","last_became_peered":"2024-08-19T00:37:03.375533+0000","last_unstale":"2024-08-19T00:37:04.368586+0000","last_undegraded":"2024-08-19T00:37:04.368586+0000","last_fullsized":"2024-08-19T00:37:04.368586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368559+0000","last_change":"2024-08-19T00:37:03.387391+0000","last_active":"2024-08-19T00:37:04.368559+0000","last_peered":"2024-08-19T00:37:04.368559+0000","last_clean":"2024-08-19T00:37:04.368559+0000","last_became_active":"2024-08-19T00:37:03.386550+0000","last_became_peered":"2024-08-19T00:37:03.386550+0000","last_unstale":"2024-08-19T00:37:04.368559+0000","last_undegraded":"2024-08-19T00:37:04.368559+0000","last_fullsized":"2024-08-19T00:37:04.368559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464051+0000","last_change":"2024-08-19T00:37:03.366111+0000","last_active":"2024-08-19T00:37:04.464051+0000","last_peered":"2024-08-19T00:37:04.464051+0000","last_clean":"2024-08-19T00:37:04.464051+0000","last_became_active":"2024-08-19T00:37:03.365397+0000","last_became_peered":"2024-08-19T00:37:03.365397+0000","last_unstale":"2024-08-19T00:37:04.464051+0000","last_undegraded":"2024-08-19T00:37:04.464051+0000","last_fullsized":"2024-08-19T00:37:04.464051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383873+0000","last_change":"2024-08-19T00:37:03.374066+0000","last_active":"2024-08-19T00:37:04.383873+0000","last_peered":"2024-08-19T00:37:04.383873+0000","last_clean":"2024-08-19T00:37:04.383873+0000","last_became_active":"2024-08-19T00:37:03.373773+0000","last_became_peered":"2024-08-19T00:37:03.373773+0000","last_unstale":"2024-08-19T00:37:04.383873+0000","last_undegraded":"2024-08-19T00:37:04.383873+0000","last_fullsized":"2024-08-19T00:37:04.383873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463972+0000","last_change":"2024-08-19T00:37:03.373062+0000","last_active":"2024-08-19T00:37:04.463972+0000","last_peered":"2024-08-19T00:37:04.463972+0000","last_clean":"2024-08-19T00:37:04.463972+0000","last_became_active":"2024-08-19T00:37:03.372380+0000","last_became_peered":"2024-08-19T00:37:03.372380+0000","last_unstale":"2024-08-19T00:37:04.463972+0000","last_undegraded":"2024-08-19T00:37:04.463972+0000","last_fullsized":"2024-08-19T00:37:04.463972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384097+0000","last_change":"2024-08-19T00:37:03.381691+0000","last_active":"2024-08-19T00:37:04.384097+0000","last_peered":"2024-08-19T00:37:04.384097+0000","last_clean":"2024-08-19T00:37:04.384097+0000","last_became_active":"2024-08-19T00:37:03.381312+0000","last_became_peered":"2024-08-19T00:37:03.381312+0000","last_unstale":"2024-08-19T00:37:04.384097+0000","last_undegraded":"2024-08-19T00:37:04.384097+0000","last_fullsized":"2024-08-19T00:37:04.384097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368077+0000","last_change":"2024-08-19T00:37:03.386764+0000","last_active":"2024-08-19T00:37:04.368077+0000","last_peered":"2024-08-19T00:37:04.368077+0000","last_clean":"2024-08-19T00:37:04.368077+0000","last_became_active":"2024-08-19T00:37:03.385701+0000","last_became_peered":"2024-08-19T00:37:03.385701+0000","last_unstale":"2024-08-19T00:37:04.368077+0000","last_undegraded":"2024-08-19T00:37:04.368077+0000","last_fullsized":"2024-08-19T00:37:04.368077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464403+0000","last_change":"2024-08-19T00:37:03.383398+0000","last_active":"2024-08-19T00:37:04.464403+0000","last_peered":"2024-08-19T00:37:04.464403+0000","last_clean":"2024-08-19T00:37:04.464403+0000","last_became_active":"2024-08-19T00:37:03.383039+0000","last_became_peered":"2024-08-19T00:37:03.383039+0000","last_unstale":"2024-08-19T00:37:04.464403+0000","last_undegraded":"2024-08-19T00:37:04.464403+0000","last_fullsized":"2024-08-19T00:37:04.464403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383773+0000","last_change":"2024-08-19T00:37:03.367285+0000","last_active":"2024-08-19T00:37:04.383773+0000","last_peered":"2024-08-19T00:37:04.383773+0000","last_clean":"2024-08-19T00:37:04.383773+0000","last_became_active":"2024-08-19T00:37:03.366995+0000","last_became_peered":"2024-08-19T00:37:03.366995+0000","last_unstale":"2024-08-19T00:37:04.383773+0000","last_undegraded":"2024-08-19T00:37:04.383773+0000","last_fullsized":"2024-08-19T00:37:04.383773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383787+0000","last_change":"2024-08-19T00:37:03.368053+0000","last_active":"2024-08-19T00:37:04.383787+0000","last_peered":"2024-08-19T00:37:04.383787+0000","last_clean":"2024-08-19T00:37:04.383787+0000","last_became_active":"2024-08-19T00:37:03.367766+0000","last_became_peered":"2024-08-19T00:37:03.367766+0000","last_unstale":"2024-08-19T00:37:04.383787+0000","last_undegraded":"2024-08-19T00:37:04.383787+0000","last_fullsized":"2024-08-19T00:37:04.383787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383805+0000","last_change":"2024-08-19T00:37:03.381800+0000","last_active":"2024-08-19T00:37:04.383805+0000","last_peered":"2024-08-19T00:37:04.383805+0000","last_clean":"2024-08-19T00:37:04.383805+0000","last_became_active":"2024-08-19T00:37:03.380371+0000","last_became_peered":"2024-08-19T00:37:03.380371+0000","last_unstale":"2024-08-19T00:37:04.383805+0000","last_undegraded":"2024-08-19T00:37:04.383805+0000","last_fullsized":"2024-08-19T00:37:04.383805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464125+0000","last_change":"2024-08-19T00:37:03.375068+0000","last_active":"2024-08-19T00:37:04.464125+0000","last_peered":"2024-08-19T00:37:04.464125+0000","last_clean":"2024-08-19T00:37:04.464125+0000","last_became_active":"2024-08-19T00:37:03.374786+0000","last_became_peered":"2024-08-19T00:37:03.374786+0000","last_unstale":"2024-08-19T00:37:04.464125+0000","last_undegraded":"2024-08-19T00:37:04.464125+0000","last_fullsized":"2024-08-19T00:37:04.464125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463980+0000","last_change":"2024-08-19T00:37:03.372712+0000","last_active":"2024-08-19T00:37:04.463980+0000","last_peered":"2024-08-19T00:37:04.463980+0000","last_clean":"2024-08-19T00:37:04.463980+0000","last_became_active":"2024-08-19T00:37:03.372479+0000","last_became_peered":"2024-08-19T00:37:03.372479+0000","last_unstale":"2024-08-19T00:37:04.463980+0000","last_undegraded":"2024-08-19T00:37:04.463980+0000","last_fullsized":"2024-08-19T00:37:04.463980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368043+0000","last_change":"2024-08-19T00:37:03.373145+0000","last_active":"2024-08-19T00:37:04.368043+0000","last_peered":"2024-08-19T00:37:04.368043+0000","last_clean":"2024-08-19T00:37:04.368043+0000","last_became_active":"2024-08-19T00:37:03.372872+0000","last_became_peered":"2024-08-19T00:37:03.372872+0000","last_unstale":"2024-08-19T00:37:04.368043+0000","last_undegraded":"2024-08-19T00:37:04.368043+0000","last_fullsized":"2024-08-19T00:37:04.368043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364979+0000","last_change":"2024-08-19T00:37:03.381878+0000","last_active":"2024-08-19T00:37:04.364979+0000","last_peered":"2024-08-19T00:37:04.364979+0000","last_clean":"2024-08-19T00:37:04.364979+0000","last_became_active":"2024-08-19T00:37:03.381642+0000","last_became_peered":"2024-08-19T00:37:03.381642+0000","last_unstale":"2024-08-19T00:37:04.364979+0000","last_undegraded":"2024-08-19T00:37:04.364979+0000","last_fullsized":"2024-08-19T00:37:04.364979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366018+0000","last_change":"2024-08-19T00:37:03.388402+0000","last_active":"2024-08-19T00:37:04.366018+0000","last_peered":"2024-08-19T00:37:04.366018+0000","last_clean":"2024-08-19T00:37:04.366018+0000","last_became_active":"2024-08-19T00:37:03.387161+0000","last_became_peered":"2024-08-19T00:37:03.387161+0000","last_unstale":"2024-08-19T00:37:04.366018+0000","last_undegraded":"2024-08-19T00:37:04.366018+0000","last_fullsized":"2024-08-19T00:37:04.366018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:17.499516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369876+0000","last_change":"2024-08-19T00:37:03.379215+0000","last_active":"2024-08-19T00:37:04.369876+0000","last_peered":"2024-08-19T00:37:04.369876+0000","last_clean":"2024-08-19T00:37:04.369876+0000","last_became_active":"2024-08-19T00:37:03.378899+0000","last_became_peered":"2024-08-19T00:37:03.378899+0000","last_unstale":"2024-08-19T00:37:04.369876+0000","last_undegraded":"2024-08-19T00:37:04.369876+0000","last_fullsized":"2024-08-19T00:37:04.369876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365805+0000","last_change":"2024-08-19T00:37:03.384467+0000","last_active":"2024-08-19T00:37:04.365805+0000","last_peered":"2024-08-19T00:37:04.365805+0000","last_clean":"2024-08-19T00:37:04.365805+0000","last_became_active":"2024-08-19T00:37:03.384206+0000","last_became_peered":"2024-08-19T00:37:03.384206+0000","last_unstale":"2024-08-19T00:37:04.365805+0000","last_undegraded":"2024-08-19T00:37:04.365805+0000","last_fullsized":"2024-08-19T00:37:04.365805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:06.468363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383955+0000","last_change":"2024-08-19T00:37:03.381984+0000","last_active":"2024-08-19T00:37:04.383955+0000","last_peered":"2024-08-19T00:37:04.383955+0000","last_clean":"2024-08-19T00:37:04.383955+0000","last_became_active":"2024-08-19T00:37:03.379208+0000","last_became_peered":"2024-08-19T00:37:03.379208+0000","last_unstale":"2024-08-19T00:37:04.383955+0000","last_undegraded":"2024-08-19T00:37:04.383955+0000","last_fullsized":"2024-08-19T00:37:04.383955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380591+0000","last_change":"2024-08-19T00:37:03.366104+0000","last_active":"2024-08-19T00:37:04.380591+0000","last_peered":"2024-08-19T00:37:04.380591+0000","last_clean":"2024-08-19T00:37:04.380591+0000","last_became_active":"2024-08-19T00:37:03.365823+0000","last_became_peered":"2024-08-19T00:37:03.365823+0000","last_unstale":"2024-08-19T00:37:04.380591+0000","last_undegraded":"2024-08-19T00:37:04.380591+0000","last_fullsized":"2024-08-19T00:37:04.380591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463440+0000","last_change":"2024-08-19T00:37:03.370063+0000","last_active":"2024-08-19T00:37:04.463440+0000","last_peered":"2024-08-19T00:37:04.463440+0000","last_clean":"2024-08-19T00:37:04.463440+0000","last_became_active":"2024-08-19T00:37:03.369707+0000","last_became_peered":"2024-08-19T00:37:03.369707+0000","last_unstale":"2024-08-19T00:37:04.463440+0000","last_undegraded":"2024-08-19T00:37:04.463440+0000","last_fullsized":"2024-08-19T00:37:04.463440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368265+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368265+0000","last_peered":"2024-08-19T00:37:04.368265+0000","last_clean":"2024-08-19T00:37:04.368265+0000","last_became_active":"2024-08-19T00:37:03.372854+0000","last_became_peered":"2024-08-19T00:37:03.372854+0000","last_unstale":"2024-08-19T00:37:04.368265+0000","last_undegraded":"2024-08-19T00:37:04.368265+0000","last_fullsized":"2024-08-19T00:37:04.368265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364944+0000","last_change":"2024-08-19T00:37:03.386557+0000","last_active":"2024-08-19T00:37:04.364944+0000","last_peered":"2024-08-19T00:37:04.364944+0000","last_clean":"2024-08-19T00:37:04.364944+0000","last_became_active":"2024-08-19T00:37:03.386294+0000","last_became_peered":"2024-08-19T00:37:03.386294+0000","last_unstale":"2024-08-19T00:37:04.364944+0000","last_undegraded":"2024-08-19T00:37:04.364944+0000","last_fullsized":"2024-08-19T00:37:04.364944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368793+0000","last_change":"2024-08-19T00:37:03.379194+0000","last_active":"2024-08-19T00:37:04.368793+0000","last_peered":"2024-08-19T00:37:04.368793+0000","last_clean":"2024-08-19T00:37:04.368793+0000","last_became_active":"2024-08-19T00:37:03.378509+0000","last_became_peered":"2024-08-19T00:37:03.378509+0000","last_unstale":"2024-08-19T00:37:04.368793+0000","last_undegraded":"2024-08-19T00:37:04.368793+0000","last_fullsized":"2024-08-19T00:37:04.368793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464421+0000","last_change":"2024-08-19T00:37:03.373705+0000","last_active":"2024-08-19T00:37:04.464421+0000","last_peered":"2024-08-19T00:37:04.464421+0000","last_clean":"2024-08-19T00:37:04.464421+0000","last_became_active":"2024-08-19T00:37:03.366841+0000","last_became_peered":"2024-08-19T00:37:03.366841+0000","last_unstale":"2024-08-19T00:37:04.464421+0000","last_undegraded":"2024-08-19T00:37:04.464421+0000","last_fullsized":"2024-08-19T00:37:04.464421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464316+0000","last_change":"2024-08-19T00:37:03.370473+0000","last_active":"2024-08-19T00:37:04.464316+0000","last_peered":"2024-08-19T00:37:04.464316+0000","last_clean":"2024-08-19T00:37:04.464316+0000","last_became_active":"2024-08-19T00:37:03.370106+0000","last_became_peered":"2024-08-19T00:37:03.370106+0000","last_unstale":"2024-08-19T00:37:04.464316+0000","last_undegraded":"2024-08-19T00:37:04.464316+0000","last_fullsized":"2024-08-19T00:37:04.464316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464155+0000","last_change":"2024-08-19T00:37:03.383036+0000","last_active":"2024-08-19T00:37:04.464155+0000","last_peered":"2024-08-19T00:37:04.464155+0000","last_clean":"2024-08-19T00:37:04.464155+0000","last_became_active":"2024-08-19T00:37:03.382643+0000","last_became_peered":"2024-08-19T00:37:03.382643+0000","last_unstale":"2024-08-19T00:37:04.464155+0000","last_undegraded":"2024-08-19T00:37:04.464155+0000","last_fullsized":"2024-08-19T00:37:04.464155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:33.644440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368293+0000","last_change":"2024-08-19T00:37:03.382477+0000","last_active":"2024-08-19T00:37:04.368293+0000","last_peered":"2024-08-19T00:37:04.368293+0000","last_clean":"2024-08-19T00:37:04.368293+0000","last_became_active":"2024-08-19T00:37:03.380124+0000","last_became_peered":"2024-08-19T00:37:03.380124+0000","last_unstale":"2024-08-19T00:37:04.368293+0000","last_undegraded":"2024-08-19T00:37:04.368293+0000","last_fullsized":"2024-08-19T00:37:04.368293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365281+0000","last_change":"2024-08-19T00:37:03.379567+0000","last_active":"2024-08-19T00:37:04.365281+0000","last_peered":"2024-08-19T00:37:04.365281+0000","last_clean":"2024-08-19T00:37:04.365281+0000","last_became_active":"2024-08-19T00:37:03.372732+0000","last_became_peered":"2024-08-19T00:37:03.372732+0000","last_unstale":"2024-08-19T00:37:04.365281+0000","last_undegraded":"2024-08-19T00:37:04.365281+0000","last_fullsized":"2024-08-19T00:37:04.365281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369286+0000","last_change":"2024-08-19T00:37:03.372911+0000","last_active":"2024-08-19T00:37:04.369286+0000","last_peered":"2024-08-19T00:37:04.369286+0000","last_clean":"2024-08-19T00:37:04.369286+0000","last_became_active":"2024-08-19T00:37:03.372598+0000","last_became_peered":"2024-08-19T00:37:03.372598+0000","last_unstale":"2024-08-19T00:37:04.369286+0000","last_undegraded":"2024-08-19T00:37:04.369286+0000","last_fullsized":"2024-08-19T00:37:04.369286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463669+0000","last_change":"2024-08-19T00:37:03.363843+0000","last_active":"2024-08-19T00:37:04.463669+0000","last_peered":"2024-08-19T00:37:04.463669+0000","last_clean":"2024-08-19T00:37:04.463669+0000","last_became_active":"2024-08-19T00:37:03.362519+0000","last_became_peered":"2024-08-19T00:37:03.362519+0000","last_unstale":"2024-08-19T00:37:04.463669+0000","last_undegraded":"2024-08-19T00:37:04.463669+0000","last_fullsized":"2024-08-19T00:37:04.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463528+0000","last_change":"2024-08-19T00:37:03.373644+0000","last_active":"2024-08-19T00:37:04.463528+0000","last_peered":"2024-08-19T00:37:04.463528+0000","last_clean":"2024-08-19T00:37:04.463528+0000","last_became_active":"2024-08-19T00:37:03.373298+0000","last_became_peered":"2024-08-19T00:37:03.373298+0000","last_unstale":"2024-08-19T00:37:04.463528+0000","last_undegraded":"2024-08-19T00:37:04.463528+0000","last_fullsized":"2024-08-19T00:37:04.463528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368301+0000","last_change":"2024-08-19T00:37:02.366620+0000","last_active":"2024-08-19T00:37:04.368301+0000","last_peered":"2024-08-19T00:37:04.368301+0000","last_clean":"2024-08-19T00:37:04.368301+0000","last_became_active":"2024-08-19T00:37:02.366071+0000","last_became_peered":"2024-08-19T00:37:02.366071+0000","last_unstale":"2024-08-19T00:37:04.368301+0000","last_undegraded":"2024-08-19T00:37:04.368301+0000","last_fullsized":"2024-08-19T00:37:04.368301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380696+0000","last_change":"2024-08-19T00:37:03.369278+0000","last_active":"2024-08-19T00:37:04.380696+0000","last_peered":"2024-08-19T00:37:04.380696+0000","last_clean":"2024-08-19T00:37:04.380696+0000","last_became_active":"2024-08-19T00:37:03.365557+0000","last_became_peered":"2024-08-19T00:37:03.365557+0000","last_unstale":"2024-08-19T00:37:04.380696+0000","last_undegraded":"2024-08-19T00:37:04.380696+0000","last_fullsized":"2024-08-19T00:37:04.380696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:53.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365384+0000","last_change":"2024-08-19T00:37:02.362332+0000","last_active":"2024-08-19T00:37:04.365384+0000","last_peered":"2024-08-19T00:37:04.365384+0000","last_clean":"2024-08-19T00:37:04.365384+0000","last_became_active":"2024-08-19T00:37:02.362055+0000","last_became_peered":"2024-08-19T00:37:02.362055+0000","last_unstale":"2024-08-19T00:37:04.365384+0000","last_undegraded":"2024-08-19T00:37:04.365384+0000","last_fullsized":"2024-08-19T00:37:04.365384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463849+0000","last_change":"2024-08-19T00:37:02.370542+0000","last_active":"2024-08-19T00:37:04.463849+0000","last_peered":"2024-08-19T00:37:04.463849+0000","last_clean":"2024-08-19T00:37:04.463849+0000","last_became_active":"2024-08-19T00:37:02.369837+0000","last_became_peered":"2024-08-19T00:37:02.369837+0000","last_unstale":"2024-08-19T00:37:04.463849+0000","last_undegraded":"2024-08-19T00:37:04.463849+0000","last_fullsized":"2024-08-19T00:37:04.463849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:45.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368309+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368309+0000","last_peered":"2024-08-19T00:37:04.368309+0000","last_clean":"2024-08-19T00:37:04.368309+0000","last_became_active":"2024-08-19T00:37:03.376353+0000","last_became_peered":"2024-08-19T00:37:03.376353+0000","last_unstale":"2024-08-19T00:37:04.368309+0000","last_undegraded":"2024-08-19T00:37:04.368309+0000","last_fullsized":"2024-08-19T00:37:04.368309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365038+0000","last_change":"2024-08-19T00:37:02.358463+0000","last_active":"2024-08-19T00:37:04.365038+0000","last_peered":"2024-08-19T00:37:04.365038+0000","last_clean":"2024-08-19T00:37:04.365038+0000","last_became_active":"2024-08-19T00:37:02.357105+0000","last_became_peered":"2024-08-19T00:37:02.357105+0000","last_unstale":"2024-08-19T00:37:04.365038+0000","last_undegraded":"2024-08-19T00:37:04.365038+0000","last_fullsized":"2024-08-19T00:37:04.365038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380664+0000","last_change":"2024-08-19T00:37:03.372060+0000","last_active":"2024-08-19T00:37:04.380664+0000","last_peered":"2024-08-19T00:37:04.380664+0000","last_clean":"2024-08-19T00:37:04.380664+0000","last_became_active":"2024-08-19T00:37:03.371830+0000","last_became_peered":"2024-08-19T00:37:03.371830+0000","last_unstale":"2024-08-19T00:37:04.380664+0000","last_undegraded":"2024-08-19T00:37:04.380664+0000","last_fullsized":"2024-08-19T00:37:04.380664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:17.064649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464497+0000","last_change":"2024-08-19T00:37:02.359600+0000","last_active":"2024-08-19T00:37:04.464497+0000","last_peered":"2024-08-19T00:37:04.464497+0000","last_clean":"2024-08-19T00:37:04.464497+0000","last_became_active":"2024-08-19T00:37:02.357350+0000","last_became_peered":"2024-08-19T00:37:02.357350+0000","last_unstale":"2024-08-19T00:37:04.464497+0000","last_undegraded":"2024-08-19T00:37:04.464497+0000","last_fullsized":"2024-08-19T00:37:04.464497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464491+0000","last_change":"2024-08-19T00:37:03.368421+0000","last_active":"2024-08-19T00:37:04.464491+0000","last_peered":"2024-08-19T00:37:04.464491+0000","last_clean":"2024-08-19T00:37:04.464491+0000","last_became_active":"2024-08-19T00:37:03.367857+0000","last_became_peered":"2024-08-19T00:37:03.367857+0000","last_unstale":"2024-08-19T00:37:04.464491+0000","last_undegraded":"2024-08-19T00:37:04.464491+0000","last_fullsized":"2024-08-19T00:37:04.464491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383943+0000","last_change":"2024-08-19T00:37:02.371034+0000","last_active":"2024-08-19T00:37:04.383943+0000","last_peered":"2024-08-19T00:37:04.383943+0000","last_clean":"2024-08-19T00:37:04.383943+0000","last_became_active":"2024-08-19T00:37:02.370558+0000","last_became_peered":"2024-08-19T00:37:02.370558+0000","last_unstale":"2024-08-19T00:37:04.383943+0000","last_undegraded":"2024-08-19T00:37:04.383943+0000","last_fullsized":"2024-08-19T00:37:04.383943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368959+0000","last_change":"2024-08-19T00:37:03.379464+0000","last_active":"2024-08-19T00:37:04.368959+0000","last_peered":"2024-08-19T00:37:04.368959+0000","last_clean":"2024-08-19T00:37:04.368959+0000","last_became_active":"2024-08-19T00:37:03.378926+0000","last_became_peered":"2024-08-19T00:37:03.378926+0000","last_unstale":"2024-08-19T00:37:04.368959+0000","last_undegraded":"2024-08-19T00:37:04.368959+0000","last_fullsized":"2024-08-19T00:37:04.368959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369623+0000","last_change":"2024-08-19T00:37:02.356530+0000","last_active":"2024-08-19T00:37:04.369623+0000","last_peered":"2024-08-19T00:37:04.369623+0000","last_clean":"2024-08-19T00:37:04.369623+0000","last_became_active":"2024-08-19T00:37:02.356057+0000","last_became_peered":"2024-08-19T00:37:02.356057+0000","last_unstale":"2024-08-19T00:37:04.369623+0000","last_undegraded":"2024-08-19T00:37:04.369623+0000","last_fullsized":"2024-08-19T00:37:04.369623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365621+0000","last_change":"2024-08-19T00:37:03.382907+0000","last_active":"2024-08-19T00:37:04.365621+0000","last_peered":"2024-08-19T00:37:04.365621+0000","last_clean":"2024-08-19T00:37:04.365621+0000","last_became_active":"2024-08-19T00:37:03.382495+0000","last_became_peered":"2024-08-19T00:37:03.382495+0000","last_unstale":"2024-08-19T00:37:04.365621+0000","last_undegraded":"2024-08-19T00:37:04.365621+0000","last_fullsized":"2024-08-19T00:37:04.365621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464058+0000","last_change":"2024-08-19T00:37:02.357795+0000","last_active":"2024-08-19T00:37:04.464058+0000","last_peered":"2024-08-19T00:37:04.464058+0000","last_clean":"2024-08-19T00:37:04.464058+0000","last_became_active":"2024-08-19T00:37:02.356980+0000","last_became_peered":"2024-08-19T00:37:02.356980+0000","last_unstale":"2024-08-19T00:37:04.464058+0000","last_undegraded":"2024-08-19T00:37:04.464058+0000","last_fullsized":"2024-08-19T00:37:04.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:04.046069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383932+0000","last_change":"2024-08-19T00:37:03.375481+0000","last_active":"2024-08-19T00:37:04.383932+0000","last_peered":"2024-08-19T00:37:04.383932+0000","last_clean":"2024-08-19T00:37:04.383932+0000","last_became_active":"2024-08-19T00:37:03.375032+0000","last_became_peered":"2024-08-19T00:37:03.375032+0000","last_unstale":"2024-08-19T00:37:04.383932+0000","last_undegraded":"2024-08-19T00:37:04.383932+0000","last_fullsized":"2024-08-19T00:37:04.383932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369528+0000","last_change":"2024-08-19T00:37:02.353428+0000","last_active":"2024-08-19T00:37:04.369528+0000","last_peered":"2024-08-19T00:37:04.369528+0000","last_clean":"2024-08-19T00:37:04.369528+0000","last_became_active":"2024-08-19T00:37:02.353106+0000","last_became_peered":"2024-08-19T00:37:02.353106+0000","last_unstale":"2024-08-19T00:37:04.369528+0000","last_undegraded":"2024-08-19T00:37:04.369528+0000","last_fullsized":"2024-08-19T00:37:04.369528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463960+0000","last_change":"2024-08-19T00:37:03.381565+0000","last_active":"2024-08-19T00:37:04.463960+0000","last_peered":"2024-08-19T00:37:04.463960+0000","last_clean":"2024-08-19T00:37:04.463960+0000","last_became_active":"2024-08-19T00:37:03.381351+0000","last_became_peered":"2024-08-19T00:37:03.381351+0000","last_unstale":"2024-08-19T00:37:04.463960+0000","last_undegraded":"2024-08-19T00:37:04.463960+0000","last_fullsized":"2024-08-19T00:37:04.463960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365506+0000","last_change":"2024-08-19T00:37:02.361424+0000","last_active":"2024-08-19T00:37:04.365506+0000","last_peered":"2024-08-19T00:37:04.365506+0000","last_clean":"2024-08-19T00:37:04.365506+0000","last_became_active":"2024-08-19T00:37:02.353015+0000","last_became_peered":"2024-08-19T00:37:02.353015+0000","last_unstale":"2024-08-19T00:37:04.365506+0000","last_undegraded":"2024-08-19T00:37:04.365506+0000","last_fullsized":"2024-08-19T00:37:04.365506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:29.508786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365319+0000","last_change":"2024-08-19T00:37:03.377594+0000","last_active":"2024-08-19T00:37:04.365319+0000","last_peered":"2024-08-19T00:37:04.365319+0000","last_clean":"2024-08-19T00:37:04.365319+0000","last_became_active":"2024-08-19T00:37:03.377315+0000","last_became_peered":"2024-08-19T00:37:03.377315+0000","last_unstale":"2024-08-19T00:37:04.365319+0000","last_undegraded":"2024-08-19T00:37:04.365319+0000","last_fullsized":"2024-08-19T00:37:04.365319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:09:14.167938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383994+0000","last_change":"2024-08-19T00:37:02.369821+0000","last_active":"2024-08-19T00:37:04.383994+0000","last_peered":"2024-08-19T00:37:04.383994+0000","last_clean":"2024-08-19T00:37:04.383994+0000","last_became_active":"2024-08-19T00:37:02.369542+0000","last_became_peered":"2024-08-19T00:37:02.369542+0000","last_unstale":"2024-08-19T00:37:04.383994+0000","last_undegraded":"2024-08-19T00:37:04.383994+0000","last_fullsized":"2024-08-19T00:37:04.383994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463395+0000","last_change":"2024-08-19T00:37:03.386039+0000","last_active":"2024-08-19T00:37:04.463395+0000","last_peered":"2024-08-19T00:37:04.463395+0000","last_clean":"2024-08-19T00:37:04.463395+0000","last_became_active":"2024-08-19T00:37:03.385346+0000","last_became_peered":"2024-08-19T00:37:03.385346+0000","last_unstale":"2024-08-19T00:37:04.463395+0000","last_undegraded":"2024-08-19T00:37:04.463395+0000","last_fullsized":"2024-08-19T00:37:04.463395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380539+0000","last_change":"2024-08-19T00:37:02.355538+0000","last_active":"2024-08-19T00:37:04.380539+0000","last_peered":"2024-08-19T00:37:04.380539+0000","last_clean":"2024-08-19T00:37:04.380539+0000","last_became_active":"2024-08-19T00:37:02.355257+0000","last_became_peered":"2024-08-19T00:37:02.355257+0000","last_unstale":"2024-08-19T00:37:04.380539+0000","last_undegraded":"2024-08-19T00:37:04.380539+0000","last_fullsized":"2024-08-19T00:37:04.380539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365142+0000","last_change":"2024-08-19T00:37:03.382874+0000","last_active":"2024-08-19T00:37:04.365142+0000","last_peered":"2024-08-19T00:37:04.365142+0000","last_clean":"2024-08-19T00:37:04.365142+0000","last_became_active":"2024-08-19T00:37:03.382547+0000","last_became_peered":"2024-08-19T00:37:03.382547+0000","last_unstale":"2024-08-19T00:37:04.365142+0000","last_undegraded":"2024-08-19T00:37:04.365142+0000","last_fullsized":"2024-08-19T00:37:04.365142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384268+0000","last_change":"2024-08-19T00:37:02.369846+0000","last_active":"2024-08-19T00:37:04.384268+0000","last_peered":"2024-08-19T00:37:04.384268+0000","last_clean":"2024-08-19T00:37:04.384268+0000","last_became_active":"2024-08-19T00:37:02.369565+0000","last_became_peered":"2024-08-19T00:37:02.369565+0000","last_unstale":"2024-08-19T00:37:04.384268+0000","last_undegraded":"2024-08-19T00:37:04.384268+0000","last_fullsized":"2024-08-19T00:37:04.384268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464558+0000","last_change":"2024-08-19T00:37:03.360371+0000","last_active":"2024-08-19T00:37:04.464558+0000","last_peered":"2024-08-19T00:37:04.464558+0000","last_clean":"2024-08-19T00:37:04.464558+0000","last_became_active":"2024-08-19T00:37:03.360065+0000","last_became_peered":"2024-08-19T00:37:03.360065+0000","last_unstale":"2024-08-19T00:37:04.464558+0000","last_undegraded":"2024-08-19T00:37:04.464558+0000","last_fullsized":"2024-08-19T00:37:04.464558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380861+0000","last_change":"2024-08-19T00:37:02.364244+0000","last_active":"2024-08-19T00:37:04.380861+0000","last_peered":"2024-08-19T00:37:04.380861+0000","last_clean":"2024-08-19T00:37:04.380861+0000","last_became_active":"2024-08-19T00:37:02.363965+0000","last_became_peered":"2024-08-19T00:37:02.363965+0000","last_unstale":"2024-08-19T00:37:04.380861+0000","last_undegraded":"2024-08-19T00:37:04.380861+0000","last_fullsized":"2024-08-19T00:37:04.380861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384061+0000","last_change":"2024-08-19T00:37:03.382232+0000","last_active":"2024-08-19T00:37:04.384061+0000","last_peered":"2024-08-19T00:37:04.384061+0000","last_clean":"2024-08-19T00:37:04.384061+0000","last_became_active":"2024-08-19T00:37:03.378909+0000","last_became_peered":"2024-08-19T00:37:03.378909+0000","last_unstale":"2024-08-19T00:37:04.384061+0000","last_undegraded":"2024-08-19T00:37:04.384061+0000","last_fullsized":"2024-08-19T00:37:04.384061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368532+0000","last_change":"2024-08-19T00:37:02.366925+0000","last_active":"2024-08-19T00:37:04.368532+0000","last_peered":"2024-08-19T00:37:04.368532+0000","last_clean":"2024-08-19T00:37:04.368532+0000","last_became_active":"2024-08-19T00:37:02.366544+0000","last_became_peered":"2024-08-19T00:37:02.366544+0000","last_unstale":"2024-08-19T00:37:04.368532+0000","last_undegraded":"2024-08-19T00:37:04.368532+0000","last_fullsized":"2024-08-19T00:37:04.368532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384116+0000","last_change":"2024-08-19T00:37:03.382037+0000","last_active":"2024-08-19T00:37:04.384116+0000","last_peered":"2024-08-19T00:37:04.384116+0000","last_clean":"2024-08-19T00:37:04.384116+0000","last_became_active":"2024-08-19T00:37:03.380743+0000","last_became_peered":"2024-08-19T00:37:03.380743+0000","last_unstale":"2024-08-19T00:37:04.384116+0000","last_undegraded":"2024-08-19T00:37:04.384116+0000","last_fullsized":"2024-08-19T00:37:04.384116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464286+0000","last_change":"2024-08-19T00:37:02.355452+0000","last_active":"2024-08-19T00:37:04.464286+0000","last_peered":"2024-08-19T00:37:04.464286+0000","last_clean":"2024-08-19T00:37:04.464286+0000","last_became_active":"2024-08-19T00:37:02.355062+0000","last_became_peered":"2024-08-19T00:37:02.355062+0000","last_unstale":"2024-08-19T00:37:04.464286+0000","last_undegraded":"2024-08-19T00:37:04.464286+0000","last_fullsized":"2024-08-19T00:37:04.464286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365642+0000","last_change":"2024-08-19T00:37:03.372275+0000","last_active":"2024-08-19T00:37:04.365642+0000","last_peered":"2024-08-19T00:37:04.365642+0000","last_clean":"2024-08-19T00:37:04.365642+0000","last_became_active":"2024-08-19T00:37:03.371952+0000","last_became_peered":"2024-08-19T00:37:03.371952+0000","last_unstale":"2024-08-19T00:37:04.365642+0000","last_undegraded":"2024-08-19T00:37:04.365642+0000","last_fullsized":"2024-08-19T00:37:04.365642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:50.890499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463384+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:37:04.463384+0000","last_peered":"2024-08-19T00:37:04.463384+0000","last_clean":"2024-08-19T00:37:04.463384+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:37:04.463384+0000","last_undegraded":"2024-08-19T00:37:04.463384+0000","last_fullsized":"2024-08-19T00:37:04.463384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365641+0000","last_change":"2024-08-19T00:37:02.355271+0000","last_active":"2024-08-19T00:37:04.365641+0000","last_peered":"2024-08-19T00:37:04.365641+0000","last_clean":"2024-08-19T00:37:04.365641+0000","last_became_active":"2024-08-19T00:37:02.354947+0000","last_became_peered":"2024-08-19T00:37:02.354947+0000","last_unstale":"2024-08-19T00:37:04.365641+0000","last_undegraded":"2024-08-19T00:37:04.365641+0000","last_fullsized":"2024-08-19T00:37:04.365641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:08.443729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380800+0000","last_change":"2024-08-19T00:37:03.363302+0000","last_active":"2024-08-19T00:37:04.380800+0000","last_peered":"2024-08-19T00:37:04.380800+0000","last_clean":"2024-08-19T00:37:04.380800+0000","last_became_active":"2024-08-19T00:37:03.362961+0000","last_became_peered":"2024-08-19T00:37:03.362961+0000","last_unstale":"2024-08-19T00:37:04.380800+0000","last_undegraded":"2024-08-19T00:37:04.380800+0000","last_fullsized":"2024-08-19T00:37:04.380800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365095+0000","last_change":"2024-08-19T00:37:02.369181+0000","last_active":"2024-08-19T00:37:04.365095+0000","last_peered":"2024-08-19T00:37:04.365095+0000","last_clean":"2024-08-19T00:37:04.365095+0000","last_became_active":"2024-08-19T00:37:02.368734+0000","last_became_peered":"2024-08-19T00:37:02.368734+0000","last_unstale":"2024-08-19T00:37:04.365095+0000","last_undegraded":"2024-08-19T00:37:04.365095+0000","last_fullsized":"2024-08-19T00:37:04.365095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464050+0000","last_change":"2024-08-19T00:37:03.376231+0000","last_active":"2024-08-19T00:37:04.464050+0000","last_peered":"2024-08-19T00:37:04.464050+0000","last_clean":"2024-08-19T00:37:04.464050+0000","last_became_active":"2024-08-19T00:37:03.375969+0000","last_became_peered":"2024-08-19T00:37:03.375969+0000","last_unstale":"2024-08-19T00:37:04.464050+0000","last_undegraded":"2024-08-19T00:37:04.464050+0000","last_fullsized":"2024-08-19T00:37:04.464050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369377+0000","last_change":"2024-08-19T00:37:02.364004+0000","last_active":"2024-08-19T00:37:04.369377+0000","last_peered":"2024-08-19T00:37:04.369377+0000","last_clean":"2024-08-19T00:37:04.369377+0000","last_became_active":"2024-08-19T00:37:02.363712+0000","last_became_peered":"2024-08-19T00:37:02.363712+0000","last_unstale":"2024-08-19T00:37:04.369377+0000","last_undegraded":"2024-08-19T00:37:04.369377+0000","last_fullsized":"2024-08-19T00:37:04.369377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368210+0000","last_change":"2024-08-19T00:37:03.383128+0000","last_active":"2024-08-19T00:37:04.368210+0000","last_peered":"2024-08-19T00:37:04.368210+0000","last_clean":"2024-08-19T00:37:04.368210+0000","last_became_active":"2024-08-19T00:37:03.380518+0000","last_became_peered":"2024-08-19T00:37:03.380518+0000","last_unstale":"2024-08-19T00:37:04.368210+0000","last_undegraded":"2024-08-19T00:37:04.368210+0000","last_fullsized":"2024-08-19T00:37:04.368210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365629+0000","last_change":"2024-08-19T00:37:02.366117+0000","last_active":"2024-08-19T00:37:04.365629+0000","last_peered":"2024-08-19T00:37:04.365629+0000","last_clean":"2024-08-19T00:37:04.365629+0000","last_became_active":"2024-08-19T00:37:02.365766+0000","last_became_peered":"2024-08-19T00:37:02.365766+0000","last_unstale":"2024-08-19T00:37:04.365629+0000","last_undegraded":"2024-08-19T00:37:04.365629+0000","last_fullsized":"2024-08-19T00:37:04.365629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:49.690337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383742+0000","last_change":"2024-08-19T00:37:03.367877+0000","last_active":"2024-08-19T00:37:04.383742+0000","last_peered":"2024-08-19T00:37:04.383742+0000","last_clean":"2024-08-19T00:37:04.383742+0000","last_became_active":"2024-08-19T00:37:03.367527+0000","last_became_peered":"2024-08-19T00:37:03.367527+0000","last_unstale":"2024-08-19T00:37:04.383742+0000","last_undegraded":"2024-08-19T00:37:04.383742+0000","last_fullsized":"2024-08-19T00:37:04.383742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368455+0000","last_change":"2024-08-19T00:37:02.369028+0000","last_active":"2024-08-19T00:37:04.368455+0000","last_peered":"2024-08-19T00:37:04.368455+0000","last_clean":"2024-08-19T00:37:04.368455+0000","last_became_active":"2024-08-19T00:37:02.368699+0000","last_became_peered":"2024-08-19T00:37:02.368699+0000","last_unstale":"2024-08-19T00:37:04.368455+0000","last_undegraded":"2024-08-19T00:37:04.368455+0000","last_fullsized":"2024-08-19T00:37:04.368455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464137+0000","last_change":"2024-08-19T00:37:03.368305+0000","last_active":"2024-08-19T00:37:04.464137+0000","last_peered":"2024-08-19T00:37:04.464137+0000","last_clean":"2024-08-19T00:37:04.464137+0000","last_became_active":"2024-08-19T00:37:03.366016+0000","last_became_peered":"2024-08-19T00:37:03.366016+0000","last_unstale":"2024-08-19T00:37:04.464137+0000","last_undegraded":"2024-08-19T00:37:04.464137+0000","last_fullsized":"2024-08-19T00:37:04.464137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365779+0000","last_change":"2024-08-19T00:37:02.359697+0000","last_active":"2024-08-19T00:37:04.365779+0000","last_peered":"2024-08-19T00:37:04.365779+0000","last_clean":"2024-08-19T00:37:04.365779+0000","last_became_active":"2024-08-19T00:37:02.358966+0000","last_became_peered":"2024-08-19T00:37:02.358966+0000","last_unstale":"2024-08-19T00:37:04.365779+0000","last_undegraded":"2024-08-19T00:37:04.365779+0000","last_fullsized":"2024-08-19T00:37:04.365779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:58.297710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464195+0000","last_change":"2024-08-19T00:37:03.380507+0000","last_active":"2024-08-19T00:37:04.464195+0000","last_peered":"2024-08-19T00:37:04.464195+0000","last_clean":"2024-08-19T00:37:04.464195+0000","last_became_active":"2024-08-19T00:37:03.378035+0000","last_became_peered":"2024-08-19T00:37:03.378035+0000","last_unstale":"2024-08-19T00:37:04.464195+0000","last_undegraded":"2024-08-19T00:37:04.464195+0000","last_fullsized":"2024-08-19T00:37:04.464195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383088+0000","last_change":"2024-08-19T00:37:02.368422+0000","last_active":"2024-08-19T00:37:04.383088+0000","last_peered":"2024-08-19T00:37:04.383088+0000","last_clean":"2024-08-19T00:37:04.383088+0000","last_became_active":"2024-08-19T00:37:02.368123+0000","last_became_peered":"2024-08-19T00:37:02.368123+0000","last_unstale":"2024-08-19T00:37:04.383088+0000","last_undegraded":"2024-08-19T00:37:04.383088+0000","last_fullsized":"2024-08-19T00:37:04.383088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380949+0000","last_change":"2024-08-19T00:37:03.369753+0000","last_active":"2024-08-19T00:37:04.380949+0000","last_peered":"2024-08-19T00:37:04.380949+0000","last_clean":"2024-08-19T00:37:04.380949+0000","last_became_active":"2024-08-19T00:37:03.369412+0000","last_became_peered":"2024-08-19T00:37:03.369412+0000","last_unstale":"2024-08-19T00:37:04.380949+0000","last_undegraded":"2024-08-19T00:37:04.380949+0000","last_fullsized":"2024-08-19T00:37:04.380949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366071+0000","last_change":"2024-08-19T00:37:02.356963+0000","last_active":"2024-08-19T00:37:04.366071+0000","last_peered":"2024-08-19T00:37:04.366071+0000","last_clean":"2024-08-19T00:37:04.366071+0000","last_became_active":"2024-08-19T00:37:02.356715+0000","last_became_peered":"2024-08-19T00:37:02.356715+0000","last_unstale":"2024-08-19T00:37:04.366071+0000","last_undegraded":"2024-08-19T00:37:04.366071+0000","last_fullsized":"2024-08-19T00:37:04.366071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:01.604784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380767+0000","last_change":"2024-08-19T00:37:03.366561+0000","last_active":"2024-08-19T00:37:04.380767+0000","last_peered":"2024-08-19T00:37:04.380767+0000","last_clean":"2024-08-19T00:37:04.380767+0000","last_became_active":"2024-08-19T00:37:03.365866+0000","last_became_peered":"2024-08-19T00:37:03.365866+0000","last_unstale":"2024-08-19T00:37:04.380767+0000","last_undegraded":"2024-08-19T00:37:04.380767+0000","last_fullsized":"2024-08-19T00:37:04.380767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383431+0000","last_change":"2024-08-19T00:37:02.358382+0000","last_active":"2024-08-19T00:37:04.383431+0000","last_peered":"2024-08-19T00:37:04.383431+0000","last_clean":"2024-08-19T00:37:04.383431+0000","last_became_active":"2024-08-19T00:37:02.358084+0000","last_became_peered":"2024-08-19T00:37:02.358084+0000","last_unstale":"2024-08-19T00:37:04.383431+0000","last_undegraded":"2024-08-19T00:37:04.383431+0000","last_fullsized":"2024-08-19T00:37:04.383431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365165+0000","last_change":"2024-08-19T00:37:03.372382+0000","last_active":"2024-08-19T00:37:04.365165+0000","last_peered":"2024-08-19T00:37:04.365165+0000","last_clean":"2024-08-19T00:37:04.365165+0000","last_became_active":"2024-08-19T00:37:03.372117+0000","last_became_peered":"2024-08-19T00:37:03.372117+0000","last_unstale":"2024-08-19T00:37:04.365165+0000","last_undegraded":"2024-08-19T00:37:04.365165+0000","last_fullsized":"2024-08-19T00:37:04.365165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380693+0000","last_change":"2024-08-19T00:37:02.372086+0000","last_active":"2024-08-19T00:37:04.380693+0000","last_peered":"2024-08-19T00:37:04.380693+0000","last_clean":"2024-08-19T00:37:04.380693+0000","last_became_active":"2024-08-19T00:37:02.371740+0000","last_became_peered":"2024-08-19T00:37:02.371740+0000","last_unstale":"2024-08-19T00:37:04.380693+0000","last_undegraded":"2024-08-19T00:37:04.380693+0000","last_fullsized":"2024-08-19T00:37:04.380693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380570+0000","last_change":"2024-08-19T00:37:03.375284+0000","last_active":"2024-08-19T00:37:04.380570+0000","last_peered":"2024-08-19T00:37:04.380570+0000","last_clean":"2024-08-19T00:37:04.380570+0000","last_became_active":"2024-08-19T00:37:03.375000+0000","last_became_peered":"2024-08-19T00:37:03.375000+0000","last_unstale":"2024-08-19T00:37:04.380570+0000","last_undegraded":"2024-08-19T00:37:04.380570+0000","last_fullsized":"2024-08-19T00:37:04.380570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464135+0000","last_change":"2024-08-19T00:37:02.364047+0000","last_active":"2024-08-19T00:37:04.464135+0000","last_peered":"2024-08-19T00:37:04.464135+0000","last_clean":"2024-08-19T00:37:04.464135+0000","last_became_active":"2024-08-19T00:37:02.363698+0000","last_became_peered":"2024-08-19T00:37:02.363698+0000","last_unstale":"2024-08-19T00:37:04.464135+0000","last_undegraded":"2024-08-19T00:37:04.464135+0000","last_fullsized":"2024-08-19T00:37:04.464135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369502+0000","last_change":"2024-08-19T00:37:03.374146+0000","last_active":"2024-08-19T00:37:04.369502+0000","last_peered":"2024-08-19T00:37:04.369502+0000","last_clean":"2024-08-19T00:37:04.369502+0000","last_became_active":"2024-08-19T00:37:03.373834+0000","last_became_peered":"2024-08-19T00:37:03.373834+0000","last_unstale":"2024-08-19T00:37:04.369502+0000","last_undegraded":"2024-08-19T00:37:04.369502+0000","last_fullsized":"2024-08-19T00:37:04.369502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365432+0000","last_change":"2024-08-19T00:37:02.349640+0000","last_active":"2024-08-19T00:37:04.365432+0000","last_peered":"2024-08-19T00:37:04.365432+0000","last_clean":"2024-08-19T00:37:04.365432+0000","last_became_active":"2024-08-19T00:37:02.349269+0000","last_became_peered":"2024-08-19T00:37:02.349269+0000","last_unstale":"2024-08-19T00:37:04.365432+0000","last_undegraded":"2024-08-19T00:37:04.365432+0000","last_fullsized":"2024-08-19T00:37:04.365432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365608+0000","last_change":"2024-08-19T00:37:03.380432+0000","last_active":"2024-08-19T00:37:04.365608+0000","last_peered":"2024-08-19T00:37:04.365608+0000","last_clean":"2024-08-19T00:37:04.365608+0000","last_became_active":"2024-08-19T00:37:03.379670+0000","last_became_peered":"2024-08-19T00:37:03.379670+0000","last_unstale":"2024-08-19T00:37:04.365608+0000","last_undegraded":"2024-08-19T00:37:04.365608+0000","last_fullsized":"2024-08-19T00:37:04.365608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:11.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365705+0000","last_change":"2024-08-19T00:37:03.381062+0000","last_active":"2024-08-19T00:37:04.365705+0000","last_peered":"2024-08-19T00:37:04.365705+0000","last_clean":"2024-08-19T00:37:04.365705+0000","last_became_active":"2024-08-19T00:37:03.380753+0000","last_became_peered":"2024-08-19T00:37:03.380753+0000","last_unstale":"2024-08-19T00:37:04.365705+0000","last_undegraded":"2024-08-19T00:37:04.365705+0000","last_fullsized":"2024-08-19T00:37:04.365705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:37.265520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384192+0000","last_change":"2024-08-19T00:37:02.367985+0000","last_active":"2024-08-19T00:37:04.384192+0000","last_peered":"2024-08-19T00:37:04.384192+0000","last_clean":"2024-08-19T00:37:04.384192+0000","last_became_active":"2024-08-19T00:37:02.367333+0000","last_became_peered":"2024-08-19T00:37:02.367333+0000","last_unstale":"2024-08-19T00:37:04.384192+0000","last_undegraded":"2024-08-19T00:37:04.384192+0000","last_fullsized":"2024-08-19T00:37:04.384192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463676+0000","last_change":"2024-08-19T00:37:03.387814+0000","last_active":"2024-08-19T00:37:04.463676+0000","last_peered":"2024-08-19T00:37:04.463676+0000","last_clean":"2024-08-19T00:37:04.463676+0000","last_became_active":"2024-08-19T00:37:03.386581+0000","last_became_peered":"2024-08-19T00:37:03.386581+0000","last_unstale":"2024-08-19T00:37:04.463676+0000","last_undegraded":"2024-08-19T00:37:04.463676+0000","last_fullsized":"2024-08-19T00:37:04.463676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384048+0000","last_change":"2024-08-19T00:37:02.370717+0000","last_active":"2024-08-19T00:37:04.384048+0000","last_peered":"2024-08-19T00:37:04.384048+0000","last_clean":"2024-08-19T00:37:04.384048+0000","last_became_active":"2024-08-19T00:37:02.368335+0000","last_became_peered":"2024-08-19T00:37:02.368335+0000","last_unstale":"2024-08-19T00:37:04.384048+0000","last_undegraded":"2024-08-19T00:37:04.384048+0000","last_fullsized":"2024-08-19T00:37:04.384048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368865+0000","last_change":"2024-08-19T00:37:03.383908+0000","last_active":"2024-08-19T00:37:04.368865+0000","last_peered":"2024-08-19T00:37:04.368865+0000","last_clean":"2024-08-19T00:37:04.368865+0000","last_became_active":"2024-08-19T00:37:03.383512+0000","last_became_peered":"2024-08-19T00:37:03.383512+0000","last_unstale":"2024-08-19T00:37:04.368865+0000","last_undegraded":"2024-08-19T00:37:04.368865+0000","last_fullsized":"2024-08-19T00:37:04.368865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368814+0000","last_change":"2024-08-19T00:37:02.366055+0000","last_active":"2024-08-19T00:37:04.368814+0000","last_peered":"2024-08-19T00:37:04.368814+0000","last_clean":"2024-08-19T00:37:04.368814+0000","last_became_active":"2024-08-19T00:37:02.365758+0000","last_became_peered":"2024-08-19T00:37:02.365758+0000","last_unstale":"2024-08-19T00:37:04.368814+0000","last_undegraded":"2024-08-19T00:37:04.368814+0000","last_fullsized":"2024-08-19T00:37:04.368814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368779+0000","last_change":"2024-08-19T00:37:03.371682+0000","last_active":"2024-08-19T00:37:04.368779+0000","last_peered":"2024-08-19T00:37:04.368779+0000","last_clean":"2024-08-19T00:37:04.368779+0000","last_became_active":"2024-08-19T00:37:03.371418+0000","last_became_peered":"2024-08-19T00:37:03.371418+0000","last_unstale":"2024-08-19T00:37:04.368779+0000","last_undegraded":"2024-08-19T00:37:04.368779+0000","last_fullsized":"2024-08-19T00:37:04.368779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380909+0000","last_change":"2024-08-19T00:37:02.361542+0000","last_active":"2024-08-19T00:37:04.380909+0000","last_peered":"2024-08-19T00:37:04.380909+0000","last_clean":"2024-08-19T00:37:04.380909+0000","last_became_active":"2024-08-19T00:37:02.361229+0000","last_became_peered":"2024-08-19T00:37:02.361229+0000","last_unstale":"2024-08-19T00:37:04.380909+0000","last_undegraded":"2024-08-19T00:37:04.380909+0000","last_fullsized":"2024-08-19T00:37:04.380909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":69429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":77889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":76187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":666043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:37:07.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:37:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.764+0000 7f5f96000640 1 Processor -- start 2024-08-19T00:37:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.764+0000 7f5f96000640 1 -- start start 2024-08-19T00:37:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.765+0000 7f5f96000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5f90159bf0 0x7f5f90073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.765+0000 7f5f96000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9006f7f0 con 0x7f5f900cec10 2024-08-19T00:37:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.765+0000 7f5f96000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9006f510 con 0x7f5f900739a0 2024-08-19T00:37:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.765+0000 7f5f96000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5f90072980 con 0x7f5f90159bf0 2024-08-19T00:37:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5f900cec10 0x7f5f900d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46232/0 (socket says 172.21.15.7:46232) 2024-08-19T00:37:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8fe00640 1 -- 172.21.15.7:0/325147258 learned_addr learned my addr 172.21.15.7:0/325147258 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8f400640 1 --2- 172.21.15.7:0/325147258 >> v2:172.21.15.162:3300/0 conn(0x7f5f90159bf0 0x7f5f90073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8ea00640 1 -- 172.21.15.7:0/325147258 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 446460479 0 0) 0x7f5f9006f7f0 con 0x7f5f900cec10 2024-08-19T00:37:07.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8ea00640 1 -- 172.21.15.7:0/325147258 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f74003520 con 0x7f5f900cec10 2024-08-19T00:37:07.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8f400640 1 -- 172.21.15.7:0/325147258 >> v1:172.21.15.162:6789/0 conn(0x7f5f900739a0 legacy=0x7f5f900ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8f400640 1 -- 172.21.15.7:0/325147258 >> v1:172.21.15.7:6789/0 conn(0x7f5f900cec10 legacy=0x7f5f900d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.766+0000 7f5f8f400640 1 -- 172.21.15.7:0/325147258 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f90072c60 con 0x7f5f90159bf0 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.767+0000 7f5f8f400640 1 --2- 172.21.15.7:0/325147258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f90159bf0 0x7f5f90073460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f800097a0 tx=0x7f5f8002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb65cf69c494000e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f8ea00640 1 -- 172.21.15.7:0/325147258 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80037070 con 0x7f5f90159bf0 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f8ea00640 1 -- 172.21.15.7:0/325147258 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f80032440 con 0x7f5f90159bf0 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f8ea00640 1 -- 172.21.15.7:0/325147258 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80032810 con 0x7f5f90159bf0 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f96000640 1 -- 172.21.15.7:0/325147258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f90159bf0 msgr2=0x7f5f90073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f96000640 1 --2- 172.21.15.7:0/325147258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f90159bf0 0x7f5f90073460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f800097a0 tx=0x7f5f8002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f96000640 1 -- 172.21.15.7:0/325147258 shutdown_connections 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f96000640 1 --2- 172.21.15.7:0/325147258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f90159bf0 0x7f5f90073460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f96000640 1 -- 172.21.15.7:0/325147258 >> 172.21.15.7:0/325147258 conn(0x7f5f9006bc70 msgr2=0x7f5f9006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:07.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f96000640 1 -- 172.21.15.7:0/325147258 shutdown_connections 2024-08-19T00:37:07.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.768+0000 7f5f96000640 1 -- 172.21.15.7:0/325147258 wait complete. 2024-08-19T00:37:07.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.770+0000 7f5f96000640 1 Processor -- start 2024-08-19T00:37:07.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.770+0000 7f5f96000640 1 -- start start 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f96000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f900739a0 0x7f5f90144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f96000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f90159bf0 0x7f5f901f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f96000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f901f75f0 0x7f5f9009c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f96000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9015a150 con 0x7f5f901f75f0 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f96000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90159fd0 con 0x7f5f900739a0 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f96000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f900d0ad0 con 0x7f5f90159bf0 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f8fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f901f75f0 0x7f5f9009c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f8fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f901f75f0 0x7f5f9009c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35262/0 (socket says 172.21.15.7:35262) 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f8fe00640 1 -- 172.21.15.7:0/2380033940 learned_addr learned my addr 172.21.15.7:0/2380033940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f87e00640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f90159bf0 0x7f5f901f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.771+0000 7f5f8f400640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f900739a0 0x7f5f90144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f8fe00640 1 -- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f90159bf0 msgr2=0x7f5f901f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f8fe00640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f90159bf0 0x7f5f901f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f8fe00640 1 -- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f900739a0 msgr2=0x7f5f90144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f8fe00640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f900739a0 0x7f5f90144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f8fe00640 1 -- 172.21.15.7:0/2380033940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f901458b0 con 0x7f5f901f75f0 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f87e00640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f90159bf0 0x7f5f901f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f8f400640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f900739a0 0x7f5f90144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f8fe00640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f901f75f0 0x7f5f9009c830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800cbb0 tx=0x7f5f8800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f87400640 1 -- 172.21.15.7:0/2380033940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88017070 con 0x7f5f901f75f0 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f87400640 1 -- 172.21.15.7:0/2380033940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8800ad40 con 0x7f5f901f75f0 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f87400640 1 -- 172.21.15.7:0/2380033940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88012600 con 0x7f5f901f75f0 2024-08-19T00:37:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f901f4900 con 0x7f5f901f75f0 2024-08-19T00:37:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.772+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f901f4ec0 con 0x7f5f901f75f0 2024-08-19T00:37:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.774+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f90073460 con 0x7f5f901f75f0 2024-08-19T00:37:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.774+0000 7f5f87400640 1 -- 172.21.15.7:0/2380033940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f8801a070 con 0x7f5f901f75f0 2024-08-19T00:37:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.775+0000 7f5f87400640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f6c06be30 0x7f5f6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.775+0000 7f5f87400640 1 -- 172.21.15.7:0/2380033940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5f8808ac20 con 0x7f5f901f75f0 2024-08-19T00:37:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.775+0000 7f5f8f400640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f6c06be30 0x7f5f6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.776+0000 7f5f8f400640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f6c06be30 0x7f5f6c06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f80034000 tx=0x7f5f8002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.780+0000 7f5f87400640 1 -- 172.21.15.7:0/2380033940 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5f88058e60 con 0x7f5f901f75f0 2024-08-19T00:37:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.959+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f9006c980 con 0x7f5f6c06be30 2024-08-19T00:37:07.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.966+0000 7f5f87400640 1 -- 172.21.15.7:0/2380033940 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7f5f9006c980 con 0x7f5f6c06be30 2024-08-19T00:37:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:07.972 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:37:07.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f6c06be30 msgr2=0x7f5f6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f6c06be30 0x7f5f6c06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f80034000 tx=0x7f5f8002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f901f75f0 msgr2=0x7f5f9009c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f901f75f0 0x7f5f9009c830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800cbb0 tx=0x7f5f8800a430 comp rx=0 tx=0).stop 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 shutdown_connections 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f6c06be30 0x7f5f6c06e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f901f75f0 0x7f5f9009c830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f90159bf0 0x7f5f901f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.969+0000 7f5f96000640 1 --2- 172.21.15.7:0/2380033940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f900739a0 0x7f5f90144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.970+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 >> 172.21.15.7:0/2380033940 conn(0x7f5f9006bc70 msgr2=0x7f5f900b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.970+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 shutdown_connections 2024-08-19T00:37:07.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:07.970+0000 7f5f96000640 1 -- 172.21.15.7:0/2380033940 wait complete. 2024-08-19T00:37:07.975 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-08-19T00:37:07.972+0000 7f3e07400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:37:07.987 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-19T00:37:07.255960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235732,"kb_used_data":2908,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738988,"statfs":{"total":773094113280,"available":772852723712,"internally_reserved":0,"allocated":2977792,"data_stored":1784096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.922704"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384036+0000","last_change":"2024-08-19T00:37:03.384522+0000","last_active":"2024-08-19T00:37:04.384036+0000","last_peered":"2024-08-19T00:37:04.384036+0000","last_clean":"2024-08-19T00:37:04.384036+0000","last_became_active":"2024-08-19T00:37:03.378809+0000","last_became_peered":"2024-08-19T00:37:03.378809+0000","last_unstale":"2024-08-19T00:37:04.384036+0000","last_undegraded":"2024-08-19T00:37:04.384036+0000","last_fullsized":"2024-08-19T00:37:04.384036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368586+0000","last_change":"2024-08-19T00:37:03.375782+0000","last_active":"2024-08-19T00:37:04.368586+0000","last_peered":"2024-08-19T00:37:04.368586+0000","last_clean":"2024-08-19T00:37:04.368586+0000","last_became_active":"2024-08-19T00:37:03.375533+0000","last_became_peered":"2024-08-19T00:37:03.375533+0000","last_unstale":"2024-08-19T00:37:04.368586+0000","last_undegraded":"2024-08-19T00:37:04.368586+0000","last_fullsized":"2024-08-19T00:37:04.368586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368559+0000","last_change":"2024-08-19T00:37:03.387391+0000","last_active":"2024-08-19T00:37:04.368559+0000","last_peered":"2024-08-19T00:37:04.368559+0000","last_clean":"2024-08-19T00:37:04.368559+0000","last_became_active":"2024-08-19T00:37:03.386550+0000","last_became_peered":"2024-08-19T00:37:03.386550+0000","last_unstale":"2024-08-19T00:37:04.368559+0000","last_undegraded":"2024-08-19T00:37:04.368559+0000","last_fullsized":"2024-08-19T00:37:04.368559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464051+0000","last_change":"2024-08-19T00:37:03.366111+0000","last_active":"2024-08-19T00:37:04.464051+0000","last_peered":"2024-08-19T00:37:04.464051+0000","last_clean":"2024-08-19T00:37:04.464051+0000","last_became_active":"2024-08-19T00:37:03.365397+0000","last_became_peered":"2024-08-19T00:37:03.365397+0000","last_unstale":"2024-08-19T00:37:04.464051+0000","last_undegraded":"2024-08-19T00:37:04.464051+0000","last_fullsized":"2024-08-19T00:37:04.464051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383873+0000","last_change":"2024-08-19T00:37:03.374066+0000","last_active":"2024-08-19T00:37:04.383873+0000","last_peered":"2024-08-19T00:37:04.383873+0000","last_clean":"2024-08-19T00:37:04.383873+0000","last_became_active":"2024-08-19T00:37:03.373773+0000","last_became_peered":"2024-08-19T00:37:03.373773+0000","last_unstale":"2024-08-19T00:37:04.383873+0000","last_undegraded":"2024-08-19T00:37:04.383873+0000","last_fullsized":"2024-08-19T00:37:04.383873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463972+0000","last_change":"2024-08-19T00:37:03.373062+0000","last_active":"2024-08-19T00:37:04.463972+0000","last_peered":"2024-08-19T00:37:04.463972+0000","last_clean":"2024-08-19T00:37:04.463972+0000","last_became_active":"2024-08-19T00:37:03.372380+0000","last_became_peered":"2024-08-19T00:37:03.372380+0000","last_unstale":"2024-08-19T00:37:04.463972+0000","last_undegraded":"2024-08-19T00:37:04.463972+0000","last_fullsized":"2024-08-19T00:37:04.463972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384097+0000","last_change":"2024-08-19T00:37:03.381691+0000","last_active":"2024-08-19T00:37:04.384097+0000","last_peered":"2024-08-19T00:37:04.384097+0000","last_clean":"2024-08-19T00:37:04.384097+0000","last_became_active":"2024-08-19T00:37:03.381312+0000","last_became_peered":"2024-08-19T00:37:03.381312+0000","last_unstale":"2024-08-19T00:37:04.384097+0000","last_undegraded":"2024-08-19T00:37:04.384097+0000","last_fullsized":"2024-08-19T00:37:04.384097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368077+0000","last_change":"2024-08-19T00:37:03.386764+0000","last_active":"2024-08-19T00:37:04.368077+0000","last_peered":"2024-08-19T00:37:04.368077+0000","last_clean":"2024-08-19T00:37:04.368077+0000","last_became_active":"2024-08-19T00:37:03.385701+0000","last_became_peered":"2024-08-19T00:37:03.385701+0000","last_unstale":"2024-08-19T00:37:04.368077+0000","last_undegraded":"2024-08-19T00:37:04.368077+0000","last_fullsized":"2024-08-19T00:37:04.368077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464403+0000","last_change":"2024-08-19T00:37:03.383398+0000","last_active":"2024-08-19T00:37:04.464403+0000","last_peered":"2024-08-19T00:37:04.464403+0000","last_clean":"2024-08-19T00:37:04.464403+0000","last_became_active":"2024-08-19T00:37:03.383039+0000","last_became_peered":"2024-08-19T00:37:03.383039+0000","last_unstale":"2024-08-19T00:37:04.464403+0000","last_undegraded":"2024-08-19T00:37:04.464403+0000","last_fullsized":"2024-08-19T00:37:04.464403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383773+0000","last_change":"2024-08-19T00:37:03.367285+0000","last_active":"2024-08-19T00:37:04.383773+0000","last_peered":"2024-08-19T00:37:04.383773+0000","last_clean":"2024-08-19T00:37:04.383773+0000","last_became_active":"2024-08-19T00:37:03.366995+0000","last_became_peered":"2024-08-19T00:37:03.366995+0000","last_unstale":"2024-08-19T00:37:04.383773+0000","last_undegraded":"2024-08-19T00:37:04.383773+0000","last_fullsized":"2024-08-19T00:37:04.383773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383787+0000","last_change":"2024-08-19T00:37:03.368053+0000","last_active":"2024-08-19T00:37:04.383787+0000","last_peered":"2024-08-19T00:37:04.383787+0000","last_clean":"2024-08-19T00:37:04.383787+0000","last_became_active":"2024-08-19T00:37:03.367766+0000","last_became_peered":"2024-08-19T00:37:03.367766+0000","last_unstale":"2024-08-19T00:37:04.383787+0000","last_undegraded":"2024-08-19T00:37:04.383787+0000","last_fullsized":"2024-08-19T00:37:04.383787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383805+0000","last_change":"2024-08-19T00:37:03.381800+0000","last_active":"2024-08-19T00:37:04.383805+0000","last_peered":"2024-08-19T00:37:04.383805+0000","last_clean":"2024-08-19T00:37:04.383805+0000","last_became_active":"2024-08-19T00:37:03.380371+0000","last_became_peered":"2024-08-19T00:37:03.380371+0000","last_unstale":"2024-08-19T00:37:04.383805+0000","last_undegraded":"2024-08-19T00:37:04.383805+0000","last_fullsized":"2024-08-19T00:37:04.383805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464125+0000","last_change":"2024-08-19T00:37:03.375068+0000","last_active":"2024-08-19T00:37:04.464125+0000","last_peered":"2024-08-19T00:37:04.464125+0000","last_clean":"2024-08-19T00:37:04.464125+0000","last_became_active":"2024-08-19T00:37:03.374786+0000","last_became_peered":"2024-08-19T00:37:03.374786+0000","last_unstale":"2024-08-19T00:37:04.464125+0000","last_undegraded":"2024-08-19T00:37:04.464125+0000","last_fullsized":"2024-08-19T00:37:04.464125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463980+0000","last_change":"2024-08-19T00:37:03.372712+0000","last_active":"2024-08-19T00:37:04.463980+0000","last_peered":"2024-08-19T00:37:04.463980+0000","last_clean":"2024-08-19T00:37:04.463980+0000","last_became_active":"2024-08-19T00:37:03.372479+0000","last_became_peered":"2024-08-19T00:37:03.372479+0000","last_unstale":"2024-08-19T00:37:04.463980+0000","last_undegraded":"2024-08-19T00:37:04.463980+0000","last_fullsized":"2024-08-19T00:37:04.463980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368043+0000","last_change":"2024-08-19T00:37:03.373145+0000","last_active":"2024-08-19T00:37:04.368043+0000","last_peered":"2024-08-19T00:37:04.368043+0000","last_clean":"2024-08-19T00:37:04.368043+0000","last_became_active":"2024-08-19T00:37:03.372872+0000","last_became_peered":"2024-08-19T00:37:03.372872+0000","last_unstale":"2024-08-19T00:37:04.368043+0000","last_undegraded":"2024-08-19T00:37:04.368043+0000","last_fullsized":"2024-08-19T00:37:04.368043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364979+0000","last_change":"2024-08-19T00:37:03.381878+0000","last_active":"2024-08-19T00:37:04.364979+0000","last_peered":"2024-08-19T00:37:04.364979+0000","last_clean":"2024-08-19T00:37:04.364979+0000","last_became_active":"2024-08-19T00:37:03.381642+0000","last_became_peered":"2024-08-19T00:37:03.381642+0000","last_unstale":"2024-08-19T00:37:04.364979+0000","last_undegraded":"2024-08-19T00:37:04.364979+0000","last_fullsized":"2024-08-19T00:37:04.364979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366018+0000","last_change":"2024-08-19T00:37:03.388402+0000","last_active":"2024-08-19T00:37:04.366018+0000","last_peered":"2024-08-19T00:37:04.366018+0000","last_clean":"2024-08-19T00:37:04.366018+0000","last_became_active":"2024-08-19T00:37:03.387161+0000","last_became_peered":"2024-08-19T00:37:03.387161+0000","last_unstale":"2024-08-19T00:37:04.366018+0000","last_undegraded":"2024-08-19T00:37:04.366018+0000","last_fullsized":"2024-08-19T00:37:04.366018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:17.499516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369876+0000","last_change":"2024-08-19T00:37:03.379215+0000","last_active":"2024-08-19T00:37:04.369876+0000","last_peered":"2024-08-19T00:37:04.369876+0000","last_clean":"2024-08-19T00:37:04.369876+0000","last_became_active":"2024-08-19T00:37:03.378899+0000","last_became_peered":"2024-08-19T00:37:03.378899+0000","last_unstale":"2024-08-19T00:37:04.369876+0000","last_undegraded":"2024-08-19T00:37:04.369876+0000","last_fullsized":"2024-08-19T00:37:04.369876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365805+0000","last_change":"2024-08-19T00:37:03.384467+0000","last_active":"2024-08-19T00:37:04.365805+0000","last_peered":"2024-08-19T00:37:04.365805+0000","last_clean":"2024-08-19T00:37:04.365805+0000","last_became_active":"2024-08-19T00:37:03.384206+0000","last_became_peered":"2024-08-19T00:37:03.384206+0000","last_unstale":"2024-08-19T00:37:04.365805+0000","last_undegraded":"2024-08-19T00:37:04.365805+0000","last_fullsized":"2024-08-19T00:37:04.365805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:06.468363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383955+0000","last_change":"2024-08-19T00:37:03.381984+0000","last_active":"2024-08-19T00:37:04.383955+0000","last_peered":"2024-08-19T00:37:04.383955+0000","last_clean":"2024-08-19T00:37:04.383955+0000","last_became_active":"2024-08-19T00:37:03.379208+0000","last_became_peered":"2024-08-19T00:37:03.379208+0000","last_unstale":"2024-08-19T00:37:04.383955+0000","last_undegraded":"2024-08-19T00:37:04.383955+0000","last_fullsized":"2024-08-19T00:37:04.383955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380591+0000","last_change":"2024-08-19T00:37:03.366104+0000","last_active":"2024-08-19T00:37:04.380591+0000","last_peered":"2024-08-19T00:37:04.380591+0000","last_clean":"2024-08-19T00:37:04.380591+0000","last_became_active":"2024-08-19T00:37:03.365823+0000","last_became_peered":"2024-08-19T00:37:03.365823+0000","last_unstale":"2024-08-19T00:37:04.380591+0000","last_undegraded":"2024-08-19T00:37:04.380591+0000","last_fullsized":"2024-08-19T00:37:04.380591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463440+0000","last_change":"2024-08-19T00:37:03.370063+0000","last_active":"2024-08-19T00:37:04.463440+0000","last_peered":"2024-08-19T00:37:04.463440+0000","last_clean":"2024-08-19T00:37:04.463440+0000","last_became_active":"2024-08-19T00:37:03.369707+0000","last_became_peered":"2024-08-19T00:37:03.369707+0000","last_unstale":"2024-08-19T00:37:04.463440+0000","last_undegraded":"2024-08-19T00:37:04.463440+0000","last_fullsized":"2024-08-19T00:37:04.463440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368265+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368265+0000","last_peered":"2024-08-19T00:37:04.368265+0000","last_clean":"2024-08-19T00:37:04.368265+0000","last_became_active":"2024-08-19T00:37:03.372854+0000","last_became_peered":"2024-08-19T00:37:03.372854+0000","last_unstale":"2024-08-19T00:37:04.368265+0000","last_undegraded":"2024-08-19T00:37:04.368265+0000","last_fullsized":"2024-08-19T00:37:04.368265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364944+0000","last_change":"2024-08-19T00:37:03.386557+0000","last_active":"2024-08-19T00:37:04.364944+0000","last_peered":"2024-08-19T00:37:04.364944+0000","last_clean":"2024-08-19T00:37:04.364944+0000","last_became_active":"2024-08-19T00:37:03.386294+0000","last_became_peered":"2024-08-19T00:37:03.386294+0000","last_unstale":"2024-08-19T00:37:04.364944+0000","last_undegraded":"2024-08-19T00:37:04.364944+0000","last_fullsized":"2024-08-19T00:37:04.364944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368793+0000","last_change":"2024-08-19T00:37:03.379194+0000","last_active":"2024-08-19T00:37:04.368793+0000","last_peered":"2024-08-19T00:37:04.368793+0000","last_clean":"2024-08-19T00:37:04.368793+0000","last_became_active":"2024-08-19T00:37:03.378509+0000","last_became_peered":"2024-08-19T00:37:03.378509+0000","last_unstale":"2024-08-19T00:37:04.368793+0000","last_undegraded":"2024-08-19T00:37:04.368793+0000","last_fullsized":"2024-08-19T00:37:04.368793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464421+0000","last_change":"2024-08-19T00:37:03.373705+0000","last_active":"2024-08-19T00:37:04.464421+0000","last_peered":"2024-08-19T00:37:04.464421+0000","last_clean":"2024-08-19T00:37:04.464421+0000","last_became_active":"2024-08-19T00:37:03.366841+0000","last_became_peered":"2024-08-19T00:37:03.366841+0000","last_unstale":"2024-08-19T00:37:04.464421+0000","last_undegraded":"2024-08-19T00:37:04.464421+0000","last_fullsized":"2024-08-19T00:37:04.464421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464316+0000","last_change":"2024-08-19T00:37:03.370473+0000","last_active":"2024-08-19T00:37:04.464316+0000","last_peered":"2024-08-19T00:37:04.464316+0000","last_clean":"2024-08-19T00:37:04.464316+0000","last_became_active":"2024-08-19T00:37:03.370106+0000","last_became_peered":"2024-08-19T00:37:03.370106+0000","last_unstale":"2024-08-19T00:37:04.464316+0000","last_undegraded":"2024-08-19T00:37:04.464316+0000","last_fullsized":"2024-08-19T00:37:04.464316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464155+0000","last_change":"2024-08-19T00:37:03.383036+0000","last_active":"2024-08-19T00:37:04.464155+0000","last_peered":"2024-08-19T00:37:04.464155+0000","last_clean":"2024-08-19T00:37:04.464155+0000","last_became_active":"2024-08-19T00:37:03.382643+0000","last_became_peered":"2024-08-19T00:37:03.382643+0000","last_unstale":"2024-08-19T00:37:04.464155+0000","last_undegraded":"2024-08-19T00:37:04.464155+0000","last_fullsized":"2024-08-19T00:37:04.464155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:33.644440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368293+0000","last_change":"2024-08-19T00:37:03.382477+0000","last_active":"2024-08-19T00:37:04.368293+0000","last_peered":"2024-08-19T00:37:04.368293+0000","last_clean":"2024-08-19T00:37:04.368293+0000","last_became_active":"2024-08-19T00:37:03.380124+0000","last_became_peered":"2024-08-19T00:37:03.380124+0000","last_unstale":"2024-08-19T00:37:04.368293+0000","last_undegraded":"2024-08-19T00:37:04.368293+0000","last_fullsized":"2024-08-19T00:37:04.368293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365281+0000","last_change":"2024-08-19T00:37:03.379567+0000","last_active":"2024-08-19T00:37:04.365281+0000","last_peered":"2024-08-19T00:37:04.365281+0000","last_clean":"2024-08-19T00:37:04.365281+0000","last_became_active":"2024-08-19T00:37:03.372732+0000","last_became_peered":"2024-08-19T00:37:03.372732+0000","last_unstale":"2024-08-19T00:37:04.365281+0000","last_undegraded":"2024-08-19T00:37:04.365281+0000","last_fullsized":"2024-08-19T00:37:04.365281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369286+0000","last_change":"2024-08-19T00:37:03.372911+0000","last_active":"2024-08-19T00:37:04.369286+0000","last_peered":"2024-08-19T00:37:04.369286+0000","last_clean":"2024-08-19T00:37:04.369286+0000","last_became_active":"2024-08-19T00:37:03.372598+0000","last_became_peered":"2024-08-19T00:37:03.372598+0000","last_unstale":"2024-08-19T00:37:04.369286+0000","last_undegraded":"2024-08-19T00:37:04.369286+0000","last_fullsized":"2024-08-19T00:37:04.369286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463669+0000","last_change":"2024-08-19T00:37:03.363843+0000","last_active":"2024-08-19T00:37:04.463669+0000","last_peered":"2024-08-19T00:37:04.463669+0000","last_clean":"2024-08-19T00:37:04.463669+0000","last_became_active":"2024-08-19T00:37:03.362519+0000","last_became_peered":"2024-08-19T00:37:03.362519+0000","last_unstale":"2024-08-19T00:37:04.463669+0000","last_undegraded":"2024-08-19T00:37:04.463669+0000","last_fullsized":"2024-08-19T00:37:04.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463528+0000","last_change":"2024-08-19T00:37:03.373644+0000","last_active":"2024-08-19T00:37:04.463528+0000","last_peered":"2024-08-19T00:37:04.463528+0000","last_clean":"2024-08-19T00:37:04.463528+0000","last_became_active":"2024-08-19T00:37:03.373298+0000","last_became_peered":"2024-08-19T00:37:03.373298+0000","last_unstale":"2024-08-19T00:37:04.463528+0000","last_undegraded":"2024-08-19T00:37:04.463528+0000","last_fullsized":"2024-08-19T00:37:04.463528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368301+0000","last_change":"2024-08-19T00:37:02.366620+0000","last_active":"2024-08-19T00:37:04.368301+0000","last_peered":"2024-08-19T00:37:04.368301+0000","last_clean":"2024-08-19T00:37:04.368301+0000","last_became_active":"2024-08-19T00:37:02.366071+0000","last_became_peered":"2024-08-19T00:37:02.366071+0000","last_unstale":"2024-08-19T00:37:04.368301+0000","last_undegraded":"2024-08-19T00:37:04.368301+0000","last_fullsized":"2024-08-19T00:37:04.368301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380696+0000","last_change":"2024-08-19T00:37:03.369278+0000","last_active":"2024-08-19T00:37:04.380696+0000","last_peered":"2024-08-19T00:37:04.380696+0000","last_clean":"2024-08-19T00:37:04.380696+0000","last_became_active":"2024-08-19T00:37:03.365557+0000","last_became_peered":"2024-08-19T00:37:03.365557+0000","last_unstale":"2024-08-19T00:37:04.380696+0000","last_undegraded":"2024-08-19T00:37:04.380696+0000","last_fullsized":"2024-08-19T00:37:04.380696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:53.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365384+0000","last_change":"2024-08-19T00:37:02.362332+0000","last_active":"2024-08-19T00:37:04.365384+0000","last_peered":"2024-08-19T00:37:04.365384+0000","last_clean":"2024-08-19T00:37:04.365384+0000","last_became_active":"2024-08-19T00:37:02.362055+0000","last_became_peered":"2024-08-19T00:37:02.362055+0000","last_unstale":"2024-08-19T00:37:04.365384+0000","last_undegraded":"2024-08-19T00:37:04.365384+0000","last_fullsized":"2024-08-19T00:37:04.365384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463849+0000","last_change":"2024-08-19T00:37:02.370542+0000","last_active":"2024-08-19T00:37:04.463849+0000","last_peered":"2024-08-19T00:37:04.463849+0000","last_clean":"2024-08-19T00:37:04.463849+0000","last_became_active":"2024-08-19T00:37:02.369837+0000","last_became_peered":"2024-08-19T00:37:02.369837+0000","last_unstale":"2024-08-19T00:37:04.463849+0000","last_undegraded":"2024-08-19T00:37:04.463849+0000","last_fullsized":"2024-08-19T00:37:04.463849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:45.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368309+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368309+0000","last_peered":"2024-08-19T00:37:04.368309+0000","last_clean":"2024-08-19T00:37:04.368309+0000","last_became_active":"2024-08-19T00:37:03.376353+0000","last_became_peered":"2024-08-19T00:37:03.376353+0000","last_unstale":"2024-08-19T00:37:04.368309+0000","last_undegraded":"2024-08-19T00:37:04.368309+0000","last_fullsized":"2024-08-19T00:37:04.368309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365038+0000","last_change":"2024-08-19T00:37:02.358463+0000","last_active":"2024-08-19T00:37:04.365038+0000","last_peered":"2024-08-19T00:37:04.365038+0000","last_clean":"2024-08-19T00:37:04.365038+0000","last_became_active":"2024-08-19T00:37:02.357105+0000","last_became_peered":"2024-08-19T00:37:02.357105+0000","last_unstale":"2024-08-19T00:37:04.365038+0000","last_undegraded":"2024-08-19T00:37:04.365038+0000","last_fullsized":"2024-08-19T00:37:04.365038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380664+0000","last_change":"2024-08-19T00:37:03.372060+0000","last_active":"2024-08-19T00:37:04.380664+0000","last_peered":"2024-08-19T00:37:04.380664+0000","last_clean":"2024-08-19T00:37:04.380664+0000","last_became_active":"2024-08-19T00:37:03.371830+0000","last_became_peered":"2024-08-19T00:37:03.371830+0000","last_unstale":"2024-08-19T00:37:04.380664+0000","last_undegraded":"2024-08-19T00:37:04.380664+0000","last_fullsized":"2024-08-19T00:37:04.380664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:17.064649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464497+0000","last_change":"2024-08-19T00:37:02.359600+0000","last_active":"2024-08-19T00:37:04.464497+0000","last_peered":"2024-08-19T00:37:04.464497+0000","last_clean":"2024-08-19T00:37:04.464497+0000","last_became_active":"2024-08-19T00:37:02.357350+0000","last_became_peered":"2024-08-19T00:37:02.357350+0000","last_unstale":"2024-08-19T00:37:04.464497+0000","last_undegraded":"2024-08-19T00:37:04.464497+0000","last_fullsized":"2024-08-19T00:37:04.464497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464491+0000","last_change":"2024-08-19T00:37:03.368421+0000","last_active":"2024-08-19T00:37:04.464491+0000","last_peered":"2024-08-19T00:37:04.464491+0000","last_clean":"2024-08-19T00:37:04.464491+0000","last_became_active":"2024-08-19T00:37:03.367857+0000","last_became_peered":"2024-08-19T00:37:03.367857+0000","last_unstale":"2024-08-19T00:37:04.464491+0000","last_undegraded":"2024-08-19T00:37:04.464491+0000","last_fullsized":"2024-08-19T00:37:04.464491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383943+0000","last_change":"2024-08-19T00:37:02.371034+0000","last_active":"2024-08-19T00:37:04.383943+0000","last_peered":"2024-08-19T00:37:04.383943+0000","last_clean":"2024-08-19T00:37:04.383943+0000","last_became_active":"2024-08-19T00:37:02.370558+0000","last_became_peered":"2024-08-19T00:37:02.370558+0000","last_unstale":"2024-08-19T00:37:04.383943+0000","last_undegraded":"2024-08-19T00:37:04.383943+0000","last_fullsized":"2024-08-19T00:37:04.383943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368959+0000","last_change":"2024-08-19T00:37:03.379464+0000","last_active":"2024-08-19T00:37:04.368959+0000","last_peered":"2024-08-19T00:37:04.368959+0000","last_clean":"2024-08-19T00:37:04.368959+0000","last_became_active":"2024-08-19T00:37:03.378926+0000","last_became_peered":"2024-08-19T00:37:03.378926+0000","last_unstale":"2024-08-19T00:37:04.368959+0000","last_undegraded":"2024-08-19T00:37:04.368959+0000","last_fullsized":"2024-08-19T00:37:04.368959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369623+0000","last_change":"2024-08-19T00:37:02.356530+0000","last_active":"2024-08-19T00:37:04.369623+0000","last_peered":"2024-08-19T00:37:04.369623+0000","last_clean":"2024-08-19T00:37:04.369623+0000","last_became_active":"2024-08-19T00:37:02.356057+0000","last_became_peered":"2024-08-19T00:37:02.356057+0000","last_unstale":"2024-08-19T00:37:04.369623+0000","last_undegraded":"2024-08-19T00:37:04.369623+0000","last_fullsized":"2024-08-19T00:37:04.369623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365621+0000","last_change":"2024-08-19T00:37:03.382907+0000","last_active":"2024-08-19T00:37:04.365621+0000","last_peered":"2024-08-19T00:37:04.365621+0000","last_clean":"2024-08-19T00:37:04.365621+0000","last_became_active":"2024-08-19T00:37:03.382495+0000","last_became_peered":"2024-08-19T00:37:03.382495+0000","last_unstale":"2024-08-19T00:37:04.365621+0000","last_undegraded":"2024-08-19T00:37:04.365621+0000","last_fullsized":"2024-08-19T00:37:04.365621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464058+0000","last_change":"2024-08-19T00:37:02.357795+0000","last_active":"2024-08-19T00:37:04.464058+0000","last_peered":"2024-08-19T00:37:04.464058+0000","last_clean":"2024-08-19T00:37:04.464058+0000","last_became_active":"2024-08-19T00:37:02.356980+0000","last_became_peered":"2024-08-19T00:37:02.356980+0000","last_unstale":"2024-08-19T00:37:04.464058+0000","last_undegraded":"2024-08-19T00:37:04.464058+0000","last_fullsized":"2024-08-19T00:37:04.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:04.046069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383932+0000","last_change":"2024-08-19T00:37:03.375481+0000","last_active":"2024-08-19T00:37:04.383932+0000","last_peered":"2024-08-19T00:37:04.383932+0000","last_clean":"2024-08-19T00:37:04.383932+0000","last_became_active":"2024-08-19T00:37:03.375032+0000","last_became_peered":"2024-08-19T00:37:03.375032+0000","last_unstale":"2024-08-19T00:37:04.383932+0000","last_undegraded":"2024-08-19T00:37:04.383932+0000","last_fullsized":"2024-08-19T00:37:04.383932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369528+0000","last_change":"2024-08-19T00:37:02.353428+0000","last_active":"2024-08-19T00:37:04.369528+0000","last_peered":"2024-08-19T00:37:04.369528+0000","last_clean":"2024-08-19T00:37:04.369528+0000","last_became_active":"2024-08-19T00:37:02.353106+0000","last_became_peered":"2024-08-19T00:37:02.353106+0000","last_unstale":"2024-08-19T00:37:04.369528+0000","last_undegraded":"2024-08-19T00:37:04.369528+0000","last_fullsized":"2024-08-19T00:37:04.369528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463960+0000","last_change":"2024-08-19T00:37:03.381565+0000","last_active":"2024-08-19T00:37:04.463960+0000","last_peered":"2024-08-19T00:37:04.463960+0000","last_clean":"2024-08-19T00:37:04.463960+0000","last_became_active":"2024-08-19T00:37:03.381351+0000","last_became_peered":"2024-08-19T00:37:03.381351+0000","last_unstale":"2024-08-19T00:37:04.463960+0000","last_undegraded":"2024-08-19T00:37:04.463960+0000","last_fullsized":"2024-08-19T00:37:04.463960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365506+0000","last_change":"2024-08-19T00:37:02.361424+0000","last_active":"2024-08-19T00:37:04.365506+0000","last_peered":"2024-08-19T00:37:04.365506+0000","last_clean":"2024-08-19T00:37:04.365506+0000","last_became_active":"2024-08-19T00:37:02.353015+0000","last_became_peered":"2024-08-19T00:37:02.353015+0000","last_unstale":"2024-08-19T00:37:04.365506+0000","last_undegraded":"2024-08-19T00:37:04.365506+0000","last_fullsized":"2024-08-19T00:37:04.365506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:29.508786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365319+0000","last_change":"2024-08-19T00:37:03.377594+0000","last_active":"2024-08-19T00:37:04.365319+0000","last_peered":"2024-08-19T00:37:04.365319+0000","last_clean":"2024-08-19T00:37:04.365319+0000","last_became_active":"2024-08-19T00:37:03.377315+0000","last_became_peered":"2024-08-19T00:37:03.377315+0000","last_unstale":"2024-08-19T00:37:04.365319+0000","last_undegraded":"2024-08-19T00:37:04.365319+0000","last_fullsized":"2024-08-19T00:37:04.365319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:09:14.167938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383994+0000","last_change":"2024-08-19T00:37:02.369821+0000","last_active":"2024-08-19T00:37:04.383994+0000","last_peered":"2024-08-19T00:37:04.383994+0000","last_clean":"2024-08-19T00:37:04.383994+0000","last_became_active":"2024-08-19T00:37:02.369542+0000","last_became_peered":"2024-08-19T00:37:02.369542+0000","last_unstale":"2024-08-19T00:37:04.383994+0000","last_undegraded":"2024-08-19T00:37:04.383994+0000","last_fullsized":"2024-08-19T00:37:04.383994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463395+0000","last_change":"2024-08-19T00:37:03.386039+0000","last_active":"2024-08-19T00:37:04.463395+0000","last_peered":"2024-08-19T00:37:04.463395+0000","last_clean":"2024-08-19T00:37:04.463395+0000","last_became_active":"2024-08-19T00:37:03.385346+0000","last_became_peered":"2024-08-19T00:37:03.385346+0000","last_unstale":"2024-08-19T00:37:04.463395+0000","last_undegraded":"2024-08-19T00:37:04.463395+0000","last_fullsized":"2024-08-19T00:37:04.463395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380539+0000","last_change":"2024-08-19T00:37:02.355538+0000","last_active":"2024-08-19T00:37:04.380539+0000","last_peered":"2024-08-19T00:37:04.380539+0000","last_clean":"2024-08-19T00:37:04.380539+0000","last_became_active":"2024-08-19T00:37:02.355257+0000","last_became_peered":"2024-08-19T00:37:02.355257+0000","last_unstale":"2024-08-19T00:37:04.380539+0000","last_undegraded":"2024-08-19T00:37:04.380539+0000","last_fullsized":"2024-08-19T00:37:04.380539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365142+0000","last_change":"2024-08-19T00:37:03.382874+0000","last_active":"2024-08-19T00:37:04.365142+0000","last_peered":"2024-08-19T00:37:04.365142+0000","last_clean":"2024-08-19T00:37:04.365142+0000","last_became_active":"2024-08-19T00:37:03.382547+0000","last_became_peered":"2024-08-19T00:37:03.382547+0000","last_unstale":"2024-08-19T00:37:04.365142+0000","last_undegraded":"2024-08-19T00:37:04.365142+0000","last_fullsized":"2024-08-19T00:37:04.365142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384268+0000","last_change":"2024-08-19T00:37:02.369846+0000","last_active":"2024-08-19T00:37:04.384268+0000","last_peered":"2024-08-19T00:37:04.384268+0000","last_clean":"2024-08-19T00:37:04.384268+0000","last_became_active":"2024-08-19T00:37:02.369565+0000","last_became_peered":"2024-08-19T00:37:02.369565+0000","last_unstale":"2024-08-19T00:37:04.384268+0000","last_undegraded":"2024-08-19T00:37:04.384268+0000","last_fullsized":"2024-08-19T00:37:04.384268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464558+0000","last_change":"2024-08-19T00:37:03.360371+0000","last_active":"2024-08-19T00:37:04.464558+0000","last_peered":"2024-08-19T00:37:04.464558+0000","last_clean":"2024-08-19T00:37:04.464558+0000","last_became_active":"2024-08-19T00:37:03.360065+0000","last_became_peered":"2024-08-19T00:37:03.360065+0000","last_unstale":"2024-08-19T00:37:04.464558+0000","last_undegraded":"2024-08-19T00:37:04.464558+0000","last_fullsized":"2024-08-19T00:37:04.464558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380861+0000","last_change":"2024-08-19T00:37:02.364244+0000","last_active":"2024-08-19T00:37:04.380861+0000","last_peered":"2024-08-19T00:37:04.380861+0000","last_clean":"2024-08-19T00:37:04.380861+0000","last_became_active":"2024-08-19T00:37:02.363965+0000","last_became_peered":"2024-08-19T00:37:02.363965+0000","last_unstale":"2024-08-19T00:37:04.380861+0000","last_undegraded":"2024-08-19T00:37:04.380861+0000","last_fullsized":"2024-08-19T00:37:04.380861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384061+0000","last_change":"2024-08-19T00:37:03.382232+0000","last_active":"2024-08-19T00:37:04.384061+0000","last_peered":"2024-08-19T00:37:04.384061+0000","last_clean":"2024-08-19T00:37:04.384061+0000","last_became_active":"2024-08-19T00:37:03.378909+0000","last_became_peered":"2024-08-19T00:37:03.378909+0000","last_unstale":"2024-08-19T00:37:04.384061+0000","last_undegraded":"2024-08-19T00:37:04.384061+0000","last_fullsized":"2024-08-19T00:37:04.384061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368532+0000","last_change":"2024-08-19T00:37:02.366925+0000","last_active":"2024-08-19T00:37:04.368532+0000","last_peered":"2024-08-19T00:37:04.368532+0000","last_clean":"2024-08-19T00:37:04.368532+0000","last_became_active":"2024-08-19T00:37:02.366544+0000","last_became_peered":"2024-08-19T00:37:02.366544+0000","last_unstale":"2024-08-19T00:37:04.368532+0000","last_undegraded":"2024-08-19T00:37:04.368532+0000","last_fullsized":"2024-08-19T00:37:04.368532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384116+0000","last_change":"2024-08-19T00:37:03.382037+0000","last_active":"2024-08-19T00:37:04.384116+0000","last_peered":"2024-08-19T00:37:04.384116+0000","last_clean":"2024-08-19T00:37:04.384116+0000","last_became_active":"2024-08-19T00:37:03.380743+0000","last_became_peered":"2024-08-19T00:37:03.380743+0000","last_unstale":"2024-08-19T00:37:04.384116+0000","last_undegraded":"2024-08-19T00:37:04.384116+0000","last_fullsized":"2024-08-19T00:37:04.384116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464286+0000","last_change":"2024-08-19T00:37:02.355452+0000","last_active":"2024-08-19T00:37:04.464286+0000","last_peered":"2024-08-19T00:37:04.464286+0000","last_clean":"2024-08-19T00:37:04.464286+0000","last_became_active":"2024-08-19T00:37:02.355062+0000","last_became_peered":"2024-08-19T00:37:02.355062+0000","last_unstale":"2024-08-19T00:37:04.464286+0000","last_undegraded":"2024-08-19T00:37:04.464286+0000","last_fullsized":"2024-08-19T00:37:04.464286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365642+0000","last_change":"2024-08-19T00:37:03.372275+0000","last_active":"2024-08-19T00:37:04.365642+0000","last_peered":"2024-08-19T00:37:04.365642+0000","last_clean":"2024-08-19T00:37:04.365642+0000","last_became_active":"2024-08-19T00:37:03.371952+0000","last_became_peered":"2024-08-19T00:37:03.371952+0000","last_unstale":"2024-08-19T00:37:04.365642+0000","last_undegraded":"2024-08-19T00:37:04.365642+0000","last_fullsized":"2024-08-19T00:37:04.365642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:50.890499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463384+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:37:04.463384+0000","last_peered":"2024-08-19T00:37:04.463384+0000","last_clean":"2024-08-19T00:37:04.463384+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:37:04.463384+0000","last_undegraded":"2024-08-19T00:37:04.463384+0000","last_fullsized":"2024-08-19T00:37:04.463384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365641+0000","last_change":"2024-08-19T00:37:02.355271+0000","last_active":"2024-08-19T00:37:04.365641+0000","last_peered":"2024-08-19T00:37:04.365641+0000","last_clean":"2024-08-19T00:37:04.365641+0000","last_became_active":"2024-08-19T00:37:02.354947+0000","last_became_peered":"2024-08-19T00:37:02.354947+0000","last_unstale":"2024-08-19T00:37:04.365641+0000","last_undegraded":"2024-08-19T00:37:04.365641+0000","last_fullsized":"2024-08-19T00:37:04.365641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:08.443729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380800+0000","last_change":"2024-08-19T00:37:03.363302+0000","last_active":"2024-08-19T00:37:04.380800+0000","last_peered":"2024-08-19T00:37:04.380800+0000","last_clean":"2024-08-19T00:37:04.380800+0000","last_became_active":"2024-08-19T00:37:03.362961+0000","last_became_peered":"2024-08-19T00:37:03.362961+0000","last_unstale":"2024-08-19T00:37:04.380800+0000","last_undegraded":"2024-08-19T00:37:04.380800+0000","last_fullsized":"2024-08-19T00:37:04.380800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365095+0000","last_change":"2024-08-19T00:37:02.369181+0000","last_active":"2024-08-19T00:37:04.365095+0000","last_peered":"2024-08-19T00:37:04.365095+0000","last_clean":"2024-08-19T00:37:04.365095+0000","last_became_active":"2024-08-19T00:37:02.368734+0000","last_became_peered":"2024-08-19T00:37:02.368734+0000","last_unstale":"2024-08-19T00:37:04.365095+0000","last_undegraded":"2024-08-19T00:37:04.365095+0000","last_fullsized":"2024-08-19T00:37:04.365095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464050+0000","last_change":"2024-08-19T00:37:03.376231+0000","last_active":"2024-08-19T00:37:04.464050+0000","last_peered":"2024-08-19T00:37:04.464050+0000","last_clean":"2024-08-19T00:37:04.464050+0000","last_became_active":"2024-08-19T00:37:03.375969+0000","last_became_peered":"2024-08-19T00:37:03.375969+0000","last_unstale":"2024-08-19T00:37:04.464050+0000","last_undegraded":"2024-08-19T00:37:04.464050+0000","last_fullsized":"2024-08-19T00:37:04.464050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369377+0000","last_change":"2024-08-19T00:37:02.364004+0000","last_active":"2024-08-19T00:37:04.369377+0000","last_peered":"2024-08-19T00:37:04.369377+0000","last_clean":"2024-08-19T00:37:04.369377+0000","last_became_active":"2024-08-19T00:37:02.363712+0000","last_became_peered":"2024-08-19T00:37:02.363712+0000","last_unstale":"2024-08-19T00:37:04.369377+0000","last_undegraded":"2024-08-19T00:37:04.369377+0000","last_fullsized":"2024-08-19T00:37:04.369377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368210+0000","last_change":"2024-08-19T00:37:03.383128+0000","last_active":"2024-08-19T00:37:04.368210+0000","last_peered":"2024-08-19T00:37:04.368210+0000","last_clean":"2024-08-19T00:37:04.368210+0000","last_became_active":"2024-08-19T00:37:03.380518+0000","last_became_peered":"2024-08-19T00:37:03.380518+0000","last_unstale":"2024-08-19T00:37:04.368210+0000","last_undegraded":"2024-08-19T00:37:04.368210+0000","last_fullsized":"2024-08-19T00:37:04.368210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365629+0000","last_change":"2024-08-19T00:37:02.366117+0000","last_active":"2024-08-19T00:37:04.365629+0000","last_peered":"2024-08-19T00:37:04.365629+0000","last_clean":"2024-08-19T00:37:04.365629+0000","last_became_active":"2024-08-19T00:37:02.365766+0000","last_became_peered":"2024-08-19T00:37:02.365766+0000","last_unstale":"2024-08-19T00:37:04.365629+0000","last_undegraded":"2024-08-19T00:37:04.365629+0000","last_fullsized":"2024-08-19T00:37:04.365629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:49.690337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383742+0000","last_change":"2024-08-19T00:37:03.367877+0000","last_active":"2024-08-19T00:37:04.383742+0000","last_peered":"2024-08-19T00:37:04.383742+0000","last_clean":"2024-08-19T00:37:04.383742+0000","last_became_active":"2024-08-19T00:37:03.367527+0000","last_became_peered":"2024-08-19T00:37:03.367527+0000","last_unstale":"2024-08-19T00:37:04.383742+0000","last_undegraded":"2024-08-19T00:37:04.383742+0000","last_fullsized":"2024-08-19T00:37:04.383742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368455+0000","last_change":"2024-08-19T00:37:02.369028+0000","last_active":"2024-08-19T00:37:04.368455+0000","last_peered":"2024-08-19T00:37:04.368455+0000","last_clean":"2024-08-19T00:37:04.368455+0000","last_became_active":"2024-08-19T00:37:02.368699+0000","last_became_peered":"2024-08-19T00:37:02.368699+0000","last_unstale":"2024-08-19T00:37:04.368455+0000","last_undegraded":"2024-08-19T00:37:04.368455+0000","last_fullsized":"2024-08-19T00:37:04.368455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464137+0000","last_change":"2024-08-19T00:37:03.368305+0000","last_active":"2024-08-19T00:37:04.464137+0000","last_peered":"2024-08-19T00:37:04.464137+0000","last_clean":"2024-08-19T00:37:04.464137+0000","last_became_active":"2024-08-19T00:37:03.366016+0000","last_became_peered":"2024-08-19T00:37:03.366016+0000","last_unstale":"2024-08-19T00:37:04.464137+0000","last_undegraded":"2024-08-19T00:37:04.464137+0000","last_fullsized":"2024-08-19T00:37:04.464137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365779+0000","last_change":"2024-08-19T00:37:02.359697+0000","last_active":"2024-08-19T00:37:04.365779+0000","last_peered":"2024-08-19T00:37:04.365779+0000","last_clean":"2024-08-19T00:37:04.365779+0000","last_became_active":"2024-08-19T00:37:02.358966+0000","last_became_peered":"2024-08-19T00:37:02.358966+0000","last_unstale":"2024-08-19T00:37:04.365779+0000","last_undegraded":"2024-08-19T00:37:04.365779+0000","last_fullsized":"2024-08-19T00:37:04.365779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:58.297710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464195+0000","last_change":"2024-08-19T00:37:03.380507+0000","last_active":"2024-08-19T00:37:04.464195+0000","last_peered":"2024-08-19T00:37:04.464195+0000","last_clean":"2024-08-19T00:37:04.464195+0000","last_became_active":"2024-08-19T00:37:03.378035+0000","last_became_peered":"2024-08-19T00:37:03.378035+0000","last_unstale":"2024-08-19T00:37:04.464195+0000","last_undegraded":"2024-08-19T00:37:04.464195+0000","last_fullsized":"2024-08-19T00:37:04.464195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383088+0000","last_change":"2024-08-19T00:37:02.368422+0000","last_active":"2024-08-19T00:37:04.383088+0000","last_peered":"2024-08-19T00:37:04.383088+0000","last_clean":"2024-08-19T00:37:04.383088+0000","last_became_active":"2024-08-19T00:37:02.368123+0000","last_became_peered":"2024-08-19T00:37:02.368123+0000","last_unstale":"2024-08-19T00:37:04.383088+0000","last_undegraded":"2024-08-19T00:37:04.383088+0000","last_fullsized":"2024-08-19T00:37:04.383088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380949+0000","last_change":"2024-08-19T00:37:03.369753+0000","last_active":"2024-08-19T00:37:04.380949+0000","last_peered":"2024-08-19T00:37:04.380949+0000","last_clean":"2024-08-19T00:37:04.380949+0000","last_became_active":"2024-08-19T00:37:03.369412+0000","last_became_peered":"2024-08-19T00:37:03.369412+0000","last_unstale":"2024-08-19T00:37:04.380949+0000","last_undegraded":"2024-08-19T00:37:04.380949+0000","last_fullsized":"2024-08-19T00:37:04.380949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366071+0000","last_change":"2024-08-19T00:37:02.356963+0000","last_active":"2024-08-19T00:37:04.366071+0000","last_peered":"2024-08-19T00:37:04.366071+0000","last_clean":"2024-08-19T00:37:04.366071+0000","last_became_active":"2024-08-19T00:37:02.356715+0000","last_became_peered":"2024-08-19T00:37:02.356715+0000","last_unstale":"2024-08-19T00:37:04.366071+0000","last_undegraded":"2024-08-19T00:37:04.366071+0000","last_fullsized":"2024-08-19T00:37:04.366071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:01.604784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380767+0000","last_change":"2024-08-19T00:37:03.366561+0000","last_active":"2024-08-19T00:37:04.380767+0000","last_peered":"2024-08-19T00:37:04.380767+0000","last_clean":"2024-08-19T00:37:04.380767+0000","last_became_active":"2024-08-19T00:37:03.365866+0000","last_became_peered":"2024-08-19T00:37:03.365866+0000","last_unstale":"2024-08-19T00:37:04.380767+0000","last_undegraded":"2024-08-19T00:37:04.380767+0000","last_fullsized":"2024-08-19T00:37:04.380767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383431+0000","last_change":"2024-08-19T00:37:02.358382+0000","last_active":"2024-08-19T00:37:04.383431+0000","last_peered":"2024-08-19T00:37:04.383431+0000","last_clean":"2024-08-19T00:37:04.383431+0000","last_became_active":"2024-08-19T00:37:02.358084+0000","last_became_peered":"2024-08-19T00:37:02.358084+0000","last_unstale":"2024-08-19T00:37:04.383431+0000","last_undegraded":"2024-08-19T00:37:04.383431+0000","last_fullsized":"2024-08-19T00:37:04.383431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365165+0000","last_change":"2024-08-19T00:37:03.372382+0000","last_active":"2024-08-19T00:37:04.365165+0000","last_peered":"2024-08-19T00:37:04.365165+0000","last_clean":"2024-08-19T00:37:04.365165+0000","last_became_active":"2024-08-19T00:37:03.372117+0000","last_became_peered":"2024-08-19T00:37:03.372117+0000","last_unstale":"2024-08-19T00:37:04.365165+0000","last_undegraded":"2024-08-19T00:37:04.365165+0000","last_fullsized":"2024-08-19T00:37:04.365165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380693+0000","last_change":"2024-08-19T00:37:02.372086+0000","last_active":"2024-08-19T00:37:04.380693+0000","last_peered":"2024-08-19T00:37:04.380693+0000","last_clean":"2024-08-19T00:37:04.380693+0000","last_became_active":"2024-08-19T00:37:02.371740+0000","last_became_peered":"2024-08-19T00:37:02.371740+0000","last_unstale":"2024-08-19T00:37:04.380693+0000","last_undegraded":"2024-08-19T00:37:04.380693+0000","last_fullsized":"2024-08-19T00:37:04.380693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380570+0000","last_change":"2024-08-19T00:37:03.375284+0000","last_active":"2024-08-19T00:37:04.380570+0000","last_peered":"2024-08-19T00:37:04.380570+0000","last_clean":"2024-08-19T00:37:04.380570+0000","last_became_active":"2024-08-19T00:37:03.375000+0000","last_became_peered":"2024-08-19T00:37:03.375000+0000","last_unstale":"2024-08-19T00:37:04.380570+0000","last_undegraded":"2024-08-19T00:37:04.380570+0000","last_fullsized":"2024-08-19T00:37:04.380570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464135+0000","last_change":"2024-08-19T00:37:02.364047+0000","last_active":"2024-08-19T00:37:04.464135+0000","last_peered":"2024-08-19T00:37:04.464135+0000","last_clean":"2024-08-19T00:37:04.464135+0000","last_became_active":"2024-08-19T00:37:02.363698+0000","last_became_peered":"2024-08-19T00:37:02.363698+0000","last_unstale":"2024-08-19T00:37:04.464135+0000","last_undegraded":"2024-08-19T00:37:04.464135+0000","last_fullsized":"2024-08-19T00:37:04.464135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369502+0000","last_change":"2024-08-19T00:37:03.374146+0000","last_active":"2024-08-19T00:37:04.369502+0000","last_peered":"2024-08-19T00:37:04.369502+0000","last_clean":"2024-08-19T00:37:04.369502+0000","last_became_active":"2024-08-19T00:37:03.373834+0000","last_became_peered":"2024-08-19T00:37:03.373834+0000","last_unstale":"2024-08-19T00:37:04.369502+0000","last_undegraded":"2024-08-19T00:37:04.369502+0000","last_fullsized":"2024-08-19T00:37:04.369502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365432+0000","last_change":"2024-08-19T00:37:02.349640+0000","last_active":"2024-08-19T00:37:04.365432+0000","last_peered":"2024-08-19T00:37:04.365432+0000","last_clean":"2024-08-19T00:37:04.365432+0000","last_became_active":"2024-08-19T00:37:02.349269+0000","last_became_peered":"2024-08-19T00:37:02.349269+0000","last_unstale":"2024-08-19T00:37:04.365432+0000","last_undegraded":"2024-08-19T00:37:04.365432+0000","last_fullsized":"2024-08-19T00:37:04.365432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365608+0000","last_change":"2024-08-19T00:37:03.380432+0000","last_active":"2024-08-19T00:37:04.365608+0000","last_peered":"2024-08-19T00:37:04.365608+0000","last_clean":"2024-08-19T00:37:04.365608+0000","last_became_active":"2024-08-19T00:37:03.379670+0000","last_became_peered":"2024-08-19T00:37:03.379670+0000","last_unstale":"2024-08-19T00:37:04.365608+0000","last_undegraded":"2024-08-19T00:37:04.365608+0000","last_fullsized":"2024-08-19T00:37:04.365608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:11.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365705+0000","last_change":"2024-08-19T00:37:03.381062+0000","last_active":"2024-08-19T00:37:04.365705+0000","last_peered":"2024-08-19T00:37:04.365705+0000","last_clean":"2024-08-19T00:37:04.365705+0000","last_became_active":"2024-08-19T00:37:03.380753+0000","last_became_peered":"2024-08-19T00:37:03.380753+0000","last_unstale":"2024-08-19T00:37:04.365705+0000","last_undegraded":"2024-08-19T00:37:04.365705+0000","last_fullsized":"2024-08-19T00:37:04.365705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:37.265520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384192+0000","last_change":"2024-08-19T00:37:02.367985+0000","last_active":"2024-08-19T00:37:04.384192+0000","last_peered":"2024-08-19T00:37:04.384192+0000","last_clean":"2024-08-19T00:37:04.384192+0000","last_became_active":"2024-08-19T00:37:02.367333+0000","last_became_peered":"2024-08-19T00:37:02.367333+0000","last_unstale":"2024-08-19T00:37:04.384192+0000","last_undegraded":"2024-08-19T00:37:04.384192+0000","last_fullsized":"2024-08-19T00:37:04.384192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463676+0000","last_change":"2024-08-19T00:37:03.387814+0000","last_active":"2024-08-19T00:37:04.463676+0000","last_peered":"2024-08-19T00:37:04.463676+0000","last_clean":"2024-08-19T00:37:04.463676+0000","last_became_active":"2024-08-19T00:37:03.386581+0000","last_became_peered":"2024-08-19T00:37:03.386581+0000","last_unstale":"2024-08-19T00:37:04.463676+0000","last_undegraded":"2024-08-19T00:37:04.463676+0000","last_fullsized":"2024-08-19T00:37:04.463676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384048+0000","last_change":"2024-08-19T00:37:02.370717+0000","last_active":"2024-08-19T00:37:04.384048+0000","last_peered":"2024-08-19T00:37:04.384048+0000","last_clean":"2024-08-19T00:37:04.384048+0000","last_became_active":"2024-08-19T00:37:02.368335+0000","last_became_peered":"2024-08-19T00:37:02.368335+0000","last_unstale":"2024-08-19T00:37:04.384048+0000","last_undegraded":"2024-08-19T00:37:04.384048+0000","last_fullsized":"2024-08-19T00:37:04.384048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368865+0000","last_change":"2024-08-19T00:37:03.383908+0000","last_active":"2024-08-19T00:37:04.368865+0000","last_peered":"2024-08-19T00:37:04.368865+0000","last_clean":"2024-08-19T00:37:04.368865+0000","last_became_active":"2024-08-19T00:37:03.383512+0000","last_became_peered":"2024-08-19T00:37:03.383512+0000","last_unstale":"2024-08-19T00:37:04.368865+0000","last_undegraded":"2024-08-19T00:37:04.368865+0000","last_fullsized":"2024-08-19T00:37:04.368865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368814+0000","last_change":"2024-08-19T00:37:02.366055+0000","last_active":"2024-08-19T00:37:04.368814+0000","last_peered":"2024-08-19T00:37:04.368814+0000","last_clean":"2024-08-19T00:37:04.368814+0000","last_became_active":"2024-08-19T00:37:02.365758+0000","last_became_peered":"2024-08-19T00:37:02.365758+0000","last_unstale":"2024-08-19T00:37:04.368814+0000","last_undegraded":"2024-08-19T00:37:04.368814+0000","last_fullsized":"2024-08-19T00:37:04.368814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368779+0000","last_change":"2024-08-19T00:37:03.371682+0000","last_active":"2024-08-19T00:37:04.368779+0000","last_peered":"2024-08-19T00:37:04.368779+0000","last_clean":"2024-08-19T00:37:04.368779+0000","last_became_active":"2024-08-19T00:37:03.371418+0000","last_became_peered":"2024-08-19T00:37:03.371418+0000","last_unstale":"2024-08-19T00:37:04.368779+0000","last_undegraded":"2024-08-19T00:37:04.368779+0000","last_fullsized":"2024-08-19T00:37:04.368779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380909+0000","last_change":"2024-08-19T00:37:02.361542+0000","last_active":"2024-08-19T00:37:04.380909+0000","last_peered":"2024-08-19T00:37:04.380909+0000","last_clean":"2024-08-19T00:37:04.380909+0000","last_became_active":"2024-08-19T00:37:02.361229+0000","last_became_peered":"2024-08-19T00:37:02.361229+0000","last_unstale":"2024-08-19T00:37:04.380909+0000","last_undegraded":"2024-08-19T00:37:04.380909+0000","last_fullsized":"2024-08-19T00:37:04.380909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":69429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":77889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":76187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":666043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:37:07.992 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:37:07.992 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-19T00:37:07.992 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-19T00:37:07.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-19T00:37:07.993 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-19T00:37:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.181+0000 7f3972800640 1 Processor -- start 2024-08-19T00:37:08.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.181+0000 7f3972800640 1 -- start start 2024-08-19T00:37:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3972800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f396c06d600 0x7f396c06da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3972800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f396c15cca0 0x7f396c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3972800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f396c073140 con 0x7f396c15bd70 2024-08-19T00:37:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3972800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f396c06df90 con 0x7f396c15cca0 2024-08-19T00:37:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3972800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f396c0733f0 con 0x7f396c06d600 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3971e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f396c15cca0 0x7f396c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3971e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f396c15cca0 0x7f396c15d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35274/0 (socket says 172.21.15.7:35274) 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.182+0000 7f3971e00640 1 -- 172.21.15.7:0/3924640601 learned_addr learned my addr 172.21.15.7:0/3924640601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.183+0000 7f3970a00640 1 --2- 172.21.15.7:0/3924640601 >> v2:172.21.15.162:3300/0 conn(0x7f396c06d600 0x7f396c06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.183+0000 7f3971e00640 1 -- 172.21.15.7:0/3924640601 >> v2:172.21.15.162:3300/0 conn(0x7f396c06d600 msgr2=0x7f396c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.183+0000 7f3971e00640 1 --2- 172.21.15.7:0/3924640601 >> v2:172.21.15.162:3300/0 conn(0x7f396c06d600 0x7f396c06da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.183+0000 7f3971e00640 1 -- 172.21.15.7:0/3924640601 >> v1:172.21.15.162:6789/0 conn(0x7f396c15bd70 legacy=0x7f396c072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.183+0000 7f3971e00640 1 -- 172.21.15.7:0/3924640601 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c0736d0 con 0x7f396c15cca0 2024-08-19T00:37:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.184+0000 7f3971e00640 1 --2- 172.21.15.7:0/3924640601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c15cca0 0x7f396c15d110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f396c06e8a0 tx=0x7f396402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c9f8078e4f4dd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.184+0000 7f396be00640 1 -- 172.21.15.7:0/3924640601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964036070 con 0x7f396c15cca0 2024-08-19T00:37:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.184+0000 7f396be00640 1 -- 172.21.15.7:0/3924640601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964031600 con 0x7f396c15cca0 2024-08-19T00:37:08.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.184+0000 7f396be00640 1 -- 172.21.15.7:0/3924640601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39640319d0 con 0x7f396c15cca0 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.184+0000 7f3972800640 1 -- 172.21.15.7:0/3924640601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c15cca0 msgr2=0x7f396c15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.184+0000 7f3972800640 1 --2- 172.21.15.7:0/3924640601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c15cca0 0x7f396c15d110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f396c06e8a0 tx=0x7f396402a6f0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.185+0000 7f3972800640 1 -- 172.21.15.7:0/3924640601 shutdown_connections 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.185+0000 7f3972800640 1 --2- 172.21.15.7:0/3924640601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c15cca0 0x7f396c15d110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.185+0000 7f3972800640 1 --2- 172.21.15.7:0/3924640601 >> v2:172.21.15.162:3300/0 conn(0x7f396c06d600 0x7f396c06da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.185+0000 7f3972800640 1 -- 172.21.15.7:0/3924640601 >> 172.21.15.7:0/3924640601 conn(0x7f396c06b850 msgr2=0x7f396c06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.185+0000 7f3972800640 1 -- 172.21.15.7:0/3924640601 shutdown_connections 2024-08-19T00:37:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.185+0000 7f3972800640 1 -- 172.21.15.7:0/3924640601 wait complete. 2024-08-19T00:37:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.186+0000 7f3972800640 1 Processor -- start 2024-08-19T00:37:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.186+0000 7f3972800640 1 -- start start 2024-08-19T00:37:08.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.187+0000 7f3972800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c06d600 0x7f396c1f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.187+0000 7f3972800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c15bd70 0x7f396c13d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.187+0000 7f3972800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c15cca0 0x7f396c1e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.187+0000 7f3972800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f396c15c780 con 0x7f396c06d600 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.187+0000 7f3972800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f396c15c4a0 con 0x7f396c15bd70 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.187+0000 7f3972800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f396c15c150 con 0x7f396c15cca0 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.187+0000 7f3971400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c06d600 0x7f396c1f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c06d600 0x7f396c1f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35286/0 (socket says 172.21.15.7:35286) 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 -- 172.21.15.7:0/3283666976 learned_addr learned my addr 172.21.15.7:0/3283666976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971e00640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c15cca0 0x7f396c1e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3970a00640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c15bd70 0x7f396c13d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 -- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c15cca0 msgr2=0x7f396c1e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c15cca0 0x7f396c1e63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 -- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c15bd70 msgr2=0x7f396c13d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c15bd70 0x7f396c13d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 -- 172.21.15.7:0/3283666976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c13d630 con 0x7f396c06d600 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3971400640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c06d600 0x7f396c1f2730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f396000c430 tx=0x7f396000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.188+0000 7f3969600640 1 -- 172.21.15.7:0/3283666976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960011790 con 0x7f396c06d600 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.189+0000 7f3969600640 1 -- 172.21.15.7:0/3283666976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960017070 con 0x7f396c06d600 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.189+0000 7f3969600640 1 -- 172.21.15.7:0/3283666976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960011b70 con 0x7f396c06d600 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.189+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c13ff90 con 0x7f396c06d600 2024-08-19T00:37:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.189+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c140550 con 0x7f396c06d600 2024-08-19T00:37:08.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.190+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c15b8b0 con 0x7f396c06d600 2024-08-19T00:37:08.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.191+0000 7f3969600640 1 -- 172.21.15.7:0/3283666976 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3960011d10 con 0x7f396c06d600 2024-08-19T00:37:08.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.192+0000 7f3969600640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.192+0000 7f3969600640 1 -- 172.21.15.7:0/3283666976 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f396008ac60 con 0x7f396c06d600 2024-08-19T00:37:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.192+0000 7f3970a00640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.192+0000 7f3970a00640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f396c152640 tx=0x7f3958008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.196+0000 7f3969600640 1 -- 172.21.15.7:0/3283666976 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3960058f20 con 0x7f396c06d600 2024-08-19T00:37:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.430+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f396c06e3a0 con 0x7f396c06d600 2024-08-19T00:37:08.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.433+0000 7f3969600640 1 -- 172.21.15.7:0/3283666976 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172929 (secure 0 0 0) 0x7f396005d220 con 0x7f396c06d600 2024-08-19T00:37:08.439 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 msgr2=0x7f394c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f396c152640 tx=0x7f3958008040 comp rx=0 tx=0).stop 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c06d600 msgr2=0x7f396c1f2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c06d600 0x7f396c1f2730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f396000c430 tx=0x7f396000c8f0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 shutdown_connections 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c15cca0 0x7f396c1e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c15bd70 0x7f396c13d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 --2- 172.21.15.7:0/3283666976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f396c06d600 0x7f396c1f2730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 >> 172.21.15.7:0/3283666976 conn(0x7f396c06b850 msgr2=0x7f396c15a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.436+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 shutdown_connections 2024-08-19T00:37:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.437+0000 7f3972800640 1 -- 172.21.15.7:0/3283666976 wait complete. 2024-08-19T00:37:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":502797190},{"type":"v1","addr":"172.21.15.7:6833","nonce":502797190}]},"active_addr":"172.21.15.7:6833/502797190","active_change":"2024-08-19T00:36:43.241555+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2667756912}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1373997779}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1376568589}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1280039841}]}]} 2024-08-19T00:37:08.458 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-19T00:37:08.458 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-19T00:37:08.458 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.613+0000 7fcff3200640 1 Processor -- start 2024-08-19T00:37:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.613+0000 7fcff3200640 1 -- start start 2024-08-19T00:37:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e360 0x7fcff415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcff40d2af0 0x7fcff40d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff40b3ab0 con 0x7fcff415e740 2024-08-19T00:37:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff3200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcff40d3490 con 0x7fcff40d2af0 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcff415f460 con 0x7fcff415e360 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff1400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcff40d2af0 0x7fcff40d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff1400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcff40d2af0 0x7fcff40d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35296/0 (socket says 172.21.15.7:35296) 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff1400640 1 -- 172.21.15.7:0/2727157619 learned_addr learned my addr 172.21.15.7:0/2727157619 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.614+0000 7fcff1e00640 1 --2- 172.21.15.7:0/2727157619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e360 0x7fcff415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.615+0000 7fcff1400640 1 -- 172.21.15.7:0/2727157619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e360 msgr2=0x7fcff415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.615+0000 7fcff1400640 1 --2- 172.21.15.7:0/2727157619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e360 0x7fcff415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.615+0000 7fcff1400640 1 -- 172.21.15.7:0/2727157619 >> v1:172.21.15.162:6789/0 conn(0x7fcff415e740 legacy=0x7fcff415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.615+0000 7fcff1400640 1 -- 172.21.15.7:0/2727157619 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff415f740 con 0x7fcff40d2af0 2024-08-19T00:37:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.616+0000 7fcff1400640 1 --2- 172.21.15.7:0/2727157619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff40d2f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009870 tx=0x7fcfe002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27b78dea690938 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.616+0000 7fcff0a00640 1 -- 172.21.15.7:0/2727157619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0037070 con 0x7fcff40d2af0 2024-08-19T00:37:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.616+0000 7fcff0a00640 1 -- 172.21.15.7:0/2727157619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe0032440 con 0x7fcff40d2af0 2024-08-19T00:37:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.616+0000 7fcff0a00640 1 -- 172.21.15.7:0/2727157619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0032810 con 0x7fcff40d2af0 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 -- 172.21.15.7:0/2727157619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 msgr2=0x7fcff40d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 --2- 172.21.15.7:0/2727157619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff40d2f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009870 tx=0x7fcfe002a270 comp rx=0 tx=0).stop 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 -- 172.21.15.7:0/2727157619 shutdown_connections 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 --2- 172.21.15.7:0/2727157619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff40d2f50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 --2- 172.21.15.7:0/2727157619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e360 0x7fcff415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 -- 172.21.15.7:0/2727157619 >> 172.21.15.7:0/2727157619 conn(0x7fcff408dbf0 msgr2=0x7fcff409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 -- 172.21.15.7:0/2727157619 shutdown_connections 2024-08-19T00:37:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.617+0000 7fcff3200640 1 -- 172.21.15.7:0/2727157619 wait complete. 2024-08-19T00:37:08.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.618+0000 7fcff3200640 1 Processor -- start 2024-08-19T00:37:08.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.619+0000 7fcff3200640 1 -- start start 2024-08-19T00:37:08.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.619+0000 7fcff3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff4156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.619+0000 7fcff3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcff415e360 0x7fcff406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.619+0000 7fcff3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e740 0x7fcff406db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.619+0000 7fcff3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcff40d2300 con 0x7fcff40d2af0 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.619+0000 7fcff3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcff40b4040 con 0x7fcff415e360 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcff40b4560 con 0x7fcff415e740 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff4156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35302/0 (socket says 172.21.15.7:35302) 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 -- 172.21.15.7:0/137175719 learned_addr learned my addr 172.21.15.7:0/137175719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff2800640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e740 0x7fcff406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1400640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcff415e360 0x7fcff406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 -- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e740 msgr2=0x7fcff406db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e740 0x7fcff406db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 -- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcff415e360 msgr2=0x7fcff406d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcff415e360 0x7fcff406d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 -- 172.21.15.7:0/137175719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff4156e90 con 0x7fcff40d2af0 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1400640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcff415e360 0x7fcff406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff2800640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e740 0x7fcff406db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.620+0000 7fcff1e00640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff4156950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400e9e0 tx=0x7fcfe400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.621+0000 7fcfea000640 1 -- 172.21.15.7:0/137175719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4017070 con 0x7fcff40d2af0 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.621+0000 7fcfea000640 1 -- 172.21.15.7:0/137175719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe400c9d0 con 0x7fcff40d2af0 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.621+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff40c8fb0 con 0x7fcff40d2af0 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.621+0000 7fcfea000640 1 -- 172.21.15.7:0/137175719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400cdc0 con 0x7fcff40d2af0 2024-08-19T00:37:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.621+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff40c9570 con 0x7fcff40d2af0 2024-08-19T00:37:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.622+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff40d2f50 con 0x7fcff40d2af0 2024-08-19T00:37:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.623+0000 7fcfea000640 1 -- 172.21.15.7:0/137175719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfe401a070 con 0x7fcff40d2af0 2024-08-19T00:37:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.624+0000 7fcfea000640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcfd406be60 0x7fcfd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.624+0000 7fcfea000640 1 -- 172.21.15.7:0/137175719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcfe408aef0 con 0x7fcff40d2af0 2024-08-19T00:37:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.624+0000 7fcff1400640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcfd406be60 0x7fcfd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.625+0000 7fcff1400640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcfd406be60 0x7fcfd406e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034000 tx=0x7fcfe002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.628+0000 7fcfea000640 1 -- 172.21.15.7:0/137175719 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcfe4059800 con 0x7fcff40d2af0 2024-08-19T00:37:08.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.814+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcff40d50d0 con 0x7fcff40d2af0 2024-08-19T00:37:08.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.816+0000 7fcfea000640 1 -- 172.21.15.7:0/137175719 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16573 (secure 0 0 0) 0x7fcfe4059100 con 0x7fcff40d2af0 2024-08-19T00:37:08.819 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:08.819 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:04.356113+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:08.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcfd406be60 msgr2=0x7fcfd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcfd406be60 0x7fcfd406e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034000 tx=0x7fcfe002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:08.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 msgr2=0x7fcff4156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff4156950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400e9e0 tx=0x7fcfe400eea0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 shutdown_connections 2024-08-19T00:37:08.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcfd406be60 0x7fcfd406e320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcff415e740 0x7fcff406db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcff415e360 0x7fcff406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 --2- 172.21.15.7:0/137175719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcff40d2af0 0x7fcff4156950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 >> 172.21.15.7:0/137175719 conn(0x7fcff408dbf0 msgr2=0x7fcff40d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:08.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 shutdown_connections 2024-08-19T00:37:08.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.818+0000 7fcff3200640 1 -- 172.21.15.7:0/137175719 wait complete. 2024-08-19T00:37:08.837 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-19T00:37:08.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:08.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f34a1a00640 1 Processor -- start 2024-08-19T00:37:08.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f34a1a00640 1 -- start start 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f34a1a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f34a1a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f349c0b3750 0x7f349c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f34a1a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349c0cdfb0 con 0x7f349c0d03c0 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f34a1a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f349c0cebc0 con 0x7f349c0b3750 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f34a1a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f349c0ce290 con 0x7f349c06e710 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f349aa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f349c0d03c0 0x7f349c0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46248/0 (socket says 172.21.15.7:46248) 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.992+0000 7f349aa00640 1 -- 172.21.15.7:0/1886977773 learned_addr learned my addr 172.21.15.7:0/1886977773 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:08.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f349b400640 1 --2- 172.21.15.7:0/1886977773 >> v2:172.21.15.7:3300/0 conn(0x7f349c0b3750 0x7f349c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f349a000640 1 --2- 172.21.15.7:0/1886977773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:08.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f3499600640 1 -- 172.21.15.7:0/1886977773 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985216945 0 0) 0x7f349c0cdfb0 con 0x7f349c0d03c0 2024-08-19T00:37:08.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f3499600640 1 -- 172.21.15.7:0/1886977773 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3480003520 con 0x7f349c0d03c0 2024-08-19T00:37:08.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f349b400640 1 -- 172.21.15.7:0/1886977773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 msgr2=0x7f349c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:08.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f349b400640 1 --2- 172.21.15.7:0/1886977773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f349b400640 1 -- 172.21.15.7:0/1886977773 >> v1:172.21.15.7:6789/0 conn(0x7f349c0d03c0 legacy=0x7f349c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.993+0000 7f349b400640 1 -- 172.21.15.7:0/1886977773 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c0ce570 con 0x7f349c0b3750 2024-08-19T00:37:08.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.994+0000 7f349b400640 1 --2- 172.21.15.7:0/1886977773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0cf050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d90 tx=0x7f349402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda1895ab9feb922 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:08.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.994+0000 7f3499600640 1 -- 172.21.15.7:0/1886977773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494007740 con 0x7f349c0b3750 2024-08-19T00:37:08.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.994+0000 7f3499600640 1 -- 172.21.15.7:0/1886977773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34940078e0 con 0x7f349c0b3750 2024-08-19T00:37:08.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.994+0000 7f3499600640 1 -- 172.21.15.7:0/1886977773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494007cb0 con 0x7f349c0b3750 2024-08-19T00:37:08.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 -- 172.21.15.7:0/1886977773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 msgr2=0x7f349c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:08.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1886977773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0cf050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d90 tx=0x7f349402a660 comp rx=0 tx=0).stop 2024-08-19T00:37:08.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 -- 172.21.15.7:0/1886977773 shutdown_connections 2024-08-19T00:37:08.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1886977773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0cf050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1886977773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:08.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 -- 172.21.15.7:0/1886977773 >> 172.21.15.7:0/1886977773 conn(0x7f349c06bc70 msgr2=0x7f349c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:08.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 -- 172.21.15.7:0/1886977773 shutdown_connections 2024-08-19T00:37:08.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.995+0000 7f34a1a00640 1 -- 172.21.15.7:0/1886977773 wait complete. 2024-08-19T00:37:08.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.997+0000 7f34a1a00640 1 Processor -- start 2024-08-19T00:37:08.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.997+0000 7f34a1a00640 1 -- start start 2024-08-19T00:37:09.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f349c0d03c0 0x7f349c1f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f349c073c60 con 0x7f349c0b3750 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f349c073ae0 con 0x7f349c0d03c0 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f349c0b3be0 con 0x7f349c06e710 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35312/0 (socket says 172.21.15.7:35312) 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 -- 172.21.15.7:0/1355750728 learned_addr learned my addr 172.21.15.7:0/1355750728 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349aa00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349b400640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f349c0d03c0 0x7f349c1f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 -- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 msgr2=0x7f349c0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 -- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f349c0d03c0 msgr2=0x7f349c1f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f349c0d03c0 0x7f349c1f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 -- 172.21.15.7:0/1355750728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c15e630 con 0x7f349c0b3750 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349b400640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f349c0d03c0 0x7f349c1f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f349a000640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0b18e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f348800d5f0 tx=0x7f348800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f3492a00640 1 -- 172.21.15.7:0/1355750728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34880125f0 con 0x7f349c0b3750 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f3492a00640 1 -- 172.21.15.7:0/1355750728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3488019070 con 0x7f349c0b3750 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f3492a00640 1 -- 172.21.15.7:0/1355750728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34880129d0 con 0x7f349c0b3750 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c15e350 con 0x7f349c0b3750 2024-08-19T00:37:09.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:08.999+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c15c850 con 0x7f349c0b3750 2024-08-19T00:37:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.000+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349c0cdfb0 con 0x7f349c0b3750 2024-08-19T00:37:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.001+0000 7f3492a00640 1 -- 172.21.15.7:0/1355750728 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3488012b70 con 0x7f349c0b3750 2024-08-19T00:37:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.002+0000 7f3492a00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f347c06be30 0x7f347c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.002+0000 7f3492a00640 1 -- 172.21.15.7:0/1355750728 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f348808b220 con 0x7f349c0b3750 2024-08-19T00:37:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.002+0000 7f349aa00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f347c06be30 0x7f347c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.003+0000 7f349aa00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f347c06be30 0x7f347c06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f348c005880 tx=0x7f348c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.007+0000 7f3492a00640 1 -- 172.21.15.7:0/1355750728 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3488059bc0 con 0x7f349c0b3750 2024-08-19T00:37:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.191+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f349c0add40 con 0x7f349c0b3750 2024-08-19T00:37:09.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.193+0000 7f3492a00640 1 -- 172.21.15.7:0/1355750728 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16573 (secure 0 0 0) 0x7f34880594c0 con 0x7f349c0b3750 2024-08-19T00:37:09.195 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:09.196 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:04.356113+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:09.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f347c06be30 msgr2=0x7f347c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f347c06be30 0x7f347c06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f348c005880 tx=0x7f348c009040 comp rx=0 tx=0).stop 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 msgr2=0x7f349c0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0b18e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f348800d5f0 tx=0x7f348800dab0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 shutdown_connections 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f347c06be30 0x7f347c06e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f349c0d03c0 0x7f349c1f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f349c0b3750 0x7f349c0b18e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 --2- 172.21.15.7:0/1355750728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f349c06e710 0x7f349c0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 >> 172.21.15.7:0/1355750728 conn(0x7f349c06bc70 msgr2=0x7f349c072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 shutdown_connections 2024-08-19T00:37:09.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.195+0000 7f34a1a00640 1 -- 172.21.15.7:0/1355750728 wait complete. 2024-08-19T00:37:09.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-19T00:37:09.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-19T00:37:09.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-19T00:37:09.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-19T00:37:09.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-19T00:37:09.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-19T00:37:09.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-19T00:37:09.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-19T00:37:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.494+0000 7eff89200640 1 Processor -- start 2024-08-19T00:37:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.495+0000 7eff89200640 1 -- start start 2024-08-19T00:37:09.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.497+0000 7f9e6da00640 1 Processor -- start 2024-08-19T00:37:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.497+0000 7fe792000640 1 Processor -- start 2024-08-19T00:37:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.497+0000 7eff89200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8415e560 0x7eff840b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.498+0000 7eff89200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff840cf580 0x7eff840cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.498+0000 7eff89200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840cfee0 con 0x7eff841621b0 2024-08-19T00:37:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.498+0000 7eff89200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7eff840d3910 con 0x7eff840cf580 2024-08-19T00:37:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.498+0000 7eff89200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff840b6ef0 con 0x7eff8415e560 2024-08-19T00:37:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.497+0000 7f9e6da00640 1 -- start start 2024-08-19T00:37:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.498+0000 7fe792000640 1 -- start start 2024-08-19T00:37:09.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.498+0000 7eff82800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7eff841621b0 0x7eff84162640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46254/0 (socket says 172.21.15.7:46254) 2024-08-19T00:37:09.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.499+0000 7eff81400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff840cf580 0x7eff840cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.499+0000 7eff81400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff840cf580 0x7eff840cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:59894/0 (socket says 172.21.15.7:59894) 2024-08-19T00:37:09.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.499+0000 7eff81400640 1 -- 172.21.15.7:0/4214493222 learned_addr learned my addr 172.21.15.7:0/4214493222 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.499+0000 7f9e6da00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9e680d12f0 0x7f9e680d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.499+0000 7f9e6da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e680b70c0 con 0x7f9e6815e4e0 2024-08-19T00:37:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.499+0000 7f9e6da00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e680b73a0 con 0x7f9e680b9e90 2024-08-19T00:37:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.499+0000 7f9e6da00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9e680b7680 con 0x7f9e680d12f0 2024-08-19T00:37:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.500+0000 7fe792000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe78c15e560 0x7fe78c0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.500+0000 7eff81400640 1 -- 172.21.15.7:0/4214493222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8415e560 msgr2=0x7eff840b69b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:37:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.500+0000 7eff81400640 1 --2- 172.21.15.7:0/4214493222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8415e560 0x7eff840b69b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.500+0000 7f9e67e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9e6815e4e0 0x7f9e680cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46262/0 (socket says 172.21.15.7:46262) 2024-08-19T00:37:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.500+0000 7f9e67e00640 1 -- 172.21.15.7:0/1929653818 learned_addr learned my addr 172.21.15.7:0/1929653818 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.500+0000 7fe792000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe78c0cf580 0x7fe78c0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.500+0000 7eff80a00640 1 -- 172.21.15.7:0/4214493222 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782600760 0 0) 0x7eff840cfee0 con 0x7eff841621b0 2024-08-19T00:37:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe792000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c0d53b0 con 0x7fe78c1621b0 2024-08-19T00:37:09.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe792000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c0d3910 con 0x7fe78c15e560 2024-08-19T00:37:09.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe792000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c0b6ef0 con 0x7fe78c0cf580 2024-08-19T00:37:09.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7f9e6d000640 1 --2- 172.21.15.7:0/1929653818 >> v2:172.21.15.7:3300/0 conn(0x7f9e680d12f0 0x7f9e680d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe78b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe78c15e560 0x7fe78c0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe78b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe78c15e560 0x7fe78c0b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35342/0 (socket says 172.21.15.7:35342) 2024-08-19T00:37:09.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7f9e6d000640 1 -- 172.21.15.7:0/1929653818 >> v1:172.21.15.162:6789/0 conn(0x7f9e680b9e90 legacy=0x7f9e680d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7f9e6d000640 1 -- 172.21.15.7:0/1929653818 >> v1:172.21.15.7:6789/0 conn(0x7f9e6815e4e0 legacy=0x7f9e680cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7f9e6d000640 1 -- 172.21.15.7:0/1929653818 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e680b7960 con 0x7f9e680d12f0 2024-08-19T00:37:09.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe78b400640 1 -- 172.21.15.7:0/3619664688 learned_addr learned my addr 172.21.15.7:0/3619664688 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe78aa00640 1 --2- 172.21.15.7:0/3619664688 >> v2:172.21.15.162:3300/0 conn(0x7fe78c0cf580 0x7fe78c0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7fe78be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe78c1621b0 0x7fe78c162600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:60966/0 (socket says 172.21.15.7:60966) 2024-08-19T00:37:09.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7eff81400640 1 -- 172.21.15.7:0/4214493222 >> v1:172.21.15.7:6789/0 conn(0x7eff841621b0 legacy=0x7eff84162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.501+0000 7eff81400640 1 -- 172.21.15.7:0/4214493222 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff840d53b0 con 0x7eff840cf580 2024-08-19T00:37:09.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.503+0000 7eff81400640 1 --2- 172.21.15.7:0/4214493222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff840cf580 0x7eff840cf9a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff70009870 tx=0x7eff7002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feaab62af89480ca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.503+0000 7eff80a00640 1 -- 172.21.15.7:0/4214493222 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70037070 con 0x7eff840cf580 2024-08-19T00:37:09.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7eff80a00640 1 -- 172.21.15.7:0/4214493222 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff70032440 con 0x7eff840cf580 2024-08-19T00:37:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.503+0000 7f9e6d000640 1 --2- 172.21.15.7:0/1929653818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680d12f0 0x7f9e680d4dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009d90 tx=0x7f9e6002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6208f5f96c7731c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.503+0000 7f9e66a00640 1 -- 172.21.15.7:0/1929653818 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60007740 con 0x7f9e680d12f0 2024-08-19T00:37:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7f9e66a00640 1 -- 172.21.15.7:0/1929653818 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e600078e0 con 0x7f9e680d12f0 2024-08-19T00:37:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7f9e66a00640 1 -- 172.21.15.7:0/1929653818 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60007cb0 con 0x7f9e680d12f0 2024-08-19T00:37:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.502+0000 7fe78b400640 1 -- 172.21.15.7:0/3619664688 >> v2:172.21.15.162:3300/0 conn(0x7fe78c0cf580 msgr2=0x7fe78c0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.502+0000 7fe78b400640 1 --2- 172.21.15.7:0/3619664688 >> v2:172.21.15.162:3300/0 conn(0x7fe78c0cf580 0x7fe78c0cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.502+0000 7fe78b400640 1 -- 172.21.15.7:0/3619664688 >> v1:172.21.15.162:6789/0 conn(0x7fe78c1621b0 legacy=0x7fe78c162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.502+0000 7fe78b400640 1 -- 172.21.15.7:0/3619664688 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c0b3710 con 0x7fe78c15e560 2024-08-19T00:37:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7fe78b400640 1 --2- 172.21.15.7:0/3619664688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c15e560 0x7fe78c0b69b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0c7c30 tx=0x7fe77c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4920cfa4ee5927 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7f9e6da00640 1 -- 172.21.15.7:0/1929653818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680d12f0 msgr2=0x7f9e680d4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7f9e6da00640 1 --2- 172.21.15.7:0/1929653818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680d12f0 0x7f9e680d4dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009d90 tx=0x7f9e6002a6f0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7f0466c00640 1 Processor -- start 2024-08-19T00:37:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.504+0000 7f0466c00640 1 -- start start 2024-08-19T00:37:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7eff80a00640 1 -- 172.21.15.7:0/4214493222 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70037070 con 0x7eff840cf580 2024-08-19T00:37:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7f9e6da00640 1 -- 172.21.15.7:0/1929653818 shutdown_connections 2024-08-19T00:37:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7f9e6da00640 1 --2- 172.21.15.7:0/1929653818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680d12f0 0x7f9e680d4dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7f9e6da00640 1 -- 172.21.15.7:0/1929653818 >> 172.21.15.7:0/1929653818 conn(0x7f9e6809d510 msgr2=0x7f9e680d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7f9e6da00640 1 -- 172.21.15.7:0/1929653818 shutdown_connections 2024-08-19T00:37:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7f9e6da00640 1 -- 172.21.15.7:0/1929653818 wait complete. 2024-08-19T00:37:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7fe78a000640 1 -- 172.21.15.7:0/3619664688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c037070 con 0x7fe78c15e560 2024-08-19T00:37:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7fe78a000640 1 -- 172.21.15.7:0/3619664688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c032440 con 0x7fe78c15e560 2024-08-19T00:37:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7fe78a000640 1 -- 172.21.15.7:0/3619664688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c032850 con 0x7fe78c15e560 2024-08-19T00:37:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.505+0000 7eff89200640 1 -- 172.21.15.7:0/4214493222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff840cf580 msgr2=0x7eff840cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7eff89200640 1 --2- 172.21.15.7:0/4214493222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff840cf580 0x7eff840cf9a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff70009870 tx=0x7eff7002a210 comp rx=0 tx=0).stop 2024-08-19T00:37:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7f0466c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f04580e6e90 0x7f04580333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7f0466c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f04580497c0 0x7f0458049c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7f0466c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04580338e0 con 0x7f0458035cb0 2024-08-19T00:37:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7f0466c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f04580e7270 con 0x7f04580e6e90 2024-08-19T00:37:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7f0466c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f045804a150 con 0x7f04580497c0 2024-08-19T00:37:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7eff89200640 1 -- 172.21.15.7:0/4214493222 shutdown_connections 2024-08-19T00:37:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7eff89200640 1 --2- 172.21.15.7:0/4214493222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff840cf580 0x7eff840cf9a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7eff89200640 1 --2- 172.21.15.7:0/4214493222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8415e560 0x7eff840b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7f045f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0458035cb0 0x7f0458034c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46270/0 (socket says 172.21.15.7:46270) 2024-08-19T00:37:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7f045fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f04580e6e90 0x7f04580333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7f045fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f04580e6e90 0x7f04580333a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35358/0 (socket says 172.21.15.7:35358) 2024-08-19T00:37:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7f045fe00640 1 -- 172.21.15.7:0/1837329322 learned_addr learned my addr 172.21.15.7:0/1837329322 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7fe792000640 1 -- 172.21.15.7:0/3619664688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c15e560 msgr2=0x7fe78c0b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7fe792000640 1 --2- 172.21.15.7:0/3619664688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c15e560 0x7fe78c0b69b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0c7c30 tx=0x7fe77c02a200 comp rx=0 tx=0).stop 2024-08-19T00:37:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7f0464c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f04580497c0 0x7f0458049c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.506+0000 7eff89200640 1 -- 172.21.15.7:0/4214493222 >> 172.21.15.7:0/4214493222 conn(0x7eff8409d710 msgr2=0x7eff840d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7fe792000640 1 -- 172.21.15.7:0/3619664688 shutdown_connections 2024-08-19T00:37:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7f9e6da00640 1 Processor -- start 2024-08-19T00:37:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7fe792000640 1 --2- 172.21.15.7:0/3619664688 >> v2:172.21.15.162:3300/0 conn(0x7fe78c0cf580 0x7fe78c0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7fe792000640 1 --2- 172.21.15.7:0/3619664688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c15e560 0x7fe78c0b69b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7fe792000640 1 -- 172.21.15.7:0/3619664688 >> 172.21.15.7:0/3619664688 conn(0x7fe78c09d710 msgr2=0x7fe78c0d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7fe792000640 1 -- 172.21.15.7:0/3619664688 shutdown_connections 2024-08-19T00:37:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7fe792000640 1 -- 172.21.15.7:0/3619664688 wait complete. 2024-08-19T00:37:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.508+0000 7f9e6da00640 1 -- start start 2024-08-19T00:37:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7eff89200640 1 -- 172.21.15.7:0/4214493222 shutdown_connections 2024-08-19T00:37:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.507+0000 7eff89200640 1 -- 172.21.15.7:0/4214493222 wait complete. 2024-08-19T00:37:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.510+0000 7f9e6da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680b9e90 0x7f9e680c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.510+0000 7f9e6da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e680d12f0 0x7f9e6815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.510+0000 7f9e6da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e6815e4e0 0x7f9e68167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.510+0000 7f9e6da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e68169070 con 0x7f9e680b9e90 2024-08-19T00:37:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.510+0000 7f9e6da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e68168ef0 con 0x7f9e6815e4e0 2024-08-19T00:37:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.510+0000 7f9e6da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9e681691f0 con 0x7f9e680d12f0 2024-08-19T00:37:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.509+0000 7f045fe00640 1 -- 172.21.15.7:0/1837329322 >> v2:172.21.15.162:3300/0 conn(0x7f04580497c0 msgr2=0x7f0458049c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.509+0000 7f045fe00640 1 --2- 172.21.15.7:0/1837329322 >> v2:172.21.15.162:3300/0 conn(0x7f04580497c0 0x7f0458049c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.509+0000 7f045fe00640 1 -- 172.21.15.7:0/1837329322 >> v1:172.21.15.7:6789/0 conn(0x7f0458035cb0 legacy=0x7f0458034c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.509+0000 7f045fe00640 1 -- 172.21.15.7:0/1837329322 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458033bb0 con 0x7f04580e6e90 2024-08-19T00:37:09.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.510+0000 7eff89200640 1 Processor -- start 2024-08-19T00:37:09.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7f9e67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680b9e90 0x7f9e680c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7f9e67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680b9e90 0x7f9e680c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35366/0 (socket says 172.21.15.7:35366) 2024-08-19T00:37:09.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7fe792000640 1 Processor -- start 2024-08-19T00:37:09.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7f9e67e00640 1 -- 172.21.15.7:0/3308598376 learned_addr learned my addr 172.21.15.7:0/3308598376 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7fe792000640 1 -- start start 2024-08-19T00:37:09.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.512+0000 7f9e67e00640 1 -- 172.21.15.7:0/3308598376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e680d12f0 msgr2=0x7f9e6815af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.512+0000 7f9e67e00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e680d12f0 0x7f9e6815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.512+0000 7f9e67e00640 1 -- 172.21.15.7:0/3308598376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e6815e4e0 msgr2=0x7f9e68167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.512+0000 7eff89200640 1 -- start start 2024-08-19T00:37:09.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7f045fe00640 1 --2- 172.21.15.7:0/1837329322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f04580333a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f046006aa30 tx=0x7f0460063720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9223d07892345c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7f045ea00640 1 -- 172.21.15.7:0/1837329322 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600b3070 con 0x7f04580e6e90 2024-08-19T00:37:09.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7f045ea00640 1 -- 172.21.15.7:0/1837329322 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04600a6c40 con 0x7f04580e6e90 2024-08-19T00:37:09.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.511+0000 7f045ea00640 1 -- 172.21.15.7:0/1837329322 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600b3070 con 0x7f04580e6e90 2024-08-19T00:37:09.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.512+0000 7f9e6d000640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e6815e4e0 0x7f9e68167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.512+0000 7f9e67e00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e6815e4e0 0x7f9e68167160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.512+0000 7f9e67e00640 1 -- 172.21.15.7:0/3308598376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e680cb0b0 con 0x7f9e680b9e90 2024-08-19T00:37:09.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7fe792000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0cf580 0x7fe78c1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7fe792000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c15e560 0x7fe78c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7fe792000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c1621b0 0x7fe78c1f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7fe792000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c0cf2c0 con 0x7fe78c0cf580 2024-08-19T00:37:09.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7fe792000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c0cff10 con 0x7fe78c15e560 2024-08-19T00:37:09.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7eff89200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff840cf580 0x7eff840c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7eff89200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff8415e560 0x7eff840b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7fe792000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c0d4d60 con 0x7fe78c1621b0 2024-08-19T00:37:09.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7eff89200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff841621b0 0x7eff840b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7eff89200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff840cefe0 con 0x7eff8415e560 2024-08-19T00:37:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7eff89200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff840cf2c0 con 0x7eff841621b0 2024-08-19T00:37:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7eff89200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff840d4d60 con 0x7eff840cf580 2024-08-19T00:37:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7f9e67e00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680b9e90 0x7f9e680c8e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800c3f0 tx=0x7f9e5800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.513+0000 7fe78aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c15e560 0x7fe78c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7fe78aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c15e560 0x7fe78c15e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:59936/0 (socket says 172.21.15.7:59936) 2024-08-19T00:37:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7fe78aa00640 1 -- 172.21.15.7:0/3703419880 learned_addr learned my addr 172.21.15.7:0/3703419880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7eff81400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff8415e560 0x7eff840b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7eff81400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff8415e560 0x7eff840b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35384/0 (socket says 172.21.15.7:35384) 2024-08-19T00:37:09.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7eff81400640 1 -- 172.21.15.7:0/3503142262 learned_addr learned my addr 172.21.15.7:0/3503142262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7eff81e00640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff840cf580 0x7eff840c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e58017070 con 0x7f9e680b9e90 2024-08-19T00:37:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e58005ce0 con 0x7f9e680b9e90 2024-08-19T00:37:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e580072f0 con 0x7f9e680b9e90 2024-08-19T00:37:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e680c9530 con 0x7f9e680b9e90 2024-08-19T00:37:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e680b53d0 con 0x7f9e680b9e90 2024-08-19T00:37:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7f0466c00640 1 -- 172.21.15.7:0/1837329322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 msgr2=0x7f04580333a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7fe78be00640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c1621b0 0x7fe78c1f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.514+0000 7f0466c00640 1 --2- 172.21.15.7:0/1837329322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f04580333a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f046006aa30 tx=0x7f0460063720 comp rx=0 tx=0).stop 2024-08-19T00:37:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7eff81400640 1 -- 172.21.15.7:0/3503142262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff840cf580 msgr2=0x7eff840c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7fe78aa00640 1 -- 172.21.15.7:0/3703419880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c1621b0 msgr2=0x7fe78c1f91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7fe78aa00640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c1621b0 0x7fe78c1f91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7fe78aa00640 1 -- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0cf580 msgr2=0x7fe78c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7fe78aa00640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0cf580 0x7fe78c1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7fe78aa00640 1 -- 172.21.15.7:0/3703419880 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c1605b0 con 0x7fe78c15e560 2024-08-19T00:37:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7fe78be00640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c1621b0 0x7fe78c1f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7f0466c00640 1 -- 172.21.15.7:0/1837329322 shutdown_connections 2024-08-19T00:37:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7f3b81000640 1 Processor -- start 2024-08-19T00:37:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7eff81400640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff840cf580 0x7eff840c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7eff81400640 1 -- 172.21.15.7:0/3503142262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff841621b0 msgr2=0x7eff840b4150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:37:09.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7eff81400640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff841621b0 0x7eff840b4150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7eff81400640 1 -- 172.21.15.7:0/3503142262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8415fa80 con 0x7eff8415e560 2024-08-19T00:37:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.515+0000 7eff81e00640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff840cf580 0x7eff840c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7fe78aa00640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c15e560 0x7fe78c15e940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe77800e9b0 tx=0x7fe77800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7eff81400640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff8415e560 0x7eff840b6150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff7002a250 tx=0x7eff700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7fb77ec00640 1 Processor -- start 2024-08-19T00:37:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe778017070 con 0x7fe78c15e560 2024-08-19T00:37:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77800c9a0 con 0x7fe78c15e560 2024-08-19T00:37:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77800cd90 con 0x7fe78c15e560 2024-08-19T00:37:09.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7fb77ec00640 1 -- start start 2024-08-19T00:37:09.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7f3b81000640 1 -- start start 2024-08-19T00:37:09.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7efd55e00640 1 Processor -- start 2024-08-19T00:37:09.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c160830 con 0x7fe78c15e560 2024-08-19T00:37:09.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.516+0000 7efd55e00640 1 -- start start 2024-08-19T00:37:09.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.517+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e680d4dc0 con 0x7f9e680b9e90 2024-08-19T00:37:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.517+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c160df0 con 0x7fe78c15e560 2024-08-19T00:37:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.517+0000 7f0466c00640 1 --2- 172.21.15.7:0/1837329322 >> v2:172.21.15.162:3300/0 conn(0x7f04580497c0 0x7f0458049c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.517+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70041020 con 0x7eff8415e560 2024-08-19T00:37:09.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.517+0000 7f0466c00640 1 --2- 172.21.15.7:0/1837329322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f04580333a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.517+0000 7f0466c00640 1 -- 172.21.15.7:0/1837329322 >> 172.21.15.7:0/1837329322 conn(0x7f045801fb40 msgr2=0x7f04580567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b81000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c15a670 0x7f3b7c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff700325f0 con 0x7eff8415e560 2024-08-19T00:37:09.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70037040 con 0x7eff8415e560 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b81000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b7c0afab0 0x7f3b7c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b81000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0b1d10 0x7f3b7c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b81000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c0d0260 con 0x7f3b7c0afab0 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b81000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c15aa50 con 0x7f3b7c0b1d10 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b81000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c0cf650 con 0x7f3b7c15a670 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b79e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c15a670 0x7f3b7c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b7a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0b1d10 0x7f3b7c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b7a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0b1d10 0x7f3b7c0b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:59940/0 (socket says 172.21.15.7:59940) 2024-08-19T00:37:09.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b7a800640 1 -- 172.21.15.7:0/673320941 learned_addr learned my addr 172.21.15.7:0/673320941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7f3b71400640 1 --2- 172.21.15.7:0/673320941 >> v2:172.21.15.7:3300/0 conn(0x7f3b7c0afab0 0x7f3b7c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7f0466c00640 1 -- 172.21.15.7:0/1837329322 shutdown_connections 2024-08-19T00:37:09.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7fb77ec00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7700349d0 0x7fb7700554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7fb77ec00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb77003a480 con 0x7fb770038230 2024-08-19T00:37:09.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7f3b7a800640 1 -- 172.21.15.7:0/673320941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c15a670 msgr2=0x7f3b7c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7f3b7a800640 1 --2- 172.21.15.7:0/673320941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c15a670 0x7f3b7c0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7f0466c00640 1 -- 172.21.15.7:0/1837329322 wait complete. 2024-08-19T00:37:09.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7f3b7a800640 1 -- 172.21.15.7:0/673320941 >> v2:172.21.15.7:3300/0 conn(0x7f3b7c0afab0 msgr2=0x7f3b7c0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7f3b7a800640 1 --2- 172.21.15.7:0/673320941 >> v2:172.21.15.7:3300/0 conn(0x7f3b7c0afab0 0x7f3b7c0afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7f3b7a800640 1 -- 172.21.15.7:0/673320941 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c0cf930 con 0x7f3b7c0b1d10 2024-08-19T00:37:09.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7efd55e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd500ce500 0x7efd500ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8415fd60 con 0x7eff8415e560 2024-08-19T00:37:09.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff84160320 con 0x7eff8415e560 2024-08-19T00:37:09.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7febe7800640 1 Processor -- start 2024-08-19T00:37:09.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7fb77ec00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb77003a760 con 0x7fb770034540 2024-08-19T00:37:09.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7fb77ec00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb770055040 con 0x7fb7700349d0 2024-08-19T00:37:09.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7fb77e200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7700349d0 0x7fb7700554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7fb77d800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb770038230 0x7fb770038610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46284/0 (socket says 172.21.15.7:46284) 2024-08-19T00:37:09.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7fb77d800640 1 -- 172.21.15.7:0/4034447413 learned_addr learned my addr 172.21.15.7:0/4034447413 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:09.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7efd55e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efd500d03c0 0x7efd500d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7febe7800640 1 -- start start 2024-08-19T00:37:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7efd55e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5006f7f0 con 0x7efd50159bf0 2024-08-19T00:37:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7efd55e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7efd500d0d50 con 0x7efd500ce500 2024-08-19T00:37:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.519+0000 7efd55e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efd5006f510 con 0x7efd500d03c0 2024-08-19T00:37:09.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.518+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe78c0ba4a0 con 0x7fe78c15e560 2024-08-19T00:37:09.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.520+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727615778 0 0) 0x7fb77003a760 con 0x7fb770034540 2024-08-19T00:37:09.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.520+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb760003520 con 0x7fb770034540 2024-08-19T00:37:09.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.520+0000 7efd4ea00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7efd50159bf0 0x7efd50073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:60994/0 (socket says 172.21.15.7:60994) 2024-08-19T00:37:09.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.520+0000 7efd4ea00640 1 -- 172.21.15.7:0/3264843133 learned_addr learned my addr 172.21.15.7:0/3264843133 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:09.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.520+0000 7efd4f400640 1 --2- 172.21.15.7:0/3264843133 >> v2:172.21.15.162:3300/0 conn(0x7efd500d03c0 0x7efd500d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.520+0000 7efd4e000640 1 --2- 172.21.15.7:0/3264843133 >> v2:172.21.15.7:3300/0 conn(0x7efd500ce500 0x7efd500ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1070315319 0 0) 0x7fb760003520 con 0x7fb770034540 2024-08-19T00:37:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 >> v2:172.21.15.162:3300/0 conn(0x7fb7700349d0 msgr2=0x7fb7700554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 --2- 172.21.15.7:0/4034447413 >> v2:172.21.15.162:3300/0 conn(0x7fb7700349d0 0x7fb7700554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 >> v1:172.21.15.7:6789/0 conn(0x7fb770038230 legacy=0x7fb770038610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb770054cd0 con 0x7fb770034540 2024-08-19T00:37:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e5801a070 con 0x7f9e680b9e90 2024-08-19T00:37:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7f3b7a800640 1 --2- 172.21.15.7:0/673320941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0b1d10 0x7f3b7c0b21c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c071910 tx=0x7f3b7402c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e33623b86214584 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7efd4d600640 1 -- 172.21.15.7:0/3264843133 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862622745 0 0) 0x7efd5006f7f0 con 0x7efd50159bf0 2024-08-19T00:37:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7efd4d600640 1 -- 172.21.15.7:0/3264843133 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd34003520 con 0x7efd50159bf0 2024-08-19T00:37:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7efd4f400640 1 -- 172.21.15.7:0/3264843133 >> v2:172.21.15.7:3300/0 conn(0x7efd500ce500 msgr2=0x7efd500ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7efd4f400640 1 --2- 172.21.15.7:0/3264843133 >> v2:172.21.15.7:3300/0 conn(0x7efd500ce500 0x7efd500ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7efd4f400640 1 -- 172.21.15.7:0/3264843133 >> v1:172.21.15.162:6789/0 conn(0x7efd50159bf0 legacy=0x7efd50073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7efd4f400640 1 -- 172.21.15.7:0/3264843133 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd50072980 con 0x7efd500d03c0 2024-08-19T00:37:09.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7f3b79400640 1 -- 172.21.15.7:0/673320941 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74039070 con 0x7f3b7c0b1d10 2024-08-19T00:37:09.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fb764001670 con 0x7fb770034540 2024-08-19T00:37:09.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7efd4e000640 1 --2- 172.21.15.7:0/3264843133 >> v2:172.21.15.7:3300/0 conn(0x7efd500ce500 0x7efd500ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:09.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe77801a070 con 0x7fe78c15e560 2024-08-19T00:37:09.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7febe7800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe00b3960 0x7febe00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7febe7800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe00cf080 con 0x7febe00b5840 2024-08-19T00:37:09.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7febe7800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe00d2dc0 con 0x7febe0162320 2024-08-19T00:37:09.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7febe7800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febe00b5c80 con 0x7febe00b3960 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.522+0000 7febe4e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7febe0162320 0x7febe0162700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:60996/0 (socket says 172.21.15.7:60996) 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.522+0000 7febe4e00640 1 -- 172.21.15.7:0/1225408057 learned_addr learned my addr 172.21.15.7:0/1225408057 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 >> v1:172.21.15.162:6789/0 conn(0x7fb770034540 legacy=0x7fb77001ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb760003a00 0x7fb760003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb760004800 0x7fb760004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7600051c0 0x7fb76000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb770055040 con 0x7fb7600051c0 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb76000c0c0 con 0x7fb760003a00 2024-08-19T00:37:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb76000c2c0 con 0x7fb760004800 2024-08-19T00:37:09.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.522+0000 7fb77d800640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb760003a00 0x7fb760003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.521+0000 7f0466c00640 1 Processor -- start 2024-08-19T00:37:09.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.522+0000 7febe5800640 1 --2- 172.21.15.7:0/1225408057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe00b3960 0x7febe00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.522+0000 7f3b79400640 1 -- 172.21.15.7:0/673320941 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b74034410 con 0x7f3b7c0b1d10 2024-08-19T00:37:09.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.522+0000 7f3b79400640 1 -- 172.21.15.7:0/673320941 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b740347e0 con 0x7f3b7c0b1d10 2024-08-19T00:37:09.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.522+0000 7f0466c00640 1 -- start start 2024-08-19T00:37:09.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7fb77ce00640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb760004800 0x7fb760004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7f9e5fe00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e4806be80 0x7f9e4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9e58056cf0 con 0x7f9e680b9e90 2024-08-19T00:37:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7fb77d800640 1 -- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb760004800 msgr2=0x7fb760004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7fb77e200640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7600051c0 0x7fb76000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7efd4f400640 1 --2- 172.21.15.7:0/3264843133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 0x7efd500d0810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd500d0fb0 tx=0x7efd4802e9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bc891878a74c298 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7f9e5fe00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f9e48074d70 0x7f9e48077210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e480778e0 con 0x7f9e48074d70 2024-08-19T00:37:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9e58055680 con 0x7f9e680b9e90 2024-08-19T00:37:09.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7f3b81000640 1 -- 172.21.15.7:0/673320941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0b1d10 msgr2=0x7f3b7c0b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7f3b81000640 1 --2- 172.21.15.7:0/673320941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0b1d10 0x7f3b7c0b21c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c071910 tx=0x7f3b7402c820 comp rx=0 tx=0).stop 2024-08-19T00:37:09.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff840d5040 con 0x7eff8415e560 2024-08-19T00:37:09.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7f9e67400640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e4806be80 0x7f9e4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7efd4d600640 1 -- 172.21.15.7:0/3264843133 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48038020 con 0x7efd500d03c0 2024-08-19T00:37:09.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7efd4d600640 1 -- 172.21.15.7:0/3264843133 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd48030040 con 0x7efd500d03c0 2024-08-19T00:37:09.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7efd4d600640 1 -- 172.21.15.7:0/3264843133 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48034a80 con 0x7efd500d03c0 2024-08-19T00:37:09.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fe783400640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76c06be80 0x7fe76c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe77808ad60 con 0x7fe78c15e560 2024-08-19T00:37:09.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fe783400640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7fe76c0740a0 0x7fe76c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe778016ec0 con 0x7fe76c0740a0 2024-08-19T00:37:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe77808d380 con 0x7fe78c15e560 2024-08-19T00:37:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7febe5800640 1 -- 172.21.15.7:0/1225408057 >> v1:172.21.15.162:6789/0 conn(0x7febe0162320 legacy=0x7febe0162700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7febe5800640 1 -- 172.21.15.7:0/1225408057 >> v1:172.21.15.7:6789/0 conn(0x7febe00b5840 legacy=0x7febe00d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.523+0000 7febe5800640 1 -- 172.21.15.7:0/1225408057 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe00d30a0 con 0x7febe00b3960 2024-08-19T00:37:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fb77d800640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb760004800 0x7fb760004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fb77d800640 1 -- 172.21.15.7:0/4034447413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7600051c0 msgr2=0x7fb76000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fb77d800640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7600051c0 0x7fb76000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fb77d800640 1 -- 172.21.15.7:0/4034447413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb760003520 con 0x7fb760003a00 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fb77e200640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7600051c0 0x7fb76000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fb77e200640 1 -- 172.21.15.7:0/4034447413 reap_dead start 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7fb77ce00640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb760004800 0x7fb760004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7f3b81000640 1 -- 172.21.15.7:0/673320941 shutdown_connections 2024-08-19T00:37:09.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7f3b81000640 1 --2- 172.21.15.7:0/673320941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0b1d10 0x7f3b7c0b21c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7f3b81000640 1 --2- 172.21.15.7:0/673320941 >> v2:172.21.15.7:3300/0 conn(0x7f3b7c0afab0 0x7f3b7c0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7f3b81000640 1 --2- 172.21.15.7:0/673320941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c15a670 0x7f3b7c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.524+0000 7f3b81000640 1 -- 172.21.15.7:0/673320941 >> 172.21.15.7:0/673320941 conn(0x7f3b7c0b5530 msgr2=0x7f3b7c0b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7f9e6d000640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f9e48074d70 0x7f9e48077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7f9e67400640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e4806be80 0x7f9e4806e340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000f60 tx=0x7f9e540079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7f0466c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0458035cb0 0x7f045804ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7febe5800640 1 --2- 172.21.15.7:0/1225408057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe00b3960 0x7febe00cf840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7febd00097d0 tx=0x7febd002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e3a746d26b1b69 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7efd55e00640 1 -- 172.21.15.7:0/3264843133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 msgr2=0x7efd500d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7efd55e00640 1 --2- 172.21.15.7:0/3264843133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 0x7efd500d0810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd500d0fb0 tx=0x7efd4802e9a0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7f0466c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04580497c0 0x7f0458052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7f3b81000640 1 -- 172.21.15.7:0/673320941 shutdown_connections 2024-08-19T00:37:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7f3b81000640 1 -- 172.21.15.7:0/673320941 wait complete. 2024-08-19T00:37:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7efd55e00640 1 -- 172.21.15.7:0/3264843133 shutdown_connections 2024-08-19T00:37:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7efd55e00640 1 --2- 172.21.15.7:0/3264843133 >> v2:172.21.15.7:3300/0 conn(0x7efd500ce500 0x7efd500ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7efd55e00640 1 --2- 172.21.15.7:0/3264843133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 0x7efd500d0810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7efd55e00640 1 -- 172.21.15.7:0/3264843133 >> 172.21.15.7:0/3264843133 conn(0x7efd5006bc70 msgr2=0x7efd5006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7f0466c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f045803bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f9e6d000640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f9e48074d70 0x7f9e48077210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7febdf400640 1 -- 172.21.15.7:0/1225408057 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0037070 con 0x7febe00b3960 2024-08-19T00:37:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7fe78be00640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7fe76c0740a0 0x7fe76c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.525+0000 7fe78b400640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76c06be80 0x7fe76c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f0464c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f045803bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f0464c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f045803bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35402/0 (socket says 172.21.15.7:35402) 2024-08-19T00:37:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7fe78be00640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7fe76c0740a0 0x7fe76c0764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f045f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04580497c0 0x7f0458052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f0464c00640 1 -- 172.21.15.7:0/3853788300 learned_addr learned my addr 172.21.15.7:0/3853788300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7fb77d800640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb760003a00 0x7fb760003e20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb76c001800 tx=0x7fb760005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae671d2f2dc9fb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c001450 con 0x7fb760003a00 2024-08-19T00:37:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76c02e070 con 0x7fb760003a00 2024-08-19T00:37:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7fb777e00640 1 -- 172.21.15.7:0/4034447413 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c02add0 con 0x7fb760003a00 2024-08-19T00:37:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0458034170 con 0x7f04580e6e90 2024-08-19T00:37:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f045fe00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0458035cb0 0x7f045804ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04580347c0 con 0x7f04580497c0 2024-08-19T00:37:09.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0458034450 con 0x7f0458035cb0 2024-08-19T00:37:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7febdf400640 1 -- 172.21.15.7:0/1225408057 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd0032440 con 0x7febe00b3960 2024-08-19T00:37:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7febdf400640 1 -- 172.21.15.7:0/1225408057 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0032810 con 0x7febe00b3960 2024-08-19T00:37:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.526+0000 7efd55e00640 1 -- 172.21.15.7:0/3264843133 shutdown_connections 2024-08-19T00:37:09.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.527+0000 7fe78b400640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76c06be80 0x7fe76c06e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe77c034000 tx=0x7fe77c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.527+0000 7efd55e00640 1 -- 172.21.15.7:0/3264843133 wait complete. 2024-08-19T00:37:09.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== osd.2 v2:172.21.15.7:6816/3897722247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe778016ec0 con 0x7fe76c0740a0 2024-08-19T00:37:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7fb77ec00640 1 -- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb760003a00 msgr2=0x7fb760003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7fb77ec00640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb760003a00 0x7fb760003e20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb76c001800 tx=0x7fb760005830 comp rx=0 tx=0).stop 2024-08-19T00:37:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.527+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff70044020 con 0x7eff8415e560 2024-08-19T00:37:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7fb77ec00640 1 -- 172.21.15.7:0/4034447413 shutdown_connections 2024-08-19T00:37:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7fb77ec00640 1 --2- 172.21.15.7:0/4034447413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb760003a00 0x7fb760003e20 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb76c001800 tx=0x7fb760005830 comp rx=0 tx=0).stop 2024-08-19T00:37:09.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7fb77ec00640 1 -- 172.21.15.7:0/4034447413 >> 172.21.15.7:0/4034447413 conn(0x7fb770053230 msgr2=0x7fb770053610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7febe7800640 1 -- 172.21.15.7:0/1225408057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe00b3960 msgr2=0x7febe00cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7febe7800640 1 --2- 172.21.15.7:0/1225408057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe00b3960 0x7febe00cf840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7febd00097d0 tx=0x7febd002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7f3b81000640 1 Processor -- start 2024-08-19T00:37:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7febe7800640 1 -- 172.21.15.7:0/1225408057 shutdown_connections 2024-08-19T00:37:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7febe7800640 1 --2- 172.21.15.7:0/1225408057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe00b3960 0x7febe00cf840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7febe7800640 1 -- 172.21.15.7:0/1225408057 >> 172.21.15.7:0/1225408057 conn(0x7febe008c000 msgr2=0x7febe00d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7f3b81000640 1 -- start start 2024-08-19T00:37:09.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7fb77ec00640 1 -- 172.21.15.7:0/4034447413 shutdown_connections 2024-08-19T00:37:09.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.527+0000 7f0464c00640 1 -- 172.21.15.7:0/3853788300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0458035cb0 msgr2=0x7f045804ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.527+0000 7f0464c00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0458035cb0 0x7f045804ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.527+0000 7f0464c00640 1 -- 172.21.15.7:0/3853788300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04580497c0 msgr2=0x7f0458052360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.527+0000 7f0464c00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04580497c0 0x7f0458052360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7f0464c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04580528a0 con 0x7f04580e6e90 2024-08-19T00:37:09.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7f0464c00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f045803bfe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f044c00eb60 tx=0x7f044c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7fb77ec00640 1 -- 172.21.15.7:0/4034447413 wait complete. 2024-08-19T00:37:09.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7f045f400640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04580497c0 0x7f0458052360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:09.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.528+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e480778e0 con 0x7f9e48074d70 2024-08-19T00:37:09.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7f045fe00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0458035cb0 0x7f045804ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:09.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7efd55e00640 1 Processor -- start 2024-08-19T00:37:09.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c017070 con 0x7f04580e6e90 2024-08-19T00:37:09.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7febe7800640 1 -- 172.21.15.7:0/1225408057 shutdown_connections 2024-08-19T00:37:09.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7efd55e00640 1 -- start start 2024-08-19T00:37:09.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c00ec50 con 0x7f04580e6e90 2024-08-19T00:37:09.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c00cc30 con 0x7f04580e6e90 2024-08-19T00:37:09.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7eff7a000640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff6406bf00 0x7eff6406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04580505e0 con 0x7f04580e6e90 2024-08-19T00:37:09.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.529+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045804f540 con 0x7f04580e6e90 2024-08-19T00:37:09.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.530+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7eff700ab8a0 con 0x7eff8415e560 2024-08-19T00:37:09.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.530+0000 7eff7a000640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7eff64074120 0x7eff64076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.530+0000 7eff81e00640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff6406bf00 0x7eff6406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff7000af30 con 0x7eff64074120 2024-08-19T00:37:09.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7eff700b02a0 con 0x7eff8415e560 2024-08-19T00:37:09.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04580eb480 con 0x7f04580e6e90 2024-08-19T00:37:09.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7eff81e00640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff6406bf00 0x7eff6406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff74006fd0 tx=0x7eff74008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7febe7800640 1 -- 172.21.15.7:0/1225408057 wait complete. 2024-08-19T00:37:09.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7f3b81000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0afab0 0x7f3b7c09db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7f3b81000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b1d10 0x7f3b7c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7f3b81000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c15a670 0x7f3b7c0b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7f3b81000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c0b0430 con 0x7f3b7c0afab0 2024-08-19T00:37:09.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7f3b81000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c0cfef0 con 0x7f3b7c15a670 2024-08-19T00:37:09.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7f3b81000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c0b2700 con 0x7f3b7c0b1d10 2024-08-19T00:37:09.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.532+0000 7eff82800640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7eff64074120 0x7eff64076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7fb77ec00640 1 Processor -- start 2024-08-19T00:37:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.531+0000 7fb77ec00640 1 -- start start 2024-08-19T00:37:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.532+0000 7efd55e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd500ce500 0x7efd500b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7f3b71400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b1d10 0x7f3b7c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7f3b71400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b1d10 0x7f3b7c0c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53304/0 (socket says 172.21.15.7:53304) 2024-08-19T00:37:09.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7f3b71400640 1 -- 172.21.15.7:0/3356082528 learned_addr learned my addr 172.21.15.7:0/3356082528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7f3b7a800640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c15a670 0x7f3b7c0b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7f3b79e00640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0afab0 0x7f3b7c09db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.532+0000 7efd55e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 0x7efd501f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.532+0000 7efd55e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd50159bf0 0x7efd500b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.532+0000 7efd55e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd50073b70 con 0x7efd500ce500 2024-08-19T00:37:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.532+0000 7efd55e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd50072f40 con 0x7efd500d03c0 2024-08-19T00:37:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.532+0000 7efd55e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd50159fd0 con 0x7efd50159bf0 2024-08-19T00:37:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7efd4ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd500ce500 0x7efd500b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7eff82800640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7eff64074120 0x7eff64076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f044c01a070 con 0x7f04580e6e90 2024-08-19T00:37:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7febe7800640 1 Processor -- start 2024-08-19T00:37:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7febe7800640 1 -- start start 2024-08-19T00:37:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7f3b7a800640 1 -- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b1d10 msgr2=0x7f3b7c0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7f3b7a800640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b1d10 0x7f3b7c0c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7f3b7a800640 1 -- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0afab0 msgr2=0x7f3b7c09db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7f3b7a800640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0afab0 0x7f3b7c09db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7f3b7a800640 1 -- 172.21.15.7:0/3356082528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c09e040 con 0x7f3b7c15a670 2024-08-19T00:37:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7efd4ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd500ce500 0x7efd500b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35406/0 (socket says 172.21.15.7:35406) 2024-08-19T00:37:09.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7efd4ea00640 1 -- 172.21.15.7:0/295213438 learned_addr learned my addr 172.21.15.7:0/295213438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.533+0000 7efd4e000640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 0x7efd501f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7fb77ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770168340 0x7fb77017de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7fb77ec00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb77000c980 0x7fb77000ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7efd4f400640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd50159bf0 0x7efd500b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.534+0000 7f3b7a800640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c15a670 0x7f3b7c0b46d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b74033000 tx=0x7f3b74004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74039040 con 0x7f3b7c15a670 2024-08-19T00:37:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7403d640 con 0x7f3b7c15a670 2024-08-19T00:37:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7403da30 con 0x7f3b7c15a670 2024-08-19T00:37:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c0c9d00 con 0x7f3b7c15a670 2024-08-19T00:37:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c0ca2c0 con 0x7f3b7c15a670 2024-08-19T00:37:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7fb77d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770168340 0x7fb77017de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7fb77d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770168340 0x7fb77017de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60014/0 (socket says 172.21.15.7:60014) 2024-08-19T00:37:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff7000af30 con 0x7eff64074120 2024-08-19T00:37:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febe7800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febe00b3960 0x7febe00cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febe7800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe00b5840 0x7febe00cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febe7800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe0162320 0x7febe00cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febe7800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7febe0161f20 con 0x7febe00b5840 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febe7800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febe00cf3b0 con 0x7febe00b3960 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febe7800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febe01620a0 con 0x7febe0162320 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe00b5840 0x7febe00cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe00b5840 0x7febe00cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35422/0 (socket says 172.21.15.7:35422) 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febdfe00640 1 -- 172.21.15.7:0/2520762314 learned_addr learned my addr 172.21.15.7:0/2520762314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7efd4f400640 1 -- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 msgr2=0x7efd501f0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7efd4f400640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd500d03c0 0x7efd501f0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7efd4f400640 1 -- 172.21.15.7:0/295213438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd500ce500 msgr2=0x7efd500b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7efd4f400640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd500ce500 0x7efd500b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.535+0000 7efd4f400640 1 -- 172.21.15.7:0/295213438 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd501f0aa0 con 0x7efd50159bf0 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.536+0000 7febe4e00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febe00b3960 0x7febe00cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7febe5800640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe0162320 0x7febe00cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7f0453e00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f044006be80 0x7f044006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f044c08b0d0 con 0x7f04580e6e90 2024-08-19T00:37:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7f0453e00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f04400740a0 0x7f04400764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f044c012e50 con 0x7f04400740a0 2024-08-19T00:37:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f044c08b480 con 0x7f04580e6e90 2024-08-19T00:37:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7efd4f400640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd50159bf0 0x7efd500b1c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd48036000 tx=0x7efd48004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7fb77ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7700077b0 0x7fb770007c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7fb77ec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb77003a010 con 0x7fb7700077b0 2024-08-19T00:37:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7fb77ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb770054980 con 0x7fb770168340 2024-08-19T00:37:09.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7fb77ec00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb77003a190 con 0x7fb77000c980 2024-08-19T00:37:09.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4804c070 con 0x7efd50159bf0 2024-08-19T00:37:09.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7fb77d800640 1 -- 172.21.15.7:0/2243483586 learned_addr learned my addr 172.21.15.7:0/2243483586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7fb77ce00640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb77000c980 0x7fb77000ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7febdfe00640 1 -- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe0162320 msgr2=0x7febe00cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7febdfe00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe0162320 0x7febe00cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7febdfe00640 1 -- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febe00b3960 msgr2=0x7febe00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7febdfe00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febe00b3960 0x7febe00cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7fb77ce00640 1 -- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770168340 msgr2=0x7fb77017de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7fb77ce00640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770168340 0x7fb77017de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7fb77ce00640 1 -- 172.21.15.7:0/2243483586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7700077b0 msgr2=0x7fb770007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7fb77ce00640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7700077b0 0x7fb770007c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7fb77ce00640 1 -- 172.21.15.7:0/2243483586 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77017d0b0 con 0x7fb77000c980 2024-08-19T00:37:09.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7febdfe00640 1 -- 172.21.15.7:0/2520762314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe00b7b60 con 0x7febe00b5840 2024-08-19T00:37:09.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.537+0000 7febe5800640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febe0162320 0x7febe00cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:09.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7febdfe00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe00b5840 0x7febe00cb990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febd800c7f0 tx=0x7febd800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7fb77d800640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770168340 0x7fb77017de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:09.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4803fc20 con 0x7efd50159bf0 2024-08-19T00:37:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48038040 con 0x7efd50159bf0 2024-08-19T00:37:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd801ba80 con 0x7febe00b5840 2024-08-19T00:37:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd8020070 con 0x7febe00b5840 2024-08-19T00:37:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe00b7e40 con 0x7febe00b5840 2024-08-19T00:37:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd801be60 con 0x7febe00b5840 2024-08-19T00:37:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe015aec0 con 0x7febe00b5840 2024-08-19T00:37:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7fb77ce00640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb77000c980 0x7fb77000ce00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d730 tx=0x7fb76400dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b54001030 con 0x7f3b7c15a670 2024-08-19T00:37:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.538+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b7403dbd0 con 0x7f3b7c15a670 2024-08-19T00:37:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7f045fe00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f044006be80 0x7f044006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764005270 con 0x7fb77000c980 2024-08-19T00:37:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb764017070 con 0x7fb77000c980 2024-08-19T00:37:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb770168720 con 0x7fb77000c980 2024-08-19T00:37:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.539+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77017d330 con 0x7fb77000c980 2024-08-19T00:37:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76400b6b0 con 0x7fb77000c980 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7f045f400640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f04400740a0 0x7f04400764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.541+0000 7f045f400640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f04400740a0 0x7f04400764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7f3b72a00640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be80 0x7f3b5806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3b740aaae0 con 0x7f3b7c15a670 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7f3b72a00640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f3b580740a0 0x7f3b580764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b7403ae50 con 0x7f3b580740a0 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3b740af2c0 con 0x7f3b7c15a670 2024-08-19T00:37:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.540+0000 7f3b79e00640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be80 0x7f3b5806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.541+0000 7f3b71400640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f3b580740a0 0x7f3b580764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.542+0000 7f3b71400640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f3b580740a0 0x7f3b580764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.541+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd500b3bb0 con 0x7efd50159bf0 2024-08-19T00:37:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.541+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efd500b38d0 con 0x7efd50159bf0 2024-08-19T00:37:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.542+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febd800a850 con 0x7febe00b5840 2024-08-19T00:37:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.542+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febe015c660 con 0x7febe00b5840 2024-08-19T00:37:09.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.543+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb754001030 con 0x7fb77000c980 2024-08-19T00:37:09.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.543+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb76400b850 con 0x7fb77000c980 2024-08-19T00:37:09.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.543+0000 7f045fe00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f044006be80 0x7f044006e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f045800bb20 tx=0x7f04600aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.543+0000 7febdcc00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febc006be80 0x7febc006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7febd8093640 con 0x7febe00b5840 2024-08-19T00:37:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f044c012e50 con 0x7f04400740a0 2024-08-19T00:37:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7febdcc00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7febc0074100 0x7febc0076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febd8029ec0 con 0x7febc0074100 2024-08-19T00:37:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7febd809a050 con 0x7febe00b5840 2024-08-19T00:37:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd5006e070 con 0x7efd50159bf0 2024-08-19T00:37:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7f3b79e00640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be80 0x7f3b5806e340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007920 tx=0x7f3b6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7febe4e00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febc006be80 0x7febc006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7febe5800640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7febc0074100 0x7febc0076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.545+0000 7fb775600640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb75806beb0 0x7fb75806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.544+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b7403ae50 con 0x7f3b580740a0 2024-08-19T00:37:09.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.545+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb76408aba0 con 0x7fb77000c980 2024-08-19T00:37:09.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.545+0000 7fb77d800640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb75806beb0 0x7fb75806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.545+0000 7fb775600640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7fb7580740d0 0x7fb7580764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.545+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb758076ba0 con 0x7fb7580740d0 2024-08-19T00:37:09.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.545+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb76408d270 con 0x7fb77000c980 2024-08-19T00:37:09.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.546+0000 7febe4e00640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febc006be80 0x7febc006e340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7febcc005880 tx=0x7febcc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.546+0000 7fb77e200640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7fb7580740d0 0x7fb7580764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.546+0000 7febe5800640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7febc0074100 0x7febc0076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.546+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd4804f070 con 0x7efd50159bf0 2024-08-19T00:37:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.546+0000 7fb77e200640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7fb7580740d0 0x7fb7580764f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.547+0000 7efd47400640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd3006be80 0x7efd3006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.547+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd480b01c0 con 0x7efd50159bf0 2024-08-19T00:37:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.547+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== osd.4 v2:172.21.15.162:6806/2900813997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febd8029ec0 con 0x7febc0074100 2024-08-19T00:37:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.547+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb758076ba0 con 0x7fb7580740d0 2024-08-19T00:37:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.547+0000 7efd47400640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7efd300740a0 0x7efd300764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.547+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd48052ec0 con 0x7efd300740a0 2024-08-19T00:37:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.547+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efd480b7050 con 0x7efd50159bf0 2024-08-19T00:37:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.548+0000 7efd4ea00640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd3006be80 0x7efd3006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.549+0000 7efd4e000640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7efd300740a0 0x7efd300764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.549+0000 7fb77d800640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb75806beb0 0x7fb75806e370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb76c001020 tx=0x7fb76c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.550+0000 7efd4ea00640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd3006be80 0x7efd3006e340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd40007680 tx=0x7efd40007c30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.550+0000 7efd4e000640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7efd300740a0 0x7efd300764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.552+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd48052ec0 con 0x7efd300740a0 2024-08-19T00:37:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.557+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe78c161570 con 0x7fe76c0740a0 2024-08-19T00:37:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.558+0000 7fe783400640 1 -- 172.21.15.7:0/3703419880 <== osd.2 v2:172.21.15.7:6816/3897722247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe78c161570 con 0x7fe76c0740a0 2024-08-19T00:37:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.559+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7fe76c0740a0 msgr2=0x7fe76c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.559+0000 7fe792000640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7fe76c0740a0 0x7fe76c0764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.562+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76c06be80 msgr2=0x7fe76c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.562+0000 7fe792000640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76c06be80 0x7fe76c06e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe77c034000 tx=0x7fe77c02c000 comp rx=0 tx=0).stop 2024-08-19T00:37:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.562+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c15e560 msgr2=0x7fe78c15e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.562+0000 7fe792000640 1 --2- 172.21.15.7:0/3703419880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c15e560 0x7fe78c15e940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe77800e9b0 tx=0x7fe77800ee70 comp rx=0 tx=0).stop 2024-08-19T00:37:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.562+0000 7fe78be00640 1 -- 172.21.15.7:0/3703419880 reap_dead start 2024-08-19T00:37:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.562+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 shutdown_connections 2024-08-19T00:37:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.562+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 >> 172.21.15.7:0/3703419880 conn(0x7fe78c09d710 msgr2=0x7fe78c0b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.563+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 shutdown_connections 2024-08-19T00:37:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.563+0000 7fe792000640 1 -- 172.21.15.7:0/3703419880 wait complete. 2024-08-19T00:37:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.564+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e680d09c0 con 0x7f9e48074d70 2024-08-19T00:37:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.565+0000 7f9e5fe00640 1 -- 172.21.15.7:0/3308598376 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e680d09c0 con 0x7f9e48074d70 2024-08-19T00:37:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.566+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f9e48074d70 msgr2=0x7f9e48077210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.566+0000 7f9e6da00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f9e48074d70 0x7f9e48077210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.566+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e4806be80 msgr2=0x7f9e4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.566+0000 7f9e6da00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e4806be80 0x7f9e4806e340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000f60 tx=0x7f9e540079b0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.566+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680b9e90 msgr2=0x7f9e680c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.566+0000 7f9e6da00640 1 --2- 172.21.15.7:0/3308598376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e680b9e90 0x7f9e680c8e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800c3f0 tx=0x7f9e5800c8b0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.566+0000 7f9e6d000640 1 -- 172.21.15.7:0/3308598376 reap_dead start 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.567+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 shutdown_connections 2024-08-19T00:37:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.567+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 >> 172.21.15.7:0/3308598376 conn(0x7f9e6809d510 msgr2=0x7f9e680b8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.567+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 shutdown_connections 2024-08-19T00:37:09.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.568+0000 7f9e6da00640 1 -- 172.21.15.7:0/3308598376 wait complete. 2024-08-19T00:37:09.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.573+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff840ba4a0 con 0x7eff64074120 2024-08-19T00:37:09.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.575+0000 7eff7a000640 1 -- 172.21.15.7:0/3503142262 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff840ba4a0 con 0x7eff64074120 2024-08-19T00:37:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.576+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7eff64074120 msgr2=0x7eff64076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.576+0000 7eff89200640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7eff64074120 0x7eff64076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.576+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff6406bf00 msgr2=0x7eff6406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.576+0000 7eff89200640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff6406bf00 0x7eff6406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff74006fd0 tx=0x7eff74008040 comp rx=0 tx=0).stop 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.576+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff8415e560 msgr2=0x7eff840b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.576+0000 7eff89200640 1 --2- 172.21.15.7:0/3503142262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff8415e560 0x7eff840b6150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff7002a250 tx=0x7eff700046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.576+0000 7eff82800640 1 -- 172.21.15.7:0/3503142262 reap_dead start 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.577+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 shutdown_connections 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.577+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 >> 172.21.15.7:0/3503142262 conn(0x7eff8409d710 msgr2=0x7eff840b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.577+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b54002dd0 con 0x7f3b580740a0 2024-08-19T00:37:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.577+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 shutdown_connections 2024-08-19T00:37:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.577+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febe00b3df0 con 0x7febc0074100 2024-08-19T00:37:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.578+0000 7febdcc00640 1 -- 172.21.15.7:0/2520762314 <== osd.4 v2:172.21.15.162:6806/2900813997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7febe00b3df0 con 0x7febc0074100 2024-08-19T00:37:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.578+0000 7f3b72a00640 1 -- 172.21.15.7:0/3356082528 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b54002dd0 con 0x7f3b580740a0 2024-08-19T00:37:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.577+0000 7eff89200640 1 -- 172.21.15.7:0/3503142262 wait complete. 2024-08-19T00:37:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.579+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7febc0074100 msgr2=0x7febc0076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.579+0000 7febe7800640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7febc0074100 0x7febc0076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.579+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f3b580740a0 msgr2=0x7f3b580764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.579+0000 7f3b81000640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f3b580740a0 0x7f3b580764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febc006be80 msgr2=0x7febc006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7febe7800640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febc006be80 0x7febc006e340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7febcc005880 tx=0x7febcc009040 comp rx=0 tx=0).stop 2024-08-19T00:37:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be80 msgr2=0x7f3b5806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7f3b81000640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be80 0x7f3b5806e340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007920 tx=0x7f3b6c008040 comp rx=0 tx=0).stop 2024-08-19T00:37:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c15a670 msgr2=0x7f3b7c0b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7f3b81000640 1 --2- 172.21.15.7:0/3356082528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c15a670 0x7f3b7c0b46d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b74033000 tx=0x7f3b74004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7f3b7a800640 1 -- 172.21.15.7:0/3356082528 reap_dead start 2024-08-19T00:37:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe00b5840 msgr2=0x7febe00cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7febe7800640 1 --2- 172.21.15.7:0/2520762314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe00b5840 0x7febe00cb990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febd800c7f0 tx=0x7febd800ccb0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7febe5800640 1 -- 172.21.15.7:0/2520762314 reap_dead start 2024-08-19T00:37:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 shutdown_connections 2024-08-19T00:37:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 >> 172.21.15.7:0/3356082528 conn(0x7f3b7c0b5530 msgr2=0x7f3b7c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 shutdown_connections 2024-08-19T00:37:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.580+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 >> 172.21.15.7:0/2520762314 conn(0x7febe008c000 msgr2=0x7febe006cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.581+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 shutdown_connections 2024-08-19T00:37:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.581+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 shutdown_connections 2024-08-19T00:37:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.581+0000 7f3b81000640 1 -- 172.21.15.7:0/3356082528 wait complete. 2024-08-19T00:37:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.581+0000 7febe7800640 1 -- 172.21.15.7:0/2520762314 wait complete. 2024-08-19T00:37:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.583+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb754002dd0 con 0x7fb7580740d0 2024-08-19T00:37:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.583+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04580108d0 con 0x7f04400740a0 2024-08-19T00:37:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.583+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd501f0ec0 con 0x7efd300740a0 2024-08-19T00:37:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.583+0000 7fb775600640 1 -- 172.21.15.7:0/2243483586 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb754002dd0 con 0x7fb7580740d0 2024-08-19T00:37:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.584+0000 7efd47400640 1 -- 172.21.15.7:0/295213438 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd501f0ec0 con 0x7efd300740a0 2024-08-19T00:37:09.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.584+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7fb7580740d0 msgr2=0x7fb7580764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.584+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7efd300740a0 msgr2=0x7efd300764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.584+0000 7efd55e00640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7efd300740a0 0x7efd300764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.584+0000 7fb77ec00640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7fb7580740d0 0x7fb7580764f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb75806beb0 msgr2=0x7fb75806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7fb77ec00640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb75806beb0 0x7fb75806e370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb76c001020 tx=0x7fb76c007000 comp rx=0 tx=0).stop 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb77000c980 msgr2=0x7fb77000ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7fb77ec00640 1 --2- 172.21.15.7:0/2243483586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb77000c980 0x7fb77000ce00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d730 tx=0x7fb76400dbf0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7fb77e200640 1 -- 172.21.15.7:0/2243483586 reap_dead start 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd3006be80 msgr2=0x7efd3006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7efd55e00640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd3006be80 0x7efd3006e340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd40007680 tx=0x7efd40007c30 comp rx=0 tx=0).stop 2024-08-19T00:37:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd50159bf0 msgr2=0x7efd500b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7efd55e00640 1 --2- 172.21.15.7:0/295213438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd50159bf0 0x7efd500b1c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd48036000 tx=0x7efd48004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 shutdown_connections 2024-08-19T00:37:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.585+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 >> 172.21.15.7:0/2243483586 conn(0x7fb770053230 msgr2=0x7fb770036110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.586+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 shutdown_connections 2024-08-19T00:37:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.586+0000 7efd4f400640 1 -- 172.21.15.7:0/295213438 reap_dead start 2024-08-19T00:37:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.586+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 shutdown_connections 2024-08-19T00:37:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.586+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 >> 172.21.15.7:0/295213438 conn(0x7efd5006bc70 msgr2=0x7efd5006c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.586+0000 7fb77ec00640 1 -- 172.21.15.7:0/2243483586 wait complete. 2024-08-19T00:37:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.586+0000 7f0453e00640 1 -- 172.21.15.7:0/3853788300 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04580108d0 con 0x7f04400740a0 2024-08-19T00:37:09.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.586+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 shutdown_connections 2024-08-19T00:37:09.632 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2024-08-19T00:37:09.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-19T00:37:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.587+0000 7efd55e00640 1 -- 172.21.15.7:0/295213438 wait complete. 2024-08-19T00:37:09.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.587+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f04400740a0 msgr2=0x7f04400764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.587+0000 7f0466c00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f04400740a0 0x7f04400764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.588+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f044006be80 msgr2=0x7f044006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.588+0000 7f0466c00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f044006be80 0x7f044006e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f045800bb20 tx=0x7f04600aa000 comp rx=0 tx=0).stop 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.588+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 msgr2=0x7f045803bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.588+0000 7f0466c00640 1 --2- 172.21.15.7:0/3853788300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04580e6e90 0x7f045803bfe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f044c00eb60 tx=0x7f044c00c520 comp rx=0 tx=0).stop 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.588+0000 7f0464c00640 1 -- 172.21.15.7:0/3853788300 reap_dead start 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.588+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 shutdown_connections 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.588+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 >> 172.21.15.7:0/3853788300 conn(0x7f045801fb40 msgr2=0x7f0458055ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.589+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 shutdown_connections 2024-08-19T00:37:09.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.592+0000 7f0466c00640 1 -- 172.21.15.7:0/3853788300 wait complete. 2024-08-19T00:37:09.635 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2024-08-19T00:37:09.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-19T00:37:09.636 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2024-08-19T00:37:09.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-19T00:37:09.637 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2024-08-19T00:37:09.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-19T00:37:09.638 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2024-08-19T00:37:09.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-19T00:37:09.639 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2024-08-19T00:37:09.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-19T00:37:09.641 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-08-19T00:37:09.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-19T00:37:09.642 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-08-19T00:37:09.642 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-19T00:37:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.950+0000 7f7d57200640 1 Processor -- start 2024-08-19T00:37:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.951+0000 7f8ef6e00640 1 Processor -- start 2024-08-19T00:37:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.952+0000 7f8ef6e00640 1 -- start start 2024-08-19T00:37:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.951+0000 7f7d57200640 1 -- start start 2024-08-19T00:37:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.953+0000 7f7d57200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d5815a2a0 0x7f7d580cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.953+0000 7f7d55e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d5815a2a0 0x7f7d580cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.953+0000 7f7d55e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d5815a2a0 0x7f7d580cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35438/0 (socket says 172.21.15.7:35438) 2024-08-19T00:37:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.953+0000 7f7d57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580cf8c0 0x7f7d580b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.953+0000 7f7d55e00640 1 -- 172.21.15.7:0/871088778 learned_addr learned my addr 172.21.15.7:0/871088778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.953+0000 7f7d57200640 1 --2- 172.21.15.7:0/871088778 >> v2:172.21.15.162:3300/0 conn(0x7f7d580b4d40 0x7f7d580cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.954+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7d580cfd30 con 0x7f7d5815a2a0 2024-08-19T00:37:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.954+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7d580b4590 con 0x7f7d580b4d40 2024-08-19T00:37:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.954+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5815a680 con 0x7f7d580cf8c0 2024-08-19T00:37:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.954+0000 7f8ef6e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ee80e2b90 0x7f8ee8007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.954+0000 7f8ef6e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8037b10 0x7f8ee803bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f8ef6e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ee8006270 con 0x7f8ee8005d70 2024-08-19T00:37:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f8ef6e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee8006550 con 0x7f8ee80e2b90 2024-08-19T00:37:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f8ef6e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee8006830 con 0x7f8ee8037b10 2024-08-19T00:37:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f8eef400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8037b10 0x7f8ee803bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.954+0000 7f7d55400640 1 --2- 172.21.15.7:0/871088778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580cf8c0 0x7f7d580b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f7d55e00640 1 -- 172.21.15.7:0/871088778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580cf8c0 msgr2=0x7f7d580b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f7d55e00640 1 --2- 172.21.15.7:0/871088778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580cf8c0 0x7f7d580b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f7d55e00640 1 -- 172.21.15.7:0/871088778 >> v2:172.21.15.162:3300/0 conn(0x7f7d580b4d40 msgr2=0x7f7d580cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f7d55e00640 1 --2- 172.21.15.7:0/871088778 >> v2:172.21.15.162:3300/0 conn(0x7f7d580b4d40 0x7f7d580cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.955+0000 7f7d55e00640 1 -- 172.21.15.7:0/871088778 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d580b3a10 con 0x7f7d5815a2a0 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.956+0000 7f8eefe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ee80e2b90 0x7f8ee8007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.956+0000 7f8eefe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ee80e2b90 0x7f8ee8007310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35450/0 (socket says 172.21.15.7:35450) 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.956+0000 7f8eefe00640 1 -- 172.21.15.7:0/4039214495 learned_addr learned my addr 172.21.15.7:0/4039214495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.957+0000 7f8eefe00640 1 -- 172.21.15.7:0/4039214495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8037b10 msgr2=0x7f8ee803bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.957+0000 7f8eefe00640 1 --2- 172.21.15.7:0/4039214495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8037b10 0x7f8ee803bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.957+0000 7f8eefe00640 1 -- 172.21.15.7:0/4039214495 >> v1:172.21.15.7:6789/0 conn(0x7f8ee8005d70 legacy=0x7f8ee803c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.957+0000 7f8eefe00640 1 -- 172.21.15.7:0/4039214495 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee8006b10 con 0x7f8ee80e2b90 2024-08-19T00:37:09.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.958+0000 7f7cdb200640 1 Processor -- start 2024-08-19T00:37:09.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.958+0000 7f7cdb200640 1 -- start start 2024-08-19T00:37:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.958+0000 7f8eefe00640 1 --2- 172.21.15.7:0/4039214495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 0x7f8ee8007310 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ef006aa30 tx=0x7f8ef0063720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78473a86378b8200 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.957+0000 7f7d55e00640 1 --2- 172.21.15.7:0/871088778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5815a2a0 0x7f7d580cf380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d580715d0 tx=0x7f7d48032a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aea130eafa17dd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.958+0000 7f8eeea00640 1 -- 172.21.15.7:0/4039214495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00b3070 con 0x7f8ee80e2b90 2024-08-19T00:37:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.959+0000 7f8eeea00640 1 -- 172.21.15.7:0/4039214495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef00a6bb0 con 0x7f8ee80e2b90 2024-08-19T00:37:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.959+0000 7f8eeea00640 1 -- 172.21.15.7:0/4039214495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00ae640 con 0x7f8ee80e2b90 2024-08-19T00:37:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.959+0000 7f7d54a00640 1 -- 172.21.15.7:0/871088778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4803b070 con 0x7f7d5815a2a0 2024-08-19T00:37:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f7cdb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc0d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f7cdb200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7cdc0b4f40 0x7f7cdc0d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f7cdb200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cdc0cee00 con 0x7f7cdc0b0e80 2024-08-19T00:37:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f7cdb200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7cdc0cf6d0 con 0x7f7cdc0b4f40 2024-08-19T00:37:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f7cdb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc0d4aa0 con 0x7f7cdc0d4180 2024-08-19T00:37:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f7d54a00640 1 -- 172.21.15.7:0/871088778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d48037860 con 0x7f7d5815a2a0 2024-08-19T00:37:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f8ef6e00640 1 -- 172.21.15.7:0/4039214495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 msgr2=0x7f8ee8007310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f7d54a00640 1 -- 172.21.15.7:0/871088778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48037c70 con 0x7f7d5815a2a0 2024-08-19T00:37:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.960+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/4039214495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 0x7f8ee8007310 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ef006aa30 tx=0x7f8ef0063720 comp rx=0 tx=0).stop 2024-08-19T00:37:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f7cd9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc0d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5815a2a0 msgr2=0x7f7d580cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f17a8600640 1 Processor -- start 2024-08-19T00:37:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f7cd9400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7cdc0b4f40 0x7f7cdc0d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f7cda800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7cdc0b0e80 0x7f7cdc0cfb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46308/0 (socket says 172.21.15.7:46308) 2024-08-19T00:37:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f7cda800640 1 -- 172.21.15.7:0/48748081 learned_addr learned my addr 172.21.15.7:0/48748081 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f7d57200640 1 --2- 172.21.15.7:0/871088778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5815a2a0 0x7f7d580cf380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d580715d0 tx=0x7f7d48032a00 comp rx=0 tx=0).stop 2024-08-19T00:37:09.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f17a8600640 1 -- start start 2024-08-19T00:37:09.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.961+0000 7f8ef6e00640 1 -- 172.21.15.7:0/4039214495 shutdown_connections 2024-08-19T00:37:09.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/4039214495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8037b10 0x7f8ee803bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/4039214495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 0x7f8ee8007310 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f8ef6e00640 1 -- 172.21.15.7:0/4039214495 >> 172.21.15.7:0/4039214495 conn(0x7f8ee803a500 msgr2=0x7f8ee803a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 shutdown_connections 2024-08-19T00:37:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7d57200640 1 --2- 172.21.15.7:0/871088778 >> v2:172.21.15.162:3300/0 conn(0x7f7d580b4d40 0x7f7d580cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7d57200640 1 --2- 172.21.15.7:0/871088778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580cf8c0 0x7f7d580b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7d57200640 1 --2- 172.21.15.7:0/871088778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5815a2a0 0x7f7d580cf380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 >> 172.21.15.7:0/871088778 conn(0x7f7d5806d600 msgr2=0x7f7d5806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f8ef6e00640 1 -- 172.21.15.7:0/4039214495 shutdown_connections 2024-08-19T00:37:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f8ef6e00640 1 -- 172.21.15.7:0/4039214495 wait complete. 2024-08-19T00:37:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 shutdown_connections 2024-08-19T00:37:09.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7cd9400640 1 -- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 msgr2=0x7f7cdc0d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7cd9400640 1 --2- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc0d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7cd9400640 1 -- 172.21.15.7:0/48748081 >> v1:172.21.15.7:6789/0 conn(0x7f7cdc0b0e80 legacy=0x7f7cdc0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.962+0000 7f7cd9400640 1 -- 172.21.15.7:0/48748081 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc0d3020 con 0x7f7cdc0b4f40 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.963+0000 7f7cd9e00640 1 --2- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc0d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.963+0000 7f17a8600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a00b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.963+0000 7f17a8600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f17a00b2160 0x7f17a00b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.963+0000 7f17a8600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a015aa50 con 0x7f17a015a670 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.963+0000 7f17a8600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f17a00cf420 con 0x7f17a00b2160 2024-08-19T00:37:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.963+0000 7f17a8600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f17a00d0260 con 0x7f17a00cefe0 2024-08-19T00:37:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.963+0000 7f7d57200640 1 -- 172.21.15.7:0/871088778 wait complete. 2024-08-19T00:37:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.964+0000 7f11e2c00640 1 Processor -- start 2024-08-19T00:37:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.964+0000 7f7cd9400640 1 --2- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0d27d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097a0 tx=0x7f7ccc02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290b847e422173d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.964+0000 7f17a5c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f17a015a670 0x7f17a00d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:32778/0 (socket says 172.21.15.7:32778) 2024-08-19T00:37:09.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.964+0000 7f17a5c00640 1 -- 172.21.15.7:0/280361108 learned_addr learned my addr 172.21.15.7:0/280361108 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:09.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.964+0000 7f17a6600640 1 --2- 172.21.15.7:0/280361108 >> v2:172.21.15.162:3300/0 conn(0x7f17a00b2160 0x7f17a00b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.964+0000 7f11e2c00640 1 -- start start 2024-08-19T00:37:09.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f7cd8a00640 1 -- 172.21.15.7:0/48748081 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc037070 con 0x7f7cdc0b4f40 2024-08-19T00:37:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f8ef6e00640 1 Processor -- start 2024-08-19T00:37:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f17a5200640 1 --2- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a00b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f7cd8a00640 1 -- 172.21.15.7:0/48748081 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc02ad10 con 0x7f7cdc0b4f40 2024-08-19T00:37:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f7cd8a00640 1 -- 172.21.15.7:0/48748081 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc037070 con 0x7f7cdc0b4f40 2024-08-19T00:37:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f17a6600640 1 -- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 msgr2=0x7f17a00b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f17a6600640 1 --2- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a00b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f17a6600640 1 -- 172.21.15.7:0/280361108 >> v1:172.21.15.162:6789/0 conn(0x7f17a015a670 legacy=0x7f17a00d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f17a6600640 1 -- 172.21.15.7:0/280361108 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a00cf650 con 0x7f17a00b2160 2024-08-19T00:37:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.965+0000 7f8ef6e00640 1 -- start start 2024-08-19T00:37:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.966+0000 7f7d57200640 1 Processor -- start 2024-08-19T00:37:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.966+0000 7f7d57200640 1 -- start start 2024-08-19T00:37:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.966+0000 7fcd2a800640 1 Processor -- start 2024-08-19T00:37:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f7cdb200640 1 -- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 msgr2=0x7f7cdc0d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f7cdb200640 1 --2- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0d27d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097a0 tx=0x7f7ccc02a080 comp rx=0 tx=0).stop 2024-08-19T00:37:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f11e2c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11dc162700 0x7f11dc0717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f11e2c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0733e0 0x7f11dc071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f11e2c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11dc0b3200 con 0x7f11dc0b1bf0 2024-08-19T00:37:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f11e2c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f11dc0ce820 con 0x7f11dc162700 2024-08-19T00:37:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f11e2c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f11dc072f50 con 0x7f11dc0733e0 2024-08-19T00:37:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7fcd2a800640 1 -- start start 2024-08-19T00:37:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f7cdb200640 1 -- 172.21.15.7:0/48748081 shutdown_connections 2024-08-19T00:37:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f7cdb200640 1 --2- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0d27d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f7cdb200640 1 --2- 172.21.15.7:0/48748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc0d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f7cdb200640 1 -- 172.21.15.7:0/48748081 >> 172.21.15.7:0/48748081 conn(0x7f7cdc08dc00 msgr2=0x7f7cdc09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8ef6e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8005d70 0x7f8ee80df880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8ef6e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ee8037b10 0x7f8ee80dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8ef6e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 0x7f8ee804e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8ef6e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee803c980 con 0x7f8ee80e2b90 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8ef6e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee803c800 con 0x7f8ee8037b10 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8ef6e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee80374c0 con 0x7f8ee8005d70 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8eefe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8005d70 0x7f8ee80df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8eefe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8005d70 0x7f8ee80df880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53382/0 (socket says 172.21.15.7:53382) 2024-08-19T00:37:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f8eefe00640 1 -- 172.21.15.7:0/3619092465 learned_addr learned my addr 172.21.15.7:0/3619092465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f8eef400640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ee8037b10 0x7f8ee80dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.967+0000 7f7cdb200640 1 -- 172.21.15.7:0/48748081 shutdown_connections 2024-08-19T00:37:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580b4d40 0x7f7d5814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d57200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d580cf8c0 0x7f7d581f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d57200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d5815a2a0 0x7f7d581f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d57200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b42b0 con 0x7f7d580cf8c0 2024-08-19T00:37:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d57200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b3fd0 con 0x7f7d5815a2a0 2024-08-19T00:37:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d57200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d580b51b0 con 0x7f7d580b4d40 2024-08-19T00:37:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f11e2200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f11dc0b1bf0 0x7f11dc1660e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:32780/0 (socket says 172.21.15.7:32780) 2024-08-19T00:37:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f11e2200640 1 -- 172.21.15.7:0/2403192972 learned_addr learned my addr 172.21.15.7:0/2403192972 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f11e0e00640 1 --2- 172.21.15.7:0/2403192972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0733e0 0x7f11dc071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f8ef4e00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 0x7f8ee804e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f11e1800640 1 --2- 172.21.15.7:0/2403192972 >> v2:172.21.15.7:3300/0 conn(0x7f11dc162700 0x7f11dc0717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d56800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d5815a2a0 0x7f7d581f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d56800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d5815a2a0 0x7f7d581f3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60062/0 (socket says 172.21.15.7:60062) 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7d56800640 1 -- 172.21.15.7:0/392330804 learned_addr learned my addr 172.21.15.7:0/392330804 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d55400640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d580cf8c0 0x7f7d581f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f8eefe00640 1 -- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ee8037b10 msgr2=0x7f8ee80dd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f8eefe00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ee8037b10 0x7f8ee80dd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f8eefe00640 1 -- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 msgr2=0x7f8ee804e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f8eefe00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 0x7f8ee804e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f8eefe00640 1 -- 172.21.15.7:0/3619092465 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee80ddcf0 con 0x7f8ee8005d70 2024-08-19T00:37:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.968+0000 7f7cdb200640 1 -- 172.21.15.7:0/48748081 wait complete. 2024-08-19T00:37:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f11e0e00640 1 -- 172.21.15.7:0/2403192972 >> v2:172.21.15.7:3300/0 conn(0x7f11dc162700 msgr2=0x7f11dc0717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f11e0e00640 1 --2- 172.21.15.7:0/2403192972 >> v2:172.21.15.7:3300/0 conn(0x7f11dc162700 0x7f11dc0717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f11e0e00640 1 -- 172.21.15.7:0/2403192972 >> v1:172.21.15.162:6789/0 conn(0x7f11dc0b1bf0 legacy=0x7f11dc1660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f11e0e00640 1 -- 172.21.15.7:0/2403192972 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc072340 con 0x7f11dc0733e0 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d55e00640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580b4d40 0x7f7d5814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d56800640 1 -- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580b4d40 msgr2=0x7f7d5814df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d56800640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580b4d40 0x7f7d5814df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d56800640 1 -- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d580cf8c0 msgr2=0x7f7d581f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d56800640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d580cf8c0 0x7f7d581f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d56800640 1 -- 172.21.15.7:0/392330804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5814e8e0 con 0x7f7d5815a2a0 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d55e00640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580b4d40 0x7f7d5814df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7f7d55400640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d580cf8c0 0x7f7d581f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.969+0000 7fcd2a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd24162320 0x7fcd240b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f17a6600640 1 --2- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a00b2160 0x7f17a00b2610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f179800be90 tx=0x7f179802c660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e86bdc2c60e0455 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd2a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd24162700 0x7fcd240d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f8eefe00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8005d70 0x7f8ee80df880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ef006a230 tx=0x7f8ef0074d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd2a800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd240cf080 con 0x7fcd240b3960 2024-08-19T00:37:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd2a800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcd240cf3b0 con 0x7fcd24162700 2024-08-19T00:37:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd2a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd240d2dc0 con 0x7fcd24162320 2024-08-19T00:37:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd23400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd24162320 0x7fcd240b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f7cdb200640 1 Processor -- start 2024-08-19T00:37:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd23400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd24162320 0x7fcd240b5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53396/0 (socket says 172.21.15.7:53396) 2024-08-19T00:37:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f179fe00640 1 -- 172.21.15.7:0/280361108 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179803a070 con 0x7f17a00b2160 2024-08-19T00:37:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f7cdb200640 1 -- start start 2024-08-19T00:37:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd23400640 1 -- 172.21.15.7:0/4196609306 learned_addr learned my addr 172.21.15.7:0/4196609306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7fcd22a00640 1 --2- 172.21.15.7:0/4196609306 >> v2:172.21.15.162:3300/0 conn(0x7fcd24162700 0x7fcd240d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f7d56800640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d5815a2a0 0x7f7d581f3350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000b970 tx=0x7f7d5000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f179fe00640 1 -- 172.21.15.7:0/280361108 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1798032480 con 0x7f17a00b2160 2024-08-19T00:37:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f7d4e000640 1 -- 172.21.15.7:0/392330804 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50019070 con 0x7f7d5815a2a0 2024-08-19T00:37:09.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.970+0000 7f179fe00640 1 -- 172.21.15.7:0/280361108 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798032850 con 0x7f17a00b2160 2024-08-19T00:37:09.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f8edfe00640 1 -- 172.21.15.7:0/3619092465 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00b3050 con 0x7f8ee8005d70 2024-08-19T00:37:09.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7fcd22000640 1 -- 172.21.15.7:0/4196609306 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021612859 0 0) 0x7fcd240cf080 con 0x7fcd240b3960 2024-08-19T00:37:09.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7fcd22000640 1 -- 172.21.15.7:0/4196609306 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd08003520 con 0x7fcd240b3960 2024-08-19T00:37:09.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f11e0e00640 1 --2- 172.21.15.7:0/2403192972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0733e0 0x7f11dc071d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097a0 tx=0x7f11c802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55cedc3ba8b7201 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7fcd23400640 1 -- 172.21.15.7:0/4196609306 >> v2:172.21.15.162:3300/0 conn(0x7fcd24162700 msgr2=0x7fcd240d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7fcd23400640 1 --2- 172.21.15.7:0/4196609306 >> v2:172.21.15.162:3300/0 conn(0x7fcd24162700 0x7fcd240d4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7fcd23400640 1 -- 172.21.15.7:0/4196609306 >> v1:172.21.15.7:6789/0 conn(0x7fcd240b3960 legacy=0x7fcd240cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7fcd23400640 1 -- 172.21.15.7:0/4196609306 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240d30a0 con 0x7fcd24162320 2024-08-19T00:37:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f8edfe00640 1 -- 172.21.15.7:0/3619092465 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef00b4040 con 0x7f8ee8005d70 2024-08-19T00:37:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f8edfe00640 1 -- 172.21.15.7:0/3619092465 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00b8810 con 0x7f8ee8005d70 2024-08-19T00:37:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee816c120 con 0x7f8ee8005d70 2024-08-19T00:37:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee804c9a0 con 0x7f8ee8005d70 2024-08-19T00:37:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.972+0000 7f7cdb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc0b0e80 0x7f7cdc0ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.972+0000 7f7cdb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.972+0000 7f7cdb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc1fbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f7d4e000640 1 -- 172.21.15.7:0/392330804 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5000cb40 con 0x7f7d5815a2a0 2024-08-19T00:37:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.971+0000 7f7d4e000640 1 -- 172.21.15.7:0/392330804 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50019070 con 0x7f7d5815a2a0 2024-08-19T00:37:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.972+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5814ebc0 con 0x7f7d5815a2a0 2024-08-19T00:37:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.972+0000 7f7cd9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc0b0e80 0x7f7cdc0ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7fa7db600640 1 Processor -- start 2024-08-19T00:37:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5814f180 con 0x7f7d5815a2a0 2024-08-19T00:37:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f11dbe00640 1 -- 172.21.15.7:0/2403192972 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8037070 con 0x7f11dc0733e0 2024-08-19T00:37:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f17a8600640 1 -- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a00b2160 msgr2=0x7f17a00b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f17a8600640 1 --2- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a00b2160 0x7f17a00b2610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f179800be90 tx=0x7f179802c660 comp rx=0 tx=0).stop 2024-08-19T00:37:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f11dbe00640 1 -- 172.21.15.7:0/2403192972 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c8032440 con 0x7f11dc0733e0 2024-08-19T00:37:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f11dbe00640 1 -- 172.21.15.7:0/2403192972 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8032810 con 0x7f11dc0733e0 2024-08-19T00:37:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7fcd23400640 1 --2- 172.21.15.7:0/4196609306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd24162320 0x7fcd240b5840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd140098a0 tx=0x7fcd1402a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5c7aee83a3d56f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7fcd22000640 1 -- 172.21.15.7:0/4196609306 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14037070 con 0x7fcd24162320 2024-08-19T00:37:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7fcd22000640 1 -- 172.21.15.7:0/4196609306 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd14032440 con 0x7fcd24162320 2024-08-19T00:37:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f11e2c00640 1 -- 172.21.15.7:0/2403192972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0733e0 msgr2=0x7f11dc071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f11e2c00640 1 --2- 172.21.15.7:0/2403192972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0733e0 0x7f11dc071d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097a0 tx=0x7f11c802a180 comp rx=0 tx=0).stop 2024-08-19T00:37:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f11e2c00640 1 -- 172.21.15.7:0/2403192972 shutdown_connections 2024-08-19T00:37:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ecc005290 con 0x7f8ee8005d70 2024-08-19T00:37:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7cdb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0d2d10 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7cd9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7cd9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60088/0 (socket says 172.21.15.7:60088) 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7cd9400640 1 -- 172.21.15.7:0/1395749865 learned_addr learned my addr 172.21.15.7:0/1395749865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7cdb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0cf360 con 0x7f7cdc0b4f40 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc15e730 con 0x7f7cdc0d4180 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7f7cda800640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc1fbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f7cd9e00640 1 -- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 msgr2=0x7f7cdc1fbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f7cd9e00640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc1fbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f7cd9e00640 1 -- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 msgr2=0x7f7cdc0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f7cd9e00640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7f7cd9e00640 1 -- 172.21.15.7:0/1395749865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc0cad60 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.974+0000 7fcd22000640 1 -- 172.21.15.7:0/4196609306 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14032810 con 0x7fcd24162320 2024-08-19T00:37:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fcd2a800640 1 -- 172.21.15.7:0/4196609306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd24162320 msgr2=0x7fcd240b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fcd2a800640 1 --2- 172.21.15.7:0/4196609306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd24162320 0x7fcd240b5840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd140098a0 tx=0x7fcd1402a1f0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fcd2a800640 1 -- 172.21.15.7:0/4196609306 shutdown_connections 2024-08-19T00:37:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fcd2a800640 1 --2- 172.21.15.7:0/4196609306 >> v2:172.21.15.162:3300/0 conn(0x7fcd24162700 0x7fcd240d4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fcd2a800640 1 --2- 172.21.15.7:0/4196609306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd24162320 0x7fcd240b5840 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fcd2a800640 1 -- 172.21.15.7:0/4196609306 >> 172.21.15.7:0/4196609306 conn(0x7fcd2408c000 msgr2=0x7fcd240d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f11e2c00640 1 --2- 172.21.15.7:0/2403192972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0733e0 0x7f11dc071d30 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097a0 tx=0x7f11c802a180 comp rx=0 tx=0).stop 2024-08-19T00:37:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f11e2c00640 1 --2- 172.21.15.7:0/2403192972 >> v2:172.21.15.7:3300/0 conn(0x7f11dc162700 0x7f11dc0717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f11e2c00640 1 -- 172.21.15.7:0/2403192972 >> 172.21.15.7:0/2403192972 conn(0x7f11dc06b850 msgr2=0x7f11dc06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f7cd9400640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:10.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f11e2c00640 1 -- 172.21.15.7:0/2403192972 shutdown_connections 2024-08-19T00:37:10.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.973+0000 7fa7db600640 1 -- start start 2024-08-19T00:37:10.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f7cd9e00640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc0b0e80 0x7f7cdc0ca820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400efc0 tx=0x7f7cd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f17a8600640 1 -- 172.21.15.7:0/280361108 shutdown_connections 2024-08-19T00:37:10.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f17a8600640 1 --2- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a00b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f17a8600640 1 --2- 172.21.15.7:0/280361108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a00b2160 0x7f17a00b2610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fa7db600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d40cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fa7db600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7d40ce460 0x7fa7d40d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fa7db600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d406e660 con 0x7fa7d40d0900 2024-08-19T00:37:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fa7db600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d40ae000 con 0x7fa7d40ce460 2024-08-19T00:37:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7fa7db600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d406e940 con 0x7fa7d40aeb10 2024-08-19T00:37:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f17a8600640 1 -- 172.21.15.7:0/280361108 >> 172.21.15.7:0/280361108 conn(0x7f17a00b5530 msgr2=0x7f17a00b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7fa7d9600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa7d40d0900 0x7fa7d40b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:32792/0 (socket says 172.21.15.7:32792) 2024-08-19T00:37:10.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7fa7d9600640 1 -- 172.21.15.7:0/1762684604 learned_addr learned my addr 172.21.15.7:0/1762684604 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f7cd2000640 1 -- 172.21.15.7:0/1395749865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4018020 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5806e0f0 con 0x7f7d5815a2a0 2024-08-19T00:37:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.977+0000 7f7d4e000640 1 -- 172.21.15.7:0/392330804 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d5001c070 con 0x7f7d5815a2a0 2024-08-19T00:37:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7fa7d8c00640 1 --2- 172.21.15.7:0/1762684604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d40cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7fa7d3e00640 1 -- 172.21.15.7:0/1762684604 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228447217 0 0) 0x7fa7d406e660 con 0x7fa7d40d0900 2024-08-19T00:37:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.977+0000 7fa7d3e00640 1 -- 172.21.15.7:0/1762684604 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7b8003520 con 0x7fa7d40d0900 2024-08-19T00:37:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f7cd2000640 1 -- 172.21.15.7:0/1395749865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd4014680 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f7cd2000640 1 -- 172.21.15.7:0/1395749865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4014a70 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc0cbd70 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc0cc330 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.975+0000 7f11e2c00640 1 -- 172.21.15.7:0/2403192972 wait complete. 2024-08-19T00:37:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.978+0000 7f17a8600640 1 -- 172.21.15.7:0/280361108 shutdown_connections 2024-08-19T00:37:10.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7fcd2a800640 1 -- 172.21.15.7:0/4196609306 shutdown_connections 2024-08-19T00:37:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.976+0000 7fcd2a800640 1 -- 172.21.15.7:0/4196609306 wait complete. 2024-08-19T00:37:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.977+0000 7fa7d8c00640 1 -- 172.21.15.7:0/1762684604 >> v2:172.21.15.7:3300/0 conn(0x7fa7d40ce460 msgr2=0x7fa7d40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.977+0000 7fa7d8c00640 1 --2- 172.21.15.7:0/1762684604 >> v2:172.21.15.7:3300/0 conn(0x7fa7d40ce460 0x7fa7d40d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.977+0000 7fa7d8c00640 1 -- 172.21.15.7:0/1762684604 >> v1:172.21.15.162:6789/0 conn(0x7fa7d40d0900 legacy=0x7fa7d40b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.977+0000 7fa7d8c00640 1 -- 172.21.15.7:0/1762684604 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d406ec20 con 0x7fa7d40aeb10 2024-08-19T00:37:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.978+0000 7f17a8600640 1 -- 172.21.15.7:0/280361108 wait complete. 2024-08-19T00:37:10.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.978+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc09dc80 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.978+0000 7f11e2c00640 1 Processor -- start 2024-08-19T00:37:10.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.979+0000 7fcd2a800640 1 Processor -- start 2024-08-19T00:37:10.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.979+0000 7f11e2c00640 1 -- start start 2024-08-19T00:37:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.979+0000 7fa7d8c00640 1 --2- 172.21.15.7:0/1762684604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d40cf3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40097a0 tx=0x7fa7c402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=278d81a5583f9490 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.979+0000 7f7d4e000640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7d3806c030 0x7f7d3806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f7d4e000640 1 -- 172.21.15.7:0/392330804 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d5008a810 con 0x7f7d5815a2a0 2024-08-19T00:37:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.979+0000 7f8edfe00640 1 -- 172.21.15.7:0/3619092465 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ef00c1020 con 0x7f8ee8005d70 2024-08-19T00:37:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.979+0000 7fcd2a800640 1 -- start start 2024-08-19T00:37:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f8edfe00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ed406be80 0x7f8ed406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f11e2c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0b1bf0 0x7f11dc157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f7d55e00640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7d3806c030 0x7f7d3806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f11e2c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11dc162700 0x7f11dc15fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f11e2c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc15e770 0x7f11dc165250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7f8e04000640 1 Processor -- start 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd2a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd240b3960 0x7fcd24160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd2a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd24162320 0x7fcd240c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd2a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd24162700 0x7fcd240c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd2a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24162b40 con 0x7fcd24162700 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd2a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240d3380 con 0x7fcd24162320 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f11e2c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc072be0 con 0x7f11dc15e770 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f11e2c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc072900 con 0x7f11dc162700 2024-08-19T00:37:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f11e2c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f11dc0b20a0 con 0x7f11dc0b1bf0 2024-08-19T00:37:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.980+0000 7f8edfe00640 1 -- 172.21.15.7:0/3619092465 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ef0126e00 con 0x7f8ee8005d70 2024-08-19T00:37:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd2a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd24160570 con 0x7fcd240b3960 2024-08-19T00:37:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7f8e04000640 1 -- start start 2024-08-19T00:37:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7f8eef400640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ed406be80 0x7f8ed406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd22a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd24162320 0x7fcd240c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd22a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd24162320 0x7fcd240c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60092/0 (socket says 172.21.15.7:60092) 2024-08-19T00:37:10.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd22a00640 1 -- 172.21.15.7:0/3119703096 learned_addr learned my addr 172.21.15.7:0/3119703096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:10.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7f11e2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc15e770 0x7f11dc165250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.981+0000 7fcd23e00640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd24162700 0x7fcd240c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f7d55e00640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7d3806c030 0x7f7d3806e4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d4803d000 tx=0x7f7d48042040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7fcd23400640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd240b3960 0x7fcd24160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11dc162700 0x7f11dc15fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11dc162700 0x7f11dc15fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60098/0 (socket says 172.21.15.7:60098) 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e0e00640 1 -- 172.21.15.7:0/996812775 learned_addr learned my addr 172.21.15.7:0/996812775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e1800640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0b1bf0 0x7f11dc157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e2200640 1 -- 172.21.15.7:0/996812775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0b1bf0 msgr2=0x7f11dc157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e2200640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0b1bf0 0x7f11dc157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e2200640 1 -- 172.21.15.7:0/996812775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11dc162700 msgr2=0x7f11dc15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e2200640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11dc162700 0x7f11dc15fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f11e2200640 1 -- 172.21.15.7:0/996812775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc157660 con 0x7f11dc15e770 2024-08-19T00:37:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7f8eef400640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ed406be80 0x7f8ed406e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ee816c790 tx=0x7f8ee4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7fcd22a00640 1 -- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd240b3960 msgr2=0x7fcd24160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7fcd22a00640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd240b3960 0x7fcd24160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7fcd22a00640 1 -- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd24162700 msgr2=0x7fcd240c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.982+0000 7fcd22a00640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd24162700 0x7fcd240c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7fcd22a00640 1 -- 172.21.15.7:0/3119703096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240c8090 con 0x7fcd24162320 2024-08-19T00:37:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7fcd23e00640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd24162700 0x7fcd240c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e04000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc0ce500 0x7f8dfc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e04000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8dfc0d03c0 0x7f8dfc0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f17a8600640 1 Processor -- start 2024-08-19T00:37:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e04000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dfc06f7f0 con 0x7f8dfc159bf0 2024-08-19T00:37:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e04000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8dfc0cee80 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e04000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc0d0d70 con 0x7f8dfc0ce500 2024-08-19T00:37:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f11e2200640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc15e770 0x7f11dc165250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11d400ca70 tx=0x7f11d400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7fcd22a00640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd24162320 0x7fcd240c9130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000d5d0 tx=0x7fcd1000da90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f7cd2000640 1 -- 172.21.15.7:0/1395749865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cd4005d10 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e00c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc0ce500 0x7f8dfc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e00c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc0ce500 0x7f8dfc0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53434/0 (socket says 172.21.15.7:53434) 2024-08-19T00:37:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f8e00c00640 1 -- 172.21.15.7:0/252992453 learned_addr learned my addr 172.21.15.7:0/252992453 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7fcd1b400640 1 -- 172.21.15.7:0/3119703096 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10004240 con 0x7fcd24162320 2024-08-19T00:37:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7f7d4e000640 1 -- 172.21.15.7:0/392330804 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7d50059120 con 0x7f7d5815a2a0 2024-08-19T00:37:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7fcd1b400640 1 -- 172.21.15.7:0/3119703096 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd100043e0 con 0x7fcd24162320 2024-08-19T00:37:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7fcd1b400640 1 -- 172.21.15.7:0/3119703096 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003810 con 0x7fcd24162320 2024-08-19T00:37:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7f8e02000640 1 --2- 172.21.15.7:0/252992453 >> v2:172.21.15.7:3300/0 conn(0x7f8dfc0d03c0 0x7f8dfc0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7f8e00c00640 1 -- 172.21.15.7:0/252992453 >> v2:172.21.15.7:3300/0 conn(0x7f8dfc0d03c0 msgr2=0x7f8dfc0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7f8e00c00640 1 --2- 172.21.15.7:0/252992453 >> v2:172.21.15.7:3300/0 conn(0x7f8dfc0d03c0 0x7f8dfc0d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7f8e00c00640 1 -- 172.21.15.7:0/252992453 >> v1:172.21.15.7:6789/0 conn(0x7f8dfc159bf0 legacy=0x7f8dfc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7f8e00c00640 1 -- 172.21.15.7:0/252992453 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc06f510 con 0x7f8dfc0ce500 2024-08-19T00:37:10.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd240c8370 con 0x7fcd24162320 2024-08-19T00:37:10.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.984+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd240c8930 con 0x7fcd24162320 2024-08-19T00:37:10.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.983+0000 7f17a8600640 1 -- start start 2024-08-19T00:37:10.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a8600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17a00b2160 0x7f17a01f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a8600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a0099b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a8600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a015a670 0x7f17a00adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a8600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00cfc10 con 0x7f17a00b2160 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a8600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00d0e00 con 0x7f17a015a670 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a8600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f17a00cfef0 con 0x7f17a00cefe0 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a0099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a0099b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53442/0 (socket says 172.21.15.7:53442) 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f17a5200640 1 -- 172.21.15.7:0/1161463547 learned_addr learned my addr 172.21.15.7:0/1161463547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7fa7d3e00640 1 -- 172.21.15.7:0/1762684604 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4037070 con 0x7fa7d40aeb10 2024-08-19T00:37:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7fa7d3e00640 1 -- 172.21.15.7:0/1762684604 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c4032440 con 0x7fa7d40aeb10 2024-08-19T00:37:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7fa7d3e00640 1 -- 172.21.15.7:0/1762684604 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4032810 con 0x7fa7d40aeb10 2024-08-19T00:37:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f8e00c00640 1 --2- 172.21.15.7:0/252992453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc0ce500 0x7f8dfc0ce940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009870 tx=0x7f8de802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecbbb718fcf87d31 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f17a6600640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a015a670 0x7f17a00adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f17a5200640 1 -- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a015a670 msgr2=0x7f17a00adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f17a5200640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a015a670 0x7f17a00adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f17a5200640 1 -- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17a00b2160 msgr2=0x7f17a01f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f17a5200640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17a00b2160 0x7f17a01f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f17a5200640 1 -- 172.21.15.7:0/1161463547 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a009a600 con 0x7f17a00cefe0 2024-08-19T00:37:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f7cd2000640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cbc06be30 0x7f7cbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.985+0000 7f7cd2000640 1 -- 172.21.15.7:0/1395749865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7cd408bb10 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f8dfbe00640 1 -- 172.21.15.7:0/252992453 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8037070 con 0x7f8dfc0ce500 2024-08-19T00:37:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f8dfbe00640 1 -- 172.21.15.7:0/252992453 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de8032440 con 0x7f8dfc0ce500 2024-08-19T00:37:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f8dfbe00640 1 -- 172.21.15.7:0/252992453 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8032810 con 0x7f8dfc0ce500 2024-08-19T00:37:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f7cd9400640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cbc06be30 0x7f7cbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f17a6600640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a015a670 0x7f17a00adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7f8edfe00640 1 -- 172.21.15.7:0/3619092465 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8ef00c8020 con 0x7f8ee8005d70 2024-08-19T00:37:10.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.986+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd24161f20 con 0x7fcd24162320 2024-08-19T00:37:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7fa7db600640 1 -- 172.21.15.7:0/1762684604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 msgr2=0x7fa7d40cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7fa7db600640 1 --2- 172.21.15.7:0/1762684604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d40cf3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40097a0 tx=0x7fa7c402a180 comp rx=0 tx=0).stop 2024-08-19T00:37:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7fa7db600640 1 -- 172.21.15.7:0/1762684604 shutdown_connections 2024-08-19T00:37:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7fa7db600640 1 --2- 172.21.15.7:0/1762684604 >> v2:172.21.15.7:3300/0 conn(0x7fa7d40ce460 0x7fa7d40d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7fa7db600640 1 --2- 172.21.15.7:0/1762684604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d40cf3c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7fa7db600640 1 -- 172.21.15.7:0/1762684604 >> 172.21.15.7:0/1762684604 conn(0x7fa7d406bc70 msgr2=0x7fa7d406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7f8e04000640 1 -- 172.21.15.7:0/252992453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc0ce500 msgr2=0x7f8dfc0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7f8e04000640 1 --2- 172.21.15.7:0/252992453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc0ce500 0x7f8dfc0ce940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009870 tx=0x7f8de802a180 comp rx=0 tx=0).stop 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7f8e04000640 1 -- 172.21.15.7:0/252992453 shutdown_connections 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7f8e04000640 1 --2- 172.21.15.7:0/252992453 >> v2:172.21.15.7:3300/0 conn(0x7f8dfc0d03c0 0x7f8dfc0d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7f8e04000640 1 --2- 172.21.15.7:0/252992453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc0ce500 0x7f8dfc0ce940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7f8e04000640 1 -- 172.21.15.7:0/252992453 >> 172.21.15.7:0/252992453 conn(0x7f8dfc06bc70 msgr2=0x7f8dfc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.987+0000 7f8e04000640 1 -- 172.21.15.7:0/252992453 shutdown_connections 2024-08-19T00:37:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7f7cd9400640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cbc06be30 0x7f7cbc06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097a0 tx=0x7f7ccc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7fa7db600640 1 -- 172.21.15.7:0/1762684604 shutdown_connections 2024-08-19T00:37:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7f17a5200640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a0099b00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f178c00d7d0 tx=0x7f178c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7f8e04000640 1 -- 172.21.15.7:0/252992453 wait complete. 2024-08-19T00:37:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7f179d600640 1 -- 172.21.15.7:0/1161463547 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c004020 con 0x7f17a00cefe0 2024-08-19T00:37:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7f179d600640 1 -- 172.21.15.7:0/1161463547 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178c0041e0 con 0x7f17a00cefe0 2024-08-19T00:37:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7f179d600640 1 -- 172.21.15.7:0/1161463547 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c0043d0 con 0x7f17a00cefe0 2024-08-19T00:37:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7f17a8600640 1 -- 172.21.15.7:0/1161463547 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a009a870 con 0x7f17a00cefe0 2024-08-19T00:37:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.989+0000 7f17a8600640 1 -- 172.21.15.7:0/1161463547 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a00ae880 con 0x7f17a00cefe0 2024-08-19T00:37:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.988+0000 7fa7db600640 1 -- 172.21.15.7:0/1762684604 wait complete. 2024-08-19T00:37:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.990+0000 7fa7db600640 1 Processor -- start 2024-08-19T00:37:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.990+0000 7f8e04000640 1 Processor -- start 2024-08-19T00:37:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.991+0000 7f8e04000640 1 -- start start 2024-08-19T00:37:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.989+0000 7fcd1b400640 1 -- 172.21.15.7:0/3119703096 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd100039b0 con 0x7fcd24162320 2024-08-19T00:37:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.991+0000 7fcd1b400640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd0406beb0 0x7fcd0406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.991+0000 7f11d9600640 1 -- 172.21.15.7:0/996812775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d4017070 con 0x7f11dc15e770 2024-08-19T00:37:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.991+0000 7f11d9600640 1 -- 172.21.15.7:0/996812775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d400ab70 con 0x7f11dc15e770 2024-08-19T00:37:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.991+0000 7f11d9600640 1 -- 172.21.15.7:0/996812775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d4012400 con 0x7f11dc15e770 2024-08-19T00:37:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.991+0000 7fcd1b400640 1 -- 172.21.15.7:0/3119703096 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd1008bb50 con 0x7fcd24162320 2024-08-19T00:37:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a00afdc0 con 0x7f17a00cefe0 2024-08-19T00:37:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7f11e2c00640 1 -- 172.21.15.7:0/996812775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11dc160280 con 0x7f11dc15e770 2024-08-19T00:37:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.991+0000 7f7cd2000640 1 -- 172.21.15.7:0/1395749865 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7cd4022030 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7f8e04000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dfc0ce500 0x7f8dfc150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7f8e04000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dfc0d03c0 0x7f8dfc1fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7f11e2c00640 1 -- 172.21.15.7:0/996812775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11dc15ef80 con 0x7f11dc15e770 2024-08-19T00:37:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7f8e04000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc159bf0 0x7f8dfc15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7fcd1b400640 1 -- 172.21.15.7:0/3119703096 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcd1005a4e0 con 0x7fcd24162320 2024-08-19T00:37:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.992+0000 7fcd23400640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd0406beb0 0x7fcd0406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.994+0000 7fcd23400640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd0406beb0 0x7fcd0406e370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd14034000 tx=0x7fcd1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.994+0000 7fa7db600640 1 -- start start 2024-08-19T00:37:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.993+0000 7f8e04000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc072f40 con 0x7f8dfc0ce500 2024-08-19T00:37:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.993+0000 7f8e04000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc072c60 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.993+0000 7f8e04000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc073b70 con 0x7f8dfc159bf0 2024-08-19T00:37:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7fa7db600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d409dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.994+0000 7f179d600640 1 -- 172.21.15.7:0/1161463547 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f178c01b020 con 0x7f17a00cefe0 2024-08-19T00:37:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7fa7db600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d40ce460 0x7fa7d4162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7fa7db600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d40d0900 0x7fa7d4165230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7fa7db600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40cf900 con 0x7fa7d40ce460 2024-08-19T00:37:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7fa7db600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d406f1e0 con 0x7fa7d40d0900 2024-08-19T00:37:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7fa7db600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d406f700 con 0x7fa7d40aeb10 2024-08-19T00:37:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dfc0d03c0 0x7f8dfc1fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dfc0d03c0 0x7f8dfc1fc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60108/0 (socket says 172.21.15.7:60108) 2024-08-19T00:37:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 -- 172.21.15.7:0/2494364331 learned_addr learned my addr 172.21.15.7:0/2494364331 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e02000640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc159bf0 0x7f8dfc15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 -- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc159bf0 msgr2=0x7f8dfc15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc159bf0 0x7f8dfc15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 -- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dfc0ce500 msgr2=0x7f8dfc150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dfc0ce500 0x7f8dfc150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.995+0000 7f8e00c00640 1 -- 172.21.15.7:0/2494364331 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc1fc6e0 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7d8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d409dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7d8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d409dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53464/0 (socket says 172.21.15.7:53464) 2024-08-19T00:37:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7d8c00640 1 -- 172.21.15.7:0/3387851593 learned_addr learned my addr 172.21.15.7:0/3387851593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7d9600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d40d0900 0x7fa7d4165230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.994+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11dc0b2430 con 0x7f11dc15e770 2024-08-19T00:37:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7f8e00c00640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dfc0d03c0 0x7f8dfc1fc1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009870 tx=0x7f8de80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7cbe00640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d40ce460 0x7fa7d4162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7f8df9600640 1 -- 172.21.15.7:0/2494364331 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8041020 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7d8c00640 1 -- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d40d0900 msgr2=0x7fa7d4165230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7d8c00640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d40d0900 0x7fa7d4165230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7fa7d8c00640 1 -- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d40ce460 msgr2=0x7fa7d4162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7f8df9600640 1 -- 172.21.15.7:0/2494364331 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de80306c0 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.996+0000 7f8df9600640 1 -- 172.21.15.7:0/2494364331 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8037040 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.997+0000 7f179d600640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f178006be60 0x7f178006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.997+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc160500 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.997+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc155220 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.997+0000 7f179d600640 1 -- 172.21.15.7:0/1161463547 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f178c08ace0 con 0x7f17a00cefe0 2024-08-19T00:37:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.998+0000 7f17a5c00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f178006be60 0x7f178006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.998+0000 7fa7d8c00640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d40ce460 0x7fa7d4162ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.998+0000 7fa7d8c00640 1 -- 172.21.15.7:0/3387851593 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d414e820 con 0x7fa7d40aeb10 2024-08-19T00:37:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.998+0000 7fa7cbe00640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d40ce460 0x7fa7d4162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.999+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc159fd0 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:09.999+0000 7f17a5c00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f178006be60 0x7f178006e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f179400ab90 tx=0x7f1794009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.000+0000 7f11d9600640 1 -- 172.21.15.7:0/996812775 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11d401a070 con 0x7f11dc15e770 2024-08-19T00:37:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.001+0000 7f179d600640 1 -- 172.21.15.7:0/1161463547 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f178c059680 con 0x7f17a00cefe0 2024-08-19T00:37:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.001+0000 7fa7d8c00640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d409dee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40098c0 tx=0x7fa7c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.001+0000 7f8df9600640 1 -- 172.21.15.7:0/2494364331 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8de8044020 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.001+0000 7f11d9600640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11bc06bf00 0x7f11bc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.002+0000 7f11d9600640 1 -- 172.21.15.7:0/996812775 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f11d408aa30 con 0x7f11dc15e770 2024-08-19T00:37:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.003+0000 7f11e1800640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11bc06bf00 0x7f11bc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.004+0000 7f11e1800640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11bc06bf00 0x7f11bc06e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009a30 tx=0x7f11d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.004+0000 7f8df9600640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ddc06bf00 0x7f8ddc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.004+0000 7f8df9600640 1 -- 172.21.15.7:0/2494364331 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8de80ab6a0 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.005+0000 7fa7d1600640 1 -- 172.21.15.7:0/3387851593 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4037040 con 0x7fa7d40aeb10 2024-08-19T00:37:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.004+0000 7f8e01600640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ddc06bf00 0x7f8ddc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.005+0000 7fa7d1600640 1 -- 172.21.15.7:0/3387851593 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c4042070 con 0x7fa7d40aeb10 2024-08-19T00:37:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.005+0000 7fa7d1600640 1 -- 172.21.15.7:0/3387851593 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4030940 con 0x7fa7d40aeb10 2024-08-19T00:37:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.005+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d414eb00 con 0x7fa7d40aeb10 2024-08-19T00:37:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.005+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d4164d10 con 0x7fa7d40aeb10 2024-08-19T00:37:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.005+0000 7f8e01600640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ddc06bf00 0x7f8ddc06e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8df0003cc0 tx=0x7f8df00079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.007+0000 7f8df9600640 1 -- 172.21.15.7:0/2494364331 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8de804b030 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.008+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac005290 con 0x7fa7d40aeb10 2024-08-19T00:37:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.009+0000 7fa7d1600640 1 -- 172.21.15.7:0/3387851593 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7c4030ae0 con 0x7fa7d40aeb10 2024-08-19T00:37:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.009+0000 7f11d9600640 1 -- 172.21.15.7:0/996812775 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f11dc157660 con 0x7f11dc15e770 2024-08-19T00:37:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.011+0000 7fa7d1600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7b006be80 0x7fa7b006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.011+0000 7fa7d1600640 1 -- 172.21.15.7:0/3387851593 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa7c40ab6e0 con 0x7fa7d40aeb10 2024-08-19T00:37:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.012+0000 7fa7cbe00640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7b006be80 0x7fa7b006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.015+0000 7fa7cbe00640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7b006be80 0x7fa7b006e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7d41554c0 tx=0x7fa7bc0073c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.015+0000 7fa7d1600640 1 -- 172.21.15.7:0/3387851593 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa7c407a070 con 0x7fa7d40aeb10 2024-08-19T00:37:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.417+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcd2408c410 con 0x7fcd24162320 2024-08-19T00:37:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.418+0000 7fcd1b400640 1 -- 172.21.15.7:0/3119703096 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd10059de0 con 0x7fcd24162320 2024-08-19T00:37:10.422 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2024-08-19T00:37:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.421+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd0406beb0 msgr2=0x7fcd0406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.421+0000 7fcd2a800640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd0406beb0 0x7fcd0406e370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd14034000 tx=0x7fcd1402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd24162320 msgr2=0x7fcd240c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd24162320 0x7fcd240c9130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000d5d0 tx=0x7fcd1000da90 comp rx=0 tx=0).stop 2024-08-19T00:37:10.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 shutdown_connections 2024-08-19T00:37:10.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd0406beb0 0x7fcd0406e370 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd24162700 0x7fcd240c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd24162320 0x7fcd240c9130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 --2- 172.21.15.7:0/3119703096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd240b3960 0x7fcd24160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 >> 172.21.15.7:0/3119703096 conn(0x7fcd2408c000 msgr2=0x7fcd2406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.422+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 shutdown_connections 2024-08-19T00:37:10.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.423+0000 7fcd2a800640 1 -- 172.21.15.7:0/3119703096 wait complete. 2024-08-19T00:37:10.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.426+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7cdc06e3f0 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.427+0000 7f7cd2000640 1 -- 172.21.15.7:0/1395749865 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7cd4010040 con 0x7f7cdc0b0e80 2024-08-19T00:37:10.428 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-08-19T00:37:10.429 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-08-19T00:37:10.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.428+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7d5806ddf0 con 0x7f7d5815a2a0 2024-08-19T00:37:10.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.430+0000 7f7d4e000640 1 -- 172.21.15.7:0/392330804 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d50058a20 con 0x7f7d5815a2a0 2024-08-19T00:37:10.431 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-08-19T00:37:10.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.430+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cbc06be30 msgr2=0x7f7cbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.430+0000 7f7cdb200640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cbc06be30 0x7f7cbc06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097a0 tx=0x7f7ccc02e000 comp rx=0 tx=0).stop 2024-08-19T00:37:10.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.430+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc0b0e80 msgr2=0x7f7cdc0ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.430+0000 7f7cdb200640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc0b0e80 0x7f7cdc0ca820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400efc0 tx=0x7f7cd400c490 comp rx=0 tx=0).stop 2024-08-19T00:37:10.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.427+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8ecc005580 con 0x7f8ee8005d70 2024-08-19T00:37:10.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.428+0000 7f8edfe00640 1 -- 172.21.15.7:0/3619092465 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ef00f5790 con 0x7f8ee8005d70 2024-08-19T00:37:10.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.431+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 shutdown_connections 2024-08-19T00:37:10.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.431+0000 7f7cdb200640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cbc06be30 0x7f7cbc06e2f0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097a0 tx=0x7f7ccc02e000 comp rx=0 tx=0).stop 2024-08-19T00:37:10.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.431+0000 7f7cdb200640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cdc0d4180 0x7f7cdc1fbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.431+0000 7f7cdb200640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cdc0b4f40 0x7f7cdc0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.431+0000 7f7cdb200640 1 --2- 172.21.15.7:0/1395749865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc0b0e80 0x7f7cdc0ca820 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.431+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 >> 172.21.15.7:0/1395749865 conn(0x7f7cdc08dc00 msgr2=0x7f7cdc0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ed406be80 msgr2=0x7f8ed406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ed406be80 0x7f8ed406e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ee816c790 tx=0x7f8ee4009190 comp rx=0 tx=0).stop 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8005d70 msgr2=0x7f8ee80df880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8005d70 0x7f8ee80df880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ef006a230 tx=0x7f8ef0074d20 comp rx=0 tx=0).stop 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 shutdown_connections 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ed406be80 0x7f8ed406e340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee80e2b90 0x7f8ee804e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ee8037b10 0x7f8ee80dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 --2- 172.21.15.7:0/3619092465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ee8005d70 0x7f8ee80df880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.432+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 >> 172.21.15.7:0/3619092465 conn(0x7f8ee803a500 msgr2=0x7f8ee8054460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.433+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8dfc06c980 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.433+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 shutdown_connections 2024-08-19T00:37:10.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.433+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 shutdown_connections 2024-08-19T00:37:10.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.433+0000 7f8ef6e00640 1 -- 172.21.15.7:0/3619092465 wait complete. 2024-08-19T00:37:10.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.433+0000 7f7cdb200640 1 -- 172.21.15.7:0/1395749865 wait complete. 2024-08-19T00:37:10.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.433+0000 7f8df9600640 1 -- 172.21.15.7:0/2494364331 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8dfc1fc6e0 con 0x7f8dfc0d03c0 2024-08-19T00:37:10.437 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7d3806c030 msgr2=0x7f7d3806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7d3806c030 0x7f7d3806e4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d4803d000 tx=0x7f7d48042040 comp rx=0 tx=0).stop 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d5815a2a0 msgr2=0x7f7d581f3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d5815a2a0 0x7f7d581f3350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000b970 tx=0x7f7d5000be30 comp rx=0 tx=0).stop 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 shutdown_connections 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7d3806c030 0x7f7d3806e4f0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d4803d000 tx=0x7f7d48042040 comp rx=0 tx=0).stop 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d5815a2a0 0x7f7d581f3350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d580cf8c0 0x7f7d581f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 --2- 172.21.15.7:0/392330804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d580b4d40 0x7f7d5814df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.434+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 >> 172.21.15.7:0/392330804 conn(0x7f7d5806d600 msgr2=0x7f7d580b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.435+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 shutdown_connections 2024-08-19T00:37:10.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.436+0000 7f7d57200640 1 -- 172.21.15.7:0/392330804 wait complete. 2024-08-19T00:37:10.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.436+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f17a00afae0 con 0x7f17a00cefe0 2024-08-19T00:37:10.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.438+0000 7f179d600640 1 -- 172.21.15.7:0/1161463547 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f178c058f80 con 0x7f17a00cefe0 2024-08-19T00:37:10.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.438+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ddc06bf00 msgr2=0x7f8ddc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.438+0000 7f8e04000640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ddc06bf00 0x7f8ddc06e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8df0003cc0 tx=0x7f8df00079b0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.440 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.438+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dfc0d03c0 msgr2=0x7f8dfc1fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.438+0000 7f8e04000640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dfc0d03c0 0x7f8dfc1fc1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009870 tx=0x7f8de80046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 shutdown_connections 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ddc06bf00 0x7f8ddc06e3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dfc159bf0 0x7f8dfc15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dfc0d03c0 0x7f8dfc1fc1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 --2- 172.21.15.7:0/2494364331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dfc0ce500 0x7f8dfc150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 >> 172.21.15.7:0/2494364331 conn(0x7f8dfc06bc70 msgr2=0x7f8dfc15abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 shutdown_connections 2024-08-19T00:37:10.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f8e04000640 1 -- 172.21.15.7:0/2494364331 wait complete. 2024-08-19T00:37:10.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.439+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f11dc0b3d60 con 0x7f11dc15e770 2024-08-19T00:37:10.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.440+0000 7f11d9600640 1 -- 172.21.15.7:0/996812775 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11d4058d70 con 0x7f11dc15e770 2024-08-19T00:37:10.443 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2024-08-19T00:37:10.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f178006be60 msgr2=0x7f178006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f178006be60 0x7f178006e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f179400ab90 tx=0x7f1794009210 comp rx=0 tx=0).stop 2024-08-19T00:37:10.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 msgr2=0x7f17a0099b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a0099b00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f178c00d7d0 tx=0x7f178c00dc90 comp rx=0 tx=0).stop 2024-08-19T00:37:10.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 shutdown_connections 2024-08-19T00:37:10.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f178006be60 0x7f178006e320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17a015a670 0x7f17a00adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17a00cefe0 0x7f17a0099b00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 --2- 172.21.15.7:0/1161463547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17a00b2160 0x7f17a01f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.442+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 >> 172.21.15.7:0/1161463547 conn(0x7f17a00b5530 msgr2=0x7f17a00b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.443+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 shutdown_connections 2024-08-19T00:37:10.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.443+0000 7f1792a00640 1 -- 172.21.15.7:0/1161463547 wait complete. 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11bc06bf00 msgr2=0x7f11bc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11bc06bf00 0x7f11bc06e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009a30 tx=0x7f11d0008040 comp rx=0 tx=0).stop 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc15e770 msgr2=0x7f11dc165250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc15e770 0x7f11dc165250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11d400ca70 tx=0x7f11d400cf30 comp rx=0 tx=0).stop 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 shutdown_connections 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11bc06bf00 0x7f11bc06e3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc15e770 0x7f11dc165250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11dc162700 0x7f11dc15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 --2- 172.21.15.7:0/996812775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11dc0b1bf0 0x7f11dc157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.444+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 >> 172.21.15.7:0/996812775 conn(0x7f11dc06b850 msgr2=0x7f11dc074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.445+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 shutdown_connections 2024-08-19T00:37:10.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.445+0000 7f11cea00640 1 -- 172.21.15.7:0/996812775 wait complete. 2024-08-19T00:37:10.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.446+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa7ac005580 con 0x7fa7d40aeb10 2024-08-19T00:37:10.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.449+0000 7fa7d1600640 1 -- 172.21.15.7:0/3387851593 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa7c4079970 con 0x7fa7d40aeb10 2024-08-19T00:37:10.450 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-08-19T00:37:10.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-08-19T00:37:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.454+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7b006be80 msgr2=0x7fa7b006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.454+0000 7fa7db600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7b006be80 0x7fa7b006e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7d41554c0 tx=0x7fa7bc0073c0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.454+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 msgr2=0x7fa7d409dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.454+0000 7fa7db600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d409dee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40098c0 tx=0x7fa7c40046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 shutdown_connections 2024-08-19T00:37:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7b006be80 0x7fa7b006e340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d40d0900 0x7fa7d4165230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d40ce460 0x7fa7d4162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 --2- 172.21.15.7:0/3387851593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d40aeb10 0x7fa7d409dee0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 >> 172.21.15.7:0/3387851593 conn(0x7fa7d406bc70 msgr2=0x7fa7d406c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 shutdown_connections 2024-08-19T00:37:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:10.455+0000 7fa7db600640 1 -- 172.21.15.7:0/3387851593 wait complete. 2024-08-19T00:37:10.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-08-19T00:37:10.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-08-19T00:37:10.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-08-19T00:37:10.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-08-19T00:37:10.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-08-19T00:37:10.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-08-19T00:37:10.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-08-19T00:37:11.456 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-19T00:37:11.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-19T00:37:11.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-19T00:37:11.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-19T00:37:11.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-19T00:37:11.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-19T00:37:11.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-19T00:37:11.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-19T00:37:11.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.708+0000 7f12ea400640 1 Processor -- start 2024-08-19T00:37:11.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.709+0000 7f12ea400640 1 -- start start 2024-08-19T00:37:11.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.711+0000 7f12ea400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f12dc053710 0x7f12dc03b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.711+0000 7f12ea400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12dc058290 0x7f12dc0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.711+0000 7f12ea400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12dc0576f0 con 0x7f12dc0e6e00 2024-08-19T00:37:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.711+0000 7f12ea400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f12dc055280 con 0x7f12dc053710 2024-08-19T00:37:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.711+0000 7f12ea400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f12dc0574a0 con 0x7f12dc058290 2024-08-19T00:37:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.712+0000 7f12e9a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12dc058290 0x7f12dc0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.712+0000 7f12e9a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12dc058290 0x7f12dc0069e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60128/0 (socket says 172.21.15.7:60128) 2024-08-19T00:37:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.712+0000 7f12e9a00640 1 -- 172.21.15.7:0/1260528262 learned_addr learned my addr 172.21.15.7:0/1260528262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.712+0000 7f12e3e00640 1 --2- 172.21.15.7:0/1260528262 >> v2:172.21.15.7:3300/0 conn(0x7f12dc053710 0x7f12dc03b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.714+0000 7f12e3e00640 1 -- 172.21.15.7:0/1260528262 >> v2:172.21.15.162:3300/0 conn(0x7f12dc058290 msgr2=0x7f12dc0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.714+0000 7f12e3e00640 1 --2- 172.21.15.7:0/1260528262 >> v2:172.21.15.162:3300/0 conn(0x7f12dc058290 0x7f12dc0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.714+0000 7f12e3e00640 1 -- 172.21.15.7:0/1260528262 >> v1:172.21.15.7:6789/0 conn(0x7f12dc0e6e00 legacy=0x7f12dc053000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.714+0000 7f12e3e00640 1 -- 172.21.15.7:0/1260528262 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc005f00 con 0x7f12dc053710 2024-08-19T00:37:11.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.717+0000 7f12e3e00640 1 --2- 172.21.15.7:0/1260528262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc053710 0x7f12dc03b800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12dc038240 tx=0x7f12d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327a04848795d2e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.718+0000 7f12e3400640 1 -- 172.21.15.7:0/1260528262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0037070 con 0x7f12dc053710 2024-08-19T00:37:11.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.718+0000 7f12e3400640 1 -- 172.21.15.7:0/1260528262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d0032440 con 0x7f12dc053710 2024-08-19T00:37:11.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.718+0000 7f12e3400640 1 -- 172.21.15.7:0/1260528262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0032830 con 0x7f12dc053710 2024-08-19T00:37:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.720+0000 7f12ea400640 1 -- 172.21.15.7:0/1260528262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc053710 msgr2=0x7f12dc03b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.720+0000 7f12ea400640 1 --2- 172.21.15.7:0/1260528262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc053710 0x7f12dc03b800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12dc038240 tx=0x7f12d002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.720+0000 7f12ea400640 1 -- 172.21.15.7:0/1260528262 shutdown_connections 2024-08-19T00:37:11.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.721+0000 7f12ea400640 1 --2- 172.21.15.7:0/1260528262 >> v2:172.21.15.162:3300/0 conn(0x7f12dc058290 0x7f12dc0069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.721+0000 7f12ea400640 1 --2- 172.21.15.7:0/1260528262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc053710 0x7f12dc03b800 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.721+0000 7f12ea400640 1 -- 172.21.15.7:0/1260528262 >> 172.21.15.7:0/1260528262 conn(0x7f12dc03a4a0 msgr2=0x7f12dc03a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.721+0000 7f12ea400640 1 -- 172.21.15.7:0/1260528262 shutdown_connections 2024-08-19T00:37:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.721+0000 7f12ea400640 1 -- 172.21.15.7:0/1260528262 wait complete. 2024-08-19T00:37:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.724+0000 7f12ea400640 1 Processor -- start 2024-08-19T00:37:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.725+0000 7f12ea400640 1 -- start start 2024-08-19T00:37:11.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.727+0000 7f12ea400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12dc053710 0x7f12dc0e2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.728+0000 7f12ea400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12dc058290 0x7f12dc1889b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.728+0000 7f12e9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12dc053710 0x7f12dc0e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.728+0000 7f12e9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12dc053710 0x7f12dc0e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60134/0 (socket says 172.21.15.7:60134) 2024-08-19T00:37:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.728+0000 7f12e9000640 1 -- 172.21.15.7:0/2935527946 learned_addr learned my addr 172.21.15.7:0/2935527946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.728+0000 7f12ea400640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc0e6e00 0x7f12dc04e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.729+0000 7f12e9a00640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc0e6e00 0x7f12dc04e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.730+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc0e71e0 con 0x7f12dc0e6e00 2024-08-19T00:37:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.730+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc0064c0 con 0x7f12dc053710 2024-08-19T00:37:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.730+0000 7f12e3e00640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12dc058290 0x7f12dc1889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.730+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc056580 con 0x7f12dc058290 2024-08-19T00:37:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.731+0000 7f12e9a00640 1 -- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12dc058290 msgr2=0x7f12dc1889b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.731+0000 7f12e9a00640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12dc058290 0x7f12dc1889b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.731+0000 7f12e9a00640 1 -- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12dc053710 msgr2=0x7f12dc0e2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.731+0000 7f12e9a00640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12dc053710 0x7f12dc0e2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.731+0000 7f12e9a00640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc0e1070 con 0x7f12dc0e6e00 2024-08-19T00:37:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.732+0000 7f12e9a00640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc0e6e00 0x7f12dc04e870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12e4050200 tx=0x7f12e40694c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.732+0000 7f12e3e00640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12dc058290 0x7f12dc1889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.733+0000 7f12e0c00640 1 -- 172.21.15.7:0/2935527946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40751f0 con 0x7f12dc0e6e00 2024-08-19T00:37:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.733+0000 7f12e0c00640 1 -- 172.21.15.7:0/2935527946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e4075390 con 0x7f12dc0e6e00 2024-08-19T00:37:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.733+0000 7f12e0c00640 1 -- 172.21.15.7:0/2935527946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4075780 con 0x7f12dc0e6e00 2024-08-19T00:37:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.733+0000 7f12e9000640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12dc053710 0x7f12dc0e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.735+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc0e1350 con 0x7f12dc0e6e00 2024-08-19T00:37:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.736+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc0e1910 con 0x7f12dc0e6e00 2024-08-19T00:37:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.738+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc03bfc0 con 0x7f12dc0e6e00 2024-08-19T00:37:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.744+0000 7f12e0c00640 1 -- 172.21.15.7:0/2935527946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12e4095430 con 0x7f12dc0e6e00 2024-08-19T00:37:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.750+0000 7f12e0c00640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12c406bf30 0x7f12c406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.750+0000 7f12e0c00640 1 -- 172.21.15.7:0/2935527946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f12e41064c0 con 0x7f12dc0e6e00 2024-08-19T00:37:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.753+0000 7f12e9000640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12c406bf30 0x7f12c406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.754+0000 7f12e0c00640 1 -- 172.21.15.7:0/2935527946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f12e409a060 con 0x7f12dc0e6e00 2024-08-19T00:37:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.756+0000 7f12e9000640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12c406bf30 0x7f12c406e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12d8001790 tx=0x7f12d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.786+0000 7f58f4400640 1 Processor -- start 2024-08-19T00:37:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.786+0000 7f58f4400640 1 -- start start 2024-08-19T00:37:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.787+0000 7f32b9000640 1 Processor -- start 2024-08-19T00:37:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.787+0000 7f32b9000640 1 -- start start 2024-08-19T00:37:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.788+0000 7f58f4400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f58e4049e80 0x7f58e4034d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.788+0000 7f58f4400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e4033c70 con 0x7f58e4035d80 2024-08-19T00:37:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7fb4c5200640 1 Processor -- start 2024-08-19T00:37:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.788+0000 7f58f4400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e4033f50 con 0x7f58e40e6f60 2024-08-19T00:37:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.788+0000 7f58f4400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f58e4034230 con 0x7f58e4049e80 2024-08-19T00:37:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7f32b9000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32b4165bb0 0x7f32b40b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7f58f1a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f58e40e6f60 0x7f58e4033390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:32802/0 (socket says 172.21.15.7:32802) 2024-08-19T00:37:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7f58f1a00640 1 -- 172.21.15.7:0/2292517757 learned_addr learned my addr 172.21.15.7:0/2292517757 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7f32b9000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f32b40b3eb0 0x7f32b41660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7f32b9000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b4166620 0x7f32b4162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7f32b9000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f32b4163cb0 con 0x7f32b4165bb0 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7f32b9000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40b4410 con 0x7f32b40b3eb0 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7f32b9000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b40b46f0 con 0x7f32b4166620 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f32b40b3eb0 0x7f32b41660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f32b40b3eb0 0x7f32b41660e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60138/0 (socket says 172.21.15.7:60138) 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b2a00640 1 -- 172.21.15.7:0/3561011458 learned_addr learned my addr 172.21.15.7:0/3561011458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b3e00640 1 --2- 172.21.15.7:0/3561011458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b4166620 0x7f32b4162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b3400640 1 --2- 172.21.15.7:0/3561011458 >> v2:172.21.15.7:3300/0 conn(0x7f32b4165bb0 0x7f32b40b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b3e00640 1 -- 172.21.15.7:0/3561011458 >> v2:172.21.15.162:3300/0 conn(0x7f32b40b3eb0 msgr2=0x7f32b41660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b3e00640 1 --2- 172.21.15.7:0/3561011458 >> v2:172.21.15.162:3300/0 conn(0x7f32b40b3eb0 0x7f32b41660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.790+0000 7f32b3e00640 1 -- 172.21.15.7:0/3561011458 >> v2:172.21.15.7:3300/0 conn(0x7f32b4165bb0 msgr2=0x7f32b40b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7f32b3e00640 1 --2- 172.21.15.7:0/3561011458 >> v2:172.21.15.7:3300/0 conn(0x7f32b4165bb0 0x7f32b40b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7f32b3e00640 1 -- 172.21.15.7:0/3561011458 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b40b49d0 con 0x7f32b4166620 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.789+0000 7fb4c5200640 1 -- start start 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4c5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4c015dc60 0x7fb4c015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4c5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c00b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4c5200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4c015e580 con 0x7fb4c015a670 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4c5200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c00b4e40 con 0x7fb4c015dc60 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4c5200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c0154a70 con 0x7fb4c015e820 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4bfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb4c015a670 0x7fb4c015ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46346/0 (socket says 172.21.15.7:46346) 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4bfe00640 1 -- 172.21.15.7:0/2730848865 learned_addr learned my addr 172.21.15.7:0/2730848865 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7fb4b6a00640 1 --2- 172.21.15.7:0/2730848865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c00b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7fb4bf400640 1 --2- 172.21.15.7:0/2730848865 >> v2:172.21.15.162:3300/0 conn(0x7fb4c015dc60 0x7fb4c015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.791+0000 7f58f2400640 1 --2- 172.21.15.7:0/2292517757 >> v2:172.21.15.7:3300/0 conn(0x7f58e4049e80 0x7f58e4034d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570016968 0 0) 0x7f58e4033f50 con 0x7f58e40e6f60 2024-08-19T00:37:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d4003520 con 0x7f58e40e6f60 2024-08-19T00:37:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7f32b3e00640 1 --2- 172.21.15.7:0/3561011458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b4166620 0x7f32b4162af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32b40afba0 tx=0x7f329c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=789c634f64082771 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7fb4b6a00640 1 -- 172.21.15.7:0/2730848865 >> v2:172.21.15.162:3300/0 conn(0x7fb4c015dc60 msgr2=0x7fb4c015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7fb4b6a00640 1 --2- 172.21.15.7:0/2730848865 >> v2:172.21.15.162:3300/0 conn(0x7fb4c015dc60 0x7fb4c015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7fb4b6a00640 1 -- 172.21.15.7:0/2730848865 >> v1:172.21.15.7:6789/0 conn(0x7fb4c015a670 legacy=0x7fb4c015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.792+0000 7fb4b6a00640 1 -- 172.21.15.7:0/2730848865 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c00b42c0 con 0x7fb4c015e820 2024-08-19T00:37:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f32b2000640 1 -- 172.21.15.7:0/3561011458 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c007740 con 0x7f32b4166620 2024-08-19T00:37:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f32b2000640 1 -- 172.21.15.7:0/3561011458 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c0078e0 con 0x7f32b4166620 2024-08-19T00:37:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f32b2000640 1 -- 172.21.15.7:0/3561011458 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c007cf0 con 0x7f32b4166620 2024-08-19T00:37:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1127905228 0 0) 0x7f58d4003520 con 0x7f58e40e6f60 2024-08-19T00:37:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 >> v2:172.21.15.7:3300/0 conn(0x7f58e4049e80 msgr2=0x7f58e4034d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 --2- 172.21.15.7:0/2292517757 >> v2:172.21.15.7:3300/0 conn(0x7f58e4049e80 0x7f58e4034d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 >> v1:172.21.15.7:6789/0 conn(0x7f58e4035d80 legacy=0x7f58e4049770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4034510 con 0x7f58e40e6f60 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f58ec075dd0 con 0x7f58e40e6f60 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 >> v1:172.21.15.162:6789/0 conn(0x7f58e40e6f60 legacy=0x7f58e4033390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58d40039b0 0x7f58d4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d4004800 0x7f58d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40051c0 0x7f58d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4034230 con 0x7f58d4004800 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58d400bfb0 con 0x7f58d40051c0 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f58d400c1b0 con 0x7f58d40039b0 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58f2400640 1 --2- 172.21.15.7:0/2292517757 >> v2:172.21.15.7:3300/0 conn(0x7f58e4049e80 0x7f58e4034d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.793+0000 7f58f2400640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40051c0 0x7f58d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.794+0000 7f58f1a00640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58d40039b0 0x7f58d4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.794+0000 7f32b9000640 1 -- 172.21.15.7:0/3561011458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b4166620 msgr2=0x7f32b4162af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.794+0000 7f32b9000640 1 --2- 172.21.15.7:0/3561011458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b4166620 0x7f32b4162af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32b40afba0 tx=0x7f329c02a5f0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.794+0000 7f58f1000640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d4004800 0x7f58d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f58f1a00640 1 -- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40051c0 msgr2=0x7f58d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f58f1a00640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40051c0 0x7f58d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f58f1a00640 1 -- 172.21.15.7:0/2292517757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d4004800 msgr2=0x7f58d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f58f1a00640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58d4004800 0x7f58d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f58f1a00640 1 -- 172.21.15.7:0/2292517757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4034510 con 0x7f58d40039b0 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f58f2400640 1 -- 172.21.15.7:0/2292517757 reap_dead start 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7fb4b6a00640 1 --2- 172.21.15.7:0/2730848865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c00b3970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800b160 tx=0x7fb4a802a980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eededf4b18b8933 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f32b9000640 1 -- 172.21.15.7:0/3561011458 shutdown_connections 2024-08-19T00:37:11.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f32b9000640 1 --2- 172.21.15.7:0/3561011458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b4166620 0x7f32b4162af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f32b9000640 1 --2- 172.21.15.7:0/3561011458 >> v2:172.21.15.162:3300/0 conn(0x7f32b40b3eb0 0x7f32b41660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f32b9000640 1 --2- 172.21.15.7:0/3561011458 >> v2:172.21.15.7:3300/0 conn(0x7f32b4165bb0 0x7f32b40b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7f32b9000640 1 -- 172.21.15.7:0/3561011458 >> 172.21.15.7:0/3561011458 conn(0x7f32b406d600 msgr2=0x7f32b406d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.795+0000 7fb3b8e00640 1 Processor -- start 2024-08-19T00:37:11.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.796+0000 7fb4bea00640 1 -- 172.21.15.7:0/2730848865 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8034020 con 0x7fb4c015e820 2024-08-19T00:37:11.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.796+0000 7fb4bea00640 1 -- 172.21.15.7:0/2730848865 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a8030880 con 0x7fb4c015e820 2024-08-19T00:37:11.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.796+0000 7fb4bea00640 1 -- 172.21.15.7:0/2730848865 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8030c50 con 0x7fb4c015e820 2024-08-19T00:37:11.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.796+0000 7fb3b8e00640 1 -- start start 2024-08-19T00:37:11.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.796+0000 7f32b9000640 1 -- 172.21.15.7:0/3561011458 shutdown_connections 2024-08-19T00:37:11.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.796+0000 7f32b9000640 1 -- 172.21.15.7:0/3561011458 wait complete. 2024-08-19T00:37:11.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 -- 172.21.15.7:0/2730848865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 msgr2=0x7fb4c00b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 --2- 172.21.15.7:0/2730848865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c00b3970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800b160 tx=0x7fb4a802a980 comp rx=0 tx=0).stop 2024-08-19T00:37:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7f58f1a00640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58d40039b0 0x7f58d4003db0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58ec06a7e0 tx=0x7f58d4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4be6cf8d0d203a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec068b70 con 0x7f58d40039b0 2024-08-19T00:37:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 -- 172.21.15.7:0/2730848865 shutdown_connections 2024-08-19T00:37:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 --2- 172.21.15.7:0/2730848865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c00b3970 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 --2- 172.21.15.7:0/2730848865 >> v2:172.21.15.162:3300/0 conn(0x7fb4c015dc60 0x7fb4c015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 -- 172.21.15.7:0/2730848865 >> 172.21.15.7:0/2730848865 conn(0x7fb4c00b1c60 msgr2=0x7fb4c00b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb3b8e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3b4147820 0x7fb3b40b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 -- 172.21.15.7:0/2730848865 shutdown_connections 2024-08-19T00:37:11.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.797+0000 7fb4c5200640 1 -- 172.21.15.7:0/2730848865 wait complete. 2024-08-19T00:37:11.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7fb3b8e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b4073b90 con 0x7fb3b4161c10 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7fb3b8e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b406ddb0 con 0x7fb3b4072fa0 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7fb3b8e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b4162a70 con 0x7fb3b4147820 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7fb3b1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3b4147820 0x7fb3b40b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7fb3b1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3b4147820 0x7fb3b40b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60176/0 (socket says 172.21.15.7:60176) 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7fb3b1e00640 1 -- 172.21.15.7:0/1503979555 learned_addr learned my addr 172.21.15.7:0/1503979555 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec06b910 con 0x7f58d40039b0 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7f58ebe00640 1 -- 172.21.15.7:0/2292517757 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec06bda0 con 0x7f58d40039b0 2024-08-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.798+0000 7f32b9000640 1 Processor -- start 2024-08-19T00:37:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251077993 0 0) 0x7fb3b4073b90 con 0x7fb3b4161c10 2024-08-19T00:37:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb398003520 con 0x7fb3b4161c10 2024-08-19T00:37:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380206260 0 0) 0x7fb3b406ddb0 con 0x7fb3b4072fa0 2024-08-19T00:37:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3b4073b90 con 0x7fb3b4072fa0 2024-08-19T00:37:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b1e00640 1 -- 172.21.15.7:0/1503979555 >> v1:172.21.15.162:6789/0 conn(0x7fb3b4072fa0 legacy=0x7fb3b406eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b1e00640 1 -- 172.21.15.7:0/1503979555 >> v1:172.21.15.7:6789/0 conn(0x7fb3b4161c10 legacy=0x7fb3b4162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2236091310 0 0) 0x7fb398003520 con 0x7fb3b4161c10 2024-08-19T00:37:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7fb3b1e00640 1 -- 172.21.15.7:0/1503979555 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b406e050 con 0x7fb3b4147820 2024-08-19T00:37:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7f58f4400640 1 -- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58d40039b0 msgr2=0x7f58d4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7f58f4400640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58d40039b0 0x7f58d4003db0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58ec06a7e0 tx=0x7f58d4005830 comp rx=0 tx=0).stop 2024-08-19T00:37:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.799+0000 7f32b9000640 1 -- start start 2024-08-19T00:37:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.800+0000 7f32b9000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b40b3eb0 0x7f32b4157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.800+0000 7fb4c5200640 1 Processor -- start 2024-08-19T00:37:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.800+0000 7f8afd400640 1 Processor -- start 2024-08-19T00:37:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.800+0000 7f32b9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b4165bb0 0x7f32b40cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b9000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b4166620 0x7f32b41fc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b9000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4166f40 con 0x7f32b4166620 2024-08-19T00:37:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.800+0000 7f3ca0e00640 1 Processor -- start 2024-08-19T00:37:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f3ca0e00640 1 -- start start 2024-08-19T00:37:11.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f58f4400640 1 -- 172.21.15.7:0/2292517757 shutdown_connections 2024-08-19T00:37:11.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b9000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4166dc0 con 0x7f32b4165bb0 2024-08-19T00:37:11.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b9000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b4163030 con 0x7f32b40b3eb0 2024-08-19T00:37:11.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7fb4c5200640 1 -- start start 2024-08-19T00:37:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f58f4400640 1 --2- 172.21.15.7:0/2292517757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58d40039b0 0x7f58d4003db0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f58f4400640 1 -- 172.21.15.7:0/2292517757 >> 172.21.15.7:0/2292517757 conn(0x7f58e401fb30 msgr2=0x7f58e40567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b4165bb0 0x7f32b40cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b40b3eb0 0x7f32b4157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b4165bb0 0x7f32b40cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60192/0 (socket says 172.21.15.7:60192) 2024-08-19T00:37:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f32b2a00640 1 -- 172.21.15.7:0/1708278296 learned_addr learned my addr 172.21.15.7:0/1708278296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f32b3e00640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b4166620 0x7f32b41fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f58f4400640 1 -- 172.21.15.7:0/2292517757 shutdown_connections 2024-08-19T00:37:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f32b2a00640 1 -- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b40b3eb0 msgr2=0x7f32b4157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f32b2a00640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b40b3eb0 0x7f32b4157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f32b2a00640 1 -- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b4166620 msgr2=0x7f32b41fc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f32b2a00640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b4166620 0x7f32b41fc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7fb4c5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c015a670 0x7fb4c014b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7fb4c5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4c015dc60 0x7fb4c01583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7fb4c5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c01563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7fb4c5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c00b4b60 con 0x7fb4c015a670 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7fb4c5200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c00b4880 con 0x7fb4c015dc60 2024-08-19T00:37:11.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7fb4c5200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c00b3eb0 con 0x7fb4c015e820 2024-08-19T00:37:11.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f58f4400640 1 -- 172.21.15.7:0/2292517757 wait complete. 2024-08-19T00:37:11.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.802+0000 7f32b2a00640 1 -- 172.21.15.7:0/1708278296 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4158320 con 0x7f32b4165bb0 2024-08-19T00:37:11.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7fb4bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c015a670 0x7fb4c014b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f3ca0e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c073760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7fb4bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c015a670 0x7fb4c014b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35616/0 (socket says 172.21.15.7:35616) 2024-08-19T00:37:11.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.801+0000 7f8afd400640 1 -- start start 2024-08-19T00:37:11.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7fb4bf400640 1 -- 172.21.15.7:0/3134087501 learned_addr learned my addr 172.21.15.7:0/3134087501 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f8afd400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8af80cfa90 0x7f8af80b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f8afd400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af815a680 con 0x7f8af80b4d40 2024-08-19T00:37:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7fb4b6a00640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4c015dc60 0x7fb4c01583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f8afd400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af80b3a10 con 0x7f8af815a2a0 2024-08-19T00:37:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f8af7e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8af815a2a0 0x7f8af80cf380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:32818/0 (socket says 172.21.15.7:32818) 2024-08-19T00:37:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f8af7e00640 1 -- 172.21.15.7:0/1606649941 learned_addr learned my addr 172.21.15.7:0/1606649941 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:11.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f8afd400640 1 -- 172.21.15.7:0/1606649941 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8af80b4590 con 0x7f8af80cfa90 2024-08-19T00:37:11.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f3ca0e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c9c071ed0 0x7f3c9c0722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f32b3e00640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b4166620 0x7f32b41fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:11.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.803+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c073760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f32b3400640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b40b3eb0 0x7f32b4157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f32b2a00640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b4165bb0 0x7f32b40cbef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32a400e8d0 tx=0x7f32a400ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513588052 0 0) 0x7f8af80b3a10 con 0x7f8af815a2a0 2024-08-19T00:37:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc003520 con 0x7f8af815a2a0 2024-08-19T00:37:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7fb4b6a00640 1 -- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 msgr2=0x7fb4c01563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7fb4b6a00640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c01563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7fb4b6a00640 1 -- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c015a670 msgr2=0x7fb4c014b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7fb4b6a00640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c015a670 0x7fb4c014b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7fb4b6a00640 1 -- 172.21.15.7:0/3134087501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c014bc30 con 0x7fb4c015dc60 2024-08-19T00:37:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c073760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53540/0 (socket says 172.21.15.7:53540) 2024-08-19T00:37:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f3c9b400640 1 -- 172.21.15.7:0/959147926 learned_addr learned my addr 172.21.15.7:0/959147926 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c15adc0 con 0x7f3c9c06d600 2024-08-19T00:37:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/959147926 >> v2:172.21.15.162:3300/0 conn(0x7f3c9c071ed0 0x7f3c9c0722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3c9c071a40 con 0x7f3c9c071ed0 2024-08-19T00:37:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9c15b0a0 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1638603061 0 0) 0x7f8adc003520 con 0x7f8af815a2a0 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 >> v2:172.21.15.162:3300/0 conn(0x7f8af80cfa90 msgr2=0x7f8af80b4800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 --2- 172.21.15.7:0/1606649941 >> v2:172.21.15.162:3300/0 conn(0x7f8af80cfa90 0x7f8af80b4800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 >> v1:172.21.15.7:6789/0 conn(0x7f8af80b4d40 legacy=0x7f8af8071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af80b3cf0 con 0x7f8af815a2a0 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f8ae4000ed0 con 0x7f8af815a2a0 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 >> v1:172.21.15.162:6789/0 conn(0x7f8af815a2a0 legacy=0x7f8af80cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af6a00640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc0039b0 0x7f8adc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af6a00640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f3c9a000640 1 -- 172.21.15.7:0/959147926 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598054122 0 0) 0x7f3c9c15adc0 con 0x7f3c9c06d600 2024-08-19T00:37:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af6a00640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8adc0052c0 0x7f8adc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7fb4b6a00640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4c015dc60 0x7fb4c01583a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8032000 tx=0x7fb4a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f3c9aa00640 1 -- 172.21.15.7:0/959147926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 msgr2=0x7f3c9c073760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/959147926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c073760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f3c9aa00640 1 -- 172.21.15.7:0/959147926 >> v1:172.21.15.162:6789/0 conn(0x7f3c9c06d600 legacy=0x7f3c9c15dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f3c9aa00640 1 -- 172.21.15.7:0/959147926 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c15b380 con 0x7f3c9c071ed0 2024-08-19T00:37:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8af80b4590 con 0x7f8adc004800 2024-08-19T00:37:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc00c200 con 0x7f8adc0039b0 2024-08-19T00:37:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8adc00c400 con 0x7f8adc0052c0 2024-08-19T00:37:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8afca00640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8adc0052c0 0x7f8adc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af7400640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.805+0000 7f8af7e00640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc0039b0 0x7f8adc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7fb4b7e00640 1 -- 172.21.15.7:0/3134087501 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8034040 con 0x7fb4c015dc60 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7fb4b7e00640 1 -- 172.21.15.7:0/3134087501 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a8039630 con 0x7fb4c015dc60 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7fb4b7e00640 1 -- 172.21.15.7:0/3134087501 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8039a00 con 0x7fb4c015dc60 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c0158c80 con 0x7fb4c015dc60 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7f8af7400640 1 -- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8adc0052c0 msgr2=0x7f8adc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7f8af7400640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8adc0052c0 0x7f8adc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7f8af7400640 1 -- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc0039b0 msgr2=0x7f8adc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7f8af7400640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc0039b0 0x7f8adc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7f8af7400640 1 -- 172.21.15.7:0/1606649941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af80b3cf0 con 0x7f8adc004800 2024-08-19T00:37:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.804+0000 7f32ab400640 1 -- 172.21.15.7:0/1708278296 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4017070 con 0x7f32b4165bb0 2024-08-19T00:37:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c0159240 con 0x7fb4c015dc60 2024-08-19T00:37:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7f8afca00640 1 -- 172.21.15.7:0/1606649941 reap_dead start 2024-08-19T00:37:11.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7f32ab400640 1 -- 172.21.15.7:0/1708278296 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a400c940 con 0x7f32b4165bb0 2024-08-19T00:37:11.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/959147926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c0722f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c880097a0 tx=0x7f3c8802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4a211d885feaebd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7f32ab400640 1 -- 172.21.15.7:0/1708278296 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a400ccf0 con 0x7f32b4165bb0 2024-08-19T00:37:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.806+0000 7fb3b1e00640 1 --2- 172.21.15.7:0/1503979555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b40b2f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009870 tx=0x7fb3a402a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d1498a5b23fbc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4037070 con 0x7fb3b4147820 2024-08-19T00:37:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a402ad10 con 0x7fb3b4147820 2024-08-19T00:37:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7fb3b0a00640 1 -- 172.21.15.7:0/1503979555 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0001670 con 0x7fb3b4147820 2024-08-19T00:37:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7f58f4400640 1 Processor -- start 2024-08-19T00:37:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7f58f4400640 1 -- start start 2024-08-19T00:37:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.807+0000 7f3c9a000640 1 -- 172.21.15.7:0/959147926 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88037070 con 0x7f3c9c071ed0 2024-08-19T00:37:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7f3c9a000640 1 -- 172.21.15.7:0/959147926 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c88032440 con 0x7f3c9c071ed0 2024-08-19T00:37:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7f3c9a000640 1 -- 172.21.15.7:0/959147926 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88032810 con 0x7f3c9c071ed0 2024-08-19T00:37:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7f8af7400640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800dc20 tx=0x7f8adc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb454c0e17f634fa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7fb3b8e00640 1 -- 172.21.15.7:0/1503979555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 msgr2=0x7fb3b40b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/1503979555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b40b2f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009870 tx=0x7fb3a402a280 comp rx=0 tx=0).stop 2024-08-19T00:37:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800d870 con 0x7f8adc004800 2024-08-19T00:37:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae802eb00 con 0x7f8adc004800 2024-08-19T00:37:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7f8af6a00640 1 -- 172.21.15.7:0/1606649941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800d2d0 con 0x7f8adc004800 2024-08-19T00:37:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.808+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c00b2750 con 0x7fb4c015dc60 2024-08-19T00:37:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b40cbc10 con 0x7f32b4165bb0 2024-08-19T00:37:11.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7fb3b8e00640 1 -- 172.21.15.7:0/1503979555 shutdown_connections 2024-08-19T00:37:11.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/1503979555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b40b2f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7fb3b8e00640 1 -- 172.21.15.7:0/1503979555 >> 172.21.15.7:0/1503979555 conn(0x7fb3b406bc70 msgr2=0x7fb3b406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7fb3b8e00640 1 -- 172.21.15.7:0/1503979555 shutdown_connections 2024-08-19T00:37:11.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c071ed0 msgr2=0x7f3c9c0722f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/959147926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c0722f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c880097a0 tx=0x7f3c8802a210 comp rx=0 tx=0).stop 2024-08-19T00:37:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b40cab60 con 0x7f32b4165bb0 2024-08-19T00:37:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f8afd400640 1 -- 172.21.15.7:0/1606649941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8adc004800 msgr2=0x7f8adc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f8afd400640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800dc20 tx=0x7f8adc005830 comp rx=0 tx=0).stop 2024-08-19T00:37:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 shutdown_connections 2024-08-19T00:37:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/959147926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c0722f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/959147926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c073760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 >> 172.21.15.7:0/959147926 conn(0x7f3c9c06b850 msgr2=0x7f3c9c06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7fb4b7e00640 1 -- 172.21.15.7:0/3134087501 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4a8037020 con 0x7fb4c015dc60 2024-08-19T00:37:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.810+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 shutdown_connections 2024-08-19T00:37:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.810+0000 7f8afd400640 1 -- 172.21.15.7:0/1606649941 shutdown_connections 2024-08-19T00:37:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.810+0000 7f8afd400640 1 --2- 172.21.15.7:0/1606649941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.810+0000 7f8afd400640 1 -- 172.21.15.7:0/1606649941 >> 172.21.15.7:0/1606649941 conn(0x7f8af806d600 msgr2=0x7f8af806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.810+0000 7f8afd400640 1 -- 172.21.15.7:0/1606649941 shutdown_connections 2024-08-19T00:37:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.810+0000 7f8afd400640 1 -- 172.21.15.7:0/1606649941 wait complete. 2024-08-19T00:37:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.810+0000 7f3ca0e00640 1 -- 172.21.15.7:0/959147926 wait complete. 2024-08-19T00:37:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7fb4b7e00640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb49c06be80 0x7fb49c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7fb4bf400640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb49c06be80 0x7fb49c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f32ab400640 1 -- 172.21.15.7:0/1708278296 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32a401a070 con 0x7f32b4165bb0 2024-08-19T00:37:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f4400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40039b0 0x7f58e40df070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f4400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58e4038e60 0x7f58e4052830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f4400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e4051870 0x7f58e40e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f4400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4034e90 con 0x7f58e4038e60 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f4400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4034d10 con 0x7f58d40039b0 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f4400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f58e4035010 con 0x7f58e4051870 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58e4038e60 0x7f58e4052830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.811+0000 7f58f1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40039b0 0x7f58e40df070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40039b0 0x7f58e40df070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60248/0 (socket says 172.21.15.7:60248) 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f1a00640 1 -- 172.21.15.7:0/1798185512 learned_addr learned my addr 172.21.15.7:0/1798185512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f2400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e4051870 0x7f58e40e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f2400640 1 -- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40039b0 msgr2=0x7f58e40df070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f2400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40039b0 0x7f58e40df070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f2400640 1 -- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58e4038e60 msgr2=0x7f58e4052830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f2400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58e4038e60 0x7f58e4052830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f58f2400640 1 -- 172.21.15.7:0/1798185512 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4050dd0 con 0x7f58e4051870 2024-08-19T00:37:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.809+0000 7fb3b8e00640 1 -- 172.21.15.7:0/1503979555 wait complete. 2024-08-19T00:37:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.813+0000 7fb4b7e00640 1 -- 172.21.15.7:0/3134087501 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb4a8077890 con 0x7fb4c015dc60 2024-08-19T00:37:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.813+0000 7fb4bf400640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb49c06be80 0x7fb49c06e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009a40 tx=0x7fb4b000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.813+0000 7fb3b8e00640 1 Processor -- start 2024-08-19T00:37:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7f8afd400640 1 Processor -- start 2024-08-19T00:37:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7f58f2400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e4051870 0x7f58e40e4550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58e400cc30 tx=0x7f58d8011920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7fb3b8e00640 1 -- start start 2024-08-19T00:37:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7f8afd400640 1 -- start start 2024-08-19T00:37:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7f3ca0e00640 1 Processor -- start 2024-08-19T00:37:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7f3ca0e00640 1 -- start start 2024-08-19T00:37:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.815+0000 7f58e9600640 1 -- 172.21.15.7:0/1798185512 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d800f040 con 0x7f58e4051870 2024-08-19T00:37:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.815+0000 7f58e9600640 1 -- 172.21.15.7:0/1798185512 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d8004020 con 0x7f58e4051870 2024-08-19T00:37:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.812+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b40b3970 con 0x7f32b4165bb0 2024-08-19T00:37:11.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.815+0000 7f58e9600640 1 -- 172.21.15.7:0/1798185512 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8004450 con 0x7f58e4051870 2024-08-19T00:37:11.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7f32ab400640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329006be30 0x7f329006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.814+0000 7f32ab400640 1 -- 172.21.15.7:0/1708278296 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f32a408ae60 con 0x7f32b4165bb0 2024-08-19T00:37:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.815+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e40531a0 con 0x7f58e4051870 2024-08-19T00:37:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.815+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e4051070 con 0x7f58e4051870 2024-08-19T00:37:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.815+0000 7fb3b8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b4072fa0 0x7fb3b40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7fb3b8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7fb3b1e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b4072fa0 0x7fb3b40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7fb3b1e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b4072fa0 0x7fb3b40cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53564/0 (socket says 172.21.15.7:53564) 2024-08-19T00:37:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f32b3400640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329006be30 0x7f329006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7fb3b1e00640 1 -- 172.21.15.7:0/3384861895 learned_addr learned my addr 172.21.15.7:0/3384861895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b4161c10 0x7fb3b4145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8afd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc004800 0x7f8af8153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8afd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af8151eb0 0x7f8af81ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8afd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af81eff30 0x7f8af81f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8afd400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8af806e0f0 con 0x7f8af8151eb0 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8afd400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8af80b42b0 con 0x7f8adc004800 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8afd400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8af806e270 con 0x7f8af81eff30 2024-08-19T00:37:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f32b3400640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329006be30 0x7f329006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006fd0 tx=0x7f32ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f3ca0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c06d600 0x7f3c9c144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f3ca0e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c1471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f3ca0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f3ca0e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c06de40 con 0x7f3c9c071ed0 2024-08-19T00:37:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f3ca0e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c06dcc0 con 0x7f3c9c06d600 2024-08-19T00:37:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f3ca0e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9c0b2f60 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.816+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c06d600 0x7f3c9c144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c06d600 0x7f3c9c144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60254/0 (socket says 172.21.15.7:60254) 2024-08-19T00:37:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f3c9b400640 1 -- 172.21.15.7:0/2366257828 learned_addr learned my addr 172.21.15.7:0/2366257828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f3c9be00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c1471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fb4b7e00640 1 -- 172.21.15.7:0/3134087501 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb4a80797f0 con 0x7fb4c015dc60 2024-08-19T00:37:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fe60f600640 1 Processor -- start 2024-08-19T00:37:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f3c9aa00640 1 -- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c06d600 msgr2=0x7f3c9c144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c06d600 0x7f3c9c144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b40b34c0 con 0x7fb3b4161c10 2024-08-19T00:37:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b406e610 con 0x7fb3b4147820 2024-08-19T00:37:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b4147c00 con 0x7fb3b4072fa0 2024-08-19T00:37:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fb3b1400640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e40e5770 con 0x7f58e4051870 2024-08-19T00:37:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7fb3b1400640 1 -- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b4072fa0 msgr2=0x7fb3b40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7fb3b1400640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b4072fa0 0x7fb3b40cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7fb3b1400640 1 -- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b4161c10 msgr2=0x7fb3b4145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f3c9aa00640 1 -- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c071ed0 msgr2=0x7f3c9c150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f3c9aa00640 1 -- 172.21.15.7:0/2366257828 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c14b160 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f3c9be00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:11.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7fb3b2800640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b4161c10 0x7fb3b4145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8af7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc004800 0x7f8af8153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.817+0000 7f8afca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af81eff30 0x7f8af81f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8afca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af81eff30 0x7f8af81f03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53576/0 (socket says 172.21.15.7:53576) 2024-08-19T00:37:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8afca00640 1 -- 172.21.15.7:0/3892798341 learned_addr learned my addr 172.21.15.7:0/3892798341 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8af7400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af8151eb0 0x7f8af81ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7fe60f600640 1 -- start start 2024-08-19T00:37:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7fb3b1400640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b4161c10 0x7fb3b4145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7fb3b1400640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b41539e0 con 0x7fb3b4147820 2024-08-19T00:37:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7fb3b2800640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b4161c10 0x7fb3b4145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8afca00640 1 -- 172.21.15.7:0/3892798341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc004800 msgr2=0x7f8af8153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8afca00640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc004800 0x7f8af8153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8afca00640 1 -- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af8151eb0 msgr2=0x7f8af81ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8afca00640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af8151eb0 0x7f8af81ef9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f8afca00640 1 -- 172.21.15.7:0/3892798341 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af81f08f0 con 0x7f8af81eff30 2024-08-19T00:37:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.818+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c1471c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c06c830 tx=0x7f3c880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7f8af7400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af8151eb0 0x7f8af81ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7f3c93400640 1 -- 172.21.15.7:0/2366257828 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88037050 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7f3c93400640 1 -- 172.21.15.7:0/2366257828 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c88038040 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7f3c93400640 1 -- 172.21.15.7:0/2366257828 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8803c830 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7fb3b1400640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b41534a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0007e00 tx=0x7fb3a000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9c14b3e0 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9c14b9a0 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.819+0000 7f58e9600640 1 -- 172.21.15.7:0/1798185512 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58d801e020 con 0x7f58e4051870 2024-08-19T00:37:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7f8afca00640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af81eff30 0x7f8af81f03b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8af000a220 tx=0x7f8af0001ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7fe60f600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe6080aeb10 0x7fe6080cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7fe60f600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60806e660 con 0x7fe6080ce460 2024-08-19T00:37:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7fe60f600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60806e940 con 0x7fe6080d0ad0 2024-08-19T00:37:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7fe60f600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe60806ec20 con 0x7fe6080aeb10 2024-08-19T00:37:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7f58e9600640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f58cc06bf30 0x7f58cc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7f58e9600640 1 -- 172.21.15.7:0/1798185512 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f58d808a5b0 con 0x7f58e4051870 2024-08-19T00:37:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.820+0000 7fe60cc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe6080aeb10 0x7fe6080cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7fe607e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe6080ce460 0x7fe6080d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46366/0 (socket says 172.21.15.7:46366) 2024-08-19T00:37:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7fe607e00640 1 -- 172.21.15.7:0/227317487 learned_addr learned my addr 172.21.15.7:0/227317487 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7f58f1a00640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f58cc06bf30 0x7f58cc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9c0b33c0 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7fe607400640 1 -- 172.21.15.7:0/227317487 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842321462 0 0) 0x7fe60806e660 con 0x7fe6080ce460 2024-08-19T00:37:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7fe60cc00640 1 -- 172.21.15.7:0/227317487 >> v1:172.21.15.162:6789/0 conn(0x7fe6080d0ad0 legacy=0x7fe6080acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7fe60cc00640 1 -- 172.21.15.7:0/227317487 >> v1:172.21.15.7:6789/0 conn(0x7fe6080ce460 legacy=0x7fe6080d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.821+0000 7fe60cc00640 1 -- 172.21.15.7:0/227317487 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60806ef00 con 0x7fe6080aeb10 2024-08-19T00:37:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.822+0000 7f32ab400640 1 -- 172.21.15.7:0/1708278296 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f32a4059800 con 0x7f32b4165bb0 2024-08-19T00:37:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.822+0000 7fb3aa000640 1 -- 172.21.15.7:0/3384861895 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0021070 con 0x7fb3b4147820 2024-08-19T00:37:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.822+0000 7fb3aa000640 1 -- 172.21.15.7:0/3384861895 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a000ad50 con 0x7fb3b4147820 2024-08-19T00:37:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.822+0000 7fb3aa000640 1 -- 172.21.15.7:0/3384861895 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a001c650 con 0x7fb3b4147820 2024-08-19T00:37:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.823+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b40c9950 con 0x7fb3b4147820 2024-08-19T00:37:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.823+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b4150aa0 con 0x7fb3b4147820 2024-08-19T00:37:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.823+0000 7f58f1a00640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f58cc06bf30 0x7f58cc06e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0761b0 tx=0x7f58ec06d000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.823+0000 7fe60cc00640 1 --2- 172.21.15.7:0/227317487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe6080cf3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe60002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b11e74c5cc1b95 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.824+0000 7fe607400640 1 -- 172.21.15.7:0/227317487 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600007740 con 0x7fe6080aeb10 2024-08-19T00:37:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.824+0000 7fe607400640 1 -- 172.21.15.7:0/227317487 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6000078e0 con 0x7fe6080aeb10 2024-08-19T00:37:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.824+0000 7fe607400640 1 -- 172.21.15.7:0/227317487 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600007cb0 con 0x7fe6080aeb10 2024-08-19T00:37:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b40b2f80 con 0x7fb3b4147820 2024-08-19T00:37:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7f8aefe00640 1 -- 172.21.15.7:0/3892798341 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af000fac0 con 0x7f8af81eff30 2024-08-19T00:37:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7f8aefe00640 1 -- 172.21.15.7:0/3892798341 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af0018070 con 0x7f8af81eff30 2024-08-19T00:37:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7f8aefe00640 1 -- 172.21.15.7:0/3892798341 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0011440 con 0x7f8af81eff30 2024-08-19T00:37:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af80c4ed0 con 0x7f8af81eff30 2024-08-19T00:37:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7f58e9600640 1 -- 172.21.15.7:0/1798185512 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f58d80588f0 con 0x7f58e4051870 2024-08-19T00:37:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af81529e0 con 0x7f8af81eff30 2024-08-19T00:37:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.825+0000 7fb3aa000640 1 -- 172.21.15.7:0/3384861895 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3a0024070 con 0x7fb3b4147820 2024-08-19T00:37:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.826+0000 7fb3aa000640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39406beb0 0x7fb39406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.826+0000 7fb3aa000640 1 -- 172.21.15.7:0/3384861895 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb3a0092740 con 0x7fb3b4147820 2024-08-19T00:37:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7fe60f600640 1 -- 172.21.15.7:0/227317487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 msgr2=0x7fe6080cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7fe60f600640 1 --2- 172.21.15.7:0/227317487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe6080cf3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe60002a6a0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af80b51e0 con 0x7f8af81eff30 2024-08-19T00:37:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7fe60f600640 1 -- 172.21.15.7:0/227317487 shutdown_connections 2024-08-19T00:37:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7fb3b1e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39406beb0 0x7fb39406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7fe60f600640 1 --2- 172.21.15.7:0/227317487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe6080cf3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7fe60f600640 1 -- 172.21.15.7:0/227317487 >> 172.21.15.7:0/227317487 conn(0x7fe60806bc70 msgr2=0x7fe60806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.827+0000 7f3c93400640 1 -- 172.21.15.7:0/2366257828 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c88045020 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.828+0000 7fe60f600640 1 -- 172.21.15.7:0/227317487 shutdown_connections 2024-08-19T00:37:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.828+0000 7fe60f600640 1 -- 172.21.15.7:0/227317487 wait complete. 2024-08-19T00:37:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.831+0000 7fe60f600640 1 Processor -- start 2024-08-19T00:37:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.831+0000 7f3c93400640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c7c06be80 0x7f3c7c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.831+0000 7fe60f600640 1 -- start start 2024-08-19T00:37:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.831+0000 7f3c93400640 1 -- 172.21.15.7:0/2366257828 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c880ab9e0 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.832+0000 7f3c93400640 1 -- 172.21.15.7:0/2366257828 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3c8804c020 con 0x7f3c9c06f8b0 2024-08-19T00:37:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.831+0000 7fb3aa000640 1 -- 172.21.15.7:0/3384861895 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb3b41539e0 con 0x7fb3b4147820 2024-08-19T00:37:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.832+0000 7fb3b1e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39406beb0 0x7fb39406e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40090b0 tx=0x7fb3a402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.834+0000 7fe60f600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe60815fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.834+0000 7fe60f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080ce460 0x7fe608163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.834+0000 7fe60f600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6080d0ad0 0x7fe608164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.834+0000 7fe60f600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe60806f700 con 0x7fe6080ce460 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.834+0000 7fe60f600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe6080cf900 con 0x7fe6080aeb10 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.834+0000 7fe60f600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe608201fe0 con 0x7fe6080d0ad0 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.835+0000 7fe60cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe60815fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.835+0000 7fe60cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe60815fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60286/0 (socket says 172.21.15.7:60286) 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.835+0000 7fe60cc00640 1 -- 172.21.15.7:0/2539036680 learned_addr learned my addr 172.21.15.7:0/2539036680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.835+0000 7fe60d600640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6080d0ad0 0x7fe608164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.835+0000 7f8aefe00640 1 -- 172.21.15.7:0/3892798341 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8af00115e0 con 0x7f8af81eff30 2024-08-19T00:37:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.835+0000 7fe607e00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080ce460 0x7fe608163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7f3c9b400640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c7c06be80 0x7f3c7c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7fe60cc00640 1 -- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6080d0ad0 msgr2=0x7fe608164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7fe60cc00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6080d0ad0 0x7fe608164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7fe60cc00640 1 -- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080ce460 msgr2=0x7fe608163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7fe60cc00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080ce460 0x7fe608163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7fe60cc00640 1 -- 172.21.15.7:0/2539036680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe608202280 con 0x7fe6080aeb10 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7fe607e00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080ce460 0x7fe608163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.836+0000 7fe60cc00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe60815fb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe600004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.837+0000 7fe604c00640 1 -- 172.21.15.7:0/2539036680 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600040070 con 0x7fe6080aeb10 2024-08-19T00:37:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.837+0000 7fe604c00640 1 -- 172.21.15.7:0/2539036680 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe600031c40 con 0x7fe6080aeb10 2024-08-19T00:37:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.837+0000 7fe604c00640 1 -- 172.21.15.7:0/2539036680 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60003c420 con 0x7fe6080aeb10 2024-08-19T00:37:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.837+0000 7f3c9b400640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c7c06be80 0x7f3c7c06e340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00a640 tx=0x7f3c8c00a350 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.838+0000 7f8aefe00640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ad806be80 0x7f8ad806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.838+0000 7f8aefe00640 1 -- 172.21.15.7:0/3892798341 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8af008bbb0 con 0x7f8af81eff30 2024-08-19T00:37:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.838+0000 7f8aefe00640 1 -- 172.21.15.7:0/3892798341 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8af008c0e0 con 0x7f8af81eff30 2024-08-19T00:37:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.838+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe608202560 con 0x7fe6080aeb10 2024-08-19T00:37:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.839+0000 7f8af7e00640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ad806be80 0x7f8ad806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.841+0000 7f8af7e00640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ad806be80 0x7f8ad806e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001460 tx=0x7f8ae4000f80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.838+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe608202b20 con 0x7fe6080aeb10 2024-08-19T00:37:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.840+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6080ad2d0 con 0x7fe6080aeb10 2024-08-19T00:37:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.841+0000 7fe604c00640 1 -- 172.21.15.7:0/2539036680 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe600039040 con 0x7fe6080aeb10 2024-08-19T00:37:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.843+0000 7fe604c00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe5e806be80 0x7fe5e806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.844+0000 7fe607e00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe5e806be80 0x7fe5e806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.846+0000 7fe607e00640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe5e806be80 0x7fe5e806e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe60806e020 tx=0x7fe5f8007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.846+0000 7fe604c00640 1 -- 172.21.15.7:0/2539036680 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe600078840 con 0x7fe6080aeb10 2024-08-19T00:37:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:11.849+0000 7fe604c00640 1 -- 172.21.15.7:0/2539036680 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe60007aea0 con 0x7fe6080aeb10 2024-08-19T00:37:12.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.172+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f12dc037c70 con 0x7f12dc0e6e00 2024-08-19T00:37:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.173+0000 7f12e0c00640 1 -- 172.21.15.7:0/2935527946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12e40d4ee0 con 0x7f12dc0e6e00 2024-08-19T00:37:12.176 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-08-19T00:37:12.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.177+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12c406bf30 msgr2=0x7f12c406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.177+0000 7f12ea400640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12c406bf30 0x7f12c406e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12d8001790 tx=0x7f12d8009040 comp rx=0 tx=0).stop 2024-08-19T00:37:12.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.178+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc0e6e00 msgr2=0x7f12dc04e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.178+0000 7f12ea400640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc0e6e00 0x7f12dc04e870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12e4050200 tx=0x7f12e40694c0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.179+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 shutdown_connections 2024-08-19T00:37:12.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.179+0000 7f12ea400640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12c406bf30 0x7f12c406e3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.179+0000 7f12ea400640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12dc0e6e00 0x7f12dc04e870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.179+0000 7f12ea400640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12dc058290 0x7f12dc1889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.179+0000 7f12ea400640 1 --2- 172.21.15.7:0/2935527946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12dc053710 0x7f12dc0e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.179+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 >> 172.21.15.7:0/2935527946 conn(0x7f12dc03a4a0 msgr2=0x7f12dc171d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.180+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 shutdown_connections 2024-08-19T00:37:12.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.180+0000 7f12ea400640 1 -- 172.21.15.7:0/2935527946 wait complete. 2024-08-19T00:37:12.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2024-08-19T00:37:12.208 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.227+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb3b406ecb0 con 0x7fb3b4147820 2024-08-19T00:37:12.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.227+0000 7fb3aa000640 1 -- 172.21.15.7:0/3384861895 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3a0061160 con 0x7fb3b4147820 2024-08-19T00:37:12.229 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2024-08-19T00:37:12.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39406beb0 msgr2=0x7fb39406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39406beb0 0x7fb39406e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40090b0 tx=0x7fb3a402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 msgr2=0x7fb3b41534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b41534a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0007e00 tx=0x7fb3a000a430 comp rx=0 tx=0).stop 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 shutdown_connections 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39406beb0 0x7fb39406e370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b4161c10 0x7fb3b4145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b4147820 0x7fb3b41534a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 --2- 172.21.15.7:0/3384861895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b4072fa0 0x7fb3b40cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.230+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 >> 172.21.15.7:0/3384861895 conn(0x7fb3b406bc70 msgr2=0x7fb3b40b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.231+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 shutdown_connections 2024-08-19T00:37:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.231+0000 7fb3b8e00640 1 -- 172.21.15.7:0/3384861895 wait complete. 2024-08-19T00:37:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.241+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb4c0156190 con 0x7fb4c015dc60 2024-08-19T00:37:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.242+0000 7fb4b7e00640 1 -- 172.21.15.7:0/3134087501 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4a807daf0 con 0x7fb4c015dc60 2024-08-19T00:37:12.245 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2024-08-19T00:37:12.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb49c06be80 msgr2=0x7fb49c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb49c06be80 0x7fb49c06e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009a40 tx=0x7fb4b000b040 comp rx=0 tx=0).stop 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4c015dc60 msgr2=0x7fb4c01583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4c015dc60 0x7fb4c01583a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8032000 tx=0x7fb4a80046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 shutdown_connections 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb49c06be80 0x7fb49c06e340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4c015e820 0x7fb4c01563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4c015dc60 0x7fb4c01583a0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8032000 tx=0x7fb4a80046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 --2- 172.21.15.7:0/3134087501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4c015a670 0x7fb4c014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.246+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 >> 172.21.15.7:0/3134087501 conn(0x7fb4c00b1c60 msgr2=0x7fb4c00717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.247+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 shutdown_connections 2024-08-19T00:37:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.247+0000 7fb4c5200640 1 -- 172.21.15.7:0/3134087501 wait complete. 2024-08-19T00:37:12.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2024-08-19T00:37:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.249+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f32b406e6d0 con 0x7f32b4165bb0 2024-08-19T00:37:12.251 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.249+0000 7f32ab400640 1 -- 172.21.15.7:0/1708278296 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32a4059100 con 0x7f32b4165bb0 2024-08-19T00:37:12.252 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2024-08-19T00:37:12.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.252+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329006be30 msgr2=0x7f329006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.252+0000 7f32b9000640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329006be30 0x7f329006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006fd0 tx=0x7f32ac008040 comp rx=0 tx=0).stop 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.252+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b4165bb0 msgr2=0x7f32b40cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.252+0000 7f32b9000640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b4165bb0 0x7f32b40cbef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32a400e8d0 tx=0x7f32a400ed90 comp rx=0 tx=0).stop 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.252+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 shutdown_connections 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.252+0000 7f32b9000640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329006be30 0x7f329006e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.253+0000 7f32b9000640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b4166620 0x7f32b41fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.253+0000 7f32b9000640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b4165bb0 0x7f32b40cbef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.253+0000 7f32b9000640 1 --2- 172.21.15.7:0/1708278296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b40b3eb0 0x7f32b4157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.253+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 >> 172.21.15.7:0/1708278296 conn(0x7f32b406d600 msgr2=0x7f32b4163400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.253+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 shutdown_connections 2024-08-19T00:37:12.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.253+0000 7f32b9000640 1 -- 172.21.15.7:0/1708278296 wait complete. 2024-08-19T00:37:12.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.257+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f58e40e5490 con 0x7f58e4051870 2024-08-19T00:37:12.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.258+0000 7f58e9600640 1 -- 172.21.15.7:0/1798185512 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58d805cbf0 con 0x7f58e4051870 2024-08-19T00:37:12.260 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2024-08-19T00:37:12.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.258+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3c9c0cc720 con 0x7f3c9c06f8b0 2024-08-19T00:37:12.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.259+0000 7f3c93400640 1 -- 172.21.15.7:0/2366257828 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3c9c14b160 con 0x7f3c9c06f8b0 2024-08-19T00:37:12.261 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2024-08-19T00:37:12.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f58cc06bf30 msgr2=0x7f58cc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f58cc06bf30 0x7f58cc06e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0761b0 tx=0x7f58ec06d000 comp rx=0 tx=0).stop 2024-08-19T00:37:12.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e4051870 msgr2=0x7f58e40e4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e4051870 0x7f58e40e4550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58e400cc30 tx=0x7f58d8011920 comp rx=0 tx=0).stop 2024-08-19T00:37:12.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.261+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c7c06be80 msgr2=0x7f3c7c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.261+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c7c06be80 0x7f3c7c06e340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00a640 tx=0x7f3c8c00a350 comp rx=0 tx=0).stop 2024-08-19T00:37:12.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.261+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 msgr2=0x7f3c9c1471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.261+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c1471c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c06c830 tx=0x7f3c880046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 shutdown_connections 2024-08-19T00:37:12.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c7c06be80 0x7f3c7c06e340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c071ed0 0x7f3c9c150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c9c06f8b0 0x7f3c9c1471c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 --2- 172.21.15.7:0/2366257828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9c06d600 0x7f3c9c144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 >> 172.21.15.7:0/2366257828 conn(0x7f3c9c06b850 msgr2=0x7f3c9c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 shutdown_connections 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f58cc06bf30 0x7f58cc06e3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e4051870 0x7f58e40e4550 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58e4038e60 0x7f58e4052830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 --2- 172.21.15.7:0/1798185512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58d40039b0 0x7f58e40df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 >> 172.21.15.7:0/1798185512 conn(0x7f58e401fb30 msgr2=0x7f58e4055e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 shutdown_connections 2024-08-19T00:37:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 shutdown_connections 2024-08-19T00:37:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f3ca0e00640 1 -- 172.21.15.7:0/2366257828 wait complete. 2024-08-19T00:37:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.262+0000 7f58f4400640 1 -- 172.21.15.7:0/1798185512 wait complete. 2024-08-19T00:37:12.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.270+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8af81574e0 con 0x7f8af81eff30 2024-08-19T00:37:12.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.271+0000 7f8aefe00640 1 -- 172.21.15.7:0/3892798341 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8af005a640 con 0x7f8af81eff30 2024-08-19T00:37:12.277 INFO:teuthology.orchestra.run.smithi007.stdout:55834574854 2024-08-19T00:37:12.277 INFO:teuthology.orchestra.run.smithi007.stdout:55834574855 2024-08-19T00:37:12.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.272+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe6080acff0 con 0x7fe6080aeb10 2024-08-19T00:37:12.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.273+0000 7fe604c00640 1 -- 172.21.15.7:0/2539036680 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe60007a7a0 con 0x7fe6080aeb10 2024-08-19T00:37:12.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2024-08-19T00:37:12.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-08-19T00:37:12.279 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.279 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ad806be80 msgr2=0x7f8ad806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ad806be80 0x7f8ad806e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001460 tx=0x7f8ae4000f80 comp rx=0 tx=0).stop 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af81eff30 msgr2=0x7f8af81f03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af81eff30 0x7f8af81f03b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8af000a220 tx=0x7f8af0001ea0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 shutdown_connections 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ad806be80 0x7f8ad806e340 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af81eff30 0x7f8af81f03b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8af8151eb0 0x7f8af81ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 --2- 172.21.15.7:0/3892798341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8adc004800 0x7f8af8153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 >> 172.21.15.7:0/3892798341 conn(0x7f8af806d600 msgr2=0x7f8af81595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 shutdown_connections 2024-08-19T00:37:12.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.275+0000 7f8afd400640 1 -- 172.21.15.7:0/3892798341 wait complete. 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe5e806be80 msgr2=0x7fe5e806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe5e806be80 0x7fe5e806e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe60806e020 tx=0x7fe5f8007c10 comp rx=0 tx=0).stop 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 msgr2=0x7fe60815fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe60815fb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe600004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 shutdown_connections 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe5e806be80 0x7fe5e806e340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6080d0ad0 0x7fe608164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6080ce460 0x7fe608163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 --2- 172.21.15.7:0/2539036680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6080aeb10 0x7fe60815fb50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 >> 172.21.15.7:0/2539036680 conn(0x7fe60806bc70 msgr2=0x7fe608072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 shutdown_connections 2024-08-19T00:37:12.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.276+0000 7fe60f600640 1 -- 172.21.15.7:0/2539036680 wait complete. 2024-08-19T00:37:12.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2024-08-19T00:37:12.285 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2024-08-19T00:37:12.292 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2024-08-19T00:37:12.297 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2024-08-19T00:37:12.300 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:12.301 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:37:12.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:37:12.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.496+0000 7f7cbd600640 1 Processor -- start 2024-08-19T00:37:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.496+0000 7f7cbd600640 1 -- start start 2024-08-19T00:37:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cbd600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7cb809aa70 0x7f7cb809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cbd600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb80d0290 0x7f7cb80d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cbd600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb809b390 con 0x7f7cb809b730 2024-08-19T00:37:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cbd600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb815ec30 con 0x7f7cb809aa70 2024-08-19T00:37:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cbd600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb815ef10 con 0x7f7cb80d0290 2024-08-19T00:37:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cb6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7cb809aa70 0x7f7cb809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cb6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7cb809aa70 0x7f7cb809ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35680/0 (socket says 172.21.15.7:35680) 2024-08-19T00:37:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cb6a00640 1 -- 172.21.15.7:0/2459835638 learned_addr learned my addr 172.21.15.7:0/2459835638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.497+0000 7f7cb7400640 1 --2- 172.21.15.7:0/2459835638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb80d0290 0x7f7cb80d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.498+0000 7f7cb6a00640 1 -- 172.21.15.7:0/2459835638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb80d0290 msgr2=0x7f7cb80d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.498+0000 7f7cb6a00640 1 --2- 172.21.15.7:0/2459835638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb80d0290 0x7f7cb80d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.498+0000 7f7cb6a00640 1 -- 172.21.15.7:0/2459835638 >> v1:172.21.15.162:6789/0 conn(0x7f7cb809b730 legacy=0x7f7cb806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.498+0000 7f7cb6a00640 1 -- 172.21.15.7:0/2459835638 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb815f1f0 con 0x7f7cb809aa70 2024-08-19T00:37:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.499+0000 7f7cb6a00640 1 --2- 172.21.15.7:0/2459835638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809aa70 0x7f7cb809ae50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009870 tx=0x7f7ca802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fd04941e7e7bcb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.499+0000 7f7cb5600640 1 -- 172.21.15.7:0/2459835638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8037070 con 0x7f7cb809aa70 2024-08-19T00:37:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.499+0000 7f7cb5600640 1 -- 172.21.15.7:0/2459835638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca8032440 con 0x7f7cb809aa70 2024-08-19T00:37:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.499+0000 7f7cb5600640 1 -- 172.21.15.7:0/2459835638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8032810 con 0x7f7cb809aa70 2024-08-19T00:37:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.499+0000 7f7cbd600640 1 -- 172.21.15.7:0/2459835638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809aa70 msgr2=0x7f7cb809ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.499+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2459835638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809aa70 0x7f7cb809ae50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009870 tx=0x7f7ca802a270 comp rx=0 tx=0).stop 2024-08-19T00:37:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.500+0000 7f7cbd600640 1 -- 172.21.15.7:0/2459835638 shutdown_connections 2024-08-19T00:37:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.500+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2459835638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb80d0290 0x7f7cb80d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.500+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2459835638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809aa70 0x7f7cb809ae50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.500+0000 7f7cbd600640 1 -- 172.21.15.7:0/2459835638 >> 172.21.15.7:0/2459835638 conn(0x7f7cb80d2190 msgr2=0x7f7cb80d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.500+0000 7f7cbd600640 1 -- 172.21.15.7:0/2459835638 shutdown_connections 2024-08-19T00:37:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.500+0000 7f7cbd600640 1 -- 172.21.15.7:0/2459835638 wait complete. 2024-08-19T00:37:12.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.501+0000 7f7cbd600640 1 Processor -- start 2024-08-19T00:37:12.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.501+0000 7f7cbd600640 1 -- start start 2024-08-19T00:37:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.502+0000 7f7cbd600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb809aa70 0x7f7cb81629b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.502+0000 7f7cbd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809b730 0x7f7cb8154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.502+0000 7f7cbd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb80d0290 0x7f7cb815fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.502+0000 7f7cbd600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb80d0c60 con 0x7f7cb809b730 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.502+0000 7f7cbd600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb815e8f0 con 0x7f7cb80d0290 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.502+0000 7f7cbd600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb80d0de0 con 0x7f7cb809aa70 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.502+0000 7f7cb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809b730 0x7f7cb8154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb809aa70 0x7f7cb81629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809b730 0x7f7cb8154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35690/0 (socket says 172.21.15.7:35690) 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb80d0290 0x7f7cb815fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 -- 172.21.15.7:0/2666663370 learned_addr learned my addr 172.21.15.7:0/2666663370 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 -- 172.21.15.7:0/2666663370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb809aa70 msgr2=0x7f7cb81629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb809aa70 0x7f7cb81629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 -- 172.21.15.7:0/2666663370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb80d0290 msgr2=0x7f7cb815fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb80d0290 0x7f7cb815fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 -- 172.21.15.7:0/2666663370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb80b7c50 con 0x7f7cb809b730 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cb6000640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809b730 0x7f7cb8154060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400c430 tx=0x7f7ca400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7caea00640 1 -- 172.21.15.7:0/2666663370 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40052d0 con 0x7f7cb809b730 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7caea00640 1 -- 172.21.15.7:0/2666663370 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca4005490 con 0x7f7cb809b730 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7caea00640 1 -- 172.21.15.7:0/2666663370 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4007260 con 0x7f7cb809b730 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.503+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb80af1c0 con 0x7f7cb809b730 2024-08-19T00:37:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.504+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb80b5e50 con 0x7f7cb809b730 2024-08-19T00:37:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.505+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb809ae50 con 0x7f7cb809b730 2024-08-19T00:37:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.506+0000 7f7caea00640 1 -- 172.21.15.7:0/2666663370 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ca4007400 con 0x7f7cb809b730 2024-08-19T00:37:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.506+0000 7f7caea00640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c9806be30 0x7f7c9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.506+0000 7f7caea00640 1 -- 172.21.15.7:0/2666663370 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7ca408a2c0 con 0x7f7cb809b730 2024-08-19T00:37:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.507+0000 7f7cb6a00640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c9806be30 0x7f7c9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.507+0000 7f7cb6a00640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c9806be30 0x7f7c9806e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8034000 tx=0x7f7ca802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.511+0000 7f7caea00640 1 -- 172.21.15.7:0/2666663370 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7ca4058620 con 0x7f7cb809b730 2024-08-19T00:37:12.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.694+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7cb8063150 con 0x7f7c9806be30 2024-08-19T00:37:12.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.701+0000 7f7caea00640 1 -- 172.21.15.7:0/2666663370 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251832 (secure 0 0 0) 0x7f7cb8063150 con 0x7f7c9806be30 2024-08-19T00:37:12.706 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c9806be30 msgr2=0x7f7c9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c9806be30 0x7f7c9806e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8034000 tx=0x7f7ca802e000 comp rx=0 tx=0).stop 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809b730 msgr2=0x7f7cb8154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809b730 0x7f7cb8154060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400c430 tx=0x7f7ca400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 shutdown_connections 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c9806be30 0x7f7c9806e2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb80d0290 0x7f7cb815fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cb809b730 0x7f7cb8154060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 --2- 172.21.15.7:0/2666663370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cb809aa70 0x7f7cb81629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 >> 172.21.15.7:0/2666663370 conn(0x7f7cb80d2190 msgr2=0x7f7cb8074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 shutdown_connections 2024-08-19T00:37:12.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.705+0000 7f7cbd600640 1 -- 172.21.15.7:0/2666663370 wait complete. 2024-08-19T00:37:12.724 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-19T00:37:11.256833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235736,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738984,"statfs":{"total":773094113280,"available":772852719616,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384036+0000","last_change":"2024-08-19T00:37:03.384522+0000","last_active":"2024-08-19T00:37:04.384036+0000","last_peered":"2024-08-19T00:37:04.384036+0000","last_clean":"2024-08-19T00:37:04.384036+0000","last_became_active":"2024-08-19T00:37:03.378809+0000","last_became_peered":"2024-08-19T00:37:03.378809+0000","last_unstale":"2024-08-19T00:37:04.384036+0000","last_undegraded":"2024-08-19T00:37:04.384036+0000","last_fullsized":"2024-08-19T00:37:04.384036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368586+0000","last_change":"2024-08-19T00:37:03.375782+0000","last_active":"2024-08-19T00:37:04.368586+0000","last_peered":"2024-08-19T00:37:04.368586+0000","last_clean":"2024-08-19T00:37:04.368586+0000","last_became_active":"2024-08-19T00:37:03.375533+0000","last_became_peered":"2024-08-19T00:37:03.375533+0000","last_unstale":"2024-08-19T00:37:04.368586+0000","last_undegraded":"2024-08-19T00:37:04.368586+0000","last_fullsized":"2024-08-19T00:37:04.368586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368559+0000","last_change":"2024-08-19T00:37:03.387391+0000","last_active":"2024-08-19T00:37:04.368559+0000","last_peered":"2024-08-19T00:37:04.368559+0000","last_clean":"2024-08-19T00:37:04.368559+0000","last_became_active":"2024-08-19T00:37:03.386550+0000","last_became_peered":"2024-08-19T00:37:03.386550+0000","last_unstale":"2024-08-19T00:37:04.368559+0000","last_undegraded":"2024-08-19T00:37:04.368559+0000","last_fullsized":"2024-08-19T00:37:04.368559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464051+0000","last_change":"2024-08-19T00:37:03.366111+0000","last_active":"2024-08-19T00:37:04.464051+0000","last_peered":"2024-08-19T00:37:04.464051+0000","last_clean":"2024-08-19T00:37:04.464051+0000","last_became_active":"2024-08-19T00:37:03.365397+0000","last_became_peered":"2024-08-19T00:37:03.365397+0000","last_unstale":"2024-08-19T00:37:04.464051+0000","last_undegraded":"2024-08-19T00:37:04.464051+0000","last_fullsized":"2024-08-19T00:37:04.464051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383873+0000","last_change":"2024-08-19T00:37:03.374066+0000","last_active":"2024-08-19T00:37:04.383873+0000","last_peered":"2024-08-19T00:37:04.383873+0000","last_clean":"2024-08-19T00:37:04.383873+0000","last_became_active":"2024-08-19T00:37:03.373773+0000","last_became_peered":"2024-08-19T00:37:03.373773+0000","last_unstale":"2024-08-19T00:37:04.383873+0000","last_undegraded":"2024-08-19T00:37:04.383873+0000","last_fullsized":"2024-08-19T00:37:04.383873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463972+0000","last_change":"2024-08-19T00:37:03.373062+0000","last_active":"2024-08-19T00:37:04.463972+0000","last_peered":"2024-08-19T00:37:04.463972+0000","last_clean":"2024-08-19T00:37:04.463972+0000","last_became_active":"2024-08-19T00:37:03.372380+0000","last_became_peered":"2024-08-19T00:37:03.372380+0000","last_unstale":"2024-08-19T00:37:04.463972+0000","last_undegraded":"2024-08-19T00:37:04.463972+0000","last_fullsized":"2024-08-19T00:37:04.463972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384097+0000","last_change":"2024-08-19T00:37:03.381691+0000","last_active":"2024-08-19T00:37:04.384097+0000","last_peered":"2024-08-19T00:37:04.384097+0000","last_clean":"2024-08-19T00:37:04.384097+0000","last_became_active":"2024-08-19T00:37:03.381312+0000","last_became_peered":"2024-08-19T00:37:03.381312+0000","last_unstale":"2024-08-19T00:37:04.384097+0000","last_undegraded":"2024-08-19T00:37:04.384097+0000","last_fullsized":"2024-08-19T00:37:04.384097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368077+0000","last_change":"2024-08-19T00:37:03.386764+0000","last_active":"2024-08-19T00:37:04.368077+0000","last_peered":"2024-08-19T00:37:04.368077+0000","last_clean":"2024-08-19T00:37:04.368077+0000","last_became_active":"2024-08-19T00:37:03.385701+0000","last_became_peered":"2024-08-19T00:37:03.385701+0000","last_unstale":"2024-08-19T00:37:04.368077+0000","last_undegraded":"2024-08-19T00:37:04.368077+0000","last_fullsized":"2024-08-19T00:37:04.368077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464403+0000","last_change":"2024-08-19T00:37:03.383398+0000","last_active":"2024-08-19T00:37:04.464403+0000","last_peered":"2024-08-19T00:37:04.464403+0000","last_clean":"2024-08-19T00:37:04.464403+0000","last_became_active":"2024-08-19T00:37:03.383039+0000","last_became_peered":"2024-08-19T00:37:03.383039+0000","last_unstale":"2024-08-19T00:37:04.464403+0000","last_undegraded":"2024-08-19T00:37:04.464403+0000","last_fullsized":"2024-08-19T00:37:04.464403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383773+0000","last_change":"2024-08-19T00:37:03.367285+0000","last_active":"2024-08-19T00:37:04.383773+0000","last_peered":"2024-08-19T00:37:04.383773+0000","last_clean":"2024-08-19T00:37:04.383773+0000","last_became_active":"2024-08-19T00:37:03.366995+0000","last_became_peered":"2024-08-19T00:37:03.366995+0000","last_unstale":"2024-08-19T00:37:04.383773+0000","last_undegraded":"2024-08-19T00:37:04.383773+0000","last_fullsized":"2024-08-19T00:37:04.383773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383787+0000","last_change":"2024-08-19T00:37:03.368053+0000","last_active":"2024-08-19T00:37:04.383787+0000","last_peered":"2024-08-19T00:37:04.383787+0000","last_clean":"2024-08-19T00:37:04.383787+0000","last_became_active":"2024-08-19T00:37:03.367766+0000","last_became_peered":"2024-08-19T00:37:03.367766+0000","last_unstale":"2024-08-19T00:37:04.383787+0000","last_undegraded":"2024-08-19T00:37:04.383787+0000","last_fullsized":"2024-08-19T00:37:04.383787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383805+0000","last_change":"2024-08-19T00:37:03.381800+0000","last_active":"2024-08-19T00:37:04.383805+0000","last_peered":"2024-08-19T00:37:04.383805+0000","last_clean":"2024-08-19T00:37:04.383805+0000","last_became_active":"2024-08-19T00:37:03.380371+0000","last_became_peered":"2024-08-19T00:37:03.380371+0000","last_unstale":"2024-08-19T00:37:04.383805+0000","last_undegraded":"2024-08-19T00:37:04.383805+0000","last_fullsized":"2024-08-19T00:37:04.383805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464125+0000","last_change":"2024-08-19T00:37:03.375068+0000","last_active":"2024-08-19T00:37:04.464125+0000","last_peered":"2024-08-19T00:37:04.464125+0000","last_clean":"2024-08-19T00:37:04.464125+0000","last_became_active":"2024-08-19T00:37:03.374786+0000","last_became_peered":"2024-08-19T00:37:03.374786+0000","last_unstale":"2024-08-19T00:37:04.464125+0000","last_undegraded":"2024-08-19T00:37:04.464125+0000","last_fullsized":"2024-08-19T00:37:04.464125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463980+0000","last_change":"2024-08-19T00:37:03.372712+0000","last_active":"2024-08-19T00:37:04.463980+0000","last_peered":"2024-08-19T00:37:04.463980+0000","last_clean":"2024-08-19T00:37:04.463980+0000","last_became_active":"2024-08-19T00:37:03.372479+0000","last_became_peered":"2024-08-19T00:37:03.372479+0000","last_unstale":"2024-08-19T00:37:04.463980+0000","last_undegraded":"2024-08-19T00:37:04.463980+0000","last_fullsized":"2024-08-19T00:37:04.463980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368043+0000","last_change":"2024-08-19T00:37:03.373145+0000","last_active":"2024-08-19T00:37:04.368043+0000","last_peered":"2024-08-19T00:37:04.368043+0000","last_clean":"2024-08-19T00:37:04.368043+0000","last_became_active":"2024-08-19T00:37:03.372872+0000","last_became_peered":"2024-08-19T00:37:03.372872+0000","last_unstale":"2024-08-19T00:37:04.368043+0000","last_undegraded":"2024-08-19T00:37:04.368043+0000","last_fullsized":"2024-08-19T00:37:04.368043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364979+0000","last_change":"2024-08-19T00:37:03.381878+0000","last_active":"2024-08-19T00:37:04.364979+0000","last_peered":"2024-08-19T00:37:04.364979+0000","last_clean":"2024-08-19T00:37:04.364979+0000","last_became_active":"2024-08-19T00:37:03.381642+0000","last_became_peered":"2024-08-19T00:37:03.381642+0000","last_unstale":"2024-08-19T00:37:04.364979+0000","last_undegraded":"2024-08-19T00:37:04.364979+0000","last_fullsized":"2024-08-19T00:37:04.364979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366018+0000","last_change":"2024-08-19T00:37:03.388402+0000","last_active":"2024-08-19T00:37:04.366018+0000","last_peered":"2024-08-19T00:37:04.366018+0000","last_clean":"2024-08-19T00:37:04.366018+0000","last_became_active":"2024-08-19T00:37:03.387161+0000","last_became_peered":"2024-08-19T00:37:03.387161+0000","last_unstale":"2024-08-19T00:37:04.366018+0000","last_undegraded":"2024-08-19T00:37:04.366018+0000","last_fullsized":"2024-08-19T00:37:04.366018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:17.499516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369876+0000","last_change":"2024-08-19T00:37:03.379215+0000","last_active":"2024-08-19T00:37:04.369876+0000","last_peered":"2024-08-19T00:37:04.369876+0000","last_clean":"2024-08-19T00:37:04.369876+0000","last_became_active":"2024-08-19T00:37:03.378899+0000","last_became_peered":"2024-08-19T00:37:03.378899+0000","last_unstale":"2024-08-19T00:37:04.369876+0000","last_undegraded":"2024-08-19T00:37:04.369876+0000","last_fullsized":"2024-08-19T00:37:04.369876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365805+0000","last_change":"2024-08-19T00:37:03.384467+0000","last_active":"2024-08-19T00:37:04.365805+0000","last_peered":"2024-08-19T00:37:04.365805+0000","last_clean":"2024-08-19T00:37:04.365805+0000","last_became_active":"2024-08-19T00:37:03.384206+0000","last_became_peered":"2024-08-19T00:37:03.384206+0000","last_unstale":"2024-08-19T00:37:04.365805+0000","last_undegraded":"2024-08-19T00:37:04.365805+0000","last_fullsized":"2024-08-19T00:37:04.365805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:06.468363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383955+0000","last_change":"2024-08-19T00:37:03.381984+0000","last_active":"2024-08-19T00:37:04.383955+0000","last_peered":"2024-08-19T00:37:04.383955+0000","last_clean":"2024-08-19T00:37:04.383955+0000","last_became_active":"2024-08-19T00:37:03.379208+0000","last_became_peered":"2024-08-19T00:37:03.379208+0000","last_unstale":"2024-08-19T00:37:04.383955+0000","last_undegraded":"2024-08-19T00:37:04.383955+0000","last_fullsized":"2024-08-19T00:37:04.383955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380591+0000","last_change":"2024-08-19T00:37:03.366104+0000","last_active":"2024-08-19T00:37:04.380591+0000","last_peered":"2024-08-19T00:37:04.380591+0000","last_clean":"2024-08-19T00:37:04.380591+0000","last_became_active":"2024-08-19T00:37:03.365823+0000","last_became_peered":"2024-08-19T00:37:03.365823+0000","last_unstale":"2024-08-19T00:37:04.380591+0000","last_undegraded":"2024-08-19T00:37:04.380591+0000","last_fullsized":"2024-08-19T00:37:04.380591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463440+0000","last_change":"2024-08-19T00:37:03.370063+0000","last_active":"2024-08-19T00:37:04.463440+0000","last_peered":"2024-08-19T00:37:04.463440+0000","last_clean":"2024-08-19T00:37:04.463440+0000","last_became_active":"2024-08-19T00:37:03.369707+0000","last_became_peered":"2024-08-19T00:37:03.369707+0000","last_unstale":"2024-08-19T00:37:04.463440+0000","last_undegraded":"2024-08-19T00:37:04.463440+0000","last_fullsized":"2024-08-19T00:37:04.463440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368265+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368265+0000","last_peered":"2024-08-19T00:37:04.368265+0000","last_clean":"2024-08-19T00:37:04.368265+0000","last_became_active":"2024-08-19T00:37:03.372854+0000","last_became_peered":"2024-08-19T00:37:03.372854+0000","last_unstale":"2024-08-19T00:37:04.368265+0000","last_undegraded":"2024-08-19T00:37:04.368265+0000","last_fullsized":"2024-08-19T00:37:04.368265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364944+0000","last_change":"2024-08-19T00:37:03.386557+0000","last_active":"2024-08-19T00:37:04.364944+0000","last_peered":"2024-08-19T00:37:04.364944+0000","last_clean":"2024-08-19T00:37:04.364944+0000","last_became_active":"2024-08-19T00:37:03.386294+0000","last_became_peered":"2024-08-19T00:37:03.386294+0000","last_unstale":"2024-08-19T00:37:04.364944+0000","last_undegraded":"2024-08-19T00:37:04.364944+0000","last_fullsized":"2024-08-19T00:37:04.364944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368793+0000","last_change":"2024-08-19T00:37:03.379194+0000","last_active":"2024-08-19T00:37:04.368793+0000","last_peered":"2024-08-19T00:37:04.368793+0000","last_clean":"2024-08-19T00:37:04.368793+0000","last_became_active":"2024-08-19T00:37:03.378509+0000","last_became_peered":"2024-08-19T00:37:03.378509+0000","last_unstale":"2024-08-19T00:37:04.368793+0000","last_undegraded":"2024-08-19T00:37:04.368793+0000","last_fullsized":"2024-08-19T00:37:04.368793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464421+0000","last_change":"2024-08-19T00:37:03.373705+0000","last_active":"2024-08-19T00:37:04.464421+0000","last_peered":"2024-08-19T00:37:04.464421+0000","last_clean":"2024-08-19T00:37:04.464421+0000","last_became_active":"2024-08-19T00:37:03.366841+0000","last_became_peered":"2024-08-19T00:37:03.366841+0000","last_unstale":"2024-08-19T00:37:04.464421+0000","last_undegraded":"2024-08-19T00:37:04.464421+0000","last_fullsized":"2024-08-19T00:37:04.464421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464316+0000","last_change":"2024-08-19T00:37:03.370473+0000","last_active":"2024-08-19T00:37:04.464316+0000","last_peered":"2024-08-19T00:37:04.464316+0000","last_clean":"2024-08-19T00:37:04.464316+0000","last_became_active":"2024-08-19T00:37:03.370106+0000","last_became_peered":"2024-08-19T00:37:03.370106+0000","last_unstale":"2024-08-19T00:37:04.464316+0000","last_undegraded":"2024-08-19T00:37:04.464316+0000","last_fullsized":"2024-08-19T00:37:04.464316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464155+0000","last_change":"2024-08-19T00:37:03.383036+0000","last_active":"2024-08-19T00:37:04.464155+0000","last_peered":"2024-08-19T00:37:04.464155+0000","last_clean":"2024-08-19T00:37:04.464155+0000","last_became_active":"2024-08-19T00:37:03.382643+0000","last_became_peered":"2024-08-19T00:37:03.382643+0000","last_unstale":"2024-08-19T00:37:04.464155+0000","last_undegraded":"2024-08-19T00:37:04.464155+0000","last_fullsized":"2024-08-19T00:37:04.464155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:33.644440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368293+0000","last_change":"2024-08-19T00:37:03.382477+0000","last_active":"2024-08-19T00:37:04.368293+0000","last_peered":"2024-08-19T00:37:04.368293+0000","last_clean":"2024-08-19T00:37:04.368293+0000","last_became_active":"2024-08-19T00:37:03.380124+0000","last_became_peered":"2024-08-19T00:37:03.380124+0000","last_unstale":"2024-08-19T00:37:04.368293+0000","last_undegraded":"2024-08-19T00:37:04.368293+0000","last_fullsized":"2024-08-19T00:37:04.368293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365281+0000","last_change":"2024-08-19T00:37:03.379567+0000","last_active":"2024-08-19T00:37:04.365281+0000","last_peered":"2024-08-19T00:37:04.365281+0000","last_clean":"2024-08-19T00:37:04.365281+0000","last_became_active":"2024-08-19T00:37:03.372732+0000","last_became_peered":"2024-08-19T00:37:03.372732+0000","last_unstale":"2024-08-19T00:37:04.365281+0000","last_undegraded":"2024-08-19T00:37:04.365281+0000","last_fullsized":"2024-08-19T00:37:04.365281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369286+0000","last_change":"2024-08-19T00:37:03.372911+0000","last_active":"2024-08-19T00:37:04.369286+0000","last_peered":"2024-08-19T00:37:04.369286+0000","last_clean":"2024-08-19T00:37:04.369286+0000","last_became_active":"2024-08-19T00:37:03.372598+0000","last_became_peered":"2024-08-19T00:37:03.372598+0000","last_unstale":"2024-08-19T00:37:04.369286+0000","last_undegraded":"2024-08-19T00:37:04.369286+0000","last_fullsized":"2024-08-19T00:37:04.369286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463669+0000","last_change":"2024-08-19T00:37:03.363843+0000","last_active":"2024-08-19T00:37:04.463669+0000","last_peered":"2024-08-19T00:37:04.463669+0000","last_clean":"2024-08-19T00:37:04.463669+0000","last_became_active":"2024-08-19T00:37:03.362519+0000","last_became_peered":"2024-08-19T00:37:03.362519+0000","last_unstale":"2024-08-19T00:37:04.463669+0000","last_undegraded":"2024-08-19T00:37:04.463669+0000","last_fullsized":"2024-08-19T00:37:04.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463528+0000","last_change":"2024-08-19T00:37:03.373644+0000","last_active":"2024-08-19T00:37:04.463528+0000","last_peered":"2024-08-19T00:37:04.463528+0000","last_clean":"2024-08-19T00:37:04.463528+0000","last_became_active":"2024-08-19T00:37:03.373298+0000","last_became_peered":"2024-08-19T00:37:03.373298+0000","last_unstale":"2024-08-19T00:37:04.463528+0000","last_undegraded":"2024-08-19T00:37:04.463528+0000","last_fullsized":"2024-08-19T00:37:04.463528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368301+0000","last_change":"2024-08-19T00:37:02.366620+0000","last_active":"2024-08-19T00:37:04.368301+0000","last_peered":"2024-08-19T00:37:04.368301+0000","last_clean":"2024-08-19T00:37:04.368301+0000","last_became_active":"2024-08-19T00:37:02.366071+0000","last_became_peered":"2024-08-19T00:37:02.366071+0000","last_unstale":"2024-08-19T00:37:04.368301+0000","last_undegraded":"2024-08-19T00:37:04.368301+0000","last_fullsized":"2024-08-19T00:37:04.368301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380696+0000","last_change":"2024-08-19T00:37:03.369278+0000","last_active":"2024-08-19T00:37:04.380696+0000","last_peered":"2024-08-19T00:37:04.380696+0000","last_clean":"2024-08-19T00:37:04.380696+0000","last_became_active":"2024-08-19T00:37:03.365557+0000","last_became_peered":"2024-08-19T00:37:03.365557+0000","last_unstale":"2024-08-19T00:37:04.380696+0000","last_undegraded":"2024-08-19T00:37:04.380696+0000","last_fullsized":"2024-08-19T00:37:04.380696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:53.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365384+0000","last_change":"2024-08-19T00:37:02.362332+0000","last_active":"2024-08-19T00:37:04.365384+0000","last_peered":"2024-08-19T00:37:04.365384+0000","last_clean":"2024-08-19T00:37:04.365384+0000","last_became_active":"2024-08-19T00:37:02.362055+0000","last_became_peered":"2024-08-19T00:37:02.362055+0000","last_unstale":"2024-08-19T00:37:04.365384+0000","last_undegraded":"2024-08-19T00:37:04.365384+0000","last_fullsized":"2024-08-19T00:37:04.365384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463849+0000","last_change":"2024-08-19T00:37:02.370542+0000","last_active":"2024-08-19T00:37:04.463849+0000","last_peered":"2024-08-19T00:37:04.463849+0000","last_clean":"2024-08-19T00:37:04.463849+0000","last_became_active":"2024-08-19T00:37:02.369837+0000","last_became_peered":"2024-08-19T00:37:02.369837+0000","last_unstale":"2024-08-19T00:37:04.463849+0000","last_undegraded":"2024-08-19T00:37:04.463849+0000","last_fullsized":"2024-08-19T00:37:04.463849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:45.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368309+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368309+0000","last_peered":"2024-08-19T00:37:04.368309+0000","last_clean":"2024-08-19T00:37:04.368309+0000","last_became_active":"2024-08-19T00:37:03.376353+0000","last_became_peered":"2024-08-19T00:37:03.376353+0000","last_unstale":"2024-08-19T00:37:04.368309+0000","last_undegraded":"2024-08-19T00:37:04.368309+0000","last_fullsized":"2024-08-19T00:37:04.368309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365038+0000","last_change":"2024-08-19T00:37:02.358463+0000","last_active":"2024-08-19T00:37:04.365038+0000","last_peered":"2024-08-19T00:37:04.365038+0000","last_clean":"2024-08-19T00:37:04.365038+0000","last_became_active":"2024-08-19T00:37:02.357105+0000","last_became_peered":"2024-08-19T00:37:02.357105+0000","last_unstale":"2024-08-19T00:37:04.365038+0000","last_undegraded":"2024-08-19T00:37:04.365038+0000","last_fullsized":"2024-08-19T00:37:04.365038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380664+0000","last_change":"2024-08-19T00:37:03.372060+0000","last_active":"2024-08-19T00:37:04.380664+0000","last_peered":"2024-08-19T00:37:04.380664+0000","last_clean":"2024-08-19T00:37:04.380664+0000","last_became_active":"2024-08-19T00:37:03.371830+0000","last_became_peered":"2024-08-19T00:37:03.371830+0000","last_unstale":"2024-08-19T00:37:04.380664+0000","last_undegraded":"2024-08-19T00:37:04.380664+0000","last_fullsized":"2024-08-19T00:37:04.380664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:17.064649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464497+0000","last_change":"2024-08-19T00:37:02.359600+0000","last_active":"2024-08-19T00:37:04.464497+0000","last_peered":"2024-08-19T00:37:04.464497+0000","last_clean":"2024-08-19T00:37:04.464497+0000","last_became_active":"2024-08-19T00:37:02.357350+0000","last_became_peered":"2024-08-19T00:37:02.357350+0000","last_unstale":"2024-08-19T00:37:04.464497+0000","last_undegraded":"2024-08-19T00:37:04.464497+0000","last_fullsized":"2024-08-19T00:37:04.464497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464491+0000","last_change":"2024-08-19T00:37:03.368421+0000","last_active":"2024-08-19T00:37:04.464491+0000","last_peered":"2024-08-19T00:37:04.464491+0000","last_clean":"2024-08-19T00:37:04.464491+0000","last_became_active":"2024-08-19T00:37:03.367857+0000","last_became_peered":"2024-08-19T00:37:03.367857+0000","last_unstale":"2024-08-19T00:37:04.464491+0000","last_undegraded":"2024-08-19T00:37:04.464491+0000","last_fullsized":"2024-08-19T00:37:04.464491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383943+0000","last_change":"2024-08-19T00:37:02.371034+0000","last_active":"2024-08-19T00:37:04.383943+0000","last_peered":"2024-08-19T00:37:04.383943+0000","last_clean":"2024-08-19T00:37:04.383943+0000","last_became_active":"2024-08-19T00:37:02.370558+0000","last_became_peered":"2024-08-19T00:37:02.370558+0000","last_unstale":"2024-08-19T00:37:04.383943+0000","last_undegraded":"2024-08-19T00:37:04.383943+0000","last_fullsized":"2024-08-19T00:37:04.383943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368959+0000","last_change":"2024-08-19T00:37:03.379464+0000","last_active":"2024-08-19T00:37:04.368959+0000","last_peered":"2024-08-19T00:37:04.368959+0000","last_clean":"2024-08-19T00:37:04.368959+0000","last_became_active":"2024-08-19T00:37:03.378926+0000","last_became_peered":"2024-08-19T00:37:03.378926+0000","last_unstale":"2024-08-19T00:37:04.368959+0000","last_undegraded":"2024-08-19T00:37:04.368959+0000","last_fullsized":"2024-08-19T00:37:04.368959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369623+0000","last_change":"2024-08-19T00:37:02.356530+0000","last_active":"2024-08-19T00:37:04.369623+0000","last_peered":"2024-08-19T00:37:04.369623+0000","last_clean":"2024-08-19T00:37:04.369623+0000","last_became_active":"2024-08-19T00:37:02.356057+0000","last_became_peered":"2024-08-19T00:37:02.356057+0000","last_unstale":"2024-08-19T00:37:04.369623+0000","last_undegraded":"2024-08-19T00:37:04.369623+0000","last_fullsized":"2024-08-19T00:37:04.369623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365621+0000","last_change":"2024-08-19T00:37:03.382907+0000","last_active":"2024-08-19T00:37:04.365621+0000","last_peered":"2024-08-19T00:37:04.365621+0000","last_clean":"2024-08-19T00:37:04.365621+0000","last_became_active":"2024-08-19T00:37:03.382495+0000","last_became_peered":"2024-08-19T00:37:03.382495+0000","last_unstale":"2024-08-19T00:37:04.365621+0000","last_undegraded":"2024-08-19T00:37:04.365621+0000","last_fullsized":"2024-08-19T00:37:04.365621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464058+0000","last_change":"2024-08-19T00:37:02.357795+0000","last_active":"2024-08-19T00:37:04.464058+0000","last_peered":"2024-08-19T00:37:04.464058+0000","last_clean":"2024-08-19T00:37:04.464058+0000","last_became_active":"2024-08-19T00:37:02.356980+0000","last_became_peered":"2024-08-19T00:37:02.356980+0000","last_unstale":"2024-08-19T00:37:04.464058+0000","last_undegraded":"2024-08-19T00:37:04.464058+0000","last_fullsized":"2024-08-19T00:37:04.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:04.046069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383932+0000","last_change":"2024-08-19T00:37:03.375481+0000","last_active":"2024-08-19T00:37:04.383932+0000","last_peered":"2024-08-19T00:37:04.383932+0000","last_clean":"2024-08-19T00:37:04.383932+0000","last_became_active":"2024-08-19T00:37:03.375032+0000","last_became_peered":"2024-08-19T00:37:03.375032+0000","last_unstale":"2024-08-19T00:37:04.383932+0000","last_undegraded":"2024-08-19T00:37:04.383932+0000","last_fullsized":"2024-08-19T00:37:04.383932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369528+0000","last_change":"2024-08-19T00:37:02.353428+0000","last_active":"2024-08-19T00:37:04.369528+0000","last_peered":"2024-08-19T00:37:04.369528+0000","last_clean":"2024-08-19T00:37:04.369528+0000","last_became_active":"2024-08-19T00:37:02.353106+0000","last_became_peered":"2024-08-19T00:37:02.353106+0000","last_unstale":"2024-08-19T00:37:04.369528+0000","last_undegraded":"2024-08-19T00:37:04.369528+0000","last_fullsized":"2024-08-19T00:37:04.369528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463960+0000","last_change":"2024-08-19T00:37:03.381565+0000","last_active":"2024-08-19T00:37:04.463960+0000","last_peered":"2024-08-19T00:37:04.463960+0000","last_clean":"2024-08-19T00:37:04.463960+0000","last_became_active":"2024-08-19T00:37:03.381351+0000","last_became_peered":"2024-08-19T00:37:03.381351+0000","last_unstale":"2024-08-19T00:37:04.463960+0000","last_undegraded":"2024-08-19T00:37:04.463960+0000","last_fullsized":"2024-08-19T00:37:04.463960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365506+0000","last_change":"2024-08-19T00:37:02.361424+0000","last_active":"2024-08-19T00:37:04.365506+0000","last_peered":"2024-08-19T00:37:04.365506+0000","last_clean":"2024-08-19T00:37:04.365506+0000","last_became_active":"2024-08-19T00:37:02.353015+0000","last_became_peered":"2024-08-19T00:37:02.353015+0000","last_unstale":"2024-08-19T00:37:04.365506+0000","last_undegraded":"2024-08-19T00:37:04.365506+0000","last_fullsized":"2024-08-19T00:37:04.365506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:29.508786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365319+0000","last_change":"2024-08-19T00:37:03.377594+0000","last_active":"2024-08-19T00:37:04.365319+0000","last_peered":"2024-08-19T00:37:04.365319+0000","last_clean":"2024-08-19T00:37:04.365319+0000","last_became_active":"2024-08-19T00:37:03.377315+0000","last_became_peered":"2024-08-19T00:37:03.377315+0000","last_unstale":"2024-08-19T00:37:04.365319+0000","last_undegraded":"2024-08-19T00:37:04.365319+0000","last_fullsized":"2024-08-19T00:37:04.365319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:09:14.167938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383994+0000","last_change":"2024-08-19T00:37:02.369821+0000","last_active":"2024-08-19T00:37:04.383994+0000","last_peered":"2024-08-19T00:37:04.383994+0000","last_clean":"2024-08-19T00:37:04.383994+0000","last_became_active":"2024-08-19T00:37:02.369542+0000","last_became_peered":"2024-08-19T00:37:02.369542+0000","last_unstale":"2024-08-19T00:37:04.383994+0000","last_undegraded":"2024-08-19T00:37:04.383994+0000","last_fullsized":"2024-08-19T00:37:04.383994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463395+0000","last_change":"2024-08-19T00:37:03.386039+0000","last_active":"2024-08-19T00:37:04.463395+0000","last_peered":"2024-08-19T00:37:04.463395+0000","last_clean":"2024-08-19T00:37:04.463395+0000","last_became_active":"2024-08-19T00:37:03.385346+0000","last_became_peered":"2024-08-19T00:37:03.385346+0000","last_unstale":"2024-08-19T00:37:04.463395+0000","last_undegraded":"2024-08-19T00:37:04.463395+0000","last_fullsized":"2024-08-19T00:37:04.463395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380539+0000","last_change":"2024-08-19T00:37:02.355538+0000","last_active":"2024-08-19T00:37:04.380539+0000","last_peered":"2024-08-19T00:37:04.380539+0000","last_clean":"2024-08-19T00:37:04.380539+0000","last_became_active":"2024-08-19T00:37:02.355257+0000","last_became_peered":"2024-08-19T00:37:02.355257+0000","last_unstale":"2024-08-19T00:37:04.380539+0000","last_undegraded":"2024-08-19T00:37:04.380539+0000","last_fullsized":"2024-08-19T00:37:04.380539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365142+0000","last_change":"2024-08-19T00:37:03.382874+0000","last_active":"2024-08-19T00:37:04.365142+0000","last_peered":"2024-08-19T00:37:04.365142+0000","last_clean":"2024-08-19T00:37:04.365142+0000","last_became_active":"2024-08-19T00:37:03.382547+0000","last_became_peered":"2024-08-19T00:37:03.382547+0000","last_unstale":"2024-08-19T00:37:04.365142+0000","last_undegraded":"2024-08-19T00:37:04.365142+0000","last_fullsized":"2024-08-19T00:37:04.365142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384268+0000","last_change":"2024-08-19T00:37:02.369846+0000","last_active":"2024-08-19T00:37:04.384268+0000","last_peered":"2024-08-19T00:37:04.384268+0000","last_clean":"2024-08-19T00:37:04.384268+0000","last_became_active":"2024-08-19T00:37:02.369565+0000","last_became_peered":"2024-08-19T00:37:02.369565+0000","last_unstale":"2024-08-19T00:37:04.384268+0000","last_undegraded":"2024-08-19T00:37:04.384268+0000","last_fullsized":"2024-08-19T00:37:04.384268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464558+0000","last_change":"2024-08-19T00:37:03.360371+0000","last_active":"2024-08-19T00:37:04.464558+0000","last_peered":"2024-08-19T00:37:04.464558+0000","last_clean":"2024-08-19T00:37:04.464558+0000","last_became_active":"2024-08-19T00:37:03.360065+0000","last_became_peered":"2024-08-19T00:37:03.360065+0000","last_unstale":"2024-08-19T00:37:04.464558+0000","last_undegraded":"2024-08-19T00:37:04.464558+0000","last_fullsized":"2024-08-19T00:37:04.464558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380861+0000","last_change":"2024-08-19T00:37:02.364244+0000","last_active":"2024-08-19T00:37:04.380861+0000","last_peered":"2024-08-19T00:37:04.380861+0000","last_clean":"2024-08-19T00:37:04.380861+0000","last_became_active":"2024-08-19T00:37:02.363965+0000","last_became_peered":"2024-08-19T00:37:02.363965+0000","last_unstale":"2024-08-19T00:37:04.380861+0000","last_undegraded":"2024-08-19T00:37:04.380861+0000","last_fullsized":"2024-08-19T00:37:04.380861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384061+0000","last_change":"2024-08-19T00:37:03.382232+0000","last_active":"2024-08-19T00:37:04.384061+0000","last_peered":"2024-08-19T00:37:04.384061+0000","last_clean":"2024-08-19T00:37:04.384061+0000","last_became_active":"2024-08-19T00:37:03.378909+0000","last_became_peered":"2024-08-19T00:37:03.378909+0000","last_unstale":"2024-08-19T00:37:04.384061+0000","last_undegraded":"2024-08-19T00:37:04.384061+0000","last_fullsized":"2024-08-19T00:37:04.384061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368532+0000","last_change":"2024-08-19T00:37:02.366925+0000","last_active":"2024-08-19T00:37:04.368532+0000","last_peered":"2024-08-19T00:37:04.368532+0000","last_clean":"2024-08-19T00:37:04.368532+0000","last_became_active":"2024-08-19T00:37:02.366544+0000","last_became_peered":"2024-08-19T00:37:02.366544+0000","last_unstale":"2024-08-19T00:37:04.368532+0000","last_undegraded":"2024-08-19T00:37:04.368532+0000","last_fullsized":"2024-08-19T00:37:04.368532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384116+0000","last_change":"2024-08-19T00:37:03.382037+0000","last_active":"2024-08-19T00:37:04.384116+0000","last_peered":"2024-08-19T00:37:04.384116+0000","last_clean":"2024-08-19T00:37:04.384116+0000","last_became_active":"2024-08-19T00:37:03.380743+0000","last_became_peered":"2024-08-19T00:37:03.380743+0000","last_unstale":"2024-08-19T00:37:04.384116+0000","last_undegraded":"2024-08-19T00:37:04.384116+0000","last_fullsized":"2024-08-19T00:37:04.384116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464286+0000","last_change":"2024-08-19T00:37:02.355452+0000","last_active":"2024-08-19T00:37:04.464286+0000","last_peered":"2024-08-19T00:37:04.464286+0000","last_clean":"2024-08-19T00:37:04.464286+0000","last_became_active":"2024-08-19T00:37:02.355062+0000","last_became_peered":"2024-08-19T00:37:02.355062+0000","last_unstale":"2024-08-19T00:37:04.464286+0000","last_undegraded":"2024-08-19T00:37:04.464286+0000","last_fullsized":"2024-08-19T00:37:04.464286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365642+0000","last_change":"2024-08-19T00:37:03.372275+0000","last_active":"2024-08-19T00:37:04.365642+0000","last_peered":"2024-08-19T00:37:04.365642+0000","last_clean":"2024-08-19T00:37:04.365642+0000","last_became_active":"2024-08-19T00:37:03.371952+0000","last_became_peered":"2024-08-19T00:37:03.371952+0000","last_unstale":"2024-08-19T00:37:04.365642+0000","last_undegraded":"2024-08-19T00:37:04.365642+0000","last_fullsized":"2024-08-19T00:37:04.365642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:50.890499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463384+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:37:04.463384+0000","last_peered":"2024-08-19T00:37:04.463384+0000","last_clean":"2024-08-19T00:37:04.463384+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:37:04.463384+0000","last_undegraded":"2024-08-19T00:37:04.463384+0000","last_fullsized":"2024-08-19T00:37:04.463384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365641+0000","last_change":"2024-08-19T00:37:02.355271+0000","last_active":"2024-08-19T00:37:04.365641+0000","last_peered":"2024-08-19T00:37:04.365641+0000","last_clean":"2024-08-19T00:37:04.365641+0000","last_became_active":"2024-08-19T00:37:02.354947+0000","last_became_peered":"2024-08-19T00:37:02.354947+0000","last_unstale":"2024-08-19T00:37:04.365641+0000","last_undegraded":"2024-08-19T00:37:04.365641+0000","last_fullsized":"2024-08-19T00:37:04.365641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:08.443729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380800+0000","last_change":"2024-08-19T00:37:03.363302+0000","last_active":"2024-08-19T00:37:04.380800+0000","last_peered":"2024-08-19T00:37:04.380800+0000","last_clean":"2024-08-19T00:37:04.380800+0000","last_became_active":"2024-08-19T00:37:03.362961+0000","last_became_peered":"2024-08-19T00:37:03.362961+0000","last_unstale":"2024-08-19T00:37:04.380800+0000","last_undegraded":"2024-08-19T00:37:04.380800+0000","last_fullsized":"2024-08-19T00:37:04.380800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365095+0000","last_change":"2024-08-19T00:37:02.369181+0000","last_active":"2024-08-19T00:37:04.365095+0000","last_peered":"2024-08-19T00:37:04.365095+0000","last_clean":"2024-08-19T00:37:04.365095+0000","last_became_active":"2024-08-19T00:37:02.368734+0000","last_became_peered":"2024-08-19T00:37:02.368734+0000","last_unstale":"2024-08-19T00:37:04.365095+0000","last_undegraded":"2024-08-19T00:37:04.365095+0000","last_fullsized":"2024-08-19T00:37:04.365095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464050+0000","last_change":"2024-08-19T00:37:03.376231+0000","last_active":"2024-08-19T00:37:04.464050+0000","last_peered":"2024-08-19T00:37:04.464050+0000","last_clean":"2024-08-19T00:37:04.464050+0000","last_became_active":"2024-08-19T00:37:03.375969+0000","last_became_peered":"2024-08-19T00:37:03.375969+0000","last_unstale":"2024-08-19T00:37:04.464050+0000","last_undegraded":"2024-08-19T00:37:04.464050+0000","last_fullsized":"2024-08-19T00:37:04.464050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369377+0000","last_change":"2024-08-19T00:37:02.364004+0000","last_active":"2024-08-19T00:37:04.369377+0000","last_peered":"2024-08-19T00:37:04.369377+0000","last_clean":"2024-08-19T00:37:04.369377+0000","last_became_active":"2024-08-19T00:37:02.363712+0000","last_became_peered":"2024-08-19T00:37:02.363712+0000","last_unstale":"2024-08-19T00:37:04.369377+0000","last_undegraded":"2024-08-19T00:37:04.369377+0000","last_fullsized":"2024-08-19T00:37:04.369377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368210+0000","last_change":"2024-08-19T00:37:03.383128+0000","last_active":"2024-08-19T00:37:04.368210+0000","last_peered":"2024-08-19T00:37:04.368210+0000","last_clean":"2024-08-19T00:37:04.368210+0000","last_became_active":"2024-08-19T00:37:03.380518+0000","last_became_peered":"2024-08-19T00:37:03.380518+0000","last_unstale":"2024-08-19T00:37:04.368210+0000","last_undegraded":"2024-08-19T00:37:04.368210+0000","last_fullsized":"2024-08-19T00:37:04.368210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365629+0000","last_change":"2024-08-19T00:37:02.366117+0000","last_active":"2024-08-19T00:37:04.365629+0000","last_peered":"2024-08-19T00:37:04.365629+0000","last_clean":"2024-08-19T00:37:04.365629+0000","last_became_active":"2024-08-19T00:37:02.365766+0000","last_became_peered":"2024-08-19T00:37:02.365766+0000","last_unstale":"2024-08-19T00:37:04.365629+0000","last_undegraded":"2024-08-19T00:37:04.365629+0000","last_fullsized":"2024-08-19T00:37:04.365629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:49.690337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383742+0000","last_change":"2024-08-19T00:37:03.367877+0000","last_active":"2024-08-19T00:37:04.383742+0000","last_peered":"2024-08-19T00:37:04.383742+0000","last_clean":"2024-08-19T00:37:04.383742+0000","last_became_active":"2024-08-19T00:37:03.367527+0000","last_became_peered":"2024-08-19T00:37:03.367527+0000","last_unstale":"2024-08-19T00:37:04.383742+0000","last_undegraded":"2024-08-19T00:37:04.383742+0000","last_fullsized":"2024-08-19T00:37:04.383742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368455+0000","last_change":"2024-08-19T00:37:02.369028+0000","last_active":"2024-08-19T00:37:04.368455+0000","last_peered":"2024-08-19T00:37:04.368455+0000","last_clean":"2024-08-19T00:37:04.368455+0000","last_became_active":"2024-08-19T00:37:02.368699+0000","last_became_peered":"2024-08-19T00:37:02.368699+0000","last_unstale":"2024-08-19T00:37:04.368455+0000","last_undegraded":"2024-08-19T00:37:04.368455+0000","last_fullsized":"2024-08-19T00:37:04.368455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464137+0000","last_change":"2024-08-19T00:37:03.368305+0000","last_active":"2024-08-19T00:37:04.464137+0000","last_peered":"2024-08-19T00:37:04.464137+0000","last_clean":"2024-08-19T00:37:04.464137+0000","last_became_active":"2024-08-19T00:37:03.366016+0000","last_became_peered":"2024-08-19T00:37:03.366016+0000","last_unstale":"2024-08-19T00:37:04.464137+0000","last_undegraded":"2024-08-19T00:37:04.464137+0000","last_fullsized":"2024-08-19T00:37:04.464137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365779+0000","last_change":"2024-08-19T00:37:02.359697+0000","last_active":"2024-08-19T00:37:04.365779+0000","last_peered":"2024-08-19T00:37:04.365779+0000","last_clean":"2024-08-19T00:37:04.365779+0000","last_became_active":"2024-08-19T00:37:02.358966+0000","last_became_peered":"2024-08-19T00:37:02.358966+0000","last_unstale":"2024-08-19T00:37:04.365779+0000","last_undegraded":"2024-08-19T00:37:04.365779+0000","last_fullsized":"2024-08-19T00:37:04.365779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:58.297710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464195+0000","last_change":"2024-08-19T00:37:03.380507+0000","last_active":"2024-08-19T00:37:04.464195+0000","last_peered":"2024-08-19T00:37:04.464195+0000","last_clean":"2024-08-19T00:37:04.464195+0000","last_became_active":"2024-08-19T00:37:03.378035+0000","last_became_peered":"2024-08-19T00:37:03.378035+0000","last_unstale":"2024-08-19T00:37:04.464195+0000","last_undegraded":"2024-08-19T00:37:04.464195+0000","last_fullsized":"2024-08-19T00:37:04.464195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383088+0000","last_change":"2024-08-19T00:37:02.368422+0000","last_active":"2024-08-19T00:37:04.383088+0000","last_peered":"2024-08-19T00:37:04.383088+0000","last_clean":"2024-08-19T00:37:04.383088+0000","last_became_active":"2024-08-19T00:37:02.368123+0000","last_became_peered":"2024-08-19T00:37:02.368123+0000","last_unstale":"2024-08-19T00:37:04.383088+0000","last_undegraded":"2024-08-19T00:37:04.383088+0000","last_fullsized":"2024-08-19T00:37:04.383088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380949+0000","last_change":"2024-08-19T00:37:03.369753+0000","last_active":"2024-08-19T00:37:04.380949+0000","last_peered":"2024-08-19T00:37:04.380949+0000","last_clean":"2024-08-19T00:37:04.380949+0000","last_became_active":"2024-08-19T00:37:03.369412+0000","last_became_peered":"2024-08-19T00:37:03.369412+0000","last_unstale":"2024-08-19T00:37:04.380949+0000","last_undegraded":"2024-08-19T00:37:04.380949+0000","last_fullsized":"2024-08-19T00:37:04.380949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366071+0000","last_change":"2024-08-19T00:37:02.356963+0000","last_active":"2024-08-19T00:37:04.366071+0000","last_peered":"2024-08-19T00:37:04.366071+0000","last_clean":"2024-08-19T00:37:04.366071+0000","last_became_active":"2024-08-19T00:37:02.356715+0000","last_became_peered":"2024-08-19T00:37:02.356715+0000","last_unstale":"2024-08-19T00:37:04.366071+0000","last_undegraded":"2024-08-19T00:37:04.366071+0000","last_fullsized":"2024-08-19T00:37:04.366071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:01.604784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380767+0000","last_change":"2024-08-19T00:37:03.366561+0000","last_active":"2024-08-19T00:37:04.380767+0000","last_peered":"2024-08-19T00:37:04.380767+0000","last_clean":"2024-08-19T00:37:04.380767+0000","last_became_active":"2024-08-19T00:37:03.365866+0000","last_became_peered":"2024-08-19T00:37:03.365866+0000","last_unstale":"2024-08-19T00:37:04.380767+0000","last_undegraded":"2024-08-19T00:37:04.380767+0000","last_fullsized":"2024-08-19T00:37:04.380767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383431+0000","last_change":"2024-08-19T00:37:02.358382+0000","last_active":"2024-08-19T00:37:04.383431+0000","last_peered":"2024-08-19T00:37:04.383431+0000","last_clean":"2024-08-19T00:37:04.383431+0000","last_became_active":"2024-08-19T00:37:02.358084+0000","last_became_peered":"2024-08-19T00:37:02.358084+0000","last_unstale":"2024-08-19T00:37:04.383431+0000","last_undegraded":"2024-08-19T00:37:04.383431+0000","last_fullsized":"2024-08-19T00:37:04.383431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365165+0000","last_change":"2024-08-19T00:37:03.372382+0000","last_active":"2024-08-19T00:37:04.365165+0000","last_peered":"2024-08-19T00:37:04.365165+0000","last_clean":"2024-08-19T00:37:04.365165+0000","last_became_active":"2024-08-19T00:37:03.372117+0000","last_became_peered":"2024-08-19T00:37:03.372117+0000","last_unstale":"2024-08-19T00:37:04.365165+0000","last_undegraded":"2024-08-19T00:37:04.365165+0000","last_fullsized":"2024-08-19T00:37:04.365165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380693+0000","last_change":"2024-08-19T00:37:02.372086+0000","last_active":"2024-08-19T00:37:04.380693+0000","last_peered":"2024-08-19T00:37:04.380693+0000","last_clean":"2024-08-19T00:37:04.380693+0000","last_became_active":"2024-08-19T00:37:02.371740+0000","last_became_peered":"2024-08-19T00:37:02.371740+0000","last_unstale":"2024-08-19T00:37:04.380693+0000","last_undegraded":"2024-08-19T00:37:04.380693+0000","last_fullsized":"2024-08-19T00:37:04.380693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380570+0000","last_change":"2024-08-19T00:37:03.375284+0000","last_active":"2024-08-19T00:37:04.380570+0000","last_peered":"2024-08-19T00:37:04.380570+0000","last_clean":"2024-08-19T00:37:04.380570+0000","last_became_active":"2024-08-19T00:37:03.375000+0000","last_became_peered":"2024-08-19T00:37:03.375000+0000","last_unstale":"2024-08-19T00:37:04.380570+0000","last_undegraded":"2024-08-19T00:37:04.380570+0000","last_fullsized":"2024-08-19T00:37:04.380570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464135+0000","last_change":"2024-08-19T00:37:02.364047+0000","last_active":"2024-08-19T00:37:04.464135+0000","last_peered":"2024-08-19T00:37:04.464135+0000","last_clean":"2024-08-19T00:37:04.464135+0000","last_became_active":"2024-08-19T00:37:02.363698+0000","last_became_peered":"2024-08-19T00:37:02.363698+0000","last_unstale":"2024-08-19T00:37:04.464135+0000","last_undegraded":"2024-08-19T00:37:04.464135+0000","last_fullsized":"2024-08-19T00:37:04.464135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369502+0000","last_change":"2024-08-19T00:37:03.374146+0000","last_active":"2024-08-19T00:37:04.369502+0000","last_peered":"2024-08-19T00:37:04.369502+0000","last_clean":"2024-08-19T00:37:04.369502+0000","last_became_active":"2024-08-19T00:37:03.373834+0000","last_became_peered":"2024-08-19T00:37:03.373834+0000","last_unstale":"2024-08-19T00:37:04.369502+0000","last_undegraded":"2024-08-19T00:37:04.369502+0000","last_fullsized":"2024-08-19T00:37:04.369502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365432+0000","last_change":"2024-08-19T00:37:02.349640+0000","last_active":"2024-08-19T00:37:04.365432+0000","last_peered":"2024-08-19T00:37:04.365432+0000","last_clean":"2024-08-19T00:37:04.365432+0000","last_became_active":"2024-08-19T00:37:02.349269+0000","last_became_peered":"2024-08-19T00:37:02.349269+0000","last_unstale":"2024-08-19T00:37:04.365432+0000","last_undegraded":"2024-08-19T00:37:04.365432+0000","last_fullsized":"2024-08-19T00:37:04.365432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365608+0000","last_change":"2024-08-19T00:37:03.380432+0000","last_active":"2024-08-19T00:37:04.365608+0000","last_peered":"2024-08-19T00:37:04.365608+0000","last_clean":"2024-08-19T00:37:04.365608+0000","last_became_active":"2024-08-19T00:37:03.379670+0000","last_became_peered":"2024-08-19T00:37:03.379670+0000","last_unstale":"2024-08-19T00:37:04.365608+0000","last_undegraded":"2024-08-19T00:37:04.365608+0000","last_fullsized":"2024-08-19T00:37:04.365608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:11.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365705+0000","last_change":"2024-08-19T00:37:03.381062+0000","last_active":"2024-08-19T00:37:04.365705+0000","last_peered":"2024-08-19T00:37:04.365705+0000","last_clean":"2024-08-19T00:37:04.365705+0000","last_became_active":"2024-08-19T00:37:03.380753+0000","last_became_peered":"2024-08-19T00:37:03.380753+0000","last_unstale":"2024-08-19T00:37:04.365705+0000","last_undegraded":"2024-08-19T00:37:04.365705+0000","last_fullsized":"2024-08-19T00:37:04.365705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:37.265520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384192+0000","last_change":"2024-08-19T00:37:02.367985+0000","last_active":"2024-08-19T00:37:04.384192+0000","last_peered":"2024-08-19T00:37:04.384192+0000","last_clean":"2024-08-19T00:37:04.384192+0000","last_became_active":"2024-08-19T00:37:02.367333+0000","last_became_peered":"2024-08-19T00:37:02.367333+0000","last_unstale":"2024-08-19T00:37:04.384192+0000","last_undegraded":"2024-08-19T00:37:04.384192+0000","last_fullsized":"2024-08-19T00:37:04.384192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463676+0000","last_change":"2024-08-19T00:37:03.387814+0000","last_active":"2024-08-19T00:37:04.463676+0000","last_peered":"2024-08-19T00:37:04.463676+0000","last_clean":"2024-08-19T00:37:04.463676+0000","last_became_active":"2024-08-19T00:37:03.386581+0000","last_became_peered":"2024-08-19T00:37:03.386581+0000","last_unstale":"2024-08-19T00:37:04.463676+0000","last_undegraded":"2024-08-19T00:37:04.463676+0000","last_fullsized":"2024-08-19T00:37:04.463676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384048+0000","last_change":"2024-08-19T00:37:02.370717+0000","last_active":"2024-08-19T00:37:04.384048+0000","last_peered":"2024-08-19T00:37:04.384048+0000","last_clean":"2024-08-19T00:37:04.384048+0000","last_became_active":"2024-08-19T00:37:02.368335+0000","last_became_peered":"2024-08-19T00:37:02.368335+0000","last_unstale":"2024-08-19T00:37:04.384048+0000","last_undegraded":"2024-08-19T00:37:04.384048+0000","last_fullsized":"2024-08-19T00:37:04.384048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368865+0000","last_change":"2024-08-19T00:37:03.383908+0000","last_active":"2024-08-19T00:37:04.368865+0000","last_peered":"2024-08-19T00:37:04.368865+0000","last_clean":"2024-08-19T00:37:04.368865+0000","last_became_active":"2024-08-19T00:37:03.383512+0000","last_became_peered":"2024-08-19T00:37:03.383512+0000","last_unstale":"2024-08-19T00:37:04.368865+0000","last_undegraded":"2024-08-19T00:37:04.368865+0000","last_fullsized":"2024-08-19T00:37:04.368865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368814+0000","last_change":"2024-08-19T00:37:02.366055+0000","last_active":"2024-08-19T00:37:04.368814+0000","last_peered":"2024-08-19T00:37:04.368814+0000","last_clean":"2024-08-19T00:37:04.368814+0000","last_became_active":"2024-08-19T00:37:02.365758+0000","last_became_peered":"2024-08-19T00:37:02.365758+0000","last_unstale":"2024-08-19T00:37:04.368814+0000","last_undegraded":"2024-08-19T00:37:04.368814+0000","last_fullsized":"2024-08-19T00:37:04.368814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368779+0000","last_change":"2024-08-19T00:37:03.371682+0000","last_active":"2024-08-19T00:37:04.368779+0000","last_peered":"2024-08-19T00:37:04.368779+0000","last_clean":"2024-08-19T00:37:04.368779+0000","last_became_active":"2024-08-19T00:37:03.371418+0000","last_became_peered":"2024-08-19T00:37:03.371418+0000","last_unstale":"2024-08-19T00:37:04.368779+0000","last_undegraded":"2024-08-19T00:37:04.368779+0000","last_fullsized":"2024-08-19T00:37:04.368779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380909+0000","last_change":"2024-08-19T00:37:02.361542+0000","last_active":"2024-08-19T00:37:04.380909+0000","last_peered":"2024-08-19T00:37:04.380909+0000","last_clean":"2024-08-19T00:37:04.380909+0000","last_became_active":"2024-08-19T00:37:02.361229+0000","last_became_peered":"2024-08-19T00:37:02.361229+0000","last_unstale":"2024-08-19T00:37:04.380909+0000","last_undegraded":"2024-08-19T00:37:04.380909+0000","last_fullsized":"2024-08-19T00:37:04.380909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":77889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":76187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":666043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:37:12.728 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:37:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.922+0000 7f6815a00640 1 Processor -- start 2024-08-19T00:37:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.922+0000 7f6815a00640 1 -- start start 2024-08-19T00:37:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.923+0000 7f6815a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f681006e520 0x7f68100d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.923+0000 7f6815a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f68100d4e00 0x7f68100d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.923+0000 7f6815a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68100d13d0 0x7f6810161100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.923+0000 7f6815a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f68100cf020 con 0x7f68100d13d0 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.923+0000 7f6815a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f68100cfe60 con 0x7f68100d4e00 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.923+0000 7f6815a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68100cf250 con 0x7f681006e520 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68100d13d0 0x7f6810161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f681006e520 0x7f68100d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68100d13d0 0x7f6810161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35696/0 (socket says 172.21.15.7:35696) 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 -- 172.21.15.7:0/1078049154 learned_addr learned my addr 172.21.15.7:0/1078049154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f6807e00640 1 --2- 172.21.15.7:0/1078049154 >> v2:172.21.15.162:3300/0 conn(0x7f68100d4e00 0x7f68100d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 -- 172.21.15.7:0/1078049154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f681006e520 msgr2=0x7f68100d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 --2- 172.21.15.7:0/1078049154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f681006e520 0x7f68100d2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 -- 172.21.15.7:0/1078049154 >> v2:172.21.15.162:3300/0 conn(0x7f68100d4e00 msgr2=0x7f68100d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 --2- 172.21.15.7:0/1078049154 >> v2:172.21.15.162:3300/0 conn(0x7f68100d4e00 0x7f68100d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680f400640 1 -- 172.21.15.7:0/1078049154 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68100cf530 con 0x7f68100d13d0 2024-08-19T00:37:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.924+0000 7f680ea00640 1 --2- 172.21.15.7:0/1078049154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f681006e520 0x7f68100d2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.926+0000 7f680f400640 1 --2- 172.21.15.7:0/1078049154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d13d0 0x7f6810161100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f681008d2e0 tx=0x7f680802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fcd1365c25bf92 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.926+0000 7f680e000640 1 -- 172.21.15.7:0/1078049154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808036070 con 0x7f68100d13d0 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.926+0000 7f680e000640 1 -- 172.21.15.7:0/1078049154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6808031600 con 0x7f68100d13d0 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.926+0000 7f680e000640 1 -- 172.21.15.7:0/1078049154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68080319d0 con 0x7f68100d13d0 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 -- 172.21.15.7:0/1078049154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d13d0 msgr2=0x7f6810161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 --2- 172.21.15.7:0/1078049154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d13d0 0x7f6810161100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f681008d2e0 tx=0x7f680802a6a0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 -- 172.21.15.7:0/1078049154 shutdown_connections 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 --2- 172.21.15.7:0/1078049154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d13d0 0x7f6810161100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 --2- 172.21.15.7:0/1078049154 >> v2:172.21.15.162:3300/0 conn(0x7f68100d4e00 0x7f68100d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 --2- 172.21.15.7:0/1078049154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f681006e520 0x7f68100d2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 -- 172.21.15.7:0/1078049154 >> 172.21.15.7:0/1078049154 conn(0x7f681009d710 msgr2=0x7f68100d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 -- 172.21.15.7:0/1078049154 shutdown_connections 2024-08-19T00:37:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.927+0000 7f6815a00640 1 -- 172.21.15.7:0/1078049154 wait complete. 2024-08-19T00:37:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.930+0000 7f6815a00640 1 Processor -- start 2024-08-19T00:37:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.930+0000 7f6815a00640 1 -- start start 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.931+0000 7f6815a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f681006e520 0x7f68101f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.931+0000 7f6815a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68100d13d0 0x7f68100cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.931+0000 7f6815a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d4e00 0x7f68101e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.931+0000 7f6815a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68100d3450 con 0x7f68100d4e00 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.931+0000 7f6815a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68100cfaf0 con 0x7f681006e520 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.931+0000 7f6815a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68100d02f0 con 0x7f68100d13d0 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f681006e520 0x7f68101f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d4e00 0x7f68101e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f6807e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68100d13d0 0x7f68100cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f681006e520 0x7f68101f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60300/0 (socket says 172.21.15.7:60300) 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d4e00 0x7f68101e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35704/0 (socket says 172.21.15.7:35704) 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680ea00640 1 -- 172.21.15.7:0/1657381674 learned_addr learned my addr 172.21.15.7:0/1657381674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680f400640 1 -- 172.21.15.7:0/1657381674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68100d13d0 msgr2=0x7f68100cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680f400640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68100d13d0 0x7f68100cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680f400640 1 -- 172.21.15.7:0/1657381674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f681006e520 msgr2=0x7f68101f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680f400640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f681006e520 0x7f68101f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.932+0000 7f680f400640 1 -- 172.21.15.7:0/1657381674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68100ce6d0 con 0x7f68100d4e00 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.933+0000 7f680f400640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d4e00 0x7f68101e5f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6808030000 tx=0x7f6808004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.933+0000 7f6806a00640 1 -- 172.21.15.7:0/1657381674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808041020 con 0x7f68100d4e00 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.933+0000 7f6806a00640 1 -- 172.21.15.7:0/1657381674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68080077a0 con 0x7f68100d4e00 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.933+0000 7f6806a00640 1 -- 172.21.15.7:0/1657381674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808036040 con 0x7f68100d4e00 2024-08-19T00:37:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.933+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68100ce3f0 con 0x7f68100d4e00 2024-08-19T00:37:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.933+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68100c80d0 con 0x7f68100d4e00 2024-08-19T00:37:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.934+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68100d2f10 con 0x7f68100d4e00 2024-08-19T00:37:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.935+0000 7f6806a00640 1 -- 172.21.15.7:0/1657381674 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6808044020 con 0x7f68100d4e00 2024-08-19T00:37:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.936+0000 7f6806a00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67ec06be30 0x7f67ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.936+0000 7f6806a00640 1 -- 172.21.15.7:0/1657381674 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f68080ab8c0 con 0x7f68100d4e00 2024-08-19T00:37:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.936+0000 7f680ea00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67ec06be30 0x7f67ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.937+0000 7f680ea00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67ec06be30 0x7f67ec06e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6800009560 tx=0x7f6800009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:12.943+0000 7f6806a00640 1 -- 172.21.15.7:0/1657381674 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f680804b030 con 0x7f68100d4e00 2024-08-19T00:37:13.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.125+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68100d0c70 con 0x7f67ec06be30 2024-08-19T00:37:13.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.132+0000 7f6806a00640 1 -- 172.21.15.7:0/1657381674 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251832 (secure 0 0 0) 0x7f68100d0c70 con 0x7f67ec06be30 2024-08-19T00:37:13.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:13.137 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:37:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67ec06be30 msgr2=0x7f67ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67ec06be30 0x7f67ec06e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6800009560 tx=0x7f6800009190 comp rx=0 tx=0).stop 2024-08-19T00:37:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d4e00 msgr2=0x7f68101e5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d4e00 0x7f68101e5f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6808030000 tx=0x7f6808004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 shutdown_connections 2024-08-19T00:37:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67ec06be30 0x7f67ec06e2f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68100d4e00 0x7f68101e5f10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68100d13d0 0x7f68100cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 --2- 172.21.15.7:0/1657381674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f681006e520 0x7f68101f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 >> 172.21.15.7:0/1657381674 conn(0x7f681009d710 msgr2=0x7f68100b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 shutdown_connections 2024-08-19T00:37:13.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.136+0000 7f6815a00640 1 -- 172.21.15.7:0/1657381674 wait complete. 2024-08-19T00:37:13.153 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-19T00:37:11.256833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235736,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738984,"statfs":{"total":773094113280,"available":772852719616,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384036+0000","last_change":"2024-08-19T00:37:03.384522+0000","last_active":"2024-08-19T00:37:04.384036+0000","last_peered":"2024-08-19T00:37:04.384036+0000","last_clean":"2024-08-19T00:37:04.384036+0000","last_became_active":"2024-08-19T00:37:03.378809+0000","last_became_peered":"2024-08-19T00:37:03.378809+0000","last_unstale":"2024-08-19T00:37:04.384036+0000","last_undegraded":"2024-08-19T00:37:04.384036+0000","last_fullsized":"2024-08-19T00:37:04.384036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368586+0000","last_change":"2024-08-19T00:37:03.375782+0000","last_active":"2024-08-19T00:37:04.368586+0000","last_peered":"2024-08-19T00:37:04.368586+0000","last_clean":"2024-08-19T00:37:04.368586+0000","last_became_active":"2024-08-19T00:37:03.375533+0000","last_became_peered":"2024-08-19T00:37:03.375533+0000","last_unstale":"2024-08-19T00:37:04.368586+0000","last_undegraded":"2024-08-19T00:37:04.368586+0000","last_fullsized":"2024-08-19T00:37:04.368586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368559+0000","last_change":"2024-08-19T00:37:03.387391+0000","last_active":"2024-08-19T00:37:04.368559+0000","last_peered":"2024-08-19T00:37:04.368559+0000","last_clean":"2024-08-19T00:37:04.368559+0000","last_became_active":"2024-08-19T00:37:03.386550+0000","last_became_peered":"2024-08-19T00:37:03.386550+0000","last_unstale":"2024-08-19T00:37:04.368559+0000","last_undegraded":"2024-08-19T00:37:04.368559+0000","last_fullsized":"2024-08-19T00:37:04.368559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464051+0000","last_change":"2024-08-19T00:37:03.366111+0000","last_active":"2024-08-19T00:37:04.464051+0000","last_peered":"2024-08-19T00:37:04.464051+0000","last_clean":"2024-08-19T00:37:04.464051+0000","last_became_active":"2024-08-19T00:37:03.365397+0000","last_became_peered":"2024-08-19T00:37:03.365397+0000","last_unstale":"2024-08-19T00:37:04.464051+0000","last_undegraded":"2024-08-19T00:37:04.464051+0000","last_fullsized":"2024-08-19T00:37:04.464051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383873+0000","last_change":"2024-08-19T00:37:03.374066+0000","last_active":"2024-08-19T00:37:04.383873+0000","last_peered":"2024-08-19T00:37:04.383873+0000","last_clean":"2024-08-19T00:37:04.383873+0000","last_became_active":"2024-08-19T00:37:03.373773+0000","last_became_peered":"2024-08-19T00:37:03.373773+0000","last_unstale":"2024-08-19T00:37:04.383873+0000","last_undegraded":"2024-08-19T00:37:04.383873+0000","last_fullsized":"2024-08-19T00:37:04.383873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:26:14.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463972+0000","last_change":"2024-08-19T00:37:03.373062+0000","last_active":"2024-08-19T00:37:04.463972+0000","last_peered":"2024-08-19T00:37:04.463972+0000","last_clean":"2024-08-19T00:37:04.463972+0000","last_became_active":"2024-08-19T00:37:03.372380+0000","last_became_peered":"2024-08-19T00:37:03.372380+0000","last_unstale":"2024-08-19T00:37:04.463972+0000","last_undegraded":"2024-08-19T00:37:04.463972+0000","last_fullsized":"2024-08-19T00:37:04.463972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384097+0000","last_change":"2024-08-19T00:37:03.381691+0000","last_active":"2024-08-19T00:37:04.384097+0000","last_peered":"2024-08-19T00:37:04.384097+0000","last_clean":"2024-08-19T00:37:04.384097+0000","last_became_active":"2024-08-19T00:37:03.381312+0000","last_became_peered":"2024-08-19T00:37:03.381312+0000","last_unstale":"2024-08-19T00:37:04.384097+0000","last_undegraded":"2024-08-19T00:37:04.384097+0000","last_fullsized":"2024-08-19T00:37:04.384097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368077+0000","last_change":"2024-08-19T00:37:03.386764+0000","last_active":"2024-08-19T00:37:04.368077+0000","last_peered":"2024-08-19T00:37:04.368077+0000","last_clean":"2024-08-19T00:37:04.368077+0000","last_became_active":"2024-08-19T00:37:03.385701+0000","last_became_peered":"2024-08-19T00:37:03.385701+0000","last_unstale":"2024-08-19T00:37:04.368077+0000","last_undegraded":"2024-08-19T00:37:04.368077+0000","last_fullsized":"2024-08-19T00:37:04.368077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464403+0000","last_change":"2024-08-19T00:37:03.383398+0000","last_active":"2024-08-19T00:37:04.464403+0000","last_peered":"2024-08-19T00:37:04.464403+0000","last_clean":"2024-08-19T00:37:04.464403+0000","last_became_active":"2024-08-19T00:37:03.383039+0000","last_became_peered":"2024-08-19T00:37:03.383039+0000","last_unstale":"2024-08-19T00:37:04.464403+0000","last_undegraded":"2024-08-19T00:37:04.464403+0000","last_fullsized":"2024-08-19T00:37:04.464403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383773+0000","last_change":"2024-08-19T00:37:03.367285+0000","last_active":"2024-08-19T00:37:04.383773+0000","last_peered":"2024-08-19T00:37:04.383773+0000","last_clean":"2024-08-19T00:37:04.383773+0000","last_became_active":"2024-08-19T00:37:03.366995+0000","last_became_peered":"2024-08-19T00:37:03.366995+0000","last_unstale":"2024-08-19T00:37:04.383773+0000","last_undegraded":"2024-08-19T00:37:04.383773+0000","last_fullsized":"2024-08-19T00:37:04.383773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383787+0000","last_change":"2024-08-19T00:37:03.368053+0000","last_active":"2024-08-19T00:37:04.383787+0000","last_peered":"2024-08-19T00:37:04.383787+0000","last_clean":"2024-08-19T00:37:04.383787+0000","last_became_active":"2024-08-19T00:37:03.367766+0000","last_became_peered":"2024-08-19T00:37:03.367766+0000","last_unstale":"2024-08-19T00:37:04.383787+0000","last_undegraded":"2024-08-19T00:37:04.383787+0000","last_fullsized":"2024-08-19T00:37:04.383787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383805+0000","last_change":"2024-08-19T00:37:03.381800+0000","last_active":"2024-08-19T00:37:04.383805+0000","last_peered":"2024-08-19T00:37:04.383805+0000","last_clean":"2024-08-19T00:37:04.383805+0000","last_became_active":"2024-08-19T00:37:03.380371+0000","last_became_peered":"2024-08-19T00:37:03.380371+0000","last_unstale":"2024-08-19T00:37:04.383805+0000","last_undegraded":"2024-08-19T00:37:04.383805+0000","last_fullsized":"2024-08-19T00:37:04.383805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464125+0000","last_change":"2024-08-19T00:37:03.375068+0000","last_active":"2024-08-19T00:37:04.464125+0000","last_peered":"2024-08-19T00:37:04.464125+0000","last_clean":"2024-08-19T00:37:04.464125+0000","last_became_active":"2024-08-19T00:37:03.374786+0000","last_became_peered":"2024-08-19T00:37:03.374786+0000","last_unstale":"2024-08-19T00:37:04.464125+0000","last_undegraded":"2024-08-19T00:37:04.464125+0000","last_fullsized":"2024-08-19T00:37:04.464125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463980+0000","last_change":"2024-08-19T00:37:03.372712+0000","last_active":"2024-08-19T00:37:04.463980+0000","last_peered":"2024-08-19T00:37:04.463980+0000","last_clean":"2024-08-19T00:37:04.463980+0000","last_became_active":"2024-08-19T00:37:03.372479+0000","last_became_peered":"2024-08-19T00:37:03.372479+0000","last_unstale":"2024-08-19T00:37:04.463980+0000","last_undegraded":"2024-08-19T00:37:04.463980+0000","last_fullsized":"2024-08-19T00:37:04.463980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368043+0000","last_change":"2024-08-19T00:37:03.373145+0000","last_active":"2024-08-19T00:37:04.368043+0000","last_peered":"2024-08-19T00:37:04.368043+0000","last_clean":"2024-08-19T00:37:04.368043+0000","last_became_active":"2024-08-19T00:37:03.372872+0000","last_became_peered":"2024-08-19T00:37:03.372872+0000","last_unstale":"2024-08-19T00:37:04.368043+0000","last_undegraded":"2024-08-19T00:37:04.368043+0000","last_fullsized":"2024-08-19T00:37:04.368043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364979+0000","last_change":"2024-08-19T00:37:03.381878+0000","last_active":"2024-08-19T00:37:04.364979+0000","last_peered":"2024-08-19T00:37:04.364979+0000","last_clean":"2024-08-19T00:37:04.364979+0000","last_became_active":"2024-08-19T00:37:03.381642+0000","last_became_peered":"2024-08-19T00:37:03.381642+0000","last_unstale":"2024-08-19T00:37:04.364979+0000","last_undegraded":"2024-08-19T00:37:04.364979+0000","last_fullsized":"2024-08-19T00:37:04.364979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366018+0000","last_change":"2024-08-19T00:37:03.388402+0000","last_active":"2024-08-19T00:37:04.366018+0000","last_peered":"2024-08-19T00:37:04.366018+0000","last_clean":"2024-08-19T00:37:04.366018+0000","last_became_active":"2024-08-19T00:37:03.387161+0000","last_became_peered":"2024-08-19T00:37:03.387161+0000","last_unstale":"2024-08-19T00:37:04.366018+0000","last_undegraded":"2024-08-19T00:37:04.366018+0000","last_fullsized":"2024-08-19T00:37:04.366018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:17.499516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369876+0000","last_change":"2024-08-19T00:37:03.379215+0000","last_active":"2024-08-19T00:37:04.369876+0000","last_peered":"2024-08-19T00:37:04.369876+0000","last_clean":"2024-08-19T00:37:04.369876+0000","last_became_active":"2024-08-19T00:37:03.378899+0000","last_became_peered":"2024-08-19T00:37:03.378899+0000","last_unstale":"2024-08-19T00:37:04.369876+0000","last_undegraded":"2024-08-19T00:37:04.369876+0000","last_fullsized":"2024-08-19T00:37:04.369876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365805+0000","last_change":"2024-08-19T00:37:03.384467+0000","last_active":"2024-08-19T00:37:04.365805+0000","last_peered":"2024-08-19T00:37:04.365805+0000","last_clean":"2024-08-19T00:37:04.365805+0000","last_became_active":"2024-08-19T00:37:03.384206+0000","last_became_peered":"2024-08-19T00:37:03.384206+0000","last_unstale":"2024-08-19T00:37:04.365805+0000","last_undegraded":"2024-08-19T00:37:04.365805+0000","last_fullsized":"2024-08-19T00:37:04.365805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:06.468363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383955+0000","last_change":"2024-08-19T00:37:03.381984+0000","last_active":"2024-08-19T00:37:04.383955+0000","last_peered":"2024-08-19T00:37:04.383955+0000","last_clean":"2024-08-19T00:37:04.383955+0000","last_became_active":"2024-08-19T00:37:03.379208+0000","last_became_peered":"2024-08-19T00:37:03.379208+0000","last_unstale":"2024-08-19T00:37:04.383955+0000","last_undegraded":"2024-08-19T00:37:04.383955+0000","last_fullsized":"2024-08-19T00:37:04.383955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380591+0000","last_change":"2024-08-19T00:37:03.366104+0000","last_active":"2024-08-19T00:37:04.380591+0000","last_peered":"2024-08-19T00:37:04.380591+0000","last_clean":"2024-08-19T00:37:04.380591+0000","last_became_active":"2024-08-19T00:37:03.365823+0000","last_became_peered":"2024-08-19T00:37:03.365823+0000","last_unstale":"2024-08-19T00:37:04.380591+0000","last_undegraded":"2024-08-19T00:37:04.380591+0000","last_fullsized":"2024-08-19T00:37:04.380591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463440+0000","last_change":"2024-08-19T00:37:03.370063+0000","last_active":"2024-08-19T00:37:04.463440+0000","last_peered":"2024-08-19T00:37:04.463440+0000","last_clean":"2024-08-19T00:37:04.463440+0000","last_became_active":"2024-08-19T00:37:03.369707+0000","last_became_peered":"2024-08-19T00:37:03.369707+0000","last_unstale":"2024-08-19T00:37:04.463440+0000","last_undegraded":"2024-08-19T00:37:04.463440+0000","last_fullsized":"2024-08-19T00:37:04.463440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368265+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368265+0000","last_peered":"2024-08-19T00:37:04.368265+0000","last_clean":"2024-08-19T00:37:04.368265+0000","last_became_active":"2024-08-19T00:37:03.372854+0000","last_became_peered":"2024-08-19T00:37:03.372854+0000","last_unstale":"2024-08-19T00:37:04.368265+0000","last_undegraded":"2024-08-19T00:37:04.368265+0000","last_fullsized":"2024-08-19T00:37:04.368265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:28.617735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.364944+0000","last_change":"2024-08-19T00:37:03.386557+0000","last_active":"2024-08-19T00:37:04.364944+0000","last_peered":"2024-08-19T00:37:04.364944+0000","last_clean":"2024-08-19T00:37:04.364944+0000","last_became_active":"2024-08-19T00:37:03.386294+0000","last_became_peered":"2024-08-19T00:37:03.386294+0000","last_unstale":"2024-08-19T00:37:04.364944+0000","last_undegraded":"2024-08-19T00:37:04.364944+0000","last_fullsized":"2024-08-19T00:37:04.364944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368793+0000","last_change":"2024-08-19T00:37:03.379194+0000","last_active":"2024-08-19T00:37:04.368793+0000","last_peered":"2024-08-19T00:37:04.368793+0000","last_clean":"2024-08-19T00:37:04.368793+0000","last_became_active":"2024-08-19T00:37:03.378509+0000","last_became_peered":"2024-08-19T00:37:03.378509+0000","last_unstale":"2024-08-19T00:37:04.368793+0000","last_undegraded":"2024-08-19T00:37:04.368793+0000","last_fullsized":"2024-08-19T00:37:04.368793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:51.657292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464421+0000","last_change":"2024-08-19T00:37:03.373705+0000","last_active":"2024-08-19T00:37:04.464421+0000","last_peered":"2024-08-19T00:37:04.464421+0000","last_clean":"2024-08-19T00:37:04.464421+0000","last_became_active":"2024-08-19T00:37:03.366841+0000","last_became_peered":"2024-08-19T00:37:03.366841+0000","last_unstale":"2024-08-19T00:37:04.464421+0000","last_undegraded":"2024-08-19T00:37:04.464421+0000","last_fullsized":"2024-08-19T00:37:04.464421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.304111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464316+0000","last_change":"2024-08-19T00:37:03.370473+0000","last_active":"2024-08-19T00:37:04.464316+0000","last_peered":"2024-08-19T00:37:04.464316+0000","last_clean":"2024-08-19T00:37:04.464316+0000","last_became_active":"2024-08-19T00:37:03.370106+0000","last_became_peered":"2024-08-19T00:37:03.370106+0000","last_unstale":"2024-08-19T00:37:04.464316+0000","last_undegraded":"2024-08-19T00:37:04.464316+0000","last_fullsized":"2024-08-19T00:37:04.464316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:05.753404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464155+0000","last_change":"2024-08-19T00:37:03.383036+0000","last_active":"2024-08-19T00:37:04.464155+0000","last_peered":"2024-08-19T00:37:04.464155+0000","last_clean":"2024-08-19T00:37:04.464155+0000","last_became_active":"2024-08-19T00:37:03.382643+0000","last_became_peered":"2024-08-19T00:37:03.382643+0000","last_unstale":"2024-08-19T00:37:04.464155+0000","last_undegraded":"2024-08-19T00:37:04.464155+0000","last_fullsized":"2024-08-19T00:37:04.464155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:33.644440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368293+0000","last_change":"2024-08-19T00:37:03.382477+0000","last_active":"2024-08-19T00:37:04.368293+0000","last_peered":"2024-08-19T00:37:04.368293+0000","last_clean":"2024-08-19T00:37:04.368293+0000","last_became_active":"2024-08-19T00:37:03.380124+0000","last_became_peered":"2024-08-19T00:37:03.380124+0000","last_unstale":"2024-08-19T00:37:04.368293+0000","last_undegraded":"2024-08-19T00:37:04.368293+0000","last_fullsized":"2024-08-19T00:37:04.368293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:00.906973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365281+0000","last_change":"2024-08-19T00:37:03.379567+0000","last_active":"2024-08-19T00:37:04.365281+0000","last_peered":"2024-08-19T00:37:04.365281+0000","last_clean":"2024-08-19T00:37:04.365281+0000","last_became_active":"2024-08-19T00:37:03.372732+0000","last_became_peered":"2024-08-19T00:37:03.372732+0000","last_unstale":"2024-08-19T00:37:04.365281+0000","last_undegraded":"2024-08-19T00:37:04.365281+0000","last_fullsized":"2024-08-19T00:37:04.365281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369286+0000","last_change":"2024-08-19T00:37:03.372911+0000","last_active":"2024-08-19T00:37:04.369286+0000","last_peered":"2024-08-19T00:37:04.369286+0000","last_clean":"2024-08-19T00:37:04.369286+0000","last_became_active":"2024-08-19T00:37:03.372598+0000","last_became_peered":"2024-08-19T00:37:03.372598+0000","last_unstale":"2024-08-19T00:37:04.369286+0000","last_undegraded":"2024-08-19T00:37:04.369286+0000","last_fullsized":"2024-08-19T00:37:04.369286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463669+0000","last_change":"2024-08-19T00:37:03.363843+0000","last_active":"2024-08-19T00:37:04.463669+0000","last_peered":"2024-08-19T00:37:04.463669+0000","last_clean":"2024-08-19T00:37:04.463669+0000","last_became_active":"2024-08-19T00:37:03.362519+0000","last_became_peered":"2024-08-19T00:37:03.362519+0000","last_unstale":"2024-08-19T00:37:04.463669+0000","last_undegraded":"2024-08-19T00:37:04.463669+0000","last_fullsized":"2024-08-19T00:37:04.463669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463528+0000","last_change":"2024-08-19T00:37:03.373644+0000","last_active":"2024-08-19T00:37:04.463528+0000","last_peered":"2024-08-19T00:37:04.463528+0000","last_clean":"2024-08-19T00:37:04.463528+0000","last_became_active":"2024-08-19T00:37:03.373298+0000","last_became_peered":"2024-08-19T00:37:03.373298+0000","last_unstale":"2024-08-19T00:37:04.463528+0000","last_undegraded":"2024-08-19T00:37:04.463528+0000","last_fullsized":"2024-08-19T00:37:04.463528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:30.515188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368301+0000","last_change":"2024-08-19T00:37:02.366620+0000","last_active":"2024-08-19T00:37:04.368301+0000","last_peered":"2024-08-19T00:37:04.368301+0000","last_clean":"2024-08-19T00:37:04.368301+0000","last_became_active":"2024-08-19T00:37:02.366071+0000","last_became_peered":"2024-08-19T00:37:02.366071+0000","last_unstale":"2024-08-19T00:37:04.368301+0000","last_undegraded":"2024-08-19T00:37:04.368301+0000","last_fullsized":"2024-08-19T00:37:04.368301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380696+0000","last_change":"2024-08-19T00:37:03.369278+0000","last_active":"2024-08-19T00:37:04.380696+0000","last_peered":"2024-08-19T00:37:04.380696+0000","last_clean":"2024-08-19T00:37:04.380696+0000","last_became_active":"2024-08-19T00:37:03.365557+0000","last_became_peered":"2024-08-19T00:37:03.365557+0000","last_unstale":"2024-08-19T00:37:04.380696+0000","last_undegraded":"2024-08-19T00:37:04.380696+0000","last_fullsized":"2024-08-19T00:37:04.380696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:53.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365384+0000","last_change":"2024-08-19T00:37:02.362332+0000","last_active":"2024-08-19T00:37:04.365384+0000","last_peered":"2024-08-19T00:37:04.365384+0000","last_clean":"2024-08-19T00:37:04.365384+0000","last_became_active":"2024-08-19T00:37:02.362055+0000","last_became_peered":"2024-08-19T00:37:02.362055+0000","last_unstale":"2024-08-19T00:37:04.365384+0000","last_undegraded":"2024-08-19T00:37:04.365384+0000","last_fullsized":"2024-08-19T00:37:04.365384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463849+0000","last_change":"2024-08-19T00:37:02.370542+0000","last_active":"2024-08-19T00:37:04.463849+0000","last_peered":"2024-08-19T00:37:04.463849+0000","last_clean":"2024-08-19T00:37:04.463849+0000","last_became_active":"2024-08-19T00:37:02.369837+0000","last_became_peered":"2024-08-19T00:37:02.369837+0000","last_unstale":"2024-08-19T00:37:04.463849+0000","last_undegraded":"2024-08-19T00:37:04.463849+0000","last_fullsized":"2024-08-19T00:37:04.463849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:45.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368309+0000","last_change":"2024-08-19T00:37:03.376837+0000","last_active":"2024-08-19T00:37:04.368309+0000","last_peered":"2024-08-19T00:37:04.368309+0000","last_clean":"2024-08-19T00:37:04.368309+0000","last_became_active":"2024-08-19T00:37:03.376353+0000","last_became_peered":"2024-08-19T00:37:03.376353+0000","last_unstale":"2024-08-19T00:37:04.368309+0000","last_undegraded":"2024-08-19T00:37:04.368309+0000","last_fullsized":"2024-08-19T00:37:04.368309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:00.989782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365038+0000","last_change":"2024-08-19T00:37:02.358463+0000","last_active":"2024-08-19T00:37:04.365038+0000","last_peered":"2024-08-19T00:37:04.365038+0000","last_clean":"2024-08-19T00:37:04.365038+0000","last_became_active":"2024-08-19T00:37:02.357105+0000","last_became_peered":"2024-08-19T00:37:02.357105+0000","last_unstale":"2024-08-19T00:37:04.365038+0000","last_undegraded":"2024-08-19T00:37:04.365038+0000","last_fullsized":"2024-08-19T00:37:04.365038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380664+0000","last_change":"2024-08-19T00:37:03.372060+0000","last_active":"2024-08-19T00:37:04.380664+0000","last_peered":"2024-08-19T00:37:04.380664+0000","last_clean":"2024-08-19T00:37:04.380664+0000","last_became_active":"2024-08-19T00:37:03.371830+0000","last_became_peered":"2024-08-19T00:37:03.371830+0000","last_unstale":"2024-08-19T00:37:04.380664+0000","last_undegraded":"2024-08-19T00:37:04.380664+0000","last_fullsized":"2024-08-19T00:37:04.380664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:17.064649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464497+0000","last_change":"2024-08-19T00:37:02.359600+0000","last_active":"2024-08-19T00:37:04.464497+0000","last_peered":"2024-08-19T00:37:04.464497+0000","last_clean":"2024-08-19T00:37:04.464497+0000","last_became_active":"2024-08-19T00:37:02.357350+0000","last_became_peered":"2024-08-19T00:37:02.357350+0000","last_unstale":"2024-08-19T00:37:04.464497+0000","last_undegraded":"2024-08-19T00:37:04.464497+0000","last_fullsized":"2024-08-19T00:37:04.464497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464491+0000","last_change":"2024-08-19T00:37:03.368421+0000","last_active":"2024-08-19T00:37:04.464491+0000","last_peered":"2024-08-19T00:37:04.464491+0000","last_clean":"2024-08-19T00:37:04.464491+0000","last_became_active":"2024-08-19T00:37:03.367857+0000","last_became_peered":"2024-08-19T00:37:03.367857+0000","last_unstale":"2024-08-19T00:37:04.464491+0000","last_undegraded":"2024-08-19T00:37:04.464491+0000","last_fullsized":"2024-08-19T00:37:04.464491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383943+0000","last_change":"2024-08-19T00:37:02.371034+0000","last_active":"2024-08-19T00:37:04.383943+0000","last_peered":"2024-08-19T00:37:04.383943+0000","last_clean":"2024-08-19T00:37:04.383943+0000","last_became_active":"2024-08-19T00:37:02.370558+0000","last_became_peered":"2024-08-19T00:37:02.370558+0000","last_unstale":"2024-08-19T00:37:04.383943+0000","last_undegraded":"2024-08-19T00:37:04.383943+0000","last_fullsized":"2024-08-19T00:37:04.383943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368959+0000","last_change":"2024-08-19T00:37:03.379464+0000","last_active":"2024-08-19T00:37:04.368959+0000","last_peered":"2024-08-19T00:37:04.368959+0000","last_clean":"2024-08-19T00:37:04.368959+0000","last_became_active":"2024-08-19T00:37:03.378926+0000","last_became_peered":"2024-08-19T00:37:03.378926+0000","last_unstale":"2024-08-19T00:37:04.368959+0000","last_undegraded":"2024-08-19T00:37:04.368959+0000","last_fullsized":"2024-08-19T00:37:04.368959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369623+0000","last_change":"2024-08-19T00:37:02.356530+0000","last_active":"2024-08-19T00:37:04.369623+0000","last_peered":"2024-08-19T00:37:04.369623+0000","last_clean":"2024-08-19T00:37:04.369623+0000","last_became_active":"2024-08-19T00:37:02.356057+0000","last_became_peered":"2024-08-19T00:37:02.356057+0000","last_unstale":"2024-08-19T00:37:04.369623+0000","last_undegraded":"2024-08-19T00:37:04.369623+0000","last_fullsized":"2024-08-19T00:37:04.369623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365621+0000","last_change":"2024-08-19T00:37:03.382907+0000","last_active":"2024-08-19T00:37:04.365621+0000","last_peered":"2024-08-19T00:37:04.365621+0000","last_clean":"2024-08-19T00:37:04.365621+0000","last_became_active":"2024-08-19T00:37:03.382495+0000","last_became_peered":"2024-08-19T00:37:03.382495+0000","last_unstale":"2024-08-19T00:37:04.365621+0000","last_undegraded":"2024-08-19T00:37:04.365621+0000","last_fullsized":"2024-08-19T00:37:04.365621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:11.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464058+0000","last_change":"2024-08-19T00:37:02.357795+0000","last_active":"2024-08-19T00:37:04.464058+0000","last_peered":"2024-08-19T00:37:04.464058+0000","last_clean":"2024-08-19T00:37:04.464058+0000","last_became_active":"2024-08-19T00:37:02.356980+0000","last_became_peered":"2024-08-19T00:37:02.356980+0000","last_unstale":"2024-08-19T00:37:04.464058+0000","last_undegraded":"2024-08-19T00:37:04.464058+0000","last_fullsized":"2024-08-19T00:37:04.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:04.046069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383932+0000","last_change":"2024-08-19T00:37:03.375481+0000","last_active":"2024-08-19T00:37:04.383932+0000","last_peered":"2024-08-19T00:37:04.383932+0000","last_clean":"2024-08-19T00:37:04.383932+0000","last_became_active":"2024-08-19T00:37:03.375032+0000","last_became_peered":"2024-08-19T00:37:03.375032+0000","last_unstale":"2024-08-19T00:37:04.383932+0000","last_undegraded":"2024-08-19T00:37:04.383932+0000","last_fullsized":"2024-08-19T00:37:04.383932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.437314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369528+0000","last_change":"2024-08-19T00:37:02.353428+0000","last_active":"2024-08-19T00:37:04.369528+0000","last_peered":"2024-08-19T00:37:04.369528+0000","last_clean":"2024-08-19T00:37:04.369528+0000","last_became_active":"2024-08-19T00:37:02.353106+0000","last_became_peered":"2024-08-19T00:37:02.353106+0000","last_unstale":"2024-08-19T00:37:04.369528+0000","last_undegraded":"2024-08-19T00:37:04.369528+0000","last_fullsized":"2024-08-19T00:37:04.369528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463960+0000","last_change":"2024-08-19T00:37:03.381565+0000","last_active":"2024-08-19T00:37:04.463960+0000","last_peered":"2024-08-19T00:37:04.463960+0000","last_clean":"2024-08-19T00:37:04.463960+0000","last_became_active":"2024-08-19T00:37:03.381351+0000","last_became_peered":"2024-08-19T00:37:03.381351+0000","last_unstale":"2024-08-19T00:37:04.463960+0000","last_undegraded":"2024-08-19T00:37:04.463960+0000","last_fullsized":"2024-08-19T00:37:04.463960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365506+0000","last_change":"2024-08-19T00:37:02.361424+0000","last_active":"2024-08-19T00:37:04.365506+0000","last_peered":"2024-08-19T00:37:04.365506+0000","last_clean":"2024-08-19T00:37:04.365506+0000","last_became_active":"2024-08-19T00:37:02.353015+0000","last_became_peered":"2024-08-19T00:37:02.353015+0000","last_unstale":"2024-08-19T00:37:04.365506+0000","last_undegraded":"2024-08-19T00:37:04.365506+0000","last_fullsized":"2024-08-19T00:37:04.365506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:24:29.508786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365319+0000","last_change":"2024-08-19T00:37:03.377594+0000","last_active":"2024-08-19T00:37:04.365319+0000","last_peered":"2024-08-19T00:37:04.365319+0000","last_clean":"2024-08-19T00:37:04.365319+0000","last_became_active":"2024-08-19T00:37:03.377315+0000","last_became_peered":"2024-08-19T00:37:03.377315+0000","last_unstale":"2024-08-19T00:37:04.365319+0000","last_undegraded":"2024-08-19T00:37:04.365319+0000","last_fullsized":"2024-08-19T00:37:04.365319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:09:14.167938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383994+0000","last_change":"2024-08-19T00:37:02.369821+0000","last_active":"2024-08-19T00:37:04.383994+0000","last_peered":"2024-08-19T00:37:04.383994+0000","last_clean":"2024-08-19T00:37:04.383994+0000","last_became_active":"2024-08-19T00:37:02.369542+0000","last_became_peered":"2024-08-19T00:37:02.369542+0000","last_unstale":"2024-08-19T00:37:04.383994+0000","last_undegraded":"2024-08-19T00:37:04.383994+0000","last_fullsized":"2024-08-19T00:37:04.383994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463395+0000","last_change":"2024-08-19T00:37:03.386039+0000","last_active":"2024-08-19T00:37:04.463395+0000","last_peered":"2024-08-19T00:37:04.463395+0000","last_clean":"2024-08-19T00:37:04.463395+0000","last_became_active":"2024-08-19T00:37:03.385346+0000","last_became_peered":"2024-08-19T00:37:03.385346+0000","last_unstale":"2024-08-19T00:37:04.463395+0000","last_undegraded":"2024-08-19T00:37:04.463395+0000","last_fullsized":"2024-08-19T00:37:04.463395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:28.941526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380539+0000","last_change":"2024-08-19T00:37:02.355538+0000","last_active":"2024-08-19T00:37:04.380539+0000","last_peered":"2024-08-19T00:37:04.380539+0000","last_clean":"2024-08-19T00:37:04.380539+0000","last_became_active":"2024-08-19T00:37:02.355257+0000","last_became_peered":"2024-08-19T00:37:02.355257+0000","last_unstale":"2024-08-19T00:37:04.380539+0000","last_undegraded":"2024-08-19T00:37:04.380539+0000","last_fullsized":"2024-08-19T00:37:04.380539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365142+0000","last_change":"2024-08-19T00:37:03.382874+0000","last_active":"2024-08-19T00:37:04.365142+0000","last_peered":"2024-08-19T00:37:04.365142+0000","last_clean":"2024-08-19T00:37:04.365142+0000","last_became_active":"2024-08-19T00:37:03.382547+0000","last_became_peered":"2024-08-19T00:37:03.382547+0000","last_unstale":"2024-08-19T00:37:04.365142+0000","last_undegraded":"2024-08-19T00:37:04.365142+0000","last_fullsized":"2024-08-19T00:37:04.365142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384268+0000","last_change":"2024-08-19T00:37:02.369846+0000","last_active":"2024-08-19T00:37:04.384268+0000","last_peered":"2024-08-19T00:37:04.384268+0000","last_clean":"2024-08-19T00:37:04.384268+0000","last_became_active":"2024-08-19T00:37:02.369565+0000","last_became_peered":"2024-08-19T00:37:02.369565+0000","last_unstale":"2024-08-19T00:37:04.384268+0000","last_undegraded":"2024-08-19T00:37:04.384268+0000","last_fullsized":"2024-08-19T00:37:04.384268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:26.280302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464558+0000","last_change":"2024-08-19T00:37:03.360371+0000","last_active":"2024-08-19T00:37:04.464558+0000","last_peered":"2024-08-19T00:37:04.464558+0000","last_clean":"2024-08-19T00:37:04.464558+0000","last_became_active":"2024-08-19T00:37:03.360065+0000","last_became_peered":"2024-08-19T00:37:03.360065+0000","last_unstale":"2024-08-19T00:37:04.464558+0000","last_undegraded":"2024-08-19T00:37:04.464558+0000","last_fullsized":"2024-08-19T00:37:04.464558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:09.450131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380861+0000","last_change":"2024-08-19T00:37:02.364244+0000","last_active":"2024-08-19T00:37:04.380861+0000","last_peered":"2024-08-19T00:37:04.380861+0000","last_clean":"2024-08-19T00:37:04.380861+0000","last_became_active":"2024-08-19T00:37:02.363965+0000","last_became_peered":"2024-08-19T00:37:02.363965+0000","last_unstale":"2024-08-19T00:37:04.380861+0000","last_undegraded":"2024-08-19T00:37:04.380861+0000","last_fullsized":"2024-08-19T00:37:04.380861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384061+0000","last_change":"2024-08-19T00:37:03.382232+0000","last_active":"2024-08-19T00:37:04.384061+0000","last_peered":"2024-08-19T00:37:04.384061+0000","last_clean":"2024-08-19T00:37:04.384061+0000","last_became_active":"2024-08-19T00:37:03.378909+0000","last_became_peered":"2024-08-19T00:37:03.378909+0000","last_unstale":"2024-08-19T00:37:04.384061+0000","last_undegraded":"2024-08-19T00:37:04.384061+0000","last_fullsized":"2024-08-19T00:37:04.384061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368532+0000","last_change":"2024-08-19T00:37:02.366925+0000","last_active":"2024-08-19T00:37:04.368532+0000","last_peered":"2024-08-19T00:37:04.368532+0000","last_clean":"2024-08-19T00:37:04.368532+0000","last_became_active":"2024-08-19T00:37:02.366544+0000","last_became_peered":"2024-08-19T00:37:02.366544+0000","last_unstale":"2024-08-19T00:37:04.368532+0000","last_undegraded":"2024-08-19T00:37:04.368532+0000","last_fullsized":"2024-08-19T00:37:04.368532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384116+0000","last_change":"2024-08-19T00:37:03.382037+0000","last_active":"2024-08-19T00:37:04.384116+0000","last_peered":"2024-08-19T00:37:04.384116+0000","last_clean":"2024-08-19T00:37:04.384116+0000","last_became_active":"2024-08-19T00:37:03.380743+0000","last_became_peered":"2024-08-19T00:37:03.380743+0000","last_unstale":"2024-08-19T00:37:04.384116+0000","last_undegraded":"2024-08-19T00:37:04.384116+0000","last_fullsized":"2024-08-19T00:37:04.384116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:23:35.452724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464286+0000","last_change":"2024-08-19T00:37:02.355452+0000","last_active":"2024-08-19T00:37:04.464286+0000","last_peered":"2024-08-19T00:37:04.464286+0000","last_clean":"2024-08-19T00:37:04.464286+0000","last_became_active":"2024-08-19T00:37:02.355062+0000","last_became_peered":"2024-08-19T00:37:02.355062+0000","last_unstale":"2024-08-19T00:37:04.464286+0000","last_undegraded":"2024-08-19T00:37:04.464286+0000","last_fullsized":"2024-08-19T00:37:04.464286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:20.715247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365642+0000","last_change":"2024-08-19T00:37:03.372275+0000","last_active":"2024-08-19T00:37:04.365642+0000","last_peered":"2024-08-19T00:37:04.365642+0000","last_clean":"2024-08-19T00:37:04.365642+0000","last_became_active":"2024-08-19T00:37:03.371952+0000","last_became_peered":"2024-08-19T00:37:03.371952+0000","last_unstale":"2024-08-19T00:37:04.365642+0000","last_undegraded":"2024-08-19T00:37:04.365642+0000","last_fullsized":"2024-08-19T00:37:04.365642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:50.890499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463384+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:37:04.463384+0000","last_peered":"2024-08-19T00:37:04.463384+0000","last_clean":"2024-08-19T00:37:04.463384+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:37:04.463384+0000","last_undegraded":"2024-08-19T00:37:04.463384+0000","last_fullsized":"2024-08-19T00:37:04.463384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365641+0000","last_change":"2024-08-19T00:37:02.355271+0000","last_active":"2024-08-19T00:37:04.365641+0000","last_peered":"2024-08-19T00:37:04.365641+0000","last_clean":"2024-08-19T00:37:04.365641+0000","last_became_active":"2024-08-19T00:37:02.354947+0000","last_became_peered":"2024-08-19T00:37:02.354947+0000","last_unstale":"2024-08-19T00:37:04.365641+0000","last_undegraded":"2024-08-19T00:37:04.365641+0000","last_fullsized":"2024-08-19T00:37:04.365641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:15:08.443729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380800+0000","last_change":"2024-08-19T00:37:03.363302+0000","last_active":"2024-08-19T00:37:04.380800+0000","last_peered":"2024-08-19T00:37:04.380800+0000","last_clean":"2024-08-19T00:37:04.380800+0000","last_became_active":"2024-08-19T00:37:03.362961+0000","last_became_peered":"2024-08-19T00:37:03.362961+0000","last_unstale":"2024-08-19T00:37:04.380800+0000","last_undegraded":"2024-08-19T00:37:04.380800+0000","last_fullsized":"2024-08-19T00:37:04.380800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:45.115155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365095+0000","last_change":"2024-08-19T00:37:02.369181+0000","last_active":"2024-08-19T00:37:04.365095+0000","last_peered":"2024-08-19T00:37:04.365095+0000","last_clean":"2024-08-19T00:37:04.365095+0000","last_became_active":"2024-08-19T00:37:02.368734+0000","last_became_peered":"2024-08-19T00:37:02.368734+0000","last_unstale":"2024-08-19T00:37:04.365095+0000","last_undegraded":"2024-08-19T00:37:04.365095+0000","last_fullsized":"2024-08-19T00:37:04.365095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:55:27.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464050+0000","last_change":"2024-08-19T00:37:03.376231+0000","last_active":"2024-08-19T00:37:04.464050+0000","last_peered":"2024-08-19T00:37:04.464050+0000","last_clean":"2024-08-19T00:37:04.464050+0000","last_became_active":"2024-08-19T00:37:03.375969+0000","last_became_peered":"2024-08-19T00:37:03.375969+0000","last_unstale":"2024-08-19T00:37:04.464050+0000","last_undegraded":"2024-08-19T00:37:04.464050+0000","last_fullsized":"2024-08-19T00:37:04.464050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:10.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369377+0000","last_change":"2024-08-19T00:37:02.364004+0000","last_active":"2024-08-19T00:37:04.369377+0000","last_peered":"2024-08-19T00:37:04.369377+0000","last_clean":"2024-08-19T00:37:04.369377+0000","last_became_active":"2024-08-19T00:37:02.363712+0000","last_became_peered":"2024-08-19T00:37:02.363712+0000","last_unstale":"2024-08-19T00:37:04.369377+0000","last_undegraded":"2024-08-19T00:37:04.369377+0000","last_fullsized":"2024-08-19T00:37:04.369377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368210+0000","last_change":"2024-08-19T00:37:03.383128+0000","last_active":"2024-08-19T00:37:04.368210+0000","last_peered":"2024-08-19T00:37:04.368210+0000","last_clean":"2024-08-19T00:37:04.368210+0000","last_became_active":"2024-08-19T00:37:03.380518+0000","last_became_peered":"2024-08-19T00:37:03.380518+0000","last_unstale":"2024-08-19T00:37:04.368210+0000","last_undegraded":"2024-08-19T00:37:04.368210+0000","last_fullsized":"2024-08-19T00:37:04.368210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365629+0000","last_change":"2024-08-19T00:37:02.366117+0000","last_active":"2024-08-19T00:37:04.365629+0000","last_peered":"2024-08-19T00:37:04.365629+0000","last_clean":"2024-08-19T00:37:04.365629+0000","last_became_active":"2024-08-19T00:37:02.365766+0000","last_became_peered":"2024-08-19T00:37:02.365766+0000","last_unstale":"2024-08-19T00:37:04.365629+0000","last_undegraded":"2024-08-19T00:37:04.365629+0000","last_fullsized":"2024-08-19T00:37:04.365629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:49.690337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383742+0000","last_change":"2024-08-19T00:37:03.367877+0000","last_active":"2024-08-19T00:37:04.383742+0000","last_peered":"2024-08-19T00:37:04.383742+0000","last_clean":"2024-08-19T00:37:04.383742+0000","last_became_active":"2024-08-19T00:37:03.367527+0000","last_became_peered":"2024-08-19T00:37:03.367527+0000","last_unstale":"2024-08-19T00:37:04.383742+0000","last_undegraded":"2024-08-19T00:37:04.383742+0000","last_fullsized":"2024-08-19T00:37:04.383742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368455+0000","last_change":"2024-08-19T00:37:02.369028+0000","last_active":"2024-08-19T00:37:04.368455+0000","last_peered":"2024-08-19T00:37:04.368455+0000","last_clean":"2024-08-19T00:37:04.368455+0000","last_became_active":"2024-08-19T00:37:02.368699+0000","last_became_peered":"2024-08-19T00:37:02.368699+0000","last_unstale":"2024-08-19T00:37:04.368455+0000","last_undegraded":"2024-08-19T00:37:04.368455+0000","last_fullsized":"2024-08-19T00:37:04.368455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:27.333814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464137+0000","last_change":"2024-08-19T00:37:03.368305+0000","last_active":"2024-08-19T00:37:04.464137+0000","last_peered":"2024-08-19T00:37:04.464137+0000","last_clean":"2024-08-19T00:37:04.464137+0000","last_became_active":"2024-08-19T00:37:03.366016+0000","last_became_peered":"2024-08-19T00:37:03.366016+0000","last_unstale":"2024-08-19T00:37:04.464137+0000","last_undegraded":"2024-08-19T00:37:04.464137+0000","last_fullsized":"2024-08-19T00:37:04.464137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365779+0000","last_change":"2024-08-19T00:37:02.359697+0000","last_active":"2024-08-19T00:37:04.365779+0000","last_peered":"2024-08-19T00:37:04.365779+0000","last_clean":"2024-08-19T00:37:04.365779+0000","last_became_active":"2024-08-19T00:37:02.358966+0000","last_became_peered":"2024-08-19T00:37:02.358966+0000","last_unstale":"2024-08-19T00:37:04.365779+0000","last_undegraded":"2024-08-19T00:37:04.365779+0000","last_fullsized":"2024-08-19T00:37:04.365779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:58.297710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464195+0000","last_change":"2024-08-19T00:37:03.380507+0000","last_active":"2024-08-19T00:37:04.464195+0000","last_peered":"2024-08-19T00:37:04.464195+0000","last_clean":"2024-08-19T00:37:04.464195+0000","last_became_active":"2024-08-19T00:37:03.378035+0000","last_became_peered":"2024-08-19T00:37:03.378035+0000","last_unstale":"2024-08-19T00:37:04.464195+0000","last_undegraded":"2024-08-19T00:37:04.464195+0000","last_fullsized":"2024-08-19T00:37:04.464195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383088+0000","last_change":"2024-08-19T00:37:02.368422+0000","last_active":"2024-08-19T00:37:04.383088+0000","last_peered":"2024-08-19T00:37:04.383088+0000","last_clean":"2024-08-19T00:37:04.383088+0000","last_became_active":"2024-08-19T00:37:02.368123+0000","last_became_peered":"2024-08-19T00:37:02.368123+0000","last_unstale":"2024-08-19T00:37:04.383088+0000","last_undegraded":"2024-08-19T00:37:04.383088+0000","last_fullsized":"2024-08-19T00:37:04.383088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:26.606014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380949+0000","last_change":"2024-08-19T00:37:03.369753+0000","last_active":"2024-08-19T00:37:04.380949+0000","last_peered":"2024-08-19T00:37:04.380949+0000","last_clean":"2024-08-19T00:37:04.380949+0000","last_became_active":"2024-08-19T00:37:03.369412+0000","last_became_peered":"2024-08-19T00:37:03.369412+0000","last_unstale":"2024-08-19T00:37:04.380949+0000","last_undegraded":"2024-08-19T00:37:04.380949+0000","last_fullsized":"2024-08-19T00:37:04.380949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:41:40.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.366071+0000","last_change":"2024-08-19T00:37:02.356963+0000","last_active":"2024-08-19T00:37:04.366071+0000","last_peered":"2024-08-19T00:37:04.366071+0000","last_clean":"2024-08-19T00:37:04.366071+0000","last_became_active":"2024-08-19T00:37:02.356715+0000","last_became_peered":"2024-08-19T00:37:02.356715+0000","last_unstale":"2024-08-19T00:37:04.366071+0000","last_undegraded":"2024-08-19T00:37:04.366071+0000","last_fullsized":"2024-08-19T00:37:04.366071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:01.604784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380767+0000","last_change":"2024-08-19T00:37:03.366561+0000","last_active":"2024-08-19T00:37:04.380767+0000","last_peered":"2024-08-19T00:37:04.380767+0000","last_clean":"2024-08-19T00:37:04.380767+0000","last_became_active":"2024-08-19T00:37:03.365866+0000","last_became_peered":"2024-08-19T00:37:03.365866+0000","last_unstale":"2024-08-19T00:37:04.380767+0000","last_undegraded":"2024-08-19T00:37:04.380767+0000","last_fullsized":"2024-08-19T00:37:04.380767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:02.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.383431+0000","last_change":"2024-08-19T00:37:02.358382+0000","last_active":"2024-08-19T00:37:04.383431+0000","last_peered":"2024-08-19T00:37:04.383431+0000","last_clean":"2024-08-19T00:37:04.383431+0000","last_became_active":"2024-08-19T00:37:02.358084+0000","last_became_peered":"2024-08-19T00:37:02.358084+0000","last_unstale":"2024-08-19T00:37:04.383431+0000","last_undegraded":"2024-08-19T00:37:04.383431+0000","last_fullsized":"2024-08-19T00:37:04.383431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:38.048649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365165+0000","last_change":"2024-08-19T00:37:03.372382+0000","last_active":"2024-08-19T00:37:04.365165+0000","last_peered":"2024-08-19T00:37:04.365165+0000","last_clean":"2024-08-19T00:37:04.365165+0000","last_became_active":"2024-08-19T00:37:03.372117+0000","last_became_peered":"2024-08-19T00:37:03.372117+0000","last_unstale":"2024-08-19T00:37:04.365165+0000","last_undegraded":"2024-08-19T00:37:04.365165+0000","last_fullsized":"2024-08-19T00:37:04.365165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:45.977868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380693+0000","last_change":"2024-08-19T00:37:02.372086+0000","last_active":"2024-08-19T00:37:04.380693+0000","last_peered":"2024-08-19T00:37:04.380693+0000","last_clean":"2024-08-19T00:37:04.380693+0000","last_became_active":"2024-08-19T00:37:02.371740+0000","last_became_peered":"2024-08-19T00:37:02.371740+0000","last_unstale":"2024-08-19T00:37:04.380693+0000","last_undegraded":"2024-08-19T00:37:04.380693+0000","last_fullsized":"2024-08-19T00:37:04.380693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380570+0000","last_change":"2024-08-19T00:37:03.375284+0000","last_active":"2024-08-19T00:37:04.380570+0000","last_peered":"2024-08-19T00:37:04.380570+0000","last_clean":"2024-08-19T00:37:04.380570+0000","last_became_active":"2024-08-19T00:37:03.375000+0000","last_became_peered":"2024-08-19T00:37:03.375000+0000","last_unstale":"2024-08-19T00:37:04.380570+0000","last_undegraded":"2024-08-19T00:37:04.380570+0000","last_fullsized":"2024-08-19T00:37:04.380570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:17.747497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.464135+0000","last_change":"2024-08-19T00:37:02.364047+0000","last_active":"2024-08-19T00:37:04.464135+0000","last_peered":"2024-08-19T00:37:04.464135+0000","last_clean":"2024-08-19T00:37:04.464135+0000","last_became_active":"2024-08-19T00:37:02.363698+0000","last_became_peered":"2024-08-19T00:37:02.363698+0000","last_unstale":"2024-08-19T00:37:04.464135+0000","last_undegraded":"2024-08-19T00:37:04.464135+0000","last_fullsized":"2024-08-19T00:37:04.464135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.369502+0000","last_change":"2024-08-19T00:37:03.374146+0000","last_active":"2024-08-19T00:37:04.369502+0000","last_peered":"2024-08-19T00:37:04.369502+0000","last_clean":"2024-08-19T00:37:04.369502+0000","last_became_active":"2024-08-19T00:37:03.373834+0000","last_became_peered":"2024-08-19T00:37:03.373834+0000","last_unstale":"2024-08-19T00:37:04.369502+0000","last_undegraded":"2024-08-19T00:37:04.369502+0000","last_fullsized":"2024-08-19T00:37:04.369502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:27.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365432+0000","last_change":"2024-08-19T00:37:02.349640+0000","last_active":"2024-08-19T00:37:04.365432+0000","last_peered":"2024-08-19T00:37:04.365432+0000","last_clean":"2024-08-19T00:37:04.365432+0000","last_became_active":"2024-08-19T00:37:02.349269+0000","last_became_peered":"2024-08-19T00:37:02.349269+0000","last_unstale":"2024-08-19T00:37:04.365432+0000","last_undegraded":"2024-08-19T00:37:04.365432+0000","last_fullsized":"2024-08-19T00:37:04.365432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365608+0000","last_change":"2024-08-19T00:37:03.380432+0000","last_active":"2024-08-19T00:37:04.365608+0000","last_peered":"2024-08-19T00:37:04.365608+0000","last_clean":"2024-08-19T00:37:04.365608+0000","last_became_active":"2024-08-19T00:37:03.379670+0000","last_became_peered":"2024-08-19T00:37:03.379670+0000","last_unstale":"2024-08-19T00:37:04.365608+0000","last_undegraded":"2024-08-19T00:37:04.365608+0000","last_fullsized":"2024-08-19T00:37:04.365608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:11.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.365705+0000","last_change":"2024-08-19T00:37:03.381062+0000","last_active":"2024-08-19T00:37:04.365705+0000","last_peered":"2024-08-19T00:37:04.365705+0000","last_clean":"2024-08-19T00:37:04.365705+0000","last_became_active":"2024-08-19T00:37:03.380753+0000","last_became_peered":"2024-08-19T00:37:03.380753+0000","last_unstale":"2024-08-19T00:37:04.365705+0000","last_undegraded":"2024-08-19T00:37:04.365705+0000","last_fullsized":"2024-08-19T00:37:04.365705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:37.265520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384192+0000","last_change":"2024-08-19T00:37:02.367985+0000","last_active":"2024-08-19T00:37:04.384192+0000","last_peered":"2024-08-19T00:37:04.384192+0000","last_clean":"2024-08-19T00:37:04.384192+0000","last_became_active":"2024-08-19T00:37:02.367333+0000","last_became_peered":"2024-08-19T00:37:02.367333+0000","last_unstale":"2024-08-19T00:37:04.384192+0000","last_undegraded":"2024-08-19T00:37:04.384192+0000","last_fullsized":"2024-08-19T00:37:04.384192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.463676+0000","last_change":"2024-08-19T00:37:03.387814+0000","last_active":"2024-08-19T00:37:04.463676+0000","last_peered":"2024-08-19T00:37:04.463676+0000","last_clean":"2024-08-19T00:37:04.463676+0000","last_became_active":"2024-08-19T00:37:03.386581+0000","last_became_peered":"2024-08-19T00:37:03.386581+0000","last_unstale":"2024-08-19T00:37:04.463676+0000","last_undegraded":"2024-08-19T00:37:04.463676+0000","last_fullsized":"2024-08-19T00:37:04.463676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:50.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.384048+0000","last_change":"2024-08-19T00:37:02.370717+0000","last_active":"2024-08-19T00:37:04.384048+0000","last_peered":"2024-08-19T00:37:04.384048+0000","last_clean":"2024-08-19T00:37:04.384048+0000","last_became_active":"2024-08-19T00:37:02.368335+0000","last_became_peered":"2024-08-19T00:37:02.368335+0000","last_unstale":"2024-08-19T00:37:04.384048+0000","last_undegraded":"2024-08-19T00:37:04.384048+0000","last_fullsized":"2024-08-19T00:37:04.384048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:09.827798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368865+0000","last_change":"2024-08-19T00:37:03.383908+0000","last_active":"2024-08-19T00:37:04.368865+0000","last_peered":"2024-08-19T00:37:04.368865+0000","last_clean":"2024-08-19T00:37:04.368865+0000","last_became_active":"2024-08-19T00:37:03.383512+0000","last_became_peered":"2024-08-19T00:37:03.383512+0000","last_unstale":"2024-08-19T00:37:04.368865+0000","last_undegraded":"2024-08-19T00:37:04.368865+0000","last_fullsized":"2024-08-19T00:37:04.368865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:54.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368814+0000","last_change":"2024-08-19T00:37:02.366055+0000","last_active":"2024-08-19T00:37:04.368814+0000","last_peered":"2024-08-19T00:37:04.368814+0000","last_clean":"2024-08-19T00:37:04.368814+0000","last_became_active":"2024-08-19T00:37:02.365758+0000","last_became_peered":"2024-08-19T00:37:02.365758+0000","last_unstale":"2024-08-19T00:37:04.368814+0000","last_undegraded":"2024-08-19T00:37:04.368814+0000","last_fullsized":"2024-08-19T00:37:04.368814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:37.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.368779+0000","last_change":"2024-08-19T00:37:03.371682+0000","last_active":"2024-08-19T00:37:04.368779+0000","last_peered":"2024-08-19T00:37:04.368779+0000","last_clean":"2024-08-19T00:37:04.368779+0000","last_became_active":"2024-08-19T00:37:03.371418+0000","last_became_peered":"2024-08-19T00:37:03.371418+0000","last_unstale":"2024-08-19T00:37:04.368779+0000","last_undegraded":"2024-08-19T00:37:04.368779+0000","last_fullsized":"2024-08-19T00:37:04.368779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:02.332489+0000","last_clean_scrub_stamp":"2024-08-19T00:37:02.332489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:43.257886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-19T00:37:04.380909+0000","last_change":"2024-08-19T00:37:02.361542+0000","last_active":"2024-08-19T00:37:04.380909+0000","last_peered":"2024-08-19T00:37:04.380909+0000","last_clean":"2024-08-19T00:37:04.380909+0000","last_became_active":"2024-08-19T00:37:02.361229+0000","last_became_peered":"2024-08-19T00:37:02.361229+0000","last_unstale":"2024-08-19T00:37:04.380909+0000","last_undegraded":"2024-08-19T00:37:04.380909+0000","last_fullsized":"2024-08-19T00:37:04.380909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:01.326088+0000","last_clean_scrub_stamp":"2024-08-19T00:37:01.326088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:56.623121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":77889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":76187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":666043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:37:13.157 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:37:13.157 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-19T00:37:13.157 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-19T00:37:13.158 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-19T00:37:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.348+0000 7fc725600640 1 Processor -- start 2024-08-19T00:37:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.348+0000 7fc725600640 1 -- start start 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.349+0000 7fc725600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc72015e4c0 0x7fc7200d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.349+0000 7fc725600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc72015e8a0 0x7fc7200d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc725600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7200d2750 con 0x7fc7200d2a60 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc725600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc7200d53e0 con 0x7fc72015e8a0 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc725600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc7200d1610 con 0x7fc72015e4c0 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc717e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc72015e8a0 0x7fc7200d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc717e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc72015e8a0 0x7fc7200d4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35718/0 (socket says 172.21.15.7:35718) 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc717e00640 1 -- 172.21.15.7:0/1464858318 learned_addr learned my addr 172.21.15.7:0/1464858318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc71ea00640 1 --2- 172.21.15.7:0/1464858318 >> v2:172.21.15.162:3300/0 conn(0x7fc72015e4c0 0x7fc7200d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc717e00640 1 -- 172.21.15.7:0/1464858318 >> v2:172.21.15.162:3300/0 conn(0x7fc72015e4c0 msgr2=0x7fc7200d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc717e00640 1 --2- 172.21.15.7:0/1464858318 >> v2:172.21.15.162:3300/0 conn(0x7fc72015e4c0 0x7fc7200d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc717e00640 1 -- 172.21.15.7:0/1464858318 >> v1:172.21.15.162:6789/0 conn(0x7fc7200d2a60 legacy=0x7fc720162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.350+0000 7fc717e00640 1 -- 172.21.15.7:0/1464858318 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7200d0ce0 con 0x7fc72015e8a0 2024-08-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.351+0000 7fc717e00640 1 --2- 172.21.15.7:0/1464858318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200d4ea0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc72008d260 tx=0x7fc70802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b486d3f72d97dae server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.351+0000 7fc71e000640 1 -- 172.21.15.7:0/1464858318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708037070 con 0x7fc72015e8a0 2024-08-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc71e000640 1 -- 172.21.15.7:0/1464858318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708032440 con 0x7fc72015e8a0 2024-08-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc71e000640 1 -- 172.21.15.7:0/1464858318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708032810 con 0x7fc72015e8a0 2024-08-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 -- 172.21.15.7:0/1464858318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 msgr2=0x7fc7200d4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 --2- 172.21.15.7:0/1464858318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200d4ea0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc72008d260 tx=0x7fc70802a270 comp rx=0 tx=0).stop 2024-08-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 -- 172.21.15.7:0/1464858318 shutdown_connections 2024-08-19T00:37:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 --2- 172.21.15.7:0/1464858318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200d4ea0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 --2- 172.21.15.7:0/1464858318 >> v2:172.21.15.162:3300/0 conn(0x7fc72015e4c0 0x7fc7200d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 -- 172.21.15.7:0/1464858318 >> 172.21.15.7:0/1464858318 conn(0x7fc72009d730 msgr2=0x7fc7200d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 -- 172.21.15.7:0/1464858318 shutdown_connections 2024-08-19T00:37:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.352+0000 7fc725600640 1 -- 172.21.15.7:0/1464858318 wait complete. 2024-08-19T00:37:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.354+0000 7fc725600640 1 Processor -- start 2024-08-19T00:37:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.354+0000 7fc725600640 1 -- start start 2024-08-19T00:37:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc725600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7200d2a60 0x7fc720160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc725600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc72015e4c0 0x7fc7200ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc725600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc725600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d0150 con 0x7fc72015e8a0 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc725600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d12a0 con 0x7fc72015e4c0 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc725600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7200d02d0 con 0x7fc7200d2a60 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc717e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc72015e4c0 0x7fc7200ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7200d2a60 0x7fc720160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35720/0 (socket says 172.21.15.7:35720) 2024-08-19T00:37:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 -- 172.21.15.7:0/1785103946 learned_addr learned my addr 172.21.15.7:0/1785103946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 -- 172.21.15.7:0/1785103946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7200d2a60 msgr2=0x7fc720160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7200d2a60 0x7fc720160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 -- 172.21.15.7:0/1785103946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc72015e4c0 msgr2=0x7fc7200ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc72015e4c0 0x7fc7200ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc71f400640 1 -- 172.21.15.7:0/1785103946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7200b89e0 con 0x7fc72015e8a0 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.355+0000 7fc717e00640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc72015e4c0 0x7fc7200ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.356+0000 7fc71f400640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200b72b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c7a0 tx=0x7fc71800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.356+0000 7fc716a00640 1 -- 172.21.15.7:0/1785103946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718003b70 con 0x7fc72015e8a0 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.356+0000 7fc716a00640 1 -- 172.21.15.7:0/1785103946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc718003d30 con 0x7fc72015e8a0 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.356+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc720160e40 con 0x7fc72015e8a0 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.356+0000 7fc716a00640 1 -- 172.21.15.7:0/1785103946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71800aa90 con 0x7fc72015e8a0 2024-08-19T00:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.356+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc720161400 con 0x7fc72015e8a0 2024-08-19T00:37:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.357+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7200d4ea0 con 0x7fc72015e8a0 2024-08-19T00:37:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.358+0000 7fc716a00640 1 -- 172.21.15.7:0/1785103946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc71800ac30 con 0x7fc72015e8a0 2024-08-19T00:37:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.359+0000 7fc716a00640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6fc06be30 0x7fc6fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.359+0000 7fc716a00640 1 -- 172.21.15.7:0/1785103946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc71808ad10 con 0x7fc72015e8a0 2024-08-19T00:37:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.359+0000 7fc71ea00640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6fc06be30 0x7fc6fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.360+0000 7fc71ea00640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6fc06be30 0x7fc6fc06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc710006fd0 tx=0x7fc710008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:13.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.364+0000 7fc716a00640 1 -- 172.21.15.7:0/1785103946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc718090020 con 0x7fc72015e8a0 2024-08-19T00:37:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.587+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc7200d1be0 con 0x7fc72015e8a0 2024-08-19T00:37:13.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.587+0000 7fc716a00640 1 -- 172.21.15.7:0/1785103946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc718058fd0 con 0x7fc72015e8a0 2024-08-19T00:37:13.589 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:13.589 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6fc06be30 msgr2=0x7fc6fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6fc06be30 0x7fc6fc06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc710006fd0 tx=0x7fc710008040 comp rx=0 tx=0).stop 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 msgr2=0x7fc7200b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200b72b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c7a0 tx=0x7fc71800cc60 comp rx=0 tx=0).stop 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 shutdown_connections 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6fc06be30 0x7fc6fc06e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc72015e8a0 0x7fc7200b72b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc72015e4c0 0x7fc7200ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 --2- 172.21.15.7:0/1785103946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7200d2a60 0x7fc720160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.589+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 >> 172.21.15.7:0/1785103946 conn(0x7fc72009d730 msgr2=0x7fc7200b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.590+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 shutdown_connections 2024-08-19T00:37:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.590+0000 7fc725600640 1 -- 172.21.15.7:0/1785103946 wait complete. 2024-08-19T00:37:13.607 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-19T00:37:13.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:13.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.762+0000 7f245da00640 1 Processor -- start 2024-08-19T00:37:13.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.762+0000 7f245da00640 1 -- start start 2024-08-19T00:37:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.763+0000 7f245da00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2458159bf0 0x7f2458073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.763+0000 7f245da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24580cec10 0x7f24580d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.763+0000 7f245da00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245806f7f0 con 0x7f24580739a0 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.763+0000 7f245da00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f245806f510 con 0x7f2458159bf0 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.763+0000 7f245da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2458072980 con 0x7f24580cec10 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2458159bf0 0x7f2458073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2457400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24580cec10 0x7f24580d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f24580739a0 0x7f24580ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:32856/0 (socket says 172.21.15.7:32856) 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2458159bf0 0x7f2458073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60328/0 (socket says 172.21.15.7:60328) 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456000640 1 -- 172.21.15.7:0/4170861571 learned_addr learned my addr 172.21.15.7:0/4170861571 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456a00640 1 -- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24580cec10 msgr2=0x7f24580d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456a00640 1 --2- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24580cec10 0x7f24580d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456a00640 1 -- 172.21.15.7:0/4170861571 >> v1:172.21.15.162:6789/0 conn(0x7f24580739a0 legacy=0x7f24580ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2456a00640 1 -- 172.21.15.7:0/4170861571 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2458072c60 con 0x7f2458159bf0 2024-08-19T00:37:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.764+0000 7f2457400640 1 --2- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24580cec10 0x7f24580d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.765+0000 7f2456a00640 1 --2- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2458159bf0 0x7f2458073460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24480097a0 tx=0x7f244802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73848bcc37dbcd5a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.765+0000 7f2455600640 1 -- 172.21.15.7:0/4170861571 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448037070 con 0x7f2458159bf0 2024-08-19T00:37:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.765+0000 7f2455600640 1 -- 172.21.15.7:0/4170861571 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244802ae50 con 0x7f2458159bf0 2024-08-19T00:37:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.765+0000 7f2455600640 1 -- 172.21.15.7:0/4170861571 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448032660 con 0x7f2458159bf0 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 -- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2458159bf0 msgr2=0x7f2458073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 --2- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2458159bf0 0x7f2458073460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24480097a0 tx=0x7f244802a100 comp rx=0 tx=0).stop 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 -- 172.21.15.7:0/4170861571 shutdown_connections 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 --2- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24580cec10 0x7f24580d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 --2- 172.21.15.7:0/4170861571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2458159bf0 0x7f2458073460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 -- 172.21.15.7:0/4170861571 >> 172.21.15.7:0/4170861571 conn(0x7f245806bc70 msgr2=0x7f245806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 -- 172.21.15.7:0/4170861571 shutdown_connections 2024-08-19T00:37:13.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.766+0000 7f245da00640 1 -- 172.21.15.7:0/4170861571 wait complete. 2024-08-19T00:37:13.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.768+0000 7f245da00640 1 Processor -- start 2024-08-19T00:37:13.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.768+0000 7f245da00640 1 -- start start 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f245da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24580739a0 0x7f245815f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f245da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2458159bf0 0x7f245814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f245da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f245814f340 0x7f24580cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f245da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f245815a150 con 0x7f2458159bf0 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f245da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2458159fd0 con 0x7f24580739a0 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f245da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f24580d0900 con 0x7f245814f340 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f2456000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2458159bf0 0x7f245814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f2456000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2458159bf0 0x7f245814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35728/0 (socket says 172.21.15.7:35728) 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.769+0000 7f2456000640 1 -- 172.21.15.7:0/255708584 learned_addr learned my addr 172.21.15.7:0/255708584 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456a00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24580739a0 0x7f245815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2457400640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f245814f340 0x7f24580cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456000640 1 -- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f245814f340 msgr2=0x7f24580cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456000640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f245814f340 0x7f24580cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456000640 1 -- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24580739a0 msgr2=0x7f245815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456000640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24580739a0 0x7f245815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456000640 1 -- 172.21.15.7:0/255708584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245814fce0 con 0x7f2458159bf0 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456a00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24580739a0 0x7f245815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f2456000640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2458159bf0 0x7f245814ee00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f244400c3f0 tx=0x7f244400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f244ea00640 1 -- 172.21.15.7:0/255708584 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444017070 con 0x7f2458159bf0 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f244ea00640 1 -- 172.21.15.7:0/255708584 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2444005ce0 con 0x7f2458159bf0 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f244ea00640 1 -- 172.21.15.7:0/255708584 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24440072f0 con 0x7f2458159bf0 2024-08-19T00:37:13.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245814ffc0 con 0x7f2458159bf0 2024-08-19T00:37:13.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.770+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2458150580 con 0x7f2458159bf0 2024-08-19T00:37:13.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.771+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2458068c00 con 0x7f2458159bf0 2024-08-19T00:37:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.773+0000 7f244ea00640 1 -- 172.21.15.7:0/255708584 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f244401a070 con 0x7f2458159bf0 2024-08-19T00:37:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.773+0000 7f244ea00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f243806be60 0x7f243806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.773+0000 7f244ea00640 1 -- 172.21.15.7:0/255708584 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f244408a1f0 con 0x7f2458159bf0 2024-08-19T00:37:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.774+0000 7f2456a00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f243806be60 0x7f243806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:13.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.774+0000 7f2456a00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f243806be60 0x7f243806e320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2448034000 tx=0x7f244802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:13.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.778+0000 7f244ea00640 1 -- 172.21.15.7:0/255708584 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2444058b00 con 0x7f2458159bf0 2024-08-19T00:37:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.997+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f245815eee0 con 0x7f2458159bf0 2024-08-19T00:37:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:13.998+0000 7f244ea00640 1 -- 172.21.15.7:0/255708584 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f2444058400 con 0x7f2458159bf0 2024-08-19T00:37:13.999 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f243806be60 msgr2=0x7f243806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f243806be60 0x7f243806e320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2448034000 tx=0x7f244802e000 comp rx=0 tx=0).stop 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2458159bf0 msgr2=0x7f245814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2458159bf0 0x7f245814ee00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f244400c3f0 tx=0x7f244400c8b0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 shutdown_connections 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f243806be60 0x7f243806e320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f245814f340 0x7f24580cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2458159bf0 0x7f245814ee00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 --2- 172.21.15.7:0/255708584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24580739a0 0x7f245815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 >> 172.21.15.7:0/255708584 conn(0x7f245806bc70 msgr2=0x7f2458158850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:14.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 shutdown_connections 2024-08-19T00:37:14.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.000+0000 7f245da00640 1 -- 172.21.15.7:0/255708584 wait complete. 2024-08-19T00:37:14.017 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:14.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.172+0000 7f5543800640 1 Processor -- start 2024-08-19T00:37:14.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.172+0000 7f5543800640 1 -- start start 2024-08-19T00:37:14.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.173+0000 7f5543800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f553c159bf0 0x7f553c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.173+0000 7f5543800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553c06f7f0 con 0x7f553c0cec10 2024-08-19T00:37:14.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.173+0000 7f5543800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553c06f510 con 0x7f553c0739a0 2024-08-19T00:37:14.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.173+0000 7f5543800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f553c072980 con 0x7f553c159bf0 2024-08-19T00:37:14.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f5541800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f553c0cec10 0x7f553c0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49010/0 (socket says 172.21.15.7:49010) 2024-08-19T00:37:14.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f5541800640 1 -- 172.21.15.7:0/3304403329 learned_addr learned my addr 172.21.15.7:0/3304403329 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:14.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f5540e00640 1 --2- 172.21.15.7:0/3304403329 >> v2:172.21.15.162:3300/0 conn(0x7f553c159bf0 0x7f553c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535013371 0 0) 0x7f553c06f7f0 con 0x7f553c0cec10 2024-08-19T00:37:14.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5524003520 con 0x7f553c0cec10 2024-08-19T00:37:14.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 408030590 0 0) 0x7f5524003520 con 0x7f553c0cec10 2024-08-19T00:37:14.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 >> v2:172.21.15.162:3300/0 conn(0x7f553c159bf0 msgr2=0x7f553c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 --2- 172.21.15.7:0/3304403329 >> v2:172.21.15.162:3300/0 conn(0x7f553c159bf0 0x7f553c073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 >> v1:172.21.15.162:6789/0 conn(0x7f553c0739a0 legacy=0x7f553c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c072c60 con 0x7f553c0cec10 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f55340019f0 con 0x7f553c0cec10 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 >> v1:172.21.15.7:6789/0 conn(0x7f553c0cec10 legacy=0x7f553c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55240039b0 0x7f5524003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.174+0000 7f553b400640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5524004800 0x7f5524004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f553b400640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240051c0 0x7f552400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f553c072980 con 0x7f55240039b0 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f552400c160 con 0x7f55240051c0 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f552400c360 con 0x7f5524004800 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5540e00640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55240039b0 0x7f5524003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5541800640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240051c0 0x7f552400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f553be00640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5524004800 0x7f5524004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5540e00640 1 -- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5524004800 msgr2=0x7f5524004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5540e00640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5524004800 0x7f5524004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5540e00640 1 -- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240051c0 msgr2=0x7f552400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5540e00640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240051c0 0x7f552400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5540e00640 1 -- 172.21.15.7:0/3304403329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5524003520 con 0x7f55240039b0 2024-08-19T00:37:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.175+0000 7f5541800640 1 -- 172.21.15.7:0/3304403329 reap_dead start 2024-08-19T00:37:14.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.176+0000 7f5540e00640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55240039b0 0x7f5524003dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5530009ac0 tx=0x7f5524005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8010bbdb94f9eedb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.176+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530036070 con 0x7f55240039b0 2024-08-19T00:37:14.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.176+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5530031400 con 0x7f55240039b0 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f553b400640 1 -- 172.21.15.7:0/3304403329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530009690 con 0x7f55240039b0 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f5543800640 1 -- 172.21.15.7:0/3304403329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55240039b0 msgr2=0x7f5524003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f5543800640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55240039b0 0x7f5524003dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5530009ac0 tx=0x7f5524005830 comp rx=0 tx=0).stop 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f5543800640 1 -- 172.21.15.7:0/3304403329 shutdown_connections 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f5543800640 1 --2- 172.21.15.7:0/3304403329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55240039b0 0x7f5524003dd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f5543800640 1 -- 172.21.15.7:0/3304403329 >> 172.21.15.7:0/3304403329 conn(0x7f553c06bc70 msgr2=0x7f553c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f5543800640 1 -- 172.21.15.7:0/3304403329 shutdown_connections 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.177+0000 7f5543800640 1 -- 172.21.15.7:0/3304403329 wait complete. 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.179+0000 7f5543800640 1 Processor -- start 2024-08-19T00:37:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.179+0000 7f5543800640 1 -- start start 2024-08-19T00:37:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5543800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240039b0 0x7f553c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5543800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c152c10 0x7f553c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5543800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f553c14f430 0x7f553c0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5543800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f553c15a150 con 0x7f553c152c10 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5543800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f553c159fd0 con 0x7f55240039b0 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5543800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f553c073460 con 0x7f553c14f430 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f553be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c152c10 0x7f553c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f553be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c152c10 0x7f553c0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56280/0 (socket says 172.21.15.7:56280) 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f553be00640 1 -- 172.21.15.7:0/2252633242 learned_addr learned my addr 172.21.15.7:0/2252633242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5540e00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240039b0 0x7f553c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f5541800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f553c14f430 0x7f553c0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f553be00640 1 -- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f553c14f430 msgr2=0x7f553c0b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f553be00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f553c14f430 0x7f553c0b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f553be00640 1 -- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240039b0 msgr2=0x7f553c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.180+0000 7f553be00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240039b0 0x7f553c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f553be00640 1 -- 172.21.15.7:0/2252633242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c1530d0 con 0x7f553c152c10 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f5540e00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240039b0 0x7f553c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f5541800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f553c14f430 0x7f553c0b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f553be00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c152c10 0x7f553c0b3d20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f552800f820 tx=0x7f552800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f5538c00640 1 -- 172.21.15.7:0/2252633242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55280050d0 con 0x7f553c152c10 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f5538c00640 1 -- 172.21.15.7:0/2252633242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5528018070 con 0x7f553c152c10 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f5538c00640 1 -- 172.21.15.7:0/2252633242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528005490 con 0x7f553c152c10 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c0b3240 con 0x7f553c152c10 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.181+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c0b3800 con 0x7f553c152c10 2024-08-19T00:37:14.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.182+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c15ac00 con 0x7f553c152c10 2024-08-19T00:37:14.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.183+0000 7f5538c00640 1 -- 172.21.15.7:0/2252633242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f552800d6d0 con 0x7f553c152c10 2024-08-19T00:37:14.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.184+0000 7f5538c00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f551c06be60 0x7f551c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.184+0000 7f5538c00640 1 -- 172.21.15.7:0/2252633242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f552808abc0 con 0x7f553c152c10 2024-08-19T00:37:14.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.184+0000 7f5540e00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f551c06be60 0x7f551c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.185+0000 7f5540e00640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f551c06be60 0x7f551c06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5530033000 tx=0x7f5530008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.188+0000 7f5538c00640 1 -- 172.21.15.7:0/2252633242 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f553c15ac00 con 0x7f553c152c10 2024-08-19T00:37:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.408+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f553c068c00 con 0x7f553c152c10 2024-08-19T00:37:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.409+0000 7f5538c00640 1 -- 172.21.15.7:0/2252633242 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f553c068c00 con 0x7f553c152c10 2024-08-19T00:37:14.411 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:14.411 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f551c06be60 msgr2=0x7f551c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f551c06be60 0x7f551c06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5530033000 tx=0x7f5530008030 comp rx=0 tx=0).stop 2024-08-19T00:37:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c152c10 msgr2=0x7f553c0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c152c10 0x7f553c0b3d20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f552800f820 tx=0x7f552800fce0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 shutdown_connections 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f551c06be60 0x7f551c06e320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f553c14f430 0x7f553c0b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c152c10 0x7f553c0b3d20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 --2- 172.21.15.7:0/2252633242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55240039b0 0x7f553c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 >> 172.21.15.7:0/2252633242 conn(0x7f553c06bc70 msgr2=0x7f553c0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 shutdown_connections 2024-08-19T00:37:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.411+0000 7f5543800640 1 -- 172.21.15.7:0/2252633242 wait complete. 2024-08-19T00:37:14.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:14.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.584+0000 7f9398600640 1 Processor -- start 2024-08-19T00:37:14.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.584+0000 7f9398600640 1 -- start start 2024-08-19T00:37:14.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9398600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9398600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93900cec10 0x7f93900d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9398600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f939006f7f0 con 0x7f93900739a0 2024-08-19T00:37:14.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9398600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f939006f510 con 0x7f93900cec10 2024-08-19T00:37:14.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9398600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9390072980 con 0x7f9390159bf0 2024-08-19T00:37:14.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9396600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93900cec10 0x7f93900d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9396600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93900cec10 0x7f93900d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56294/0 (socket says 172.21.15.7:56294) 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9396600640 1 -- 172.21.15.7:0/1056284188 learned_addr learned my addr 172.21.15.7:0/1056284188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9396600640 1 -- 172.21.15.7:0/1056284188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 msgr2=0x7f9390073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9395c00640 1 --2- 172.21.15.7:0/1056284188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.585+0000 7f9396600640 1 --2- 172.21.15.7:0/1056284188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.586+0000 7f9396600640 1 -- 172.21.15.7:0/1056284188 >> v1:172.21.15.162:6789/0 conn(0x7f93900739a0 legacy=0x7f93900ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.586+0000 7f9396600640 1 -- 172.21.15.7:0/1056284188 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9390072c60 con 0x7f93900cec10 2024-08-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.586+0000 7f9395c00640 1 --2- 172.21.15.7:0/1056284188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:14.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.586+0000 7f9396600640 1 --2- 172.21.15.7:0/1056284188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93900cec10 0x7f93900d03c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e50 tx=0x7f938802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e932ba005dfda0a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f938fe00640 1 -- 172.21.15.7:0/1056284188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388036070 con 0x7f93900cec10 2024-08-19T00:37:14.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f938fe00640 1 -- 172.21.15.7:0/1056284188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9388031600 con 0x7f93900cec10 2024-08-19T00:37:14.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f938fe00640 1 -- 172.21.15.7:0/1056284188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93880319d0 con 0x7f93900cec10 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f9398600640 1 -- 172.21.15.7:0/1056284188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93900cec10 msgr2=0x7f93900d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f9398600640 1 --2- 172.21.15.7:0/1056284188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93900cec10 0x7f93900d03c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e50 tx=0x7f938802a640 comp rx=0 tx=0).stop 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f9398600640 1 -- 172.21.15.7:0/1056284188 shutdown_connections 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f9398600640 1 --2- 172.21.15.7:0/1056284188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93900cec10 0x7f93900d03c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f9398600640 1 --2- 172.21.15.7:0/1056284188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.587+0000 7f9398600640 1 -- 172.21.15.7:0/1056284188 >> 172.21.15.7:0/1056284188 conn(0x7f939006bc70 msgr2=0x7f939006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.588+0000 7f9398600640 1 -- 172.21.15.7:0/1056284188 shutdown_connections 2024-08-19T00:37:14.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.588+0000 7f9398600640 1 -- 172.21.15.7:0/1056284188 wait complete. 2024-08-19T00:37:14.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.589+0000 7f9398600640 1 Processor -- start 2024-08-19T00:37:14.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.589+0000 7f9398600640 1 -- start start 2024-08-19T00:37:14.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.590+0000 7f9398600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93900739a0 0x7f9390153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.590+0000 7f9398600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.590+0000 7f9398600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93901ea240 0x7f93901ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.590+0000 7f9398600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f939015a150 con 0x7f93901ea240 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.590+0000 7f9398600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9390159fd0 con 0x7f93900739a0 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.590+0000 7f9398600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f93900d0900 con 0x7f9390159bf0 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.590+0000 7f9396600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93901ea240 0x7f93901ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93901ea240 0x7f93901ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56304/0 (socket says 172.21.15.7:56304) 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 -- 172.21.15.7:0/913179718 learned_addr learned my addr 172.21.15.7:0/913179718 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9395200640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9395c00640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93900739a0 0x7f9390153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 -- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 msgr2=0x7f9390155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 -- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93900739a0 msgr2=0x7f9390153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93900739a0 0x7f9390153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 -- 172.21.15.7:0/913179718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9390155d70 con 0x7f93901ea240 2024-08-19T00:37:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f9396600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93901ea240 0x7f93901ea6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e50 tx=0x7f9388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.591+0000 7f938d600640 1 -- 172.21.15.7:0/913179718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388036050 con 0x7f93901ea240 2024-08-19T00:37:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.592+0000 7f938d600640 1 -- 172.21.15.7:0/913179718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9388042070 con 0x7f93901ea240 2024-08-19T00:37:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.592+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9390154200 con 0x7f93901ea240 2024-08-19T00:37:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.592+0000 7f938d600640 1 -- 172.21.15.7:0/913179718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388009510 con 0x7f93901ea240 2024-08-19T00:37:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.592+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93901547c0 con 0x7f93901ea240 2024-08-19T00:37:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.593+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9390068c00 con 0x7f93901ea240 2024-08-19T00:37:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.594+0000 7f938d600640 1 -- 172.21.15.7:0/913179718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9388007b90 con 0x7f93901ea240 2024-08-19T00:37:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.594+0000 7f938d600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f937006be30 0x7f937006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.594+0000 7f938d600640 1 -- 172.21.15.7:0/913179718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f93880abd60 con 0x7f93901ea240 2024-08-19T00:37:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.595+0000 7f9395c00640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f937006be30 0x7f937006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.595+0000 7f9395c00640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f937006be30 0x7f937006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f938400ab60 tx=0x7f9384008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.599+0000 7f938d600640 1 -- 172.21.15.7:0/913179718 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9390155d70 con 0x7f93901ea240 2024-08-19T00:37:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.786+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93900b4800 con 0x7f93901ea240 2024-08-19T00:37:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.787+0000 7f938d600640 1 -- 172.21.15.7:0/913179718 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16573 (secure 0 0 0) 0x7f938802ae20 con 0x7f93901ea240 2024-08-19T00:37:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:14.789 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:04.356113+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f937006be30 msgr2=0x7f937006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f937006be30 0x7f937006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f938400ab60 tx=0x7f9384008040 comp rx=0 tx=0).stop 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93901ea240 msgr2=0x7f93901ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93901ea240 0x7f93901ea6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e50 tx=0x7f9388004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 shutdown_connections 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f937006be30 0x7f937006e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93901ea240 0x7f93901ea6f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9390159bf0 0x7f9390155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 --2- 172.21.15.7:0/913179718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93900739a0 0x7f9390153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 >> 172.21.15.7:0/913179718 conn(0x7f939006bc70 msgr2=0x7f939015a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:14.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 shutdown_connections 2024-08-19T00:37:14.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.789+0000 7f9398600640 1 -- 172.21.15.7:0/913179718 wait complete. 2024-08-19T00:37:14.806 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:14.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.961+0000 7f47af800640 1 Processor -- start 2024-08-19T00:37:14.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.961+0000 7f47af800640 1 -- start start 2024-08-19T00:37:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.962+0000 7f47af800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f47a815f5b0 0x7f47a80cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.962+0000 7f47af800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47af800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a80cfaf0 con 0x7f47a80b4380 2024-08-19T00:37:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47af800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f47a80d0d60 con 0x7f47a815f5b0 2024-08-19T00:37:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47af800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47a815f990 con 0x7f47a80d03c0 2024-08-19T00:37:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47ad800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f47a80b4380 0x7f47a80b4830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49024/0 (socket says 172.21.15.7:49024) 2024-08-19T00:37:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47ad800640 1 -- 172.21.15.7:0/2993952334 learned_addr learned my addr 172.21.15.7:0/2993952334 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f479fe00640 1 --2- 172.21.15.7:0/2993952334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47ace00640 1 --2- 172.21.15.7:0/2993952334 >> v2:172.21.15.162:3300/0 conn(0x7f47a815f5b0 0x7f47a80cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47a7e00640 1 -- 172.21.15.7:0/2993952334 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114646804 0 0) 0x7f47a80cfaf0 con 0x7f47a80b4380 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.963+0000 7f47a7e00640 1 -- 172.21.15.7:0/2993952334 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f478c003520 con 0x7f47a80b4380 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.964+0000 7f47a7e00640 1 -- 172.21.15.7:0/2993952334 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452190596 0 0) 0x7f478c003520 con 0x7f47a80b4380 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.964+0000 7f479fe00640 1 -- 172.21.15.7:0/2993952334 >> v2:172.21.15.162:3300/0 conn(0x7f47a815f5b0 msgr2=0x7f47a80cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.964+0000 7f479fe00640 1 --2- 172.21.15.7:0/2993952334 >> v2:172.21.15.162:3300/0 conn(0x7f47a815f5b0 0x7f47a80cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.964+0000 7f479fe00640 1 -- 172.21.15.7:0/2993952334 >> v1:172.21.15.7:6789/0 conn(0x7f47a80b4380 legacy=0x7f47a80b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.964+0000 7f479fe00640 1 -- 172.21.15.7:0/2993952334 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a80b50b0 con 0x7f47a80d03c0 2024-08-19T00:37:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.964+0000 7f47ace00640 1 --2- 172.21.15.7:0/2993952334 >> v2:172.21.15.162:3300/0 conn(0x7f47a815f5b0 0x7f47a80cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f479fe00640 1 --2- 172.21.15.7:0/2993952334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80d0820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47900097a0 tx=0x7f479002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e7febe5a6cdaa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47a7e00640 1 -- 172.21.15.7:0/2993952334 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790037070 con 0x7f47a80d03c0 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47a7e00640 1 -- 172.21.15.7:0/2993952334 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f479002ab10 con 0x7f47a80d03c0 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47a7e00640 1 -- 172.21.15.7:0/2993952334 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a00019f0 con 0x7f47a80d03c0 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47af800640 1 -- 172.21.15.7:0/2993952334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 msgr2=0x7f47a80d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47af800640 1 --2- 172.21.15.7:0/2993952334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80d0820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47900097a0 tx=0x7f479002a080 comp rx=0 tx=0).stop 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47af800640 1 -- 172.21.15.7:0/2993952334 shutdown_connections 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47af800640 1 --2- 172.21.15.7:0/2993952334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80d0820 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47af800640 1 --2- 172.21.15.7:0/2993952334 >> v2:172.21.15.162:3300/0 conn(0x7f47a815f5b0 0x7f47a80cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.965+0000 7f47af800640 1 -- 172.21.15.7:0/2993952334 >> 172.21.15.7:0/2993952334 conn(0x7f47a806bc70 msgr2=0x7f47a806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.966+0000 7f47af800640 1 -- 172.21.15.7:0/2993952334 shutdown_connections 2024-08-19T00:37:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.966+0000 7f47af800640 1 -- 172.21.15.7:0/2993952334 wait complete. 2024-08-19T00:37:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.967+0000 7f47af800640 1 Processor -- start 2024-08-19T00:37:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.967+0000 7f47af800640 1 -- start start 2024-08-19T00:37:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47af800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a80b4380 0x7f47a81543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47af800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47af800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a815f5b0 0x7f47a80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47af800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47a80cedb0 con 0x7f47a815f5b0 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47af800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47a80cf120 con 0x7f47a80b4380 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47af800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47a806e660 con 0x7f47a80d03c0 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47ad800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a815f5b0 0x7f47a80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47ad800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a815f5b0 0x7f47a80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56308/0 (socket says 172.21.15.7:56308) 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.968+0000 7f47ad800640 1 -- 172.21.15.7:0/3081660087 learned_addr learned my addr 172.21.15.7:0/3081660087 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ace00640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a80b4380 0x7f47a81543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f479fe00640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ad800640 1 -- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 msgr2=0x7f47a80aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ad800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ad800640 1 -- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a80b4380 msgr2=0x7f47a81543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ad800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a80b4380 0x7f47a81543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ad800640 1 -- 172.21.15.7:0/3081660087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a80ae950 con 0x7f47a815f5b0 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ace00640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a80b4380 0x7f47a81543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47ad800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a815f5b0 0x7f47a80ae410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47a000cca0 tx=0x7f47a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47a5600640 1 -- 172.21.15.7:0/3081660087 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a0017070 con 0x7f47a815f5b0 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47a5600640 1 -- 172.21.15.7:0/3081660087 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a0012400 con 0x7f47a815f5b0 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a80aec00 con 0x7f47a815f5b0 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47a5600640 1 -- 172.21.15.7:0/3081660087 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a00127f0 con 0x7f47a815f5b0 2024-08-19T00:37:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.969+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a80af1c0 con 0x7f47a815f5b0 2024-08-19T00:37:14.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.971+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a80d0820 con 0x7f47a815f5b0 2024-08-19T00:37:14.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.971+0000 7f47a5600640 1 -- 172.21.15.7:0/3081660087 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47a001a070 con 0x7f47a815f5b0 2024-08-19T00:37:14.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.972+0000 7f47a5600640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f478406be30 0x7f478406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:14.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.972+0000 7f47a5600640 1 -- 172.21.15.7:0/3081660087 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f47a008adf0 con 0x7f47a815f5b0 2024-08-19T00:37:14.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.973+0000 7f47ace00640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f478406be30 0x7f478406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:14.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.973+0000 7f47ace00640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f478406be30 0x7f478406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4798009a20 tx=0x7f4798008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:14.977+0000 7f47a5600640 1 -- 172.21.15.7:0/3081660087 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f47a00597a0 con 0x7f47a815f5b0 2024-08-19T00:37:15.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.195+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47a80cfaa0 con 0x7f47a815f5b0 2024-08-19T00:37:15.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.196+0000 7f47a5600640 1 -- 172.21.15.7:0/3081660087 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f47a00590a0 con 0x7f47a815f5b0 2024-08-19T00:37:15.198 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:15.198 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:15.198 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f478406be30 msgr2=0x7f478406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f478406be30 0x7f478406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4798009a20 tx=0x7f4798008040 comp rx=0 tx=0).stop 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a815f5b0 msgr2=0x7f47a80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a815f5b0 0x7f47a80ae410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47a000cca0 tx=0x7f47a000a430 comp rx=0 tx=0).stop 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 shutdown_connections 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f478406be30 0x7f478406e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a815f5b0 0x7f47a80ae410 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a80d03c0 0x7f47a80aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 --2- 172.21.15.7:0/3081660087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a80b4380 0x7f47a81543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 >> 172.21.15.7:0/3081660087 conn(0x7f47a806bc70 msgr2=0x7f47a80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 shutdown_connections 2024-08-19T00:37:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.198+0000 7f47af800640 1 -- 172.21.15.7:0/3081660087 wait complete. 2024-08-19T00:37:15.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:37:02.781631+0000', 'modified': '2024-08-19T00:37:05.796949+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6834/1516018308', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1516018308}, {'type': 'v1', 'addr': '172.21.15.162:6834', 'nonce': 1516018308}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4291, 'qdb_cluster': [4291]} 2024-08-19T00:37:15.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:37:15.619 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-19T00:37:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.775+0000 7f16cc200640 1 Processor -- start 2024-08-19T00:37:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.775+0000 7f16cc200640 1 -- start start 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16cc200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c4159bf0 0x7f16c4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16cc200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16c40739a0 0x7f16c40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16cc200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c406f7f0 con 0x7f16c40cea40 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16cc200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f16c406f510 con 0x7f16c40739a0 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16cc200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16c4072980 con 0x7f16c4159bf0 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16ca200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f16c40cea40 0x7f16c40d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49028/0 (socket says 172.21.15.7:49028) 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16ca200640 1 -- 172.21.15.7:0/1047050673 learned_addr learned my addr 172.21.15.7:0/1047050673 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:15.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16c9800640 1 --2- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c4159bf0 0x7f16c4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16c8e00640 1 --2- 172.21.15.7:0/1047050673 >> v2:172.21.15.162:3300/0 conn(0x7f16c40739a0 0x7f16c40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16c3e00640 1 -- 172.21.15.7:0/1047050673 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263332015 0 0) 0x7f16c406f7f0 con 0x7f16c40cea40 2024-08-19T00:37:15.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.777+0000 7f16c3e00640 1 -- 172.21.15.7:0/1047050673 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16ac003520 con 0x7f16c40cea40 2024-08-19T00:37:15.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.778+0000 7f16c8e00640 1 -- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c4159bf0 msgr2=0x7f16c4073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.778+0000 7f16c8e00640 1 --2- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c4159bf0 0x7f16c4073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.778+0000 7f16c8e00640 1 -- 172.21.15.7:0/1047050673 >> v1:172.21.15.7:6789/0 conn(0x7f16c40cea40 legacy=0x7f16c40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.778+0000 7f16c8e00640 1 -- 172.21.15.7:0/1047050673 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c4072c60 con 0x7f16c40739a0 2024-08-19T00:37:15.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.779+0000 7f16c8e00640 1 --2- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40739a0 0x7f16c40ce500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16b00097a0 tx=0x7f16b002a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a6febb969fdc26 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:15.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.779+0000 7f16c3e00640 1 -- 172.21.15.7:0/1047050673 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0037070 con 0x7f16c40739a0 2024-08-19T00:37:15.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.779+0000 7f16c3e00640 1 -- 172.21.15.7:0/1047050673 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b002ae40 con 0x7f16c40739a0 2024-08-19T00:37:15.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.779+0000 7f16c3e00640 1 -- 172.21.15.7:0/1047050673 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0032660 con 0x7f16c40739a0 2024-08-19T00:37:15.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 -- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40739a0 msgr2=0x7f16c40ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 --2- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40739a0 0x7f16c40ce500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16b00097a0 tx=0x7f16b002a0f0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 -- 172.21.15.7:0/1047050673 shutdown_connections 2024-08-19T00:37:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 --2- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40739a0 0x7f16c40ce500 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 --2- 172.21.15.7:0/1047050673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c4159bf0 0x7f16c4073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 -- 172.21.15.7:0/1047050673 >> 172.21.15.7:0/1047050673 conn(0x7f16c406bc70 msgr2=0x7f16c406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 -- 172.21.15.7:0/1047050673 shutdown_connections 2024-08-19T00:37:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.780+0000 7f16cc200640 1 -- 172.21.15.7:0/1047050673 wait complete. 2024-08-19T00:37:15.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.781+0000 7f16cc200640 1 Processor -- start 2024-08-19T00:37:15.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.781+0000 7f16cc200640 1 -- start start 2024-08-19T00:37:15.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.782+0000 7f16cc200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c40739a0 0x7f16c40c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.782+0000 7f16cc200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40cea40 0x7f16c40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.782+0000 7f16cc200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16c4159bf0 0x7f16c40c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.782+0000 7f16cc200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16c415a150 con 0x7f16c4159bf0 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.782+0000 7f16cc200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16c4159fd0 con 0x7f16c40cea40 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.782+0000 7f16cc200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40d0ad0 con 0x7f16c40739a0 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16c4159bf0 0x7f16c40c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16c4159bf0 0x7f16c40c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56322/0 (socket says 172.21.15.7:56322) 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 -- 172.21.15.7:0/3324770408 learned_addr learned my addr 172.21.15.7:0/3324770408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16c9800640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c40739a0 0x7f16c40c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16c8e00640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40cea40 0x7f16c40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 -- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c40739a0 msgr2=0x7f16c40c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c40739a0 0x7f16c40c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 -- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40cea40 msgr2=0x7f16c40b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40cea40 0x7f16c40b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 -- 172.21.15.7:0/3324770408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40c51d0 con 0x7f16c4159bf0 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.783+0000 7f16ca200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16c4159bf0 0x7f16c40c6d20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00cb70 tx=0x7f16bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.784+0000 7f16c1600640 1 -- 172.21.15.7:0/3324770408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc017070 con 0x7f16c4159bf0 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.784+0000 7f16c1600640 1 -- 172.21.15.7:0/3324770408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc00ad40 con 0x7f16c4159bf0 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.784+0000 7f16c1600640 1 -- 172.21.15.7:0/3324770408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc012620 con 0x7f16c4159bf0 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.784+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c40c54b0 con 0x7f16c4159bf0 2024-08-19T00:37:15.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.784+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c40c5a70 con 0x7f16c4159bf0 2024-08-19T00:37:15.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.786+0000 7f16c1600640 1 -- 172.21.15.7:0/3324770408 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16bc01a070 con 0x7f16c4159bf0 2024-08-19T00:37:15.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.787+0000 7f16c1600640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a406be30 0x7f16a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.787+0000 7f16c1600640 1 -- 172.21.15.7:0/3324770408 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f16bc08acc0 con 0x7f16c4159bf0 2024-08-19T00:37:15.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.787+0000 7f16c9800640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a406be30 0x7f16a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.787+0000 7f16cf026740 1 Processor -- start 2024-08-19T00:37:15.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.787+0000 7f16cf026740 1 -- start start 2024-08-19T00:37:15.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16c9800640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a406be30 0x7f16a406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16c40b1f60 tx=0x7f16b8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b818330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b83b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16cf026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b830df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16cf026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56134b750ba0 con 0x56134b83bdd0 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56134b6e9230 con 0x56134b817f50 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56134b74cb60 con 0x56134b83b470 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16ca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b830df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16ca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b830df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56334/0 (socket says 172.21.15.7:56334) 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.788+0000 7f16ca200640 1 -- 172.21.15.7:0/2971538476 learned_addr learned my addr 172.21.15.7:0/2971538476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16c9800640 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b818330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16c8e00640 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b83b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16ca200640 1 -- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 msgr2=0x56134b83b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16ca200640 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b83b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16ca200640 1 -- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 msgr2=0x56134b818330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16ca200640 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b818330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16ca200640 1 -- 172.21.15.7:0/2971538476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134b71abb0 con 0x56134b83bdd0 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16ca200640 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b830df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f16bc089090 tx=0x7f16bc059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece5ab9681356223 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16b6000640 1 -- 172.21.15.7:0/2971538476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc057280 con 0x56134b83bdd0 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16b6000640 1 -- 172.21.15.7:0/2971538476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc0555f0 con 0x56134b83bdd0 2024-08-19T00:37:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.789+0000 7f16b6000640 1 -- 172.21.15.7:0/2971538476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc061820 con 0x56134b83bdd0 2024-08-19T00:37:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 -- 172.21.15.7:0/2971538476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 msgr2=0x56134b830df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b830df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f16bc089090 tx=0x7f16bc059040 comp rx=0 tx=0).stop 2024-08-19T00:37:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 -- 172.21.15.7:0/2971538476 shutdown_connections 2024-08-19T00:37:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b830df0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b83b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 --2- 172.21.15.7:0/2971538476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b818330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 -- 172.21.15.7:0/2971538476 >> 172.21.15.7:0/2971538476 conn(0x56134b7b5110 msgr2=0x56134b832d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 -- 172.21.15.7:0/2971538476 shutdown_connections 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.790+0000 7f16cf026740 1 -- 172.21.15.7:0/2971538476 wait complete. 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.791+0000 7f16cf026740 1 -- start start 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.791+0000 7f16cf026740 1 Processor -- start 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b7ee390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16cf026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83b470 0x56134b812b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 0x56134b832050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16cf026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56134b834ea0 con 0x56134b83b470 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56134b70c250 con 0x56134b817f50 2024-08-19T00:37:15.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56134b8345b0 con 0x56134b83bdd0 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16cf026740 10 client.0 _ll_register_callbacks cb 0x56134b710740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83b470 0x56134b812b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83b470 0x56134b812b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56350/0 (socket says 172.21.15.7:56350) 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 -- 172.21.15.7:0/3717248988 learned_addr learned my addr 172.21.15.7:0/3717248988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 -- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 msgr2=0x56134b832050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 0x56134b832050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 -- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 msgr2=0x56134b7ee390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c9800640 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b7ee390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b7ee390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c8e00640 1 -- 172.21.15.7:0/3717248988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134b4642d0 con 0x56134b83b470 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.792+0000 7f16c9800640 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b7ee390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16c8e00640 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83b470 0x56134b812b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b9cc8db1654627 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:15.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16aaa00640 1 -- 172.21.15.7:0/3717248988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0037040 con 0x56134b83b470 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16aaa00640 1 -- 172.21.15.7:0/3717248988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f16b0032dd0 con 0x56134b83b470 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16bc0555f0 con 0x56134b83b470 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16aaa00640 1 -- 172.21.15.7:0/3717248988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f16b0006e10 con 0x56134b83b470 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16cf026740 10 client.4563 fetch_fsmap learned FSMap version 8 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56134b52e6b0 con 0x56134b83b470 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16aaa00640 1 -- 172.21.15.7:0/3717248988 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc0555f0 con 0x56134b83b470 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16aaa00640 1 -- 172.21.15.7:0/3717248988 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f16b0046410 con 0x56134b83b470 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16cf026740 10 client.4563 fetch_fsmap finished waiting for FSMap version 8 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.793+0000 7f16cf026740 10 client.4563 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.794+0000 7f16cf026740 20 client.4563 populate_metadata read hostname 'smithi007' 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.794+0000 7f16cf026740 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b82e530 0x56134b82e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.794+0000 7f16cf026740 4 client.4563 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:37:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.794+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 --> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56134b75e2d0 con 0x56134b82e530 2024-08-19T00:37:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.794+0000 7f16c9800640 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b82e530 0x56134b82e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.795+0000 7f16c9800640 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b82e530 0x56134b82e910 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c030f2e09a94875 server_cookie=eb09ab50e379bba4 in_seq=0 out_seq=0 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.795+0000 7f16aaa00640 10 client.4563 ms_handle_connect on v2:172.21.15.162:6832/1516018308 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16aaa00640 1 -- 172.21.15.7:0/3717248988 <== mds.0 v2:172.21.15.162:6832/1516018308 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56134b75e2d0 con 0x56134b82e530 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16aaa00640 10 client.4563 handle_command_reply: tid=0 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 client.4563 shutdown 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83b470 msgr2=0x56134b812b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83b470 0x56134b812b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b0004730 comp rx=0 tx=0).stop 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 shutdown_connections 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b82e530 0x56134b82e910 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 0x56134b832050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83b470 0x56134b812b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 --2- 172.21.15.7:0/3717248988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b7ee390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 >> 172.21.15.7:0/3717248988 conn(0x56134b7b5110 msgr2=0x56134b832c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16aaa00640 0 client.4563 ms_handle_reset on v2:172.21.15.162:6832/1516018308 2024-08-19T00:37:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 shutdown_connections 2024-08-19T00:37:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 1 -- 172.21.15.7:0/3717248988 wait complete. 2024-08-19T00:37:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.796+0000 7f16cf026740 20 client.4563 trim_cache size 0 max 16384 2024-08-19T00:37:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.815+0000 7f16cf026740 1 Processor -- start 2024-08-19T00:37:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.815+0000 7f16cf026740 1 -- start start 2024-08-19T00:37:15.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b82eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b856760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16cf026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b856ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16cf026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16c41ff7b0 con 0x56134b83bdd0 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40b33f0 con 0x56134b817f50 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40b3a40 con 0x56134b83b470 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16ca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b856ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16ca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b856ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56362/0 (socket says 172.21.15.7:56362) 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16ca200640 1 -- 172.21.15.7:0/3246222316 learned_addr learned my addr 172.21.15.7:0/3246222316 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16c9800640 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b82eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.816+0000 7f16c8e00640 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b856760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16ca200640 1 -- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 msgr2=0x56134b856760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16ca200640 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b856760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16ca200640 1 -- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 msgr2=0x56134b82eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16ca200640 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b82eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16ca200640 1 -- 172.21.15.7:0/3246222316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134b753040 con 0x56134b83bdd0 2024-08-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16c9800640 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b82eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16ca200640 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b856ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0012e0 tx=0x7f16bc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3117d71663f565a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16b5600640 1 -- 172.21.15.7:0/3246222316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0555f0 con 0x56134b83bdd0 2024-08-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16b5600640 1 -- 172.21.15.7:0/3246222316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc073070 con 0x56134b83bdd0 2024-08-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.817+0000 7f16b5600640 1 -- 172.21.15.7:0/3246222316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc061860 con 0x56134b83bdd0 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 -- 172.21.15.7:0/3246222316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 msgr2=0x56134b856ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b856ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0012e0 tx=0x7f16bc01e000 comp rx=0 tx=0).stop 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 -- 172.21.15.7:0/3246222316 shutdown_connections 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b83bdd0 0x56134b856ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83b470 0x56134b856760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 --2- 172.21.15.7:0/3246222316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b817f50 0x56134b82eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 -- 172.21.15.7:0/3246222316 >> 172.21.15.7:0/3246222316 conn(0x56134b7b5110 msgr2=0x56134b833380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 -- 172.21.15.7:0/3246222316 shutdown_connections 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 -- 172.21.15.7:0/3246222316 wait complete. 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.818+0000 7f16cf026740 1 -- start start 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.819+0000 7f16cf026740 1 Processor -- start 2024-08-19T00:37:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16cf026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b817f50 0x56134b89a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b83b470 0x56134b856530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16cf026740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 0x56134b856a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16cf026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56134b82f4c0 con 0x56134b817f50 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56134b7ec580 con 0x56134b83b470 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16cf026740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56134b8147e0 con 0x56134b83bdd0 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16cf026740 10 client.0 _ll_register_callbacks cb 0x7f16ac0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b817f50 0x56134b89a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b817f50 0x56134b89a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56368/0 (socket says 172.21.15.7:56368) 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 -- 172.21.15.7:0/1569963020 learned_addr learned my addr 172.21.15.7:0/1569963020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c8e00640 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b83b470 0x56134b856530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16ca200640 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 0x56134b856a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 -- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 msgr2=0x56134b856a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 0x56134b856a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 -- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b83b470 msgr2=0x56134b856530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b83b470 0x56134b856530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 -- 172.21.15.7:0/1569963020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134b7e9ae0 con 0x56134b817f50 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16c9800640 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b817f50 0x56134b89a030 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16b80042a0 tx=0x7f16b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0afa026d1bab0a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.820+0000 7f16aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16aaa00640 1 -- 172.21.15.7:0/1569963020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8003a90 con 0x56134b817f50 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16aaa00640 1 -- 172.21.15.7:0/1569963020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f16b800f040 con 0x56134b817f50 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16bc073070 con 0x56134b817f50 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16aaa00640 1 -- 172.21.15.7:0/1569963020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f16b8003c30 con 0x56134b817f50 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 10 client.4569 fetch_fsmap learned FSMap version 8 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56134b813990 con 0x56134b817f50 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16aaa00640 1 -- 172.21.15.7:0/1569963020 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc073070 con 0x56134b817f50 2024-08-19T00:37:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16aaa00640 1 -- 172.21.15.7:0/1569963020 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f16b803b080 con 0x56134b817f50 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 10 client.4569 fetch_fsmap finished waiting for FSMap version 8 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 10 client.4569 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 20 client.4569 populate_metadata read hostname 'smithi007' 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b8b16e0 0x56134b84be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 4 client.4569 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.821+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 --> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] -- command(tid 0: {"prefix": "status"}) -- 0x56134b758620 con 0x56134b8b16e0 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.822+0000 7f16c8e00640 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b8b16e0 0x56134b84be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.822+0000 7f16c8e00640 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b8b16e0 0x56134b84be90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef22402d26c15b6f server_cookie=c72ac517753b5c14 in_seq=0 out_seq=0 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.822+0000 7f16aaa00640 10 client.4569 ms_handle_connect on v2:172.21.15.162:6832/1516018308 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16aaa00640 1 -- 172.21.15.7:0/1569963020 <== mds.0 v2:172.21.15.162:6832/1516018308 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56134b758620 con 0x56134b8b16e0 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16aaa00640 10 client.4569 handle_command_reply: tid=0 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 client.4569 shutdown 2024-08-19T00:37:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b817f50 msgr2=0x56134b89a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b817f50 0x56134b89a030 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16b80042a0 tx=0x7f16b80046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 shutdown_connections 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:6832/1516018308,v1:172.21.15.162:6834/1516018308] conn(0x56134b8b16e0 0x56134b84be90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56134b83bdd0 0x56134b856a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56134b83b470 0x56134b856530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 --2- 172.21.15.7:0/1569963020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56134b817f50 0x56134b89a030 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16aaa00640 0 client.4569 ms_handle_reset on v2:172.21.15.162:6832/1516018308 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 >> 172.21.15.7:0/1569963020 conn(0x56134b7b5110 msgr2=0x56134b834dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 shutdown_connections 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 1 -- 172.21.15.7:0/1569963020 wait complete. 2024-08-19T00:37:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.823+0000 7f16cf026740 20 client.4569 trim_cache size 0 max 16384 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4291, 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 12.464757447, 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 8, 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 21, 2024-08-19T00:37:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 21, 2024-08-19T00:37:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 18.851299523000002 2024-08-19T00:37:15.831 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:37:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a406be30 msgr2=0x7f16a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a406be30 0x7f16a406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16c40b1f60 tx=0x7f16b8009190 comp rx=0 tx=0).stop 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16c4159bf0 msgr2=0x7f16c40c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16c4159bf0 0x7f16c40c6d20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00cb70 tx=0x7f16bc00a430 comp rx=0 tx=0).stop 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 shutdown_connections 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a406be30 0x7f16a406e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16c4159bf0 0x7f16c40c6d20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c40cea40 0x7f16c40b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 --2- 172.21.15.7:0/3324770408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c40739a0 0x7f16c40c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 >> 172.21.15.7:0/3324770408 conn(0x7f16c406bc70 msgr2=0x7f16c415b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 shutdown_connections 2024-08-19T00:37:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:15.824+0000 7f16cc200640 1 -- 172.21.15.7:0/3324770408 wait complete. 2024-08-19T00:37:15.841 INFO:teuthology.run_tasks:Running task sequential... 2024-08-19T00:37:15.853 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-19T00:37:15.853 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-19T00:37:15.853 INFO:teuthology.task.print:Enabling mgr modules 2024-08-19T00:37:15.854 INFO:teuthology.run_tasks:Running task kclient... 2024-08-19T00:37:15.891 INFO:tasks.kclient:Mounting kernel clients... 2024-08-19T00:37:15.891 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-19T00:37:15.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:15.891 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:37:15.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:15.927 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-08-19T00:37:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-08-19T00:37:16.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:37:16.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:16.029 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:37:16.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:16.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-08-19T00:37:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-08-19T00:37:16.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:37:16.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:16.168 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-19T00:37:16.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:16.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-19T00:37:16.312 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-08-19T00:37:16.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:37:16.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:16.316 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-19T00:37:16.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:16.352 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-19T00:37:16.450 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-08-19T00:37:16.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:37:16.453 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-08-19T00:37:16.454 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:37:16.454 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:16.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:37:16.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.609+0000 7ff4c7000640 1 Processor -- start 2024-08-19T00:37:16.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.609+0000 7ff4c7000640 1 -- start start 2024-08-19T00:37:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.610+0000 7ff4c7000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4c0159bf0 0x7ff4c0073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.610+0000 7ff4c7000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c006f7f0 con 0x7ff4c00739a0 2024-08-19T00:37:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.610+0000 7ff4c7000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c006f510 con 0x7ff4c00cec10 2024-08-19T00:37:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4c7000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c0072980 con 0x7ff4c0159bf0 2024-08-19T00:37:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4b7400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff4c00739a0 0x7ff4c00ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49038/0 (socket says 172.21.15.7:49038) 2024-08-19T00:37:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4b7400640 1 -- 172.21.15.7:0/3988004870 learned_addr learned my addr 172.21.15.7:0/3988004870 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:16.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bfe00640 1 --2- 172.21.15.7:0/3988004870 >> v2:172.21.15.162:3300/0 conn(0x7ff4c0159bf0 0x7ff4c0073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:16.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1330680916 0 0) 0x7ff4c006f7f0 con 0x7ff4c00739a0 2024-08-19T00:37:16.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4a4003520 con 0x7ff4c00739a0 2024-08-19T00:37:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727952196 0 0) 0x7ff4c006f510 con 0x7ff4c00cec10 2024-08-19T00:37:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c006f7f0 con 0x7ff4c00cec10 2024-08-19T00:37:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1294402074 0 0) 0x7ff4a4003520 con 0x7ff4c00739a0 2024-08-19T00:37:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bfe00640 1 -- 172.21.15.7:0/3988004870 >> v1:172.21.15.162:6789/0 conn(0x7ff4c00cec10 legacy=0x7ff4c00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bfe00640 1 -- 172.21.15.7:0/3988004870 >> v1:172.21.15.7:6789/0 conn(0x7ff4c00739a0 legacy=0x7ff4c00ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:16.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.611+0000 7ff4bfe00640 1 -- 172.21.15.7:0/3988004870 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c0072c60 con 0x7ff4c0159bf0 2024-08-19T00:37:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.612+0000 7ff4bfe00640 1 --2- 172.21.15.7:0/3988004870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0159bf0 0x7ff4c0073460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00097a0 tx=0x7ff4b002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ed6d4c1d933e0e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0037070 con 0x7ff4c0159bf0 2024-08-19T00:37:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b002abc0 con 0x7ff4c0159bf0 2024-08-19T00:37:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4bf400640 1 -- 172.21.15.7:0/3988004870 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8001670 con 0x7ff4c0159bf0 2024-08-19T00:37:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4c7000640 1 -- 172.21.15.7:0/3988004870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0159bf0 msgr2=0x7ff4c0073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4c7000640 1 --2- 172.21.15.7:0/3988004870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0159bf0 0x7ff4c0073460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00097a0 tx=0x7ff4b002a130 comp rx=0 tx=0).stop 2024-08-19T00:37:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4c7000640 1 -- 172.21.15.7:0/3988004870 shutdown_connections 2024-08-19T00:37:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4c7000640 1 --2- 172.21.15.7:0/3988004870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0159bf0 0x7ff4c0073460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.613+0000 7ff4c7000640 1 -- 172.21.15.7:0/3988004870 >> 172.21.15.7:0/3988004870 conn(0x7ff4c006bc70 msgr2=0x7ff4c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.614+0000 7ff4c7000640 1 -- 172.21.15.7:0/3988004870 shutdown_connections 2024-08-19T00:37:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.614+0000 7ff4c7000640 1 -- 172.21.15.7:0/3988004870 wait complete. 2024-08-19T00:37:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.615+0000 7ff4c7000640 1 Processor -- start 2024-08-19T00:37:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.615+0000 7ff4c7000640 1 -- start start 2024-08-19T00:37:16.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4c7000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4c00739a0 0x7ff4c01525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4c7000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c0159bf0 0x7ff4c01557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4c7000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0153ed0 0x7ff4c014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4c7000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c015a150 con 0x7ff4c00739a0 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4c7000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0159fd0 con 0x7ff4c0153ed0 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4c7000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c00d0ad0 con 0x7ff4c0159bf0 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4c00739a0 0x7ff4c01525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.616+0000 7ff4bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4c00739a0 0x7ff4c01525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56380/0 (socket says 172.21.15.7:56380) 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4bfe00640 1 -- 172.21.15.7:0/2578056180 learned_addr learned my addr 172.21.15.7:0/2578056180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4b7400640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c0159bf0 0x7ff4c01557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4c5000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0153ed0 0x7ff4c014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4bfe00640 1 -- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c0159bf0 msgr2=0x7ff4c01557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4bfe00640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c0159bf0 0x7ff4c01557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4bfe00640 1 -- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0153ed0 msgr2=0x7ff4c014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4bfe00640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0153ed0 0x7ff4c014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4bfe00640 1 -- 172.21.15.7:0/2578056180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c0154700 con 0x7ff4c00739a0 2024-08-19T00:37:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4c5000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0153ed0 0x7ff4c014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.617+0000 7ff4bfe00640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4c00739a0 0x7ff4c01525b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0035040 tx=0x7ff4b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.618+0000 7ff4bcc00640 1 -- 172.21.15.7:0/2578056180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0041070 con 0x7ff4c00739a0 2024-08-19T00:37:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.618+0000 7ff4bcc00640 1 -- 172.21.15.7:0/2578056180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b003c660 con 0x7ff4c00739a0 2024-08-19T00:37:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.618+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c01549e0 con 0x7ff4c00739a0 2024-08-19T00:37:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.618+0000 7ff4bcc00640 1 -- 172.21.15.7:0/2578056180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0037040 con 0x7ff4c00739a0 2024-08-19T00:37:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.618+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c0154fa0 con 0x7ff4c00739a0 2024-08-19T00:37:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.619+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c0073460 con 0x7ff4c00739a0 2024-08-19T00:37:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.620+0000 7ff4bcc00640 1 -- 172.21.15.7:0/2578056180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4b0044070 con 0x7ff4c00739a0 2024-08-19T00:37:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.621+0000 7ff4bcc00640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff49c06be30 0x7ff49c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.621+0000 7ff4bcc00640 1 -- 172.21.15.7:0/2578056180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff4b00ab570 con 0x7ff4c00739a0 2024-08-19T00:37:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.621+0000 7ff4b7400640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff49c06be30 0x7ff49c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.621+0000 7ff4b7400640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff49c06be30 0x7ff49c06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0159000 tx=0x7ff4a8001610 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:16.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.625+0000 7ff4bcc00640 1 -- 172.21.15.7:0/2578056180 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff4b00798c0 con 0x7ff4c00739a0 2024-08-19T00:37:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.845+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff4c0158c70 con 0x7ff4c00739a0 2024-08-19T00:37:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.846+0000 7ff4bcc00640 1 -- 172.21.15.7:0/2578056180 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7ff4b00a9e20 con 0x7ff4c00739a0 2024-08-19T00:37:16.848 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff49c06be30 msgr2=0x7ff49c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff49c06be30 0x7ff49c06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0159000 tx=0x7ff4a8001610 comp rx=0 tx=0).stop 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4c00739a0 msgr2=0x7ff4c01525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4c00739a0 0x7ff4c01525b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0035040 tx=0x7ff4b00046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 shutdown_connections 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff49c06be30 0x7ff49c06e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0153ed0 0x7ff4c014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c0159bf0 0x7ff4c01557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 --2- 172.21.15.7:0/2578056180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4c00739a0 0x7ff4c01525b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 >> 172.21.15.7:0/2578056180 conn(0x7ff4c006bc70 msgr2=0x7ff4c0074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 shutdown_connections 2024-08-19T00:37:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:16.848+0000 7ff4c7000640 1 -- 172.21.15.7:0/2578056180 wait complete. 2024-08-19T00:37:16.866 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-19T00:37:16.866 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:37:16.866 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:37:16.866 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:37:16.866 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:16.866 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-19T00:37:16.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:37:16.867 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:37:16.867 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:37:16.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:16.867 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42825sec preferred_lft 42825sec 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:16.904 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:37:16.905 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-19T00:37:16.905 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:16.905 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:16.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-08-19T00:37:16.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-08-19T00:37:16.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-08-19T00:37:16.906 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-19T00:37:16.906 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:17.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:17.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:17.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:17.348 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:37:17.403 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:37:17.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:17.407 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:37:17.456 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:37:17.456 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:37:17.456 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:37:17.456 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:37:17.456 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:37:17.457 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:17.457 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:17.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:37:17.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:37:17.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:37:17.457 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:18.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:18.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:18.095 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:37:18.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:18.131 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-08-19T00:37:18.206 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:18.206 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:18.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:37:18.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-19T00:37:18.206 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:18.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:18.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:18.385 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-19T00:37:18.386 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:18.386 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:18.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-19T00:37:18.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-19T00:37:18.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-19T00:37:18.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-19T00:37:18.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-19T00:37:18.387 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:18.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:18.625 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:18.625 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:18.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:37:18.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-08-19T00:37:18.626 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:18.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:18.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:18.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:18.794 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:18.829 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:37:18.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:18.829 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:18.904 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:37:18.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:18.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:19.048 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:19.048 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:37:19.048 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:19.681 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:19.681 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:37:19.681 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:19.681 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:19.681 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:19.707 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:19.707 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:37:19.707 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:19.707 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:19.707 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:19.707 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:37:19.707 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:37:19.708 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:37:19.709 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:37:19.709 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:37:19.709 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:37:19.710 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:37:19.710 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:37:19.712 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:37:19.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:19.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:19.770 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:19.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:19.871 INFO:teuthology.orchestra.run.smithi007.stdout:client4578 2024-08-19T00:37:19.871 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:19.871 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:19.907 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:20.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:20.048 INFO:teuthology.orchestra.run.smithi007.stdout:client4578 2024-08-19T00:37:20.048 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:20.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:20.150 INFO:teuthology.orchestra.run.smithi007.stdout:client4578 2024-08-19T00:37:20.150 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd35d026-e259-45a6-99d5-e8ea5afa8a60.client4578/status') 2024-08-19T00:37:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:20.258 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.4578 (3)192.168.0.1:0/3207514540 2024-08-19T00:37:20.259 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-08-19T00:37:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-08-19T00:37:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-08-19T00:37:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:69 bytes copied, 5.6961e-05 s, 1.2 MB/s 2024-08-19T00:37:20.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:20.269 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-08-19T00:37:20.269 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:37:20.269 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-19T00:37:20.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:37:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.425+0000 7f9df3e00640 1 Processor -- start 2024-08-19T00:37:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.425+0000 7f9df3e00640 1 -- start start 2024-08-19T00:37:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9df406cf70 0x7f9df40ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9df40ae390 0x7f9df4160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df40aebc0 con 0x7f9df4155110 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9df41554f0 con 0x7f9df40ae390 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9df415f880 con 0x7f9df406cf70 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9df40ae390 0x7f9df4160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9df40ae390 0x7f9df4160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56386/0 (socket says 172.21.15.7:56386) 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.426+0000 7f9df3400640 1 -- 172.21.15.7:0/1510253523 learned_addr learned my addr 172.21.15.7:0/1510253523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.427+0000 7f9debe00640 1 --2- 172.21.15.7:0/1510253523 >> v2:172.21.15.162:3300/0 conn(0x7f9df406cf70 0x7f9df40ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.427+0000 7f9df3400640 1 -- 172.21.15.7:0/1510253523 >> v2:172.21.15.162:3300/0 conn(0x7f9df406cf70 msgr2=0x7f9df40ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.427+0000 7f9df3400640 1 --2- 172.21.15.7:0/1510253523 >> v2:172.21.15.162:3300/0 conn(0x7f9df406cf70 0x7f9df40ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.427+0000 7f9df3400640 1 -- 172.21.15.7:0/1510253523 >> v1:172.21.15.162:6789/0 conn(0x7f9df4155110 legacy=0x7f9df406c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.427+0000 7f9df3400640 1 -- 172.21.15.7:0/1510253523 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df415fb60 con 0x7f9df40ae390 2024-08-19T00:37:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.428+0000 7f9df3400640 1 --2- 172.21.15.7:0/1510253523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df40ae390 0x7f9df4160360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9df40d1770 tx=0x7f9dec02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85ccd1027c53083 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.428+0000 7f9df2000640 1 -- 172.21.15.7:0/1510253523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec036070 con 0x7f9df40ae390 2024-08-19T00:37:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.428+0000 7f9df2000640 1 -- 172.21.15.7:0/1510253523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec031600 con 0x7f9df40ae390 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.428+0000 7f9df2000640 1 -- 172.21.15.7:0/1510253523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0319d0 con 0x7f9df40ae390 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 -- 172.21.15.7:0/1510253523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df40ae390 msgr2=0x7f9df4160360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1510253523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df40ae390 0x7f9df4160360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9df40d1770 tx=0x7f9dec02a780 comp rx=0 tx=0).stop 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 -- 172.21.15.7:0/1510253523 shutdown_connections 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1510253523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df40ae390 0x7f9df4160360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1510253523 >> v2:172.21.15.162:3300/0 conn(0x7f9df406cf70 0x7f9df40ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 -- 172.21.15.7:0/1510253523 >> 172.21.15.7:0/1510253523 conn(0x7f9df4072020 msgr2=0x7f9df4072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 -- 172.21.15.7:0/1510253523 shutdown_connections 2024-08-19T00:37:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.429+0000 7f9df3e00640 1 -- 172.21.15.7:0/1510253523 wait complete. 2024-08-19T00:37:20.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.430+0000 7f9df3e00640 1 Processor -- start 2024-08-19T00:37:20.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.431+0000 7f9df3e00640 1 -- start start 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.431+0000 7f9df3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9df406cf70 0x7f9df4155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.431+0000 7f9df3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9df40ae390 0x7f9df4143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.431+0000 7f9df3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df4155110 0x7f9df4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.431+0000 7f9df3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9df40ae800 con 0x7f9df4155110 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.431+0000 7f9df3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9df40aeea0 con 0x7f9df40ae390 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.431+0000 7f9df3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9df40ae980 con 0x7f9df406cf70 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df4155110 0x7f9df4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df4155110 0x7f9df4158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56392/0 (socket says 172.21.15.7:56392) 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 -- 172.21.15.7:0/1236484707 learned_addr learned my addr 172.21.15.7:0/1236484707 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9debe00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9df40ae390 0x7f9df4143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df2a00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9df406cf70 0x7f9df4155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 -- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9df406cf70 msgr2=0x7f9df4155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9df406cf70 0x7f9df4155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 -- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9df40ae390 msgr2=0x7f9df4143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9df40ae390 0x7f9df4143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 -- 172.21.15.7:0/1236484707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df41440b0 con 0x7f9df4155110 2024-08-19T00:37:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.432+0000 7f9df3400640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df4155110 0x7f9df4158c50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009f40 tx=0x7f9dec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.433+0000 7f9deaa00640 1 -- 172.21.15.7:0/1236484707 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec036050 con 0x7f9df4155110 2024-08-19T00:37:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.433+0000 7f9deaa00640 1 -- 172.21.15.7:0/1236484707 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec042070 con 0x7f9df4155110 2024-08-19T00:37:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.433+0000 7f9deaa00640 1 -- 172.21.15.7:0/1236484707 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec009510 con 0x7f9df4155110 2024-08-19T00:37:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.433+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df4144370 con 0x7f9df4155110 2024-08-19T00:37:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.433+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df4144930 con 0x7f9df4155110 2024-08-19T00:37:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.434+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df40ade50 con 0x7f9df4155110 2024-08-19T00:37:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.435+0000 7f9deaa00640 1 -- 172.21.15.7:0/1236484707 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dec007bd0 con 0x7f9df4155110 2024-08-19T00:37:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.436+0000 7f9deaa00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9dd006be30 0x7f9dd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.436+0000 7f9deaa00640 1 -- 172.21.15.7:0/1236484707 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9dec0abc40 con 0x7f9df4155110 2024-08-19T00:37:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.436+0000 7f9df2a00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9dd006be30 0x7f9dd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.437+0000 7f9df2a00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9dd006be30 0x7f9dd006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9de4006fd0 tx=0x7f9de4009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.441+0000 7f9deaa00640 1 -- 172.21.15.7:0/1236484707 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9dec079f00 con 0x7f9df4155110 2024-08-19T00:37:20.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.659+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9df41613d0 con 0x7f9df4155110 2024-08-19T00:37:20.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.660+0000 7f9deaa00640 1 -- 172.21.15.7:0/1236484707 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f9dec07e200 con 0x7f9df4155110 2024-08-19T00:37:20.661 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:37:20.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9dd006be30 msgr2=0x7f9dd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9dd006be30 0x7f9dd006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9de4006fd0 tx=0x7f9de4009060 comp rx=0 tx=0).stop 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df4155110 msgr2=0x7f9df4158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df4155110 0x7f9df4158c50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009f40 tx=0x7f9dec004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 shutdown_connections 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9dd006be30 0x7f9dd006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9df4155110 0x7f9df4158c50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9df40ae390 0x7f9df4143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 --2- 172.21.15.7:0/1236484707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9df406cf70 0x7f9df4155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 >> 172.21.15.7:0/1236484707 conn(0x7f9df4072020 msgr2=0x7f9df4161ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 shutdown_connections 2024-08-19T00:37:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20.662+0000 7f9df3e00640 1 -- 172.21.15.7:0/1236484707 wait complete. 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:37:20.680 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:37:20.681 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-19T00:37:20.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:20.681 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:37:20.718 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:20.718 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:20.719 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:37:20.720 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:37:20.721 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:37:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:37:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:37:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42821sec preferred_lft 42821sec 2024-08-19T00:37:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:37:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:20.722 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:37:20.723 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:37:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:37:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:37:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:20.724 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:37:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:37:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:37:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:20.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:20.725 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:37:20.812 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:37:20.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:20.815 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:37:20.852 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:37:20.852 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:37:20.852 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:37:20.852 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:37:20.852 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:37:20.852 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:20.852 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:20.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:37:20.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:37:20.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:37:20.853 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:21.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:21.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:21.050 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:37:21.085 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:37:21.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:21.086 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-08-19T00:37:21.160 INFO:teuthology.orchestra.run.smithi007.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-19T00:37:21.161 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:21.161 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:21.161 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:37:21.161 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-19T00:37:21.161 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:21.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:21.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 92:a1:70:3d:0a:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-19T00:37:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-19T00:37:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::90a1:70ff:fe3d:ae9/64 scope link 2024-08-19T00:37:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:21.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-19T00:37:21.455 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 92:a1:70:3d:0a:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::90a1:70ff:fe3d:ae9/64 scope link 2024-08-19T00:37:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:21.458 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-19T00:37:21.458 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:21.459 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:21.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-19T00:37:21.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-19T00:37:21.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-19T00:37:21.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-19T00:37:21.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-19T00:37:21.459 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:21.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:21.676 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:21.676 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:21.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.1 up 2024-08-19T00:37:21.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.1 master ceph-brx 2024-08-19T00:37:21.676 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:21.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:21.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:21.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:21.847 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-19T00:37:21.883 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-19T00:37:21.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:21.883 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-19T00:37:21.959 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:37:21.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:21.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-19T00:37:22.087 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-19T00:37:22.087 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-08-19T00:37:22.087 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:22.102 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-19T00:37:22.102 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-08-19T00:37:22.103 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:22.103 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:22.103 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:22.125 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-19T00:37:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-08-19T00:37:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:37:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:37:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:37:22.127 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-19T00:37:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:37:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:37:22.128 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:37:22.128 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:37:22.130 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:37:22.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:22.131 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-19T00:37:22.186 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:22.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:22.278 INFO:teuthology.orchestra.run.smithi007.stdout:client4618 2024-08-19T00:37:22.278 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:22.278 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:22.315 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:22.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:22.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:22.444 INFO:teuthology.orchestra.run.smithi007.stdout:client4618 2024-08-19T00:37:22.445 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:22.535 INFO:teuthology.orchestra.run.smithi007.stdout:client4618 2024-08-19T00:37:22.535 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd35d026-e259-45a6-99d5-e8ea5afa8a60.client4618/status') 2024-08-19T00:37:22.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:22.635 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.4618 (3)172.21.15.7:0/2113522591 2024-08-19T00:37:22.635 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-08-19T00:37:22.635 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-08-19T00:37:22.635 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-08-19T00:37:22.635 INFO:teuthology.orchestra.run.smithi007.stderr:69 bytes copied, 6.0355e-05 s, 1.1 MB/s 2024-08-19T00:37:22.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:22.646 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-08-19T00:37:22.646 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:37:22.646 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-19T00:37:22.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:37:22.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.802+0000 7f2257200640 1 Processor -- start 2024-08-19T00:37:22.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.802+0000 7f2257200640 1 -- start start 2024-08-19T00:37:22.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2257200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f225006c480 0x7f22500b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:22.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2257200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006b850 0x7f225006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:22.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2257200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22500d0320 con 0x7f2250161a30 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2257200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f22500b0cf0 con 0x7f225006c480 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2257200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22500b3cf0 con 0x7f225006b850 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2247e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f225006c480 0x7f22500b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2247e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f225006c480 0x7f22500b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56400/0 (socket says 172.21.15.7:56400) 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2247e00640 1 -- 172.21.15.7:0/1149435603 learned_addr learned my addr 172.21.15.7:0/1149435603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.803+0000 7f2255200640 1 --2- 172.21.15.7:0/1149435603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006b850 0x7f225006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.804+0000 7f2247e00640 1 -- 172.21.15.7:0/1149435603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006b850 msgr2=0x7f225006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.804+0000 7f2247e00640 1 --2- 172.21.15.7:0/1149435603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006b850 0x7f225006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.804+0000 7f2247e00640 1 -- 172.21.15.7:0/1149435603 >> v1:172.21.15.162:6789/0 conn(0x7f2250161a30 legacy=0x7f22500b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.804+0000 7f2247e00640 1 -- 172.21.15.7:0/1149435603 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22500d05c0 con 0x7f225006c480 2024-08-19T00:37:22.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.804+0000 7f224f400640 1 -- 172.21.15.7:0/1149435603 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710203475 0 0) 0x7f22500d0320 con 0x7f2250161a30 2024-08-19T00:37:22.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.805+0000 7f2247e00640 1 --2- 172.21.15.7:0/1149435603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225006c480 0x7f22500b37b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2238009870 tx=0x7f223802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5310b54b0f9b247b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:22.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.805+0000 7f224f400640 1 -- 172.21.15.7:0/1149435603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238037070 con 0x7f225006c480 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.805+0000 7f224f400640 1 -- 172.21.15.7:0/1149435603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223802ae50 con 0x7f225006c480 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.805+0000 7f224f400640 1 -- 172.21.15.7:0/1149435603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238032860 con 0x7f225006c480 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 -- 172.21.15.7:0/1149435603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225006c480 msgr2=0x7f22500b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 --2- 172.21.15.7:0/1149435603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225006c480 0x7f22500b37b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2238009870 tx=0x7f223802a300 comp rx=0 tx=0).stop 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 -- 172.21.15.7:0/1149435603 shutdown_connections 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 --2- 172.21.15.7:0/1149435603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006b850 0x7f225006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 --2- 172.21.15.7:0/1149435603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225006c480 0x7f22500b37b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 -- 172.21.15.7:0/1149435603 >> 172.21.15.7:0/1149435603 conn(0x7f22500b6840 msgr2=0x7f22500b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 -- 172.21.15.7:0/1149435603 shutdown_connections 2024-08-19T00:37:22.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.806+0000 7f2257200640 1 -- 172.21.15.7:0/1149435603 wait complete. 2024-08-19T00:37:22.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.807+0000 7f2257200640 1 Processor -- start 2024-08-19T00:37:22.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.808+0000 7f2257200640 1 -- start start 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.808+0000 7f2257200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f225006b850 0x7f225009ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2257200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006c480 0x7f2250158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2257200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2250161a30 0x7f22501f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2257200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22500d0b80 con 0x7f2250161a30 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2257200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22500b0f90 con 0x7f225006b850 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2257200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2250161e10 con 0x7f225006c480 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2250161a30 0x7f22501f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2250161a30 0x7f22501f3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56406/0 (socket says 172.21.15.7:56406) 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 -- 172.21.15.7:0/3893768969 learned_addr learned my addr 172.21.15.7:0/3893768969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2247e00640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006c480 0x7f2250158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f224fe00640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f225006b850 0x7f225009ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 -- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006c480 msgr2=0x7f2250158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006c480 0x7f2250158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 -- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f225006b850 msgr2=0x7f225009ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f225006b850 0x7f225009ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.809+0000 7f2255200640 1 -- 172.21.15.7:0/3893768969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22501f4650 con 0x7f2250161a30 2024-08-19T00:37:22.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.810+0000 7f2255200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2250161a30 0x7f22501f3ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f224800efc0 tx=0x7f224800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:22.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.810+0000 7f224cc00640 1 -- 172.21.15.7:0/3893768969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248018020 con 0x7f2250161a30 2024-08-19T00:37:22.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.810+0000 7f224cc00640 1 -- 172.21.15.7:0/3893768969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2248014480 con 0x7f2250161a30 2024-08-19T00:37:22.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.810+0000 7f224cc00640 1 -- 172.21.15.7:0/3893768969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248014870 con 0x7f2250161a30 2024-08-19T00:37:22.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.810+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22501f4930 con 0x7f2250161a30 2024-08-19T00:37:22.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.810+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22500ca480 con 0x7f2250161a30 2024-08-19T00:37:22.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.811+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22501f4e50 con 0x7f2250161a30 2024-08-19T00:37:22.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.812+0000 7f224cc00640 1 -- 172.21.15.7:0/3893768969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2248005d10 con 0x7f2250161a30 2024-08-19T00:37:22.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.813+0000 7f224cc00640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f222c06be30 0x7f222c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:22.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.813+0000 7f224cc00640 1 -- 172.21.15.7:0/3893768969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f224808b890 con 0x7f2250161a30 2024-08-19T00:37:22.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.813+0000 7f224fe00640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f222c06be30 0x7f222c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:22.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.814+0000 7f224fe00640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f222c06be30 0x7f222c06e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22500cfd50 tx=0x7f2240009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:22.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:22.817+0000 7f224cc00640 1 -- 172.21.15.7:0/3893768969 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f22501f4e50 con 0x7f2250161a30 2024-08-19T00:37:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.039+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f22500b37b0 con 0x7f2250161a30 2024-08-19T00:37:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.040+0000 7f224cc00640 1 -- 172.21.15.7:0/3893768969 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f2248022070 con 0x7f2250161a30 2024-08-19T00:37:23.041 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f222c06be30 msgr2=0x7f222c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f222c06be30 0x7f222c06e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22500cfd50 tx=0x7f2240009040 comp rx=0 tx=0).stop 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2250161a30 msgr2=0x7f22501f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2250161a30 0x7f22501f3ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f224800efc0 tx=0x7f224800c490 comp rx=0 tx=0).stop 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 shutdown_connections 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f222c06be30 0x7f222c06e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2250161a30 0x7f22501f3ee0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f225006c480 0x7f2250158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 --2- 172.21.15.7:0/3893768969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f225006b850 0x7f225009ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 >> 172.21.15.7:0/3893768969 conn(0x7f22500b6840 msgr2=0x7f22500b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:23.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 shutdown_connections 2024-08-19T00:37:23.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:23.042+0000 7f2257200640 1 -- 172.21.15.7:0/3893768969 wait complete. 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:37:23.059 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-19T00:37:23.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:23.060 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-08-19T00:37:23.100 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:23.101 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:23.102 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:37:23.102 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:23.102 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-19T00:37:23.102 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42842sec preferred_lft 42842sec 2024-08-19T00:37:23.102 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-08-19T00:37:23.102 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:23.102 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-19T00:37:23.103 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:23.106 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:23.106 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2024-08-19T00:37:23.106 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2024-08-19T00:37:23.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2024-08-19T00:37:23.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-19T00:37:23.107 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:23.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:23.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:23.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:23.530 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-08-19T00:37:23.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:23.589 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-08-19T00:37:23.639 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-08-19T00:37:23.639 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:37:23.639 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-19T00:37:23.639 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-19T00:37:23.639 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:37:23.639 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:23.640 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:23.640 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-19T00:37:23.640 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-19T00:37:23.640 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-19T00:37:23.640 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:24.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:24.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:24.237 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-19T00:37:24.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:24.273 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-08-19T00:37:24.349 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:24.349 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:24.349 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:37:24.349 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-19T00:37:24.349 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:24.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:24.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:24.530 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-19T00:37:24.530 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:24.530 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:24.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-19T00:37:24.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-19T00:37:24.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-19T00:37:24.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-19T00:37:24.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-19T00:37:24.531 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:24.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:24.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:24.783 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:24.783 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:24.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-08-19T00:37:24.784 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2024-08-19T00:37:24.784 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:24.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:24.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:24.958 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-19T00:37:24.993 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-19T00:37:24.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:24.993 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-19T00:37:25.069 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:37:25.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:25.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-19T00:37:25.210 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-19T00:37:25.210 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-08-19T00:37:25.211 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-08-19T00:37:25.807 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-19T00:37:25.807 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-08-19T00:37:25.808 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-08-19T00:37:25.808 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:25.808 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:25.834 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-19T00:37:25.834 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-08-19T00:37:25.834 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-08-19T00:37:25.834 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:25.834 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:25.835 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:37:25.835 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:37:25.835 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:37:25.836 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-19T00:37:25.836 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:37:25.836 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:37:25.836 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:37:25.836 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:37:25.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:37:25.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:25.839 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-19T00:37:25.895 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:25.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:25.987 INFO:teuthology.orchestra.run.smithi162.stdout:client4593 2024-08-19T00:37:25.987 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:25.987 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:26.023 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:26.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:26.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:26.152 INFO:teuthology.orchestra.run.smithi162.stdout:client4593 2024-08-19T00:37:26.153 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:26.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:26.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:26.242 INFO:teuthology.orchestra.run.smithi162.stdout:client4593 2024-08-19T00:37:26.243 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd35d026-e259-45a6-99d5-e8ea5afa8a60.client4593/status') 2024-08-19T00:37:26.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:26.341 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4593 (3)172.21.15.162:0/2134355068 2024-08-19T00:37:26.342 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-08-19T00:37:26.342 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-08-19T00:37:26.342 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-08-19T00:37:26.342 INFO:teuthology.orchestra.run.smithi162.stderr:71 bytes copied, 5.534e-05 s, 1.3 MB/s 2024-08-19T00:37:26.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:26.353 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-08-19T00:37:26.353 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:37:26.353 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-19T00:37:26.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:37:26.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.520+0000 7fc3d3800640 1 Processor -- start 2024-08-19T00:37:26.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.520+0000 7fc3d3800640 1 -- start start 2024-08-19T00:37:26.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d3800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3cc071980 0x7fc3cc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:26.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d3800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3cc0cdfb0 con 0x7fc3cc0d03c0 2024-08-19T00:37:26.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d3800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3cc0ce290 con 0x7fc3cc06e710 2024-08-19T00:37:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d3800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc3cc0cebc0 con 0x7fc3cc071980 2024-08-19T00:37:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d0e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc3cc0d03c0 0x7fc3cc0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60072/0 (socket says 172.21.15.7:60072) 2024-08-19T00:37:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d0e00640 1 -- 172.21.15.7:0/3381956863 learned_addr learned my addr 172.21.15.7:0/3381956863 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d1800640 1 --2- 172.21.15.7:0/3381956863 >> v2:172.21.15.7:3300/0 conn(0x7fc3cc071980 0x7fc3cc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d1800640 1 -- 172.21.15.7:0/3381956863 >> v1:172.21.15.162:6789/0 conn(0x7fc3cc06e710 legacy=0x7fc3cc0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d1800640 1 -- 172.21.15.7:0/3381956863 >> v1:172.21.15.7:6789/0 conn(0x7fc3cc0d03c0 legacy=0x7fc3cc0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:26.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.522+0000 7fc3d1800640 1 -- 172.21.15.7:0/3381956863 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc0ce570 con 0x7fc3cc071980 2024-08-19T00:37:26.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.523+0000 7fc3d1800640 1 --2- 172.21.15.7:0/3381956863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc0cf050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009dc0 tx=0x7fc3c402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9b70a9af97a944 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:26.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3cb400640 1 -- 172.21.15.7:0/3381956863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4036020 con 0x7fc3cc071980 2024-08-19T00:37:26.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3cb400640 1 -- 172.21.15.7:0/3381956863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c4032800 con 0x7fc3cc071980 2024-08-19T00:37:26.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3cb400640 1 -- 172.21.15.7:0/3381956863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4032bd0 con 0x7fc3cc071980 2024-08-19T00:37:26.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3d3800640 1 -- 172.21.15.7:0/3381956863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 msgr2=0x7fc3cc0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:26.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3d3800640 1 --2- 172.21.15.7:0/3381956863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc0cf050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009dc0 tx=0x7fc3c402c940 comp rx=0 tx=0).stop 2024-08-19T00:37:26.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3d3800640 1 -- 172.21.15.7:0/3381956863 shutdown_connections 2024-08-19T00:37:26.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3d3800640 1 --2- 172.21.15.7:0/3381956863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc0cf050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:26.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3d3800640 1 -- 172.21.15.7:0/3381956863 >> 172.21.15.7:0/3381956863 conn(0x7fc3cc06bc70 msgr2=0x7fc3cc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:26.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3d3800640 1 -- 172.21.15.7:0/3381956863 shutdown_connections 2024-08-19T00:37:26.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.524+0000 7fc3d3800640 1 -- 172.21.15.7:0/3381956863 wait complete. 2024-08-19T00:37:26.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.526+0000 7fc3d3800640 1 Processor -- start 2024-08-19T00:37:26.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.526+0000 7fc3d3800640 1 -- start start 2024-08-19T00:37:26.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3d3800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3cc06e710 0x7fc3cc0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:26.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3d3800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:26.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3d3800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0d03c0 0x7fc3cc1f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:26.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3d3800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc073c60 con 0x7fc3cc071980 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3d3800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc073ae0 con 0x7fc3cc0d03c0 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3d3800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc0cf590 con 0x7fc3cc06e710 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc14cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60220/0 (socket says 172.21.15.7:60220) 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.527+0000 7fc3cbe00640 1 -- 172.21.15.7:0/2253902165 learned_addr learned my addr 172.21.15.7:0/2253902165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3d1800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0d03c0 0x7fc3cc1f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3d0e00640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3cc06e710 0x7fc3cc0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3cbe00640 1 -- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3cc06e710 msgr2=0x7fc3cc0af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3cbe00640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3cc06e710 0x7fc3cc0af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3cbe00640 1 -- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0d03c0 msgr2=0x7fc3cc1f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3cbe00640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0d03c0 0x7fc3cc1f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3cbe00640 1 -- 172.21.15.7:0/2253902165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc0cc250 con 0x7fc3cc071980 2024-08-19T00:37:26.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3d1800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0d03c0 0x7fc3cc1f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:26.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3cbe00640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc14cc50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c3c0 tx=0x7fc3b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:26.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3c8c00640 1 -- 172.21.15.7:0/2253902165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80052d0 con 0x7fc3cc071980 2024-08-19T00:37:26.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3c8c00640 1 -- 172.21.15.7:0/2253902165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b8005490 con 0x7fc3cc071980 2024-08-19T00:37:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3c8c00640 1 -- 172.21.15.7:0/2253902165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8007260 con 0x7fc3cc071980 2024-08-19T00:37:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc0cc530 con 0x7fc3cc071980 2024-08-19T00:37:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.528+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc0ae920 con 0x7fc3cc071980 2024-08-19T00:37:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.529+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc0cf050 con 0x7fc3cc071980 2024-08-19T00:37:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.530+0000 7fc3c8c00640 1 -- 172.21.15.7:0/2253902165 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3b8007400 con 0x7fc3cc071980 2024-08-19T00:37:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.531+0000 7fc3c8c00640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3ac06be30 0x7fc3ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.531+0000 7fc3c8c00640 1 -- 172.21.15.7:0/2253902165 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3b808a3b0 con 0x7fc3cc071980 2024-08-19T00:37:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.532+0000 7fc3d0e00640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3ac06be30 0x7fc3ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.532+0000 7fc3d0e00640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3ac06be30 0x7fc3ac06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005880 tx=0x7fc3c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:26.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.536+0000 7fc3c8c00640 1 -- 172.21.15.7:0/2253902165 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc3b8058cc0 con 0x7fc3cc071980 2024-08-19T00:37:26.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.757+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc3cc0b03e0 con 0x7fc3cc071980 2024-08-19T00:37:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.757+0000 7fc3c8c00640 1 -- 172.21.15.7:0/2253902165 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fc3b80585c0 con 0x7fc3cc071980 2024-08-19T00:37:26.759 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:37:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3ac06be30 msgr2=0x7fc3ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3ac06be30 0x7fc3ac06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005880 tx=0x7fc3c0009040 comp rx=0 tx=0).stop 2024-08-19T00:37:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 msgr2=0x7fc3cc14cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc14cc50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c3c0 tx=0x7fc3b800c880 comp rx=0 tx=0).stop 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 shutdown_connections 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3ac06be30 0x7fc3ac06e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0d03c0 0x7fc3cc1f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3cc071980 0x7fc3cc14cc50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 --2- 172.21.15.7:0/2253902165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3cc06e710 0x7fc3cc0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.759+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 >> 172.21.15.7:0/2253902165 conn(0x7fc3cc06bc70 msgr2=0x7fc3cc15a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.760+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 shutdown_connections 2024-08-19T00:37:26.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:26.760+0000 7fc3d3800640 1 -- 172.21.15.7:0/2253902165 wait complete. 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:37:26.777 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:37:26.778 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-19T00:37:26.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:26.778 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-08-19T00:37:26.815 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-08-19T00:37:26.816 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42839sec preferred_lft 42839sec 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether ae:ab:be:f8:ee:ee brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::d812:52ff:fe80:f4da/64 scope link 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:26.817 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:37:26.818 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether ae:ab:be:f8:ee:ee brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:37:26.818 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::acab:beff:fef8:eeee/64 scope link 2024-08-19T00:37:26.818 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:26.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:26.818 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:37:26.911 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-08-19T00:37:26.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:26.914 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-08-19T00:37:26.951 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-08-19T00:37:26.951 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:37:26.951 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-19T00:37:26.951 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-19T00:37:26.951 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:37:26.952 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:26.952 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:26.952 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-19T00:37:26.952 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-19T00:37:26.952 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-19T00:37:26.952 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:27.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:27.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:27.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:27.149 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-19T00:37:27.184 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-19T00:37:27.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:27.185 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-08-19T00:37:27.259 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-19T00:37:27.260 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:27.261 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:27.261 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-19T00:37:27.261 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-19T00:37:27.261 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:27.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:27.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:27.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:27.441 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-19T00:37:27.496 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether f2:d4:5a:89:f7:4c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::f0d4:5aff:fe89:f74c/64 scope link 2024-08-19T00:37:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:27.500 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:37:27.555 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether f2:d4:5a:89:f7:4c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-19T00:37:27.556 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-19T00:37:27.556 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.556 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::f0d4:5aff:fe89:f74c/64 scope link 2024-08-19T00:37:27.556 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:27.558 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-19T00:37:27.558 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:27.558 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:27.558 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-19T00:37:27.558 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-19T00:37:27.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-19T00:37:27.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-19T00:37:27.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-19T00:37:27.559 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:27.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:27.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:27.774 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:27.775 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-19T00:37:27.775 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2024-08-19T00:37:27.775 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2024-08-19T00:37:27.775 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-19T00:37:27.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:27.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:27.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:27.942 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-19T00:37:27.977 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-19T00:37:27.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:27.978 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-19T00:37:28.052 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:37:28.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:28.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-19T00:37:28.182 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-19T00:37:28.182 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-08-19T00:37:28.182 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-08-19T00:37:28.198 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-19T00:37:28.198 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-08-19T00:37:28.198 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-08-19T00:37:28.198 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:28.198 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:28.220 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-19T00:37:28.220 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-08-19T00:37:28.220 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-08-19T00:37:28.220 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:28.220 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:28.220 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:37:28.220 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:37:28.221 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:37:28.223 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-19T00:37:28.223 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:37:28.223 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:37:28.223 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:37:28.223 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:37:28.226 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:37:28.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:28.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-19T00:37:28.282 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:28.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:28.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:28.372 INFO:teuthology.orchestra.run.smithi162.stdout:client4460 2024-08-19T00:37:28.372 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:28.372 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:28.408 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:28.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:28.537 INFO:teuthology.orchestra.run.smithi162.stdout:client4460 2024-08-19T00:37:28.537 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:28.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:28.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:28.627 INFO:teuthology.orchestra.run.smithi162.stdout:client4460 2024-08-19T00:37:28.627 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd35d026-e259-45a6-99d5-e8ea5afa8a60.client4460/status') 2024-08-19T00:37:28.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:28.726 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4460 (3)192.168.0.2:0/2497379717 2024-08-19T00:37:28.726 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-08-19T00:37:28.727 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-08-19T00:37:28.727 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-08-19T00:37:28.727 INFO:teuthology.orchestra.run.smithi162.stderr:69 bytes copied, 7.142e-05 s, 966 kB/s 2024-08-19T00:37:28.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-19T00:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:28.738 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-19T00:37:28.801 INFO:tasks.cephfs_test_runner:Starting test: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:37:28.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.968+0000 7f6da5c00640 1 Processor -- start 2024-08-19T00:37:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.968+0000 7f6da5c00640 1 -- start start 2024-08-19T00:37:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6da5c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6da5c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6da009b730 0x7f6da006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6da5c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6da0161f20 0x7f6da01623d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6da5c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6da009b390 con 0x7f6da0161f20 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6da5c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6da015ec30 con 0x7f6da009b730 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6da5c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6da015ef10 con 0x7f6da009aa70 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6d9f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6da0161f20 0x7f6da01623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6d9f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6da0161f20 0x7f6da01623d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60232/0 (socket says 172.21.15.7:60232) 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6d9f400640 1 -- 172.21.15.7:0/4039449073 learned_addr learned my addr 172.21.15.7:0/4039449073 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6d9ea00640 1 --2- 172.21.15.7:0/4039449073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.969+0000 7f6d97e00640 1 --2- 172.21.15.7:0/4039449073 >> v2:172.21.15.162:3300/0 conn(0x7f6da009b730 0x7f6da006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.970+0000 7f6d9f400640 1 -- 172.21.15.7:0/4039449073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 msgr2=0x7f6da009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.970+0000 7f6d9f400640 1 --2- 172.21.15.7:0/4039449073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da009ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.970+0000 7f6d9f400640 1 -- 172.21.15.7:0/4039449073 >> v2:172.21.15.162:3300/0 conn(0x7f6da009b730 msgr2=0x7f6da006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.970+0000 7f6d9f400640 1 --2- 172.21.15.7:0/4039449073 >> v2:172.21.15.162:3300/0 conn(0x7f6da009b730 0x7f6da006fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.970+0000 7f6d9f400640 1 -- 172.21.15.7:0/4039449073 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da015f1f0 con 0x7f6da0161f20 2024-08-19T00:37:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.970+0000 7f6d9ea00640 1 --2- 172.21.15.7:0/4039449073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.971+0000 7f6d9f400640 1 --2- 172.21.15.7:0/4039449073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da01623d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009e50 tx=0x7f6d9802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5306ea6f09f7ecd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.971+0000 7f6d9e000640 1 -- 172.21.15.7:0/4039449073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98036070 con 0x7f6da0161f20 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.971+0000 7f6d9e000640 1 -- 172.21.15.7:0/4039449073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d98031600 con 0x7f6da0161f20 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.971+0000 7f6d9e000640 1 -- 172.21.15.7:0/4039449073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980319d0 con 0x7f6da0161f20 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.971+0000 7f6da5c00640 1 -- 172.21.15.7:0/4039449073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 msgr2=0x7f6da01623d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.971+0000 7f6da5c00640 1 --2- 172.21.15.7:0/4039449073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da01623d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009e50 tx=0x7f6d9802a6c0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.972+0000 7f6da5c00640 1 -- 172.21.15.7:0/4039449073 shutdown_connections 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.972+0000 7f6da5c00640 1 --2- 172.21.15.7:0/4039449073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da01623d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.972+0000 7f6da5c00640 1 --2- 172.21.15.7:0/4039449073 >> v2:172.21.15.162:3300/0 conn(0x7f6da009b730 0x7f6da006fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.972+0000 7f6da5c00640 1 --2- 172.21.15.7:0/4039449073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.972+0000 7f6da5c00640 1 -- 172.21.15.7:0/4039449073 >> 172.21.15.7:0/4039449073 conn(0x7f6da00d2190 msgr2=0x7f6da00d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:28.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.972+0000 7f6da5c00640 1 -- 172.21.15.7:0/4039449073 shutdown_connections 2024-08-19T00:37:28.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.972+0000 7f6da5c00640 1 -- 172.21.15.7:0/4039449073 wait complete. 2024-08-19T00:37:28.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.973+0000 7f6da5c00640 1 Processor -- start 2024-08-19T00:37:28.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.973+0000 7f6da5c00640 1 -- start start 2024-08-19T00:37:28.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.974+0000 7f6da5c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:28.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.974+0000 7f6da5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6da009b730 0x7f6da015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.974+0000 7f6da5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da00b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.974+0000 7f6da5c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6da015e8f0 con 0x7f6da0161f20 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.974+0000 7f6da5c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0070170 con 0x7f6da009b730 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.974+0000 7f6da5c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6da0162910 con 0x7f6da009aa70 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da00b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d97e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6da009b730 0x7f6da015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da01596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52012/0 (socket says 172.21.15.7:52012) 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da00b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60242/0 (socket says 172.21.15.7:60242) 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9ea00640 1 -- 172.21.15.7:0/2487406545 learned_addr learned my addr 172.21.15.7:0/2487406545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9f400640 1 -- 172.21.15.7:0/2487406545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 msgr2=0x7f6da01596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9f400640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da01596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9f400640 1 -- 172.21.15.7:0/2487406545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6da009b730 msgr2=0x7f6da015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9f400640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6da009b730 0x7f6da015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d9f400640 1 -- 172.21.15.7:0/2487406545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da015ce30 con 0x7f6da0161f20 2024-08-19T00:37:28.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.975+0000 7f6d97e00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6da009b730 0x7f6da015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.976+0000 7f6d9f400640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da00b6cf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6da0072ea0 tx=0x7f6d98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.976+0000 7f6d96a00640 1 -- 172.21.15.7:0/2487406545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98041020 con 0x7f6da0161f20 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.976+0000 7f6d96a00640 1 -- 172.21.15.7:0/2487406545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d980077a0 con 0x7f6da0161f20 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.976+0000 7f6d96a00640 1 -- 172.21.15.7:0/2487406545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98036040 con 0x7f6da0161f20 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.976+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da015d420 con 0x7f6da0161f20 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.976+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da00b64f0 con 0x7f6da0161f20 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.977+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da0162b80 con 0x7f6da0161f20 2024-08-19T00:37:28.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.978+0000 7f6d96a00640 1 -- 172.21.15.7:0/2487406545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d98044020 con 0x7f6da0161f20 2024-08-19T00:37:28.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.979+0000 7f6d96a00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6d7c06be30 0x7f6d7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:28.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.979+0000 7f6d96a00640 1 -- 172.21.15.7:0/2487406545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6d980ab990 con 0x7f6da0161f20 2024-08-19T00:37:28.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.979+0000 7f6d9ea00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6d7c06be30 0x7f6d7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.980+0000 7f6d9ea00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6d7c06be30 0x7f6d7c06e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6da00b1fb0 tx=0x7f6d90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:28.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:28.983+0000 7f6d96a00640 1 -- 172.21.15.7:0/2487406545 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6d9804b030 con 0x7f6da0161f20 2024-08-19T00:37:29.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.167+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6da0161d00 con 0x7f6da0161f20 2024-08-19T00:37:29.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.168+0000 7f6d96a00640 1 -- 172.21.15.7:0/2487406545 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16573 (secure 0 0 0) 0x7f6d98079c50 con 0x7f6da0161f20 2024-08-19T00:37:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:29.170 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:04.356113+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:29.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6d7c06be30 msgr2=0x7f6d7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6d7c06be30 0x7f6d7c06e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6da00b1fb0 tx=0x7f6d90008040 comp rx=0 tx=0).stop 2024-08-19T00:37:29.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 msgr2=0x7f6da00b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da00b6cf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6da0072ea0 tx=0x7f6d98004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:29.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 shutdown_connections 2024-08-19T00:37:29.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6d7c06be30 0x7f6d7c06e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da0161f20 0x7f6da00b6cf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6da009b730 0x7f6da015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 --2- 172.21.15.7:0/2487406545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6da009aa70 0x7f6da01596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 >> 172.21.15.7:0/2487406545 conn(0x7f6da00d2190 msgr2=0x7f6da006c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:29.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 shutdown_connections 2024-08-19T00:37:29.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.170+0000 7f6da5c00640 1 -- 172.21.15.7:0/2487406545 wait complete. 2024-08-19T00:37:29.189 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:36:51.315746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-19T00:37:00.464439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-19T00:37:01.775398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:37:29.189 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T00:37:29.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.347+0000 7fb418600640 1 Processor -- start 2024-08-19T00:37:29.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.348+0000 7fb418600640 1 -- start start 2024-08-19T00:37:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb418600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb41015bfb0 0x7fb4100b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb418600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb4100aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb418600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb41015c390 0x7fb4100af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb418600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb4100af650 con 0x7fb41015bfb0 2024-08-19T00:37:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb418600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb4100ad790 con 0x7fb41015c390 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb418600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4100acef0 con 0x7fb4100b5130 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb415c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb41015bfb0 0x7fb4100b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb415c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb41015bfb0 0x7fb4100b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60254/0 (socket says 172.21.15.7:60254) 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb415c00640 1 -- 172.21.15.7:0/2237932427 learned_addr learned my addr 172.21.15.7:0/2237932427 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb416600640 1 --2- 172.21.15.7:0/2237932427 >> v2:172.21.15.162:3300/0 conn(0x7fb41015c390 0x7fb4100af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.349+0000 7fb415200640 1 --2- 172.21.15.7:0/2237932427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb4100aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.350+0000 7fb415c00640 1 -- 172.21.15.7:0/2237932427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 msgr2=0x7fb4100aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.350+0000 7fb415c00640 1 --2- 172.21.15.7:0/2237932427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb4100aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.350+0000 7fb415c00640 1 -- 172.21.15.7:0/2237932427 >> v2:172.21.15.162:3300/0 conn(0x7fb41015c390 msgr2=0x7fb4100af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.350+0000 7fb415c00640 1 --2- 172.21.15.7:0/2237932427 >> v2:172.21.15.162:3300/0 conn(0x7fb41015c390 0x7fb4100af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.350+0000 7fb415c00640 1 -- 172.21.15.7:0/2237932427 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4100ad1d0 con 0x7fb41015bfb0 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.350+0000 7fb415200640 1 --2- 172.21.15.7:0/2237932427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb4100aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:29.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.350+0000 7fb416600640 1 --2- 172.21.15.7:0/2237932427 >> v2:172.21.15.162:3300/0 conn(0x7fb41015c390 0x7fb4100af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb415c00640 1 --2- 172.21.15.7:0/2237932427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb4100b3e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb4100ae640 tx=0x7fb40402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9ebf12c1aab5f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb40fe00640 1 -- 172.21.15.7:0/2237932427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404037070 con 0x7fb41015bfb0 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb40fe00640 1 -- 172.21.15.7:0/2237932427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb404032440 con 0x7fb41015bfb0 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb40fe00640 1 -- 172.21.15.7:0/2237932427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404032810 con 0x7fb41015bfb0 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb418600640 1 -- 172.21.15.7:0/2237932427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 msgr2=0x7fb4100b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb418600640 1 --2- 172.21.15.7:0/2237932427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb4100b3e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb4100ae640 tx=0x7fb40402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb418600640 1 -- 172.21.15.7:0/2237932427 shutdown_connections 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb418600640 1 --2- 172.21.15.7:0/2237932427 >> v2:172.21.15.162:3300/0 conn(0x7fb41015c390 0x7fb4100af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb418600640 1 --2- 172.21.15.7:0/2237932427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb4100aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb418600640 1 --2- 172.21.15.7:0/2237932427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb4100b3e00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.351+0000 7fb418600640 1 -- 172.21.15.7:0/2237932427 >> 172.21.15.7:0/2237932427 conn(0x7fb4100b2300 msgr2=0x7fb41006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:29.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.352+0000 7fb418600640 1 -- 172.21.15.7:0/2237932427 shutdown_connections 2024-08-19T00:37:29.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.352+0000 7fb418600640 1 -- 172.21.15.7:0/2237932427 wait complete. 2024-08-19T00:37:29.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.353+0000 7fb418600640 1 Processor -- start 2024-08-19T00:37:29.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.353+0000 7fb418600640 1 -- start start 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb418600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb41014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb418600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb410152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb418600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41015c390 0x7fb410153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb418600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4100b4340 con 0x7fb41015bfb0 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb418600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb410071b20 con 0x7fb41015c390 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb418600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4100b44c0 con 0x7fb4100b5130 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb415200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb410152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb415200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb410152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60256/0 (socket says 172.21.15.7:60256) 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb415200640 1 -- 172.21.15.7:0/2239475490 learned_addr learned my addr 172.21.15.7:0/2239475490 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb416600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41015c390 0x7fb410153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.354+0000 7fb415c00640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb41014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb415200640 1 -- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 msgr2=0x7fb41014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb415200640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb41014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb415200640 1 -- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41015c390 msgr2=0x7fb410153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb415200640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41015c390 0x7fb410153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb415200640 1 -- 172.21.15.7:0/2239475490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41009b250 con 0x7fb41015bfb0 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb415200640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb410152750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00e810 tx=0x7fb3fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb40d600640 1 -- 172.21.15.7:0/2239475490 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00f040 con 0x7fb41015bfb0 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb40d600640 1 -- 172.21.15.7:0/2239475490 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc004030 con 0x7fb41015bfb0 2024-08-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb40d600640 1 -- 172.21.15.7:0/2239475490 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc004400 con 0x7fb41015bfb0 2024-08-19T00:37:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.355+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41009b530 con 0x7fb41015bfb0 2024-08-19T00:37:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.356+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41009baf0 con 0x7fb41015bfb0 2024-08-19T00:37:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.357+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4100b3e00 con 0x7fb41015bfb0 2024-08-19T00:37:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.357+0000 7fb40d600640 1 -- 172.21.15.7:0/2239475490 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3fc00c6d0 con 0x7fb41015bfb0 2024-08-19T00:37:29.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.358+0000 7fb40d600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb3f006be60 0x7fb3f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.358+0000 7fb40d600640 1 -- 172.21.15.7:0/2239475490 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb3fc08aab0 con 0x7fb41015bfb0 2024-08-19T00:37:29.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.359+0000 7fb415c00640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb3f006be60 0x7fb3f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.359+0000 7fb415c00640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb3f006be60 0x7fb3f006e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb404034000 tx=0x7fb40402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:29.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.362+0000 7fb40d600640 1 -- 172.21.15.7:0/2239475490 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb3fc017020 con 0x7fb41015bfb0 2024-08-19T00:37:29.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.545+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb41015f0f0 con 0x7fb41015bfb0 2024-08-19T00:37:29.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.545+0000 7fb40d600640 1 -- 172.21.15.7:0/2239475490 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fb3fc058d70 con 0x7fb41015bfb0 2024-08-19T00:37:29.547 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-08-19T00:37:29.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.547+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb3f006be60 msgr2=0x7fb3f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.547+0000 7fb418600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb3f006be60 0x7fb3f006e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb404034000 tx=0x7fb40402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.547+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 msgr2=0x7fb410152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.547+0000 7fb418600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb410152750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00e810 tx=0x7fb3fc00ecd0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 shutdown_connections 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb3f006be60 0x7fb3f006e320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41015c390 0x7fb410153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb41015bfb0 0x7fb410152750 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 --2- 172.21.15.7:0/2239475490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4100b5130 0x7fb41014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 >> 172.21.15.7:0/2239475490 conn(0x7fb4100b2300 msgr2=0x7fb41015c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 shutdown_connections 2024-08-19T00:37:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.548+0000 7fb418600640 1 -- 172.21.15.7:0/2239475490 wait complete. 2024-08-19T00:37:29.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-19T00:37:29.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.722+0000 7fd333e00640 1 Processor -- start 2024-08-19T00:37:29.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.723+0000 7fd333e00640 1 -- start start 2024-08-19T00:37:29.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd333e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd32c0aed00 0x7fd32c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd333e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd333e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd32c0b3450 0x7fd32c06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd333e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c15e720 con 0x7fd32c0b3450 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd333e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c0b3c00 con 0x7fd32c0aed00 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd333e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c072450 con 0x7fd32c06f720 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd331e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd32c0b3450 0x7fd32c06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd331e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd32c0b3450 0x7fd32c06deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60258/0 (socket says 172.21.15.7:60258) 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd331e00640 1 -- 172.21.15.7:0/1238987292 learned_addr learned my addr 172.21.15.7:0/1238987292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd331400640 1 --2- 172.21.15.7:0/1238987292 >> v2:172.21.15.162:3300/0 conn(0x7fd32c0aed00 0x7fd32c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.724+0000 7fd330a00640 1 --2- 172.21.15.7:0/1238987292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.725+0000 7fd331e00640 1 -- 172.21.15.7:0/1238987292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 msgr2=0x7fd32c0b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:29.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.725+0000 7fd331e00640 1 --2- 172.21.15.7:0/1238987292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c0b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.725+0000 7fd331e00640 1 -- 172.21.15.7:0/1238987292 >> v2:172.21.15.162:3300/0 conn(0x7fd32c0aed00 msgr2=0x7fd32c06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:29.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.725+0000 7fd331e00640 1 --2- 172.21.15.7:0/1238987292 >> v2:172.21.15.162:3300/0 conn(0x7fd32c0aed00 0x7fd32c06f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.725+0000 7fd331e00640 1 -- 172.21.15.7:0/1238987292 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c072730 con 0x7fd32c0b3450 2024-08-19T00:37:29.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.725+0000 7fd331400640 1 --2- 172.21.15.7:0/1238987292 >> v2:172.21.15.162:3300/0 conn(0x7fd32c0aed00 0x7fd32c06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.726+0000 7fd331e00640 1 --2- 172.21.15.7:0/1238987292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c06deb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0b2ca0 tx=0x7fd32402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542dd45948ea8b51 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.726+0000 7fd32be00640 1 -- 172.21.15.7:0/1238987292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324036070 con 0x7fd32c0b3450 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.726+0000 7fd32be00640 1 -- 172.21.15.7:0/1238987292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd324031600 con 0x7fd32c0b3450 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.726+0000 7fd32be00640 1 -- 172.21.15.7:0/1238987292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240319d0 con 0x7fd32c0b3450 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 -- 172.21.15.7:0/1238987292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 msgr2=0x7fd32c06deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 --2- 172.21.15.7:0/1238987292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c06deb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0b2ca0 tx=0x7fd32402a570 comp rx=0 tx=0).stop 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 -- 172.21.15.7:0/1238987292 shutdown_connections 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 --2- 172.21.15.7:0/1238987292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c06deb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 --2- 172.21.15.7:0/1238987292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c0b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 --2- 172.21.15.7:0/1238987292 >> v2:172.21.15.162:3300/0 conn(0x7fd32c0aed00 0x7fd32c06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 -- 172.21.15.7:0/1238987292 >> 172.21.15.7:0/1238987292 conn(0x7fd32c0b2300 msgr2=0x7fd32c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:29.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 -- 172.21.15.7:0/1238987292 shutdown_connections 2024-08-19T00:37:29.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.727+0000 7fd333e00640 1 -- 172.21.15.7:0/1238987292 wait complete. 2024-08-19T00:37:29.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.728+0000 7fd333e00640 1 Processor -- start 2024-08-19T00:37:29.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.728+0000 7fd333e00640 1 -- start start 2024-08-19T00:37:29.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.729+0000 7fd333e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c1e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.729+0000 7fd333e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd32c0aed00 0x7fd32c148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.729+0000 7fd333e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c1e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.729+0000 7fd333e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c06e3f0 con 0x7fd32c0b3450 2024-08-19T00:37:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.729+0000 7fd333e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c072cf0 con 0x7fd32c0aed00 2024-08-19T00:37:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.729+0000 7fd333e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c06e570 con 0x7fd32c06f720 2024-08-19T00:37:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c1e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c1e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60270/0 (socket says 172.21.15.7:60270) 2024-08-19T00:37:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 -- 172.21.15.7:0/3603422718 learned_addr learned my addr 172.21.15.7:0/3603422718 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd330a00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd32c0aed00 0x7fd32c148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331400640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c1e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 -- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 msgr2=0x7fd32c1e6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c1e6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 -- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd32c0aed00 msgr2=0x7fd32c148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd32c0aed00 0x7fd32c148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 -- 172.21.15.7:0/3603422718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c148c00 con 0x7fd32c0b3450 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.730+0000 7fd331e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c1e9480 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd324009f40 tx=0x7fd324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:29.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.731+0000 7fd329600640 1 -- 172.21.15.7:0/3603422718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324036050 con 0x7fd32c0b3450 2024-08-19T00:37:29.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.731+0000 7fd329600640 1 -- 172.21.15.7:0/3603422718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd324042070 con 0x7fd32c0b3450 2024-08-19T00:37:29.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.731+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c148ee0 con 0x7fd32c0b3450 2024-08-19T00:37:29.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.731+0000 7fd329600640 1 -- 172.21.15.7:0/3603422718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324009510 con 0x7fd32c0b3450 2024-08-19T00:37:29.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.731+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c1494a0 con 0x7fd32c0b3450 2024-08-19T00:37:29.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.732+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c09ded0 con 0x7fd32c0b3450 2024-08-19T00:37:29.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.733+0000 7fd329600640 1 -- 172.21.15.7:0/3603422718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd324007bd0 con 0x7fd32c0b3450 2024-08-19T00:37:29.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.734+0000 7fd329600640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd30c06be30 0x7fd30c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:29.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.734+0000 7fd329600640 1 -- 172.21.15.7:0/3603422718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd3240abb80 con 0x7fd32c0b3450 2024-08-19T00:37:29.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.734+0000 7fd331400640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd30c06be30 0x7fd30c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:29.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.735+0000 7fd331400640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd30c06be30 0x7fd30c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd320006fd0 tx=0x7fd320008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:29.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.738+0000 7fd329600640 1 -- 172.21.15.7:0/3603422718 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd32c09ded0 con 0x7fd32c0b3450 2024-08-19T00:37:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.919+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd32c06f190 con 0x7fd32c0b3450 2024-08-19T00:37:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.920+0000 7fd329600640 1 -- 172.21.15.7:0/3603422718 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fd324079ed0 con 0x7fd32c0b3450 2024-08-19T00:37:29.921 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-08-19T00:37:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd30c06be30 msgr2=0x7fd30c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd30c06be30 0x7fd30c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd320006fd0 tx=0x7fd320008040 comp rx=0 tx=0).stop 2024-08-19T00:37:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 msgr2=0x7fd32c1e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c1e9480 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd324009f40 tx=0x7fd324004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 shutdown_connections 2024-08-19T00:37:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd30c06be30 0x7fd30c06e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32c0b3450 0x7fd32c1e9480 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd32c0aed00 0x7fd32c148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 --2- 172.21.15.7:0/3603422718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd32c06f720 0x7fd32c1e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 >> 172.21.15.7:0/3603422718 conn(0x7fd32c0b2300 msgr2=0x7fd32c09ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 shutdown_connections 2024-08-19T00:37:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:29.922+0000 7fd333e00640 1 -- 172.21.15.7:0/3603422718 wait complete. 2024-08-19T00:37:29.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-19T00:37:30.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.097+0000 7fe777200640 1 Processor -- start 2024-08-19T00:37:30.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.097+0000 7fe777200640 1 -- start start 2024-08-19T00:37:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.098+0000 7fe777200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780d27b0 0x7fe7780d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.098+0000 7fe777200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7780d3110 con 0x7fe7780b4150 2024-08-19T00:37:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.098+0000 7fe777200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7780b4df0 con 0x7fe77815e3e0 2024-08-19T00:37:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.098+0000 7fe777200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7780b50d0 con 0x7fe7780d27b0 2024-08-19T00:37:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe776800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe7780b4150 0x7fe7780b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60074/0 (socket says 172.21.15.7:60074) 2024-08-19T00:37:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe776800640 1 -- 172.21.15.7:0/1882103792 learned_addr learned my addr 172.21.15.7:0/1882103792 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe775e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe77815e3e0 0x7fe7780b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:52374/0 (socket says 172.21.15.7:52374) 2024-08-19T00:37:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe775400640 1 --2- 172.21.15.7:0/1882103792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780d27b0 0x7fe7780d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe774a00640 1 -- 172.21.15.7:0/1882103792 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798129760 0 0) 0x7fe7780b4df0 con 0x7fe77815e3e0 2024-08-19T00:37:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe774a00640 1 -- 172.21.15.7:0/1882103792 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe75c003520 con 0x7fe77815e3e0 2024-08-19T00:37:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe774a00640 1 -- 172.21.15.7:0/1882103792 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383428261 0 0) 0x7fe7780d3110 con 0x7fe7780b4150 2024-08-19T00:37:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe774a00640 1 -- 172.21.15.7:0/1882103792 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7780b4df0 con 0x7fe7780b4150 2024-08-19T00:37:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe775400640 1 -- 172.21.15.7:0/1882103792 >> v1:172.21.15.162:6789/0 conn(0x7fe77815e3e0 legacy=0x7fe7780b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe775400640 1 -- 172.21.15.7:0/1882103792 >> v1:172.21.15.7:6789/0 conn(0x7fe7780b4150 legacy=0x7fe7780b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.099+0000 7fe775400640 1 -- 172.21.15.7:0/1882103792 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7780cf1e0 con 0x7fe7780d27b0 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.100+0000 7fe775400640 1 --2- 172.21.15.7:0/1882103792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780d27b0 0x7fe7780d2bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7640097d0 tx=0x7fe76402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc54033b6df33011 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe774a00640 1 -- 172.21.15.7:0/1882103792 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764037070 con 0x7fe7780d27b0 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe774a00640 1 -- 172.21.15.7:0/1882103792 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe764032440 con 0x7fe7780d27b0 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe774a00640 1 -- 172.21.15.7:0/1882103792 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764032810 con 0x7fe7780d27b0 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe777200640 1 -- 172.21.15.7:0/1882103792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780d27b0 msgr2=0x7fe7780d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe777200640 1 --2- 172.21.15.7:0/1882103792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780d27b0 0x7fe7780d2bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7640097d0 tx=0x7fe76402a210 comp rx=0 tx=0).stop 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe777200640 1 -- 172.21.15.7:0/1882103792 shutdown_connections 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe777200640 1 --2- 172.21.15.7:0/1882103792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780d27b0 0x7fe7780d2bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe777200640 1 -- 172.21.15.7:0/1882103792 >> 172.21.15.7:0/1882103792 conn(0x7fe77808dbe0 msgr2=0x7fe77809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe777200640 1 -- 172.21.15.7:0/1882103792 shutdown_connections 2024-08-19T00:37:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.101+0000 7fe777200640 1 -- 172.21.15.7:0/1882103792 wait complete. 2024-08-19T00:37:30.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.103+0000 7fe777200640 1 Processor -- start 2024-08-19T00:37:30.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.103+0000 7fe777200640 1 -- start start 2024-08-19T00:37:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe777200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780b4150 0x7fe7780b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe777200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7780d27b0 0x7fe7780cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe777200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe77815e3e0 0x7fe7780cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe777200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe7780cf9e0 con 0x7fe77815e3e0 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe777200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7780cee90 con 0x7fe7780d27b0 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe777200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7780cfb60 con 0x7fe7780b4150 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe776800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe77815e3e0 0x7fe7780cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe776800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe77815e3e0 0x7fe7780cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60284/0 (socket says 172.21.15.7:60284) 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.104+0000 7fe776800640 1 -- 172.21.15.7:0/3537857253 learned_addr learned my addr 172.21.15.7:0/3537857253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe775e00640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780b4150 0x7fe7780b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe775400640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7780d27b0 0x7fe7780cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe776800640 1 -- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780b4150 msgr2=0x7fe7780b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe776800640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780b4150 0x7fe7780b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe776800640 1 -- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7780d27b0 msgr2=0x7fe7780cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe776800640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7780d27b0 0x7fe7780cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe776800640 1 -- 172.21.15.7:0/3537857253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7780b8840 con 0x7fe77815e3e0 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe775400640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7780d27b0 0x7fe7780cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe776800640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe77815e3e0 0x7fe7780cdfb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe77000cb40 tx=0x7fe77000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe76e000640 1 -- 172.21.15.7:0/3537857253 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770017070 con 0x7fe77815e3e0 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe76e000640 1 -- 172.21.15.7:0/3537857253 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77000aca0 con 0x7fe77815e3e0 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe76e000640 1 -- 172.21.15.7:0/3537857253 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770012620 con 0x7fe77815e3e0 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.105+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7780b8b20 con 0x7fe77815e3e0 2024-08-19T00:37:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.106+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7780ce4f0 con 0x7fe77815e3e0 2024-08-19T00:37:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.106+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7780cd8a0 con 0x7fe77815e3e0 2024-08-19T00:37:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.108+0000 7fe76e000640 1 -- 172.21.15.7:0/3537857253 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe77001a070 con 0x7fe77815e3e0 2024-08-19T00:37:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.108+0000 7fe76e000640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe75806be30 0x7fe75806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.108+0000 7fe76e000640 1 -- 172.21.15.7:0/3537857253 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe77008ace0 con 0x7fe77815e3e0 2024-08-19T00:37:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.109+0000 7fe775e00640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe75806be30 0x7fe75806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.109+0000 7fe775e00640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe75806be30 0x7fe75806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7680011e0 tx=0x7fe768007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.113+0000 7fe76e000640 1 -- 172.21.15.7:0/3537857253 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe770059680 con 0x7fe77815e3e0 2024-08-19T00:37:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.298+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe7780d2bd0 con 0x7fe77815e3e0 2024-08-19T00:37:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.298+0000 7fe76e000640 1 -- 172.21.15.7:0/3537857253 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fe770058f80 con 0x7fe77815e3e0 2024-08-19T00:37:30.300 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-08-19T00:37:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe75806be30 msgr2=0x7fe75806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe75806be30 0x7fe75806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7680011e0 tx=0x7fe768007b70 comp rx=0 tx=0).stop 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe77815e3e0 msgr2=0x7fe7780cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe77815e3e0 0x7fe7780cdfb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe77000cb40 tx=0x7fe77000a060 comp rx=0 tx=0).stop 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 shutdown_connections 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe75806be30 0x7fe75806e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe77815e3e0 0x7fe7780cdfb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7780d27b0 0x7fe7780cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 --2- 172.21.15.7:0/3537857253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7780b4150 0x7fe7780b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 >> 172.21.15.7:0/3537857253 conn(0x7fe77808dbe0 msgr2=0x7fe7780b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 shutdown_connections 2024-08-19T00:37:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.301+0000 7fe777200640 1 -- 172.21.15.7:0/3537857253 wait complete. 2024-08-19T00:37:30.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry' 2024-08-19T00:37:30.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.474+0000 7f32bb200640 1 Processor -- start 2024-08-19T00:37:30.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.474+0000 7f32bb200640 1 -- start start 2024-08-19T00:37:30.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.475+0000 7f32bb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e360 0x7f32b415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.475+0000 7f32bb200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f32b40d2af0 0x7f32b40d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.475+0000 7f32bb200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b40b3ab0 con 0x7f32b415e740 2024-08-19T00:37:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.475+0000 7f32bb200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40d3490 con 0x7f32b40d2af0 2024-08-19T00:37:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.475+0000 7f32bb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b415f460 con 0x7f32b415e360 2024-08-19T00:37:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32ba800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f32b415e740 0x7f32b415ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60076/0 (socket says 172.21.15.7:60076) 2024-08-19T00:37:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32ba800640 1 -- 172.21.15.7:0/35889366 learned_addr learned my addr 172.21.15.7:0/35889366 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b9e00640 1 --2- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e360 0x7f32b415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b9400640 1 --2- 172.21.15.7:0/35889366 >> v2:172.21.15.162:3300/0 conn(0x7f32b40d2af0 0x7f32b40d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b8a00640 1 -- 172.21.15.7:0/35889366 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821528799 0 0) 0x7f32b40b3ab0 con 0x7f32b415e740 2024-08-19T00:37:30.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b8a00640 1 -- 172.21.15.7:0/35889366 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f329c003520 con 0x7f32b415e740 2024-08-19T00:37:30.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b9400640 1 -- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e360 msgr2=0x7f32b415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:30.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b9400640 1 --2- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e360 0x7f32b415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b9400640 1 -- 172.21.15.7:0/35889366 >> v1:172.21.15.7:6789/0 conn(0x7f32b415e740 legacy=0x7f32b415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b9400640 1 -- 172.21.15.7:0/35889366 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b415f740 con 0x7f32b40d2af0 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.476+0000 7f32b9e00640 1 --2- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e360 0x7f32b415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.477+0000 7f32b9400640 1 --2- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 0x7f32b40d2f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32a40097a0 tx=0x7f32a402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e469c00c23fb720 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32b8a00640 1 -- 172.21.15.7:0/35889366 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4037070 con 0x7f32b40d2af0 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32b8a00640 1 -- 172.21.15.7:0/35889366 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a4032440 con 0x7f32b40d2af0 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32b8a00640 1 -- 172.21.15.7:0/35889366 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4032810 con 0x7f32b40d2af0 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 -- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 msgr2=0x7f32b40d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 --2- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 0x7f32b40d2f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32a40097a0 tx=0x7f32a402a180 comp rx=0 tx=0).stop 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 -- 172.21.15.7:0/35889366 shutdown_connections 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 --2- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 0x7f32b40d2f50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 --2- 172.21.15.7:0/35889366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e360 0x7f32b415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 -- 172.21.15.7:0/35889366 >> 172.21.15.7:0/35889366 conn(0x7f32b408dbf0 msgr2=0x7f32b409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:30.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 -- 172.21.15.7:0/35889366 shutdown_connections 2024-08-19T00:37:30.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.478+0000 7f32bb200640 1 -- 172.21.15.7:0/35889366 wait complete. 2024-08-19T00:37:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.480+0000 7f32bb200640 1 Processor -- start 2024-08-19T00:37:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.480+0000 7f32bb200640 1 -- start start 2024-08-19T00:37:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.481+0000 7f32bb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 0x7f32b40d0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.481+0000 7f32bb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b415e360 0x7f32b40d0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.481+0000 7f32bb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e740 0x7f32b415b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.481+0000 7f32bb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40d2300 con 0x7f32b415e360 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.481+0000 7f32bb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40b4040 con 0x7f32b40d2af0 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.481+0000 7f32bb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b40b4560 con 0x7f32b415e740 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.481+0000 7f32b9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b415e360 0x7f32b40d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b415e360 0x7f32b40d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60292/0 (socket says 172.21.15.7:60292) 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 -- 172.21.15.7:0/2537850791 learned_addr learned my addr 172.21.15.7:0/2537850791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9e00640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 0x7f32b40d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32ba800640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e740 0x7f32b415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 -- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e740 msgr2=0x7f32b415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e740 0x7f32b415b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 -- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 msgr2=0x7f32b40d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 0x7f32b40d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 -- 172.21.15.7:0/2537850791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4156a50 con 0x7f32b415e360 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.482+0000 7f32b9400640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b415e360 0x7f32b40d0580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32a4035040 tx=0x7f32a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.483+0000 7f32ae000640 1 -- 172.21.15.7:0/2537850791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4041030 con 0x7f32b415e360 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.483+0000 7f32ae000640 1 -- 172.21.15.7:0/2537850791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a403d4e0 con 0x7f32b415e360 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.483+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b41e7d20 con 0x7f32b415e360 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.483+0000 7f32ae000640 1 -- 172.21.15.7:0/2537850791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4037040 con 0x7f32b415e360 2024-08-19T00:37:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.483+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b41e82e0 con 0x7f32b415e360 2024-08-19T00:37:30.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.484+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b40d2f50 con 0x7f32b415e360 2024-08-19T00:37:30.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.485+0000 7f32ae000640 1 -- 172.21.15.7:0/2537850791 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32a4044070 con 0x7f32b415e360 2024-08-19T00:37:30.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.486+0000 7f32ae000640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329806be30 0x7f329806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:30.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.486+0000 7f32ae000640 1 -- 172.21.15.7:0/2537850791 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f32a40ab380 con 0x7f32b415e360 2024-08-19T00:37:30.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.486+0000 7f32b9e00640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329806be30 0x7f329806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:30.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.487+0000 7f32b9e00640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329806be30 0x7f329806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b9900 tx=0x7f32a8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:30.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.490+0000 7f32ae000640 1 -- 172.21.15.7:0/2537850791 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f32b4156a50 con 0x7f32b415e360 2024-08-19T00:37:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:30.739+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]} v 0) -- 0x7f32b40d50d0 con 0x7f32b415e360 2024-08-19T00:37:30.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:37:30.927 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:37:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.227+0000 7f32ae000640 1 -- 172.21.15.7:0/2537850791 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]}]=0 v51) ==== 137+0+0 (secure 0 0 0) 0x7f32a4079850 con 0x7f32b415e360 2024-08-19T00:37:31.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329806be30 msgr2=0x7f329806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329806be30 0x7f329806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b9900 tx=0x7f32a8009190 comp rx=0 tx=0).stop 2024-08-19T00:37:31.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b415e360 msgr2=0x7f32b40d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b415e360 0x7f32b40d0580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32a4035040 tx=0x7f32a40046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 shutdown_connections 2024-08-19T00:37:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329806be30 0x7f329806e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b415e740 0x7f32b415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b415e360 0x7f32b40d0580 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 --2- 172.21.15.7:0/2537850791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b40d2af0 0x7f32b40d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.229+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 >> 172.21.15.7:0/2537850791 conn(0x7f32b408dbf0 msgr2=0x7f32b406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.230+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 shutdown_connections 2024-08-19T00:37:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.230+0000 7f32bb200640 1 -- 172.21.15.7:0/2537850791 wait complete. 2024-08-19T00:37:31.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-19T00:37:31.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.410+0000 7f523ce00640 1 Processor -- start 2024-08-19T00:37:31.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.410+0000 7f523ce00640 1 -- start start 2024-08-19T00:37:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.411+0000 7f523ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f52380b4860 0x7f52380d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.411+0000 7f523ce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52380b4df0 con 0x7f52380d27b0 2024-08-19T00:37:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.411+0000 7f523ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52380b50d0 con 0x7f523815e3e0 2024-08-19T00:37:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.411+0000 7f523ce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f52380d3140 con 0x7f52380b4860 2024-08-19T00:37:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5236a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f52380d27b0 0x7f52380b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60092/0 (socket says 172.21.15.7:60092) 2024-08-19T00:37:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5236a00640 1 -- 172.21.15.7:0/423558344 learned_addr learned my addr 172.21.15.7:0/423558344 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5237e00640 1 --2- 172.21.15.7:0/423558344 >> v2:172.21.15.162:3300/0 conn(0x7f52380b4860 0x7f52380d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:31.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5236000640 1 -- 172.21.15.7:0/423558344 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356469099 0 0) 0x7f52380b4df0 con 0x7f52380d27b0 2024-08-19T00:37:31.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5236000640 1 -- 172.21.15.7:0/423558344 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f521c003520 con 0x7f52380d27b0 2024-08-19T00:37:31.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5236000640 1 -- 172.21.15.7:0/423558344 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296918668 0 0) 0x7f52380b50d0 con 0x7f523815e3e0 2024-08-19T00:37:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5236000640 1 -- 172.21.15.7:0/423558344 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52380b4df0 con 0x7f523815e3e0 2024-08-19T00:37:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5237e00640 1 -- 172.21.15.7:0/423558344 >> v1:172.21.15.162:6789/0 conn(0x7f523815e3e0 legacy=0x7f52380b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5237e00640 1 -- 172.21.15.7:0/423558344 >> v1:172.21.15.7:6789/0 conn(0x7f52380d27b0 legacy=0x7f52380b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.412+0000 7f5237e00640 1 -- 172.21.15.7:0/423558344 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52380cf1e0 con 0x7f52380b4860 2024-08-19T00:37:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f5237e00640 1 --2- 172.21.15.7:0/423558344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 0x7f52380d2c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5230009dc0 tx=0x7f523002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d9175c05b79f64 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f5236000640 1 -- 172.21.15.7:0/423558344 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230007740 con 0x7f52380b4860 2024-08-19T00:37:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f5236000640 1 -- 172.21.15.7:0/423558344 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52300078e0 con 0x7f52380b4860 2024-08-19T00:37:31.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f5236000640 1 -- 172.21.15.7:0/423558344 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230007cb0 con 0x7f52380b4860 2024-08-19T00:37:31.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f523ce00640 1 -- 172.21.15.7:0/423558344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 msgr2=0x7f52380d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f523ce00640 1 --2- 172.21.15.7:0/423558344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 0x7f52380d2c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5230009dc0 tx=0x7f523002a730 comp rx=0 tx=0).stop 2024-08-19T00:37:31.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f523ce00640 1 -- 172.21.15.7:0/423558344 shutdown_connections 2024-08-19T00:37:31.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f523ce00640 1 --2- 172.21.15.7:0/423558344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 0x7f52380d2c00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.414+0000 7f523ce00640 1 -- 172.21.15.7:0/423558344 >> 172.21.15.7:0/423558344 conn(0x7f523808dbe0 msgr2=0x7f523809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:31.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.415+0000 7f523ce00640 1 -- 172.21.15.7:0/423558344 shutdown_connections 2024-08-19T00:37:31.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.415+0000 7f523ce00640 1 -- 172.21.15.7:0/423558344 wait complete. 2024-08-19T00:37:31.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.416+0000 7f523ce00640 1 Processor -- start 2024-08-19T00:37:31.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.416+0000 7f523ce00640 1 -- start start 2024-08-19T00:37:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.417+0000 7f523ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 0x7f52380c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.417+0000 7f523ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52380d27b0 0x7f52380b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.417+0000 7f523ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523815e3e0 0x7f52380b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.417+0000 7f523ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f52380cf9e0 con 0x7f52380d27b0 2024-08-19T00:37:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.417+0000 7f523ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52380cee90 con 0x7f52380b4860 2024-08-19T00:37:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.417+0000 7f523ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f52380cfb60 con 0x7f523815e3e0 2024-08-19T00:37:31.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52380d27b0 0x7f52380b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52380d27b0 0x7f52380b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60306/0 (socket says 172.21.15.7:60306) 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 -- 172.21.15.7:0/1401093249 learned_addr learned my addr 172.21.15.7:0/1401093249 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5237400640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 0x7f52380c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5237e00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523815e3e0 0x7f52380b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 -- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523815e3e0 msgr2=0x7f52380b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523815e3e0 0x7f52380b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 -- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 msgr2=0x7f52380c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 0x7f52380c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 -- 172.21.15.7:0/1401093249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52380ca010 con 0x7f52380d27b0 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5237e00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523815e3e0 0x7f52380b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.418+0000 7f5236a00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52380d27b0 0x7f52380b2850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f522400c500 tx=0x7f522400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.419+0000 7f522f400640 1 -- 172.21.15.7:0/1401093249 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224017070 con 0x7f52380d27b0 2024-08-19T00:37:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.419+0000 7f522f400640 1 -- 172.21.15.7:0/1401093249 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224005ce0 con 0x7f52380d27b0 2024-08-19T00:37:31.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.419+0000 7f522f400640 1 -- 172.21.15.7:0/1401093249 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240072f0 con 0x7f52380d27b0 2024-08-19T00:37:31.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.419+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52381f3cc0 con 0x7f52380d27b0 2024-08-19T00:37:31.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.419+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52381f4280 con 0x7f52380d27b0 2024-08-19T00:37:31.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.420+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52380d2c00 con 0x7f52380d27b0 2024-08-19T00:37:31.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.421+0000 7f522f400640 1 -- 172.21.15.7:0/1401093249 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f522401a070 con 0x7f52380d27b0 2024-08-19T00:37:31.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.421+0000 7f522f400640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f521806be30 0x7f521806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:31.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.422+0000 7f522f400640 1 -- 172.21.15.7:0/1401093249 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f522408a1f0 con 0x7f52380d27b0 2024-08-19T00:37:31.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.422+0000 7f5237400640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f521806be30 0x7f521806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:31.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.422+0000 7f5237400640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f521806be30 0x7f521806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5228007fd0 tx=0x7f5228009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:31.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.426+0000 7f522f400640 1 -- 172.21.15.7:0/1401093249 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5224058540 con 0x7f52380d27b0 2024-08-19T00:37:31.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.634+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f52381f39c0 con 0x7f52380d27b0 2024-08-19T00:37:31.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.637+0000 7f522f400640 1 -- 172.21.15.7:0/1401093249 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f522405c840 con 0x7f52380d27b0 2024-08-19T00:37:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f521806be30 msgr2=0x7f521806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f521806be30 0x7f521806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5228007fd0 tx=0x7f5228009040 comp rx=0 tx=0).stop 2024-08-19T00:37:31.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52380d27b0 msgr2=0x7f52380b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52380d27b0 0x7f52380b2850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f522400c500 tx=0x7f522400c9c0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 shutdown_connections 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f521806be30 0x7f521806e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523815e3e0 0x7f52380b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52380d27b0 0x7f52380b2850 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 --2- 172.21.15.7:0/1401093249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52380b4860 0x7f52380c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 >> 172.21.15.7:0/1401093249 conn(0x7f523808dbe0 msgr2=0x7f52380b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 shutdown_connections 2024-08-19T00:37:31.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:31.640+0000 7f523ce00640 1 -- 172.21.15.7:0/1401093249 wait complete. 2024-08-19T00:37:31.658 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:37:31.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:37:31.751 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:37:31.852 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:37:31.853 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:31.853 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:31.889 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:31.889 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:31.965 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:31.966 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:32.042 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:37:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.241+0000 7f0aa7600640 1 Processor -- start 2024-08-19T00:37:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.241+0000 7f0aa7600640 1 -- start start 2024-08-19T00:37:32.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.242+0000 7f0aa7600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0aa015e560 0x7f0aa00b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.242+0000 7f0aa7600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa0162fd0 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.242+0000 7f0aa7600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa00d53b0 con 0x7f0aa00cf580 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.242+0000 7f0aa7600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0aa00d3910 con 0x7f0aa015e560 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.242+0000 7f0aa4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0aa015e560 0x7f0aa00b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.243+0000 7f0aa5600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0aa00cf9d0 0x7f0aa01628c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60102/0 (socket says 172.21.15.7:60102) 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.243+0000 7f0aa5600640 1 -- 172.21.15.7:0/292847478 learned_addr learned my addr 172.21.15.7:0/292847478 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.243+0000 7f0aa4c00640 1 -- 172.21.15.7:0/292847478 >> v1:172.21.15.162:6789/0 conn(0x7f0aa00cf580 legacy=0x7f0aa01621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.243+0000 7f0aa4c00640 1 -- 172.21.15.7:0/292847478 >> v1:172.21.15.7:6789/0 conn(0x7f0aa00cf9d0 legacy=0x7f0aa01628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.243+0000 7f0aa4c00640 1 -- 172.21.15.7:0/292847478 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa00b3710 con 0x7f0aa015e560 2024-08-19T00:37:32.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.244+0000 7f0aa4c00640 1 --2- 172.21.15.7:0/292847478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa015e560 0x7f0aa00b69b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097a0 tx=0x7f0a9402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1372f55d732774 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:32.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.244+0000 7f0a9f400640 1 -- 172.21.15.7:0/292847478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94037070 con 0x7f0aa015e560 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.244+0000 7f0a9f400640 1 -- 172.21.15.7:0/292847478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a94032440 con 0x7f0aa015e560 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.244+0000 7f0a9f400640 1 -- 172.21.15.7:0/292847478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94032810 con 0x7f0aa015e560 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.245+0000 7f0aa7600640 1 -- 172.21.15.7:0/292847478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa015e560 msgr2=0x7f0aa00b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.245+0000 7f0aa7600640 1 --2- 172.21.15.7:0/292847478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa015e560 0x7f0aa00b69b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097a0 tx=0x7f0a9402a1a0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.245+0000 7f0aa7600640 1 -- 172.21.15.7:0/292847478 shutdown_connections 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.245+0000 7f0aa7600640 1 --2- 172.21.15.7:0/292847478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa015e560 0x7f0aa00b69b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.245+0000 7f0aa7600640 1 -- 172.21.15.7:0/292847478 >> 172.21.15.7:0/292847478 conn(0x7f0aa009d710 msgr2=0x7f0aa00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.245+0000 7f0aa7600640 1 -- 172.21.15.7:0/292847478 shutdown_connections 2024-08-19T00:37:32.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.245+0000 7f0aa7600640 1 -- 172.21.15.7:0/292847478 wait complete. 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.247+0000 7f0aa7600640 1 Processor -- start 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.247+0000 7f0aa7600640 1 -- start start 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aa00cf580 0x7f0aa015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa00cf9d0 0x7f0aa00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aa015e560 0x7f0aa01e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa7600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa00cf2c0 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa00b6ef0 con 0x7f0aa015e560 2024-08-19T00:37:32.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa00d4d60 con 0x7f0aa00cf580 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0a9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa00cf9d0 0x7f0aa00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0a9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa00cf9d0 0x7f0aa00ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60322/0 (socket says 172.21.15.7:60322) 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0a9fe00640 1 -- 172.21.15.7:0/1094161461 learned_addr learned my addr 172.21.15.7:0/1094161461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa4c00640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aa00cf580 0x7f0aa015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.248+0000 7f0aa5600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aa015e560 0x7f0aa01e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9fe00640 1 -- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aa00cf580 msgr2=0x7f0aa015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9fe00640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aa00cf580 0x7f0aa015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9fe00640 1 -- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aa015e560 msgr2=0x7f0aa01e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9fe00640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aa015e560 0x7f0aa01e9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9fe00640 1 -- 172.21.15.7:0/1094161461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa00c8b50 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0aa5600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aa015e560 0x7f0aa01e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:32.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9fe00640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa00cf9d0 0x7f0aa00ca7d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00c400 tx=0x7f0a8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:32.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9cc00640 1 -- 172.21.15.7:0/1094161461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0052d0 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9cc00640 1 -- 172.21.15.7:0/1094161461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c005490 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0a9cc00640 1 -- 172.21.15.7:0/1094161461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c007260 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa00c8e30 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.249+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa00c93f0 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.251+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa00c88e0 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.251+0000 7f0a9cc00640 1 -- 172.21.15.7:0/1094161461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a8c007400 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.252+0000 7f0a9cc00640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a8006be60 0x7f0a8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.252+0000 7f0a9cc00640 1 -- 172.21.15.7:0/1094161461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a8c08a260 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.253+0000 7f0aa4c00640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a8006be60 0x7f0a8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.253+0000 7f0aa4c00640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a8006be60 0x7f0a8006e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a94034000 tx=0x7f0a9402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.257+0000 7f0a9cc00640 1 -- 172.21.15.7:0/1094161461 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0a8c058650 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.452+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0aa00d5040 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.453+0000 7f0a9cc00640 1 -- 172.21.15.7:0/1094161461 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f0a8c05c950 con 0x7f0aa00cf9d0 2024-08-19T00:37:32.455 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a8006be60 msgr2=0x7f0a8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a8006be60 0x7f0a8006e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0a94034000 tx=0x7f0a9402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa00cf9d0 msgr2=0x7f0aa00ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa00cf9d0 0x7f0aa00ca7d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00c400 tx=0x7f0a8c00c8c0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 shutdown_connections 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a8006be60 0x7f0a8006e320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aa015e560 0x7f0aa01e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa00cf9d0 0x7f0aa00ca7d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 --2- 172.21.15.7:0/1094161461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aa00cf580 0x7f0aa015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 >> 172.21.15.7:0/1094161461 conn(0x7f0aa009d710 msgr2=0x7f0aa006db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:32.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 shutdown_connections 2024-08-19T00:37:32.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.455+0000 7f0aa7600640 1 -- 172.21.15.7:0/1094161461 wait complete. 2024-08-19T00:37:32.473 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:37:32.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:32.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:37:32.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:37:32.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:32.537 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:37:32.579 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:32.579 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:32.620 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:32.620 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:32.698 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:32.698 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:32.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:37:32.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.933+0000 7f6ad0600640 1 Processor -- start 2024-08-19T00:37:32.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.934+0000 7f6ad0600640 1 -- start start 2024-08-19T00:37:32.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6ad0600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ac80d03c0 0x7f6ac8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6ad0600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac80cdfb0 con 0x7f6ac806e710 2024-08-19T00:37:32.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6ad0600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac80ce290 con 0x7f6ac80b3750 2024-08-19T00:37:32.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6ad0600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac80cebc0 con 0x7f6ac80d03c0 2024-08-19T00:37:32.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6acdc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ac80d03c0 0x7f6ac8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6acd200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6ac806e710 0x7f6ac80d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60104/0 (socket says 172.21.15.7:60104) 2024-08-19T00:37:32.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6acd200640 1 -- 172.21.15.7:0/3400002406 learned_addr learned my addr 172.21.15.7:0/3400002406 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:32.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6acdc00640 1 -- 172.21.15.7:0/3400002406 >> v1:172.21.15.162:6789/0 conn(0x7f6ac80b3750 legacy=0x7f6ac80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6acdc00640 1 -- 172.21.15.7:0/3400002406 >> v1:172.21.15.7:6789/0 conn(0x7f6ac806e710 legacy=0x7f6ac80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.935+0000 7f6ac7e00640 1 -- 172.21.15.7:0/3400002406 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927141864 0 0) 0x7f6ac80cdfb0 con 0x7f6ac806e710 2024-08-19T00:37:32.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.936+0000 7f6acdc00640 1 -- 172.21.15.7:0/3400002406 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac80ce570 con 0x7f6ac80d03c0 2024-08-19T00:37:32.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.937+0000 7f6acdc00640 1 --2- 172.21.15.7:0/3400002406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80d03c0 0x7f6ac8071980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0097d0 tx=0x7f6abc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf689a915b57f416 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:32.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.937+0000 7f6ac7e00640 1 -- 172.21.15.7:0/3400002406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc037070 con 0x7f6ac80d03c0 2024-08-19T00:37:32.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.937+0000 7f6ac7e00640 1 -- 172.21.15.7:0/3400002406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc032440 con 0x7f6ac80d03c0 2024-08-19T00:37:32.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.937+0000 7f6ac7e00640 1 -- 172.21.15.7:0/3400002406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc032810 con 0x7f6ac80d03c0 2024-08-19T00:37:32.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.937+0000 7f6ad0600640 1 -- 172.21.15.7:0/3400002406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80d03c0 msgr2=0x7f6ac8071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.937+0000 7f6ad0600640 1 --2- 172.21.15.7:0/3400002406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80d03c0 0x7f6ac8071980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0097d0 tx=0x7f6abc02a270 comp rx=0 tx=0).stop 2024-08-19T00:37:32.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.938+0000 7f6ad0600640 1 -- 172.21.15.7:0/3400002406 shutdown_connections 2024-08-19T00:37:32.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.938+0000 7f6ad0600640 1 --2- 172.21.15.7:0/3400002406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80d03c0 0x7f6ac8071980 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.938+0000 7f6ad0600640 1 -- 172.21.15.7:0/3400002406 >> 172.21.15.7:0/3400002406 conn(0x7f6ac806bc70 msgr2=0x7f6ac806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:32.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.938+0000 7f6ad0600640 1 -- 172.21.15.7:0/3400002406 shutdown_connections 2024-08-19T00:37:32.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.938+0000 7f6ad0600640 1 -- 172.21.15.7:0/3400002406 wait complete. 2024-08-19T00:37:32.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.939+0000 7f6ad0600640 1 Processor -- start 2024-08-19T00:37:32.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.939+0000 7f6ad0600640 1 -- start start 2024-08-19T00:37:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.940+0000 7f6ad0600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac806e710 0x7f6ac809b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.940+0000 7f6ad0600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80b3750 0x7f6ac80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.940+0000 7f6ad0600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac80d03c0 0x7f6ac81557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.940+0000 7f6ad0600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8073c60 con 0x7f6ac80b3750 2024-08-19T00:37:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.940+0000 7f6ad0600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8073ae0 con 0x7f6ac80d03c0 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.940+0000 7f6ad0600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac80b3be0 con 0x7f6ac806e710 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80b3750 0x7f6ac80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80b3750 0x7f6ac80cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60336/0 (socket says 172.21.15.7:60336) 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 -- 172.21.15.7:0/2491684313 learned_addr learned my addr 172.21.15.7:0/2491684313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acdc00640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac806e710 0x7f6ac809b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6ace600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac80d03c0 0x7f6ac81557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 -- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac806e710 msgr2=0x7f6ac809b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac806e710 0x7f6ac809b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 -- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac80d03c0 msgr2=0x7f6ac81557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac80d03c0 0x7f6ac81557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 -- 172.21.15.7:0/2491684313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac80c9430 con 0x7f6ac80b3750 2024-08-19T00:37:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.941+0000 7f6acd200640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80b3750 0x7f6ac80cbe80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c3f0 tx=0x7f6ab400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.942+0000 7f6ac5600640 1 -- 172.21.15.7:0/2491684313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40074e0 con 0x7f6ac80b3750 2024-08-19T00:37:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.942+0000 7f6ac5600640 1 -- 172.21.15.7:0/2491684313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab40047e0 con 0x7f6ac80b3750 2024-08-19T00:37:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.942+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac80c9710 con 0x7f6ac80b3750 2024-08-19T00:37:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.942+0000 7f6ac5600640 1 -- 172.21.15.7:0/2491684313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4004c10 con 0x7f6ac80b3750 2024-08-19T00:37:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.942+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac80c9cd0 con 0x7f6ac80b3750 2024-08-19T00:37:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.943+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac8071980 con 0x7f6ac80b3750 2024-08-19T00:37:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.944+0000 7f6ac5600640 1 -- 172.21.15.7:0/2491684313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab4011070 con 0x7f6ac80b3750 2024-08-19T00:37:32.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.944+0000 7f6ac5600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:32.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.945+0000 7f6ac5600640 1 -- 172.21.15.7:0/2491684313 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6ab408aa60 con 0x7f6ac80b3750 2024-08-19T00:37:32.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.945+0000 7f6acdc00640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:32.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.945+0000 7f6acdc00640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa806be30 0x7f6aa806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6abc034000 tx=0x7f6abc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:32.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:32.949+0000 7f6ac5600640 1 -- 172.21.15.7:0/2491684313 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6ab4058c90 con 0x7f6ac80b3750 2024-08-19T00:37:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.146+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ac80b4d20 con 0x7f6ac80b3750 2024-08-19T00:37:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.146+0000 7f6ac5600640 1 -- 172.21.15.7:0/2491684313 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f6ab405cf90 con 0x7f6ac80b3750 2024-08-19T00:37:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:37:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa806be30 msgr2=0x7f6aa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa806be30 0x7f6aa806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6abc034000 tx=0x7f6abc02e000 comp rx=0 tx=0).stop 2024-08-19T00:37:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80b3750 msgr2=0x7f6ac80cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80b3750 0x7f6ac80cbe80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c3f0 tx=0x7f6ab400c8b0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 shutdown_connections 2024-08-19T00:37:33.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac80d03c0 0x7f6ac81557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac80b3750 0x7f6ac80cbe80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 --2- 172.21.15.7:0/2491684313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac806e710 0x7f6ac809b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 >> 172.21.15.7:0/2491684313 conn(0x7f6ac806bc70 msgr2=0x7f6ac80ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 shutdown_connections 2024-08-19T00:37:33.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.148+0000 7f6ad0600640 1 -- 172.21.15.7:0/2491684313 wait complete. 2024-08-19T00:37:33.165 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-19T00:37:33.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:33.165 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-19T00:37:33.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:37:33.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:33.230 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-19T00:37:33.284 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:33.284 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:33.323 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:33.324 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:33.399 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:33.399 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:33.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:37:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.671+0000 7f6213800640 1 Processor -- start 2024-08-19T00:37:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.671+0000 7f6213800640 1 -- start start 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.672+0000 7f6213800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.672+0000 7f6213800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620c06f7f0 con 0x7f620c0ce500 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.672+0000 7f6213800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620c06f510 con 0x7f620c159bf0 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.672+0000 7f6213800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f620c072980 con 0x7f620c0d0ad0 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f620be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f620c0ce500 0x7f620c0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60106/0 (socket says 172.21.15.7:60106) 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f620be00640 1 -- 172.21.15.7:0/1233602063 learned_addr learned my addr 172.21.15.7:0/1233602063 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f6211800640 1 --2- 172.21.15.7:0/1233602063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f620b400640 1 -- 172.21.15.7:0/1233602063 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192987902 0 0) 0x7f620c06f7f0 con 0x7f620c0ce500 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f620b400640 1 -- 172.21.15.7:0/1233602063 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f4003520 con 0x7f620c0ce500 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f620b400640 1 -- 172.21.15.7:0/1233602063 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331284629 0 0) 0x7f620c06f510 con 0x7f620c159bf0 2024-08-19T00:37:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f620b400640 1 -- 172.21.15.7:0/1233602063 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620c06f7f0 con 0x7f620c159bf0 2024-08-19T00:37:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f6211800640 1 -- 172.21.15.7:0/1233602063 >> v1:172.21.15.162:6789/0 conn(0x7f620c159bf0 legacy=0x7f620c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f6211800640 1 -- 172.21.15.7:0/1233602063 >> v1:172.21.15.7:6789/0 conn(0x7f620c0ce500 legacy=0x7f620c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.673+0000 7f6211800640 1 -- 172.21.15.7:0/1233602063 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c072c60 con 0x7f620c0d0ad0 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.674+0000 7f6211800640 1 --2- 172.21.15.7:0/1233602063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c0ce970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6204009dc0 tx=0x7f620402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f809bfadafeb42dc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f620b400640 1 -- 172.21.15.7:0/1233602063 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620402ae60 con 0x7f620c0d0ad0 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f620b400640 1 -- 172.21.15.7:0/1233602063 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6204007740 con 0x7f620c0d0ad0 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f620b400640 1 -- 172.21.15.7:0/1233602063 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204007b10 con 0x7f620c0d0ad0 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f6213800640 1 -- 172.21.15.7:0/1233602063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 msgr2=0x7f620c0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f6213800640 1 --2- 172.21.15.7:0/1233602063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c0ce970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6204009dc0 tx=0x7f620402a640 comp rx=0 tx=0).stop 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f6213800640 1 -- 172.21.15.7:0/1233602063 shutdown_connections 2024-08-19T00:37:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f6213800640 1 --2- 172.21.15.7:0/1233602063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c0ce970 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f6213800640 1 -- 172.21.15.7:0/1233602063 >> 172.21.15.7:0/1233602063 conn(0x7f620c06bc70 msgr2=0x7f620c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f6213800640 1 -- 172.21.15.7:0/1233602063 shutdown_connections 2024-08-19T00:37:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.675+0000 7f6213800640 1 -- 172.21.15.7:0/1233602063 wait complete. 2024-08-19T00:37:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.677+0000 7f6213800640 1 Processor -- start 2024-08-19T00:37:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.677+0000 7f6213800640 1 -- start start 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6213800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f620c0ce500 0x7f620c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6213800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c15ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6213800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f620c159bf0 0x7f620c15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6213800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f620c159fd0 con 0x7f620c0ce500 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6213800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f620c073b70 con 0x7f620c159bf0 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6213800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f620c15a150 con 0x7f620c0d0ad0 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6210e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f620c0ce500 0x7f620c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6210e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f620c0ce500 0x7f620c14da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60342/0 (socket says 172.21.15.7:60342) 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6210e00640 1 -- 172.21.15.7:0/384301161 learned_addr learned my addr 172.21.15.7:0/384301161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f620be00640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c15ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.678+0000 7f6211800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f620c159bf0 0x7f620c15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6210e00640 1 -- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 msgr2=0x7f620c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6210e00640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c15ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6210e00640 1 -- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f620c159bf0 msgr2=0x7f620c15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6210e00640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f620c159bf0 0x7f620c15f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6210e00640 1 -- 172.21.15.7:0/384301161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c15b980 con 0x7f620c0ce500 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6211800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f620c159bf0 0x7f620c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6210e00640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f620c0ce500 0x7f620c14da60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f620000c530 tx=0x7f620000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6208c00640 1 -- 172.21.15.7:0/384301161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62000052d0 con 0x7f620c0ce500 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6208c00640 1 -- 172.21.15.7:0/384301161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6200005490 con 0x7f620c0ce500 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c0ca560 con 0x7f620c0ce500 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6208c00640 1 -- 172.21.15.7:0/384301161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200012870 con 0x7f620c0ce500 2024-08-19T00:37:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.679+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c15fb20 con 0x7f620c0ce500 2024-08-19T00:37:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.680+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620c0ce970 con 0x7f620c0ce500 2024-08-19T00:37:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.681+0000 7f6208c00640 1 -- 172.21.15.7:0/384301161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6200012a10 con 0x7f620c0ce500 2024-08-19T00:37:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.682+0000 7f6208c00640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61ec06be30 0x7f61ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.682+0000 7f6208c00640 1 -- 172.21.15.7:0/384301161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f620008aa90 con 0x7f620c0ce500 2024-08-19T00:37:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.682+0000 7f620be00640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61ec06be30 0x7f61ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.683+0000 7f620be00640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61ec06be30 0x7f61ec06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f620c1528e0 tx=0x7f61f8007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:33.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.687+0000 7f6208c00640 1 -- 172.21.15.7:0/384301161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f62000593b0 con 0x7f620c0ce500 2024-08-19T00:37:33.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.881+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f620c06c050 con 0x7f620c0ce500 2024-08-19T00:37:33.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.882+0000 7f6208c00640 1 -- 172.21.15.7:0/384301161 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f6200058cb0 con 0x7f620c0ce500 2024-08-19T00:37:33.883 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:37:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61ec06be30 msgr2=0x7f61ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61ec06be30 0x7f61ec06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f620c1528e0 tx=0x7f61f8007d30 comp rx=0 tx=0).stop 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f620c0ce500 msgr2=0x7f620c14da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f620c0ce500 0x7f620c14da60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f620000c530 tx=0x7f620000c9f0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 shutdown_connections 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61ec06be30 0x7f61ec06e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f620c159bf0 0x7f620c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620c0d0ad0 0x7f620c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 --2- 172.21.15.7:0/384301161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f620c0ce500 0x7f620c14da60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 >> 172.21.15.7:0/384301161 conn(0x7f620c06bc70 msgr2=0x7f620c0cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 shutdown_connections 2024-08-19T00:37:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:33.884+0000 7f6213800640 1 -- 172.21.15.7:0/384301161 wait complete. 2024-08-19T00:37:33.901 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-19T00:37:33.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:33.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-19T00:37:33.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:37:33.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:33.963 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-19T00:37:34.000 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:34.001 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:34.037 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:34.038 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:34.113 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:37:34.113 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:34.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:37:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.345+0000 7f81f0a00640 1 Processor -- start 2024-08-19T00:37:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.345+0000 7f81f0a00640 1 -- start start 2024-08-19T00:37:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81f0a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f81ec0d0ad0 0x7f81ec0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81f0a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec06f7f0 con 0x7f81ec0ce500 2024-08-19T00:37:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81f0a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec06f510 con 0x7f81ec159bf0 2024-08-19T00:37:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81f0a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f81ec072980 con 0x7f81ec0d0ad0 2024-08-19T00:37:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81e1400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f81ec0ce500 0x7f81ec0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39900/0 (socket says 172.21.15.7:39900) 2024-08-19T00:37:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81e1400640 1 -- 172.21.15.7:0/4221081121 learned_addr learned my addr 172.21.15.7:0/4221081121 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81ea800640 1 --2- 172.21.15.7:0/4221081121 >> v2:172.21.15.7:3300/0 conn(0x7f81ec0d0ad0 0x7f81ec0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81ea800640 1 -- 172.21.15.7:0/4221081121 >> v1:172.21.15.162:6789/0 conn(0x7f81ec159bf0 legacy=0x7f81ec073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81e9400640 1 -- 172.21.15.7:0/4221081121 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442212695 0 0) 0x7f81ec06f7f0 con 0x7f81ec0ce500 2024-08-19T00:37:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81ea800640 1 -- 172.21.15.7:0/4221081121 >> v1:172.21.15.7:6789/0 conn(0x7f81ec0ce500 legacy=0x7f81ec0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.347+0000 7f81ea800640 1 -- 172.21.15.7:0/4221081121 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec072c60 con 0x7f81ec0d0ad0 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.348+0000 7f81ea800640 1 --2- 172.21.15.7:0/4221081121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0d0ad0 0x7f81ec0ce970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009d90 tx=0x7f81e402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10dde1606aadb49 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81e9400640 1 -- 172.21.15.7:0/4221081121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4007740 con 0x7f81ec0d0ad0 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81e9400640 1 -- 172.21.15.7:0/4221081121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e40078e0 con 0x7f81ec0d0ad0 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81e9400640 1 -- 172.21.15.7:0/4221081121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4007cb0 con 0x7f81ec0d0ad0 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81f0a00640 1 -- 172.21.15.7:0/4221081121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0d0ad0 msgr2=0x7f81ec0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81f0a00640 1 --2- 172.21.15.7:0/4221081121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0d0ad0 0x7f81ec0ce970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009d90 tx=0x7f81e402a660 comp rx=0 tx=0).stop 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81f0a00640 1 -- 172.21.15.7:0/4221081121 shutdown_connections 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81f0a00640 1 --2- 172.21.15.7:0/4221081121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0d0ad0 0x7f81ec0ce970 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81f0a00640 1 -- 172.21.15.7:0/4221081121 >> 172.21.15.7:0/4221081121 conn(0x7f81ec06bc70 msgr2=0x7f81ec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81f0a00640 1 -- 172.21.15.7:0/4221081121 shutdown_connections 2024-08-19T00:37:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.349+0000 7f81f0a00640 1 -- 172.21.15.7:0/4221081121 wait complete. 2024-08-19T00:37:34.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.351+0000 7f81f0a00640 1 Processor -- start 2024-08-19T00:37:34.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.351+0000 7f81f0a00640 1 -- start start 2024-08-19T00:37:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81f0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0ce500 0x7f81ec147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81f0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81ec0d0ad0 0x7f81ec09cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81f0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ec159bf0 0x7f81ec09aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81f0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec159fd0 con 0x7f81ec0ce500 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81f0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec073b70 con 0x7f81ec159bf0 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81f0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec15a150 con 0x7f81ec0d0ad0 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81e9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0ce500 0x7f81ec147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81e9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0ce500 0x7f81ec147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60718/0 (socket says 172.21.15.7:60718) 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81e9e00640 1 -- 172.21.15.7:0/3054056220 learned_addr learned my addr 172.21.15.7:0/3054056220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81e1400640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81ec0d0ad0 0x7f81ec09cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.352+0000 7f81ea800640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ec159bf0 0x7f81ec09aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e9e00640 1 -- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81ec0d0ad0 msgr2=0x7f81ec09cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e9e00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81ec0d0ad0 0x7f81ec09cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e9e00640 1 -- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ec159bf0 msgr2=0x7f81ec09aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e9e00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ec159bf0 0x7f81ec09aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e9e00640 1 -- 172.21.15.7:0/3054056220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec09d500 con 0x7f81ec0ce500 2024-08-19T00:37:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e9e00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0ce500 0x7f81ec147300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c450 tx=0x7f81dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e2a00640 1 -- 172.21.15.7:0/3054056220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0052d0 con 0x7f81ec0ce500 2024-08-19T00:37:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.353+0000 7f81e2a00640 1 -- 172.21.15.7:0/3054056220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc005470 con 0x7f81ec0ce500 2024-08-19T00:37:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.354+0000 7f81e2a00640 1 -- 172.21.15.7:0/3054056220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc012870 con 0x7f81ec0ce500 2024-08-19T00:37:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.354+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec09d7e0 con 0x7f81ec0ce500 2024-08-19T00:37:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.354+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec09dda0 con 0x7f81ec0ce500 2024-08-19T00:37:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.355+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec0cf130 con 0x7f81ec0ce500 2024-08-19T00:37:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.356+0000 7f81e2a00640 1 -- 172.21.15.7:0/3054056220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81dc012a10 con 0x7f81ec0ce500 2024-08-19T00:37:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.357+0000 7f81e2a00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81c806be30 0x7f81c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.357+0000 7f81e2a00640 1 -- 172.21.15.7:0/3054056220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f81dc08a9b0 con 0x7f81ec0ce500 2024-08-19T00:37:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.357+0000 7f81e1400640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81c806be30 0x7f81c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.358+0000 7f81e1400640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81c806be30 0x7f81c806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81ec1f55f0 tx=0x7f81d4007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.361+0000 7f81e2a00640 1 -- 172.21.15.7:0/3054056220 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f81dc058c70 con 0x7f81ec0ce500 2024-08-19T00:37:34.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.557+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f81ec1582f0 con 0x7f81ec0ce500 2024-08-19T00:37:34.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.557+0000 7f81e2a00640 1 -- 172.21.15.7:0/3054056220 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f81dc05cf70 con 0x7f81ec0ce500 2024-08-19T00:37:34.559 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81c806be30 msgr2=0x7f81c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81c806be30 0x7f81c806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81ec1f55f0 tx=0x7f81d4007e40 comp rx=0 tx=0).stop 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0ce500 msgr2=0x7f81ec147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0ce500 0x7f81ec147300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c450 tx=0x7f81dc00c910 comp rx=0 tx=0).stop 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 shutdown_connections 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81c806be30 0x7f81c806e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ec159bf0 0x7f81ec09aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81ec0d0ad0 0x7f81ec09cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 --2- 172.21.15.7:0/3054056220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81ec0ce500 0x7f81ec147300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 >> 172.21.15.7:0/3054056220 conn(0x7f81ec06bc70 msgr2=0x7f81ec074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 shutdown_connections 2024-08-19T00:37:34.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.560+0000 7f81f0a00640 1 -- 172.21.15.7:0/3054056220 wait complete. 2024-08-19T00:37:34.578 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-19T00:37:34.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:34.578 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-19T00:37:34.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:37:34.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:34.638 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-19T00:37:34.674 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-19T00:37:34.674 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:34.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.830+0000 7ff793e00640 1 Processor -- start 2024-08-19T00:37:34.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.830+0000 7ff793e00640 1 -- start start 2024-08-19T00:37:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff793e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 0x7ff79415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff793e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff79415e740 0x7ff79415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff793e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7940b3ab0 con 0x7ff79415e360 2024-08-19T00:37:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff793e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff79415f460 con 0x7ff79415e740 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff793e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff79415f740 con 0x7ff7940d3200 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff792a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff79415e360 0x7ff7940d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39910/0 (socket says 172.21.15.7:39910) 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff792a00640 1 -- 172.21.15.7:0/2754206461 learned_addr learned my addr 172.21.15.7:0/2754206461 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.831+0000 7ff793400640 1 --2- 172.21.15.7:0/2754206461 >> v2:172.21.15.7:3300/0 conn(0x7ff79415e740 0x7ff79415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.832+0000 7ff792000640 1 --2- 172.21.15.7:0/2754206461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 0x7ff79415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.832+0000 7ff791600640 1 -- 172.21.15.7:0/2754206461 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041554334 0 0) 0x7ff7940b3ab0 con 0x7ff79415e360 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.832+0000 7ff791600640 1 -- 172.21.15.7:0/2754206461 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff778003520 con 0x7ff79415e360 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.832+0000 7ff793400640 1 -- 172.21.15.7:0/2754206461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 msgr2=0x7ff79415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.832+0000 7ff793400640 1 --2- 172.21.15.7:0/2754206461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 0x7ff79415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.832+0000 7ff793400640 1 -- 172.21.15.7:0/2754206461 >> v1:172.21.15.7:6789/0 conn(0x7ff79415e360 legacy=0x7ff7940d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.832+0000 7ff793400640 1 -- 172.21.15.7:0/2754206461 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7940b3d60 con 0x7ff79415e740 2024-08-19T00:37:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.833+0000 7ff793400640 1 --2- 172.21.15.7:0/2754206461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e740 0x7ff79415ebb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009d90 tx=0x7ff78c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97b20253f0d98da server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.833+0000 7ff791600640 1 -- 172.21.15.7:0/2754206461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c007740 con 0x7ff79415e740 2024-08-19T00:37:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.833+0000 7ff791600640 1 -- 172.21.15.7:0/2754206461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c0078e0 con 0x7ff79415e740 2024-08-19T00:37:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.833+0000 7ff791600640 1 -- 172.21.15.7:0/2754206461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c007cb0 con 0x7ff79415e740 2024-08-19T00:37:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 -- 172.21.15.7:0/2754206461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e740 msgr2=0x7ff79415ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 --2- 172.21.15.7:0/2754206461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e740 0x7ff79415ebb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009d90 tx=0x7ff78c02a660 comp rx=0 tx=0).stop 2024-08-19T00:37:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 -- 172.21.15.7:0/2754206461 shutdown_connections 2024-08-19T00:37:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 --2- 172.21.15.7:0/2754206461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e740 0x7ff79415ebb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 --2- 172.21.15.7:0/2754206461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 0x7ff79415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 -- 172.21.15.7:0/2754206461 >> 172.21.15.7:0/2754206461 conn(0x7ff79408dbf0 msgr2=0x7ff79409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 -- 172.21.15.7:0/2754206461 shutdown_connections 2024-08-19T00:37:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.834+0000 7ff793e00640 1 -- 172.21.15.7:0/2754206461 wait complete. 2024-08-19T00:37:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.835+0000 7ff793e00640 1 Processor -- start 2024-08-19T00:37:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.836+0000 7ff793e00640 1 -- start start 2024-08-19T00:37:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.836+0000 7ff793e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 0x7ff7940b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.836+0000 7ff793e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e360 0x7ff7940d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.836+0000 7ff793e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79415e740 0x7ff7940b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.836+0000 7ff793e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff79415f0f0 con 0x7ff79415e360 2024-08-19T00:37:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.836+0000 7ff793e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7940d2300 con 0x7ff79415e740 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff793e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7940b4560 con 0x7ff7940d3200 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e360 0x7ff7940d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e360 0x7ff7940d0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60742/0 (socket says 172.21.15.7:60742) 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 -- 172.21.15.7:0/3864383932 learned_addr learned my addr 172.21.15.7:0/3864383932 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 -- 172.21.15.7:0/3864383932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 msgr2=0x7ff7940b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 0x7ff7940b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 -- 172.21.15.7:0/3864383932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79415e740 msgr2=0x7ff7940b8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79415e740 0x7ff7940b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 -- 172.21.15.7:0/3864383932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7940b8460 con 0x7ff79415e360 2024-08-19T00:37:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.837+0000 7ff792000640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e360 0x7ff7940d0d30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff78000e980 tx=0x7ff78000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:34.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.838+0000 7ff78aa00640 1 -- 172.21.15.7:0/3864383932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780017070 con 0x7ff79415e360 2024-08-19T00:37:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.838+0000 7ff78aa00640 1 -- 172.21.15.7:0/3864383932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78000ca00 con 0x7ff79415e360 2024-08-19T00:37:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.838+0000 7ff78aa00640 1 -- 172.21.15.7:0/3864383932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78000cdd0 con 0x7ff79415e360 2024-08-19T00:37:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.838+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7940d1270 con 0x7ff79415e360 2024-08-19T00:37:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.838+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7940b8700 con 0x7ff79415e360 2024-08-19T00:37:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.839+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79415ebb0 con 0x7ff79415e360 2024-08-19T00:37:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.840+0000 7ff78aa00640 1 -- 172.21.15.7:0/3864383932 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff78001a070 con 0x7ff79415e360 2024-08-19T00:37:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.841+0000 7ff78aa00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff77406be30 0x7ff77406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.841+0000 7ff78aa00640 1 -- 172.21.15.7:0/3864383932 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff78008ae80 con 0x7ff79415e360 2024-08-19T00:37:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.841+0000 7ff792a00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff77406be30 0x7ff77406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.842+0000 7ff792a00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff77406be30 0x7ff77406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff784000f60 tx=0x7ff7840078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:34.845+0000 7ff78aa00640 1 -- 172.21.15.7:0/3864383932 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff780059820 con 0x7ff79415e360 2024-08-19T00:37:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.064+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff79415dc80 con 0x7ff79415e360 2024-08-19T00:37:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.064+0000 7ff78aa00640 1 -- 172.21.15.7:0/3864383932 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7ff780059120 con 0x7ff79415e360 2024-08-19T00:37:35.066 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:35.066 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.066+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff77406be30 msgr2=0x7ff77406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff77406be30 0x7ff77406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff784000f60 tx=0x7ff7840078f0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e360 msgr2=0x7ff7940d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e360 0x7ff7940d0d30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff78000e980 tx=0x7ff78000ee40 comp rx=0 tx=0).stop 2024-08-19T00:37:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 shutdown_connections 2024-08-19T00:37:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff77406be30 0x7ff77406e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79415e740 0x7ff7940b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff79415e360 0x7ff7940d0d30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 --2- 172.21.15.7:0/3864383932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7940d3200 0x7ff7940b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 >> 172.21.15.7:0/3864383932 conn(0x7ff79408dbf0 msgr2=0x7ff7940d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 shutdown_connections 2024-08-19T00:37:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.067+0000 7ff793e00640 1 -- 172.21.15.7:0/3864383932 wait complete. 2024-08-19T00:37:35.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:35.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.239+0000 7f4781c00640 1 Processor -- start 2024-08-19T00:37:35.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.239+0000 7f4781c00640 1 -- start start 2024-08-19T00:37:35.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.240+0000 7f4781c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f477c06d960 0x7f477c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.240+0000 7f4781c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.240+0000 7f4781c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c0d5240 con 0x7f477c161ba0 2024-08-19T00:37:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.240+0000 7f4781c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f477c0b39c0 con 0x7f477c06d960 2024-08-19T00:37:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.240+0000 7f4781c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f477c0b36e0 con 0x7f477c0d2ba0 2024-08-19T00:37:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f4772000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f477c06d960 0x7f477c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f477aa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f477c161ba0 0x7f477c0d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39926/0 (socket says 172.21.15.7:39926) 2024-08-19T00:37:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f477aa00640 1 -- 172.21.15.7:0/2290111092 learned_addr learned my addr 172.21.15.7:0/2290111092 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f477b400640 1 --2- 172.21.15.7:0/2290111092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f4772000640 1 -- 172.21.15.7:0/2290111092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 msgr2=0x7f477c0b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f4772000640 1 --2- 172.21.15.7:0/2290111092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f4772000640 1 -- 172.21.15.7:0/2290111092 >> v1:172.21.15.7:6789/0 conn(0x7f477c161ba0 legacy=0x7f477c0d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.241+0000 7f4772000640 1 -- 172.21.15.7:0/2290111092 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c06e3a0 con 0x7f477c06d960 2024-08-19T00:37:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.242+0000 7f4772000640 1 --2- 172.21.15.7:0/2290111092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c06d960 0x7f477c0b2100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47640097a0 tx=0x7f476402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bcad2ffd2c091d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.243+0000 7f477a000640 1 -- 172.21.15.7:0/2290111092 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764037070 con 0x7f477c06d960 2024-08-19T00:37:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.243+0000 7f477a000640 1 -- 172.21.15.7:0/2290111092 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4764032440 con 0x7f477c06d960 2024-08-19T00:37:35.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.243+0000 7f477a000640 1 -- 172.21.15.7:0/2290111092 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764032810 con 0x7f477c06d960 2024-08-19T00:37:35.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 -- 172.21.15.7:0/2290111092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c06d960 msgr2=0x7f477c0b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 --2- 172.21.15.7:0/2290111092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c06d960 0x7f477c0b2100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47640097a0 tx=0x7f476402a180 comp rx=0 tx=0).stop 2024-08-19T00:37:35.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 -- 172.21.15.7:0/2290111092 shutdown_connections 2024-08-19T00:37:35.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 --2- 172.21.15.7:0/2290111092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 --2- 172.21.15.7:0/2290111092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c06d960 0x7f477c0b2100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 -- 172.21.15.7:0/2290111092 >> 172.21.15.7:0/2290111092 conn(0x7f477c08c000 msgr2=0x7f477c0d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:35.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 -- 172.21.15.7:0/2290111092 shutdown_connections 2024-08-19T00:37:35.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.244+0000 7f4781c00640 1 -- 172.21.15.7:0/2290111092 wait complete. 2024-08-19T00:37:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.246+0000 7f4781c00640 1 Processor -- start 2024-08-19T00:37:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.246+0000 7f4781c00640 1 -- start start 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f4781c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f477c06d960 0x7f477c0cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f4781c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f4781c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c161ba0 0x7f477c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f4781c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f477c161f80 con 0x7f477c161ba0 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f4781c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f477c0b1be0 con 0x7f477c06d960 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f4781c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f477c162100 con 0x7f477c0d2ba0 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c161ba0 0x7f477c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c161ba0 0x7f477c1576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60762/0 (socket says 172.21.15.7:60762) 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 -- 172.21.15.7:0/4197482007 learned_addr learned my addr 172.21.15.7:0/4197482007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f4772000640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477aa00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f477c06d960 0x7f477c0cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 -- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 msgr2=0x7f477c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 -- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f477c06d960 msgr2=0x7f477c0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f477c06d960 0x7f477c0cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.247+0000 7f477b400640 1 -- 172.21.15.7:0/4197482007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c157bf0 con 0x7f477c161ba0 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.248+0000 7f477b400640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c161ba0 0x7f477c1576b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f477400ef90 tx=0x7f477400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.248+0000 7f4773400640 1 -- 172.21.15.7:0/4197482007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774018020 con 0x7f477c161ba0 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.248+0000 7f4773400640 1 -- 172.21.15.7:0/4197482007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774014480 con 0x7f477c161ba0 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.248+0000 7f4773400640 1 -- 172.21.15.7:0/4197482007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774014870 con 0x7f477c161ba0 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.248+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c0c96f0 con 0x7f477c161ba0 2024-08-19T00:37:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.248+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c0c9cb0 con 0x7f477c161ba0 2024-08-19T00:37:35.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.249+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c0d4b30 con 0x7f477c161ba0 2024-08-19T00:37:35.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.250+0000 7f4773400640 1 -- 172.21.15.7:0/4197482007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4774005d10 con 0x7f477c161ba0 2024-08-19T00:37:35.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.251+0000 7f4773400640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f475806be30 0x7f475806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.251+0000 7f4773400640 1 -- 172.21.15.7:0/4197482007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f477408bc30 con 0x7f477c161ba0 2024-08-19T00:37:35.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.251+0000 7f477aa00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f475806be30 0x7f475806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.252+0000 7f477aa00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f475806be30 0x7f475806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f476c007fd0 tx=0x7f476c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.255+0000 7f4773400640 1 -- 172.21.15.7:0/4197482007 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4774022030 con 0x7f477c161ba0 2024-08-19T00:37:35.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.481+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f477c0cb190 con 0x7f477c161ba0 2024-08-19T00:37:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.482+0000 7f4773400640 1 -- 172.21.15.7:0/4197482007 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f4774010040 con 0x7f477c161ba0 2024-08-19T00:37:35.484 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:35.484 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f475806be30 msgr2=0x7f475806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f475806be30 0x7f475806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f476c007fd0 tx=0x7f476c007e80 comp rx=0 tx=0).stop 2024-08-19T00:37:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c161ba0 msgr2=0x7f477c1576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c161ba0 0x7f477c1576b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f477400ef90 tx=0x7f477400c490 comp rx=0 tx=0).stop 2024-08-19T00:37:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 shutdown_connections 2024-08-19T00:37:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f475806be30 0x7f475806e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f477c161ba0 0x7f477c1576b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477c0d2ba0 0x7f477c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 --2- 172.21.15.7:0/4197482007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f477c06d960 0x7f477c0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.484+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 >> 172.21.15.7:0/4197482007 conn(0x7f477c08c000 msgr2=0x7f477c0cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.485+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 shutdown_connections 2024-08-19T00:37:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.485+0000 7f4781c00640 1 -- 172.21.15.7:0/4197482007 wait complete. 2024-08-19T00:37:35.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.656+0000 7f44d1400640 1 Processor -- start 2024-08-19T00:37:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.656+0000 7f44d1400640 1 -- start start 2024-08-19T00:37:35.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.657+0000 7f44d1400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f44cc0ce500 0x7f44cc0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.657+0000 7f44d1400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44cc06f7f0 con 0x7f44cc159bf0 2024-08-19T00:37:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.657+0000 7f44d1400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44cc06f510 con 0x7f44cc0d03c0 2024-08-19T00:37:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.657+0000 7f44d1400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f44cc072980 con 0x7f44cc0ce500 2024-08-19T00:37:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.657+0000 7f44c9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f44cc0ce500 0x7f44cc0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.657+0000 7f44ca800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f44cc159bf0 0x7f44cc073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39932/0 (socket says 172.21.15.7:39932) 2024-08-19T00:37:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.657+0000 7f44ca800640 1 -- 172.21.15.7:0/3043633469 learned_addr learned my addr 172.21.15.7:0/3043633469 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.658+0000 7f44c9e00640 1 -- 172.21.15.7:0/3043633469 >> v1:172.21.15.162:6789/0 conn(0x7f44cc0d03c0 legacy=0x7f44cc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.658+0000 7f44c9e00640 1 -- 172.21.15.7:0/3043633469 >> v1:172.21.15.7:6789/0 conn(0x7f44cc159bf0 legacy=0x7f44cc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.658+0000 7f44c9e00640 1 -- 172.21.15.7:0/3043633469 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc072c60 con 0x7f44cc0ce500 2024-08-19T00:37:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.658+0000 7f44c9400640 1 -- 172.21.15.7:0/3043633469 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483362092 0 0) 0x7f44cc06f7f0 con 0x7f44cc159bf0 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.659+0000 7f44c9e00640 1 --2- 172.21.15.7:0/3043633469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc0ce970 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f44b80097a0 tx=0x7f44b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9d72bfad3eedac server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.659+0000 7f44c9400640 1 -- 172.21.15.7:0/3043633469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8037070 con 0x7f44cc0ce500 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.659+0000 7f44c9400640 1 -- 172.21.15.7:0/3043633469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b8032440 con 0x7f44cc0ce500 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.659+0000 7f44c9400640 1 -- 172.21.15.7:0/3043633469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8032810 con 0x7f44cc0ce500 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.660+0000 7f44d1400640 1 -- 172.21.15.7:0/3043633469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 msgr2=0x7f44cc0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.660+0000 7f44d1400640 1 --2- 172.21.15.7:0/3043633469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc0ce970 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f44b80097a0 tx=0x7f44b802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.660+0000 7f44d1400640 1 -- 172.21.15.7:0/3043633469 shutdown_connections 2024-08-19T00:37:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.660+0000 7f44d1400640 1 --2- 172.21.15.7:0/3043633469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc0ce970 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.660+0000 7f44d1400640 1 -- 172.21.15.7:0/3043633469 >> 172.21.15.7:0/3043633469 conn(0x7f44cc06bc70 msgr2=0x7f44cc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:35.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.660+0000 7f44d1400640 1 -- 172.21.15.7:0/3043633469 shutdown_connections 2024-08-19T00:37:35.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.660+0000 7f44d1400640 1 -- 172.21.15.7:0/3043633469 wait complete. 2024-08-19T00:37:35.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.661+0000 7f44d1400640 1 Processor -- start 2024-08-19T00:37:35.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.661+0000 7f44d1400640 1 -- start start 2024-08-19T00:37:35.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.662+0000 7f44d1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.662+0000 7f44d1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44cc0d03c0 0x7f44cc15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.662+0000 7f44d1400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44cc159bf0 0x7f44cc1f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.662+0000 7f44d1400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc159fd0 con 0x7f44cc0ce500 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.662+0000 7f44d1400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc073b70 con 0x7f44cc0d03c0 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.662+0000 7f44d1400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc15a150 con 0x7f44cc159bf0 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60776/0 (socket says 172.21.15.7:60776) 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 -- 172.21.15.7:0/3073647089 learned_addr learned my addr 172.21.15.7:0/3073647089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44c9e00640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44cc0d03c0 0x7f44cc15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44cb200640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44cc159bf0 0x7f44cc1f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 -- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44cc159bf0 msgr2=0x7f44cc1f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44cc159bf0 0x7f44cc1f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 -- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44cc0d03c0 msgr2=0x7f44cc15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44cc0d03c0 0x7f44cc15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 -- 172.21.15.7:0/3073647089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc1496e0 con 0x7f44cc0ce500 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44cb200640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44cc159bf0 0x7f44cc1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.663+0000 7f44ca800640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc149050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00c4a0 tx=0x7f44bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.664+0000 7f44c2a00640 1 -- 172.21.15.7:0/3073647089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc018070 con 0x7f44cc0ce500 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.664+0000 7f44c2a00640 1 -- 172.21.15.7:0/3073647089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0074e0 con 0x7f44cc0ce500 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.664+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44cc1499c0 con 0x7f44cc0ce500 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.664+0000 7f44c2a00640 1 -- 172.21.15.7:0/3073647089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc004a20 con 0x7f44cc0ce500 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.664+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44cc149f80 con 0x7f44cc0ce500 2024-08-19T00:37:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.665+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44cc15f910 con 0x7f44cc0ce500 2024-08-19T00:37:35.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.666+0000 7f44c2a00640 1 -- 172.21.15.7:0/3073647089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44bc01b070 con 0x7f44cc0ce500 2024-08-19T00:37:35.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.667+0000 7f44c2a00640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44ac06be30 0x7f44ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.667+0000 7f44c2a00640 1 -- 172.21.15.7:0/3073647089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f44bc089fc0 con 0x7f44cc0ce500 2024-08-19T00:37:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.667+0000 7f44c9e00640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44ac06be30 0x7f44ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.667+0000 7f44c9e00640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44ac06be30 0x7f44ac06e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44b8034000 tx=0x7f44b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:35.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.671+0000 7f44c2a00640 1 -- 172.21.15.7:0/3073647089 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f44cc15f910 con 0x7f44cc0ce500 2024-08-19T00:37:35.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.855+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44cc0ce970 con 0x7f44cc0ce500 2024-08-19T00:37:35.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.856+0000 7f44c2a00640 1 -- 172.21.15.7:0/3073647089 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16573 (secure 0 0 0) 0x7f44bc0583b0 con 0x7f44cc0ce500 2024-08-19T00:37:35.858 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:35.858 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:04.356113+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.858+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44ac06be30 msgr2=0x7f44ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.858+0000 7f44d1400640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44ac06be30 0x7f44ac06e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44b8034000 tx=0x7f44b802e000 comp rx=0 tx=0).stop 2024-08-19T00:37:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.858+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 msgr2=0x7f44cc149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.858+0000 7f44d1400640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc149050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00c4a0 tx=0x7f44bc00c960 comp rx=0 tx=0).stop 2024-08-19T00:37:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.858+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 shutdown_connections 2024-08-19T00:37:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.858+0000 7f44d1400640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44ac06be30 0x7f44ac06e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.859+0000 7f44d1400640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44cc159bf0 0x7f44cc1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.859+0000 7f44d1400640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44cc0d03c0 0x7f44cc15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.859+0000 7f44d1400640 1 --2- 172.21.15.7:0/3073647089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44cc0ce500 0x7f44cc149050 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.859+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 >> 172.21.15.7:0/3073647089 conn(0x7f44cc06bc70 msgr2=0x7f44cc1580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.859+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 shutdown_connections 2024-08-19T00:37:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:35.859+0000 7f44d1400640 1 -- 172.21.15.7:0/3073647089 wait complete. 2024-08-19T00:37:35.876 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:37:35.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.029+0000 7f48bdc00640 1 Processor -- start 2024-08-19T00:37:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.030+0000 7f48bdc00640 1 -- start start 2024-08-19T00:37:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48bdc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b8159bf0 0x7f48b8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48bdc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48b80cec10 0x7f48b80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48bdc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b806f7f0 con 0x7f48b80739a0 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48bdc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f48b806f510 con 0x7f48b80cec10 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48bdc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48b8072980 con 0x7f48b8159bf0 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48b7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48b80cec10 0x7f48b80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48b7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48b80cec10 0x7f48b80d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60784/0 (socket says 172.21.15.7:60784) 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48b7400640 1 -- 172.21.15.7:0/2089568500 learned_addr learned my addr 172.21.15.7:0/2089568500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48b6a00640 1 --2- 172.21.15.7:0/2089568500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b8159bf0 0x7f48b8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48b7400640 1 -- 172.21.15.7:0/2089568500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b8159bf0 msgr2=0x7f48b8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48b7400640 1 --2- 172.21.15.7:0/2089568500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b8159bf0 0x7f48b8073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.031+0000 7f48b7400640 1 -- 172.21.15.7:0/2089568500 >> v1:172.21.15.162:6789/0 conn(0x7f48b80739a0 legacy=0x7f48b80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.032+0000 7f48b7400640 1 -- 172.21.15.7:0/2089568500 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b8072c60 con 0x7f48b80cec10 2024-08-19T00:37:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.032+0000 7f48b7400640 1 --2- 172.21.15.7:0/2089568500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b80cec10 0x7f48b80d03c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009e50 tx=0x7f48b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d116d0cf1d75afcc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48b6000640 1 -- 172.21.15.7:0/2089568500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0036070 con 0x7f48b80cec10 2024-08-19T00:37:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48b6000640 1 -- 172.21.15.7:0/2089568500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b0031600 con 0x7f48b80cec10 2024-08-19T00:37:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48b6000640 1 -- 172.21.15.7:0/2089568500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b00319d0 con 0x7f48b80cec10 2024-08-19T00:37:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 -- 172.21.15.7:0/2089568500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b80cec10 msgr2=0x7f48b80d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 --2- 172.21.15.7:0/2089568500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b80cec10 0x7f48b80d03c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009e50 tx=0x7f48b002a680 comp rx=0 tx=0).stop 2024-08-19T00:37:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 -- 172.21.15.7:0/2089568500 shutdown_connections 2024-08-19T00:37:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 --2- 172.21.15.7:0/2089568500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b80cec10 0x7f48b80d03c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 --2- 172.21.15.7:0/2089568500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b8159bf0 0x7f48b8073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 -- 172.21.15.7:0/2089568500 >> 172.21.15.7:0/2089568500 conn(0x7f48b806bc70 msgr2=0x7f48b806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 -- 172.21.15.7:0/2089568500 shutdown_connections 2024-08-19T00:37:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.033+0000 7f48bdc00640 1 -- 172.21.15.7:0/2089568500 wait complete. 2024-08-19T00:37:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.035+0000 7f48bdc00640 1 Processor -- start 2024-08-19T00:37:36.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.035+0000 7f48bdc00640 1 -- start start 2024-08-19T00:37:36.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48bdc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b80739a0 0x7f48b8153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48bdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b8159bf0 0x7f48b80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48bdc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b80b0e30 0x7f48b81586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48bdc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48b815a150 con 0x7f48b8159bf0 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48bdc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48b8159fd0 con 0x7f48b80739a0 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48bdc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48b80d0900 con 0x7f48b80b0e30 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b8159bf0 0x7f48b80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b8159bf0 0x7f48b80b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60796/0 (socket says 172.21.15.7:60796) 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48afe00640 1 -- 172.21.15.7:0/386292893 learned_addr learned my addr 172.21.15.7:0/386292893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48b6a00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b80739a0 0x7f48b8153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.036+0000 7f48b7400640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b80b0e30 0x7f48b81586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48afe00640 1 -- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b80b0e30 msgr2=0x7f48b81586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48afe00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b80b0e30 0x7f48b81586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48afe00640 1 -- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b80739a0 msgr2=0x7f48b8153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48afe00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b80739a0 0x7f48b8153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48afe00640 1 -- 172.21.15.7:0/386292893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b81536b0 con 0x7f48b8159bf0 2024-08-19T00:37:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48afe00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b8159bf0 0x7f48b80b08f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c440 tx=0x7f48a000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48aea00640 1 -- 172.21.15.7:0/386292893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a00052d0 con 0x7f48b8159bf0 2024-08-19T00:37:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48aea00640 1 -- 172.21.15.7:0/386292893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a0005470 con 0x7f48b8159bf0 2024-08-19T00:37:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48aea00640 1 -- 172.21.15.7:0/386292893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0007260 con 0x7f48b8159bf0 2024-08-19T00:37:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b8157740 con 0x7f48b8159bf0 2024-08-19T00:37:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.037+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b8156ea0 con 0x7f48b8159bf0 2024-08-19T00:37:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.038+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b80d03c0 con 0x7f48b8159bf0 2024-08-19T00:37:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.039+0000 7f48aea00640 1 -- 172.21.15.7:0/386292893 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48a00074c0 con 0x7f48b8159bf0 2024-08-19T00:37:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.040+0000 7f48aea00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f489406be30 0x7f489406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.040+0000 7f48aea00640 1 -- 172.21.15.7:0/386292893 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48a008a2e0 con 0x7f48b8159bf0 2024-08-19T00:37:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.040+0000 7f48b6a00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f489406be30 0x7f489406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.041+0000 7f48b6a00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f489406be30 0x7f489406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48b809e550 tx=0x7f48a8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.044+0000 7f48aea00640 1 -- 172.21.15.7:0/386292893 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f48a00585a0 con 0x7f48b8159bf0 2024-08-19T00:37:36.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.264+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48b80b5020 con 0x7f48b8159bf0 2024-08-19T00:37:36.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.264+0000 7f48aea00640 1 -- 172.21.15.7:0/386292893 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f48a005c8a0 con 0x7f48b8159bf0 2024-08-19T00:37:36.266 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:36.266 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:36.267 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f489406be30 msgr2=0x7f489406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f489406be30 0x7f489406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48b809e550 tx=0x7f48a8009190 comp rx=0 tx=0).stop 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b8159bf0 msgr2=0x7f48b80b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b8159bf0 0x7f48b80b08f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c440 tx=0x7f48a000c900 comp rx=0 tx=0).stop 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 shutdown_connections 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f489406be30 0x7f489406e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48b80b0e30 0x7f48b81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b8159bf0 0x7f48b80b08f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 --2- 172.21.15.7:0/386292893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b80739a0 0x7f48b8153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 >> 172.21.15.7:0/386292893 conn(0x7f48b806bc70 msgr2=0x7f48b815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:36.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 shutdown_connections 2024-08-19T00:37:36.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.267+0000 7f48bdc00640 1 -- 172.21.15.7:0/386292893 wait complete. 2024-08-19T00:37:36.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:36.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.439+0000 7f7372200640 1 Processor -- start 2024-08-19T00:37:36.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.439+0000 7f7372200640 1 -- start start 2024-08-19T00:37:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.440+0000 7f7372200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f736c0d3200 0x7f736c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.440+0000 7f7372200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f736c0b3ab0 con 0x7f736c15e360 2024-08-19T00:37:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.440+0000 7f7372200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f736c15f460 con 0x7f736c15e740 2024-08-19T00:37:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.440+0000 7f7372200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f736c15f740 con 0x7f736c0d3200 2024-08-19T00:37:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.440+0000 7f7370e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f736c15e360 0x7f736c0d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39942/0 (socket says 172.21.15.7:39942) 2024-08-19T00:37:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.441+0000 7f7370e00640 1 -- 172.21.15.7:0/836152608 learned_addr learned my addr 172.21.15.7:0/836152608 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.441+0000 7f736be00640 1 --2- 172.21.15.7:0/836152608 >> v2:172.21.15.7:3300/0 conn(0x7f736c0d3200 0x7f736c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.441+0000 7f736be00640 1 -- 172.21.15.7:0/836152608 >> v1:172.21.15.162:6789/0 conn(0x7f736c15e740 legacy=0x7f736c15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.441+0000 7f736be00640 1 -- 172.21.15.7:0/836152608 >> v1:172.21.15.7:6789/0 conn(0x7f736c15e360 legacy=0x7f736c0d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.441+0000 7f736be00640 1 -- 172.21.15.7:0/836152608 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c0b3d60 con 0x7f736c0d3200 2024-08-19T00:37:36.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.442+0000 7f736be00640 1 --2- 172.21.15.7:0/836152608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c0d3200 0x7f736c15fab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73580097a0 tx=0x7f735802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f401de05fd2b0c29 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.442+0000 7f736b400640 1 -- 172.21.15.7:0/836152608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358037070 con 0x7f736c0d3200 2024-08-19T00:37:36.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.442+0000 7f736b400640 1 -- 172.21.15.7:0/836152608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f735802adc0 con 0x7f736c0d3200 2024-08-19T00:37:36.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.442+0000 7f736b400640 1 -- 172.21.15.7:0/836152608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358032660 con 0x7f736c0d3200 2024-08-19T00:37:36.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.443+0000 7f7372200640 1 -- 172.21.15.7:0/836152608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c0d3200 msgr2=0x7f736c15fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.443+0000 7f7372200640 1 --2- 172.21.15.7:0/836152608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c0d3200 0x7f736c15fab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73580097a0 tx=0x7f735802a130 comp rx=0 tx=0).stop 2024-08-19T00:37:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.443+0000 7f7372200640 1 -- 172.21.15.7:0/836152608 shutdown_connections 2024-08-19T00:37:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.443+0000 7f7372200640 1 --2- 172.21.15.7:0/836152608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c0d3200 0x7f736c15fab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.443+0000 7f7372200640 1 -- 172.21.15.7:0/836152608 >> 172.21.15.7:0/836152608 conn(0x7f736c08dbf0 msgr2=0x7f736c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.443+0000 7f7372200640 1 -- 172.21.15.7:0/836152608 shutdown_connections 2024-08-19T00:37:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.443+0000 7f7372200640 1 -- 172.21.15.7:0/836152608 wait complete. 2024-08-19T00:37:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.445+0000 7f7372200640 1 Processor -- start 2024-08-19T00:37:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.445+0000 7f7372200640 1 -- start start 2024-08-19T00:37:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7372200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f736c0d3200 0x7f736c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7372200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c15e360 0x7f736c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7372200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c15e740 0x7f736c0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7372200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f736c0b4560 con 0x7f736c15e360 2024-08-19T00:37:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7372200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f736c0d2300 con 0x7f736c15e740 2024-08-19T00:37:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7372200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f736c0b46e0 con 0x7f736c0d3200 2024-08-19T00:37:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c15e360 0x7f736c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c15e360 0x7f736c0cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60824/0 (socket says 172.21.15.7:60824) 2024-08-19T00:37:36.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 -- 172.21.15.7:0/2563199573 learned_addr learned my addr 172.21.15.7:0/2563199573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:36.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7370e00640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f736c0d3200 0x7f736c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f7371800640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c15e740 0x7f736c0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 -- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f736c0d3200 msgr2=0x7f736c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f736c0d3200 0x7f736c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 -- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c15e740 msgr2=0x7f736c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c15e740 0x7f736c0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.446+0000 7f736be00640 1 -- 172.21.15.7:0/2563199573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c0cba60 con 0x7f736c15e360 2024-08-19T00:37:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.447+0000 7f736be00640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c15e360 0x7f736c0cb520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73580098c0 tx=0x7f73580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.447+0000 7f7368c00640 1 -- 172.21.15.7:0/2563199573 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358042070 con 0x7f736c15e360 2024-08-19T00:37:36.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.447+0000 7f7368c00640 1 -- 172.21.15.7:0/2563199573 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7358004250 con 0x7f736c15e360 2024-08-19T00:37:36.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.447+0000 7f7368c00640 1 -- 172.21.15.7:0/2563199573 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358037040 con 0x7f736c15e360 2024-08-19T00:37:36.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.447+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c0c7f60 con 0x7f736c15e360 2024-08-19T00:37:36.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.447+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c0c8520 con 0x7f736c15e360 2024-08-19T00:37:36.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.448+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736c15fab0 con 0x7f736c15e360 2024-08-19T00:37:36.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.449+0000 7f7368c00640 1 -- 172.21.15.7:0/2563199573 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7358045070 con 0x7f736c15e360 2024-08-19T00:37:36.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.450+0000 7f7368c00640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f734c06be30 0x7f734c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.450+0000 7f7368c00640 1 -- 172.21.15.7:0/2563199573 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73580aa850 con 0x7f736c15e360 2024-08-19T00:37:36.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.450+0000 7f7370e00640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f734c06be30 0x7f734c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.451+0000 7f7370e00640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f734c06be30 0x7f734c06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7360000f60 tx=0x7f7360007e20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.454+0000 7f7368c00640 1 -- 172.21.15.7:0/2563199573 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7358078b50 con 0x7f736c15e360 2024-08-19T00:37:36.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.677+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f736c0d4bc0 con 0x7f736c15e360 2024-08-19T00:37:36.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.678+0000 7f7368c00640 1 -- 172.21.15.7:0/2563199573 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f735807ce50 con 0x7f736c15e360 2024-08-19T00:37:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:36.680 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-08-19T00:37:06:376245+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/845579358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":845579358},{"type":"v1","addr":"172.21.15.162:6835","nonce":845579358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3957757440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3957757440},{"type":"v1","addr":"172.21.15.7:6836","nonce":3957757440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/950251636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":950251636},{"type":"v1","addr":"172.21.15.7:6837","nonce":950251636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:02.781631+0000","modified":"2024-08-19T00:37:05.796949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1516018308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1516018308},{"type":"v1","addr":"172.21.15.162:6834","nonce":1516018308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-08-19T00:37:36.680 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-08-19T00:37:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.680+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f734c06be30 msgr2=0x7f734c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.680+0000 7f7372200640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f734c06be30 0x7f734c06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7360000f60 tx=0x7f7360007e20 comp rx=0 tx=0).stop 2024-08-19T00:37:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.680+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c15e360 msgr2=0x7f736c0cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.680+0000 7f7372200640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c15e360 0x7f736c0cb520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73580098c0 tx=0x7f73580046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 shutdown_connections 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f734c06be30 0x7f734c06e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c15e740 0x7f736c0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736c15e360 0x7f736c0cb520 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 --2- 172.21.15.7:0/2563199573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f736c0d3200 0x7f736c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 >> 172.21.15.7:0/2563199573 conn(0x7f736c08dbf0 msgr2=0x7f736c160be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 shutdown_connections 2024-08-19T00:37:36.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.681+0000 7f7372200640 1 -- 172.21.15.7:0/2563199573 wait complete. 2024-08-19T00:37:36.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.854+0000 7f6223400640 1 Processor -- start 2024-08-19T00:37:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.854+0000 7f6223400640 1 -- start start 2024-08-19T00:37:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6223400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f621c161ba0 0x7f621c0d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6223400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f621c0d4b30 0x7f621c0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6223400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f621c0d5240 con 0x7f621c06c950 2024-08-19T00:37:36.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6223400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f621c0b39c0 con 0x7f621c161ba0 2024-08-19T00:37:36.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6223400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f621c0b36e0 con 0x7f621c0d4b30 2024-08-19T00:37:36.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6220a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f621c161ba0 0x7f621c0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6220a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f621c161ba0 0x7f621c0d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60840/0 (socket says 172.21.15.7:60840) 2024-08-19T00:37:36.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.855+0000 7f6220a00640 1 -- 172.21.15.7:0/4125572080 learned_addr learned my addr 172.21.15.7:0/4125572080 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:36.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.856+0000 7f6220a00640 1 -- 172.21.15.7:0/4125572080 >> v2:172.21.15.162:3300/0 conn(0x7f621c0d4b30 msgr2=0x7f621c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:36.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.856+0000 7f621be00640 1 --2- 172.21.15.7:0/4125572080 >> v2:172.21.15.162:3300/0 conn(0x7f621c0d4b30 0x7f621c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.856+0000 7f6220a00640 1 --2- 172.21.15.7:0/4125572080 >> v2:172.21.15.162:3300/0 conn(0x7f621c0d4b30 0x7f621c0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.856+0000 7f6220a00640 1 -- 172.21.15.7:0/4125572080 >> v1:172.21.15.162:6789/0 conn(0x7f621c06c950 legacy=0x7f621c06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.856+0000 7f6220a00640 1 -- 172.21.15.7:0/4125572080 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c06e3a0 con 0x7f621c161ba0 2024-08-19T00:37:36.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.856+0000 7f621be00640 1 --2- 172.21.15.7:0/4125572080 >> v2:172.21.15.162:3300/0 conn(0x7f621c0d4b30 0x7f621c0d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:36.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.857+0000 7f6220a00640 1 --2- 172.21.15.7:0/4125572080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c161ba0 0x7f621c0d2490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ce8a0 tx=0x7f621002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e831f58aaf1a99d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.857+0000 7f621b400640 1 -- 172.21.15.7:0/4125572080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210037070 con 0x7f621c161ba0 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.857+0000 7f621b400640 1 -- 172.21.15.7:0/4125572080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210032440 con 0x7f621c161ba0 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.857+0000 7f621b400640 1 -- 172.21.15.7:0/4125572080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210032810 con 0x7f621c161ba0 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 -- 172.21.15.7:0/4125572080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c161ba0 msgr2=0x7f621c0d2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 --2- 172.21.15.7:0/4125572080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c161ba0 0x7f621c0d2490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ce8a0 tx=0x7f621002a270 comp rx=0 tx=0).stop 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 -- 172.21.15.7:0/4125572080 shutdown_connections 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 --2- 172.21.15.7:0/4125572080 >> v2:172.21.15.162:3300/0 conn(0x7f621c0d4b30 0x7f621c0d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 --2- 172.21.15.7:0/4125572080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c161ba0 0x7f621c0d2490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 -- 172.21.15.7:0/4125572080 >> 172.21.15.7:0/4125572080 conn(0x7f621c08c000 msgr2=0x7f621c0d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 -- 172.21.15.7:0/4125572080 shutdown_connections 2024-08-19T00:37:36.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.858+0000 7f6223400640 1 -- 172.21.15.7:0/4125572080 wait complete. 2024-08-19T00:37:36.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.859+0000 7f6223400640 1 Processor -- start 2024-08-19T00:37:36.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.860+0000 7f6223400640 1 -- start start 2024-08-19T00:37:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.860+0000 7f6223400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621c06c950 0x7f621c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.860+0000 7f6223400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c0d4b30 0x7f621c0b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.860+0000 7f6223400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c161ba0 0x7f621c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.860+0000 7f6223400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f621c161f80 con 0x7f621c0d4b30 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.860+0000 7f6223400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0b1be0 con 0x7f621c161ba0 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.860+0000 7f6223400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f621c162100 con 0x7f621c06c950 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c0d4b30 0x7f621c0b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c0d4b30 0x7f621c0b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60842/0 (socket says 172.21.15.7:60842) 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 -- 172.21.15.7:0/4178868282 learned_addr learned my addr 172.21.15.7:0/4178868282 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f6220a00640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621c06c950 0x7f621c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f6221400640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c161ba0 0x7f621c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 -- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621c06c950 msgr2=0x7f621c155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621c06c950 0x7f621c155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 -- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c161ba0 msgr2=0x7f621c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:36.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c161ba0 0x7f621c0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:36.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.861+0000 7f621be00640 1 -- 172.21.15.7:0/4178868282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c1f43a0 con 0x7f621c0d4b30 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.862+0000 7f621be00640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c0d4b30 0x7f621c0b7c80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f620800c7f0 tx=0x7f620800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.862+0000 7f6218c00640 1 -- 172.21.15.7:0/4178868282 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208004230 con 0x7f621c0d4b30 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.862+0000 7f6218c00640 1 -- 172.21.15.7:0/4178868282 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62080043d0 con 0x7f621c0d4b30 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.862+0000 7f6218c00640 1 -- 172.21.15.7:0/4178868282 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208007a70 con 0x7f621c0d4b30 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.862+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c1f4680 con 0x7f621c0d4b30 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.862+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c1f4c40 con 0x7f621c0d4b30 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.863+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c0d2490 con 0x7f621c0d4b30 2024-08-19T00:37:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.864+0000 7f6218c00640 1 -- 172.21.15.7:0/4178868282 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6208007c10 con 0x7f621c0d4b30 2024-08-19T00:37:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.865+0000 7f6218c00640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61fc06be30 0x7f61fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.865+0000 7f6218c00640 1 -- 172.21.15.7:0/4178868282 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f620808aea0 con 0x7f621c0d4b30 2024-08-19T00:37:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.865+0000 7f6220a00640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61fc06be30 0x7f61fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.866+0000 7f6220a00640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61fc06be30 0x7f61fc06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:36.869+0000 7f6218c00640 1 -- 172.21.15.7:0/4178868282 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6208015020 con 0x7f621c0d4b30 2024-08-19T00:37:37.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.056+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f621c0cee70 con 0x7f621c0d4b30 2024-08-19T00:37:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.058+0000 7f6218c00640 1 -- 172.21.15.7:0/4178868282 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16573 (secure 0 0 0) 0x7f62080591f0 con 0x7f621c0d4b30 2024-08-19T00:37:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:37.060 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:04.356113+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:00.464439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:01.775398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:37.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61fc06be30 msgr2=0x7f61fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61fc06be30 0x7f61fc06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:37.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c0d4b30 msgr2=0x7f621c0b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c0d4b30 0x7f621c0b7c80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f620800c7f0 tx=0x7f620800ccb0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 shutdown_connections 2024-08-19T00:37:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61fc06be30 0x7f61fc06e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c161ba0 0x7f621c0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621c0d4b30 0x7f621c0b7c80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 --2- 172.21.15.7:0/4178868282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621c06c950 0x7f621c155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 >> 172.21.15.7:0/4178868282 conn(0x7f621c08c000 msgr2=0x7f621c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 shutdown_connections 2024-08-19T00:37:37.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.060+0000 7f6223400640 1 -- 172.21.15.7:0/4178868282 wait complete. 2024-08-19T00:37:37.078 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:37:37.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.235+0000 7fef08c00640 1 Processor -- start 2024-08-19T00:37:37.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.235+0000 7fef08c00640 1 -- start start 2024-08-19T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.236+0000 7fef08c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef0406e710 0x7fef04071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.236+0000 7fef08c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef040cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7fef08c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef040cdfb0 con 0x7fef040d03c0 2024-08-19T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7fef08c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fef040cebc0 con 0x7fef0406e710 2024-08-19T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7fef08c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef040ce290 con 0x7fef040b3750 2024-08-19T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7feef9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef0406e710 0x7fef04071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7feef9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef0406e710 0x7fef04071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60856/0 (socket says 172.21.15.7:60856) 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7feef9400640 1 -- 172.21.15.7:0/2241283485 learned_addr learned my addr 172.21.15.7:0/2241283485 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7fef02800640 1 --2- 172.21.15.7:0/2241283485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef040cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7feef9400640 1 -- 172.21.15.7:0/2241283485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 msgr2=0x7fef040cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7feef9400640 1 --2- 172.21.15.7:0/2241283485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef040cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7feef9400640 1 -- 172.21.15.7:0/2241283485 >> v1:172.21.15.162:6789/0 conn(0x7fef040d03c0 legacy=0x7fef040d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7feef9400640 1 -- 172.21.15.7:0/2241283485 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef040ce570 con 0x7fef0406e710 2024-08-19T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.237+0000 7fef02800640 1 --2- 172.21.15.7:0/2241283485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef040cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.238+0000 7feef9400640 1 --2- 172.21.15.7:0/2241283485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef0406e710 0x7fef04071980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feeec0098a0 tx=0x7feeec02c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7545015935a4f0e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef01400640 1 -- 172.21.15.7:0/2241283485 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec038070 con 0x7fef0406e710 2024-08-19T00:37:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef01400640 1 -- 172.21.15.7:0/2241283485 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec031710 con 0x7fef0406e710 2024-08-19T00:37:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef01400640 1 -- 172.21.15.7:0/2241283485 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec031ae0 con 0x7fef0406e710 2024-08-19T00:37:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 -- 172.21.15.7:0/2241283485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef0406e710 msgr2=0x7fef04071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 --2- 172.21.15.7:0/2241283485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef0406e710 0x7fef04071980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feeec0098a0 tx=0x7feeec02c4a0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 -- 172.21.15.7:0/2241283485 shutdown_connections 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 --2- 172.21.15.7:0/2241283485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef040cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 --2- 172.21.15.7:0/2241283485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef0406e710 0x7fef04071980 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 -- 172.21.15.7:0/2241283485 >> 172.21.15.7:0/2241283485 conn(0x7fef0406bc70 msgr2=0x7fef0406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 -- 172.21.15.7:0/2241283485 shutdown_connections 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.239+0000 7fef08c00640 1 -- 172.21.15.7:0/2241283485 wait complete. 2024-08-19T00:37:37.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.241+0000 7fef08c00640 1 Processor -- start 2024-08-19T00:37:37.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.241+0000 7fef08c00640 1 -- start start 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef08c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0406e710 0x7fef04099340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef08c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef0409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef08c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef040d03c0 0x7fef040b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef08c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef04073c60 con 0x7fef040d03c0 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef08c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef04073ae0 con 0x7fef0406e710 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef08c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef040b3be0 con 0x7fef040b3750 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef02800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef040d03c0 0x7fef040b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef02800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef040d03c0 0x7fef040b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60858/0 (socket says 172.21.15.7:60858) 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.242+0000 7fef02800640 1 -- 172.21.15.7:0/505426204 learned_addr learned my addr 172.21.15.7:0/505426204 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7feef9400640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef0409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef01e00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0406e710 0x7fef04099340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef02800640 1 -- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 msgr2=0x7fef0409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef02800640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef0409aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef02800640 1 -- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0406e710 msgr2=0x7fef04099340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef02800640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0406e710 0x7fef04099340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef02800640 1 -- 172.21.15.7:0/505426204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef04099880 con 0x7fef040d03c0 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7feef9400640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef0409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef02800640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef040d03c0 0x7fef040b0bc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feefc007ef0 tx=0x7feefc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7feefaa00640 1 -- 172.21.15.7:0/505426204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc01a070 con 0x7fef040d03c0 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7feefaa00640 1 -- 172.21.15.7:0/505426204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feefc003b90 con 0x7fef040d03c0 2024-08-19T00:37:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7feefaa00640 1 -- 172.21.15.7:0/505426204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc004030 con 0x7fef040d03c0 2024-08-19T00:37:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0409bb60 con 0x7fef040d03c0 2024-08-19T00:37:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.243+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0409c120 con 0x7fef040d03c0 2024-08-19T00:37:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.245+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef04071980 con 0x7fef040d03c0 2024-08-19T00:37:37.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.245+0000 7feefaa00640 1 -- 172.21.15.7:0/505426204 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feefc01d070 con 0x7fef040d03c0 2024-08-19T00:37:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.246+0000 7feefaa00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feee006be30 0x7feee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.246+0000 7feefaa00640 1 -- 172.21.15.7:0/505426204 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feefc08afe0 con 0x7fef040d03c0 2024-08-19T00:37:37.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.247+0000 7fef01e00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feee006be30 0x7feee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.247+0000 7fef01e00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feee006be30 0x7feee006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feef4001640 tx=0x7feef4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:37.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.251+0000 7feefaa00640 1 -- 172.21.15.7:0/505426204 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feefc010070 con 0x7fef040d03c0 2024-08-19T00:37:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.470+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fef040b0290 con 0x7fef040d03c0 2024-08-19T00:37:37.472 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:37:37.471+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:37:37.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.473+0000 7feefaa00640 1 -- 172.21.15.7:0/505426204 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7feefc059370 con 0x7fef040d03c0 2024-08-19T00:37:37.475 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:37:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feee006be30 msgr2=0x7feee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feee006be30 0x7feee006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feef4001640 tx=0x7feef4009040 comp rx=0 tx=0).stop 2024-08-19T00:37:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef040d03c0 msgr2=0x7fef040b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef040d03c0 0x7fef040b0bc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feefc007ef0 tx=0x7feefc00d4a0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 shutdown_connections 2024-08-19T00:37:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feee006be30 0x7feee006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef040d03c0 0x7fef040b0bc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef040b3750 0x7fef0409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 --2- 172.21.15.7:0/505426204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0406e710 0x7fef04099340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 >> 172.21.15.7:0/505426204 conn(0x7fef0406bc70 msgr2=0x7fef040aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 shutdown_connections 2024-08-19T00:37:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.476+0000 7fef08c00640 1 -- 172.21.15.7:0/505426204 wait complete. 2024-08-19T00:37:37.489 INFO:tasks.ceph.mds.d.smithi162.stderr: -6913> 2024-08-19T00:37:07.972+0000 7f3e07400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:37:37.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:37:37.542 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:37:37.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.653+0000 7febd9200640 1 Processor -- start 2024-08-19T00:37:37.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.653+0000 7febd9200640 1 -- start start 2024-08-19T00:37:37.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.654+0000 7febd9200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febd415e3e0 0x7febd40b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.654+0000 7febd9200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7febd40d27b0 0x7febd40d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.654+0000 7febd9200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd40b4df0 con 0x7febd40b4150 2024-08-19T00:37:37.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.654+0000 7febd9200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7febd40d3140 con 0x7febd415e3e0 2024-08-19T00:37:37.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.654+0000 7febd9200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7febd40b50d0 con 0x7febd40d27b0 2024-08-19T00:37:37.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.654+0000 7febd3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febd415e3e0 0x7febd40b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.655+0000 7febd3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febd415e3e0 0x7febd40b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60872/0 (socket says 172.21.15.7:60872) 2024-08-19T00:37:37.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.655+0000 7febd3400640 1 -- 172.21.15.7:0/4162781066 learned_addr learned my addr 172.21.15.7:0/4162781066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:37.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.655+0000 7febcbe00640 1 --2- 172.21.15.7:0/4162781066 >> v2:172.21.15.162:3300/0 conn(0x7febd40d27b0 0x7febd40d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.655+0000 7febd3400640 1 -- 172.21.15.7:0/4162781066 >> v2:172.21.15.162:3300/0 conn(0x7febd40d27b0 msgr2=0x7febd40d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:37.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.655+0000 7febd3400640 1 --2- 172.21.15.7:0/4162781066 >> v2:172.21.15.162:3300/0 conn(0x7febd40d27b0 0x7febd40d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.655+0000 7febd3400640 1 -- 172.21.15.7:0/4162781066 >> v1:172.21.15.162:6789/0 conn(0x7febd40b4150 legacy=0x7febd40b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.655+0000 7febd3400640 1 -- 172.21.15.7:0/4162781066 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd40cf1e0 con 0x7febd415e3e0 2024-08-19T00:37:37.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.656+0000 7febd3400640 1 --2- 172.21.15.7:0/4162781066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd415e3e0 0x7febd40b0e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7febc4009870 tx=0x7febc402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599c45e5def24900 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.656+0000 7febd2a00640 1 -- 172.21.15.7:0/4162781066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4037070 con 0x7febd415e3e0 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.656+0000 7febd2a00640 1 -- 172.21.15.7:0/4162781066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc4032440 con 0x7febd415e3e0 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.656+0000 7febd2a00640 1 -- 172.21.15.7:0/4162781066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4032810 con 0x7febd415e3e0 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 -- 172.21.15.7:0/4162781066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd415e3e0 msgr2=0x7febd40b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 --2- 172.21.15.7:0/4162781066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd415e3e0 0x7febd40b0e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7febc4009870 tx=0x7febc402a2a0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 -- 172.21.15.7:0/4162781066 shutdown_connections 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 --2- 172.21.15.7:0/4162781066 >> v2:172.21.15.162:3300/0 conn(0x7febd40d27b0 0x7febd40d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 --2- 172.21.15.7:0/4162781066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd415e3e0 0x7febd40b0e60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 -- 172.21.15.7:0/4162781066 >> 172.21.15.7:0/4162781066 conn(0x7febd408dbe0 msgr2=0x7febd409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 -- 172.21.15.7:0/4162781066 shutdown_connections 2024-08-19T00:37:37.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.657+0000 7febd9200640 1 -- 172.21.15.7:0/4162781066 wait complete. 2024-08-19T00:37:37.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.659+0000 7febd9200640 1 Processor -- start 2024-08-19T00:37:37.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.659+0000 7febd9200640 1 -- start start 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.659+0000 7febd9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40b4150 0x7febd4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.659+0000 7febd9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febd40d27b0 0x7febd40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd9200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febd415e3e0 0x7febd40cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd9200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7febd40b13a0 con 0x7febd40b4150 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd9200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febd40cee90 con 0x7febd40d27b0 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd9200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febd40cf9e0 con 0x7febd415e3e0 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40b4150 0x7febd4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40b4150 0x7febd4156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60882/0 (socket says 172.21.15.7:60882) 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 -- 172.21.15.7:0/2867959935 learned_addr learned my addr 172.21.15.7:0/2867959935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febcbe00640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febd40d27b0 0x7febd40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3e00640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febd415e3e0 0x7febd40cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 -- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febd415e3e0 msgr2=0x7febd40cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febd415e3e0 0x7febd40cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 -- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febd40d27b0 msgr2=0x7febd40cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febd40d27b0 0x7febd40cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.660+0000 7febd3400640 1 -- 172.21.15.7:0/2867959935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd40c8cb0 con 0x7febd40b4150 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.661+0000 7febd3400640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40b4150 0x7febd4156db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7febc4000c00 tx=0x7febc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.661+0000 7febcb400640 1 -- 172.21.15.7:0/2867959935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4037040 con 0x7febd40b4150 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.661+0000 7febcb400640 1 -- 172.21.15.7:0/2867959935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc4042070 con 0x7febd40b4150 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.661+0000 7febcb400640 1 -- 172.21.15.7:0/2867959935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4030880 con 0x7febd40b4150 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.661+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd40cb700 con 0x7febd40b4150 2024-08-19T00:37:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.661+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd40cbcc0 con 0x7febd40b4150 2024-08-19T00:37:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.662+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd40d2c00 con 0x7febd40b4150 2024-08-19T00:37:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.663+0000 7febcb400640 1 -- 172.21.15.7:0/2867959935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febc4030a20 con 0x7febd40b4150 2024-08-19T00:37:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.664+0000 7febcb400640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febb006be30 0x7febb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.664+0000 7febcb400640 1 -- 172.21.15.7:0/2867959935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7febc40ab640 con 0x7febd40b4150 2024-08-19T00:37:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.664+0000 7febcbe00640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febb006be30 0x7febb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.665+0000 7febcbe00640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febb006be30 0x7febb006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febd415d880 tx=0x7febbc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:37.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.668+0000 7febcb400640 1 -- 172.21.15.7:0/2867959935 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7febc40798a0 con 0x7febd40b4150 2024-08-19T00:37:37.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:37.888+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7febd40cbe90 con 0x7febd40b4150 2024-08-19T00:37:38.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.475+0000 7febcb400640 1 -- 172.21.15.7:0/2867959935 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7febc407dba0 con 0x7febd40b4150 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febb006be30 msgr2=0x7febb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febb006be30 0x7febb006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febd415d880 tx=0x7febbc009190 comp rx=0 tx=0).stop 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40b4150 msgr2=0x7febd4156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40b4150 0x7febd4156db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7febc4000c00 tx=0x7febc40046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 shutdown_connections 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febb006be30 0x7febb006e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febd415e3e0 0x7febd40cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febd40d27b0 0x7febd40cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 --2- 172.21.15.7:0/2867959935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40b4150 0x7febd4156db0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 >> 172.21.15.7:0/2867959935 conn(0x7febd408dbe0 msgr2=0x7febd406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 shutdown_connections 2024-08-19T00:37:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.478+0000 7febd9200640 1 -- 172.21.15.7:0/2867959935 wait complete. 2024-08-19T00:37:38.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:37:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.658+0000 7f0b27400640 1 Processor -- start 2024-08-19T00:37:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.658+0000 7f0b27400640 1 -- start start 2024-08-19T00:37:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.659+0000 7f0b27400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200b5c30 0x7f0b20161f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.659+0000 7f0b27400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b200b6110 con 0x7f0b2015c060 2024-08-19T00:37:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.659+0000 7f0b27400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b200b63f0 con 0x7f0b20162460 2024-08-19T00:37:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.659+0000 7f0b27400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0b200b66d0 con 0x7f0b200b5c30 2024-08-19T00:37:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b24a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0b2015c060 0x7f0b2009b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39958/0 (socket says 172.21.15.7:39958) 2024-08-19T00:37:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b24a00640 1 -- 172.21.15.7:0/1115566107 learned_addr learned my addr 172.21.15.7:0/1115566107 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1fe00640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200b5c30 0x7f0b20161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643742664 0 0) 0x7f0b200b6110 con 0x7f0b2015c060 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b08003520 con 0x7f0b2015c060 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780274757 0 0) 0x7f0b200b63f0 con 0x7f0b20162460 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b200b6110 con 0x7f0b20162460 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4121318023 0 0) 0x7f0b08003520 con 0x7f0b2015c060 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200b5c30 msgr2=0x7f0b20161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200b5c30 0x7f0b20161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 >> v1:172.21.15.162:6789/0 conn(0x7f0b20162460 legacy=0x7f0b2006f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b200b69b0 con 0x7f0b2015c060 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.660+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f0b14001670 con 0x7f0b2015c060 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 >> v1:172.21.15.7:6789/0 conn(0x7f0b2015c060 legacy=0x7f0b2009b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1f400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b08003b70 0x7f0b08003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1f400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b08004800 0x7f0b08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1f400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0b200b66d0 con 0x7f0b080051c0 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0800bfb0 con 0x7f0b08003b70 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0800c1b0 con 0x7f0b08004800 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1fe00640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200b5c30 0x7f0b20161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b25400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b24a00640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b08003b70 0x7f0b08003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b1fe00640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b08004800 0x7f0b08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b25400640 1 -- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b08004800 msgr2=0x7f0b08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b25400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b08004800 0x7f0b08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b25400640 1 -- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b08003b70 msgr2=0x7f0b08003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b25400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b08003b70 0x7f0b08003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.661+0000 7f0b25400640 1 -- 172.21.15.7:0/1115566107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b08003520 con 0x7f0b080051c0 2024-08-19T00:37:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.662+0000 7f0b25400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b0800b9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b18001fc0 tx=0x7f0b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55edf5819b6de99 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18001be0 con 0x7f0b080051c0 2024-08-19T00:37:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b18003b90 con 0x7f0b080051c0 2024-08-19T00:37:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b1f400640 1 -- 172.21.15.7:0/1115566107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180050d0 con 0x7f0b080051c0 2024-08-19T00:37:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b27400640 1 -- 172.21.15.7:0/1115566107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 msgr2=0x7f0b0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b27400640 1 --2- 172.21.15.7:0/1115566107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b0800b9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b18001fc0 tx=0x7f0b08005830 comp rx=0 tx=0).stop 2024-08-19T00:37:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b25400640 1 -- 172.21.15.7:0/1115566107 reap_dead start 2024-08-19T00:37:38.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b27400640 1 -- 172.21.15.7:0/1115566107 shutdown_connections 2024-08-19T00:37:38.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b27400640 1 -- 172.21.15.7:0/1115566107 >> 172.21.15.7:0/1115566107 conn(0x7f0b200b3db0 msgr2=0x7f0b200b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:38.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b27400640 1 -- 172.21.15.7:0/1115566107 shutdown_connections 2024-08-19T00:37:38.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.663+0000 7f0b27400640 1 -- 172.21.15.7:0/1115566107 wait complete. 2024-08-19T00:37:38.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.665+0000 7f0b27400640 1 Processor -- start 2024-08-19T00:37:38.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.665+0000 7f0b27400640 1 -- start start 2024-08-19T00:37:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b27400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b20155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b27400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200cb430 0x7f0b2015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b27400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b200afca0 0x7f0b20160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b27400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0b200b71b0 con 0x7f0b080051c0 2024-08-19T00:37:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b27400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2009bc00 con 0x7f0b200afca0 2024-08-19T00:37:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b27400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0b200b7330 con 0x7f0b200cb430 2024-08-19T00:37:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b24a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b20155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b24a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b20155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60896/0 (socket says 172.21.15.7:60896) 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b24a00640 1 -- 172.21.15.7:0/329726134 learned_addr learned my addr 172.21.15.7:0/329726134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b25400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b200afca0 0x7f0b20160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.666+0000 7f0b1fe00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200cb430 0x7f0b2015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b24a00640 1 -- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200cb430 msgr2=0x7f0b2015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b24a00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200cb430 0x7f0b2015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b24a00640 1 -- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b200afca0 msgr2=0x7f0b20160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b24a00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b200afca0 0x7f0b20160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b24a00640 1 -- 172.21.15.7:0/329726134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b200cb8c0 con 0x7f0b080051c0 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b25400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b200afca0 0x7f0b20160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b1fe00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200cb430 0x7f0b2015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:38.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b24a00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b20155f70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b14007310 tx=0x7f0b140077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:38.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b1cc00640 1 -- 172.21.15.7:0/329726134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400f9c0 con 0x7f0b080051c0 2024-08-19T00:37:38.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b1cc00640 1 -- 172.21.15.7:0/329726134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b14018070 con 0x7f0b080051c0 2024-08-19T00:37:38.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b1cc00640 1 -- 172.21.15.7:0/329726134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400fdc0 con 0x7f0b080051c0 2024-08-19T00:37:38.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b200af1c0 con 0x7f0b080051c0 2024-08-19T00:37:38.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.667+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b200cbba0 con 0x7f0b080051c0 2024-08-19T00:37:38.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.668+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b200b6350 con 0x7f0b080051c0 2024-08-19T00:37:38.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.669+0000 7f0b1cc00640 1 -- 172.21.15.7:0/329726134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b1401d460 con 0x7f0b080051c0 2024-08-19T00:37:38.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.670+0000 7f0b1cc00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b0006be30 0x7f0b0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:38.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.670+0000 7f0b1cc00640 1 -- 172.21.15.7:0/329726134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f0b1408b030 con 0x7f0b080051c0 2024-08-19T00:37:38.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.670+0000 7f0b1fe00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b0006be30 0x7f0b0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:38.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.671+0000 7f0b1fe00640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b0006be30 0x7f0b0006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b201f7850 tx=0x7f0b0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:38.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.675+0000 7f0b1cc00640 1 -- 172.21.15.7:0/329726134 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0b14059970 con 0x7f0b080051c0 2024-08-19T00:37:38.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:38.860+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b20073eb0 con 0x7f0b080051c0 2024-08-19T00:37:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.477+0000 7f0b1cc00640 1 -- 172.21.15.7:0/329726134 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f0b14059270 con 0x7f0b080051c0 2024-08-19T00:37:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:37:39.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b0006be30 msgr2=0x7f0b0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b0006be30 0x7f0b0006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b201f7850 tx=0x7f0b0c008040 comp rx=0 tx=0).stop 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 msgr2=0x7f0b20155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b20155f70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b14007310 tx=0x7f0b140077d0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 shutdown_connections 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b0006be30 0x7f0b0006e2f0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b201f7850 tx=0x7f0b0c008040 comp rx=0 tx=0).stop 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b200afca0 0x7f0b20160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b200cb430 0x7f0b2015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 --2- 172.21.15.7:0/329726134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b080051c0 0x7f0b20155f70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.480+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 >> 172.21.15.7:0/329726134 conn(0x7f0b200b3db0 msgr2=0x7f0b201575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.481+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 shutdown_connections 2024-08-19T00:37:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.481+0000 7f0b27400640 1 -- 172.21.15.7:0/329726134 wait complete. 2024-08-19T00:37:39.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:37:39.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.667+0000 7f8a04c00640 1 Processor -- start 2024-08-19T00:37:39.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.667+0000 7f8a04c00640 1 -- start start 2024-08-19T00:37:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.668+0000 7f8a04c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a0015e400 0x7f8a0009b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.668+0000 7f8a04c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a0006d070 0x7f8a0006fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.668+0000 7f8a04c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0009bad0 con 0x7f8a000d1260 2024-08-19T00:37:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.668+0000 7f8a04c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8a000d0780 con 0x7f8a0006d070 2024-08-19T00:37:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.668+0000 7f8a04c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a000d0a60 con 0x7f8a0015e400 2024-08-19T00:37:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fde00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a0015e400 0x7f8a0009b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fe800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a0006d070 0x7f8a0006fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fe800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a0006d070 0x7f8a0006fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:37604/0 (socket says 172.21.15.7:37604) 2024-08-19T00:37:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fe800640 1 -- 172.21.15.7:0/3828372663 learned_addr learned my addr 172.21.15.7:0/3828372663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fde00640 1 --2- 172.21.15.7:0/3828372663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a0015e400 0x7f8a0009b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:33448/0 (socket says 172.21.15.7:33448) 2024-08-19T00:37:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fde00640 1 -- 172.21.15.7:0/3828372663 >> v2:172.21.15.162:3300/0 conn(0x7f8a0006d070 msgr2=0x7f8a0006fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fde00640 1 --2- 172.21.15.7:0/3828372663 >> v2:172.21.15.162:3300/0 conn(0x7f8a0006d070 0x7f8a0006fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fde00640 1 -- 172.21.15.7:0/3828372663 >> v1:172.21.15.162:6789/0 conn(0x7f8a000d1260 legacy=0x7f8a0006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fde00640 1 -- 172.21.15.7:0/3828372663 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a000d0d40 con 0x7f8a0015e400 2024-08-19T00:37:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.669+0000 7f89fe800640 1 --2- 172.21.15.7:0/3828372663 >> v2:172.21.15.162:3300/0 conn(0x7f8a0006d070 0x7f8a0006fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.670+0000 7f89fde00640 1 --2- 172.21.15.7:0/3828372663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a0015e400 0x7f8a0009b480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f89f00097a0 tx=0x7f89f002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cec8dc3e926174 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f89fca00640 1 -- 172.21.15.7:0/3828372663 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0037070 con 0x7f8a0015e400 2024-08-19T00:37:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f89fca00640 1 -- 172.21.15.7:0/3828372663 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f002ae50 con 0x7f8a0015e400 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f89fca00640 1 -- 172.21.15.7:0/3828372663 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0032660 con 0x7f8a0015e400 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 -- 172.21.15.7:0/3828372663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a0015e400 msgr2=0x7f8a0009b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 --2- 172.21.15.7:0/3828372663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a0015e400 0x7f8a0009b480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f89f00097a0 tx=0x7f89f002a100 comp rx=0 tx=0).stop 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 -- 172.21.15.7:0/3828372663 shutdown_connections 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 --2- 172.21.15.7:0/3828372663 >> v2:172.21.15.162:3300/0 conn(0x7f8a0006d070 0x7f8a0006fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 --2- 172.21.15.7:0/3828372663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a0015e400 0x7f8a0009b480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 -- 172.21.15.7:0/3828372663 >> 172.21.15.7:0/3828372663 conn(0x7f8a000d2160 msgr2=0x7f8a000d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 -- 172.21.15.7:0/3828372663 shutdown_connections 2024-08-19T00:37:39.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.671+0000 7f8a04c00640 1 -- 172.21.15.7:0/3828372663 wait complete. 2024-08-19T00:37:39.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.673+0000 7f8a04c00640 1 Processor -- start 2024-08-19T00:37:39.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.673+0000 7f8a04c00640 1 -- start start 2024-08-19T00:37:39.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f8a04c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006d070 0x7f8a001576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:39.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f8a04c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a000d1260 0x7f8a000c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:39.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f8a04c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0015e400 0x7f8a000c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:39.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f8a04c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0015e7e0 con 0x7f8a0015e400 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f8a04c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000d0430 con 0x7f8a0006d070 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f8a04c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a001e5c40 con 0x7f8a000d1260 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f89fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0015e400 0x7f8a000c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f89fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0015e400 0x7f8a000c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60898/0 (socket says 172.21.15.7:60898) 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f89fe800640 1 -- 172.21.15.7:0/1941650284 learned_addr learned my addr 172.21.15.7:0/1941650284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f89fde00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006d070 0x7f8a001576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.674+0000 7f89fd400640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a000d1260 0x7f8a000c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89fe800640 1 -- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a000d1260 msgr2=0x7f8a000c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89fe800640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a000d1260 0x7f8a000c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89fe800640 1 -- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006d070 msgr2=0x7f8a001576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89fe800640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006d070 0x7f8a001576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89fe800640 1 -- 172.21.15.7:0/1941650284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a001e76d0 con 0x7f8a0015e400 2024-08-19T00:37:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89fe800640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0015e400 0x7f8a000c9910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89f800efc0 tx=0x7f89f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89f6000640 1 -- 172.21.15.7:0/1941650284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f800cbe0 con 0x7f8a0015e400 2024-08-19T00:37:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89f6000640 1 -- 172.21.15.7:0/1941650284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f800cd80 con 0x7f8a0015e400 2024-08-19T00:37:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a001e5960 con 0x7f8a0015e400 2024-08-19T00:37:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.675+0000 7f89f6000640 1 -- 172.21.15.7:0/1941650284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8003bb0 con 0x7f8a0015e400 2024-08-19T00:37:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.676+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a001e7c50 con 0x7f8a0015e400 2024-08-19T00:37:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.677+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a00157c60 con 0x7f8a0015e400 2024-08-19T00:37:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.678+0000 7f89f6000640 1 -- 172.21.15.7:0/1941650284 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89f801b030 con 0x7f8a0015e400 2024-08-19T00:37:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.678+0000 7f89f6000640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89e006be30 0x7f89e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.679+0000 7f89f6000640 1 -- 172.21.15.7:0/1941650284 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f89f808afa0 con 0x7f8a0015e400 2024-08-19T00:37:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.679+0000 7f89fde00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89e006be30 0x7f89e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.679+0000 7f89fde00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89e006be30 0x7f89e006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89f0034000 tx=0x7f89f002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:39.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.683+0000 7f89f6000640 1 -- 172.21.15.7:0/1941650284 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f89f8022020 con 0x7f8a0015e400 2024-08-19T00:37:39.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:39.867+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8a000d1680 con 0x7f8a0015e400 2024-08-19T00:37:40.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.479+0000 7f89f6000640 1 -- 172.21.15.7:0/1941650284 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f89f8010040 con 0x7f8a0015e400 2024-08-19T00:37:40.480 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-08-19T00:37:40.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.482+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89e006be30 msgr2=0x7f89e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:40.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.482+0000 7f8a04c00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89e006be30 0x7f89e006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89f0034000 tx=0x7f89f002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:40.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0015e400 msgr2=0x7f8a000c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:40.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0015e400 0x7f8a000c9910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89f800efc0 tx=0x7f89f800c490 comp rx=0 tx=0).stop 2024-08-19T00:37:40.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 shutdown_connections 2024-08-19T00:37:40.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89e006be30 0x7f89e006e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0015e400 0x7f8a000c9910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a000d1260 0x7f8a000c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 --2- 172.21.15.7:0/1941650284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a0006d070 0x7f8a001576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.483+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 >> 172.21.15.7:0/1941650284 conn(0x7f8a000d2160 msgr2=0x7f8a000b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:40.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.484+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 shutdown_connections 2024-08-19T00:37:40.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.484+0000 7f8a04c00640 1 -- 172.21.15.7:0/1941650284 wait complete. 2024-08-19T00:37:40.505 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:37:40.505 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-19T00:37:40.505 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:37:40.505 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:37:40.505 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:37:40.505 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-19T00:37:40.506 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:37:40.506 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:37:40.506 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-19T00:37:40.506 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-19T00:37:40.506 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-19T00:37:40.506 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:37:40.506 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-19T00:37:40.507 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-19T00:37:40.507 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-19T00:37:40.507 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:37:40.522 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:37:40.522 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:37:40.523 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:37:40.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:37:40.524 INFO:tasks.ceph.mds.b:Stopped 2024-08-19T00:37:40.524 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-19T00:37:40.525 INFO:tasks.ceph.mds.d:Stopped 2024-08-19T00:37:40.525 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-19T00:37:40.566 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:37:40.567 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:40.568 INFO:tasks.ceph.mds.b:Started 2024-08-19T00:37:40.568 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:40.569 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:37:40.569 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:40.571 INFO:tasks.ceph.mds.d:Started 2024-08-19T00:37:40.571 DEBUG:teuthology.parallel:result is None 2024-08-19T00:37:40.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-19T00:37:40.701 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:37:40.701 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:37:40.703 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:37:40.704 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:37:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.735+0000 7fc6a5800640 1 Processor -- start 2024-08-19T00:37:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.735+0000 7fc6a5800640 1 -- start start 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.736+0000 7fc6a5800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6a013dc30 0x7fc6a0140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.736+0000 7fc6a5800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a0140640 0x7fc6a006d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.736+0000 7fc6a5800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc6a006db40 0x7fc6a0072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.736+0000 7fc6a5800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a015e930 con 0x7fc6a013dc30 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.736+0000 7fc6a5800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a015ec10 con 0x7fc6a006db40 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.736+0000 7fc6a5800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a015eef0 con 0x7fc6a0140640 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6a013dc30 0x7fc6a0140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6a013dc30 0x7fc6a0140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60940/0 (socket says 172.21.15.7:60940) 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 -- 172.21.15.7:0/3349146234 learned_addr learned my addr 172.21.15.7:0/3349146234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc697e00640 1 --2- 172.21.15.7:0/3349146234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a0140640 0x7fc6a006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc6a4e00640 1 --2- 172.21.15.7:0/3349146234 >> v2:172.21.15.162:3300/0 conn(0x7fc6a006db40 0x7fc6a0072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 -- 172.21.15.7:0/3349146234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a0140640 msgr2=0x7fc6a006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 --2- 172.21.15.7:0/3349146234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a0140640 0x7fc6a006d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 -- 172.21.15.7:0/3349146234 >> v2:172.21.15.162:3300/0 conn(0x7fc6a006db40 msgr2=0x7fc6a0072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 --2- 172.21.15.7:0/3349146234 >> v2:172.21.15.162:3300/0 conn(0x7fc6a006db40 0x7fc6a0072920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc69fe00640 1 -- 172.21.15.7:0/3349146234 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a015f1d0 con 0x7fc6a013dc30 2024-08-19T00:37:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.737+0000 7fc6a4e00640 1 --2- 172.21.15.7:0/3349146234 >> v2:172.21.15.162:3300/0 conn(0x7fc6a006db40 0x7fc6a0072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.738+0000 7fc69fe00640 1 --2- 172.21.15.7:0/3349146234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a013dc30 0x7fc6a0140ce0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00cd530 tx=0x7fc69002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f605e7b2a3491f97 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc69f400640 1 -- 172.21.15.7:0/3349146234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690037070 con 0x7fc6a013dc30 2024-08-19T00:37:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc69f400640 1 -- 172.21.15.7:0/3349146234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc690032440 con 0x7fc6a013dc30 2024-08-19T00:37:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc69f400640 1 -- 172.21.15.7:0/3349146234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690032810 con 0x7fc6a013dc30 2024-08-19T00:37:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 -- 172.21.15.7:0/3349146234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a013dc30 msgr2=0x7fc6a0140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3349146234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a013dc30 0x7fc6a0140ce0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00cd530 tx=0x7fc69002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 -- 172.21.15.7:0/3349146234 shutdown_connections 2024-08-19T00:37:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3349146234 >> v2:172.21.15.162:3300/0 conn(0x7fc6a006db40 0x7fc6a0072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3349146234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a0140640 0x7fc6a006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3349146234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a013dc30 0x7fc6a0140ce0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 -- 172.21.15.7:0/3349146234 >> 172.21.15.7:0/3349146234 conn(0x7fc6a006b850 msgr2=0x7fc6a006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 -- 172.21.15.7:0/3349146234 shutdown_connections 2024-08-19T00:37:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.739+0000 7fc6a5800640 1 -- 172.21.15.7:0/3349146234 wait complete. 2024-08-19T00:37:40.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.741+0000 7fc6a5800640 1 Processor -- start 2024-08-19T00:37:40.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.741+0000 7fc6a5800640 1 -- start start 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6a006db40 0x7fc6a00b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a5800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a013dc30 0x7fc6a00b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a0140640 0x7fc6a01f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a5800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01413a0 con 0x7fc6a0140640 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a5800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0141220 con 0x7fc6a006db40 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a5800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a013e010 con 0x7fc6a013dc30 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a0140640 0x7fc6a01f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a0140640 0x7fc6a01f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60948/0 (socket says 172.21.15.7:60948) 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc6a4e00640 1 -- 172.21.15.7:0/3524831643 learned_addr learned my addr 172.21.15.7:0/3524831643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc69fe00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6a006db40 0x7fc6a00b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.742+0000 7fc697e00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a013dc30 0x7fc6a00b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a4e00640 1 -- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a013dc30 msgr2=0x7fc6a00b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a4e00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a013dc30 0x7fc6a00b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a4e00640 1 -- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6a006db40 msgr2=0x7fc6a00b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a4e00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6a006db40 0x7fc6a00b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a4e00640 1 -- 172.21.15.7:0/3524831643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a012d240 con 0x7fc6a0140640 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc697e00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a013dc30 0x7fc6a00b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a4e00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a0140640 0x7fc6a01f4280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc698007ef0 tx=0x7fc69800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc69cc00640 1 -- 172.21.15.7:0/3524831643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69801a070 con 0x7fc6a0140640 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc69cc00640 1 -- 172.21.15.7:0/3524831643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc698003b90 con 0x7fc6a0140640 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc69cc00640 1 -- 172.21.15.7:0/3524831643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698004030 con 0x7fc6a0140640 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a012d520 con 0x7fc6a0140640 2024-08-19T00:37:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.743+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a012dae0 con 0x7fc6a0140640 2024-08-19T00:37:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.744+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a0140ce0 con 0x7fc6a0140640 2024-08-19T00:37:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.745+0000 7fc69cc00640 1 -- 172.21.15.7:0/3524831643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc69801d070 con 0x7fc6a0140640 2024-08-19T00:37:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.746+0000 7fc69cc00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.746+0000 7fc69cc00640 1 -- 172.21.15.7:0/3524831643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7fc69808add0 con 0x7fc6a0140640 2024-08-19T00:37:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.746+0000 7fc69fe00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.747+0000 7fc69fe00640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc690034000 tx=0x7fc69002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.750+0000 7fc69cc00640 1 -- 172.21.15.7:0/3524831643 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc698010070 con 0x7fc6a0140640 2024-08-19T00:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:40.958+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc6a006c860 con 0x7fc6a0140640 2024-08-19T00:37:41.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.489+0000 7fc69cc00640 1 -- 172.21.15.7:0/3524831643 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7fc698059390 con 0x7fc6a0140640 2024-08-19T00:37:41.491 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-08-19T00:37:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 msgr2=0x7fc67c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc690034000 tx=0x7fc69002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a0140640 msgr2=0x7fc6a01f4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a0140640 0x7fc6a01f4280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc698007ef0 tx=0x7fc69800d4a0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 shutdown_connections 2024-08-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6a0140640 0x7fc6a01f4280 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6a013dc30 0x7fc6a00b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 --2- 172.21.15.7:0/3524831643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6a006db40 0x7fc6a00b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.492+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 >> 172.21.15.7:0/3524831643 conn(0x7fc6a006b850 msgr2=0x7fc6a01544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.493+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 shutdown_connections 2024-08-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.493+0000 7fc6a5800640 1 -- 172.21.15.7:0/3524831643 wait complete. 2024-08-19T00:37:41.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-19T00:37:41.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.671+0000 7ff790a00640 1 Processor -- start 2024-08-19T00:37:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.671+0000 7ff790a00640 1 -- start start 2024-08-19T00:37:41.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff790a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c0d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:41.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff790a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff78c0d3f90 0x7ff78c0d43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:41.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff790a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff78c0b4340 con 0x7ff78c15e2c0 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff790a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff78c0d3320 con 0x7ff78c0d3f90 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff790a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c0b4620 con 0x7ff78c15e6a0 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff78aa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c0d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff78b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff78c15e2c0 0x7ff78c0b3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:38388/0 (socket says 172.21.15.7:38388) 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff78be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff78c0d3f90 0x7ff78c0d43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.672+0000 7ff78b400640 1 -- 172.21.15.7:0/4028427361 learned_addr learned my addr 172.21.15.7:0/4028427361 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.673+0000 7ff78aa00640 1 -- 172.21.15.7:0/4028427361 >> v2:172.21.15.162:3300/0 conn(0x7ff78c0d3f90 msgr2=0x7ff78c0d43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.673+0000 7ff78aa00640 1 --2- 172.21.15.7:0/4028427361 >> v2:172.21.15.162:3300/0 conn(0x7ff78c0d3f90 0x7ff78c0d43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.673+0000 7ff78aa00640 1 -- 172.21.15.7:0/4028427361 >> v1:172.21.15.162:6789/0 conn(0x7ff78c15e2c0 legacy=0x7ff78c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.673+0000 7ff78a000640 1 -- 172.21.15.7:0/4028427361 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233368401 0 0) 0x7ff78c0b4340 con 0x7ff78c15e2c0 2024-08-19T00:37:41.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.673+0000 7ff78aa00640 1 -- 172.21.15.7:0/4028427361 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c0b4900 con 0x7ff78c15e6a0 2024-08-19T00:37:41.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.673+0000 7ff78be00640 1 --2- 172.21.15.7:0/4028427361 >> v2:172.21.15.162:3300/0 conn(0x7ff78c0d3f90 0x7ff78c0d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.674+0000 7ff78aa00640 1 --2- 172.21.15.7:0/4028427361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c0d2de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7780097a0 tx=0x7ff77802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff15fc8c7c9abde7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.674+0000 7ff78a000640 1 -- 172.21.15.7:0/4028427361 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778037070 con 0x7ff78c15e6a0 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.674+0000 7ff78a000640 1 -- 172.21.15.7:0/4028427361 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff778032440 con 0x7ff78c15e6a0 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.674+0000 7ff78a000640 1 -- 172.21.15.7:0/4028427361 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778032810 con 0x7ff78c15e6a0 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 -- 172.21.15.7:0/4028427361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 msgr2=0x7ff78c0d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 --2- 172.21.15.7:0/4028427361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c0d2de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7780097a0 tx=0x7ff77802a180 comp rx=0 tx=0).stop 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 -- 172.21.15.7:0/4028427361 shutdown_connections 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 --2- 172.21.15.7:0/4028427361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c0d2de0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 --2- 172.21.15.7:0/4028427361 >> v2:172.21.15.162:3300/0 conn(0x7ff78c0d3f90 0x7ff78c0d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 -- 172.21.15.7:0/4028427361 >> 172.21.15.7:0/4028427361 conn(0x7ff78c08dbe0 msgr2=0x7ff78c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 -- 172.21.15.7:0/4028427361 shutdown_connections 2024-08-19T00:37:41.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.675+0000 7ff790a00640 1 -- 172.21.15.7:0/4028427361 wait complete. 2024-08-19T00:37:41.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.677+0000 7ff790a00640 1 Processor -- start 2024-08-19T00:37:41.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.677+0000 7ff790a00640 1 -- start start 2024-08-19T00:37:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff790a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff78c0d3f90 0x7ff78c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff790a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78c15e2c0 0x7ff78c14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff790a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff790a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c0d4920 con 0x7ff78c15e2c0 2024-08-19T00:37:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff790a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c0b4ec0 con 0x7ff78c0d3f90 2024-08-19T00:37:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff790a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c0cede0 con 0x7ff78c15e6a0 2024-08-19T00:37:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78c15e2c0 0x7ff78c14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78c15e2c0 0x7ff78c14acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60962/0 (socket says 172.21.15.7:60962) 2024-08-19T00:37:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 -- 172.21.15.7:0/2105454311 learned_addr learned my addr 172.21.15.7:0/2105454311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78be00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78b400640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff78c0d3f90 0x7ff78c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 -- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 msgr2=0x7ff78c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 -- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff78c0d3f90 msgr2=0x7ff78c0b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff78c0d3f90 0x7ff78c0b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.678+0000 7ff78aa00640 1 -- 172.21.15.7:0/2105454311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c0c95d0 con 0x7ff78c15e2c0 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.679+0000 7ff78aa00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78c15e2c0 0x7ff78c14acf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff778000c00 tx=0x7ff7780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.679+0000 7ff783400640 1 -- 172.21.15.7:0/2105454311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778037040 con 0x7ff78c15e2c0 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.679+0000 7ff783400640 1 -- 172.21.15.7:0/2105454311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff778042070 con 0x7ff78c15e2c0 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.679+0000 7ff783400640 1 -- 172.21.15.7:0/2105454311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778030920 con 0x7ff78c15e2c0 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.679+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c0c98b0 con 0x7ff78c15e2c0 2024-08-19T00:37:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.679+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c0c9e70 con 0x7ff78c15e2c0 2024-08-19T00:37:41.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.680+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78c0d43e0 con 0x7ff78c15e2c0 2024-08-19T00:37:41.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.681+0000 7ff783400640 1 -- 172.21.15.7:0/2105454311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff778030ac0 con 0x7ff78c15e2c0 2024-08-19T00:37:41.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.682+0000 7ff783400640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff76c06be60 0x7ff76c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:41.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.682+0000 7ff783400640 1 -- 172.21.15.7:0/2105454311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7ff7780ab480 con 0x7ff78c15e2c0 2024-08-19T00:37:41.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.683+0000 7ff78b400640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff76c06be60 0x7ff76c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:41.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.683+0000 7ff78b400640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff76c06be60 0x7ff76c06e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000f60 tx=0x7ff77c007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.686+0000 7ff783400640 1 -- 172.21.15.7:0/2105454311 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff778079a90 con 0x7ff78c15e2c0 2024-08-19T00:37:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.941+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff78c0ce700 con 0x7ff78c15e2c0 2024-08-19T00:37:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.942+0000 7ff783400640 1 -- 172.21.15.7:0/2105454311 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7ff77807dd90 con 0x7ff78c15e2c0 2024-08-19T00:37:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:41.944 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:37:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-08-19T00:37:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-08-19T00:37:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g==", 2024-08-19T00:37:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:37:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:37:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA==", 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ==", 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:37:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA==", 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA==", 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ==", 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ==", 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w==", 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg==", 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-08-19T00:37:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ==", 2024-08-19T00:37:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-08-19T00:37:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA==", 2024-08-19T00:37:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-08-19T00:37:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA==", 2024-08-19T00:37:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:37:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:37:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-08-19T00:37:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA==", 2024-08-19T00:37:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA==", 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:37:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:37:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:37:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-08-19T00:37:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ==", 2024-08-19T00:37:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg==", 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8Jmuq0sEBAA7n5q8IKlS3tRogqIwCSCeQ==", 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mds", 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCWk8JmTp1FDhAAvHYW3PAt4mpXzNsI9olD2w==", 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mds" 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mgr", 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCWk8JmwKZFDhAATv2I6+Q4UpfCq3Jfv3CQMg==", 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-osd", 2024-08-19T00:37:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCWk8JmTbBFDhAAG2vAUxunnNG0VBqRDr3teQ==", 2024-08-19T00:37:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-osd" 2024-08-19T00:37:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd", 2024-08-19T00:37:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCWk8Jm4bhFDhAAhYxzg87eNEAwIRD6iD4LyQ==", 2024-08-19T00:37:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-19T00:37:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-19T00:37:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCWk8Jm+cBFDhAAFJm+CXaTjvY1PNyf2KWQzw==", 2024-08-19T00:37:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-19T00:37:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rgw", 2024-08-19T00:37:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCWk8JmP8lFDhAAX40Wc302wP5LgaFNSYWlxg==", 2024-08-19T00:37:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-19T00:37:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ==", 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:37:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg==", 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:37:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:37:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-08-19T00:37:41.972 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:37:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff76c06be60 msgr2=0x7ff76c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff76c06be60 0x7ff76c06e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000f60 tx=0x7ff77c007b70 comp rx=0 tx=0).stop 2024-08-19T00:37:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78c15e2c0 msgr2=0x7ff78c14acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78c15e2c0 0x7ff78c14acf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff778000c00 tx=0x7ff7780046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 shutdown_connections 2024-08-19T00:37:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff76c06be60 0x7ff76c06e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff78c15e6a0 0x7ff78c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff78c15e2c0 0x7ff78c14acf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.944+0000 7ff790a00640 1 --2- 172.21.15.7:0/2105454311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff78c0d3f90 0x7ff78c0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.945+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 >> 172.21.15.7:0/2105454311 conn(0x7ff78c08dbe0 msgr2=0x7ff78c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.945+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 shutdown_connections 2024-08-19T00:37:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:41.945+0000 7ff790a00640 1 -- 172.21.15.7:0/2105454311 wait complete. 2024-08-19T00:37:41.976 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-19T00:37:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.132+0000 7fd6fc800640 1 Processor -- start 2024-08-19T00:37:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.132+0000 7fd6fc800640 1 -- start start 2024-08-19T00:37:42.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.133+0000 7fd6fc800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6f40d03c0 0x7fd6f4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.133+0000 7fd6fc800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f406e710 0x7fd6f40d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.133+0000 7fd6fc800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd6f40b3750 0x7fd6f40cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.133+0000 7fd6fc800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f40cebc0 con 0x7fd6f40b3750 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.133+0000 7fd6fc800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f40d0ce0 con 0x7fd6f40d03c0 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.133+0000 7fd6fc800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f40cdfb0 con 0x7fd6f406e710 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd6f40b3750 0x7fd6f40cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd6f40b3750 0x7fd6f40cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60974/0 (socket says 172.21.15.7:60974) 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 -- 172.21.15.7:0/4070978819 learned_addr learned my addr 172.21.15.7:0/4070978819 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6f9e00640 1 --2- 172.21.15.7:0/4070978819 >> v2:172.21.15.162:3300/0 conn(0x7fd6f40d03c0 0x7fd6f4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6f9400640 1 --2- 172.21.15.7:0/4070978819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f406e710 0x7fd6f40d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 -- 172.21.15.7:0/4070978819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f406e710 msgr2=0x7fd6f40d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 --2- 172.21.15.7:0/4070978819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f406e710 0x7fd6f40d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 -- 172.21.15.7:0/4070978819 >> v2:172.21.15.162:3300/0 conn(0x7fd6f40d03c0 msgr2=0x7fd6f4071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 --2- 172.21.15.7:0/4070978819 >> v2:172.21.15.162:3300/0 conn(0x7fd6f40d03c0 0x7fd6f4071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.134+0000 7fd6fa800640 1 -- 172.21.15.7:0/4070978819 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f40ce290 con 0x7fd6f40b3750 2024-08-19T00:37:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.135+0000 7fd6fa800640 1 --2- 172.21.15.7:0/4070978819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40b3750 0x7fd6f40cf050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd6f406f030 tx=0x7fd6f002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696ea448180e0934 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6f8a00640 1 -- 172.21.15.7:0/4070978819 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0033400 con 0x7fd6f40b3750 2024-08-19T00:37:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6f8a00640 1 -- 172.21.15.7:0/4070978819 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f00335a0 con 0x7fd6f40b3750 2024-08-19T00:37:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6f8a00640 1 -- 172.21.15.7:0/4070978819 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0033970 con 0x7fd6f40b3750 2024-08-19T00:37:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 -- 172.21.15.7:0/4070978819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40b3750 msgr2=0x7fd6f40cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 --2- 172.21.15.7:0/4070978819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40b3750 0x7fd6f40cf050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd6f406f030 tx=0x7fd6f002c8b0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 -- 172.21.15.7:0/4070978819 shutdown_connections 2024-08-19T00:37:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 --2- 172.21.15.7:0/4070978819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40b3750 0x7fd6f40cf050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 --2- 172.21.15.7:0/4070978819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f406e710 0x7fd6f40d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 --2- 172.21.15.7:0/4070978819 >> v2:172.21.15.162:3300/0 conn(0x7fd6f40d03c0 0x7fd6f4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 -- 172.21.15.7:0/4070978819 >> 172.21.15.7:0/4070978819 conn(0x7fd6f406bc70 msgr2=0x7fd6f406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 -- 172.21.15.7:0/4070978819 shutdown_connections 2024-08-19T00:37:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.136+0000 7fd6fc800640 1 -- 172.21.15.7:0/4070978819 wait complete. 2024-08-19T00:37:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.138+0000 7fd6fc800640 1 Processor -- start 2024-08-19T00:37:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.138+0000 7fd6fc800640 1 -- start start 2024-08-19T00:37:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fc800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f406e710 0x7fd6f41f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fc800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f40b3750 0x7fd6f409caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fc800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40d03c0 0x7fd6f40ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fc800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4073ae0 con 0x7fd6f40d03c0 2024-08-19T00:37:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fc800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f40ce850 con 0x7fd6f406e710 2024-08-19T00:37:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fc800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f4073c60 con 0x7fd6f40b3750 2024-08-19T00:37:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40d03c0 0x7fd6f40ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40d03c0 0x7fd6f40ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60978/0 (socket says 172.21.15.7:60978) 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fa800640 1 -- 172.21.15.7:0/1912148655 learned_addr learned my addr 172.21.15.7:0/1912148655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6f9e00640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f406e710 0x7fd6f41f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6f9400640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f40b3750 0x7fd6f409caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fa800640 1 -- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f40b3750 msgr2=0x7fd6f409caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.139+0000 7fd6fa800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f40b3750 0x7fd6f409caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6fa800640 1 -- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f406e710 msgr2=0x7fd6f41f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6fa800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f406e710 0x7fd6f41f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6fa800640 1 -- 172.21.15.7:0/1912148655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f409de10 con 0x7fd6f40d03c0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6f9e00640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f406e710 0x7fd6f41f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6fa800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40d03c0 0x7fd6f40ca1b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009f40 tx=0x7fd6f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6ee000640 1 -- 172.21.15.7:0/1912148655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0040070 con 0x7fd6f40d03c0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6ee000640 1 -- 172.21.15.7:0/1912148655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f003c620 con 0x7fd6f40d03c0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6ee000640 1 -- 172.21.15.7:0/1912148655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0009510 con 0x7fd6f40d03c0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f409d570 con 0x7fd6f40d03c0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.140+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f409db30 con 0x7fd6f40d03c0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.141+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f40b3be0 con 0x7fd6f40d03c0 2024-08-19T00:37:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.142+0000 7fd6ee000640 1 -- 172.21.15.7:0/1912148655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6f0043070 con 0x7fd6f40d03c0 2024-08-19T00:37:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.143+0000 7fd6ee000640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d806be60 0x7fd6d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.143+0000 7fd6ee000640 1 -- 172.21.15.7:0/1912148655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd6f00aaf50 con 0x7fd6f40d03c0 2024-08-19T00:37:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.143+0000 7fd6f9e00640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d806be60 0x7fd6d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.144+0000 7fd6f9e00640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d806be60 0x7fd6d806e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009b90 tx=0x7fd6e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.147+0000 7fd6ee000640 1 -- 172.21.15.7:0/1912148655 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd6f004a070 con 0x7fd6f40d03c0 2024-08-19T00:37:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.402+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fd6f4073350 con 0x7fd6f40d03c0 2024-08-19T00:37:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.405+0000 7fd6ee000640 1 -- 172.21.15.7:0/1912148655 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fd6f0079c40 con 0x7fd6f40d03c0 2024-08-19T00:37:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d806be60 msgr2=0x7fd6d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d806be60 0x7fd6d806e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009b90 tx=0x7fd6e8008040 comp rx=0 tx=0).stop 2024-08-19T00:37:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40d03c0 msgr2=0x7fd6f40ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40d03c0 0x7fd6f40ca1b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009f40 tx=0x7fd6f0004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 shutdown_connections 2024-08-19T00:37:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d806be60 0x7fd6d806e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6f40d03c0 0x7fd6f40ca1b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f40b3750 0x7fd6f409caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 --2- 172.21.15.7:0/1912148655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f406e710 0x7fd6f41f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 >> 172.21.15.7:0/1912148655 conn(0x7fd6f406bc70 msgr2=0x7fd6f40aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.407+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 shutdown_connections 2024-08-19T00:37:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.408+0000 7fd6fc800640 1 -- 172.21.15.7:0/1912148655 wait complete. 2024-08-19T00:37:42.425 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-19T00:37:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.586+0000 7f21e9400640 1 Processor -- start 2024-08-19T00:37:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.586+0000 7f21e9400640 1 -- start start 2024-08-19T00:37:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.587+0000 7f21e9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d03c0 0x7f21e4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.587+0000 7f21e9400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e40cdfb0 con 0x7f21e40b3750 2024-08-19T00:37:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.587+0000 7f21e9400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e40ce290 con 0x7f21e406e710 2024-08-19T00:37:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.587+0000 7f21e9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21e40cebc0 con 0x7f21e40d03c0 2024-08-19T00:37:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.587+0000 7f21e3200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f21e40b3750 0x7f21e40cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39962/0 (socket says 172.21.15.7:39962) 2024-08-19T00:37:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.587+0000 7f21e3200640 1 -- 172.21.15.7:0/3256357408 learned_addr learned my addr 172.21.15.7:0/3256357408 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.587+0000 7f21e2800640 1 --2- 172.21.15.7:0/3256357408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d03c0 0x7f21e4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.588+0000 7f21e1e00640 1 -- 172.21.15.7:0/3256357408 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557967747 0 0) 0x7f21e40cdfb0 con 0x7f21e40b3750 2024-08-19T00:37:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.588+0000 7f21e1e00640 1 -- 172.21.15.7:0/3256357408 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21c8003520 con 0x7f21e40b3750 2024-08-19T00:37:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.588+0000 7f21e2800640 1 -- 172.21.15.7:0/3256357408 >> v1:172.21.15.162:6789/0 conn(0x7f21e406e710 legacy=0x7f21e40d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.588+0000 7f21e1e00640 1 -- 172.21.15.7:0/3256357408 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261322370 0 0) 0x7f21e40ce290 con 0x7f21e406e710 2024-08-19T00:37:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.588+0000 7f21e2800640 1 -- 172.21.15.7:0/3256357408 >> v1:172.21.15.7:6789/0 conn(0x7f21e40b3750 legacy=0x7f21e40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.588+0000 7f21e2800640 1 -- 172.21.15.7:0/3256357408 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e40ce570 con 0x7f21e40d03c0 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.589+0000 7f21e2800640 1 --2- 172.21.15.7:0/3256357408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d03c0 0x7f21e4071980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f21d40097d0 tx=0x7f21d402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e52a5cbeebba150 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.589+0000 7f21e1e00640 1 -- 172.21.15.7:0/3256357408 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4037070 con 0x7f21e40d03c0 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e1e00640 1 -- 172.21.15.7:0/3256357408 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d4032440 con 0x7f21e40d03c0 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e1e00640 1 -- 172.21.15.7:0/3256357408 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4032810 con 0x7f21e40d03c0 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e9400640 1 -- 172.21.15.7:0/3256357408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d03c0 msgr2=0x7f21e4071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e9400640 1 --2- 172.21.15.7:0/3256357408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d03c0 0x7f21e4071980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f21d40097d0 tx=0x7f21d402a210 comp rx=0 tx=0).stop 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e9400640 1 -- 172.21.15.7:0/3256357408 shutdown_connections 2024-08-19T00:37:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e9400640 1 --2- 172.21.15.7:0/3256357408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d03c0 0x7f21e4071980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e9400640 1 -- 172.21.15.7:0/3256357408 >> 172.21.15.7:0/3256357408 conn(0x7f21e406bc70 msgr2=0x7f21e406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e9400640 1 -- 172.21.15.7:0/3256357408 shutdown_connections 2024-08-19T00:37:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.590+0000 7f21e9400640 1 -- 172.21.15.7:0/3256357408 wait complete. 2024-08-19T00:37:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.592+0000 7f21e9400640 1 Processor -- start 2024-08-19T00:37:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.592+0000 7f21e9400640 1 -- start start 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e406e710 0x7f21e40cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21e40b3750 0x7f21e41f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d03c0 0x7f21e415d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21e4073c60 con 0x7f21e40b3750 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21e4073ae0 con 0x7f21e40d03c0 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21e40b3be0 con 0x7f21e406e710 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21e40b3750 0x7f21e41f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21e40b3750 0x7f21e41f38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60994/0 (socket says 172.21.15.7:60994) 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21dbe00640 1 -- 172.21.15.7:0/2549508276 learned_addr learned my addr 172.21.15.7:0/2549508276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:42.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e2800640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e406e710 0x7f21e40cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.593+0000 7f21e3200640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d03c0 0x7f21e415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21dbe00640 1 -- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e406e710 msgr2=0x7f21e40cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21dbe00640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e406e710 0x7f21e40cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21dbe00640 1 -- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d03c0 msgr2=0x7f21e415d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21dbe00640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d03c0 0x7f21e415d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21dbe00640 1 -- 172.21.15.7:0/2549508276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e40cbd40 con 0x7f21e40b3750 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21dbe00640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21e40b3750 0x7f21e41f38c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00c410 tx=0x7f21cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21daa00640 1 -- 172.21.15.7:0/2549508276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc017070 con 0x7f21e40b3750 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21daa00640 1 -- 172.21.15.7:0/2549508276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc0035f0 con 0x7f21e40b3750 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21daa00640 1 -- 172.21.15.7:0/2549508276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0039e0 con 0x7f21e40b3750 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e40cc020 con 0x7f21e40b3750 2024-08-19T00:37:42.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.594+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e40cc5e0 con 0x7f21e40b3750 2024-08-19T00:37:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.595+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e4157490 con 0x7f21e40b3750 2024-08-19T00:37:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.596+0000 7f21daa00640 1 -- 172.21.15.7:0/2549508276 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21cc01a070 con 0x7f21e40b3750 2024-08-19T00:37:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.597+0000 7f21daa00640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21c006be30 0x7f21c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.597+0000 7f21daa00640 1 -- 172.21.15.7:0/2549508276 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f21cc089f80 con 0x7f21e40b3750 2024-08-19T00:37:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.598+0000 7f21e2800640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21c006be30 0x7f21c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.598+0000 7f21e2800640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21c006be30 0x7f21c006e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21d4034000 tx=0x7f21d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.602+0000 7f21daa00640 1 -- 172.21.15.7:0/2549508276 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f21e4157490 con 0x7f21e40b3750 2024-08-19T00:37:42.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.855+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f21e40ce290 con 0x7f21e40b3750 2024-08-19T00:37:42.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.858+0000 7f21daa00640 1 -- 172.21.15.7:0/2549508276 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f21cc058590 con 0x7f21e40b3750 2024-08-19T00:37:42.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21c006be30 msgr2=0x7f21c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21c006be30 0x7f21c006e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21d4034000 tx=0x7f21d402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:42.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21e40b3750 msgr2=0x7f21e41f38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21e40b3750 0x7f21e41f38c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00c410 tx=0x7f21cc00c8d0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 shutdown_connections 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21c006be30 0x7f21c006e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d03c0 0x7f21e415d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21e40b3750 0x7f21e41f38c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 --2- 172.21.15.7:0/2549508276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e406e710 0x7f21e40cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.860+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 >> 172.21.15.7:0/2549508276 conn(0x7f21e406bc70 msgr2=0x7f21e415a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.861+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 shutdown_connections 2024-08-19T00:37:42.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:42.861+0000 7f21e9400640 1 -- 172.21.15.7:0/2549508276 wait complete. 2024-08-19T00:37:42.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-19T00:37:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.034+0000 7f8f24000640 1 Processor -- start 2024-08-19T00:37:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.035+0000 7f8f24000640 1 -- start start 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f24000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f1c06cad0 0x7f8f1c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f24000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8f1c15dc30 0x7f8f1c15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f24000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1c0ae780 con 0x7f8f1c06ceb0 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f24000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c0b5dd0 con 0x7f8f1c06cad0 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f24000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c0aea00 con 0x7f8f1c15dc30 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f21600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f1c06cad0 0x7f8f1c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f21600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f1c06cad0 0x7f8f1c0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32768/0 (socket says 172.21.15.7:32768) 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f21600640 1 -- 172.21.15.7:0/2702786426 learned_addr learned my addr 172.21.15.7:0/2702786426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:43.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.036+0000 7f8f22000640 1 --2- 172.21.15.7:0/2702786426 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c15dc30 0x7f8f1c15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.037+0000 7f8f21600640 1 -- 172.21.15.7:0/2702786426 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c15dc30 msgr2=0x7f8f1c15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:43.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.037+0000 7f8f21600640 1 --2- 172.21.15.7:0/2702786426 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c15dc30 0x7f8f1c15e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.037+0000 7f8f21600640 1 -- 172.21.15.7:0/2702786426 >> v1:172.21.15.162:6789/0 conn(0x7f8f1c06ceb0 legacy=0x7f8f1c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.037+0000 7f8f21600640 1 -- 172.21.15.7:0/2702786426 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c0aece0 con 0x7f8f1c06cad0 2024-08-19T00:37:43.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.038+0000 7f8f21600640 1 --2- 172.21.15.7:0/2702786426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c06cad0 0x7f8f1c0af7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009870 tx=0x7f8f1002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b022eb3e487bbd6e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.038+0000 7f8f1be00640 1 -- 172.21.15.7:0/2702786426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10037070 con 0x7f8f1c06cad0 2024-08-19T00:37:43.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.038+0000 7f8f1be00640 1 -- 172.21.15.7:0/2702786426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10032440 con 0x7f8f1c06cad0 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.038+0000 7f8f1be00640 1 -- 172.21.15.7:0/2702786426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10032810 con 0x7f8f1c06cad0 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.038+0000 7f8f24000640 1 -- 172.21.15.7:0/2702786426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c06cad0 msgr2=0x7f8f1c0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.038+0000 7f8f24000640 1 --2- 172.21.15.7:0/2702786426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c06cad0 0x7f8f1c0af7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009870 tx=0x7f8f1002a210 comp rx=0 tx=0).stop 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.039+0000 7f8f24000640 1 -- 172.21.15.7:0/2702786426 shutdown_connections 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.039+0000 7f8f24000640 1 --2- 172.21.15.7:0/2702786426 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c15dc30 0x7f8f1c15e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.039+0000 7f8f24000640 1 --2- 172.21.15.7:0/2702786426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c06cad0 0x7f8f1c0af7c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.039+0000 7f8f24000640 1 -- 172.21.15.7:0/2702786426 >> 172.21.15.7:0/2702786426 conn(0x7f8f1c0721b0 msgr2=0x7f8f1c0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.039+0000 7f8f24000640 1 -- 172.21.15.7:0/2702786426 shutdown_connections 2024-08-19T00:37:43.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.039+0000 7f8f24000640 1 -- 172.21.15.7:0/2702786426 wait complete. 2024-08-19T00:37:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.040+0000 7f8f24000640 1 Processor -- start 2024-08-19T00:37:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.040+0000 7f8f24000640 1 -- start start 2024-08-19T00:37:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.041+0000 7f8f24000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c06cad0 0x7f8f1c1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.041+0000 7f8f24000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c06ceb0 0x7f8f1c15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.041+0000 7f8f24000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c15dc30 0x7f8f1c1f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.041+0000 7f8f24000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c0afd00 con 0x7f8f1c15dc30 2024-08-19T00:37:43.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.041+0000 7f8f24000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c0af2a0 con 0x7f8f1c06ceb0 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.041+0000 7f8f24000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c15e600 con 0x7f8f1c06cad0 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c15dc30 0x7f8f1c1f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c15dc30 0x7f8f1c1f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32770/0 (socket says 172.21.15.7:32770) 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 -- 172.21.15.7:0/2094390058 learned_addr learned my addr 172.21.15.7:0/2094390058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f21600640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c06cad0 0x7f8f1c1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f20c00640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c06ceb0 0x7f8f1c15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 -- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c06cad0 msgr2=0x7f8f1c1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c06cad0 0x7f8f1c1515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 -- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c06ceb0 msgr2=0x7f8f1c15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c06ceb0 0x7f8f1c15d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 -- 172.21.15.7:0/2094390058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c15d6e0 con 0x7f8f1c15dc30 2024-08-19T00:37:43.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.042+0000 7f8f22000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c15dc30 0x7f8f1c1f7b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007e40 tx=0x7f8f1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.043+0000 7f8f19600640 1 -- 172.21.15.7:0/2094390058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14014620 con 0x7f8f1c15dc30 2024-08-19T00:37:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.043+0000 7f8f19600640 1 -- 172.21.15.7:0/2094390058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f14019070 con 0x7f8f1c15dc30 2024-08-19T00:37:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.043+0000 7f8f19600640 1 -- 172.21.15.7:0/2094390058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14014a20 con 0x7f8f1c15dc30 2024-08-19T00:37:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.043+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c15acf0 con 0x7f8f1c15dc30 2024-08-19T00:37:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.043+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c15a420 con 0x7f8f1c15dc30 2024-08-19T00:37:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.044+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1c15a750 con 0x7f8f1c15dc30 2024-08-19T00:37:43.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.045+0000 7f8f19600640 1 -- 172.21.15.7:0/2094390058 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f14014bc0 con 0x7f8f1c15dc30 2024-08-19T00:37:43.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.046+0000 7f8f19600640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.046+0000 7f8f19600640 1 -- 172.21.15.7:0/2094390058 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f8f1408b270 con 0x7f8f1c15dc30 2024-08-19T00:37:43.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.046+0000 7f8f21600640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.046+0000 7f8f21600640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8efc06be30 0x7f8efc06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f1002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.050+0000 7f8f19600640 1 -- 172.21.15.7:0/2094390058 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8f14059910 con 0x7f8f1c15dc30 2024-08-19T00:37:43.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.300+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f8f1c0b4a00 con 0x7f8f1c15dc30 2024-08-19T00:37:43.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.303+0000 7f8f19600640 1 -- 172.21.15.7:0/2094390058 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f8f1405dc10 con 0x7f8f1c15dc30 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8efc06be30 msgr2=0x7f8efc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8efc06be30 0x7f8efc06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f1002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c15dc30 msgr2=0x7f8f1c1f7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c15dc30 0x7f8f1c1f7b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007e40 tx=0x7f8f1400e4b0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 shutdown_connections 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c15dc30 0x7f8f1c1f7b70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c06ceb0 0x7f8f1c15d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 --2- 172.21.15.7:0/2094390058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c06cad0 0x7f8f1c1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 >> 172.21.15.7:0/2094390058 conn(0x7f8f1c0721b0 msgr2=0x7f8f1c0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:43.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 shutdown_connections 2024-08-19T00:37:43.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.306+0000 7f8f24000640 1 -- 172.21.15.7:0/2094390058 wait complete. 2024-08-19T00:37:43.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-19T00:37:43.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.479+0000 7effdd400640 1 Processor -- start 2024-08-19T00:37:43.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.480+0000 7effdd400640 1 -- start start 2024-08-19T00:37:43.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effdd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 0x7effd8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effdd400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effd80cec10 0x7effd80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effdd400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd806f7f0 con 0x7effd80739a0 2024-08-19T00:37:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effdd400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7effd806f510 con 0x7effd80cec10 2024-08-19T00:37:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effdd400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7effd8072980 con 0x7effd8159bf0 2024-08-19T00:37:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effd5e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7effd80739a0 0x7effd80ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39968/0 (socket says 172.21.15.7:39968) 2024-08-19T00:37:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effd5e00640 1 -- 172.21.15.7:0/935180260 learned_addr learned my addr 172.21.15.7:0/935180260 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.481+0000 7effd6800640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 0x7effd8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd7200640 1 --2- 172.21.15.7:0/935180260 >> v2:172.21.15.162:3300/0 conn(0x7effd80cec10 0x7effd80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224250635 0 0) 0x7effd806f7f0 con 0x7effd80739a0 2024-08-19T00:37:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effbc003520 con 0x7effd80739a0 2024-08-19T00:37:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2573618643 0 0) 0x7effbc003520 con 0x7effd80739a0 2024-08-19T00:37:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 msgr2=0x7effd8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 0x7effd8073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 >> v2:172.21.15.162:3300/0 conn(0x7effd80cec10 msgr2=0x7effd80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 --2- 172.21.15.7:0/935180260 >> v2:172.21.15.162:3300/0 conn(0x7effd80cec10 0x7effd80d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd8072c60 con 0x7effd80739a0 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7effc4001670 con 0x7effd80739a0 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 >> v1:172.21.15.7:6789/0 conn(0x7effd80739a0 legacy=0x7effd80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 0x7effbc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effbc003f80 0x7effbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc004d40 0x7effbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effd806f510 con 0x7effbc004d40 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7effd8072980 con 0x7effbc003f80 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7effbc00ba70 con 0x7effd8159bf0 2024-08-19T00:37:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd7200640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc004d40 0x7effbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.482+0000 7effd6800640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 0x7effbc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.483+0000 7effd5e00640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effbc003f80 0x7effbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.483+0000 7effd6800640 1 -- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effbc003f80 msgr2=0x7effbc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.483+0000 7effd6800640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effbc003f80 0x7effbc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.483+0000 7effd6800640 1 -- 172.21.15.7:0/935180260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc004d40 msgr2=0x7effbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.483+0000 7effd6800640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc004d40 0x7effbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.483+0000 7effd6800640 1 -- 172.21.15.7:0/935180260 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc003520 con 0x7effd8159bf0 2024-08-19T00:37:43.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.483+0000 7effd7200640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc004d40 0x7effbc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.484+0000 7effd6800640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 0x7effbc0039b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effc8009ac0 tx=0x7effbc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19537924091ecc09 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.484+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8036070 con 0x7effd8159bf0 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.484+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc8031400 con 0x7effd8159bf0 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.484+0000 7effd5400640 1 -- 172.21.15.7:0/935180260 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8009690 con 0x7effd8159bf0 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.485+0000 7effdd400640 1 -- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 msgr2=0x7effbc0039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.485+0000 7effdd400640 1 --2- 172.21.15.7:0/935180260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd8159bf0 0x7effbc0039b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effc8009ac0 tx=0x7effbc005830 comp rx=0 tx=0).stop 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.485+0000 7effd7200640 1 -- 172.21.15.7:0/935180260 reap_dead start 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.485+0000 7effdd400640 1 -- 172.21.15.7:0/935180260 shutdown_connections 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.485+0000 7effdd400640 1 -- 172.21.15.7:0/935180260 >> 172.21.15.7:0/935180260 conn(0x7effd806bc70 msgr2=0x7effd806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.485+0000 7effdd400640 1 -- 172.21.15.7:0/935180260 shutdown_connections 2024-08-19T00:37:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.485+0000 7effdd400640 1 -- 172.21.15.7:0/935180260 wait complete. 2024-08-19T00:37:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.487+0000 7effdd400640 1 Processor -- start 2024-08-19T00:37:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.487+0000 7effdd400640 1 -- start start 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effdd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd8159bf0 0x7effd815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effdd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd814b830 0x7effd8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effdd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd8158640 0x7effd8158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effdd400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effd815a150 con 0x7effd8158640 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effdd400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7effd8159fd0 con 0x7effd8159bf0 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effdd400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7effd8073460 con 0x7effd814b830 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effd7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd8158640 0x7effd8158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effd7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd8158640 0x7effd8158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32792/0 (socket says 172.21.15.7:32792) 2024-08-19T00:37:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effd7200640 1 -- 172.21.15.7:0/716518901 learned_addr learned my addr 172.21.15.7:0/716518901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.488+0000 7effd6800640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd8159bf0 0x7effd815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd5e00640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd814b830 0x7effd8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd7200640 1 -- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd814b830 msgr2=0x7effd8157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd7200640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd814b830 0x7effd8157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd7200640 1 -- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd8159bf0 msgr2=0x7effd815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd7200640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd8159bf0 0x7effd815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd7200640 1 -- 172.21.15.7:0/716518901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd814bcf0 con 0x7effd8158640 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd6800640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd8159bf0 0x7effd815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effd7200640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd8158640 0x7effd8158ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7effd80b2da0 tx=0x7effd000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effcea00640 1 -- 172.21.15.7:0/716518901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0009c10 con 0x7effd8158640 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effcea00640 1 -- 172.21.15.7:0/716518901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd000fd90 con 0x7effd8158640 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effcea00640 1 -- 172.21.15.7:0/716518901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0003bb0 con 0x7effd8158640 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd814bfd0 con 0x7effd8158640 2024-08-19T00:37:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.489+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd814c590 con 0x7effd8158640 2024-08-19T00:37:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.490+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd8160820 con 0x7effd8158640 2024-08-19T00:37:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.492+0000 7effcea00640 1 -- 172.21.15.7:0/716518901 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effd001f020 con 0x7effd8158640 2024-08-19T00:37:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.492+0000 7effcea00640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.492+0000 7effcea00640 1 -- 172.21.15.7:0/716518901 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7effd008ae20 con 0x7effd8158640 2024-08-19T00:37:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.493+0000 7effd6800640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.493+0000 7effd6800640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7effc8033000 tx=0x7effc8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.497+0000 7effcea00640 1 -- 172.21.15.7:0/716518901 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7effd0010040 con 0x7effd8158640 2024-08-19T00:37:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.750+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7effd8157b40 con 0x7effd8158640 2024-08-19T00:37:43.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.752+0000 7effcea00640 1 -- 172.21.15.7:0/716518901 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7effd0059a80 con 0x7effd8158640 2024-08-19T00:37:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.754+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 msgr2=0x7effb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.754+0000 7effdd400640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7effc8033000 tx=0x7effc8008030 comp rx=0 tx=0).stop 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.754+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd8158640 msgr2=0x7effd8158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.754+0000 7effdd400640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd8158640 0x7effd8158ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7effd80b2da0 tx=0x7effd000f580 comp rx=0 tx=0).stop 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 shutdown_connections 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd8158640 0x7effd8158ad0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd814b830 0x7effd8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 --2- 172.21.15.7:0/716518901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd8159bf0 0x7effd815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 >> 172.21.15.7:0/716518901 conn(0x7effd806bc70 msgr2=0x7effd815fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 shutdown_connections 2024-08-19T00:37:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.755+0000 7effdd400640 1 -- 172.21.15.7:0/716518901 wait complete. 2024-08-19T00:37:43.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-19T00:37:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.929+0000 7f4c22c00640 1 Processor -- start 2024-08-19T00:37:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.929+0000 7f4c22c00640 1 -- start start 2024-08-19T00:37:43.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c22c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c1c0d03c0 0x7f4c1c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c22c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c1c06e710 0x7f4c1c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0b3750 0x7f4c1c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c22c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4c1c0cebc0 con 0x7f4c1c0d03c0 2024-08-19T00:37:43.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c22c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4c1c0d0ce0 con 0x7f4c1c06e710 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c22c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1c0cdfb0 con 0x7f4c1c0b3750 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c1be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c1c0d03c0 0x7f4c1c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c1be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c1c0d03c0 0x7f4c1c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56176/0 (socket says 172.21.15.7:56176) 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c1be00640 1 -- 172.21.15.7:0/2870210444 learned_addr learned my addr 172.21.15.7:0/2870210444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c13e00640 1 --2- 172.21.15.7:0/2870210444 >> v2:172.21.15.162:3300/0 conn(0x7f4c1c06e710 0x7f4c1c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.930+0000 7f4c20c00640 1 --2- 172.21.15.7:0/2870210444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0b3750 0x7f4c1c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.931+0000 7f4c1be00640 1 -- 172.21.15.7:0/2870210444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0b3750 msgr2=0x7f4c1c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.931+0000 7f4c1be00640 1 --2- 172.21.15.7:0/2870210444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0b3750 0x7f4c1c0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.931+0000 7f4c1be00640 1 -- 172.21.15.7:0/2870210444 >> v2:172.21.15.162:3300/0 conn(0x7f4c1c06e710 msgr2=0x7f4c1c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.931+0000 7f4c1be00640 1 --2- 172.21.15.7:0/2870210444 >> v2:172.21.15.162:3300/0 conn(0x7f4c1c06e710 0x7f4c1c0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.931+0000 7f4c1be00640 1 -- 172.21.15.7:0/2870210444 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c0ce290 con 0x7f4c1c0d03c0 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.932+0000 7f4c1be00640 1 --2- 172.21.15.7:0/2870210444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c0d03c0 0x7f4c1c071980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e62e9f9e667750 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.932+0000 7f4c1b400640 1 -- 172.21.15.7:0/2870210444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c037070 con 0x7f4c1c0d03c0 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.932+0000 7f4c1b400640 1 -- 172.21.15.7:0/2870210444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c032440 con 0x7f4c1c0d03c0 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.932+0000 7f4c1b400640 1 -- 172.21.15.7:0/2870210444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c032810 con 0x7f4c1c0d03c0 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.932+0000 7f4c22c00640 1 -- 172.21.15.7:0/2870210444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c0d03c0 msgr2=0x7f4c1c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.932+0000 7f4c22c00640 1 --2- 172.21.15.7:0/2870210444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c0d03c0 0x7f4c1c071980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c02a200 comp rx=0 tx=0).stop 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.933+0000 7f4c22c00640 1 -- 172.21.15.7:0/2870210444 shutdown_connections 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.933+0000 7f4c22c00640 1 --2- 172.21.15.7:0/2870210444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0b3750 0x7f4c1c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.933+0000 7f4c22c00640 1 --2- 172.21.15.7:0/2870210444 >> v2:172.21.15.162:3300/0 conn(0x7f4c1c06e710 0x7f4c1c0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.933+0000 7f4c22c00640 1 --2- 172.21.15.7:0/2870210444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c0d03c0 0x7f4c1c071980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.933+0000 7f4c22c00640 1 -- 172.21.15.7:0/2870210444 >> 172.21.15.7:0/2870210444 conn(0x7f4c1c06bc70 msgr2=0x7f4c1c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:43.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.933+0000 7f4c22c00640 1 -- 172.21.15.7:0/2870210444 shutdown_connections 2024-08-19T00:37:43.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.933+0000 7f4c22c00640 1 -- 172.21.15.7:0/2870210444 wait complete. 2024-08-19T00:37:43.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.934+0000 7f4c22c00640 1 Processor -- start 2024-08-19T00:37:43.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.934+0000 7f4c22c00640 1 -- start start 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c06e710 0x7f4c1c15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c0b3750 0x7f4c1c155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0d03c0 0x7f4c1c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c22c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c073ae0 con 0x7f4c1c06e710 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c22c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c0ce850 con 0x7f4c1c0b3750 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c22c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1c073c60 con 0x7f4c1c0d03c0 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c06e710 0x7f4c1c15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c06e710 0x7f4c1c15e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56184/0 (socket says 172.21.15.7:56184) 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.935+0000 7f4c1be00640 1 -- 172.21.15.7:0/3398810151 learned_addr learned my addr 172.21.15.7:0/3398810151 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c13e00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c0b3750 0x7f4c1c155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c20c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0d03c0 0x7f4c1c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c1be00640 1 -- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0d03c0 msgr2=0x7f4c1c15a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c1be00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0d03c0 0x7f4c1c15a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c1be00640 1 -- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c0b3750 msgr2=0x7f4c1c155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:43.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c1be00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c0b3750 0x7f4c1c155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:43.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c1be00640 1 -- 172.21.15.7:0/3398810151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c167900 con 0x7f4c1c06e710 2024-08-19T00:37:43.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c13e00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c0b3750 0x7f4c1c155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:43.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c1be00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c06e710 0x7f4c1c15e0e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c18c00640 1 -- 172.21.15.7:0/3398810151 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c041070 con 0x7f4c1c06e710 2024-08-19T00:37:43.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c18c00640 1 -- 172.21.15.7:0/3398810151 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c03c890 con 0x7f4c1c06e710 2024-08-19T00:37:43.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c18c00640 1 -- 172.21.15.7:0/3398810151 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c037040 con 0x7f4c1c06e710 2024-08-19T00:37:43.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.936+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1c167be0 con 0x7f4c1c06e710 2024-08-19T00:37:43.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.937+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1c14e0e0 con 0x7f4c1c06e710 2024-08-19T00:37:43.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.938+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1c0b3be0 con 0x7f4c1c06e710 2024-08-19T00:37:43.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.939+0000 7f4c18c00640 1 -- 172.21.15.7:0/3398810151 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c0c044070 con 0x7f4c1c06e710 2024-08-19T00:37:43.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.939+0000 7f4c18c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bf806be30 0x7f4bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:43.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.940+0000 7f4c18c00640 1 -- 172.21.15.7:0/3398810151 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f4c0c0ab820 con 0x7f4c1c06e710 2024-08-19T00:37:43.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.940+0000 7f4c13e00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bf806be30 0x7f4bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:43.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.940+0000 7f4c13e00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bf806be30 0x7f4bf806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c1f7b80 tx=0x7f4c04008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:43.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:43.944+0000 7f4c18c00640 1 -- 172.21.15.7:0/3398810151 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4c0c07a5a0 con 0x7f4c1c06e710 2024-08-19T00:37:44.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.194+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f4c1c153320 con 0x7f4c1c06e710 2024-08-19T00:37:44.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.197+0000 7f4c18c00640 1 -- 172.21.15.7:0/3398810151 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f4c0c079ea0 con 0x7f4c1c06e710 2024-08-19T00:37:44.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bf806be30 msgr2=0x7f4bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bf806be30 0x7f4bf806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c1f7b80 tx=0x7f4c04008040 comp rx=0 tx=0).stop 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c06e710 msgr2=0x7f4c1c15e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c06e710 0x7f4c1c15e0e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 shutdown_connections 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bf806be30 0x7f4bf806e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0d03c0 0x7f4c1c15a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c0b3750 0x7f4c1c155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 --2- 172.21.15.7:0/3398810151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1c06e710 0x7f4c1c15e0e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 >> 172.21.15.7:0/3398810151 conn(0x7f4c1c06bc70 msgr2=0x7f4c1c1565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 shutdown_connections 2024-08-19T00:37:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.199+0000 7f4c22c00640 1 -- 172.21.15.7:0/3398810151 wait complete. 2024-08-19T00:37:44.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-19T00:37:44.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.373+0000 7f8a99e00640 1 Processor -- start 2024-08-19T00:37:44.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.373+0000 7f8a99e00640 1 -- start start 2024-08-19T00:37:44.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.374+0000 7f8a99e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8a9406d600 0x7f8a9406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.374+0000 7f8a99e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9415f290 con 0x7f8a9415e640 2024-08-19T00:37:44.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.374+0000 7f8a99e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9415f570 con 0x7f8a94147ac0 2024-08-19T00:37:44.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.374+0000 7f8a99e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8a94072d80 con 0x7f8a9406d600 2024-08-19T00:37:44.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.375+0000 7f8a93e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8a9406d600 0x7f8a9406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.375+0000 7f8a99400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8a9415e640 0x7f8a9415ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41366/0 (socket says 172.21.15.7:41366) 2024-08-19T00:37:44.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.375+0000 7f8a99400640 1 -- 172.21.15.7:0/891705980 learned_addr learned my addr 172.21.15.7:0/891705980 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:44.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.375+0000 7f8a93e00640 1 -- 172.21.15.7:0/891705980 >> v1:172.21.15.162:6789/0 conn(0x7f8a94147ac0 legacy=0x7f8a940b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.375+0000 7f8a93e00640 1 -- 172.21.15.7:0/891705980 >> v1:172.21.15.7:6789/0 conn(0x7f8a9415e640 legacy=0x7f8a9415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.375+0000 7f8a93e00640 1 -- 172.21.15.7:0/891705980 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a940b4340 con 0x7f8a9406d600 2024-08-19T00:37:44.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.375+0000 7f8a93400640 1 -- 172.21.15.7:0/891705980 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448406982 0 0) 0x7f8a9415f290 con 0x7f8a9415e640 2024-08-19T00:37:44.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.376+0000 7f8a93e00640 1 --2- 172.21.15.7:0/891705980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a9406da40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162d19affd2ed546 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.376+0000 7f8a93400640 1 -- 172.21.15.7:0/891705980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80037070 con 0x7f8a9406d600 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.376+0000 7f8a93400640 1 -- 172.21.15.7:0/891705980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80032440 con 0x7f8a9406d600 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.376+0000 7f8a93400640 1 -- 172.21.15.7:0/891705980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80032810 con 0x7f8a9406d600 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.377+0000 7f8a99e00640 1 -- 172.21.15.7:0/891705980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 msgr2=0x7f8a9406da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.377+0000 7f8a99e00640 1 --2- 172.21.15.7:0/891705980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a9406da40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a8002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.377+0000 7f8a99e00640 1 -- 172.21.15.7:0/891705980 shutdown_connections 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.377+0000 7f8a99e00640 1 --2- 172.21.15.7:0/891705980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a9406da40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.377+0000 7f8a99e00640 1 -- 172.21.15.7:0/891705980 >> 172.21.15.7:0/891705980 conn(0x7f8a9406b850 msgr2=0x7f8a9406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.377+0000 7f8a99e00640 1 -- 172.21.15.7:0/891705980 shutdown_connections 2024-08-19T00:37:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.377+0000 7f8a99e00640 1 -- 172.21.15.7:0/891705980 wait complete. 2024-08-19T00:37:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.379+0000 7f8a99e00640 1 Processor -- start 2024-08-19T00:37:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.379+0000 7f8a99e00640 1 -- start start 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a99e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a940b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a99e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a94147ac0 0x7f8a9415d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a99e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9415e640 0x7f8a941404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a99e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9406df80 con 0x7f8a9406d600 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a99e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a940b4990 con 0x7f8a9415e640 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a99e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a940ad8e0 con 0x7f8a94147ac0 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a98a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a940b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a98a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a940b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56198/0 (socket says 172.21.15.7:56198) 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a98a00640 1 -- 172.21.15.7:0/3217507476 learned_addr learned my addr 172.21.15.7:0/3217507476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a93e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a94147ac0 0x7f8a9415d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.380+0000 7f8a99400640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9415e640 0x7f8a941404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a98a00640 1 -- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a94147ac0 msgr2=0x7f8a9415d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a98a00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a94147ac0 0x7f8a9415d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a98a00640 1 -- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9415e640 msgr2=0x7f8a941404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a98a00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9415e640 0x7f8a941404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a98a00640 1 -- 172.21.15.7:0/3217507476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a940b16d0 con 0x7f8a9406d600 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a99400640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9415e640 0x7f8a941404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a98a00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a940b2770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800c450 tx=0x7f8a8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a90c00640 1 -- 172.21.15.7:0/3217507476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880052d0 con 0x7f8a9406d600 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a90c00640 1 -- 172.21.15.7:0/3217507476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88005470 con 0x7f8a9406d600 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a90c00640 1 -- 172.21.15.7:0/3217507476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88012870 con 0x7f8a9406d600 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a940b19b0 con 0x7f8a9406d600 2024-08-19T00:37:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.381+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a940b1f70 con 0x7f8a9406d600 2024-08-19T00:37:44.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.382+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a940cc630 con 0x7f8a9406d600 2024-08-19T00:37:44.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.383+0000 7f8a90c00640 1 -- 172.21.15.7:0/3217507476 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a88012a10 con 0x7f8a9406d600 2024-08-19T00:37:44.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.384+0000 7f8a90c00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a7406be30 0x7f8a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.385+0000 7f8a90c00640 1 -- 172.21.15.7:0/3217507476 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f8a8808a680 con 0x7f8a9406d600 2024-08-19T00:37:44.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.385+0000 7f8a93e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a7406be30 0x7f8a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.385+0000 7f8a93e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a7406be30 0x7f8a7406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a80034000 tx=0x7f8a8002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.389+0000 7f8a90c00640 1 -- 172.21.15.7:0/3217507476 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8a940cc630 con 0x7f8a9406d600 2024-08-19T00:37:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.642+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f8a940b2400 con 0x7f8a9406d600 2024-08-19T00:37:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.644+0000 7f8a90c00640 1 -- 172.21.15.7:0/3217507476 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f8a8805f020 con 0x7f8a9406d600 2024-08-19T00:37:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a7406be30 msgr2=0x7f8a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a7406be30 0x7f8a7406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a80034000 tx=0x7f8a8002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 msgr2=0x7f8a940b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a940b2770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800c450 tx=0x7f8a8800c910 comp rx=0 tx=0).stop 2024-08-19T00:37:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 shutdown_connections 2024-08-19T00:37:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a7406be30 0x7f8a7406e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9415e640 0x7f8a941404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a94147ac0 0x7f8a9415d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 --2- 172.21.15.7:0/3217507476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a9406d600 0x7f8a940b2770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.646+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 >> 172.21.15.7:0/3217507476 conn(0x7f8a9406b850 msgr2=0x7f8a94072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.647+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 shutdown_connections 2024-08-19T00:37:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.647+0000 7f8a99e00640 1 -- 172.21.15.7:0/3217507476 wait complete. 2024-08-19T00:37:44.663 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-19T00:37:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.819+0000 7f1411000640 1 Processor -- start 2024-08-19T00:37:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.819+0000 7f1411000640 1 -- start start 2024-08-19T00:37:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1411000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06ceb0 0x7f140c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1411000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f140c0b5c00 0x7f140c15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1411000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140c0ae780 con 0x7f140c06cad0 2024-08-19T00:37:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1411000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f140c0aea00 con 0x7f140c0b5c00 2024-08-19T00:37:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1411000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f140c0aece0 con 0x7f140c06ceb0 2024-08-19T00:37:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1409e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f140c06cad0 0x7f140c0af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41378/0 (socket says 172.21.15.7:41378) 2024-08-19T00:37:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1409e00640 1 -- 172.21.15.7:0/2954824307 learned_addr learned my addr 172.21.15.7:0/2954824307 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f140a800640 1 --2- 172.21.15.7:0/2954824307 >> v2:172.21.15.162:3300/0 conn(0x7f140c0b5c00 0x7f140c15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.820+0000 7f1401400640 1 --2- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06ceb0 0x7f140c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f1409400640 1 -- 172.21.15.7:0/2954824307 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735478383 0 0) 0x7f13fc001110 con 0x7f140c06cad0 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f1409400640 1 -- 172.21.15.7:0/2954824307 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f0003520 con 0x7f140c06cad0 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f1409400640 1 -- 172.21.15.7:0/2954824307 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 35036533 0 0) 0x7f13f0003520 con 0x7f140c06cad0 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f140a800640 1 -- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06ceb0 msgr2=0x7f140c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f140a800640 1 --2- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06ceb0 0x7f140c0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f140a800640 1 -- 172.21.15.7:0/2954824307 >> v1:172.21.15.7:6789/0 conn(0x7f140c06cad0 legacy=0x7f140c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f140a800640 1 -- 172.21.15.7:0/2954824307 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c0aefc0 con 0x7f140c0b5c00 2024-08-19T00:37:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.821+0000 7f1401400640 1 --2- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06ceb0 0x7f140c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.822+0000 7f140a800640 1 --2- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c0b5c00 0x7f140c15dc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1404009d90 tx=0x7f140402a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7be199ce411880c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.822+0000 7f1409400640 1 -- 172.21.15.7:0/2954824307 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc001840 con 0x7f140c0b5c00 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1409400640 1 -- 172.21.15.7:0/2954824307 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1404007540 con 0x7f140c0b5c00 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1409400640 1 -- 172.21.15.7:0/2954824307 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404007910 con 0x7f140c0b5c00 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 -- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c0b5c00 msgr2=0x7f140c15dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 --2- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c0b5c00 0x7f140c15dc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1404009d90 tx=0x7f140402a550 comp rx=0 tx=0).stop 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 -- 172.21.15.7:0/2954824307 shutdown_connections 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 --2- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c0b5c00 0x7f140c15dc30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 --2- 172.21.15.7:0/2954824307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06ceb0 0x7f140c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 -- 172.21.15.7:0/2954824307 >> 172.21.15.7:0/2954824307 conn(0x7f140c0721b0 msgr2=0x7f140c0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:44.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 -- 172.21.15.7:0/2954824307 shutdown_connections 2024-08-19T00:37:44.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.823+0000 7f1411000640 1 -- 172.21.15.7:0/2954824307 wait complete. 2024-08-19T00:37:44.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.825+0000 7f1411000640 1 Processor -- start 2024-08-19T00:37:44.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.825+0000 7f1411000640 1 -- start start 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f1411000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06cad0 0x7f140c15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f1411000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c06ceb0 0x7f140c1611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f1411000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140c0b5c00 0x7f140c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f1411000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0b4b80 con 0x7f140c0b5c00 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f1411000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0b4a00 con 0x7f140c06ceb0 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f1411000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f140c15e170 con 0x7f140c06cad0 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f140a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140c0b5c00 0x7f140c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f140a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140c0b5c00 0x7f140c153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56200/0 (socket says 172.21.15.7:56200) 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.826+0000 7f140a800640 1 -- 172.21.15.7:0/544676616 learned_addr learned my addr 172.21.15.7:0/544676616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:44.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f1409e00640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06cad0 0x7f140c15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f1401400640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c06ceb0 0x7f140c1611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f140a800640 1 -- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06cad0 msgr2=0x7f140c15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f140a800640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06cad0 0x7f140c15f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f140a800640 1 -- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c06ceb0 msgr2=0x7f140c1611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f140a800640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c06ceb0 0x7f140c1611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f140a800640 1 -- 172.21.15.7:0/544676616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c1543d0 con 0x7f140c0b5c00 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f1409e00640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06cad0 0x7f140c15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f140a800640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140c0b5c00 0x7f140c153aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1404009d90 tx=0x7f1404004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f1402a00640 1 -- 172.21.15.7:0/544676616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140403f070 con 0x7f140c0b5c00 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f1402a00640 1 -- 172.21.15.7:0/544676616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1404031b40 con 0x7f140c0b5c00 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f1402a00640 1 -- 172.21.15.7:0/544676616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404007e90 con 0x7f140c0b5c00 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.827+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c15e8e0 con 0x7f140c0b5c00 2024-08-19T00:37:44.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.828+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c15eea0 con 0x7f140c0b5c00 2024-08-19T00:37:44.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.829+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140c15f0a0 con 0x7f140c0b5c00 2024-08-19T00:37:44.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.829+0000 7f1402a00640 1 -- 172.21.15.7:0/544676616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f140403b410 con 0x7f140c0b5c00 2024-08-19T00:37:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.830+0000 7f1402a00640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13e806be30 0x7f13e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.830+0000 7f1402a00640 1 -- 172.21.15.7:0/544676616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f14040abeb0 con 0x7f140c0b5c00 2024-08-19T00:37:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.831+0000 7f1409e00640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13e806be30 0x7f13e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.831+0000 7f1409e00640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13e806be30 0x7f13e806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f13fc000f60 tx=0x7f13fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:44.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:44.835+0000 7f1402a00640 1 -- 172.21.15.7:0/544676616 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f140c15f0a0 con 0x7f140c0b5c00 2024-08-19T00:37:45.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.023+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f140c15e550 con 0x7f140c0b5c00 2024-08-19T00:37:45.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.024+0000 7f1402a00640 1 -- 172.21.15.7:0/544676616 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f140407ab10 con 0x7f140c0b5c00 2024-08-19T00:37:45.025 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:45.026 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:37:45.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:37:45.026 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-08-19T00:37:45.026 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-08-19T00:37:45.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:37:45.026 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13e806be30 msgr2=0x7f13e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13e806be30 0x7f13e806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f13fc000f60 tx=0x7f13fc009040 comp rx=0 tx=0).stop 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140c0b5c00 msgr2=0x7f140c153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140c0b5c00 0x7f140c153aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1404009d90 tx=0x7f1404004a40 comp rx=0 tx=0).stop 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 shutdown_connections 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13e806be30 0x7f13e806e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f140c0b5c00 0x7f140c153aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c06ceb0 0x7f140c1611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 --2- 172.21.15.7:0/544676616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06cad0 0x7f140c15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 >> 172.21.15.7:0/544676616 conn(0x7f140c0721b0 msgr2=0x7f140c15ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 shutdown_connections 2024-08-19T00:37:45.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.026+0000 7f1411000640 1 -- 172.21.15.7:0/544676616 wait complete. 2024-08-19T00:37:45.043 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:37:45.043 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:37:45.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.202+0000 7f68bd400640 1 Processor -- start 2024-08-19T00:37:45.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.202+0000 7f68bd400640 1 -- start start 2024-08-19T00:37:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.203+0000 7f68bd400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68b806f650 0x7f68b8072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.203+0000 7f68bd400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b80b2c10 con 0x7f68b806f270 2024-08-19T00:37:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.203+0000 7f68bd400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b806e100 con 0x7f68b815fb00 2024-08-19T00:37:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.203+0000 7f68bd400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f68b815ff30 con 0x7f68b806f650 2024-08-19T00:37:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.203+0000 7f68b6800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f68b806f270 0x7f68b80ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41390/0 (socket says 172.21.15.7:41390) 2024-08-19T00:37:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.203+0000 7f68b6800640 1 -- 172.21.15.7:0/565421579 learned_addr learned my addr 172.21.15.7:0/565421579 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.203+0000 7f68b5e00640 1 --2- 172.21.15.7:0/565421579 >> v2:172.21.15.7:3300/0 conn(0x7f68b806f650 0x7f68b8072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.204+0000 7f68b5400640 1 -- 172.21.15.7:0/565421579 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 440262841 0 0) 0x7f68b80b2c10 con 0x7f68b806f270 2024-08-19T00:37:45.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.204+0000 7f68b5400640 1 -- 172.21.15.7:0/565421579 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f689c003520 con 0x7f68b806f270 2024-08-19T00:37:45.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.204+0000 7f68b5e00640 1 -- 172.21.15.7:0/565421579 >> v1:172.21.15.162:6789/0 conn(0x7f68b815fb00 legacy=0x7f68b815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.204+0000 7f68b5e00640 1 -- 172.21.15.7:0/565421579 >> v1:172.21.15.7:6789/0 conn(0x7f68b806f270 legacy=0x7f68b80ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.204+0000 7f68b5e00640 1 -- 172.21.15.7:0/565421579 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b806e3e0 con 0x7f68b806f650 2024-08-19T00:37:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.205+0000 7f68b5e00640 1 --2- 172.21.15.7:0/565421579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b8072c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68a40097a0 tx=0x7f68a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0124a70e1646b86 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.205+0000 7f68b5400640 1 -- 172.21.15.7:0/565421579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4037070 con 0x7f68b806f650 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.205+0000 7f68b5400640 1 -- 172.21.15.7:0/565421579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a4032440 con 0x7f68b806f650 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.205+0000 7f68b5400640 1 -- 172.21.15.7:0/565421579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4032810 con 0x7f68b806f650 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.206+0000 7f68bd400640 1 -- 172.21.15.7:0/565421579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 msgr2=0x7f68b8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.206+0000 7f68bd400640 1 --2- 172.21.15.7:0/565421579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b8072c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68a40097a0 tx=0x7f68a402a230 comp rx=0 tx=0).stop 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.206+0000 7f68bd400640 1 -- 172.21.15.7:0/565421579 shutdown_connections 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.206+0000 7f68bd400640 1 --2- 172.21.15.7:0/565421579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b8072c20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.206+0000 7f68bd400640 1 -- 172.21.15.7:0/565421579 >> 172.21.15.7:0/565421579 conn(0x7f68b806be80 msgr2=0x7f68b80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.206+0000 7f68bd400640 1 -- 172.21.15.7:0/565421579 shutdown_connections 2024-08-19T00:37:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.206+0000 7f68bd400640 1 -- 172.21.15.7:0/565421579 wait complete. 2024-08-19T00:37:45.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.208+0000 7f68bd400640 1 Processor -- start 2024-08-19T00:37:45.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.208+0000 7f68bd400640 1 -- start start 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68bd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b806f270 0x7f68b81593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68bd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68bd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68b815fb00 0x7f68b80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68bd400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68b80cdf40 con 0x7f68b806f650 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68bd400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68b806e9a0 con 0x7f68b806f270 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68bd400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68b806da00 con 0x7f68b815fb00 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b81555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56220/0 (socket says 172.21.15.7:56220) 2024-08-19T00:37:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 -- 172.21.15.7:0/1809657628 learned_addr learned my addr 172.21.15.7:0/1809657628 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 -- 172.21.15.7:0/1809657628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68b815fb00 msgr2=0x7f68b80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68b815fb00 0x7f68b80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 -- 172.21.15.7:0/1809657628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b806f270 msgr2=0x7f68b81593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b806f270 0x7f68b81593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.209+0000 7f68b5e00640 1 -- 172.21.15.7:0/1809657628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b81f79e0 con 0x7f68b806f650 2024-08-19T00:37:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.210+0000 7f68b5e00640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b81555a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68a4035040 tx=0x7f68a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.210+0000 7f68aea00640 1 -- 172.21.15.7:0/1809657628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4037040 con 0x7f68b806f650 2024-08-19T00:37:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.210+0000 7f68aea00640 1 -- 172.21.15.7:0/1809657628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a4030500 con 0x7f68b806f650 2024-08-19T00:37:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.210+0000 7f68aea00640 1 -- 172.21.15.7:0/1809657628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4030910 con 0x7f68b806f650 2024-08-19T00:37:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.210+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b81f7cc0 con 0x7f68b806f650 2024-08-19T00:37:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.210+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b81f8280 con 0x7f68b806f650 2024-08-19T00:37:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.211+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b806ddf0 con 0x7f68b806f650 2024-08-19T00:37:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.212+0000 7f68aea00640 1 -- 172.21.15.7:0/1809657628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68a4044020 con 0x7f68b806f650 2024-08-19T00:37:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.213+0000 7f68aea00640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f689806be80 0x7f689806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.213+0000 7f68aea00640 1 -- 172.21.15.7:0/1809657628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f68a40aae10 con 0x7f68b806f650 2024-08-19T00:37:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.213+0000 7f68b6800640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f689806be80 0x7f689806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.214+0000 7f68b6800640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f689806be80 0x7f689806e340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f68b815cfc0 tx=0x7f68a8007930 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:45.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.217+0000 7f68aea00640 1 -- 172.21.15.7:0/1809657628 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f68a40ae030 con 0x7f68b806f650 2024-08-19T00:37:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.402+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f68b81571a0 con 0x7f68b806f650 2024-08-19T00:37:45.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.650+0000 7f68aea00640 1 -- 172.21.15.7:0/1809657628 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f68a4079af0 con 0x7f68b806f650 2024-08-19T00:37:45.652 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-08-19T00:37:45.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f689806be80 msgr2=0x7f689806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f689806be80 0x7f689806e340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f68b815cfc0 tx=0x7f68a8007930 comp rx=0 tx=0).stop 2024-08-19T00:37:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 msgr2=0x7f68b81555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b81555a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68a4035040 tx=0x7f68a40046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 shutdown_connections 2024-08-19T00:37:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f689806be80 0x7f689806e340 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68b815fb00 0x7f68b80ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68b806f650 0x7f68b81555a0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68a4035040 tx=0x7f68a40046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 --2- 172.21.15.7:0/1809657628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b806f270 0x7f68b81593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.653+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 >> 172.21.15.7:0/1809657628 conn(0x7f68b806be80 msgr2=0x7f68b80b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.654+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 shutdown_connections 2024-08-19T00:37:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.654+0000 7f68bd400640 1 -- 172.21.15.7:0/1809657628 wait complete. 2024-08-19T00:37:45.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:37:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.838+0000 7f30a4c00640 1 Processor -- start 2024-08-19T00:37:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.838+0000 7f30a4c00640 1 -- start start 2024-08-19T00:37:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.839+0000 7f30a4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30a0161c90 0x7f30a00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.839+0000 7f30a4c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30a006e330 0x7f30a00d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.839+0000 7f30a4c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a006e750 con 0x7f30a00d2a40 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.839+0000 7f30a4c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f30a00d0110 con 0x7f30a0161c90 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.839+0000 7f30a4c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f30a00d2e70 con 0x7f30a006e330 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.839+0000 7f309de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30a0161c90 0x7f30a00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.840+0000 7f309de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30a0161c90 0x7f30a00cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56224/0 (socket says 172.21.15.7:56224) 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.840+0000 7f309de00640 1 -- 172.21.15.7:0/3838094770 learned_addr learned my addr 172.21.15.7:0/3838094770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.840+0000 7f309d400640 1 --2- 172.21.15.7:0/3838094770 >> v2:172.21.15.162:3300/0 conn(0x7f30a006e330 0x7f30a00d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.840+0000 7f309de00640 1 -- 172.21.15.7:0/3838094770 >> v2:172.21.15.162:3300/0 conn(0x7f30a006e330 msgr2=0x7f30a00d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.840+0000 7f309de00640 1 --2- 172.21.15.7:0/3838094770 >> v2:172.21.15.162:3300/0 conn(0x7f30a006e330 0x7f30a00d2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.840+0000 7f309de00640 1 -- 172.21.15.7:0/3838094770 >> v1:172.21.15.162:6789/0 conn(0x7f30a00d2a40 legacy=0x7f30a00d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.840+0000 7f309de00640 1 -- 172.21.15.7:0/3838094770 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a00cf500 con 0x7f30a0161c90 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.841+0000 7f309de00640 1 --2- 172.21.15.7:0/3838094770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a0161c90 0x7f30a00cef00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30a008d0f0 tx=0x7f309002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2ac596e57bd175 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.841+0000 7f309ca00640 1 -- 172.21.15.7:0/3838094770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090037070 con 0x7f30a0161c90 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.841+0000 7f309ca00640 1 -- 172.21.15.7:0/3838094770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3090032440 con 0x7f30a0161c90 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.841+0000 7f309ca00640 1 -- 172.21.15.7:0/3838094770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090032810 con 0x7f30a0161c90 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 -- 172.21.15.7:0/3838094770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a0161c90 msgr2=0x7f30a00cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 --2- 172.21.15.7:0/3838094770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a0161c90 0x7f30a00cef00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30a008d0f0 tx=0x7f309002a230 comp rx=0 tx=0).stop 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 -- 172.21.15.7:0/3838094770 shutdown_connections 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 --2- 172.21.15.7:0/3838094770 >> v2:172.21.15.162:3300/0 conn(0x7f30a006e330 0x7f30a00d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 --2- 172.21.15.7:0/3838094770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a0161c90 0x7f30a00cef00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 -- 172.21.15.7:0/3838094770 >> 172.21.15.7:0/3838094770 conn(0x7f30a008c000 msgr2=0x7f30a00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 -- 172.21.15.7:0/3838094770 shutdown_connections 2024-08-19T00:37:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.842+0000 7f30a4c00640 1 -- 172.21.15.7:0/3838094770 wait complete. 2024-08-19T00:37:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.844+0000 7f30a4c00640 1 Processor -- start 2024-08-19T00:37:45.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.844+0000 7f30a4c00640 1 -- start start 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.844+0000 7f30a4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a006e330 0x7f30a014d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f30a4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a00d2a40 0x7f30a00cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f30a4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a0161c90 0x7f30a015e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f30a4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f30a00cfda0 con 0x7f30a00d2a40 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f30a4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30a00cfac0 con 0x7f30a0161c90 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f30a4c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30a0162070 con 0x7f30a006e330 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a00d2a40 0x7f30a00cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a00d2a40 0x7f30a00cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56232/0 (socket says 172.21.15.7:56232) 2024-08-19T00:37:45.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 -- 172.21.15.7:0/2076277640 learned_addr learned my addr 172.21.15.7:0/2076277640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309de00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a006e330 0x7f30a014d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309e800640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a0161c90 0x7f30a015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 -- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a006e330 msgr2=0x7f30a014d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a006e330 0x7f30a014d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 -- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a0161c90 msgr2=0x7f30a015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a0161c90 0x7f30a015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309d400640 1 -- 172.21.15.7:0/2076277640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a014db50 con 0x7f30a00d2a40 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.845+0000 7f309e800640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a0161c90 0x7f30a015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:45.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.846+0000 7f309d400640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a00d2a40 0x7f30a00cb690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f308c00d5f0 tx=0x7f308c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.846+0000 7f3096000640 1 -- 172.21.15.7:0/2076277640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c0125f0 con 0x7f30a00d2a40 2024-08-19T00:37:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.846+0000 7f3096000640 1 -- 172.21.15.7:0/2076277640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308c019070 con 0x7f30a00d2a40 2024-08-19T00:37:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.846+0000 7f3096000640 1 -- 172.21.15.7:0/2076277640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c0129d0 con 0x7f30a00d2a40 2024-08-19T00:37:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.846+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a014de30 con 0x7f30a00d2a40 2024-08-19T00:37:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.846+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a00cbbd0 con 0x7f30a00d2a40 2024-08-19T00:37:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.847+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a00d3270 con 0x7f30a00d2a40 2024-08-19T00:37:45.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.848+0000 7f3096000640 1 -- 172.21.15.7:0/2076277640 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f308c012b70 con 0x7f30a00d2a40 2024-08-19T00:37:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.850+0000 7f3096000640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f308006be30 0x7f308006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.850+0000 7f3096000640 1 -- 172.21.15.7:0/2076277640 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f308c08bc20 con 0x7f30a00d2a40 2024-08-19T00:37:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.850+0000 7f309de00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f308006be30 0x7f308006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:45.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.851+0000 7f309de00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f308006be30 0x7f308006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3090034000 tx=0x7f309002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:45.854+0000 7f3096000640 1 -- 172.21.15.7:0/2076277640 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f308c05a790 con 0x7f30a00d2a40 2024-08-19T00:37:46.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.038+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f30a006d5c0 con 0x7f30a00d2a40 2024-08-19T00:37:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.658+0000 7f3096000640 1 -- 172.21.15.7:0/2076277640 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f308c05a090 con 0x7f30a00d2a40 2024-08-19T00:37:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-08-19T00:37:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.663+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f308006be30 msgr2=0x7f308006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.663+0000 7f30a4c00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f308006be30 0x7f308006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3090034000 tx=0x7f309002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.663+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a00d2a40 msgr2=0x7f30a00cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.663+0000 7f30a4c00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a00d2a40 0x7f30a00cb690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f308c00d5f0 tx=0x7f308c00dab0 comp rx=0 tx=0).stop 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.664+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 shutdown_connections 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.664+0000 7f30a4c00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f308006be30 0x7f308006e2f0 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3090034000 tx=0x7f309002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.664+0000 7f30a4c00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a0161c90 0x7f30a015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.664+0000 7f30a4c00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30a00d2a40 0x7f30a00cb690 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.664+0000 7f30a4c00640 1 --2- 172.21.15.7:0/2076277640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a006e330 0x7f30a014d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.664+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 >> 172.21.15.7:0/2076277640 conn(0x7f30a008c000 msgr2=0x7f30a00b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:46.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.665+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 shutdown_connections 2024-08-19T00:37:46.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.665+0000 7f30a4c00640 1 -- 172.21.15.7:0/2076277640 wait complete. 2024-08-19T00:37:46.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:37:46.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.859+0000 7f6947200640 1 Processor -- start 2024-08-19T00:37:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.859+0000 7f6947200640 1 -- start start 2024-08-19T00:37:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.860+0000 7f6947200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.860+0000 7f6947200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480b4df0 con 0x7f69480d27b0 2024-08-19T00:37:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.860+0000 7f6947200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480b50d0 con 0x7f69480b4150 2024-08-19T00:37:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.860+0000 7f6947200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69480cf1e0 con 0x7f694815e3e0 2024-08-19T00:37:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.860+0000 7f6945400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f69480d27b0 0x7f69480d2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41394/0 (socket says 172.21.15.7:41394) 2024-08-19T00:37:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.860+0000 7f6945400640 1 -- 172.21.15.7:0/2506505923 learned_addr learned my addr 172.21.15.7:0/2506505923 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.860+0000 7f6945e00640 1 --2- 172.21.15.7:0/2506505923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.861+0000 7f6944a00640 1 -- 172.21.15.7:0/2506505923 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516167713 0 0) 0x7f69480b4df0 con 0x7f69480d27b0 2024-08-19T00:37:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.861+0000 7f6944a00640 1 -- 172.21.15.7:0/2506505923 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f692c003520 con 0x7f69480d27b0 2024-08-19T00:37:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.861+0000 7f6945e00640 1 -- 172.21.15.7:0/2506505923 >> v1:172.21.15.162:6789/0 conn(0x7f69480b4150 legacy=0x7f69480b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.861+0000 7f6945e00640 1 -- 172.21.15.7:0/2506505923 >> v1:172.21.15.7:6789/0 conn(0x7f69480d27b0 legacy=0x7f69480d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.861+0000 7f6944a00640 1 -- 172.21.15.7:0/2506505923 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769161046 0 0) 0x7f69480b50d0 con 0x7f69480b4150 2024-08-19T00:37:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.861+0000 7f6945e00640 1 -- 172.21.15.7:0/2506505923 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480cf4c0 con 0x7f694815e3e0 2024-08-19T00:37:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.862+0000 7f6945e00640 1 --2- 172.21.15.7:0/2506505923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b0e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69380097d0 tx=0x7f693802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c8e6d58c3209615 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6944a00640 1 -- 172.21.15.7:0/2506505923 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938037070 con 0x7f694815e3e0 2024-08-19T00:37:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6944a00640 1 -- 172.21.15.7:0/2506505923 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6938032440 con 0x7f694815e3e0 2024-08-19T00:37:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6944a00640 1 -- 172.21.15.7:0/2506505923 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938032810 con 0x7f694815e3e0 2024-08-19T00:37:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6947200640 1 -- 172.21.15.7:0/2506505923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 msgr2=0x7f69480b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6947200640 1 --2- 172.21.15.7:0/2506505923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b0e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69380097d0 tx=0x7f693802a210 comp rx=0 tx=0).stop 2024-08-19T00:37:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6947200640 1 -- 172.21.15.7:0/2506505923 shutdown_connections 2024-08-19T00:37:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6947200640 1 --2- 172.21.15.7:0/2506505923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b0e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6947200640 1 -- 172.21.15.7:0/2506505923 >> 172.21.15.7:0/2506505923 conn(0x7f694808dbe0 msgr2=0x7f694809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6947200640 1 -- 172.21.15.7:0/2506505923 shutdown_connections 2024-08-19T00:37:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.863+0000 7f6947200640 1 -- 172.21.15.7:0/2506505923 wait complete. 2024-08-19T00:37:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.865+0000 7f6947200640 1 Processor -- start 2024-08-19T00:37:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.865+0000 7f6947200640 1 -- start start 2024-08-19T00:37:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6947200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69480b4150 0x7f6948158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6947200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69480d27b0 0x7f6948156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6947200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6947200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f69480cf9e0 con 0x7f69480b4150 2024-08-19T00:37:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6947200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69480b13a0 con 0x7f69480d27b0 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6947200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69480cfb60 con 0x7f694815e3e0 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6945e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69480b4150 0x7f6948158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6945e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69480b4150 0x7f6948158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56242/0 (socket says 172.21.15.7:56242) 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.866+0000 7f6945e00640 1 -- 172.21.15.7:0/2144353074 learned_addr learned my addr 172.21.15.7:0/2144353074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6945400640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69480d27b0 0x7f6948156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6946800640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6945e00640 1 -- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 msgr2=0x7f69480b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6945e00640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6945e00640 1 -- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69480d27b0 msgr2=0x7f6948156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6945e00640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69480d27b0 0x7f6948156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6945e00640 1 -- 172.21.15.7:0/2144353074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480c7e80 con 0x7f69480b4150 2024-08-19T00:37:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6945e00640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69480b4150 0x7f6948158a60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6938035040 tx=0x7f69380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f693e000640 1 -- 172.21.15.7:0/2144353074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938041020 con 0x7f69480b4150 2024-08-19T00:37:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f693e000640 1 -- 172.21.15.7:0/2144353074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693803d6e0 con 0x7f69480b4150 2024-08-19T00:37:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f693e000640 1 -- 172.21.15.7:0/2144353074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938037040 con 0x7f69480b4150 2024-08-19T00:37:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.867+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69480c8160 con 0x7f69480b4150 2024-08-19T00:37:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.868+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69480b7f70 con 0x7f69480b4150 2024-08-19T00:37:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.869+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69480b0e60 con 0x7f69480b4150 2024-08-19T00:37:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.870+0000 7f693e000640 1 -- 172.21.15.7:0/2144353074 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6938044020 con 0x7f69480b4150 2024-08-19T00:37:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.871+0000 7f693e000640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f692806be30 0x7f692806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.871+0000 7f693e000640 1 -- 172.21.15.7:0/2144353074 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f69380abbd0 con 0x7f69480b4150 2024-08-19T00:37:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.871+0000 7f6945400640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f692806be30 0x7f692806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.871+0000 7f6945400640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f692806be30 0x7f692806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f69480d2cf0 tx=0x7f6934009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:46.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:46.874+0000 7f693e000640 1 -- 172.21.15.7:0/2144353074 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f693804b030 con 0x7f69480b4150 2024-08-19T00:37:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.094+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f69480d1630 con 0x7f69480b4150 2024-08-19T00:37:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.669+0000 7f693e000640 1 -- 172.21.15.7:0/2144353074 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f693807a770 con 0x7f69480b4150 2024-08-19T00:37:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 4 and data pool 5 2024-08-19T00:37:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.675+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f692806be30 msgr2=0x7f692806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.675+0000 7f6947200640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f692806be30 0x7f692806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f69480d2cf0 tx=0x7f6934009040 comp rx=0 tx=0).stop 2024-08-19T00:37:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.675+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69480b4150 msgr2=0x7f6948158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.675+0000 7f6947200640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69480b4150 0x7f6948158a60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6938035040 tx=0x7f69380046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.677+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 shutdown_connections 2024-08-19T00:37:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.677+0000 7f6947200640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f692806be30 0x7f692806e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.677+0000 7f6947200640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694815e3e0 0x7f69480b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.677+0000 7f6947200640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69480d27b0 0x7f6948156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.677+0000 7f6947200640 1 --2- 172.21.15.7:0/2144353074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69480b4150 0x7f6948158a60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.677+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 >> 172.21.15.7:0/2144353074 conn(0x7f694808dbe0 msgr2=0x7f69480b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:47.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.679+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 shutdown_connections 2024-08-19T00:37:47.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.679+0000 7f6947200640 1 -- 172.21.15.7:0/2144353074 wait complete. 2024-08-19T00:37:47.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:47.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.873+0000 7f372b200640 1 Processor -- start 2024-08-19T00:37:47.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.873+0000 7f372b200640 1 -- start start 2024-08-19T00:37:47.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f372b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f372406e710 0x7f3724071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:47.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f372b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37240b3750 0x7f37240cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:47.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f372b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37240cdfb0 con 0x7f37240d03c0 2024-08-19T00:37:47.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f372b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f37240cebc0 con 0x7f372406e710 2024-08-19T00:37:47.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f372b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f37240ce290 con 0x7f37240b3750 2024-08-19T00:37:47.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f3723e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f37240d03c0 0x7f37240d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41408/0 (socket says 172.21.15.7:41408) 2024-08-19T00:37:47.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f3723e00640 1 -- 172.21.15.7:0/4033556567 learned_addr learned my addr 172.21.15.7:0/4033556567 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:47.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f371be00640 1 --2- 172.21.15.7:0/4033556567 >> v2:172.21.15.7:3300/0 conn(0x7f372406e710 0x7f3724071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f3729200640 1 --2- 172.21.15.7:0/4033556567 >> v2:172.21.15.162:3300/0 conn(0x7f37240b3750 0x7f37240cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f3723400640 1 -- 172.21.15.7:0/4033556567 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754374628 0 0) 0x7f37240cdfb0 con 0x7f37240d03c0 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f3723400640 1 -- 172.21.15.7:0/4033556567 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3708005730 con 0x7f37240d03c0 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f371be00640 1 -- 172.21.15.7:0/4033556567 >> v2:172.21.15.162:3300/0 conn(0x7f37240b3750 msgr2=0x7f37240cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f371be00640 1 --2- 172.21.15.7:0/4033556567 >> v2:172.21.15.162:3300/0 conn(0x7f37240b3750 0x7f37240cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f371be00640 1 -- 172.21.15.7:0/4033556567 >> v1:172.21.15.7:6789/0 conn(0x7f37240d03c0 legacy=0x7f37240d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.875+0000 7f371be00640 1 -- 172.21.15.7:0/4033556567 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37240ce570 con 0x7f372406e710 2024-08-19T00:37:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.876+0000 7f371be00640 1 --2- 172.21.15.7:0/4033556567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f3724071980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f370c0097a0 tx=0x7f370c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c681c90bcf2b4a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f3723400640 1 -- 172.21.15.7:0/4033556567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c037070 con 0x7f372406e710 2024-08-19T00:37:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f3723400640 1 -- 172.21.15.7:0/4033556567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f370c032440 con 0x7f372406e710 2024-08-19T00:37:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f3723400640 1 -- 172.21.15.7:0/4033556567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c032810 con 0x7f372406e710 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f372b200640 1 -- 172.21.15.7:0/4033556567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 msgr2=0x7f3724071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f372b200640 1 --2- 172.21.15.7:0/4033556567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f3724071980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f370c0097a0 tx=0x7f370c02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f372b200640 1 -- 172.21.15.7:0/4033556567 shutdown_connections 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f372b200640 1 --2- 172.21.15.7:0/4033556567 >> v2:172.21.15.162:3300/0 conn(0x7f37240b3750 0x7f37240cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f372b200640 1 --2- 172.21.15.7:0/4033556567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f3724071980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.877+0000 7f372b200640 1 -- 172.21.15.7:0/4033556567 >> 172.21.15.7:0/4033556567 conn(0x7f372406bc70 msgr2=0x7f372406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.878+0000 7f372b200640 1 -- 172.21.15.7:0/4033556567 shutdown_connections 2024-08-19T00:37:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.878+0000 7f372b200640 1 -- 172.21.15.7:0/4033556567 wait complete. 2024-08-19T00:37:47.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.879+0000 7f372b200640 1 Processor -- start 2024-08-19T00:37:47.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.879+0000 7f372b200640 1 -- start start 2024-08-19T00:37:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f372b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f37241f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f372b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37240b3750 0x7f372409a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f372b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240d03c0 0x7f372415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f372b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3724073c60 con 0x7f372406e710 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f372b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3724073ae0 con 0x7f37240d03c0 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f372b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37240b3be0 con 0x7f37240b3750 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f3723e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f37241f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f3723e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f37241f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56270/0 (socket says 172.21.15.7:56270) 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.880+0000 7f3723e00640 1 -- 172.21.15.7:0/1898730628 learned_addr learned my addr 172.21.15.7:0/1898730628 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3729200640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240d03c0 0x7f372415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f371be00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37240b3750 0x7f372409a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3723e00640 1 -- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37240b3750 msgr2=0x7f372409a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3723e00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37240b3750 0x7f372409a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3723e00640 1 -- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240d03c0 msgr2=0x7f372415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3723e00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240d03c0 0x7f372415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3723e00640 1 -- 172.21.15.7:0/1898730628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372409d3d0 con 0x7f372406e710 2024-08-19T00:37:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f371be00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37240b3750 0x7f372409a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3723e00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f37241f3c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f371400c430 tx=0x7f371400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3720c00640 1 -- 172.21.15.7:0/1898730628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714017070 con 0x7f372406e710 2024-08-19T00:37:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3720c00640 1 -- 172.21.15.7:0/1898730628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3714005ce0 con 0x7f372406e710 2024-08-19T00:37:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372409d6b0 con 0x7f372406e710 2024-08-19T00:37:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.881+0000 7f3720c00640 1 -- 172.21.15.7:0/1898730628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37140072f0 con 0x7f372406e710 2024-08-19T00:37:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.882+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372409dc70 con 0x7f372406e710 2024-08-19T00:37:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.883+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3724071980 con 0x7f372406e710 2024-08-19T00:37:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.884+0000 7f3720c00640 1 -- 172.21.15.7:0/1898730628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f371401a070 con 0x7f372406e710 2024-08-19T00:37:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.884+0000 7f3720c00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370006be30 0x7f370006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.885+0000 7f3720c00640 1 -- 172.21.15.7:0/1898730628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f371408a2b0 con 0x7f372406e710 2024-08-19T00:37:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.885+0000 7f371be00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370006be30 0x7f370006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.885+0000 7f371be00640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370006be30 0x7f370006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f370c034000 tx=0x7f370c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:47.889+0000 7f3720c00640 1 -- 172.21.15.7:0/1898730628 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3714058610 con 0x7f372406e710 2024-08-19T00:37:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.073+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3724073680 con 0x7f372406e710 2024-08-19T00:37:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.074+0000 7f3720c00640 1 -- 172.21.15.7:0/1898730628 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16586 (secure 0 0 0) 0x7f371405c910 con 0x7f372406e710 2024-08-19T00:37:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:48.076 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:47.095569+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:45.444628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:46.080604+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370006be30 msgr2=0x7f370006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370006be30 0x7f370006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f370c034000 tx=0x7f370c02e000 comp rx=0 tx=0).stop 2024-08-19T00:37:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 msgr2=0x7f37241f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f37241f3c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f371400c430 tx=0x7f371400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 shutdown_connections 2024-08-19T00:37:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370006be30 0x7f370006e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240d03c0 0x7f372415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37240b3750 0x7f372409a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 --2- 172.21.15.7:0/1898730628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372406e710 0x7f37241f3c50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.076+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 >> 172.21.15.7:0/1898730628 conn(0x7f372406bc70 msgr2=0x7f37240ad760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.077+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 shutdown_connections 2024-08-19T00:37:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.077+0000 7f372b200640 1 -- 172.21.15.7:0/1898730628 wait complete. 2024-08-19T00:37:48.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.249+0000 7fe19b200640 1 Processor -- start 2024-08-19T00:37:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.249+0000 7fe19b200640 1 -- start start 2024-08-19T00:37:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe19b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe19c0d48e0 0x7fe19c0d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe19b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe19c0b3f10 0x7fe19c0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe19b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19c0d4d50 con 0x7fe19c0d27b0 2024-08-19T00:37:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe19b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe19c0d0110 con 0x7fe19c0b3f10 2024-08-19T00:37:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe19b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe19c0d4fe0 con 0x7fe19c0d48e0 2024-08-19T00:37:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe199e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe19c0d27b0 0x7fe19c0d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41418/0 (socket says 172.21.15.7:41418) 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe199e00640 1 -- 172.21.15.7:0/1683482187 learned_addr learned my addr 172.21.15.7:0/1683482187 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.250+0000 7fe19a800640 1 --2- 172.21.15.7:0/1683482187 >> v2:172.21.15.7:3300/0 conn(0x7fe19c0b3f10 0x7fe19c0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.251+0000 7fe193e00640 1 --2- 172.21.15.7:0/1683482187 >> v2:172.21.15.162:3300/0 conn(0x7fe19c0d48e0 0x7fe19c0d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.251+0000 7fe19a800640 1 -- 172.21.15.7:0/1683482187 >> v2:172.21.15.162:3300/0 conn(0x7fe19c0d48e0 msgr2=0x7fe19c0d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.251+0000 7fe19a800640 1 --2- 172.21.15.7:0/1683482187 >> v2:172.21.15.162:3300/0 conn(0x7fe19c0d48e0 0x7fe19c0d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.251+0000 7fe19a800640 1 -- 172.21.15.7:0/1683482187 >> v1:172.21.15.7:6789/0 conn(0x7fe19c0d27b0 legacy=0x7fe19c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.251+0000 7fe19a800640 1 -- 172.21.15.7:0/1683482187 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0cf870 con 0x7fe19c0b3f10 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.251+0000 7fe199400640 1 -- 172.21.15.7:0/1683482187 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664563952 0 0) 0x7fe19c0d4d50 con 0x7fe19c0d27b0 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.252+0000 7fe19a800640 1 --2- 172.21.15.7:0/1683482187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0b3f10 0x7fe19c0b43a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe19c09d940 tx=0x7fe19402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d377a5835e074c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.252+0000 7fe199400640 1 -- 172.21.15.7:0/1683482187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194007740 con 0x7fe19c0b3f10 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.252+0000 7fe199400640 1 -- 172.21.15.7:0/1683482187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1940078e0 con 0x7fe19c0b3f10 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.252+0000 7fe199400640 1 -- 172.21.15.7:0/1683482187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194007cb0 con 0x7fe19c0b3f10 2024-08-19T00:37:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 -- 172.21.15.7:0/1683482187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0b3f10 msgr2=0x7fe19c0b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 --2- 172.21.15.7:0/1683482187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0b3f10 0x7fe19c0b43a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe19c09d940 tx=0x7fe19402a680 comp rx=0 tx=0).stop 2024-08-19T00:37:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 -- 172.21.15.7:0/1683482187 shutdown_connections 2024-08-19T00:37:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 --2- 172.21.15.7:0/1683482187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0b3f10 0x7fe19c0b43a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 --2- 172.21.15.7:0/1683482187 >> v2:172.21.15.162:3300/0 conn(0x7fe19c0d48e0 0x7fe19c0d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 -- 172.21.15.7:0/1683482187 >> 172.21.15.7:0/1683482187 conn(0x7fe19c09d510 msgr2=0x7fe19c0d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 -- 172.21.15.7:0/1683482187 shutdown_connections 2024-08-19T00:37:48.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.253+0000 7fe19b200640 1 -- 172.21.15.7:0/1683482187 wait complete. 2024-08-19T00:37:48.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.254+0000 7fe19b200640 1 Processor -- start 2024-08-19T00:37:48.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.254+0000 7fe19b200640 1 -- start start 2024-08-19T00:37:48.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.255+0000 7fe19b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe19c0b3f10 0x7fe19c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.255+0000 7fe19b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0d27b0 0x7fe19c0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.255+0000 7fe19b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe19c0d48e0 0x7fe19c0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.255+0000 7fe19b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c15e550 con 0x7fe19c0d27b0 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.255+0000 7fe19b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0cfe30 con 0x7fe19c0d48e0 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.255+0000 7fe19b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c15e6d0 con 0x7fe19c0b3f10 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0d27b0 0x7fe19c0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0d27b0 0x7fe19c0b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56282/0 (socket says 172.21.15.7:56282) 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 -- 172.21.15.7:0/109346037 learned_addr learned my addr 172.21.15.7:0/109346037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe19a800640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe19c0d48e0 0x7fe19c0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe199e00640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe19c0b3f10 0x7fe19c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 -- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe19c0b3f10 msgr2=0x7fe19c1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe19c0b3f10 0x7fe19c1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 -- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe19c0d48e0 msgr2=0x7fe19c0b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe19c0d48e0 0x7fe19c0b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 -- 172.21.15.7:0/109346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c153bf0 con 0x7fe19c0d27b0 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe193e00640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0d27b0 0x7fe19c0b5df0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe18400d5f0 tx=0x7fe18400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.256+0000 7fe192000640 1 -- 172.21.15.7:0/109346037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1840125f0 con 0x7fe19c0d27b0 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.257+0000 7fe192000640 1 -- 172.21.15.7:0/109346037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe184019070 con 0x7fe19c0d27b0 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.257+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c15ffa0 con 0x7fe19c0d27b0 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.257+0000 7fe192000640 1 -- 172.21.15.7:0/109346037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1840129d0 con 0x7fe19c0d27b0 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.257+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c160560 con 0x7fe19c0d27b0 2024-08-19T00:37:48.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.258+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c0d1fd0 con 0x7fe19c0d27b0 2024-08-19T00:37:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.259+0000 7fe192000640 1 -- 172.21.15.7:0/109346037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe184012b70 con 0x7fe19c0d27b0 2024-08-19T00:37:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.260+0000 7fe192000640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe17806be30 0x7fe17806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.260+0000 7fe192000640 1 -- 172.21.15.7:0/109346037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe18408b260 con 0x7fe19c0d27b0 2024-08-19T00:37:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.260+0000 7fe199e00640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe17806be30 0x7fe17806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.260+0000 7fe199e00640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe17806be30 0x7fe17806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f60 tx=0x7fe18c007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.264+0000 7fe192000640 1 -- 172.21.15.7:0/109346037 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe184059c00 con 0x7fe19c0d27b0 2024-08-19T00:37:48.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.449+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe19c0b1f50 con 0x7fe19c0d27b0 2024-08-19T00:37:48.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.451+0000 7fe192000640 1 -- 172.21.15.7:0/109346037 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16586 (secure 0 0 0) 0x7fe184059500 con 0x7fe19c0d27b0 2024-08-19T00:37:48.453 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:48.453 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:47.095569+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:45.444628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:46.080604+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe17806be30 msgr2=0x7fe17806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe17806be30 0x7fe17806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f60 tx=0x7fe18c007b70 comp rx=0 tx=0).stop 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0d27b0 msgr2=0x7fe19c0b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0d27b0 0x7fe19c0b5df0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe18400d5f0 tx=0x7fe18400dab0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 shutdown_connections 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe17806be30 0x7fe17806e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe19c0d48e0 0x7fe19c0b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe19c0d27b0 0x7fe19c0b5df0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 --2- 172.21.15.7:0/109346037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe19c0b3f10 0x7fe19c1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 >> 172.21.15.7:0/109346037 conn(0x7fe19c09d510 msgr2=0x7fe19c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:48.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 shutdown_connections 2024-08-19T00:37:48.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.453+0000 7fe19b200640 1 -- 172.21.15.7:0/109346037 wait complete. 2024-08-19T00:37:48.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:37:48.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.629+0000 7f37c2000640 1 Processor -- start 2024-08-19T00:37:48.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.629+0000 7f37c2000640 1 -- start start 2024-08-19T00:37:48.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37c2000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37bc0b4160 0x7f37bc0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37c2000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37bc0aeae0 con 0x7f37bc158cd0 2024-08-19T00:37:48.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37c2000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37bc0aedc0 con 0x7f37bc0731c0 2024-08-19T00:37:48.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37c2000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f37bc0af0a0 con 0x7f37bc0b4160 2024-08-19T00:37:48.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37bb400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f37bc158cd0 0x7f37bc072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41420/0 (socket says 172.21.15.7:41420) 2024-08-19T00:37:48.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37bb400640 1 -- 172.21.15.7:0/1655047258 learned_addr learned my addr 172.21.15.7:0/1655047258 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:48.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37bbe00640 1 --2- 172.21.15.7:0/1655047258 >> v2:172.21.15.162:3300/0 conn(0x7f37bc0b4160 0x7f37bc0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37ba000640 1 -- 172.21.15.7:0/1655047258 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740660689 0 0) 0x7f37bc0aeae0 con 0x7f37bc158cd0 2024-08-19T00:37:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37ba000640 1 -- 172.21.15.7:0/1655047258 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37a0005730 con 0x7f37bc158cd0 2024-08-19T00:37:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.631+0000 7f37ba000640 1 -- 172.21.15.7:0/1655047258 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052248727 0 0) 0x7f37bc0aedc0 con 0x7f37bc0731c0 2024-08-19T00:37:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.632+0000 7f37ba000640 1 -- 172.21.15.7:0/1655047258 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37bc0aeae0 con 0x7f37bc0731c0 2024-08-19T00:37:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.632+0000 7f37bbe00640 1 -- 172.21.15.7:0/1655047258 >> v1:172.21.15.162:6789/0 conn(0x7f37bc0731c0 legacy=0x7f37bc0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.632+0000 7f37bbe00640 1 -- 172.21.15.7:0/1655047258 >> v1:172.21.15.7:6789/0 conn(0x7f37bc158cd0 legacy=0x7f37bc072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.632+0000 7f37bbe00640 1 -- 172.21.15.7:0/1655047258 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc0af380 con 0x7f37bc0b4160 2024-08-19T00:37:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.633+0000 7f37bbe00640 1 --2- 172.21.15.7:0/1655047258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0b4160 0x7f37bc0ae480 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009d90 tx=0x7f37b402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22db567450a50095 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.633+0000 7f37ba000640 1 -- 172.21.15.7:0/1655047258 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4031600 con 0x7f37bc0b4160 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.633+0000 7f37ba000640 1 -- 172.21.15.7:0/1655047258 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b40317a0 con 0x7f37bc0b4160 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.633+0000 7f37ba000640 1 -- 172.21.15.7:0/1655047258 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4031b70 con 0x7f37bc0b4160 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.633+0000 7f37c2000640 1 -- 172.21.15.7:0/1655047258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0b4160 msgr2=0x7f37bc0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.633+0000 7f37c2000640 1 --2- 172.21.15.7:0/1655047258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0b4160 0x7f37bc0ae480 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009d90 tx=0x7f37b402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.634+0000 7f37c2000640 1 -- 172.21.15.7:0/1655047258 shutdown_connections 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.634+0000 7f37c2000640 1 --2- 172.21.15.7:0/1655047258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0b4160 0x7f37bc0ae480 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.634+0000 7f37c2000640 1 -- 172.21.15.7:0/1655047258 >> 172.21.15.7:0/1655047258 conn(0x7f37bc0b2300 msgr2=0x7f37bc06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.634+0000 7f37c2000640 1 -- 172.21.15.7:0/1655047258 shutdown_connections 2024-08-19T00:37:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.634+0000 7f37c2000640 1 -- 172.21.15.7:0/1655047258 wait complete. 2024-08-19T00:37:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.635+0000 7f37c2000640 1 Processor -- start 2024-08-19T00:37:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.635+0000 7f37c2000640 1 -- start start 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.636+0000 7f37c2000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37bc0731c0 0x7f37bc0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.636+0000 7f37c2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc0b4160 0x7f37bc14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.636+0000 7f37c2000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0cc970 0x7f37bc15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.636+0000 7f37c2000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc071b20 con 0x7f37bc0b4160 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.636+0000 7f37c2000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc0719a0 con 0x7f37bc0cc970 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.636+0000 7f37c2000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37bc071ca0 con 0x7f37bc0731c0 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc0b4160 0x7f37bc14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc0b4160 0x7f37bc14bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56292/0 (socket says 172.21.15.7:56292) 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 -- 172.21.15.7:0/3926992517 learned_addr learned my addr 172.21.15.7:0/3926992517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37bb400640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37bc0731c0 0x7f37bc0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37bbe00640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0cc970 0x7f37bc15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 -- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37bc0731c0 msgr2=0x7f37bc0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37bc0731c0 0x7f37bc0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 -- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0cc970 msgr2=0x7f37bc15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0cc970 0x7f37bc15a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.637+0000 7f37baa00640 1 -- 172.21.15.7:0/3926992517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc0cd350 con 0x7f37bc0b4160 2024-08-19T00:37:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.638+0000 7f37baa00640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc0b4160 0x7f37bc14bc20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37a800c460 tx=0x7f37a800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:48.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.638+0000 7f37b3400640 1 -- 172.21.15.7:0/3926992517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a80052d0 con 0x7f37bc0b4160 2024-08-19T00:37:48.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.638+0000 7f37b3400640 1 -- 172.21.15.7:0/3926992517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a8005470 con 0x7f37bc0b4160 2024-08-19T00:37:48.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.638+0000 7f37b3400640 1 -- 172.21.15.7:0/3926992517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8012870 con 0x7f37bc0b4160 2024-08-19T00:37:48.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.638+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc0cd630 con 0x7f37bc0b4160 2024-08-19T00:37:48.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.638+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc0cdbf0 con 0x7f37bc0b4160 2024-08-19T00:37:48.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.639+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37bc0add70 con 0x7f37bc0b4160 2024-08-19T00:37:48.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.640+0000 7f37b3400640 1 -- 172.21.15.7:0/3926992517 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37a8012a10 con 0x7f37bc0b4160 2024-08-19T00:37:48.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.641+0000 7f37b3400640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:48.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.641+0000 7f37b3400640 1 -- 172.21.15.7:0/3926992517 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f37a808a940 con 0x7f37bc0b4160 2024-08-19T00:37:48.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.641+0000 7f37bb400640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:48.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.642+0000 7f37bb400640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f379c06be30 0x7f379c06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0011e0 tx=0x7f37ac007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:48.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.645+0000 7f37b3400640 1 -- 172.21.15.7:0/3926992517 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f37a8058d50 con 0x7f37bc0b4160 2024-08-19T00:37:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:48.875+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f37bc0cfd30 con 0x7f37bc0b4160 2024-08-19T00:37:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.682+0000 7f37b3400640 1 -- 172.21.15.7:0/3926992517 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f37a805d050 con 0x7f37bc0b4160 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f379c06be30 msgr2=0x7f379c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f379c06be30 0x7f379c06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0011e0 tx=0x7f37ac007d30 comp rx=0 tx=0).stop 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc0b4160 msgr2=0x7f37bc14bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc0b4160 0x7f37bc14bc20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37a800c460 tx=0x7f37a800c920 comp rx=0 tx=0).stop 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 shutdown_connections 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37bc0cc970 0x7f37bc15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37bc0b4160 0x7f37bc14bc20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 --2- 172.21.15.7:0/3926992517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37bc0731c0 0x7f37bc0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 >> 172.21.15.7:0/3926992517 conn(0x7f37bc0b2300 msgr2=0x7f37bc0afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:49.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 shutdown_connections 2024-08-19T00:37:49.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.686+0000 7f37c2000640 1 -- 172.21.15.7:0/3926992517 wait complete. 2024-08-19T00:37:49.707 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-19T00:37:49.707 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-19T00:37:49.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.870+0000 7f9537200640 1 Processor -- start 2024-08-19T00:37:49.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.870+0000 7f9537200640 1 -- start start 2024-08-19T00:37:49.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.871+0000 7f9537200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f953815e3e0 0x7f95380b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.871+0000 7f9537200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95380d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.871+0000 7f9537200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f95380b4150 0x7f95380b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.871+0000 7f9537200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f95380d3110 con 0x7f953815e3e0 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.871+0000 7f9537200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f95380b4b20 con 0x7f95380b4150 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.871+0000 7f9537200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f95380b4df0 con 0x7f95380d27b0 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.871+0000 7f9535e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f953815e3e0 0x7f95380b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f953815e3e0 0x7f95380b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56296/0 (socket says 172.21.15.7:56296) 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535e00640 1 -- 172.21.15.7:0/3667288827 learned_addr learned my addr 172.21.15.7:0/3667288827 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9536800640 1 --2- 172.21.15.7:0/3667288827 >> v2:172.21.15.162:3300/0 conn(0x7f95380b4150 0x7f95380b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535400640 1 --2- 172.21.15.7:0/3667288827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95380d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535e00640 1 -- 172.21.15.7:0/3667288827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 msgr2=0x7f95380d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:49.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535e00640 1 --2- 172.21.15.7:0/3667288827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95380d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535e00640 1 -- 172.21.15.7:0/3667288827 >> v2:172.21.15.162:3300/0 conn(0x7f95380b4150 msgr2=0x7f95380b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535e00640 1 --2- 172.21.15.7:0/3667288827 >> v2:172.21.15.162:3300/0 conn(0x7f95380b4150 0x7f95380b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.872+0000 7f9535e00640 1 -- 172.21.15.7:0/3667288827 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95380b50d0 con 0x7f953815e3e0 2024-08-19T00:37:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.873+0000 7f9535e00640 1 --2- 172.21.15.7:0/3667288827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953815e3e0 0x7f95380b0e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9538161d70 tx=0x7f952802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfca31f688314a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.873+0000 7f9534a00640 1 -- 172.21.15.7:0/3667288827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528037070 con 0x7f953815e3e0 2024-08-19T00:37:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.873+0000 7f9534a00640 1 -- 172.21.15.7:0/3667288827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9528032440 con 0x7f953815e3e0 2024-08-19T00:37:49.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.873+0000 7f9534a00640 1 -- 172.21.15.7:0/3667288827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528032810 con 0x7f953815e3e0 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 -- 172.21.15.7:0/3667288827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953815e3e0 msgr2=0x7f95380b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 --2- 172.21.15.7:0/3667288827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953815e3e0 0x7f95380b0e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9538161d70 tx=0x7f952802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 -- 172.21.15.7:0/3667288827 shutdown_connections 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 --2- 172.21.15.7:0/3667288827 >> v2:172.21.15.162:3300/0 conn(0x7f95380b4150 0x7f95380b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 --2- 172.21.15.7:0/3667288827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95380d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 --2- 172.21.15.7:0/3667288827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953815e3e0 0x7f95380b0e60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 -- 172.21.15.7:0/3667288827 >> 172.21.15.7:0/3667288827 conn(0x7f953808dbe0 msgr2=0x7f953809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 -- 172.21.15.7:0/3667288827 shutdown_connections 2024-08-19T00:37:49.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.874+0000 7f9537200640 1 -- 172.21.15.7:0/3667288827 wait complete. 2024-08-19T00:37:49.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.876+0000 7f9537200640 1 Processor -- start 2024-08-19T00:37:49.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.876+0000 7f9537200640 1 -- start start 2024-08-19T00:37:49.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9537200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95380b4150 0x7f9538156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9537200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95381f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9537200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f953815e3e0 0x7f95381f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9537200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95380cee90 con 0x7f95380b4150 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9537200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f95380cf4c0 con 0x7f953815e3e0 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9537200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f95380b13a0 con 0x7f95380d27b0 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95380b4150 0x7f9538156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95380b4150 0x7f9538156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56298/0 (socket says 172.21.15.7:56298) 2024-08-19T00:37:49.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 -- 172.21.15.7:0/1191859576 learned_addr learned my addr 172.21.15.7:0/1191859576 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:49.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535400640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95381f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:49.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 -- 172.21.15.7:0/1191859576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 msgr2=0x7f95381f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:49.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95381f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 -- 172.21.15.7:0/1191859576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f953815e3e0 msgr2=0x7f95381f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:49.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f953815e3e0 0x7f95381f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.877+0000 7f9535e00640 1 -- 172.21.15.7:0/1191859576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9538158890 con 0x7f95380b4150 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.878+0000 7f9535e00640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95380b4150 0x7f9538156940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9528000c00 tx=0x7f95280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.878+0000 7f952e000640 1 -- 172.21.15.7:0/1191859576 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528041070 con 0x7f95380b4150 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.878+0000 7f952e000640 1 -- 172.21.15.7:0/1191859576 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952803c870 con 0x7f95380b4150 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.878+0000 7f952e000640 1 -- 172.21.15.7:0/1191859576 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528037040 con 0x7f95380b4150 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.878+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9538158b70 con 0x7f95380b4150 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.878+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95380a21a0 con 0x7f95380b4150 2024-08-19T00:37:49.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.879+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95380d2bd0 con 0x7f95380b4150 2024-08-19T00:37:49.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.880+0000 7f952e000640 1 -- 172.21.15.7:0/1191859576 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9528044070 con 0x7f95380b4150 2024-08-19T00:37:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.881+0000 7f952e000640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f951806be30 0x7f951806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.881+0000 7f952e000640 1 -- 172.21.15.7:0/1191859576 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f95280ab9d0 con 0x7f95380b4150 2024-08-19T00:37:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.881+0000 7f9535400640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f951806be30 0x7f951806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:49.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.882+0000 7f9535400640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f951806be30 0x7f951806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95380ba160 tx=0x7f9524008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:49.886+0000 7f952e000640 1 -- 172.21.15.7:0/1191859576 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f952807a530 con 0x7f95380b4150 2024-08-19T00:37:50.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.104+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f95380b3a40 con 0x7f95380b4150 2024-08-19T00:37:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.688+0000 7f952e000640 1 -- 172.21.15.7:0/1191859576 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f9528079e30 con 0x7f95380b4150 2024-08-19T00:37:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.691+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f951806be30 msgr2=0x7f951806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.691+0000 7f9537200640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f951806be30 0x7f951806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95380ba160 tx=0x7f9524008040 comp rx=0 tx=0).stop 2024-08-19T00:37:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.691+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95380b4150 msgr2=0x7f9538156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.691+0000 7f9537200640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95380b4150 0x7f9538156940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9528000c00 tx=0x7f95280046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.691+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 shutdown_connections 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.692+0000 7f9537200640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f951806be30 0x7f951806e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.692+0000 7f9537200640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f953815e3e0 0x7f95381f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.692+0000 7f9537200640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95380d27b0 0x7f95381f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.692+0000 7f9537200640 1 --2- 172.21.15.7:0/1191859576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95380b4150 0x7f9538156940 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.692+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 >> 172.21.15.7:0/1191859576 conn(0x7f953808dbe0 msgr2=0x7f95380cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.692+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 shutdown_connections 2024-08-19T00:37:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.692+0000 7f9537200640 1 -- 172.21.15.7:0/1191859576 wait complete. 2024-08-19T00:37:50.714 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-19T00:37:50.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.873+0000 7f79a7600640 1 Processor -- start 2024-08-19T00:37:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.873+0000 7f79a7600640 1 -- start start 2024-08-19T00:37:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.874+0000 7f79a7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a0159bf0 0x7f79a0073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f79a7600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f79a00739a0 0x7f79a00ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f79a7600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a006f7f0 con 0x7f79a00cea40 2024-08-19T00:37:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f79a7600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f79a006f510 con 0x7f79a00739a0 2024-08-19T00:37:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f79a7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79a0072980 con 0x7f79a0159bf0 2024-08-19T00:37:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f79a4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a0159bf0 0x7f79a0073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f79a4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a0159bf0 0x7f79a0073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:57980/0 (socket says 172.21.15.7:57980) 2024-08-19T00:37:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f799fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f79a00739a0 0x7f79a00ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.875+0000 7f79a4c00640 1 -- 172.21.15.7:0/2845210671 learned_addr learned my addr 172.21.15.7:0/2845210671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.876+0000 7f799f400640 1 -- 172.21.15.7:0/2845210671 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470055937 0 0) 0x7f79a006f7f0 con 0x7f79a00cea40 2024-08-19T00:37:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.876+0000 7f79a4c00640 1 -- 172.21.15.7:0/2845210671 >> v2:172.21.15.162:3300/0 conn(0x7f79a00739a0 msgr2=0x7f79a00ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.876+0000 7f79a4c00640 1 --2- 172.21.15.7:0/2845210671 >> v2:172.21.15.162:3300/0 conn(0x7f79a00739a0 0x7f79a00ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.876+0000 7f79a4c00640 1 -- 172.21.15.7:0/2845210671 >> v1:172.21.15.162:6789/0 conn(0x7f79a00cea40 legacy=0x7f79a00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.876+0000 7f79a4c00640 1 -- 172.21.15.7:0/2845210671 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a0072c60 con 0x7f79a0159bf0 2024-08-19T00:37:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.877+0000 7f79a4c00640 1 --2- 172.21.15.7:0/2845210671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a0159bf0 0x7f79a0073460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7994009870 tx=0x7f799402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24181548c1dae8c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.877+0000 7f799f400640 1 -- 172.21.15.7:0/2845210671 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994037070 con 0x7f79a0159bf0 2024-08-19T00:37:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.877+0000 7f799f400640 1 -- 172.21.15.7:0/2845210671 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994032440 con 0x7f79a0159bf0 2024-08-19T00:37:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.877+0000 7f799f400640 1 -- 172.21.15.7:0/2845210671 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994032810 con 0x7f79a0159bf0 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 -- 172.21.15.7:0/2845210671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a0159bf0 msgr2=0x7f79a0073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 --2- 172.21.15.7:0/2845210671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a0159bf0 0x7f79a0073460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7994009870 tx=0x7f799402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 -- 172.21.15.7:0/2845210671 shutdown_connections 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 --2- 172.21.15.7:0/2845210671 >> v2:172.21.15.162:3300/0 conn(0x7f79a00739a0 0x7f79a00ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 --2- 172.21.15.7:0/2845210671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a0159bf0 0x7f79a0073460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 -- 172.21.15.7:0/2845210671 >> 172.21.15.7:0/2845210671 conn(0x7f79a006bc70 msgr2=0x7f79a006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 -- 172.21.15.7:0/2845210671 shutdown_connections 2024-08-19T00:37:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.878+0000 7f79a7600640 1 -- 172.21.15.7:0/2845210671 wait complete. 2024-08-19T00:37:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.880+0000 7f79a7600640 1 Processor -- start 2024-08-19T00:37:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.880+0000 7f79a7600640 1 -- start start 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.880+0000 7f79a7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a00739a0 0x7f79a0155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.880+0000 7f79a7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a00cea40 0x7f79a014a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79a0159bf0 0x7f79a0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a7600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79a015a150 con 0x7f79a00739a0 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0159fd0 con 0x7f79a0159bf0 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79a00d0ad0 con 0x7f79a00cea40 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a00739a0 0x7f79a0155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a00739a0 0x7f79a0155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56314/0 (socket says 172.21.15.7:56314) 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 -- 172.21.15.7:0/3236012442 learned_addr learned my addr 172.21.15.7:0/3236012442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f799fe00640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a00cea40 0x7f79a014a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a5600640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79a0159bf0 0x7f79a0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 -- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a00cea40 msgr2=0x7f79a014a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a00cea40 0x7f79a014a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 -- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79a0159bf0 msgr2=0x7f79a0154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79a0159bf0 0x7f79a0154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.881+0000 7f79a4c00640 1 -- 172.21.15.7:0/3236012442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a014ad80 con 0x7f79a00739a0 2024-08-19T00:37:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.882+0000 7f79a4c00640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a00739a0 0x7f79a0155ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f799402a200 tx=0x7f79940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.882+0000 7f799cc00640 1 -- 172.21.15.7:0/3236012442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994041030 con 0x7f79a00739a0 2024-08-19T00:37:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.882+0000 7f799cc00640 1 -- 172.21.15.7:0/3236012442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994030440 con 0x7f79a00739a0 2024-08-19T00:37:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.882+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a01557b0 con 0x7f79a00739a0 2024-08-19T00:37:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.882+0000 7f799cc00640 1 -- 172.21.15.7:0/3236012442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994037040 con 0x7f79a00739a0 2024-08-19T00:37:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.882+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a009cc20 con 0x7f79a00739a0 2024-08-19T00:37:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.883+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a00ce500 con 0x7f79a00739a0 2024-08-19T00:37:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.884+0000 7f799cc00640 1 -- 172.21.15.7:0/3236012442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7994044070 con 0x7f79a00739a0 2024-08-19T00:37:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.885+0000 7f799cc00640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f798006be30 0x7f798006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.885+0000 7f799cc00640 1 -- 172.21.15.7:0/3236012442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f79940ab4a0 con 0x7f79a00739a0 2024-08-19T00:37:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.885+0000 7f799fe00640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f798006be30 0x7f798006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.886+0000 7f799fe00640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f798006be30 0x7f798006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79a00b1750 tx=0x7f798c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:50.889+0000 7f799cc00640 1 -- 172.21.15.7:0/3236012442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7994079dc0 con 0x7f79a00739a0 2024-08-19T00:37:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.110+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79a00b1780 con 0x7f79a00739a0 2024-08-19T00:37:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.111+0000 7f799cc00640 1 -- 172.21.15.7:0/3236012442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f79940796c0 con 0x7f79a00739a0 2024-08-19T00:37:51.113 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:51.113 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"btime":"2024-08-19T00:37:50:684047+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:37:50.105814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4577":{"gid":4577,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6835/1856893937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1856893937},{"type":"v1","addr":"172.21.15.162:6835","nonce":1856893937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4577,"qdb_cluster":[4577]},"id":2}]} 2024-08-19T00:37:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 16 2024-08-19T00:37:51.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.113+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f798006be30 msgr2=0x7f798006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.113+0000 7f79a7600640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f798006be30 0x7f798006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79a00b1750 tx=0x7f798c009190 comp rx=0 tx=0).stop 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.113+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a00739a0 msgr2=0x7f79a0155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.113+0000 7f79a7600640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a00739a0 0x7f79a0155ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f799402a200 tx=0x7f79940046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.113+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 shutdown_connections 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.113+0000 7f79a7600640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f798006be30 0x7f798006e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.113+0000 7f79a7600640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79a0159bf0 0x7f79a0154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.114+0000 7f79a7600640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79a00cea40 0x7f79a014a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.114+0000 7f79a7600640 1 --2- 172.21.15.7:0/3236012442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a00739a0 0x7f79a0155ff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.114+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 >> 172.21.15.7:0/3236012442 conn(0x7f79a006bc70 msgr2=0x7f79a015a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.114+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 shutdown_connections 2024-08-19T00:37:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.114+0000 7f79a7600640 1 -- 172.21.15.7:0/3236012442 wait complete. 2024-08-19T00:37:51.131 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:37:51.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.287+0000 7f5a02800640 1 Processor -- start 2024-08-19T00:37:51.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.287+0000 7f5a02800640 1 -- start start 2024-08-19T00:37:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.288+0000 7f5a02800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc13dc30 0x7f59fc140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.288+0000 7f5a02800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f59fc140640 0x7f59fc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.288+0000 7f5a02800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59fc15e930 con 0x7f59fc06db40 2024-08-19T00:37:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.288+0000 7f5a02800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f59fc15ec10 con 0x7f59fc140640 2024-08-19T00:37:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.288+0000 7f5a02800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f59fc15eef0 con 0x7f59fc13dc30 2024-08-19T00:37:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.288+0000 7f5a01e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f59fc06db40 0x7f59fc072920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41428/0 (socket says 172.21.15.7:41428) 2024-08-19T00:37:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.288+0000 7f5a01e00640 1 -- 172.21.15.7:0/2587786305 learned_addr learned my addr 172.21.15.7:0/2587786305 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f5a00a00640 1 --2- 172.21.15.7:0/2587786305 >> v2:172.21.15.162:3300/0 conn(0x7f59fc140640 0x7f59fc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f5a01400640 1 --2- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc13dc30 0x7f59fc140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f59fbe00640 1 -- 172.21.15.7:0/2587786305 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367081277 0 0) 0x7f59fc15e930 con 0x7f59fc06db40 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f59fbe00640 1 -- 172.21.15.7:0/2587786305 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e4003520 con 0x7f59fc06db40 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f5a00a00640 1 -- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc13dc30 msgr2=0x7f59fc140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f5a00a00640 1 --2- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc13dc30 0x7f59fc140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f5a00a00640 1 -- 172.21.15.7:0/2587786305 >> v1:172.21.15.7:6789/0 conn(0x7f59fc06db40 legacy=0x7f59fc072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f59fbe00640 1 -- 172.21.15.7:0/2587786305 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 933187390 0 0) 0x7f59e4003520 con 0x7f59fc06db40 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.289+0000 7f5a00a00640 1 -- 172.21.15.7:0/2587786305 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc15f1d0 con 0x7f59fc140640 2024-08-19T00:37:51.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.290+0000 7f5a00a00640 1 --2- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc140640 0x7f59fc06d600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f59e80097a0 tx=0x7f59e802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35e6fdacc8c7d8c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:51.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.291+0000 7f59fbe00640 1 -- 172.21.15.7:0/2587786305 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8037070 con 0x7f59fc140640 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.291+0000 7f59fbe00640 1 -- 172.21.15.7:0/2587786305 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e802aba0 con 0x7f59fc140640 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.291+0000 7f59fbe00640 1 -- 172.21.15.7:0/2587786305 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f40019f0 con 0x7f59fc140640 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 -- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc140640 msgr2=0x7f59fc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 --2- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc140640 0x7f59fc06d600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f59e80097a0 tx=0x7f59e802a110 comp rx=0 tx=0).stop 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 -- 172.21.15.7:0/2587786305 shutdown_connections 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 --2- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc140640 0x7f59fc06d600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 --2- 172.21.15.7:0/2587786305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc13dc30 0x7f59fc140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 -- 172.21.15.7:0/2587786305 >> 172.21.15.7:0/2587786305 conn(0x7f59fc06b850 msgr2=0x7f59fc06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:51.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 -- 172.21.15.7:0/2587786305 shutdown_connections 2024-08-19T00:37:51.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.292+0000 7f5a02800640 1 -- 172.21.15.7:0/2587786305 wait complete. 2024-08-19T00:37:51.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.293+0000 7f5a02800640 1 Processor -- start 2024-08-19T00:37:51.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.294+0000 7f5a02800640 1 -- start start 2024-08-19T00:37:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.294+0000 7f5a02800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59fc06db40 0x7f59fc13c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.294+0000 7f5a02800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc13dc30 0x7f59fc139830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.294+0000 7f5a02800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc140640 0x7f59fc13ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.294+0000 7f5a02800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc1413a0 con 0x7f59fc06db40 2024-08-19T00:37:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.294+0000 7f5a02800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc141220 con 0x7f59fc13dc30 2024-08-19T00:37:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.294+0000 7f5a02800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f59fc13e010 con 0x7f59fc140640 2024-08-19T00:37:51.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59fc06db40 0x7f59fc13c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59fc06db40 0x7f59fc13c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56318/0 (socket says 172.21.15.7:56318) 2024-08-19T00:37:51.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 -- 172.21.15.7:0/3006955518 learned_addr learned my addr 172.21.15.7:0/3006955518 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:51.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a00a00640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc13dc30 0x7f59fc139830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01e00640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc140640 0x7f59fc13ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 -- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc140640 msgr2=0x7f59fc13ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc140640 0x7f59fc13ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 -- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc13dc30 msgr2=0x7f59fc139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc13dc30 0x7f59fc139830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 -- 172.21.15.7:0/3006955518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc13b220 con 0x7f59fc06db40 2024-08-19T00:37:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.295+0000 7f5a01400640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59fc06db40 0x7f59fc13c2c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59f000e9b0 tx=0x7f59f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.296+0000 7f59f9600640 1 -- 172.21.15.7:0/3006955518 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0017070 con 0x7f59fc06db40 2024-08-19T00:37:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.296+0000 7f59f9600640 1 -- 172.21.15.7:0/3006955518 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f000c9a0 con 0x7f59fc06db40 2024-08-19T00:37:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.296+0000 7f59f9600640 1 -- 172.21.15.7:0/3006955518 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f000cd90 con 0x7f59fc06db40 2024-08-19T00:37:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.296+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59fc13b500 con 0x7f59fc06db40 2024-08-19T00:37:51.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.296+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59fc13bac0 con 0x7f59fc06db40 2024-08-19T00:37:51.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.297+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59fc13bf00 con 0x7f59fc06db40 2024-08-19T00:37:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.298+0000 7f59f9600640 1 -- 172.21.15.7:0/3006955518 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59f001a070 con 0x7f59fc06db40 2024-08-19T00:37:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.299+0000 7f59f9600640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f59dc06be30 0x7f59dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.299+0000 7f59f9600640 1 -- 172.21.15.7:0/3006955518 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f59f008b280 con 0x7f59fc06db40 2024-08-19T00:37:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.299+0000 7f5a00a00640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f59dc06be30 0x7f59dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.300+0000 7f5a00a00640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f59dc06be30 0x7f59dc06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59e8034000 tx=0x7f59e802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:51.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.303+0000 7f59f9600640 1 -- 172.21.15.7:0/3006955518 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f59f0059b90 con 0x7f59fc06db40 2024-08-19T00:37:51.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.488+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59fc140ce0 con 0x7f59fc06db40 2024-08-19T00:37:51.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.489+0000 7f59f9600640 1 -- 172.21.15.7:0/3006955518 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16573 (secure 0 0 0) 0x7f59f0059490 con 0x7f59fc06db40 2024-08-19T00:37:51.491 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:51.491 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:48.669619+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:45.444628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:46.080604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f59dc06be30 msgr2=0x7f59dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f59dc06be30 0x7f59dc06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59e8034000 tx=0x7f59e802e000 comp rx=0 tx=0).stop 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59fc06db40 msgr2=0x7f59fc13c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59fc06db40 0x7f59fc13c2c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59f000e9b0 tx=0x7f59f000ee70 comp rx=0 tx=0).stop 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 shutdown_connections 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f59dc06be30 0x7f59dc06e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59fc140640 0x7f59fc13ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59fc13dc30 0x7f59fc139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 --2- 172.21.15.7:0/3006955518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59fc06db40 0x7f59fc13c2c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 >> 172.21.15.7:0/3006955518 conn(0x7f59fc06b850 msgr2=0x7f59fc15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 shutdown_connections 2024-08-19T00:37:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.491+0000 7f5a02800640 1 -- 172.21.15.7:0/3006955518 wait complete. 2024-08-19T00:37:51.510 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:37:51.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:37:51.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.665+0000 7fa7be000640 1 Processor -- start 2024-08-19T00:37:51.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.666+0000 7fa7be000640 1 -- start start 2024-08-19T00:37:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7be000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b8159bf0 0x7fa7b8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7be000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa7b80739a0 0x7fa7b80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7be000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7b80cea40 0x7fa7b80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7be000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b806f7f0 con 0x7fa7b80cea40 2024-08-19T00:37:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7be000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b806f510 con 0x7fa7b80739a0 2024-08-19T00:37:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7be000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b8072980 con 0x7fa7b8159bf0 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7b80cea40 0x7fa7b80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7b80cea40 0x7fa7b80d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56328/0 (socket says 172.21.15.7:56328) 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 -- 172.21.15.7:0/11971839 learned_addr learned my addr 172.21.15.7:0/11971839 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7400640 1 --2- 172.21.15.7:0/11971839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b8159bf0 0x7fa7b8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7afe00640 1 --2- 172.21.15.7:0/11971839 >> v2:172.21.15.162:3300/0 conn(0x7fa7b80739a0 0x7fa7b80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 -- 172.21.15.7:0/11971839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b8159bf0 msgr2=0x7fa7b8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 --2- 172.21.15.7:0/11971839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b8159bf0 0x7fa7b8073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 -- 172.21.15.7:0/11971839 >> v2:172.21.15.162:3300/0 conn(0x7fa7b80739a0 msgr2=0x7fa7b80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 --2- 172.21.15.7:0/11971839 >> v2:172.21.15.162:3300/0 conn(0x7fa7b80739a0 0x7fa7b80ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.667+0000 7fa7b7e00640 1 -- 172.21.15.7:0/11971839 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b8072c60 con 0x7fa7b80cea40 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.668+0000 7fa7b7e00640 1 --2- 172.21.15.7:0/11971839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b80d03c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80b5370 tx=0x7fa7b002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e041fba396db1fee server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7b6a00640 1 -- 172.21.15.7:0/11971839 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0036070 con 0x7fa7b80cea40 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7b6a00640 1 -- 172.21.15.7:0/11971839 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b0031600 con 0x7fa7b80cea40 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7b6a00640 1 -- 172.21.15.7:0/11971839 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00319d0 con 0x7fa7b80cea40 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7be000640 1 -- 172.21.15.7:0/11971839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 msgr2=0x7fa7b80d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7be000640 1 --2- 172.21.15.7:0/11971839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b80d03c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80b5370 tx=0x7fa7b002a610 comp rx=0 tx=0).stop 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7be000640 1 -- 172.21.15.7:0/11971839 shutdown_connections 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7be000640 1 --2- 172.21.15.7:0/11971839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b80d03c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7be000640 1 --2- 172.21.15.7:0/11971839 >> v2:172.21.15.162:3300/0 conn(0x7fa7b80739a0 0x7fa7b80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7be000640 1 --2- 172.21.15.7:0/11971839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b8159bf0 0x7fa7b8073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.669+0000 7fa7be000640 1 -- 172.21.15.7:0/11971839 >> 172.21.15.7:0/11971839 conn(0x7fa7b806bc70 msgr2=0x7fa7b806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.670+0000 7fa7be000640 1 -- 172.21.15.7:0/11971839 shutdown_connections 2024-08-19T00:37:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.670+0000 7fa7be000640 1 -- 172.21.15.7:0/11971839 wait complete. 2024-08-19T00:37:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.671+0000 7fa7be000640 1 Processor -- start 2024-08-19T00:37:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.671+0000 7fa7be000640 1 -- start start 2024-08-19T00:37:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7be000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80739a0 0x7fa7b8158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7be000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7be000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b8159bf0 0x7fa7b815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7be000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b815a150 con 0x7fa7b80cea40 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7be000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b8159fd0 con 0x7fa7b8159bf0 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7be000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b80d0900 con 0x7fa7b80739a0 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b815e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56340/0 (socket says 172.21.15.7:56340) 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.672+0000 7fa7afe00640 1 -- 172.21.15.7:0/1474006049 learned_addr learned my addr 172.21.15.7:0/1474006049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7b7e00640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b8159bf0 0x7fa7b815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7b7400640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80739a0 0x7fa7b8158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7afe00640 1 -- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80739a0 msgr2=0x7fa7b8158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7afe00640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80739a0 0x7fa7b8158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7afe00640 1 -- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b8159bf0 msgr2=0x7fa7b815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7afe00640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b8159bf0 0x7fa7b815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7afe00640 1 -- 172.21.15.7:0/1474006049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b814d330 con 0x7fa7b80cea40 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7afe00640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b815e950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000d600 tx=0x7fa7a000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7af400640 1 -- 172.21.15.7:0/1474006049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0004240 con 0x7fa7b80cea40 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7af400640 1 -- 172.21.15.7:0/1474006049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a00043e0 con 0x7fa7b80cea40 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b814d610 con 0x7fa7b80cea40 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.673+0000 7fa7af400640 1 -- 172.21.15.7:0/1474006049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0003830 con 0x7fa7b80cea40 2024-08-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.674+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b814dd40 con 0x7fa7b80cea40 2024-08-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.675+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b814e1a0 con 0x7fa7b80cea40 2024-08-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.676+0000 7fa7af400640 1 -- 172.21.15.7:0/1474006049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7a00039d0 con 0x7fa7b80cea40 2024-08-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.677+0000 7fa7af400640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa79406be30 0x7fa79406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.677+0000 7fa7af400640 1 -- 172.21.15.7:0/1474006049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa7a008b070 con 0x7fa7b80cea40 2024-08-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.677+0000 7fa7b7400640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa79406be30 0x7fa79406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.678+0000 7fa7b7400640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa79406be30 0x7fa79406e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009ac0 tx=0x7fa7a8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.681+0000 7fa7af400640 1 -- 172.21.15.7:0/1474006049 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa7a0059330 con 0x7fa7b80cea40 2024-08-19T00:37:51.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.866+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7b814d0e0 con 0x7fa79406be30 2024-08-19T00:37:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.874+0000 7fa7af400640 1 -- 172.21.15.7:0/1474006049 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7fa7b814d0e0 con 0x7fa79406be30 2024-08-19T00:37:51.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:51.880 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:37:51.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa79406be30 msgr2=0x7fa79406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa79406be30 0x7fa79406e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009ac0 tx=0x7fa7a8009190 comp rx=0 tx=0).stop 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 msgr2=0x7fa7b815e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b815e950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000d600 tx=0x7fa7a000dac0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 shutdown_connections 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa79406be30 0x7fa79406e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b8159bf0 0x7fa7b815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7b80cea40 0x7fa7b815e950 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 --2- 172.21.15.7:0/1474006049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80739a0 0x7fa7b8158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 >> 172.21.15.7:0/1474006049 conn(0x7fa7b806bc70 msgr2=0x7fa7b80cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 shutdown_connections 2024-08-19T00:37:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:51.878+0000 7fa7be000640 1 -- 172.21.15.7:0/1474006049 wait complete. 2024-08-19T00:37:51.895 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-19T00:37:51.265642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236856,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737864,"statfs":{"total":773094113280,"available":772851572736,"internally_reserved":0,"allocated":4136960,"data_stored":2295996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614382"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724977+0000","last_change":"2024-08-19T00:37:47.685551+0000","last_active":"2024-08-19T00:37:48.724977+0000","last_peered":"2024-08-19T00:37:48.724977+0000","last_clean":"2024-08-19T00:37:48.724977+0000","last_became_active":"2024-08-19T00:37:47.685265+0000","last_became_peered":"2024-08-19T00:37:47.685265+0000","last_unstale":"2024-08-19T00:37:48.724977+0000","last_undegraded":"2024-08-19T00:37:48.724977+0000","last_fullsized":"2024-08-19T00:37:48.724977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:25.016360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.677083+0000","last_change":"2024-08-19T00:37:47.694647+0000","last_active":"2024-08-19T00:37:48.677083+0000","last_peered":"2024-08-19T00:37:48.677083+0000","last_clean":"2024-08-19T00:37:48.677083+0000","last_became_active":"2024-08-19T00:37:47.694316+0000","last_became_peered":"2024-08-19T00:37:47.694316+0000","last_unstale":"2024-08-19T00:37:48.677083+0000","last_undegraded":"2024-08-19T00:37:48.677083+0000","last_fullsized":"2024-08-19T00:37:48.677083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868918+0000","last_change":"2024-08-19T00:37:47.680643+0000","last_active":"2024-08-19T00:37:48.868918+0000","last_peered":"2024-08-19T00:37:48.868918+0000","last_clean":"2024-08-19T00:37:48.868918+0000","last_became_active":"2024-08-19T00:37:47.680314+0000","last_became_peered":"2024-08-19T00:37:47.680314+0000","last_unstale":"2024-08-19T00:37:48.868918+0000","last_undegraded":"2024-08-19T00:37:48.868918+0000","last_fullsized":"2024-08-19T00:37:48.868918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:50.787283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870497+0000","last_change":"2024-08-19T00:37:47.693799+0000","last_active":"2024-08-19T00:37:48.870497+0000","last_peered":"2024-08-19T00:37:48.870497+0000","last_clean":"2024-08-19T00:37:48.870497+0000","last_became_active":"2024-08-19T00:37:47.693453+0000","last_became_peered":"2024-08-19T00:37:47.693453+0000","last_unstale":"2024-08-19T00:37:48.870497+0000","last_undegraded":"2024-08-19T00:37:48.870497+0000","last_fullsized":"2024-08-19T00:37:48.870497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676148+0000","last_change":"2024-08-19T00:37:47.688949+0000","last_active":"2024-08-19T00:37:48.676148+0000","last_peered":"2024-08-19T00:37:48.676148+0000","last_clean":"2024-08-19T00:37:48.676148+0000","last_became_active":"2024-08-19T00:37:47.688658+0000","last_became_peered":"2024-08-19T00:37:47.688658+0000","last_unstale":"2024-08-19T00:37:48.676148+0000","last_undegraded":"2024-08-19T00:37:48.676148+0000","last_fullsized":"2024-08-19T00:37:48.676148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675461+0000","last_change":"2024-08-19T00:37:47.692578+0000","last_active":"2024-08-19T00:37:48.675461+0000","last_peered":"2024-08-19T00:37:48.675461+0000","last_clean":"2024-08-19T00:37:48.675461+0000","last_became_active":"2024-08-19T00:37:47.688251+0000","last_became_peered":"2024-08-19T00:37:47.688251+0000","last_unstale":"2024-08-19T00:37:48.675461+0000","last_undegraded":"2024-08-19T00:37:48.675461+0000","last_fullsized":"2024-08-19T00:37:48.675461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:01.818436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724706+0000","last_change":"2024-08-19T00:37:47.677811+0000","last_active":"2024-08-19T00:37:48.724706+0000","last_peered":"2024-08-19T00:37:48.724706+0000","last_clean":"2024-08-19T00:37:48.724706+0000","last_became_active":"2024-08-19T00:37:47.677255+0000","last_became_peered":"2024-08-19T00:37:47.677255+0000","last_unstale":"2024-08-19T00:37:48.724706+0000","last_undegraded":"2024-08-19T00:37:48.724706+0000","last_fullsized":"2024-08-19T00:37:48.724706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:10.911535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724684+0000","last_change":"2024-08-19T00:37:47.679294+0000","last_active":"2024-08-19T00:37:48.724684+0000","last_peered":"2024-08-19T00:37:48.724684+0000","last_clean":"2024-08-19T00:37:48.724684+0000","last_became_active":"2024-08-19T00:37:47.679009+0000","last_became_peered":"2024-08-19T00:37:47.679009+0000","last_unstale":"2024-08-19T00:37:48.724684+0000","last_undegraded":"2024-08-19T00:37:48.724684+0000","last_fullsized":"2024-08-19T00:37:48.724684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:11.657528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869191+0000","last_change":"2024-08-19T00:37:47.692993+0000","last_active":"2024-08-19T00:37:48.869191+0000","last_peered":"2024-08-19T00:37:48.869191+0000","last_clean":"2024-08-19T00:37:48.869191+0000","last_became_active":"2024-08-19T00:37:47.692611+0000","last_became_peered":"2024-08-19T00:37:47.692611+0000","last_unstale":"2024-08-19T00:37:48.869191+0000","last_undegraded":"2024-08-19T00:37:48.869191+0000","last_fullsized":"2024-08-19T00:37:48.869191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:46.538654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870923+0000","last_change":"2024-08-19T00:37:47.702995+0000","last_active":"2024-08-19T00:37:48.870923+0000","last_peered":"2024-08-19T00:37:48.870923+0000","last_clean":"2024-08-19T00:37:48.870923+0000","last_became_active":"2024-08-19T00:37:47.702053+0000","last_became_peered":"2024-08-19T00:37:47.702053+0000","last_unstale":"2024-08-19T00:37:48.870923+0000","last_undegraded":"2024-08-19T00:37:48.870923+0000","last_fullsized":"2024-08-19T00:37:48.870923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:10.571431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674111+0000","last_change":"2024-08-19T00:37:47.695578+0000","last_active":"2024-08-19T00:37:48.674111+0000","last_peered":"2024-08-19T00:37:48.674111+0000","last_clean":"2024-08-19T00:37:48.674111+0000","last_became_active":"2024-08-19T00:37:47.694820+0000","last_became_peered":"2024-08-19T00:37:47.694820+0000","last_unstale":"2024-08-19T00:37:48.674111+0000","last_undegraded":"2024-08-19T00:37:48.674111+0000","last_fullsized":"2024-08-19T00:37:48.674111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:44.388640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869166+0000","last_change":"2024-08-19T00:37:47.683750+0000","last_active":"2024-08-19T00:37:48.869166+0000","last_peered":"2024-08-19T00:37:48.869166+0000","last_clean":"2024-08-19T00:37:48.869166+0000","last_became_active":"2024-08-19T00:37:47.682744+0000","last_became_peered":"2024-08-19T00:37:47.682744+0000","last_unstale":"2024-08-19T00:37:48.869166+0000","last_undegraded":"2024-08-19T00:37:48.869166+0000","last_fullsized":"2024-08-19T00:37:48.869166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:01.818436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869933+0000","last_change":"2024-08-19T00:37:47.695362+0000","last_active":"2024-08-19T00:37:48.869933+0000","last_peered":"2024-08-19T00:37:48.869933+0000","last_clean":"2024-08-19T00:37:48.869933+0000","last_became_active":"2024-08-19T00:37:47.695095+0000","last_became_peered":"2024-08-19T00:37:47.695095+0000","last_unstale":"2024-08-19T00:37:48.869933+0000","last_undegraded":"2024-08-19T00:37:48.869933+0000","last_fullsized":"2024-08-19T00:37:48.869933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:33.953161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870232+0000","last_change":"2024-08-19T00:37:47.700978+0000","last_active":"2024-08-19T00:37:48.870232+0000","last_peered":"2024-08-19T00:37:48.870232+0000","last_clean":"2024-08-19T00:37:48.870232+0000","last_became_active":"2024-08-19T00:37:47.692034+0000","last_became_peered":"2024-08-19T00:37:47.692034+0000","last_unstale":"2024-08-19T00:37:48.870232+0000","last_undegraded":"2024-08-19T00:37:48.870232+0000","last_fullsized":"2024-08-19T00:37:48.870232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869456+0000","last_change":"2024-08-19T00:37:47.685353+0000","last_active":"2024-08-19T00:37:48.869456+0000","last_peered":"2024-08-19T00:37:48.869456+0000","last_clean":"2024-08-19T00:37:48.869456+0000","last_became_active":"2024-08-19T00:37:47.685028+0000","last_became_peered":"2024-08-19T00:37:47.685028+0000","last_unstale":"2024-08-19T00:37:48.869456+0000","last_undegraded":"2024-08-19T00:37:48.869456+0000","last_fullsized":"2024-08-19T00:37:48.869456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:25.016360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868952+0000","last_change":"2024-08-19T00:37:47.690620+0000","last_active":"2024-08-19T00:37:48.868952+0000","last_peered":"2024-08-19T00:37:48.868952+0000","last_clean":"2024-08-19T00:37:48.868952+0000","last_became_active":"2024-08-19T00:37:47.689013+0000","last_became_peered":"2024-08-19T00:37:47.689013+0000","last_unstale":"2024-08-19T00:37:48.868952+0000","last_undegraded":"2024-08-19T00:37:48.868952+0000","last_fullsized":"2024-08-19T00:37:48.868952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:39.287532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673935+0000","last_change":"2024-08-19T00:37:47.677088+0000","last_active":"2024-08-19T00:37:48.673935+0000","last_peered":"2024-08-19T00:37:48.673935+0000","last_clean":"2024-08-19T00:37:48.673935+0000","last_became_active":"2024-08-19T00:37:47.676597+0000","last_became_peered":"2024-08-19T00:37:47.676597+0000","last_unstale":"2024-08-19T00:37:48.673935+0000","last_undegraded":"2024-08-19T00:37:48.673935+0000","last_fullsized":"2024-08-19T00:37:48.673935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:31:27.846182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676585+0000","last_change":"2024-08-19T00:37:47.693377+0000","last_active":"2024-08-19T00:37:48.676585+0000","last_peered":"2024-08-19T00:37:48.676585+0000","last_clean":"2024-08-19T00:37:48.676585+0000","last_became_active":"2024-08-19T00:37:47.693138+0000","last_became_peered":"2024-08-19T00:37:47.693138+0000","last_unstale":"2024-08-19T00:37:48.676585+0000","last_undegraded":"2024-08-19T00:37:48.676585+0000","last_fullsized":"2024-08-19T00:37:48.676585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:43.510296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675964+0000","last_change":"2024-08-19T00:37:47.699501+0000","last_active":"2024-08-19T00:37:48.675964+0000","last_peered":"2024-08-19T00:37:48.675964+0000","last_clean":"2024-08-19T00:37:48.675964+0000","last_became_active":"2024-08-19T00:37:47.699208+0000","last_became_peered":"2024-08-19T00:37:47.699208+0000","last_unstale":"2024-08-19T00:37:48.675964+0000","last_undegraded":"2024-08-19T00:37:48.675964+0000","last_fullsized":"2024-08-19T00:37:48.675964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:46.538654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869990+0000","last_change":"2024-08-19T00:37:47.690103+0000","last_active":"2024-08-19T00:37:48.869990+0000","last_peered":"2024-08-19T00:37:48.869990+0000","last_clean":"2024-08-19T00:37:48.869990+0000","last_became_active":"2024-08-19T00:37:47.689836+0000","last_became_peered":"2024-08-19T00:37:47.689836+0000","last_unstale":"2024-08-19T00:37:48.869990+0000","last_undegraded":"2024-08-19T00:37:48.869990+0000","last_fullsized":"2024-08-19T00:37:48.869990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:00.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869730+0000","last_change":"2024-08-19T00:37:47.684380+0000","last_active":"2024-08-19T00:37:48.869730+0000","last_peered":"2024-08-19T00:37:48.869730+0000","last_clean":"2024-08-19T00:37:48.869730+0000","last_became_active":"2024-08-19T00:37:47.684088+0000","last_became_peered":"2024-08-19T00:37:47.684088+0000","last_unstale":"2024-08-19T00:37:48.869730+0000","last_undegraded":"2024-08-19T00:37:48.869730+0000","last_fullsized":"2024-08-19T00:37:48.869730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725045+0000","last_change":"2024-08-19T00:37:47.699238+0000","last_active":"2024-08-19T00:37:48.725045+0000","last_peered":"2024-08-19T00:37:48.725045+0000","last_clean":"2024-08-19T00:37:48.725045+0000","last_became_active":"2024-08-19T00:37:47.698958+0000","last_became_peered":"2024-08-19T00:37:47.698958+0000","last_unstale":"2024-08-19T00:37:48.725045+0000","last_undegraded":"2024-08-19T00:37:48.725045+0000","last_fullsized":"2024-08-19T00:37:48.725045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:10.314801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869517+0000","last_change":"2024-08-19T00:37:47.677032+0000","last_active":"2024-08-19T00:37:48.869517+0000","last_peered":"2024-08-19T00:37:48.869517+0000","last_clean":"2024-08-19T00:37:48.869517+0000","last_became_active":"2024-08-19T00:37:47.676418+0000","last_became_peered":"2024-08-19T00:37:47.676418+0000","last_unstale":"2024-08-19T00:37:48.869517+0000","last_undegraded":"2024-08-19T00:37:48.869517+0000","last_fullsized":"2024-08-19T00:37:48.869517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.822226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724701+0000","last_change":"2024-08-19T00:37:47.698823+0000","last_active":"2024-08-19T00:37:48.724701+0000","last_peered":"2024-08-19T00:37:48.724701+0000","last_clean":"2024-08-19T00:37:48.724701+0000","last_became_active":"2024-08-19T00:37:47.698407+0000","last_became_peered":"2024-08-19T00:37:47.698407+0000","last_unstale":"2024-08-19T00:37:48.724701+0000","last_undegraded":"2024-08-19T00:37:48.724701+0000","last_fullsized":"2024-08-19T00:37:48.724701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:32:27.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870887+0000","last_change":"2024-08-19T00:37:47.695381+0000","last_active":"2024-08-19T00:37:48.870887+0000","last_peered":"2024-08-19T00:37:48.870887+0000","last_clean":"2024-08-19T00:37:48.870887+0000","last_became_active":"2024-08-19T00:37:47.689122+0000","last_became_peered":"2024-08-19T00:37:47.689122+0000","last_unstale":"2024-08-19T00:37:48.870887+0000","last_undegraded":"2024-08-19T00:37:48.870887+0000","last_fullsized":"2024-08-19T00:37:48.870887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:12:44.538682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.871014+0000","last_change":"2024-08-19T00:37:47.688191+0000","last_active":"2024-08-19T00:37:48.871014+0000","last_peered":"2024-08-19T00:37:48.871014+0000","last_clean":"2024-08-19T00:37:48.871014+0000","last_became_active":"2024-08-19T00:37:47.687809+0000","last_became_peered":"2024-08-19T00:37:47.687809+0000","last_unstale":"2024-08-19T00:37:48.871014+0000","last_undegraded":"2024-08-19T00:37:48.871014+0000","last_fullsized":"2024-08-19T00:37:48.871014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:35:19.471712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675948+0000","last_change":"2024-08-19T00:37:47.693658+0000","last_active":"2024-08-19T00:37:48.675948+0000","last_peered":"2024-08-19T00:37:48.675948+0000","last_clean":"2024-08-19T00:37:48.675948+0000","last_became_active":"2024-08-19T00:37:47.688198+0000","last_became_peered":"2024-08-19T00:37:47.688198+0000","last_unstale":"2024-08-19T00:37:48.675948+0000","last_undegraded":"2024-08-19T00:37:48.675948+0000","last_fullsized":"2024-08-19T00:37:48.675948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725221+0000","last_change":"2024-08-19T00:37:47.679222+0000","last_active":"2024-08-19T00:37:48.725221+0000","last_peered":"2024-08-19T00:37:48.725221+0000","last_clean":"2024-08-19T00:37:48.725221+0000","last_became_active":"2024-08-19T00:37:47.678917+0000","last_became_peered":"2024-08-19T00:37:47.678917+0000","last_unstale":"2024-08-19T00:37:48.725221+0000","last_undegraded":"2024-08-19T00:37:48.725221+0000","last_fullsized":"2024-08-19T00:37:48.725221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869618+0000","last_change":"2024-08-19T00:37:47.704326+0000","last_active":"2024-08-19T00:37:48.869618+0000","last_peered":"2024-08-19T00:37:48.869618+0000","last_clean":"2024-08-19T00:37:48.869618+0000","last_became_active":"2024-08-19T00:37:47.704043+0000","last_became_peered":"2024-08-19T00:37:47.704043+0000","last_unstale":"2024-08-19T00:37:48.869618+0000","last_undegraded":"2024-08-19T00:37:48.869618+0000","last_fullsized":"2024-08-19T00:37:48.869618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869474+0000","last_change":"2024-08-19T00:37:47.685449+0000","last_active":"2024-08-19T00:37:48.869474+0000","last_peered":"2024-08-19T00:37:48.869474+0000","last_clean":"2024-08-19T00:37:48.869474+0000","last_became_active":"2024-08-19T00:37:47.685146+0000","last_became_peered":"2024-08-19T00:37:47.685146+0000","last_unstale":"2024-08-19T00:37:48.869474+0000","last_undegraded":"2024-08-19T00:37:48.869474+0000","last_fullsized":"2024-08-19T00:37:48.869474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725066+0000","last_change":"2024-08-19T00:37:47.692460+0000","last_active":"2024-08-19T00:37:48.725066+0000","last_peered":"2024-08-19T00:37:48.725066+0000","last_clean":"2024-08-19T00:37:48.725066+0000","last_became_active":"2024-08-19T00:37:47.692170+0000","last_became_peered":"2024-08-19T00:37:47.692170+0000","last_unstale":"2024-08-19T00:37:48.725066+0000","last_undegraded":"2024-08-19T00:37:48.725066+0000","last_fullsized":"2024-08-19T00:37:48.725066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673508+0000","last_change":"2024-08-19T00:37:47.678527+0000","last_active":"2024-08-19T00:37:48.673508+0000","last_peered":"2024-08-19T00:37:48.673508+0000","last_clean":"2024-08-19T00:37:48.673508+0000","last_became_active":"2024-08-19T00:37:47.678278+0000","last_became_peered":"2024-08-19T00:37:47.678278+0000","last_unstale":"2024-08-19T00:37:48.673508+0000","last_undegraded":"2024-08-19T00:37:48.673508+0000","last_fullsized":"2024-08-19T00:37:48.673508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:42:47.025878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869901+0000","last_change":"2024-08-19T00:37:47.672860+0000","last_active":"2024-08-19T00:37:48.869901+0000","last_peered":"2024-08-19T00:37:48.869901+0000","last_clean":"2024-08-19T00:37:48.869901+0000","last_became_active":"2024-08-19T00:37:47.672466+0000","last_became_peered":"2024-08-19T00:37:47.672466+0000","last_unstale":"2024-08-19T00:37:48.869901+0000","last_undegraded":"2024-08-19T00:37:48.869901+0000","last_fullsized":"2024-08-19T00:37:48.869901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:51:29.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674227+0000","last_change":"2024-08-19T00:37:46.674844+0000","last_active":"2024-08-19T00:37:48.674227+0000","last_peered":"2024-08-19T00:37:48.674227+0000","last_clean":"2024-08-19T00:37:48.674227+0000","last_became_active":"2024-08-19T00:37:46.674548+0000","last_became_peered":"2024-08-19T00:37:46.674548+0000","last_unstale":"2024-08-19T00:37:48.674227+0000","last_undegraded":"2024-08-19T00:37:48.674227+0000","last_fullsized":"2024-08-19T00:37:48.674227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:16.456720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725730+0000","last_change":"2024-08-19T00:37:47.687784+0000","last_active":"2024-08-19T00:37:48.725730+0000","last_peered":"2024-08-19T00:37:48.725730+0000","last_clean":"2024-08-19T00:37:48.725730+0000","last_became_active":"2024-08-19T00:37:47.687012+0000","last_became_peered":"2024-08-19T00:37:47.687012+0000","last_unstale":"2024-08-19T00:37:48.725730+0000","last_undegraded":"2024-08-19T00:37:48.725730+0000","last_fullsized":"2024-08-19T00:37:48.725730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.871072+0000","last_change":"2024-08-19T00:37:46.683255+0000","last_active":"2024-08-19T00:37:48.871072+0000","last_peered":"2024-08-19T00:37:48.871072+0000","last_clean":"2024-08-19T00:37:48.871072+0000","last_became_active":"2024-08-19T00:37:46.681679+0000","last_became_peered":"2024-08-19T00:37:46.681679+0000","last_unstale":"2024-08-19T00:37:48.871072+0000","last_undegraded":"2024-08-19T00:37:48.871072+0000","last_fullsized":"2024-08-19T00:37:48.871072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:42.504367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725196+0000","last_change":"2024-08-19T00:37:47.702137+0000","last_active":"2024-08-19T00:37:48.725196+0000","last_peered":"2024-08-19T00:37:48.725196+0000","last_clean":"2024-08-19T00:37:48.725196+0000","last_became_active":"2024-08-19T00:37:47.700863+0000","last_became_peered":"2024-08-19T00:37:47.700863+0000","last_unstale":"2024-08-19T00:37:48.725196+0000","last_undegraded":"2024-08-19T00:37:48.725196+0000","last_fullsized":"2024-08-19T00:37:48.725196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676229+0000","last_change":"2024-08-19T00:37:46.676308+0000","last_active":"2024-08-19T00:37:48.676229+0000","last_peered":"2024-08-19T00:37:48.676229+0000","last_clean":"2024-08-19T00:37:48.676229+0000","last_became_active":"2024-08-19T00:37:46.674766+0000","last_became_peered":"2024-08-19T00:37:46.674766+0000","last_unstale":"2024-08-19T00:37:48.676229+0000","last_undegraded":"2024-08-19T00:37:48.676229+0000","last_fullsized":"2024-08-19T00:37:48.676229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:16:29.290859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.871144+0000","last_change":"2024-08-19T00:37:47.686863+0000","last_active":"2024-08-19T00:37:48.871144+0000","last_peered":"2024-08-19T00:37:48.871144+0000","last_clean":"2024-08-19T00:37:48.871144+0000","last_became_active":"2024-08-19T00:37:47.686609+0000","last_became_peered":"2024-08-19T00:37:47.686609+0000","last_unstale":"2024-08-19T00:37:48.871144+0000","last_undegraded":"2024-08-19T00:37:48.871144+0000","last_fullsized":"2024-08-19T00:37:48.871144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:04:14.707305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870676+0000","last_change":"2024-08-19T00:37:46.686433+0000","last_active":"2024-08-19T00:37:48.870676+0000","last_peered":"2024-08-19T00:37:48.870676+0000","last_clean":"2024-08-19T00:37:48.870676+0000","last_became_active":"2024-08-19T00:37:46.685774+0000","last_became_peered":"2024-08-19T00:37:46.685774+0000","last_unstale":"2024-08-19T00:37:48.870676+0000","last_undegraded":"2024-08-19T00:37:48.870676+0000","last_fullsized":"2024-08-19T00:37:48.870676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:12:49.176756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868912+0000","last_change":"2024-08-19T00:37:47.690021+0000","last_active":"2024-08-19T00:37:48.868912+0000","last_peered":"2024-08-19T00:37:48.868912+0000","last_clean":"2024-08-19T00:37:48.868912+0000","last_became_active":"2024-08-19T00:37:47.689049+0000","last_became_peered":"2024-08-19T00:37:47.689049+0000","last_unstale":"2024-08-19T00:37:48.868912+0000","last_undegraded":"2024-08-19T00:37:48.868912+0000","last_fullsized":"2024-08-19T00:37:48.868912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:00:21.584440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724891+0000","last_change":"2024-08-19T00:37:46.675184+0000","last_active":"2024-08-19T00:37:48.724891+0000","last_peered":"2024-08-19T00:37:48.724891+0000","last_clean":"2024-08-19T00:37:48.724891+0000","last_became_active":"2024-08-19T00:37:46.674899+0000","last_became_peered":"2024-08-19T00:37:46.674899+0000","last_unstale":"2024-08-19T00:37:48.724891+0000","last_undegraded":"2024-08-19T00:37:48.724891+0000","last_fullsized":"2024-08-19T00:37:48.724891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:54.484342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724888+0000","last_change":"2024-08-19T00:37:47.691524+0000","last_active":"2024-08-19T00:37:48.724888+0000","last_peered":"2024-08-19T00:37:48.724888+0000","last_clean":"2024-08-19T00:37:48.724888+0000","last_became_active":"2024-08-19T00:37:47.691245+0000","last_became_peered":"2024-08-19T00:37:47.691245+0000","last_unstale":"2024-08-19T00:37:48.724888+0000","last_undegraded":"2024-08-19T00:37:48.724888+0000","last_fullsized":"2024-08-19T00:37:48.724888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:39.287532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725258+0000","last_change":"2024-08-19T00:37:46.687267+0000","last_active":"2024-08-19T00:37:48.725258+0000","last_peered":"2024-08-19T00:37:48.725258+0000","last_clean":"2024-08-19T00:37:48.725258+0000","last_became_active":"2024-08-19T00:37:46.686882+0000","last_became_peered":"2024-08-19T00:37:46.686882+0000","last_unstale":"2024-08-19T00:37:48.725258+0000","last_undegraded":"2024-08-19T00:37:48.725258+0000","last_fullsized":"2024-08-19T00:37:48.725258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:45.532725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868889+0000","last_change":"2024-08-19T00:37:47.701859+0000","last_active":"2024-08-19T00:37:48.868889+0000","last_peered":"2024-08-19T00:37:48.868889+0000","last_clean":"2024-08-19T00:37:48.868889+0000","last_became_active":"2024-08-19T00:37:47.690647+0000","last_became_peered":"2024-08-19T00:37:47.690647+0000","last_unstale":"2024-08-19T00:37:48.868889+0000","last_undegraded":"2024-08-19T00:37:48.868889+0000","last_fullsized":"2024-08-19T00:37:48.868889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:55.490271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675333+0000","last_change":"2024-08-19T00:37:46.676233+0000","last_active":"2024-08-19T00:37:48.675333+0000","last_peered":"2024-08-19T00:37:48.675333+0000","last_clean":"2024-08-19T00:37:48.675333+0000","last_became_active":"2024-08-19T00:37:46.675867+0000","last_became_peered":"2024-08-19T00:37:46.675867+0000","last_unstale":"2024-08-19T00:37:48.675333+0000","last_undegraded":"2024-08-19T00:37:48.675333+0000","last_fullsized":"2024-08-19T00:37:48.675333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:38.091770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870216+0000","last_change":"2024-08-19T00:37:47.683416+0000","last_active":"2024-08-19T00:37:48.870216+0000","last_peered":"2024-08-19T00:37:48.870216+0000","last_clean":"2024-08-19T00:37:48.870216+0000","last_became_active":"2024-08-19T00:37:47.683001+0000","last_became_peered":"2024-08-19T00:37:47.683001+0000","last_unstale":"2024-08-19T00:37:48.870216+0000","last_undegraded":"2024-08-19T00:37:48.870216+0000","last_fullsized":"2024-08-19T00:37:48.870216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724893+0000","last_change":"2024-08-19T00:37:46.688071+0000","last_active":"2024-08-19T00:37:48.724893+0000","last_peered":"2024-08-19T00:37:48.724893+0000","last_clean":"2024-08-19T00:37:48.724893+0000","last_became_active":"2024-08-19T00:37:46.686464+0000","last_became_peered":"2024-08-19T00:37:46.686464+0000","last_unstale":"2024-08-19T00:37:48.724893+0000","last_undegraded":"2024-08-19T00:37:48.724893+0000","last_fullsized":"2024-08-19T00:37:48.724893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:00.812507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674429+0000","last_change":"2024-08-19T00:37:47.681108+0000","last_active":"2024-08-19T00:37:48.674429+0000","last_peered":"2024-08-19T00:37:48.674429+0000","last_clean":"2024-08-19T00:37:48.674429+0000","last_became_active":"2024-08-19T00:37:47.680805+0000","last_became_peered":"2024-08-19T00:37:47.680805+0000","last_unstale":"2024-08-19T00:37:48.674429+0000","last_undegraded":"2024-08-19T00:37:48.674429+0000","last_fullsized":"2024-08-19T00:37:48.674429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:24.081472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676589+0000","last_change":"2024-08-19T00:37:46.682174+0000","last_active":"2024-08-19T00:37:48.676589+0000","last_peered":"2024-08-19T00:37:48.676589+0000","last_clean":"2024-08-19T00:37:48.676589+0000","last_became_active":"2024-08-19T00:37:46.681852+0000","last_became_peered":"2024-08-19T00:37:46.681852+0000","last_unstale":"2024-08-19T00:37:48.676589+0000","last_undegraded":"2024-08-19T00:37:48.676589+0000","last_fullsized":"2024-08-19T00:37:48.676589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:32.947231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870931+0000","last_change":"2024-08-19T00:37:47.700217+0000","last_active":"2024-08-19T00:37:48.870931+0000","last_peered":"2024-08-19T00:37:48.870931+0000","last_clean":"2024-08-19T00:37:48.870931+0000","last_became_active":"2024-08-19T00:37:47.699922+0000","last_became_peered":"2024-08-19T00:37:47.699922+0000","last_unstale":"2024-08-19T00:37:48.870931+0000","last_undegraded":"2024-08-19T00:37:48.870931+0000","last_fullsized":"2024-08-19T00:37:48.870931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:41:17.856088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676385+0000","last_change":"2024-08-19T00:37:46.679294+0000","last_active":"2024-08-19T00:37:48.676385+0000","last_peered":"2024-08-19T00:37:48.676385+0000","last_clean":"2024-08-19T00:37:48.676385+0000","last_became_active":"2024-08-19T00:37:46.678993+0000","last_became_peered":"2024-08-19T00:37:46.678993+0000","last_unstale":"2024-08-19T00:37:48.676385+0000","last_undegraded":"2024-08-19T00:37:48.676385+0000","last_fullsized":"2024-08-19T00:37:48.676385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:26:11.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870687+0000","last_change":"2024-08-19T00:37:47.697433+0000","last_active":"2024-08-19T00:37:48.870687+0000","last_peered":"2024-08-19T00:37:48.870687+0000","last_clean":"2024-08-19T00:37:48.870687+0000","last_became_active":"2024-08-19T00:37:47.686345+0000","last_became_peered":"2024-08-19T00:37:47.686345+0000","last_unstale":"2024-08-19T00:37:48.870687+0000","last_undegraded":"2024-08-19T00:37:48.870687+0000","last_fullsized":"2024-08-19T00:37:48.870687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673981+0000","last_change":"2024-08-19T00:37:46.678221+0000","last_active":"2024-08-19T00:37:48.673981+0000","last_peered":"2024-08-19T00:37:48.673981+0000","last_clean":"2024-08-19T00:37:48.673981+0000","last_became_active":"2024-08-19T00:37:46.677938+0000","last_became_peered":"2024-08-19T00:37:46.677938+0000","last_unstale":"2024-08-19T00:37:48.673981+0000","last_undegraded":"2024-08-19T00:37:48.673981+0000","last_fullsized":"2024-08-19T00:37:48.673981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:24.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673878+0000","last_change":"2024-08-19T00:37:47.688184+0000","last_active":"2024-08-19T00:37:48.673878+0000","last_peered":"2024-08-19T00:37:48.673878+0000","last_clean":"2024-08-19T00:37:48.673878+0000","last_became_active":"2024-08-19T00:37:47.687895+0000","last_became_peered":"2024-08-19T00:37:47.687895+0000","last_unstale":"2024-08-19T00:37:48.673878+0000","last_undegraded":"2024-08-19T00:37:48.673878+0000","last_fullsized":"2024-08-19T00:37:48.673878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:16.217823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870114+0000","last_change":"2024-08-19T00:37:46.684939+0000","last_active":"2024-08-19T00:37:48.870114+0000","last_peered":"2024-08-19T00:37:48.870114+0000","last_clean":"2024-08-19T00:37:48.870114+0000","last_became_active":"2024-08-19T00:37:46.684657+0000","last_became_peered":"2024-08-19T00:37:46.684657+0000","last_unstale":"2024-08-19T00:37:48.870114+0000","last_undegraded":"2024-08-19T00:37:48.870114+0000","last_fullsized":"2024-08-19T00:37:48.870114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:34.203490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869512+0000","last_change":"2024-08-19T00:37:47.678607+0000","last_active":"2024-08-19T00:37:48.869512+0000","last_peered":"2024-08-19T00:37:48.869512+0000","last_clean":"2024-08-19T00:37:48.869512+0000","last_became_active":"2024-08-19T00:37:47.678277+0000","last_became_peered":"2024-08-19T00:37:47.678277+0000","last_unstale":"2024-08-19T00:37:48.869512+0000","last_undegraded":"2024-08-19T00:37:48.869512+0000","last_fullsized":"2024-08-19T00:37:48.869512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:32:42.886700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725065+0000","last_change":"2024-08-19T00:37:46.683784+0000","last_active":"2024-08-19T00:37:48.725065+0000","last_peered":"2024-08-19T00:37:48.725065+0000","last_clean":"2024-08-19T00:37:48.725065+0000","last_became_active":"2024-08-19T00:37:46.683505+0000","last_became_peered":"2024-08-19T00:37:46.683505+0000","last_unstale":"2024-08-19T00:37:48.725065+0000","last_undegraded":"2024-08-19T00:37:48.725065+0000","last_fullsized":"2024-08-19T00:37:48.725065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:34.203490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870610+0000","last_change":"2024-08-19T00:37:47.694716+0000","last_active":"2024-08-19T00:37:48.870610+0000","last_peered":"2024-08-19T00:37:48.870610+0000","last_clean":"2024-08-19T00:37:48.870610+0000","last_became_active":"2024-08-19T00:37:47.693907+0000","last_became_peered":"2024-08-19T00:37:47.693907+0000","last_unstale":"2024-08-19T00:37:48.870610+0000","last_undegraded":"2024-08-19T00:37:48.870610+0000","last_fullsized":"2024-08-19T00:37:48.870610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870353+0000","last_change":"2024-08-19T00:37:46.682589+0000","last_active":"2024-08-19T00:37:48.870353+0000","last_peered":"2024-08-19T00:37:48.870353+0000","last_clean":"2024-08-19T00:37:48.870353+0000","last_became_active":"2024-08-19T00:37:46.682253+0000","last_became_peered":"2024-08-19T00:37:46.682253+0000","last_unstale":"2024-08-19T00:37:48.870353+0000","last_undegraded":"2024-08-19T00:37:48.870353+0000","last_fullsized":"2024-08-19T00:37:48.870353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:26.465784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725172+0000","last_change":"2024-08-19T00:37:47.679538+0000","last_active":"2024-08-19T00:37:48.725172+0000","last_peered":"2024-08-19T00:37:48.725172+0000","last_clean":"2024-08-19T00:37:48.725172+0000","last_became_active":"2024-08-19T00:37:47.679194+0000","last_became_peered":"2024-08-19T00:37:47.679194+0000","last_unstale":"2024-08-19T00:37:48.725172+0000","last_undegraded":"2024-08-19T00:37:48.725172+0000","last_fullsized":"2024-08-19T00:37:48.725172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870028+0000","last_change":"2024-08-19T00:37:46.683047+0000","last_active":"2024-08-19T00:37:48.870028+0000","last_peered":"2024-08-19T00:37:48.870028+0000","last_clean":"2024-08-19T00:37:48.870028+0000","last_became_active":"2024-08-19T00:37:46.682254+0000","last_became_peered":"2024-08-19T00:37:46.682254+0000","last_unstale":"2024-08-19T00:37:48.870028+0000","last_undegraded":"2024-08-19T00:37:48.870028+0000","last_fullsized":"2024-08-19T00:37:48.870028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:17.964073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673479+0000","last_change":"2024-08-19T00:37:47.675940+0000","last_active":"2024-08-19T00:37:48.673479+0000","last_peered":"2024-08-19T00:37:48.673479+0000","last_clean":"2024-08-19T00:37:48.673479+0000","last_became_active":"2024-08-19T00:37:47.674936+0000","last_became_peered":"2024-08-19T00:37:47.674936+0000","last_unstale":"2024-08-19T00:37:48.673479+0000","last_undegraded":"2024-08-19T00:37:48.673479+0000","last_fullsized":"2024-08-19T00:37:48.673479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:19.358957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675214+0000","last_change":"2024-08-19T00:37:46.672431+0000","last_active":"2024-08-19T00:37:48.675214+0000","last_peered":"2024-08-19T00:37:48.675214+0000","last_clean":"2024-08-19T00:37:48.675214+0000","last_became_active":"2024-08-19T00:37:46.672105+0000","last_became_peered":"2024-08-19T00:37:46.672105+0000","last_unstale":"2024-08-19T00:37:48.675214+0000","last_undegraded":"2024-08-19T00:37:48.675214+0000","last_fullsized":"2024-08-19T00:37:48.675214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:34.970284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674500+0000","last_change":"2024-08-19T00:37:47.695060+0000","last_active":"2024-08-19T00:37:48.674500+0000","last_peered":"2024-08-19T00:37:48.674500+0000","last_clean":"2024-08-19T00:37:48.674500+0000","last_became_active":"2024-08-19T00:37:47.694817+0000","last_became_peered":"2024-08-19T00:37:47.694817+0000","last_unstale":"2024-08-19T00:37:48.674500+0000","last_undegraded":"2024-08-19T00:37:48.674500+0000","last_fullsized":"2024-08-19T00:37:48.674500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:01.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676533+0000","last_change":"2024-08-19T00:37:46.684814+0000","last_active":"2024-08-19T00:37:48.676533+0000","last_peered":"2024-08-19T00:37:48.676533+0000","last_clean":"2024-08-19T00:37:48.676533+0000","last_became_active":"2024-08-19T00:37:46.683969+0000","last_became_peered":"2024-08-19T00:37:46.683969+0000","last_unstale":"2024-08-19T00:37:48.676533+0000","last_undegraded":"2024-08-19T00:37:48.676533+0000","last_fullsized":"2024-08-19T00:37:48.676533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:24:18.765715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869241+0000","last_change":"2024-08-19T00:37:47.684038+0000","last_active":"2024-08-19T00:37:48.869241+0000","last_peered":"2024-08-19T00:37:48.869241+0000","last_clean":"2024-08-19T00:37:48.869241+0000","last_became_active":"2024-08-19T00:37:47.683106+0000","last_became_peered":"2024-08-19T00:37:47.683106+0000","last_unstale":"2024-08-19T00:37:48.869241+0000","last_undegraded":"2024-08-19T00:37:48.869241+0000","last_fullsized":"2024-08-19T00:37:48.869241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:18.970002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724864+0000","last_change":"2024-08-19T00:37:46.681515+0000","last_active":"2024-08-19T00:37:48.724864+0000","last_peered":"2024-08-19T00:37:48.724864+0000","last_clean":"2024-08-19T00:37:48.724864+0000","last_became_active":"2024-08-19T00:37:46.681152+0000","last_became_peered":"2024-08-19T00:37:46.681152+0000","last_unstale":"2024-08-19T00:37:48.724864+0000","last_undegraded":"2024-08-19T00:37:48.724864+0000","last_fullsized":"2024-08-19T00:37:48.724864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:55.298585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676077+0000","last_change":"2024-08-19T00:37:47.684158+0000","last_active":"2024-08-19T00:37:48.676077+0000","last_peered":"2024-08-19T00:37:48.676077+0000","last_clean":"2024-08-19T00:37:48.676077+0000","last_became_active":"2024-08-19T00:37:47.683876+0000","last_became_peered":"2024-08-19T00:37:47.683876+0000","last_unstale":"2024-08-19T00:37:48.676077+0000","last_undegraded":"2024-08-19T00:37:48.676077+0000","last_fullsized":"2024-08-19T00:37:48.676077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674225+0000","last_change":"2024-08-19T00:37:46.682263+0000","last_active":"2024-08-19T00:37:48.674225+0000","last_peered":"2024-08-19T00:37:48.674225+0000","last_clean":"2024-08-19T00:37:48.674225+0000","last_became_active":"2024-08-19T00:37:46.681946+0000","last_became_peered":"2024-08-19T00:37:46.681946+0000","last_unstale":"2024-08-19T00:37:48.674225+0000","last_undegraded":"2024-08-19T00:37:48.674225+0000","last_fullsized":"2024-08-19T00:37:48.674225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:50.234269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676067+0000","last_change":"2024-08-19T00:37:47.691085+0000","last_active":"2024-08-19T00:37:48.676067+0000","last_peered":"2024-08-19T00:37:48.676067+0000","last_clean":"2024-08-19T00:37:48.676067+0000","last_became_active":"2024-08-19T00:37:47.690560+0000","last_became_peered":"2024-08-19T00:37:47.690560+0000","last_unstale":"2024-08-19T00:37:48.676067+0000","last_undegraded":"2024-08-19T00:37:48.676067+0000","last_fullsized":"2024-08-19T00:37:48.676067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:18.970002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869706+0000","last_change":"2024-08-19T00:37:46.685050+0000","last_active":"2024-08-19T00:37:48.869706+0000","last_peered":"2024-08-19T00:37:48.869706+0000","last_clean":"2024-08-19T00:37:48.869706+0000","last_became_active":"2024-08-19T00:37:46.684741+0000","last_became_peered":"2024-08-19T00:37:46.684741+0000","last_unstale":"2024-08-19T00:37:48.869706+0000","last_undegraded":"2024-08-19T00:37:48.869706+0000","last_fullsized":"2024-08-19T00:37:48.869706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:59.715293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869696+0000","last_change":"2024-08-19T00:37:47.687131+0000","last_active":"2024-08-19T00:37:48.869696+0000","last_peered":"2024-08-19T00:37:48.869696+0000","last_clean":"2024-08-19T00:37:48.869696+0000","last_became_active":"2024-08-19T00:37:47.686754+0000","last_became_peered":"2024-08-19T00:37:47.686754+0000","last_unstale":"2024-08-19T00:37:48.869696+0000","last_undegraded":"2024-08-19T00:37:48.869696+0000","last_fullsized":"2024-08-19T00:37:48.869696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:00.721222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676592+0000","last_change":"2024-08-19T00:37:46.682463+0000","last_active":"2024-08-19T00:37:48.676592+0000","last_peered":"2024-08-19T00:37:48.676592+0000","last_clean":"2024-08-19T00:37:48.676592+0000","last_became_active":"2024-08-19T00:37:46.682038+0000","last_became_peered":"2024-08-19T00:37:46.682038+0000","last_unstale":"2024-08-19T00:37:48.676592+0000","last_undegraded":"2024-08-19T00:37:48.676592+0000","last_fullsized":"2024-08-19T00:37:48.676592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:10.651599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676740+0000","last_change":"2024-08-19T00:37:47.692859+0000","last_active":"2024-08-19T00:37:48.676740+0000","last_peered":"2024-08-19T00:37:48.676740+0000","last_clean":"2024-08-19T00:37:48.676740+0000","last_became_active":"2024-08-19T00:37:47.692611+0000","last_became_peered":"2024-08-19T00:37:47.692611+0000","last_unstale":"2024-08-19T00:37:48.676740+0000","last_undegraded":"2024-08-19T00:37:48.676740+0000","last_fullsized":"2024-08-19T00:37:48.676740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725144+0000","last_change":"2024-08-19T00:37:46.676430+0000","last_active":"2024-08-19T00:37:48.725144+0000","last_peered":"2024-08-19T00:37:48.725144+0000","last_clean":"2024-08-19T00:37:48.725144+0000","last_became_active":"2024-08-19T00:37:46.676190+0000","last_became_peered":"2024-08-19T00:37:46.676190+0000","last_unstale":"2024-08-19T00:37:48.725144+0000","last_undegraded":"2024-08-19T00:37:48.725144+0000","last_fullsized":"2024-08-19T00:37:48.725144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:49.781354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870372+0000","last_change":"2024-08-19T00:37:47.694649+0000","last_active":"2024-08-19T00:37:48.870372+0000","last_peered":"2024-08-19T00:37:48.870372+0000","last_clean":"2024-08-19T00:37:48.870372+0000","last_became_active":"2024-08-19T00:37:47.694362+0000","last_became_peered":"2024-08-19T00:37:47.694362+0000","last_unstale":"2024-08-19T00:37:48.870372+0000","last_undegraded":"2024-08-19T00:37:48.870372+0000","last_fullsized":"2024-08-19T00:37:48.870372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:26:12.337052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868989+0000","last_change":"2024-08-19T00:37:46.680931+0000","last_active":"2024-08-19T00:37:48.868989+0000","last_peered":"2024-08-19T00:37:48.868989+0000","last_clean":"2024-08-19T00:37:48.868989+0000","last_became_active":"2024-08-19T00:37:46.680587+0000","last_became_peered":"2024-08-19T00:37:46.680587+0000","last_unstale":"2024-08-19T00:37:48.868989+0000","last_undegraded":"2024-08-19T00:37:48.868989+0000","last_fullsized":"2024-08-19T00:37:48.868989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:59.750305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868908+0000","last_change":"2024-08-19T00:37:47.690795+0000","last_active":"2024-08-19T00:37:48.868908+0000","last_peered":"2024-08-19T00:37:48.868908+0000","last_clean":"2024-08-19T00:37:48.868908+0000","last_became_active":"2024-08-19T00:37:47.690315+0000","last_became_peered":"2024-08-19T00:37:47.690315+0000","last_unstale":"2024-08-19T00:37:48.868908+0000","last_undegraded":"2024-08-19T00:37:48.868908+0000","last_fullsized":"2024-08-19T00:37:48.868908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:35.209419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673521+0000","last_change":"2024-08-19T00:37:46.681392+0000","last_active":"2024-08-19T00:37:48.673521+0000","last_peered":"2024-08-19T00:37:48.673521+0000","last_clean":"2024-08-19T00:37:48.673521+0000","last_became_active":"2024-08-19T00:37:46.681122+0000","last_became_peered":"2024-08-19T00:37:46.681122+0000","last_unstale":"2024-08-19T00:37:48.673521+0000","last_undegraded":"2024-08-19T00:37:48.673521+0000","last_fullsized":"2024-08-19T00:37:48.673521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:38.281603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676707+0000","last_change":"2024-08-19T00:37:47.692979+0000","last_active":"2024-08-19T00:37:48.676707+0000","last_peered":"2024-08-19T00:37:48.676707+0000","last_clean":"2024-08-19T00:37:48.676707+0000","last_became_active":"2024-08-19T00:37:47.692710+0000","last_became_peered":"2024-08-19T00:37:47.692710+0000","last_unstale":"2024-08-19T00:37:48.676707+0000","last_undegraded":"2024-08-19T00:37:48.676707+0000","last_fullsized":"2024-08-19T00:37:48.676707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:27.471713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869799+0000","last_change":"2024-08-19T00:37:46.686650+0000","last_active":"2024-08-19T00:37:48.869799+0000","last_peered":"2024-08-19T00:37:48.869799+0000","last_clean":"2024-08-19T00:37:48.869799+0000","last_became_active":"2024-08-19T00:37:46.686265+0000","last_became_peered":"2024-08-19T00:37:46.686265+0000","last_unstale":"2024-08-19T00:37:48.869799+0000","last_undegraded":"2024-08-19T00:37:48.869799+0000","last_fullsized":"2024-08-19T00:37:48.869799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:55.298585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674110+0000","last_change":"2024-08-19T00:37:47.691518+0000","last_active":"2024-08-19T00:37:48.674110+0000","last_peered":"2024-08-19T00:37:48.674110+0000","last_clean":"2024-08-19T00:37:48.674110+0000","last_became_active":"2024-08-19T00:37:47.690575+0000","last_became_peered":"2024-08-19T00:37:47.690575+0000","last_unstale":"2024-08-19T00:37:48.674110+0000","last_undegraded":"2024-08-19T00:37:48.674110+0000","last_fullsized":"2024-08-19T00:37:48.674110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:31:47.203287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.682240+0000","last_change":"2024-08-19T00:37:46.680010+0000","last_active":"2024-08-19T00:37:48.682240+0000","last_peered":"2024-08-19T00:37:48.682240+0000","last_clean":"2024-08-19T00:37:48.682240+0000","last_became_active":"2024-08-19T00:37:46.679672+0000","last_became_peered":"2024-08-19T00:37:46.679672+0000","last_unstale":"2024-08-19T00:37:48.682240+0000","last_undegraded":"2024-08-19T00:37:48.682240+0000","last_fullsized":"2024-08-19T00:37:48.682240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:05:59.994009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676140+0000","last_change":"2024-08-19T00:37:47.705813+0000","last_active":"2024-08-19T00:37:48.676140+0000","last_peered":"2024-08-19T00:37:48.676140+0000","last_clean":"2024-08-19T00:37:48.676140+0000","last_became_active":"2024-08-19T00:37:47.705523+0000","last_became_peered":"2024-08-19T00:37:47.705523+0000","last_unstale":"2024-08-19T00:37:48.676140+0000","last_undegraded":"2024-08-19T00:37:48.676140+0000","last_fullsized":"2024-08-19T00:37:48.676140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:12:50.182685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870216+0000","last_change":"2024-08-19T00:37:46.676714+0000","last_active":"2024-08-19T00:37:48.870216+0000","last_peered":"2024-08-19T00:37:48.870216+0000","last_clean":"2024-08-19T00:37:48.870216+0000","last_became_active":"2024-08-19T00:37:46.676452+0000","last_became_peered":"2024-08-19T00:37:46.676452+0000","last_unstale":"2024-08-19T00:37:48.870216+0000","last_undegraded":"2024-08-19T00:37:48.870216+0000","last_fullsized":"2024-08-19T00:37:48.870216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:49.781354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869551+0000","last_change":"2024-08-19T00:37:47.693842+0000","last_active":"2024-08-19T00:37:48.869551+0000","last_peered":"2024-08-19T00:37:48.869551+0000","last_clean":"2024-08-19T00:37:48.869551+0000","last_became_active":"2024-08-19T00:37:47.693550+0000","last_became_peered":"2024-08-19T00:37:47.693550+0000","last_unstale":"2024-08-19T00:37:48.869551+0000","last_undegraded":"2024-08-19T00:37:48.869551+0000","last_fullsized":"2024-08-19T00:37:48.869551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870131+0000","last_change":"2024-08-19T00:37:46.681338+0000","last_active":"2024-08-19T00:37:48.870131+0000","last_peered":"2024-08-19T00:37:48.870131+0000","last_clean":"2024-08-19T00:37:48.870131+0000","last_became_active":"2024-08-19T00:37:46.680197+0000","last_became_peered":"2024-08-19T00:37:46.680197+0000","last_unstale":"2024-08-19T00:37:48.870131+0000","last_undegraded":"2024-08-19T00:37:48.870131+0000","last_fullsized":"2024-08-19T00:37:48.870131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:00:20.578511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870800+0000","last_change":"2024-08-19T00:37:47.694130+0000","last_active":"2024-08-19T00:37:48.870800+0000","last_peered":"2024-08-19T00:37:48.870800+0000","last_clean":"2024-08-19T00:37:48.870800+0000","last_became_active":"2024-08-19T00:37:47.687374+0000","last_became_peered":"2024-08-19T00:37:47.687374+0000","last_unstale":"2024-08-19T00:37:48.870800+0000","last_undegraded":"2024-08-19T00:37:48.870800+0000","last_fullsized":"2024-08-19T00:37:48.870800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:29.298098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869838+0000","last_change":"2024-08-19T00:37:46.680993+0000","last_active":"2024-08-19T00:37:48.869838+0000","last_peered":"2024-08-19T00:37:48.869838+0000","last_clean":"2024-08-19T00:37:48.869838+0000","last_became_active":"2024-08-19T00:37:46.680733+0000","last_became_peered":"2024-08-19T00:37:46.680733+0000","last_unstale":"2024-08-19T00:37:48.869838+0000","last_undegraded":"2024-08-19T00:37:48.869838+0000","last_fullsized":"2024-08-19T00:37:48.869838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:54.484342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869595+0000","last_change":"2024-08-19T00:37:47.690646+0000","last_active":"2024-08-19T00:37:48.869595+0000","last_peered":"2024-08-19T00:37:48.869595+0000","last_clean":"2024-08-19T00:37:48.869595+0000","last_became_active":"2024-08-19T00:37:47.689486+0000","last_became_peered":"2024-08-19T00:37:47.689486+0000","last_unstale":"2024-08-19T00:37:48.869595+0000","last_undegraded":"2024-08-19T00:37:48.869595+0000","last_fullsized":"2024-08-19T00:37:48.869595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:25.016360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724961+0000","last_change":"2024-08-19T00:37:46.681637+0000","last_active":"2024-08-19T00:37:48.724961+0000","last_peered":"2024-08-19T00:37:48.724961+0000","last_clean":"2024-08-19T00:37:48.724961+0000","last_became_active":"2024-08-19T00:37:46.681338+0000","last_became_peered":"2024-08-19T00:37:46.681338+0000","last_unstale":"2024-08-19T00:37:48.724961+0000","last_undegraded":"2024-08-19T00:37:48.724961+0000","last_fullsized":"2024-08-19T00:37:48.724961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:00:20.578511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673560+0000","last_change":"2024-08-19T00:37:47.688568+0000","last_active":"2024-08-19T00:37:48.673560+0000","last_peered":"2024-08-19T00:37:48.673560+0000","last_clean":"2024-08-19T00:37:48.673560+0000","last_became_active":"2024-08-19T00:37:47.687457+0000","last_became_peered":"2024-08-19T00:37:47.687457+0000","last_unstale":"2024-08-19T00:37:48.673560+0000","last_undegraded":"2024-08-19T00:37:48.673560+0000","last_fullsized":"2024-08-19T00:37:48.673560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:18:36.554390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869974+0000","last_change":"2024-08-19T00:37:46.681444+0000","last_active":"2024-08-19T00:37:48.869974+0000","last_peered":"2024-08-19T00:37:48.869974+0000","last_clean":"2024-08-19T00:37:48.869974+0000","last_became_active":"2024-08-19T00:37:46.681137+0000","last_became_peered":"2024-08-19T00:37:46.681137+0000","last_unstale":"2024-08-19T00:37:48.869974+0000","last_undegraded":"2024-08-19T00:37:48.869974+0000","last_fullsized":"2024-08-19T00:37:48.869974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:45.532725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869649+0000","last_change":"2024-08-19T00:37:47.690316+0000","last_active":"2024-08-19T00:37:48.869649+0000","last_peered":"2024-08-19T00:37:48.869649+0000","last_clean":"2024-08-19T00:37:48.869649+0000","last_became_active":"2024-08-19T00:37:47.690008+0000","last_became_peered":"2024-08-19T00:37:47.690008+0000","last_unstale":"2024-08-19T00:37:48.869649+0000","last_undegraded":"2024-08-19T00:37:48.869649+0000","last_fullsized":"2024-08-19T00:37:48.869649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674293+0000","last_change":"2024-08-19T00:37:46.681554+0000","last_active":"2024-08-19T00:37:48.674293+0000","last_peered":"2024-08-19T00:37:48.674293+0000","last_clean":"2024-08-19T00:37:48.674293+0000","last_became_active":"2024-08-19T00:37:46.681291+0000","last_became_peered":"2024-08-19T00:37:46.681291+0000","last_unstale":"2024-08-19T00:37:48.674293+0000","last_undegraded":"2024-08-19T00:37:48.674293+0000","last_fullsized":"2024-08-19T00:37:48.674293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:27.606426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868945+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:37:48.868945+0000","last_peered":"2024-08-19T00:37:48.868945+0000","last_clean":"2024-08-19T00:37:48.868945+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:37:48.868945+0000","last_undegraded":"2024-08-19T00:37:48.868945+0000","last_fullsized":"2024-08-19T00:37:48.868945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":140417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":139581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":138839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":729243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":138895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:37:51.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:37:52.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.089+0000 7f1159200640 1 Processor -- start 2024-08-19T00:37:52.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.090+0000 7f1159200640 1 -- start start 2024-08-19T00:37:52.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1159200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1154159bf0 0x7f1154073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1159200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11540cec10 0x7f11540d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1159200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115406f7f0 con 0x7f11540739a0 2024-08-19T00:37:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1159200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f115406f510 con 0x7f1154159bf0 2024-08-19T00:37:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1159200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1154072980 con 0x7f11540cec10 2024-08-19T00:37:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1151e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1154159bf0 0x7f1154073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f114be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f11540739a0 0x7f11540ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41442/0 (socket says 172.21.15.7:41442) 2024-08-19T00:37:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f114be00640 1 -- 172.21.15.7:0/3855533165 learned_addr learned my addr 172.21.15.7:0/3855533165 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:52.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1152800640 1 --2- 172.21.15.7:0/3855533165 >> v2:172.21.15.162:3300/0 conn(0x7f11540cec10 0x7f11540d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.091+0000 7f1151400640 1 -- 172.21.15.7:0/3855533165 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893021463 0 0) 0x7f115406f7f0 con 0x7f11540739a0 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.092+0000 7f1151400640 1 -- 172.21.15.7:0/3855533165 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1138003520 con 0x7f11540739a0 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.092+0000 7f1151e00640 1 -- 172.21.15.7:0/3855533165 >> v2:172.21.15.162:3300/0 conn(0x7f11540cec10 msgr2=0x7f11540d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.092+0000 7f1151e00640 1 --2- 172.21.15.7:0/3855533165 >> v2:172.21.15.162:3300/0 conn(0x7f11540cec10 0x7f11540d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.092+0000 7f1151e00640 1 -- 172.21.15.7:0/3855533165 >> v1:172.21.15.7:6789/0 conn(0x7f11540739a0 legacy=0x7f11540ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.092+0000 7f1151e00640 1 -- 172.21.15.7:0/3855533165 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1154072c60 con 0x7f1154159bf0 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.093+0000 7f1151e00640 1 --2- 172.21.15.7:0/3855533165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f1154073460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f11540d0f80 tx=0x7f114402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6103f43f114dd99 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.093+0000 7f1151400640 1 -- 172.21.15.7:0/3855533165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144037070 con 0x7f1154159bf0 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.093+0000 7f1151400640 1 -- 172.21.15.7:0/3855533165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1144032440 con 0x7f1154159bf0 2024-08-19T00:37:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.093+0000 7f1151400640 1 -- 172.21.15.7:0/3855533165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114402ae60 con 0x7f1154159bf0 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.093+0000 7f1159200640 1 -- 172.21.15.7:0/3855533165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 msgr2=0x7f1154073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.093+0000 7f1159200640 1 --2- 172.21.15.7:0/3855533165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f1154073460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f11540d0f80 tx=0x7f114402a110 comp rx=0 tx=0).stop 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.094+0000 7f1159200640 1 -- 172.21.15.7:0/3855533165 shutdown_connections 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.094+0000 7f1159200640 1 --2- 172.21.15.7:0/3855533165 >> v2:172.21.15.162:3300/0 conn(0x7f11540cec10 0x7f11540d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.094+0000 7f1159200640 1 --2- 172.21.15.7:0/3855533165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f1154073460 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.094+0000 7f1159200640 1 -- 172.21.15.7:0/3855533165 >> 172.21.15.7:0/3855533165 conn(0x7f115406bc70 msgr2=0x7f115406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.094+0000 7f1159200640 1 -- 172.21.15.7:0/3855533165 shutdown_connections 2024-08-19T00:37:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.094+0000 7f1159200640 1 -- 172.21.15.7:0/3855533165 wait complete. 2024-08-19T00:37:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.095+0000 7f1159200640 1 Processor -- start 2024-08-19T00:37:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.095+0000 7f1159200640 1 -- start start 2024-08-19T00:37:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.096+0000 7f1159200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11540739a0 0x7f11541521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.096+0000 7f1159200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f115414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.096+0000 7f1159200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541529f0 0x7f11541f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.096+0000 7f1159200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f115415a150 con 0x7f1154159bf0 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.096+0000 7f1159200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1154159fd0 con 0x7f11541529f0 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.096+0000 7f1159200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f11540d0900 con 0x7f11540739a0 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f115414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f115414dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56358/0 (socket says 172.21.15.7:56358) 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 -- 172.21.15.7:0/738688791 learned_addr learned my addr 172.21.15.7:0/738688791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f1152800640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541529f0 0x7f11541f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f1151e00640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11540739a0 0x7f11541521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 -- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11540739a0 msgr2=0x7f11541521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11540739a0 0x7f11541521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 -- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541529f0 msgr2=0x7f11541f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541529f0 0x7f11541f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 -- 172.21.15.7:0/738688791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1154152e80 con 0x7f1154159bf0 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f1151e00640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11540739a0 0x7f11541521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.097+0000 7f114be00640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f115414dda0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c390 tx=0x7f113c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.098+0000 7f114a000640 1 -- 172.21.15.7:0/738688791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c017070 con 0x7f1154159bf0 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.098+0000 7f114a000640 1 -- 172.21.15.7:0/738688791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113c005ce0 con 0x7f1154159bf0 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.098+0000 7f114a000640 1 -- 172.21.15.7:0/738688791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c0072f0 con 0x7f1154159bf0 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.098+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1154153140 con 0x7f1154159bf0 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.098+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1154153700 con 0x7f1154159bf0 2024-08-19T00:37:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.099+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11540d0c90 con 0x7f1154159bf0 2024-08-19T00:37:52.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.100+0000 7f114a000640 1 -- 172.21.15.7:0/738688791 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f113c01a070 con 0x7f1154159bf0 2024-08-19T00:37:52.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.101+0000 7f114a000640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f113006be30 0x7f113006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.101+0000 7f114a000640 1 -- 172.21.15.7:0/738688791 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f113c08a2b0 con 0x7f1154159bf0 2024-08-19T00:37:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.101+0000 7f1151e00640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f113006be30 0x7f113006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.102+0000 7f1151e00640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f113006be30 0x7f113006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1144034000 tx=0x7f114402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.106+0000 7f114a000640 1 -- 172.21.15.7:0/738688791 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f113c058c50 con 0x7f1154159bf0 2024-08-19T00:37:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.285+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f115415ba50 con 0x7f113006be30 2024-08-19T00:37:52.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.292+0000 7f114a000640 1 -- 172.21.15.7:0/738688791 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7f115415ba50 con 0x7f113006be30 2024-08-19T00:37:52.296 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:52.297 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.295+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f113006be30 msgr2=0x7f113006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.295+0000 7f1159200640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f113006be30 0x7f113006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1144034000 tx=0x7f114402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.295+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 msgr2=0x7f115414dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.295+0000 7f1159200640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f115414dda0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c390 tx=0x7f113c00c850 comp rx=0 tx=0).stop 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 shutdown_connections 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f113006be30 0x7f113006e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541529f0 0x7f11541f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1154159bf0 0x7f115414dda0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 --2- 172.21.15.7:0/738688791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11540739a0 0x7f11541521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 >> 172.21.15.7:0/738688791 conn(0x7f115406bc70 msgr2=0x7f11540cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 shutdown_connections 2024-08-19T00:37:52.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.296+0000 7f1159200640 1 -- 172.21.15.7:0/738688791 wait complete. 2024-08-19T00:37:52.313 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-19T00:37:51.265642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236856,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737864,"statfs":{"total":773094113280,"available":772851572736,"internally_reserved":0,"allocated":4136960,"data_stored":2295996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614382"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724977+0000","last_change":"2024-08-19T00:37:47.685551+0000","last_active":"2024-08-19T00:37:48.724977+0000","last_peered":"2024-08-19T00:37:48.724977+0000","last_clean":"2024-08-19T00:37:48.724977+0000","last_became_active":"2024-08-19T00:37:47.685265+0000","last_became_peered":"2024-08-19T00:37:47.685265+0000","last_unstale":"2024-08-19T00:37:48.724977+0000","last_undegraded":"2024-08-19T00:37:48.724977+0000","last_fullsized":"2024-08-19T00:37:48.724977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:25.016360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.677083+0000","last_change":"2024-08-19T00:37:47.694647+0000","last_active":"2024-08-19T00:37:48.677083+0000","last_peered":"2024-08-19T00:37:48.677083+0000","last_clean":"2024-08-19T00:37:48.677083+0000","last_became_active":"2024-08-19T00:37:47.694316+0000","last_became_peered":"2024-08-19T00:37:47.694316+0000","last_unstale":"2024-08-19T00:37:48.677083+0000","last_undegraded":"2024-08-19T00:37:48.677083+0000","last_fullsized":"2024-08-19T00:37:48.677083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868918+0000","last_change":"2024-08-19T00:37:47.680643+0000","last_active":"2024-08-19T00:37:48.868918+0000","last_peered":"2024-08-19T00:37:48.868918+0000","last_clean":"2024-08-19T00:37:48.868918+0000","last_became_active":"2024-08-19T00:37:47.680314+0000","last_became_peered":"2024-08-19T00:37:47.680314+0000","last_unstale":"2024-08-19T00:37:48.868918+0000","last_undegraded":"2024-08-19T00:37:48.868918+0000","last_fullsized":"2024-08-19T00:37:48.868918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:50.787283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870497+0000","last_change":"2024-08-19T00:37:47.693799+0000","last_active":"2024-08-19T00:37:48.870497+0000","last_peered":"2024-08-19T00:37:48.870497+0000","last_clean":"2024-08-19T00:37:48.870497+0000","last_became_active":"2024-08-19T00:37:47.693453+0000","last_became_peered":"2024-08-19T00:37:47.693453+0000","last_unstale":"2024-08-19T00:37:48.870497+0000","last_undegraded":"2024-08-19T00:37:48.870497+0000","last_fullsized":"2024-08-19T00:37:48.870497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676148+0000","last_change":"2024-08-19T00:37:47.688949+0000","last_active":"2024-08-19T00:37:48.676148+0000","last_peered":"2024-08-19T00:37:48.676148+0000","last_clean":"2024-08-19T00:37:48.676148+0000","last_became_active":"2024-08-19T00:37:47.688658+0000","last_became_peered":"2024-08-19T00:37:47.688658+0000","last_unstale":"2024-08-19T00:37:48.676148+0000","last_undegraded":"2024-08-19T00:37:48.676148+0000","last_fullsized":"2024-08-19T00:37:48.676148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675461+0000","last_change":"2024-08-19T00:37:47.692578+0000","last_active":"2024-08-19T00:37:48.675461+0000","last_peered":"2024-08-19T00:37:48.675461+0000","last_clean":"2024-08-19T00:37:48.675461+0000","last_became_active":"2024-08-19T00:37:47.688251+0000","last_became_peered":"2024-08-19T00:37:47.688251+0000","last_unstale":"2024-08-19T00:37:48.675461+0000","last_undegraded":"2024-08-19T00:37:48.675461+0000","last_fullsized":"2024-08-19T00:37:48.675461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:01.818436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724706+0000","last_change":"2024-08-19T00:37:47.677811+0000","last_active":"2024-08-19T00:37:48.724706+0000","last_peered":"2024-08-19T00:37:48.724706+0000","last_clean":"2024-08-19T00:37:48.724706+0000","last_became_active":"2024-08-19T00:37:47.677255+0000","last_became_peered":"2024-08-19T00:37:47.677255+0000","last_unstale":"2024-08-19T00:37:48.724706+0000","last_undegraded":"2024-08-19T00:37:48.724706+0000","last_fullsized":"2024-08-19T00:37:48.724706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:10.911535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724684+0000","last_change":"2024-08-19T00:37:47.679294+0000","last_active":"2024-08-19T00:37:48.724684+0000","last_peered":"2024-08-19T00:37:48.724684+0000","last_clean":"2024-08-19T00:37:48.724684+0000","last_became_active":"2024-08-19T00:37:47.679009+0000","last_became_peered":"2024-08-19T00:37:47.679009+0000","last_unstale":"2024-08-19T00:37:48.724684+0000","last_undegraded":"2024-08-19T00:37:48.724684+0000","last_fullsized":"2024-08-19T00:37:48.724684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:11.657528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869191+0000","last_change":"2024-08-19T00:37:47.692993+0000","last_active":"2024-08-19T00:37:48.869191+0000","last_peered":"2024-08-19T00:37:48.869191+0000","last_clean":"2024-08-19T00:37:48.869191+0000","last_became_active":"2024-08-19T00:37:47.692611+0000","last_became_peered":"2024-08-19T00:37:47.692611+0000","last_unstale":"2024-08-19T00:37:48.869191+0000","last_undegraded":"2024-08-19T00:37:48.869191+0000","last_fullsized":"2024-08-19T00:37:48.869191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:46.538654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870923+0000","last_change":"2024-08-19T00:37:47.702995+0000","last_active":"2024-08-19T00:37:48.870923+0000","last_peered":"2024-08-19T00:37:48.870923+0000","last_clean":"2024-08-19T00:37:48.870923+0000","last_became_active":"2024-08-19T00:37:47.702053+0000","last_became_peered":"2024-08-19T00:37:47.702053+0000","last_unstale":"2024-08-19T00:37:48.870923+0000","last_undegraded":"2024-08-19T00:37:48.870923+0000","last_fullsized":"2024-08-19T00:37:48.870923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:10.571431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674111+0000","last_change":"2024-08-19T00:37:47.695578+0000","last_active":"2024-08-19T00:37:48.674111+0000","last_peered":"2024-08-19T00:37:48.674111+0000","last_clean":"2024-08-19T00:37:48.674111+0000","last_became_active":"2024-08-19T00:37:47.694820+0000","last_became_peered":"2024-08-19T00:37:47.694820+0000","last_unstale":"2024-08-19T00:37:48.674111+0000","last_undegraded":"2024-08-19T00:37:48.674111+0000","last_fullsized":"2024-08-19T00:37:48.674111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:44.388640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869166+0000","last_change":"2024-08-19T00:37:47.683750+0000","last_active":"2024-08-19T00:37:48.869166+0000","last_peered":"2024-08-19T00:37:48.869166+0000","last_clean":"2024-08-19T00:37:48.869166+0000","last_became_active":"2024-08-19T00:37:47.682744+0000","last_became_peered":"2024-08-19T00:37:47.682744+0000","last_unstale":"2024-08-19T00:37:48.869166+0000","last_undegraded":"2024-08-19T00:37:48.869166+0000","last_fullsized":"2024-08-19T00:37:48.869166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:01.818436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869933+0000","last_change":"2024-08-19T00:37:47.695362+0000","last_active":"2024-08-19T00:37:48.869933+0000","last_peered":"2024-08-19T00:37:48.869933+0000","last_clean":"2024-08-19T00:37:48.869933+0000","last_became_active":"2024-08-19T00:37:47.695095+0000","last_became_peered":"2024-08-19T00:37:47.695095+0000","last_unstale":"2024-08-19T00:37:48.869933+0000","last_undegraded":"2024-08-19T00:37:48.869933+0000","last_fullsized":"2024-08-19T00:37:48.869933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:33.953161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870232+0000","last_change":"2024-08-19T00:37:47.700978+0000","last_active":"2024-08-19T00:37:48.870232+0000","last_peered":"2024-08-19T00:37:48.870232+0000","last_clean":"2024-08-19T00:37:48.870232+0000","last_became_active":"2024-08-19T00:37:47.692034+0000","last_became_peered":"2024-08-19T00:37:47.692034+0000","last_unstale":"2024-08-19T00:37:48.870232+0000","last_undegraded":"2024-08-19T00:37:48.870232+0000","last_fullsized":"2024-08-19T00:37:48.870232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869456+0000","last_change":"2024-08-19T00:37:47.685353+0000","last_active":"2024-08-19T00:37:48.869456+0000","last_peered":"2024-08-19T00:37:48.869456+0000","last_clean":"2024-08-19T00:37:48.869456+0000","last_became_active":"2024-08-19T00:37:47.685028+0000","last_became_peered":"2024-08-19T00:37:47.685028+0000","last_unstale":"2024-08-19T00:37:48.869456+0000","last_undegraded":"2024-08-19T00:37:48.869456+0000","last_fullsized":"2024-08-19T00:37:48.869456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:25.016360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868952+0000","last_change":"2024-08-19T00:37:47.690620+0000","last_active":"2024-08-19T00:37:48.868952+0000","last_peered":"2024-08-19T00:37:48.868952+0000","last_clean":"2024-08-19T00:37:48.868952+0000","last_became_active":"2024-08-19T00:37:47.689013+0000","last_became_peered":"2024-08-19T00:37:47.689013+0000","last_unstale":"2024-08-19T00:37:48.868952+0000","last_undegraded":"2024-08-19T00:37:48.868952+0000","last_fullsized":"2024-08-19T00:37:48.868952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:39.287532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673935+0000","last_change":"2024-08-19T00:37:47.677088+0000","last_active":"2024-08-19T00:37:48.673935+0000","last_peered":"2024-08-19T00:37:48.673935+0000","last_clean":"2024-08-19T00:37:48.673935+0000","last_became_active":"2024-08-19T00:37:47.676597+0000","last_became_peered":"2024-08-19T00:37:47.676597+0000","last_unstale":"2024-08-19T00:37:48.673935+0000","last_undegraded":"2024-08-19T00:37:48.673935+0000","last_fullsized":"2024-08-19T00:37:48.673935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:31:27.846182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676585+0000","last_change":"2024-08-19T00:37:47.693377+0000","last_active":"2024-08-19T00:37:48.676585+0000","last_peered":"2024-08-19T00:37:48.676585+0000","last_clean":"2024-08-19T00:37:48.676585+0000","last_became_active":"2024-08-19T00:37:47.693138+0000","last_became_peered":"2024-08-19T00:37:47.693138+0000","last_unstale":"2024-08-19T00:37:48.676585+0000","last_undegraded":"2024-08-19T00:37:48.676585+0000","last_fullsized":"2024-08-19T00:37:48.676585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:43.510296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675964+0000","last_change":"2024-08-19T00:37:47.699501+0000","last_active":"2024-08-19T00:37:48.675964+0000","last_peered":"2024-08-19T00:37:48.675964+0000","last_clean":"2024-08-19T00:37:48.675964+0000","last_became_active":"2024-08-19T00:37:47.699208+0000","last_became_peered":"2024-08-19T00:37:47.699208+0000","last_unstale":"2024-08-19T00:37:48.675964+0000","last_undegraded":"2024-08-19T00:37:48.675964+0000","last_fullsized":"2024-08-19T00:37:48.675964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:46.538654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869990+0000","last_change":"2024-08-19T00:37:47.690103+0000","last_active":"2024-08-19T00:37:48.869990+0000","last_peered":"2024-08-19T00:37:48.869990+0000","last_clean":"2024-08-19T00:37:48.869990+0000","last_became_active":"2024-08-19T00:37:47.689836+0000","last_became_peered":"2024-08-19T00:37:47.689836+0000","last_unstale":"2024-08-19T00:37:48.869990+0000","last_undegraded":"2024-08-19T00:37:48.869990+0000","last_fullsized":"2024-08-19T00:37:48.869990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:00.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869730+0000","last_change":"2024-08-19T00:37:47.684380+0000","last_active":"2024-08-19T00:37:48.869730+0000","last_peered":"2024-08-19T00:37:48.869730+0000","last_clean":"2024-08-19T00:37:48.869730+0000","last_became_active":"2024-08-19T00:37:47.684088+0000","last_became_peered":"2024-08-19T00:37:47.684088+0000","last_unstale":"2024-08-19T00:37:48.869730+0000","last_undegraded":"2024-08-19T00:37:48.869730+0000","last_fullsized":"2024-08-19T00:37:48.869730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725045+0000","last_change":"2024-08-19T00:37:47.699238+0000","last_active":"2024-08-19T00:37:48.725045+0000","last_peered":"2024-08-19T00:37:48.725045+0000","last_clean":"2024-08-19T00:37:48.725045+0000","last_became_active":"2024-08-19T00:37:47.698958+0000","last_became_peered":"2024-08-19T00:37:47.698958+0000","last_unstale":"2024-08-19T00:37:48.725045+0000","last_undegraded":"2024-08-19T00:37:48.725045+0000","last_fullsized":"2024-08-19T00:37:48.725045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:10.314801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869517+0000","last_change":"2024-08-19T00:37:47.677032+0000","last_active":"2024-08-19T00:37:48.869517+0000","last_peered":"2024-08-19T00:37:48.869517+0000","last_clean":"2024-08-19T00:37:48.869517+0000","last_became_active":"2024-08-19T00:37:47.676418+0000","last_became_peered":"2024-08-19T00:37:47.676418+0000","last_unstale":"2024-08-19T00:37:48.869517+0000","last_undegraded":"2024-08-19T00:37:48.869517+0000","last_fullsized":"2024-08-19T00:37:48.869517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:14.822226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724701+0000","last_change":"2024-08-19T00:37:47.698823+0000","last_active":"2024-08-19T00:37:48.724701+0000","last_peered":"2024-08-19T00:37:48.724701+0000","last_clean":"2024-08-19T00:37:48.724701+0000","last_became_active":"2024-08-19T00:37:47.698407+0000","last_became_peered":"2024-08-19T00:37:47.698407+0000","last_unstale":"2024-08-19T00:37:48.724701+0000","last_undegraded":"2024-08-19T00:37:48.724701+0000","last_fullsized":"2024-08-19T00:37:48.724701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:32:27.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870887+0000","last_change":"2024-08-19T00:37:47.695381+0000","last_active":"2024-08-19T00:37:48.870887+0000","last_peered":"2024-08-19T00:37:48.870887+0000","last_clean":"2024-08-19T00:37:48.870887+0000","last_became_active":"2024-08-19T00:37:47.689122+0000","last_became_peered":"2024-08-19T00:37:47.689122+0000","last_unstale":"2024-08-19T00:37:48.870887+0000","last_undegraded":"2024-08-19T00:37:48.870887+0000","last_fullsized":"2024-08-19T00:37:48.870887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:12:44.538682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.871014+0000","last_change":"2024-08-19T00:37:47.688191+0000","last_active":"2024-08-19T00:37:48.871014+0000","last_peered":"2024-08-19T00:37:48.871014+0000","last_clean":"2024-08-19T00:37:48.871014+0000","last_became_active":"2024-08-19T00:37:47.687809+0000","last_became_peered":"2024-08-19T00:37:47.687809+0000","last_unstale":"2024-08-19T00:37:48.871014+0000","last_undegraded":"2024-08-19T00:37:48.871014+0000","last_fullsized":"2024-08-19T00:37:48.871014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:35:19.471712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675948+0000","last_change":"2024-08-19T00:37:47.693658+0000","last_active":"2024-08-19T00:37:48.675948+0000","last_peered":"2024-08-19T00:37:48.675948+0000","last_clean":"2024-08-19T00:37:48.675948+0000","last_became_active":"2024-08-19T00:37:47.688198+0000","last_became_peered":"2024-08-19T00:37:47.688198+0000","last_unstale":"2024-08-19T00:37:48.675948+0000","last_undegraded":"2024-08-19T00:37:48.675948+0000","last_fullsized":"2024-08-19T00:37:48.675948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725221+0000","last_change":"2024-08-19T00:37:47.679222+0000","last_active":"2024-08-19T00:37:48.725221+0000","last_peered":"2024-08-19T00:37:48.725221+0000","last_clean":"2024-08-19T00:37:48.725221+0000","last_became_active":"2024-08-19T00:37:47.678917+0000","last_became_peered":"2024-08-19T00:37:47.678917+0000","last_unstale":"2024-08-19T00:37:48.725221+0000","last_undegraded":"2024-08-19T00:37:48.725221+0000","last_fullsized":"2024-08-19T00:37:48.725221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869618+0000","last_change":"2024-08-19T00:37:47.704326+0000","last_active":"2024-08-19T00:37:48.869618+0000","last_peered":"2024-08-19T00:37:48.869618+0000","last_clean":"2024-08-19T00:37:48.869618+0000","last_became_active":"2024-08-19T00:37:47.704043+0000","last_became_peered":"2024-08-19T00:37:47.704043+0000","last_unstale":"2024-08-19T00:37:48.869618+0000","last_undegraded":"2024-08-19T00:37:48.869618+0000","last_fullsized":"2024-08-19T00:37:48.869618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869474+0000","last_change":"2024-08-19T00:37:47.685449+0000","last_active":"2024-08-19T00:37:48.869474+0000","last_peered":"2024-08-19T00:37:48.869474+0000","last_clean":"2024-08-19T00:37:48.869474+0000","last_became_active":"2024-08-19T00:37:47.685146+0000","last_became_peered":"2024-08-19T00:37:47.685146+0000","last_unstale":"2024-08-19T00:37:48.869474+0000","last_undegraded":"2024-08-19T00:37:48.869474+0000","last_fullsized":"2024-08-19T00:37:48.869474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725066+0000","last_change":"2024-08-19T00:37:47.692460+0000","last_active":"2024-08-19T00:37:48.725066+0000","last_peered":"2024-08-19T00:37:48.725066+0000","last_clean":"2024-08-19T00:37:48.725066+0000","last_became_active":"2024-08-19T00:37:47.692170+0000","last_became_peered":"2024-08-19T00:37:47.692170+0000","last_unstale":"2024-08-19T00:37:48.725066+0000","last_undegraded":"2024-08-19T00:37:48.725066+0000","last_fullsized":"2024-08-19T00:37:48.725066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673508+0000","last_change":"2024-08-19T00:37:47.678527+0000","last_active":"2024-08-19T00:37:48.673508+0000","last_peered":"2024-08-19T00:37:48.673508+0000","last_clean":"2024-08-19T00:37:48.673508+0000","last_became_active":"2024-08-19T00:37:47.678278+0000","last_became_peered":"2024-08-19T00:37:47.678278+0000","last_unstale":"2024-08-19T00:37:48.673508+0000","last_undegraded":"2024-08-19T00:37:48.673508+0000","last_fullsized":"2024-08-19T00:37:48.673508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:42:47.025878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869901+0000","last_change":"2024-08-19T00:37:47.672860+0000","last_active":"2024-08-19T00:37:48.869901+0000","last_peered":"2024-08-19T00:37:48.869901+0000","last_clean":"2024-08-19T00:37:48.869901+0000","last_became_active":"2024-08-19T00:37:47.672466+0000","last_became_peered":"2024-08-19T00:37:47.672466+0000","last_unstale":"2024-08-19T00:37:48.869901+0000","last_undegraded":"2024-08-19T00:37:48.869901+0000","last_fullsized":"2024-08-19T00:37:48.869901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:51:29.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674227+0000","last_change":"2024-08-19T00:37:46.674844+0000","last_active":"2024-08-19T00:37:48.674227+0000","last_peered":"2024-08-19T00:37:48.674227+0000","last_clean":"2024-08-19T00:37:48.674227+0000","last_became_active":"2024-08-19T00:37:46.674548+0000","last_became_peered":"2024-08-19T00:37:46.674548+0000","last_unstale":"2024-08-19T00:37:48.674227+0000","last_undegraded":"2024-08-19T00:37:48.674227+0000","last_fullsized":"2024-08-19T00:37:48.674227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:16.456720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725730+0000","last_change":"2024-08-19T00:37:47.687784+0000","last_active":"2024-08-19T00:37:48.725730+0000","last_peered":"2024-08-19T00:37:48.725730+0000","last_clean":"2024-08-19T00:37:48.725730+0000","last_became_active":"2024-08-19T00:37:47.687012+0000","last_became_peered":"2024-08-19T00:37:47.687012+0000","last_unstale":"2024-08-19T00:37:48.725730+0000","last_undegraded":"2024-08-19T00:37:48.725730+0000","last_fullsized":"2024-08-19T00:37:48.725730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.871072+0000","last_change":"2024-08-19T00:37:46.683255+0000","last_active":"2024-08-19T00:37:48.871072+0000","last_peered":"2024-08-19T00:37:48.871072+0000","last_clean":"2024-08-19T00:37:48.871072+0000","last_became_active":"2024-08-19T00:37:46.681679+0000","last_became_peered":"2024-08-19T00:37:46.681679+0000","last_unstale":"2024-08-19T00:37:48.871072+0000","last_undegraded":"2024-08-19T00:37:48.871072+0000","last_fullsized":"2024-08-19T00:37:48.871072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:42.504367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725196+0000","last_change":"2024-08-19T00:37:47.702137+0000","last_active":"2024-08-19T00:37:48.725196+0000","last_peered":"2024-08-19T00:37:48.725196+0000","last_clean":"2024-08-19T00:37:48.725196+0000","last_became_active":"2024-08-19T00:37:47.700863+0000","last_became_peered":"2024-08-19T00:37:47.700863+0000","last_unstale":"2024-08-19T00:37:48.725196+0000","last_undegraded":"2024-08-19T00:37:48.725196+0000","last_fullsized":"2024-08-19T00:37:48.725196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:17.462649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676229+0000","last_change":"2024-08-19T00:37:46.676308+0000","last_active":"2024-08-19T00:37:48.676229+0000","last_peered":"2024-08-19T00:37:48.676229+0000","last_clean":"2024-08-19T00:37:48.676229+0000","last_became_active":"2024-08-19T00:37:46.674766+0000","last_became_peered":"2024-08-19T00:37:46.674766+0000","last_unstale":"2024-08-19T00:37:48.676229+0000","last_undegraded":"2024-08-19T00:37:48.676229+0000","last_fullsized":"2024-08-19T00:37:48.676229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:16:29.290859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.871144+0000","last_change":"2024-08-19T00:37:47.686863+0000","last_active":"2024-08-19T00:37:48.871144+0000","last_peered":"2024-08-19T00:37:48.871144+0000","last_clean":"2024-08-19T00:37:48.871144+0000","last_became_active":"2024-08-19T00:37:47.686609+0000","last_became_peered":"2024-08-19T00:37:47.686609+0000","last_unstale":"2024-08-19T00:37:48.871144+0000","last_undegraded":"2024-08-19T00:37:48.871144+0000","last_fullsized":"2024-08-19T00:37:48.871144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:04:14.707305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870676+0000","last_change":"2024-08-19T00:37:46.686433+0000","last_active":"2024-08-19T00:37:48.870676+0000","last_peered":"2024-08-19T00:37:48.870676+0000","last_clean":"2024-08-19T00:37:48.870676+0000","last_became_active":"2024-08-19T00:37:46.685774+0000","last_became_peered":"2024-08-19T00:37:46.685774+0000","last_unstale":"2024-08-19T00:37:48.870676+0000","last_undegraded":"2024-08-19T00:37:48.870676+0000","last_fullsized":"2024-08-19T00:37:48.870676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:12:49.176756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868912+0000","last_change":"2024-08-19T00:37:47.690021+0000","last_active":"2024-08-19T00:37:48.868912+0000","last_peered":"2024-08-19T00:37:48.868912+0000","last_clean":"2024-08-19T00:37:48.868912+0000","last_became_active":"2024-08-19T00:37:47.689049+0000","last_became_peered":"2024-08-19T00:37:47.689049+0000","last_unstale":"2024-08-19T00:37:48.868912+0000","last_undegraded":"2024-08-19T00:37:48.868912+0000","last_fullsized":"2024-08-19T00:37:48.868912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:00:21.584440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724891+0000","last_change":"2024-08-19T00:37:46.675184+0000","last_active":"2024-08-19T00:37:48.724891+0000","last_peered":"2024-08-19T00:37:48.724891+0000","last_clean":"2024-08-19T00:37:48.724891+0000","last_became_active":"2024-08-19T00:37:46.674899+0000","last_became_peered":"2024-08-19T00:37:46.674899+0000","last_unstale":"2024-08-19T00:37:48.724891+0000","last_undegraded":"2024-08-19T00:37:48.724891+0000","last_fullsized":"2024-08-19T00:37:48.724891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:54.484342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724888+0000","last_change":"2024-08-19T00:37:47.691524+0000","last_active":"2024-08-19T00:37:48.724888+0000","last_peered":"2024-08-19T00:37:48.724888+0000","last_clean":"2024-08-19T00:37:48.724888+0000","last_became_active":"2024-08-19T00:37:47.691245+0000","last_became_peered":"2024-08-19T00:37:47.691245+0000","last_unstale":"2024-08-19T00:37:48.724888+0000","last_undegraded":"2024-08-19T00:37:48.724888+0000","last_fullsized":"2024-08-19T00:37:48.724888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:39.287532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725258+0000","last_change":"2024-08-19T00:37:46.687267+0000","last_active":"2024-08-19T00:37:48.725258+0000","last_peered":"2024-08-19T00:37:48.725258+0000","last_clean":"2024-08-19T00:37:48.725258+0000","last_became_active":"2024-08-19T00:37:46.686882+0000","last_became_peered":"2024-08-19T00:37:46.686882+0000","last_unstale":"2024-08-19T00:37:48.725258+0000","last_undegraded":"2024-08-19T00:37:48.725258+0000","last_fullsized":"2024-08-19T00:37:48.725258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:45.532725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868889+0000","last_change":"2024-08-19T00:37:47.701859+0000","last_active":"2024-08-19T00:37:48.868889+0000","last_peered":"2024-08-19T00:37:48.868889+0000","last_clean":"2024-08-19T00:37:48.868889+0000","last_became_active":"2024-08-19T00:37:47.690647+0000","last_became_peered":"2024-08-19T00:37:47.690647+0000","last_unstale":"2024-08-19T00:37:48.868889+0000","last_undegraded":"2024-08-19T00:37:48.868889+0000","last_fullsized":"2024-08-19T00:37:48.868889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:55.490271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675333+0000","last_change":"2024-08-19T00:37:46.676233+0000","last_active":"2024-08-19T00:37:48.675333+0000","last_peered":"2024-08-19T00:37:48.675333+0000","last_clean":"2024-08-19T00:37:48.675333+0000","last_became_active":"2024-08-19T00:37:46.675867+0000","last_became_peered":"2024-08-19T00:37:46.675867+0000","last_unstale":"2024-08-19T00:37:48.675333+0000","last_undegraded":"2024-08-19T00:37:48.675333+0000","last_fullsized":"2024-08-19T00:37:48.675333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:38.091770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870216+0000","last_change":"2024-08-19T00:37:47.683416+0000","last_active":"2024-08-19T00:37:48.870216+0000","last_peered":"2024-08-19T00:37:48.870216+0000","last_clean":"2024-08-19T00:37:48.870216+0000","last_became_active":"2024-08-19T00:37:47.683001+0000","last_became_peered":"2024-08-19T00:37:47.683001+0000","last_unstale":"2024-08-19T00:37:48.870216+0000","last_undegraded":"2024-08-19T00:37:48.870216+0000","last_fullsized":"2024-08-19T00:37:48.870216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:51.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724893+0000","last_change":"2024-08-19T00:37:46.688071+0000","last_active":"2024-08-19T00:37:48.724893+0000","last_peered":"2024-08-19T00:37:48.724893+0000","last_clean":"2024-08-19T00:37:48.724893+0000","last_became_active":"2024-08-19T00:37:46.686464+0000","last_became_peered":"2024-08-19T00:37:46.686464+0000","last_unstale":"2024-08-19T00:37:48.724893+0000","last_undegraded":"2024-08-19T00:37:48.724893+0000","last_fullsized":"2024-08-19T00:37:48.724893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:00.812507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674429+0000","last_change":"2024-08-19T00:37:47.681108+0000","last_active":"2024-08-19T00:37:48.674429+0000","last_peered":"2024-08-19T00:37:48.674429+0000","last_clean":"2024-08-19T00:37:48.674429+0000","last_became_active":"2024-08-19T00:37:47.680805+0000","last_became_peered":"2024-08-19T00:37:47.680805+0000","last_unstale":"2024-08-19T00:37:48.674429+0000","last_undegraded":"2024-08-19T00:37:48.674429+0000","last_fullsized":"2024-08-19T00:37:48.674429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:24.081472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676589+0000","last_change":"2024-08-19T00:37:46.682174+0000","last_active":"2024-08-19T00:37:48.676589+0000","last_peered":"2024-08-19T00:37:48.676589+0000","last_clean":"2024-08-19T00:37:48.676589+0000","last_became_active":"2024-08-19T00:37:46.681852+0000","last_became_peered":"2024-08-19T00:37:46.681852+0000","last_unstale":"2024-08-19T00:37:48.676589+0000","last_undegraded":"2024-08-19T00:37:48.676589+0000","last_fullsized":"2024-08-19T00:37:48.676589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:32.947231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870931+0000","last_change":"2024-08-19T00:37:47.700217+0000","last_active":"2024-08-19T00:37:48.870931+0000","last_peered":"2024-08-19T00:37:48.870931+0000","last_clean":"2024-08-19T00:37:48.870931+0000","last_became_active":"2024-08-19T00:37:47.699922+0000","last_became_peered":"2024-08-19T00:37:47.699922+0000","last_unstale":"2024-08-19T00:37:48.870931+0000","last_undegraded":"2024-08-19T00:37:48.870931+0000","last_fullsized":"2024-08-19T00:37:48.870931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:41:17.856088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676385+0000","last_change":"2024-08-19T00:37:46.679294+0000","last_active":"2024-08-19T00:37:48.676385+0000","last_peered":"2024-08-19T00:37:48.676385+0000","last_clean":"2024-08-19T00:37:48.676385+0000","last_became_active":"2024-08-19T00:37:46.678993+0000","last_became_peered":"2024-08-19T00:37:46.678993+0000","last_unstale":"2024-08-19T00:37:48.676385+0000","last_undegraded":"2024-08-19T00:37:48.676385+0000","last_fullsized":"2024-08-19T00:37:48.676385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:26:11.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870687+0000","last_change":"2024-08-19T00:37:47.697433+0000","last_active":"2024-08-19T00:37:48.870687+0000","last_peered":"2024-08-19T00:37:48.870687+0000","last_clean":"2024-08-19T00:37:48.870687+0000","last_became_active":"2024-08-19T00:37:47.686345+0000","last_became_peered":"2024-08-19T00:37:47.686345+0000","last_unstale":"2024-08-19T00:37:48.870687+0000","last_undegraded":"2024-08-19T00:37:48.870687+0000","last_fullsized":"2024-08-19T00:37:48.870687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673981+0000","last_change":"2024-08-19T00:37:46.678221+0000","last_active":"2024-08-19T00:37:48.673981+0000","last_peered":"2024-08-19T00:37:48.673981+0000","last_clean":"2024-08-19T00:37:48.673981+0000","last_became_active":"2024-08-19T00:37:46.677938+0000","last_became_peered":"2024-08-19T00:37:46.677938+0000","last_unstale":"2024-08-19T00:37:48.673981+0000","last_undegraded":"2024-08-19T00:37:48.673981+0000","last_fullsized":"2024-08-19T00:37:48.673981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:24.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673878+0000","last_change":"2024-08-19T00:37:47.688184+0000","last_active":"2024-08-19T00:37:48.673878+0000","last_peered":"2024-08-19T00:37:48.673878+0000","last_clean":"2024-08-19T00:37:48.673878+0000","last_became_active":"2024-08-19T00:37:47.687895+0000","last_became_peered":"2024-08-19T00:37:47.687895+0000","last_unstale":"2024-08-19T00:37:48.673878+0000","last_undegraded":"2024-08-19T00:37:48.673878+0000","last_fullsized":"2024-08-19T00:37:48.673878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:16.217823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870114+0000","last_change":"2024-08-19T00:37:46.684939+0000","last_active":"2024-08-19T00:37:48.870114+0000","last_peered":"2024-08-19T00:37:48.870114+0000","last_clean":"2024-08-19T00:37:48.870114+0000","last_became_active":"2024-08-19T00:37:46.684657+0000","last_became_peered":"2024-08-19T00:37:46.684657+0000","last_unstale":"2024-08-19T00:37:48.870114+0000","last_undegraded":"2024-08-19T00:37:48.870114+0000","last_fullsized":"2024-08-19T00:37:48.870114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:34.203490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869512+0000","last_change":"2024-08-19T00:37:47.678607+0000","last_active":"2024-08-19T00:37:48.869512+0000","last_peered":"2024-08-19T00:37:48.869512+0000","last_clean":"2024-08-19T00:37:48.869512+0000","last_became_active":"2024-08-19T00:37:47.678277+0000","last_became_peered":"2024-08-19T00:37:47.678277+0000","last_unstale":"2024-08-19T00:37:48.869512+0000","last_undegraded":"2024-08-19T00:37:48.869512+0000","last_fullsized":"2024-08-19T00:37:48.869512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:32:42.886700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725065+0000","last_change":"2024-08-19T00:37:46.683784+0000","last_active":"2024-08-19T00:37:48.725065+0000","last_peered":"2024-08-19T00:37:48.725065+0000","last_clean":"2024-08-19T00:37:48.725065+0000","last_became_active":"2024-08-19T00:37:46.683505+0000","last_became_peered":"2024-08-19T00:37:46.683505+0000","last_unstale":"2024-08-19T00:37:48.725065+0000","last_undegraded":"2024-08-19T00:37:48.725065+0000","last_fullsized":"2024-08-19T00:37:48.725065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:34.203490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870610+0000","last_change":"2024-08-19T00:37:47.694716+0000","last_active":"2024-08-19T00:37:48.870610+0000","last_peered":"2024-08-19T00:37:48.870610+0000","last_clean":"2024-08-19T00:37:48.870610+0000","last_became_active":"2024-08-19T00:37:47.693907+0000","last_became_peered":"2024-08-19T00:37:47.693907+0000","last_unstale":"2024-08-19T00:37:48.870610+0000","last_undegraded":"2024-08-19T00:37:48.870610+0000","last_fullsized":"2024-08-19T00:37:48.870610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:01.732570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870353+0000","last_change":"2024-08-19T00:37:46.682589+0000","last_active":"2024-08-19T00:37:48.870353+0000","last_peered":"2024-08-19T00:37:48.870353+0000","last_clean":"2024-08-19T00:37:48.870353+0000","last_became_active":"2024-08-19T00:37:46.682253+0000","last_became_peered":"2024-08-19T00:37:46.682253+0000","last_unstale":"2024-08-19T00:37:48.870353+0000","last_undegraded":"2024-08-19T00:37:48.870353+0000","last_fullsized":"2024-08-19T00:37:48.870353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:26.465784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725172+0000","last_change":"2024-08-19T00:37:47.679538+0000","last_active":"2024-08-19T00:37:48.725172+0000","last_peered":"2024-08-19T00:37:48.725172+0000","last_clean":"2024-08-19T00:37:48.725172+0000","last_became_active":"2024-08-19T00:37:47.679194+0000","last_became_peered":"2024-08-19T00:37:47.679194+0000","last_unstale":"2024-08-19T00:37:48.725172+0000","last_undegraded":"2024-08-19T00:37:48.725172+0000","last_fullsized":"2024-08-19T00:37:48.725172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870028+0000","last_change":"2024-08-19T00:37:46.683047+0000","last_active":"2024-08-19T00:37:48.870028+0000","last_peered":"2024-08-19T00:37:48.870028+0000","last_clean":"2024-08-19T00:37:48.870028+0000","last_became_active":"2024-08-19T00:37:46.682254+0000","last_became_peered":"2024-08-19T00:37:46.682254+0000","last_unstale":"2024-08-19T00:37:48.870028+0000","last_undegraded":"2024-08-19T00:37:48.870028+0000","last_fullsized":"2024-08-19T00:37:48.870028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:17.964073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673479+0000","last_change":"2024-08-19T00:37:47.675940+0000","last_active":"2024-08-19T00:37:48.673479+0000","last_peered":"2024-08-19T00:37:48.673479+0000","last_clean":"2024-08-19T00:37:48.673479+0000","last_became_active":"2024-08-19T00:37:47.674936+0000","last_became_peered":"2024-08-19T00:37:47.674936+0000","last_unstale":"2024-08-19T00:37:48.673479+0000","last_undegraded":"2024-08-19T00:37:48.673479+0000","last_fullsized":"2024-08-19T00:37:48.673479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:19.358957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.675214+0000","last_change":"2024-08-19T00:37:46.672431+0000","last_active":"2024-08-19T00:37:48.675214+0000","last_peered":"2024-08-19T00:37:48.675214+0000","last_clean":"2024-08-19T00:37:48.675214+0000","last_became_active":"2024-08-19T00:37:46.672105+0000","last_became_peered":"2024-08-19T00:37:46.672105+0000","last_unstale":"2024-08-19T00:37:48.675214+0000","last_undegraded":"2024-08-19T00:37:48.675214+0000","last_fullsized":"2024-08-19T00:37:48.675214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:34.970284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674500+0000","last_change":"2024-08-19T00:37:47.695060+0000","last_active":"2024-08-19T00:37:48.674500+0000","last_peered":"2024-08-19T00:37:48.674500+0000","last_clean":"2024-08-19T00:37:48.674500+0000","last_became_active":"2024-08-19T00:37:47.694817+0000","last_became_peered":"2024-08-19T00:37:47.694817+0000","last_unstale":"2024-08-19T00:37:48.674500+0000","last_undegraded":"2024-08-19T00:37:48.674500+0000","last_fullsized":"2024-08-19T00:37:48.674500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:01.273099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676533+0000","last_change":"2024-08-19T00:37:46.684814+0000","last_active":"2024-08-19T00:37:48.676533+0000","last_peered":"2024-08-19T00:37:48.676533+0000","last_clean":"2024-08-19T00:37:48.676533+0000","last_became_active":"2024-08-19T00:37:46.683969+0000","last_became_peered":"2024-08-19T00:37:46.683969+0000","last_unstale":"2024-08-19T00:37:48.676533+0000","last_undegraded":"2024-08-19T00:37:48.676533+0000","last_fullsized":"2024-08-19T00:37:48.676533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:24:18.765715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869241+0000","last_change":"2024-08-19T00:37:47.684038+0000","last_active":"2024-08-19T00:37:48.869241+0000","last_peered":"2024-08-19T00:37:48.869241+0000","last_clean":"2024-08-19T00:37:48.869241+0000","last_became_active":"2024-08-19T00:37:47.683106+0000","last_became_peered":"2024-08-19T00:37:47.683106+0000","last_unstale":"2024-08-19T00:37:48.869241+0000","last_undegraded":"2024-08-19T00:37:48.869241+0000","last_fullsized":"2024-08-19T00:37:48.869241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:18.970002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724864+0000","last_change":"2024-08-19T00:37:46.681515+0000","last_active":"2024-08-19T00:37:48.724864+0000","last_peered":"2024-08-19T00:37:48.724864+0000","last_clean":"2024-08-19T00:37:48.724864+0000","last_became_active":"2024-08-19T00:37:46.681152+0000","last_became_peered":"2024-08-19T00:37:46.681152+0000","last_unstale":"2024-08-19T00:37:48.724864+0000","last_undegraded":"2024-08-19T00:37:48.724864+0000","last_fullsized":"2024-08-19T00:37:48.724864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:55.298585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676077+0000","last_change":"2024-08-19T00:37:47.684158+0000","last_active":"2024-08-19T00:37:48.676077+0000","last_peered":"2024-08-19T00:37:48.676077+0000","last_clean":"2024-08-19T00:37:48.676077+0000","last_became_active":"2024-08-19T00:37:47.683876+0000","last_became_peered":"2024-08-19T00:37:47.683876+0000","last_unstale":"2024-08-19T00:37:48.676077+0000","last_undegraded":"2024-08-19T00:37:48.676077+0000","last_fullsized":"2024-08-19T00:37:48.676077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674225+0000","last_change":"2024-08-19T00:37:46.682263+0000","last_active":"2024-08-19T00:37:48.674225+0000","last_peered":"2024-08-19T00:37:48.674225+0000","last_clean":"2024-08-19T00:37:48.674225+0000","last_became_active":"2024-08-19T00:37:46.681946+0000","last_became_peered":"2024-08-19T00:37:46.681946+0000","last_unstale":"2024-08-19T00:37:48.674225+0000","last_undegraded":"2024-08-19T00:37:48.674225+0000","last_fullsized":"2024-08-19T00:37:48.674225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:50.234269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676067+0000","last_change":"2024-08-19T00:37:47.691085+0000","last_active":"2024-08-19T00:37:48.676067+0000","last_peered":"2024-08-19T00:37:48.676067+0000","last_clean":"2024-08-19T00:37:48.676067+0000","last_became_active":"2024-08-19T00:37:47.690560+0000","last_became_peered":"2024-08-19T00:37:47.690560+0000","last_unstale":"2024-08-19T00:37:48.676067+0000","last_undegraded":"2024-08-19T00:37:48.676067+0000","last_fullsized":"2024-08-19T00:37:48.676067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:18.970002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869706+0000","last_change":"2024-08-19T00:37:46.685050+0000","last_active":"2024-08-19T00:37:48.869706+0000","last_peered":"2024-08-19T00:37:48.869706+0000","last_clean":"2024-08-19T00:37:48.869706+0000","last_became_active":"2024-08-19T00:37:46.684741+0000","last_became_peered":"2024-08-19T00:37:46.684741+0000","last_unstale":"2024-08-19T00:37:48.869706+0000","last_undegraded":"2024-08-19T00:37:48.869706+0000","last_fullsized":"2024-08-19T00:37:48.869706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:59.715293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869696+0000","last_change":"2024-08-19T00:37:47.687131+0000","last_active":"2024-08-19T00:37:48.869696+0000","last_peered":"2024-08-19T00:37:48.869696+0000","last_clean":"2024-08-19T00:37:48.869696+0000","last_became_active":"2024-08-19T00:37:47.686754+0000","last_became_peered":"2024-08-19T00:37:47.686754+0000","last_unstale":"2024-08-19T00:37:48.869696+0000","last_undegraded":"2024-08-19T00:37:48.869696+0000","last_fullsized":"2024-08-19T00:37:48.869696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:00.721222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676592+0000","last_change":"2024-08-19T00:37:46.682463+0000","last_active":"2024-08-19T00:37:48.676592+0000","last_peered":"2024-08-19T00:37:48.676592+0000","last_clean":"2024-08-19T00:37:48.676592+0000","last_became_active":"2024-08-19T00:37:46.682038+0000","last_became_peered":"2024-08-19T00:37:46.682038+0000","last_unstale":"2024-08-19T00:37:48.676592+0000","last_undegraded":"2024-08-19T00:37:48.676592+0000","last_fullsized":"2024-08-19T00:37:48.676592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:10.651599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676740+0000","last_change":"2024-08-19T00:37:47.692859+0000","last_active":"2024-08-19T00:37:48.676740+0000","last_peered":"2024-08-19T00:37:48.676740+0000","last_clean":"2024-08-19T00:37:48.676740+0000","last_became_active":"2024-08-19T00:37:47.692611+0000","last_became_peered":"2024-08-19T00:37:47.692611+0000","last_unstale":"2024-08-19T00:37:48.676740+0000","last_undegraded":"2024-08-19T00:37:48.676740+0000","last_fullsized":"2024-08-19T00:37:48.676740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.725144+0000","last_change":"2024-08-19T00:37:46.676430+0000","last_active":"2024-08-19T00:37:48.725144+0000","last_peered":"2024-08-19T00:37:48.725144+0000","last_clean":"2024-08-19T00:37:48.725144+0000","last_became_active":"2024-08-19T00:37:46.676190+0000","last_became_peered":"2024-08-19T00:37:46.676190+0000","last_unstale":"2024-08-19T00:37:48.725144+0000","last_undegraded":"2024-08-19T00:37:48.725144+0000","last_fullsized":"2024-08-19T00:37:48.725144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:49.781354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870372+0000","last_change":"2024-08-19T00:37:47.694649+0000","last_active":"2024-08-19T00:37:48.870372+0000","last_peered":"2024-08-19T00:37:48.870372+0000","last_clean":"2024-08-19T00:37:48.870372+0000","last_became_active":"2024-08-19T00:37:47.694362+0000","last_became_peered":"2024-08-19T00:37:47.694362+0000","last_unstale":"2024-08-19T00:37:48.870372+0000","last_undegraded":"2024-08-19T00:37:48.870372+0000","last_fullsized":"2024-08-19T00:37:48.870372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:26:12.337052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868989+0000","last_change":"2024-08-19T00:37:46.680931+0000","last_active":"2024-08-19T00:37:48.868989+0000","last_peered":"2024-08-19T00:37:48.868989+0000","last_clean":"2024-08-19T00:37:48.868989+0000","last_became_active":"2024-08-19T00:37:46.680587+0000","last_became_peered":"2024-08-19T00:37:46.680587+0000","last_unstale":"2024-08-19T00:37:48.868989+0000","last_undegraded":"2024-08-19T00:37:48.868989+0000","last_fullsized":"2024-08-19T00:37:48.868989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:59.750305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868908+0000","last_change":"2024-08-19T00:37:47.690795+0000","last_active":"2024-08-19T00:37:48.868908+0000","last_peered":"2024-08-19T00:37:48.868908+0000","last_clean":"2024-08-19T00:37:48.868908+0000","last_became_active":"2024-08-19T00:37:47.690315+0000","last_became_peered":"2024-08-19T00:37:47.690315+0000","last_unstale":"2024-08-19T00:37:48.868908+0000","last_undegraded":"2024-08-19T00:37:48.868908+0000","last_fullsized":"2024-08-19T00:37:48.868908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:35.209419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673521+0000","last_change":"2024-08-19T00:37:46.681392+0000","last_active":"2024-08-19T00:37:48.673521+0000","last_peered":"2024-08-19T00:37:48.673521+0000","last_clean":"2024-08-19T00:37:48.673521+0000","last_became_active":"2024-08-19T00:37:46.681122+0000","last_became_peered":"2024-08-19T00:37:46.681122+0000","last_unstale":"2024-08-19T00:37:48.673521+0000","last_undegraded":"2024-08-19T00:37:48.673521+0000","last_fullsized":"2024-08-19T00:37:48.673521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:38.281603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676707+0000","last_change":"2024-08-19T00:37:47.692979+0000","last_active":"2024-08-19T00:37:48.676707+0000","last_peered":"2024-08-19T00:37:48.676707+0000","last_clean":"2024-08-19T00:37:48.676707+0000","last_became_active":"2024-08-19T00:37:47.692710+0000","last_became_peered":"2024-08-19T00:37:47.692710+0000","last_unstale":"2024-08-19T00:37:48.676707+0000","last_undegraded":"2024-08-19T00:37:48.676707+0000","last_fullsized":"2024-08-19T00:37:48.676707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:27.471713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869799+0000","last_change":"2024-08-19T00:37:46.686650+0000","last_active":"2024-08-19T00:37:48.869799+0000","last_peered":"2024-08-19T00:37:48.869799+0000","last_clean":"2024-08-19T00:37:48.869799+0000","last_became_active":"2024-08-19T00:37:46.686265+0000","last_became_peered":"2024-08-19T00:37:46.686265+0000","last_unstale":"2024-08-19T00:37:48.869799+0000","last_undegraded":"2024-08-19T00:37:48.869799+0000","last_fullsized":"2024-08-19T00:37:48.869799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:43:55.298585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674110+0000","last_change":"2024-08-19T00:37:47.691518+0000","last_active":"2024-08-19T00:37:48.674110+0000","last_peered":"2024-08-19T00:37:48.674110+0000","last_clean":"2024-08-19T00:37:48.674110+0000","last_became_active":"2024-08-19T00:37:47.690575+0000","last_became_peered":"2024-08-19T00:37:47.690575+0000","last_unstale":"2024-08-19T00:37:48.674110+0000","last_undegraded":"2024-08-19T00:37:48.674110+0000","last_fullsized":"2024-08-19T00:37:48.674110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:31:47.203287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.682240+0000","last_change":"2024-08-19T00:37:46.680010+0000","last_active":"2024-08-19T00:37:48.682240+0000","last_peered":"2024-08-19T00:37:48.682240+0000","last_clean":"2024-08-19T00:37:48.682240+0000","last_became_active":"2024-08-19T00:37:46.679672+0000","last_became_peered":"2024-08-19T00:37:46.679672+0000","last_unstale":"2024-08-19T00:37:48.682240+0000","last_undegraded":"2024-08-19T00:37:48.682240+0000","last_fullsized":"2024-08-19T00:37:48.682240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:05:59.994009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.676140+0000","last_change":"2024-08-19T00:37:47.705813+0000","last_active":"2024-08-19T00:37:48.676140+0000","last_peered":"2024-08-19T00:37:48.676140+0000","last_clean":"2024-08-19T00:37:48.676140+0000","last_became_active":"2024-08-19T00:37:47.705523+0000","last_became_peered":"2024-08-19T00:37:47.705523+0000","last_unstale":"2024-08-19T00:37:48.676140+0000","last_undegraded":"2024-08-19T00:37:48.676140+0000","last_fullsized":"2024-08-19T00:37:48.676140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:12:50.182685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870216+0000","last_change":"2024-08-19T00:37:46.676714+0000","last_active":"2024-08-19T00:37:48.870216+0000","last_peered":"2024-08-19T00:37:48.870216+0000","last_clean":"2024-08-19T00:37:48.870216+0000","last_became_active":"2024-08-19T00:37:46.676452+0000","last_became_peered":"2024-08-19T00:37:46.676452+0000","last_unstale":"2024-08-19T00:37:48.870216+0000","last_undegraded":"2024-08-19T00:37:48.870216+0000","last_fullsized":"2024-08-19T00:37:48.870216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:49.781354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869551+0000","last_change":"2024-08-19T00:37:47.693842+0000","last_active":"2024-08-19T00:37:48.869551+0000","last_peered":"2024-08-19T00:37:48.869551+0000","last_clean":"2024-08-19T00:37:48.869551+0000","last_became_active":"2024-08-19T00:37:47.693550+0000","last_became_peered":"2024-08-19T00:37:47.693550+0000","last_unstale":"2024-08-19T00:37:48.869551+0000","last_undegraded":"2024-08-19T00:37:48.869551+0000","last_fullsized":"2024-08-19T00:37:48.869551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:28.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870131+0000","last_change":"2024-08-19T00:37:46.681338+0000","last_active":"2024-08-19T00:37:48.870131+0000","last_peered":"2024-08-19T00:37:48.870131+0000","last_clean":"2024-08-19T00:37:48.870131+0000","last_became_active":"2024-08-19T00:37:46.680197+0000","last_became_peered":"2024-08-19T00:37:46.680197+0000","last_unstale":"2024-08-19T00:37:48.870131+0000","last_undegraded":"2024-08-19T00:37:48.870131+0000","last_fullsized":"2024-08-19T00:37:48.870131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:00:20.578511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.870800+0000","last_change":"2024-08-19T00:37:47.694130+0000","last_active":"2024-08-19T00:37:48.870800+0000","last_peered":"2024-08-19T00:37:48.870800+0000","last_clean":"2024-08-19T00:37:48.870800+0000","last_became_active":"2024-08-19T00:37:47.687374+0000","last_became_peered":"2024-08-19T00:37:47.687374+0000","last_unstale":"2024-08-19T00:37:48.870800+0000","last_undegraded":"2024-08-19T00:37:48.870800+0000","last_fullsized":"2024-08-19T00:37:48.870800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:29.298098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869838+0000","last_change":"2024-08-19T00:37:46.680993+0000","last_active":"2024-08-19T00:37:48.869838+0000","last_peered":"2024-08-19T00:37:48.869838+0000","last_clean":"2024-08-19T00:37:48.869838+0000","last_became_active":"2024-08-19T00:37:46.680733+0000","last_became_peered":"2024-08-19T00:37:46.680733+0000","last_unstale":"2024-08-19T00:37:48.869838+0000","last_undegraded":"2024-08-19T00:37:48.869838+0000","last_fullsized":"2024-08-19T00:37:48.869838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:54.484342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869595+0000","last_change":"2024-08-19T00:37:47.690646+0000","last_active":"2024-08-19T00:37:48.869595+0000","last_peered":"2024-08-19T00:37:48.869595+0000","last_clean":"2024-08-19T00:37:48.869595+0000","last_became_active":"2024-08-19T00:37:47.689486+0000","last_became_peered":"2024-08-19T00:37:47.689486+0000","last_unstale":"2024-08-19T00:37:48.869595+0000","last_undegraded":"2024-08-19T00:37:48.869595+0000","last_fullsized":"2024-08-19T00:37:48.869595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:52:25.016360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.724961+0000","last_change":"2024-08-19T00:37:46.681637+0000","last_active":"2024-08-19T00:37:48.724961+0000","last_peered":"2024-08-19T00:37:48.724961+0000","last_clean":"2024-08-19T00:37:48.724961+0000","last_became_active":"2024-08-19T00:37:46.681338+0000","last_became_peered":"2024-08-19T00:37:46.681338+0000","last_unstale":"2024-08-19T00:37:48.724961+0000","last_undegraded":"2024-08-19T00:37:48.724961+0000","last_fullsized":"2024-08-19T00:37:48.724961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:00:20.578511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.673560+0000","last_change":"2024-08-19T00:37:47.688568+0000","last_active":"2024-08-19T00:37:48.673560+0000","last_peered":"2024-08-19T00:37:48.673560+0000","last_clean":"2024-08-19T00:37:48.673560+0000","last_became_active":"2024-08-19T00:37:47.687457+0000","last_became_peered":"2024-08-19T00:37:47.687457+0000","last_unstale":"2024-08-19T00:37:48.673560+0000","last_undegraded":"2024-08-19T00:37:48.673560+0000","last_fullsized":"2024-08-19T00:37:48.673560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:18:36.554390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869974+0000","last_change":"2024-08-19T00:37:46.681444+0000","last_active":"2024-08-19T00:37:48.869974+0000","last_peered":"2024-08-19T00:37:48.869974+0000","last_clean":"2024-08-19T00:37:48.869974+0000","last_became_active":"2024-08-19T00:37:46.681137+0000","last_became_peered":"2024-08-19T00:37:46.681137+0000","last_unstale":"2024-08-19T00:37:48.869974+0000","last_undegraded":"2024-08-19T00:37:48.869974+0000","last_fullsized":"2024-08-19T00:37:48.869974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:45.532725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.869649+0000","last_change":"2024-08-19T00:37:47.690316+0000","last_active":"2024-08-19T00:37:48.869649+0000","last_peered":"2024-08-19T00:37:48.869649+0000","last_clean":"2024-08-19T00:37:48.869649+0000","last_became_active":"2024-08-19T00:37:47.690008+0000","last_became_peered":"2024-08-19T00:37:47.690008+0000","last_unstale":"2024-08-19T00:37:48.869649+0000","last_undegraded":"2024-08-19T00:37:48.869649+0000","last_fullsized":"2024-08-19T00:37:48.869649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:46.651409+0000","last_clean_scrub_stamp":"2024-08-19T00:37:46.651409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:34.885577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.674293+0000","last_change":"2024-08-19T00:37:46.681554+0000","last_active":"2024-08-19T00:37:48.674293+0000","last_peered":"2024-08-19T00:37:48.674293+0000","last_clean":"2024-08-19T00:37:48.674293+0000","last_became_active":"2024-08-19T00:37:46.681291+0000","last_became_peered":"2024-08-19T00:37:46.681291+0000","last_unstale":"2024-08-19T00:37:48.674293+0000","last_undegraded":"2024-08-19T00:37:48.674293+0000","last_fullsized":"2024-08-19T00:37:48.674293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:37:45.645480+0000","last_clean_scrub_stamp":"2024-08-19T00:37:45.645480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:27.606426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-19T00:37:48.868945+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:37:48.868945+0000","last_peered":"2024-08-19T00:37:48.868945+0000","last_clean":"2024-08-19T00:37:48.868945+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:37:48.868945+0000","last_undegraded":"2024-08-19T00:37:48.868945+0000","last_fullsized":"2024-08-19T00:37:48.868945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":140417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":139581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":138839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":729243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":138895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:37:52.316 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:37:52.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-19T00:37:52.502 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-08-19T00:37:52.501+0000 7fb2fcc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:37:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.515+0000 7fda7b600640 1 Processor -- start 2024-08-19T00:37:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.516+0000 7fda7b600640 1 -- start start 2024-08-19T00:37:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda7b600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fda740b5130 0x7fda740aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda7b600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415c390 0x7fda740af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda7b600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda740acef0 con 0x7fda7415bfb0 2024-08-19T00:37:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda7b600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fda740af650 con 0x7fda740b5130 2024-08-19T00:37:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda7b600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda740ad790 con 0x7fda7415c390 2024-08-19T00:37:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda78c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fda7415bfb0 0x7fda740b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41454/0 (socket says 172.21.15.7:41454) 2024-08-19T00:37:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda78c00640 1 -- 172.21.15.7:0/134558005 learned_addr learned my addr 172.21.15.7:0/134558005 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:52.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.517+0000 7fda79600640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415c390 0x7fda740af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73e00640 1 --2- 172.21.15.7:0/134558005 >> v2:172.21.15.162:3300/0 conn(0x7fda740b5130 0x7fda740aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479479573 0 0) 0x7fda740acef0 con 0x7fda7415bfb0 2024-08-19T00:37:52.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda5c003520 con 0x7fda7415bfb0 2024-08-19T00:37:52.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3657804868 0 0) 0x7fda5c003520 con 0x7fda7415bfb0 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415c390 msgr2=0x7fda740af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415c390 0x7fda740af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 >> v2:172.21.15.162:3300/0 conn(0x7fda740b5130 msgr2=0x7fda740aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 --2- 172.21.15.7:0/134558005 >> v2:172.21.15.162:3300/0 conn(0x7fda740b5130 0x7fda740aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda740ad1d0 con 0x7fda7415bfb0 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fda68001670 con 0x7fda7415bfb0 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 >> v1:172.21.15.7:6789/0 conn(0x7fda7415bfb0 legacy=0x7fda740b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda5c0039b0 0x7fda5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c004800 0x7fda5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0051c0 0x7fda5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda740af650 con 0x7fda5c0039b0 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda740ad790 con 0x7fda5c0051c0 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda5c00bf00 con 0x7fda5c004800 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda73e00640 1 --2- 172.21.15.7:0/134558005 >> v2:172.21.15.162:3300/0 conn(0x7fda740b5130 0x7fda740aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda79600640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415c390 0x7fda740af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.518+0000 7fda78c00640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda5c0039b0 0x7fda5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda73e00640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c004800 0x7fda5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda79600640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0051c0 0x7fda5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda78c00640 1 -- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c004800 msgr2=0x7fda5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda78c00640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c004800 0x7fda5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda78c00640 1 -- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0051c0 msgr2=0x7fda5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda78c00640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0051c0 0x7fda5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda78c00640 1 -- 172.21.15.7:0/134558005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c003520 con 0x7fda5c0039b0 2024-08-19T00:37:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.519+0000 7fda79600640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0051c0 0x7fda5c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:52.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.520+0000 7fda78c00640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda5c0039b0 0x7fda5c003dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c190 tx=0x7fda5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9fd307c33296fa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.520+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68007c60 con 0x7fda5c0039b0 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.520+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda68005af0 con 0x7fda5c0039b0 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.520+0000 7fda73400640 1 -- 172.21.15.7:0/134558005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68007070 con 0x7fda5c0039b0 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.521+0000 7fda7b600640 1 -- 172.21.15.7:0/134558005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda5c0039b0 msgr2=0x7fda5c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.521+0000 7fda7b600640 1 --2- 172.21.15.7:0/134558005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda5c0039b0 0x7fda5c003dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c190 tx=0x7fda5c005830 comp rx=0 tx=0).stop 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.521+0000 7fda79600640 1 -- 172.21.15.7:0/134558005 reap_dead start 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.521+0000 7fda7b600640 1 -- 172.21.15.7:0/134558005 shutdown_connections 2024-08-19T00:37:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.521+0000 7fda7b600640 1 -- 172.21.15.7:0/134558005 >> 172.21.15.7:0/134558005 conn(0x7fda740b2300 msgr2=0x7fda7406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.521+0000 7fda7b600640 1 -- 172.21.15.7:0/134558005 shutdown_connections 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.521+0000 7fda7b600640 1 -- 172.21.15.7:0/134558005 wait complete. 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.522+0000 7fda7b600640 1 Processor -- start 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.523+0000 7fda7b600640 1 -- start start 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.523+0000 7fda7b600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c0039b0 0x7fda74158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.523+0000 7fda7b600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda740cecc0 0x7fda74155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.523+0000 7fda7b600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda740cf140 0x7fda741559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda7b600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda740af110 con 0x7fda740cf140 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda7b600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda74071b20 con 0x7fda740cecc0 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda7b600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda740af290 con 0x7fda5c0039b0 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda740cf140 0x7fda741559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda740cf140 0x7fda741559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56364/0 (socket says 172.21.15.7:56364) 2024-08-19T00:37:52.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 -- 172.21.15.7:0/4078236172 learned_addr learned my addr 172.21.15.7:0/4078236172 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda78c00640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c0039b0 0x7fda74158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda73e00640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda740cecc0 0x7fda74155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 -- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c0039b0 msgr2=0x7fda74158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c0039b0 0x7fda74158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 -- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda740cecc0 msgr2=0x7fda74155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda740cecc0 0x7fda74155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.524+0000 7fda79600640 1 -- 172.21.15.7:0/4078236172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda740c9670 con 0x7fda740cf140 2024-08-19T00:37:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.525+0000 7fda79600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda740cf140 0x7fda741559b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fda7415fbb0 tx=0x7fda6c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.525+0000 7fda70c00640 1 -- 172.21.15.7:0/4078236172 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c003990 con 0x7fda740cf140 2024-08-19T00:37:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.525+0000 7fda70c00640 1 -- 172.21.15.7:0/4078236172 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c01b070 con 0x7fda740cf140 2024-08-19T00:37:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.525+0000 7fda70c00640 1 -- 172.21.15.7:0/4078236172 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c003b30 con 0x7fda740cf140 2024-08-19T00:37:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.525+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda740c9950 con 0x7fda740cf140 2024-08-19T00:37:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.525+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda740c9f10 con 0x7fda740cf140 2024-08-19T00:37:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.526+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda740aebd0 con 0x7fda740cf140 2024-08-19T00:37:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.527+0000 7fda70c00640 1 -- 172.21.15.7:0/4078236172 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda6c005d10 con 0x7fda740cf140 2024-08-19T00:37:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.528+0000 7fda70c00640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda5406be30 0x7fda5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.529+0000 7fda70c00640 1 -- 172.21.15.7:0/4078236172 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fda6c08b580 con 0x7fda740cf140 2024-08-19T00:37:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.529+0000 7fda78c00640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda5406be30 0x7fda5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.529+0000 7fda78c00640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda5406be30 0x7fda5406e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda68032000 tx=0x7fda68034040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.533+0000 7fda70c00640 1 -- 172.21.15.7:0/4078236172 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fda6c025020 con 0x7fda740cf140 2024-08-19T00:37:52.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.789+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fda74157860 con 0x7fda740cf140 2024-08-19T00:37:52.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.792+0000 7fda70c00640 1 -- 172.21.15.7:0/4078236172 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fda6c0598d0 con 0x7fda740cf140 2024-08-19T00:37:52.794 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-08-19T00:37:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:37:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-08-19T00:37:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-08-19T00:37:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-19T00:37:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-08-19T00:37:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda5406be30 msgr2=0x7fda5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda5406be30 0x7fda5406e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda68032000 tx=0x7fda68034040 comp rx=0 tx=0).stop 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda740cf140 msgr2=0x7fda741559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda740cf140 0x7fda741559b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fda7415fbb0 tx=0x7fda6c0115a0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 shutdown_connections 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda5406be30 0x7fda5406e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda740cf140 0x7fda741559b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda740cecc0 0x7fda74155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 --2- 172.21.15.7:0/4078236172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c0039b0 0x7fda74158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 >> 172.21.15.7:0/4078236172 conn(0x7fda740b2300 msgr2=0x7fda740b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 shutdown_connections 2024-08-19T00:37:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.795+0000 7fda7b600640 1 -- 172.21.15.7:0/4078236172 wait complete. 2024-08-19T00:37:52.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:52.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.967+0000 7f45a0c00640 1 Processor -- start 2024-08-19T00:37:52.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.967+0000 7f45a0c00640 1 -- start start 2024-08-19T00:37:52.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.968+0000 7f45a0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f459c0d03c0 0x7f459c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.968+0000 7f45a0c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.968+0000 7f45a0c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f459c0b3750 0x7f459c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.968+0000 7f45a0c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f459c0cebc0 con 0x7f459c0d03c0 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.968+0000 7f45a0c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f459c0d0ce0 con 0x7f459c0b3750 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.968+0000 7f45a0c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f459c0cdfb0 con 0x7f459c06e710 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.968+0000 7f4599e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f459c0d03c0 0x7f459c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f459c0d03c0 0x7f459c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56370/0 (socket says 172.21.15.7:56370) 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599e00640 1 -- 172.21.15.7:0/3614878948 learned_addr learned my addr 172.21.15.7:0/3614878948 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f459a800640 1 --2- 172.21.15.7:0/3614878948 >> v2:172.21.15.162:3300/0 conn(0x7f459c0b3750 0x7f459c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599400640 1 --2- 172.21.15.7:0/3614878948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599e00640 1 -- 172.21.15.7:0/3614878948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 msgr2=0x7f459c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599e00640 1 --2- 172.21.15.7:0/3614878948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599e00640 1 -- 172.21.15.7:0/3614878948 >> v2:172.21.15.162:3300/0 conn(0x7f459c0b3750 msgr2=0x7f459c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599e00640 1 --2- 172.21.15.7:0/3614878948 >> v2:172.21.15.162:3300/0 conn(0x7f459c0b3750 0x7f459c0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599e00640 1 -- 172.21.15.7:0/3614878948 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c0ce290 con 0x7f459c0d03c0 2024-08-19T00:37:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f459a800640 1 --2- 172.21.15.7:0/3614878948 >> v2:172.21.15.162:3300/0 conn(0x7f459c0b3750 0x7f459c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.969+0000 7f4599400640 1 --2- 172.21.15.7:0/3614878948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:52.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.970+0000 7f4599e00640 1 --2- 172.21.15.7:0/3614878948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0d03c0 0x7f459c071980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f459c09e320 tx=0x7f458c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e421f21b536ebe server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.970+0000 7f4598a00640 1 -- 172.21.15.7:0/3614878948 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c032790 con 0x7f459c0d03c0 2024-08-19T00:37:52.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.970+0000 7f4598a00640 1 -- 172.21.15.7:0/3614878948 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c038070 con 0x7f459c0d03c0 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.970+0000 7f4598a00640 1 -- 172.21.15.7:0/3614878948 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c032b50 con 0x7f459c0d03c0 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 -- 172.21.15.7:0/3614878948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0d03c0 msgr2=0x7f459c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 --2- 172.21.15.7:0/3614878948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0d03c0 0x7f459c071980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f459c09e320 tx=0x7f458c02c890 comp rx=0 tx=0).stop 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 -- 172.21.15.7:0/3614878948 shutdown_connections 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 --2- 172.21.15.7:0/3614878948 >> v2:172.21.15.162:3300/0 conn(0x7f459c0b3750 0x7f459c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 --2- 172.21.15.7:0/3614878948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 --2- 172.21.15.7:0/3614878948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0d03c0 0x7f459c071980 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 -- 172.21.15.7:0/3614878948 >> 172.21.15.7:0/3614878948 conn(0x7f459c06bc70 msgr2=0x7f459c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 -- 172.21.15.7:0/3614878948 shutdown_connections 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.971+0000 7f45a0c00640 1 -- 172.21.15.7:0/3614878948 wait complete. 2024-08-19T00:37:52.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.973+0000 7f45a0c00640 1 Processor -- start 2024-08-19T00:37:52.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.973+0000 7f45a0c00640 1 -- start start 2024-08-19T00:37:52.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.973+0000 7f45a0c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f45a0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0b3750 0x7f459c155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f45a0c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f459c0d03c0 0x7f459c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f45a0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f459c073ae0 con 0x7f459c0b3750 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f45a0c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f459c0ce850 con 0x7f459c0d03c0 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f45a0c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f459c073c60 con 0x7f459c06e710 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0b3750 0x7f459c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0b3750 0x7f459c155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56378/0 (socket says 172.21.15.7:56378) 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 -- 172.21.15.7:0/4006137051 learned_addr learned my addr 172.21.15.7:0/4006137051 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599e00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f459a800640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f459c0d03c0 0x7f459c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 -- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 msgr2=0x7f459c15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 -- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f459c0d03c0 msgr2=0x7f459c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f459c0d03c0 0x7f459c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f4599400640 1 -- 172.21.15.7:0/4006137051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c1546f0 con 0x7f459c0b3750 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.974+0000 7f459a800640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f459c0d03c0 0x7f459c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.975+0000 7f4599400640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0b3750 0x7f459c155790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f458800c7f0 tx=0x7f458800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.975+0000 7f4592000640 1 -- 172.21.15.7:0/4006137051 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588015070 con 0x7f459c0b3750 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.975+0000 7f4592000640 1 -- 172.21.15.7:0/4006137051 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4588007820 con 0x7f459c0b3750 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.975+0000 7f4592000640 1 -- 172.21.15.7:0/4006137051 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588007c10 con 0x7f459c0b3750 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.975+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c1549d0 con 0x7f459c0b3750 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.975+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c154f90 con 0x7f459c0b3750 2024-08-19T00:37:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.976+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459c0b3be0 con 0x7f459c0b3750 2024-08-19T00:37:52.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.977+0000 7f4592000640 1 -- 172.21.15.7:0/4006137051 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4588018070 con 0x7f459c0b3750 2024-08-19T00:37:52.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.978+0000 7f4592000640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f457c06be30 0x7f457c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:52.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.978+0000 7f4592000640 1 -- 172.21.15.7:0/4006137051 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f458808b0a0 con 0x7f459c0b3750 2024-08-19T00:37:52.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.978+0000 7f4599e00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f457c06be30 0x7f457c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:52.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.979+0000 7f4599e00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f457c06be30 0x7f457c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f458c037000 tx=0x7f458c03e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:52.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:52.982+0000 7f4592000640 1 -- 172.21.15.7:0/4006137051 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4588059930 con 0x7f459c0b3750 2024-08-19T00:37:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.200+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f459c0b06a0 con 0x7f459c0b3750 2024-08-19T00:37:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.201+0000 7f4592000640 1 -- 172.21.15.7:0/4006137051 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f4588059230 con 0x7f459c0b3750 2024-08-19T00:37:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:53.203 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"btime":"2024-08-19T00:37:50:684047+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:37:50.105814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4577":{"gid":4577,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6835/1856893937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1856893937},{"type":"v1","addr":"172.21.15.162:6835","nonce":1856893937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4577,"qdb_cluster":[4577]},"id":2}]} 2024-08-19T00:37:53.203 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 16 2024-08-19T00:37:53.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f457c06be30 msgr2=0x7f457c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f457c06be30 0x7f457c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f458c037000 tx=0x7f458c03e040 comp rx=0 tx=0).stop 2024-08-19T00:37:53.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0b3750 msgr2=0x7f459c155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0b3750 0x7f459c155790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f458800c7f0 tx=0x7f458800ccb0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 shutdown_connections 2024-08-19T00:37:53.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f457c06be30 0x7f457c06e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f459c0d03c0 0x7f459c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f459c0b3750 0x7f459c155790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 --2- 172.21.15.7:0/4006137051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f459c06e710 0x7f459c15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 >> 172.21.15.7:0/4006137051 conn(0x7f459c06bc70 msgr2=0x7f459c0b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:53.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 shutdown_connections 2024-08-19T00:37:53.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.203+0000 7f45a0c00640 1 -- 172.21.15.7:0/4006137051 wait complete. 2024-08-19T00:37:53.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:37:47.095917+0000', 'modified': '2024-08-19T00:37:50.105814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4577}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4577': {'gid': 4577, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6835/1856893937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6833', 'nonce': 1856893937}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 1856893937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4577, 'qdb_cluster': [4577]} 2024-08-19T00:37:53.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:37:53.625 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-19T00:37:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.782+0000 7fd409200640 1 Processor -- start 2024-08-19T00:37:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.783+0000 7fd409200640 1 -- start start 2024-08-19T00:37:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd409200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd404159bf0 0x7fd404073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd409200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40406f7f0 con 0x7fd4040cec10 2024-08-19T00:37:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd409200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40406f510 con 0x7fd4040739a0 2024-08-19T00:37:53.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd409200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd404072980 con 0x7fd404159bf0 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd402800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd4040cec10 0x7fd4040d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41456/0 (socket says 172.21.15.7:41456) 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd402800640 1 -- 172.21.15.7:0/1136893529 learned_addr learned my addr 172.21.15.7:0/1136893529 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd401e00640 1 --2- 172.21.15.7:0/1136893529 >> v2:172.21.15.162:3300/0 conn(0x7fd404159bf0 0x7fd404073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985719869 0 0) 0x7fd40406f7f0 con 0x7fd4040cec10 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.784+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e8003520 con 0x7fd4040cec10 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.785+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255087545 0 0) 0x7fd40406f510 con 0x7fd4040739a0 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.785+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd40406f7f0 con 0x7fd4040739a0 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.785+0000 7fd401e00640 1 -- 172.21.15.7:0/1136893529 >> v1:172.21.15.162:6789/0 conn(0x7fd4040739a0 legacy=0x7fd4040ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.785+0000 7fd401e00640 1 -- 172.21.15.7:0/1136893529 >> v1:172.21.15.7:6789/0 conn(0x7fd4040cec10 legacy=0x7fd4040d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.785+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1662576658 0 0) 0x7fd3e8003520 con 0x7fd4040cec10 2024-08-19T00:37:53.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.785+0000 7fd401e00640 1 -- 172.21.15.7:0/1136893529 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd404072c60 con 0x7fd404159bf0 2024-08-19T00:37:53.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.786+0000 7fd401e00640 1 --2- 172.21.15.7:0/1136893529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd404159bf0 0x7fd404073460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40097a0 tx=0x7fd3f402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d5e6cefcf0bb3bf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:53.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.786+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4037070 con 0x7fd404159bf0 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.786+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f402abc0 con 0x7fd404159bf0 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.786+0000 7fd401400640 1 -- 172.21.15.7:0/1136893529 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0019f0 con 0x7fd404159bf0 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.787+0000 7fd409200640 1 -- 172.21.15.7:0/1136893529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd404159bf0 msgr2=0x7fd404073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.787+0000 7fd409200640 1 --2- 172.21.15.7:0/1136893529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd404159bf0 0x7fd404073460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40097a0 tx=0x7fd3f402a130 comp rx=0 tx=0).stop 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.787+0000 7fd409200640 1 -- 172.21.15.7:0/1136893529 shutdown_connections 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.787+0000 7fd409200640 1 --2- 172.21.15.7:0/1136893529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd404159bf0 0x7fd404073460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.787+0000 7fd409200640 1 -- 172.21.15.7:0/1136893529 >> 172.21.15.7:0/1136893529 conn(0x7fd40406bc70 msgr2=0x7fd40406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.787+0000 7fd409200640 1 -- 172.21.15.7:0/1136893529 shutdown_connections 2024-08-19T00:37:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.787+0000 7fd409200640 1 -- 172.21.15.7:0/1136893529 wait complete. 2024-08-19T00:37:53.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.788+0000 7fd409200640 1 Processor -- start 2024-08-19T00:37:53.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.789+0000 7fd409200640 1 -- start start 2024-08-19T00:37:53.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.789+0000 7fd409200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4040739a0 0x7fd404099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.789+0000 7fd409200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd404159bf0 0x7fd4041501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.789+0000 7fd409200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd40414f900 0x7fd404150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.789+0000 7fd409200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd40415a150 con 0x7fd40414f900 2024-08-19T00:37:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.789+0000 7fd409200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd404159fd0 con 0x7fd4040739a0 2024-08-19T00:37:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.789+0000 7fd409200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4040d0ad0 con 0x7fd404159bf0 2024-08-19T00:37:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd40414f900 0x7fd404150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd40414f900 0x7fd404150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56382/0 (socket says 172.21.15.7:56382) 2024-08-19T00:37:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 -- 172.21.15.7:0/1557870822 learned_addr learned my addr 172.21.15.7:0/1557870822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd401e00640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4040739a0 0x7fd404099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd404159bf0 0x7fd4041501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 -- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd404159bf0 msgr2=0x7fd4041501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd404159bf0 0x7fd4041501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 -- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4040739a0 msgr2=0x7fd404099b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4040739a0 0x7fd404099b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 -- 172.21.15.7:0/1557870822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd404152080 con 0x7fd40414f900 2024-08-19T00:37:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.790+0000 7fd402800640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd40414f900 0x7fd404150700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00cc40 tx=0x7fd3fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.791+0000 7fd3fa000640 1 -- 172.21.15.7:0/1557870822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc017070 con 0x7fd40414f900 2024-08-19T00:37:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.791+0000 7fd3fa000640 1 -- 172.21.15.7:0/1557870822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00ce50 con 0x7fd40414f900 2024-08-19T00:37:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.791+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd404152360 con 0x7fd40414f900 2024-08-19T00:37:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.791+0000 7fd3fa000640 1 -- 172.21.15.7:0/1557870822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc012640 con 0x7fd40414f900 2024-08-19T00:37:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.791+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd404152920 con 0x7fd40414f900 2024-08-19T00:37:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.794+0000 7fd3fa000640 1 -- 172.21.15.7:0/1557870822 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3fc01a070 con 0x7fd40414f900 2024-08-19T00:37:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.795+0000 7fd3fa000640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3e006be30 0x7fd3e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.795+0000 7fd40c23a740 1 Processor -- start 2024-08-19T00:37:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.795+0000 7fd3fa000640 1 -- 172.21.15.7:0/1557870822 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd3fc08ae90 con 0x7fd40414f900 2024-08-19T00:37:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.795+0000 7fd40c23a740 1 -- start start 2024-08-19T00:37:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.795+0000 7fd401e00640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3e006be30 0x7fd3e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.796+0000 7fd401e00640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3e006be30 0x7fd3e006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4034000 tx=0x7fd3f402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.796+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.796+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.796+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.796+0000 7fd40c23a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e7bc5dbba0 con 0x55e7bc6a2f50 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.796+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e7bc574230 con 0x55e7bc6c6470 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.796+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e7bc5d7b60 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56384/0 (socket says 172.21.15.7:56384) 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 -- 172.21.15.7:0/1683943597 learned_addr learned my addr 172.21.15.7:0/1683943597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd402800640 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 -- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 msgr2=0x55e7bc6bbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6bbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 -- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 msgr2=0x55e7bc6c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.797+0000 7fd401e00640 1 -- 172.21.15.7:0/1683943597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bc5a5bb0 con 0x55e7bc6a2f50 2024-08-19T00:37:53.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.798+0000 7fd401e00640 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6a3330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009890 tx=0x7fd3f402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9a33ff23308d63 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:53.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.798+0000 7fd3f2a00640 1 -- 172.21.15.7:0/1683943597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f404d070 con 0x55e7bc6a2f50 2024-08-19T00:37:53.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.798+0000 7fd3f2a00640 1 -- 172.21.15.7:0/1683943597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f403fbb0 con 0x55e7bc6a2f50 2024-08-19T00:37:53.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.798+0000 7fd3f2a00640 1 -- 172.21.15.7:0/1683943597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4037040 con 0x55e7bc6a2f50 2024-08-19T00:37:53.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.798+0000 7fd40c23a740 1 -- 172.21.15.7:0/1683943597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6a2f50 msgr2=0x55e7bc6a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.798+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6a3330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009890 tx=0x7fd3f402c000 comp rx=0 tx=0).stop 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 -- 172.21.15.7:0/1683943597 shutdown_connections 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6bbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1683943597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6a3330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 -- 172.21.15.7:0/1683943597 >> 172.21.15.7:0/1683943597 conn(0x55e7bc640110 msgr2=0x55e7bc6bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 -- 172.21.15.7:0/1683943597 shutdown_connections 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 -- 172.21.15.7:0/1683943597 wait complete. 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.799+0000 7fd40c23a740 1 -- start start 2024-08-19T00:37:53.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.800+0000 7fd40c23a740 1 Processor -- start 2024-08-19T00:37:53.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.800+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc6b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd40c23a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e7bc6bfea0 con 0x55e7bc6c6470 2024-08-19T00:37:53.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e7bc597250 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e7bc6bf5b0 con 0x55e7bc6a2f50 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd40c23a740 10 client.0 _ll_register_callbacks cb 0x55e7bc59b740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6bcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56390/0 (socket says 172.21.15.7:56390) 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 -- 172.21.15.7:0/582315106 learned_addr learned my addr 172.21.15.7:0/582315106 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd401e00640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc6b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd402800640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 -- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 msgr2=0x55e7bc6b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc6b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 -- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6dd0 msgr2=0x55e7bc6bd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6bd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd3fbe00640 1 -- 172.21.15.7:0/582315106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bc2ef2d0 con 0x55e7bc6c6470 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.801+0000 7fd401e00640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc6b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:53.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6bcd70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec003aa0 tx=0x7fd3ec003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbae83f50e2103e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd3e7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd3e7400640 1 -- 172.21.15.7:0/582315106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec001b50 con 0x55e7bc6c6470 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3f403fbb0 con 0x55e7bc6c6470 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd3e7400640 1 -- 172.21.15.7:0/582315106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd3ec014400 con 0x55e7bc6c6470 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd3e7400640 1 -- 172.21.15.7:0/582315106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd3ec001cf0 con 0x55e7bc6c6470 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd40c23a740 10 client.4920 fetch_fsmap learned FSMap version 16 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55e7bc3b96b0 con 0x55e7bc6c6470 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.802+0000 7fd3e7400640 1 -- 172.21.15.7:0/582315106 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f403fbb0 con 0x55e7bc6c6470 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd3e7400640 1 -- 172.21.15.7:0/582315106 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fd3ec024080 con 0x55e7bc6c6470 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd40c23a740 10 client.4920 fetch_fsmap finished waiting for FSMap version 16 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd40c23a740 10 client.4920 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd40c23a740 20 client.4920 populate_metadata read hostname 'smithi007' 2024-08-19T00:37:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd40c23a740 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b9550 0x55e7bc6b9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd40c23a740 4 client.4920 mds_command: new command op to 4577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:37:53.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 --> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7bc5e92d0 con 0x55e7bc6b9550 2024-08-19T00:37:53.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.803+0000 7fd401e00640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b9550 0x55e7bc6b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.804+0000 7fd401e00640 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b9550 0x55e7bc6b9930 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9016aae54002b2f server_cookie=19dc8b70551b3c33 in_seq=0 out_seq=0 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.804+0000 7fd3e7400640 10 client.4920 ms_handle_connect on v2:172.21.15.162:6833/1856893937 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd3e7400640 1 -- 172.21.15.7:0/582315106 <== mds.0 v2:172.21.15.162:6833/1856893937 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7bc5e92d0 con 0x55e7bc6b9550 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd3e7400640 10 client.4920 handle_command_reply: tid=0 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 client.4920 shutdown 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 msgr2=0x55e7bc6bcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6bcd70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec003aa0 tx=0x7fd3ec003f60 comp rx=0 tx=0).stop 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 shutdown_connections 2024-08-19T00:37:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b9550 0x55e7bc6b9930 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6bd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6bcd70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 --2- 172.21.15.7:0/582315106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc6b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 >> 172.21.15.7:0/582315106 conn(0x55e7bc640110 msgr2=0x55e7bc6bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.805+0000 7fd3e7400640 0 client.4920 ms_handle_reset on v2:172.21.15.162:6833/1856893937 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.806+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 shutdown_connections 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.806+0000 7fd40c23a740 1 -- 172.21.15.7:0/582315106 wait complete. 2024-08-19T00:37:53.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.806+0000 7fd40c23a740 20 client.4920 trim_cache size 0 max 16384 2024-08-19T00:37:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.824+0000 7fd40c23a740 1 Processor -- start 2024-08-19T00:37:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.824+0000 7fd40c23a740 1 -- start start 2024-08-19T00:37:53.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc67a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6e55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd40c23a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040b4460 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd40413ee80 con 0x55e7bc6c6470 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4041550c0 con 0x55e7bc6a2f50 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd402800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6e55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd402800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6e55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51590/0 (socket says 172.21.15.7:51590) 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.825+0000 7fd402800640 1 -- 172.21.15.7:0/1572197919 learned_addr learned my addr 172.21.15.7:0/1572197919 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd401e00640 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc67a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd402800640 1 -- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 msgr2=0x55e7bc67a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd402800640 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc67a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd402800640 1 -- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 msgr2=0x55e7bc6b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd402800640 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd402800640 1 -- 172.21.15.7:0/1572197919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bc6b5690 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd402800640 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6e55c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc089320 tx=0x7fd3fc0591e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef3f29787a8abd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd3f2000640 1 -- 172.21.15.7:0/1572197919 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc089430 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd3f2000640 1 -- 172.21.15.7:0/1572197919 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3fc05d110 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.826+0000 7fd3f2000640 1 -- 172.21.15.7:0/1572197919 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0617f0 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 -- 172.21.15.7:0/1572197919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6dd0 msgr2=0x55e7bc6e55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6e55c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc089320 tx=0x7fd3fc0591e0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 -- 172.21.15.7:0/1572197919 shutdown_connections 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6dd0 0x55e7bc6e55c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1572197919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6a2f50 0x55e7bc67a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 -- 172.21.15.7:0/1572197919 >> 172.21.15.7:0/1572197919 conn(0x55e7bc640110 msgr2=0x55e7bc6bd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 -- 172.21.15.7:0/1572197919 shutdown_connections 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 -- 172.21.15.7:0/1572197919 wait complete. 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.827+0000 7fd40c23a740 1 -- start start 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.828+0000 7fd40c23a740 1 Processor -- start 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6b7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd40c23a740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd40c23a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e7bc6b5b40 con 0x55e7bc6c6470 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e7bc677650 con 0x55e7bc6a2f50 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd40c23a740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e7bc677e50 con 0x55e7bc6c6dd0 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd40c23a740 10 client.0 _ll_register_callbacks cb 0x7fd3ec007dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51604/0 (socket says 172.21.15.7:51604) 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 -- 172.21.15.7:0/1662556006 learned_addr learned my addr 172.21.15.7:0/1662556006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd401e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd402800640 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 -- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 msgr2=0x55e7bc6b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 -- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6a2f50 msgr2=0x55e7bc6b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.829+0000 7fd3fbe00640 1 -- 172.21.15.7:0/1662556006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bc6b6490 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd3fbe00640 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b7c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec016df0 tx=0x7fd3ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c59f2eab94fde42 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd3e7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd3e7400640 1 -- 172.21.15.7:0/1662556006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec031060 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd3e7400640 1 -- 172.21.15.7:0/1662556006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd3ec014400 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3fc05d110 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd3e7400640 1 -- 172.21.15.7:0/1662556006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd3ec037050 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd40c23a740 10 client.4926 fetch_fsmap learned FSMap version 16 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55e7bc6d49b0 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.830+0000 7fd3e7400640 1 -- 172.21.15.7:0/1662556006 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3fc05d110 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd3e7400640 1 -- 172.21.15.7:0/1662556006 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fd3ec03a020 con 0x55e7bc6c6470 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd40c23a740 10 client.4926 fetch_fsmap finished waiting for FSMap version 16 2024-08-19T00:37:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd40c23a740 10 client.4926 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:37:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd40c23a740 20 client.4926 populate_metadata read hostname 'smithi007' 2024-08-19T00:37:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b8390 0x55e7bc6b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd40c23a740 4 client.4926 mds_command: new command op to 4577 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:37:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 --> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] -- command(tid 0: {"prefix": "status"}) -- 0x55e7bc6bec80 con 0x55e7bc6b8390 2024-08-19T00:37:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.831+0000 7fd401e00640 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b8390 0x55e7bc6b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd401e00640 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b8390 0x55e7bc6b8770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9603bc1ac658963a server_cookie=4c14cbf4a26266d0 in_seq=0 out_seq=0 2024-08-19T00:37:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd3e7400640 10 client.4926 ms_handle_connect on v2:172.21.15.162:6833/1856893937 2024-08-19T00:37:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd3e7400640 1 -- 172.21.15.7:0/1662556006 <== mds.0 v2:172.21.15.162:6833/1856893937 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55e7bc6bec80 con 0x55e7bc6b8390 2024-08-19T00:37:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd3e7400640 10 client.4926 handle_command_reply: tid=0 2024-08-19T00:37:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 client.4926 shutdown 2024-08-19T00:37:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 msgr2=0x55e7bc6b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b7c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec016df0 tx=0x7fd3ec000ed0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 shutdown_connections 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e7bc6c6dd0 0x55e7bc6b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e7bc6c6470 0x55e7bc6b7c80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:6833/1856893937,v1:172.21.15.162:6835/1856893937] conn(0x55e7bc6b8390 0x55e7bc6b8770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 --2- 172.21.15.7:0/1662556006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7bc6a2f50 0x55e7bc6b7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 >> 172.21.15.7:0/1662556006 conn(0x55e7bc640110 msgr2=0x55e7bc6937a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd3e7400640 0 client.4926 ms_handle_reset on v2:172.21.15.162:6833/1856893937 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 shutdown_connections 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 1 -- 172.21.15.7:0/1662556006 wait complete. 2024-08-19T00:37:53.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.832+0000 7fd40c23a740 20 client.4926 trim_cache size 0 max 16384 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4577, 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.1595615300000004, 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 16, 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 32, 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 32, 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 13.125945836 2024-08-19T00:37:53.840 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:37:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3e006be30 msgr2=0x7fd3e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3e006be30 0x7fd3e006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4034000 tx=0x7fd3f402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd40414f900 msgr2=0x7fd404150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd40414f900 0x7fd404150700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00cc40 tx=0x7fd3fc00a430 comp rx=0 tx=0).stop 2024-08-19T00:37:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 shutdown_connections 2024-08-19T00:37:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3e006be30 0x7fd3e006e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd40414f900 0x7fd404150700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd404159bf0 0x7fd4041501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 --2- 172.21.15.7:0/1557870822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4040739a0 0x7fd404099b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 >> 172.21.15.7:0/1557870822 conn(0x7fd40406bc70 msgr2=0x7fd40415d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 shutdown_connections 2024-08-19T00:37:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:53.833+0000 7fd409200640 1 -- 172.21.15.7:0/1557870822 wait complete. 2024-08-19T00:37:53.851 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:37:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.004+0000 7f8d2d000640 1 Processor -- start 2024-08-19T00:37:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.005+0000 7f8d2d000640 1 -- start start 2024-08-19T00:37:54.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d2d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d280ce500 0x7f8d280ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d2d000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d2806f7f0 con 0x7f8d280d03c0 2024-08-19T00:37:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d2d000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d2806f510 con 0x7f8d28159bf0 2024-08-19T00:37:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d2d000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8d28072980 con 0x7f8d280ce500 2024-08-19T00:37:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d1fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d280ce500 0x7f8d280ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d26800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8d280d03c0 0x7f8d2806e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34358/0 (socket says 172.21.15.7:34358) 2024-08-19T00:37:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d26800640 1 -- 172.21.15.7:0/3786476441 learned_addr learned my addr 172.21.15.7:0/3786476441 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.006+0000 7f8d1fe00640 1 -- 172.21.15.7:0/3786476441 >> v1:172.21.15.162:6789/0 conn(0x7f8d28159bf0 legacy=0x7f8d28073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.007+0000 7f8d1fe00640 1 -- 172.21.15.7:0/3786476441 >> v1:172.21.15.7:6789/0 conn(0x7f8d280d03c0 legacy=0x7f8d2806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.007+0000 7f8d1fe00640 1 -- 172.21.15.7:0/3786476441 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d28072c60 con 0x7f8d280ce500 2024-08-19T00:37:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d1fe00640 1 --2- 172.21.15.7:0/3786476441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d280ce970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d100097a0 tx=0x7f8d1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea81aad22414f69 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d25400640 1 -- 172.21.15.7:0/3786476441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10037070 con 0x7f8d280ce500 2024-08-19T00:37:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d25400640 1 -- 172.21.15.7:0/3786476441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1002ae50 con 0x7f8d280ce500 2024-08-19T00:37:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d25400640 1 -- 172.21.15.7:0/3786476441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10032660 con 0x7f8d280ce500 2024-08-19T00:37:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d2d000640 1 -- 172.21.15.7:0/3786476441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 msgr2=0x7f8d280ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d2d000640 1 --2- 172.21.15.7:0/3786476441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d280ce970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d100097a0 tx=0x7f8d1002a140 comp rx=0 tx=0).stop 2024-08-19T00:37:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d2d000640 1 -- 172.21.15.7:0/3786476441 shutdown_connections 2024-08-19T00:37:54.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d2d000640 1 --2- 172.21.15.7:0/3786476441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d280ce970 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:54.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.008+0000 7f8d2d000640 1 -- 172.21.15.7:0/3786476441 >> 172.21.15.7:0/3786476441 conn(0x7f8d2806bc70 msgr2=0x7f8d2806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:54.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.009+0000 7f8d2d000640 1 -- 172.21.15.7:0/3786476441 shutdown_connections 2024-08-19T00:37:54.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.009+0000 7f8d2d000640 1 -- 172.21.15.7:0/3786476441 wait complete. 2024-08-19T00:37:54.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.010+0000 7f8d2d000640 1 Processor -- start 2024-08-19T00:37:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.010+0000 7f8d2d000640 1 -- start start 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d281558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280d03c0 0x7f8d28141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28159bf0 0x7f8d28099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d2d000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28159fd0 con 0x7f8d280ce500 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d2d000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28073b70 con 0x7f8d28159bf0 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d2d000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2815a150 con 0x7f8d280d03c0 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d25e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d281558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d25e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d281558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51626/0 (socket says 172.21.15.7:51626) 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.011+0000 7f8d25e00640 1 -- 172.21.15.7:0/1828856971 learned_addr learned my addr 172.21.15.7:0/1828856971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d26800640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28159bf0 0x7f8d28099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d1fe00640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280d03c0 0x7f8d28141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d25e00640 1 -- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280d03c0 msgr2=0x7f8d28141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d25e00640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280d03c0 0x7f8d28141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d25e00640 1 -- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28159bf0 msgr2=0x7f8d28099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d25e00640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28159bf0 0x7f8d28099520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d25e00640 1 -- 172.21.15.7:0/1828856971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d28099a60 con 0x7f8d280ce500 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d25e00640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d281558d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c460 tx=0x7f8d1800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d1e000640 1 -- 172.21.15.7:0/1828856971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18016020 con 0x7f8d280ce500 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d1e000640 1 -- 172.21.15.7:0/1828856971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d18012870 con 0x7f8d280ce500 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d281423d0 con 0x7f8d280ce500 2024-08-19T00:37:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d1e000640 1 -- 172.21.15.7:0/1828856971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18012c60 con 0x7f8d280ce500 2024-08-19T00:37:54.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.012+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d28142990 con 0x7f8d280ce500 2024-08-19T00:37:54.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.014+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d280cf130 con 0x7f8d280ce500 2024-08-19T00:37:54.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.014+0000 7f8d1e000640 1 -- 172.21.15.7:0/1828856971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d18019020 con 0x7f8d280ce500 2024-08-19T00:37:54.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.016+0000 7f8d1e000640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d0406be30 0x7f8d0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:54.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.016+0000 7f8d1e000640 1 -- 172.21.15.7:0/1828856971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8d1808a8e0 con 0x7f8d280ce500 2024-08-19T00:37:54.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.016+0000 7f8d1fe00640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d0406be30 0x7f8d0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:54.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.017+0000 7f8d1fe00640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d0406be30 0x7f8d0406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d10034000 tx=0x7f8d1002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:54.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.021+0000 7f8d1e000640 1 -- 172.21.15.7:0/1828856971 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8d18020070 con 0x7f8d280ce500 2024-08-19T00:37:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.239+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8d280b1930 con 0x7f8d280ce500 2024-08-19T00:37:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.240+0000 7f8d1e000640 1 -- 172.21.15.7:0/1828856971 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f8d18059280 con 0x7f8d280ce500 2024-08-19T00:37:54.243 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d0406be30 msgr2=0x7f8d0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d0406be30 0x7f8d0406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d10034000 tx=0x7f8d1002e000 comp rx=0 tx=0).stop 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 msgr2=0x7f8d281558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d281558d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c460 tx=0x7f8d1800c920 comp rx=0 tx=0).stop 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 shutdown_connections 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d0406be30 0x7f8d0406e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28159bf0 0x7f8d28099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280d03c0 0x7f8d28141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 --2- 172.21.15.7:0/1828856971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d280ce500 0x7f8d281558d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:54.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 >> 172.21.15.7:0/1828856971 conn(0x7f8d2806bc70 msgr2=0x7f8d2815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:54.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 shutdown_connections 2024-08-19T00:37:54.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54.242+0000 7f8d2d000640 1 -- 172.21.15.7:0/1828856971 wait complete. 2024-08-19T00:37:54.260 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:37:54.260 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:37:54.260 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:37:54.260 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:37:54.260 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:54.260 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:37:54.260 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:37:54.261 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:37:54.261 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:37:54.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:54.261 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:37:54.297 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:37:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:37:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:37:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:37:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42787sec preferred_lft 42787sec 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:37:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:37:54.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:54.300 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:37:54.391 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:37:54.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:54.394 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:37:54.433 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:37:54.433 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:37:54.433 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:37:54.433 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:37:54.433 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:37:54.434 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:37:54.434 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:37:54.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:37:54.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:37:54.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:37:54.434 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:37:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:37:54.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:54.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:54.633 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:37:54.669 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:37:54.669 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:37:54.669 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:37:54.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:54.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:37:54.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:54.767 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:54.802 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:37:54.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:37:54.802 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:54.877 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:37:54.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:54.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:55.006 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:55.006 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:37:55.007 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:55.022 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:55.022 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:37:55.022 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:55.022 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:55.022 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:55.044 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:37:55.044 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:37:55.044 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:37:55.044 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:37:55.044 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:37:55.044 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:37:55.045 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:37:55.045 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:37:55.045 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:37:55.046 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:37:55.046 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:37:55.046 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:37:55.046 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:37:55.048 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:37:55.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:55.049 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:55.105 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:37:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:37:55.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:55.206 INFO:teuthology.orchestra.run.smithi007.stdout:client4938 2024-08-19T00:37:55.206 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:55.206 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:55.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:55.242 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-08-19T00:37:55.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:55.328 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-08-19T00:37:55.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:55.408 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-08-19T00:37:55.486 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:37:55.486 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:37:55.486 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:37:55.486 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:37:55.486 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-08-19T00:37:55.486 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:37:55.627 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-08-19T00:37:55.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:37:55.638 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:55.638 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:55.716 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:37:55.716 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:37:55.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:37:55.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.988+0000 7ff1a0400640 1 Processor -- start 2024-08-19T00:37:55.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.988+0000 7ff1a0400640 1 -- start start 2024-08-19T00:37:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff1a0400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 0x7ff198071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff1a0400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1980b3750 0x7ff1980cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff1a0400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1980cdfb0 con 0x7ff1980d03c0 2024-08-19T00:37:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff1a0400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff1980cebc0 con 0x7ff1980b3750 2024-08-19T00:37:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff1a0400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff1980ce290 con 0x7ff19806e710 2024-08-19T00:37:55.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff19da00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff1980d03c0 0x7ff1980d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34364/0 (socket says 172.21.15.7:34364) 2024-08-19T00:37:55.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff19da00640 1 -- 172.21.15.7:0/2198813433 learned_addr learned my addr 172.21.15.7:0/2198813433 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:55.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff19d000640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 0x7ff198071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:55.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff19e400640 1 --2- 172.21.15.7:0/2198813433 >> v2:172.21.15.162:3300/0 conn(0x7ff1980b3750 0x7ff1980cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:55.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985491921 0 0) 0x7ff1980cdfb0 con 0x7ff1980d03c0 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.990+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff180003520 con 0x7ff1980d03c0 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1309636640 0 0) 0x7ff180003520 con 0x7ff1980d03c0 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 msgr2=0x7ff198071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 0x7ff198071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 >> v2:172.21.15.162:3300/0 conn(0x7ff1980b3750 msgr2=0x7ff1980cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 --2- 172.21.15.7:0/2198813433 >> v2:172.21.15.162:3300/0 conn(0x7ff1980b3750 0x7ff1980cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1980ce570 con 0x7ff1980d03c0 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7ff18c001670 con 0x7ff1980d03c0 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 >> v1:172.21.15.7:6789/0 conn(0x7ff1980d03c0 legacy=0x7ff1980d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1800039b0 0x7ff180003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff180004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 0x7ff1800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1980cebc0 con 0x7ff180004800 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1980ce290 con 0x7ff1800039b0 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff18000b9c0 con 0x7ff19806e710 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff19d000640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff180004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff19e400640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 0x7ff1800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.991+0000 7ff19da00640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1800039b0 0x7ff180003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.992+0000 7ff19d000640 1 -- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 msgr2=0x7ff1800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.992+0000 7ff19d000640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19806e710 0x7ff1800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.992+0000 7ff19d000640 1 -- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1800039b0 msgr2=0x7ff180003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.992+0000 7ff19d000640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1800039b0 0x7ff180003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.992+0000 7ff19d000640 1 -- 172.21.15.7:0/2198813433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff180003520 con 0x7ff180004800 2024-08-19T00:37:55.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff19d000640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff180004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff184009ac0 tx=0x7ff180005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1875e83267e750d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:55.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184036070 con 0x7ff180004800 2024-08-19T00:37:55.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff184031400 con 0x7ff180004800 2024-08-19T00:37:55.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff197e00640 1 -- 172.21.15.7:0/2198813433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184009690 con 0x7ff180004800 2024-08-19T00:37:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff1a0400640 1 -- 172.21.15.7:0/2198813433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 msgr2=0x7ff180004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff1a0400640 1 --2- 172.21.15.7:0/2198813433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff180004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff184009ac0 tx=0x7ff180005830 comp rx=0 tx=0).stop 2024-08-19T00:37:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff19e400640 1 -- 172.21.15.7:0/2198813433 reap_dead start 2024-08-19T00:37:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff1a0400640 1 -- 172.21.15.7:0/2198813433 shutdown_connections 2024-08-19T00:37:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.993+0000 7ff1a0400640 1 -- 172.21.15.7:0/2198813433 >> 172.21.15.7:0/2198813433 conn(0x7ff19806bc70 msgr2=0x7ff19806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.994+0000 7ff1a0400640 1 -- 172.21.15.7:0/2198813433 shutdown_connections 2024-08-19T00:37:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.994+0000 7ff1a0400640 1 -- 172.21.15.7:0/2198813433 wait complete. 2024-08-19T00:37:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.995+0000 7ff1a0400640 1 Processor -- start 2024-08-19T00:37:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.995+0000 7ff1a0400640 1 -- start start 2024-08-19T00:37:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.996+0000 7ff1a0400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff19815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.996+0000 7ff1a0400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1981ef620 0x7ff1980b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.996+0000 7ff1a0400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1981efaa0 0x7ff1980b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.996+0000 7ff1a0400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff198073c60 con 0x7ff180004800 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.996+0000 7ff1a0400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff198073ae0 con 0x7ff1981efaa0 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.996+0000 7ff1a0400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff1980b3be0 con 0x7ff1981ef620 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff19815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff19815b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51646/0 (socket says 172.21.15.7:51646) 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 -- 172.21.15.7:0/4102246958 learned_addr learned my addr 172.21.15.7:0/4102246958 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19d000640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1981ef620 0x7ff1980b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19e400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1981efaa0 0x7ff1980b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 -- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1981ef620 msgr2=0x7ff1980b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1981ef620 0x7ff1980b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 -- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1981efaa0 msgr2=0x7ff1980b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1981efaa0 0x7ff1980b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 -- 172.21.15.7:0/4102246958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1981453a0 con 0x7ff180004800 2024-08-19T00:37:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19e400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1981efaa0 0x7ff1980b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff19da00640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff19815b6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff18c007370 tx=0x7ff18c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff195600640 1 -- 172.21.15.7:0/4102246958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00f9c0 con 0x7ff180004800 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff195600640 1 -- 172.21.15.7:0/4102246958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff18c018070 con 0x7ff180004800 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.997+0000 7ff195600640 1 -- 172.21.15.7:0/4102246958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00fda0 con 0x7ff180004800 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.998+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff198145680 con 0x7ff180004800 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.998+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff198145c40 con 0x7ff180004800 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:55.999+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1980cdf10 con 0x7ff180004800 2024-08-19T00:37:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.000+0000 7ff195600640 1 -- 172.21.15.7:0/4102246958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff18c01c410 con 0x7ff180004800 2024-08-19T00:37:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.001+0000 7ff195600640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff17806be60 0x7ff17806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.001+0000 7ff195600640 1 -- 172.21.15.7:0/4102246958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff18c08abb0 con 0x7ff180004800 2024-08-19T00:37:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.001+0000 7ff19d000640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff17806be60 0x7ff17806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.002+0000 7ff19d000640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff17806be60 0x7ff17806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff184033000 tx=0x7ff184008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.006+0000 7ff195600640 1 -- 172.21.15.7:0/4102246958 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff18c059550 con 0x7ff180004800 2024-08-19T00:37:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.201+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff19815a050 con 0x7ff180004800 2024-08-19T00:37:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.202+0000 7ff195600640 1 -- 172.21.15.7:0/4102246958 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7ff18c058e50 con 0x7ff180004800 2024-08-19T00:37:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:37:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.204+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff17806be60 msgr2=0x7ff17806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.204+0000 7ff1a0400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff17806be60 0x7ff17806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff184033000 tx=0x7ff184008030 comp rx=0 tx=0).stop 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.204+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 msgr2=0x7ff19815b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.204+0000 7ff1a0400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff19815b6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff18c007370 tx=0x7ff18c007830 comp rx=0 tx=0).stop 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 shutdown_connections 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff17806be60 0x7ff17806e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1981efaa0 0x7ff1980b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1981ef620 0x7ff1980b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 --2- 172.21.15.7:0/4102246958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff180004800 0x7ff19815b6d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 >> 172.21.15.7:0/4102246958 conn(0x7ff19806bc70 msgr2=0x7ff1980acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 shutdown_connections 2024-08-19T00:37:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.205+0000 7ff1a0400640 1 -- 172.21.15.7:0/4102246958 wait complete. 2024-08-19T00:37:56.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:37:56.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:56.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:37:56.319 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:37:56.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:37:56.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:37:56.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.557+0000 7f6f2ce00640 1 Processor -- start 2024-08-19T00:37:56.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.557+0000 7f6f2ce00640 1 -- start start 2024-08-19T00:37:56.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f2ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6f2815e360 0x7f6f2815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f2ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6f2815ee50 0x7f6f280d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f2ce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f280b3ab0 con 0x7f6f280d2af0 2024-08-19T00:37:56.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f2ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6f2815f460 con 0x7f6f2815e360 2024-08-19T00:37:56.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f2ce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6f2815f740 con 0x7f6f2815ee50 2024-08-19T00:37:56.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f27400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6f2815e360 0x7f6f2815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f26a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6f280d2af0 0x7f6f2815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34372/0 (socket says 172.21.15.7:34372) 2024-08-19T00:37:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.558+0000 7f6f26a00640 1 -- 172.21.15.7:0/3220986739 learned_addr learned my addr 172.21.15.7:0/3220986739 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.559+0000 7f6f27e00640 1 --2- 172.21.15.7:0/3220986739 >> v2:172.21.15.162:3300/0 conn(0x7f6f2815ee50 0x7f6f280d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.559+0000 7f6f27400640 1 -- 172.21.15.7:0/3220986739 >> v2:172.21.15.162:3300/0 conn(0x7f6f2815ee50 msgr2=0x7f6f280d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.559+0000 7f6f27400640 1 --2- 172.21.15.7:0/3220986739 >> v2:172.21.15.162:3300/0 conn(0x7f6f2815ee50 0x7f6f280d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.559+0000 7f6f27400640 1 -- 172.21.15.7:0/3220986739 >> v1:172.21.15.7:6789/0 conn(0x7f6f280d2af0 legacy=0x7f6f2815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.559+0000 7f6f27400640 1 -- 172.21.15.7:0/3220986739 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280b3d60 con 0x7f6f2815e360 2024-08-19T00:37:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.560+0000 7f6f27400640 1 --2- 172.21.15.7:0/3220986739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f2815fab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6f280d1c20 tx=0x7f6f1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6614b5e61c75a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.560+0000 7f6f26000640 1 -- 172.21.15.7:0/3220986739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18037070 con 0x7f6f2815e360 2024-08-19T00:37:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.560+0000 7f6f26000640 1 -- 172.21.15.7:0/3220986739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f18032440 con 0x7f6f2815e360 2024-08-19T00:37:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.560+0000 7f6f26000640 1 -- 172.21.15.7:0/3220986739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18032810 con 0x7f6f2815e360 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 -- 172.21.15.7:0/3220986739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 msgr2=0x7f6f2815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/3220986739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f2815fab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6f280d1c20 tx=0x7f6f1802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 -- 172.21.15.7:0/3220986739 shutdown_connections 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/3220986739 >> v2:172.21.15.162:3300/0 conn(0x7f6f2815ee50 0x7f6f280d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/3220986739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f2815fab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 -- 172.21.15.7:0/3220986739 >> 172.21.15.7:0/3220986739 conn(0x7f6f2808dbf0 msgr2=0x7f6f2809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 -- 172.21.15.7:0/3220986739 shutdown_connections 2024-08-19T00:37:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.561+0000 7f6f2ce00640 1 -- 172.21.15.7:0/3220986739 wait complete. 2024-08-19T00:37:56.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.563+0000 7f6f2ce00640 1 Processor -- start 2024-08-19T00:37:56.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.563+0000 7f6f2ce00640 1 -- start start 2024-08-19T00:37:56.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f2ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f280d2af0 0x7f6f280cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f2ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f280cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f2ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2815ee50 0x7f6f280c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f2ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280b4560 con 0x7f6f2815e360 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f2ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280d2300 con 0x7f6f2815ee50 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f2ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f280b46e0 con 0x7f6f280d2af0 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f280cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f280cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51662/0 (socket says 172.21.15.7:51662) 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 -- 172.21.15.7:0/2037728076 learned_addr learned my addr 172.21.15.7:0/2037728076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f27e00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2815ee50 0x7f6f280c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f27400640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f280d2af0 0x7f6f280cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 -- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f280d2af0 msgr2=0x7f6f280cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f280d2af0 0x7f6f280cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 -- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2815ee50 msgr2=0x7f6f280c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2815ee50 0x7f6f280c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f26a00640 1 -- 172.21.15.7:0/2037728076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280d07d0 con 0x7f6f2815e360 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f27400640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f280d2af0 0x7f6f280cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.564+0000 7f6f27e00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2815ee50 0x7f6f280c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.565+0000 7f6f26a00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f280cfe10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c400 tx=0x7f6f1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.565+0000 7f6f1f400640 1 -- 172.21.15.7:0/2037728076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14017070 con 0x7f6f2815e360 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.565+0000 7f6f1f400640 1 -- 172.21.15.7:0/2037728076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f14005ce0 con 0x7f6f2815e360 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.565+0000 7f6f1f400640 1 -- 172.21.15.7:0/2037728076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f140072f0 con 0x7f6f2815e360 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.565+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f280d0ab0 con 0x7f6f2815e360 2024-08-19T00:37:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.565+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f280d1070 con 0x7f6f2815e360 2024-08-19T00:37:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.566+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2815fab0 con 0x7f6f2815e360 2024-08-19T00:37:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.567+0000 7f6f1f400640 1 -- 172.21.15.7:0/2037728076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f1401a070 con 0x7f6f2815e360 2024-08-19T00:37:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.568+0000 7f6f1f400640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f0806be30 0x7f6f0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.568+0000 7f6f1f400640 1 -- 172.21.15.7:0/2037728076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6f1408a300 con 0x7f6f2815e360 2024-08-19T00:37:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.568+0000 7f6f27400640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f0806be30 0x7f6f0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.569+0000 7f6f27400640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f0806be30 0x7f6f0806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f18034000 tx=0x7f6f1802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:56.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.572+0000 7f6f1f400640 1 -- 172.21.15.7:0/2037728076 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6f14058c10 con 0x7f6f2815e360 2024-08-19T00:37:56.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.793+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f280d50d0 con 0x7f6f2815e360 2024-08-19T00:37:56.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.794+0000 7f6f1f400640 1 -- 172.21.15.7:0/2037728076 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f6f14058510 con 0x7f6f2815e360 2024-08-19T00:37:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:56.797 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"btime":"2024-08-19T00:37:50:684047+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:37:50.105814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4577":{"gid":4577,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6835/1856893937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1856893937},{"type":"v1","addr":"172.21.15.162:6835","nonce":1856893937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4577,"qdb_cluster":[4577]},"id":2}]} 2024-08-19T00:37:56.797 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 16 2024-08-19T00:37:56.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f0806be30 msgr2=0x7f6f0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f0806be30 0x7f6f0806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f18034000 tx=0x7f6f1802e000 comp rx=0 tx=0).stop 2024-08-19T00:37:56.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 msgr2=0x7f6f280cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f280cfe10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c400 tx=0x7f6f1400c8c0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 shutdown_connections 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f0806be30 0x7f6f0806e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2815ee50 0x7f6f280c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f2815e360 0x7f6f280cfe10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 --2- 172.21.15.7:0/2037728076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f280d2af0 0x7f6f280cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.796+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 >> 172.21.15.7:0/2037728076 conn(0x7f6f2808dbf0 msgr2=0x7f6f28160980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.797+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 shutdown_connections 2024-08-19T00:37:56.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:56.797+0000 7f6f2ce00640 1 -- 172.21.15.7:0/2037728076 wait complete. 2024-08-19T00:37:56.816 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-08-19T00:37:57.008 INFO:teuthology.orchestra.run.smithi162.stdout:{"message":"","return_code":0} 2024-08-19T00:37:57.009 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-19T00:37:57.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:37:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.165+0000 7f6f66200640 1 Processor -- start 2024-08-19T00:37:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.165+0000 7f6f66200640 1 -- start start 2024-08-19T00:37:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f66200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f66200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6f6006e710 0x7f6f600d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f66200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f600d0ce0 con 0x7f6f600b3750 2024-08-19T00:37:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f66200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6f600cebc0 con 0x7f6f6006e710 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f66200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f600cdfb0 con 0x7f6f600d03c0 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f5fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6f600b3750 0x7f6f600cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34388/0 (socket says 172.21.15.7:34388) 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f5fe00640 1 -- 172.21.15.7:0/3631015797 learned_addr learned my addr 172.21.15.7:0/3631015797 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f57e00640 1 --2- 172.21.15.7:0/3631015797 >> v2:172.21.15.162:3300/0 conn(0x7f6f6006e710 0x7f6f600d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.166+0000 7f6f5f400640 1 --2- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.167+0000 7f6f5ea00640 1 -- 172.21.15.7:0/3631015797 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787027215 0 0) 0x7f6f600d0ce0 con 0x7f6f600b3750 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.167+0000 7f6f5ea00640 1 -- 172.21.15.7:0/3631015797 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f44003520 con 0x7f6f600b3750 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.167+0000 7f6f57e00640 1 -- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 msgr2=0x7f6f60071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.167+0000 7f6f57e00640 1 --2- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.167+0000 7f6f57e00640 1 -- 172.21.15.7:0/3631015797 >> v1:172.21.15.7:6789/0 conn(0x7f6f600b3750 legacy=0x7f6f600cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.167+0000 7f6f57e00640 1 -- 172.21.15.7:0/3631015797 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f600ce290 con 0x7f6f6006e710 2024-08-19T00:37:57.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.167+0000 7f6f5f400640 1 --2- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.168+0000 7f6f57e00640 1 --2- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f600d07a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6f480097a0 tx=0x7f6f4802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5994180aad55de1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.168+0000 7f6f5ea00640 1 -- 172.21.15.7:0/3631015797 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48037070 con 0x7f6f6006e710 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.168+0000 7f6f5ea00640 1 -- 172.21.15.7:0/3631015797 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f48032440 con 0x7f6f6006e710 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.168+0000 7f6f5ea00640 1 -- 172.21.15.7:0/3631015797 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480327f0 con 0x7f6f6006e710 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 -- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 msgr2=0x7f6f600d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 --2- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f600d07a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6f480097a0 tx=0x7f6f4802a180 comp rx=0 tx=0).stop 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 -- 172.21.15.7:0/3631015797 shutdown_connections 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 --2- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f600d07a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 --2- 172.21.15.7:0/3631015797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 -- 172.21.15.7:0/3631015797 >> 172.21.15.7:0/3631015797 conn(0x7f6f6006bc70 msgr2=0x7f6f6006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 -- 172.21.15.7:0/3631015797 shutdown_connections 2024-08-19T00:37:57.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.169+0000 7f6f66200640 1 -- 172.21.15.7:0/3631015797 wait complete. 2024-08-19T00:37:57.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.171+0000 7f6f66200640 1 Processor -- start 2024-08-19T00:37:57.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.171+0000 7f6f66200640 1 -- start start 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f66200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f60158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f66200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f600b3750 0x7f6f60152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f66200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f66200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60073ae0 con 0x7f6f600b3750 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f66200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600ce850 con 0x7f6f6006e710 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f66200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f60073c60 con 0x7f6f600d03c0 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f600b3750 0x7f6f60152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f5f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f60158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f600b3750 0x7f6f60152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51678/0 (socket says 172.21.15.7:51678) 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f57e00640 1 -- 172.21.15.7:0/1452192272 learned_addr learned my addr 172.21.15.7:0/1452192272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:57.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.172+0000 7f6f5fe00640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f5f400640 1 -- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 msgr2=0x7f6f60153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f5f400640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f5f400640 1 -- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f600b3750 msgr2=0x7f6f60152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f5f400640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f600b3750 0x7f6f60152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f5f400640 1 -- 172.21.15.7:0/1452192272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f60157dd0 con 0x7f6f6006e710 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f5f400640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f60158e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e900 tx=0x7f6f5000edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f57400640 1 -- 172.21.15.7:0/1452192272 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50017070 con 0x7f6f6006e710 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f57400640 1 -- 172.21.15.7:0/1452192272 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5000ca00 con 0x7f6f6006e710 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f57400640 1 -- 172.21.15.7:0/1452192272 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000cdf0 con 0x7f6f6006e710 2024-08-19T00:37:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f601580b0 con 0x7f6f6006e710 2024-08-19T00:37:57.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.173+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f60158670 con 0x7f6f6006e710 2024-08-19T00:37:57.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.174+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f600b3be0 con 0x7f6f6006e710 2024-08-19T00:37:57.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.175+0000 7f6f57400640 1 -- 172.21.15.7:0/1452192272 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f5001a070 con 0x7f6f6006e710 2024-08-19T00:37:57.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.176+0000 7f6f57400640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f3c06be30 0x7f6f3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.176+0000 7f6f57400640 1 -- 172.21.15.7:0/1452192272 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6f5008aff0 con 0x7f6f6006e710 2024-08-19T00:37:57.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.177+0000 7f6f57e00640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f3c06be30 0x7f6f3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.177+0000 7f6f57e00640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f3c06be30 0x7f6f3c06e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f480097a0 tx=0x7f6f4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.181+0000 7f6f57400640 1 -- 172.21.15.7:0/1452192272 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6f50059360 con 0x7f6f6006e710 2024-08-19T00:37:57.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.400+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6f600cd090 con 0x7f6f6006e710 2024-08-19T00:37:57.404 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:37:57.402+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:37:57.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.407+0000 7f6f57400640 1 -- 172.21.15.7:0/1452192272 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f6f5005d660 con 0x7f6f6006e710 2024-08-19T00:37:57.410 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f3c06be30 msgr2=0x7f6f3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f3c06be30 0x7f6f3c06e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f480097a0 tx=0x7f6f4802e000 comp rx=0 tx=0).stop 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 msgr2=0x7f6f60158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f60158e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e900 tx=0x7f6f5000edc0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 shutdown_connections 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f3c06be30 0x7f6f3c06e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f600d03c0 0x7f6f60153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f600b3750 0x7f6f60152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 --2- 172.21.15.7:0/1452192272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6006e710 0x7f6f60158e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 >> 172.21.15.7:0/1452192272 conn(0x7f6f6006bc70 msgr2=0x7f6f600af400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 shutdown_connections 2024-08-19T00:37:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.410+0000 7f6f66200640 1 -- 172.21.15.7:0/1452192272 wait complete. 2024-08-19T00:37:57.417 INFO:tasks.ceph.mds.d.smithi162.stderr: -4539> 2024-08-19T00:37:52.501+0000 7fb2fcc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:37:57.428 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:37:57.466 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:37:57.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.504+0000 7f284a7e0f40 1 Processor -- start 2024-08-19T00:37:57.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.504+0000 7f284a7e0f40 1 -- start start 2024-08-19T00:37:57.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f284a7e0f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1d95b0 0x557e9d1d8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f284a7e0f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d1d48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f284a7e0f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1f18d0 0x557e9d274bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f284a7e0f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e9d27f0a0 con 0x557e9d1d95b0 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f284a7e0f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e9d27edc0 con 0x557e9d1d9990 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f284a7e0f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e9d27f380 con 0x557e9d1f18d0 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f2847a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1d95b0 0x557e9d1d8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f2847a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1d95b0 0x557e9d1d8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51704/0 (socket says 172.21.15.7:51704) 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f2847a00640 1 -- 172.21.15.7:0/1159281750 learned_addr learned my addr 172.21.15.7:0/1159281750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f2847000640 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d1d48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.505+0000 7f2848400640 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1f18d0 0x557e9d274bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2847a00640 1 -- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1f18d0 msgr2=0x557e9d274bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:57.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2847a00640 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1f18d0 0x557e9d274bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2847a00640 1 -- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 msgr2=0x557e9d1d48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2847a00640 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d1d48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2847a00640 1 -- 172.21.15.7:0/1159281750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d0dc130 con 0x557e9d1d95b0 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2848400640 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1f18d0 0x557e9d274bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2847a00640 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1d95b0 0x557e9d1d8be0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2838058040 tx=0x7f2838051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a96fcc573008bb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2845c00640 1 -- 172.21.15.7:0/1159281750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283805a050 con 0x557e9d1d95b0 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2845c00640 1 -- 172.21.15.7:0/1159281750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283805b040 con 0x557e9d1d95b0 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.506+0000 7f2845c00640 1 -- 172.21.15.7:0/1159281750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838055b50 con 0x557e9d1d95b0 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 -- 172.21.15.7:0/1159281750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1d95b0 msgr2=0x557e9d1d8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1d95b0 0x557e9d1d8be0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2838058040 tx=0x7f2838051000 comp rx=0 tx=0).stop 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 -- 172.21.15.7:0/1159281750 shutdown_connections 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1f18d0 0x557e9d274bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d1d48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/1159281750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1d95b0 0x557e9d1d8be0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 -- 172.21.15.7:0/1159281750 >> 172.21.15.7:0/1159281750 conn(0x557e9d1d64e0 msgr2=0x557e9d1a6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:57.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 -- 172.21.15.7:0/1159281750 shutdown_connections 2024-08-19T00:37:57.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 -- 172.21.15.7:0/1159281750 wait complete. 2024-08-19T00:37:57.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.507+0000 7f284a7e0f40 1 Processor -- start 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.508+0000 7f284a7e0f40 1 -- start start 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.508+0000 7f284a7e0f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1d95b0 0x557e9d1a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.508+0000 7f284a7e0f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d25f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.508+0000 7f284a7e0f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1f18d0 0x557e9d277e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.508+0000 7f284a7e0f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e9d1f3cd0 con 0x557e9d1f18d0 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.508+0000 7f284a7e0f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e9d261e80 con 0x557e9d1d9990 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.508+0000 7f284a7e0f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e9d2605b0 con 0x557e9d1d95b0 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2848400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1f18d0 0x557e9d277e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2847000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d25f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2848400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1f18d0 0x557e9d277e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51716/0 (socket says 172.21.15.7:51716) 2024-08-19T00:37:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2847a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1d95b0 0x557e9d1a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2848400640 1 -- 172.21.15.7:0/3580969235 learned_addr learned my addr 172.21.15.7:0/3580969235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2847000640 1 -- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1d95b0 msgr2=0x557e9d1a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2847000640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e9d1d95b0 0x557e9d1a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2847000640 1 -- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1f18d0 msgr2=0x557e9d277e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2847000640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1f18d0 0x557e9d277e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2847000640 1 -- 172.21.15.7:0/3580969235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d0d2b30 con 0x557e9d1d9990 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.509+0000 7f2848400640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e9d1f18d0 0x557e9d277e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.510+0000 7f2847000640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d25f140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2834008680 tx=0x7f2834008770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.510+0000 7f283fe00640 1 -- 172.21.15.7:0/3580969235 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28340148a0 con 0x557e9d1d9990 2024-08-19T00:37:57.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.510+0000 7f283fe00640 1 -- 172.21.15.7:0/3580969235 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283401a070 con 0x557e9d1d9990 2024-08-19T00:37:57.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.510+0000 7f283fe00640 1 -- 172.21.15.7:0/3580969235 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834014c40 con 0x557e9d1d9990 2024-08-19T00:37:57.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.510+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e9d10f080 con 0x557e9d1d9990 2024-08-19T00:37:57.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.510+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9d278360 con 0x557e9d1d9990 2024-08-19T00:37:57.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.512+0000 7f283fe00640 1 -- 172.21.15.7:0/3580969235 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2834015470 con 0x557e9d1d9990 2024-08-19T00:37:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.513+0000 7f283fe00640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f282806a810 0x7f282806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.513+0000 7f283fe00640 1 -- 172.21.15.7:0/3580969235 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f283408a370 con 0x557e9d1d9990 2024-08-19T00:37:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.513+0000 7f2847a00640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f282806a810 0x7f282806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.513+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e9d315500 0x557e9d1d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.513+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e9d315900 con 0x557e9d315500 2024-08-19T00:37:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.513+0000 7f2848400640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e9d315500 0x557e9d1d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.514+0000 7f2847a00640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f282806a810 0x7f282806ccd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x557e9d1f4120 tx=0x7f2838053000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.514+0000 7f2848400640 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e9d315500 0x557e9d1d5d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f2848400640 1 -- 172.21.15.7:0/3580969235 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v33'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f2840014420 con 0x557e9d315500 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e9d315500 msgr2=0x557e9d1d5d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e9d315500 0x557e9d1d5d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f282806a810 msgr2=0x7f282806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f282806a810 0x7f282806ccd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x557e9d1f4120 tx=0x7f2838053000 comp rx=0 tx=0).stop 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 msgr2=0x557e9d25f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 --2- 172.21.15.7:0/3580969235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e9d1d9990 0x557e9d25f140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2834008680 tx=0x7f2834008770 comp rx=0 tx=0).stop 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f2848400640 1 -- 172.21.15.7:0/3580969235 reap_dead start 2024-08-19T00:37:57.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 shutdown_connections 2024-08-19T00:37:57.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 >> 172.21.15.7:0/3580969235 conn(0x557e9d1d64e0 msgr2=0x557e9d1d68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:57.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 shutdown_connections 2024-08-19T00:37:57.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.518+0000 7f284a7e0f40 1 -- 172.21.15.7:0/3580969235 wait complete. 2024-08-19T00:37:57.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:37:57.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.683+0000 7f2fd9a00640 1 Processor -- start 2024-08-19T00:37:57.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.683+0000 7f2fd9a00640 1 -- start start 2024-08-19T00:37:57.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fd9a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fd4158cd0 0x7f2fd4072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fd9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fd9a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fd40aeae0 con 0x7f2fd4072ff0 2024-08-19T00:37:57.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fd9a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd4073460 con 0x7f2fd4158cd0 2024-08-19T00:37:57.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fd9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd40aedc0 con 0x7f2fd40ae480 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fd3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fd2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fd4158cd0 0x7f2fd4072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fca000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2fd4072ff0 0x7f2fd40add70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:42276/0 (socket says 172.21.15.7:42276) 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.684+0000 7f2fca000640 1 -- 172.21.15.7:0/523075458 learned_addr learned my addr 172.21.15.7:0/523075458 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.685+0000 7f2fd2000640 1 -- 172.21.15.7:0/523075458 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516840987 0 0) 0x7f2fd40aeae0 con 0x7f2fd4072ff0 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.685+0000 7f2fd2000640 1 -- 172.21.15.7:0/523075458 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fb8003520 con 0x7f2fd4072ff0 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.685+0000 7f2fd2a00640 1 -- 172.21.15.7:0/523075458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 msgr2=0x7f2fd40b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.685+0000 7f2fd2a00640 1 --2- 172.21.15.7:0/523075458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd40b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.685+0000 7f2fd2a00640 1 -- 172.21.15.7:0/523075458 >> v1:172.21.15.162:6789/0 conn(0x7f2fd4072ff0 legacy=0x7f2fd40add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.685+0000 7f2fd2a00640 1 -- 172.21.15.7:0/523075458 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd40af0a0 con 0x7f2fd4158cd0 2024-08-19T00:37:57.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.686+0000 7f2fd2a00640 1 --2- 172.21.15.7:0/523075458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4158cd0 0x7f2fd4072ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097a0 tx=0x7f2fc402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41bb628c63996a7d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.686+0000 7f2fd2000640 1 -- 172.21.15.7:0/523075458 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4037070 con 0x7f2fd4158cd0 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.686+0000 7f2fd2000640 1 -- 172.21.15.7:0/523075458 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc402ae40 con 0x7f2fd4158cd0 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.686+0000 7f2fd2000640 1 -- 172.21.15.7:0/523075458 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4032660 con 0x7f2fd4158cd0 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 -- 172.21.15.7:0/523075458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4158cd0 msgr2=0x7f2fd4072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/523075458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4158cd0 0x7f2fd4072ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097a0 tx=0x7f2fc402a0f0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 -- 172.21.15.7:0/523075458 shutdown_connections 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/523075458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd40b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/523075458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4158cd0 0x7f2fd4072ab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 -- 172.21.15.7:0/523075458 >> 172.21.15.7:0/523075458 conn(0x7f2fd40b2300 msgr2=0x7f2fd406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 -- 172.21.15.7:0/523075458 shutdown_connections 2024-08-19T00:37:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.687+0000 7f2fd9a00640 1 -- 172.21.15.7:0/523075458 wait complete. 2024-08-19T00:37:57.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.689+0000 7f2fd9a00640 1 Processor -- start 2024-08-19T00:37:57.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.689+0000 7f2fd9a00640 1 -- start start 2024-08-19T00:37:57.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4072ff0 0x7f2fd4142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd409b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fd415d840 0x7f2fd415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd9a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd40b3690 con 0x7f2fd415d840 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd9a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd40af660 con 0x7f2fd4072ff0 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd40b3810 con 0x7f2fd40ae480 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fd415d840 0x7f2fd415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fd415d840 0x7f2fd415dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51730/0 (socket says 172.21.15.7:51730) 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 -- 172.21.15.7:0/2997736983 learned_addr learned my addr 172.21.15.7:0/2997736983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd2a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4072ff0 0x7f2fd4142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fca000640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd409b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 -- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 msgr2=0x7f2fd409b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd409b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 -- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4072ff0 msgr2=0x7f2fd4142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4072ff0 0x7f2fd4142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.690+0000 7f2fd3400640 1 -- 172.21.15.7:0/2997736983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd409c960 con 0x7f2fd415d840 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.691+0000 7f2fd3400640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fd415d840 0x7f2fd415dcc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc010fa0 tx=0x7f2fcc00e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.691+0000 7f2fcb400640 1 -- 172.21.15.7:0/2997736983 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00b2d0 con 0x7f2fd415d840 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.691+0000 7f2fcb400640 1 -- 172.21.15.7:0/2997736983 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fcc01b070 con 0x7f2fd415d840 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.691+0000 7f2fcb400640 1 -- 172.21.15.7:0/2997736983 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc009780 con 0x7f2fd415d840 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.691+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd409cc40 con 0x7f2fd415d840 2024-08-19T00:37:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.691+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd415b9d0 con 0x7f2fd415d840 2024-08-19T00:37:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.692+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd40b3150 con 0x7f2fd415d840 2024-08-19T00:37:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.693+0000 7f2fcb400640 1 -- 172.21.15.7:0/2997736983 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fcc005d10 con 0x7f2fd415d840 2024-08-19T00:37:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.694+0000 7f2fcb400640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fb006be30 0x7f2fb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.694+0000 7f2fcb400640 1 -- 172.21.15.7:0/2997736983 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f2fcc08d4d0 con 0x7f2fd415d840 2024-08-19T00:37:57.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.694+0000 7f2fd2a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fb006be30 0x7f2fb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:57.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.695+0000 7f2fd2a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fb006be30 0x7f2fb006e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4034000 tx=0x7f2fc402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:57.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.699+0000 7f2fcb400640 1 -- 172.21.15.7:0/2997736983 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2fcc012040 con 0x7f2fd415d840 2024-08-19T00:37:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:57.921+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f2fd40cfd30 con 0x7f2fd415d840 2024-08-19T00:37:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.034+0000 7f2fcb400640 1 -- 172.21.15.7:0/2997736983 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v18) ==== 162+0+0 (secure 0 0 0) 0x7f2fcc05b7c0 con 0x7f2fd415d840 2024-08-19T00:37:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:37:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fb006be30 msgr2=0x7f2fb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fb006be30 0x7f2fb006e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4034000 tx=0x7f2fc402e000 comp rx=0 tx=0).stop 2024-08-19T00:37:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fd415d840 msgr2=0x7f2fd415dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fd415d840 0x7f2fd415dcc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc010fa0 tx=0x7f2fcc00e550 comp rx=0 tx=0).stop 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 shutdown_connections 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fb006be30 0x7f2fb006e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fd415d840 0x7f2fd415dcc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fd40ae480 0x7f2fd409b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 --2- 172.21.15.7:0/2997736983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4072ff0 0x7f2fd4142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 >> 172.21.15.7:0/2997736983 conn(0x7f2fd40b2300 msgr2=0x7f2fd40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.036+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 shutdown_connections 2024-08-19T00:37:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.037+0000 7f2fd9a00640 1 -- 172.21.15.7:0/2997736983 wait complete. 2024-08-19T00:37:58.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:37:58.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.212+0000 7fbb23400640 1 Processor -- start 2024-08-19T00:37:58.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.212+0000 7fbb23400640 1 -- start start 2024-08-19T00:37:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb23400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbb1c159bf0 0x7fbb1c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb23400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbb1c0739a0 0x7fbb1c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb23400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c06f7f0 con 0x7fbb1c0cea40 2024-08-19T00:37:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb23400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c0cee80 con 0x7fbb1c159bf0 2024-08-19T00:37:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb23400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c06f510 con 0x7fbb1c0739a0 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb20a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbb1c159bf0 0x7fbb1c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb21400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbb1c0cea40 0x7fbb1c0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34400/0 (socket says 172.21.15.7:34400) 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb21400640 1 -- 172.21.15.7:0/3333132771 learned_addr learned my addr 172.21.15.7:0/3333132771 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.213+0000 7fbb1be00640 1 --2- 172.21.15.7:0/3333132771 >> v2:172.21.15.162:3300/0 conn(0x7fbb1c0739a0 0x7fbb1c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.214+0000 7fbb20a00640 1 -- 172.21.15.7:0/3333132771 >> v2:172.21.15.162:3300/0 conn(0x7fbb1c0739a0 msgr2=0x7fbb1c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.214+0000 7fbb20a00640 1 --2- 172.21.15.7:0/3333132771 >> v2:172.21.15.162:3300/0 conn(0x7fbb1c0739a0 0x7fbb1c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.214+0000 7fbb20a00640 1 -- 172.21.15.7:0/3333132771 >> v1:172.21.15.7:6789/0 conn(0x7fbb1c0cea40 legacy=0x7fbb1c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.214+0000 7fbb20a00640 1 -- 172.21.15.7:0/3333132771 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c072980 con 0x7fbb1c159bf0 2024-08-19T00:37:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.214+0000 7fbb1b400640 1 -- 172.21.15.7:0/3333132771 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221131582 0 0) 0x7fbb1c06f7f0 con 0x7fbb1c0cea40 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.215+0000 7fbb20a00640 1 --2- 172.21.15.7:0/3333132771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c159bf0 0x7fbb1c073460 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b1cc0 tx=0x7fbb1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a217abfafb9d81 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.215+0000 7fbb1b400640 1 -- 172.21.15.7:0/3333132771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10037070 con 0x7fbb1c159bf0 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.215+0000 7fbb1b400640 1 -- 172.21.15.7:0/3333132771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb10032440 con 0x7fbb1c159bf0 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.215+0000 7fbb1b400640 1 -- 172.21.15.7:0/3333132771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1002ae60 con 0x7fbb1c159bf0 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 -- 172.21.15.7:0/3333132771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c159bf0 msgr2=0x7fbb1c073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 --2- 172.21.15.7:0/3333132771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c159bf0 0x7fbb1c073460 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b1cc0 tx=0x7fbb1002a110 comp rx=0 tx=0).stop 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 -- 172.21.15.7:0/3333132771 shutdown_connections 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 --2- 172.21.15.7:0/3333132771 >> v2:172.21.15.162:3300/0 conn(0x7fbb1c0739a0 0x7fbb1c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 --2- 172.21.15.7:0/3333132771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c159bf0 0x7fbb1c073460 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 -- 172.21.15.7:0/3333132771 >> 172.21.15.7:0/3333132771 conn(0x7fbb1c06bc70 msgr2=0x7fbb1c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 -- 172.21.15.7:0/3333132771 shutdown_connections 2024-08-19T00:37:58.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.216+0000 7fbb23400640 1 -- 172.21.15.7:0/3333132771 wait complete. 2024-08-19T00:37:58.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.217+0000 7fbb23400640 1 Processor -- start 2024-08-19T00:37:58.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.218+0000 7fbb23400640 1 -- start start 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.218+0000 7fbb23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c0739a0 0x7fbb1c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.218+0000 7fbb23400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb1c0cea40 0x7fbb1c153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.218+0000 7fbb23400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb1c159bf0 0x7fbb1c155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb23400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c159fd0 con 0x7fbb1c0739a0 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb23400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c072f40 con 0x7fbb1c159bf0 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb23400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1c15a150 con 0x7fbb1c0cea40 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c0739a0 0x7fbb1c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c0739a0 0x7fbb1c1504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51750/0 (socket says 172.21.15.7:51750) 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 -- 172.21.15.7:0/559620826 learned_addr learned my addr 172.21.15.7:0/559620826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb1be00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb1c0cea40 0x7fbb1c153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb21400640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb1c159bf0 0x7fbb1c155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 -- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb1c0cea40 msgr2=0x7fbb1c153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb1c0cea40 0x7fbb1c153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 -- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb1c159bf0 msgr2=0x7fbb1c155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb1c159bf0 0x7fbb1c155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb20a00640 1 -- 172.21.15.7:0/559620826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c155e80 con 0x7fbb1c0739a0 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.219+0000 7fbb1be00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb1c0cea40 0x7fbb1c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:37:58.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.220+0000 7fbb20a00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c0739a0 0x7fbb1c1504e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbb10000c00 tx=0x7fbb100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:58.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.220+0000 7fbb18c00640 1 -- 172.21.15.7:0/559620826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10037050 con 0x7fbb1c0739a0 2024-08-19T00:37:58.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.220+0000 7fbb18c00640 1 -- 172.21.15.7:0/559620826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb10038040 con 0x7fbb1c0739a0 2024-08-19T00:37:58.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.220+0000 7fbb18c00640 1 -- 172.21.15.7:0/559620826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10004470 con 0x7fbb1c0739a0 2024-08-19T00:37:58.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.220+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c154190 con 0x7fbb1c0739a0 2024-08-19T00:37:58.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.220+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c155140 con 0x7fbb1c0739a0 2024-08-19T00:37:58.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.221+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c0ce500 con 0x7fbb1c0739a0 2024-08-19T00:37:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.222+0000 7fbb18c00640 1 -- 172.21.15.7:0/559620826 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb10003610 con 0x7fbb1c0739a0 2024-08-19T00:37:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.223+0000 7fbb18c00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbafc06be30 0x7fbafc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:37:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.223+0000 7fbb18c00640 1 -- 172.21.15.7:0/559620826 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fbb100ab920 con 0x7fbb1c0739a0 2024-08-19T00:37:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.223+0000 7fbb1be00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbafc06be30 0x7fbafc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:37:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.224+0000 7fbb1be00640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbafc06be30 0x7fbafc06e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009af0 tx=0x7fbb08008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:37:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.228+0000 7fbb18c00640 1 -- 172.21.15.7:0/559620826 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbb1007a260 con 0x7fbb1c0739a0 2024-08-19T00:37:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.448+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb1c0b2200 con 0x7fbb1c0739a0 2024-08-19T00:37:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.449+0000 7fbb18c00640 1 -- 172.21.15.7:0/559620826 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5214 (secure 0 0 0) 0x7fbb10079b60 con 0x7fbb1c0739a0 2024-08-19T00:37:58.451 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:37:58.452 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"btime":"2024-08-19T00:37:58:034256+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:37:58.034225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:replay","state_seq":1,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-08-19T00:37:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-08-19T00:37:58.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbafc06be30 msgr2=0x7fbafc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbafc06be30 0x7fbafc06e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009af0 tx=0x7fbb08008040 comp rx=0 tx=0).stop 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c0739a0 msgr2=0x7fbb1c1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c0739a0 0x7fbb1c1504e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbb10000c00 tx=0x7fbb100046c0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 shutdown_connections 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbafc06be30 0x7fbafc06e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb1c159bf0 0x7fbb1c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb1c0cea40 0x7fbb1c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 --2- 172.21.15.7:0/559620826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1c0739a0 0x7fbb1c1504e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 >> 172.21.15.7:0/559620826 conn(0x7fbb1c06bc70 msgr2=0x7fbb1c0d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 shutdown_connections 2024-08-19T00:37:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:37:58.451+0000 7fbb23400640 1 -- 172.21.15.7:0/559620826 wait complete. 2024-08-19T00:37:58.872 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:37:47.095917+0000', 'modified': '2024-08-19T00:37:58.034225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 33, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4706}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4706': {'gid': 4706, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/230096578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6833', 'nonce': 230096578}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 230096578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:37:58.872 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4706:up:replay 2024-08-19T00:37:59.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:00.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.037+0000 7fe9ad800640 1 Processor -- start 2024-08-19T00:38:00.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.037+0000 7fe9ad800640 1 -- start start 2024-08-19T00:38:00.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.038+0000 7fe9ad800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9a809aa70 0x7fe9a809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.038+0000 7fe9ad800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe9a80d0290 0x7fe9a80d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.038+0000 7fe9ad800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a809b390 con 0x7fe9a809b730 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.038+0000 7fe9ad800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a815ec30 con 0x7fe9a809aa70 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.038+0000 7fe9ad800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a815ef10 con 0x7fe9a80d0290 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9a809aa70 0x7fe9a809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9a809aa70 0x7fe9a809ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51762/0 (socket says 172.21.15.7:51762) 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a6a00640 1 -- 172.21.15.7:0/2887556284 learned_addr learned my addr 172.21.15.7:0/2887556284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a7400640 1 --2- 172.21.15.7:0/2887556284 >> v2:172.21.15.162:3300/0 conn(0x7fe9a80d0290 0x7fe9a80d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a6a00640 1 -- 172.21.15.7:0/2887556284 >> v2:172.21.15.162:3300/0 conn(0x7fe9a80d0290 msgr2=0x7fe9a80d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a6a00640 1 --2- 172.21.15.7:0/2887556284 >> v2:172.21.15.162:3300/0 conn(0x7fe9a80d0290 0x7fe9a80d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a6a00640 1 -- 172.21.15.7:0/2887556284 >> v1:172.21.15.162:6789/0 conn(0x7fe9a809b730 legacy=0x7fe9a806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:00.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.039+0000 7fe9a6a00640 1 -- 172.21.15.7:0/2887556284 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a815f1f0 con 0x7fe9a809aa70 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.040+0000 7fe9a6a00640 1 --2- 172.21.15.7:0/2887556284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a809aa70 0x7fe9a809ae50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80730f0 tx=0x7fe99802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c173f7fc4379bf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.040+0000 7fe9a5600640 1 -- 172.21.15.7:0/2887556284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998037070 con 0x7fe9a809aa70 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.040+0000 7fe9a5600640 1 -- 172.21.15.7:0/2887556284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe998032440 con 0x7fe9a809aa70 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.040+0000 7fe9a5600640 1 -- 172.21.15.7:0/2887556284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998032810 con 0x7fe9a809aa70 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 -- 172.21.15.7:0/2887556284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a809aa70 msgr2=0x7fe9a809ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 --2- 172.21.15.7:0/2887556284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a809aa70 0x7fe9a809ae50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80730f0 tx=0x7fe99802a270 comp rx=0 tx=0).stop 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 -- 172.21.15.7:0/2887556284 shutdown_connections 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 --2- 172.21.15.7:0/2887556284 >> v2:172.21.15.162:3300/0 conn(0x7fe9a80d0290 0x7fe9a80d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 --2- 172.21.15.7:0/2887556284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a809aa70 0x7fe9a809ae50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 -- 172.21.15.7:0/2887556284 >> 172.21.15.7:0/2887556284 conn(0x7fe9a80d2190 msgr2=0x7fe9a80d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 -- 172.21.15.7:0/2887556284 shutdown_connections 2024-08-19T00:38:00.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.041+0000 7fe9ad800640 1 -- 172.21.15.7:0/2887556284 wait complete. 2024-08-19T00:38:00.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.043+0000 7fe9ad800640 1 Processor -- start 2024-08-19T00:38:00.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.043+0000 7fe9ad800640 1 -- start start 2024-08-19T00:38:00.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9ad800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9a809aa70 0x7fe9a8153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:00.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9ad800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9a809b730 0x7fe9a80b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:00.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9ad800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a80d0290 0x7fe9a815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:00.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9ad800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a80d0c60 con 0x7fe9a80d0290 2024-08-19T00:38:00.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9ad800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a815e8f0 con 0x7fe9a809b730 2024-08-19T00:38:00.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9ad800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a80d0de0 con 0x7fe9a809aa70 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9a7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a80d0290 0x7fe9a815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9a6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9a809aa70 0x7fe9a8153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9a6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9a809aa70 0x7fe9a8153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:55968/0 (socket says 172.21.15.7:55968) 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9a6a00640 1 -- 172.21.15.7:0/35335402 learned_addr learned my addr 172.21.15.7:0/35335402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.044+0000 7fe9a6000640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9a809b730 0x7fe9a80b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.045+0000 7fe9a6a00640 1 -- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9a809b730 msgr2=0x7fe9a80b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.045+0000 7fe9a6a00640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9a809b730 0x7fe9a80b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.045+0000 7fe9a6a00640 1 -- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a80d0290 msgr2=0x7fe9a815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.045+0000 7fe9a6a00640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a80d0290 0x7fe9a815fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.045+0000 7fe9a6a00640 1 -- 172.21.15.7:0/35335402 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a80b5870 con 0x7fe9a809aa70 2024-08-19T00:38:00.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.045+0000 7fe9a7400640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a80d0290 0x7fe9a815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:00.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.045+0000 7fe9a6a00640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9a809aa70 0x7fe9a8153280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe99802a2b0 tx=0x7fe9980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.047+0000 7fe99ea00640 1 -- 172.21.15.7:0/35335402 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998041070 con 0x7fe9a809aa70 2024-08-19T00:38:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.047+0000 7fe99ea00640 1 -- 172.21.15.7:0/35335402 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99803c870 con 0x7fe9a809aa70 2024-08-19T00:38:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.047+0000 7fe99ea00640 1 -- 172.21.15.7:0/35335402 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998037040 con 0x7fe9a809aa70 2024-08-19T00:38:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.047+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a80b5b50 con 0x7fe9a809aa70 2024-08-19T00:38:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.047+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a80b6110 con 0x7fe9a809aa70 2024-08-19T00:38:00.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.048+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a809ae50 con 0x7fe9a809aa70 2024-08-19T00:38:00.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.049+0000 7fe99ea00640 1 -- 172.21.15.7:0/35335402 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe998044070 con 0x7fe9a809aa70 2024-08-19T00:38:00.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.050+0000 7fe99ea00640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe98806be30 0x7fe98806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:00.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.050+0000 7fe99ea00640 1 -- 172.21.15.7:0/35335402 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fe9980abc70 con 0x7fe9a809aa70 2024-08-19T00:38:00.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.050+0000 7fe9a6000640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe98806be30 0x7fe98806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:00.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.051+0000 7fe9a6000640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe98806be30 0x7fe98806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80b6ee0 tx=0x7fe994009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:00.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.055+0000 7fe99ea00640 1 -- 172.21.15.7:0/35335402 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe998079f60 con 0x7fe9a809aa70 2024-08-19T00:38:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.274+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9a80c8d50 con 0x7fe9a809aa70 2024-08-19T00:38:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.274+0000 7fe99ea00640 1 -- 172.21.15.7:0/35335402 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5214 (secure 0 0 0) 0x7fe99807e260 con 0x7fe9a809aa70 2024-08-19T00:38:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:00.278 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"btime":"2024-08-19T00:38:00:037731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:37:59.039911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-08-19T00:38:00.278 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe98806be30 msgr2=0x7fe98806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe98806be30 0x7fe98806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80b6ee0 tx=0x7fe994009040 comp rx=0 tx=0).stop 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9a809aa70 msgr2=0x7fe9a8153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9a809aa70 0x7fe9a8153280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe99802a2b0 tx=0x7fe9980046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 shutdown_connections 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe98806be30 0x7fe98806e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a80d0290 0x7fe9a815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9a809b730 0x7fe9a80b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 --2- 172.21.15.7:0/35335402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9a809aa70 0x7fe9a8153280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:00.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 >> 172.21.15.7:0/35335402 conn(0x7fe9a80d2190 msgr2=0x7fe9a8074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:00.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 shutdown_connections 2024-08-19T00:38:00.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:00.277+0000 7fe9ad800640 1 -- 172.21.15.7:0/35335402 wait complete. 2024-08-19T00:38:00.699 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:37:47.095917+0000', 'modified': '2024-08-19T00:37:59.039911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 33, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4706}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4706': {'gid': 4706, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.162:6835/230096578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6833', 'nonce': 230096578}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 230096578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:38:00.699 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4706:up:rejoin 2024-08-19T00:38:01.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:38:01.039 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:38:01.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.866+0000 7fbec8a00640 1 Processor -- start 2024-08-19T00:38:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.866+0000 7fbec8a00640 1 -- start start 2024-08-19T00:38:01.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec8a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec40d3200 0x7fbec415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:01.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec8a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbec415e740 0x7fbec415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:01.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec8a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec40b3ab0 con 0x7fbec415e360 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec8a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbec415f460 con 0x7fbec415e740 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec8a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbec415f740 con 0x7fbec40d3200 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbec415e740 0x7fbec415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec2800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbec415e360 0x7fbec40d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34414/0 (socket says 172.21.15.7:34414) 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.867+0000 7fbec2800640 1 -- 172.21.15.7:0/2218469574 learned_addr learned my addr 172.21.15.7:0/2218469574 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.868+0000 7fbec1e00640 1 --2- 172.21.15.7:0/2218469574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec40d3200 0x7fbec415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.868+0000 7fbec3200640 1 -- 172.21.15.7:0/2218469574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec40d3200 msgr2=0x7fbec415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:01.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.868+0000 7fbec3200640 1 --2- 172.21.15.7:0/2218469574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec40d3200 0x7fbec415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:01.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.868+0000 7fbec3200640 1 -- 172.21.15.7:0/2218469574 >> v1:172.21.15.7:6789/0 conn(0x7fbec415e360 legacy=0x7fbec40d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:01.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.868+0000 7fbec3200640 1 -- 172.21.15.7:0/2218469574 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec40b3d60 con 0x7fbec415e740 2024-08-19T00:38:01.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.869+0000 7fbec3200640 1 --2- 172.21.15.7:0/2218469574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec415ebb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009d90 tx=0x7fbebc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975d4c4a7f0493d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:01.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.869+0000 7fbec1400640 1 -- 172.21.15.7:0/2218469574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc007740 con 0x7fbec415e740 2024-08-19T00:38:01.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.869+0000 7fbec1400640 1 -- 172.21.15.7:0/2218469574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc0078e0 con 0x7fbec415e740 2024-08-19T00:38:01.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.869+0000 7fbec1400640 1 -- 172.21.15.7:0/2218469574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc007cb0 con 0x7fbec415e740 2024-08-19T00:38:01.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 -- 172.21.15.7:0/2218469574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 msgr2=0x7fbec415ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2218469574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec415ebb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009d90 tx=0x7fbebc02a660 comp rx=0 tx=0).stop 2024-08-19T00:38:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 -- 172.21.15.7:0/2218469574 shutdown_connections 2024-08-19T00:38:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2218469574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec415ebb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2218469574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec40d3200 0x7fbec415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 -- 172.21.15.7:0/2218469574 >> 172.21.15.7:0/2218469574 conn(0x7fbec408dbf0 msgr2=0x7fbec409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 -- 172.21.15.7:0/2218469574 shutdown_connections 2024-08-19T00:38:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.870+0000 7fbec8a00640 1 -- 172.21.15.7:0/2218469574 wait complete. 2024-08-19T00:38:01.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.872+0000 7fbec8a00640 1 Processor -- start 2024-08-19T00:38:01.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.872+0000 7fbec8a00640 1 -- start start 2024-08-19T00:38:01.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.872+0000 7fbec8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec40d3200 0x7fbec41f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec8a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec415e360 0x7fbec4156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec40b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec8a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbec415f0f0 con 0x7fbec415e740 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40d2300 con 0x7fbec40d3200 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec8a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbec40b4560 con 0x7fbec415e360 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec40b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec40b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51784/0 (socket says 172.21.15.7:51784) 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 -- 172.21.15.7:0/2046360488 learned_addr learned my addr 172.21.15.7:0/2046360488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec1e00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec415e360 0x7fbec4156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:01.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec2800640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec40d3200 0x7fbec41f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:01.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 -- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec415e360 msgr2=0x7fbec4156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec415e360 0x7fbec4156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 -- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec40d3200 msgr2=0x7fbec41f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec40d3200 0x7fbec41f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.873+0000 7fbec3200640 1 -- 172.21.15.7:0/2046360488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec4156f90 con 0x7fbec415e740 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.874+0000 7fbec3200640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec40b23a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009eb0 tx=0x7fbebc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.874+0000 7fbebaa00640 1 -- 172.21.15.7:0/2046360488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc03f070 con 0x7fbec415e740 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.874+0000 7fbebaa00640 1 -- 172.21.15.7:0/2046360488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc031bc0 con 0x7fbec415e740 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.874+0000 7fbebaa00640 1 -- 172.21.15.7:0/2046360488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc044460 con 0x7fbec415e740 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.874+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec40b28e0 con 0x7fbec415e740 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.874+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec41f8730 con 0x7fbec415e740 2024-08-19T00:38:01.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.875+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec415ebb0 con 0x7fbec415e740 2024-08-19T00:38:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.876+0000 7fbebaa00640 1 -- 172.21.15.7:0/2046360488 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbebc007790 con 0x7fbec415e740 2024-08-19T00:38:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.877+0000 7fbebaa00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbea406be30 0x7fbea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:01.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.877+0000 7fbebaa00640 1 -- 172.21.15.7:0/2046360488 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fbebc0ac690 con 0x7fbec415e740 2024-08-19T00:38:01.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.877+0000 7fbec2800640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbea406be30 0x7fbea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:01.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.878+0000 7fbec2800640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbea406be30 0x7fbea406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4007fd0 tx=0x7fbeb4007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:01.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:01.881+0000 7fbebaa00640 1 -- 172.21.15.7:0/2046360488 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbebc07a8f0 con 0x7fbec415e740 2024-08-19T00:38:02.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.102+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbec40c7660 con 0x7fbec415e740 2024-08-19T00:38:02.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.103+0000 7fbebaa00640 1 -- 172.21.15.7:0/2046360488 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5221 (secure 0 0 0) 0x7fbebc07ebf0 con 0x7fbec415e740 2024-08-19T00:38:02.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:02.106 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"btime":"2024-08-19T00:38:01:044484+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:38:01.044479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4706,"qdb_cluster":[4706]},"id":2}]} 2024-08-19T00:38:02.106 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbea406be30 msgr2=0x7fbea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbea406be30 0x7fbea406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4007fd0 tx=0x7fbeb4007e80 comp rx=0 tx=0).stop 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 msgr2=0x7fbec40b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec40b23a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009eb0 tx=0x7fbebc004a40 comp rx=0 tx=0).stop 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 shutdown_connections 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbea406be30 0x7fbea406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbec415e740 0x7fbec40b23a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec415e360 0x7fbec4156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 --2- 172.21.15.7:0/2046360488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec40d3200 0x7fbec41f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 >> 172.21.15.7:0/2046360488 conn(0x7fbec408dbf0 msgr2=0x7fbec406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 shutdown_connections 2024-08-19T00:38:02.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.105+0000 7fbec8a00640 1 -- 172.21.15.7:0/2046360488 wait complete. 2024-08-19T00:38:02.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:37:47.095917+0000', 'modified': '2024-08-19T00:38:01.044479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 33, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4706}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4706': {'gid': 4706, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.162:6835/230096578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6833', 'nonce': 230096578}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 230096578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4706, 'qdb_cluster': [4706]} 2024-08-19T00:38:02.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:38:02.528 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-19T00:38:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.685+0000 7f41d4c00640 1 Processor -- start 2024-08-19T00:38:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.686+0000 7f41d4c00640 1 -- start start 2024-08-19T00:38:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41d4c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f41d0159bf0 0x7f41d0073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41d4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f41d00cec10 0x7f41d00d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41d4c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d006f7f0 con 0x7f41d00739a0 2024-08-19T00:38:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41d4c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f41d006f510 con 0x7f41d00cec10 2024-08-19T00:38:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41d4c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f41d0072980 con 0x7f41d0159bf0 2024-08-19T00:38:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41cd400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f41d00739a0 0x7f41d00ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34424/0 (socket says 172.21.15.7:34424) 2024-08-19T00:38:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41cd400640 1 -- 172.21.15.7:0/3299279542 learned_addr learned my addr 172.21.15.7:0/3299279542 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41ce800640 1 --2- 172.21.15.7:0/3299279542 >> v2:172.21.15.7:3300/0 conn(0x7f41d00cec10 0x7f41d00d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41cde00640 1 --2- 172.21.15.7:0/3299279542 >> v2:172.21.15.162:3300/0 conn(0x7f41d0159bf0 0x7f41d0073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41ce800640 1 -- 172.21.15.7:0/3299279542 >> v2:172.21.15.162:3300/0 conn(0x7f41d0159bf0 msgr2=0x7f41d0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41ce800640 1 --2- 172.21.15.7:0/3299279542 >> v2:172.21.15.162:3300/0 conn(0x7f41d0159bf0 0x7f41d0073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41ce800640 1 -- 172.21.15.7:0/3299279542 >> v1:172.21.15.7:6789/0 conn(0x7f41d00739a0 legacy=0x7f41d00ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.687+0000 7f41ce800640 1 -- 172.21.15.7:0/3299279542 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d0072c60 con 0x7f41d00cec10 2024-08-19T00:38:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.688+0000 7f41ce800640 1 --2- 172.21.15.7:0/3299279542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00cec10 0x7f41d00d03c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41d006d280 tx=0x7f41c802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0bd8d9096770a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41cca00640 1 -- 172.21.15.7:0/3299279542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8007740 con 0x7f41d00cec10 2024-08-19T00:38:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41cca00640 1 -- 172.21.15.7:0/3299279542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c80078e0 con 0x7f41d00cec10 2024-08-19T00:38:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41cca00640 1 -- 172.21.15.7:0/3299279542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8007cb0 con 0x7f41d00cec10 2024-08-19T00:38:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 -- 172.21.15.7:0/3299279542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00cec10 msgr2=0x7f41d00d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 --2- 172.21.15.7:0/3299279542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00cec10 0x7f41d00d03c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41d006d280 tx=0x7f41c802a5f0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 -- 172.21.15.7:0/3299279542 shutdown_connections 2024-08-19T00:38:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 --2- 172.21.15.7:0/3299279542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00cec10 0x7f41d00d03c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 --2- 172.21.15.7:0/3299279542 >> v2:172.21.15.162:3300/0 conn(0x7f41d0159bf0 0x7f41d0073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 -- 172.21.15.7:0/3299279542 >> 172.21.15.7:0/3299279542 conn(0x7f41d006bc70 msgr2=0x7f41d006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 -- 172.21.15.7:0/3299279542 shutdown_connections 2024-08-19T00:38:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.689+0000 7f41d4c00640 1 -- 172.21.15.7:0/3299279542 wait complete. 2024-08-19T00:38:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.691+0000 7f41d4c00640 1 Processor -- start 2024-08-19T00:38:02.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.691+0000 7f41d4c00640 1 -- start start 2024-08-19T00:38:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.692+0000 7f41d4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00739a0 0x7f41d01f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.692+0000 7f41d4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41d0159bf0 0x7f41d01f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.692+0000 7f41d4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41d01f7270 0x7f41d009c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.692+0000 7f41d4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41d015a150 con 0x7f41d00739a0 2024-08-19T00:38:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.692+0000 7f41d4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0159fd0 con 0x7f41d0159bf0 2024-08-19T00:38:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.692+0000 7f41d4c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41d00d0900 con 0x7f41d01f7270 2024-08-19T00:38:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.692+0000 7f41cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00739a0 0x7f41d01f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00739a0 0x7f41d01f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51806/0 (socket says 172.21.15.7:51806) 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 -- 172.21.15.7:0/2314076183 learned_addr learned my addr 172.21.15.7:0/2314076183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cd400640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41d0159bf0 0x7f41d01f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41ce800640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41d01f7270 0x7f41d009c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 -- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41d01f7270 msgr2=0x7f41d009c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41d01f7270 0x7f41d009c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 -- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41d0159bf0 msgr2=0x7f41d01f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41d0159bf0 0x7f41d01f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 -- 172.21.15.7:0/2314076183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d01f7700 con 0x7f41d00739a0 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cd400640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41d0159bf0 0x7f41d01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41cde00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00739a0 0x7f41d01f36e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41c000e9b0 tx=0x7f41c000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.693+0000 7f41c6000640 1 -- 172.21.15.7:0/2314076183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0017070 con 0x7f41d00739a0 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.694+0000 7f41c6000640 1 -- 172.21.15.7:0/2314076183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c000c9a0 con 0x7f41d00739a0 2024-08-19T00:38:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.694+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d01f79e0 con 0x7f41d00739a0 2024-08-19T00:38:02.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.694+0000 7f41c6000640 1 -- 172.21.15.7:0/2314076183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c000cd90 con 0x7f41d00739a0 2024-08-19T00:38:02.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.694+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d01f7fa0 con 0x7f41d00739a0 2024-08-19T00:38:02.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.696+0000 7f41c6000640 1 -- 172.21.15.7:0/2314076183 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41c001a070 con 0x7f41d00739a0 2024-08-19T00:38:02.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.697+0000 7f41c6000640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41b006be30 0x7f41b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.697+0000 7f41c6000640 1 -- 172.21.15.7:0/2314076183 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f41c008b2d0 con 0x7f41d00739a0 2024-08-19T00:38:02.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.697+0000 7f41cd400640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41b006be30 0x7f41b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.698+0000 7f41d7c24740 1 Processor -- start 2024-08-19T00:38:02.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.698+0000 7f41d7c24740 1 -- start start 2024-08-19T00:38:02.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.698+0000 7f41cd400640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41b006be30 0x7f41b006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f41d0155930 tx=0x7f41bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f606e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091470 0x55e8f6091890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091dd0 0x55e8f6086df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41d7c24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8f5fa6ba0 con 0x55e8f6091470 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e8f5f3f230 con 0x55e8f606df50 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e8f5fa2b60 con 0x55e8f6091dd0 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091470 0x55e8f6091890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f606e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091470 0x55e8f6091890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51814/0 (socket says 172.21.15.7:51814) 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 -- 172.21.15.7:0/1056176102 learned_addr learned my addr 172.21.15.7:0/1056176102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41ce800640 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091dd0 0x55e8f6086df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 -- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091dd0 msgr2=0x55e8f6086df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091dd0 0x55e8f6086df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 -- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 msgr2=0x55e8f606e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f606e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cd400640 1 -- 172.21.15.7:0/1056176102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f5f70bb0 con 0x55e8f6091470 2024-08-19T00:38:02.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.699+0000 7f41cde00640 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f606e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:02.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.700+0000 7f41cd400640 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091470 0x55e8f6091890 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41bc005a80 tx=0x7f41bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23325bd4f18cf053 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.700+0000 7f41ba600640 1 -- 172.21.15.7:0/1056176102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00e500 con 0x55e8f6091470 2024-08-19T00:38:02.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.700+0000 7f41ba600640 1 -- 172.21.15.7:0/1056176102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc00e6a0 con 0x55e8f6091470 2024-08-19T00:38:02.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.700+0000 7f41ba600640 1 -- 172.21.15.7:0/1056176102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00ea50 con 0x55e8f6091470 2024-08-19T00:38:02.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.700+0000 7f41d7c24740 1 -- 172.21.15.7:0/1056176102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091470 msgr2=0x55e8f6091890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.700+0000 7f41d7c24740 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091470 0x55e8f6091890 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41bc005a80 tx=0x7f41bc011000 comp rx=0 tx=0).stop 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 -- 172.21.15.7:0/1056176102 shutdown_connections 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091dd0 0x55e8f6086df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091470 0x55e8f6091890 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 --2- 172.21.15.7:0/1056176102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f606e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 -- 172.21.15.7:0/1056176102 >> 172.21.15.7:0/1056176102 conn(0x55e8f600b110 msgr2=0x55e8f6088d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 -- 172.21.15.7:0/1056176102 shutdown_connections 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 -- 172.21.15.7:0/1056176102 wait complete. 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 -- start start 2024-08-19T00:38:02.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.701+0000 7f41d7c24740 1 Processor -- start 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.702+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 0x55e8f606aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.702+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.702+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f605e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.702+0000 7f41d7c24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8f608aea0 con 0x55e8f6091dd0 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.702+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e8f5f62250 con 0x55e8f6091470 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.702+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e8f608a5b0 con 0x55e8f606df50 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41d7c24740 10 client.0 _ll_register_callbacks cb 0x55e8f5f66740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f605e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f605e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51830/0 (socket says 172.21.15.7:51830) 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 -- 172.21.15.7:0/2819157145 learned_addr learned my addr 172.21.15.7:0/2819157145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:02.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41cde00640 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 0x55e8f606aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41cd400640 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 -- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 msgr2=0x55e8f606aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 0x55e8f606aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 -- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 msgr2=0x55e8f6063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6063100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.703+0000 7f41ce800640 1 -- 172.21.15.7:0/2819157145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f5cba2d0 con 0x55e8f6091dd0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41ce800640 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f605e810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41c802abe0 tx=0x7f41c8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f5c90bc8f05c65 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41aea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41aea00640 1 -- 172.21.15.7:0/2819157145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c803d430 con 0x55e8f6091dd0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41aea00640 1 -- 172.21.15.7:0/2819157145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f41c803d5d0 con 0x55e8f6091dd0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41bc00e6a0 con 0x55e8f6091dd0 2024-08-19T00:38:02.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41aea00640 1 -- 172.21.15.7:0/2819157145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f41c8050050 con 0x55e8f6091dd0 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41d7c24740 10 client.5019 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55e8f5d846b0 con 0x55e8f6091dd0 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41aea00640 1 -- 172.21.15.7:0/2819157145 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc00e6a0 con 0x55e8f6091dd0 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41aea00640 1 -- 172.21.15.7:0/2819157145 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f41c8053020 con 0x55e8f6091dd0 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41d7c24740 10 client.5019 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.704+0000 7f41d7c24740 10 client.5019 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.705+0000 7f41d7c24740 20 client.5019 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.705+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f6069630 0x55e8f6069a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.705+0000 7f41d7c24740 4 client.5019 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.705+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8f5fb42d0 con 0x55e8f6069630 2024-08-19T00:38:02.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.705+0000 7f41cde00640 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f6069630 0x55e8f6069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.706+0000 7f41cde00640 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f6069630 0x55e8f6069a10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca910d5347c2b343 server_cookie=d30969c9d1de5b5a in_seq=0 out_seq=0 2024-08-19T00:38:02.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.706+0000 7f41aea00640 10 client.5019 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:02.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41aea00640 1 -- 172.21.15.7:0/2819157145 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8f5fb42d0 con 0x55e8f6069630 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41aea00640 10 client.5019 handle_command_reply: tid=0 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 client.5019 shutdown 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 msgr2=0x55e8f605e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f605e810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41c802abe0 tx=0x7f41c8004ab0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 shutdown_connections 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f605e810 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f6069630 0x55e8f6069a10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6063100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2819157145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 0x55e8f606aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 >> 172.21.15.7:0/2819157145 conn(0x55e8f600b110 msgr2=0x55e8f6088c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41aea00640 0 client.5019 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 shutdown_connections 2024-08-19T00:38:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.707+0000 7f41d7c24740 1 -- 172.21.15.7:0/2819157145 wait complete. 2024-08-19T00:38:02.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.708+0000 7f41d7c24740 20 client.5019 trim_cache size 0 max 16384 2024-08-19T00:38:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.726+0000 7f41d7c24740 1 Processor -- start 2024-08-19T00:38:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.727+0000 7f41d7c24740 1 -- start start 2024-08-19T00:38:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.727+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 0x55e8f6039c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.727+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6069a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.727+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f6069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.727+0000 7f41d7c24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41d01ffb30 con 0x55e8f6091dd0 2024-08-19T00:38:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.727+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41d00b4a70 con 0x55e8f6091470 2024-08-19T00:38:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.727+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41d01ff5e0 con 0x55e8f606df50 2024-08-19T00:38:02.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f6069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f6069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51836/0 (socket says 172.21.15.7:51836) 2024-08-19T00:38:02.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 -- 172.21.15.7:0/2950914100 learned_addr learned my addr 172.21.15.7:0/2950914100 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:02.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 -- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 msgr2=0x55e8f6039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 0x55e8f6039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 -- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 msgr2=0x55e8f6069a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41cd400640 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6069a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 -- 172.21.15.7:0/2950914100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f608b640 con 0x55e8f6091dd0 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41cd400640 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6069a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.728+0000 7f41ce800640 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f6069f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f41c8002230 tx=0x7f41c8042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d308d75686cb61e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41b9c00640 1 -- 172.21.15.7:0/2950914100 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c802ac70 con 0x55e8f6091dd0 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41b9c00640 1 -- 172.21.15.7:0/2950914100 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c803d430 con 0x55e8f6091dd0 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41b9c00640 1 -- 172.21.15.7:0/2950914100 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c803d990 con 0x55e8f6091dd0 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 -- 172.21.15.7:0/2950914100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 msgr2=0x55e8f6069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f6069f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f41c8002230 tx=0x7f41c8042000 comp rx=0 tx=0).stop 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 -- 172.21.15.7:0/2950914100 shutdown_connections 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f6069f50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f6091470 0x55e8f6069a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 --2- 172.21.15.7:0/2950914100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f606df50 0x55e8f6039c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 -- 172.21.15.7:0/2950914100 >> 172.21.15.7:0/2950914100 conn(0x55e8f600b110 msgr2=0x55e8f6067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 -- 172.21.15.7:0/2950914100 shutdown_connections 2024-08-19T00:38:02.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.729+0000 7f41d7c24740 1 -- 172.21.15.7:0/2950914100 wait complete. 2024-08-19T00:38:02.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.730+0000 7f41d7c24740 1 -- start start 2024-08-19T00:38:02.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.730+0000 7f41d7c24740 1 Processor -- start 2024-08-19T00:38:02.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f60ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091470 0x55e8f60a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41d7c24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f60a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41d7c24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8f6066c70 con 0x55e8f6091dd0 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e8f6063fd0 con 0x55e8f606df50 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41d7c24740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e8f6066160 con 0x55e8f6091470 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41d7c24740 10 client.0 _ll_register_callbacks cb 0x7f41c8009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f60a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f60a2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51850/0 (socket says 172.21.15.7:51850) 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41ce800640 1 -- 172.21.15.7:0/23899884 learned_addr learned my addr 172.21.15.7:0/23899884 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41cde00640 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f60ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.731+0000 7f41cd400640 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091470 0x55e8f60a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41ce800640 1 -- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091470 msgr2=0x55e8f60a2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41ce800640 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091470 0x55e8f60a2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41ce800640 1 -- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 msgr2=0x55e8f60ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41ce800640 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f60ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41ce800640 1 -- 172.21.15.7:0/23899884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f60ab9d0 con 0x55e8f6091dd0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41ce800640 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f60a2ab0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c090 tx=0x7f41c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d3817ed6697cd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41aea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41aea00640 1 -- 172.21.15.7:0/23899884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c802ac70 con 0x55e8f6091dd0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41aea00640 1 -- 172.21.15.7:0/23899884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f41c8059070 con 0x55e8f6091dd0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41c803d430 con 0x55e8f6091dd0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.732+0000 7f41aea00640 1 -- 172.21.15.7:0/23899884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f41c803dba0 con 0x55e8f6091dd0 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 10 client.5025 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:02.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55e8f6068e40 con 0x55e8f6091dd0 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41aea00640 1 -- 172.21.15.7:0/23899884 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c803d430 con 0x55e8f6091dd0 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41aea00640 1 -- 172.21.15.7:0/23899884 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f41c8053040 con 0x55e8f6091dd0 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 10 client.5025 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 10 client.5025 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 20 client.5025 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f60853a0 0x55e8f6085780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 4 client.5025 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "status"}) -- 0x55e8f5fae620 con 0x55e8f60853a0 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.733+0000 7f41cde00640 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f60853a0 0x55e8f6085780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.734+0000 7f41cde00640 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f60853a0 0x55e8f6085780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e319f0acebab9272 server_cookie=1880a8426b4b0582 in_seq=0 out_seq=0 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.734+0000 7f41aea00640 10 client.5025 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41aea00640 1 -- 172.21.15.7:0/23899884 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55e8f5fae620 con 0x55e8f60853a0 2024-08-19T00:38:02.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41aea00640 10 client.5025 handle_command_reply: tid=0 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 client.5025 shutdown 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 msgr2=0x55e8f60a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f60a2ab0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c090 tx=0x7f41c8009750 comp rx=0 tx=0).stop 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 shutdown_connections 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8f6091dd0 0x55e8f60a2ab0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8f6091470 0x55e8f60a2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55e8f60853a0 0x55e8f6085780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 --2- 172.21.15.7:0/23899884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8f606df50 0x55e8f60ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 >> 172.21.15.7:0/23899884 conn(0x55e8f600b110 msgr2=0x55e8f6039c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41aea00640 0 client.5025 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 shutdown_connections 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 1 -- 172.21.15.7:0/23899884 wait complete. 2024-08-19T00:38:02.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.735+0000 7f41d7c24740 20 client.5025 trim_cache size 0 max 16384 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4706, 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.6994226320000001, 2024-08-19T00:38:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 21, 2024-08-19T00:38:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 33, 2024-08-19T00:38:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 33, 2024-08-19T00:38:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 5.2683805460000004 2024-08-19T00:38:02.743 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41b006be30 msgr2=0x7f41b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41b006be30 0x7f41b006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f41d0155930 tx=0x7f41bc009040 comp rx=0 tx=0).stop 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00739a0 msgr2=0x7f41d01f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00739a0 0x7f41d01f36e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41c000e9b0 tx=0x7f41c000ee70 comp rx=0 tx=0).stop 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 shutdown_connections 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41b006be30 0x7f41b006e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41d01f7270 0x7f41d009c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41d0159bf0 0x7f41d01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 --2- 172.21.15.7:0/2314076183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d00739a0 0x7f41d01f36e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 >> 172.21.15.7:0/2314076183 conn(0x7f41d006bc70 msgr2=0x7f41d0074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 shutdown_connections 2024-08-19T00:38:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.736+0000 7f41d4c00640 1 -- 172.21.15.7:0/2314076183 wait complete. 2024-08-19T00:38:02.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:38:02.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.908+0000 7f7588e00640 1 Processor -- start 2024-08-19T00:38:02.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.909+0000 7f7588e00640 1 -- start start 2024-08-19T00:38:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7588e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7584159bf0 0x7f7584073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7588e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758406f7f0 con 0x7f75840cec10 2024-08-19T00:38:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7588e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758406f510 con 0x7f75840739a0 2024-08-19T00:38:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7588e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7584072980 con 0x7f7584159bf0 2024-08-19T00:38:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7582800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f75840cec10 0x7f75840d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34430/0 (socket says 172.21.15.7:34430) 2024-08-19T00:38:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7582800640 1 -- 172.21.15.7:0/196485943 learned_addr learned my addr 172.21.15.7:0/196485943 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7581e00640 1 --2- 172.21.15.7:0/196485943 >> v2:172.21.15.162:3300/0 conn(0x7f7584159bf0 0x7f7584073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.910+0000 7f7581400640 1 -- 172.21.15.7:0/196485943 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150611822 0 0) 0x7f758406f7f0 con 0x7f75840cec10 2024-08-19T00:38:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.911+0000 7f7581400640 1 -- 172.21.15.7:0/196485943 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7568003520 con 0x7f75840cec10 2024-08-19T00:38:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.911+0000 7f7581400640 1 -- 172.21.15.7:0/196485943 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2813796450 0 0) 0x7f7568003520 con 0x7f75840cec10 2024-08-19T00:38:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.911+0000 7f7581e00640 1 -- 172.21.15.7:0/196485943 >> v1:172.21.15.162:6789/0 conn(0x7f75840739a0 legacy=0x7f75840ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.911+0000 7f7581e00640 1 -- 172.21.15.7:0/196485943 >> v1:172.21.15.7:6789/0 conn(0x7f75840cec10 legacy=0x7f75840d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.911+0000 7f7581e00640 1 -- 172.21.15.7:0/196485943 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7584072c60 con 0x7f7584159bf0 2024-08-19T00:38:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.912+0000 7f7581e00640 1 --2- 172.21.15.7:0/196485943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 0x7f7584073460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75740097a0 tx=0x7f757402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94cb7c65a37c4a02 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7581400640 1 -- 172.21.15.7:0/196485943 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574037070 con 0x7f7584159bf0 2024-08-19T00:38:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7581400640 1 -- 172.21.15.7:0/196485943 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757402abc0 con 0x7f7584159bf0 2024-08-19T00:38:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7581400640 1 -- 172.21.15.7:0/196485943 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c0019f0 con 0x7f7584159bf0 2024-08-19T00:38:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7588e00640 1 -- 172.21.15.7:0/196485943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 msgr2=0x7f7584073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7588e00640 1 --2- 172.21.15.7:0/196485943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 0x7f7584073460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75740097a0 tx=0x7f757402a130 comp rx=0 tx=0).stop 2024-08-19T00:38:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7588e00640 1 -- 172.21.15.7:0/196485943 shutdown_connections 2024-08-19T00:38:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7588e00640 1 --2- 172.21.15.7:0/196485943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 0x7f7584073460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7588e00640 1 -- 172.21.15.7:0/196485943 >> 172.21.15.7:0/196485943 conn(0x7f758406bc70 msgr2=0x7f758406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7588e00640 1 -- 172.21.15.7:0/196485943 shutdown_connections 2024-08-19T00:38:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.913+0000 7f7588e00640 1 -- 172.21.15.7:0/196485943 wait complete. 2024-08-19T00:38:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.915+0000 7f7588e00640 1 Processor -- start 2024-08-19T00:38:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.915+0000 7f7588e00640 1 -- start start 2024-08-19T00:38:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7588e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75840739a0 0x7f75841f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7588e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 0x7f75841f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7588e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f758409ba00 0x7f758409beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7588e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f758415a150 con 0x7f75840739a0 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7588e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7584159fd0 con 0x7f7584159bf0 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7588e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75840d0ad0 con 0x7f758409ba00 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7581e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75840739a0 0x7f75841f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7581e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75840739a0 0x7f75841f82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51856/0 (socket says 172.21.15.7:51856) 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7581e00640 1 -- 172.21.15.7:0/1575561523 learned_addr learned my addr 172.21.15.7:0/1575561523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7582800640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f758409ba00 0x7f758409beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.916+0000 7f7579400640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 0x7f75841f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f7581e00640 1 -- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f758409ba00 msgr2=0x7f758409beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f7581e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f758409ba00 0x7f758409beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f7581e00640 1 -- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 msgr2=0x7f75841f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f7581e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 0x7f75841f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f7581e00640 1 -- 172.21.15.7:0/1575561523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75841f8830 con 0x7f75840739a0 2024-08-19T00:38:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f7581e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75840739a0 0x7f75841f82f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7574035040 tx=0x7f75740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f757aa00640 1 -- 172.21.15.7:0/1575561523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574041070 con 0x7f75840739a0 2024-08-19T00:38:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f757aa00640 1 -- 172.21.15.7:0/1575561523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757403c660 con 0x7f75840739a0 2024-08-19T00:38:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f757aa00640 1 -- 172.21.15.7:0/1575561523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574037040 con 0x7f75840739a0 2024-08-19T00:38:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.917+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7584157170 con 0x7f75840739a0 2024-08-19T00:38:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.918+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7584157730 con 0x7f75840739a0 2024-08-19T00:38:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.918+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7584073460 con 0x7f75840739a0 2024-08-19T00:38:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.920+0000 7f757aa00640 1 -- 172.21.15.7:0/1575561523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7574044070 con 0x7f75840739a0 2024-08-19T00:38:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.920+0000 7f757aa00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f756006be60 0x7f756006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.921+0000 7f757aa00640 1 -- 172.21.15.7:0/1575561523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f75740ab7c0 con 0x7f75840739a0 2024-08-19T00:38:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.921+0000 7f7579400640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f756006be60 0x7f756006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:02.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.921+0000 7f7579400640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f756006be60 0x7f756006e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f756c007fd0 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:02.925+0000 7f757aa00640 1 -- 172.21.15.7:0/1575561523 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f75841f8830 con 0x7f75840739a0 2024-08-19T00:38:03.043 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-08-19T00:38:03.042+0000 7f7f77a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:38:03.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.145+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f758415c010 con 0x7f75840739a0 2024-08-19T00:38:03.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.145+0000 7f757aa00640 1 -- 172.21.15.7:0/1575561523 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7f757407a220 con 0x7f75840739a0 2024-08-19T00:38:03.148 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.147+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f756006be60 msgr2=0x7f756006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.147+0000 7f7588e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f756006be60 0x7f756006e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f756c007fd0 tx=0x7f756c009040 comp rx=0 tx=0).stop 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.147+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75840739a0 msgr2=0x7f75841f82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.147+0000 7f7588e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75840739a0 0x7f75841f82f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7574035040 tx=0x7f75740046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 shutdown_connections 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f756006be60 0x7f756006e320 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f758409ba00 0x7f758409beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584159bf0 0x7f75841f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 --2- 172.21.15.7:0/1575561523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75840739a0 0x7f75841f82f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 >> 172.21.15.7:0/1575561523 conn(0x7f758406bc70 msgr2=0x7f758415ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 shutdown_connections 2024-08-19T00:38:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03.148+0000 7f7588e00640 1 -- 172.21.15.7:0/1575561523 wait complete. 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:38:03.167 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:38:03.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:03.168 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:38:03.204 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42778sec preferred_lft 42778sec 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:03.205 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:38:03.206 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:38:03.207 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:38:03.207 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:03.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:03.207 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:38:03.298 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:38:03.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:03.301 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:38:03.337 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:38:03.337 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:38:03.337 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:38:03.337 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:38:03.337 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:38:03.338 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:38:03.338 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:38:03.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:38:03.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:38:03.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:38:03.338 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:38:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:38:03.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:38:03.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:03.537 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:38:03.572 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:38:03.572 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:38:03.572 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:38:03.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:03.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:38:03.668 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:38:03.669 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:03.706 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:38:03.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:38:03.707 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:03.781 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:38:03.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:03.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:03.910 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:03.910 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:38:03.910 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:38:03.926 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:03.926 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:38:03.926 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:38:03.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:38:03.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:38:03.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:38:03.951 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:38:03.951 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:38:03.952 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:38:03.952 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:38:03.952 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:38:03.954 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:38:03.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:03.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:04.011 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:38:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:38:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:38:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:client5034 2024-08-19T00:38:04.103 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:04.104 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:04.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:04.140 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-08-19T00:38:04.218 INFO:teuthology.orchestra.run.smithi007.stdout:file_undamaged 2024-08-19T00:38:04.219 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:38:04.219 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> import json 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(e.errno) 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:38:04.220 DEBUG:teuthology.orchestra.run.smithi007:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-19T00:38:04.221 DEBUG:teuthology.orchestra.run.smithi007:> print(json.dumps( 2024-08-19T00:38:04.221 DEBUG:teuthology.orchestra.run.smithi007:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-19T00:38:04.221 DEBUG:teuthology.orchestra.run.smithi007:> indent=2)) 2024-08-19T00:38:04.221 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:38:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-08-19T00:38:04.373 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-08-19T00:38:04.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:04.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.568+0000 7f1f23400640 1 Processor -- start 2024-08-19T00:38:04.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.568+0000 7f1f23400640 1 -- start start 2024-08-19T00:38:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f23400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1f1c071980 0x7f1f1c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f23400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c0cdfb0 con 0x7f1f1c0d03c0 2024-08-19T00:38:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f23400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c0ce290 con 0x7f1f1c06e710 2024-08-19T00:38:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f23400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c0cebc0 con 0x7f1f1c071980 2024-08-19T00:38:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f20a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1f1c0d03c0 0x7f1f1c0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53182/0 (socket says 172.21.15.7:53182) 2024-08-19T00:38:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f20a00640 1 -- 172.21.15.7:0/142522384 learned_addr learned my addr 172.21.15.7:0/142522384 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:04.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f21400640 1 --2- 172.21.15.7:0/142522384 >> v2:172.21.15.162:3300/0 conn(0x7f1f1c071980 0x7f1f1c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f1b400640 1 -- 172.21.15.7:0/142522384 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634616983 0 0) 0x7f1f1c0cdfb0 con 0x7f1f1c0d03c0 2024-08-19T00:38:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f1b400640 1 -- 172.21.15.7:0/142522384 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f04003520 con 0x7f1f1c0d03c0 2024-08-19T00:38:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.570+0000 7f1f1b400640 1 -- 172.21.15.7:0/142522384 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570045437 0 0) 0x7f1f1c0ce290 con 0x7f1f1c06e710 2024-08-19T00:38:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.571+0000 7f1f1b400640 1 -- 172.21.15.7:0/142522384 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c0cdfb0 con 0x7f1f1c06e710 2024-08-19T00:38:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.571+0000 7f1f21400640 1 -- 172.21.15.7:0/142522384 >> v1:172.21.15.162:6789/0 conn(0x7f1f1c06e710 legacy=0x7f1f1c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.571+0000 7f1f21400640 1 -- 172.21.15.7:0/142522384 >> v1:172.21.15.7:6789/0 conn(0x7f1f1c0d03c0 legacy=0x7f1f1c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.571+0000 7f1f21400640 1 -- 172.21.15.7:0/142522384 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c0ce570 con 0x7f1f1c071980 2024-08-19T00:38:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.572+0000 7f1f21400640 1 --2- 172.21.15.7:0/142522384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c071980 0x7f1f1c0cf050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009dc0 tx=0x7f1f1402a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5732bab52a363902 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.572+0000 7f1f1b400640 1 -- 172.21.15.7:0/142522384 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007740 con 0x7f1f1c071980 2024-08-19T00:38:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.572+0000 7f1f1b400640 1 -- 172.21.15.7:0/142522384 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f140078e0 con 0x7f1f1c071980 2024-08-19T00:38:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.572+0000 7f1f1b400640 1 -- 172.21.15.7:0/142522384 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007cb0 con 0x7f1f1c071980 2024-08-19T00:38:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.572+0000 7f1f23400640 1 -- 172.21.15.7:0/142522384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c071980 msgr2=0x7f1f1c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.572+0000 7f1f23400640 1 --2- 172.21.15.7:0/142522384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c071980 0x7f1f1c0cf050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009dc0 tx=0x7f1f1402a730 comp rx=0 tx=0).stop 2024-08-19T00:38:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.573+0000 7f1f23400640 1 -- 172.21.15.7:0/142522384 shutdown_connections 2024-08-19T00:38:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.573+0000 7f1f23400640 1 --2- 172.21.15.7:0/142522384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c071980 0x7f1f1c0cf050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.573+0000 7f1f23400640 1 -- 172.21.15.7:0/142522384 >> 172.21.15.7:0/142522384 conn(0x7f1f1c06bc70 msgr2=0x7f1f1c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.573+0000 7f1f23400640 1 -- 172.21.15.7:0/142522384 shutdown_connections 2024-08-19T00:38:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.573+0000 7f1f23400640 1 -- 172.21.15.7:0/142522384 wait complete. 2024-08-19T00:38:04.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.574+0000 7f1f23400640 1 Processor -- start 2024-08-19T00:38:04.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.574+0000 7f1f23400640 1 -- start start 2024-08-19T00:38:04.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.575+0000 7f1f23400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c06e710 0x7f1f1c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.575+0000 7f1f23400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f1c071980 0x7f1f1c1f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.575+0000 7f1f23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1c0d03c0 0x7f1f1c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.575+0000 7f1f23400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c073c60 con 0x7f1f1c0d03c0 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.575+0000 7f1f23400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c073ae0 con 0x7f1f1c06e710 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.575+0000 7f1f23400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c0cf590 con 0x7f1f1c071980 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f21400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1c0d03c0 0x7f1f1c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c06e710 0x7f1f1c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c06e710 0x7f1f1c1547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:47316/0 (socket says 172.21.15.7:47316) 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 -- 172.21.15.7:0/999447436 learned_addr learned my addr 172.21.15.7:0/999447436 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f1be00640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f1c071980 0x7f1f1c1f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 -- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f1c071980 msgr2=0x7f1f1c1f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f1c071980 0x7f1f1c1f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 -- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1c0d03c0 msgr2=0x7f1f1c1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1c0d03c0 0x7f1f1c1593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 -- 172.21.15.7:0/999447436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c1f5460 con 0x7f1f1c06e710 2024-08-19T00:38:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.576+0000 7f1f20a00640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c06e710 0x7f1f1c1547c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c500 tx=0x7f1f1000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:04.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.577+0000 7f1f18c00640 1 -- 172.21.15.7:0/999447436 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10017070 con 0x7f1f1c06e710 2024-08-19T00:38:04.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.577+0000 7f1f18c00640 1 -- 172.21.15.7:0/999447436 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f10005ce0 con 0x7f1f1c06e710 2024-08-19T00:38:04.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.577+0000 7f1f18c00640 1 -- 172.21.15.7:0/999447436 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f100072f0 con 0x7f1f1c06e710 2024-08-19T00:38:04.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.577+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c153ba0 con 0x7f1f1c06e710 2024-08-19T00:38:04.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.577+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c155be0 con 0x7f1f1c06e710 2024-08-19T00:38:04.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.578+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c06e510 con 0x7f1f1c06e710 2024-08-19T00:38:04.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.579+0000 7f1f18c00640 1 -- 172.21.15.7:0/999447436 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f1001a070 con 0x7f1f1c06e710 2024-08-19T00:38:04.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.580+0000 7f1f18c00640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1efc06be30 0x7f1efc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.580+0000 7f1f18c00640 1 -- 172.21.15.7:0/999447436 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f1f1008a1e0 con 0x7f1f1c06e710 2024-08-19T00:38:04.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.580+0000 7f1f1be00640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1efc06be30 0x7f1efc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.581+0000 7f1f1be00640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1efc06be30 0x7f1efc06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f08007fd0 tx=0x7f1f08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:04.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.585+0000 7f1f18c00640 1 -- 172.21.15.7:0/999447436 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1f1c06e510 con 0x7f1f1c06e710 2024-08-19T00:38:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.806+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f1c0ce290 con 0x7f1f1c06e710 2024-08-19T00:38:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.807+0000 7f1f18c00640 1 -- 172.21.15.7:0/999447436 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5221 (secure 0 0 0) 0x7f1f100584d0 con 0x7f1f1c06e710 2024-08-19T00:38:04.810 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:04.810 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"btime":"2024-08-19T00:38:01:044484+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:38:01.044479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4706,"qdb_cluster":[4706]},"id":2}]} 2024-08-19T00:38:04.811 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-08-19T00:38:04.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1efc06be30 msgr2=0x7f1efc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1efc06be30 0x7f1efc06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f08007fd0 tx=0x7f1f08009040 comp rx=0 tx=0).stop 2024-08-19T00:38:04.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c06e710 msgr2=0x7f1f1c1547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c06e710 0x7f1f1c1547c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c500 tx=0x7f1f1000c9c0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 shutdown_connections 2024-08-19T00:38:04.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1efc06be30 0x7f1efc06e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1c0d03c0 0x7f1f1c1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f1c071980 0x7f1f1c1f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 --2- 172.21.15.7:0/999447436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f1c06e710 0x7f1f1c1547c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.809+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 >> 172.21.15.7:0/999447436 conn(0x7f1f1c06bc70 msgr2=0x7f1f1c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:04.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.810+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 shutdown_connections 2024-08-19T00:38:04.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.810+0000 7f1f23400640 1 -- 172.21.15.7:0/999447436 wait complete. 2024-08-19T00:38:04.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage ls --format=json-pretty 2024-08-19T00:38:04.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.983+0000 7fd2f3200640 1 Processor -- start 2024-08-19T00:38:04.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.984+0000 7fd2f3200640 1 -- start start 2024-08-19T00:38:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2f3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2ec15bfb0 0x7fd2ec0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2f3200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2ec0b5130 0x7fd2ec0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2f3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ec0acef0 con 0x7fd2ec15c390 2024-08-19T00:38:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2f3200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ec0ad790 con 0x7fd2ec15bfb0 2024-08-19T00:38:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2f3200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ec0ad1d0 con 0x7fd2ec0b5130 2024-08-19T00:38:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2ebe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2ec15bfb0 0x7fd2ec0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2ebe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2ec15bfb0 0x7fd2ec0b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38266/0 (socket says 172.21.15.7:38266) 2024-08-19T00:38:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.985+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1430998570 learned_addr learned my addr 172.21.15.7:0/1430998570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.986+0000 7fd2eb400640 1 --2- 172.21.15.7:0/1430998570 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec0b5130 0x7fd2ec0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.986+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1430998570 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec0b5130 msgr2=0x7fd2ec0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.986+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1430998570 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec0b5130 0x7fd2ec0aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.986+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1430998570 >> v1:172.21.15.162:6789/0 conn(0x7fd2ec15c390 legacy=0x7fd2ec15fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.986+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1430998570 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec0ad4b0 con 0x7fd2ec15bfb0 2024-08-19T00:38:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.987+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1430998570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec15bfb0 0x7fd2ec0b3e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0b4710 tx=0x7fd2dc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844071db34e7128 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.987+0000 7fd2eaa00640 1 -- 172.21.15.7:0/1430998570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc037070 con 0x7fd2ec15bfb0 2024-08-19T00:38:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.987+0000 7fd2eaa00640 1 -- 172.21.15.7:0/1430998570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc032440 con 0x7fd2ec15bfb0 2024-08-19T00:38:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.987+0000 7fd2eaa00640 1 -- 172.21.15.7:0/1430998570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc032810 con 0x7fd2ec15bfb0 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.987+0000 7fd2f3200640 1 -- 172.21.15.7:0/1430998570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec15bfb0 msgr2=0x7fd2ec0b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.987+0000 7fd2f3200640 1 --2- 172.21.15.7:0/1430998570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec15bfb0 0x7fd2ec0b3e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0b4710 tx=0x7fd2dc02a230 comp rx=0 tx=0).stop 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.988+0000 7fd2f3200640 1 -- 172.21.15.7:0/1430998570 shutdown_connections 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.988+0000 7fd2f3200640 1 --2- 172.21.15.7:0/1430998570 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec0b5130 0x7fd2ec0aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.988+0000 7fd2f3200640 1 --2- 172.21.15.7:0/1430998570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec15bfb0 0x7fd2ec0b3e00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.988+0000 7fd2f3200640 1 -- 172.21.15.7:0/1430998570 >> 172.21.15.7:0/1430998570 conn(0x7fd2ec0b2300 msgr2=0x7fd2ec06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.988+0000 7fd2f3200640 1 -- 172.21.15.7:0/1430998570 shutdown_connections 2024-08-19T00:38:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.988+0000 7fd2f3200640 1 -- 172.21.15.7:0/1430998570 wait complete. 2024-08-19T00:38:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.989+0000 7fd2f3200640 1 Processor -- start 2024-08-19T00:38:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.989+0000 7fd2f3200640 1 -- start start 2024-08-19T00:38:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.990+0000 7fd2f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec0b5130 0x7fd2ec150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.990+0000 7fd2f3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15bfb0 0x7fd2ec154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.990+0000 7fd2f3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15c390 0x7fd2ec09c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.990+0000 7fd2f3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec0b44c0 con 0x7fd2ec0b5130 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.990+0000 7fd2f3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec0b4340 con 0x7fd2ec15c390 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.990+0000 7fd2f3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ec073050 con 0x7fd2ec15bfb0 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.990+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec0b5130 0x7fd2ec150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec0b5130 0x7fd2ec150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38270/0 (socket says 172.21.15.7:38270) 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 -- 172.21.15.7:0/3747431788 learned_addr learned my addr 172.21.15.7:0/3747431788 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2f1200640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15c390 0x7fd2ec09c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2eb400640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15bfb0 0x7fd2ec154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 -- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15bfb0 msgr2=0x7fd2ec154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15bfb0 0x7fd2ec154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 -- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15c390 msgr2=0x7fd2ec09c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15c390 0x7fd2ec09c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 -- 172.21.15.7:0/3747431788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec09ba20 con 0x7fd2ec0b5130 2024-08-19T00:38:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec0b5130 0x7fd2ec150a50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc000c00 tx=0x7fd2dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.991+0000 7fd2e3e00640 1 -- 172.21.15.7:0/3747431788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc041020 con 0x7fd2ec0b5130 2024-08-19T00:38:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.992+0000 7fd2e3e00640 1 -- 172.21.15.7:0/3747431788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc0306c0 con 0x7fd2ec0b5130 2024-08-19T00:38:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.992+0000 7fd2e3e00640 1 -- 172.21.15.7:0/3747431788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc037040 con 0x7fd2ec0b5130 2024-08-19T00:38:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.992+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec09bd00 con 0x7fd2ec0b5130 2024-08-19T00:38:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.992+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec151730 con 0x7fd2ec0b5130 2024-08-19T00:38:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.994+0000 7fd2e3e00640 1 -- 172.21.15.7:0/3747431788 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2dc044020 con 0x7fd2ec0b5130 2024-08-19T00:38:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.995+0000 7fd2e3e00640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2cc06be80 0x7fd2cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.995+0000 7fd2e3e00640 1 -- 172.21.15.7:0/3747431788 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fd2dc0ab730 con 0x7fd2ec0b5130 2024-08-19T00:38:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.995+0000 7fd2eb400640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2cc06be80 0x7fd2cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.996+0000 7fd2eb400640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2cc06be80 0x7fd2cc06e340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec153e80 tx=0x7fd2d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.996+0000 7fd2f6067740 1 Processor -- start 2024-08-19T00:38:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.996+0000 7fd2f6067740 1 -- start start 2024-08-19T00:38:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f0e9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f134b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f135060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2f6067740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e3f051ef0 con 0x563e3f0e9540 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563e3eff9d10 con 0x563e3f1331c0 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563e3f04deb0 con 0x563e3f0e9e60 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f0e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f0e9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38278/0 (socket says 172.21.15.7:38278) 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2ebe00640 1 -- 172.21.15.7:0/2404649487 learned_addr learned my addr 172.21.15.7:0/2404649487 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2f1200640 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f135060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.997+0000 7fd2eb400640 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2ebe00640 1 -- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 msgr2=0x563e3f134b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f134b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2ebe00640 1 -- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 msgr2=0x563e3f135060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f135060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2ebe00640 1 -- 172.21.15.7:0/2404649487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3ee317c0 con 0x563e3f0e9540 2024-08-19T00:38:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2eb400640 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f0e9920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009280 tx=0x7fd2dc0795d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4233c7d2a239c4da server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2e0c00640 1 -- 172.21.15.7:0/2404649487 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc07dd10 con 0x563e3f0e9540 2024-08-19T00:38:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2e0c00640 1 -- 172.21.15.7:0/2404649487 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc082540 con 0x563e3f0e9540 2024-08-19T00:38:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.998+0000 7fd2e0c00640 1 -- 172.21.15.7:0/2404649487 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc075fd0 con 0x563e3f0e9540 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 -- 172.21.15.7:0/2404649487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 msgr2=0x563e3f0e9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f0e9920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009280 tx=0x7fd2dc0795d0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 -- 172.21.15.7:0/2404649487 shutdown_connections 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f135060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 --2- 172.21.15.7:0/2404649487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f0e9920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 -- 172.21.15.7:0/2404649487 >> 172.21.15.7:0/2404649487 conn(0x563e3f0b5d00 msgr2=0x563e3f1339d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 -- 172.21.15.7:0/2404649487 shutdown_connections 2024-08-19T00:38:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:04.999+0000 7fd2f6067740 1 -- 172.21.15.7:0/2404649487 wait complete. 2024-08-19T00:38:05.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.000+0000 7fd2f6067740 1 -- start start 2024-08-19T00:38:05.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.000+0000 7fd2f6067740 1 Processor -- start 2024-08-19T00:38:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f119080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9e60 0x563e3f12e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f113660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f6067740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e3f051ef0 con 0x563e3f0e9e60 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563e3f00d8d0 con 0x563e3f1331c0 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563e3f0ef7d0 con 0x563e3f0e9540 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f6067740 10 client.0 _ll_register_callbacks cb 0x563e3ed64ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9e60 0x563e3f12e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9e60 0x563e3f12e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38286/0 (socket says 172.21.15.7:38286) 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2eb400640 1 -- 172.21.15.7:0/121711924 learned_addr learned my addr 172.21.15.7:0/121711924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f119080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.001+0000 7fd2f1200640 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2eb400640 1 -- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 msgr2=0x563e3f119080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2eb400640 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f119080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2eb400640 1 -- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 msgr2=0x563e3f113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2eb400640 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f113660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2eb400640 1 -- 172.21.15.7:0/121711924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3ee91f50 con 0x563e3f0e9e60 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2eb400640 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9e60 0x563e3f12e070 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8014510 tx=0x7fd2d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd55154d4482a6e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2d5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2d5600640 1 -- 172.21.15.7:0/121711924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8025020 con 0x563e3f0e9e60 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2dc082540 con 0x563e3f0e9e60 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2d5600640 1 -- 172.21.15.7:0/121711924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fd2d80158e0 con 0x563e3f0e9e60 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2d5600640 1 -- 172.21.15.7:0/121711924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd2d802f050 con 0x563e3f0e9e60 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2f6067740 10 client.5052 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.002+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x563e3ed250b0 con 0x563e3f0e9e60 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2d5600640 1 -- 172.21.15.7:0/121711924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc082540 con 0x563e3f0e9e60 2024-08-19T00:38:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2d5600640 1 -- 172.21.15.7:0/121711924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fd2d8032020 con 0x563e3f0e9e60 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2f6067740 10 client.5052 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2f6067740 10 client.5052 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2f6067740 20 client.5052 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2f6067740 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f116c60 0x563e3f117040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2f6067740 4 client.5052 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e3f05f620 con 0x563e3f116c60 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.003+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f116c60 0x563e3f117040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.004+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f116c60 0x563e3f117040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42356541f64113f1 server_cookie=6ef97701bc05f24 in_seq=0 out_seq=0 2024-08-19T00:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.004+0000 7fd2d5600640 10 client.5052 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:05.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2d5600640 1 -- 172.21.15.7:0/121711924 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e3f05f620 con 0x563e3f116c60 2024-08-19T00:38:05.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2d5600640 10 client.5052 handle_command_reply: tid=0 2024-08-19T00:38:05.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 client.5052 shutdown 2024-08-19T00:38:05.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9e60 msgr2=0x563e3f12e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9e60 0x563e3f12e070 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8014510 tx=0x7fd2d8004730 comp rx=0 tx=0).stop 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 shutdown_connections 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f116c60 0x563e3f117040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9e60 0x563e3f12e070 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 --2- 172.21.15.7:0/121711924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f119080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2d5600640 0 client.5052 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 >> 172.21.15.7:0/121711924 conn(0x563e3f0b5d00 msgr2=0x563e3f1160e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 shutdown_connections 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 1 -- 172.21.15.7:0/121711924 wait complete. 2024-08-19T00:38:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.005+0000 7fd2f6067740 20 client.5052 trim_cache size 0 max 16384 2024-08-19T00:38:05.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.019+0000 7fd2f6067740 1 Processor -- start 2024-08-19T00:38:05.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.019+0000 7fd2f6067740 1 -- start start 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.020+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f12fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.020+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f0e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.020+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f117460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.020+0000 7fd2f6067740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec06ee90 con 0x563e3f0e9540 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.020+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec152db0 con 0x563e3f1331c0 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.020+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ec1f2a30 con 0x563e3f0e9e60 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.020+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f12fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f12fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38290/0 (socket says 172.21.15.7:38290) 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1703796522 learned_addr learned my addr 172.21.15.7:0/1703796522 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2f1200640 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f117460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2eb400640 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f0e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 msgr2=0x563e3f0e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f0e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 msgr2=0x563e3f117460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f117460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 -- 172.21.15.7:0/1703796522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3f131440 con 0x563e3f0e9540 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2f1200640 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f117460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2eb400640 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f0e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f12fa00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0798a0 tx=0x7fd2dc047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ddb132b1c3593b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2d7e00640 1 -- 172.21.15.7:0/1703796522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc077c60 con 0x563e3f0e9540 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2d7e00640 1 -- 172.21.15.7:0/1703796522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc091030 con 0x563e3f0e9540 2024-08-19T00:38:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.021+0000 7fd2d7e00640 1 -- 172.21.15.7:0/1703796522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0800c0 con 0x563e3f0e9540 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 -- 172.21.15.7:0/1703796522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 msgr2=0x563e3f12fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f12fa00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0798a0 tx=0x7fd2dc047000 comp rx=0 tx=0).stop 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 -- 172.21.15.7:0/1703796522 shutdown_connections 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f1331c0 0x563e3f117460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9e60 0x563e3f0e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1703796522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f0e9540 0x563e3f12fa00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 -- 172.21.15.7:0/1703796522 >> 172.21.15.7:0/1703796522 conn(0x563e3f0b5d00 msgr2=0x563e3f1345a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 -- 172.21.15.7:0/1703796522 shutdown_connections 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.022+0000 7fd2f6067740 1 -- 172.21.15.7:0/1703796522 wait complete. 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.023+0000 7fd2f6067740 1 -- start start 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.023+0000 7fd2f6067740 1 Processor -- start 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f0e9e60 0x563e3f1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f6067740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f1331c0 0x563e3f1b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f6067740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e3f113d60 con 0x563e3f1331c0 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563e3f119680 con 0x563e3f0e9e60 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f6067740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563e3f14b380 con 0x563e3f0e9540 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f6067740 10 client.0 _ll_register_callbacks cb 0x7fd2d800b1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f1331c0 0x563e3f1b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f1331c0 0x563e3f1b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38296/0 (socket says 172.21.15.7:38296) 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2f1200640 1 -- 172.21.15.7:0/1345413936 learned_addr learned my addr 172.21.15.7:0/1345413936 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2eb400640 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f0e9e60 0x563e3f1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.024+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2f1200640 1 -- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 msgr2=0x563e3f15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2f1200640 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2f1200640 1 -- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f0e9e60 msgr2=0x563e3f1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2f1200640 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f0e9e60 0x563e3f1483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2f1200640 1 -- 172.21.15.7:0/1345413936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3f1350b0 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2f1200640 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f1331c0 0x563e3f1b4d40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400bf20 tx=0x7fd2e400a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ae383dcb260ef1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2d5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2d5600640 1 -- 172.21.15.7:0/1345413936 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e401d020 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2dc091030 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2d5600640 1 -- 172.21.15.7:0/1345413936 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fd2e4019660 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.025+0000 7fd2d5600640 1 -- 172.21.15.7:0/1345413936 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd2e4027050 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 10 client.5058 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x563e3f15bfe0 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2d5600640 1 -- 172.21.15.7:0/1345413936 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc091030 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2d5600640 1 -- 172.21.15.7:0/1345413936 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fd2e402a020 con 0x563e3f1331c0 2024-08-19T00:38:05.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 10 client.5058 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 10 client.5058 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:38:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 20 client.5058 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f131a90 0x563e3f136e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 4 client.5058 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-08-19T00:38:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x563e3f059970 con 0x563e3f131a90 2024-08-19T00:38:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.026+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f131a90 0x563e3f136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.027+0000 7fd2ebe00640 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f131a90 0x563e3f136e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa302f4e7a26aaf5 server_cookie=d18019d29c4195bb in_seq=0 out_seq=0 2024-08-19T00:38:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.027+0000 7fd2d5600640 10 client.5058 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.027+0000 7fd2d5600640 1 -- 172.21.15.7:0/1345413936 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x563e3f059970 con 0x563e3f131a90 2024-08-19T00:38:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.027+0000 7fd2d5600640 10 client.5058 handle_command_reply: tid=0 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.027+0000 7fd2f6067740 1 client.5058 shutdown 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f1331c0 msgr2=0x563e3f1b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f1331c0 0x563e3f1b4d40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400bf20 tx=0x7fd2e400a7b0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 shutdown_connections 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e3f1331c0 0x563e3f1b4d40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x563e3f131a90 0x563e3f136e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563e3f0e9e60 0x563e3f1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 --2- 172.21.15.7:0/1345413936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563e3f0e9540 0x563e3f15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 >> 172.21.15.7:0/1345413936 conn(0x563e3f0b5d00 msgr2=0x563e3f117460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2d5600640 0 client.5058 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 shutdown_connections 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 1 -- 172.21.15.7:0/1345413936 wait complete. 2024-08-19T00:38:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.028+0000 7fd2f6067740 20 client.5058 trim_cache size 0 max 16384 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "dentry", 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 1724412901, 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627776, 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: "frag": "*", 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "file_to_be_damaged", 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_id": "head", 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/subdir/file_to_be_damaged" 2024-08-19T00:38:05.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:05.036 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:38:05.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2cc06be80 msgr2=0x7fd2cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2cc06be80 0x7fd2cc06e340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec153e80 tx=0x7fd2d8008040 comp rx=0 tx=0).stop 2024-08-19T00:38:05.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec0b5130 msgr2=0x7fd2ec150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec0b5130 0x7fd2ec150a50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc000c00 tx=0x7fd2dc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 shutdown_connections 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2cc06be80 0x7fd2cc06e340 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15c390 0x7fd2ec09c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15bfb0 0x7fd2ec154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 --2- 172.21.15.7:0/3747431788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2ec0b5130 0x7fd2ec150a50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 >> 172.21.15.7:0/3747431788 conn(0x7fd2ec0b2300 msgr2=0x7fd2ec160690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 shutdown_connections 2024-08-19T00:38:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.029+0000 7fd2f3200640 1 -- 172.21.15.7:0/3747431788 wait complete. 2024-08-19T00:38:05.047 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:38:05.047 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-08-19T00:38:05.047 DEBUG:teuthology.orchestra.run.smithi007:> import errno 2024-08-19T00:38:05.048 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:38:05.048 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-08-19T00:38:05.048 DEBUG:teuthology.orchestra.run.smithi007:> f = open("/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged", "w") 2024-08-19T00:38:05.048 DEBUG:teuthology.orchestra.run.smithi007:> f.close() 2024-08-19T00:38:05.048 DEBUG:teuthology.orchestra.run.smithi007:> except IOError as e: 2024-08-19T00:38:05.048 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(errno.EIO) 2024-08-19T00:38:05.048 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:38:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-08-19T00:38:05.160 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-08-19T00:38:05.161 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:38:05.161 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:38:05.161 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:38:05.161 DEBUG:teuthology.orchestra.run.smithi007:> import json 2024-08-19T00:38:05.161 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(e.errno) 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> print(json.dumps( 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> indent=2)) 2024-08-19T00:38:05.162 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:38:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-08-19T00:38:05.318 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-08-19T00:38:05.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:05.319 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-08-19T00:38:05.396 INFO:teuthology.orchestra.run.smithi007.stdout:2 2024-08-19T00:38:05.396 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:05.396 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:05.471 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:05.471 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:05.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:38:05.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.743+0000 7f0c71200640 1 Processor -- start 2024-08-19T00:38:05.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.743+0000 7f0c71200640 1 -- start start 2024-08-19T00:38:05.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c71200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c06e710 0x7f0c6c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c71200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c6c0b3750 0x7f0c6c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c71200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c0cdfb0 con 0x7f0c6c0d03c0 2024-08-19T00:38:05.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c71200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0c6c0cebc0 con 0x7f0c6c0b3750 2024-08-19T00:38:05.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c71200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6c0ce290 con 0x7f0c6c06e710 2024-08-19T00:38:05.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c63e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c06e710 0x7f0c6c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c63e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c06e710 0x7f0c6c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:54718/0 (socket says 172.21.15.7:54718) 2024-08-19T00:38:05.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c6a800640 1 --2- 172.21.15.7:0/3044577126 >> v2:172.21.15.162:3300/0 conn(0x7f0c6c0b3750 0x7f0c6c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.745+0000 7f0c63e00640 1 -- 172.21.15.7:0/3044577126 learned_addr learned my addr 172.21.15.7:0/3044577126 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:05.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.746+0000 7f0c6a800640 1 -- 172.21.15.7:0/3044577126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c06e710 msgr2=0x7f0c6c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:05.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.746+0000 7f0c6a800640 1 --2- 172.21.15.7:0/3044577126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c06e710 0x7f0c6c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.746+0000 7f0c6a800640 1 -- 172.21.15.7:0/3044577126 >> v1:172.21.15.162:6789/0 conn(0x7f0c6c0d03c0 legacy=0x7f0c6c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.746+0000 7f0c6a800640 1 -- 172.21.15.7:0/3044577126 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c0ce570 con 0x7f0c6c0b3750 2024-08-19T00:38:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.747+0000 7f0c6a800640 1 --2- 172.21.15.7:0/3044577126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0b3750 0x7f0c6c0cf050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009d90 tx=0x7f0c6402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae040d6d600da9d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:05.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.747+0000 7f0c69400640 1 -- 172.21.15.7:0/3044577126 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64007740 con 0x7f0c6c0b3750 2024-08-19T00:38:05.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.747+0000 7f0c69400640 1 -- 172.21.15.7:0/3044577126 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c640078e0 con 0x7f0c6c0b3750 2024-08-19T00:38:05.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.747+0000 7f0c69400640 1 -- 172.21.15.7:0/3044577126 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64007cb0 con 0x7f0c6c0b3750 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 -- 172.21.15.7:0/3044577126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0b3750 msgr2=0x7f0c6c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 --2- 172.21.15.7:0/3044577126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0b3750 0x7f0c6c0cf050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009d90 tx=0x7f0c6402a660 comp rx=0 tx=0).stop 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 -- 172.21.15.7:0/3044577126 shutdown_connections 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 --2- 172.21.15.7:0/3044577126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c06e710 0x7f0c6c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 --2- 172.21.15.7:0/3044577126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0b3750 0x7f0c6c0cf050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 -- 172.21.15.7:0/3044577126 >> 172.21.15.7:0/3044577126 conn(0x7f0c6c06bc70 msgr2=0x7f0c6c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 -- 172.21.15.7:0/3044577126 shutdown_connections 2024-08-19T00:38:05.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.748+0000 7f0c71200640 1 -- 172.21.15.7:0/3044577126 wait complete. 2024-08-19T00:38:05.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.750+0000 7f0c71200640 1 Processor -- start 2024-08-19T00:38:05.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.750+0000 7f0c71200640 1 -- start start 2024-08-19T00:38:05.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c71200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c6c06e710 0x7f0c6c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c71200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c0b3750 0x7f0c6c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c71200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0d03c0 0x7f0c6c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c71200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c073c60 con 0x7f0c6c06e710 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c71200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c073ae0 con 0x7f0c6c0d03c0 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c71200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6c0b3be0 con 0x7f0c6c0b3750 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c6c06e710 0x7f0c6c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c6c06e710 0x7f0c6c156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38300/0 (socket says 172.21.15.7:38300) 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 -- 172.21.15.7:0/2039295616 learned_addr learned my addr 172.21.15.7:0/2039295616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c6a800640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0d03c0 0x7f0c6c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c63e00640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c0b3750 0x7f0c6c0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 -- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c0b3750 msgr2=0x7f0c6c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c0b3750 0x7f0c6c0cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 -- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0d03c0 msgr2=0x7f0c6c157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0d03c0 0x7f0c6c157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.751+0000 7f0c69e00640 1 -- 172.21.15.7:0/2039295616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c156e90 con 0x7f0c6c06e710 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.752+0000 7f0c69e00640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c6c06e710 0x7f0c6c156950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c430 tx=0x7f0c5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.752+0000 7f0c62000640 1 -- 172.21.15.7:0/2039295616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0052d0 con 0x7f0c6c06e710 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.752+0000 7f0c62000640 1 -- 172.21.15.7:0/2039295616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5c005490 con 0x7f0c6c06e710 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.752+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c0cadf0 con 0x7f0c6c06e710 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.752+0000 7f0c62000640 1 -- 172.21.15.7:0/2039295616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c007260 con 0x7f0c6c06e710 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.752+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c0cb3b0 con 0x7f0c6c06e710 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.753+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c072b00 con 0x7f0c6c06e710 2024-08-19T00:38:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.754+0000 7f0c62000640 1 -- 172.21.15.7:0/2039295616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c5c007400 con 0x7f0c6c06e710 2024-08-19T00:38:05.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.755+0000 7f0c62000640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c4806be30 0x7f0c4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:05.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.755+0000 7f0c62000640 1 -- 172.21.15.7:0/2039295616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f0c5c08a3d0 con 0x7f0c6c06e710 2024-08-19T00:38:05.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.755+0000 7f0c63e00640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c4806be30 0x7f0c4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:05.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.756+0000 7f0c63e00640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c4806be30 0x7f0c4806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c15a980 tx=0x7f0c54009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.760+0000 7f0c62000640 1 -- 172.21.15.7:0/2039295616 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0c5c058630 con 0x7f0c6c06e710 2024-08-19T00:38:05.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.954+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c6c0af160 con 0x7f0c6c06e710 2024-08-19T00:38:05.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.955+0000 7f0c62000640 1 -- 172.21.15.7:0/2039295616 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v33) ==== 80+0+124 (secure 0 0 0) 0x7f0c5c05c930 con 0x7f0c6c06e710 2024-08-19T00:38:05.958 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/1856893937 2024-08-20T00:37:57.403602+0000 2024-08-19T00:38:05.958 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/1856893937 2024-08-20T00:37:57.403602+0000 2024-08-19T00:38:05.958 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c4806be30 msgr2=0x7f0c4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c4806be30 0x7f0c4806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c15a980 tx=0x7f0c54009240 comp rx=0 tx=0).stop 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c6c06e710 msgr2=0x7f0c6c156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c6c06e710 0x7f0c6c156950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c430 tx=0x7f0c5c00c8f0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 shutdown_connections 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c4806be30 0x7f0c4806e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c6c0d03c0 0x7f0c6c157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c6c0b3750 0x7f0c6c0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 --2- 172.21.15.7:0/2039295616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c6c06e710 0x7f0c6c156950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 >> 172.21.15.7:0/2039295616 conn(0x7f0c6c06bc70 msgr2=0x7f0c6c06d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 shutdown_connections 2024-08-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:05.957+0000 7f0c71200640 1 -- 172.21.15.7:0/2039295616 wait complete. 2024-08-19T00:38:05.976 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:38:05.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:05.976 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:06.038 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:38:06.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:06.038 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:38:06.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:06.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start /subdir repair 2024-08-19T00:38:06.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.279+0000 7f751be00640 1 Processor -- start 2024-08-19T00:38:06.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.280+0000 7f751be00640 1 -- start start 2024-08-19T00:38:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f751be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7514073540 0x7f75140cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f751be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f751be00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751415d390 con 0x7f751415c740 2024-08-19T00:38:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f751be00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7514072f10 con 0x7f7514073540 2024-08-19T00:38:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f751be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f751415d670 con 0x7f7514160940 2024-08-19T00:38:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f7519400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7514073540 0x7f75140cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f7519400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7514073540 0x7f75140cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38312/0 (socket says 172.21.15.7:38312) 2024-08-19T00:38:06.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.281+0000 7f7519400640 1 -- 172.21.15.7:0/1780119594 learned_addr learned my addr 172.21.15.7:0/1780119594 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.282+0000 7f7518a00640 1 --2- 172.21.15.7:0/1780119594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.282+0000 7f7519400640 1 -- 172.21.15.7:0/1780119594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 msgr2=0x7f75140cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.282+0000 7f7519400640 1 --2- 172.21.15.7:0/1780119594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.282+0000 7f7519400640 1 -- 172.21.15.7:0/1780119594 >> v1:172.21.15.162:6789/0 conn(0x7f751415c740 legacy=0x7f751415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.282+0000 7f7519400640 1 -- 172.21.15.7:0/1780119594 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751415fe60 con 0x7f7514073540 2024-08-19T00:38:06.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.283+0000 7f7519400640 1 --2- 172.21.15.7:0/1780119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7514073540 0x7f75140cc970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7508009870 tx=0x7f750802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edc6b29568ef075 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.283+0000 7f7513e00640 1 -- 172.21.15.7:0/1780119594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508037070 con 0x7f7514073540 2024-08-19T00:38:06.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.283+0000 7f7513e00640 1 -- 172.21.15.7:0/1780119594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7508032440 con 0x7f7514073540 2024-08-19T00:38:06.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.283+0000 7f7513e00640 1 -- 172.21.15.7:0/1780119594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508032810 con 0x7f7514073540 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 -- 172.21.15.7:0/1780119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7514073540 msgr2=0x7f75140cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 --2- 172.21.15.7:0/1780119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7514073540 0x7f75140cc970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7508009870 tx=0x7f750802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 -- 172.21.15.7:0/1780119594 shutdown_connections 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 --2- 172.21.15.7:0/1780119594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 --2- 172.21.15.7:0/1780119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7514073540 0x7f75140cc970 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 -- 172.21.15.7:0/1780119594 >> 172.21.15.7:0/1780119594 conn(0x7f751406be80 msgr2=0x7f75140b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 -- 172.21.15.7:0/1780119594 shutdown_connections 2024-08-19T00:38:06.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.284+0000 7f751be00640 1 -- 172.21.15.7:0/1780119594 wait complete. 2024-08-19T00:38:06.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.285+0000 7f751be00640 1 Processor -- start 2024-08-19T00:38:06.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.285+0000 7f751be00640 1 -- start start 2024-08-19T00:38:06.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.286+0000 7f751be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7514073540 0x7f751414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.286+0000 7f751be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751415c740 0x7f75140b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.286+0000 7f751be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.286+0000 7f751be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7514073920 con 0x7f751415c740 2024-08-19T00:38:06.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.286+0000 7f751be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7514160420 con 0x7f7514073540 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.286+0000 7f751be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75140b4130 con 0x7f7514160940 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751415c740 0x7f75140b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751415c740 0x7f75140b00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38328/0 (socket says 172.21.15.7:38328) 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 -- 172.21.15.7:0/1796219333 learned_addr learned my addr 172.21.15.7:0/1796219333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7519400640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7514073540 0x7f751414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7519e00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 -- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 msgr2=0x7f75140b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 -- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7514073540 msgr2=0x7f751414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7514073540 0x7f751414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 -- 172.21.15.7:0/1796219333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751414bbc0 con 0x7f751415c740 2024-08-19T00:38:06.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7519e00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:06.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7518a00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751415c740 0x7f75140b00b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f750000d5f0 tx=0x7f750000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.287+0000 7f7511600640 1 -- 172.21.15.7:0/1796219333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75000125f0 con 0x7f751415c740 2024-08-19T00:38:06.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.288+0000 7f7511600640 1 -- 172.21.15.7:0/1796219333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500019070 con 0x7f751415c740 2024-08-19T00:38:06.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.288+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75140ca8f0 con 0x7f751415c740 2024-08-19T00:38:06.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.288+0000 7f7511600640 1 -- 172.21.15.7:0/1796219333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75000129d0 con 0x7f751415c740 2024-08-19T00:38:06.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.288+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75141f7df0 con 0x7f751415c740 2024-08-19T00:38:06.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.290+0000 7f7511600640 1 -- 172.21.15.7:0/1796219333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7500012b70 con 0x7f751415c740 2024-08-19T00:38:06.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.291+0000 7f7511600640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f406be30 0x7f74f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.291+0000 7f7511600640 1 -- 172.21.15.7:0/1796219333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f750008b220 con 0x7f751415c740 2024-08-19T00:38:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.291+0000 7f7519400640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f406be30 0x7f74f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.291+0000 7f751edfb740 1 Processor -- start 2024-08-19T00:38:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f751edfb740 1 -- start start 2024-08-19T00:38:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f7519400640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f406be30 0x7f74f406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7508034000 tx=0x7f750802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fdd20 0x564f298fe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298b4a50 0x564f298fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f751edfb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fa5d0 0x564f298e1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f751edfb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f2981a080 con 0x564f298fa5d0 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f297c1ee0 con 0x564f298fdd20 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.292+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564f29816040 con 0x564f298b4a50 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fa5d0 0x564f298e1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fdd20 0x564f298fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fa5d0 0x564f298e1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38334/0 (socket says 172.21.15.7:38334) 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7518a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298b4a50 0x564f298fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 -- 172.21.15.7:0/1163200036 learned_addr learned my addr 172.21.15.7:0/1163200036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 -- 172.21.15.7:0/1163200036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298b4a50 msgr2=0x564f298fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 --2- 172.21.15.7:0/1163200036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298b4a50 0x564f298fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 -- 172.21.15.7:0/1163200036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fdd20 msgr2=0x564f298fe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 --2- 172.21.15.7:0/1163200036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fdd20 0x564f298fe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 -- 172.21.15.7:0/1163200036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f295f9a20 con 0x564f298fa5d0 2024-08-19T00:38:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.293+0000 7f7519e00640 1 --2- 172.21.15.7:0/1163200036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fa5d0 0x564f298e1040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f750c001d20 tx=0x7f750c0021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665667044bb2845f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f7505c00640 1 -- 172.21.15.7:0/1163200036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c019070 con 0x564f298fa5d0 2024-08-19T00:38:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f7505c00640 1 -- 172.21.15.7:0/1163200036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c003b80 con 0x564f298fa5d0 2024-08-19T00:38:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f7505c00640 1 -- 172.21.15.7:0/1163200036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c00e920 con 0x564f298fa5d0 2024-08-19T00:38:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f751edfb740 1 -- 172.21.15.7:0/1163200036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fa5d0 msgr2=0x564f298e1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f751edfb740 1 --2- 172.21.15.7:0/1163200036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fa5d0 0x564f298e1040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f750c001d20 tx=0x7f750c0021e0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f751edfb740 1 -- 172.21.15.7:0/1163200036 shutdown_connections 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f751edfb740 1 --2- 172.21.15.7:0/1163200036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fa5d0 0x564f298e1040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f751edfb740 1 --2- 172.21.15.7:0/1163200036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298b4a50 0x564f298fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f751edfb740 1 --2- 172.21.15.7:0/1163200036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fdd20 0x564f298fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.294+0000 7f751edfb740 1 -- 172.21.15.7:0/1163200036 >> 172.21.15.7:0/1163200036 conn(0x564f298b3a50 msgr2=0x564f298fc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.295+0000 7f751edfb740 1 -- 172.21.15.7:0/1163200036 shutdown_connections 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.295+0000 7f751edfb740 1 -- 172.21.15.7:0/1163200036 wait complete. 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.295+0000 7f751edfb740 1 -- start start 2024-08-19T00:38:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.295+0000 7f751edfb740 1 Processor -- start 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.296+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298e1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.296+0000 7f751edfb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f2990eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.296+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f2990bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.296+0000 7f751edfb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f297d5a90 con 0x564f298fdd20 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.296+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f298fd190 con 0x564f298dfa10 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.296+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564f298e2030 con 0x564f298fa5d0 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.296+0000 7f751edfb740 10 client.0 _ll_register_callbacks cb 0x564f297cf7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f2990eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f2990eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38340/0 (socket says 172.21.15.7:38340) 2024-08-19T00:38:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 -- 172.21.15.7:0/3152170153 learned_addr learned my addr 172.21.15.7:0/3152170153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7519400640 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298e1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7519e00640 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f2990bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 -- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 msgr2=0x564f298e1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298e1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 -- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 msgr2=0x564f2990bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f2990bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 -- 172.21.15.7:0/3152170153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f294ed310 con 0x564f298fdd20 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f7518a00640 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f2990eb40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f75000558c0 tx=0x7f7500059c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a99eaf513baff69 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f74fa000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f74fa000640 1 -- 172.21.15.7:0/3152170153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500088060 con 0x564f298fdd20 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f74fa000640 1 -- 172.21.15.7:0/3152170153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f7500055ad0 con 0x564f298fdd20 2024-08-19T00:38:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.297+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f750c003b80 con 0x564f298fdd20 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f74fa000640 1 -- 172.21.15.7:0/3152170153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7500071070 con 0x564f298fdd20 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 10 client.5073 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x564f2965a1b0 con 0x564f298fdd20 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f74fa000640 1 -- 172.21.15.7:0/3152170153 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c003b80 con 0x564f298fdd20 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f74fa000640 1 -- 172.21.15.7:0/3152170153 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f7500013070 con 0x564f298fdd20 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 10 client.5073 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 10 client.5073 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 20 client.5073 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f2990c8b0 0x564f298f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 4 client.5073 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f2982dc60 con 0x564f2990c8b0 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.298+0000 7f7519400640 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f2990c8b0 0x564f298f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.299+0000 7f7519400640 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f2990c8b0 0x564f298f8540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98aa6c97d6d79414 server_cookie=70844c01392436f2 in_seq=0 out_seq=0 2024-08-19T00:38:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.299+0000 7f74fa000640 10 client.5073 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.300+0000 7f74fa000640 1 -- 172.21.15.7:0/3152170153 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f2982dc60 con 0x564f2990c8b0 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.300+0000 7f74fa000640 10 client.5073 handle_command_reply: tid=0 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.300+0000 7f751edfb740 1 client.5073 shutdown 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.300+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 msgr2=0x564f2990eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.300+0000 7f751edfb740 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f2990eb40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f75000558c0 tx=0x7f7500059c40 comp rx=0 tx=0).stop 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 shutdown_connections 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f2990c8b0 0x564f298f8540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f2990bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f2990eb40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 --2- 172.21.15.7:0/3152170153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298e1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f74fa000640 0 client.5073 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 >> 172.21.15.7:0/3152170153 conn(0x564f298b4a50 msgr2=0x564f298b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 shutdown_connections 2024-08-19T00:38:06.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 1 -- 172.21.15.7:0/3152170153 wait complete. 2024-08-19T00:38:06.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.301+0000 7f751edfb740 20 client.5073 trim_cache size 0 max 16384 2024-08-19T00:38:06.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.319+0000 7f751edfb740 1 Processor -- start 2024-08-19T00:38:06.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.319+0000 7f751edfb740 1 -- start start 2024-08-19T00:38:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298dfa10 0x564f298acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fa5d0 0x564f298f6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f751edfb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f298f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f751edfb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7514200af0 con 0x564f298fdd20 2024-08-19T00:38:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75141ffc30 con 0x564f298fa5d0 2024-08-19T00:38:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f751406e270 con 0x564f298dfa10 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f7519e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f298f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f7519e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f298f6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38356/0 (socket says 172.21.15.7:38356) 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.320+0000 7f7519e00640 1 -- 172.21.15.7:0/3542492046 learned_addr learned my addr 172.21.15.7:0/3542492046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7519e00640 1 -- 172.21.15.7:0/3542492046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298dfa10 msgr2=0x564f298acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7519e00640 1 --2- 172.21.15.7:0/3542492046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298dfa10 0x564f298acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7519e00640 1 -- 172.21.15.7:0/3542492046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fa5d0 msgr2=0x564f298f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7519e00640 1 --2- 172.21.15.7:0/3542492046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fa5d0 0x564f298f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7519e00640 1 -- 172.21.15.7:0/3542492046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2990c210 con 0x564f298fdd20 2024-08-19T00:38:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7519e00640 1 --2- 172.21.15.7:0/3542492046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f298f6a80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f750c017040 tx=0x7f750c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de5437935cd7069 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7505200640 1 -- 172.21.15.7:0/3542492046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c024070 con 0x564f298fdd20 2024-08-19T00:38:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7505200640 1 -- 172.21.15.7:0/3542492046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c006d50 con 0x564f298fdd20 2024-08-19T00:38:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.321+0000 7f7505200640 1 -- 172.21.15.7:0/3542492046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c019040 con 0x564f298fdd20 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 -- 172.21.15.7:0/3542492046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 msgr2=0x564f298f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 --2- 172.21.15.7:0/3542492046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f298f6a80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f750c017040 tx=0x7f750c00a000 comp rx=0 tx=0).stop 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 -- 172.21.15.7:0/3542492046 shutdown_connections 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 --2- 172.21.15.7:0/3542492046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f298f6a80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 --2- 172.21.15.7:0/3542492046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298fa5d0 0x564f298f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 --2- 172.21.15.7:0/3542492046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298dfa10 0x564f298acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 -- 172.21.15.7:0/3542492046 >> 172.21.15.7:0/3542492046 conn(0x564f298b4a50 msgr2=0x564f298b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 -- 172.21.15.7:0/3542492046 shutdown_connections 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 -- 172.21.15.7:0/3542492046 wait complete. 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.322+0000 7f751edfb740 1 -- start start 2024-08-19T00:38:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.323+0000 7f751edfb740 1 Processor -- start 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f298b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f751edfb740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f751edfb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f299148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f751edfb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f298b79a0 con 0x564f298fdd20 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f751406e8c0 con 0x564f298dfa10 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f751edfb740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564f298fce10 con 0x564f298fa5d0 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f751edfb740 10 client.0 _ll_register_callbacks cb 0x7f7500006e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f299148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f299148b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38372/0 (socket says 172.21.15.7:38372) 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 -- 172.21.15.7:0/3653916195 learned_addr learned my addr 172.21.15.7:0/3653916195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519400640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f298b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7518a00640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 -- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 msgr2=0x564f298b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 -- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 msgr2=0x564f298b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f298b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519e00640 1 -- 172.21.15.7:0/3653916195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f298de380 con 0x564f298fdd20 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.324+0000 7f7519400640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f298b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f7519e00640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f299148b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f750c0012e0 tx=0x7f750c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deff7ffa345ba324 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f74fa000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:06.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f74fa000640 1 -- 172.21.15.7:0/3653916195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c019030 con 0x564f298fdd20 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f74fa000640 1 -- 172.21.15.7:0/3653916195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f750c00eb30 con 0x564f298fdd20 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f750c006d50 con 0x564f298fdd20 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f74fa000640 1 -- 172.21.15.7:0/3653916195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f750c030050 con 0x564f298fdd20 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f751edfb740 10 client.5079 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x564f298fe470 con 0x564f298fdd20 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f74fa000640 1 -- 172.21.15.7:0/3653916195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c006d50 con 0x564f298fdd20 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.325+0000 7f74fa000640 1 -- 172.21.15.7:0/3653916195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f750c033020 con 0x564f298fdd20 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f751edfb740 10 client.5079 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f751edfb740 10 client.5079 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f751edfb740 20 client.5079 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f751edfb740 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f29914df0 0x564f2997a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f751edfb740 4 client.5079 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair"]}] 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair"]}) -- 0x564f298277b0 con 0x564f29914df0 2024-08-19T00:38:06.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f7519400640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f29914df0 0x564f2997a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f7519400640 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f29914df0 0x564f2997a180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cff1ed0d683fd431 server_cookie=ac22969875124f57 in_seq=0 out_seq=0 2024-08-19T00:38:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.326+0000 7f74fa000640 10 client.5079 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.327+0000 7f74fa000640 1 -- 172.21.15.7:0/3653916195 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f298277b0 con 0x564f29914df0 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.327+0000 7f74fa000640 10 client.5079 handle_command_reply: tid=0 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.327+0000 7f751edfb740 1 client.5079 shutdown 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.327+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 msgr2=0x564f299148b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.327+0000 7f751edfb740 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f299148b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f750c0012e0 tx=0x7f750c011000 comp rx=0 tx=0).stop 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 shutdown_connections 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f298fdd20 0x564f299148b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f298fa5d0 0x564f298b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x564f29914df0 0x564f2997a180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 --2- 172.21.15.7:0/3653916195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f298dfa10 0x564f298b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 >> 172.21.15.7:0/3653916195 conn(0x564f298b4a50 msgr2=0x564f298f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f74fa000640 0 client.5079 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 shutdown_connections 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 1 -- 172.21.15.7:0/3653916195 wait complete. 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751edfb740 20 client.5079 trim_cache size 0 max 16384 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "bc880fe8-6479-4b9a-9580-365001dbc687", 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-08-19T00:38:06.334 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:38:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f406be30 msgr2=0x7f74f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751be00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f406be30 0x7f74f406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7508034000 tx=0x7f750802e000 comp rx=0 tx=0).stop 2024-08-19T00:38:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751415c740 msgr2=0x7f75140b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.328+0000 7f751be00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751415c740 0x7f75140b00b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f750000d5f0 tx=0x7f750000dab0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 shutdown_connections 2024-08-19T00:38:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f406be30 0x7f74f406e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7514160940 0x7f75140b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751415c740 0x7f75140b00b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 --2- 172.21.15.7:0/1796219333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7514073540 0x7f751414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 >> 172.21.15.7:0/1796219333 conn(0x7f751406be80 msgr2=0x7f7514074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 shutdown_connections 2024-08-19T00:38:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.329+0000 7f751be00640 1 -- 172.21.15.7:0/1796219333 wait complete. 2024-08-19T00:38:06.346 INFO:tasks.cephfs.test_damage:{ "return_code": 0, "scrub_tag": "bc880fe8-6479-4b9a-9580-365001dbc687", "mode": "asynchronous" } 2024-08-19T00:38:06.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:06.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-08-19T00:38:06.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.503+0000 7f6d10c00640 1 Processor -- start 2024-08-19T00:38:06.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.504+0000 7f6d10c00640 1 -- start start 2024-08-19T00:38:06.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d10c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6d0c15bfb0 0x7f6d0c0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d10c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0c0acef0 con 0x7f6d0c0b5130 2024-08-19T00:38:06.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d10c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0c0ad1d0 con 0x7f6d0c15c390 2024-08-19T00:38:06.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d10c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6d0c0ad790 con 0x7f6d0c15bfb0 2024-08-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d09e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6d0c15bfb0 0x7f6d0c0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d03e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6d0c0b5130 0x7f6d0c0aebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53186/0 (socket says 172.21.15.7:53186) 2024-08-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d03e00640 1 -- 172.21.15.7:0/799063468 learned_addr learned my addr 172.21.15.7:0/799063468 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.505+0000 7f6d09e00640 1 -- 172.21.15.7:0/799063468 >> v1:172.21.15.162:6789/0 conn(0x7f6d0c15c390 legacy=0x7f6d0c072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.506+0000 7f6d09e00640 1 -- 172.21.15.7:0/799063468 >> v1:172.21.15.7:6789/0 conn(0x7f6d0c0b5130 legacy=0x7f6d0c0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.506+0000 7f6d09e00640 1 -- 172.21.15.7:0/799063468 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c0ad4b0 con 0x7f6d0c15bfb0 2024-08-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.506+0000 7f6d09400640 1 -- 172.21.15.7:0/799063468 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366585155 0 0) 0x7f6d0c0acef0 con 0x7f6d0c0b5130 2024-08-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d09e00640 1 --2- 172.21.15.7:0/799063468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15bfb0 0x7f6d0c0b3e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0097a0 tx=0x7f6cfc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828a06f6dd787832 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d09400640 1 -- 172.21.15.7:0/799063468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc037070 con 0x7f6d0c15bfb0 2024-08-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d09400640 1 -- 172.21.15.7:0/799063468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cfc032440 con 0x7f6d0c15bfb0 2024-08-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d09400640 1 -- 172.21.15.7:0/799063468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc032810 con 0x7f6d0c15bfb0 2024-08-19T00:38:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d10c00640 1 -- 172.21.15.7:0/799063468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15bfb0 msgr2=0x7f6d0c0b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d10c00640 1 --2- 172.21.15.7:0/799063468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15bfb0 0x7f6d0c0b3e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0097a0 tx=0x7f6cfc02a230 comp rx=0 tx=0).stop 2024-08-19T00:38:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d10c00640 1 -- 172.21.15.7:0/799063468 shutdown_connections 2024-08-19T00:38:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d10c00640 1 --2- 172.21.15.7:0/799063468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15bfb0 0x7f6d0c0b3e00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.507+0000 7f6d10c00640 1 -- 172.21.15.7:0/799063468 >> 172.21.15.7:0/799063468 conn(0x7f6d0c0b2300 msgr2=0x7f6d0c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.508+0000 7f6d10c00640 1 -- 172.21.15.7:0/799063468 shutdown_connections 2024-08-19T00:38:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.508+0000 7f6d10c00640 1 -- 172.21.15.7:0/799063468 wait complete. 2024-08-19T00:38:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.509+0000 7f6d10c00640 1 Processor -- start 2024-08-19T00:38:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.509+0000 7f6d10c00640 1 -- start start 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d10c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d0c0b5130 0x7f6d0c0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d10c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d0c15bfb0 0x7f6d0c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d10c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15c390 0x7f6d0c156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d10c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c0b44c0 con 0x7f6d0c15c390 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d10c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c0b4340 con 0x7f6d0c0b5130 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d10c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c0af2e0 con 0x7f6d0c15bfb0 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d0a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15c390 0x7f6d0c156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.510+0000 7f6d0a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15c390 0x7f6d0c156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38396/0 (socket says 172.21.15.7:38396) 2024-08-19T00:38:06.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d0a800640 1 -- 172.21.15.7:0/2989238670 learned_addr learned my addr 172.21.15.7:0/2989238670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d09e00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d0c0b5130 0x7f6d0c0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d03e00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d0c15bfb0 0x7f6d0c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d0a800640 1 -- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d0c15bfb0 msgr2=0x7f6d0c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d0a800640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d0c15bfb0 0x7f6d0c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d0a800640 1 -- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d0c0b5130 msgr2=0x7f6d0c0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d0a800640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d0c0b5130 0x7f6d0c0cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d0a800640 1 -- 172.21.15.7:0/2989238670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c154260 con 0x7f6d0c15c390 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d09e00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d0c0b5130 0x7f6d0c0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.511+0000 7f6d0a800640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15c390 0x7f6d0c156170 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c6e0 tx=0x7f6d0400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.512+0000 7f6d02000640 1 -- 172.21.15.7:0/2989238670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04003b70 con 0x7f6d0c15c390 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.512+0000 7f6d02000640 1 -- 172.21.15.7:0/2989238670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d04003d30 con 0x7f6d0c15c390 2024-08-19T00:38:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.512+0000 7f6d02000640 1 -- 172.21.15.7:0/2989238670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04005310 con 0x7f6d0c15c390 2024-08-19T00:38:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.512+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0c0cc2e0 con 0x7f6d0c15c390 2024-08-19T00:38:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.512+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0c157460 con 0x7f6d0c15c390 2024-08-19T00:38:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.514+0000 7f6d02000640 1 -- 172.21.15.7:0/2989238670 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d040054b0 con 0x7f6d0c15c390 2024-08-19T00:38:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.515+0000 7f6d02000640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ce806be60 0x7f6ce806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.515+0000 7f6d02000640 1 -- 172.21.15.7:0/2989238670 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f6d0408abe0 con 0x7f6d0c15c390 2024-08-19T00:38:06.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.515+0000 7f6d09e00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ce806be60 0x7f6ce806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.515+0000 7f6d13ab7740 1 Processor -- start 2024-08-19T00:38:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d13ab7740 1 -- start start 2024-08-19T00:38:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d09e00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ce806be60 0x7f6ce806e320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc034000 tx=0x7f6cfc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427ddb7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd6bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56427dcd3de0 con 0x56427dd6ed00 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56427dc6c0e0 con 0x56427dd72d10 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.516+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56427dccfda0 con 0x56427ddb7bf0 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd6bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d09e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427ddb7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd6bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38402/0 (socket says 172.21.15.7:38402) 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 -- 172.21.15.7:0/1821477314 learned_addr learned my addr 172.21.15.7:0/1821477314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d0a800640 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 -- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 msgr2=0x56427ddb7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427ddb7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 -- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 msgr2=0x56427ddb4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 -- 172.21.15.7:0/1821477314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56427dab17d0 con 0x56427dd6ed00 2024-08-19T00:38:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d09e00640 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427ddb7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.517+0000 7f6d03e00640 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd6bb30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000c00 tx=0x7f6cf4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3039c2d77f9220e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6cfa600640 1 -- 172.21.15.7:0/1821477314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4001890 con 0x56427dd6ed00 2024-08-19T00:38:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6cfa600640 1 -- 172.21.15.7:0/1821477314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4018070 con 0x56427dd6ed00 2024-08-19T00:38:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6cfa600640 1 -- 172.21.15.7:0/1821477314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4001c50 con 0x56427dd6ed00 2024-08-19T00:38:06.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6d13ab7740 1 -- 172.21.15.7:0/1821477314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 msgr2=0x56427dd6bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd6bb30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000c00 tx=0x7f6cf4004bb0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6d13ab7740 1 -- 172.21.15.7:0/1821477314 shutdown_connections 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd6bb30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/1821477314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427ddb7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.518+0000 7f6d13ab7740 1 -- 172.21.15.7:0/1821477314 >> 172.21.15.7:0/1821477314 conn(0x56427dd37ff0 msgr2=0x56427ddb6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.519+0000 7f6d13ab7740 1 -- 172.21.15.7:0/1821477314 shutdown_connections 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.519+0000 7f6d13ab7740 1 -- 172.21.15.7:0/1821477314 wait complete. 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.519+0000 7f6d13ab7740 1 -- start start 2024-08-19T00:38:06.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.519+0000 7f6d13ab7740 1 Processor -- start 2024-08-19T00:38:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.520+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd89c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.520+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.520+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd8c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.520+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56427ddb4040 con 0x56427dd6ed00 2024-08-19T00:38:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.520+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56427dc8f180 con 0x56427dd72d10 2024-08-19T00:38:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.520+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56427dd99050 con 0x56427ddb7bf0 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.520+0000 7f6d13ab7740 10 client.0 _ll_register_callbacks cb 0x56427dc7b4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd89c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd89c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38414/0 (socket says 172.21.15.7:38414) 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 -- 172.21.15.7:0/3015615012 learned_addr learned my addr 172.21.15.7:0/3015615012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d03e00640 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d0a800640 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd8c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 -- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 msgr2=0x56427dd8c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd8c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 -- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 msgr2=0x56427ddb0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 -- 172.21.15.7:0/3015615012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56427d9e73f0 con 0x56427dd6ed00 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.521+0000 7f6d09e00640 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd89c20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0098c0 tx=0x7f6cfc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960932ae939a5762 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6ceea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6ceea00640 1 -- 172.21.15.7:0/3015615012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc04f020 con 0x56427dd6ed00 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6ceea00640 1 -- 172.21.15.7:0/3015615012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f6cfc04b460 con 0x56427dd6ed00 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf4018070 con 0x56427dd6ed00 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6ceea00640 1 -- 172.21.15.7:0/3015615012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6cfc037040 con 0x56427dd6ed00 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6d13ab7740 10 client.5094 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56427d9a70f0 con 0x56427dd6ed00 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6ceea00640 1 -- 172.21.15.7:0/3015615012 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4018070 con 0x56427dd6ed00 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6ceea00640 1 -- 172.21.15.7:0/3015615012 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6cfc04b660 con 0x56427dd6ed00 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6d13ab7740 10 client.5094 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6d13ab7740 10 client.5094 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.522+0000 7f6d13ab7740 20 client.5094 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.523+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427ddb0e90 0x56427dd86600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.523+0000 7f6d13ab7740 4 client.5094 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:38:06.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.523+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56427dce1510 con 0x56427ddb0e90 2024-08-19T00:38:06.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.523+0000 7f6d03e00640 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427ddb0e90 0x56427dd86600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.524+0000 7f6d03e00640 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427ddb0e90 0x56427dd86600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=260454bd349ddfed server_cookie=c273437e30de545e in_seq=0 out_seq=0 2024-08-19T00:38:06.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.524+0000 7f6ceea00640 10 client.5094 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6ceea00640 1 -- 172.21.15.7:0/3015615012 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56427dce1510 con 0x56427ddb0e90 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6ceea00640 10 client.5094 handle_command_reply: tid=0 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 client.5094 shutdown 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 msgr2=0x56427dd89c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd89c20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0098c0 tx=0x7f6cfc004730 comp rx=0 tx=0).stop 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 shutdown_connections 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd8c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427ddb0e90 0x56427dd86600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd72d10 0x56427ddb0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/3015615012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd6ed00 0x56427dd89c20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 >> 172.21.15.7:0/3015615012 conn(0x56427dd37ff0 msgr2=0x56427dd70990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6ceea00640 0 client.5094 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 shutdown_connections 2024-08-19T00:38:06.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 1 -- 172.21.15.7:0/3015615012 wait complete. 2024-08-19T00:38:06.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.525+0000 7f6d13ab7740 20 client.5094 trim_cache size 0 max 16384 2024-08-19T00:38:06.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.544+0000 7f6d13ab7740 1 Processor -- start 2024-08-19T00:38:06.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.544+0000 7f6d13ab7740 1 -- start start 2024-08-19T00:38:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddb63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427dd72d10 0x56427dd70420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427ddb7bf0 0x56427dd70960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c200840 con 0x56427ddb7bf0 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c0cb390 con 0x56427dd6ed00 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c06e5a0 con 0x56427dd72d10 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427ddb7bf0 0x56427dd70960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427ddb7bf0 0x56427dd70960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38418/0 (socket says 172.21.15.7:38418) 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 -- 172.21.15.7:0/2533954441 learned_addr learned my addr 172.21.15.7:0/2533954441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d09e00640 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddb63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d03e00640 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427dd72d10 0x56427dd70420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 -- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427dd72d10 msgr2=0x56427dd70420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427dd72d10 0x56427dd70420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 -- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 msgr2=0x56427ddb63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddb63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d0a800640 1 -- 172.21.15.7:0/2533954441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56427ddaced0 con 0x56427ddb7bf0 2024-08-19T00:38:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.545+0000 7f6d03e00640 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427dd72d10 0x56427dd70420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d0a800640 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427ddb7bf0 0x56427dd70960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6d04058e10 tx=0x7f6d04005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5caea6c4a9d4699d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6cf9c00640 1 -- 172.21.15.7:0/2533954441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04086070 con 0x56427ddb7bf0 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6cf9c00640 1 -- 172.21.15.7:0/2533954441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d04074020 con 0x56427ddb7bf0 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6cf9c00640 1 -- 172.21.15.7:0/2533954441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d040571d0 con 0x56427ddb7bf0 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d13ab7740 1 -- 172.21.15.7:0/2533954441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427ddb7bf0 msgr2=0x56427dd70960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427ddb7bf0 0x56427dd70960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6d04058e10 tx=0x7f6d04005040 comp rx=0 tx=0).stop 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d13ab7740 1 -- 172.21.15.7:0/2533954441 shutdown_connections 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427ddb7bf0 0x56427dd70960 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427dd72d10 0x56427dd70420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/2533954441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddb63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.546+0000 7f6d13ab7740 1 -- 172.21.15.7:0/2533954441 >> 172.21.15.7:0/2533954441 conn(0x56427dd37ff0 msgr2=0x56427ddac1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.547+0000 7f6d13ab7740 1 -- 172.21.15.7:0/2533954441 shutdown_connections 2024-08-19T00:38:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.547+0000 7f6d13ab7740 1 -- 172.21.15.7:0/2533954441 wait complete. 2024-08-19T00:38:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.547+0000 7f6d13ab7740 1 -- start start 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.547+0000 7f6d13ab7740 1 Processor -- start 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.548+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddafe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.548+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd72d10 0x56427ddb03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.548+0000 7f6d13ab7740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd6f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.548+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56427ddada90 con 0x56427dd72d10 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.548+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c0cad00 con 0x56427dd6ed00 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.548+0000 7f6d13ab7740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56427dd6e140 con 0x56427ddb7bf0 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.548+0000 7f6d13ab7740 10 client.0 _ll_register_callbacks cb 0x7f6cfc032c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd72d10 0x56427ddb03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd72d10 0x56427ddb03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38430/0 (socket says 172.21.15.7:38430) 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 -- 172.21.15.7:0/517255387 learned_addr learned my addr 172.21.15.7:0/517255387 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d0a800640 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd6f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d09e00640 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddafe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 -- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 msgr2=0x56427dd6f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd6f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 -- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 msgr2=0x56427ddafe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddafe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 -- 172.21.15.7:0/517255387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56427dd99e40 con 0x56427dd72d10 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6d03e00640 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd72d10 0x56427ddb03b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000f60 tx=0x7f6cf4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f052fc20ef058d30 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6ceea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.549+0000 7f6ceea00640 1 -- 172.21.15.7:0/517255387 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf402f070 con 0x56427dd72d10 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6ceea00640 1 -- 172.21.15.7:0/517255387 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f6cf402a430 con 0x56427dd72d10 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d04074020 con 0x56427dd72d10 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6ceea00640 1 -- 172.21.15.7:0/517255387 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6cf4037050 con 0x56427dd72d10 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 10 client.5100 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56427de247a0 con 0x56427dd72d10 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6ceea00640 1 -- 172.21.15.7:0/517255387 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d04074020 con 0x56427dd72d10 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6ceea00640 1 -- 172.21.15.7:0/517255387 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6cf403a020 con 0x56427dd72d10 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 10 client.5100 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 10 client.5100 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 20 client.5100 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427dd6fc80 0x56427dd70090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 4 client.5100 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.550+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56427dcdb860 con 0x56427dd6fc80 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.551+0000 7f6d09e00640 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427dd6fc80 0x56427dd70090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.551+0000 7f6d09e00640 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427dd6fc80 0x56427dd70090 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55613b04ef4ffc9f server_cookie=baa2b807b73816f2 in_seq=0 out_seq=0 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.551+0000 7f6ceea00640 10 client.5100 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.551+0000 7f6ceea00640 1 -- 172.21.15.7:0/517255387 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+256 (crc 0 0 0) 0x56427dcdb860 con 0x56427dd6fc80 2024-08-19T00:38:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.551+0000 7f6ceea00640 10 client.5100 handle_command_reply: tid=0 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.551+0000 7f6d13ab7740 1 client.5100 shutdown 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd72d10 msgr2=0x56427ddb03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd72d10 0x56427ddb03b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000f60 tx=0x7f6cf4007d10 comp rx=0 tx=0).stop 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 shutdown_connections 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56427ddb7bf0 0x56427dd6f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56427dd72d10 0x56427ddb03b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x56427dd6fc80 0x56427dd70090 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 --2- 172.21.15.7:0/517255387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56427dd6ed00 0x56427ddafe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6ceea00640 0 client.5100 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 >> 172.21.15.7:0/517255387 conn(0x56427dd37ff0 msgr2=0x56427dd9ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 shutdown_connections 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 1 -- 172.21.15.7:0/517255387 wait complete. 2024-08-19T00:38:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d13ab7740 20 client.5100 trim_cache size 0 max 16384 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "bc880fe8-6479-4b9a-9580-365001dbc687": { 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/subdir", 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "bc880fe8-6479-4b9a-9580-365001dbc687", 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "repair" 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:06.559 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:38:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ce806be60 msgr2=0x7f6ce806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d10c00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ce806be60 0x7f6ce806e320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc034000 tx=0x7f6cfc02e000 comp rx=0 tx=0).stop 2024-08-19T00:38:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15c390 msgr2=0x7f6d0c156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.552+0000 7f6d10c00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15c390 0x7f6d0c156170 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c6e0 tx=0x7f6d0400cba0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 shutdown_connections 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ce806be60 0x7f6ce806e320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d0c15c390 0x7f6d0c156170 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d0c15bfb0 0x7f6d0c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 --2- 172.21.15.7:0/2989238670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d0c0b5130 0x7f6d0c0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 >> 172.21.15.7:0/2989238670 conn(0x7f6d0c0b2300 msgr2=0x7f6d0c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 shutdown_connections 2024-08-19T00:38:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:06.553+0000 7f6d10c00640 1 -- 172.21.15.7:0/2989238670 wait complete. 2024-08-19T00:38:06.571 INFO:tasks.cephfs.filesystem:scrub status for tag:bc880fe8-6479-4b9a-9580-365001dbc687 - {'path': '/subdir', 'tag': 'bc880fe8-6479-4b9a-9580-365001dbc687', 'options': 'repair'} 2024-08-19T00:38:31.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:38:31.146 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:38:36.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:36.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-08-19T00:38:36.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.740+0000 7fbc52800640 1 Processor -- start 2024-08-19T00:38:36.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.740+0000 7fbc52800640 1 -- start start 2024-08-19T00:38:36.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.741+0000 7fbc52800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c158cd0 0x7fbc4c072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.741+0000 7fbc52800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbc4c072ff0 0x7fbc4c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.741+0000 7fbc52800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4c0aeae0 con 0x7fbc4c0ae2b0 2024-08-19T00:38:36.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.741+0000 7fbc52800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4c073430 con 0x7fbc4c072ff0 2024-08-19T00:38:36.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.741+0000 7fbc52800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c0aedc0 con 0x7fbc4c158cd0 2024-08-19T00:38:36.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.741+0000 7fbc4b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c158cd0 0x7fbc4c072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.742+0000 7fbc43e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbc4c072ff0 0x7fbc4c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.742+0000 7fbc4b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c158cd0 0x7fbc4c072ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:51522/0 (socket says 172.21.15.7:51522) 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.742+0000 7fbc4b400640 1 -- 172.21.15.7:0/4252242081 learned_addr learned my addr 172.21.15.7:0/4252242081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.742+0000 7fbc4b400640 1 -- 172.21.15.7:0/4252242081 >> v2:172.21.15.162:3300/0 conn(0x7fbc4c072ff0 msgr2=0x7fbc4c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.742+0000 7fbc4b400640 1 --2- 172.21.15.7:0/4252242081 >> v2:172.21.15.162:3300/0 conn(0x7fbc4c072ff0 0x7fbc4c0add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.742+0000 7fbc4b400640 1 -- 172.21.15.7:0/4252242081 >> v1:172.21.15.162:6789/0 conn(0x7fbc4c0ae2b0 legacy=0x7fbc4c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.742+0000 7fbc4b400640 1 -- 172.21.15.7:0/4252242081 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c0af0a0 con 0x7fbc4c158cd0 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.743+0000 7fbc4b400640 1 --2- 172.21.15.7:0/4252242081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c158cd0 0x7fbc4c072ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0735b0 tx=0x7fbc3c02a120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f8f4d4833fa3b8c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.743+0000 7fbc4aa00640 1 -- 172.21.15.7:0/4252242081 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c037070 con 0x7fbc4c158cd0 2024-08-19T00:38:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.743+0000 7fbc4aa00640 1 -- 172.21.15.7:0/4252242081 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c032440 con 0x7fbc4c158cd0 2024-08-19T00:38:36.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.743+0000 7fbc4aa00640 1 -- 172.21.15.7:0/4252242081 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c032810 con 0x7fbc4c158cd0 2024-08-19T00:38:36.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 -- 172.21.15.7:0/4252242081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c158cd0 msgr2=0x7fbc4c072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 --2- 172.21.15.7:0/4252242081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c158cd0 0x7fbc4c072ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0735b0 tx=0x7fbc3c02a120 comp rx=0 tx=0).stop 2024-08-19T00:38:36.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 -- 172.21.15.7:0/4252242081 shutdown_connections 2024-08-19T00:38:36.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 --2- 172.21.15.7:0/4252242081 >> v2:172.21.15.162:3300/0 conn(0x7fbc4c072ff0 0x7fbc4c0add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 --2- 172.21.15.7:0/4252242081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c158cd0 0x7fbc4c072ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 -- 172.21.15.7:0/4252242081 >> 172.21.15.7:0/4252242081 conn(0x7fbc4c0b2300 msgr2=0x7fbc4c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:36.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 -- 172.21.15.7:0/4252242081 shutdown_connections 2024-08-19T00:38:36.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.744+0000 7fbc52800640 1 -- 172.21.15.7:0/4252242081 wait complete. 2024-08-19T00:38:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.746+0000 7fbc52800640 1 Processor -- start 2024-08-19T00:38:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.746+0000 7fbc52800640 1 -- start start 2024-08-19T00:38:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4c072ff0 0x7fbc4c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc52800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c0ae2b0 0x7fbc4c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc52800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc4c14bde0 0x7fbc4c14c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc52800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0ae700 con 0x7fbc4c072ff0 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc52800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0af660 con 0x7fbc4c14bde0 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc52800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c0ae880 con 0x7fbc4c0ae2b0 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc4b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4c072ff0 0x7fbc4c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc4b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4c072ff0 0x7fbc4c15b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43352/0 (socket says 172.21.15.7:43352) 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc4b400640 1 -- 172.21.15.7:0/3383571854 learned_addr learned my addr 172.21.15.7:0/3383571854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.747+0000 7fbc43e00640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c0ae2b0 0x7fbc4c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4be00640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc4c14bde0 0x7fbc4c14c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4b400640 1 -- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c0ae2b0 msgr2=0x7fbc4c14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4b400640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c0ae2b0 0x7fbc4c14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4b400640 1 -- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc4c14bde0 msgr2=0x7fbc4c14c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4b400640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc4c14bde0 0x7fbc4c14c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4b400640 1 -- 172.21.15.7:0/3383571854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c15c650 con 0x7fbc4c072ff0 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4be00640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc4c14bde0 0x7fbc4c14c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc4b400640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4c072ff0 0x7fbc4c15b4e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c02a160 tx=0x7fbc3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc43400640 1 -- 172.21.15.7:0/3383571854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c037040 con 0x7fbc4c072ff0 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc43400640 1 -- 172.21.15.7:0/3383571854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c042070 con 0x7fbc4c072ff0 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc43400640 1 -- 172.21.15.7:0/3383571854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c030880 con 0x7fbc4c072ff0 2024-08-19T00:38:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4c15c090 con 0x7fbc4c072ff0 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.748+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4c14f1f0 con 0x7fbc4c072ff0 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.751+0000 7fbc43400640 1 -- 172.21.15.7:0/3383571854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc3c030a20 con 0x7fbc4c072ff0 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.751+0000 7fbc43400640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc2806be30 0x7fbc2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.752+0000 7fbc43400640 1 -- 172.21.15.7:0/3383571854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fbc3c0ab740 con 0x7fbc4c072ff0 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.752+0000 7fbc43e00640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc2806be30 0x7fbc2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.752+0000 7fbc55811740 1 Processor -- start 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc43e00640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc2806be30 0x7fbc2806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0cc8e0 tx=0x7fbc3400b3a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc55811740 1 -- start start 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970513990 0x555970559990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970510d00 0x555970559ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc55811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513d70 0x55597053d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc55811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555970475de0 con 0x555970513d70 2024-08-19T00:38:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55597040e0e0 con 0x555970513990 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.753+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555970471da0 con 0x555970510d00 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513d70 0x55597053d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970513990 0x555970559990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513d70 0x55597053d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43354/0 (socket says 172.21.15.7:43354) 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4be00640 1 -- 172.21.15.7:0/899815385 learned_addr learned my addr 172.21.15.7:0/899815385 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc43e00640 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970510d00 0x555970559ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4b400640 1 -- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970510d00 msgr2=0x555970559ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4b400640 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970510d00 0x555970559ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4b400640 1 -- 172.21.15.7:0/899815385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513d70 msgr2=0x55597053d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4b400640 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513d70 0x55597053d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4b400640 1 -- 172.21.15.7:0/899815385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559702537d0 con 0x555970513990 2024-08-19T00:38:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4be00640 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513d70 0x55597053d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.754+0000 7fbc4b400640 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970513990 0x555970559990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0a9bd0 tx=0x7fbc3c075d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1889a0b58505afc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc3be00640 1 -- 172.21.15.7:0/899815385 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c079980 con 0x555970513990 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc3be00640 1 -- 172.21.15.7:0/899815385 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c07dd30 con 0x555970513990 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc3be00640 1 -- 172.21.15.7:0/899815385 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c082560 con 0x555970513990 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc55811740 1 -- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970513990 msgr2=0x555970559990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc55811740 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970513990 0x555970559990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0a9bd0 tx=0x7fbc3c075d50 comp rx=0 tx=0).stop 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc55811740 1 -- 172.21.15.7:0/899815385 shutdown_connections 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc55811740 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513d70 0x55597053d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc55811740 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970510d00 0x555970559ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc55811740 1 --2- 172.21.15.7:0/899815385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970513990 0x555970559990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.755+0000 7fbc55811740 1 -- 172.21.15.7:0/899815385 >> 172.21.15.7:0/899815385 conn(0x5559704d9ff0 msgr2=0x555970558250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:36.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.756+0000 7fbc55811740 1 -- 172.21.15.7:0/899815385 shutdown_connections 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.756+0000 7fbc55811740 1 -- 172.21.15.7:0/899815385 wait complete. 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.756+0000 7fbc55811740 1 -- start start 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.756+0000 7fbc55811740 1 Processor -- start 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.757+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x55597053de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.757+0000 7fbc55811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970540390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.757+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970539bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.757+0000 7fbc55811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55597040e0e0 con 0x555970513990 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.757+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555970431180 con 0x555970510d00 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.757+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55597050e6c0 con 0x555970513d70 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.757+0000 7fbc55811740 10 client.0 _ll_register_callbacks cb 0x55597041d4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970540390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970540390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43362/0 (socket says 172.21.15.7:43362) 2024-08-19T00:38:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 -- 172.21.15.7:0/2982159285 learned_addr learned my addr 172.21.15.7:0/2982159285 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc4be00640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970539bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc4b400640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x55597053de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 -- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 msgr2=0x555970539bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970539bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 -- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 msgr2=0x55597053de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x55597053de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 -- 172.21.15.7:0/2982159285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559701893f0 con 0x555970513990 2024-08-19T00:38:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc4be00640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970539bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970540390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc3401c890 tx=0x7fbc34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e524c50c0f3018 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.758+0000 7fbc38c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc38c00640 1 -- 172.21.15.7:0/2982159285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401b670 con 0x555970513990 2024-08-19T00:38:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc38c00640 1 -- 172.21.15.7:0/2982159285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fbc3401b810 con 0x555970513990 2024-08-19T00:38:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc3c07dd30 con 0x555970513990 2024-08-19T00:38:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc38c00640 1 -- 172.21.15.7:0/2982159285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc34031050 con 0x555970513990 2024-08-19T00:38:36.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 10 client.5109 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5559701490f0 con 0x555970513990 2024-08-19T00:38:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc38c00640 1 -- 172.21.15.7:0/2982159285 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c07dd30 con 0x555970513990 2024-08-19T00:38:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc38c00640 1 -- 172.21.15.7:0/2982159285 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fbc34034020 con 0x555970513990 2024-08-19T00:38:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 10 client.5109 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:36.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 10 client.5109 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-08-19T00:38:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 20 client.5109 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970570730 0x55597053aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 4 client.5109 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:38:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.759+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555970483510 con 0x555970570730 2024-08-19T00:38:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.760+0000 7fbc4b400640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970570730 0x55597053aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.760+0000 7fbc4b400640 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970570730 0x55597053aac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed6f93493aa2b3c9 server_cookie=252fecdf46113ee7 in_seq=0 out_seq=0 2024-08-19T00:38:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.760+0000 7fbc38c00640 10 client.5109 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.761+0000 7fbc38c00640 1 -- 172.21.15.7:0/2982159285 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555970483510 con 0x555970570730 2024-08-19T00:38:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.761+0000 7fbc38c00640 10 client.5109 handle_command_reply: tid=0 2024-08-19T00:38:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.761+0000 7fbc55811740 1 client.5109 shutdown 2024-08-19T00:38:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.761+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 msgr2=0x555970540390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970540390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc3401c890 tx=0x7fbc34016000 comp rx=0 tx=0).stop 2024-08-19T00:38:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 shutdown_connections 2024-08-19T00:38:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970539bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970540390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970570730 0x55597053aac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 --2- 172.21.15.7:0/2982159285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x55597053de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 >> 172.21.15.7:0/2982159285 conn(0x5559704d9ff0 msgr2=0x55597055b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc38c00640 0 client.5109 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 shutdown_connections 2024-08-19T00:38:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 1 -- 172.21.15.7:0/2982159285 wait complete. 2024-08-19T00:38:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.762+0000 7fbc55811740 20 client.5109 trim_cache size 0 max 16384 2024-08-19T00:38:36.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.780+0000 7fbc55811740 1 Processor -- start 2024-08-19T00:38:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.780+0000 7fbc55811740 1 -- start start 2024-08-19T00:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x555970580ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc55811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970557f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x55597050ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc55811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c1fc6b0 con 0x555970513990 2024-08-19T00:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c1fb690 con 0x555970510d00 2024-08-19T00:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c09cdb0 con 0x555970513d70 2024-08-19T00:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970557f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970557f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43372/0 (socket says 172.21.15.7:43372) 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 -- 172.21.15.7:0/2001584052 learned_addr learned my addr 172.21.15.7:0/2001584052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc4b400640 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x555970580ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc4be00640 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x55597050ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 -- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 msgr2=0x55597050ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x55597050ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 -- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 msgr2=0x555970580ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x555970580ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.781+0000 7fbc43e00640 1 -- 172.21.15.7:0/2001584052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555970541390 con 0x555970513990 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.782+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970557f00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc3401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847621373d271250 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.782+0000 7fbc3b400640 1 -- 172.21.15.7:0/2001584052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34005c10 con 0x555970513990 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.782+0000 7fbc3b400640 1 -- 172.21.15.7:0/2001584052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc34005db0 con 0x555970513990 2024-08-19T00:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.782+0000 7fbc3b400640 1 -- 172.21.15.7:0/2001584052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401b8b0 con 0x555970513990 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.782+0000 7fbc55811740 1 -- 172.21.15.7:0/2001584052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 msgr2=0x555970557f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.782+0000 7fbc55811740 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970557f00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc3401b000 comp rx=0 tx=0).stop 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 -- 172.21.15.7:0/2001584052 shutdown_connections 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x55597050ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x555970557f00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 --2- 172.21.15.7:0/2001584052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x555970580ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 -- 172.21.15.7:0/2001584052 >> 172.21.15.7:0/2001584052 conn(0x5559704d9ff0 msgr2=0x5559705399c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 -- 172.21.15.7:0/2001584052 shutdown_connections 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 -- 172.21.15.7:0/2001584052 wait complete. 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 -- start start 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.783+0000 7fbc55811740 1 Processor -- start 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.784+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x5559705da7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.784+0000 7fbc55811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x5559705bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.784+0000 7fbc55811740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970555f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.784+0000 7fbc55811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55597050f1e0 con 0x555970513990 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.784+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c09d400 con 0x555970510d00 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.784+0000 7fbc55811740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55597053bad0 con 0x555970513d70 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.784+0000 7fbc55811740 10 client.0 _ll_register_callbacks cb 0x7fbc3400bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x5559705bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x5559705bf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43374/0 (socket says 172.21.15.7:43374) 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 -- 172.21.15.7:0/430015560 learned_addr learned my addr 172.21.15.7:0/430015560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc4b400640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x5559705da7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc4be00640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970555f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 -- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 msgr2=0x555970555f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970555f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 -- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 msgr2=0x5559705da7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x5559705da7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 -- 172.21.15.7:0/430015560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559705dd5f0 con 0x555970513990 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc4be00640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970555f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc43e00640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x5559705bf9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbc34037000 tx=0x7fbc34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea0ea8b128a446e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.785+0000 7fbc38c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc38c00640 1 -- 172.21.15.7:0/430015560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34046020 con 0x555970513990 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc38c00640 1 -- 172.21.15.7:0/430015560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fbc34005f60 con 0x555970513990 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc34005db0 con 0x555970513990 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc38c00640 1 -- 172.21.15.7:0/430015560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc34050050 con 0x555970513990 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 10 client.5115 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55597057f230 con 0x555970513990 2024-08-19T00:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc38c00640 1 -- 172.21.15.7:0/430015560 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc34005db0 con 0x555970513990 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc38c00640 1 -- 172.21.15.7:0/430015560 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fbc34053020 con 0x555970513990 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 10 client.5115 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 10 client.5115 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 20 client.5115 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970557fc0 0x555970556460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 4 client.5115 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.786+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55597047d860 con 0x555970557fc0 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.787+0000 7fbc4b400640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970557fc0 0x555970556460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.787+0000 7fbc4b400640 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970557fc0 0x555970556460 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bd1927f488cfc23 server_cookie=a8ff983f24ccf9c0 in_seq=0 out_seq=0 2024-08-19T00:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.787+0000 7fbc38c00640 10 client.5115 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc38c00640 1 -- 172.21.15.7:0/430015560 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55597047d860 con 0x555970557fc0 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc38c00640 10 client.5115 handle_command_reply: tid=0 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 client.5115 shutdown 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 msgr2=0x5559705bf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x5559705bf9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbc34037000 tx=0x7fbc34004730 comp rx=0 tx=0).stop 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 shutdown_connections 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555970513d70 0x555970555f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555970513990 0x5559705bf9a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x555970557fc0 0x555970556460 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 --2- 172.21.15.7:0/430015560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555970510d00 0x5559705da7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc38c00640 0 client.5115 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 >> 172.21.15.7:0/430015560 conn(0x5559704d9ff0 msgr2=0x555970580610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 shutdown_connections 2024-08-19T00:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 1 -- 172.21.15.7:0/430015560 wait complete. 2024-08-19T00:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.788+0000 7fbc55811740 20 client.5115 trim_cache size 0 max 16384 2024-08-19T00:38:36.799 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:38:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-08-19T00:38:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-08-19T00:38:36.799 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:38:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc2806be30 msgr2=0x7fbc2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc2806be30 0x7fbc2806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0cc8e0 tx=0x7fbc3400b3a0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4c072ff0 msgr2=0x7fbc4c15b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4c072ff0 0x7fbc4c15b4e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c02a160 tx=0x7fbc3c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 shutdown_connections 2024-08-19T00:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc2806be30 0x7fbc2806e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc4c14bde0 0x7fbc4c14c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc4c0ae2b0 0x7fbc4c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 --2- 172.21.15.7:0/3383571854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4c072ff0 0x7fbc4c15b4e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 >> 172.21.15.7:0/3383571854 conn(0x7fbc4c0b2300 msgr2=0x7fbc4c14dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 shutdown_connections 2024-08-19T00:38:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.789+0000 7fbc52800640 1 -- 172.21.15.7:0/3383571854 wait complete. 2024-08-19T00:38:36.806 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-19T00:38:36.806 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:38:36.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.960+0000 7f621f000640 1 Processor -- start 2024-08-19T00:38:36.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.960+0000 7f621f000640 1 -- start start 2024-08-19T00:38:36.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.961+0000 7f621f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621806e710 0x7f6218071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.961+0000 7f621f000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62180b3750 0x7f62180cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.961+0000 7f621f000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62180cdfb0 con 0x7f62180d03c0 2024-08-19T00:38:36.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.961+0000 7f621f000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f62180cebc0 con 0x7f62180b3750 2024-08-19T00:38:36.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.961+0000 7f621f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62180ce290 con 0x7f621806e710 2024-08-19T00:38:36.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f621d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62180b3750 0x7f62180cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f6217e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f62180d03c0 0x7f62180d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44068/0 (socket says 172.21.15.7:44068) 2024-08-19T00:38:36.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f6217e00640 1 -- 172.21.15.7:0/3510339490 learned_addr learned my addr 172.21.15.7:0/3510339490 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:36.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f620fe00640 1 --2- 172.21.15.7:0/3510339490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621806e710 0x7f6218071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f621d000640 1 -- 172.21.15.7:0/3510339490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621806e710 msgr2=0x7f6218071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:36.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f621d000640 1 --2- 172.21.15.7:0/3510339490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621806e710 0x7f6218071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f621d000640 1 -- 172.21.15.7:0/3510339490 >> v1:172.21.15.7:6789/0 conn(0x7f62180d03c0 legacy=0x7f62180d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f621d000640 1 -- 172.21.15.7:0/3510339490 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62180ce570 con 0x7f62180b3750 2024-08-19T00:38:36.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.962+0000 7f6217400640 1 -- 172.21.15.7:0/3510339490 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321452886 0 0) 0x7f62180cdfb0 con 0x7f62180d03c0 2024-08-19T00:38:36.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.963+0000 7f621d000640 1 --2- 172.21.15.7:0/3510339490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62180cf050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6210009d90 tx=0x7f621002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5283ff9be5f61255 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.963+0000 7f6217400640 1 -- 172.21.15.7:0/3510339490 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210007740 con 0x7f62180b3750 2024-08-19T00:38:36.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.963+0000 7f6217400640 1 -- 172.21.15.7:0/3510339490 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62100078e0 con 0x7f62180b3750 2024-08-19T00:38:36.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.963+0000 7f6217400640 1 -- 172.21.15.7:0/3510339490 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210007cb0 con 0x7f62180b3750 2024-08-19T00:38:36.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 -- 172.21.15.7:0/3510339490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 msgr2=0x7f62180cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 --2- 172.21.15.7:0/3510339490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62180cf050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6210009d90 tx=0x7f621002a660 comp rx=0 tx=0).stop 2024-08-19T00:38:36.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 -- 172.21.15.7:0/3510339490 shutdown_connections 2024-08-19T00:38:36.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 --2- 172.21.15.7:0/3510339490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62180cf050 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 --2- 172.21.15.7:0/3510339490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f621806e710 0x7f6218071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 -- 172.21.15.7:0/3510339490 >> 172.21.15.7:0/3510339490 conn(0x7f621806bc70 msgr2=0x7f621806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:36.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 -- 172.21.15.7:0/3510339490 shutdown_connections 2024-08-19T00:38:36.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.964+0000 7f621f000640 1 -- 172.21.15.7:0/3510339490 wait complete. 2024-08-19T00:38:36.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.966+0000 7f621f000640 1 Processor -- start 2024-08-19T00:38:36.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.966+0000 7f621f000640 1 -- start start 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f621f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621806e710 0x7f6218157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f621f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62181f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f621f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180d03c0 0x7f621815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f621f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6218073c60 con 0x7f62180b3750 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f621f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6218073ae0 con 0x7f621806e710 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f621f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62180b3be0 con 0x7f62180d03c0 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f620fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62181f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f620fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62181f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43394/0 (socket says 172.21.15.7:43394) 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f620fe00640 1 -- 172.21.15.7:0/2289564109 learned_addr learned my addr 172.21.15.7:0/2289564109 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f621d000640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180d03c0 0x7f621815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f6217e00640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621806e710 0x7f6218157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f620fe00640 1 -- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180d03c0 msgr2=0x7f621815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f620fe00640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180d03c0 0x7f621815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f620fe00640 1 -- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621806e710 msgr2=0x7f6218157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.967+0000 7f620fe00640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621806e710 0x7f6218157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.968+0000 7f620fe00640 1 -- 172.21.15.7:0/2289564109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6218158350 con 0x7f62180b3750 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.968+0000 7f620fe00640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62181f55e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f620000e8a0 tx=0x7f620000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.968+0000 7f6214c00640 1 -- 172.21.15.7:0/2289564109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200017070 con 0x7f62180b3750 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.968+0000 7f6214c00640 1 -- 172.21.15.7:0/2289564109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620000c940 con 0x7f62180b3750 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.968+0000 7f6214c00640 1 -- 172.21.15.7:0/2289564109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620000cd30 con 0x7f62180b3750 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.968+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621815b870 con 0x7f62180b3750 2024-08-19T00:38:36.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.968+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621815be30 con 0x7f62180b3750 2024-08-19T00:38:36.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.970+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62180cdfb0 con 0x7f62180b3750 2024-08-19T00:38:36.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.970+0000 7f6214c00640 1 -- 172.21.15.7:0/2289564109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f620001a070 con 0x7f62180b3750 2024-08-19T00:38:36.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.971+0000 7f6214c00640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61f406be30 0x7f61f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:36.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.971+0000 7f6214c00640 1 -- 172.21.15.7:0/2289564109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f620008b1b0 con 0x7f62180b3750 2024-08-19T00:38:36.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.971+0000 7f6217e00640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61f406be30 0x7f61f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:36.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.972+0000 7f6217e00640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61f406be30 0x7f61f406e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6208000f60 tx=0x7f6208007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:36.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:36.976+0000 7f6214c00640 1 -- 172.21.15.7:0/2289564109 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6200059a60 con 0x7f62180b3750 2024-08-19T00:38:37.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.194+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6218072d80 con 0x7f62180b3750 2024-08-19T00:38:37.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.194+0000 7f6214c00640 1 -- 172.21.15.7:0/2289564109 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7f6200059360 con 0x7f62180b3750 2024-08-19T00:38:37.196 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:38:37.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61f406be30 msgr2=0x7f61f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:37.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61f406be30 0x7f61f406e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6208000f60 tx=0x7f6208007b70 comp rx=0 tx=0).stop 2024-08-19T00:38:37.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 msgr2=0x7f62181f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:37.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62181f55e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f620000e8a0 tx=0x7f620000ed60 comp rx=0 tx=0).stop 2024-08-19T00:38:37.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 shutdown_connections 2024-08-19T00:38:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61f406be30 0x7f61f406e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180d03c0 0x7f621815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62180b3750 0x7f62181f55e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 --2- 172.21.15.7:0/2289564109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621806e710 0x7f6218157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.196+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 >> 172.21.15.7:0/2289564109 conn(0x7f621806bc70 msgr2=0x7f6218071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:37.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.197+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 shutdown_connections 2024-08-19T00:38:37.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37.197+0000 7f621f000640 1 -- 172.21.15.7:0/2289564109 wait complete. 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:38:37.215 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:38:37.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:37.216 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:38:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42744sec preferred_lft 42744sec 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:38:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:38:37.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:37.256 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:38:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:38:37.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:37.351 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:38:37.387 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:38:37.387 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:38:37.388 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:38:37.388 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:38:37.388 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:38:37.388 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:38:37.388 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:38:37.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:38:37.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:38:37.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:38:37.389 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:38:37.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:38:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:38:37.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:37.585 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:38:37.622 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:38:37.622 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:38:37.622 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:38:37.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:37.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:38:37.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:38:37.719 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:37.755 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:38:37.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:38:37.756 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:37.830 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:38:37.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:37.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:37.959 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:37.960 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:38:37.960 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:38:37.975 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:37.975 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:38:37.975 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:38:37.975 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:38:37.975 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:38:37.998 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:38:37.998 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:38:37.998 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:38:37.998 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:38:37.998 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:38:37.999 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:38:37.999 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:38:37.999 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:38:38.000 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:38:38.000 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:38:38.000 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:38:38.000 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:38:38.001 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:38:38.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:38:38.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:38.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:38.059 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:38:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:38:38.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:38:38.149 INFO:teuthology.orchestra.run.smithi007.stdout:client5127 2024-08-19T00:38:38.149 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:38.150 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:38.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:38.186 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-08-19T00:38:38.263 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:38:38.264 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:38:38.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.382+0000 7f1ba211cf40 1 Processor -- start 2024-08-19T00:38:38.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.382+0000 7f1ba211cf40 1 -- start start 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1ba211cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c8ff40 0x55f059d28ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1ba211cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d2e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1ba211cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c91990 0x55f059d2ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1ba211cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f059c05d00 con 0x55f059c915b0 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1ba211cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f059c09d40 con 0x55f059c8ff40 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1ba211cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f059d36dc0 con 0x55f059c91990 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1b9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d2e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1b9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d2e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43402/0 (socket says 172.21.15.7:43402) 2024-08-19T00:38:38.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1b9e000640 1 -- 172.21.15.7:0/2080151354 learned_addr learned my addr 172.21.15.7:0/2080151354 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1b9ea00640 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c8ff40 0x55f059d28ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.383+0000 7f1b9f400640 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c91990 0x55f059d2ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9e000640 1 -- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c91990 msgr2=0x55f059d2ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9e000640 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c91990 0x55f059d2ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9e000640 1 -- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c8ff40 msgr2=0x55f059d28ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9e000640 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c8ff40 0x55f059d28ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9e000640 1 -- 172.21.15.7:0/2080151354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f059bc7080 con 0x55f059c915b0 2024-08-19T00:38:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9ea00640 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c8ff40 0x55f059d28ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9e000640 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d2e810 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c001ce0 tx=0x7f1b8c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82cb96e1fd3ef8d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9cc00640 1 -- 172.21.15.7:0/2080151354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00bd80 con 0x55f059c915b0 2024-08-19T00:38:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9cc00640 1 -- 172.21.15.7:0/2080151354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00f400 con 0x55f059c915b0 2024-08-19T00:38:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.384+0000 7f1b9cc00640 1 -- 172.21.15.7:0/2080151354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00f830 con 0x55f059c915b0 2024-08-19T00:38:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 -- 172.21.15.7:0/2080151354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 msgr2=0x55f059d2e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d2e810 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c001ce0 tx=0x7f1b8c00b5b0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 -- 172.21.15.7:0/2080151354 shutdown_connections 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c91990 0x55f059d2ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d2e810 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/2080151354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c8ff40 0x55f059d28ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 -- 172.21.15.7:0/2080151354 >> 172.21.15.7:0/2080151354 conn(0x55f059c8e4e0 msgr2=0x55f059ca98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 -- 172.21.15.7:0/2080151354 shutdown_connections 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.385+0000 7f1ba211cf40 1 -- 172.21.15.7:0/2080151354 wait complete. 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.386+0000 7f1ba211cf40 1 Processor -- start 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.386+0000 7f1ba211cf40 1 -- start start 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1ba211cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c8ff40 0x55f059dcc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1ba211cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1ba211cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c91990 0x55f059d2bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1ba211cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f059c8de20 con 0x55f059c915b0 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1ba211cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f059d2bd50 con 0x55f059c91990 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1ba211cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f059d37a10 con 0x55f059c8ff40 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d249b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43406/0 (socket says 172.21.15.7:43406) 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 -- 172.21.15.7:0/3838973543 learned_addr learned my addr 172.21.15.7:0/3838973543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9ea00640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c8ff40 0x55f059dcc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9f400640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c91990 0x55f059d2bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 -- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c8ff40 msgr2=0x55f059dcc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c8ff40 0x55f059dcc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 -- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c91990 msgr2=0x55f059d2bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f059c91990 0x55f059d2bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9e000640 1 -- 172.21.15.7:0/3838973543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f059d2c8b0 con 0x55f059c915b0 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.387+0000 7f1b9ea00640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f059c8ff40 0x55f059dcc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.388+0000 7f1b9e000640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d249b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c002000 tx=0x7f1b8c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.388+0000 7f1b97400640 1 -- 172.21.15.7:0/3838973543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c020070 con 0x55f059c915b0 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.388+0000 7f1b97400640 1 -- 172.21.15.7:0/3838973543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c01c440 con 0x55f059c915b0 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.388+0000 7f1b97400640 1 -- 172.21.15.7:0/3838973543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c01c850 con 0x55f059c915b0 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.388+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f059d2cb90 con 0x55f059c915b0 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.388+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f059d2d3b0 con 0x55f059c915b0 2024-08-19T00:38:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.390+0000 7f1b97400640 1 -- 172.21.15.7:0/3838973543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b8c023070 con 0x55f059c915b0 2024-08-19T00:38:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.391+0000 7f1b97400640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b8006a840 0x7f1b8006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.391+0000 7f1b97400640 1 -- 172.21.15.7:0/3838973543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f1b8c08b480 con 0x55f059c915b0 2024-08-19T00:38:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.391+0000 7f1b9ea00640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b8006a840 0x7f1b8006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.391+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55f059d252b0 0x55f059d2dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.391+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f059d2e0f0 con 0x55f059d252b0 2024-08-19T00:38:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.392+0000 7f1b9f400640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55f059d252b0 0x55f059d2dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.392+0000 7f1b9ea00640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b8006a840 0x7f1b8006cd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f059c5e1b0 tx=0x7f1b90050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.392+0000 7f1b9f400640 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55f059d252b0 0x55f059d2dbb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1b9f400640 1 -- 172.21.15.7:0/3838973543 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v33'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1b98006d30 con 0x55f059d252b0 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55f059d252b0 msgr2=0x55f059d2dbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55f059d252b0 0x55f059d2dbb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b8006a840 msgr2=0x7f1b8006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b8006a840 0x7f1b8006cd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f059c5e1b0 tx=0x7f1b90050000 comp rx=0 tx=0).stop 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 msgr2=0x55f059d249b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 --2- 172.21.15.7:0/3838973543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f059c915b0 0x55f059d249b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c002000 tx=0x7f1b8c000bc0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1b9f400640 1 -- 172.21.15.7:0/3838973543 reap_dead start 2024-08-19T00:38:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 shutdown_connections 2024-08-19T00:38:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 >> 172.21.15.7:0/3838973543 conn(0x55f059c8e4e0 msgr2=0x55f059ca9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.394+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 shutdown_connections 2024-08-19T00:38:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.395+0000 7f1ba211cf40 1 -- 172.21.15.7:0/3838973543 wait complete. 2024-08-19T00:38:38.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:38.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.555+0000 7fc827e00640 1 Processor -- start 2024-08-19T00:38:38.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.555+0000 7fc827e00640 1 -- start start 2024-08-19T00:38:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc827e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8200d03c0 0x7fc820071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc827e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc82006e710 0x7fc8200d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc827e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8200b3750 0x7fc8200cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc827e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc8200cebc0 con 0x7fc8200d03c0 2024-08-19T00:38:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc827e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc8200d0ce0 con 0x7fc82006e710 2024-08-19T00:38:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc827e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8200cdfb0 con 0x7fc8200b3750 2024-08-19T00:38:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8200d03c0 0x7fc820071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc8200d03c0 0x7fc820071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43422/0 (socket says 172.21.15.7:43422) 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 -- 172.21.15.7:0/2192560454 learned_addr learned my addr 172.21.15.7:0/2192560454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825e00640 1 --2- 172.21.15.7:0/2192560454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8200b3750 0x7fc8200cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc824a00640 1 --2- 172.21.15.7:0/2192560454 >> v2:172.21.15.162:3300/0 conn(0x7fc82006e710 0x7fc8200d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 -- 172.21.15.7:0/2192560454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8200b3750 msgr2=0x7fc8200cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 --2- 172.21.15.7:0/2192560454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8200b3750 0x7fc8200cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 -- 172.21.15.7:0/2192560454 >> v2:172.21.15.162:3300/0 conn(0x7fc82006e710 msgr2=0x7fc8200d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 --2- 172.21.15.7:0/2192560454 >> v2:172.21.15.162:3300/0 conn(0x7fc82006e710 0x7fc8200d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825400640 1 -- 172.21.15.7:0/2192560454 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8200ce290 con 0x7fc8200d03c0 2024-08-19T00:38:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.557+0000 7fc825e00640 1 --2- 172.21.15.7:0/2192560454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8200b3750 0x7fc8200cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.558+0000 7fc825400640 1 --2- 172.21.15.7:0/2192560454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc820071980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc814009870 tx=0x7fc81402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcec87cfe5e2253a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc81fe00640 1 -- 172.21.15.7:0/2192560454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814037070 con 0x7fc8200d03c0 2024-08-19T00:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc81fe00640 1 -- 172.21.15.7:0/2192560454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc814032440 con 0x7fc8200d03c0 2024-08-19T00:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc81fe00640 1 -- 172.21.15.7:0/2192560454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814032810 con 0x7fc8200d03c0 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 -- 172.21.15.7:0/2192560454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 msgr2=0x7fc820071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 --2- 172.21.15.7:0/2192560454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc820071980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc814009870 tx=0x7fc81402a210 comp rx=0 tx=0).stop 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 -- 172.21.15.7:0/2192560454 shutdown_connections 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 --2- 172.21.15.7:0/2192560454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8200b3750 0x7fc8200cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 --2- 172.21.15.7:0/2192560454 >> v2:172.21.15.162:3300/0 conn(0x7fc82006e710 0x7fc8200d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 --2- 172.21.15.7:0/2192560454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc820071980 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 -- 172.21.15.7:0/2192560454 >> 172.21.15.7:0/2192560454 conn(0x7fc82006bc70 msgr2=0x7fc82006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 -- 172.21.15.7:0/2192560454 shutdown_connections 2024-08-19T00:38:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.559+0000 7fc827e00640 1 -- 172.21.15.7:0/2192560454 wait complete. 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.561+0000 7fc827e00640 1 Processor -- start 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.561+0000 7fc827e00640 1 -- start start 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc827e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc82006e710 0x7fc8200b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc827e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8200b3750 0x7fc8200cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc827e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc82015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc827e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc820073ae0 con 0x7fc8200d03c0 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc827e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8200ce850 con 0x7fc8200b3750 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc827e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc820073c60 con 0x7fc82006e710 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc825e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc82015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc825e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc82015de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43424/0 (socket says 172.21.15.7:43424) 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc825e00640 1 -- 172.21.15.7:0/3647036732 learned_addr learned my addr 172.21.15.7:0/3647036732 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc824a00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8200b3750 0x7fc8200cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.562+0000 7fc825400640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc82006e710 0x7fc8200b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc825e00640 1 -- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc82006e710 msgr2=0x7fc8200b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc825e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc82006e710 0x7fc8200b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc825e00640 1 -- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8200b3750 msgr2=0x7fc8200cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc825e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8200b3750 0x7fc8200cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc825e00640 1 -- 172.21.15.7:0/3647036732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8201531c0 con 0x7fc8200d03c0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc825400640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc82006e710 0x7fc8200b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc825e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc82015de60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc818007e20 tx=0x7fc81800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc81d600640 1 -- 172.21.15.7:0/3647036732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81801a070 con 0x7fc8200d03c0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc81d600640 1 -- 172.21.15.7:0/3647036732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc818003b90 con 0x7fc8200d03c0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc81d600640 1 -- 172.21.15.7:0/3647036732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81800de80 con 0x7fc8200d03c0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8200cbe60 con 0x7fc8200d03c0 2024-08-19T00:38:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.563+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8200c9810 con 0x7fc8200d03c0 2024-08-19T00:38:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.565+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8200b3be0 con 0x7fc8200d03c0 2024-08-19T00:38:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.565+0000 7fc81d600640 1 -- 172.21.15.7:0/3647036732 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc81801d070 con 0x7fc8200d03c0 2024-08-19T00:38:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.566+0000 7fc81d600640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc80006be30 0x7fc80006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.566+0000 7fc81d600640 1 -- 172.21.15.7:0/3647036732 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fc81808b0e0 con 0x7fc8200d03c0 2024-08-19T00:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.567+0000 7fc825400640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc80006be30 0x7fc80006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.567+0000 7fc825400640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc80006be30 0x7fc80006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc814034000 tx=0x7fc81402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.571+0000 7fc81d600640 1 -- 172.21.15.7:0/3647036732 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc8201531c0 con 0x7fc8200d03c0 2024-08-19T00:38:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.794+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8200b29d0 con 0x7fc8200d03c0 2024-08-19T00:38:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.795+0000 7fc81d600640 1 -- 172.21.15.7:0/3647036732 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5221 (secure 0 0 0) 0x7fc818010070 con 0x7fc8200d03c0 2024-08-19T00:38:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:38.797 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"btime":"2024-08-19T00:38:01:044484+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:38:01.044479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4706,"qdb_cluster":[4706]},"id":2}]} 2024-08-19T00:38:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-08-19T00:38:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc80006be30 msgr2=0x7fc80006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc80006be30 0x7fc80006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc814034000 tx=0x7fc81402e000 comp rx=0 tx=0).stop 2024-08-19T00:38:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 msgr2=0x7fc82015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc82015de60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc818007e20 tx=0x7fc81800d4a0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 shutdown_connections 2024-08-19T00:38:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc80006be30 0x7fc80006e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8200d03c0 0x7fc82015de60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8200b3750 0x7fc8200cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 --2- 172.21.15.7:0/3647036732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc82006e710 0x7fc8200b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 >> 172.21.15.7:0/3647036732 conn(0x7fc82006bc70 msgr2=0x7fc8200b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.797+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 shutdown_connections 2024-08-19T00:38:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.798+0000 7fc827e00640 1 -- 172.21.15.7:0/3647036732 wait complete. 2024-08-19T00:38:38.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage rm 1724412901 2024-08-19T00:38:38.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.973+0000 7f254a800640 1 Processor -- start 2024-08-19T00:38:38.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.973+0000 7f254a800640 1 -- start start 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.974+0000 7f254a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25440d27b0 0x7f25440d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.974+0000 7f254a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440b4150 0x7f25440b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.974+0000 7f254a800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25440b4b20 con 0x7f254415e3e0 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.974+0000 7f254a800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f25440d3140 con 0x7f25440d27b0 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.974+0000 7f254a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25440b4df0 con 0x7f25440b4150 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.974+0000 7f2548a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25440d27b0 0x7f25440d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.975+0000 7f2548a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25440d27b0 0x7f25440d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43428/0 (socket says 172.21.15.7:43428) 2024-08-19T00:38:38.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.975+0000 7f2548a00640 1 -- 172.21.15.7:0/3698542576 learned_addr learned my addr 172.21.15.7:0/3698542576 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.975+0000 7f2549e00640 1 --2- 172.21.15.7:0/3698542576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440b4150 0x7f25440b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.975+0000 7f2548a00640 1 -- 172.21.15.7:0/3698542576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440b4150 msgr2=0x7f25440b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.975+0000 7f2548a00640 1 --2- 172.21.15.7:0/3698542576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440b4150 0x7f25440b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.975+0000 7f2548a00640 1 -- 172.21.15.7:0/3698542576 >> v1:172.21.15.162:6789/0 conn(0x7f254415e3e0 legacy=0x7f25440b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.975+0000 7f2548a00640 1 -- 172.21.15.7:0/3698542576 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25440b50d0 con 0x7f25440d27b0 2024-08-19T00:38:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.976+0000 7f2548a00640 1 --2- 172.21.15.7:0/3698542576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25440d27b0 0x7f25440d2c00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25300098a0 tx=0x7f253002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7937a3e68320aa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.976+0000 7f2543e00640 1 -- 172.21.15.7:0/3698542576 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530037070 con 0x7f25440d27b0 2024-08-19T00:38:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.976+0000 7f2543e00640 1 -- 172.21.15.7:0/3698542576 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2530032440 con 0x7f25440d27b0 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.976+0000 7f2543e00640 1 -- 172.21.15.7:0/3698542576 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530032810 con 0x7f25440d27b0 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 -- 172.21.15.7:0/3698542576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25440d27b0 msgr2=0x7f25440d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 --2- 172.21.15.7:0/3698542576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25440d27b0 0x7f25440d2c00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25300098a0 tx=0x7f253002a250 comp rx=0 tx=0).stop 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 -- 172.21.15.7:0/3698542576 shutdown_connections 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 --2- 172.21.15.7:0/3698542576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440b4150 0x7f25440b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 --2- 172.21.15.7:0/3698542576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25440d27b0 0x7f25440d2c00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 -- 172.21.15.7:0/3698542576 >> 172.21.15.7:0/3698542576 conn(0x7f254408dbe0 msgr2=0x7f254409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 -- 172.21.15.7:0/3698542576 shutdown_connections 2024-08-19T00:38:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.977+0000 7f254a800640 1 -- 172.21.15.7:0/3698542576 wait complete. 2024-08-19T00:38:38.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.979+0000 7f254a800640 1 Processor -- start 2024-08-19T00:38:38.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.979+0000 7f254a800640 1 -- start start 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f254a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25440b4150 0x7f25441577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f254a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440d27b0 0x7f25440cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f254a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f254415e3e0 0x7f2544161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f254a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25440cee90 con 0x7f254415e3e0 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f254a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25440cf4c0 con 0x7f25440b4150 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f254a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25440cf9e0 con 0x7f25440d27b0 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f2549e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f254415e3e0 0x7f2544161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f2549e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f254415e3e0 0x7f2544161040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43442/0 (socket says 172.21.15.7:43442) 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f2548a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440d27b0 0x7f25440cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f2549e00640 1 -- 172.21.15.7:0/3223997696 learned_addr learned my addr 172.21.15.7:0/3223997696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.980+0000 7f2549400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25440b4150 0x7f25441577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2549e00640 1 -- 172.21.15.7:0/3223997696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440d27b0 msgr2=0x7f25440cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2549e00640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440d27b0 0x7f25440cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2549e00640 1 -- 172.21.15.7:0/3223997696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25440b4150 msgr2=0x7f25441577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2549e00640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25440b4150 0x7f25441577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2549e00640 1 -- 172.21.15.7:0/3223997696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544157ce0 con 0x7f254415e3e0 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2549e00640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f254415e3e0 0x7f2544161040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f253c007e70 tx=0x7f253c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2541600640 1 -- 172.21.15.7:0/3223997696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c014620 con 0x7f254415e3e0 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2541600640 1 -- 172.21.15.7:0/3223997696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c019070 con 0x7f254415e3e0 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f2541600640 1 -- 172.21.15.7:0/3223997696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c014a20 con 0x7f254415e3e0 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254415ffa0 con 0x7f254415e3e0 2024-08-19T00:38:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.981+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2544160560 con 0x7f254415e3e0 2024-08-19T00:38:38.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.983+0000 7f2541600640 1 -- 172.21.15.7:0/3223997696 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f253c014bc0 con 0x7f254415e3e0 2024-08-19T00:38:38.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.984+0000 7f2541600640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f252406be30 0x7f252406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.984+0000 7f2541600640 1 -- 172.21.15.7:0/3223997696 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f253c08b750 con 0x7f254415e3e0 2024-08-19T00:38:38.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.985+0000 7f2549400640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f252406be30 0x7f252406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.985+0000 7f254ecaa740 1 Processor -- start 2024-08-19T00:38:38.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.985+0000 7f254ecaa740 1 -- start start 2024-08-19T00:38:38.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.985+0000 7f2549400640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f252406be30 0x7f252406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2538006fd0 tx=0x7f2538009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe76c0 0x55df45fe7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe7fe0 0x55df46032ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df46031340 0x55df460331e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f254ecaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df45f4fe90 con 0x55df46031340 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55df45ef7cb0 con 0x55df45fe76c0 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55df45f4be50 con 0x55df45fe7fe0 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f2549e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df46031340 0x55df460331e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f2549e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df46031340 0x55df460331e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43450/0 (socket says 172.21.15.7:43450) 2024-08-19T00:38:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f2549e00640 1 -- 172.21.15.7:0/1642749431 learned_addr learned my addr 172.21.15.7:0/1642749431 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f2548a00640 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe7fe0 0x55df46032ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.986+0000 7f2549400640 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe76c0 0x55df45fe7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2549e00640 1 -- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe7fe0 msgr2=0x55df46032ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2549e00640 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe7fe0 0x55df46032ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2549e00640 1 -- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe76c0 msgr2=0x55df45fe7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2549e00640 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe76c0 0x55df45fe7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2549e00640 1 -- 172.21.15.7:0/1642749431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df45d2f710 con 0x55df46031340 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2549e00640 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df46031340 0x55df460331e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c040 tx=0x7f253c05dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97744f0bcc14645e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2535c00640 1 -- 172.21.15.7:0/1642749431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c0600c0 con 0x55df46031340 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2535c00640 1 -- 172.21.15.7:0/1642749431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c056020 con 0x55df46031340 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.987+0000 7f2535c00640 1 -- 172.21.15.7:0/1642749431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c059000 con 0x55df46031340 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 -- 172.21.15.7:0/1642749431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df46031340 msgr2=0x55df460331e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df46031340 0x55df460331e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c040 tx=0x7f253c05dcb0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 -- 172.21.15.7:0/1642749431 shutdown_connections 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df46031340 0x55df460331e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe7fe0 0x55df46032ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1642749431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe76c0 0x55df45fe7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 -- 172.21.15.7:0/1642749431 >> 172.21.15.7:0/1642749431 conn(0x55df45fb3ca0 msgr2=0x55df46031b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 -- 172.21.15.7:0/1642749431 shutdown_connections 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.988+0000 7f254ecaa740 1 -- 172.21.15.7:0/1642749431 wait complete. 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.989+0000 7f254ecaa740 1 -- start start 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.989+0000 7f254ecaa740 1 Processor -- start 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df46013390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46016e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df4602ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f254ecaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df45fed950 con 0x55df45fe7fe0 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55df45f0b870 con 0x55df46031340 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55df460310d0 con 0x55df45fe76c0 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f254ecaa740 10 client.0 _ll_register_callbacks cb 0x55df45c62af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f2548a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46016e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f2548a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46016e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43458/0 (socket says 172.21.15.7:43458) 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f2548a00640 1 -- 172.21.15.7:0/1733503026 learned_addr learned my addr 172.21.15.7:0/1733503026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f2549400640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df46013390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.990+0000 7f2549e00640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df4602ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f2548a00640 1 -- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 msgr2=0x55df46013390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f2548a00640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df46013390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f2548a00640 1 -- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 msgr2=0x55df4602ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f2548a00640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df4602ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f2548a00640 1 -- 172.21.15.7:0/1733503026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df45d8fea0 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f2549e00640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df4602ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f2548a00640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46016e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2530035040 tx=0x7f2530004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85002ae28800a0f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f252a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f252a000640 1 -- 172.21.15.7:0/1733503026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530043070 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f252a000640 1 -- 172.21.15.7:0/1733503026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f2530003a20 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253c056020 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f252a000640 1 -- 172.21.15.7:0/1733503026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f253004e050 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f254ecaa740 10 client.5154 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.991+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55df45c23000 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f252a000640 1 -- 172.21.15.7:0/1733503026 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c056020 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f252a000640 1 -- 172.21.15.7:0/1733503026 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f2530051020 con 0x55df45fe7fe0 2024-08-19T00:38:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f254ecaa740 10 client.5154 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f254ecaa740 10 client.5154 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:38:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f254ecaa740 20 client.5154 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df46036a00 0x55df4604f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f254ecaa740 4 client.5154 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:38:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df45f5d5c0 con 0x55df46036a00 2024-08-19T00:38:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.992+0000 7f2549400640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df46036a00 0x55df4604f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.993+0000 7f2549400640 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df46036a00 0x55df4604f1c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53eaef1f7a479a48 server_cookie=ce4be513f82cd7e1 in_seq=0 out_seq=0 2024-08-19T00:38:39.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.993+0000 7f252a000640 10 client.5154 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:39.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f252a000640 1 -- 172.21.15.7:0/1733503026 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df45f5d5c0 con 0x55df46036a00 2024-08-19T00:38:39.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f252a000640 10 client.5154 handle_command_reply: tid=0 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 client.5154 shutdown 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 msgr2=0x55df46016e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46016e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2530035040 tx=0x7f2530004730 comp rx=0 tx=0).stop 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 shutdown_connections 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df46036a00 0x55df4604f1c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df4602ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46016e60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 --2- 172.21.15.7:0/1733503026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df46013390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f252a000640 0 client.5154 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 >> 172.21.15.7:0/1733503026 conn(0x55df45fb3ca0 msgr2=0x55df46031f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 shutdown_connections 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.994+0000 7f254ecaa740 1 -- 172.21.15.7:0/1733503026 wait complete. 2024-08-19T00:38:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:38.995+0000 7f254ecaa740 20 client.5154 trim_cache size 0 max 16384 2024-08-19T00:38:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.008+0000 7f254ecaa740 1 Processor -- start 2024-08-19T00:38:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.009+0000 7f254ecaa740 1 -- start start 2024-08-19T00:38:39.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.009+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe76c0 0x55df45fe66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.009+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.009+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.009+0000 7f254ecaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ff9d0 con 0x55df45fe76c0 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.009+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f254415ec20 con 0x55df45fe7fe0 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.009+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f254415f270 con 0x55df46031340 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe76c0 0x55df45fe66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe76c0 0x55df45fe66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43464/0 (socket says 172.21.15.7:43464) 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 -- 172.21.15.7:0/2619885167 learned_addr learned my addr 172.21.15.7:0/2619885167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549e00640 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 -- 172.21.15.7:0/2619885167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df46031340 msgr2=0x55df46015050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 -- 172.21.15.7:0/2619885167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe7fe0 msgr2=0x55df46014b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:38:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 -- 172.21.15.7:0/2619885167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4602f400 con 0x55df45fe76c0 2024-08-19T00:38:39.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2549400640 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe76c0 0x55df45fe66a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55df46013920 tx=0x7f2538015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6563be8559812ee server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:39.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2535200640 1 -- 172.21.15.7:0/2619885167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253801b040 con 0x55df45fe76c0 2024-08-19T00:38:39.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2535200640 1 -- 172.21.15.7:0/2619885167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253802e070 con 0x55df45fe76c0 2024-08-19T00:38:39.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.010+0000 7f2535200640 1 -- 172.21.15.7:0/2619885167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538016b80 con 0x55df45fe76c0 2024-08-19T00:38:39.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 -- 172.21.15.7:0/2619885167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe76c0 msgr2=0x55df45fe66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe76c0 0x55df45fe66a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55df46013920 tx=0x7f2538015000 comp rx=0 tx=0).stop 2024-08-19T00:38:39.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 -- 172.21.15.7:0/2619885167 shutdown_connections 2024-08-19T00:38:39.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 --2- 172.21.15.7:0/2619885167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe76c0 0x55df45fe66a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 -- 172.21.15.7:0/2619885167 >> 172.21.15.7:0/2619885167 conn(0x55df45fb3ca0 msgr2=0x55df4602ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:39.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 -- 172.21.15.7:0/2619885167 shutdown_connections 2024-08-19T00:38:39.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.011+0000 7f254ecaa740 1 -- 172.21.15.7:0/2619885167 wait complete. 2024-08-19T00:38:39.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.012+0000 7f254ecaa740 1 -- start start 2024-08-19T00:38:39.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.012+0000 7f254ecaa740 1 Processor -- start 2024-08-19T00:38:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df460b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f254ecaa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f254ecaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df46036880 con 0x55df45fe7fe0 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55df4602f280 con 0x55df46031340 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f254ecaa740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55df4602cf10 con 0x55df45fe76c0 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f254ecaa740 10 client.0 _ll_register_callbacks cb 0x7f25300096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f2548a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f2548a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43474/0 (socket says 172.21.15.7:43474) 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f2548a00640 1 -- 172.21.15.7:0/3035178000 learned_addr learned my addr 172.21.15.7:0/3035178000 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f2549e00640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.013+0000 7f2549400640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df460b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2548a00640 1 -- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 msgr2=0x55df460b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2548a00640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df460b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2548a00640 1 -- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 msgr2=0x55df46015050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2548a00640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2548a00640 1 -- 172.21.15.7:0/3035178000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df46018960 con 0x55df45fe7fe0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2549400640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df460b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2549e00640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f2548a00640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f25300090b0 tx=0x7f2530009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b4bfb284598214 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f252a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f252a000640 1 -- 172.21.15.7:0/3035178000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530043040 con 0x55df45fe7fe0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f252a000640 1 -- 172.21.15.7:0/3035178000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f2530049b50 con 0x55df45fe7fe0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253802e070 con 0x55df45fe7fe0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f252a000640 1 -- 172.21.15.7:0/3035178000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2530058050 con 0x55df45fe7fe0 2024-08-19T00:38:39.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f254ecaa740 10 client.5160 fetch_fsmap learned FSMap version 21 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.014+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55df45fe2c60 con 0x55df45fe7fe0 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f252a000640 1 -- 172.21.15.7:0/3035178000 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253802e070 con 0x55df45fe7fe0 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f252a000640 1 -- 172.21.15.7:0/3035178000 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f253005b020 con 0x55df45fe7fe0 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f254ecaa740 10 client.5160 fetch_fsmap finished waiting for FSMap version 21 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f254ecaa740 10 client.5160 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f254ecaa740 20 client.5160 populate_metadata read hostname 'smithi007' 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f254ecaa740 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df460b9020 0x55df460bb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f254ecaa740 4 client.5160 mds_command: new command op to 4706 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 1724412901}] 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 --> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1724412901}) -- 0x55df45f57910 con 0x55df460b9020 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.015+0000 7f2549400640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df460b9020 0x55df460bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f2549400640 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df460b9020 0x55df460bb410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf3183e73ad2baca server_cookie=5d01f11760f01d4b in_seq=0 out_seq=0 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f252a000640 10 client.5160 ms_handle_connect on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f252a000640 1 -- 172.21.15.7:0/3035178000 <== mds.0 v2:172.21.15.162:6833/230096578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55df45f57910 con 0x55df460b9020 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f252a000640 10 client.5160 handle_command_reply: tid=0 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 client.5160 shutdown 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 msgr2=0x55df46014b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f25300090b0 tx=0x7f2530009240 comp rx=0 tx=0).stop 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 shutdown_connections 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:6833/230096578,v1:172.21.15.162:6835/230096578] conn(0x55df460b9020 0x55df460bb410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df46031340 0x55df46015050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df45fe7fe0 0x55df46014b10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 --2- 172.21.15.7:0/3035178000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55df45fe76c0 0x55df460b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 >> 172.21.15.7:0/3035178000 conn(0x55df45fb3ca0 msgr2=0x55df46013200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.016+0000 7f252a000640 0 client.5160 ms_handle_reset on v2:172.21.15.162:6833/230096578 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 shutdown_connections 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254ecaa740 1 -- 172.21.15.7:0/3035178000 wait complete. 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254ecaa740 20 client.5160 trim_cache size 0 max 16384 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f252406be30 msgr2=0x7f252406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f252406be30 0x7f252406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2538006fd0 tx=0x7f2538009060 comp rx=0 tx=0).stop 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f254415e3e0 msgr2=0x7f2544161040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f254415e3e0 0x7f2544161040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f253c007e70 tx=0x7f253c00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 shutdown_connections 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f252406be30 0x7f252406e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f254415e3e0 0x7f2544161040 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25440d27b0 0x7f25440cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 --2- 172.21.15.7:0/3223997696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25440b4150 0x7f25441577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 >> 172.21.15.7:0/3223997696 conn(0x7f254408dbe0 msgr2=0x7f25440b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 shutdown_connections 2024-08-19T00:38:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.017+0000 7f254a800640 1 -- 172.21.15.7:0/3223997696 wait complete. 2024-08-19T00:38:39.034 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:38:39.034 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-08-19T00:38:39.034 DEBUG:teuthology.orchestra.run.smithi007:> import errno 2024-08-19T00:38:39.035 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:38:39.035 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-08-19T00:38:39.035 DEBUG:teuthology.orchestra.run.smithi007:> f = open("/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged", "w") 2024-08-19T00:38:39.035 DEBUG:teuthology.orchestra.run.smithi007:> f.close() 2024-08-19T00:38:39.035 DEBUG:teuthology.orchestra.run.smithi007:> except IOError as e: 2024-08-19T00:38:39.035 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(errno.EIO) 2024-08-19T00:38:39.035 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:38:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:38:39.151 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:38:39.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:38:39.287 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:38:39.377 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:38:39.377 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:38:39.378 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:39.378 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:39.413 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:39.413 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:39.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:38:39.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.683+0000 7f14eba00640 1 Processor -- start 2024-08-19T00:38:39.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.683+0000 7f14eba00640 1 -- start start 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.684+0000 7f14eba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e40cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.684+0000 7f14eba00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14e40d03c0 0x7f14e40d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14eba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f14e40b4380 0x7f14e40b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14eba00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f14e40d0d60 con 0x7f14e40d03c0 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14eba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f14e415f990 con 0x7f14e40b4380 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14eba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14e40cf120 con 0x7f14e415f5b0 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14e40d03c0 0x7f14e40d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14e40d03c0 0x7f14e40d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43490/0 (socket says 172.21.15.7:43490) 2024-08-19T00:38:39.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 -- 172.21.15.7:0/259936360 learned_addr learned my addr 172.21.15.7:0/259936360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e9a00640 1 --2- 172.21.15.7:0/259936360 >> v2:172.21.15.162:3300/0 conn(0x7f14e40b4380 0x7f14e40b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e9000640 1 --2- 172.21.15.7:0/259936360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e40cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 -- 172.21.15.7:0/259936360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 msgr2=0x7f14e40cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 --2- 172.21.15.7:0/259936360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e40cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 -- 172.21.15.7:0/259936360 >> v2:172.21.15.162:3300/0 conn(0x7f14e40b4380 msgr2=0x7f14e40b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 --2- 172.21.15.7:0/259936360 >> v2:172.21.15.162:3300/0 conn(0x7f14e40b4380 0x7f14e40b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.685+0000 7f14e3e00640 1 -- 172.21.15.7:0/259936360 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e40cfaf0 con 0x7f14e40d03c0 2024-08-19T00:38:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.686+0000 7f14e3e00640 1 --2- 172.21.15.7:0/259936360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e40d0820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f14e406e140 tx=0x7f14d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6796942401ee5a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14e3400640 1 -- 172.21.15.7:0/259936360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0037070 con 0x7f14e40d03c0 2024-08-19T00:38:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14e3400640 1 -- 172.21.15.7:0/259936360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d0032440 con 0x7f14e40d03c0 2024-08-19T00:38:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14e3400640 1 -- 172.21.15.7:0/259936360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0032810 con 0x7f14e40d03c0 2024-08-19T00:38:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 -- 172.21.15.7:0/259936360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 msgr2=0x7f14e40d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 --2- 172.21.15.7:0/259936360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e40d0820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f14e406e140 tx=0x7f14d002a140 comp rx=0 tx=0).stop 2024-08-19T00:38:39.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 -- 172.21.15.7:0/259936360 shutdown_connections 2024-08-19T00:38:39.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 --2- 172.21.15.7:0/259936360 >> v2:172.21.15.162:3300/0 conn(0x7f14e40b4380 0x7f14e40b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 --2- 172.21.15.7:0/259936360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e40d0820 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 --2- 172.21.15.7:0/259936360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e40cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 -- 172.21.15.7:0/259936360 >> 172.21.15.7:0/259936360 conn(0x7f14e406bc70 msgr2=0x7f14e406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:39.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 -- 172.21.15.7:0/259936360 shutdown_connections 2024-08-19T00:38:39.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.687+0000 7f14eba00640 1 -- 172.21.15.7:0/259936360 wait complete. 2024-08-19T00:38:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.689+0000 7f14eba00640 1 Processor -- start 2024-08-19T00:38:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.689+0000 7f14eba00640 1 -- start start 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14eba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e40b4380 0x7f14e4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14eba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e409dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14eba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14eba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40cedb0 con 0x7f14e40d03c0 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14eba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40cead0 con 0x7f14e40b4380 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14eba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14e40b4d70 con 0x7f14e415f5b0 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e409dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e409dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43500/0 (socket says 172.21.15.7:43500) 2024-08-19T00:38:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.690+0000 7f14e3e00640 1 -- 172.21.15.7:0/2775405346 learned_addr learned my addr 172.21.15.7:0/2775405346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e3e00640 1 -- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 msgr2=0x7f14e415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e9000640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e40b4380 0x7f14e4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e9a00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e3e00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e415d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e3e00640 1 -- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e40b4380 msgr2=0x7f14e4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e3e00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e40b4380 0x7f14e4157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e3e00640 1 -- 172.21.15.7:0/2775405346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e415b350 con 0x7f14e40d03c0 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e9000640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e40b4380 0x7f14e4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e9a00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e3e00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e409dc10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14d002a180 tx=0x7f14d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e0c00640 1 -- 172.21.15.7:0/2775405346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0037040 con 0x7f14e40d03c0 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.691+0000 7f14e0c00640 1 -- 172.21.15.7:0/2775405346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d0042070 con 0x7f14e40d03c0 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.692+0000 7f14e0c00640 1 -- 172.21.15.7:0/2775405346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0030880 con 0x7f14e40d03c0 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.692+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e415b630 con 0x7f14e40d03c0 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.692+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e415af70 con 0x7f14e40d03c0 2024-08-19T00:38:39.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.693+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e40d0820 con 0x7f14e40d03c0 2024-08-19T00:38:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.693+0000 7f14e0c00640 1 -- 172.21.15.7:0/2775405346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14d0030a20 con 0x7f14e40d03c0 2024-08-19T00:38:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.694+0000 7f14e0c00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c406be30 0x7f14c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.694+0000 7f14e0c00640 1 -- 172.21.15.7:0/2775405346 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f14d00ab6b0 con 0x7f14e40d03c0 2024-08-19T00:38:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.695+0000 7f14e9000640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c406be30 0x7f14c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:39.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.695+0000 7f14e9000640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c406be30 0x7f14c406e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f14d8006fd0 tx=0x7f14d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.699+0000 7f14e0c00640 1 -- 172.21.15.7:0/2775405346 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f14d007a090 con 0x7f14e40d03c0 2024-08-19T00:38:39.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.893+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14e41e9d10 con 0x7f14e40d03c0 2024-08-19T00:38:39.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.893+0000 7f14e0c00640 1 -- 172.21.15.7:0/2775405346 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v33) ==== 80+0+124 (secure 0 0 0) 0x7f14d0079990 con 0x7f14e40d03c0 2024-08-19T00:38:39.895 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/1856893937 2024-08-20T00:37:57.403602+0000 2024-08-19T00:38:39.895 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/1856893937 2024-08-20T00:37:57.403602+0000 2024-08-19T00:38:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-08-19T00:38:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c406be30 msgr2=0x7f14c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c406be30 0x7f14c406e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f14d8006fd0 tx=0x7f14d8008040 comp rx=0 tx=0).stop 2024-08-19T00:38:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 msgr2=0x7f14e409dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e409dc10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14d002a180 tx=0x7f14d00046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 shutdown_connections 2024-08-19T00:38:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c406be30 0x7f14c406e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e415f5b0 0x7f14e415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e40d03c0 0x7f14e409dc10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 --2- 172.21.15.7:0/2775405346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e40b4380 0x7f14e4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.895+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 >> 172.21.15.7:0/2775405346 conn(0x7f14e406bc70 msgr2=0x7f14e4160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.896+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 shutdown_connections 2024-08-19T00:38:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:39.896+0000 7f14eba00640 1 -- 172.21.15.7:0/2775405346 wait complete. 2024-08-19T00:38:39.912 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:38:39.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:39.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:38:39.976 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:38:39.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:38:39.976 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:38:40.014 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:38:40.014 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:38:40.014 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:40.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:38:40.055 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:38:40.056 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:40.056 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:40.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:38:40.091 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:38:40.091 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:38:40.092 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:40.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:38:40.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:40.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.289+0000 7ff2c6200640 1 Processor -- start 2024-08-19T00:38:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.289+0000 7ff2c6200640 1 -- start start 2024-08-19T00:38:40.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c6200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2c015e360 0x7ff2c015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c6200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c00d2af0 0x7ff2c00d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c6200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c00b3ab0 con 0x7ff2c015e740 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c6200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c00d3490 con 0x7ff2c015e360 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c6200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c015f460 con 0x7ff2c00d2af0 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c4e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2c015e360 0x7ff2c015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c4e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2c015e360 0x7ff2c015fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43504/0 (socket says 172.21.15.7:43504) 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.290+0000 7ff2c4e00640 1 -- 172.21.15.7:0/2952476582 learned_addr learned my addr 172.21.15.7:0/2952476582 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.291+0000 7ff2bfe00640 1 --2- 172.21.15.7:0/2952476582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c00d2af0 0x7ff2c00d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.291+0000 7ff2c4e00640 1 -- 172.21.15.7:0/2952476582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c00d2af0 msgr2=0x7ff2c00d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.291+0000 7ff2c4e00640 1 --2- 172.21.15.7:0/2952476582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c00d2af0 0x7ff2c00d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.291+0000 7ff2c4e00640 1 -- 172.21.15.7:0/2952476582 >> v1:172.21.15.162:6789/0 conn(0x7ff2c015e740 legacy=0x7ff2c015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.291+0000 7ff2c4e00640 1 -- 172.21.15.7:0/2952476582 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c015f740 con 0x7ff2c015e360 2024-08-19T00:38:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.291+0000 7ff2bfe00640 1 --2- 172.21.15.7:0/2952476582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c00d2af0 0x7ff2c00d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:40.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.292+0000 7ff2c4e00640 1 --2- 172.21.15.7:0/2952476582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c015fab0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009870 tx=0x7ff2b402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677db62f3e9268fc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.292+0000 7ff2bf400640 1 -- 172.21.15.7:0/2952476582 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4037070 con 0x7ff2c015e360 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.292+0000 7ff2bf400640 1 -- 172.21.15.7:0/2952476582 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b4032440 con 0x7ff2c015e360 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.292+0000 7ff2bf400640 1 -- 172.21.15.7:0/2952476582 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4032810 con 0x7ff2c015e360 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 -- 172.21.15.7:0/2952476582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 msgr2=0x7ff2c015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 --2- 172.21.15.7:0/2952476582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c015fab0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009870 tx=0x7ff2b402a250 comp rx=0 tx=0).stop 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 -- 172.21.15.7:0/2952476582 shutdown_connections 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 --2- 172.21.15.7:0/2952476582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c00d2af0 0x7ff2c00d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 --2- 172.21.15.7:0/2952476582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c015fab0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 -- 172.21.15.7:0/2952476582 >> 172.21.15.7:0/2952476582 conn(0x7ff2c008dbf0 msgr2=0x7ff2c009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 -- 172.21.15.7:0/2952476582 shutdown_connections 2024-08-19T00:38:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.293+0000 7ff2c6200640 1 -- 172.21.15.7:0/2952476582 wait complete. 2024-08-19T00:38:40.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.294+0000 7ff2c6200640 1 Processor -- start 2024-08-19T00:38:40.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.294+0000 7ff2c6200640 1 -- start start 2024-08-19T00:38:40.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.295+0000 7ff2c6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c00d2af0 0x7ff2c014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.295+0000 7ff2c6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c00ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.295+0000 7ff2c6200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c015e740 0x7ff2c00d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.295+0000 7ff2c6200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00d2300 con 0x7ff2c015e360 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.295+0000 7ff2c6200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00b4040 con 0x7ff2c00d2af0 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.295+0000 7ff2c6200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c00b4560 con 0x7ff2c015e740 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c00ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c00ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43514/0 (socket says 172.21.15.7:43514) 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 -- 172.21.15.7:0/1511274224 learned_addr learned my addr 172.21.15.7:0/1511274224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2c4e00640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c00d2af0 0x7ff2c014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2c5800640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c015e740 0x7ff2c00d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 -- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c015e740 msgr2=0x7ff2c00d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c015e740 0x7ff2c00d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 -- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c00d2af0 msgr2=0x7ff2c014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c00d2af0 0x7ff2c014f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 -- 172.21.15.7:0/1511274224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c00b81d0 con 0x7ff2c015e360 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.296+0000 7ff2bfe00640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c00ca550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e7e0 tx=0x7ff2ac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.297+0000 7ff2bcc00640 1 -- 172.21.15.7:0/1511274224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac017070 con 0x7ff2c015e360 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.297+0000 7ff2bcc00640 1 -- 172.21.15.7:0/1511274224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac00c6d0 con 0x7ff2c015e360 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.297+0000 7ff2bcc00640 1 -- 172.21.15.7:0/1511274224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00f040 con 0x7ff2c015e360 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.297+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c00b7ef0 con 0x7ff2c015e360 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.297+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c00c9d50 con 0x7ff2c015e360 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.298+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c00d2f50 con 0x7ff2c015e360 2024-08-19T00:38:40.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.299+0000 7ff2bcc00640 1 -- 172.21.15.7:0/1511274224 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2ac01a070 con 0x7ff2c015e360 2024-08-19T00:38:40.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.300+0000 7ff2bcc00640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff2a006be30 0x7ff2a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.300+0000 7ff2bcc00640 1 -- 172.21.15.7:0/1511274224 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7ff2ac08ae40 con 0x7ff2c015e360 2024-08-19T00:38:40.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.300+0000 7ff2c4e00640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff2a006be30 0x7ff2a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.301+0000 7ff2c4e00640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff2a006be30 0x7ff2a006e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4034000 tx=0x7ff2b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:40.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.304+0000 7ff2bcc00640 1 -- 172.21.15.7:0/1511274224 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff2ac059010 con 0x7ff2c015e360 2024-08-19T00:38:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.525+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2c0161fe0 con 0x7ff2c015e360 2024-08-19T00:38:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.526+0000 7ff2bcc00640 1 -- 172.21.15.7:0/1511274224 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5221 (secure 0 0 0) 0x7ff2ac05d310 con 0x7ff2c015e360 2024-08-19T00:38:40.528 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:40.528 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"btime":"2024-08-19T00:38:01:044484+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:38:01.044479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4706,"qdb_cluster":[4706]},"id":2}]} 2024-08-19T00:38:40.528 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-08-19T00:38:40.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.528+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff2a006be30 msgr2=0x7ff2a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.528+0000 7ff2c6200640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff2a006be30 0x7ff2a006e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4034000 tx=0x7ff2b402e000 comp rx=0 tx=0).stop 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.528+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 msgr2=0x7ff2c00ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.528+0000 7ff2c6200640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c00ca550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e7e0 tx=0x7ff2ac00eca0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 shutdown_connections 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff2a006be30 0x7ff2a006e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2c015e740 0x7ff2c00d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c015e360 0x7ff2c00ca550 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 --2- 172.21.15.7:0/1511274224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c00d2af0 0x7ff2c014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 >> 172.21.15.7:0/1511274224 conn(0x7ff2c008dbf0 msgr2=0x7ff2c00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 shutdown_connections 2024-08-19T00:38:40.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.529+0000 7ff2c6200640 1 -- 172.21.15.7:0/1511274224 wait complete. 2024-08-19T00:38:40.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.702+0000 7f854b200640 1 Processor -- start 2024-08-19T00:38:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.702+0000 7f854b200640 1 -- start start 2024-08-19T00:38:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.703+0000 7f854b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e360 0x7f854c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.703+0000 7f854b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f854c0d2af0 0x7f854c0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f854c15e740 0x7f854c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f854c0d3490 con 0x7f854c15e740 2024-08-19T00:38:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f854c0b3ab0 con 0x7f854c0d2af0 2024-08-19T00:38:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f854c15f460 con 0x7f854c15e360 2024-08-19T00:38:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f854c15e740 0x7f854c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f854c15e740 0x7f854c15ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43518/0 (socket says 172.21.15.7:43518) 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 -- 172.21.15.7:0/757443945 learned_addr learned my addr 172.21.15.7:0/757443945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f8543e00640 1 --2- 172.21.15.7:0/757443945 >> v2:172.21.15.162:3300/0 conn(0x7f854c0d2af0 0x7f854c0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f8549e00640 1 --2- 172.21.15.7:0/757443945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e360 0x7f854c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 -- 172.21.15.7:0/757443945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e360 msgr2=0x7f854c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 --2- 172.21.15.7:0/757443945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e360 0x7f854c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 -- 172.21.15.7:0/757443945 >> v2:172.21.15.162:3300/0 conn(0x7f854c0d2af0 msgr2=0x7f854c0d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 --2- 172.21.15.7:0/757443945 >> v2:172.21.15.162:3300/0 conn(0x7f854c0d2af0 0x7f854c0d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f854a800640 1 -- 172.21.15.7:0/757443945 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c15f740 con 0x7f854c15e740 2024-08-19T00:38:40.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.704+0000 7f8543e00640 1 --2- 172.21.15.7:0/757443945 >> v2:172.21.15.162:3300/0 conn(0x7f854c0d2af0 0x7f854c0d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:40.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.705+0000 7f854a800640 1 --2- 172.21.15.7:0/757443945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e740 0x7f854c15ebd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f854c06c290 tx=0x7f854402a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714e9c4afab54b26 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:40.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f8549400640 1 -- 172.21.15.7:0/757443945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544036070 con 0x7f854c15e740 2024-08-19T00:38:40.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f8549400640 1 -- 172.21.15.7:0/757443945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544031600 con 0x7f854c15e740 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f8549400640 1 -- 172.21.15.7:0/757443945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85440319d0 con 0x7f854c15e740 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 -- 172.21.15.7:0/757443945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e740 msgr2=0x7f854c15ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 --2- 172.21.15.7:0/757443945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e740 0x7f854c15ebd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f854c06c290 tx=0x7f854402a690 comp rx=0 tx=0).stop 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 -- 172.21.15.7:0/757443945 shutdown_connections 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 --2- 172.21.15.7:0/757443945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e740 0x7f854c15ebd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 --2- 172.21.15.7:0/757443945 >> v2:172.21.15.162:3300/0 conn(0x7f854c0d2af0 0x7f854c0d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 --2- 172.21.15.7:0/757443945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e360 0x7f854c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 -- 172.21.15.7:0/757443945 >> 172.21.15.7:0/757443945 conn(0x7f854c08dbf0 msgr2=0x7f854c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 -- 172.21.15.7:0/757443945 shutdown_connections 2024-08-19T00:38:40.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.706+0000 7f854b200640 1 -- 172.21.15.7:0/757443945 wait complete. 2024-08-19T00:38:40.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.708+0000 7f854b200640 1 Processor -- start 2024-08-19T00:38:40.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.708+0000 7f854b200640 1 -- start start 2024-08-19T00:38:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f854b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c0d2af0 0x7f854c15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f854b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e360 0x7f854c0b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f854b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e740 0x7f854c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f854b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f854c15f110 con 0x7f854c15e360 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f854b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0b4040 con 0x7f854c0d2af0 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f854b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f854c0d2300 con 0x7f854c15e740 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f8543e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e360 0x7f854c0b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f8543e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e360 0x7f854c0b7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43530/0 (socket says 172.21.15.7:43530) 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f8543e00640 1 -- 172.21.15.7:0/1133715713 learned_addr learned my addr 172.21.15.7:0/1133715713 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.709+0000 7f8549e00640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c0d2af0 0x7f854c15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f854a800640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e740 0x7f854c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8543e00640 1 -- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e740 msgr2=0x7f854c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8543e00640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e740 0x7f854c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8543e00640 1 -- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c0d2af0 msgr2=0x7f854c15c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8543e00640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c0d2af0 0x7f854c15c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8543e00640 1 -- 172.21.15.7:0/1133715713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c15c6d0 con 0x7f854c15e360 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8543e00640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e360 0x7f854c0b7a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f853400d800 tx=0x7f853400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8542000640 1 -- 172.21.15.7:0/1133715713 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534018030 con 0x7f854c15e360 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8542000640 1 -- 172.21.15.7:0/1133715713 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85340096a0 con 0x7f854c15e360 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f8542000640 1 -- 172.21.15.7:0/1133715713 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534009870 con 0x7f854c15e360 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.710+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c0b8270 con 0x7f854c15e360 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.711+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c0b8ce0 con 0x7f854c15e360 2024-08-19T00:38:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.712+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c0d2f50 con 0x7f854c15e360 2024-08-19T00:38:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.713+0000 7f8542000640 1 -- 172.21.15.7:0/1133715713 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f853401b070 con 0x7f854c15e360 2024-08-19T00:38:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.714+0000 7f8542000640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f852806be60 0x7f852806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.714+0000 7f8542000640 1 -- 172.21.15.7:0/1133715713 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f853408b0a0 con 0x7f854c15e360 2024-08-19T00:38:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.714+0000 7f8549e00640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f852806be60 0x7f852806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.715+0000 7f8549e00640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f852806be60 0x7f852806e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f853c006fd0 tx=0x7f853c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.718+0000 7f8542000640 1 -- 172.21.15.7:0/1133715713 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f85340598d0 con 0x7f854c15e360 2024-08-19T00:38:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.940+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f854c160570 con 0x7f854c15e360 2024-08-19T00:38:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.940+0000 7f8542000640 1 -- 172.21.15.7:0/1133715713 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5221 (secure 0 0 0) 0x7f85340591d0 con 0x7f854c15e360 2024-08-19T00:38:40.942 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:40.942 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"btime":"2024-08-19T00:38:01:044484+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:38:01.044479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4706,"qdb_cluster":[4706]},"id":2}]} 2024-08-19T00:38:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-08-19T00:38:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f852806be60 msgr2=0x7f852806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f852806be60 0x7f852806e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f853c006fd0 tx=0x7f853c008040 comp rx=0 tx=0).stop 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e360 msgr2=0x7f854c0b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e360 0x7f854c0b7a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f853400d800 tx=0x7f853400dcc0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 shutdown_connections 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f852806be60 0x7f852806e320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f854c15e740 0x7f854c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f854c15e360 0x7f854c0b7a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 --2- 172.21.15.7:0/1133715713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c0d2af0 0x7f854c15c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 >> 172.21.15.7:0/1133715713 conn(0x7f854c08dbf0 msgr2=0x7f854c06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 shutdown_connections 2024-08-19T00:38:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:40.943+0000 7f854b200640 1 -- 172.21.15.7:0/1133715713 wait complete. 2024-08-19T00:38:40.961 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:38:41.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.117+0000 7fe6f6c00640 1 Processor -- start 2024-08-19T00:38:41.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.117+0000 7fe6f6c00640 1 -- start start 2024-08-19T00:38:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f6c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6f015e360 0x7fe6f015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f6c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f00d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f6c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f00b3ab0 con 0x7fe6f015e740 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f6c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f00d3490 con 0x7fe6f015e360 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f6c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f015f460 con 0x7fe6f00d2af0 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f5800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6f015e360 0x7fe6f015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f5800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6f015e360 0x7fe6f015fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43536/0 (socket says 172.21.15.7:43536) 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.118+0000 7fe6f5800640 1 -- 172.21.15.7:0/3849046773 learned_addr learned my addr 172.21.15.7:0/3849046773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.119+0000 7fe6f4e00640 1 --2- 172.21.15.7:0/3849046773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f00d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.119+0000 7fe6f5800640 1 -- 172.21.15.7:0/3849046773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 msgr2=0x7fe6f00d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.119+0000 7fe6f5800640 1 --2- 172.21.15.7:0/3849046773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f00d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.119+0000 7fe6f5800640 1 -- 172.21.15.7:0/3849046773 >> v1:172.21.15.162:6789/0 conn(0x7fe6f015e740 legacy=0x7fe6f015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.119+0000 7fe6f5800640 1 -- 172.21.15.7:0/3849046773 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f015f740 con 0x7fe6f015e360 2024-08-19T00:38:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.119+0000 7fe6efe00640 1 -- 172.21.15.7:0/3849046773 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239911873 0 0) 0x7fe6f00b3ab0 con 0x7fe6f015e740 2024-08-19T00:38:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.120+0000 7fe6f5800640 1 --2- 172.21.15.7:0/3849046773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e360 0x7fe6f015fab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009870 tx=0x7fe6e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ba27ce0a315744 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.120+0000 7fe6efe00640 1 -- 172.21.15.7:0/3849046773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4037070 con 0x7fe6f015e360 2024-08-19T00:38:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.120+0000 7fe6efe00640 1 -- 172.21.15.7:0/3849046773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e4032440 con 0x7fe6f015e360 2024-08-19T00:38:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.120+0000 7fe6efe00640 1 -- 172.21.15.7:0/3849046773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4032810 con 0x7fe6f015e360 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 -- 172.21.15.7:0/3849046773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e360 msgr2=0x7fe6f015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/3849046773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e360 0x7fe6f015fab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009870 tx=0x7fe6e402a270 comp rx=0 tx=0).stop 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 -- 172.21.15.7:0/3849046773 shutdown_connections 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/3849046773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f00d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/3849046773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e360 0x7fe6f015fab0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 -- 172.21.15.7:0/3849046773 >> 172.21.15.7:0/3849046773 conn(0x7fe6f008dbf0 msgr2=0x7fe6f009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 -- 172.21.15.7:0/3849046773 shutdown_connections 2024-08-19T00:38:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.121+0000 7fe6f6c00640 1 -- 172.21.15.7:0/3849046773 wait complete. 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.122+0000 7fe6f6c00640 1 Processor -- start 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.123+0000 7fe6f6c00640 1 -- start start 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.123+0000 7fe6f6c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f0156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.123+0000 7fe6f6c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f015e360 0x7fe6f01e8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e740 0x7fe6f01619b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00d2300 con 0x7fe6f015e740 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00b4040 con 0x7fe6f015e360 2024-08-19T00:38:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f00b4560 con 0x7fe6f00d2af0 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e740 0x7fe6f01619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e740 0x7fe6f01619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43552/0 (socket says 172.21.15.7:43552) 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 -- 172.21.15.7:0/1599358590 learned_addr learned my addr 172.21.15.7:0/1599358590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f4e00640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f015e360 0x7fe6f01e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f5800640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f0156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 -- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 msgr2=0x7fe6f0156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f0156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 -- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f015e360 msgr2=0x7fe6f01e8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f015e360 0x7fe6f01e8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.124+0000 7fe6f6200640 1 -- 172.21.15.7:0/1599358590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f00ba0f0 con 0x7fe6f015e740 2024-08-19T00:38:41.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.125+0000 7fe6f6200640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e740 0x7fe6f01619b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800c780 tx=0x7fe6e800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.125+0000 7fe6ed600640 1 -- 172.21.15.7:0/1599358590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8003b70 con 0x7fe6f015e740 2024-08-19T00:38:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.125+0000 7fe6ed600640 1 -- 172.21.15.7:0/1599358590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e8003d10 con 0x7fe6f015e740 2024-08-19T00:38:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.125+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f00b90e0 con 0x7fe6f015e740 2024-08-19T00:38:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.125+0000 7fe6ed600640 1 -- 172.21.15.7:0/1599358590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8005270 con 0x7fe6f015e740 2024-08-19T00:38:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.125+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f00b96a0 con 0x7fe6f015e740 2024-08-19T00:38:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.126+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f00d2f50 con 0x7fe6f015e740 2024-08-19T00:38:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.127+0000 7fe6ed600640 1 -- 172.21.15.7:0/1599358590 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6e8005410 con 0x7fe6f015e740 2024-08-19T00:38:41.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.128+0000 7fe6ed600640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6d006be30 0x7fe6d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.128+0000 7fe6ed600640 1 -- 172.21.15.7:0/1599358590 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fe6e808acb0 con 0x7fe6f015e740 2024-08-19T00:38:41.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.128+0000 7fe6f5800640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6d006be30 0x7fe6d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.129+0000 7fe6f5800640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6d006be30 0x7fe6d006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4034000 tx=0x7fe6e402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.132+0000 7fe6ed600640 1 -- 172.21.15.7:0/1599358590 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe6e8058f10 con 0x7fe6f015e740 2024-08-19T00:38:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.318+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6f015dc80 con 0x7fe6f015e740 2024-08-19T00:38:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.320+0000 7fe6ed600640 1 -- 172.21.15.7:0/1599358590 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16704 (secure 0 0 0) 0x7fe6e805d210 con 0x7fe6f015e740 2024-08-19T00:38:41.321 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:41.322 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:57.403624+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:45.444628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:46.080604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6835/1856893937":"2024-08-20T00:37:57.403602+0000","172.21.15.162:6833/1856893937":"2024-08-20T00:37:57.403602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6d006be30 msgr2=0x7fe6d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6d006be30 0x7fe6d006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4034000 tx=0x7fe6e402e000 comp rx=0 tx=0).stop 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e740 msgr2=0x7fe6f01619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e740 0x7fe6f01619b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800c780 tx=0x7fe6e800cb80 comp rx=0 tx=0).stop 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 shutdown_connections 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6d006be30 0x7fe6d006e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f015e740 0x7fe6f01619b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f015e360 0x7fe6f01e8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 --2- 172.21.15.7:0/1599358590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00d2af0 0x7fe6f0156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 >> 172.21.15.7:0/1599358590 conn(0x7fe6f008dbf0 msgr2=0x7fe6f00d4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 shutdown_connections 2024-08-19T00:38:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.322+0000 7fe6f6c00640 1 -- 172.21.15.7:0/1599358590 wait complete. 2024-08-19T00:38:41.340 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:38:41.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:41.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.495+0000 7fc5a1c00640 1 Processor -- start 2024-08-19T00:38:41.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.495+0000 7fc5a1c00640 1 -- start start 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.496+0000 7fc5a1c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc59c161ba0 0x7fc59c0d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.496+0000 7fc5a1c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c0d4b30 0x7fc59c0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.496+0000 7fc5a1c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc59c06c950 0x7fc59c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.496+0000 7fc5a1c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc59c0d5240 con 0x7fc59c06c950 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.496+0000 7fc5a1c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc59c0b39c0 con 0x7fc59c161ba0 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.496+0000 7fc5a1c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc59c0b36e0 con 0x7fc59c0d4b30 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc59c06c950 0x7fc59c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc59c06c950 0x7fc59c06ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43556/0 (socket says 172.21.15.7:43556) 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 -- 172.21.15.7:0/4213534951 learned_addr learned my addr 172.21.15.7:0/4213534951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:41.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59aa00640 1 --2- 172.21.15.7:0/4213534951 >> v2:172.21.15.162:3300/0 conn(0x7fc59c161ba0 0x7fc59c0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc593e00640 1 --2- 172.21.15.7:0/4213534951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c0d4b30 0x7fc59c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 -- 172.21.15.7:0/4213534951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c0d4b30 msgr2=0x7fc59c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 --2- 172.21.15.7:0/4213534951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c0d4b30 0x7fc59c0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 -- 172.21.15.7:0/4213534951 >> v2:172.21.15.162:3300/0 conn(0x7fc59c161ba0 msgr2=0x7fc59c0d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 --2- 172.21.15.7:0/4213534951 >> v2:172.21.15.162:3300/0 conn(0x7fc59c161ba0 0x7fc59c0d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc59b400640 1 -- 172.21.15.7:0/4213534951 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c06e3a0 con 0x7fc59c06c950 2024-08-19T00:38:41.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.497+0000 7fc593e00640 1 --2- 172.21.15.7:0/4213534951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c0d4b30 0x7fc59c0d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.498+0000 7fc59b400640 1 --2- 172.21.15.7:0/4213534951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06c950 0x7fc59c06ce00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0c7f20 tx=0x7fc59402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d27dade52878c90 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.498+0000 7fc59a000640 1 -- 172.21.15.7:0/4213534951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc594036070 con 0x7fc59c06c950 2024-08-19T00:38:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.498+0000 7fc59a000640 1 -- 172.21.15.7:0/4213534951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc594031600 con 0x7fc59c06c950 2024-08-19T00:38:41.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.498+0000 7fc59a000640 1 -- 172.21.15.7:0/4213534951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940319d0 con 0x7fc59c06c950 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 -- 172.21.15.7:0/4213534951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06c950 msgr2=0x7fc59c06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/4213534951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06c950 0x7fc59c06ce00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0c7f20 tx=0x7fc59402a6a0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 -- 172.21.15.7:0/4213534951 shutdown_connections 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/4213534951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06c950 0x7fc59c06ce00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/4213534951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c0d4b30 0x7fc59c0d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/4213534951 >> v2:172.21.15.162:3300/0 conn(0x7fc59c161ba0 0x7fc59c0d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 -- 172.21.15.7:0/4213534951 >> 172.21.15.7:0/4213534951 conn(0x7fc59c08c000 msgr2=0x7fc59c0d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 -- 172.21.15.7:0/4213534951 shutdown_connections 2024-08-19T00:38:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.499+0000 7fc5a1c00640 1 -- 172.21.15.7:0/4213534951 wait complete. 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.501+0000 7fc5a1c00640 1 Processor -- start 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.501+0000 7fc5a1c00640 1 -- start start 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc5a1c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c06c950 0x7fc59c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc5a1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c0d4b30 0x7fc59c0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc5a1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c161ba0 0x7fc59c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc5a1c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c161f80 con 0x7fc59c0d4b30 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc5a1c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c0b1be0 con 0x7fc59c161ba0 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc5a1c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc59c162100 con 0x7fc59c06c950 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc593e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c0d4b30 0x7fc59c0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc593e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c0d4b30 0x7fc59c0b8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43568/0 (socket says 172.21.15.7:43568) 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc593e00640 1 -- 172.21.15.7:0/446606283 learned_addr learned my addr 172.21.15.7:0/446606283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc59aa00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c06c950 0x7fc59c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.502+0000 7fc59b400640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c161ba0 0x7fc59c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc593e00640 1 -- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c06c950 msgr2=0x7fc59c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc593e00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c06c950 0x7fc59c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc593e00640 1 -- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c161ba0 msgr2=0x7fc59c0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc593e00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c161ba0 0x7fc59c0b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc593e00640 1 -- 172.21.15.7:0/446606283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c0cb690 con 0x7fc59c0d4b30 2024-08-19T00:38:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc593e00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c0d4b30 0x7fc59c0b8c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e840 tx=0x7fc58400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc592a00640 1 -- 172.21.15.7:0/446606283 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584017070 con 0x7fc59c0d4b30 2024-08-19T00:38:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc592a00640 1 -- 172.21.15.7:0/446606283 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58400c8d0 con 0x7fc59c0d4b30 2024-08-19T00:38:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59c0cb970 con 0x7fc59c0d4b30 2024-08-19T00:38:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc592a00640 1 -- 172.21.15.7:0/446606283 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58400f040 con 0x7fc59c0d4b30 2024-08-19T00:38:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.503+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59c0cbf30 con 0x7fc59c0d4b30 2024-08-19T00:38:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.504+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59c0d2490 con 0x7fc59c0d4b30 2024-08-19T00:38:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.505+0000 7fc592a00640 1 -- 172.21.15.7:0/446606283 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc58401a070 con 0x7fc59c0d4b30 2024-08-19T00:38:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.506+0000 7fc592a00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc57806be30 0x7fc57806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.506+0000 7fc592a00640 1 -- 172.21.15.7:0/446606283 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fc58408aa60 con 0x7fc59c0d4b30 2024-08-19T00:38:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.507+0000 7fc59aa00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc57806be30 0x7fc57806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.507+0000 7fc59aa00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc57806be30 0x7fc57806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009aa0 tx=0x7fc58c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.510+0000 7fc592a00640 1 -- 172.21.15.7:0/446606283 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc584009e20 con 0x7fc59c0d4b30 2024-08-19T00:38:41.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.730+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc59c0b66c0 con 0x7fc59c0d4b30 2024-08-19T00:38:41.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.730+0000 7fc592a00640 1 -- 172.21.15.7:0/446606283 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5221 (secure 0 0 0) 0x7fc584058cc0 con 0x7fc59c0d4b30 2024-08-19T00:38:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:41.732 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"btime":"2024-08-19T00:38:01:044484+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:38:01.044479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4706,"qdb_cluster":[4706]},"id":2}]} 2024-08-19T00:38:41.733 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc57806be30 msgr2=0x7fc57806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc57806be30 0x7fc57806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009aa0 tx=0x7fc58c009190 comp rx=0 tx=0).stop 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c0d4b30 msgr2=0x7fc59c0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c0d4b30 0x7fc59c0b8c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e840 tx=0x7fc58400ed00 comp rx=0 tx=0).stop 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 shutdown_connections 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc57806be30 0x7fc57806e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c161ba0 0x7fc59c0b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c0d4b30 0x7fc59c0b8c30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 --2- 172.21.15.7:0/446606283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc59c06c950 0x7fc59c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 >> 172.21.15.7:0/446606283 conn(0x7fc59c08c000 msgr2=0x7fc59c0b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:41.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 shutdown_connections 2024-08-19T00:38:41.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.733+0000 7fc5a1c00640 1 -- 172.21.15.7:0/446606283 wait complete. 2024-08-19T00:38:41.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:41.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.906+0000 7fc6a3400640 1 Processor -- start 2024-08-19T00:38:41.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.907+0000 7fc6a3400640 1 -- start start 2024-08-19T00:38:41.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a3400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc69c0ce500 0x7fc69c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc69c0d03c0 0x7fc69c0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a3400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c06f7f0 con 0x7fc69c159bf0 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a3400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc69c0d0d50 con 0x7fc69c0d03c0 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a3400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc69c06f510 con 0x7fc69c0ce500 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a1400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc69c0d03c0 0x7fc69c0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a1400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc69c0d03c0 0x7fc69c0d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43582/0 (socket says 172.21.15.7:43582) 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc6a1400640 1 -- 172.21.15.7:0/4097537546 learned_addr learned my addr 172.21.15.7:0/4097537546 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.908+0000 7fc69be00640 1 --2- 172.21.15.7:0/4097537546 >> v2:172.21.15.162:3300/0 conn(0x7fc69c0ce500 0x7fc69c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.909+0000 7fc6a1400640 1 -- 172.21.15.7:0/4097537546 >> v2:172.21.15.162:3300/0 conn(0x7fc69c0ce500 msgr2=0x7fc69c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.909+0000 7fc6a1400640 1 --2- 172.21.15.7:0/4097537546 >> v2:172.21.15.162:3300/0 conn(0x7fc69c0ce500 0x7fc69c0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.909+0000 7fc6a1400640 1 -- 172.21.15.7:0/4097537546 >> v1:172.21.15.162:6789/0 conn(0x7fc69c159bf0 legacy=0x7fc69c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.909+0000 7fc6a1400640 1 -- 172.21.15.7:0/4097537546 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c072980 con 0x7fc69c0d03c0 2024-08-19T00:38:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.910+0000 7fc6a1400640 1 --2- 172.21.15.7:0/4097537546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0d03c0 0x7fc69c0d0810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0b1cc0 tx=0x7fc69402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4bc8348b5d171a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.910+0000 7fc69b400640 1 -- 172.21.15.7:0/4097537546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694036070 con 0x7fc69c0d03c0 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.910+0000 7fc69b400640 1 -- 172.21.15.7:0/4097537546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc694031600 con 0x7fc69c0d03c0 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.910+0000 7fc69b400640 1 -- 172.21.15.7:0/4097537546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6940319d0 con 0x7fc69c0d03c0 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 -- 172.21.15.7:0/4097537546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0d03c0 msgr2=0x7fc69c0d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 --2- 172.21.15.7:0/4097537546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0d03c0 0x7fc69c0d0810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0b1cc0 tx=0x7fc69402a6a0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 -- 172.21.15.7:0/4097537546 shutdown_connections 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 --2- 172.21.15.7:0/4097537546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0d03c0 0x7fc69c0d0810 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 --2- 172.21.15.7:0/4097537546 >> v2:172.21.15.162:3300/0 conn(0x7fc69c0ce500 0x7fc69c0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 -- 172.21.15.7:0/4097537546 >> 172.21.15.7:0/4097537546 conn(0x7fc69c06bc70 msgr2=0x7fc69c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 -- 172.21.15.7:0/4097537546 shutdown_connections 2024-08-19T00:38:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.911+0000 7fc6a3400640 1 -- 172.21.15.7:0/4097537546 wait complete. 2024-08-19T00:38:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.912+0000 7fc6a3400640 1 Processor -- start 2024-08-19T00:38:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.913+0000 7fc6a3400640 1 -- start start 2024-08-19T00:38:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.913+0000 7fc6a3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0ce500 0x7fc69c09dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.913+0000 7fc6a3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69c0d03c0 0x7fc69c09a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.913+0000 7fc6a3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc69c159bf0 0x7fc69c1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.913+0000 7fc6a3400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c073b70 con 0x7fc69c0ce500 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.913+0000 7fc6a3400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c072f40 con 0x7fc69c159bf0 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.913+0000 7fc6a3400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c159fd0 con 0x7fc69c0d03c0 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0ce500 0x7fc69c09dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0ce500 0x7fc69c09dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43590/0 (socket says 172.21.15.7:43590) 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 -- 172.21.15.7:0/1302949639 learned_addr learned my addr 172.21.15.7:0/1302949639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc69be00640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69c0d03c0 0x7fc69c09a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a1400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc69c159bf0 0x7fc69c1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 -- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69c0d03c0 msgr2=0x7fc69c09a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69c0d03c0 0x7fc69c09a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 -- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc69c159bf0 msgr2=0x7fc69c1477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc69c159bf0 0x7fc69c1477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 -- 172.21.15.7:0/1302949639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c1f40c0 con 0x7fc69c0ce500 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a1400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc69c159bf0 0x7fc69c1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.914+0000 7fc6a0a00640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0ce500 0x7fc69c09dbb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c480 tx=0x7fc69000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.915+0000 7fc698c00640 1 -- 172.21.15.7:0/1302949639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6900052d0 con 0x7fc69c0ce500 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.915+0000 7fc698c00640 1 -- 172.21.15.7:0/1302949639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc690005470 con 0x7fc69c0ce500 2024-08-19T00:38:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.915+0000 7fc698c00640 1 -- 172.21.15.7:0/1302949639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690012870 con 0x7fc69c0ce500 2024-08-19T00:38:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.915+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c148240 con 0x7fc69c0ce500 2024-08-19T00:38:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.915+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c156b40 con 0x7fc69c0ce500 2024-08-19T00:38:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.916+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c0d0810 con 0x7fc69c0ce500 2024-08-19T00:38:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.917+0000 7fc698c00640 1 -- 172.21.15.7:0/1302949639 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc690012a10 con 0x7fc69c0ce500 2024-08-19T00:38:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.917+0000 7fc698c00640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.918+0000 7fc698c00640 1 -- 172.21.15.7:0/1302949639 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fc69008aa30 con 0x7fc69c0ce500 2024-08-19T00:38:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.918+0000 7fc69be00640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.918+0000 7fc69be00640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc69c15f820 tx=0x7fc688009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:41.922+0000 7fc698c00640 1 -- 172.21.15.7:0/1302949639 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc690059370 con 0x7fc69c0ce500 2024-08-19T00:38:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.142+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc69c0cf0b0 con 0x7fc69c0ce500 2024-08-19T00:38:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.142+0000 7fc698c00640 1 -- 172.21.15.7:0/1302949639 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5221 (secure 0 0 0) 0x7fc69005f020 con 0x7fc69c0ce500 2024-08-19T00:38:42.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:42.144 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"btime":"2024-08-19T00:38:01:044484+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:37:47.095917+0000","modified":"2024-08-19T00:38:01.044479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4706":{"gid":4706,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6835/230096578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":230096578},{"type":"v1","addr":"172.21.15.162:6835","nonce":230096578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4706,"qdb_cluster":[4706]},"id":2}]} 2024-08-19T00:38:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-08-19T00:38:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.144+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 msgr2=0x7fc67c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.144+0000 7fc6a3400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc69c15f820 tx=0x7fc688009190 comp rx=0 tx=0).stop 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.144+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0ce500 msgr2=0x7fc69c09dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.144+0000 7fc6a3400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0ce500 0x7fc69c09dbb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c480 tx=0x7fc69000c940 comp rx=0 tx=0).stop 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 shutdown_connections 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc69c159bf0 0x7fc69c1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69c0d03c0 0x7fc69c09a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 --2- 172.21.15.7:0/1302949639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c0ce500 0x7fc69c09dbb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 >> 172.21.15.7:0/1302949639 conn(0x7fc69c06bc70 msgr2=0x7fc69c15a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 shutdown_connections 2024-08-19T00:38:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.145+0000 7fc6a3400640 1 -- 172.21.15.7:0/1302949639 wait complete. 2024-08-19T00:38:42.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:38:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.318+0000 7f256ca00640 1 Processor -- start 2024-08-19T00:38:42.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.318+0000 7f256ca00640 1 -- start start 2024-08-19T00:38:42.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f256ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f256815e360 0x7f256815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f256ca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f25680d2af0 0x7f25680d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f256ca00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25680b3ab0 con 0x7f256815e740 2024-08-19T00:38:42.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f256ca00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f256815f460 con 0x7f256815e360 2024-08-19T00:38:42.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f256ca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f256815f740 con 0x7f25680d2af0 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f2567400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f256815e360 0x7f256815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f2567e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f256815e740 0x7f256815eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44092/0 (socket says 172.21.15.7:44092) 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.319+0000 7f2567e00640 1 -- 172.21.15.7:0/2998893360 learned_addr learned my addr 172.21.15.7:0/2998893360 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.320+0000 7f2566a00640 1 --2- 172.21.15.7:0/2998893360 >> v2:172.21.15.162:3300/0 conn(0x7f25680d2af0 0x7f25680d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.320+0000 7f2567400640 1 -- 172.21.15.7:0/2998893360 >> v2:172.21.15.162:3300/0 conn(0x7f25680d2af0 msgr2=0x7f25680d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.320+0000 7f2567400640 1 --2- 172.21.15.7:0/2998893360 >> v2:172.21.15.162:3300/0 conn(0x7f25680d2af0 0x7f25680d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.320+0000 7f2567400640 1 -- 172.21.15.7:0/2998893360 >> v1:172.21.15.7:6789/0 conn(0x7f256815e740 legacy=0x7f256815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.320+0000 7f2567400640 1 -- 172.21.15.7:0/2998893360 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25680b3d60 con 0x7f256815e360 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.320+0000 7f2566000640 1 -- 172.21.15.7:0/2998893360 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3044823913 0 0) 0x7f25680b3ab0 con 0x7f256815e740 2024-08-19T00:38:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.320+0000 7f2566a00640 1 --2- 172.21.15.7:0/2998893360 >> v2:172.21.15.162:3300/0 conn(0x7f25680d2af0 0x7f25680d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.321+0000 7f2567400640 1 --2- 172.21.15.7:0/2998893360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f256815e360 0x7f256815fab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f256808db80 tx=0x7f255802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e8efb8b403bc36 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.321+0000 7f2566000640 1 -- 172.21.15.7:0/2998893360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558037070 con 0x7f256815e360 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.321+0000 7f2566000640 1 -- 172.21.15.7:0/2998893360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2558032440 con 0x7f256815e360 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.321+0000 7f2566000640 1 -- 172.21.15.7:0/2998893360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558032810 con 0x7f256815e360 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.321+0000 7f256ca00640 1 -- 172.21.15.7:0/2998893360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f256815e360 msgr2=0x7f256815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.321+0000 7f256ca00640 1 --2- 172.21.15.7:0/2998893360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f256815e360 0x7f256815fab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f256808db80 tx=0x7f255802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.322+0000 7f256ca00640 1 -- 172.21.15.7:0/2998893360 shutdown_connections 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.322+0000 7f256ca00640 1 --2- 172.21.15.7:0/2998893360 >> v2:172.21.15.162:3300/0 conn(0x7f25680d2af0 0x7f25680d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.322+0000 7f256ca00640 1 --2- 172.21.15.7:0/2998893360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f256815e360 0x7f256815fab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.322+0000 7f256ca00640 1 -- 172.21.15.7:0/2998893360 >> 172.21.15.7:0/2998893360 conn(0x7f256808dbf0 msgr2=0x7f256809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.322+0000 7f256ca00640 1 -- 172.21.15.7:0/2998893360 shutdown_connections 2024-08-19T00:38:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.322+0000 7f256ca00640 1 -- 172.21.15.7:0/2998893360 wait complete. 2024-08-19T00:38:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.323+0000 7f256ca00640 1 Processor -- start 2024-08-19T00:38:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.323+0000 7f256ca00640 1 -- start start 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.324+0000 7f256ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25680d2af0 0x7f25680cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.324+0000 7f256ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f256815e360 0x7f25681f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.324+0000 7f256ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f256815e740 0x7f2568075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.324+0000 7f256ca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25680b4560 con 0x7f25680d2af0 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.324+0000 7f256ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25680d2300 con 0x7f256815e740 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.324+0000 7f256ca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25680b46e0 con 0x7f256815e360 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25680d2af0 0x7f25680cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25680d2af0 0x7f25680cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43602/0 (socket says 172.21.15.7:43602) 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 -- 172.21.15.7:0/476974413 learned_addr learned my addr 172.21.15.7:0/476974413 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2566a00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f256815e360 0x7f25681f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567e00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f256815e740 0x7f2568075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 -- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f256815e360 msgr2=0x7f25681f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f256815e360 0x7f25681f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 -- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f256815e740 msgr2=0x7f2568075050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f256815e740 0x7f2568075050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 -- 172.21.15.7:0/476974413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25680cb950 con 0x7f25680d2af0 2024-08-19T00:38:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.325+0000 7f2567400640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25680d2af0 0x7f25680cb2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2558000c00 tx=0x7f25580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:42.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.326+0000 7f255f400640 1 -- 172.21.15.7:0/476974413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558037040 con 0x7f25680d2af0 2024-08-19T00:38:42.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.326+0000 7f255f400640 1 -- 172.21.15.7:0/476974413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2558042070 con 0x7f25680d2af0 2024-08-19T00:38:42.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.326+0000 7f255f400640 1 -- 172.21.15.7:0/476974413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558030a50 con 0x7f25680d2af0 2024-08-19T00:38:42.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.326+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25680cbc30 con 0x7f25680d2af0 2024-08-19T00:38:42.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.326+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25680cc1f0 con 0x7f25680d2af0 2024-08-19T00:38:42.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.327+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25680d2f80 con 0x7f25680d2af0 2024-08-19T00:38:42.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.328+0000 7f255f400640 1 -- 172.21.15.7:0/476974413 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2558030bf0 con 0x7f25680d2af0 2024-08-19T00:38:42.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.329+0000 7f255f400640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f254806be30 0x7f254806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.329+0000 7f255f400640 1 -- 172.21.15.7:0/476974413 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f25580ab8d0 con 0x7f25680d2af0 2024-08-19T00:38:42.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.329+0000 7f2566a00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f254806be30 0x7f254806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.330+0000 7f2566a00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f254806be30 0x7f254806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25681513f0 tx=0x7f2554008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.333+0000 7f255f400640 1 -- 172.21.15.7:0/476974413 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f255807a330 con 0x7f25680d2af0 2024-08-19T00:38:42.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.518+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25680d50d0 con 0x7f25680d2af0 2024-08-19T00:38:42.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.519+0000 7f255f400640 1 -- 172.21.15.7:0/476974413 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16704 (secure 0 0 0) 0x7f2558079c30 con 0x7f25680d2af0 2024-08-19T00:38:42.521 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:42.521 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:37:57.403624+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:37:45.444628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-19T00:37:46.080604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6835/1856893937":"2024-08-20T00:37:57.403602+0000","172.21.15.162:6833/1856893937":"2024-08-20T00:37:57.403602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:38:42.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f254806be30 msgr2=0x7f254806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f254806be30 0x7f254806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25681513f0 tx=0x7f2554008040 comp rx=0 tx=0).stop 2024-08-19T00:38:42.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25680d2af0 msgr2=0x7f25680cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25680d2af0 0x7f25680cb2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2558000c00 tx=0x7f25580046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 shutdown_connections 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f254806be30 0x7f254806e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f256815e740 0x7f2568075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f256815e360 0x7f25681f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 --2- 172.21.15.7:0/476974413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25680d2af0 0x7f25680cb2b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.521+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 >> 172.21.15.7:0/476974413 conn(0x7f256808dbf0 msgr2=0x7f256815f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.522+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 shutdown_connections 2024-08-19T00:38:42.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.522+0000 7f256ca00640 1 -- 172.21.15.7:0/476974413 wait complete. 2024-08-19T00:38:42.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:38:42.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.696+0000 7f4efcc00640 1 Processor -- start 2024-08-19T00:38:42.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.696+0000 7f4efcc00640 1 -- start start 2024-08-19T00:38:42.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4efcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80d03c0 0x7f4ef8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4efcc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4ef806e710 0x7f4ef80d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4efcc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ef80b3750 0x7f4ef80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4efcc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef80cebc0 con 0x7f4ef80b3750 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4efcc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef80d0ce0 con 0x7f4ef806e710 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4efcc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef80cdfb0 con 0x7f4ef80d03c0 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4ef6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ef80b3750 0x7f4ef80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4ef6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ef80b3750 0x7f4ef80cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43606/0 (socket says 172.21.15.7:43606) 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.697+0000 7f4ef6800640 1 -- 172.21.15.7:0/1829591014 learned_addr learned my addr 172.21.15.7:0/1829591014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4ef5e00640 1 --2- 172.21.15.7:0/1829591014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80d03c0 0x7f4ef8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4eefe00640 1 --2- 172.21.15.7:0/1829591014 >> v2:172.21.15.162:3300/0 conn(0x7f4ef806e710 0x7f4ef80d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4ef6800640 1 -- 172.21.15.7:0/1829591014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80d03c0 msgr2=0x7f4ef8071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:42.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4ef6800640 1 --2- 172.21.15.7:0/1829591014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80d03c0 0x7f4ef8071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4ef6800640 1 -- 172.21.15.7:0/1829591014 >> v2:172.21.15.162:3300/0 conn(0x7f4ef806e710 msgr2=0x7f4ef80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:42.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4ef6800640 1 --2- 172.21.15.7:0/1829591014 >> v2:172.21.15.162:3300/0 conn(0x7f4ef806e710 0x7f4ef80d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4ef6800640 1 -- 172.21.15.7:0/1829591014 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef80ce290 con 0x7f4ef80b3750 2024-08-19T00:38:42.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.698+0000 7f4eefe00640 1 --2- 172.21.15.7:0/1829591014 >> v2:172.21.15.162:3300/0 conn(0x7f4ef806e710 0x7f4ef80d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:42.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.699+0000 7f4ef6800640 1 --2- 172.21.15.7:0/1829591014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80b3750 0x7f4ef80cf050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80cdbc0 tx=0x7f4ef002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34c99fe46f5284c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:42.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.699+0000 7f4ef5400640 1 -- 172.21.15.7:0/1829591014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0036070 con 0x7f4ef80b3750 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.699+0000 7f4ef5400640 1 -- 172.21.15.7:0/1829591014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef0031600 con 0x7f4ef80b3750 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.699+0000 7f4ef5400640 1 -- 172.21.15.7:0/1829591014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00319d0 con 0x7f4ef80b3750 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 -- 172.21.15.7:0/1829591014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80b3750 msgr2=0x7f4ef80cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 --2- 172.21.15.7:0/1829591014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80b3750 0x7f4ef80cf050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80cdbc0 tx=0x7f4ef002a6a0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 -- 172.21.15.7:0/1829591014 shutdown_connections 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 --2- 172.21.15.7:0/1829591014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80b3750 0x7f4ef80cf050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 --2- 172.21.15.7:0/1829591014 >> v2:172.21.15.162:3300/0 conn(0x7f4ef806e710 0x7f4ef80d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 --2- 172.21.15.7:0/1829591014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80d03c0 0x7f4ef8071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 -- 172.21.15.7:0/1829591014 >> 172.21.15.7:0/1829591014 conn(0x7f4ef806bc70 msgr2=0x7f4ef806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 -- 172.21.15.7:0/1829591014 shutdown_connections 2024-08-19T00:38:42.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.700+0000 7f4efcc00640 1 -- 172.21.15.7:0/1829591014 wait complete. 2024-08-19T00:38:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.701+0000 7f4efcc00640 1 Processor -- start 2024-08-19T00:38:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.702+0000 7f4efcc00640 1 -- start start 2024-08-19T00:38:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.702+0000 7f4efcc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef806e710 0x7f4ef8154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.702+0000 7f4efcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80b3750 0x7f4ef80b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.702+0000 7f4efcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80d03c0 0x7f4ef815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.702+0000 7f4efcc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8073ae0 con 0x7f4ef80d03c0 2024-08-19T00:38:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.702+0000 7f4efcc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef80ce850 con 0x7f4ef806e710 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4efcc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef8073c60 con 0x7f4ef80b3750 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80d03c0 0x7f4ef815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef806e710 0x7f4ef8154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef806e710 0x7f4ef8154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:49730/0 (socket says 172.21.15.7:49730) 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef5e00640 1 -- 172.21.15.7:0/755466681 learned_addr learned my addr 172.21.15.7:0/755466681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4eefe00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80b3750 0x7f4ef80b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef6800640 1 -- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80b3750 msgr2=0x7f4ef80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef6800640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80b3750 0x7f4ef80b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef6800640 1 -- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef806e710 msgr2=0x7f4ef8154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef6800640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef806e710 0x7f4ef8154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef6800640 1 -- 172.21.15.7:0/755466681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef81547c0 con 0x7f4ef80d03c0 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.703+0000 7f4ef5e00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef806e710 0x7f4ef8154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:42.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.704+0000 7f4ef6800640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80d03c0 0x7f4ef815ba70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0030000 tx=0x7f4ef0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.704+0000 7f4eee000640 1 -- 172.21.15.7:0/755466681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0036050 con 0x7f4ef80d03c0 2024-08-19T00:38:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.704+0000 7f4eee000640 1 -- 172.21.15.7:0/755466681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef0042070 con 0x7f4ef80d03c0 2024-08-19T00:38:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.704+0000 7f4eee000640 1 -- 172.21.15.7:0/755466681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0009510 con 0x7f4ef80d03c0 2024-08-19T00:38:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.704+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef815c400 con 0x7f4ef80d03c0 2024-08-19T00:38:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.704+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef815c9c0 con 0x7f4ef80d03c0 2024-08-19T00:38:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.705+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef80b3be0 con 0x7f4ef80d03c0 2024-08-19T00:38:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.706+0000 7f4eee000640 1 -- 172.21.15.7:0/755466681 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ef0007bf0 con 0x7f4ef80d03c0 2024-08-19T00:38:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.707+0000 7f4eee000640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.707+0000 7f4eee000640 1 -- 172.21.15.7:0/755466681 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f4ef00abaf0 con 0x7f4ef80d03c0 2024-08-19T00:38:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.708+0000 7f4ef5e00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.708+0000 7f4ef5e00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4ed406be30 0x7f4ed406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b240 tx=0x7f4ee800b3a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.712+0000 7f4eee000640 1 -- 172.21.15.7:0/755466681 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4ef0079f00 con 0x7f4ef80d03c0 2024-08-19T00:38:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.935+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4ef80add80 con 0x7f4ef80d03c0 2024-08-19T00:38:42.937 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:38:42.935+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:38:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.937+0000 7f4eee000640 1 -- 172.21.15.7:0/755466681 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f4ef007e200 con 0x7f4ef80d03c0 2024-08-19T00:38:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:38:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4ed406be30 msgr2=0x7f4ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4ed406be30 0x7f4ed406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b240 tx=0x7f4ee800b3a0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80d03c0 msgr2=0x7f4ef815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80d03c0 0x7f4ef815ba70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0030000 tx=0x7f4ef0004a40 comp rx=0 tx=0).stop 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 shutdown_connections 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ef80d03c0 0x7f4ef815ba70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ef80b3750 0x7f4ef80b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 --2- 172.21.15.7:0/755466681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef806e710 0x7f4ef8154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 >> 172.21.15.7:0/755466681 conn(0x7f4ef806bc70 msgr2=0x7f4ef80b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 shutdown_connections 2024-08-19T00:38:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:42.941+0000 7f4efcc00640 1 -- 172.21.15.7:0/755466681 wait complete. 2024-08-19T00:38:42.951 INFO:tasks.ceph.mds.d.smithi162.stderr: -3428> 2024-08-19T00:38:03.042+0000 7f7f77a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:38:42.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:38:43.001 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:38:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.116+0000 7f4d4a600640 1 Processor -- start 2024-08-19T00:38:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.117+0000 7f4d4a600640 1 -- start start 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.118+0000 7f4d4a600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d4415c390 0x7f4d44166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.118+0000 7f4d4a600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d440acef0 con 0x7f4d4415bfb0 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.118+0000 7f4d4a600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d440ad1d0 con 0x7f4d440b5130 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.118+0000 7f4d4a600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4d440ad790 con 0x7f4d4415c390 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.118+0000 7f4d43400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4d4415bfb0 0x7f4d440b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44106/0 (socket says 172.21.15.7:44106) 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.118+0000 7f4d43400640 1 -- 172.21.15.7:0/4008657555 learned_addr learned my addr 172.21.15.7:0/4008657555 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.118+0000 7f4d43e00640 1 --2- 172.21.15.7:0/4008657555 >> v2:172.21.15.162:3300/0 conn(0x7f4d4415c390 0x7f4d44166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.119+0000 7f4d43e00640 1 -- 172.21.15.7:0/4008657555 >> v1:172.21.15.162:6789/0 conn(0x7f4d440b5130 legacy=0x7f4d440aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.119+0000 7f4d42000640 1 -- 172.21.15.7:0/4008657555 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013546209 0 0) 0x7f4d440acef0 con 0x7f4d4415bfb0 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.119+0000 7f4d43e00640 1 -- 172.21.15.7:0/4008657555 >> v1:172.21.15.7:6789/0 conn(0x7f4d4415bfb0 legacy=0x7f4d440b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.119+0000 7f4d43e00640 1 -- 172.21.15.7:0/4008657555 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d440ad4b0 con 0x7f4d4415c390 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.120+0000 7f4d43e00640 1 --2- 172.21.15.7:0/4008657555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 0x7f4d44166dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009d90 tx=0x7f4d3c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1219a59fdb2b1478 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.120+0000 7f4d42000640 1 -- 172.21.15.7:0/4008657555 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c007740 con 0x7f4d4415c390 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.120+0000 7f4d42000640 1 -- 172.21.15.7:0/4008657555 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c0078e0 con 0x7f4d4415c390 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.120+0000 7f4d42000640 1 -- 172.21.15.7:0/4008657555 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c007cb0 con 0x7f4d4415c390 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.121+0000 7f4d4a600640 1 -- 172.21.15.7:0/4008657555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 msgr2=0x7f4d44166dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.121+0000 7f4d4a600640 1 --2- 172.21.15.7:0/4008657555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 0x7f4d44166dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009d90 tx=0x7f4d3c02a6f0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.121+0000 7f4d4a600640 1 -- 172.21.15.7:0/4008657555 shutdown_connections 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.121+0000 7f4d4a600640 1 --2- 172.21.15.7:0/4008657555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 0x7f4d44166dd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.121+0000 7f4d4a600640 1 -- 172.21.15.7:0/4008657555 >> 172.21.15.7:0/4008657555 conn(0x7f4d440b2300 msgr2=0x7f4d4406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.121+0000 7f4d4a600640 1 -- 172.21.15.7:0/4008657555 shutdown_connections 2024-08-19T00:38:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.121+0000 7f4d4a600640 1 -- 172.21.15.7:0/4008657555 wait complete. 2024-08-19T00:38:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.122+0000 7f4d4a600640 1 Processor -- start 2024-08-19T00:38:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.122+0000 7f4d4a600640 1 -- start start 2024-08-19T00:38:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.123+0000 7f4d4a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d440b5130 0x7f4d440cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.123+0000 7f4d4a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d4415bfb0 0x7f4d440c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.123+0000 7f4d4a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 0x7f4d441f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.123+0000 7f4d4a600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d440731d0 con 0x7f4d4415bfb0 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.123+0000 7f4d4a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d44073050 con 0x7f4d4415c390 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.123+0000 7f4d4a600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d440af2e0 con 0x7f4d440b5130 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d440b5130 0x7f4d440cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d42a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d4415bfb0 0x7f4d440c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d440b5130 0x7f4d440cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:51824/0 (socket says 172.21.15.7:51824) 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 -- 172.21.15.7:0/699315124 learned_addr learned my addr 172.21.15.7:0/699315124 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43e00640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 0x7f4d441f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 -- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 msgr2=0x7f4d441f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 0x7f4d441f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 -- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d4415bfb0 msgr2=0x7f4d440c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d4415bfb0 0x7f4d440c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 -- 172.21.15.7:0/699315124 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d440ca220 con 0x7f4d440b5130 2024-08-19T00:38:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.124+0000 7f4d43400640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d440b5130 0x7f4d440cbdf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c4a0 tx=0x7f4d3400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.125+0000 7f4d3b400640 1 -- 172.21.15.7:0/699315124 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34018070 con 0x7f4d440b5130 2024-08-19T00:38:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.125+0000 7f4d3b400640 1 -- 172.21.15.7:0/699315124 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d340074e0 con 0x7f4d440b5130 2024-08-19T00:38:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.125+0000 7f4d3b400640 1 -- 172.21.15.7:0/699315124 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004a20 con 0x7f4d440b5130 2024-08-19T00:38:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.125+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d441f4a10 con 0x7f4d440b5130 2024-08-19T00:38:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.125+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d440c94e0 con 0x7f4d440b5130 2024-08-19T00:38:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.126+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d440aebd0 con 0x7f4d440b5130 2024-08-19T00:38:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.127+0000 7f4d3b400640 1 -- 172.21.15.7:0/699315124 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d34004bc0 con 0x7f4d440b5130 2024-08-19T00:38:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.128+0000 7f4d3b400640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d2406be30 0x7f4d2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.128+0000 7f4d3b400640 1 -- 172.21.15.7:0/699315124 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5881+0+0 (secure 0 0 0) 0x7f4d3408a220 con 0x7f4d440b5130 2024-08-19T00:38:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.128+0000 7f4d42a00640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d2406be30 0x7f4d2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.129+0000 7f4d42a00640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d2406be30 0x7f4d2406e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d4415efa0 tx=0x7f4d30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:43.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.133+0000 7f4d3b400640 1 -- 172.21.15.7:0/699315124 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4d340584c0 con 0x7f4d440b5130 2024-08-19T00:38:43.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.356+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4d440cb2e0 con 0x7f4d440b5130 2024-08-19T00:38:43.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.942+0000 7f4d3b400640 1 -- 172.21.15.7:0/699315124 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f4d3405c7c0 con 0x7f4d440b5130 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d2406be30 msgr2=0x7f4d2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d2406be30 0x7f4d2406e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d4415efa0 tx=0x7f4d30009040 comp rx=0 tx=0).stop 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d440b5130 msgr2=0x7f4d440cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d440b5130 0x7f4d440cbdf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c4a0 tx=0x7f4d3400c960 comp rx=0 tx=0).stop 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 shutdown_connections 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d2406be30 0x7f4d2406e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4415c390 0x7f4d441f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d4415bfb0 0x7f4d440c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 --2- 172.21.15.7:0/699315124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d440b5130 0x7f4d440cbdf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 >> 172.21.15.7:0/699315124 conn(0x7f4d440b2300 msgr2=0x7f4d4406f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:43.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 shutdown_connections 2024-08-19T00:38:43.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:43.945+0000 7f4d4a600640 1 -- 172.21.15.7:0/699315124 wait complete. 2024-08-19T00:38:43.964 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:38:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.124+0000 7effe2400640 1 Processor -- start 2024-08-19T00:38:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.125+0000 7effe2400640 1 -- start start 2024-08-19T00:38:44.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effe2400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effdc06f270 0x7effdc072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:44.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effe2400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effdc06f650 0x7effdc15fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:44.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effe2400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effdc0b2c10 con 0x7effdc06da00 2024-08-19T00:38:44.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effe2400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7effdc06de30 con 0x7effdc06f650 2024-08-19T00:38:44.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effe2400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7effdc06e100 con 0x7effdc06f270 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effd3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effdc06f650 0x7effdc15fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effd3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effdc06f650 0x7effdc15fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39706/0 (socket says 172.21.15.7:39706) 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effd3e00640 1 -- 172.21.15.7:0/2653399335 learned_addr learned my addr 172.21.15.7:0/2653399335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effdb400640 1 --2- 172.21.15.7:0/2653399335 >> v2:172.21.15.162:3300/0 conn(0x7effdc06f270 0x7effdc072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effd3e00640 1 -- 172.21.15.7:0/2653399335 >> v2:172.21.15.162:3300/0 conn(0x7effdc06f270 msgr2=0x7effdc072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effd3e00640 1 --2- 172.21.15.7:0/2653399335 >> v2:172.21.15.162:3300/0 conn(0x7effdc06f270 0x7effdc072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.126+0000 7effd3e00640 1 -- 172.21.15.7:0/2653399335 >> v1:172.21.15.162:6789/0 conn(0x7effdc06da00 legacy=0x7effdc0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.127+0000 7effd3e00640 1 -- 172.21.15.7:0/2653399335 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc06e3e0 con 0x7effdc06f650 2024-08-19T00:38:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effd3e00640 1 --2- 172.21.15.7:0/2653399335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f650 0x7effdc15fb00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7effdc0cdd70 tx=0x7effc402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8c322d7e373c5e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effdaa00640 1 -- 172.21.15.7:0/2653399335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4037070 con 0x7effdc06f650 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effdaa00640 1 -- 172.21.15.7:0/2653399335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc4032440 con 0x7effdc06f650 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effdaa00640 1 -- 172.21.15.7:0/2653399335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4032810 con 0x7effdc06f650 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effe2400640 1 -- 172.21.15.7:0/2653399335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f650 msgr2=0x7effdc15fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effe2400640 1 --2- 172.21.15.7:0/2653399335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f650 0x7effdc15fb00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7effdc0cdd70 tx=0x7effc402a230 comp rx=0 tx=0).stop 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effe2400640 1 -- 172.21.15.7:0/2653399335 shutdown_connections 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effe2400640 1 --2- 172.21.15.7:0/2653399335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f650 0x7effdc15fb00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effe2400640 1 --2- 172.21.15.7:0/2653399335 >> v2:172.21.15.162:3300/0 conn(0x7effdc06f270 0x7effdc072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.128+0000 7effe2400640 1 -- 172.21.15.7:0/2653399335 >> 172.21.15.7:0/2653399335 conn(0x7effdc06be80 msgr2=0x7effdc0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.129+0000 7effe2400640 1 -- 172.21.15.7:0/2653399335 shutdown_connections 2024-08-19T00:38:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.129+0000 7effe2400640 1 -- 172.21.15.7:0/2653399335 wait complete. 2024-08-19T00:38:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.130+0000 7effe2400640 1 Processor -- start 2024-08-19T00:38:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.130+0000 7effe2400640 1 -- start start 2024-08-19T00:38:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effe2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effdc06da00 0x7effdc14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effe2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f270 0x7effdc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effe2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effdc06f650 0x7effdc0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effe2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0cdf40 con 0x7effdc06f270 2024-08-19T00:38:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effe2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7effdc06e9a0 con 0x7effdc06da00 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effe2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7effdc15f2c0 con 0x7effdc06f650 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effd3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f270 0x7effdc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effd3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f270 0x7effdc0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39710/0 (socket says 172.21.15.7:39710) 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.131+0000 7effd3e00640 1 -- 172.21.15.7:0/2657970278 learned_addr learned my addr 172.21.15.7:0/2657970278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effdb400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effdc06da00 0x7effdc14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effdbe00640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effdc06f650 0x7effdc0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3e00640 1 -- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effdc06f650 msgr2=0x7effdc0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3e00640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effdc06f650 0x7effdc0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3e00640 1 -- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effdc06da00 msgr2=0x7effdc14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3e00640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effdc06da00 0x7effdc14fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3e00640 1 -- 172.21.15.7:0/2657970278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc09d430 con 0x7effdc06f270 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3e00640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f270 0x7effdc0cc7d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7effc4000c00 tx=0x7effc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3400640 1 -- 172.21.15.7:0/2657970278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4041020 con 0x7effdc06f270 2024-08-19T00:38:44.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3400640 1 -- 172.21.15.7:0/2657970278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc40306c0 con 0x7effdc06f270 2024-08-19T00:38:44.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effd3400640 1 -- 172.21.15.7:0/2657970278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4037040 con 0x7effdc06f270 2024-08-19T00:38:44.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc09d150 con 0x7effdc06f270 2024-08-19T00:38:44.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.132+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc1f5a20 con 0x7effdc06f270 2024-08-19T00:38:44.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.134+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc15f650 con 0x7effdc06f270 2024-08-19T00:38:44.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.134+0000 7effd3400640 1 -- 172.21.15.7:0/2657970278 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effc4044020 con 0x7effdc06f270 2024-08-19T00:38:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.135+0000 7effd3400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.135+0000 7effd3400640 1 -- 172.21.15.7:0/2657970278 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5881+0+0 (secure 0 0 0) 0x7effc40ab750 con 0x7effdc06f270 2024-08-19T00:38:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.136+0000 7effdb400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.136+0000 7effdb400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effcc006fd0 tx=0x7effcc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.140+0000 7effd3400640 1 -- 172.21.15.7:0/2657970278 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7effc404b030 con 0x7effdc06f270 2024-08-19T00:38:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:44.329+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7effdc0affc0 con 0x7effdc06f270 2024-08-19T00:38:45.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.278+0000 7effd3400640 1 -- 172.21.15.7:0/2657970278 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7effc407a050 con 0x7effdc06f270 2024-08-19T00:38:45.280 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:38:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.284+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 msgr2=0x7effb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.284+0000 7effe2400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effcc006fd0 tx=0x7effcc008040 comp rx=0 tx=0).stop 2024-08-19T00:38:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.284+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f270 msgr2=0x7effdc0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.284+0000 7effe2400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f270 0x7effdc0cc7d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7effc4000c00 tx=0x7effc40046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.285+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 shutdown_connections 2024-08-19T00:38:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.285+0000 7effe2400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7effb806be30 0x7effb806e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.285+0000 7effe2400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effdc06f650 0x7effdc0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.285+0000 7effe2400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effdc06f270 0x7effdc0cc7d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.285+0000 7effe2400640 1 --2- 172.21.15.7:0/2657970278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effdc06da00 0x7effdc14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.285+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 >> 172.21.15.7:0/2657970278 conn(0x7effdc06be80 msgr2=0x7effdc0aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.286+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 shutdown_connections 2024-08-19T00:38:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.286+0000 7effe2400640 1 -- 172.21.15.7:0/2657970278 wait complete. 2024-08-19T00:38:45.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:38:45.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.470+0000 7f500fc00640 1 Processor -- start 2024-08-19T00:38:45.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.470+0000 7f500fc00640 1 -- start start 2024-08-19T00:38:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.471+0000 7f500fc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f500815ce50 0x7f50081670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.471+0000 7f500fc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500815d390 con 0x7f5008073540 2024-08-19T00:38:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.471+0000 7f500fc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500815fe60 con 0x7f50080cd080 2024-08-19T00:38:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.471+0000 7f500fc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5008072f10 con 0x7f500815ce50 2024-08-19T00:38:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.471+0000 7f500d200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5008073540 0x7f50080cc970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35404/0 (socket says 172.21.15.7:35404) 2024-08-19T00:38:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.471+0000 7f500d200640 1 -- 172.21.15.7:0/2825367430 learned_addr learned my addr 172.21.15.7:0/2825367430 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:45.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f500dc00640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f500815ce50 0x7f50081670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:45.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985286207 0 0) 0x7f500815d390 con 0x7f5008073540 2024-08-19T00:38:45.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff0003520 con 0x7f5008073540 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845231862 0 0) 0x7f500815fe60 con 0x7f50080cd080 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f500815d390 con 0x7f50080cd080 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3443922558 0 0) 0x7f4ff0003520 con 0x7f5008073540 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f500815ce50 msgr2=0x7f50081670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f500815ce50 0x7f50081670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 >> v1:172.21.15.162:6789/0 conn(0x7f50080cd080 legacy=0x7f500815c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5008160140 con 0x7f5008073540 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f4ffc001670 con 0x7f5008073540 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 >> v1:172.21.15.7:6789/0 conn(0x7f5008073540 legacy=0x7f50080cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0003b70 0x7f4ff0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff0004800 0x7f4ff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff00051c0 0x7f4ff000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff000c000 con 0x7f4ff00051c0 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff000c1b0 con 0x7f4ff0003b70 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff000c3b0 con 0x7f4ff0004800 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.472+0000 7f500dc00640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f500815ce50 0x7f50081670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500d200640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0003b70 0x7f4ff0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500dc00640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff00051c0 0x7f4ff000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f5007e00640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff0004800 0x7f4ff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500d200640 1 -- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff0004800 msgr2=0x7f4ff0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500d200640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff0004800 0x7f4ff0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500d200640 1 -- 172.21.15.7:0/2825367430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff00051c0 msgr2=0x7f4ff000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500d200640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff00051c0 0x7f4ff000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500d200640 1 -- 172.21.15.7:0/2825367430 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff0003520 con 0x7f4ff0003b70 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.473+0000 7f500dc00640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff00051c0 0x7f4ff000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.474+0000 7f500d200640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0003b70 0x7f4ff0003f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc007fd0 tx=0x7f4ff0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b9fba0f78627770 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.474+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc007ca0 con 0x7f4ff0003b70 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.474+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc005ad0 con 0x7f4ff0003b70 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.474+0000 7f5007400640 1 -- 172.21.15.7:0/2825367430 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc007070 con 0x7f4ff0003b70 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.475+0000 7f500fc00640 1 -- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0003b70 msgr2=0x7f4ff0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.475+0000 7f500fc00640 1 --2- 172.21.15.7:0/2825367430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0003b70 0x7f4ff0003f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc007fd0 tx=0x7f4ff0005830 comp rx=0 tx=0).stop 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.475+0000 7f500dc00640 1 -- 172.21.15.7:0/2825367430 reap_dead start 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.475+0000 7f500fc00640 1 -- 172.21.15.7:0/2825367430 shutdown_connections 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.475+0000 7f500fc00640 1 -- 172.21.15.7:0/2825367430 >> 172.21.15.7:0/2825367430 conn(0x7f500806be80 msgr2=0x7f50080b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.475+0000 7f500fc00640 1 -- 172.21.15.7:0/2825367430 shutdown_connections 2024-08-19T00:38:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.475+0000 7f500fc00640 1 -- 172.21.15.7:0/2825367430 wait complete. 2024-08-19T00:38:45.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.477+0000 7f500fc00640 1 Processor -- start 2024-08-19T00:38:45.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.477+0000 7f500fc00640 1 -- start start 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500fc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff0003b70 0x7f50080d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500fc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50080ae550 0x7f50080ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f500809c800 0x7f500809cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500fc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5008073920 con 0x7f4ff0003b70 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500fc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f500815d670 con 0x7f500809c800 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500fc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5008160940 con 0x7f50080ae550 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff0003b70 0x7f50080d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff0003b70 0x7f50080d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39720/0 (socket says 172.21.15.7:39720) 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 -- 172.21.15.7:0/3668867937 learned_addr learned my addr 172.21.15.7:0/3668867937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 -- 172.21.15.7:0/3668867937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50080ae550 msgr2=0x7f50080ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50080ae550 0x7f50080ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 -- 172.21.15.7:0/3668867937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f500809c800 msgr2=0x7f500809cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f500809c800 0x7f500809cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.478+0000 7f500d200640 1 -- 172.21.15.7:0/3668867937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500809d630 con 0x7f4ff0003b70 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.479+0000 7f500d200640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff0003b70 0x7f50080d08e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc02ad80 tx=0x7f500815d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.479+0000 7f5004c00640 1 -- 172.21.15.7:0/3668867937 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc037040 con 0x7f4ff0003b70 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.479+0000 7f5004c00640 1 -- 172.21.15.7:0/3668867937 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc041070 con 0x7f4ff0003b70 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.479+0000 7f5004c00640 1 -- 172.21.15.7:0/3668867937 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc001020 con 0x7f4ff0003b70 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.479+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500809d910 con 0x7f4ff0003b70 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.479+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500813d630 con 0x7f4ff0003b70 2024-08-19T00:38:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.480+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50080aef10 con 0x7f4ff0003b70 2024-08-19T00:38:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.481+0000 7f5004c00640 1 -- 172.21.15.7:0/3668867937 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ffc0047e0 con 0x7f4ff0003b70 2024-08-19T00:38:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.482+0000 7f5004c00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fe806be60 0x7f4fe806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.482+0000 7f5004c00640 1 -- 172.21.15.7:0/3668867937 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5559+0+0 (secure 0 0 0) 0x7f4ffc0aa7f0 con 0x7f4ff0003b70 2024-08-19T00:38:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.482+0000 7f5007e00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fe806be60 0x7f4fe806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.483+0000 7f5007e00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fe806be60 0x7f4fe806e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50081f5670 tx=0x7f4ff4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:45.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.486+0000 7f5004c00640 1 -- 172.21.15.7:0/3668867937 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4ffc04b020 con 0x7f4ff0003b70 2024-08-19T00:38:45.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:45.669+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f50080cc970 con 0x7f4ff0003b70 2024-08-19T00:38:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.280+0000 7f5004c00640 1 -- 172.21.15.7:0/3668867937 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f4ffc0aa070 con 0x7f4ff0003b70 2024-08-19T00:38:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-08-19T00:38:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fe806be60 msgr2=0x7f4fe806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fe806be60 0x7f4fe806e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50081f5670 tx=0x7f4ff4009040 comp rx=0 tx=0).stop 2024-08-19T00:38:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff0003b70 msgr2=0x7f50080d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff0003b70 0x7f50080d08e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc02ad80 tx=0x7f500815d560 comp rx=0 tx=0).stop 2024-08-19T00:38:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 shutdown_connections 2024-08-19T00:38:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fe806be60 0x7f4fe806e320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f500809c800 0x7f500809cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50080ae550 0x7f50080ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 --2- 172.21.15.7:0/3668867937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff0003b70 0x7f50080d08e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 >> 172.21.15.7:0/3668867937 conn(0x7f500806be80 msgr2=0x7f50081525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.284+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 shutdown_connections 2024-08-19T00:38:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.285+0000 7f500fc00640 1 -- 172.21.15.7:0/3668867937 wait complete. 2024-08-19T00:38:46.304 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-19T00:38:46.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.463+0000 7f9681200640 1 Processor -- start 2024-08-19T00:38:46.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.463+0000 7f9681200640 1 -- start start 2024-08-19T00:38:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9681200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f967c0b3620 0x7f967c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9681200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f967c06f720 0x7f967c0acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9681200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967c15e720 con 0x7f967c0aed00 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9681200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f967c0b3c00 con 0x7f967c0b3620 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9681200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f967c072450 con 0x7f967c06f720 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9679e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f967c0aed00 0x7f967c0b2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35416/0 (socket says 172.21.15.7:35416) 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9679e00640 1 -- 172.21.15.7:0/789198624 learned_addr learned my addr 172.21.15.7:0/789198624 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.464+0000 7f9671400640 1 --2- 172.21.15.7:0/789198624 >> v2:172.21.15.7:3300/0 conn(0x7f967c0b3620 0x7f967c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.465+0000 7f967a800640 1 --2- 172.21.15.7:0/789198624 >> v2:172.21.15.162:3300/0 conn(0x7f967c06f720 0x7f967c0acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.465+0000 7f9679400640 1 -- 172.21.15.7:0/789198624 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953492982 0 0) 0x7f966c001110 con 0x7f967c0aed00 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.465+0000 7f9671400640 1 -- 172.21.15.7:0/789198624 >> v2:172.21.15.162:3300/0 conn(0x7f967c06f720 msgr2=0x7f967c0acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.465+0000 7f9671400640 1 --2- 172.21.15.7:0/789198624 >> v2:172.21.15.162:3300/0 conn(0x7f967c06f720 0x7f967c0acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.465+0000 7f9671400640 1 -- 172.21.15.7:0/789198624 >> v1:172.21.15.7:6789/0 conn(0x7f967c0aed00 legacy=0x7f967c0b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.465+0000 7f9671400640 1 -- 172.21.15.7:0/789198624 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c072730 con 0x7f967c0b3620 2024-08-19T00:38:46.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.466+0000 7f9671400640 1 --2- 172.21.15.7:0/789198624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c0b3620 0x7f967c06f0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f967c09e220 tx=0x7f966402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa72e3d80ffa2ed server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.466+0000 7f9679400640 1 -- 172.21.15.7:0/789198624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664037070 con 0x7f967c0b3620 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.466+0000 7f9679400640 1 -- 172.21.15.7:0/789198624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966402add0 con 0x7f967c0b3620 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.466+0000 7f9679400640 1 -- 172.21.15.7:0/789198624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664032660 con 0x7f967c0b3620 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 -- 172.21.15.7:0/789198624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c0b3620 msgr2=0x7f967c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 --2- 172.21.15.7:0/789198624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c0b3620 0x7f967c06f0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f967c09e220 tx=0x7f966402a080 comp rx=0 tx=0).stop 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 -- 172.21.15.7:0/789198624 shutdown_connections 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 --2- 172.21.15.7:0/789198624 >> v2:172.21.15.162:3300/0 conn(0x7f967c06f720 0x7f967c0acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 --2- 172.21.15.7:0/789198624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c0b3620 0x7f967c06f0d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 -- 172.21.15.7:0/789198624 >> 172.21.15.7:0/789198624 conn(0x7f967c0b2300 msgr2=0x7f967c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 -- 172.21.15.7:0/789198624 shutdown_connections 2024-08-19T00:38:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.467+0000 7f9681200640 1 -- 172.21.15.7:0/789198624 wait complete. 2024-08-19T00:38:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.468+0000 7f9681200640 1 Processor -- start 2024-08-19T00:38:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.469+0000 7f9681200640 1 -- start start 2024-08-19T00:38:46.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.469+0000 7f9681200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c06f720 0x7f967c146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.469+0000 7f9681200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f967c0aed00 0x7f967c160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.469+0000 7f9681200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f967c0b3620 0x7f967c161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.469+0000 7f9681200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f967c0ad430 con 0x7f967c06f720 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.469+0000 7f9681200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f967c072cf0 con 0x7f967c0aed00 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.469+0000 7f9681200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f967c0ad5b0 con 0x7f967c0b3620 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c06f720 0x7f967c146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c06f720 0x7f967c146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39740/0 (socket says 172.21.15.7:39740) 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 -- 172.21.15.7:0/30341975 learned_addr learned my addr 172.21.15.7:0/30341975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9671400640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f967c0aed00 0x7f967c160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f967a800640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f967c0b3620 0x7f967c161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 -- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f967c0b3620 msgr2=0x7f967c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f967c0b3620 0x7f967c161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 -- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f967c0aed00 msgr2=0x7f967c160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f967c0aed00 0x7f967c160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.470+0000 7f9679e00640 1 -- 172.21.15.7:0/30341975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c09d500 con 0x7f967c06f720 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.471+0000 7f9679e00640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c06f720 0x7f967c146c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c780 tx=0x7f966c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.471+0000 7f9672a00640 1 -- 172.21.15.7:0/30341975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c018070 con 0x7f967c06f720 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.471+0000 7f9672a00640 1 -- 172.21.15.7:0/30341975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966c0072d0 con 0x7f967c06f720 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.471+0000 7f9672a00640 1 -- 172.21.15.7:0/30341975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c0047e0 con 0x7f967c06f720 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.471+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967c09d7e0 con 0x7f967c06f720 2024-08-19T00:38:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.471+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967c1588a0 con 0x7f967c06f720 2024-08-19T00:38:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.472+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967c0acef0 con 0x7f967c06f720 2024-08-19T00:38:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.473+0000 7f9672a00640 1 -- 172.21.15.7:0/30341975 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f966c01b070 con 0x7f967c06f720 2024-08-19T00:38:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.474+0000 7f9672a00640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f965806be80 0x7f965806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.474+0000 7f9672a00640 1 -- 172.21.15.7:0/30341975 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7f966c089fe0 con 0x7f967c06f720 2024-08-19T00:38:46.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.474+0000 7f9671400640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f965806be80 0x7f965806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.475+0000 7f9671400640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f965806be80 0x7f965806e340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9664034000 tx=0x7f966402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.478+0000 7f9672a00640 1 -- 172.21.15.7:0/30341975 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f967c15e720 con 0x7f967c06f720 2024-08-19T00:38:46.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.661+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f967c157e10 con 0x7f967c06f720 2024-08-19T00:38:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.665+0000 7f9672a00640 1 -- 172.21.15.7:0/30341975 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f966c0585c0 con 0x7f967c06f720 2024-08-19T00:38:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f965806be80 msgr2=0x7f965806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f965806be80 0x7f965806e340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9664034000 tx=0x7f966402e000 comp rx=0 tx=0).stop 2024-08-19T00:38:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c06f720 msgr2=0x7f967c146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c06f720 0x7f967c146c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c780 tx=0x7f966c00cc40 comp rx=0 tx=0).stop 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 shutdown_connections 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f965806be80 0x7f965806e340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f967c0b3620 0x7f967c161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f967c0aed00 0x7f967c160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 --2- 172.21.15.7:0/30341975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f967c06f720 0x7f967c146c20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 >> 172.21.15.7:0/30341975 conn(0x7f967c0b2300 msgr2=0x7f967c0ad940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.667+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 shutdown_connections 2024-08-19T00:38:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.668+0000 7f9681200640 1 -- 172.21.15.7:0/30341975 wait complete. 2024-08-19T00:38:46.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry' 2024-08-19T00:38:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.843+0000 7fa261200640 1 Processor -- start 2024-08-19T00:38:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.843+0000 7fa261200640 1 -- start start 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa261200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa25c159bf0 0x7fa25c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa261200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c0cec10 0x7fa25c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa261200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25c06f7f0 con 0x7fa25c0739a0 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa261200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa25c06f510 con 0x7fa25c159bf0 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa261200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa25c072980 con 0x7fa25c0cec10 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa259e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa25c159bf0 0x7fa25c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa259400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa25c0739a0 0x7fa25c0ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35426/0 (socket says 172.21.15.7:35426) 2024-08-19T00:38:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.844+0000 7fa259400640 1 -- 172.21.15.7:0/2145028135 learned_addr learned my addr 172.21.15.7:0/2145028135 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.845+0000 7fa25a800640 1 --2- 172.21.15.7:0/2145028135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c0cec10 0x7fa25c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.845+0000 7fa258a00640 1 -- 172.21.15.7:0/2145028135 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117381326 0 0) 0x7fa25c06f7f0 con 0x7fa25c0739a0 2024-08-19T00:38:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.845+0000 7fa259e00640 1 -- 172.21.15.7:0/2145028135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c0cec10 msgr2=0x7fa25c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.845+0000 7fa259e00640 1 --2- 172.21.15.7:0/2145028135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c0cec10 0x7fa25c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.845+0000 7fa259e00640 1 -- 172.21.15.7:0/2145028135 >> v1:172.21.15.7:6789/0 conn(0x7fa25c0739a0 legacy=0x7fa25c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.845+0000 7fa259e00640 1 -- 172.21.15.7:0/2145028135 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c072c60 con 0x7fa25c159bf0 2024-08-19T00:38:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.846+0000 7fa259e00640 1 --2- 172.21.15.7:0/2145028135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c159bf0 0x7fa25c073460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0097a0 tx=0x7fa24c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a7a782a530f6a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.846+0000 7fa258a00640 1 -- 172.21.15.7:0/2145028135 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c037070 con 0x7fa25c159bf0 2024-08-19T00:38:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.846+0000 7fa258a00640 1 -- 172.21.15.7:0/2145028135 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c02ae50 con 0x7fa25c159bf0 2024-08-19T00:38:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.846+0000 7fa258a00640 1 -- 172.21.15.7:0/2145028135 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c032660 con 0x7fa25c159bf0 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 -- 172.21.15.7:0/2145028135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c159bf0 msgr2=0x7fa25c073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 --2- 172.21.15.7:0/2145028135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c159bf0 0x7fa25c073460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0097a0 tx=0x7fa24c02a100 comp rx=0 tx=0).stop 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 -- 172.21.15.7:0/2145028135 shutdown_connections 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 --2- 172.21.15.7:0/2145028135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c0cec10 0x7fa25c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 --2- 172.21.15.7:0/2145028135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c159bf0 0x7fa25c073460 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 -- 172.21.15.7:0/2145028135 >> 172.21.15.7:0/2145028135 conn(0x7fa25c06bc70 msgr2=0x7fa25c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 -- 172.21.15.7:0/2145028135 shutdown_connections 2024-08-19T00:38:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.847+0000 7fa261200640 1 -- 172.21.15.7:0/2145028135 wait complete. 2024-08-19T00:38:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.848+0000 7fa261200640 1 Processor -- start 2024-08-19T00:38:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.849+0000 7fa261200640 1 -- start start 2024-08-19T00:38:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.849+0000 7fa261200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c0739a0 0x7fa25c1f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa261200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25c159bf0 0x7fa25c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa261200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c1529f0 0x7fa25c151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa261200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c15a150 con 0x7fa25c0739a0 2024-08-19T00:38:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa261200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c159fd0 con 0x7fa25c159bf0 2024-08-19T00:38:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa261200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa25c0d0900 con 0x7fa25c1529f0 2024-08-19T00:38:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c0739a0 0x7fa25c1f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c0739a0 0x7fa25c1f14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39756/0 (socket says 172.21.15.7:39756) 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 -- 172.21.15.7:0/3190326875 learned_addr learned my addr 172.21.15.7:0/3190326875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa25a800640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c1529f0 0x7fa25c151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259400640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25c159bf0 0x7fa25c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 -- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c1529f0 msgr2=0x7fa25c151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c1529f0 0x7fa25c151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 -- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25c159bf0 msgr2=0x7fa25c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25c159bf0 0x7fa25c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259e00640 1 -- 172.21.15.7:0/3190326875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c152ef0 con 0x7fa25c0739a0 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.850+0000 7fa259400640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25c159bf0 0x7fa25c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.851+0000 7fa259e00640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c0739a0 0x7fa25c1f14c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0097a0 tx=0x7fa24c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.851+0000 7fa252000640 1 -- 172.21.15.7:0/3190326875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c037040 con 0x7fa25c0739a0 2024-08-19T00:38:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.851+0000 7fa252000640 1 -- 172.21.15.7:0/3190326875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c004030 con 0x7fa25c0739a0 2024-08-19T00:38:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.851+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c1531d0 con 0x7fa25c0739a0 2024-08-19T00:38:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.851+0000 7fa252000640 1 -- 172.21.15.7:0/3190326875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c004420 con 0x7fa25c0739a0 2024-08-19T00:38:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.851+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c153790 con 0x7fa25c0739a0 2024-08-19T00:38:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.852+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25c0d0ce0 con 0x7fa25c0739a0 2024-08-19T00:38:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.853+0000 7fa252000640 1 -- 172.21.15.7:0/3190326875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa24c003610 con 0x7fa25c0739a0 2024-08-19T00:38:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.854+0000 7fa252000640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23c06be30 0x7fa23c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.854+0000 7fa252000640 1 -- 172.21.15.7:0/3190326875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7fa24c0aba30 con 0x7fa25c0739a0 2024-08-19T00:38:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.854+0000 7fa259400640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23c06be30 0x7fa23c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.855+0000 7fa259400640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23c06be30 0x7fa23c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0cd120 tx=0x7fa248007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:46.858+0000 7fa252000640 1 -- 172.21.15.7:0/3190326875 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa24c07a700 con 0x7fa25c0739a0 2024-08-19T00:38:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.111+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]} v 0) -- 0x7fa25c156080 con 0x7fa25c0739a0 2024-08-19T00:38:47.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.288+0000 7fa252000640 1 -- 172.21.15.7:0/3190326875 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]}]=0 v113) ==== 134+0+0 (secure 0 0 0) 0x7fa24c07a000 con 0x7fa25c0739a0 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23c06be30 msgr2=0x7fa23c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23c06be30 0x7fa23c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0cd120 tx=0x7fa248007ca0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c0739a0 msgr2=0x7fa25c1f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c0739a0 0x7fa25c1f14c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0097a0 tx=0x7fa24c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 shutdown_connections 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23c06be30 0x7fa23c06e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25c1529f0 0x7fa25c151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25c159bf0 0x7fa25c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 --2- 172.21.15.7:0/3190326875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa25c0739a0 0x7fa25c1f14c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 >> 172.21.15.7:0/3190326875 conn(0x7fa25c06bc70 msgr2=0x7fa25c15ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:47.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 shutdown_connections 2024-08-19T00:38:47.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.291+0000 7fa261200640 1 -- 172.21.15.7:0/3190326875 wait complete. 2024-08-19T00:38:47.309 INFO:tasks.cephfs_test_runner:test_damaged_dentry (tasks.cephfs.test_damage.TestDamage) ... ok 2024-08-19T00:38:47.309 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_existing (tasks.cephfs.test_damage.TestDamage) That the MDS won't abort when the dentry is already known to be damaged. 2024-08-19T00:38:47.309 INFO:tasks.cephfs_test_runner:test_dentry_first_existing (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:38:47.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:38:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.466+0000 7fb247e00640 1 Processor -- start 2024-08-19T00:38:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.466+0000 7fb247e00640 1 -- start start 2024-08-19T00:38:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.467+0000 7fb247e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 0x7fb24815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.467+0000 7fb247e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2480b3ab0 con 0x7fb24815ee50 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.467+0000 7fb247e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb24815f460 con 0x7fb2480d2af0 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.467+0000 7fb247e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb24815f740 con 0x7fb24815e360 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb247400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb24815ee50 0x7fb2480b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35438/0 (socket says 172.21.15.7:35438) 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb247400640 1 -- 172.21.15.7:0/57154723 learned_addr learned my addr 172.21.15.7:0/57154723 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246a00640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 0x7fb24815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345341823 0 0) 0x7fb2480b3ab0 con 0x7fb24815ee50 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22c003520 con 0x7fb24815ee50 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237409455 0 0) 0x7fb24815f460 con 0x7fb2480d2af0 2024-08-19T00:38:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2480b3ab0 con 0x7fb2480d2af0 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2448369553 0 0) 0x7fb22c003520 con 0x7fb24815ee50 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 msgr2=0x7fb24815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 0x7fb24815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.468+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 >> v1:172.21.15.162:6789/0 conn(0x7fb2480d2af0 legacy=0x7fb24815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2480b3d60 con 0x7fb24815ee50 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fb2400019f0 con 0x7fb24815ee50 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 >> v1:172.21.15.7:6789/0 conn(0x7fb24815ee50 legacy=0x7fb2480b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb22c003b70 0x7fb22c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 0x7fb22c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb22c004d40 0x7fb22c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb24815f740 con 0x7fb22c004d40 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c00ba70 con 0x7fb22c003b70 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c00bc70 con 0x7fb24815e360 2024-08-19T00:38:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb247400640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb22c004d40 0x7fb22c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb246a00640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb22c003b70 0x7fb22c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb23e000640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 0x7fb22c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb247400640 1 -- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 msgr2=0x7fb22c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb247400640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb24815e360 0x7fb22c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb247400640 1 -- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb22c003b70 msgr2=0x7fb22c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb247400640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb22c003b70 0x7fb22c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.469+0000 7fb247400640 1 -- 172.21.15.7:0/57154723 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c003520 con 0x7fb22c004d40 2024-08-19T00:38:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.470+0000 7fb247400640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb22c004d40 0x7fb22c0051c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb24000a730 tx=0x7fb22c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da437d57a0ab3dc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24000a350 con 0x7fb22c004d40 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24002f070 con 0x7fb22c004d40 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb246000640 1 -- 172.21.15.7:0/57154723 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24002bb90 con 0x7fb22c004d40 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb247e00640 1 -- 172.21.15.7:0/57154723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb22c004d40 msgr2=0x7fb22c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb247e00640 1 --2- 172.21.15.7:0/57154723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb22c004d40 0x7fb22c0051c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb24000a730 tx=0x7fb22c005830 comp rx=0 tx=0).stop 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb247400640 1 -- 172.21.15.7:0/57154723 reap_dead start 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb247e00640 1 -- 172.21.15.7:0/57154723 shutdown_connections 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb247e00640 1 -- 172.21.15.7:0/57154723 >> 172.21.15.7:0/57154723 conn(0x7fb24808dbf0 msgr2=0x7fb24809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb247e00640 1 -- 172.21.15.7:0/57154723 shutdown_connections 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.471+0000 7fb247e00640 1 -- 172.21.15.7:0/57154723 wait complete. 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.473+0000 7fb247e00640 1 Processor -- start 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.473+0000 7fb247e00640 1 -- start start 2024-08-19T00:38:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb247e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb22c004d40 0x7fb24814bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb247e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb24806d800 0x7fb24806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb247e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2480c7d10 0x7fb2480c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb247e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb24815fab0 con 0x7fb24806d800 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb247e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480d2300 con 0x7fb2480c7d10 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb247e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb24815fc30 con 0x7fb22c004d40 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb23e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb24806d800 0x7fb24806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb23e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb24806d800 0x7fb24806dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39786/0 (socket says 172.21.15.7:39786) 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb23e000640 1 -- 172.21.15.7:0/234840792 learned_addr learned my addr 172.21.15.7:0/234840792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb246a00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb22c004d40 0x7fb24814bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.474+0000 7fb247400640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2480c7d10 0x7fb2480c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23e000640 1 -- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb22c004d40 msgr2=0x7fb24814bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23e000640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb22c004d40 0x7fb24814bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23e000640 1 -- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2480c7d10 msgr2=0x7fb2480c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23e000640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2480c7d10 0x7fb2480c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23e000640 1 -- 172.21.15.7:0/234840792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24814e740 con 0x7fb24806d800 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb247400640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2480c7d10 0x7fb2480c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23e000640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb24806d800 0x7fb24806dc40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb23000f7a0 tx=0x7fb23000fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23fe00640 1 -- 172.21.15.7:0/234840792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23001a070 con 0x7fb24806d800 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23fe00640 1 -- 172.21.15.7:0/234840792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb230005110 con 0x7fb24806d800 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb23fe00640 1 -- 172.21.15.7:0/234840792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230007050 con 0x7fb24806d800 2024-08-19T00:38:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2480c8a20 con 0x7fb24806d800 2024-08-19T00:38:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.475+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24814ece0 con 0x7fb24806d800 2024-08-19T00:38:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.476+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2480d2f50 con 0x7fb24806d800 2024-08-19T00:38:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.477+0000 7fb23fe00640 1 -- 172.21.15.7:0/234840792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb23001d070 con 0x7fb24806d800 2024-08-19T00:38:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.479+0000 7fb23fe00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb22406be60 0x7fb22406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.479+0000 7fb23fe00640 1 -- 172.21.15.7:0/234840792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7fb23008a430 con 0x7fb24806d800 2024-08-19T00:38:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.479+0000 7fb246a00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb22406be60 0x7fb22406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.480+0000 7fb246a00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb22406be60 0x7fb22406e320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb238009bc0 tx=0x7fb238009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.487+0000 7fb23fe00640 1 -- 172.21.15.7:0/234840792 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb230058fe0 con 0x7fb24806d800 2024-08-19T00:38:47.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.673+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb248160bc0 con 0x7fb24806d800 2024-08-19T00:38:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.674+0000 7fb23fe00640 1 -- 172.21.15.7:0/234840792 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13116 (secure 0 0 0) 0x7fb23005de20 con 0x7fb24806d800 2024-08-19T00:38:47.675 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:47.675 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:38:46.279189+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6835/230096578":"2024-08-20T00:38:42.936338+0000","172.21.15.162:6833/230096578":"2024-08-20T00:38:42.936338+0000","172.21.15.162:6835/1856893937":"2024-08-20T00:37:57.403602+0000","172.21.15.162:6833/1856893937":"2024-08-20T00:37:57.403602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:38:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb22406be60 msgr2=0x7fb22406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb22406be60 0x7fb22406e320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb238009bc0 tx=0x7fb238009190 comp rx=0 tx=0).stop 2024-08-19T00:38:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb24806d800 msgr2=0x7fb24806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb24806d800 0x7fb24806dc40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb23000f7a0 tx=0x7fb23000fba0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 shutdown_connections 2024-08-19T00:38:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb22406be60 0x7fb22406e320 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2480c7d10 0x7fb2480c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb24806d800 0x7fb24806dc40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 --2- 172.21.15.7:0/234840792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb22c004d40 0x7fb24814bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 >> 172.21.15.7:0/234840792 conn(0x7fb24808dbf0 msgr2=0x7fb24806cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 shutdown_connections 2024-08-19T00:38:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.676+0000 7fb247e00640 1 -- 172.21.15.7:0/234840792 wait complete. 2024-08-19T00:38:47.693 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:36:51.315746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:38:47.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T00:38:47.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.852+0000 7f71a1000640 1 Processor -- start 2024-08-19T00:38:47.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.852+0000 7f71a1000640 1 -- start start 2024-08-19T00:38:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.853+0000 7f71a1000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f719c15c390 0x7f719c166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.853+0000 7f71a1000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719c0acef0 con 0x7f719c15bfb0 2024-08-19T00:38:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.853+0000 7f71a1000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719c0ad1d0 con 0x7f719c0b5130 2024-08-19T00:38:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.853+0000 7f71a1000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f719c0ad790 con 0x7f719c15c390 2024-08-19T00:38:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.853+0000 7f7199e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f719c15bfb0 0x7f719c0b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35446/0 (socket says 172.21.15.7:35446) 2024-08-19T00:38:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.853+0000 7f7199e00640 1 -- 172.21.15.7:0/2350474388 learned_addr learned my addr 172.21.15.7:0/2350474388 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.854+0000 7f719a800640 1 --2- 172.21.15.7:0/2350474388 >> v2:172.21.15.162:3300/0 conn(0x7f719c15c390 0x7f719c166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.854+0000 7f7199400640 1 -- 172.21.15.7:0/2350474388 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253920270 0 0) 0x7f719c0acef0 con 0x7f719c15bfb0 2024-08-19T00:38:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.854+0000 7f7199400640 1 -- 172.21.15.7:0/2350474388 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7180003520 con 0x7f719c15bfb0 2024-08-19T00:38:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.854+0000 7f719a800640 1 -- 172.21.15.7:0/2350474388 >> v1:172.21.15.162:6789/0 conn(0x7f719c0b5130 legacy=0x7f719c0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.854+0000 7f719a800640 1 -- 172.21.15.7:0/2350474388 >> v1:172.21.15.7:6789/0 conn(0x7f719c15bfb0 legacy=0x7f719c0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.854+0000 7f719a800640 1 -- 172.21.15.7:0/2350474388 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c0ad4b0 con 0x7f719c15c390 2024-08-19T00:38:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.855+0000 7f719a800640 1 --2- 172.21.15.7:0/2350474388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15c390 0x7f719c166dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7194009d90 tx=0x7f719402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e05a7978a6537e99 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f7199400640 1 -- 172.21.15.7:0/2350474388 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194007740 con 0x7f719c15c390 2024-08-19T00:38:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f7199400640 1 -- 172.21.15.7:0/2350474388 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71940078e0 con 0x7f719c15c390 2024-08-19T00:38:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f7199400640 1 -- 172.21.15.7:0/2350474388 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194007cb0 con 0x7f719c15c390 2024-08-19T00:38:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f71a1000640 1 -- 172.21.15.7:0/2350474388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15c390 msgr2=0x7f719c166dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f71a1000640 1 --2- 172.21.15.7:0/2350474388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15c390 0x7f719c166dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7194009d90 tx=0x7f719402a6f0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f71a1000640 1 -- 172.21.15.7:0/2350474388 shutdown_connections 2024-08-19T00:38:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f71a1000640 1 --2- 172.21.15.7:0/2350474388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15c390 0x7f719c166dd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f71a1000640 1 -- 172.21.15.7:0/2350474388 >> 172.21.15.7:0/2350474388 conn(0x7f719c0b2300 msgr2=0x7f719c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f71a1000640 1 -- 172.21.15.7:0/2350474388 shutdown_connections 2024-08-19T00:38:47.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.856+0000 7f71a1000640 1 -- 172.21.15.7:0/2350474388 wait complete. 2024-08-19T00:38:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.858+0000 7f71a1000640 1 Processor -- start 2024-08-19T00:38:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.858+0000 7f71a1000640 1 -- start start 2024-08-19T00:38:47.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f71a1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f719c0b5130 0x7f719c0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f71a1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15bfb0 0x7f719c1f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f71a1000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f719c15c390 0x7f719c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f71a1000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f719c0731d0 con 0x7f719c0b5130 2024-08-19T00:38:47.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f71a1000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f719c073050 con 0x7f719c15bfb0 2024-08-19T00:38:47.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f71a1000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f719c0af2e0 con 0x7f719c15c390 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f7199e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f719c0b5130 0x7f719c0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f7199e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f719c0b5130 0x7f719c0cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39802/0 (socket says 172.21.15.7:39802) 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f7199e00640 1 -- 172.21.15.7:0/1551087952 learned_addr learned my addr 172.21.15.7:0/1551087952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f7193e00640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15bfb0 0x7f719c1f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.859+0000 7f719a800640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f719c15c390 0x7f719c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7199e00640 1 -- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f719c15c390 msgr2=0x7f719c06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7199e00640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f719c15c390 0x7f719c06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7199e00640 1 -- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15bfb0 msgr2=0x7f719c1f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7199e00640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15bfb0 0x7f719c1f3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7199e00640 1 -- 172.21.15.7:0/1551087952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c1f46a0 con 0x7f719c0b5130 2024-08-19T00:38:47.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7199e00640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f719c0b5130 0x7f719c0cea80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f718c00c500 tx=0x7f718c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:47.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7192000640 1 -- 172.21.15.7:0/1551087952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c017070 con 0x7f719c0b5130 2024-08-19T00:38:47.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7192000640 1 -- 172.21.15.7:0/1551087952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c005ce0 con 0x7f719c0b5130 2024-08-19T00:38:47.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c1f4980 con 0x7f719c0b5130 2024-08-19T00:38:47.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f7192000640 1 -- 172.21.15.7:0/1551087952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c007330 con 0x7f719c0b5130 2024-08-19T00:38:47.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.860+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c0cca20 con 0x7f719c0b5130 2024-08-19T00:38:47.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.861+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719c06c450 con 0x7f719c0b5130 2024-08-19T00:38:47.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.862+0000 7f7192000640 1 -- 172.21.15.7:0/1551087952 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f718c01a070 con 0x7f719c0b5130 2024-08-19T00:38:47.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.863+0000 7f7192000640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f717806be60 0x7f717806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:47.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.863+0000 7f7192000640 1 -- 172.21.15.7:0/1551087952 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7f718c08a0e0 con 0x7f719c0b5130 2024-08-19T00:38:47.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.863+0000 7f7193e00640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f717806be60 0x7f717806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:47.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.864+0000 7f7193e00640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f717806be60 0x7f717806e320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f719c158bd0 tx=0x7f7184009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:47.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:47.868+0000 7f7192000640 1 -- 172.21.15.7:0/1551087952 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f719c06c450 con 0x7f719c0b5130 2024-08-19T00:38:48.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.050+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f719c0aebd0 con 0x7f719c0b5130 2024-08-19T00:38:48.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.050+0000 7f7192000640 1 -- 172.21.15.7:0/1551087952 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f718c058d50 con 0x7f719c0b5130 2024-08-19T00:38:48.052 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f717806be60 msgr2=0x7f717806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f717806be60 0x7f717806e320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f719c158bd0 tx=0x7f7184009040 comp rx=0 tx=0).stop 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f719c0b5130 msgr2=0x7f719c0cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f719c0b5130 0x7f719c0cea80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f718c00c500 tx=0x7f718c00c9c0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 shutdown_connections 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f717806be60 0x7f717806e320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f719c15c390 0x7f719c06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f719c15bfb0 0x7f719c1f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 --2- 172.21.15.7:0/1551087952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f719c0b5130 0x7f719c0cea80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 >> 172.21.15.7:0/1551087952 conn(0x7f719c0b2300 msgr2=0x7f719c0b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:48.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 shutdown_connections 2024-08-19T00:38:48.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.053+0000 7f71a1000640 1 -- 172.21.15.7:0/1551087952 wait complete. 2024-08-19T00:38:48.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing' 2024-08-19T00:38:48.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.225+0000 7fd2e6400640 1 Processor -- start 2024-08-19T00:38:48.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.226+0000 7fd2e6400640 1 -- start start 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2e6400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2e00d03c0 0x7fd2e00d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2e6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e00b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2e6400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e00b50b0 con 0x7fd2e015f5b0 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2e6400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e015f990 con 0x7fd2e00d03c0 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2e6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e00cf120 con 0x7fd2e00b4380 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2df400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd2e015f5b0 0x7fd2e00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35454/0 (socket says 172.21.15.7:35454) 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2df400640 1 -- 172.21.15.7:0/3609009418 learned_addr learned my addr 172.21.15.7:0/3609009418 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2d7e00640 1 --2- 172.21.15.7:0/3609009418 >> v2:172.21.15.7:3300/0 conn(0x7fd2e00d03c0 0x7fd2e00d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2dfe00640 1 --2- 172.21.15.7:0/3609009418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e00b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:48.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.227+0000 7fd2dea00640 1 -- 172.21.15.7:0/3609009418 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652370032 0 0) 0x7fd2e00b50b0 con 0x7fd2e015f5b0 2024-08-19T00:38:48.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.228+0000 7fd2dea00640 1 -- 172.21.15.7:0/3609009418 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c4003520 con 0x7fd2e015f5b0 2024-08-19T00:38:48.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.228+0000 7fd2d7e00640 1 -- 172.21.15.7:0/3609009418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 msgr2=0x7fd2e00b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.228+0000 7fd2d7e00640 1 --2- 172.21.15.7:0/3609009418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e00b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.228+0000 7fd2d7e00640 1 -- 172.21.15.7:0/3609009418 >> v1:172.21.15.7:6789/0 conn(0x7fd2e015f5b0 legacy=0x7fd2e00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.228+0000 7fd2d7e00640 1 -- 172.21.15.7:0/3609009418 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e00cead0 con 0x7fd2e00d03c0 2024-08-19T00:38:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2d7e00640 1 --2- 172.21.15.7:0/3609009418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e00d03c0 0x7fd2e00d0800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097a0 tx=0x7fd2c802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc18db9257b517c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2dea00640 1 -- 172.21.15.7:0/3609009418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8037070 con 0x7fd2e00d03c0 2024-08-19T00:38:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2dea00640 1 -- 172.21.15.7:0/3609009418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c802ae50 con 0x7fd2e00d03c0 2024-08-19T00:38:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2dea00640 1 -- 172.21.15.7:0/3609009418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8032640 con 0x7fd2e00d03c0 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2e6400640 1 -- 172.21.15.7:0/3609009418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e00d03c0 msgr2=0x7fd2e00d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2e6400640 1 --2- 172.21.15.7:0/3609009418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e00d03c0 0x7fd2e00d0800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097a0 tx=0x7fd2c802a100 comp rx=0 tx=0).stop 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2e6400640 1 -- 172.21.15.7:0/3609009418 shutdown_connections 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2e6400640 1 --2- 172.21.15.7:0/3609009418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e00b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2e6400640 1 --2- 172.21.15.7:0/3609009418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e00d03c0 0x7fd2e00d0800 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.229+0000 7fd2e6400640 1 -- 172.21.15.7:0/3609009418 >> 172.21.15.7:0/3609009418 conn(0x7fd2e006bc70 msgr2=0x7fd2e006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.230+0000 7fd2e6400640 1 -- 172.21.15.7:0/3609009418 shutdown_connections 2024-08-19T00:38:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.230+0000 7fd2e6400640 1 -- 172.21.15.7:0/3609009418 wait complete. 2024-08-19T00:38:48.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.231+0000 7fd2e6400640 1 Processor -- start 2024-08-19T00:38:48.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.231+0000 7fd2e6400640 1 -- start start 2024-08-19T00:38:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2e6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e0153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2e6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00d03c0 0x7fd2e0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2e6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e015f5b0 0x7fd2e0154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2e6400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00b4d30 con 0x7fd2e015f5b0 2024-08-19T00:38:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2e6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00d0d40 con 0x7fd2e00d03c0 2024-08-19T00:38:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2e6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e006e660 con 0x7fd2e00b4380 2024-08-19T00:38:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e015f5b0 0x7fd2e0154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e015f5b0 0x7fd2e0154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39828/0 (socket says 172.21.15.7:39828) 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.232+0000 7fd2dfe00640 1 -- 172.21.15.7:0/1773785819 learned_addr learned my addr 172.21.15.7:0/1773785819 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2df400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e0153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2d7e00640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00d03c0 0x7fd2e0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2dfe00640 1 -- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 msgr2=0x7fd2e0153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2dfe00640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e0153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2dfe00640 1 -- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00d03c0 msgr2=0x7fd2e0157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2dfe00640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00d03c0 0x7fd2e0157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2dfe00640 1 -- 172.21.15.7:0/1773785819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e01531b0 con 0x7fd2e015f5b0 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2d7e00640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00d03c0 0x7fd2e0157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2dfe00640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e015f5b0 0x7fd2e0154e20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800efc0 tx=0x7fd2d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2d7400640 1 -- 172.21.15.7:0/1773785819 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8018020 con 0x7fd2e015f5b0 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2d7400640 1 -- 172.21.15.7:0/1773785819 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d8014480 con 0x7fd2e015f5b0 2024-08-19T00:38:48.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2d7400640 1 -- 172.21.15.7:0/1773785819 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8014870 con 0x7fd2e015f5b0 2024-08-19T00:38:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.233+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e0153490 con 0x7fd2e015f5b0 2024-08-19T00:38:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.234+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01544b0 con 0x7fd2e015f5b0 2024-08-19T00:38:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.235+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e00b47f0 con 0x7fd2e015f5b0 2024-08-19T00:38:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.236+0000 7fd2d7400640 1 -- 172.21.15.7:0/1773785819 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2d801b020 con 0x7fd2e015f5b0 2024-08-19T00:38:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.236+0000 7fd2d7400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2bc06be30 0x7fd2bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.237+0000 7fd2d7400640 1 -- 172.21.15.7:0/1773785819 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7fd2d808b810 con 0x7fd2e015f5b0 2024-08-19T00:38:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.237+0000 7fd2df400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2bc06be30 0x7fd2bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.237+0000 7fd2df400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2bc06be30 0x7fd2bc06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005880 tx=0x7fd2d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.241+0000 7fd2d7400640 1 -- 172.21.15.7:0/1773785819 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd2d8022030 con 0x7fd2e015f5b0 2024-08-19T00:38:48.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:48.492+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]} v 0) -- 0x7fd2e0162ba0 con 0x7fd2e015f5b0 2024-08-19T00:38:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.295+0000 7fd2d7400640 1 -- 172.21.15.7:0/1773785819 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]}]=0 v115) ==== 144+0+0 (secure 0 0 0) 0x7fd2d8010040 con 0x7fd2e015f5b0 2024-08-19T00:38:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2bc06be30 msgr2=0x7fd2bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2bc06be30 0x7fd2bc06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005880 tx=0x7fd2d0009040 comp rx=0 tx=0).stop 2024-08-19T00:38:49.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e015f5b0 msgr2=0x7fd2e0154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e015f5b0 0x7fd2e0154e20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800efc0 tx=0x7fd2d800c490 comp rx=0 tx=0).stop 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 shutdown_connections 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2bc06be30 0x7fd2bc06e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e015f5b0 0x7fd2e0154e20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00d03c0 0x7fd2e0157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 --2- 172.21.15.7:0/1773785819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2e00b4380 0x7fd2e0153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.298+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 >> 172.21.15.7:0/1773785819 conn(0x7fd2e006bc70 msgr2=0x7fd2e00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.299+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 shutdown_connections 2024-08-19T00:38:49.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.299+0000 7fd2e6400640 1 -- 172.21.15.7:0/1773785819 wait complete. 2024-08-19T00:38:49.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-19T00:38:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.482+0000 7f275fa00640 1 Processor -- start 2024-08-19T00:38:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.482+0000 7f275fa00640 1 -- start start 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275fa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2758158cd0 0x7f2758072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f27580b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275fa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27580aeae0 con 0x7f2758072ff0 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275fa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2758073460 con 0x7f2758158cd0 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27580aedc0 con 0x7f27580ae480 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2758158cd0 0x7f2758072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2758158cd0 0x7f2758072ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39834/0 (socket says 172.21.15.7:39834) 2024-08-19T00:38:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275d000640 1 -- 172.21.15.7:0/3559831618 learned_addr learned my addr 172.21.15.7:0/3559831618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275da00640 1 --2- 172.21.15.7:0/3559831618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f27580b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275d000640 1 -- 172.21.15.7:0/3559831618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 msgr2=0x7f27580b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275d000640 1 --2- 172.21.15.7:0/3559831618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f27580b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.484+0000 7f275d000640 1 -- 172.21.15.7:0/3559831618 >> v1:172.21.15.7:6789/0 conn(0x7f2758072ff0 legacy=0x7f27580add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.485+0000 7f275d000640 1 -- 172.21.15.7:0/3559831618 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27580af0a0 con 0x7f2758158cd0 2024-08-19T00:38:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.485+0000 7f2757400640 1 -- 172.21.15.7:0/3559831618 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081404930 0 0) 0x7f27580aeae0 con 0x7f2758072ff0 2024-08-19T00:38:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275d000640 1 --2- 172.21.15.7:0/3559831618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758158cd0 0x7f2758072ab0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f274c00bb10 tx=0x7f274c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fcb479c36a639f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f2757400640 1 -- 172.21.15.7:0/3559831618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c032790 con 0x7f2758158cd0 2024-08-19T00:38:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f2757400640 1 -- 172.21.15.7:0/3559831618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c038070 con 0x7f2758158cd0 2024-08-19T00:38:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f2757400640 1 -- 172.21.15.7:0/3559831618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c032b50 con 0x7f2758158cd0 2024-08-19T00:38:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275fa00640 1 -- 172.21.15.7:0/3559831618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758158cd0 msgr2=0x7f2758072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275fa00640 1 --2- 172.21.15.7:0/3559831618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758158cd0 0x7f2758072ab0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f274c00bb10 tx=0x7f274c02c890 comp rx=0 tx=0).stop 2024-08-19T00:38:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275fa00640 1 -- 172.21.15.7:0/3559831618 shutdown_connections 2024-08-19T00:38:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275fa00640 1 --2- 172.21.15.7:0/3559831618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f27580b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275fa00640 1 --2- 172.21.15.7:0/3559831618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758158cd0 0x7f2758072ab0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275fa00640 1 -- 172.21.15.7:0/3559831618 >> 172.21.15.7:0/3559831618 conn(0x7f27580b2300 msgr2=0x7f275806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.486+0000 7f275fa00640 1 -- 172.21.15.7:0/3559831618 shutdown_connections 2024-08-19T00:38:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.487+0000 7f275fa00640 1 -- 172.21.15.7:0/3559831618 wait complete. 2024-08-19T00:38:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.488+0000 7f275fa00640 1 Processor -- start 2024-08-19T00:38:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.488+0000 7f275fa00640 1 -- start start 2024-08-19T00:38:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758072ff0 0x7f27581f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f275814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275815b510 0x7f275814e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275fa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27580b3690 con 0x7f2758072ff0 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27580af660 con 0x7f275815b510 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27580b3810 con 0x7f27580ae480 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758072ff0 0x7f27581f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758072ff0 0x7f27581f8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39836/0 (socket says 172.21.15.7:39836) 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.489+0000 7f275d000640 1 -- 172.21.15.7:0/312082021 learned_addr learned my addr 172.21.15.7:0/312082021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f2757e00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f275814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275da00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275815b510 0x7f275814e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275d000640 1 -- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 msgr2=0x7f275814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275d000640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f275814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275d000640 1 -- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275815b510 msgr2=0x7f275814e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275d000640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275815b510 0x7f275814e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275d000640 1 -- 172.21.15.7:0/312082021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275815dd60 con 0x7f2758072ff0 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275d000640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758072ff0 0x7f27581f8ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f274c035040 tx=0x7f274c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f2754c00640 1 -- 172.21.15.7:0/312082021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c004230 con 0x7f2758072ff0 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f2754c00640 1 -- 172.21.15.7:0/312082021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c0043d0 con 0x7f2758072ff0 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27581f91e0 con 0x7f2758072ff0 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.490+0000 7f2754c00640 1 -- 172.21.15.7:0/312082021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c003850 con 0x7f2758072ff0 2024-08-19T00:38:49.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.491+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275815c310 con 0x7f2758072ff0 2024-08-19T00:38:49.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.492+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27580b3150 con 0x7f2758072ff0 2024-08-19T00:38:49.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.493+0000 7f2754c00640 1 -- 172.21.15.7:0/312082021 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f274c0039f0 con 0x7f2758072ff0 2024-08-19T00:38:49.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.493+0000 7f2754c00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:49.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.494+0000 7f2754c00640 1 -- 172.21.15.7:0/312082021 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7f274c0ab910 con 0x7f2758072ff0 2024-08-19T00:38:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.494+0000 7f2757e00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.494+0000 7f2757e00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f273806be30 0x7f273806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f27581586e0 tx=0x7f2744009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:49.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.498+0000 7f2754c00640 1 -- 172.21.15.7:0/312082021 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f27581f91e0 con 0x7f2758072ff0 2024-08-19T00:38:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.683+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f27580cfd30 con 0x7f2758072ff0 2024-08-19T00:38:49.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.687+0000 7f2754c00640 1 -- 172.21.15.7:0/312082021 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f274c07a4c0 con 0x7f2758072ff0 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f273806be30 msgr2=0x7f273806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f273806be30 0x7f273806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f27581586e0 tx=0x7f2744009040 comp rx=0 tx=0).stop 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758072ff0 msgr2=0x7f27581f8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758072ff0 0x7f27581f8ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f274c035040 tx=0x7f274c004730 comp rx=0 tx=0).stop 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 shutdown_connections 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275815b510 0x7f275814e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27580ae480 0x7f275814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 --2- 172.21.15.7:0/312082021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2758072ff0 0x7f27581f8ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 >> 172.21.15.7:0/312082021 conn(0x7f27580b2300 msgr2=0x7f27580719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 shutdown_connections 2024-08-19T00:38:49.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:49.689+0000 7f275fa00640 1 -- 172.21.15.7:0/312082021 wait complete. 2024-08-19T00:38:49.706 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:38:49.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:38:49.790 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:38:49.898 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:38:49.898 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:49.899 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:49.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:38:49.935 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:38:49.935 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:49.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:38:49.972 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:38:49.973 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:50.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:38:50.010 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:38:50.010 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:38:50.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:38:50.050 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-19T00:38:50.051 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:50.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.205+0000 7f490da00640 1 Processor -- start 2024-08-19T00:38:50.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.205+0000 7f490da00640 1 -- start start 2024-08-19T00:38:50.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.206+0000 7f490da00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4908159bf0 0x7f4908073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.206+0000 7f490da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f49080ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.206+0000 7f490da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490806f7f0 con 0x7f49080cea40 2024-08-19T00:38:50.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f490da00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f490806f510 con 0x7f4908159bf0 2024-08-19T00:38:50.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f490da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4908072980 con 0x7f49080739a0 2024-08-19T00:38:50.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4907400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f49080cea40 0x7f49080d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35472/0 (socket says 172.21.15.7:35472) 2024-08-19T00:38:50.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4907400640 1 -- 172.21.15.7:0/2631767754 learned_addr learned my addr 172.21.15.7:0/2631767754 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:50.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4906a00640 1 --2- 172.21.15.7:0/2631767754 >> v2:172.21.15.162:3300/0 conn(0x7f4908159bf0 0x7f4908073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f48ffe00640 1 --2- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f49080ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4906000640 1 -- 172.21.15.7:0/2631767754 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399945411 0 0) 0x7f490806f7f0 con 0x7f49080cea40 2024-08-19T00:38:50.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4906000640 1 -- 172.21.15.7:0/2631767754 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48ec003520 con 0x7f49080cea40 2024-08-19T00:38:50.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4906a00640 1 -- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 msgr2=0x7f49080ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:50.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4906a00640 1 --2- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f49080ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4906a00640 1 -- 172.21.15.7:0/2631767754 >> v1:172.21.15.7:6789/0 conn(0x7f49080cea40 legacy=0x7f49080d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.207+0000 7f4906a00640 1 -- 172.21.15.7:0/2631767754 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4908072c60 con 0x7f4908159bf0 2024-08-19T00:38:50.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.208+0000 7f48ffe00640 1 --2- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f49080ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:50.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.209+0000 7f4906a00640 1 --2- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 0x7f4908073460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48f80097a0 tx=0x7f48f802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b7d61d23b72186 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:50.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.209+0000 7f4906000640 1 -- 172.21.15.7:0/2631767754 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8037070 con 0x7f4908159bf0 2024-08-19T00:38:50.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.209+0000 7f4906000640 1 -- 172.21.15.7:0/2631767754 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f802ae50 con 0x7f4908159bf0 2024-08-19T00:38:50.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.209+0000 7f4906000640 1 -- 172.21.15.7:0/2631767754 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8032660 con 0x7f4908159bf0 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.209+0000 7f490da00640 1 -- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 msgr2=0x7f4908073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.209+0000 7f490da00640 1 --2- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 0x7f4908073460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48f80097a0 tx=0x7f48f802a100 comp rx=0 tx=0).stop 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.210+0000 7f490da00640 1 -- 172.21.15.7:0/2631767754 shutdown_connections 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.210+0000 7f490da00640 1 --2- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f49080ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.210+0000 7f490da00640 1 --2- 172.21.15.7:0/2631767754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 0x7f4908073460 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.210+0000 7f490da00640 1 -- 172.21.15.7:0/2631767754 >> 172.21.15.7:0/2631767754 conn(0x7f490806bc70 msgr2=0x7f490806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.210+0000 7f490da00640 1 -- 172.21.15.7:0/2631767754 shutdown_connections 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.210+0000 7f490da00640 1 -- 172.21.15.7:0/2631767754 wait complete. 2024-08-19T00:38:50.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.211+0000 7f490da00640 1 Processor -- start 2024-08-19T00:38:50.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.211+0000 7f490da00640 1 -- start start 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f490da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f4908155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f490da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49080cea40 0x7f49080b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f490da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 0x7f490809c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f490da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f490815a150 con 0x7f49080cea40 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f490da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4908159fd0 con 0x7f4908159bf0 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f490da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f49080d0ad0 con 0x7f49080739a0 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f48ffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49080cea40 0x7f49080b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f48ffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49080cea40 0x7f49080b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39850/0 (socket says 172.21.15.7:39850) 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.212+0000 7f48ffe00640 1 -- 172.21.15.7:0/3085618292 learned_addr learned my addr 172.21.15.7:0/3085618292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f4906a00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f4908155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f4907400640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 0x7f490809c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48ffe00640 1 -- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 msgr2=0x7f4908155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48ffe00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f4908155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48ffe00640 1 -- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 msgr2=0x7f490809c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48ffe00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 0x7f490809c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48ffe00640 1 -- 172.21.15.7:0/3085618292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49080ad290 con 0x7f49080cea40 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48ffe00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49080cea40 0x7f49080b0250 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f48f000e910 tx=0x7f48f000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48fea00640 1 -- 172.21.15.7:0/3085618292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0017070 con 0x7f49080cea40 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48fea00640 1 -- 172.21.15.7:0/3085618292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f000ca00 con 0x7f49080cea40 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49081f27b0 con 0x7f49080cea40 2024-08-19T00:38:50.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.213+0000 7f48fea00640 1 -- 172.21.15.7:0/3085618292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f000cdb0 con 0x7f49080cea40 2024-08-19T00:38:50.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.214+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49080afa50 con 0x7f49080cea40 2024-08-19T00:38:50.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.215+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49080ce500 con 0x7f49080cea40 2024-08-19T00:38:50.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.216+0000 7f48fea00640 1 -- 172.21.15.7:0/3085618292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48f001a070 con 0x7f49080cea40 2024-08-19T00:38:50.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.217+0000 7f48fea00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48e406be30 0x7f48e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.217+0000 7f48fea00640 1 -- 172.21.15.7:0/3085618292 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7f48f008aee0 con 0x7f49080cea40 2024-08-19T00:38:50.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.218+0000 7f4906a00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48e406be30 0x7f48e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.218+0000 7f4906a00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48e406be30 0x7f48e406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f48f8034000 tx=0x7f48f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:50.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.222+0000 7f48fea00640 1 -- 172.21.15.7:0/3085618292 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f48f0059a90 con 0x7f49080cea40 2024-08-19T00:38:50.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.445+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f490815c050 con 0x7f49080cea40 2024-08-19T00:38:50.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.445+0000 7f48fea00640 1 -- 172.21.15.7:0/3085618292 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+3911 (secure 0 0 0) 0x7f48f0059390 con 0x7f49080cea40 2024-08-19T00:38:50.447 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:50.447 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":23,"btime":"2024-08-19T00:38:43:938452+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1070861555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1070861555},{"type":"v1","addr":"172.21.15.7:6836","nonce":1070861555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1022884220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1022884220},{"type":"v1","addr":"172.21.15.7:6837","nonce":1022884220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1200232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1200232941},{"type":"v1","addr":"172.21.15.162:6834","nonce":1200232941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3701002424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3701002424},{"type":"v1","addr":"172.21.15.162:6835","nonce":3701002424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[]} 2024-08-19T00:38:50.447 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 23 2024-08-19T00:38:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48e406be30 msgr2=0x7f48e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48e406be30 0x7f48e406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f48f8034000 tx=0x7f48f802e000 comp rx=0 tx=0).stop 2024-08-19T00:38:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49080cea40 msgr2=0x7f49080b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49080cea40 0x7f49080b0250 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f48f000e910 tx=0x7f48f000edd0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 shutdown_connections 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48e406be30 0x7f48e406e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4908159bf0 0x7f490809c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49080cea40 0x7f49080b0250 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 --2- 172.21.15.7:0/3085618292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49080739a0 0x7f4908155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.447+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 >> 172.21.15.7:0/3085618292 conn(0x7f490806bc70 msgr2=0x7f49080b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.448+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 shutdown_connections 2024-08-19T00:38:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.448+0000 7f490da00640 1 -- 172.21.15.7:0/3085618292 wait complete. 2024-08-19T00:38:50.465 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:38:50.465 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-19T00:38:50.466 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:38:50.466 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:38:50.466 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:38:50.466 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-19T00:38:50.466 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:38:50.466 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:38:50.467 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-19T00:38:50.467 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-19T00:38:50.467 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-19T00:38:50.467 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:38:50.467 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-19T00:38:50.467 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-19T00:38:50.467 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-19T00:38:50.467 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:38:50.481 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:38:50.481 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:38:50.482 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:38:50.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:38:50.485 INFO:tasks.ceph.mds.b:Stopped 2024-08-19T00:38:50.485 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-19T00:38:50.486 INFO:tasks.ceph.mds.d:Stopped 2024-08-19T00:38:50.486 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-19T00:38:50.526 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:38:50.526 DEBUG:teuthology.parallel:result is None 2024-08-19T00:38:50.528 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:38:50.528 DEBUG:teuthology.parallel:result is None 2024-08-19T00:38:50.530 INFO:tasks.ceph.mds.b:Started 2024-08-19T00:38:50.530 DEBUG:teuthology.parallel:result is None 2024-08-19T00:38:50.532 INFO:tasks.ceph.mds.d:Started 2024-08-19T00:38:50.532 DEBUG:teuthology.parallel:result is None 2024-08-19T00:38:50.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-19T00:38:50.660 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:38:50.660 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:38:50.661 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:38:50.661 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:38:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.699+0000 7f086b000640 1 Processor -- start 2024-08-19T00:38:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.699+0000 7f086b000640 1 -- start start 2024-08-19T00:38:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.700+0000 7f086b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f08640cfc90 0x7f08640b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.700+0000 7f086b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08640d2900 0x7f08640d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.700+0000 7f086b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08640d53b0 con 0x7f086415e560 2024-08-19T00:38:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.700+0000 7f086b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f08640b6ef0 con 0x7f08640cfc90 2024-08-19T00:38:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.700+0000 7f086b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08640cf2c0 con 0x7f08640d2900 2024-08-19T00:38:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0869000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08640d2900 0x7f08640d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0863e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f086415e560 0x7f08640cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:55306/0 (socket says 172.21.15.7:55306) 2024-08-19T00:38:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0863e00640 1 -- 172.21.15.7:0/878600044 learned_addr learned my addr 172.21.15.7:0/878600044 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0863400640 1 --2- 172.21.15.7:0/878600044 >> v2:172.21.15.162:3300/0 conn(0x7f08640cfc90 0x7f08640b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0869000640 1 -- 172.21.15.7:0/878600044 >> v2:172.21.15.162:3300/0 conn(0x7f08640cfc90 msgr2=0x7f08640b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0869000640 1 --2- 172.21.15.7:0/878600044 >> v2:172.21.15.162:3300/0 conn(0x7f08640cfc90 0x7f08640b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0869000640 1 -- 172.21.15.7:0/878600044 >> v1:172.21.15.162:6789/0 conn(0x7f086415e560 legacy=0x7f08640cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0869000640 1 -- 172.21.15.7:0/878600044 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08640b3710 con 0x7f08640d2900 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.701+0000 7f0862a00640 1 -- 172.21.15.7:0/878600044 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460191122 0 0) 0x7f08640d53b0 con 0x7f086415e560 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.702+0000 7f0869000640 1 --2- 172.21.15.7:0/878600044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08640d2900 0x7f08640d2d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f085c009d90 tx=0x7f085c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d724d4db0995057a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.702+0000 7f0862a00640 1 -- 172.21.15.7:0/878600044 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c031600 con 0x7f08640d2900 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.702+0000 7f0862a00640 1 -- 172.21.15.7:0/878600044 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c0317a0 con 0x7f08640d2900 2024-08-19T00:38:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.702+0000 7f0862a00640 1 -- 172.21.15.7:0/878600044 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c031b70 con 0x7f08640d2900 2024-08-19T00:38:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 -- 172.21.15.7:0/878600044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08640d2900 msgr2=0x7f08640d2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 --2- 172.21.15.7:0/878600044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08640d2900 0x7f08640d2d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f085c009d90 tx=0x7f085c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 -- 172.21.15.7:0/878600044 shutdown_connections 2024-08-19T00:38:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 --2- 172.21.15.7:0/878600044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08640d2900 0x7f08640d2d50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 --2- 172.21.15.7:0/878600044 >> v2:172.21.15.162:3300/0 conn(0x7f08640cfc90 0x7f08640b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 -- 172.21.15.7:0/878600044 >> 172.21.15.7:0/878600044 conn(0x7f086409d710 msgr2=0x7f08640d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 -- 172.21.15.7:0/878600044 shutdown_connections 2024-08-19T00:38:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.703+0000 7f086b000640 1 -- 172.21.15.7:0/878600044 wait complete. 2024-08-19T00:38:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.705+0000 7f086b000640 1 Processor -- start 2024-08-19T00:38:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.705+0000 7f086b000640 1 -- start start 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f086b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08640cfc90 0x7f0864158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f086b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08640d2900 0x7f086415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f086b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086415e560 0x7f086415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f086b000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08640d5040 con 0x7f08640cfc90 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f086b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08640d4d60 con 0x7f08640d2900 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f086b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f086406c870 con 0x7f086415e560 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08640cfc90 0x7f0864158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08640cfc90 0x7f0864158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39874/0 (socket says 172.21.15.7:39874) 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863e00640 1 -- 172.21.15.7:0/3851637428 learned_addr learned my addr 172.21.15.7:0/3851637428 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863400640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08640d2900 0x7f086415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0869000640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086415e560 0x7f086415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863400640 1 -- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086415e560 msgr2=0x7f086415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863400640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086415e560 0x7f086415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863400640 1 -- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08640cfc90 msgr2=0x7f0864158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863400640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08640cfc90 0x7f0864158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863400640 1 -- 172.21.15.7:0/3851637428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08640ccaf0 con 0x7f08640d2900 2024-08-19T00:38:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.706+0000 7f0863e00640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08640cfc90 0x7f0864158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:38:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.707+0000 7f0863400640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08640d2900 0x7f086415d270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f085000e870 tx=0x7f085000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.707+0000 7f085be00640 1 -- 172.21.15.7:0/3851637428 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850017070 con 0x7f08640d2900 2024-08-19T00:38:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.707+0000 7f085be00640 1 -- 172.21.15.7:0/3851637428 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085000ee60 con 0x7f08640d2900 2024-08-19T00:38:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.707+0000 7f085be00640 1 -- 172.21.15.7:0/3851637428 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085000cb60 con 0x7f08640d2900 2024-08-19T00:38:50.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.707+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08640ccdd0 con 0x7f08640d2900 2024-08-19T00:38:50.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.707+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0864159470 con 0x7f08640d2900 2024-08-19T00:38:50.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.709+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08640d5670 con 0x7f08640d2900 2024-08-19T00:38:50.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.709+0000 7f085be00640 1 -- 172.21.15.7:0/3851637428 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f085001a070 con 0x7f08640d2900 2024-08-19T00:38:50.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.710+0000 7f085be00640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f084406be30 0x7f084406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:50.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.710+0000 7f085be00640 1 -- 172.21.15.7:0/3851637428 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5029+0+0 (secure 0 0 0) 0x7f085008acb0 con 0x7f08640d2900 2024-08-19T00:38:50.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.710+0000 7f0863e00640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f084406be30 0x7f084406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:50.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.711+0000 7f0863e00640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f084406be30 0x7f084406e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0854000f60 tx=0x7f0854007e10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.715+0000 7f085be00640 1 -- 172.21.15.7:0/3851637428 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f08640d5670 con 0x7f08640d2900 2024-08-19T00:38:50.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:50.910+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f08640ba4a0 con 0x7f08640d2900 2024-08-19T00:38:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.314+0000 7f085be00640 1 -- 172.21.15.7:0/3851637428 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7f08500592a0 con 0x7f08640d2900 2024-08-19T00:38:51.316 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-08-19T00:38:51.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f084406be30 msgr2=0x7f084406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f084406be30 0x7f084406e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0854000f60 tx=0x7f0854007e10 comp rx=0 tx=0).stop 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08640d2900 msgr2=0x7f086415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08640d2900 0x7f086415d270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f085000e870 tx=0x7f085000ed30 comp rx=0 tx=0).stop 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 shutdown_connections 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f084406be30 0x7f084406e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086415e560 0x7f086415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08640d2900 0x7f086415d270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 --2- 172.21.15.7:0/3851637428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08640cfc90 0x7f0864158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 >> 172.21.15.7:0/3851637428 conn(0x7f086409d710 msgr2=0x7f08640cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 shutdown_connections 2024-08-19T00:38:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.317+0000 7f086b000640 1 -- 172.21.15.7:0/3851637428 wait complete. 2024-08-19T00:38:51.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-19T00:38:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.491+0000 7fe485400640 1 Processor -- start 2024-08-19T00:38:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.491+0000 7fe485400640 1 -- start start 2024-08-19T00:38:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.492+0000 7fe485400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe480159bf0 0x7fe480073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.492+0000 7fe485400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4800739a0 0x7fe4800ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.492+0000 7fe485400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48006f7f0 con 0x7fe4800cea40 2024-08-19T00:38:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.492+0000 7fe485400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe48006f510 con 0x7fe4800739a0 2024-08-19T00:38:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.492+0000 7fe485400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe480072980 con 0x7fe480159bf0 2024-08-19T00:38:51.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe475e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4800739a0 0x7fe4800ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe475e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4800739a0 0x7fe4800ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39884/0 (socket says 172.21.15.7:39884) 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe475e00640 1 -- 172.21.15.7:0/1188692254 learned_addr learned my addr 172.21.15.7:0/1188692254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe47e800640 1 --2- 172.21.15.7:0/1188692254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe480159bf0 0x7fe480073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe475e00640 1 -- 172.21.15.7:0/1188692254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe480159bf0 msgr2=0x7fe480073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe475e00640 1 --2- 172.21.15.7:0/1188692254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe480159bf0 0x7fe480073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe475e00640 1 -- 172.21.15.7:0/1188692254 >> v1:172.21.15.162:6789/0 conn(0x7fe4800cea40 legacy=0x7fe4800d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.493+0000 7fe475e00640 1 -- 172.21.15.7:0/1188692254 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe480072c60 con 0x7fe4800739a0 2024-08-19T00:38:51.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.494+0000 7fe475e00640 1 --2- 172.21.15.7:0/1188692254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4800739a0 0x7fe4800ce500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe468009870 tx=0x7fe46802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e019ac7feb0974 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:51.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.494+0000 7fe47de00640 1 -- 172.21.15.7:0/1188692254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468037070 con 0x7fe4800739a0 2024-08-19T00:38:51.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.494+0000 7fe47de00640 1 -- 172.21.15.7:0/1188692254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe468032440 con 0x7fe4800739a0 2024-08-19T00:38:51.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.494+0000 7fe47de00640 1 -- 172.21.15.7:0/1188692254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468032810 con 0x7fe4800739a0 2024-08-19T00:38:51.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 -- 172.21.15.7:0/1188692254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4800739a0 msgr2=0x7fe4800ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 --2- 172.21.15.7:0/1188692254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4800739a0 0x7fe4800ce500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe468009870 tx=0x7fe46802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 -- 172.21.15.7:0/1188692254 shutdown_connections 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 --2- 172.21.15.7:0/1188692254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4800739a0 0x7fe4800ce500 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 --2- 172.21.15.7:0/1188692254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe480159bf0 0x7fe480073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 -- 172.21.15.7:0/1188692254 >> 172.21.15.7:0/1188692254 conn(0x7fe48006bc70 msgr2=0x7fe48006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 -- 172.21.15.7:0/1188692254 shutdown_connections 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.495+0000 7fe485400640 1 -- 172.21.15.7:0/1188692254 wait complete. 2024-08-19T00:38:51.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.497+0000 7fe485400640 1 Processor -- start 2024-08-19T00:38:51.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.497+0000 7fe485400640 1 -- start start 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe485400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4800739a0 0x7fe4800b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe485400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4800cea40 0x7fe4800b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe485400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe480159bf0 0x7fe480155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe485400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe48015a150 con 0x7fe480159bf0 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe485400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe480159fd0 con 0x7fe4800cea40 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe485400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4800d0ad0 con 0x7fe4800739a0 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe47f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe480159bf0 0x7fe480155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe47f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe480159bf0 0x7fe480155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39890/0 (socket says 172.21.15.7:39890) 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe47f200640 1 -- 172.21.15.7:0/1662071556 learned_addr learned my addr 172.21.15.7:0/1662071556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe47e800640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4800739a0 0x7fe4800b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.498+0000 7fe475e00640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4800cea40 0x7fe4800b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe47f200640 1 -- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4800739a0 msgr2=0x7fe4800b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe47f200640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4800739a0 0x7fe4800b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe47f200640 1 -- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4800cea40 msgr2=0x7fe4800b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe47f200640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4800cea40 0x7fe4800b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe47f200640 1 -- 172.21.15.7:0/1662071556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe480160950 con 0x7fe480159bf0 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe47e800640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4800739a0 0x7fe4800b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe47f200640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe480159bf0 0x7fe480155060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c710 tx=0x7fe47800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe477400640 1 -- 172.21.15.7:0/1662071556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478016020 con 0x7fe480159bf0 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe477400640 1 -- 172.21.15.7:0/1662071556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe478006d50 con 0x7fe480159bf0 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe477400640 1 -- 172.21.15.7:0/1662071556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478003bb0 con 0x7fe480159bf0 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4800b3810 con 0x7fe480159bf0 2024-08-19T00:38:51.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.499+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4800b3dd0 con 0x7fe480159bf0 2024-08-19T00:38:51.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.500+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4800ce500 con 0x7fe480159bf0 2024-08-19T00:38:51.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.502+0000 7fe477400640 1 -- 172.21.15.7:0/1662071556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe47800a850 con 0x7fe480159bf0 2024-08-19T00:38:51.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.502+0000 7fe477400640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45c06be30 0x7fe45c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.503+0000 7fe477400640 1 -- 172.21.15.7:0/1662071556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fe47808a710 con 0x7fe480159bf0 2024-08-19T00:38:51.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.503+0000 7fe47e800640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45c06be30 0x7fe45c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.503+0000 7fe47e800640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45c06be30 0x7fe45c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe470006fd0 tx=0x7fe470008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:51.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.507+0000 7fe477400640 1 -- 172.21.15.7:0/1662071556 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe478020020 con 0x7fe480159bf0 2024-08-19T00:38:51.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.755+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe4800b4110 con 0x7fe480159bf0 2024-08-19T00:38:51.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.756+0000 7fe477400640 1 -- 172.21.15.7:0/1662071556 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fe478059400 con 0x7fe480159bf0 2024-08-19T00:38:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:51.759 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:38:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-08-19T00:38:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-08-19T00:38:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g==", 2024-08-19T00:38:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:38:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA==", 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:38:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ==", 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA==", 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA==", 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-08-19T00:38:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ==", 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ==", 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w==", 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg==", 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-08-19T00:38:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ==", 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA==", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA==", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:38:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA==", 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA==", 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ==", 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg==", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:38:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8Jmuq0sEBAA7n5q8IKlS3tRogqIwCSCeQ==", 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-08-19T00:38:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ==", 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg==", 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:38:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:38:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-08-19T00:38:51.775 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:38:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45c06be30 msgr2=0x7fe45c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45c06be30 0x7fe45c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe470006fd0 tx=0x7fe470008040 comp rx=0 tx=0).stop 2024-08-19T00:38:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe480159bf0 msgr2=0x7fe480155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe480159bf0 0x7fe480155060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c710 tx=0x7fe47800cbd0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 shutdown_connections 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45c06be30 0x7fe45c06e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe480159bf0 0x7fe480155060 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4800cea40 0x7fe4800b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 --2- 172.21.15.7:0/1662071556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4800739a0 0x7fe4800b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 >> 172.21.15.7:0/1662071556 conn(0x7fe48006bc70 msgr2=0x7fe4800751a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 shutdown_connections 2024-08-19T00:38:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.758+0000 7fe485400640 1 -- 172.21.15.7:0/1662071556 wait complete. 2024-08-19T00:38:51.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-19T00:38:51.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.933+0000 7f8282400640 1 Processor -- start 2024-08-19T00:38:51.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.933+0000 7f8282400640 1 -- start start 2024-08-19T00:38:51.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.934+0000 7f8282400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f827c0b4e30 0x7f827c0d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.934+0000 7f8282400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827c0d1430 con 0x7f827c0b49d0 2024-08-19T00:38:51.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.934+0000 7f8282400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827c0d1710 con 0x7f827c15e3a0 2024-08-19T00:38:51.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.934+0000 7f8282400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f827c0d11f0 con 0x7f827c0b4e30 2024-08-19T00:38:51.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.934+0000 7f827be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f827c0b49d0 0x7f827c0d2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35490/0 (socket says 172.21.15.7:35490) 2024-08-19T00:38:51.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.934+0000 7f827be00640 1 -- 172.21.15.7:0/3040427285 learned_addr learned my addr 172.21.15.7:0/3040427285 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.934+0000 7f8281a00640 1 --2- 172.21.15.7:0/3040427285 >> v2:172.21.15.162:3300/0 conn(0x7f827c0b4e30 0x7f827c0d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.935+0000 7f827b400640 1 -- 172.21.15.7:0/3040427285 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626961816 0 0) 0x7f827c0d1430 con 0x7f827c0b49d0 2024-08-19T00:38:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.935+0000 7f827b400640 1 -- 172.21.15.7:0/3040427285 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8264003520 con 0x7f827c0b49d0 2024-08-19T00:38:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.935+0000 7f8281a00640 1 -- 172.21.15.7:0/3040427285 >> v1:172.21.15.162:6789/0 conn(0x7f827c15e3a0 legacy=0x7f827c0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.935+0000 7f8281a00640 1 -- 172.21.15.7:0/3040427285 >> v1:172.21.15.7:6789/0 conn(0x7f827c0b49d0 legacy=0x7f827c0d2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.935+0000 7f8281a00640 1 -- 172.21.15.7:0/3040427285 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c0b41d0 con 0x7f827c0b4e30 2024-08-19T00:38:51.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.936+0000 7f8281a00640 1 --2- 172.21.15.7:0/3040427285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b4e30 0x7f827c0d2a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8274009d90 tx=0x7f827402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55483e7f1ede6bc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:51.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.936+0000 7f827b400640 1 -- 172.21.15.7:0/3040427285 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274007740 con 0x7f827c0b4e30 2024-08-19T00:38:51.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.936+0000 7f827b400640 1 -- 172.21.15.7:0/3040427285 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740078e0 con 0x7f827c0b4e30 2024-08-19T00:38:51.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.936+0000 7f827b400640 1 -- 172.21.15.7:0/3040427285 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274007cb0 con 0x7f827c0b4e30 2024-08-19T00:38:51.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.937+0000 7f8282400640 1 -- 172.21.15.7:0/3040427285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b4e30 msgr2=0x7f827c0d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.937+0000 7f8282400640 1 --2- 172.21.15.7:0/3040427285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b4e30 0x7f827c0d2a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8274009d90 tx=0x7f827402a6f0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.937+0000 7f8282400640 1 -- 172.21.15.7:0/3040427285 shutdown_connections 2024-08-19T00:38:51.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.937+0000 7f8282400640 1 --2- 172.21.15.7:0/3040427285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b4e30 0x7f827c0d2a70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.937+0000 7f8282400640 1 -- 172.21.15.7:0/3040427285 >> 172.21.15.7:0/3040427285 conn(0x7f827c08dbe0 msgr2=0x7f827c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:51.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.937+0000 7f8282400640 1 -- 172.21.15.7:0/3040427285 shutdown_connections 2024-08-19T00:38:51.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.937+0000 7f8282400640 1 -- 172.21.15.7:0/3040427285 wait complete. 2024-08-19T00:38:51.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.939+0000 7f8282400640 1 Processor -- start 2024-08-19T00:38:51.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.939+0000 7f8282400640 1 -- start start 2024-08-19T00:38:51.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f8282400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b49d0 0x7f827c160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f8282400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c0b4e30 0x7f827c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f8282400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f827c15e3a0 0x7f827c0cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f8282400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f827c0d19f0 con 0x7f827c0b4e30 2024-08-19T00:38:51.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f8282400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f827c0b4540 con 0x7f827c0b49d0 2024-08-19T00:38:51.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f8282400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f827c0d2fb0 con 0x7f827c15e3a0 2024-08-19T00:38:51.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c0b4e30 0x7f827c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c0b4e30 0x7f827c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39892/0 (socket says 172.21.15.7:39892) 2024-08-19T00:38:51.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 -- 172.21.15.7:0/1534421324 learned_addr learned my addr 172.21.15.7:0/1534421324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:51.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f8281000640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b49d0 0x7f827c160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 -- 172.21.15.7:0/1534421324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f827c15e3a0 msgr2=0x7f827c0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f827c15e3a0 0x7f827c0cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 -- 172.21.15.7:0/1534421324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b49d0 msgr2=0x7f827c160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:51.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b49d0 0x7f827c160d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:51.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.940+0000 7f827be00640 1 -- 172.21.15.7:0/1534421324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c0cc070 con 0x7f827c0b4e30 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.941+0000 7f827be00640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c0b4e30 0x7f827c156bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f826800c530 tx=0x7f826800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.941+0000 7f8278c00640 1 -- 172.21.15.7:0/1534421324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268017070 con 0x7f827c0b4e30 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.941+0000 7f8278c00640 1 -- 172.21.15.7:0/1534421324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8268005ce0 con 0x7f827c0b4e30 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.941+0000 7f8278c00640 1 -- 172.21.15.7:0/1534421324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680072b0 con 0x7f827c0b4e30 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.941+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827c0cc350 con 0x7f827c0b4e30 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.941+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827c0cc910 con 0x7f827c0b4e30 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.942+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827c0d0ae0 con 0x7f827c0b4e30 2024-08-19T00:38:51.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.943+0000 7f8278c00640 1 -- 172.21.15.7:0/1534421324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f826801a070 con 0x7f827c0b4e30 2024-08-19T00:38:51.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.944+0000 7f8278c00640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f825c06be30 0x7f825c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:51.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.944+0000 7f8278c00640 1 -- 172.21.15.7:0/1534421324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f8268089f30 con 0x7f827c0b4e30 2024-08-19T00:38:51.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.944+0000 7f8281000640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f825c06be30 0x7f825c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:51.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.945+0000 7f8281000640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f825c06be30 0x7f825c06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8270001500 tx=0x7f8270009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:51.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:51.948+0000 7f8278c00640 1 -- 172.21.15.7:0/1534421324 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8268058cf0 con 0x7f827c0b4e30 2024-08-19T00:38:52.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.134+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f827c0b5ef0 con 0x7f827c0b4e30 2024-08-19T00:38:52.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.134+0000 7f8278c00640 1 -- 172.21.15.7:0/1534421324 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f82680585f0 con 0x7f827c0b4e30 2024-08-19T00:38:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:52.136 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:38:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:38:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-08-19T00:38:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-08-19T00:38:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:38:52.137 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:38:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f825c06be30 msgr2=0x7f825c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f825c06be30 0x7f825c06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8270001500 tx=0x7f8270009040 comp rx=0 tx=0).stop 2024-08-19T00:38:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c0b4e30 msgr2=0x7f827c156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c0b4e30 0x7f827c156bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f826800c530 tx=0x7f826800c9f0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 shutdown_connections 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f825c06be30 0x7f825c06e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f827c15e3a0 0x7f827c0cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f827c0b4e30 0x7f827c156bc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 --2- 172.21.15.7:0/1534421324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827c0b49d0 0x7f827c160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.136+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 >> 172.21.15.7:0/1534421324 conn(0x7f827c08dbe0 msgr2=0x7f827c06db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.137+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 shutdown_connections 2024-08-19T00:38:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.137+0000 7f8282400640 1 -- 172.21.15.7:0/1534421324 wait complete. 2024-08-19T00:38:52.155 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:38:52.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:38:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.316+0000 7feac3000640 1 Processor -- start 2024-08-19T00:38:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.316+0000 7feac3000640 1 -- start start 2024-08-19T00:38:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.318+0000 7feac3000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feabc06da50 0x7feabc15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.318+0000 7feac3000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feabc073140 con 0x7feabc15bd70 2024-08-19T00:38:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.318+0000 7feac3000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feabc0733f0 con 0x7feabc06d600 2024-08-19T00:38:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.318+0000 7feac3000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feabc0736d0 con 0x7feabc06da50 2024-08-19T00:38:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.318+0000 7feac1c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feabc15bd70 0x7feabc072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35498/0 (socket says 172.21.15.7:35498) 2024-08-19T00:38:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.318+0000 7feac1c00640 1 -- 172.21.15.7:0/3902435340 learned_addr learned my addr 172.21.15.7:0/3902435340 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.318+0000 7feac2600640 1 --2- 172.21.15.7:0/3902435340 >> v2:172.21.15.162:3300/0 conn(0x7feabc06da50 0x7feabc15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.319+0000 7feabbe00640 1 -- 172.21.15.7:0/3902435340 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237847403 0 0) 0x7feabc073140 con 0x7feabc15bd70 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.319+0000 7feabbe00640 1 -- 172.21.15.7:0/3902435340 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaa4003520 con 0x7feabc15bd70 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.319+0000 7feabbe00640 1 -- 172.21.15.7:0/3902435340 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17028609 0 0) 0x7feabc0733f0 con 0x7feabc06d600 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.319+0000 7feabbe00640 1 -- 172.21.15.7:0/3902435340 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feabc073140 con 0x7feabc06d600 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.319+0000 7feac2600640 1 -- 172.21.15.7:0/3902435340 >> v1:172.21.15.162:6789/0 conn(0x7feabc06d600 legacy=0x7feabc15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.319+0000 7feac2600640 1 -- 172.21.15.7:0/3902435340 >> v1:172.21.15.7:6789/0 conn(0x7feabc15bd70 legacy=0x7feabc072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.319+0000 7feac2600640 1 -- 172.21.15.7:0/3902435340 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc0739b0 con 0x7feabc06da50 2024-08-19T00:38:52.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.320+0000 7feac2600640 1 --2- 172.21.15.7:0/3902435340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc06da50 0x7feabc15d3b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d90 tx=0x7feab402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d5af9ae8a4e21b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:52.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.320+0000 7feabbe00640 1 -- 172.21.15.7:0/3902435340 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4007740 con 0x7feabc06da50 2024-08-19T00:38:52.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.320+0000 7feabbe00640 1 -- 172.21.15.7:0/3902435340 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab40078e0 con 0x7feabc06da50 2024-08-19T00:38:52.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.320+0000 7feabbe00640 1 -- 172.21.15.7:0/3902435340 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4007cb0 con 0x7feabc06da50 2024-08-19T00:38:52.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.321+0000 7feac3000640 1 -- 172.21.15.7:0/3902435340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc06da50 msgr2=0x7feabc15d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:52.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.321+0000 7feac3000640 1 --2- 172.21.15.7:0/3902435340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc06da50 0x7feabc15d3b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d90 tx=0x7feab402a6f0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.321+0000 7feac3000640 1 -- 172.21.15.7:0/3902435340 shutdown_connections 2024-08-19T00:38:52.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.321+0000 7feac3000640 1 --2- 172.21.15.7:0/3902435340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc06da50 0x7feabc15d3b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.321+0000 7feac3000640 1 -- 172.21.15.7:0/3902435340 >> 172.21.15.7:0/3902435340 conn(0x7feabc06b850 msgr2=0x7feabc06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:52.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.321+0000 7feac3000640 1 -- 172.21.15.7:0/3902435340 shutdown_connections 2024-08-19T00:38:52.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.321+0000 7feac3000640 1 -- 172.21.15.7:0/3902435340 wait complete. 2024-08-19T00:38:52.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.323+0000 7feac3000640 1 Processor -- start 2024-08-19T00:38:52.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.323+0000 7feac3000640 1 -- start start 2024-08-19T00:38:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac3000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feabc06d600 0x7feabc1f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feabc06da50 0x7feabc155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac3000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15bd70 0x7feabc0ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feabc06dec0 con 0x7feabc06da50 2024-08-19T00:38:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac3000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feabc15c780 con 0x7feabc15bd70 2024-08-19T00:38:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac3000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feabc15c150 con 0x7feabc06d600 2024-08-19T00:38:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feabc06da50 0x7feabc155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feabc06da50 0x7feabc155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39896/0 (socket says 172.21.15.7:39896) 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac1200640 1 -- 172.21.15.7:0/2917829356 learned_addr learned my addr 172.21.15.7:0/2917829356 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac2600640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15bd70 0x7feabc0ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.324+0000 7feac1c00640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feabc06d600 0x7feabc1f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac1200640 1 -- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feabc06d600 msgr2=0x7feabc1f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac1200640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feabc06d600 0x7feabc1f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac1200640 1 -- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15bd70 msgr2=0x7feabc0ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac1200640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15bd70 0x7feabc0ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:52.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac1200640 1 -- 172.21.15.7:0/2917829356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc0c5190 con 0x7feabc06da50 2024-08-19T00:38:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac1200640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feabc06da50 0x7feabc155980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c430 tx=0x7feaa800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feab9600640 1 -- 172.21.15.7:0/2917829356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8017070 con 0x7feabc06da50 2024-08-19T00:38:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feab9600640 1 -- 172.21.15.7:0/2917829356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa80052f0 con 0x7feabc06da50 2024-08-19T00:38:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feab9600640 1 -- 172.21.15.7:0/2917829356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8003830 con 0x7feabc06da50 2024-08-19T00:38:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feabc0c5430 con 0x7feabc06da50 2024-08-19T00:38:52.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.325+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feabc0c59f0 con 0x7feabc06da50 2024-08-19T00:38:52.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.327+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feabc06e3a0 con 0x7feabc06da50 2024-08-19T00:38:52.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.327+0000 7feab9600640 1 -- 172.21.15.7:0/2917829356 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feaa801a070 con 0x7feabc06da50 2024-08-19T00:38:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.328+0000 7feab9600640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea9c06be30 0x7fea9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.328+0000 7feab9600640 1 -- 172.21.15.7:0/2917829356 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7feaa8089e70 con 0x7feabc06da50 2024-08-19T00:38:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.328+0000 7feac1c00640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea9c06be30 0x7fea9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.329+0000 7feac1c00640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea9c06be30 0x7fea9c06e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feab00011e0 tx=0x7feab0007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:52.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.332+0000 7feab9600640 1 -- 172.21.15.7:0/2917829356 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feaa8058510 con 0x7feabc06da50 2024-08-19T00:38:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:52.516+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7feabc0a94d0 con 0x7feabc06da50 2024-08-19T00:38:53.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.319+0000 7feab9600640 1 -- 172.21.15.7:0/2917829356 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7feaa805c810 con 0x7feabc06da50 2024-08-19T00:38:53.321 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-08-19T00:38:53.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea9c06be30 msgr2=0x7fea9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:53.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea9c06be30 0x7fea9c06e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feab00011e0 tx=0x7feab0007d30 comp rx=0 tx=0).stop 2024-08-19T00:38:53.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feabc06da50 msgr2=0x7feabc155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:53.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feabc06da50 0x7feabc155980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c430 tx=0x7feaa800c8f0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 shutdown_connections 2024-08-19T00:38:53.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea9c06be30 0x7fea9c06e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15bd70 0x7feabc0ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feabc06da50 0x7feabc155980 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 --2- 172.21.15.7:0/2917829356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feabc06d600 0x7feabc1f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.323+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 >> 172.21.15.7:0/2917829356 conn(0x7feabc06b850 msgr2=0x7feabc0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.324+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 shutdown_connections 2024-08-19T00:38:53.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.324+0000 7feac3000640 1 -- 172.21.15.7:0/2917829356 wait complete. 2024-08-19T00:38:53.349 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:38:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.517+0000 7ff236e00640 1 Processor -- start 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.517+0000 7ff236e00640 1 -- start start 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.518+0000 7ff236e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2300af9c0 0x7ff2300afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.518+0000 7ff236e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2300b02e0 con 0x7ff23009ba80 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.518+0000 7ff236e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2300b1480 con 0x7ff2300b2b50 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.518+0000 7ff236e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff2300b6240 con 0x7ff2300af9c0 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.518+0000 7ff22fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2300af9c0 0x7ff2300afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.518+0000 7ff22f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff23009ba80 0x7ff2300b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35510/0 (socket says 172.21.15.7:35510) 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.518+0000 7ff22f400640 1 -- 172.21.15.7:0/442556956 learned_addr learned my addr 172.21.15.7:0/442556956 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.519+0000 7ff22fe00640 1 -- 172.21.15.7:0/442556956 >> v1:172.21.15.162:6789/0 conn(0x7ff2300b2b50 legacy=0x7ff2300b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.519+0000 7ff22fe00640 1 -- 172.21.15.7:0/442556956 >> v1:172.21.15.7:6789/0 conn(0x7ff23009ba80 legacy=0x7ff2300b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.519+0000 7ff22fe00640 1 -- 172.21.15.7:0/442556956 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2300b6520 con 0x7ff2300af9c0 2024-08-19T00:38:53.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.519+0000 7ff22ea00640 1 -- 172.21.15.7:0/442556956 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3087274839 0 0) 0x7ff2300b02e0 con 0x7ff23009ba80 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.520+0000 7ff22fe00640 1 --2- 172.21.15.7:0/442556956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff2300afda0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff2200097a0 tx=0x7ff22002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eca23117661d172 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.520+0000 7ff22ea00640 1 -- 172.21.15.7:0/442556956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220037070 con 0x7ff2300af9c0 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.520+0000 7ff22ea00640 1 -- 172.21.15.7:0/442556956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff220032440 con 0x7ff2300af9c0 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.520+0000 7ff22ea00640 1 -- 172.21.15.7:0/442556956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220032810 con 0x7ff2300af9c0 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.521+0000 7ff236e00640 1 -- 172.21.15.7:0/442556956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 msgr2=0x7ff2300afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.521+0000 7ff236e00640 1 --2- 172.21.15.7:0/442556956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff2300afda0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff2200097a0 tx=0x7ff22002a230 comp rx=0 tx=0).stop 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.521+0000 7ff236e00640 1 -- 172.21.15.7:0/442556956 shutdown_connections 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.521+0000 7ff236e00640 1 --2- 172.21.15.7:0/442556956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff2300afda0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.521+0000 7ff236e00640 1 -- 172.21.15.7:0/442556956 >> 172.21.15.7:0/442556956 conn(0x7ff2300d2180 msgr2=0x7ff2300d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.521+0000 7ff236e00640 1 -- 172.21.15.7:0/442556956 shutdown_connections 2024-08-19T00:38:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.521+0000 7ff236e00640 1 -- 172.21.15.7:0/442556956 wait complete. 2024-08-19T00:38:53.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.522+0000 7ff236e00640 1 Processor -- start 2024-08-19T00:38:53.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.523+0000 7ff236e00640 1 -- start start 2024-08-19T00:38:53.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.523+0000 7ff236e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff23009ba80 0x7ff2301f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.523+0000 7ff236e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff23006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff236e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2300b2b50 0x7ff230157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff236e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300b5ed0 con 0x7ff2300af9c0 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff236e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff23015c740 con 0x7ff2300b2b50 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff236e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff2300b6800 con 0x7ff23009ba80 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff23006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff23006fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39918/0 (socket says 172.21.15.7:39918) 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 -- 172.21.15.7:0/3376763047 learned_addr learned my addr 172.21.15.7:0/3376763047 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22fe00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff23009ba80 0x7ff2301f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff234e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2300b2b50 0x7ff230157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 -- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff23009ba80 msgr2=0x7ff2301f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff23009ba80 0x7ff2301f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 -- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2300b2b50 msgr2=0x7ff230157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2300b2b50 0x7ff230157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22f400640 1 -- 172.21.15.7:0/3376763047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2301f5890 con 0x7ff2300af9c0 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.524+0000 7ff22fe00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff23009ba80 0x7ff2301f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.525+0000 7ff22f400640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff23006fec0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c460 tx=0x7ff21c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.525+0000 7ff227e00640 1 -- 172.21.15.7:0/3376763047 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c018070 con 0x7ff2300af9c0 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.525+0000 7ff227e00640 1 -- 172.21.15.7:0/3376763047 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c007520 con 0x7ff2300af9c0 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.525+0000 7ff227e00640 1 -- 172.21.15.7:0/3376763047 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c004a20 con 0x7ff2300af9c0 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.525+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23015d800 con 0x7ff2300af9c0 2024-08-19T00:38:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.525+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23015d240 con 0x7ff2300af9c0 2024-08-19T00:38:53.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.526+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2300b73f0 con 0x7ff2300af9c0 2024-08-19T00:38:53.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.527+0000 7ff227e00640 1 -- 172.21.15.7:0/3376763047 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff21c004bc0 con 0x7ff2300af9c0 2024-08-19T00:38:53.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.528+0000 7ff227e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff21006be30 0x7ff21006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:53.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.529+0000 7ff227e00640 1 -- 172.21.15.7:0/3376763047 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7ff21c089ff0 con 0x7ff2300af9c0 2024-08-19T00:38:53.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.529+0000 7ff22fe00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff21006be30 0x7ff21006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:53.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.529+0000 7ff22fe00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff21006be30 0x7ff21006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff220034000 tx=0x7ff22002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:53.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.534+0000 7ff227e00640 1 -- 172.21.15.7:0/3376763047 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff2300b73f0 con 0x7ff2300af9c0 2024-08-19T00:38:53.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:53.718+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff2300b0f00 con 0x7ff2300af9c0 2024-08-19T00:38:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.322+0000 7ff227e00640 1 -- 172.21.15.7:0/3376763047 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7ff2301f5890 con 0x7ff2300af9c0 2024-08-19T00:38:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-08-19T00:38:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.326+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff21006be30 msgr2=0x7ff21006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.326+0000 7ff236e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff21006be30 0x7ff21006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff220034000 tx=0x7ff22002e000 comp rx=0 tx=0).stop 2024-08-19T00:38:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.326+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 msgr2=0x7ff23006fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.326+0000 7ff236e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff23006fec0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c460 tx=0x7ff21c00c920 comp rx=0 tx=0).stop 2024-08-19T00:38:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.328+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 shutdown_connections 2024-08-19T00:38:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.328+0000 7ff236e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff21006be30 0x7ff21006e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.328+0000 7ff236e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2300b2b50 0x7ff230157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.328+0000 7ff236e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2300af9c0 0x7ff23006fec0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.328+0000 7ff236e00640 1 --2- 172.21.15.7:0/3376763047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff23009ba80 0x7ff2301f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.328+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 >> 172.21.15.7:0/3376763047 conn(0x7ff2300d2180 msgr2=0x7ff2301e4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:54.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.329+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 shutdown_connections 2024-08-19T00:38:54.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.330+0000 7ff236e00640 1 -- 172.21.15.7:0/3376763047 wait complete. 2024-08-19T00:38:54.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:38:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.523+0000 7f832ec00640 1 Processor -- start 2024-08-19T00:38:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.523+0000 7f832ec00640 1 -- start start 2024-08-19T00:38:54.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.524+0000 7f832ec00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f83280d2c10 0x7f83280cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.524+0000 7f832ec00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f832806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.524+0000 7f832ec00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83280cf500 con 0x7f8328161c90 2024-08-19T00:38:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.524+0000 7f832ec00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f83280d0110 con 0x7f83280d2c10 2024-08-19T00:38:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.524+0000 7f832ec00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f832806e7a0 con 0x7f832806e330 2024-08-19T00:38:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f832cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f832806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f832cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f832806ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52998/0 (socket says 172.21.15.7:52998) 2024-08-19T00:38:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f832cc00640 1 -- 172.21.15.7:0/955547063 learned_addr learned my addr 172.21.15.7:0/955547063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f8327e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8328161c90 0x7f83280d2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:35890/0 (socket says 172.21.15.7:35890) 2024-08-19T00:38:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f8327400640 1 --2- 172.21.15.7:0/955547063 >> v2:172.21.15.162:3300/0 conn(0x7f83280d2c10 0x7f83280cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f832cc00640 1 -- 172.21.15.7:0/955547063 >> v2:172.21.15.162:3300/0 conn(0x7f83280d2c10 msgr2=0x7f83280cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f832cc00640 1 --2- 172.21.15.7:0/955547063 >> v2:172.21.15.162:3300/0 conn(0x7f83280d2c10 0x7f83280cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f832cc00640 1 -- 172.21.15.7:0/955547063 >> v1:172.21.15.162:6789/0 conn(0x7f8328161c90 legacy=0x7f83280d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.525+0000 7f832cc00640 1 -- 172.21.15.7:0/955547063 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83280cf7e0 con 0x7f832806e330 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.526+0000 7f832cc00640 1 --2- 172.21.15.7:0/955547063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f832806ca10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8320009e50 tx=0x7f832002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f8de89b5d408ba server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.526+0000 7f8326a00640 1 -- 172.21.15.7:0/955547063 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320036070 con 0x7f832806e330 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f8326a00640 1 -- 172.21.15.7:0/955547063 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8320031600 con 0x7f832806e330 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f8326a00640 1 -- 172.21.15.7:0/955547063 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200319d0 con 0x7f832806e330 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 -- 172.21.15.7:0/955547063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 msgr2=0x7f832806ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 --2- 172.21.15.7:0/955547063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f832806ca10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8320009e50 tx=0x7f832002a710 comp rx=0 tx=0).stop 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 -- 172.21.15.7:0/955547063 shutdown_connections 2024-08-19T00:38:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 --2- 172.21.15.7:0/955547063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f832806ca10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 --2- 172.21.15.7:0/955547063 >> v2:172.21.15.162:3300/0 conn(0x7f83280d2c10 0x7f83280cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 -- 172.21.15.7:0/955547063 >> 172.21.15.7:0/955547063 conn(0x7f832808c000 msgr2=0x7f83280d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 -- 172.21.15.7:0/955547063 shutdown_connections 2024-08-19T00:38:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.527+0000 7f832ec00640 1 -- 172.21.15.7:0/955547063 wait complete. 2024-08-19T00:38:54.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.529+0000 7f832ec00640 1 Processor -- start 2024-08-19T00:38:54.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.529+0000 7f832ec00640 1 -- start start 2024-08-19T00:38:54.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f832ec00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f83280cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:54.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f832ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280d2c10 0x7f83281f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:54.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f832ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8328161c90 0x7f832815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f832ec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8328162070 con 0x7f83280d2c10 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f832ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f83280cfda0 con 0x7f8328161c90 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f832ec00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f83281621f0 con 0x7f832806e330 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f8327400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280d2c10 0x7f83281f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f8327400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280d2c10 0x7f83281f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60450/0 (socket says 172.21.15.7:60450) 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f8327400640 1 -- 172.21.15.7:0/2456327773 learned_addr learned my addr 172.21.15.7:0/2456327773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f8327e00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f83280cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.530+0000 7f832cc00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8328161c90 0x7f832815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f8327400640 1 -- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 msgr2=0x7f83280cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f8327400640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f83280cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f8327400640 1 -- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8328161c90 msgr2=0x7f832815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f8327400640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8328161c90 0x7f832815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f8327400640 1 -- 172.21.15.7:0/2456327773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83280ce3b0 con 0x7f83280d2c10 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f8327400640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280d2c10 0x7f83281f35e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f831400e870 tx=0x7f831400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f831fe00640 1 -- 172.21.15.7:0/2456327773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314017070 con 0x7f83280d2c10 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f831fe00640 1 -- 172.21.15.7:0/2456327773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831400c940 con 0x7f83280d2c10 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832815cf30 con 0x7f83280d2c10 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f831fe00640 1 -- 172.21.15.7:0/2456327773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831400cd30 con 0x7f83280d2c10 2024-08-19T00:38:54.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.531+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832815d4f0 con 0x7f83280d2c10 2024-08-19T00:38:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.533+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83280d3300 con 0x7f83280d2c10 2024-08-19T00:38:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.534+0000 7f831fe00640 1 -- 172.21.15.7:0/2456327773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f831401a070 con 0x7f83280d2c10 2024-08-19T00:38:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.535+0000 7f831fe00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806be30 0x7f830806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.535+0000 7f831fe00640 1 -- 172.21.15.7:0/2456327773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f831408b3e0 con 0x7f83280d2c10 2024-08-19T00:38:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.535+0000 7f8327e00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806be30 0x7f830806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.536+0000 7f8327e00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806be30 0x7f830806e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8318007fd0 tx=0x7f8318007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:54.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.539+0000 7f831fe00640 1 -- 172.21.15.7:0/2456327773 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8314059810 con 0x7f83280d2c10 2024-08-19T00:38:54.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:54.759+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f83280008d0 con 0x7f83280d2c10 2024-08-19T00:38:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.343+0000 7f831fe00640 1 -- 172.21.15.7:0/2456327773 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v26) ==== 172+0+0 (secure 0 0 0) 0x7f831405db10 con 0x7f83280d2c10 2024-08-19T00:38:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 6 and data pool 7 2024-08-19T00:38:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.350+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806be30 msgr2=0x7f830806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.350+0000 7f832ec00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806be30 0x7f830806e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8318007fd0 tx=0x7f8318007e80 comp rx=0 tx=0).stop 2024-08-19T00:38:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.350+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280d2c10 msgr2=0x7f83281f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.350+0000 7f832ec00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280d2c10 0x7f83281f35e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f831400e870 tx=0x7f831400ed30 comp rx=0 tx=0).stop 2024-08-19T00:38:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.351+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 shutdown_connections 2024-08-19T00:38:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.351+0000 7f832ec00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806be30 0x7f830806e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.351+0000 7f832ec00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8328161c90 0x7f832815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.351+0000 7f832ec00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83280d2c10 0x7f83281f35e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.351+0000 7f832ec00640 1 --2- 172.21.15.7:0/2456327773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f832806e330 0x7f83280cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.351+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 >> 172.21.15.7:0/2456327773 conn(0x7f832808c000 msgr2=0x7f83280b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.352+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 shutdown_connections 2024-08-19T00:38:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.352+0000 7f832ec00640 1 -- 172.21.15.7:0/2456327773 wait complete. 2024-08-19T00:38:55.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:38:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.544+0000 7f4c09a00640 1 Processor -- start 2024-08-19T00:38:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.544+0000 7f4c09a00640 1 -- start start 2024-08-19T00:38:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.545+0000 7f4c09a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.545+0000 7f4c09a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c040739a0 0x7f4c040ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.545+0000 7f4c09a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c040cea40 0x7f4c040d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.545+0000 7f4c09a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0406f7f0 con 0x7f4c040cea40 2024-08-19T00:38:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.545+0000 7f4c09a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0406f510 con 0x7f4c040739a0 2024-08-19T00:38:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.545+0000 7f4c09a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c04072980 con 0x7f4c04159bf0 2024-08-19T00:38:55.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c040cea40 0x7f4c040d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c040cea40 0x7f4c040d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60456/0 (socket says 172.21.15.7:60456) 2024-08-19T00:38:55.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 -- 172.21.15.7:0/716464634 learned_addr learned my addr 172.21.15.7:0/716464634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4bfbe00640 1 --2- 172.21.15.7:0/716464634 >> v2:172.21.15.162:3300/0 conn(0x7f4c040739a0 0x7f4c040ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c02a00640 1 --2- 172.21.15.7:0/716464634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 -- 172.21.15.7:0/716464634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 msgr2=0x7f4c04073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 --2- 172.21.15.7:0/716464634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 -- 172.21.15.7:0/716464634 >> v2:172.21.15.162:3300/0 conn(0x7f4c040739a0 msgr2=0x7f4c040ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 --2- 172.21.15.7:0/716464634 >> v2:172.21.15.162:3300/0 conn(0x7f4c040739a0 0x7f4c040ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.546+0000 7f4c03400640 1 -- 172.21.15.7:0/716464634 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04072c60 con 0x7f4c040cea40 2024-08-19T00:38:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.547+0000 7f4c03400640 1 --2- 172.21.15.7:0/716464634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040cea40 0x7f4c040d03c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4c040b5370 tx=0x7f4bfc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01cf09db780e7dd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.547+0000 7f4c02000640 1 -- 172.21.15.7:0/716464634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc036070 con 0x7f4c040cea40 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.547+0000 7f4c02000640 1 -- 172.21.15.7:0/716464634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc031600 con 0x7f4c040cea40 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.547+0000 7f4c02000640 1 -- 172.21.15.7:0/716464634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0319d0 con 0x7f4c040cea40 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 -- 172.21.15.7:0/716464634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040cea40 msgr2=0x7f4c040d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 --2- 172.21.15.7:0/716464634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040cea40 0x7f4c040d03c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4c040b5370 tx=0x7f4bfc02a610 comp rx=0 tx=0).stop 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 -- 172.21.15.7:0/716464634 shutdown_connections 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 --2- 172.21.15.7:0/716464634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040cea40 0x7f4c040d03c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 --2- 172.21.15.7:0/716464634 >> v2:172.21.15.162:3300/0 conn(0x7f4c040739a0 0x7f4c040ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 --2- 172.21.15.7:0/716464634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 -- 172.21.15.7:0/716464634 >> 172.21.15.7:0/716464634 conn(0x7f4c0406bc70 msgr2=0x7f4c0406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 -- 172.21.15.7:0/716464634 shutdown_connections 2024-08-19T00:38:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.548+0000 7f4c09a00640 1 -- 172.21.15.7:0/716464634 wait complete. 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.550+0000 7f4c09a00640 1 Processor -- start 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.550+0000 7f4c09a00640 1 -- start start 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c09a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040739a0 0x7f4c041535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c09a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c040cea40 0x7f4c041542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c09a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c09a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0415a150 con 0x7f4c040739a0 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c09a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04159fd0 con 0x7f4c040cea40 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c09a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040d0900 con 0x7f4c04159bf0 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040739a0 0x7f4c041535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040739a0 0x7f4c041535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60458/0 (socket says 172.21.15.7:60458) 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 -- 172.21.15.7:0/3896541774 learned_addr learned my addr 172.21.15.7:0/3896541774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c03400640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4bfbe00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c040cea40 0x7f4c041542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 -- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 msgr2=0x7f4c04154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 -- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c040cea40 msgr2=0x7f4c041542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c040cea40 0x7f4c041542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.551+0000 7f4c02a00640 1 -- 172.21.15.7:0/3896541774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04153b00 con 0x7f4c040739a0 2024-08-19T00:38:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.552+0000 7f4c02a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040739a0 0x7f4c041535c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400e9b0 tx=0x7f4bf400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.552+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3896541774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4017070 con 0x7f4c040739a0 2024-08-19T00:38:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.552+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3896541774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf400c9a0 con 0x7f4c040739a0 2024-08-19T00:38:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.552+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c041501a0 con 0x7f4c040739a0 2024-08-19T00:38:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.552+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3896541774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400cd90 con 0x7f4c040739a0 2024-08-19T00:38:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.552+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c04150760 con 0x7f4c040739a0 2024-08-19T00:38:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.553+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0406e070 con 0x7f4c040739a0 2024-08-19T00:38:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.554+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3896541774 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bf401a070 con 0x7f4c040739a0 2024-08-19T00:38:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.555+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4be006be30 0x7f4be006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.555+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3896541774 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f4bf408b230 con 0x7f4c040739a0 2024-08-19T00:38:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.555+0000 7f4bfbe00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4be006be30 0x7f4be006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.556+0000 7f4bfbe00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4be006be30 0x7f4be006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cd270 tx=0x7f4bec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.560+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3896541774 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4c0406e070 con 0x7f4c040739a0 2024-08-19T00:38:55.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.748+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c040d03c0 con 0x7f4c040739a0 2024-08-19T00:38:55.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.749+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3896541774 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16586 (secure 0 0 0) 0x7f4bf4059b40 con 0x7f4c040739a0 2024-08-19T00:38:55.752 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:55.752 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:38:54.760863+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:38:52.558342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-08-19T00:38:53.760748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:38:55.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4be006be30 msgr2=0x7f4be006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4be006be30 0x7f4be006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cd270 tx=0x7f4bec008040 comp rx=0 tx=0).stop 2024-08-19T00:38:55.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040739a0 msgr2=0x7f4c041535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040739a0 0x7f4c041535c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400e9b0 tx=0x7f4bf400ee70 comp rx=0 tx=0).stop 2024-08-19T00:38:55.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 shutdown_connections 2024-08-19T00:38:55.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4be006be30 0x7f4be006e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c04159bf0 0x7f4c04154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c040cea40 0x7f4c041542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 --2- 172.21.15.7:0/3896541774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c040739a0 0x7f4c041535c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 >> 172.21.15.7:0/3896541774 conn(0x7f4c0406bc70 msgr2=0x7f4c04160330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:55.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 shutdown_connections 2024-08-19T00:38:55.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.752+0000 7f4c09a00640 1 -- 172.21.15.7:0/3896541774 wait complete. 2024-08-19T00:38:55.771 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:38:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.927+0000 7f66a5c00640 1 Processor -- start 2024-08-19T00:38:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.927+0000 7f66a5c00640 1 -- start start 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f66a5c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f66a0161ba0 0x7f66a00d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f66a5c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a00d4b30 0x7f66a00d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f66a5c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66a006c950 0x7f66a006ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f66a5c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f66a00d5240 con 0x7f66a006c950 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f66a5c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f66a00b39c0 con 0x7f66a0161ba0 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f66a5c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66a00b36e0 con 0x7f66a00d4b30 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f669f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66a006c950 0x7f66a006ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.928+0000 7f669f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66a006c950 0x7f66a006ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60460/0 (socket says 172.21.15.7:60460) 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669f400640 1 -- 172.21.15.7:0/2388111609 learned_addr learned my addr 172.21.15.7:0/2388111609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669e000640 1 --2- 172.21.15.7:0/2388111609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a00d4b30 0x7f66a00d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669ea00640 1 --2- 172.21.15.7:0/2388111609 >> v2:172.21.15.162:3300/0 conn(0x7f66a0161ba0 0x7f66a00d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669f400640 1 -- 172.21.15.7:0/2388111609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a00d4b30 msgr2=0x7f66a00d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669f400640 1 --2- 172.21.15.7:0/2388111609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a00d4b30 0x7f66a00d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669f400640 1 -- 172.21.15.7:0/2388111609 >> v2:172.21.15.162:3300/0 conn(0x7f66a0161ba0 msgr2=0x7f66a00d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669f400640 1 --2- 172.21.15.7:0/2388111609 >> v2:172.21.15.162:3300/0 conn(0x7f66a0161ba0 0x7f66a00d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.929+0000 7f669f400640 1 -- 172.21.15.7:0/2388111609 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a006e3a0 con 0x7f66a006c950 2024-08-19T00:38:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.930+0000 7f669f400640 1 --2- 172.21.15.7:0/2388111609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a006c950 0x7f66a006ce00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f66a00c7f20 tx=0x7f669802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfc646152534918 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.930+0000 7f669d600640 1 -- 172.21.15.7:0/2388111609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698036070 con 0x7f66a006c950 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.930+0000 7f669d600640 1 -- 172.21.15.7:0/2388111609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6698031600 con 0x7f66a006c950 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.930+0000 7f669d600640 1 -- 172.21.15.7:0/2388111609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980319d0 con 0x7f66a006c950 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 -- 172.21.15.7:0/2388111609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a006c950 msgr2=0x7f66a006ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2388111609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a006c950 0x7f66a006ce00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f66a00c7f20 tx=0x7f669802a6a0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 -- 172.21.15.7:0/2388111609 shutdown_connections 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2388111609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a006c950 0x7f66a006ce00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2388111609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a00d4b30 0x7f66a00d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2388111609 >> v2:172.21.15.162:3300/0 conn(0x7f66a0161ba0 0x7f66a00d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 -- 172.21.15.7:0/2388111609 >> 172.21.15.7:0/2388111609 conn(0x7f66a008c000 msgr2=0x7f66a00d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 -- 172.21.15.7:0/2388111609 shutdown_connections 2024-08-19T00:38:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.931+0000 7f66a5c00640 1 -- 172.21.15.7:0/2388111609 wait complete. 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.933+0000 7f66a5c00640 1 Processor -- start 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.933+0000 7f66a5c00640 1 -- start start 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f66a5c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a006c950 0x7f66a01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f66a5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66a00d4b30 0x7f66a00b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f66a5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0161ba0 0x7f66a00b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f66a5c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66a0161f80 con 0x7f66a0161ba0 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f66a5c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66a00b1be0 con 0x7f66a00d4b30 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f66a5c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66a0162100 con 0x7f66a006c950 2024-08-19T00:38:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0161ba0 0x7f66a00b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0161ba0 0x7f66a00b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60472/0 (socket says 172.21.15.7:60472) 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 -- 172.21.15.7:0/2625325130 learned_addr learned my addr 172.21.15.7:0/2625325130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669e000640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66a00d4b30 0x7f66a00b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669ea00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a006c950 0x7f66a01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 -- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a006c950 msgr2=0x7f66a01593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a006c950 0x7f66a01593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 -- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66a00d4b30 msgr2=0x7f66a00b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66a00d4b30 0x7f66a00b8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.934+0000 7f669f400640 1 -- 172.21.15.7:0/2625325130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a00cb690 con 0x7f66a0161ba0 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.935+0000 7f669f400640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0161ba0 0x7f66a00b52c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6698009f40 tx=0x7f6698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.935+0000 7f6696a00640 1 -- 172.21.15.7:0/2625325130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698041020 con 0x7f66a0161ba0 2024-08-19T00:38:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.935+0000 7f6696a00640 1 -- 172.21.15.7:0/2625325130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66980077a0 con 0x7f66a0161ba0 2024-08-19T00:38:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.935+0000 7f6696a00640 1 -- 172.21.15.7:0/2625325130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698036040 con 0x7f66a0161ba0 2024-08-19T00:38:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.935+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a00cb970 con 0x7f66a0161ba0 2024-08-19T00:38:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.935+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a00cbf30 con 0x7f66a0161ba0 2024-08-19T00:38:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.936+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a00d2490 con 0x7f66a0161ba0 2024-08-19T00:38:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.937+0000 7f6696a00640 1 -- 172.21.15.7:0/2625325130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6698044020 con 0x7f66a0161ba0 2024-08-19T00:38:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.938+0000 7f6696a00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f668006be30 0x7f668006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.938+0000 7f6696a00640 1 -- 172.21.15.7:0/2625325130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f66980abd90 con 0x7f66a0161ba0 2024-08-19T00:38:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.938+0000 7f669ea00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f668006be30 0x7f668006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.939+0000 7f669ea00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f668006be30 0x7f668006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6690009a30 tx=0x7f6690008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:55.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:55.943+0000 7f6696a00640 1 -- 172.21.15.7:0/2625325130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f669804b020 con 0x7f66a0161ba0 2024-08-19T00:38:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.129+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66a00b66c0 con 0x7f66a0161ba0 2024-08-19T00:38:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.130+0000 7f6696a00640 1 -- 172.21.15.7:0/2625325130 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16586 (secure 0 0 0) 0x7f669807a7c0 con 0x7f66a0161ba0 2024-08-19T00:38:56.133 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:56.133 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:38:54.760863+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:38:52.558342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-08-19T00:38:53.760748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f668006be30 msgr2=0x7f668006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f668006be30 0x7f668006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6690009a30 tx=0x7f6690008040 comp rx=0 tx=0).stop 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0161ba0 msgr2=0x7f66a00b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0161ba0 0x7f66a00b52c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6698009f40 tx=0x7f6698004a40 comp rx=0 tx=0).stop 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 shutdown_connections 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f668006be30 0x7f668006e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0161ba0 0x7f66a00b52c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66a00d4b30 0x7f66a00b8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:56.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 --2- 172.21.15.7:0/2625325130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66a006c950 0x7f66a01593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:56.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 >> 172.21.15.7:0/2625325130 conn(0x7f66a008c000 msgr2=0x7f66a00b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:56.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 shutdown_connections 2024-08-19T00:38:56.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.132+0000 7f66a5c00640 1 -- 172.21.15.7:0/2625325130 wait complete. 2024-08-19T00:38:56.150 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:38:56.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.307+0000 7f66cc200640 1 Processor -- start 2024-08-19T00:38:56.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.308+0000 7f66cc200640 1 -- start start 2024-08-19T00:38:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.309+0000 7f66cc200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f66c40b5130 0x7f66c40aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.309+0000 7f66cc200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c40acef0 con 0x7f66c415bfb0 2024-08-19T00:38:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.309+0000 7f66cc200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c40ad1d0 con 0x7f66c415c390 2024-08-19T00:38:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.309+0000 7f66cc200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f66c40ad790 con 0x7f66c40b5130 2024-08-19T00:38:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.309+0000 7f66c9800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f66c415bfb0 0x7f66c40b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58940/0 (socket says 172.21.15.7:58940) 2024-08-19T00:38:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.309+0000 7f66c9800640 1 -- 172.21.15.7:0/2067906961 learned_addr learned my addr 172.21.15.7:0/2067906961 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.309+0000 7f66c8e00640 1 --2- 172.21.15.7:0/2067906961 >> v2:172.21.15.162:3300/0 conn(0x7f66c40b5130 0x7f66c40aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.310+0000 7f66c8e00640 1 -- 172.21.15.7:0/2067906961 >> v1:172.21.15.162:6789/0 conn(0x7f66c415c390 legacy=0x7f66c4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.310+0000 7f66c8e00640 1 -- 172.21.15.7:0/2067906961 >> v1:172.21.15.7:6789/0 conn(0x7f66c415bfb0 legacy=0x7f66c40b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.310+0000 7f66c8e00640 1 -- 172.21.15.7:0/2067906961 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c40ad4b0 con 0x7f66c40b5130 2024-08-19T00:38:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.310+0000 7f66c3e00640 1 -- 172.21.15.7:0/2067906961 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038602971 0 0) 0x7f66c40acef0 con 0x7f66c415bfb0 2024-08-19T00:38:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.311+0000 7f66c8e00640 1 --2- 172.21.15.7:0/2067906961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c40b5130 0x7f66c40aebd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66b00097a0 tx=0x7f66b002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c711901387e74c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.311+0000 7f66c3e00640 1 -- 172.21.15.7:0/2067906961 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0037070 con 0x7f66c40b5130 2024-08-19T00:38:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.311+0000 7f66c3e00640 1 -- 172.21.15.7:0/2067906961 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b0032440 con 0x7f66c40b5130 2024-08-19T00:38:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.311+0000 7f66c3e00640 1 -- 172.21.15.7:0/2067906961 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0032810 con 0x7f66c40b5130 2024-08-19T00:38:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.312+0000 7f66cc200640 1 -- 172.21.15.7:0/2067906961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c40b5130 msgr2=0x7f66c40aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.312+0000 7f66cc200640 1 --2- 172.21.15.7:0/2067906961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c40b5130 0x7f66c40aebd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66b00097a0 tx=0x7f66b002a230 comp rx=0 tx=0).stop 2024-08-19T00:38:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.312+0000 7f66cc200640 1 -- 172.21.15.7:0/2067906961 shutdown_connections 2024-08-19T00:38:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.312+0000 7f66cc200640 1 --2- 172.21.15.7:0/2067906961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c40b5130 0x7f66c40aebd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.312+0000 7f66cc200640 1 -- 172.21.15.7:0/2067906961 >> 172.21.15.7:0/2067906961 conn(0x7f66c40b2300 msgr2=0x7f66c406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.312+0000 7f66cc200640 1 -- 172.21.15.7:0/2067906961 shutdown_connections 2024-08-19T00:38:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.312+0000 7f66cc200640 1 -- 172.21.15.7:0/2067906961 wait complete. 2024-08-19T00:38:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.314+0000 7f66cc200640 1 Processor -- start 2024-08-19T00:38:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.314+0000 7f66cc200640 1 -- start start 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66cc200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c40b5130 0x7f66c4149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66cc200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66c415bfb0 0x7f66c409bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66cc200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c415c390 0x7f66c4159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66cc200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66c40af290 con 0x7f66c415bfb0 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66cc200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66c40af110 con 0x7f66c415c390 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66cc200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66c40af410 con 0x7f66c40b5130 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66c415bfb0 0x7f66c409bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66c415bfb0 0x7f66c409bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60478/0 (socket says 172.21.15.7:60478) 2024-08-19T00:38:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 -- 172.21.15.7:0/481247800 learned_addr learned my addr 172.21.15.7:0/481247800 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c9800640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c40b5130 0x7f66c4149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66ca200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c415c390 0x7f66c4159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 -- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c40b5130 msgr2=0x7f66c4149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c40b5130 0x7f66c4149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 -- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c415c390 msgr2=0x7f66c4159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c415c390 0x7f66c4159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66c8e00640 1 -- 172.21.15.7:0/481247800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c409af00 con 0x7f66c415bfb0 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.315+0000 7f66ca200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c415c390 0x7f66c4159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.316+0000 7f66c8e00640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66c415bfb0 0x7f66c409bfa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f66b00098c0 tx=0x7f66b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.316+0000 7f66c1600640 1 -- 172.21.15.7:0/481247800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0037040 con 0x7f66c415bfb0 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.316+0000 7f66c1600640 1 -- 172.21.15.7:0/481247800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b0042070 con 0x7f66c415bfb0 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.316+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c409b1e0 con 0x7f66c415bfb0 2024-08-19T00:38:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.316+0000 7f66c1600640 1 -- 172.21.15.7:0/481247800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0030a70 con 0x7f66c415bfb0 2024-08-19T00:38:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.316+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c409b7a0 con 0x7f66c415bfb0 2024-08-19T00:38:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.317+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c40aebd0 con 0x7f66c415bfb0 2024-08-19T00:38:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.318+0000 7f66c1600640 1 -- 172.21.15.7:0/481247800 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66b0030c10 con 0x7f66c415bfb0 2024-08-19T00:38:56.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.320+0000 7f66c1600640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66a406be30 0x7f66a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:56.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.320+0000 7f66c1600640 1 -- 172.21.15.7:0/481247800 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f66b00ab9e0 con 0x7f66c415bfb0 2024-08-19T00:38:56.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.320+0000 7f66c9800640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66a406be30 0x7f66a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:56.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.320+0000 7f66c9800640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66a406be30 0x7f66a406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66b8000f60 tx=0x7f66b8007b90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.324+0000 7f66c1600640 1 -- 172.21.15.7:0/481247800 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f66b0045360 con 0x7f66c415bfb0 2024-08-19T00:38:56.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:56.547+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f66c40cc390 con 0x7f66c415bfb0 2024-08-19T00:38:57.321 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:38:57.320+0000 7face3c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:38:57.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.370+0000 7f66c1600640 1 -- 172.21.15.7:0/481247800 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f66b007a260 con 0x7f66c415bfb0 2024-08-19T00:38:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66a406be30 msgr2=0x7f66a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66a406be30 0x7f66a406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66b8000f60 tx=0x7f66b8007b90 comp rx=0 tx=0).stop 2024-08-19T00:38:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66c415bfb0 msgr2=0x7f66c409bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66c415bfb0 0x7f66c409bfa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f66b00098c0 tx=0x7f66b00046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 shutdown_connections 2024-08-19T00:38:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66a406be30 0x7f66a406e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c415c390 0x7f66c4159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66c415bfb0 0x7f66c409bfa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 --2- 172.21.15.7:0/481247800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c40b5130 0x7f66c4149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 >> 172.21.15.7:0/481247800 conn(0x7f66c40b2300 msgr2=0x7f66c40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 shutdown_connections 2024-08-19T00:38:57.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.373+0000 7f66cc200640 1 -- 172.21.15.7:0/481247800 wait complete. 2024-08-19T00:38:57.394 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-19T00:38:57.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-19T00:38:57.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.557+0000 7fc16b400640 1 Processor -- start 2024-08-19T00:38:57.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.558+0000 7fc16b400640 1 -- start start 2024-08-19T00:38:57.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc16b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc16415bfb0 0x7fc1640b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc16b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1640b5130 0x7fc1640aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc16b400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1640acef0 con 0x7fc16415c390 2024-08-19T00:38:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc16b400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc1640ad790 con 0x7fc1640b5130 2024-08-19T00:38:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc16b400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc1640ad1d0 con 0x7fc16415bfb0 2024-08-19T00:38:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc163e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1640b5130 0x7fc1640aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc169400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc16415c390 0x7fc16415fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58946/0 (socket says 172.21.15.7:58946) 2024-08-19T00:38:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc169400640 1 -- 172.21.15.7:0/2147992760 learned_addr learned my addr 172.21.15.7:0/2147992760 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:57.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc168a00640 1 --2- 172.21.15.7:0/2147992760 >> v2:172.21.15.162:3300/0 conn(0x7fc16415bfb0 0x7fc1640b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:57.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc163e00640 1 -- 172.21.15.7:0/2147992760 >> v2:172.21.15.162:3300/0 conn(0x7fc16415bfb0 msgr2=0x7fc1640b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc163e00640 1 --2- 172.21.15.7:0/2147992760 >> v2:172.21.15.162:3300/0 conn(0x7fc16415bfb0 0x7fc1640b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc163e00640 1 -- 172.21.15.7:0/2147992760 >> v1:172.21.15.7:6789/0 conn(0x7fc16415c390 legacy=0x7fc16415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.560+0000 7fc163e00640 1 -- 172.21.15.7:0/2147992760 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1640ad4b0 con 0x7fc1640b5130 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.559+0000 7fc163400640 1 -- 172.21.15.7:0/2147992760 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143102662 0 0) 0x7fc1640acef0 con 0x7fc16415c390 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc163e00640 1 --2- 172.21.15.7:0/2147992760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1640b5130 0x7fc1640aebd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc1640b2ca0 tx=0x7fc15002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef66a4a8ba082b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc163400640 1 -- 172.21.15.7:0/2147992760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150037070 con 0x7fc1640b5130 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc163400640 1 -- 172.21.15.7:0/2147992760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150032440 con 0x7fc1640b5130 2024-08-19T00:38:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc163400640 1 -- 172.21.15.7:0/2147992760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150032810 con 0x7fc1640b5130 2024-08-19T00:38:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc16b400640 1 -- 172.21.15.7:0/2147992760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1640b5130 msgr2=0x7fc1640aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc16b400640 1 --2- 172.21.15.7:0/2147992760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1640b5130 0x7fc1640aebd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc1640b2ca0 tx=0x7fc15002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc16b400640 1 -- 172.21.15.7:0/2147992760 shutdown_connections 2024-08-19T00:38:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc16b400640 1 --2- 172.21.15.7:0/2147992760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1640b5130 0x7fc1640aebd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc16b400640 1 --2- 172.21.15.7:0/2147992760 >> v2:172.21.15.162:3300/0 conn(0x7fc16415bfb0 0x7fc1640b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.561+0000 7fc16b400640 1 -- 172.21.15.7:0/2147992760 >> 172.21.15.7:0/2147992760 conn(0x7fc1640b2300 msgr2=0x7fc16406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.562+0000 7fc16b400640 1 -- 172.21.15.7:0/2147992760 shutdown_connections 2024-08-19T00:38:57.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.562+0000 7fc16b400640 1 -- 172.21.15.7:0/2147992760 wait complete. 2024-08-19T00:38:57.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.563+0000 7fc16b400640 1 Processor -- start 2024-08-19T00:38:57.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.563+0000 7fc16b400640 1 -- start start 2024-08-19T00:38:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc16b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1640b5130 0x7fc16415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc16b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc16415bfb0 0x7fc1640c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc16b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc16415c390 0x7fc16414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc16b400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1640b44c0 con 0x7fc16415bfb0 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc16b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1640b4340 con 0x7fc1640b5130 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc16b400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc164073050 con 0x7fc16415c390 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc163e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc16415bfb0 0x7fc1640c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc163e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc16415bfb0 0x7fc1640c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60500/0 (socket says 172.21.15.7:60500) 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.564+0000 7fc163e00640 1 -- 172.21.15.7:0/339987145 learned_addr learned my addr 172.21.15.7:0/339987145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc168a00640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1640b5130 0x7fc16415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc169400640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc16415c390 0x7fc16414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc163e00640 1 -- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc16415c390 msgr2=0x7fc16414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc163e00640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc16415c390 0x7fc16414a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc163e00640 1 -- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1640b5130 msgr2=0x7fc16415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc163e00640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1640b5130 0x7fc16415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc163e00640 1 -- 172.21.15.7:0/339987145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1641486a0 con 0x7fc16415bfb0 2024-08-19T00:38:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc163e00640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc16415bfb0 0x7fc1640c4e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc150009890 tx=0x7fc1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc160c00640 1 -- 172.21.15.7:0/339987145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150037040 con 0x7fc16415bfb0 2024-08-19T00:38:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc160c00640 1 -- 172.21.15.7:0/339987145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150042070 con 0x7fc16415bfb0 2024-08-19T00:38:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc160c00640 1 -- 172.21.15.7:0/339987145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150030bd0 con 0x7fc16415bfb0 2024-08-19T00:38:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.565+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16415e920 con 0x7fc16415bfb0 2024-08-19T00:38:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.566+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16415eee0 con 0x7fc16415bfb0 2024-08-19T00:38:57.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.567+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc164072a60 con 0x7fc16415bfb0 2024-08-19T00:38:57.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.568+0000 7fc160c00640 1 -- 172.21.15.7:0/339987145 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc150047460 con 0x7fc16415bfb0 2024-08-19T00:38:57.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.568+0000 7fc160c00640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc14406be30 0x7fc14406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:57.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.569+0000 7fc160c00640 1 -- 172.21.15.7:0/339987145 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fc1500abad0 con 0x7fc16415bfb0 2024-08-19T00:38:57.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.569+0000 7fc168a00640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc14406be30 0x7fc14406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:57.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.569+0000 7fc168a00640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc14406be30 0x7fc14406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc158006fd0 tx=0x7fc158008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:57.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.573+0000 7fc160c00640 1 -- 172.21.15.7:0/339987145 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc150032e20 con 0x7fc16415bfb0 2024-08-19T00:38:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:57.792+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc1640b3e00 con 0x7fc16415bfb0 2024-08-19T00:38:58.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.372+0000 7fc160c00640 1 -- 172.21.15.7:0/339987145 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fc15007a3e0 con 0x7fc16415bfb0 2024-08-19T00:38:58.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.374+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc14406be30 msgr2=0x7fc14406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.374+0000 7fc16b400640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc14406be30 0x7fc14406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc158006fd0 tx=0x7fc158008040 comp rx=0 tx=0).stop 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.374+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc16415bfb0 msgr2=0x7fc1640c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.374+0000 7fc16b400640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc16415bfb0 0x7fc1640c4e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc150009890 tx=0x7fc1500046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 shutdown_connections 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc14406be30 0x7fc14406e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc16415c390 0x7fc16414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc16415bfb0 0x7fc1640c4e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 --2- 172.21.15.7:0/339987145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1640b5130 0x7fc16415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 >> 172.21.15.7:0/339987145 conn(0x7fc1640b2300 msgr2=0x7fc164071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 shutdown_connections 2024-08-19T00:38:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.375+0000 7fc16b400640 1 -- 172.21.15.7:0/339987145 wait complete. 2024-08-19T00:38:58.393 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-19T00:38:58.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:38:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.550+0000 7f3f30a00640 1 Processor -- start 2024-08-19T00:38:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.550+0000 7f3f30a00640 1 -- start start 2024-08-19T00:38:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.551+0000 7f3f30a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f2c15f5b0 0x7f3f2c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.551+0000 7f3f30a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0b4a90 0x7f3f2c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f30a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c0cfaf0 con 0x7f3f2c0d03c0 2024-08-19T00:38:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f30a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2c0d0d60 con 0x7f3f2c15f5b0 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f30a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2c15f990 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f29e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f2c15f5b0 0x7f3f2c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f23e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3f2c0d03c0 0x7f3f2c0b4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58954/0 (socket says 172.21.15.7:58954) 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f23e00640 1 -- 172.21.15.7:0/3017135080 learned_addr learned my addr 172.21.15.7:0/3017135080 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f29e00640 1 --2- 172.21.15.7:0/3017135080 >> v2:172.21.15.7:3300/0 conn(0x7f3f2c15f5b0 0x7f3f2c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60510/0 (socket says 172.21.15.7:60510) 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f2a800640 1 --2- 172.21.15.7:0/3017135080 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0b4a90 0x7f3f2c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f29e00640 1 -- 172.21.15.7:0/3017135080 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0b4a90 msgr2=0x7f3f2c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f29e00640 1 --2- 172.21.15.7:0/3017135080 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0b4a90 0x7f3f2c0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f29e00640 1 -- 172.21.15.7:0/3017135080 >> v1:172.21.15.7:6789/0 conn(0x7f3f2c0d03c0 legacy=0x7f3f2c0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f29e00640 1 -- 172.21.15.7:0/3017135080 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c0b50b0 con 0x7f3f2c15f5b0 2024-08-19T00:38:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f29400640 1 -- 172.21.15.7:0/3017135080 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346635145 0 0) 0x7f3f2c0cfaf0 con 0x7f3f2c0d03c0 2024-08-19T00:38:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.552+0000 7f3f2a800640 1 --2- 172.21.15.7:0/3017135080 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0b4a90 0x7f3f2c0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.553+0000 7f3f29e00640 1 --2- 172.21.15.7:0/3017135080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c15f5b0 0x7f3f2c0cf5b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c06f9f0 tx=0x7f3f1c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ffa7a422b2bf0b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f29400640 1 -- 172.21.15.7:0/3017135080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c037070 con 0x7f3f2c15f5b0 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f29400640 1 -- 172.21.15.7:0/3017135080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c02ae50 con 0x7f3f2c15f5b0 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f29400640 1 -- 172.21.15.7:0/3017135080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c032660 con 0x7f3f2c15f5b0 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 -- 172.21.15.7:0/3017135080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c15f5b0 msgr2=0x7f3f2c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 --2- 172.21.15.7:0/3017135080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c15f5b0 0x7f3f2c0cf5b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c06f9f0 tx=0x7f3f1c02a140 comp rx=0 tx=0).stop 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 -- 172.21.15.7:0/3017135080 shutdown_connections 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 --2- 172.21.15.7:0/3017135080 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0b4a90 0x7f3f2c0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 --2- 172.21.15.7:0/3017135080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c15f5b0 0x7f3f2c0cf5b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 -- 172.21.15.7:0/3017135080 >> 172.21.15.7:0/3017135080 conn(0x7f3f2c06bc70 msgr2=0x7f3f2c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 -- 172.21.15.7:0/3017135080 shutdown_connections 2024-08-19T00:38:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.554+0000 7f3f30a00640 1 -- 172.21.15.7:0/3017135080 wait complete. 2024-08-19T00:38:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.556+0000 7f3f30a00640 1 Processor -- start 2024-08-19T00:38:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.556+0000 7f3f30a00640 1 -- start start 2024-08-19T00:38:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f30a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c0b4a90 0x7f3f2c160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f30a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f2c0d03c0 0x7f3f2c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f30a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f2c15f5b0 0x7f3f2c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f30a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c0cedb0 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f30a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c0cf120 con 0x7f3f2c15f5b0 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f30a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3f2c06e660 con 0x7f3f2c0d03c0 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c0b4a90 0x7f3f2c160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c0b4a90 0x7f3f2c160ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60512/0 (socket says 172.21.15.7:60512) 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 -- 172.21.15.7:0/4021469067 learned_addr learned my addr 172.21.15.7:0/4021469067 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 -- 172.21.15.7:0/4021469067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f2c0d03c0 msgr2=0x7f3f2c156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f2c0d03c0 0x7f3f2c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 -- 172.21.15.7:0/4021469067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f2c15f5b0 msgr2=0x7f3f2c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f2c15f5b0 0x7f3f2c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.557+0000 7f3f29e00640 1 -- 172.21.15.7:0/4021469067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c155550 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.558+0000 7f3f29e00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c0b4a90 0x7f3f2c160ba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c035040 tx=0x7f3f1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.558+0000 7f3f22000640 1 -- 172.21.15.7:0/4021469067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c041070 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.558+0000 7f3f22000640 1 -- 172.21.15.7:0/4021469067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c03c670 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.558+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2c155830 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.558+0000 7f3f22000640 1 -- 172.21.15.7:0/4021469067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c037040 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.558+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2c156e00 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.559+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2c155c20 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.560+0000 7f3f22000640 1 -- 172.21.15.7:0/4021469067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f1c03a070 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.561+0000 7f3f22000640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f0806be30 0x7f3f0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.561+0000 7f3f22000640 1 -- 172.21.15.7:0/4021469067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3f1c0ab250 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.561+0000 7f3f23e00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f0806be30 0x7f3f0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.562+0000 7f3f23e00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f0806be30 0x7f3f0806e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3f14007fd0 tx=0x7f3f14007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.566+0000 7f3f22000640 1 -- 172.21.15.7:0/4021469067 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3f1c079c80 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.792+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f2c155a00 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.793+0000 7f3f22000640 1 -- 172.21.15.7:0/4021469067 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5217 (secure 0 0 0) 0x7f3f1c079580 con 0x7f3f2c0b4a90 2024-08-19T00:38:58.795 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:58.795 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"btime":"2024-08-19T00:38:58:370924+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:38:57.793158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5319":{"gid":5319,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/484605249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":484605249},{"type":"v1","addr":"172.21.15.7:6837","nonce":484605249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5319,"qdb_cluster":[5319]},"id":3}]} 2024-08-19T00:38:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-08-19T00:38:58.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f0806be30 msgr2=0x7f3f0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f0806be30 0x7f3f0806e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3f14007fd0 tx=0x7f3f14007920 comp rx=0 tx=0).stop 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c0b4a90 msgr2=0x7f3f2c160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c0b4a90 0x7f3f2c160ba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c035040 tx=0x7f3f1c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 shutdown_connections 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f0806be30 0x7f3f0806e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f2c15f5b0 0x7f3f2c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f2c0d03c0 0x7f3f2c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 --2- 172.21.15.7:0/4021469067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f2c0b4a90 0x7f3f2c160ba0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.795+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 >> 172.21.15.7:0/4021469067 conn(0x7f3f2c06bc70 msgr2=0x7f3f2c157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.796+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 shutdown_connections 2024-08-19T00:38:58.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.796+0000 7f3f30a00640 1 -- 172.21.15.7:0/4021469067 wait complete. 2024-08-19T00:38:58.814 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:38:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.968+0000 7fa08f200640 1 Processor -- start 2024-08-19T00:38:58.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.968+0000 7fa08f200640 1 -- start start 2024-08-19T00:38:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa09015e360 0x7fa09015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa09015ee50 0x7fa0900d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0900b3ab0 con 0x7fa0900d2af0 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa09015f460 con 0x7fa09015ee50 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa09015f740 con 0x7fa09015e360 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa09015ee50 0x7fa0900d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa09015ee50 0x7fa0900d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60518/0 (socket says 172.21.15.7:60518) 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08e800640 1 -- 172.21.15.7:0/1052290120 learned_addr learned my addr 172.21.15.7:0/1052290120 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.969+0000 7fa08d400640 1 --1- 172.21.15.7:0/1052290120 >> v1:172.21.15.7:6789/0 conn(0x7fa0900d2af0 0x7fa09015e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58964/0 (socket says 172.21.15.7:58964) 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.970+0000 7fa08de00640 1 --2- 172.21.15.7:0/1052290120 >> v2:172.21.15.162:3300/0 conn(0x7fa09015e360 0x7fa09015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.970+0000 7fa08e800640 1 -- 172.21.15.7:0/1052290120 >> v2:172.21.15.162:3300/0 conn(0x7fa09015e360 msgr2=0x7fa09015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.970+0000 7fa08e800640 1 --2- 172.21.15.7:0/1052290120 >> v2:172.21.15.162:3300/0 conn(0x7fa09015e360 0x7fa09015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.970+0000 7fa08e800640 1 -- 172.21.15.7:0/1052290120 >> v1:172.21.15.7:6789/0 conn(0x7fa0900d2af0 legacy=0x7fa09015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.970+0000 7fa08e800640 1 -- 172.21.15.7:0/1052290120 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0900b3d60 con 0x7fa09015ee50 2024-08-19T00:38:58.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.970+0000 7fa08de00640 1 --2- 172.21.15.7:0/1052290120 >> v2:172.21.15.162:3300/0 conn(0x7fa09015e360 0x7fa09015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:38:58.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.971+0000 7fa08e800640 1 --2- 172.21.15.7:0/1052290120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa09015ee50 0x7fa0900d2f80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa09008e8a0 tx=0x7fa08802a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff5a6d271615960 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:58.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.971+0000 7fa08ca00640 1 -- 172.21.15.7:0/1052290120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088036070 con 0x7fa09015ee50 2024-08-19T00:38:58.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.971+0000 7fa08ca00640 1 -- 172.21.15.7:0/1052290120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa088031600 con 0x7fa09015ee50 2024-08-19T00:38:58.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.971+0000 7fa08ca00640 1 -- 172.21.15.7:0/1052290120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0880319d0 con 0x7fa09015ee50 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 -- 172.21.15.7:0/1052290120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa09015ee50 msgr2=0x7fa0900d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 --2- 172.21.15.7:0/1052290120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa09015ee50 0x7fa0900d2f80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa09008e8a0 tx=0x7fa08802a740 comp rx=0 tx=0).stop 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 -- 172.21.15.7:0/1052290120 shutdown_connections 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 --2- 172.21.15.7:0/1052290120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa09015ee50 0x7fa0900d2f80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 --2- 172.21.15.7:0/1052290120 >> v2:172.21.15.162:3300/0 conn(0x7fa09015e360 0x7fa09015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 -- 172.21.15.7:0/1052290120 >> 172.21.15.7:0/1052290120 conn(0x7fa09008dbf0 msgr2=0x7fa09009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 -- 172.21.15.7:0/1052290120 shutdown_connections 2024-08-19T00:38:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.972+0000 7fa08f200640 1 -- 172.21.15.7:0/1052290120 wait complete. 2024-08-19T00:38:58.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.973+0000 7fa08f200640 1 Processor -- start 2024-08-19T00:38:58.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.974+0000 7fa08f200640 1 -- start start 2024-08-19T00:38:58.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.974+0000 7fa08f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0900d2af0 0x7fa090153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09015e360 0x7fa0900cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa09015ee50 0x7fa0900c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0900b4560 con 0x7fa0900d2af0 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0900d2300 con 0x7fa09015e360 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0900b46e0 con 0x7fa09015ee50 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0900d2af0 0x7fa090153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0900d2af0 0x7fa090153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60528/0 (socket says 172.21.15.7:60528) 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 -- 172.21.15.7:0/1929372783 learned_addr learned my addr 172.21.15.7:0/1929372783 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08d400640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09015e360 0x7fa0900cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08e800640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa09015ee50 0x7fa0900c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 -- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa09015ee50 msgr2=0x7fa0900c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa09015ee50 0x7fa0900c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 -- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09015e360 msgr2=0x7fa0900cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09015e360 0x7fa0900cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.975+0000 7fa08de00640 1 -- 172.21.15.7:0/1929372783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0900c8a00 con 0x7fa0900d2af0 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.976+0000 7fa08de00640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0900d2af0 0x7fa090153600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa08000e7e0 tx=0x7fa08000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.976+0000 7fa086000640 1 -- 172.21.15.7:0/1929372783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08000f040 con 0x7fa0900d2af0 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.976+0000 7fa086000640 1 -- 172.21.15.7:0/1929372783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa080004030 con 0x7fa0900d2af0 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.976+0000 7fa086000640 1 -- 172.21.15.7:0/1929372783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0800043e0 con 0x7fa0900d2af0 2024-08-19T00:38:58.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.976+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0900c8ce0 con 0x7fa0900d2af0 2024-08-19T00:38:58.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.976+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0900cb350 con 0x7fa0900d2af0 2024-08-19T00:38:58.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.977+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09015fab0 con 0x7fa0900d2af0 2024-08-19T00:38:58.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.978+0000 7fa086000640 1 -- 172.21.15.7:0/1929372783 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa08000c6d0 con 0x7fa0900d2af0 2024-08-19T00:38:58.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.979+0000 7fa086000640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa07006be60 0x7fa07006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:58.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.979+0000 7fa086000640 1 -- 172.21.15.7:0/1929372783 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa08008aea0 con 0x7fa0900d2af0 2024-08-19T00:38:58.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.979+0000 7fa08d400640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa07006be60 0x7fa07006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:58.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.980+0000 7fa08d400640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa07006be60 0x7fa07006e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa09006e540 tx=0x7fa07c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:58.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:58.983+0000 7fa086000640 1 -- 172.21.15.7:0/1929372783 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa080017020 con 0x7fa0900d2af0 2024-08-19T00:38:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.167+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0900d50d0 con 0x7fa0900d2af0 2024-08-19T00:38:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.168+0000 7fa086000640 1 -- 172.21.15.7:0/1929372783 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16573 (secure 0 0 0) 0x7fa080059290 con 0x7fa0900d2af0 2024-08-19T00:38:59.170 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:59.170 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:38:56.342735+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:38:52.558342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-08-19T00:38:53.760748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:38:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.170+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa07006be60 msgr2=0x7fa07006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.170+0000 7fa08f200640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa07006be60 0x7fa07006e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa09006e540 tx=0x7fa07c007e80 comp rx=0 tx=0).stop 2024-08-19T00:38:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0900d2af0 msgr2=0x7fa090153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0900d2af0 0x7fa090153600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa08000e7e0 tx=0x7fa08000eca0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 shutdown_connections 2024-08-19T00:38:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa07006be60 0x7fa07006e320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa09015ee50 0x7fa0900c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09015e360 0x7fa0900cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 --2- 172.21.15.7:0/1929372783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0900d2af0 0x7fa090153600 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 >> 172.21.15.7:0/1929372783 conn(0x7fa09008dbf0 msgr2=0x7fa090074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 shutdown_connections 2024-08-19T00:38:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.171+0000 7fa08f200640 1 -- 172.21.15.7:0/1929372783 wait complete. 2024-08-19T00:38:59.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:38:59.189 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:38:59.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.345+0000 7f0bb2800640 1 Processor -- start 2024-08-19T00:38:59.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.345+0000 7f0bb2800640 1 -- start start 2024-08-19T00:38:59.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bac161960 0x7f0bac0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb2800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac0cf2b0 0x7f0bac0cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb2800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bac0d28c0 con 0x7f0bac0d0910 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb2800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0bac0b7150 con 0x7f0bac161960 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb2800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac0d2ba0 con 0x7f0bac0cf2b0 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb1400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bac161960 0x7f0bac0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb1400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bac161960 0x7f0bac0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60530/0 (socket says 172.21.15.7:60530) 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.346+0000 7f0bb1400640 1 -- 172.21.15.7:0/4232165071 learned_addr learned my addr 172.21.15.7:0/4232165071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.347+0000 7f0bb0a00640 1 --2- 172.21.15.7:0/4232165071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac0cf2b0 0x7f0bac0cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.347+0000 7f0bb1400640 1 -- 172.21.15.7:0/4232165071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac0cf2b0 msgr2=0x7f0bac0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.347+0000 7f0bb1400640 1 --2- 172.21.15.7:0/4232165071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac0cf2b0 0x7f0bac0cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.347+0000 7f0bb1400640 1 -- 172.21.15.7:0/4232165071 >> v1:172.21.15.162:6789/0 conn(0x7f0bac0d0910 legacy=0x7f0bac0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.347+0000 7f0bb1400640 1 -- 172.21.15.7:0/4232165071 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac0d2e80 con 0x7f0bac161960 2024-08-19T00:38:59.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.348+0000 7f0bb1400640 1 --2- 172.21.15.7:0/4232165071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac161960 0x7f0bac0ced70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009870 tx=0x7f0ba002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07d8e85643c9761 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:59.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.348+0000 7f0babe00640 1 -- 172.21.15.7:0/4232165071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0037070 con 0x7f0bac161960 2024-08-19T00:38:59.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.348+0000 7f0babe00640 1 -- 172.21.15.7:0/4232165071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba002ae50 con 0x7f0bac161960 2024-08-19T00:38:59.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.348+0000 7f0babe00640 1 -- 172.21.15.7:0/4232165071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0032860 con 0x7f0bac161960 2024-08-19T00:38:59.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 -- 172.21.15.7:0/4232165071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac161960 msgr2=0x7f0bac0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 --2- 172.21.15.7:0/4232165071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac161960 0x7f0bac0ced70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009870 tx=0x7f0ba002a300 comp rx=0 tx=0).stop 2024-08-19T00:38:59.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 -- 172.21.15.7:0/4232165071 shutdown_connections 2024-08-19T00:38:59.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 --2- 172.21.15.7:0/4232165071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac0cf2b0 0x7f0bac0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 --2- 172.21.15.7:0/4232165071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac161960 0x7f0bac0ced70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 -- 172.21.15.7:0/4232165071 >> 172.21.15.7:0/4232165071 conn(0x7f0bac09d500 msgr2=0x7f0bac0d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:59.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 -- 172.21.15.7:0/4232165071 shutdown_connections 2024-08-19T00:38:59.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.349+0000 7f0bb2800640 1 -- 172.21.15.7:0/4232165071 wait complete. 2024-08-19T00:38:59.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.351+0000 7f0bb2800640 1 Processor -- start 2024-08-19T00:38:59.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.351+0000 7f0bb2800640 1 -- start start 2024-08-19T00:38:59.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bac0cf2b0 0x7f0bac15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac0d0910 0x7f0bac15d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb2800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac161960 0x7f0bac15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb2800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac0d4cb0 con 0x7f0bac0d0910 2024-08-19T00:38:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb2800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac0d3160 con 0x7f0bac0cf2b0 2024-08-19T00:38:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb2800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac0d4e30 con 0x7f0bac161960 2024-08-19T00:38:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac0d0910 0x7f0bac15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac0d0910 0x7f0bac15d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60538/0 (socket says 172.21.15.7:60538) 2024-08-19T00:38:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 -- 172.21.15.7:0/1341471213 learned_addr learned my addr 172.21.15.7:0/1341471213 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb1e00640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac161960 0x7f0bac15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb1400640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bac0cf2b0 0x7f0bac15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 -- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac161960 msgr2=0x7f0bac15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac161960 0x7f0bac15d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 -- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bac0cf2b0 msgr2=0x7f0bac15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bac0cf2b0 0x7f0bac15b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb0a00640 1 -- 172.21.15.7:0/1341471213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac15bc00 con 0x7f0bac0d0910 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb1e00640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac161960 0x7f0bac15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.352+0000 7f0bb1400640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bac0cf2b0 0x7f0bac15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.353+0000 7f0bb0a00640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac0d0910 0x7f0bac15d030 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800d7d0 tx=0x7f0b9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.353+0000 7f0ba9600640 1 -- 172.21.15.7:0/1341471213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98004020 con 0x7f0bac0d0910 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.353+0000 7f0ba9600640 1 -- 172.21.15.7:0/1341471213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b980041e0 con 0x7f0bac0d0910 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.353+0000 7f0ba9600640 1 -- 172.21.15.7:0/1341471213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b980043d0 con 0x7f0bac0d0910 2024-08-19T00:38:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.353+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac15bee0 con 0x7f0bac0d0910 2024-08-19T00:38:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.353+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac15c4a0 con 0x7f0bac0d0910 2024-08-19T00:38:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.354+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bac161d40 con 0x7f0bac0d0910 2024-08-19T00:38:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.355+0000 7f0ba9600640 1 -- 172.21.15.7:0/1341471213 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b9801b020 con 0x7f0bac0d0910 2024-08-19T00:38:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.356+0000 7f0ba9600640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b8c06be60 0x7f0b8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.356+0000 7f0ba9600640 1 -- 172.21.15.7:0/1341471213 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f0b9808aca0 con 0x7f0bac0d0910 2024-08-19T00:38:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.356+0000 7f0bb1400640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b8c06be60 0x7f0b8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.357+0000 7f0bb1400640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b8c06be60 0x7f0b8c06e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0034000 tx=0x7f0ba002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.360+0000 7f0ba9600640 1 -- 172.21.15.7:0/1341471213 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0b980595b0 con 0x7f0bac0d0910 2024-08-19T00:38:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.541+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0bac06d290 con 0x7f0b8c06be60 2024-08-19T00:38:59.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.549+0000 7f0ba9600640 1 -- 172.21.15.7:0/1341471213 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7f0bac06d290 con 0x7f0b8c06be60 2024-08-19T00:38:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:59.554 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b8c06be60 msgr2=0x7f0b8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b8c06be60 0x7f0b8c06e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0034000 tx=0x7f0ba002e000 comp rx=0 tx=0).stop 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac0d0910 msgr2=0x7f0bac15d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac0d0910 0x7f0bac15d030 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800d7d0 tx=0x7f0b9800dc90 comp rx=0 tx=0).stop 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 shutdown_connections 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0b8c06be60 0x7f0b8c06e320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bac161960 0x7f0bac15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bac0d0910 0x7f0bac15d030 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.552+0000 7f0bb2800640 1 --2- 172.21.15.7:0/1341471213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bac0cf2b0 0x7f0bac15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.553+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 >> 172.21.15.7:0/1341471213 conn(0x7f0bac09d500 msgr2=0x7f0bac0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:59.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.553+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 shutdown_connections 2024-08-19T00:38:59.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.553+0000 7f0bb2800640 1 -- 172.21.15.7:0/1341471213 wait complete. 2024-08-19T00:38:59.569 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-08-19T00:38:59.282309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237928,"kb_used_data":5096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736792,"statfs":{"total":773094113280,"available":772850475008,"internally_reserved":0,"allocated":5218304,"data_stored":2796240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.961367"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335384+0000","last_change":"2024-08-19T00:38:54.335384+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335384+0000","last_undegraded":"2024-08-19T00:38:54.335384+0000","last_fullsized":"2024-08-19T00:38:54.335384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328224+0000","last_change":"2024-08-19T00:38:54.328224+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328224+0000","last_undegraded":"2024-08-19T00:38:54.328224+0000","last_fullsized":"2024-08-19T00:38:54.328224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333407+0000","last_change":"2024-08-19T00:38:54.333407+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333407+0000","last_undegraded":"2024-08-19T00:38:54.333407+0000","last_fullsized":"2024-08-19T00:38:54.333407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335655+0000","last_change":"2024-08-19T00:38:54.335655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335655+0000","last_undegraded":"2024-08-19T00:38:54.335655+0000","last_fullsized":"2024-08-19T00:38:54.335655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335775+0000","last_change":"2024-08-19T00:38:54.335775+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335775+0000","last_undegraded":"2024-08-19T00:38:54.335775+0000","last_fullsized":"2024-08-19T00:38:54.335775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332729+0000","last_change":"2024-08-19T00:38:54.332729+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332729+0000","last_undegraded":"2024-08-19T00:38:54.332729+0000","last_fullsized":"2024-08-19T00:38:54.332729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.340397+0000","last_change":"2024-08-19T00:38:54.340397+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.340397+0000","last_undegraded":"2024-08-19T00:38:54.340397+0000","last_fullsized":"2024-08-19T00:38:54.340397+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334758+0000","last_change":"2024-08-19T00:38:54.334758+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334758+0000","last_undegraded":"2024-08-19T00:38:54.334758+0000","last_fullsized":"2024-08-19T00:38:54.334758+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334622+0000","last_change":"2024-08-19T00:38:54.334622+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334622+0000","last_undegraded":"2024-08-19T00:38:54.334622+0000","last_fullsized":"2024-08-19T00:38:54.334622+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332055+0000","last_change":"2024-08-19T00:38:54.332055+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332055+0000","last_undegraded":"2024-08-19T00:38:54.332055+0000","last_fullsized":"2024-08-19T00:38:54.332055+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338588+0000","last_change":"2024-08-19T00:38:54.338588+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338588+0000","last_undegraded":"2024-08-19T00:38:54.338588+0000","last_fullsized":"2024-08-19T00:38:54.338588+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.329187+0000","last_change":"2024-08-19T00:38:54.329187+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.329187+0000","last_undegraded":"2024-08-19T00:38:54.329187+0000","last_fullsized":"2024-08-19T00:38:54.329187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334469+0000","last_change":"2024-08-19T00:38:54.334469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334469+0000","last_undegraded":"2024-08-19T00:38:54.334469+0000","last_fullsized":"2024-08-19T00:38:54.334469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334235+0000","last_change":"2024-08-19T00:38:54.334235+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334235+0000","last_undegraded":"2024-08-19T00:38:54.334235+0000","last_fullsized":"2024-08-19T00:38:54.334235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334310+0000","last_change":"2024-08-19T00:38:54.334310+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334310+0000","last_undegraded":"2024-08-19T00:38:54.334310+0000","last_fullsized":"2024-08-19T00:38:54.334310+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333331+0000","last_change":"2024-08-19T00:38:54.333331+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333331+0000","last_undegraded":"2024-08-19T00:38:54.333331+0000","last_fullsized":"2024-08-19T00:38:54.333331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328641+0000","last_change":"2024-08-19T00:38:54.328641+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328641+0000","last_undegraded":"2024-08-19T00:38:54.328641+0000","last_fullsized":"2024-08-19T00:38:54.328641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335469+0000","last_change":"2024-08-19T00:38:54.335469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335469+0000","last_undegraded":"2024-08-19T00:38:54.335469+0000","last_fullsized":"2024-08-19T00:38:54.335469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.341032+0000","last_change":"2024-08-19T00:38:54.341032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.341032+0000","last_undegraded":"2024-08-19T00:38:54.341032+0000","last_fullsized":"2024-08-19T00:38:54.341032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333144+0000","last_change":"2024-08-19T00:38:54.333144+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333144+0000","last_undegraded":"2024-08-19T00:38:54.333144+0000","last_fullsized":"2024-08-19T00:38:54.333144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331994+0000","last_change":"2024-08-19T00:38:54.331994+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331994+0000","last_undegraded":"2024-08-19T00:38:54.331994+0000","last_fullsized":"2024-08-19T00:38:54.331994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327655+0000","last_change":"2024-08-19T00:38:54.327655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327655+0000","last_undegraded":"2024-08-19T00:38:54.327655+0000","last_fullsized":"2024-08-19T00:38:54.327655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339928+0000","last_change":"2024-08-19T00:38:54.339928+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339928+0000","last_undegraded":"2024-08-19T00:38:54.339928+0000","last_fullsized":"2024-08-19T00:38:54.339928+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327851+0000","last_change":"2024-08-19T00:38:54.327851+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327851+0000","last_undegraded":"2024-08-19T00:38:54.327851+0000","last_fullsized":"2024-08-19T00:38:54.327851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334914+0000","last_change":"2024-08-19T00:38:54.334914+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334914+0000","last_undegraded":"2024-08-19T00:38:54.334914+0000","last_fullsized":"2024-08-19T00:38:54.334914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338520+0000","last_change":"2024-08-19T00:38:54.338520+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338520+0000","last_undegraded":"2024-08-19T00:38:54.338520+0000","last_fullsized":"2024-08-19T00:38:54.338520+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339452+0000","last_change":"2024-08-19T00:38:54.339452+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339452+0000","last_undegraded":"2024-08-19T00:38:54.339452+0000","last_fullsized":"2024-08-19T00:38:54.339452+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334985+0000","last_change":"2024-08-19T00:38:54.334985+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334985+0000","last_undegraded":"2024-08-19T00:38:54.334985+0000","last_fullsized":"2024-08-19T00:38:54.334985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335274+0000","last_change":"2024-08-19T00:38:54.335274+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335274+0000","last_undegraded":"2024-08-19T00:38:54.335274+0000","last_fullsized":"2024-08-19T00:38:54.335274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327840+0000","last_change":"2024-08-19T00:38:54.327840+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327840+0000","last_undegraded":"2024-08-19T00:38:54.327840+0000","last_fullsized":"2024-08-19T00:38:54.327840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332340+0000","last_change":"2024-08-19T00:38:54.332340+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332340+0000","last_undegraded":"2024-08-19T00:38:54.332340+0000","last_fullsized":"2024-08-19T00:38:54.332340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334261+0000","last_change":"2024-08-19T00:38:54.334261+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334261+0000","last_undegraded":"2024-08-19T00:38:54.334261+0000","last_fullsized":"2024-08-19T00:38:54.334261+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328352+0000","last_change":"2024-08-19T00:38:54.328352+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328352+0000","last_undegraded":"2024-08-19T00:38:54.328352+0000","last_fullsized":"2024-08-19T00:38:54.328352+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352999+0000","last_change":"2024-08-19T00:38:54.351258+0000","last_active":"2024-08-19T00:38:54.352999+0000","last_peered":"2024-08-19T00:38:54.352999+0000","last_clean":"2024-08-19T00:38:54.352999+0000","last_became_active":"2024-08-19T00:38:54.350541+0000","last_became_peered":"2024-08-19T00:38:54.350541+0000","last_unstale":"2024-08-19T00:38:54.352999+0000","last_undegraded":"2024-08-19T00:38:54.352999+0000","last_fullsized":"2024-08-19T00:38:54.352999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.639154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334112+0000","last_change":"2024-08-19T00:38:54.334112+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334112+0000","last_undegraded":"2024-08-19T00:38:54.334112+0000","last_fullsized":"2024-08-19T00:38:54.334112+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345500+0000","last_change":"2024-08-19T00:38:54.341106+0000","last_active":"2024-08-19T00:38:54.345500+0000","last_peered":"2024-08-19T00:38:54.345500+0000","last_clean":"2024-08-19T00:38:54.345500+0000","last_became_active":"2024-08-19T00:38:54.340815+0000","last_became_peered":"2024-08-19T00:38:54.340815+0000","last_unstale":"2024-08-19T00:38:54.345500+0000","last_undegraded":"2024-08-19T00:38:54.345500+0000","last_fullsized":"2024-08-19T00:38:54.345500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:30.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328756+0000","last_change":"2024-08-19T00:38:54.328756+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328756+0000","last_undegraded":"2024-08-19T00:38:54.328756+0000","last_fullsized":"2024-08-19T00:38:54.328756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348652+0000","last_change":"2024-08-19T00:38:54.347121+0000","last_active":"2024-08-19T00:38:54.348652+0000","last_peered":"2024-08-19T00:38:54.348652+0000","last_clean":"2024-08-19T00:38:54.348652+0000","last_became_active":"2024-08-19T00:38:54.346853+0000","last_became_peered":"2024-08-19T00:38:54.346853+0000","last_unstale":"2024-08-19T00:38:54.348652+0000","last_undegraded":"2024-08-19T00:38:54.348652+0000","last_fullsized":"2024-08-19T00:38:54.348652+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:07.935034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338096+0000","last_change":"2024-08-19T00:38:54.338096+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338096+0000","last_undegraded":"2024-08-19T00:38:54.338096+0000","last_fullsized":"2024-08-19T00:38:54.338096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.341600+0000","last_change":"2024-08-19T00:38:54.336448+0000","last_active":"2024-08-19T00:38:54.341600+0000","last_peered":"2024-08-19T00:38:54.341600+0000","last_clean":"2024-08-19T00:38:54.341600+0000","last_became_active":"2024-08-19T00:38:54.336119+0000","last_became_peered":"2024-08-19T00:38:54.336119+0000","last_unstale":"2024-08-19T00:38:54.341600+0000","last_undegraded":"2024-08-19T00:38:54.341600+0000","last_fullsized":"2024-08-19T00:38:54.341600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:46.926817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.337044+0000","last_change":"2024-08-19T00:38:54.337044+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.337044+0000","last_undegraded":"2024-08-19T00:38:54.337044+0000","last_fullsized":"2024-08-19T00:38:54.337044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345864+0000","last_change":"2024-08-19T00:38:54.342546+0000","last_active":"2024-08-19T00:38:54.345864+0000","last_peered":"2024-08-19T00:38:54.345864+0000","last_clean":"2024-08-19T00:38:54.345864+0000","last_became_active":"2024-08-19T00:38:54.342242+0000","last_became_peered":"2024-08-19T00:38:54.342242+0000","last_unstale":"2024-08-19T00:38:54.345864+0000","last_undegraded":"2024-08-19T00:38:54.345864+0000","last_fullsized":"2024-08-19T00:38:54.345864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:27:30.743408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331833+0000","last_change":"2024-08-19T00:38:54.331833+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331833+0000","last_undegraded":"2024-08-19T00:38:54.331833+0000","last_fullsized":"2024-08-19T00:38:54.331833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352208+0000","last_change":"2024-08-19T00:38:54.349377+0000","last_active":"2024-08-19T00:38:54.352208+0000","last_peered":"2024-08-19T00:38:54.352208+0000","last_clean":"2024-08-19T00:38:54.352208+0000","last_became_active":"2024-08-19T00:38:54.349118+0000","last_became_peered":"2024-08-19T00:38:54.349118+0000","last_unstale":"2024-08-19T00:38:54.352208+0000","last_undegraded":"2024-08-19T00:38:54.352208+0000","last_fullsized":"2024-08-19T00:38:54.352208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:44.945873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.336940+0000","last_change":"2024-08-19T00:38:54.336940+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.336940+0000","last_undegraded":"2024-08-19T00:38:54.336940+0000","last_fullsized":"2024-08-19T00:38:54.336940+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349712+0000","last_change":"2024-08-19T00:38:54.344490+0000","last_active":"2024-08-19T00:38:54.349712+0000","last_peered":"2024-08-19T00:38:54.349712+0000","last_clean":"2024-08-19T00:38:54.349712+0000","last_became_active":"2024-08-19T00:38:54.344198+0000","last_became_peered":"2024-08-19T00:38:54.344198+0000","last_unstale":"2024-08-19T00:38:54.349712+0000","last_undegraded":"2024-08-19T00:38:54.349712+0000","last_fullsized":"2024-08-19T00:38:54.349712+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338863+0000","last_change":"2024-08-19T00:38:54.338863+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338863+0000","last_undegraded":"2024-08-19T00:38:54.338863+0000","last_fullsized":"2024-08-19T00:38:54.338863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347492+0000","last_change":"2024-08-19T00:38:54.344307+0000","last_active":"2024-08-19T00:38:54.347492+0000","last_peered":"2024-08-19T00:38:54.347492+0000","last_clean":"2024-08-19T00:38:54.347492+0000","last_became_active":"2024-08-19T00:38:54.344000+0000","last_became_peered":"2024-08-19T00:38:54.344000+0000","last_unstale":"2024-08-19T00:38:54.347492+0000","last_undegraded":"2024-08-19T00:38:54.347492+0000","last_fullsized":"2024-08-19T00:38:54.347492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335032+0000","last_change":"2024-08-19T00:38:54.335032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335032+0000","last_undegraded":"2024-08-19T00:38:54.335032+0000","last_fullsized":"2024-08-19T00:38:54.335032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351397+0000","last_change":"2024-08-19T00:38:54.347355+0000","last_active":"2024-08-19T00:38:54.351397+0000","last_peered":"2024-08-19T00:38:54.351397+0000","last_clean":"2024-08-19T00:38:54.351397+0000","last_became_active":"2024-08-19T00:38:54.344875+0000","last_became_peered":"2024-08-19T00:38:54.344875+0000","last_unstale":"2024-08-19T00:38:54.351397+0000","last_undegraded":"2024-08-19T00:38:54.351397+0000","last_fullsized":"2024-08-19T00:38:54.351397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:41.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333712+0000","last_change":"2024-08-19T00:38:54.333712+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333712+0000","last_undegraded":"2024-08-19T00:38:54.333712+0000","last_fullsized":"2024-08-19T00:38:54.333712+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355804+0000","last_change":"2024-08-19T00:38:54.351964+0000","last_active":"2024-08-19T00:38:54.355804+0000","last_peered":"2024-08-19T00:38:54.355804+0000","last_clean":"2024-08-19T00:38:54.355804+0000","last_became_active":"2024-08-19T00:38:54.351662+0000","last_became_peered":"2024-08-19T00:38:54.351662+0000","last_unstale":"2024-08-19T00:38:54.355804+0000","last_undegraded":"2024-08-19T00:38:54.355804+0000","last_fullsized":"2024-08-19T00:38:54.355804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:33.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334857+0000","last_change":"2024-08-19T00:38:54.334857+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334857+0000","last_undegraded":"2024-08-19T00:38:54.334857+0000","last_fullsized":"2024-08-19T00:38:54.334857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349339+0000","last_change":"2024-08-19T00:38:54.347070+0000","last_active":"2024-08-19T00:38:54.349339+0000","last_peered":"2024-08-19T00:38:54.349339+0000","last_clean":"2024-08-19T00:38:54.349339+0000","last_became_active":"2024-08-19T00:38:54.346775+0000","last_became_peered":"2024-08-19T00:38:54.346775+0000","last_unstale":"2024-08-19T00:38:54.349339+0000","last_undegraded":"2024-08-19T00:38:54.349339+0000","last_fullsized":"2024-08-19T00:38:54.349339+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334475+0000","last_change":"2024-08-19T00:38:54.334475+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334475+0000","last_undegraded":"2024-08-19T00:38:54.334475+0000","last_fullsized":"2024-08-19T00:38:54.334475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348664+0000","last_change":"2024-08-19T00:38:54.346097+0000","last_active":"2024-08-19T00:38:54.348664+0000","last_peered":"2024-08-19T00:38:54.348664+0000","last_clean":"2024-08-19T00:38:54.348664+0000","last_became_active":"2024-08-19T00:38:54.343893+0000","last_became_peered":"2024-08-19T00:38:54.343893+0000","last_unstale":"2024-08-19T00:38:54.348664+0000","last_undegraded":"2024-08-19T00:38:54.348664+0000","last_fullsized":"2024-08-19T00:38:54.348664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334848+0000","last_change":"2024-08-19T00:38:54.334848+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334848+0000","last_undegraded":"2024-08-19T00:38:54.334848+0000","last_fullsized":"2024-08-19T00:38:54.334848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345005+0000","last_change":"2024-08-19T00:38:54.343418+0000","last_active":"2024-08-19T00:38:54.345005+0000","last_peered":"2024-08-19T00:38:54.345005+0000","last_clean":"2024-08-19T00:38:54.345005+0000","last_became_active":"2024-08-19T00:38:54.343059+0000","last_became_peered":"2024-08-19T00:38:54.343059+0000","last_unstale":"2024-08-19T00:38:54.345005+0000","last_undegraded":"2024-08-19T00:38:54.345005+0000","last_fullsized":"2024-08-19T00:38:54.345005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327674+0000","last_change":"2024-08-19T00:38:54.327674+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327674+0000","last_undegraded":"2024-08-19T00:38:54.327674+0000","last_fullsized":"2024-08-19T00:38:54.327674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351568+0000","last_change":"2024-08-19T00:38:54.345428+0000","last_active":"2024-08-19T00:38:54.351568+0000","last_peered":"2024-08-19T00:38:54.351568+0000","last_clean":"2024-08-19T00:38:54.351568+0000","last_became_active":"2024-08-19T00:38:54.345122+0000","last_became_peered":"2024-08-19T00:38:54.345122+0000","last_unstale":"2024-08-19T00:38:54.351568+0000","last_undegraded":"2024-08-19T00:38:54.351568+0000","last_fullsized":"2024-08-19T00:38:54.351568+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:02.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327761+0000","last_change":"2024-08-19T00:38:54.327761+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327761+0000","last_undegraded":"2024-08-19T00:38:54.327761+0000","last_fullsized":"2024-08-19T00:38:54.327761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351561+0000","last_change":"2024-08-19T00:38:54.349434+0000","last_active":"2024-08-19T00:38:54.351561+0000","last_peered":"2024-08-19T00:38:54.351561+0000","last_clean":"2024-08-19T00:38:54.351561+0000","last_became_active":"2024-08-19T00:38:54.349177+0000","last_became_peered":"2024-08-19T00:38:54.349177+0000","last_unstale":"2024-08-19T00:38:54.351561+0000","last_undegraded":"2024-08-19T00:38:54.351561+0000","last_fullsized":"2024-08-19T00:38:54.351561+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:33.953532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.330173+0000","last_change":"2024-08-19T00:38:54.330173+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.330173+0000","last_undegraded":"2024-08-19T00:38:54.330173+0000","last_fullsized":"2024-08-19T00:38:54.330173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.350762+0000","last_change":"2024-08-19T00:38:54.346829+0000","last_active":"2024-08-19T00:38:54.350762+0000","last_peered":"2024-08-19T00:38:54.350762+0000","last_clean":"2024-08-19T00:38:54.350762+0000","last_became_active":"2024-08-19T00:38:54.346572+0000","last_became_peered":"2024-08-19T00:38:54.346572+0000","last_unstale":"2024-08-19T00:38:54.350762+0000","last_undegraded":"2024-08-19T00:38:54.350762+0000","last_fullsized":"2024-08-19T00:38:54.350762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:11.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327714+0000","last_change":"2024-08-19T00:38:54.327714+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327714+0000","last_undegraded":"2024-08-19T00:38:54.327714+0000","last_fullsized":"2024-08-19T00:38:54.327714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355542+0000","last_change":"2024-08-19T00:38:54.349597+0000","last_active":"2024-08-19T00:38:54.355542+0000","last_peered":"2024-08-19T00:38:54.355542+0000","last_clean":"2024-08-19T00:38:54.355542+0000","last_became_active":"2024-08-19T00:38:54.348927+0000","last_became_peered":"2024-08-19T00:38:54.348927+0000","last_unstale":"2024-08-19T00:38:54.355542+0000","last_undegraded":"2024-08-19T00:38:54.355542+0000","last_fullsized":"2024-08-19T00:38:54.355542+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327936+0000","last_change":"2024-08-19T00:38:54.327936+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327936+0000","last_undegraded":"2024-08-19T00:38:54.327936+0000","last_fullsized":"2024-08-19T00:38:54.327936+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351282+0000","last_change":"2024-08-19T00:38:54.346271+0000","last_active":"2024-08-19T00:38:54.351282+0000","last_peered":"2024-08-19T00:38:54.351282+0000","last_clean":"2024-08-19T00:38:54.351282+0000","last_became_active":"2024-08-19T00:38:54.346017+0000","last_became_peered":"2024-08-19T00:38:54.346017+0000","last_unstale":"2024-08-19T00:38:54.351282+0000","last_undegraded":"2024-08-19T00:38:54.351282+0000","last_fullsized":"2024-08-19T00:38:54.351282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:24.124584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352750+0000","last_change":"2024-08-19T00:38:54.350148+0000","last_active":"2024-08-19T00:38:54.352750+0000","last_peered":"2024-08-19T00:38:54.352750+0000","last_clean":"2024-08-19T00:38:54.352750+0000","last_became_active":"2024-08-19T00:38:54.347799+0000","last_became_peered":"2024-08-19T00:38:54.347799+0000","last_unstale":"2024-08-19T00:38:54.352750+0000","last_undegraded":"2024-08-19T00:38:54.352750+0000","last_fullsized":"2024-08-19T00:38:54.352750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332636+0000","last_change":"2024-08-19T00:38:54.332636+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332636+0000","last_undegraded":"2024-08-19T00:38:54.332636+0000","last_fullsized":"2024-08-19T00:38:54.332636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353008+0000","last_change":"2024-08-19T00:38:54.350844+0000","last_active":"2024-08-19T00:38:54.353008+0000","last_peered":"2024-08-19T00:38:54.353008+0000","last_clean":"2024-08-19T00:38:54.353008+0000","last_became_active":"2024-08-19T00:38:54.350579+0000","last_became_peered":"2024-08-19T00:38:54.350579+0000","last_unstale":"2024-08-19T00:38:54.353008+0000","last_undegraded":"2024-08-19T00:38:54.353008+0000","last_fullsized":"2024-08-19T00:38:54.353008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:22.283543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333016+0000","last_change":"2024-08-19T00:38:54.333016+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333016+0000","last_undegraded":"2024-08-19T00:38:54.333016+0000","last_fullsized":"2024-08-19T00:38:54.333016+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355810+0000","last_change":"2024-08-19T00:38:54.351955+0000","last_active":"2024-08-19T00:38:54.355810+0000","last_peered":"2024-08-19T00:38:54.355810+0000","last_clean":"2024-08-19T00:38:54.355810+0000","last_became_active":"2024-08-19T00:38:54.351347+0000","last_became_peered":"2024-08-19T00:38:54.351347+0000","last_unstale":"2024-08-19T00:38:54.355810+0000","last_undegraded":"2024-08-19T00:38:54.355810+0000","last_fullsized":"2024-08-19T00:38:54.355810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:37.514345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334051+0000","last_change":"2024-08-19T00:38:54.334051+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334051+0000","last_undegraded":"2024-08-19T00:38:54.334051+0000","last_fullsized":"2024-08-19T00:38:54.334051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353746+0000","last_change":"2024-08-19T00:38:54.351507+0000","last_active":"2024-08-19T00:38:54.353746+0000","last_peered":"2024-08-19T00:38:54.353746+0000","last_clean":"2024-08-19T00:38:54.353746+0000","last_became_active":"2024-08-19T00:38:54.350965+0000","last_became_peered":"2024-08-19T00:38:54.350965+0000","last_unstale":"2024-08-19T00:38:54.353746+0000","last_undegraded":"2024-08-19T00:38:54.353746+0000","last_fullsized":"2024-08-19T00:38:54.353746+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333801+0000","last_change":"2024-08-19T00:38:54.333801+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333801+0000","last_undegraded":"2024-08-19T00:38:54.333801+0000","last_fullsized":"2024-08-19T00:38:54.333801+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348609+0000","last_change":"2024-08-19T00:38:54.345173+0000","last_active":"2024-08-19T00:38:54.348609+0000","last_peered":"2024-08-19T00:38:54.348609+0000","last_clean":"2024-08-19T00:38:54.348609+0000","last_became_active":"2024-08-19T00:38:54.344931+0000","last_became_peered":"2024-08-19T00:38:54.344931+0000","last_unstale":"2024-08-19T00:38:54.348609+0000","last_undegraded":"2024-08-19T00:38:54.348609+0000","last_fullsized":"2024-08-19T00:38:54.348609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333830+0000","last_change":"2024-08-19T00:38:54.333830+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333830+0000","last_undegraded":"2024-08-19T00:38:54.333830+0000","last_fullsized":"2024-08-19T00:38:54.333830+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347685+0000","last_change":"2024-08-19T00:38:54.345007+0000","last_active":"2024-08-19T00:38:54.347685+0000","last_peered":"2024-08-19T00:38:54.347685+0000","last_clean":"2024-08-19T00:38:54.347685+0000","last_became_active":"2024-08-19T00:38:54.344731+0000","last_became_peered":"2024-08-19T00:38:54.344731+0000","last_unstale":"2024-08-19T00:38:54.347685+0000","last_undegraded":"2024-08-19T00:38:54.347685+0000","last_fullsized":"2024-08-19T00:38:54.347685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:44.571404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331845+0000","last_change":"2024-08-19T00:38:54.331845+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331845+0000","last_undegraded":"2024-08-19T00:38:54.331845+0000","last_fullsized":"2024-08-19T00:38:54.331845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355552+0000","last_change":"2024-08-19T00:38:54.349998+0000","last_active":"2024-08-19T00:38:54.355552+0000","last_peered":"2024-08-19T00:38:54.355552+0000","last_clean":"2024-08-19T00:38:54.355552+0000","last_became_active":"2024-08-19T00:38:54.349609+0000","last_became_peered":"2024-08-19T00:38:54.349609+0000","last_unstale":"2024-08-19T00:38:54.355552+0000","last_undegraded":"2024-08-19T00:38:54.355552+0000","last_fullsized":"2024-08-19T00:38:54.355552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332706+0000","last_change":"2024-08-19T00:38:54.332706+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332706+0000","last_undegraded":"2024-08-19T00:38:54.332706+0000","last_fullsized":"2024-08-19T00:38:54.332706+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.354351+0000","last_change":"2024-08-19T00:38:54.353417+0000","last_active":"2024-08-19T00:38:54.354351+0000","last_peered":"2024-08-19T00:38:54.354351+0000","last_clean":"2024-08-19T00:38:54.354351+0000","last_became_active":"2024-08-19T00:38:54.353149+0000","last_became_peered":"2024-08-19T00:38:54.353149+0000","last_unstale":"2024-08-19T00:38:54.354351+0000","last_undegraded":"2024-08-19T00:38:54.354351+0000","last_fullsized":"2024-08-19T00:38:54.354351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331627+0000","last_change":"2024-08-19T00:38:54.331627+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331627+0000","last_undegraded":"2024-08-19T00:38:54.331627+0000","last_fullsized":"2024-08-19T00:38:54.331627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351748+0000","last_change":"2024-08-19T00:38:54.348067+0000","last_active":"2024-08-19T00:38:54.351748+0000","last_peered":"2024-08-19T00:38:54.351748+0000","last_clean":"2024-08-19T00:38:54.351748+0000","last_became_active":"2024-08-19T00:38:54.347686+0000","last_became_peered":"2024-08-19T00:38:54.347686+0000","last_unstale":"2024-08-19T00:38:54.351748+0000","last_undegraded":"2024-08-19T00:38:54.351748+0000","last_fullsized":"2024-08-19T00:38:54.351748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:35.960033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332614+0000","last_change":"2024-08-19T00:38:54.332614+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332614+0000","last_undegraded":"2024-08-19T00:38:54.332614+0000","last_fullsized":"2024-08-19T00:38:54.332614+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353010+0000","last_change":"2024-08-19T00:38:54.348542+0000","last_active":"2024-08-19T00:38:54.353010+0000","last_peered":"2024-08-19T00:38:54.353010+0000","last_clean":"2024-08-19T00:38:54.353010+0000","last_became_active":"2024-08-19T00:38:54.348292+0000","last_became_peered":"2024-08-19T00:38:54.348292+0000","last_unstale":"2024-08-19T00:38:54.353010+0000","last_undegraded":"2024-08-19T00:38:54.353010+0000","last_fullsized":"2024-08-19T00:38:54.353010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:23.899300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333244+0000","last_change":"2024-08-19T00:38:54.333244+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333244+0000","last_undegraded":"2024-08-19T00:38:54.333244+0000","last_fullsized":"2024-08-19T00:38:54.333244+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351059+0000","last_change":"2024-08-19T00:38:54.347335+0000","last_active":"2024-08-19T00:38:54.351059+0000","last_peered":"2024-08-19T00:38:54.351059+0000","last_clean":"2024-08-19T00:38:54.351059+0000","last_became_active":"2024-08-19T00:38:54.347065+0000","last_became_peered":"2024-08-19T00:38:54.347065+0000","last_unstale":"2024-08-19T00:38:54.351059+0000","last_undegraded":"2024-08-19T00:38:54.351059+0000","last_fullsized":"2024-08-19T00:38:54.351059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:14:02.952709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334134+0000","last_change":"2024-08-19T00:38:54.334134+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334134+0000","last_undegraded":"2024-08-19T00:38:54.334134+0000","last_fullsized":"2024-08-19T00:38:54.334134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352292+0000","last_change":"2024-08-19T00:38:54.350331+0000","last_active":"2024-08-19T00:38:54.352292+0000","last_peered":"2024-08-19T00:38:54.352292+0000","last_clean":"2024-08-19T00:38:54.352292+0000","last_became_active":"2024-08-19T00:38:54.349006+0000","last_became_peered":"2024-08-19T00:38:54.349006+0000","last_unstale":"2024-08-19T00:38:54.352292+0000","last_undegraded":"2024-08-19T00:38:54.352292+0000","last_fullsized":"2024-08-19T00:38:54.352292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:18.045159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352684+0000","last_change":"2024-08-19T00:38:54.351356+0000","last_active":"2024-08-19T00:38:54.352684+0000","last_peered":"2024-08-19T00:38:54.352684+0000","last_clean":"2024-08-19T00:38:54.352684+0000","last_became_active":"2024-08-19T00:38:54.350850+0000","last_became_peered":"2024-08-19T00:38:54.350850+0000","last_unstale":"2024-08-19T00:38:54.352684+0000","last_undegraded":"2024-08-19T00:38:54.352684+0000","last_fullsized":"2024-08-19T00:38:54.352684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:51.200617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338008+0000","last_change":"2024-08-19T00:38:54.338008+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338008+0000","last_undegraded":"2024-08-19T00:38:54.338008+0000","last_fullsized":"2024-08-19T00:38:54.338008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351347+0000","last_change":"2024-08-19T00:38:54.347205+0000","last_active":"2024-08-19T00:38:54.351347+0000","last_peered":"2024-08-19T00:38:54.351347+0000","last_clean":"2024-08-19T00:38:54.351347+0000","last_became_active":"2024-08-19T00:38:54.344536+0000","last_became_peered":"2024-08-19T00:38:54.344536+0000","last_unstale":"2024-08-19T00:38:54.351347+0000","last_undegraded":"2024-08-19T00:38:54.351347+0000","last_fullsized":"2024-08-19T00:38:54.351347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:33.298522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.339486+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:38:54.339486+0000","last_peered":"2024-08-19T00:38:54.339486+0000","last_clean":"2024-08-19T00:38:54.339486+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:38:54.339486+0000","last_undegraded":"2024-08-19T00:38:54.339486+0000","last_fullsized":"2024-08-19T00:38:54.339486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:38:59.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:38:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.764+0000 7f06e5000640 1 Processor -- start 2024-08-19T00:38:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.765+0000 7f06e5000640 1 -- start start 2024-08-19T00:38:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06e5000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f06e006e710 0x7f06e0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06e5000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06e00b3750 0x7f06e00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06e5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e00cdfb0 con 0x7f06e00d03c0 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06e5000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f06e00cebc0 con 0x7f06e00b3750 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06e5000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f06e00ce290 con 0x7f06e006e710 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06de800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06e00b3750 0x7f06e00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06de800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06e00b3750 0x7f06e00cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60546/0 (socket says 172.21.15.7:60546) 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06de800640 1 -- 172.21.15.7:0/1273147745 learned_addr learned my addr 172.21.15.7:0/1273147745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06d7e00640 1 --2- 172.21.15.7:0/1273147745 >> v2:172.21.15.162:3300/0 conn(0x7f06e006e710 0x7f06e0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.766+0000 7f06de800640 1 -- 172.21.15.7:0/1273147745 >> v2:172.21.15.162:3300/0 conn(0x7f06e006e710 msgr2=0x7f06e0071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.767+0000 7f06de800640 1 --2- 172.21.15.7:0/1273147745 >> v2:172.21.15.162:3300/0 conn(0x7f06e006e710 0x7f06e0071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.767+0000 7f06de800640 1 -- 172.21.15.7:0/1273147745 >> v1:172.21.15.162:6789/0 conn(0x7f06e00d03c0 legacy=0x7f06e00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:38:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.767+0000 7f06de800640 1 -- 172.21.15.7:0/1273147745 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e00ce570 con 0x7f06e00b3750 2024-08-19T00:38:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.767+0000 7f06d7e00640 1 --2- 172.21.15.7:0/1273147745 >> v2:172.21.15.162:3300/0 conn(0x7f06e006e710 0x7f06e0071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06de800640 1 --2- 172.21.15.7:0/1273147745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00b3750 0x7f06e00cf050 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bc76bccf402247 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06dd400640 1 -- 172.21.15.7:0/1273147745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8036070 con 0x7f06e00b3750 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06dd400640 1 -- 172.21.15.7:0/1273147745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8031600 con 0x7f06e00b3750 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06dd400640 1 -- 172.21.15.7:0/1273147745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d80319d0 con 0x7f06e00b3750 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06e5000640 1 -- 172.21.15.7:0/1273147745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00b3750 msgr2=0x7f06e00cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06e5000640 1 --2- 172.21.15.7:0/1273147745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00b3750 0x7f06e00cf050 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d802a760 comp rx=0 tx=0).stop 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06e5000640 1 -- 172.21.15.7:0/1273147745 shutdown_connections 2024-08-19T00:38:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06e5000640 1 --2- 172.21.15.7:0/1273147745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00b3750 0x7f06e00cf050 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06e5000640 1 --2- 172.21.15.7:0/1273147745 >> v2:172.21.15.162:3300/0 conn(0x7f06e006e710 0x7f06e0071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.768+0000 7f06e5000640 1 -- 172.21.15.7:0/1273147745 >> 172.21.15.7:0/1273147745 conn(0x7f06e006bc70 msgr2=0x7f06e006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.769+0000 7f06e5000640 1 -- 172.21.15.7:0/1273147745 shutdown_connections 2024-08-19T00:38:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.769+0000 7f06e5000640 1 -- 172.21.15.7:0/1273147745 wait complete. 2024-08-19T00:38:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.770+0000 7f06e5000640 1 Processor -- start 2024-08-19T00:38:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.770+0000 7f06e5000640 1 -- start start 2024-08-19T00:38:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06e5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06e006e710 0x7f06e009dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06e5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b3750 0x7f06e01e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06e5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00d03c0 0x7f06e01e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06e5000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0073c60 con 0x7f06e00d03c0 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06e5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0073ae0 con 0x7f06e006e710 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06e5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00b3be0 con 0x7f06e00b3750 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00d03c0 0x7f06e01e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00d03c0 0x7f06e01e5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60550/0 (socket says 172.21.15.7:60550) 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.771+0000 7f06de800640 1 -- 172.21.15.7:0/2710461750 learned_addr learned my addr 172.21.15.7:0/2710461750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06d7e00640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b3750 0x7f06e01e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06dde00640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06e006e710 0x7f06e009dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06de800640 1 -- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b3750 msgr2=0x7f06e01e43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06de800640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b3750 0x7f06e01e43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06de800640 1 -- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06e006e710 msgr2=0x7f06e009dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06de800640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06e006e710 0x7f06e009dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06de800640 1 -- 172.21.15.7:0/2710461750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e01e4920 con 0x7f06e00d03c0 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06de800640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00d03c0 0x7f06e01e5430 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06d6000640 1 -- 172.21.15.7:0/2710461750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8036050 con 0x7f06e00d03c0 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06d6000640 1 -- 172.21.15.7:0/2710461750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8042070 con 0x7f06e00d03c0 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06d6000640 1 -- 172.21.15.7:0/2710461750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8009510 con 0x7f06e00d03c0 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.772+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e01e5da0 con 0x7f06e00d03c0 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.773+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e01e3900 con 0x7f06e00d03c0 2024-08-19T00:38:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.774+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e0071980 con 0x7f06e00d03c0 2024-08-19T00:38:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.775+0000 7f06d6000640 1 -- 172.21.15.7:0/2710461750 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06d8007bd0 con 0x7f06e00d03c0 2024-08-19T00:38:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.776+0000 7f06d6000640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06bc06be30 0x7f06bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:38:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.776+0000 7f06d6000640 1 -- 172.21.15.7:0/2710461750 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f06d80abc90 con 0x7f06e00d03c0 2024-08-19T00:38:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.776+0000 7f06dde00640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06bc06be30 0x7f06bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:38:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.776+0000 7f06dde00640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06bc06be30 0x7f06bc06e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f60 tx=0x7f06d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:38:59.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.780+0000 7f06d6000640 1 -- 172.21.15.7:0/2710461750 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f06d807a6d0 con 0x7f06e00d03c0 2024-08-19T00:38:59.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.960+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06e00af3a0 con 0x7f06bc06be30 2024-08-19T00:38:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.967+0000 7f06d6000640 1 -- 172.21.15.7:0/2710461750 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7f06e00af3a0 con 0x7f06bc06be30 2024-08-19T00:38:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:38:59.972 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:38:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.970+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06bc06be30 msgr2=0x7f06bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.970+0000 7f06e5000640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06bc06be30 0x7f06bc06e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f60 tx=0x7f06d0009040 comp rx=0 tx=0).stop 2024-08-19T00:38:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.970+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00d03c0 msgr2=0x7f06e01e5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:38:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.970+0000 7f06e5000640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00d03c0 0x7f06e01e5430 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d8004a40 comp rx=0 tx=0).stop 2024-08-19T00:38:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 shutdown_connections 2024-08-19T00:38:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06bc06be30 0x7f06bc06e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e00d03c0 0x7f06e01e5430 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b3750 0x7f06e01e43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 --2- 172.21.15.7:0/2710461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06e006e710 0x7f06e009dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:38:59.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 >> 172.21.15.7:0/2710461750 conn(0x7f06e006bc70 msgr2=0x7f06e00b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:38:59.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 shutdown_connections 2024-08-19T00:38:59.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:38:59.971+0000 7f06e5000640 1 -- 172.21.15.7:0/2710461750 wait complete. 2024-08-19T00:38:59.988 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-08-19T00:38:59.282309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237928,"kb_used_data":5096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736792,"statfs":{"total":773094113280,"available":772850475008,"internally_reserved":0,"allocated":5218304,"data_stored":2796240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.961367"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335384+0000","last_change":"2024-08-19T00:38:54.335384+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335384+0000","last_undegraded":"2024-08-19T00:38:54.335384+0000","last_fullsized":"2024-08-19T00:38:54.335384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328224+0000","last_change":"2024-08-19T00:38:54.328224+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328224+0000","last_undegraded":"2024-08-19T00:38:54.328224+0000","last_fullsized":"2024-08-19T00:38:54.328224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333407+0000","last_change":"2024-08-19T00:38:54.333407+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333407+0000","last_undegraded":"2024-08-19T00:38:54.333407+0000","last_fullsized":"2024-08-19T00:38:54.333407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335655+0000","last_change":"2024-08-19T00:38:54.335655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335655+0000","last_undegraded":"2024-08-19T00:38:54.335655+0000","last_fullsized":"2024-08-19T00:38:54.335655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335775+0000","last_change":"2024-08-19T00:38:54.335775+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335775+0000","last_undegraded":"2024-08-19T00:38:54.335775+0000","last_fullsized":"2024-08-19T00:38:54.335775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332729+0000","last_change":"2024-08-19T00:38:54.332729+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332729+0000","last_undegraded":"2024-08-19T00:38:54.332729+0000","last_fullsized":"2024-08-19T00:38:54.332729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.340397+0000","last_change":"2024-08-19T00:38:54.340397+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.340397+0000","last_undegraded":"2024-08-19T00:38:54.340397+0000","last_fullsized":"2024-08-19T00:38:54.340397+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334758+0000","last_change":"2024-08-19T00:38:54.334758+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334758+0000","last_undegraded":"2024-08-19T00:38:54.334758+0000","last_fullsized":"2024-08-19T00:38:54.334758+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334622+0000","last_change":"2024-08-19T00:38:54.334622+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334622+0000","last_undegraded":"2024-08-19T00:38:54.334622+0000","last_fullsized":"2024-08-19T00:38:54.334622+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332055+0000","last_change":"2024-08-19T00:38:54.332055+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332055+0000","last_undegraded":"2024-08-19T00:38:54.332055+0000","last_fullsized":"2024-08-19T00:38:54.332055+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338588+0000","last_change":"2024-08-19T00:38:54.338588+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338588+0000","last_undegraded":"2024-08-19T00:38:54.338588+0000","last_fullsized":"2024-08-19T00:38:54.338588+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.329187+0000","last_change":"2024-08-19T00:38:54.329187+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.329187+0000","last_undegraded":"2024-08-19T00:38:54.329187+0000","last_fullsized":"2024-08-19T00:38:54.329187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334469+0000","last_change":"2024-08-19T00:38:54.334469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334469+0000","last_undegraded":"2024-08-19T00:38:54.334469+0000","last_fullsized":"2024-08-19T00:38:54.334469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334235+0000","last_change":"2024-08-19T00:38:54.334235+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334235+0000","last_undegraded":"2024-08-19T00:38:54.334235+0000","last_fullsized":"2024-08-19T00:38:54.334235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334310+0000","last_change":"2024-08-19T00:38:54.334310+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334310+0000","last_undegraded":"2024-08-19T00:38:54.334310+0000","last_fullsized":"2024-08-19T00:38:54.334310+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333331+0000","last_change":"2024-08-19T00:38:54.333331+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333331+0000","last_undegraded":"2024-08-19T00:38:54.333331+0000","last_fullsized":"2024-08-19T00:38:54.333331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328641+0000","last_change":"2024-08-19T00:38:54.328641+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328641+0000","last_undegraded":"2024-08-19T00:38:54.328641+0000","last_fullsized":"2024-08-19T00:38:54.328641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335469+0000","last_change":"2024-08-19T00:38:54.335469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335469+0000","last_undegraded":"2024-08-19T00:38:54.335469+0000","last_fullsized":"2024-08-19T00:38:54.335469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.341032+0000","last_change":"2024-08-19T00:38:54.341032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.341032+0000","last_undegraded":"2024-08-19T00:38:54.341032+0000","last_fullsized":"2024-08-19T00:38:54.341032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333144+0000","last_change":"2024-08-19T00:38:54.333144+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333144+0000","last_undegraded":"2024-08-19T00:38:54.333144+0000","last_fullsized":"2024-08-19T00:38:54.333144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331994+0000","last_change":"2024-08-19T00:38:54.331994+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331994+0000","last_undegraded":"2024-08-19T00:38:54.331994+0000","last_fullsized":"2024-08-19T00:38:54.331994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327655+0000","last_change":"2024-08-19T00:38:54.327655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327655+0000","last_undegraded":"2024-08-19T00:38:54.327655+0000","last_fullsized":"2024-08-19T00:38:54.327655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339928+0000","last_change":"2024-08-19T00:38:54.339928+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339928+0000","last_undegraded":"2024-08-19T00:38:54.339928+0000","last_fullsized":"2024-08-19T00:38:54.339928+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327851+0000","last_change":"2024-08-19T00:38:54.327851+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327851+0000","last_undegraded":"2024-08-19T00:38:54.327851+0000","last_fullsized":"2024-08-19T00:38:54.327851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334914+0000","last_change":"2024-08-19T00:38:54.334914+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334914+0000","last_undegraded":"2024-08-19T00:38:54.334914+0000","last_fullsized":"2024-08-19T00:38:54.334914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338520+0000","last_change":"2024-08-19T00:38:54.338520+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338520+0000","last_undegraded":"2024-08-19T00:38:54.338520+0000","last_fullsized":"2024-08-19T00:38:54.338520+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339452+0000","last_change":"2024-08-19T00:38:54.339452+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339452+0000","last_undegraded":"2024-08-19T00:38:54.339452+0000","last_fullsized":"2024-08-19T00:38:54.339452+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334985+0000","last_change":"2024-08-19T00:38:54.334985+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334985+0000","last_undegraded":"2024-08-19T00:38:54.334985+0000","last_fullsized":"2024-08-19T00:38:54.334985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335274+0000","last_change":"2024-08-19T00:38:54.335274+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335274+0000","last_undegraded":"2024-08-19T00:38:54.335274+0000","last_fullsized":"2024-08-19T00:38:54.335274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327840+0000","last_change":"2024-08-19T00:38:54.327840+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327840+0000","last_undegraded":"2024-08-19T00:38:54.327840+0000","last_fullsized":"2024-08-19T00:38:54.327840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332340+0000","last_change":"2024-08-19T00:38:54.332340+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332340+0000","last_undegraded":"2024-08-19T00:38:54.332340+0000","last_fullsized":"2024-08-19T00:38:54.332340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334261+0000","last_change":"2024-08-19T00:38:54.334261+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334261+0000","last_undegraded":"2024-08-19T00:38:54.334261+0000","last_fullsized":"2024-08-19T00:38:54.334261+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328352+0000","last_change":"2024-08-19T00:38:54.328352+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328352+0000","last_undegraded":"2024-08-19T00:38:54.328352+0000","last_fullsized":"2024-08-19T00:38:54.328352+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352999+0000","last_change":"2024-08-19T00:38:54.351258+0000","last_active":"2024-08-19T00:38:54.352999+0000","last_peered":"2024-08-19T00:38:54.352999+0000","last_clean":"2024-08-19T00:38:54.352999+0000","last_became_active":"2024-08-19T00:38:54.350541+0000","last_became_peered":"2024-08-19T00:38:54.350541+0000","last_unstale":"2024-08-19T00:38:54.352999+0000","last_undegraded":"2024-08-19T00:38:54.352999+0000","last_fullsized":"2024-08-19T00:38:54.352999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.639154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334112+0000","last_change":"2024-08-19T00:38:54.334112+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334112+0000","last_undegraded":"2024-08-19T00:38:54.334112+0000","last_fullsized":"2024-08-19T00:38:54.334112+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345500+0000","last_change":"2024-08-19T00:38:54.341106+0000","last_active":"2024-08-19T00:38:54.345500+0000","last_peered":"2024-08-19T00:38:54.345500+0000","last_clean":"2024-08-19T00:38:54.345500+0000","last_became_active":"2024-08-19T00:38:54.340815+0000","last_became_peered":"2024-08-19T00:38:54.340815+0000","last_unstale":"2024-08-19T00:38:54.345500+0000","last_undegraded":"2024-08-19T00:38:54.345500+0000","last_fullsized":"2024-08-19T00:38:54.345500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:30.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328756+0000","last_change":"2024-08-19T00:38:54.328756+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328756+0000","last_undegraded":"2024-08-19T00:38:54.328756+0000","last_fullsized":"2024-08-19T00:38:54.328756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348652+0000","last_change":"2024-08-19T00:38:54.347121+0000","last_active":"2024-08-19T00:38:54.348652+0000","last_peered":"2024-08-19T00:38:54.348652+0000","last_clean":"2024-08-19T00:38:54.348652+0000","last_became_active":"2024-08-19T00:38:54.346853+0000","last_became_peered":"2024-08-19T00:38:54.346853+0000","last_unstale":"2024-08-19T00:38:54.348652+0000","last_undegraded":"2024-08-19T00:38:54.348652+0000","last_fullsized":"2024-08-19T00:38:54.348652+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:07.935034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338096+0000","last_change":"2024-08-19T00:38:54.338096+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338096+0000","last_undegraded":"2024-08-19T00:38:54.338096+0000","last_fullsized":"2024-08-19T00:38:54.338096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.341600+0000","last_change":"2024-08-19T00:38:54.336448+0000","last_active":"2024-08-19T00:38:54.341600+0000","last_peered":"2024-08-19T00:38:54.341600+0000","last_clean":"2024-08-19T00:38:54.341600+0000","last_became_active":"2024-08-19T00:38:54.336119+0000","last_became_peered":"2024-08-19T00:38:54.336119+0000","last_unstale":"2024-08-19T00:38:54.341600+0000","last_undegraded":"2024-08-19T00:38:54.341600+0000","last_fullsized":"2024-08-19T00:38:54.341600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:46.926817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.337044+0000","last_change":"2024-08-19T00:38:54.337044+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.337044+0000","last_undegraded":"2024-08-19T00:38:54.337044+0000","last_fullsized":"2024-08-19T00:38:54.337044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345864+0000","last_change":"2024-08-19T00:38:54.342546+0000","last_active":"2024-08-19T00:38:54.345864+0000","last_peered":"2024-08-19T00:38:54.345864+0000","last_clean":"2024-08-19T00:38:54.345864+0000","last_became_active":"2024-08-19T00:38:54.342242+0000","last_became_peered":"2024-08-19T00:38:54.342242+0000","last_unstale":"2024-08-19T00:38:54.345864+0000","last_undegraded":"2024-08-19T00:38:54.345864+0000","last_fullsized":"2024-08-19T00:38:54.345864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:27:30.743408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331833+0000","last_change":"2024-08-19T00:38:54.331833+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331833+0000","last_undegraded":"2024-08-19T00:38:54.331833+0000","last_fullsized":"2024-08-19T00:38:54.331833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352208+0000","last_change":"2024-08-19T00:38:54.349377+0000","last_active":"2024-08-19T00:38:54.352208+0000","last_peered":"2024-08-19T00:38:54.352208+0000","last_clean":"2024-08-19T00:38:54.352208+0000","last_became_active":"2024-08-19T00:38:54.349118+0000","last_became_peered":"2024-08-19T00:38:54.349118+0000","last_unstale":"2024-08-19T00:38:54.352208+0000","last_undegraded":"2024-08-19T00:38:54.352208+0000","last_fullsized":"2024-08-19T00:38:54.352208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:44.945873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.336940+0000","last_change":"2024-08-19T00:38:54.336940+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.336940+0000","last_undegraded":"2024-08-19T00:38:54.336940+0000","last_fullsized":"2024-08-19T00:38:54.336940+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349712+0000","last_change":"2024-08-19T00:38:54.344490+0000","last_active":"2024-08-19T00:38:54.349712+0000","last_peered":"2024-08-19T00:38:54.349712+0000","last_clean":"2024-08-19T00:38:54.349712+0000","last_became_active":"2024-08-19T00:38:54.344198+0000","last_became_peered":"2024-08-19T00:38:54.344198+0000","last_unstale":"2024-08-19T00:38:54.349712+0000","last_undegraded":"2024-08-19T00:38:54.349712+0000","last_fullsized":"2024-08-19T00:38:54.349712+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338863+0000","last_change":"2024-08-19T00:38:54.338863+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338863+0000","last_undegraded":"2024-08-19T00:38:54.338863+0000","last_fullsized":"2024-08-19T00:38:54.338863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347492+0000","last_change":"2024-08-19T00:38:54.344307+0000","last_active":"2024-08-19T00:38:54.347492+0000","last_peered":"2024-08-19T00:38:54.347492+0000","last_clean":"2024-08-19T00:38:54.347492+0000","last_became_active":"2024-08-19T00:38:54.344000+0000","last_became_peered":"2024-08-19T00:38:54.344000+0000","last_unstale":"2024-08-19T00:38:54.347492+0000","last_undegraded":"2024-08-19T00:38:54.347492+0000","last_fullsized":"2024-08-19T00:38:54.347492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335032+0000","last_change":"2024-08-19T00:38:54.335032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335032+0000","last_undegraded":"2024-08-19T00:38:54.335032+0000","last_fullsized":"2024-08-19T00:38:54.335032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351397+0000","last_change":"2024-08-19T00:38:54.347355+0000","last_active":"2024-08-19T00:38:54.351397+0000","last_peered":"2024-08-19T00:38:54.351397+0000","last_clean":"2024-08-19T00:38:54.351397+0000","last_became_active":"2024-08-19T00:38:54.344875+0000","last_became_peered":"2024-08-19T00:38:54.344875+0000","last_unstale":"2024-08-19T00:38:54.351397+0000","last_undegraded":"2024-08-19T00:38:54.351397+0000","last_fullsized":"2024-08-19T00:38:54.351397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:41.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333712+0000","last_change":"2024-08-19T00:38:54.333712+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333712+0000","last_undegraded":"2024-08-19T00:38:54.333712+0000","last_fullsized":"2024-08-19T00:38:54.333712+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355804+0000","last_change":"2024-08-19T00:38:54.351964+0000","last_active":"2024-08-19T00:38:54.355804+0000","last_peered":"2024-08-19T00:38:54.355804+0000","last_clean":"2024-08-19T00:38:54.355804+0000","last_became_active":"2024-08-19T00:38:54.351662+0000","last_became_peered":"2024-08-19T00:38:54.351662+0000","last_unstale":"2024-08-19T00:38:54.355804+0000","last_undegraded":"2024-08-19T00:38:54.355804+0000","last_fullsized":"2024-08-19T00:38:54.355804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:33.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334857+0000","last_change":"2024-08-19T00:38:54.334857+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334857+0000","last_undegraded":"2024-08-19T00:38:54.334857+0000","last_fullsized":"2024-08-19T00:38:54.334857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349339+0000","last_change":"2024-08-19T00:38:54.347070+0000","last_active":"2024-08-19T00:38:54.349339+0000","last_peered":"2024-08-19T00:38:54.349339+0000","last_clean":"2024-08-19T00:38:54.349339+0000","last_became_active":"2024-08-19T00:38:54.346775+0000","last_became_peered":"2024-08-19T00:38:54.346775+0000","last_unstale":"2024-08-19T00:38:54.349339+0000","last_undegraded":"2024-08-19T00:38:54.349339+0000","last_fullsized":"2024-08-19T00:38:54.349339+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334475+0000","last_change":"2024-08-19T00:38:54.334475+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334475+0000","last_undegraded":"2024-08-19T00:38:54.334475+0000","last_fullsized":"2024-08-19T00:38:54.334475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348664+0000","last_change":"2024-08-19T00:38:54.346097+0000","last_active":"2024-08-19T00:38:54.348664+0000","last_peered":"2024-08-19T00:38:54.348664+0000","last_clean":"2024-08-19T00:38:54.348664+0000","last_became_active":"2024-08-19T00:38:54.343893+0000","last_became_peered":"2024-08-19T00:38:54.343893+0000","last_unstale":"2024-08-19T00:38:54.348664+0000","last_undegraded":"2024-08-19T00:38:54.348664+0000","last_fullsized":"2024-08-19T00:38:54.348664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334848+0000","last_change":"2024-08-19T00:38:54.334848+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334848+0000","last_undegraded":"2024-08-19T00:38:54.334848+0000","last_fullsized":"2024-08-19T00:38:54.334848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345005+0000","last_change":"2024-08-19T00:38:54.343418+0000","last_active":"2024-08-19T00:38:54.345005+0000","last_peered":"2024-08-19T00:38:54.345005+0000","last_clean":"2024-08-19T00:38:54.345005+0000","last_became_active":"2024-08-19T00:38:54.343059+0000","last_became_peered":"2024-08-19T00:38:54.343059+0000","last_unstale":"2024-08-19T00:38:54.345005+0000","last_undegraded":"2024-08-19T00:38:54.345005+0000","last_fullsized":"2024-08-19T00:38:54.345005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327674+0000","last_change":"2024-08-19T00:38:54.327674+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327674+0000","last_undegraded":"2024-08-19T00:38:54.327674+0000","last_fullsized":"2024-08-19T00:38:54.327674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351568+0000","last_change":"2024-08-19T00:38:54.345428+0000","last_active":"2024-08-19T00:38:54.351568+0000","last_peered":"2024-08-19T00:38:54.351568+0000","last_clean":"2024-08-19T00:38:54.351568+0000","last_became_active":"2024-08-19T00:38:54.345122+0000","last_became_peered":"2024-08-19T00:38:54.345122+0000","last_unstale":"2024-08-19T00:38:54.351568+0000","last_undegraded":"2024-08-19T00:38:54.351568+0000","last_fullsized":"2024-08-19T00:38:54.351568+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:02.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327761+0000","last_change":"2024-08-19T00:38:54.327761+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327761+0000","last_undegraded":"2024-08-19T00:38:54.327761+0000","last_fullsized":"2024-08-19T00:38:54.327761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351561+0000","last_change":"2024-08-19T00:38:54.349434+0000","last_active":"2024-08-19T00:38:54.351561+0000","last_peered":"2024-08-19T00:38:54.351561+0000","last_clean":"2024-08-19T00:38:54.351561+0000","last_became_active":"2024-08-19T00:38:54.349177+0000","last_became_peered":"2024-08-19T00:38:54.349177+0000","last_unstale":"2024-08-19T00:38:54.351561+0000","last_undegraded":"2024-08-19T00:38:54.351561+0000","last_fullsized":"2024-08-19T00:38:54.351561+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:33.953532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.330173+0000","last_change":"2024-08-19T00:38:54.330173+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.330173+0000","last_undegraded":"2024-08-19T00:38:54.330173+0000","last_fullsized":"2024-08-19T00:38:54.330173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.350762+0000","last_change":"2024-08-19T00:38:54.346829+0000","last_active":"2024-08-19T00:38:54.350762+0000","last_peered":"2024-08-19T00:38:54.350762+0000","last_clean":"2024-08-19T00:38:54.350762+0000","last_became_active":"2024-08-19T00:38:54.346572+0000","last_became_peered":"2024-08-19T00:38:54.346572+0000","last_unstale":"2024-08-19T00:38:54.350762+0000","last_undegraded":"2024-08-19T00:38:54.350762+0000","last_fullsized":"2024-08-19T00:38:54.350762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:11.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327714+0000","last_change":"2024-08-19T00:38:54.327714+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327714+0000","last_undegraded":"2024-08-19T00:38:54.327714+0000","last_fullsized":"2024-08-19T00:38:54.327714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355542+0000","last_change":"2024-08-19T00:38:54.349597+0000","last_active":"2024-08-19T00:38:54.355542+0000","last_peered":"2024-08-19T00:38:54.355542+0000","last_clean":"2024-08-19T00:38:54.355542+0000","last_became_active":"2024-08-19T00:38:54.348927+0000","last_became_peered":"2024-08-19T00:38:54.348927+0000","last_unstale":"2024-08-19T00:38:54.355542+0000","last_undegraded":"2024-08-19T00:38:54.355542+0000","last_fullsized":"2024-08-19T00:38:54.355542+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327936+0000","last_change":"2024-08-19T00:38:54.327936+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327936+0000","last_undegraded":"2024-08-19T00:38:54.327936+0000","last_fullsized":"2024-08-19T00:38:54.327936+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351282+0000","last_change":"2024-08-19T00:38:54.346271+0000","last_active":"2024-08-19T00:38:54.351282+0000","last_peered":"2024-08-19T00:38:54.351282+0000","last_clean":"2024-08-19T00:38:54.351282+0000","last_became_active":"2024-08-19T00:38:54.346017+0000","last_became_peered":"2024-08-19T00:38:54.346017+0000","last_unstale":"2024-08-19T00:38:54.351282+0000","last_undegraded":"2024-08-19T00:38:54.351282+0000","last_fullsized":"2024-08-19T00:38:54.351282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:24.124584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352750+0000","last_change":"2024-08-19T00:38:54.350148+0000","last_active":"2024-08-19T00:38:54.352750+0000","last_peered":"2024-08-19T00:38:54.352750+0000","last_clean":"2024-08-19T00:38:54.352750+0000","last_became_active":"2024-08-19T00:38:54.347799+0000","last_became_peered":"2024-08-19T00:38:54.347799+0000","last_unstale":"2024-08-19T00:38:54.352750+0000","last_undegraded":"2024-08-19T00:38:54.352750+0000","last_fullsized":"2024-08-19T00:38:54.352750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332636+0000","last_change":"2024-08-19T00:38:54.332636+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332636+0000","last_undegraded":"2024-08-19T00:38:54.332636+0000","last_fullsized":"2024-08-19T00:38:54.332636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353008+0000","last_change":"2024-08-19T00:38:54.350844+0000","last_active":"2024-08-19T00:38:54.353008+0000","last_peered":"2024-08-19T00:38:54.353008+0000","last_clean":"2024-08-19T00:38:54.353008+0000","last_became_active":"2024-08-19T00:38:54.350579+0000","last_became_peered":"2024-08-19T00:38:54.350579+0000","last_unstale":"2024-08-19T00:38:54.353008+0000","last_undegraded":"2024-08-19T00:38:54.353008+0000","last_fullsized":"2024-08-19T00:38:54.353008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:22.283543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333016+0000","last_change":"2024-08-19T00:38:54.333016+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333016+0000","last_undegraded":"2024-08-19T00:38:54.333016+0000","last_fullsized":"2024-08-19T00:38:54.333016+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355810+0000","last_change":"2024-08-19T00:38:54.351955+0000","last_active":"2024-08-19T00:38:54.355810+0000","last_peered":"2024-08-19T00:38:54.355810+0000","last_clean":"2024-08-19T00:38:54.355810+0000","last_became_active":"2024-08-19T00:38:54.351347+0000","last_became_peered":"2024-08-19T00:38:54.351347+0000","last_unstale":"2024-08-19T00:38:54.355810+0000","last_undegraded":"2024-08-19T00:38:54.355810+0000","last_fullsized":"2024-08-19T00:38:54.355810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:37.514345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334051+0000","last_change":"2024-08-19T00:38:54.334051+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334051+0000","last_undegraded":"2024-08-19T00:38:54.334051+0000","last_fullsized":"2024-08-19T00:38:54.334051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353746+0000","last_change":"2024-08-19T00:38:54.351507+0000","last_active":"2024-08-19T00:38:54.353746+0000","last_peered":"2024-08-19T00:38:54.353746+0000","last_clean":"2024-08-19T00:38:54.353746+0000","last_became_active":"2024-08-19T00:38:54.350965+0000","last_became_peered":"2024-08-19T00:38:54.350965+0000","last_unstale":"2024-08-19T00:38:54.353746+0000","last_undegraded":"2024-08-19T00:38:54.353746+0000","last_fullsized":"2024-08-19T00:38:54.353746+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333801+0000","last_change":"2024-08-19T00:38:54.333801+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333801+0000","last_undegraded":"2024-08-19T00:38:54.333801+0000","last_fullsized":"2024-08-19T00:38:54.333801+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348609+0000","last_change":"2024-08-19T00:38:54.345173+0000","last_active":"2024-08-19T00:38:54.348609+0000","last_peered":"2024-08-19T00:38:54.348609+0000","last_clean":"2024-08-19T00:38:54.348609+0000","last_became_active":"2024-08-19T00:38:54.344931+0000","last_became_peered":"2024-08-19T00:38:54.344931+0000","last_unstale":"2024-08-19T00:38:54.348609+0000","last_undegraded":"2024-08-19T00:38:54.348609+0000","last_fullsized":"2024-08-19T00:38:54.348609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333830+0000","last_change":"2024-08-19T00:38:54.333830+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333830+0000","last_undegraded":"2024-08-19T00:38:54.333830+0000","last_fullsized":"2024-08-19T00:38:54.333830+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347685+0000","last_change":"2024-08-19T00:38:54.345007+0000","last_active":"2024-08-19T00:38:54.347685+0000","last_peered":"2024-08-19T00:38:54.347685+0000","last_clean":"2024-08-19T00:38:54.347685+0000","last_became_active":"2024-08-19T00:38:54.344731+0000","last_became_peered":"2024-08-19T00:38:54.344731+0000","last_unstale":"2024-08-19T00:38:54.347685+0000","last_undegraded":"2024-08-19T00:38:54.347685+0000","last_fullsized":"2024-08-19T00:38:54.347685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:44.571404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331845+0000","last_change":"2024-08-19T00:38:54.331845+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331845+0000","last_undegraded":"2024-08-19T00:38:54.331845+0000","last_fullsized":"2024-08-19T00:38:54.331845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355552+0000","last_change":"2024-08-19T00:38:54.349998+0000","last_active":"2024-08-19T00:38:54.355552+0000","last_peered":"2024-08-19T00:38:54.355552+0000","last_clean":"2024-08-19T00:38:54.355552+0000","last_became_active":"2024-08-19T00:38:54.349609+0000","last_became_peered":"2024-08-19T00:38:54.349609+0000","last_unstale":"2024-08-19T00:38:54.355552+0000","last_undegraded":"2024-08-19T00:38:54.355552+0000","last_fullsized":"2024-08-19T00:38:54.355552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332706+0000","last_change":"2024-08-19T00:38:54.332706+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332706+0000","last_undegraded":"2024-08-19T00:38:54.332706+0000","last_fullsized":"2024-08-19T00:38:54.332706+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.354351+0000","last_change":"2024-08-19T00:38:54.353417+0000","last_active":"2024-08-19T00:38:54.354351+0000","last_peered":"2024-08-19T00:38:54.354351+0000","last_clean":"2024-08-19T00:38:54.354351+0000","last_became_active":"2024-08-19T00:38:54.353149+0000","last_became_peered":"2024-08-19T00:38:54.353149+0000","last_unstale":"2024-08-19T00:38:54.354351+0000","last_undegraded":"2024-08-19T00:38:54.354351+0000","last_fullsized":"2024-08-19T00:38:54.354351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331627+0000","last_change":"2024-08-19T00:38:54.331627+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331627+0000","last_undegraded":"2024-08-19T00:38:54.331627+0000","last_fullsized":"2024-08-19T00:38:54.331627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351748+0000","last_change":"2024-08-19T00:38:54.348067+0000","last_active":"2024-08-19T00:38:54.351748+0000","last_peered":"2024-08-19T00:38:54.351748+0000","last_clean":"2024-08-19T00:38:54.351748+0000","last_became_active":"2024-08-19T00:38:54.347686+0000","last_became_peered":"2024-08-19T00:38:54.347686+0000","last_unstale":"2024-08-19T00:38:54.351748+0000","last_undegraded":"2024-08-19T00:38:54.351748+0000","last_fullsized":"2024-08-19T00:38:54.351748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:35.960033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332614+0000","last_change":"2024-08-19T00:38:54.332614+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332614+0000","last_undegraded":"2024-08-19T00:38:54.332614+0000","last_fullsized":"2024-08-19T00:38:54.332614+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353010+0000","last_change":"2024-08-19T00:38:54.348542+0000","last_active":"2024-08-19T00:38:54.353010+0000","last_peered":"2024-08-19T00:38:54.353010+0000","last_clean":"2024-08-19T00:38:54.353010+0000","last_became_active":"2024-08-19T00:38:54.348292+0000","last_became_peered":"2024-08-19T00:38:54.348292+0000","last_unstale":"2024-08-19T00:38:54.353010+0000","last_undegraded":"2024-08-19T00:38:54.353010+0000","last_fullsized":"2024-08-19T00:38:54.353010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:23.899300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333244+0000","last_change":"2024-08-19T00:38:54.333244+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333244+0000","last_undegraded":"2024-08-19T00:38:54.333244+0000","last_fullsized":"2024-08-19T00:38:54.333244+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351059+0000","last_change":"2024-08-19T00:38:54.347335+0000","last_active":"2024-08-19T00:38:54.351059+0000","last_peered":"2024-08-19T00:38:54.351059+0000","last_clean":"2024-08-19T00:38:54.351059+0000","last_became_active":"2024-08-19T00:38:54.347065+0000","last_became_peered":"2024-08-19T00:38:54.347065+0000","last_unstale":"2024-08-19T00:38:54.351059+0000","last_undegraded":"2024-08-19T00:38:54.351059+0000","last_fullsized":"2024-08-19T00:38:54.351059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:14:02.952709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334134+0000","last_change":"2024-08-19T00:38:54.334134+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334134+0000","last_undegraded":"2024-08-19T00:38:54.334134+0000","last_fullsized":"2024-08-19T00:38:54.334134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352292+0000","last_change":"2024-08-19T00:38:54.350331+0000","last_active":"2024-08-19T00:38:54.352292+0000","last_peered":"2024-08-19T00:38:54.352292+0000","last_clean":"2024-08-19T00:38:54.352292+0000","last_became_active":"2024-08-19T00:38:54.349006+0000","last_became_peered":"2024-08-19T00:38:54.349006+0000","last_unstale":"2024-08-19T00:38:54.352292+0000","last_undegraded":"2024-08-19T00:38:54.352292+0000","last_fullsized":"2024-08-19T00:38:54.352292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:18.045159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352684+0000","last_change":"2024-08-19T00:38:54.351356+0000","last_active":"2024-08-19T00:38:54.352684+0000","last_peered":"2024-08-19T00:38:54.352684+0000","last_clean":"2024-08-19T00:38:54.352684+0000","last_became_active":"2024-08-19T00:38:54.350850+0000","last_became_peered":"2024-08-19T00:38:54.350850+0000","last_unstale":"2024-08-19T00:38:54.352684+0000","last_undegraded":"2024-08-19T00:38:54.352684+0000","last_fullsized":"2024-08-19T00:38:54.352684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:51.200617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338008+0000","last_change":"2024-08-19T00:38:54.338008+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338008+0000","last_undegraded":"2024-08-19T00:38:54.338008+0000","last_fullsized":"2024-08-19T00:38:54.338008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351347+0000","last_change":"2024-08-19T00:38:54.347205+0000","last_active":"2024-08-19T00:38:54.351347+0000","last_peered":"2024-08-19T00:38:54.351347+0000","last_clean":"2024-08-19T00:38:54.351347+0000","last_became_active":"2024-08-19T00:38:54.344536+0000","last_became_peered":"2024-08-19T00:38:54.344536+0000","last_unstale":"2024-08-19T00:38:54.351347+0000","last_undegraded":"2024-08-19T00:38:54.351347+0000","last_fullsized":"2024-08-19T00:38:54.351347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:33.298522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.339486+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:38:54.339486+0000","last_peered":"2024-08-19T00:38:54.339486+0000","last_clean":"2024-08-19T00:38:54.339486+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:38:54.339486+0000","last_undegraded":"2024-08-19T00:38:54.339486+0000","last_fullsized":"2024-08-19T00:38:54.339486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:38:59.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:00.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.183+0000 7f1640000640 1 Processor -- start 2024-08-19T00:39:00.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.183+0000 7f1640000640 1 -- start start 2024-08-19T00:39:00.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f1640000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16380d03c0 0x7f1638071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f1640000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f1640000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16380cdfb0 con 0x7f163806e710 2024-08-19T00:39:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f1640000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f16380cebc0 con 0x7f16380d03c0 2024-08-19T00:39:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f1640000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16380ce290 con 0x7f16380b3750 2024-08-19T00:39:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163d600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16380d03c0 0x7f1638071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163d600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16380d03c0 0x7f1638071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60552/0 (socket says 172.21.15.7:60552) 2024-08-19T00:39:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163d600640 1 -- 172.21.15.7:0/3679030551 learned_addr learned my addr 172.21.15.7:0/3679030551 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163e000640 1 --2- 172.21.15.7:0/3679030551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163d600640 1 -- 172.21.15.7:0/3679030551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 msgr2=0x7f16380cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163d600640 1 --2- 172.21.15.7:0/3679030551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163d600640 1 -- 172.21.15.7:0/3679030551 >> v1:172.21.15.7:6789/0 conn(0x7f163806e710 legacy=0x7f16380d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163d600640 1 -- 172.21.15.7:0/3679030551 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16380ce570 con 0x7f16380d03c0 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f1637e00640 1 -- 172.21.15.7:0/3679030551 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711268839 0 0) 0x7f16380cdfb0 con 0x7f163806e710 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.185+0000 7f163e000640 1 --2- 172.21.15.7:0/3679030551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.186+0000 7f163d600640 1 --2- 172.21.15.7:0/3679030551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16380d03c0 0x7f1638071980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f162c0098a0 tx=0x7f162c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d39ee6e17fe5c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:00.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1637e00640 1 -- 172.21.15.7:0/3679030551 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c037070 con 0x7f16380d03c0 2024-08-19T00:39:00.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1637e00640 1 -- 172.21.15.7:0/3679030551 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162c032440 con 0x7f16380d03c0 2024-08-19T00:39:00.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1637e00640 1 -- 172.21.15.7:0/3679030551 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c032810 con 0x7f16380d03c0 2024-08-19T00:39:00.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 -- 172.21.15.7:0/3679030551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16380d03c0 msgr2=0x7f1638071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 --2- 172.21.15.7:0/3679030551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16380d03c0 0x7f1638071980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f162c0098a0 tx=0x7f162c02a290 comp rx=0 tx=0).stop 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 -- 172.21.15.7:0/3679030551 shutdown_connections 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 --2- 172.21.15.7:0/3679030551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 --2- 172.21.15.7:0/3679030551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16380d03c0 0x7f1638071980 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 -- 172.21.15.7:0/3679030551 >> 172.21.15.7:0/3679030551 conn(0x7f163806bc70 msgr2=0x7f163806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 -- 172.21.15.7:0/3679030551 shutdown_connections 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.187+0000 7f1640000640 1 -- 172.21.15.7:0/3679030551 wait complete. 2024-08-19T00:39:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.189+0000 7f1640000640 1 Processor -- start 2024-08-19T00:39:00.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.189+0000 7f1640000640 1 -- start start 2024-08-19T00:39:00.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f1640000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f163806e710 0x7f16381f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f1640000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f1640000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16380d03c0 0x7f163815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f1640000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1638073c60 con 0x7f163806e710 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f1640000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1638073ae0 con 0x7f16380d03c0 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f1640000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16380b3be0 con 0x7f16380b3750 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f163d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f163806e710 0x7f16381f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f163d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f163806e710 0x7f16381f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60564/0 (socket says 172.21.15.7:60564) 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.190+0000 7f163d600640 1 -- 172.21.15.7:0/1164080201 learned_addr learned my addr 172.21.15.7:0/1164080201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163cc00640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163d600640 1 -- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 msgr2=0x7f16380cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163e000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16380d03c0 0x7f163815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163d600640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163d600640 1 -- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16380d03c0 msgr2=0x7f163815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163d600640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16380d03c0 0x7f163815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163d600640 1 -- 172.21.15.7:0/1164080201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16381f4530 con 0x7f163806e710 2024-08-19T00:39:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163cc00640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163e000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16380d03c0 0x7f163815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f163d600640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f163806e710 0x7f16381f8560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f162c0097c0 tx=0x7f162c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f1635600640 1 -- 172.21.15.7:0/1164080201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c041070 con 0x7f163806e710 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f1635600640 1 -- 172.21.15.7:0/1164080201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162c004220 con 0x7f163806e710 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f1635600640 1 -- 172.21.15.7:0/1164080201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c037040 con 0x7f163806e710 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.191+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16381f47e0 con 0x7f163806e710 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.192+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16381f4da0 con 0x7f163806e710 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.193+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16380b3230 con 0x7f163806e710 2024-08-19T00:39:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.194+0000 7f1635600640 1 -- 172.21.15.7:0/1164080201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f162c003610 con 0x7f163806e710 2024-08-19T00:39:00.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.194+0000 7f1635600640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f161806be30 0x7f161806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.194+0000 7f1635600640 1 -- 172.21.15.7:0/1164080201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f162c0ab800 con 0x7f163806e710 2024-08-19T00:39:00.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.195+0000 7f163cc00640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f161806be30 0x7f161806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.195+0000 7f163cc00640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f161806be30 0x7f161806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f16380b46b0 tx=0x7f1624009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:00.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.199+0000 7f1635600640 1 -- 172.21.15.7:0/1164080201 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f16380b3230 con 0x7f163806e710 2024-08-19T00:39:00.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.382+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1638072a80 con 0x7f161806be30 2024-08-19T00:39:00.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.388+0000 7f1635600640 1 -- 172.21.15.7:0/1164080201 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7f1638072a80 con 0x7f161806be30 2024-08-19T00:39:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:00.394 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f161806be30 msgr2=0x7f161806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f161806be30 0x7f161806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f16380b46b0 tx=0x7f1624009040 comp rx=0 tx=0).stop 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f163806e710 msgr2=0x7f16381f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f163806e710 0x7f16381f8560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f162c0097c0 tx=0x7f162c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 shutdown_connections 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f161806be30 0x7f161806e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16380d03c0 0x7f163815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16380b3750 0x7f16380cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 --2- 172.21.15.7:0/1164080201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f163806e710 0x7f16381f8560 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 >> 172.21.15.7:0/1164080201 conn(0x7f163806bc70 msgr2=0x7f16380aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 shutdown_connections 2024-08-19T00:39:00.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.392+0000 7f1640000640 1 -- 172.21.15.7:0/1164080201 wait complete. 2024-08-19T00:39:00.409 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-08-19T00:38:59.282309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237928,"kb_used_data":5096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736792,"statfs":{"total":773094113280,"available":772850475008,"internally_reserved":0,"allocated":5218304,"data_stored":2796240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.961367"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335384+0000","last_change":"2024-08-19T00:38:54.335384+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335384+0000","last_undegraded":"2024-08-19T00:38:54.335384+0000","last_fullsized":"2024-08-19T00:38:54.335384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328224+0000","last_change":"2024-08-19T00:38:54.328224+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328224+0000","last_undegraded":"2024-08-19T00:38:54.328224+0000","last_fullsized":"2024-08-19T00:38:54.328224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333407+0000","last_change":"2024-08-19T00:38:54.333407+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333407+0000","last_undegraded":"2024-08-19T00:38:54.333407+0000","last_fullsized":"2024-08-19T00:38:54.333407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335655+0000","last_change":"2024-08-19T00:38:54.335655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335655+0000","last_undegraded":"2024-08-19T00:38:54.335655+0000","last_fullsized":"2024-08-19T00:38:54.335655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335775+0000","last_change":"2024-08-19T00:38:54.335775+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335775+0000","last_undegraded":"2024-08-19T00:38:54.335775+0000","last_fullsized":"2024-08-19T00:38:54.335775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332729+0000","last_change":"2024-08-19T00:38:54.332729+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332729+0000","last_undegraded":"2024-08-19T00:38:54.332729+0000","last_fullsized":"2024-08-19T00:38:54.332729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.340397+0000","last_change":"2024-08-19T00:38:54.340397+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.340397+0000","last_undegraded":"2024-08-19T00:38:54.340397+0000","last_fullsized":"2024-08-19T00:38:54.340397+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334758+0000","last_change":"2024-08-19T00:38:54.334758+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334758+0000","last_undegraded":"2024-08-19T00:38:54.334758+0000","last_fullsized":"2024-08-19T00:38:54.334758+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334622+0000","last_change":"2024-08-19T00:38:54.334622+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334622+0000","last_undegraded":"2024-08-19T00:38:54.334622+0000","last_fullsized":"2024-08-19T00:38:54.334622+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332055+0000","last_change":"2024-08-19T00:38:54.332055+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332055+0000","last_undegraded":"2024-08-19T00:38:54.332055+0000","last_fullsized":"2024-08-19T00:38:54.332055+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338588+0000","last_change":"2024-08-19T00:38:54.338588+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338588+0000","last_undegraded":"2024-08-19T00:38:54.338588+0000","last_fullsized":"2024-08-19T00:38:54.338588+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.329187+0000","last_change":"2024-08-19T00:38:54.329187+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.329187+0000","last_undegraded":"2024-08-19T00:38:54.329187+0000","last_fullsized":"2024-08-19T00:38:54.329187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334469+0000","last_change":"2024-08-19T00:38:54.334469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334469+0000","last_undegraded":"2024-08-19T00:38:54.334469+0000","last_fullsized":"2024-08-19T00:38:54.334469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334235+0000","last_change":"2024-08-19T00:38:54.334235+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334235+0000","last_undegraded":"2024-08-19T00:38:54.334235+0000","last_fullsized":"2024-08-19T00:38:54.334235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334310+0000","last_change":"2024-08-19T00:38:54.334310+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334310+0000","last_undegraded":"2024-08-19T00:38:54.334310+0000","last_fullsized":"2024-08-19T00:38:54.334310+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333331+0000","last_change":"2024-08-19T00:38:54.333331+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333331+0000","last_undegraded":"2024-08-19T00:38:54.333331+0000","last_fullsized":"2024-08-19T00:38:54.333331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328641+0000","last_change":"2024-08-19T00:38:54.328641+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328641+0000","last_undegraded":"2024-08-19T00:38:54.328641+0000","last_fullsized":"2024-08-19T00:38:54.328641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335469+0000","last_change":"2024-08-19T00:38:54.335469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335469+0000","last_undegraded":"2024-08-19T00:38:54.335469+0000","last_fullsized":"2024-08-19T00:38:54.335469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.341032+0000","last_change":"2024-08-19T00:38:54.341032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.341032+0000","last_undegraded":"2024-08-19T00:38:54.341032+0000","last_fullsized":"2024-08-19T00:38:54.341032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333144+0000","last_change":"2024-08-19T00:38:54.333144+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333144+0000","last_undegraded":"2024-08-19T00:38:54.333144+0000","last_fullsized":"2024-08-19T00:38:54.333144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331994+0000","last_change":"2024-08-19T00:38:54.331994+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331994+0000","last_undegraded":"2024-08-19T00:38:54.331994+0000","last_fullsized":"2024-08-19T00:38:54.331994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327655+0000","last_change":"2024-08-19T00:38:54.327655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327655+0000","last_undegraded":"2024-08-19T00:38:54.327655+0000","last_fullsized":"2024-08-19T00:38:54.327655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339928+0000","last_change":"2024-08-19T00:38:54.339928+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339928+0000","last_undegraded":"2024-08-19T00:38:54.339928+0000","last_fullsized":"2024-08-19T00:38:54.339928+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327851+0000","last_change":"2024-08-19T00:38:54.327851+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327851+0000","last_undegraded":"2024-08-19T00:38:54.327851+0000","last_fullsized":"2024-08-19T00:38:54.327851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334914+0000","last_change":"2024-08-19T00:38:54.334914+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334914+0000","last_undegraded":"2024-08-19T00:38:54.334914+0000","last_fullsized":"2024-08-19T00:38:54.334914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338520+0000","last_change":"2024-08-19T00:38:54.338520+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338520+0000","last_undegraded":"2024-08-19T00:38:54.338520+0000","last_fullsized":"2024-08-19T00:38:54.338520+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339452+0000","last_change":"2024-08-19T00:38:54.339452+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339452+0000","last_undegraded":"2024-08-19T00:38:54.339452+0000","last_fullsized":"2024-08-19T00:38:54.339452+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334985+0000","last_change":"2024-08-19T00:38:54.334985+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334985+0000","last_undegraded":"2024-08-19T00:38:54.334985+0000","last_fullsized":"2024-08-19T00:38:54.334985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335274+0000","last_change":"2024-08-19T00:38:54.335274+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335274+0000","last_undegraded":"2024-08-19T00:38:54.335274+0000","last_fullsized":"2024-08-19T00:38:54.335274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327840+0000","last_change":"2024-08-19T00:38:54.327840+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327840+0000","last_undegraded":"2024-08-19T00:38:54.327840+0000","last_fullsized":"2024-08-19T00:38:54.327840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332340+0000","last_change":"2024-08-19T00:38:54.332340+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332340+0000","last_undegraded":"2024-08-19T00:38:54.332340+0000","last_fullsized":"2024-08-19T00:38:54.332340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334261+0000","last_change":"2024-08-19T00:38:54.334261+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334261+0000","last_undegraded":"2024-08-19T00:38:54.334261+0000","last_fullsized":"2024-08-19T00:38:54.334261+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328352+0000","last_change":"2024-08-19T00:38:54.328352+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328352+0000","last_undegraded":"2024-08-19T00:38:54.328352+0000","last_fullsized":"2024-08-19T00:38:54.328352+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352999+0000","last_change":"2024-08-19T00:38:54.351258+0000","last_active":"2024-08-19T00:38:54.352999+0000","last_peered":"2024-08-19T00:38:54.352999+0000","last_clean":"2024-08-19T00:38:54.352999+0000","last_became_active":"2024-08-19T00:38:54.350541+0000","last_became_peered":"2024-08-19T00:38:54.350541+0000","last_unstale":"2024-08-19T00:38:54.352999+0000","last_undegraded":"2024-08-19T00:38:54.352999+0000","last_fullsized":"2024-08-19T00:38:54.352999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.639154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334112+0000","last_change":"2024-08-19T00:38:54.334112+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334112+0000","last_undegraded":"2024-08-19T00:38:54.334112+0000","last_fullsized":"2024-08-19T00:38:54.334112+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345500+0000","last_change":"2024-08-19T00:38:54.341106+0000","last_active":"2024-08-19T00:38:54.345500+0000","last_peered":"2024-08-19T00:38:54.345500+0000","last_clean":"2024-08-19T00:38:54.345500+0000","last_became_active":"2024-08-19T00:38:54.340815+0000","last_became_peered":"2024-08-19T00:38:54.340815+0000","last_unstale":"2024-08-19T00:38:54.345500+0000","last_undegraded":"2024-08-19T00:38:54.345500+0000","last_fullsized":"2024-08-19T00:38:54.345500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:30.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328756+0000","last_change":"2024-08-19T00:38:54.328756+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328756+0000","last_undegraded":"2024-08-19T00:38:54.328756+0000","last_fullsized":"2024-08-19T00:38:54.328756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348652+0000","last_change":"2024-08-19T00:38:54.347121+0000","last_active":"2024-08-19T00:38:54.348652+0000","last_peered":"2024-08-19T00:38:54.348652+0000","last_clean":"2024-08-19T00:38:54.348652+0000","last_became_active":"2024-08-19T00:38:54.346853+0000","last_became_peered":"2024-08-19T00:38:54.346853+0000","last_unstale":"2024-08-19T00:38:54.348652+0000","last_undegraded":"2024-08-19T00:38:54.348652+0000","last_fullsized":"2024-08-19T00:38:54.348652+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:07.935034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338096+0000","last_change":"2024-08-19T00:38:54.338096+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338096+0000","last_undegraded":"2024-08-19T00:38:54.338096+0000","last_fullsized":"2024-08-19T00:38:54.338096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.341600+0000","last_change":"2024-08-19T00:38:54.336448+0000","last_active":"2024-08-19T00:38:54.341600+0000","last_peered":"2024-08-19T00:38:54.341600+0000","last_clean":"2024-08-19T00:38:54.341600+0000","last_became_active":"2024-08-19T00:38:54.336119+0000","last_became_peered":"2024-08-19T00:38:54.336119+0000","last_unstale":"2024-08-19T00:38:54.341600+0000","last_undegraded":"2024-08-19T00:38:54.341600+0000","last_fullsized":"2024-08-19T00:38:54.341600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:46.926817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.337044+0000","last_change":"2024-08-19T00:38:54.337044+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.337044+0000","last_undegraded":"2024-08-19T00:38:54.337044+0000","last_fullsized":"2024-08-19T00:38:54.337044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345864+0000","last_change":"2024-08-19T00:38:54.342546+0000","last_active":"2024-08-19T00:38:54.345864+0000","last_peered":"2024-08-19T00:38:54.345864+0000","last_clean":"2024-08-19T00:38:54.345864+0000","last_became_active":"2024-08-19T00:38:54.342242+0000","last_became_peered":"2024-08-19T00:38:54.342242+0000","last_unstale":"2024-08-19T00:38:54.345864+0000","last_undegraded":"2024-08-19T00:38:54.345864+0000","last_fullsized":"2024-08-19T00:38:54.345864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:27:30.743408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331833+0000","last_change":"2024-08-19T00:38:54.331833+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331833+0000","last_undegraded":"2024-08-19T00:38:54.331833+0000","last_fullsized":"2024-08-19T00:38:54.331833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352208+0000","last_change":"2024-08-19T00:38:54.349377+0000","last_active":"2024-08-19T00:38:54.352208+0000","last_peered":"2024-08-19T00:38:54.352208+0000","last_clean":"2024-08-19T00:38:54.352208+0000","last_became_active":"2024-08-19T00:38:54.349118+0000","last_became_peered":"2024-08-19T00:38:54.349118+0000","last_unstale":"2024-08-19T00:38:54.352208+0000","last_undegraded":"2024-08-19T00:38:54.352208+0000","last_fullsized":"2024-08-19T00:38:54.352208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:44.945873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.336940+0000","last_change":"2024-08-19T00:38:54.336940+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.336940+0000","last_undegraded":"2024-08-19T00:38:54.336940+0000","last_fullsized":"2024-08-19T00:38:54.336940+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349712+0000","last_change":"2024-08-19T00:38:54.344490+0000","last_active":"2024-08-19T00:38:54.349712+0000","last_peered":"2024-08-19T00:38:54.349712+0000","last_clean":"2024-08-19T00:38:54.349712+0000","last_became_active":"2024-08-19T00:38:54.344198+0000","last_became_peered":"2024-08-19T00:38:54.344198+0000","last_unstale":"2024-08-19T00:38:54.349712+0000","last_undegraded":"2024-08-19T00:38:54.349712+0000","last_fullsized":"2024-08-19T00:38:54.349712+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338863+0000","last_change":"2024-08-19T00:38:54.338863+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338863+0000","last_undegraded":"2024-08-19T00:38:54.338863+0000","last_fullsized":"2024-08-19T00:38:54.338863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347492+0000","last_change":"2024-08-19T00:38:54.344307+0000","last_active":"2024-08-19T00:38:54.347492+0000","last_peered":"2024-08-19T00:38:54.347492+0000","last_clean":"2024-08-19T00:38:54.347492+0000","last_became_active":"2024-08-19T00:38:54.344000+0000","last_became_peered":"2024-08-19T00:38:54.344000+0000","last_unstale":"2024-08-19T00:38:54.347492+0000","last_undegraded":"2024-08-19T00:38:54.347492+0000","last_fullsized":"2024-08-19T00:38:54.347492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335032+0000","last_change":"2024-08-19T00:38:54.335032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335032+0000","last_undegraded":"2024-08-19T00:38:54.335032+0000","last_fullsized":"2024-08-19T00:38:54.335032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351397+0000","last_change":"2024-08-19T00:38:54.347355+0000","last_active":"2024-08-19T00:38:54.351397+0000","last_peered":"2024-08-19T00:38:54.351397+0000","last_clean":"2024-08-19T00:38:54.351397+0000","last_became_active":"2024-08-19T00:38:54.344875+0000","last_became_peered":"2024-08-19T00:38:54.344875+0000","last_unstale":"2024-08-19T00:38:54.351397+0000","last_undegraded":"2024-08-19T00:38:54.351397+0000","last_fullsized":"2024-08-19T00:38:54.351397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:41.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333712+0000","last_change":"2024-08-19T00:38:54.333712+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333712+0000","last_undegraded":"2024-08-19T00:38:54.333712+0000","last_fullsized":"2024-08-19T00:38:54.333712+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355804+0000","last_change":"2024-08-19T00:38:54.351964+0000","last_active":"2024-08-19T00:38:54.355804+0000","last_peered":"2024-08-19T00:38:54.355804+0000","last_clean":"2024-08-19T00:38:54.355804+0000","last_became_active":"2024-08-19T00:38:54.351662+0000","last_became_peered":"2024-08-19T00:38:54.351662+0000","last_unstale":"2024-08-19T00:38:54.355804+0000","last_undegraded":"2024-08-19T00:38:54.355804+0000","last_fullsized":"2024-08-19T00:38:54.355804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:33.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334857+0000","last_change":"2024-08-19T00:38:54.334857+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334857+0000","last_undegraded":"2024-08-19T00:38:54.334857+0000","last_fullsized":"2024-08-19T00:38:54.334857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349339+0000","last_change":"2024-08-19T00:38:54.347070+0000","last_active":"2024-08-19T00:38:54.349339+0000","last_peered":"2024-08-19T00:38:54.349339+0000","last_clean":"2024-08-19T00:38:54.349339+0000","last_became_active":"2024-08-19T00:38:54.346775+0000","last_became_peered":"2024-08-19T00:38:54.346775+0000","last_unstale":"2024-08-19T00:38:54.349339+0000","last_undegraded":"2024-08-19T00:38:54.349339+0000","last_fullsized":"2024-08-19T00:38:54.349339+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334475+0000","last_change":"2024-08-19T00:38:54.334475+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334475+0000","last_undegraded":"2024-08-19T00:38:54.334475+0000","last_fullsized":"2024-08-19T00:38:54.334475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348664+0000","last_change":"2024-08-19T00:38:54.346097+0000","last_active":"2024-08-19T00:38:54.348664+0000","last_peered":"2024-08-19T00:38:54.348664+0000","last_clean":"2024-08-19T00:38:54.348664+0000","last_became_active":"2024-08-19T00:38:54.343893+0000","last_became_peered":"2024-08-19T00:38:54.343893+0000","last_unstale":"2024-08-19T00:38:54.348664+0000","last_undegraded":"2024-08-19T00:38:54.348664+0000","last_fullsized":"2024-08-19T00:38:54.348664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334848+0000","last_change":"2024-08-19T00:38:54.334848+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334848+0000","last_undegraded":"2024-08-19T00:38:54.334848+0000","last_fullsized":"2024-08-19T00:38:54.334848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345005+0000","last_change":"2024-08-19T00:38:54.343418+0000","last_active":"2024-08-19T00:38:54.345005+0000","last_peered":"2024-08-19T00:38:54.345005+0000","last_clean":"2024-08-19T00:38:54.345005+0000","last_became_active":"2024-08-19T00:38:54.343059+0000","last_became_peered":"2024-08-19T00:38:54.343059+0000","last_unstale":"2024-08-19T00:38:54.345005+0000","last_undegraded":"2024-08-19T00:38:54.345005+0000","last_fullsized":"2024-08-19T00:38:54.345005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327674+0000","last_change":"2024-08-19T00:38:54.327674+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327674+0000","last_undegraded":"2024-08-19T00:38:54.327674+0000","last_fullsized":"2024-08-19T00:38:54.327674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351568+0000","last_change":"2024-08-19T00:38:54.345428+0000","last_active":"2024-08-19T00:38:54.351568+0000","last_peered":"2024-08-19T00:38:54.351568+0000","last_clean":"2024-08-19T00:38:54.351568+0000","last_became_active":"2024-08-19T00:38:54.345122+0000","last_became_peered":"2024-08-19T00:38:54.345122+0000","last_unstale":"2024-08-19T00:38:54.351568+0000","last_undegraded":"2024-08-19T00:38:54.351568+0000","last_fullsized":"2024-08-19T00:38:54.351568+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:02.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327761+0000","last_change":"2024-08-19T00:38:54.327761+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327761+0000","last_undegraded":"2024-08-19T00:38:54.327761+0000","last_fullsized":"2024-08-19T00:38:54.327761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351561+0000","last_change":"2024-08-19T00:38:54.349434+0000","last_active":"2024-08-19T00:38:54.351561+0000","last_peered":"2024-08-19T00:38:54.351561+0000","last_clean":"2024-08-19T00:38:54.351561+0000","last_became_active":"2024-08-19T00:38:54.349177+0000","last_became_peered":"2024-08-19T00:38:54.349177+0000","last_unstale":"2024-08-19T00:38:54.351561+0000","last_undegraded":"2024-08-19T00:38:54.351561+0000","last_fullsized":"2024-08-19T00:38:54.351561+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:33.953532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.330173+0000","last_change":"2024-08-19T00:38:54.330173+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.330173+0000","last_undegraded":"2024-08-19T00:38:54.330173+0000","last_fullsized":"2024-08-19T00:38:54.330173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.350762+0000","last_change":"2024-08-19T00:38:54.346829+0000","last_active":"2024-08-19T00:38:54.350762+0000","last_peered":"2024-08-19T00:38:54.350762+0000","last_clean":"2024-08-19T00:38:54.350762+0000","last_became_active":"2024-08-19T00:38:54.346572+0000","last_became_peered":"2024-08-19T00:38:54.346572+0000","last_unstale":"2024-08-19T00:38:54.350762+0000","last_undegraded":"2024-08-19T00:38:54.350762+0000","last_fullsized":"2024-08-19T00:38:54.350762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:11.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327714+0000","last_change":"2024-08-19T00:38:54.327714+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327714+0000","last_undegraded":"2024-08-19T00:38:54.327714+0000","last_fullsized":"2024-08-19T00:38:54.327714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355542+0000","last_change":"2024-08-19T00:38:54.349597+0000","last_active":"2024-08-19T00:38:54.355542+0000","last_peered":"2024-08-19T00:38:54.355542+0000","last_clean":"2024-08-19T00:38:54.355542+0000","last_became_active":"2024-08-19T00:38:54.348927+0000","last_became_peered":"2024-08-19T00:38:54.348927+0000","last_unstale":"2024-08-19T00:38:54.355542+0000","last_undegraded":"2024-08-19T00:38:54.355542+0000","last_fullsized":"2024-08-19T00:38:54.355542+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327936+0000","last_change":"2024-08-19T00:38:54.327936+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327936+0000","last_undegraded":"2024-08-19T00:38:54.327936+0000","last_fullsized":"2024-08-19T00:38:54.327936+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351282+0000","last_change":"2024-08-19T00:38:54.346271+0000","last_active":"2024-08-19T00:38:54.351282+0000","last_peered":"2024-08-19T00:38:54.351282+0000","last_clean":"2024-08-19T00:38:54.351282+0000","last_became_active":"2024-08-19T00:38:54.346017+0000","last_became_peered":"2024-08-19T00:38:54.346017+0000","last_unstale":"2024-08-19T00:38:54.351282+0000","last_undegraded":"2024-08-19T00:38:54.351282+0000","last_fullsized":"2024-08-19T00:38:54.351282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:24.124584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352750+0000","last_change":"2024-08-19T00:38:54.350148+0000","last_active":"2024-08-19T00:38:54.352750+0000","last_peered":"2024-08-19T00:38:54.352750+0000","last_clean":"2024-08-19T00:38:54.352750+0000","last_became_active":"2024-08-19T00:38:54.347799+0000","last_became_peered":"2024-08-19T00:38:54.347799+0000","last_unstale":"2024-08-19T00:38:54.352750+0000","last_undegraded":"2024-08-19T00:38:54.352750+0000","last_fullsized":"2024-08-19T00:38:54.352750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332636+0000","last_change":"2024-08-19T00:38:54.332636+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332636+0000","last_undegraded":"2024-08-19T00:38:54.332636+0000","last_fullsized":"2024-08-19T00:38:54.332636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353008+0000","last_change":"2024-08-19T00:38:54.350844+0000","last_active":"2024-08-19T00:38:54.353008+0000","last_peered":"2024-08-19T00:38:54.353008+0000","last_clean":"2024-08-19T00:38:54.353008+0000","last_became_active":"2024-08-19T00:38:54.350579+0000","last_became_peered":"2024-08-19T00:38:54.350579+0000","last_unstale":"2024-08-19T00:38:54.353008+0000","last_undegraded":"2024-08-19T00:38:54.353008+0000","last_fullsized":"2024-08-19T00:38:54.353008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:22.283543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333016+0000","last_change":"2024-08-19T00:38:54.333016+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333016+0000","last_undegraded":"2024-08-19T00:38:54.333016+0000","last_fullsized":"2024-08-19T00:38:54.333016+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355810+0000","last_change":"2024-08-19T00:38:54.351955+0000","last_active":"2024-08-19T00:38:54.355810+0000","last_peered":"2024-08-19T00:38:54.355810+0000","last_clean":"2024-08-19T00:38:54.355810+0000","last_became_active":"2024-08-19T00:38:54.351347+0000","last_became_peered":"2024-08-19T00:38:54.351347+0000","last_unstale":"2024-08-19T00:38:54.355810+0000","last_undegraded":"2024-08-19T00:38:54.355810+0000","last_fullsized":"2024-08-19T00:38:54.355810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:37.514345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334051+0000","last_change":"2024-08-19T00:38:54.334051+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334051+0000","last_undegraded":"2024-08-19T00:38:54.334051+0000","last_fullsized":"2024-08-19T00:38:54.334051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353746+0000","last_change":"2024-08-19T00:38:54.351507+0000","last_active":"2024-08-19T00:38:54.353746+0000","last_peered":"2024-08-19T00:38:54.353746+0000","last_clean":"2024-08-19T00:38:54.353746+0000","last_became_active":"2024-08-19T00:38:54.350965+0000","last_became_peered":"2024-08-19T00:38:54.350965+0000","last_unstale":"2024-08-19T00:38:54.353746+0000","last_undegraded":"2024-08-19T00:38:54.353746+0000","last_fullsized":"2024-08-19T00:38:54.353746+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333801+0000","last_change":"2024-08-19T00:38:54.333801+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333801+0000","last_undegraded":"2024-08-19T00:38:54.333801+0000","last_fullsized":"2024-08-19T00:38:54.333801+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348609+0000","last_change":"2024-08-19T00:38:54.345173+0000","last_active":"2024-08-19T00:38:54.348609+0000","last_peered":"2024-08-19T00:38:54.348609+0000","last_clean":"2024-08-19T00:38:54.348609+0000","last_became_active":"2024-08-19T00:38:54.344931+0000","last_became_peered":"2024-08-19T00:38:54.344931+0000","last_unstale":"2024-08-19T00:38:54.348609+0000","last_undegraded":"2024-08-19T00:38:54.348609+0000","last_fullsized":"2024-08-19T00:38:54.348609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333830+0000","last_change":"2024-08-19T00:38:54.333830+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333830+0000","last_undegraded":"2024-08-19T00:38:54.333830+0000","last_fullsized":"2024-08-19T00:38:54.333830+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347685+0000","last_change":"2024-08-19T00:38:54.345007+0000","last_active":"2024-08-19T00:38:54.347685+0000","last_peered":"2024-08-19T00:38:54.347685+0000","last_clean":"2024-08-19T00:38:54.347685+0000","last_became_active":"2024-08-19T00:38:54.344731+0000","last_became_peered":"2024-08-19T00:38:54.344731+0000","last_unstale":"2024-08-19T00:38:54.347685+0000","last_undegraded":"2024-08-19T00:38:54.347685+0000","last_fullsized":"2024-08-19T00:38:54.347685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:44.571404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331845+0000","last_change":"2024-08-19T00:38:54.331845+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331845+0000","last_undegraded":"2024-08-19T00:38:54.331845+0000","last_fullsized":"2024-08-19T00:38:54.331845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355552+0000","last_change":"2024-08-19T00:38:54.349998+0000","last_active":"2024-08-19T00:38:54.355552+0000","last_peered":"2024-08-19T00:38:54.355552+0000","last_clean":"2024-08-19T00:38:54.355552+0000","last_became_active":"2024-08-19T00:38:54.349609+0000","last_became_peered":"2024-08-19T00:38:54.349609+0000","last_unstale":"2024-08-19T00:38:54.355552+0000","last_undegraded":"2024-08-19T00:38:54.355552+0000","last_fullsized":"2024-08-19T00:38:54.355552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332706+0000","last_change":"2024-08-19T00:38:54.332706+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332706+0000","last_undegraded":"2024-08-19T00:38:54.332706+0000","last_fullsized":"2024-08-19T00:38:54.332706+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.354351+0000","last_change":"2024-08-19T00:38:54.353417+0000","last_active":"2024-08-19T00:38:54.354351+0000","last_peered":"2024-08-19T00:38:54.354351+0000","last_clean":"2024-08-19T00:38:54.354351+0000","last_became_active":"2024-08-19T00:38:54.353149+0000","last_became_peered":"2024-08-19T00:38:54.353149+0000","last_unstale":"2024-08-19T00:38:54.354351+0000","last_undegraded":"2024-08-19T00:38:54.354351+0000","last_fullsized":"2024-08-19T00:38:54.354351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331627+0000","last_change":"2024-08-19T00:38:54.331627+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331627+0000","last_undegraded":"2024-08-19T00:38:54.331627+0000","last_fullsized":"2024-08-19T00:38:54.331627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351748+0000","last_change":"2024-08-19T00:38:54.348067+0000","last_active":"2024-08-19T00:38:54.351748+0000","last_peered":"2024-08-19T00:38:54.351748+0000","last_clean":"2024-08-19T00:38:54.351748+0000","last_became_active":"2024-08-19T00:38:54.347686+0000","last_became_peered":"2024-08-19T00:38:54.347686+0000","last_unstale":"2024-08-19T00:38:54.351748+0000","last_undegraded":"2024-08-19T00:38:54.351748+0000","last_fullsized":"2024-08-19T00:38:54.351748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:35.960033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332614+0000","last_change":"2024-08-19T00:38:54.332614+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332614+0000","last_undegraded":"2024-08-19T00:38:54.332614+0000","last_fullsized":"2024-08-19T00:38:54.332614+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353010+0000","last_change":"2024-08-19T00:38:54.348542+0000","last_active":"2024-08-19T00:38:54.353010+0000","last_peered":"2024-08-19T00:38:54.353010+0000","last_clean":"2024-08-19T00:38:54.353010+0000","last_became_active":"2024-08-19T00:38:54.348292+0000","last_became_peered":"2024-08-19T00:38:54.348292+0000","last_unstale":"2024-08-19T00:38:54.353010+0000","last_undegraded":"2024-08-19T00:38:54.353010+0000","last_fullsized":"2024-08-19T00:38:54.353010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:23.899300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333244+0000","last_change":"2024-08-19T00:38:54.333244+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333244+0000","last_undegraded":"2024-08-19T00:38:54.333244+0000","last_fullsized":"2024-08-19T00:38:54.333244+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351059+0000","last_change":"2024-08-19T00:38:54.347335+0000","last_active":"2024-08-19T00:38:54.351059+0000","last_peered":"2024-08-19T00:38:54.351059+0000","last_clean":"2024-08-19T00:38:54.351059+0000","last_became_active":"2024-08-19T00:38:54.347065+0000","last_became_peered":"2024-08-19T00:38:54.347065+0000","last_unstale":"2024-08-19T00:38:54.351059+0000","last_undegraded":"2024-08-19T00:38:54.351059+0000","last_fullsized":"2024-08-19T00:38:54.351059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:14:02.952709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334134+0000","last_change":"2024-08-19T00:38:54.334134+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334134+0000","last_undegraded":"2024-08-19T00:38:54.334134+0000","last_fullsized":"2024-08-19T00:38:54.334134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352292+0000","last_change":"2024-08-19T00:38:54.350331+0000","last_active":"2024-08-19T00:38:54.352292+0000","last_peered":"2024-08-19T00:38:54.352292+0000","last_clean":"2024-08-19T00:38:54.352292+0000","last_became_active":"2024-08-19T00:38:54.349006+0000","last_became_peered":"2024-08-19T00:38:54.349006+0000","last_unstale":"2024-08-19T00:38:54.352292+0000","last_undegraded":"2024-08-19T00:38:54.352292+0000","last_fullsized":"2024-08-19T00:38:54.352292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:18.045159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352684+0000","last_change":"2024-08-19T00:38:54.351356+0000","last_active":"2024-08-19T00:38:54.352684+0000","last_peered":"2024-08-19T00:38:54.352684+0000","last_clean":"2024-08-19T00:38:54.352684+0000","last_became_active":"2024-08-19T00:38:54.350850+0000","last_became_peered":"2024-08-19T00:38:54.350850+0000","last_unstale":"2024-08-19T00:38:54.352684+0000","last_undegraded":"2024-08-19T00:38:54.352684+0000","last_fullsized":"2024-08-19T00:38:54.352684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:51.200617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338008+0000","last_change":"2024-08-19T00:38:54.338008+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338008+0000","last_undegraded":"2024-08-19T00:38:54.338008+0000","last_fullsized":"2024-08-19T00:38:54.338008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351347+0000","last_change":"2024-08-19T00:38:54.347205+0000","last_active":"2024-08-19T00:38:54.351347+0000","last_peered":"2024-08-19T00:38:54.351347+0000","last_clean":"2024-08-19T00:38:54.351347+0000","last_became_active":"2024-08-19T00:38:54.344536+0000","last_became_peered":"2024-08-19T00:38:54.344536+0000","last_unstale":"2024-08-19T00:38:54.351347+0000","last_undegraded":"2024-08-19T00:38:54.351347+0000","last_fullsized":"2024-08-19T00:38:54.351347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:33.298522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.339486+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:38:54.339486+0000","last_peered":"2024-08-19T00:38:54.339486+0000","last_clean":"2024-08-19T00:38:54.339486+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:38:54.339486+0000","last_undegraded":"2024-08-19T00:38:54.339486+0000","last_fullsized":"2024-08-19T00:38:54.339486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.335384+0000', 'last_change': '2024-08-19T00:38:54.335384+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.335384+0000', 'last_undegraded': '2024-08-19T00:38:54.335384+0000', 'last_fullsized': '2024-08-19T00:38:54.335384+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.328224+0000', 'last_change': '2024-08-19T00:38:54.328224+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.328224+0000', 'last_undegraded': '2024-08-19T00:38:54.328224+0000', 'last_fullsized': '2024-08-19T00:38:54.328224+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333407+0000', 'last_change': '2024-08-19T00:38:54.333407+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333407+0000', 'last_undegraded': '2024-08-19T00:38:54.333407+0000', 'last_fullsized': '2024-08-19T00:38:54.333407+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-08-19T00:39:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.335655+0000', 'last_change': '2024-08-19T00:38:54.335655+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.335655+0000', 'last_undegraded': '2024-08-19T00:38:54.335655+0000', 'last_fullsized': '2024-08-19T00:38:54.335655+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.335775+0000', 'last_change': '2024-08-19T00:38:54.335775+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.335775+0000', 'last_undegraded': '2024-08-19T00:38:54.335775+0000', 'last_fullsized': '2024-08-19T00:38:54.335775+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3a is not active+clean 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.332729+0000', 'last_change': '2024-08-19T00:38:54.332729+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.332729+0000', 'last_undegraded': '2024-08-19T00:38:54.332729+0000', 'last_fullsized': '2024-08-19T00:38:54.332729+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.340397+0000', 'last_change': '2024-08-19T00:38:54.340397+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.340397+0000', 'last_undegraded': '2024-08-19T00:38:54.340397+0000', 'last_fullsized': '2024-08-19T00:38:54.340397+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334758+0000', 'last_change': '2024-08-19T00:38:54.334758+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334758+0000', 'last_undegraded': '2024-08-19T00:38:54.334758+0000', 'last_fullsized': '2024-08-19T00:38:54.334758+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-08-19T00:39:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334622+0000', 'last_change': '2024-08-19T00:38:54.334622+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334622+0000', 'last_undegraded': '2024-08-19T00:38:54.334622+0000', 'last_fullsized': '2024-08-19T00:38:54.334622+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.332055+0000', 'last_change': '2024-08-19T00:38:54.332055+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.332055+0000', 'last_undegraded': '2024-08-19T00:38:54.332055+0000', 'last_fullsized': '2024-08-19T00:38:54.332055+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.338588+0000', 'last_change': '2024-08-19T00:38:54.338588+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.338588+0000', 'last_undegraded': '2024-08-19T00:38:54.338588+0000', 'last_fullsized': '2024-08-19T00:38:54.338588+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.329187+0000', 'last_change': '2024-08-19T00:38:54.329187+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.329187+0000', 'last_undegraded': '2024-08-19T00:38:54.329187+0000', 'last_fullsized': '2024-08-19T00:38:54.329187+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334469+0000', 'last_change': '2024-08-19T00:38:54.334469+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334469+0000', 'last_undegraded': '2024-08-19T00:38:54.334469+0000', 'last_fullsized': '2024-08-19T00:38:54.334469+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334235+0000', 'last_change': '2024-08-19T00:38:54.334235+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334235+0000', 'last_undegraded': '2024-08-19T00:38:54.334235+0000', 'last_fullsized': '2024-08-19T00:38:54.334235+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-08-19T00:39:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334310+0000', 'last_change': '2024-08-19T00:38:54.334310+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334310+0000', 'last_undegraded': '2024-08-19T00:38:54.334310+0000', 'last_fullsized': '2024-08-19T00:38:54.334310+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-08-19T00:39:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333331+0000', 'last_change': '2024-08-19T00:38:54.333331+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333331+0000', 'last_undegraded': '2024-08-19T00:38:54.333331+0000', 'last_fullsized': '2024-08-19T00:38:54.333331+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-08-19T00:39:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.328641+0000', 'last_change': '2024-08-19T00:38:54.328641+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.328641+0000', 'last_undegraded': '2024-08-19T00:38:54.328641+0000', 'last_fullsized': '2024-08-19T00:38:54.328641+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-08-19T00:39:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.335469+0000', 'last_change': '2024-08-19T00:38:54.335469+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.335469+0000', 'last_undegraded': '2024-08-19T00:38:54.335469+0000', 'last_fullsized': '2024-08-19T00:38:54.335469+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.341032+0000', 'last_change': '2024-08-19T00:38:54.341032+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.341032+0000', 'last_undegraded': '2024-08-19T00:38:54.341032+0000', 'last_fullsized': '2024-08-19T00:38:54.341032+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333144+0000', 'last_change': '2024-08-19T00:38:54.333144+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333144+0000', 'last_undegraded': '2024-08-19T00:38:54.333144+0000', 'last_fullsized': '2024-08-19T00:38:54.333144+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.331994+0000', 'last_change': '2024-08-19T00:38:54.331994+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.331994+0000', 'last_undegraded': '2024-08-19T00:38:54.331994+0000', 'last_fullsized': '2024-08-19T00:38:54.331994+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-08-19T00:39:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.327655+0000', 'last_change': '2024-08-19T00:38:54.327655+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.327655+0000', 'last_undegraded': '2024-08-19T00:38:54.327655+0000', 'last_fullsized': '2024-08-19T00:38:54.327655+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.339928+0000', 'last_change': '2024-08-19T00:38:54.339928+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.339928+0000', 'last_undegraded': '2024-08-19T00:38:54.339928+0000', 'last_fullsized': '2024-08-19T00:38:54.339928+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.327851+0000', 'last_change': '2024-08-19T00:38:54.327851+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.327851+0000', 'last_undegraded': '2024-08-19T00:38:54.327851+0000', 'last_fullsized': '2024-08-19T00:38:54.327851+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334914+0000', 'last_change': '2024-08-19T00:38:54.334914+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334914+0000', 'last_undegraded': '2024-08-19T00:38:54.334914+0000', 'last_fullsized': '2024-08-19T00:38:54.334914+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.338520+0000', 'last_change': '2024-08-19T00:38:54.338520+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.338520+0000', 'last_undegraded': '2024-08-19T00:38:54.338520+0000', 'last_fullsized': '2024-08-19T00:38:54.338520+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-08-19T00:39:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.339452+0000', 'last_change': '2024-08-19T00:38:54.339452+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.339452+0000', 'last_undegraded': '2024-08-19T00:38:54.339452+0000', 'last_fullsized': '2024-08-19T00:38:54.339452+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334985+0000', 'last_change': '2024-08-19T00:38:54.334985+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334985+0000', 'last_undegraded': '2024-08-19T00:38:54.334985+0000', 'last_fullsized': '2024-08-19T00:38:54.334985+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.335274+0000', 'last_change': '2024-08-19T00:38:54.335274+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.335274+0000', 'last_undegraded': '2024-08-19T00:38:54.335274+0000', 'last_fullsized': '2024-08-19T00:38:54.335274+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.327840+0000', 'last_change': '2024-08-19T00:38:54.327840+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.327840+0000', 'last_undegraded': '2024-08-19T00:38:54.327840+0000', 'last_fullsized': '2024-08-19T00:38:54.327840+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 7.21 is not active+clean 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.332340+0000', 'last_change': '2024-08-19T00:38:54.332340+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.332340+0000', 'last_undegraded': '2024-08-19T00:38:54.332340+0000', 'last_fullsized': '2024-08-19T00:38:54.332340+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334261+0000', 'last_change': '2024-08-19T00:38:54.334261+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334261+0000', 'last_undegraded': '2024-08-19T00:38:54.334261+0000', 'last_fullsized': '2024-08-19T00:38:54.334261+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-08-19T00:39:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.328352+0000', 'last_change': '2024-08-19T00:38:54.328352+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.328352+0000', 'last_undegraded': '2024-08-19T00:38:54.328352+0000', 'last_fullsized': '2024-08-19T00:38:54.328352+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-08-19T00:39:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334112+0000', 'last_change': '2024-08-19T00:38:54.334112+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334112+0000', 'last_undegraded': '2024-08-19T00:38:54.334112+0000', 'last_fullsized': '2024-08-19T00:38:54.334112+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-08-19T00:39:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.328756+0000', 'last_change': '2024-08-19T00:38:54.328756+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.328756+0000', 'last_undegraded': '2024-08-19T00:38:54.328756+0000', 'last_fullsized': '2024-08-19T00:38:54.328756+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-08-19T00:39:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.338096+0000', 'last_change': '2024-08-19T00:38:54.338096+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.338096+0000', 'last_undegraded': '2024-08-19T00:38:54.338096+0000', 'last_fullsized': '2024-08-19T00:38:54.338096+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-08-19T00:39:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.337044+0000', 'last_change': '2024-08-19T00:38:54.337044+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.337044+0000', 'last_undegraded': '2024-08-19T00:38:54.337044+0000', 'last_fullsized': '2024-08-19T00:38:54.337044+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-08-19T00:39:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.331833+0000', 'last_change': '2024-08-19T00:38:54.331833+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.331833+0000', 'last_undegraded': '2024-08-19T00:38:54.331833+0000', 'last_fullsized': '2024-08-19T00:38:54.331833+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-08-19T00:39:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.336940+0000', 'last_change': '2024-08-19T00:38:54.336940+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.336940+0000', 'last_undegraded': '2024-08-19T00:38:54.336940+0000', 'last_fullsized': '2024-08-19T00:38:54.336940+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.338863+0000', 'last_change': '2024-08-19T00:38:54.338863+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.338863+0000', 'last_undegraded': '2024-08-19T00:38:54.338863+0000', 'last_fullsized': '2024-08-19T00:38:54.338863+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.335032+0000', 'last_change': '2024-08-19T00:38:54.335032+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.335032+0000', 'last_undegraded': '2024-08-19T00:38:54.335032+0000', 'last_fullsized': '2024-08-19T00:38:54.335032+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333712+0000', 'last_change': '2024-08-19T00:38:54.333712+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333712+0000', 'last_undegraded': '2024-08-19T00:38:54.333712+0000', 'last_fullsized': '2024-08-19T00:38:54.333712+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334857+0000', 'last_change': '2024-08-19T00:38:54.334857+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334857+0000', 'last_undegraded': '2024-08-19T00:38:54.334857+0000', 'last_fullsized': '2024-08-19T00:38:54.334857+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334475+0000', 'last_change': '2024-08-19T00:38:54.334475+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334475+0000', 'last_undegraded': '2024-08-19T00:38:54.334475+0000', 'last_fullsized': '2024-08-19T00:38:54.334475+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-08-19T00:39:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334848+0000', 'last_change': '2024-08-19T00:38:54.334848+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334848+0000', 'last_undegraded': '2024-08-19T00:38:54.334848+0000', 'last_fullsized': '2024-08-19T00:38:54.334848+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.327674+0000', 'last_change': '2024-08-19T00:38:54.327674+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.327674+0000', 'last_undegraded': '2024-08-19T00:38:54.327674+0000', 'last_fullsized': '2024-08-19T00:38:54.327674+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.327761+0000', 'last_change': '2024-08-19T00:38:54.327761+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.327761+0000', 'last_undegraded': '2024-08-19T00:38:54.327761+0000', 'last_fullsized': '2024-08-19T00:38:54.327761+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.330173+0000', 'last_change': '2024-08-19T00:38:54.330173+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.330173+0000', 'last_undegraded': '2024-08-19T00:38:54.330173+0000', 'last_fullsized': '2024-08-19T00:38:54.330173+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.327714+0000', 'last_change': '2024-08-19T00:38:54.327714+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.327714+0000', 'last_undegraded': '2024-08-19T00:38:54.327714+0000', 'last_fullsized': '2024-08-19T00:38:54.327714+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.327936+0000', 'last_change': '2024-08-19T00:38:54.327936+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.327936+0000', 'last_undegraded': '2024-08-19T00:38:54.327936+0000', 'last_fullsized': '2024-08-19T00:38:54.327936+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-08-19T00:39:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.328139+0000', 'last_change': '2024-08-19T00:38:54.328139+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.328139+0000', 'last_undegraded': '2024-08-19T00:38:54.328139+0000', 'last_fullsized': '2024-08-19T00:38:54.328139+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.332636+0000', 'last_change': '2024-08-19T00:38:54.332636+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.332636+0000', 'last_undegraded': '2024-08-19T00:38:54.332636+0000', 'last_fullsized': '2024-08-19T00:38:54.332636+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333016+0000', 'last_change': '2024-08-19T00:38:54.333016+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333016+0000', 'last_undegraded': '2024-08-19T00:38:54.333016+0000', 'last_fullsized': '2024-08-19T00:38:54.333016+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334051+0000', 'last_change': '2024-08-19T00:38:54.334051+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334051+0000', 'last_undegraded': '2024-08-19T00:38:54.334051+0000', 'last_fullsized': '2024-08-19T00:38:54.334051+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333801+0000', 'last_change': '2024-08-19T00:38:54.333801+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333801+0000', 'last_undegraded': '2024-08-19T00:38:54.333801+0000', 'last_fullsized': '2024-08-19T00:38:54.333801+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-08-19T00:39:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333830+0000', 'last_change': '2024-08-19T00:38:54.333830+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333830+0000', 'last_undegraded': '2024-08-19T00:38:54.333830+0000', 'last_fullsized': '2024-08-19T00:38:54.333830+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.331845+0000', 'last_change': '2024-08-19T00:38:54.331845+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.331845+0000', 'last_undegraded': '2024-08-19T00:38:54.331845+0000', 'last_fullsized': '2024-08-19T00:38:54.331845+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.332706+0000', 'last_change': '2024-08-19T00:38:54.332706+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.332706+0000', 'last_undegraded': '2024-08-19T00:38:54.332706+0000', 'last_fullsized': '2024-08-19T00:38:54.332706+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.331627+0000', 'last_change': '2024-08-19T00:38:54.331627+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.331627+0000', 'last_undegraded': '2024-08-19T00:38:54.331627+0000', 'last_fullsized': '2024-08-19T00:38:54.331627+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.332614+0000', 'last_change': '2024-08-19T00:38:54.332614+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.332614+0000', 'last_undegraded': '2024-08-19T00:38:54.332614+0000', 'last_fullsized': '2024-08-19T00:38:54.332614+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-08-19T00:39:00.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.333244+0000', 'last_change': '2024-08-19T00:38:54.333244+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.333244+0000', 'last_undegraded': '2024-08-19T00:38:54.333244+0000', 'last_fullsized': '2024-08-19T00:38:54.333244+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.427 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-08-19T00:39:00.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.334134+0000', 'last_change': '2024-08-19T00:38:54.334134+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.334134+0000', 'last_undegraded': '2024-08-19T00:38:54.334134+0000', 'last_fullsized': '2024-08-19T00:38:54.334134+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:00.427 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-08-19T00:39:00.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.328139+0000', 'last_change': '2024-08-19T00:38:54.328139+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.328139+0000', 'last_undegraded': '2024-08-19T00:38:54.328139+0000', 'last_fullsized': '2024-08-19T00:38:54.328139+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:00.427 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-08-19T00:39:00.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:38:54.338008+0000', 'last_change': '2024-08-19T00:38:54.338008+0000', 'last_active': '2024-08-19T00:38:54.320224+0000', 'last_peered': '2024-08-19T00:38:54.320224+0000', 'last_clean': '2024-08-19T00:38:54.320224+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:38:54.338008+0000', 'last_undegraded': '2024-08-19T00:38:54.338008+0000', 'last_fullsized': '2024-08-19T00:38:54.338008+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'last_clean_scrub_stamp': '2024-08-19T00:38:54.320224+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:00.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-19T00:39:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.604+0000 7f872d800640 1 Processor -- start 2024-08-19T00:39:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.604+0000 7f872d800640 1 -- start start 2024-08-19T00:39:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.605+0000 7f872d800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8728159bf0 0x7f8728073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.605+0000 7f872d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 0x7f87280ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f872d800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872806f7f0 con 0x7f87280cea40 2024-08-19T00:39:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f872d800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f872806f510 con 0x7f8728159bf0 2024-08-19T00:39:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f872d800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8728072980 con 0x7f87280739a0 2024-08-19T00:39:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f8727400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f87280cea40 0x7f87280d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58980/0 (socket says 172.21.15.7:58980) 2024-08-19T00:39:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f8727400640 1 -- 172.21.15.7:0/2694966941 learned_addr learned my addr 172.21.15.7:0/2694966941 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f871fe00640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 0x7f87280ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f8726a00640 1 --2- 172.21.15.7:0/2694966941 >> v2:172.21.15.162:3300/0 conn(0x7f8728159bf0 0x7f8728073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553128739 0 0) 0x7f872806f7f0 con 0x7f87280cea40 2024-08-19T00:39:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.606+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f870c003520 con 0x7f87280cea40 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3160564508 0 0) 0x7f870c003520 con 0x7f87280cea40 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 msgr2=0x7f87280ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 0x7f87280ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 >> v2:172.21.15.162:3300/0 conn(0x7f8728159bf0 msgr2=0x7f8728073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 --2- 172.21.15.7:0/2694966941 >> v2:172.21.15.162:3300/0 conn(0x7f8728159bf0 0x7f8728073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8728072c60 con 0x7f87280cea40 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f87200019f0 con 0x7f87280cea40 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 >> v1:172.21.15.7:6789/0 conn(0x7f87280cea40 legacy=0x7f87280d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 0x7f870c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c003f80 0x7f870c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f870c004d40 0x7f870c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f872806f510 con 0x7f870c004d40 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8728072980 con 0x7f870c003f80 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f870c00ba70 con 0x7f87280739a0 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8727400640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f870c004d40 0x7f870c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8726a00640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 0x7f870c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f871fe00640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c003f80 0x7f870c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8727400640 1 -- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 msgr2=0x7f870c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8727400640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87280739a0 0x7f870c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8727400640 1 -- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c003f80 msgr2=0x7f870c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8727400640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c003f80 0x7f870c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.607+0000 7f8727400640 1 -- 172.21.15.7:0/2694966941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c003520 con 0x7f870c004d40 2024-08-19T00:39:00.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.608+0000 7f8727400640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f870c004d40 0x7f870c0051c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f872000a7b0 tx=0x7f870c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325344502807660b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:00.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872000a3d0 con 0x7f870c004d40 2024-08-19T00:39:00.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872002f070 con 0x7f870c004d40 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f8726000640 1 -- 172.21.15.7:0/2694966941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872002bc60 con 0x7f870c004d40 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f872d800640 1 -- 172.21.15.7:0/2694966941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f870c004d40 msgr2=0x7f870c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f872d800640 1 --2- 172.21.15.7:0/2694966941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f870c004d40 0x7f870c0051c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f872000a7b0 tx=0x7f870c005830 comp rx=0 tx=0).stop 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f8727400640 1 -- 172.21.15.7:0/2694966941 reap_dead start 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f872d800640 1 -- 172.21.15.7:0/2694966941 shutdown_connections 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f872d800640 1 -- 172.21.15.7:0/2694966941 >> 172.21.15.7:0/2694966941 conn(0x7f872806bc70 msgr2=0x7f872806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f872d800640 1 -- 172.21.15.7:0/2694966941 shutdown_connections 2024-08-19T00:39:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.609+0000 7f872d800640 1 -- 172.21.15.7:0/2694966941 wait complete. 2024-08-19T00:39:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.611+0000 7f872d800640 1 Processor -- start 2024-08-19T00:39:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.611+0000 7f872d800640 1 -- start start 2024-08-19T00:39:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.612+0000 7f872d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c004d40 0x7f8728155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.612+0000 7f872d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8728154820 0x7f87280b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.612+0000 7f872d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8728146190 0x7f8728157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.612+0000 7f872d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f872815a150 con 0x7f8728154820 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.612+0000 7f872d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8728159fd0 con 0x7f870c004d40 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.612+0000 7f872d800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87280d0ad0 con 0x7f8728146190 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8728154820 0x7f87280b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8728154820 0x7f87280b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60584/0 (socket says 172.21.15.7:60584) 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 -- 172.21.15.7:0/3108717855 learned_addr learned my addr 172.21.15.7:0/3108717855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f8727400640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8728146190 0x7f8728157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f8726a00640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c004d40 0x7f8728155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 -- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8728146190 msgr2=0x7f8728157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8728146190 0x7f8728157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 -- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c004d40 msgr2=0x7f8728155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c004d40 0x7f8728155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 -- 172.21.15.7:0/3108717855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87280b3a80 con 0x7f8728154820 2024-08-19T00:39:00.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f8727400640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8728146190 0x7f8728157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.613+0000 7f871fe00640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8728154820 0x7f87280b3110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8710011960 tx=0x7f8710011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.614+0000 7f871ea00640 1 -- 172.21.15.7:0/3108717855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871000f9d0 con 0x7f8728154820 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.614+0000 7f871ea00640 1 -- 172.21.15.7:0/3108717855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871000fb70 con 0x7f8728154820 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.614+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87280b3d60 con 0x7f8728154820 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.614+0000 7f871ea00640 1 -- 172.21.15.7:0/3108717855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710014440 con 0x7f8728154820 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.614+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8728156f70 con 0x7f8728154820 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.615+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8728073460 con 0x7f8728154820 2024-08-19T00:39:00.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.616+0000 7f871ea00640 1 -- 172.21.15.7:0/3108717855 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8710012040 con 0x7f8728154820 2024-08-19T00:39:00.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.617+0000 7f871ea00640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f870406be60 0x7f870406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:00.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.617+0000 7f871ea00640 1 -- 172.21.15.7:0/3108717855 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f871008b410 con 0x7f8728154820 2024-08-19T00:39:00.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.617+0000 7f8726a00640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f870406be60 0x7f870406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:00.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.617+0000 7f8726a00640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f870406be60 0x7f870406e320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8718009c40 tx=0x7f8718009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:00.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.621+0000 7f871ea00640 1 -- 172.21.15.7:0/3108717855 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8710019030 con 0x7f8728154820 2024-08-19T00:39:00.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.874+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f872815fc10 con 0x7f8728154820 2024-08-19T00:39:00.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.874+0000 7f871ea00640 1 -- 172.21.15.7:0/3108717855 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1076 (secure 0 0 0) 0x7f8710059d20 con 0x7f8728154820 2024-08-19T00:39:00.876 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:00.876 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":142,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1724027810,"num_in_osds":8,"osd_in_since":1724027801,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":243638272,"bytes_avail":772850475008,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":30,"btime":"2024-08-19T00:38:58:370924+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5319}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-08-19T00:38:43.279026+0000","services":{}},"progress_events":{}} 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f870406be60 msgr2=0x7f870406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f870406be60 0x7f870406e320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8718009c40 tx=0x7f8718009190 comp rx=0 tx=0).stop 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8728154820 msgr2=0x7f87280b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8728154820 0x7f87280b3110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8710011960 tx=0x7f8710011d60 comp rx=0 tx=0).stop 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 shutdown_connections 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f870406be60 0x7f870406e320 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8718009c40 tx=0x7f8718009190 comp rx=0 tx=0).stop 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8728146190 0x7f8728157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8728154820 0x7f87280b3110 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 --2- 172.21.15.7:0/3108717855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c004d40 0x7f8728155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 >> 172.21.15.7:0/3108717855 conn(0x7f872806bc70 msgr2=0x7f872815ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 shutdown_connections 2024-08-19T00:39:00.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:00.877+0000 7f872d800640 1 -- 172.21.15.7:0/3108717855 wait complete. 2024-08-19T00:39:00.895 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-19T00:39:00.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:01.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.050+0000 7fb580600640 1 Processor -- start 2024-08-19T00:39:01.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.050+0000 7fb580600640 1 -- start start 2024-08-19T00:39:01.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.051+0000 7fb580600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5780d03c0 0x7fb5780d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:01.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.051+0000 7fb580600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5780b4380 0x7fb5780b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:01.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.051+0000 7fb580600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5780b50b0 con 0x7fb57815f5b0 2024-08-19T00:39:01.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.051+0000 7fb580600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb57815f990 con 0x7fb5780b4380 2024-08-19T00:39:01.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb580600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb5780cf120 con 0x7fb5780d03c0 2024-08-19T00:39:01.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57e600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5780b4380 0x7fb5780b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:01.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57e600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5780b4380 0x7fb5780b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60594/0 (socket says 172.21.15.7:60594) 2024-08-19T00:39:01.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57e600640 1 -- 172.21.15.7:0/1756867560 learned_addr learned my addr 172.21.15.7:0/1756867560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:01.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57d200640 1 --2- 172.21.15.7:0/1756867560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5780d03c0 0x7fb5780d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57e600640 1 -- 172.21.15.7:0/1756867560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5780d03c0 msgr2=0x7fb5780d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57e600640 1 --2- 172.21.15.7:0/1756867560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5780d03c0 0x7fb5780d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57e600640 1 -- 172.21.15.7:0/1756867560 >> v1:172.21.15.162:6789/0 conn(0x7fb57815f5b0 legacy=0x7fb5780cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.052+0000 7fb57e600640 1 -- 172.21.15.7:0/1756867560 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5780cead0 con 0x7fb5780b4380 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.053+0000 7fb57e600640 1 --2- 172.21.15.7:0/1756867560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780b4830 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb570009e50 tx=0x7fb57002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2650408e246dbd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.053+0000 7fb577e00640 1 -- 172.21.15.7:0/1756867560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570036070 con 0x7fb5780b4380 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb577e00640 1 -- 172.21.15.7:0/1756867560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb570031600 con 0x7fb5780b4380 2024-08-19T00:39:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb577e00640 1 -- 172.21.15.7:0/1756867560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700319d0 con 0x7fb5780b4380 2024-08-19T00:39:01.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 -- 172.21.15.7:0/1756867560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 msgr2=0x7fb5780b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:01.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 --2- 172.21.15.7:0/1756867560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780b4830 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb570009e50 tx=0x7fb57002a6a0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 -- 172.21.15.7:0/1756867560 shutdown_connections 2024-08-19T00:39:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 --2- 172.21.15.7:0/1756867560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780b4830 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 --2- 172.21.15.7:0/1756867560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5780d03c0 0x7fb5780d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 -- 172.21.15.7:0/1756867560 >> 172.21.15.7:0/1756867560 conn(0x7fb57806bc70 msgr2=0x7fb57806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 -- 172.21.15.7:0/1756867560 shutdown_connections 2024-08-19T00:39:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.054+0000 7fb580600640 1 -- 172.21.15.7:0/1756867560 wait complete. 2024-08-19T00:39:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.056+0000 7fb580600640 1 Processor -- start 2024-08-19T00:39:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.056+0000 7fb580600640 1 -- start start 2024-08-19T00:39:01.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb580600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:01.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb580600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5780d03c0 0x7fb5780acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:01.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb580600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb57815f5b0 0x7fb578159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb580600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780b4d70 con 0x7fb5780b4380 2024-08-19T00:39:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb580600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780d0d40 con 0x7fb5780d03c0 2024-08-19T00:39:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb580600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb57806e660 con 0x7fb57815f5b0 2024-08-19T00:39:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb57dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb57dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60610/0 (socket says 172.21.15.7:60610) 2024-08-19T00:39:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.057+0000 7fb57dc00640 1 -- 172.21.15.7:0/2564460423 learned_addr learned my addr 172.21.15.7:0/2564460423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57d200640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5780d03c0 0x7fb5780acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57e600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb57815f5b0 0x7fb578159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57dc00640 1 -- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb57815f5b0 msgr2=0x7fb578159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57dc00640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb57815f5b0 0x7fb578159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57dc00640 1 -- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5780d03c0 msgr2=0x7fb5780acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57dc00640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5780d03c0 0x7fb5780acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57dc00640 1 -- 172.21.15.7:0/2564460423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5780ad990 con 0x7fb5780b4380 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57e600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb57815f5b0 0x7fb578159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57d200640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5780d03c0 0x7fb5780acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:01.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb57dc00640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780aea30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c3f0 tx=0x7fb56c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb575600640 1 -- 172.21.15.7:0/2564460423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0052d0 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb575600640 1 -- 172.21.15.7:0/2564460423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56c005490 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb575600640 1 -- 172.21.15.7:0/2564460423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c007260 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.058+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5780adc70 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.059+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5780ae230 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.060+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5780b4830 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.061+0000 7fb575600640 1 -- 172.21.15.7:0/2564460423 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb56c007400 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.061+0000 7fb575600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb55806be60 0x7fb55806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.062+0000 7fb575600640 1 -- 172.21.15.7:0/2564460423 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb56c08a350 con 0x7fb5780b4380 2024-08-19T00:39:01.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.062+0000 7fb57d200640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb55806be60 0x7fb55806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:01.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.062+0000 7fb57d200640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb55806be60 0x7fb55806e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb578157140 tx=0x7fb564008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:01.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.066+0000 7fb575600640 1 -- 172.21.15.7:0/2564460423 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb56c058d00 con 0x7fb5780b4380 2024-08-19T00:39:01.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:39:01.246 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:39:01.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.246+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5780cf890 con 0x7fb55806be60 2024-08-19T00:39:01.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.253+0000 7fb575600640 1 -- 172.21.15.7:0/2564460423 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7fb5780cf890 con 0x7fb55806be60 2024-08-19T00:39:01.257 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:01.260 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:01.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb55806be60 msgr2=0x7fb55806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:01.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb55806be60 0x7fb55806e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb578157140 tx=0x7fb564008040 comp rx=0 tx=0).stop 2024-08-19T00:39:01.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 msgr2=0x7fb5780aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:01.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780aea30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c3f0 tx=0x7fb56c00c8b0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 shutdown_connections 2024-08-19T00:39:01.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb55806be60 0x7fb55806e320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb57815f5b0 0x7fb578159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5780d03c0 0x7fb5780acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 --2- 172.21.15.7:0/2564460423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5780b4380 0x7fb5780aea30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 >> 172.21.15.7:0/2564460423 conn(0x7fb57806bc70 msgr2=0x7fb578157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 shutdown_connections 2024-08-19T00:39:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:01.258+0000 7fb580600640 1 -- 172.21.15.7:0/2564460423 wait complete. 2024-08-19T00:39:01.276 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-08-19T00:38:59.282309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237928,"kb_used_data":5096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736792,"statfs":{"total":773094113280,"available":772850475008,"internally_reserved":0,"allocated":5218304,"data_stored":2796240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.961367"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335384+0000","last_change":"2024-08-19T00:38:54.335384+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335384+0000","last_undegraded":"2024-08-19T00:38:54.335384+0000","last_fullsized":"2024-08-19T00:38:54.335384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328224+0000","last_change":"2024-08-19T00:38:54.328224+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328224+0000","last_undegraded":"2024-08-19T00:38:54.328224+0000","last_fullsized":"2024-08-19T00:38:54.328224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333407+0000","last_change":"2024-08-19T00:38:54.333407+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333407+0000","last_undegraded":"2024-08-19T00:38:54.333407+0000","last_fullsized":"2024-08-19T00:38:54.333407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335655+0000","last_change":"2024-08-19T00:38:54.335655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335655+0000","last_undegraded":"2024-08-19T00:38:54.335655+0000","last_fullsized":"2024-08-19T00:38:54.335655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335775+0000","last_change":"2024-08-19T00:38:54.335775+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335775+0000","last_undegraded":"2024-08-19T00:38:54.335775+0000","last_fullsized":"2024-08-19T00:38:54.335775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332729+0000","last_change":"2024-08-19T00:38:54.332729+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332729+0000","last_undegraded":"2024-08-19T00:38:54.332729+0000","last_fullsized":"2024-08-19T00:38:54.332729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.340397+0000","last_change":"2024-08-19T00:38:54.340397+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.340397+0000","last_undegraded":"2024-08-19T00:38:54.340397+0000","last_fullsized":"2024-08-19T00:38:54.340397+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334758+0000","last_change":"2024-08-19T00:38:54.334758+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334758+0000","last_undegraded":"2024-08-19T00:38:54.334758+0000","last_fullsized":"2024-08-19T00:38:54.334758+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334622+0000","last_change":"2024-08-19T00:38:54.334622+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334622+0000","last_undegraded":"2024-08-19T00:38:54.334622+0000","last_fullsized":"2024-08-19T00:38:54.334622+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332055+0000","last_change":"2024-08-19T00:38:54.332055+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332055+0000","last_undegraded":"2024-08-19T00:38:54.332055+0000","last_fullsized":"2024-08-19T00:38:54.332055+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338588+0000","last_change":"2024-08-19T00:38:54.338588+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338588+0000","last_undegraded":"2024-08-19T00:38:54.338588+0000","last_fullsized":"2024-08-19T00:38:54.338588+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.329187+0000","last_change":"2024-08-19T00:38:54.329187+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.329187+0000","last_undegraded":"2024-08-19T00:38:54.329187+0000","last_fullsized":"2024-08-19T00:38:54.329187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334469+0000","last_change":"2024-08-19T00:38:54.334469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334469+0000","last_undegraded":"2024-08-19T00:38:54.334469+0000","last_fullsized":"2024-08-19T00:38:54.334469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334235+0000","last_change":"2024-08-19T00:38:54.334235+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334235+0000","last_undegraded":"2024-08-19T00:38:54.334235+0000","last_fullsized":"2024-08-19T00:38:54.334235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334310+0000","last_change":"2024-08-19T00:38:54.334310+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334310+0000","last_undegraded":"2024-08-19T00:38:54.334310+0000","last_fullsized":"2024-08-19T00:38:54.334310+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333331+0000","last_change":"2024-08-19T00:38:54.333331+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333331+0000","last_undegraded":"2024-08-19T00:38:54.333331+0000","last_fullsized":"2024-08-19T00:38:54.333331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328641+0000","last_change":"2024-08-19T00:38:54.328641+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328641+0000","last_undegraded":"2024-08-19T00:38:54.328641+0000","last_fullsized":"2024-08-19T00:38:54.328641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335469+0000","last_change":"2024-08-19T00:38:54.335469+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335469+0000","last_undegraded":"2024-08-19T00:38:54.335469+0000","last_fullsized":"2024-08-19T00:38:54.335469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.341032+0000","last_change":"2024-08-19T00:38:54.341032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.341032+0000","last_undegraded":"2024-08-19T00:38:54.341032+0000","last_fullsized":"2024-08-19T00:38:54.341032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333144+0000","last_change":"2024-08-19T00:38:54.333144+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333144+0000","last_undegraded":"2024-08-19T00:38:54.333144+0000","last_fullsized":"2024-08-19T00:38:54.333144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331994+0000","last_change":"2024-08-19T00:38:54.331994+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331994+0000","last_undegraded":"2024-08-19T00:38:54.331994+0000","last_fullsized":"2024-08-19T00:38:54.331994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327655+0000","last_change":"2024-08-19T00:38:54.327655+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327655+0000","last_undegraded":"2024-08-19T00:38:54.327655+0000","last_fullsized":"2024-08-19T00:38:54.327655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339928+0000","last_change":"2024-08-19T00:38:54.339928+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339928+0000","last_undegraded":"2024-08-19T00:38:54.339928+0000","last_fullsized":"2024-08-19T00:38:54.339928+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327851+0000","last_change":"2024-08-19T00:38:54.327851+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327851+0000","last_undegraded":"2024-08-19T00:38:54.327851+0000","last_fullsized":"2024-08-19T00:38:54.327851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334914+0000","last_change":"2024-08-19T00:38:54.334914+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334914+0000","last_undegraded":"2024-08-19T00:38:54.334914+0000","last_fullsized":"2024-08-19T00:38:54.334914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338520+0000","last_change":"2024-08-19T00:38:54.338520+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338520+0000","last_undegraded":"2024-08-19T00:38:54.338520+0000","last_fullsized":"2024-08-19T00:38:54.338520+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.339452+0000","last_change":"2024-08-19T00:38:54.339452+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.339452+0000","last_undegraded":"2024-08-19T00:38:54.339452+0000","last_fullsized":"2024-08-19T00:38:54.339452+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334985+0000","last_change":"2024-08-19T00:38:54.334985+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334985+0000","last_undegraded":"2024-08-19T00:38:54.334985+0000","last_fullsized":"2024-08-19T00:38:54.334985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335274+0000","last_change":"2024-08-19T00:38:54.335274+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335274+0000","last_undegraded":"2024-08-19T00:38:54.335274+0000","last_fullsized":"2024-08-19T00:38:54.335274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327840+0000","last_change":"2024-08-19T00:38:54.327840+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327840+0000","last_undegraded":"2024-08-19T00:38:54.327840+0000","last_fullsized":"2024-08-19T00:38:54.327840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332340+0000","last_change":"2024-08-19T00:38:54.332340+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332340+0000","last_undegraded":"2024-08-19T00:38:54.332340+0000","last_fullsized":"2024-08-19T00:38:54.332340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334261+0000","last_change":"2024-08-19T00:38:54.334261+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334261+0000","last_undegraded":"2024-08-19T00:38:54.334261+0000","last_fullsized":"2024-08-19T00:38:54.334261+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328352+0000","last_change":"2024-08-19T00:38:54.328352+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328352+0000","last_undegraded":"2024-08-19T00:38:54.328352+0000","last_fullsized":"2024-08-19T00:38:54.328352+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352999+0000","last_change":"2024-08-19T00:38:54.351258+0000","last_active":"2024-08-19T00:38:54.352999+0000","last_peered":"2024-08-19T00:38:54.352999+0000","last_clean":"2024-08-19T00:38:54.352999+0000","last_became_active":"2024-08-19T00:38:54.350541+0000","last_became_peered":"2024-08-19T00:38:54.350541+0000","last_unstale":"2024-08-19T00:38:54.352999+0000","last_undegraded":"2024-08-19T00:38:54.352999+0000","last_fullsized":"2024-08-19T00:38:54.352999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.639154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334112+0000","last_change":"2024-08-19T00:38:54.334112+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334112+0000","last_undegraded":"2024-08-19T00:38:54.334112+0000","last_fullsized":"2024-08-19T00:38:54.334112+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345500+0000","last_change":"2024-08-19T00:38:54.341106+0000","last_active":"2024-08-19T00:38:54.345500+0000","last_peered":"2024-08-19T00:38:54.345500+0000","last_clean":"2024-08-19T00:38:54.345500+0000","last_became_active":"2024-08-19T00:38:54.340815+0000","last_became_peered":"2024-08-19T00:38:54.340815+0000","last_unstale":"2024-08-19T00:38:54.345500+0000","last_undegraded":"2024-08-19T00:38:54.345500+0000","last_fullsized":"2024-08-19T00:38:54.345500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:30.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328756+0000","last_change":"2024-08-19T00:38:54.328756+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328756+0000","last_undegraded":"2024-08-19T00:38:54.328756+0000","last_fullsized":"2024-08-19T00:38:54.328756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348652+0000","last_change":"2024-08-19T00:38:54.347121+0000","last_active":"2024-08-19T00:38:54.348652+0000","last_peered":"2024-08-19T00:38:54.348652+0000","last_clean":"2024-08-19T00:38:54.348652+0000","last_became_active":"2024-08-19T00:38:54.346853+0000","last_became_peered":"2024-08-19T00:38:54.346853+0000","last_unstale":"2024-08-19T00:38:54.348652+0000","last_undegraded":"2024-08-19T00:38:54.348652+0000","last_fullsized":"2024-08-19T00:38:54.348652+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:07.935034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338096+0000","last_change":"2024-08-19T00:38:54.338096+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338096+0000","last_undegraded":"2024-08-19T00:38:54.338096+0000","last_fullsized":"2024-08-19T00:38:54.338096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.341600+0000","last_change":"2024-08-19T00:38:54.336448+0000","last_active":"2024-08-19T00:38:54.341600+0000","last_peered":"2024-08-19T00:38:54.341600+0000","last_clean":"2024-08-19T00:38:54.341600+0000","last_became_active":"2024-08-19T00:38:54.336119+0000","last_became_peered":"2024-08-19T00:38:54.336119+0000","last_unstale":"2024-08-19T00:38:54.341600+0000","last_undegraded":"2024-08-19T00:38:54.341600+0000","last_fullsized":"2024-08-19T00:38:54.341600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:46.926817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.337044+0000","last_change":"2024-08-19T00:38:54.337044+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.337044+0000","last_undegraded":"2024-08-19T00:38:54.337044+0000","last_fullsized":"2024-08-19T00:38:54.337044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345864+0000","last_change":"2024-08-19T00:38:54.342546+0000","last_active":"2024-08-19T00:38:54.345864+0000","last_peered":"2024-08-19T00:38:54.345864+0000","last_clean":"2024-08-19T00:38:54.345864+0000","last_became_active":"2024-08-19T00:38:54.342242+0000","last_became_peered":"2024-08-19T00:38:54.342242+0000","last_unstale":"2024-08-19T00:38:54.345864+0000","last_undegraded":"2024-08-19T00:38:54.345864+0000","last_fullsized":"2024-08-19T00:38:54.345864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:27:30.743408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331833+0000","last_change":"2024-08-19T00:38:54.331833+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331833+0000","last_undegraded":"2024-08-19T00:38:54.331833+0000","last_fullsized":"2024-08-19T00:38:54.331833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352208+0000","last_change":"2024-08-19T00:38:54.349377+0000","last_active":"2024-08-19T00:38:54.352208+0000","last_peered":"2024-08-19T00:38:54.352208+0000","last_clean":"2024-08-19T00:38:54.352208+0000","last_became_active":"2024-08-19T00:38:54.349118+0000","last_became_peered":"2024-08-19T00:38:54.349118+0000","last_unstale":"2024-08-19T00:38:54.352208+0000","last_undegraded":"2024-08-19T00:38:54.352208+0000","last_fullsized":"2024-08-19T00:38:54.352208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:44.945873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.336940+0000","last_change":"2024-08-19T00:38:54.336940+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.336940+0000","last_undegraded":"2024-08-19T00:38:54.336940+0000","last_fullsized":"2024-08-19T00:38:54.336940+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349712+0000","last_change":"2024-08-19T00:38:54.344490+0000","last_active":"2024-08-19T00:38:54.349712+0000","last_peered":"2024-08-19T00:38:54.349712+0000","last_clean":"2024-08-19T00:38:54.349712+0000","last_became_active":"2024-08-19T00:38:54.344198+0000","last_became_peered":"2024-08-19T00:38:54.344198+0000","last_unstale":"2024-08-19T00:38:54.349712+0000","last_undegraded":"2024-08-19T00:38:54.349712+0000","last_fullsized":"2024-08-19T00:38:54.349712+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338863+0000","last_change":"2024-08-19T00:38:54.338863+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338863+0000","last_undegraded":"2024-08-19T00:38:54.338863+0000","last_fullsized":"2024-08-19T00:38:54.338863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347492+0000","last_change":"2024-08-19T00:38:54.344307+0000","last_active":"2024-08-19T00:38:54.347492+0000","last_peered":"2024-08-19T00:38:54.347492+0000","last_clean":"2024-08-19T00:38:54.347492+0000","last_became_active":"2024-08-19T00:38:54.344000+0000","last_became_peered":"2024-08-19T00:38:54.344000+0000","last_unstale":"2024-08-19T00:38:54.347492+0000","last_undegraded":"2024-08-19T00:38:54.347492+0000","last_fullsized":"2024-08-19T00:38:54.347492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.335032+0000","last_change":"2024-08-19T00:38:54.335032+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.335032+0000","last_undegraded":"2024-08-19T00:38:54.335032+0000","last_fullsized":"2024-08-19T00:38:54.335032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351397+0000","last_change":"2024-08-19T00:38:54.347355+0000","last_active":"2024-08-19T00:38:54.351397+0000","last_peered":"2024-08-19T00:38:54.351397+0000","last_clean":"2024-08-19T00:38:54.351397+0000","last_became_active":"2024-08-19T00:38:54.344875+0000","last_became_peered":"2024-08-19T00:38:54.344875+0000","last_unstale":"2024-08-19T00:38:54.351397+0000","last_undegraded":"2024-08-19T00:38:54.351397+0000","last_fullsized":"2024-08-19T00:38:54.351397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:41.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333712+0000","last_change":"2024-08-19T00:38:54.333712+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333712+0000","last_undegraded":"2024-08-19T00:38:54.333712+0000","last_fullsized":"2024-08-19T00:38:54.333712+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355804+0000","last_change":"2024-08-19T00:38:54.351964+0000","last_active":"2024-08-19T00:38:54.355804+0000","last_peered":"2024-08-19T00:38:54.355804+0000","last_clean":"2024-08-19T00:38:54.355804+0000","last_became_active":"2024-08-19T00:38:54.351662+0000","last_became_peered":"2024-08-19T00:38:54.351662+0000","last_unstale":"2024-08-19T00:38:54.355804+0000","last_undegraded":"2024-08-19T00:38:54.355804+0000","last_fullsized":"2024-08-19T00:38:54.355804+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:33.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334857+0000","last_change":"2024-08-19T00:38:54.334857+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334857+0000","last_undegraded":"2024-08-19T00:38:54.334857+0000","last_fullsized":"2024-08-19T00:38:54.334857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.349339+0000","last_change":"2024-08-19T00:38:54.347070+0000","last_active":"2024-08-19T00:38:54.349339+0000","last_peered":"2024-08-19T00:38:54.349339+0000","last_clean":"2024-08-19T00:38:54.349339+0000","last_became_active":"2024-08-19T00:38:54.346775+0000","last_became_peered":"2024-08-19T00:38:54.346775+0000","last_unstale":"2024-08-19T00:38:54.349339+0000","last_undegraded":"2024-08-19T00:38:54.349339+0000","last_fullsized":"2024-08-19T00:38:54.349339+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334475+0000","last_change":"2024-08-19T00:38:54.334475+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334475+0000","last_undegraded":"2024-08-19T00:38:54.334475+0000","last_fullsized":"2024-08-19T00:38:54.334475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348664+0000","last_change":"2024-08-19T00:38:54.346097+0000","last_active":"2024-08-19T00:38:54.348664+0000","last_peered":"2024-08-19T00:38:54.348664+0000","last_clean":"2024-08-19T00:38:54.348664+0000","last_became_active":"2024-08-19T00:38:54.343893+0000","last_became_peered":"2024-08-19T00:38:54.343893+0000","last_unstale":"2024-08-19T00:38:54.348664+0000","last_undegraded":"2024-08-19T00:38:54.348664+0000","last_fullsized":"2024-08-19T00:38:54.348664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334848+0000","last_change":"2024-08-19T00:38:54.334848+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334848+0000","last_undegraded":"2024-08-19T00:38:54.334848+0000","last_fullsized":"2024-08-19T00:38:54.334848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.345005+0000","last_change":"2024-08-19T00:38:54.343418+0000","last_active":"2024-08-19T00:38:54.345005+0000","last_peered":"2024-08-19T00:38:54.345005+0000","last_clean":"2024-08-19T00:38:54.345005+0000","last_became_active":"2024-08-19T00:38:54.343059+0000","last_became_peered":"2024-08-19T00:38:54.343059+0000","last_unstale":"2024-08-19T00:38:54.345005+0000","last_undegraded":"2024-08-19T00:38:54.345005+0000","last_fullsized":"2024-08-19T00:38:54.345005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327674+0000","last_change":"2024-08-19T00:38:54.327674+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327674+0000","last_undegraded":"2024-08-19T00:38:54.327674+0000","last_fullsized":"2024-08-19T00:38:54.327674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351568+0000","last_change":"2024-08-19T00:38:54.345428+0000","last_active":"2024-08-19T00:38:54.351568+0000","last_peered":"2024-08-19T00:38:54.351568+0000","last_clean":"2024-08-19T00:38:54.351568+0000","last_became_active":"2024-08-19T00:38:54.345122+0000","last_became_peered":"2024-08-19T00:38:54.345122+0000","last_unstale":"2024-08-19T00:38:54.351568+0000","last_undegraded":"2024-08-19T00:38:54.351568+0000","last_fullsized":"2024-08-19T00:38:54.351568+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:02.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327761+0000","last_change":"2024-08-19T00:38:54.327761+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327761+0000","last_undegraded":"2024-08-19T00:38:54.327761+0000","last_fullsized":"2024-08-19T00:38:54.327761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351561+0000","last_change":"2024-08-19T00:38:54.349434+0000","last_active":"2024-08-19T00:38:54.351561+0000","last_peered":"2024-08-19T00:38:54.351561+0000","last_clean":"2024-08-19T00:38:54.351561+0000","last_became_active":"2024-08-19T00:38:54.349177+0000","last_became_peered":"2024-08-19T00:38:54.349177+0000","last_unstale":"2024-08-19T00:38:54.351561+0000","last_undegraded":"2024-08-19T00:38:54.351561+0000","last_fullsized":"2024-08-19T00:38:54.351561+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:33.953532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.330173+0000","last_change":"2024-08-19T00:38:54.330173+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.330173+0000","last_undegraded":"2024-08-19T00:38:54.330173+0000","last_fullsized":"2024-08-19T00:38:54.330173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.350762+0000","last_change":"2024-08-19T00:38:54.346829+0000","last_active":"2024-08-19T00:38:54.350762+0000","last_peered":"2024-08-19T00:38:54.350762+0000","last_clean":"2024-08-19T00:38:54.350762+0000","last_became_active":"2024-08-19T00:38:54.346572+0000","last_became_peered":"2024-08-19T00:38:54.346572+0000","last_unstale":"2024-08-19T00:38:54.350762+0000","last_undegraded":"2024-08-19T00:38:54.350762+0000","last_fullsized":"2024-08-19T00:38:54.350762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:11.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327714+0000","last_change":"2024-08-19T00:38:54.327714+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327714+0000","last_undegraded":"2024-08-19T00:38:54.327714+0000","last_fullsized":"2024-08-19T00:38:54.327714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355542+0000","last_change":"2024-08-19T00:38:54.349597+0000","last_active":"2024-08-19T00:38:54.355542+0000","last_peered":"2024-08-19T00:38:54.355542+0000","last_clean":"2024-08-19T00:38:54.355542+0000","last_became_active":"2024-08-19T00:38:54.348927+0000","last_became_peered":"2024-08-19T00:38:54.348927+0000","last_unstale":"2024-08-19T00:38:54.355542+0000","last_undegraded":"2024-08-19T00:38:54.355542+0000","last_fullsized":"2024-08-19T00:38:54.355542+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.327936+0000","last_change":"2024-08-19T00:38:54.327936+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.327936+0000","last_undegraded":"2024-08-19T00:38:54.327936+0000","last_fullsized":"2024-08-19T00:38:54.327936+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351282+0000","last_change":"2024-08-19T00:38:54.346271+0000","last_active":"2024-08-19T00:38:54.351282+0000","last_peered":"2024-08-19T00:38:54.351282+0000","last_clean":"2024-08-19T00:38:54.351282+0000","last_became_active":"2024-08-19T00:38:54.346017+0000","last_became_peered":"2024-08-19T00:38:54.346017+0000","last_unstale":"2024-08-19T00:38:54.351282+0000","last_undegraded":"2024-08-19T00:38:54.351282+0000","last_fullsized":"2024-08-19T00:38:54.351282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:24.124584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352750+0000","last_change":"2024-08-19T00:38:54.350148+0000","last_active":"2024-08-19T00:38:54.352750+0000","last_peered":"2024-08-19T00:38:54.352750+0000","last_clean":"2024-08-19T00:38:54.352750+0000","last_became_active":"2024-08-19T00:38:54.347799+0000","last_became_peered":"2024-08-19T00:38:54.347799+0000","last_unstale":"2024-08-19T00:38:54.352750+0000","last_undegraded":"2024-08-19T00:38:54.352750+0000","last_fullsized":"2024-08-19T00:38:54.352750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:08.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332636+0000","last_change":"2024-08-19T00:38:54.332636+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332636+0000","last_undegraded":"2024-08-19T00:38:54.332636+0000","last_fullsized":"2024-08-19T00:38:54.332636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353008+0000","last_change":"2024-08-19T00:38:54.350844+0000","last_active":"2024-08-19T00:38:54.353008+0000","last_peered":"2024-08-19T00:38:54.353008+0000","last_clean":"2024-08-19T00:38:54.353008+0000","last_became_active":"2024-08-19T00:38:54.350579+0000","last_became_peered":"2024-08-19T00:38:54.350579+0000","last_unstale":"2024-08-19T00:38:54.353008+0000","last_undegraded":"2024-08-19T00:38:54.353008+0000","last_fullsized":"2024-08-19T00:38:54.353008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:22.283543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333016+0000","last_change":"2024-08-19T00:38:54.333016+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333016+0000","last_undegraded":"2024-08-19T00:38:54.333016+0000","last_fullsized":"2024-08-19T00:38:54.333016+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355810+0000","last_change":"2024-08-19T00:38:54.351955+0000","last_active":"2024-08-19T00:38:54.355810+0000","last_peered":"2024-08-19T00:38:54.355810+0000","last_clean":"2024-08-19T00:38:54.355810+0000","last_became_active":"2024-08-19T00:38:54.351347+0000","last_became_peered":"2024-08-19T00:38:54.351347+0000","last_unstale":"2024-08-19T00:38:54.355810+0000","last_undegraded":"2024-08-19T00:38:54.355810+0000","last_fullsized":"2024-08-19T00:38:54.355810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:37.514345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334051+0000","last_change":"2024-08-19T00:38:54.334051+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334051+0000","last_undegraded":"2024-08-19T00:38:54.334051+0000","last_fullsized":"2024-08-19T00:38:54.334051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353746+0000","last_change":"2024-08-19T00:38:54.351507+0000","last_active":"2024-08-19T00:38:54.353746+0000","last_peered":"2024-08-19T00:38:54.353746+0000","last_clean":"2024-08-19T00:38:54.353746+0000","last_became_active":"2024-08-19T00:38:54.350965+0000","last_became_peered":"2024-08-19T00:38:54.350965+0000","last_unstale":"2024-08-19T00:38:54.353746+0000","last_undegraded":"2024-08-19T00:38:54.353746+0000","last_fullsized":"2024-08-19T00:38:54.353746+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333801+0000","last_change":"2024-08-19T00:38:54.333801+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333801+0000","last_undegraded":"2024-08-19T00:38:54.333801+0000","last_fullsized":"2024-08-19T00:38:54.333801+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.348609+0000","last_change":"2024-08-19T00:38:54.345173+0000","last_active":"2024-08-19T00:38:54.348609+0000","last_peered":"2024-08-19T00:38:54.348609+0000","last_clean":"2024-08-19T00:38:54.348609+0000","last_became_active":"2024-08-19T00:38:54.344931+0000","last_became_peered":"2024-08-19T00:38:54.344931+0000","last_unstale":"2024-08-19T00:38:54.348609+0000","last_undegraded":"2024-08-19T00:38:54.348609+0000","last_fullsized":"2024-08-19T00:38:54.348609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333830+0000","last_change":"2024-08-19T00:38:54.333830+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333830+0000","last_undegraded":"2024-08-19T00:38:54.333830+0000","last_fullsized":"2024-08-19T00:38:54.333830+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.347685+0000","last_change":"2024-08-19T00:38:54.345007+0000","last_active":"2024-08-19T00:38:54.347685+0000","last_peered":"2024-08-19T00:38:54.347685+0000","last_clean":"2024-08-19T00:38:54.347685+0000","last_became_active":"2024-08-19T00:38:54.344731+0000","last_became_peered":"2024-08-19T00:38:54.344731+0000","last_unstale":"2024-08-19T00:38:54.347685+0000","last_undegraded":"2024-08-19T00:38:54.347685+0000","last_fullsized":"2024-08-19T00:38:54.347685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:44.571404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331845+0000","last_change":"2024-08-19T00:38:54.331845+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331845+0000","last_undegraded":"2024-08-19T00:38:54.331845+0000","last_fullsized":"2024-08-19T00:38:54.331845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.355552+0000","last_change":"2024-08-19T00:38:54.349998+0000","last_active":"2024-08-19T00:38:54.355552+0000","last_peered":"2024-08-19T00:38:54.355552+0000","last_clean":"2024-08-19T00:38:54.355552+0000","last_became_active":"2024-08-19T00:38:54.349609+0000","last_became_peered":"2024-08-19T00:38:54.349609+0000","last_unstale":"2024-08-19T00:38:54.355552+0000","last_undegraded":"2024-08-19T00:38:54.355552+0000","last_fullsized":"2024-08-19T00:38:54.355552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332706+0000","last_change":"2024-08-19T00:38:54.332706+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332706+0000","last_undegraded":"2024-08-19T00:38:54.332706+0000","last_fullsized":"2024-08-19T00:38:54.332706+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.354351+0000","last_change":"2024-08-19T00:38:54.353417+0000","last_active":"2024-08-19T00:38:54.354351+0000","last_peered":"2024-08-19T00:38:54.354351+0000","last_clean":"2024-08-19T00:38:54.354351+0000","last_became_active":"2024-08-19T00:38:54.353149+0000","last_became_peered":"2024-08-19T00:38:54.353149+0000","last_unstale":"2024-08-19T00:38:54.354351+0000","last_undegraded":"2024-08-19T00:38:54.354351+0000","last_fullsized":"2024-08-19T00:38:54.354351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.331627+0000","last_change":"2024-08-19T00:38:54.331627+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.331627+0000","last_undegraded":"2024-08-19T00:38:54.331627+0000","last_fullsized":"2024-08-19T00:38:54.331627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351748+0000","last_change":"2024-08-19T00:38:54.348067+0000","last_active":"2024-08-19T00:38:54.351748+0000","last_peered":"2024-08-19T00:38:54.351748+0000","last_clean":"2024-08-19T00:38:54.351748+0000","last_became_active":"2024-08-19T00:38:54.347686+0000","last_became_peered":"2024-08-19T00:38:54.347686+0000","last_unstale":"2024-08-19T00:38:54.351748+0000","last_undegraded":"2024-08-19T00:38:54.351748+0000","last_fullsized":"2024-08-19T00:38:54.351748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:35.960033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.332614+0000","last_change":"2024-08-19T00:38:54.332614+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.332614+0000","last_undegraded":"2024-08-19T00:38:54.332614+0000","last_fullsized":"2024-08-19T00:38:54.332614+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.353010+0000","last_change":"2024-08-19T00:38:54.348542+0000","last_active":"2024-08-19T00:38:54.353010+0000","last_peered":"2024-08-19T00:38:54.353010+0000","last_clean":"2024-08-19T00:38:54.353010+0000","last_became_active":"2024-08-19T00:38:54.348292+0000","last_became_peered":"2024-08-19T00:38:54.348292+0000","last_unstale":"2024-08-19T00:38:54.353010+0000","last_undegraded":"2024-08-19T00:38:54.353010+0000","last_fullsized":"2024-08-19T00:38:54.353010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:23.899300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.333244+0000","last_change":"2024-08-19T00:38:54.333244+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.333244+0000","last_undegraded":"2024-08-19T00:38:54.333244+0000","last_fullsized":"2024-08-19T00:38:54.333244+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351059+0000","last_change":"2024-08-19T00:38:54.347335+0000","last_active":"2024-08-19T00:38:54.351059+0000","last_peered":"2024-08-19T00:38:54.351059+0000","last_clean":"2024-08-19T00:38:54.351059+0000","last_became_active":"2024-08-19T00:38:54.347065+0000","last_became_peered":"2024-08-19T00:38:54.347065+0000","last_unstale":"2024-08-19T00:38:54.351059+0000","last_undegraded":"2024-08-19T00:38:54.351059+0000","last_fullsized":"2024-08-19T00:38:54.351059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:14:02.952709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.334134+0000","last_change":"2024-08-19T00:38:54.334134+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.334134+0000","last_undegraded":"2024-08-19T00:38:54.334134+0000","last_fullsized":"2024-08-19T00:38:54.334134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352292+0000","last_change":"2024-08-19T00:38:54.350331+0000","last_active":"2024-08-19T00:38:54.352292+0000","last_peered":"2024-08-19T00:38:54.352292+0000","last_clean":"2024-08-19T00:38:54.352292+0000","last_became_active":"2024-08-19T00:38:54.349006+0000","last_became_peered":"2024-08-19T00:38:54.349006+0000","last_unstale":"2024-08-19T00:38:54.352292+0000","last_undegraded":"2024-08-19T00:38:54.352292+0000","last_fullsized":"2024-08-19T00:38:54.352292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:18.045159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.328139+0000","last_change":"2024-08-19T00:38:54.328139+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.328139+0000","last_undegraded":"2024-08-19T00:38:54.328139+0000","last_fullsized":"2024-08-19T00:38:54.328139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.352684+0000","last_change":"2024-08-19T00:38:54.351356+0000","last_active":"2024-08-19T00:38:54.352684+0000","last_peered":"2024-08-19T00:38:54.352684+0000","last_clean":"2024-08-19T00:38:54.352684+0000","last_became_active":"2024-08-19T00:38:54.350850+0000","last_became_peered":"2024-08-19T00:38:54.350850+0000","last_unstale":"2024-08-19T00:38:54.352684+0000","last_undegraded":"2024-08-19T00:38:54.352684+0000","last_fullsized":"2024-08-19T00:38:54.352684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:51.200617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-08-19T00:38:54.338008+0000","last_change":"2024-08-19T00:38:54.338008+0000","last_active":"2024-08-19T00:38:54.320224+0000","last_peered":"2024-08-19T00:38:54.320224+0000","last_clean":"2024-08-19T00:38:54.320224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:38:54.338008+0000","last_undegraded":"2024-08-19T00:38:54.338008+0000","last_fullsized":"2024-08-19T00:38:54.338008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.351347+0000","last_change":"2024-08-19T00:38:54.347205+0000","last_active":"2024-08-19T00:38:54.351347+0000","last_peered":"2024-08-19T00:38:54.351347+0000","last_clean":"2024-08-19T00:38:54.351347+0000","last_became_active":"2024-08-19T00:38:54.344536+0000","last_became_peered":"2024-08-19T00:38:54.344536+0000","last_unstale":"2024-08-19T00:38:54.351347+0000","last_undegraded":"2024-08-19T00:38:54.351347+0000","last_fullsized":"2024-08-19T00:38:54.351347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:33.298522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-19T00:38:54.339486+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:38:54.339486+0000","last_peered":"2024-08-19T00:38:54.339486+0000","last_clean":"2024-08-19T00:38:54.339486+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:38:54.339486+0000","last_undegraded":"2024-08-19T00:38:54.339486+0000","last_fullsized":"2024-08-19T00:38:54.339486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":792306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":503808,"data_stored":201938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:04.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:04.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.447+0000 7ff328800640 1 Processor -- start 2024-08-19T00:39:04.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.447+0000 7ff328800640 1 -- start start 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.448+0000 7ff328800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff32015f5b0 0x7ff3200cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.448+0000 7ff328800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff3200d03c0 0x7ff3200d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff328800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3200cfaf0 con 0x7ff3200b4380 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff328800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff3200d0d60 con 0x7ff32015f5b0 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff328800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff32015f990 con 0x7ff3200d03c0 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff325e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff32015f5b0 0x7ff3200cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff326800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff3200b4380 0x7ff3200b47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40238/0 (socket says 172.21.15.7:40238) 2024-08-19T00:39:04.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff326800640 1 -- 172.21.15.7:0/1780193532 learned_addr learned my addr 172.21.15.7:0/1780193532 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:04.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff325400640 1 --2- 172.21.15.7:0/1780193532 >> v2:172.21.15.162:3300/0 conn(0x7ff3200d03c0 0x7ff3200d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff325e00640 1 -- 172.21.15.7:0/1780193532 >> v2:172.21.15.162:3300/0 conn(0x7ff3200d03c0 msgr2=0x7ff3200d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:04.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff325e00640 1 --2- 172.21.15.7:0/1780193532 >> v2:172.21.15.162:3300/0 conn(0x7ff3200d03c0 0x7ff3200d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff325e00640 1 -- 172.21.15.7:0/1780193532 >> v1:172.21.15.7:6789/0 conn(0x7ff3200b4380 legacy=0x7ff3200b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.449+0000 7ff325e00640 1 -- 172.21.15.7:0/1780193532 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3200b50b0 con 0x7ff32015f5b0 2024-08-19T00:39:04.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.450+0000 7ff325e00640 1 --2- 172.21.15.7:0/1780193532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff32015f5b0 0x7ff3200cf5b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b3340 tx=0x7ff31402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a1db6b6a14ea95 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:04.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff324a00640 1 -- 172.21.15.7:0/1780193532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314037070 con 0x7ff32015f5b0 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff324a00640 1 -- 172.21.15.7:0/1780193532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31402ae50 con 0x7ff32015f5b0 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff324a00640 1 -- 172.21.15.7:0/1780193532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314032660 con 0x7ff32015f5b0 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 -- 172.21.15.7:0/1780193532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff32015f5b0 msgr2=0x7ff3200cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 --2- 172.21.15.7:0/1780193532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff32015f5b0 0x7ff3200cf5b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b3340 tx=0x7ff31402a140 comp rx=0 tx=0).stop 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 -- 172.21.15.7:0/1780193532 shutdown_connections 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 --2- 172.21.15.7:0/1780193532 >> v2:172.21.15.162:3300/0 conn(0x7ff3200d03c0 0x7ff3200d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 --2- 172.21.15.7:0/1780193532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff32015f5b0 0x7ff3200cf5b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 -- 172.21.15.7:0/1780193532 >> 172.21.15.7:0/1780193532 conn(0x7ff32006bc70 msgr2=0x7ff32006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:04.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 -- 172.21.15.7:0/1780193532 shutdown_connections 2024-08-19T00:39:04.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.451+0000 7ff328800640 1 -- 172.21.15.7:0/1780193532 wait complete. 2024-08-19T00:39:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.453+0000 7ff328800640 1 Processor -- start 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.453+0000 7ff328800640 1 -- start start 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff328800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3200b4380 0x7ff320156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff328800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3200d03c0 0x7ff3201f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff328800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff32015f5b0 0x7ff3201f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff328800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3200cedb0 con 0x7ff3200d03c0 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff328800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3200cf120 con 0x7ff32015f5b0 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff328800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff32006e660 con 0x7ff3200b4380 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff325400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3200d03c0 0x7ff3201f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff325400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3200d03c0 0x7ff3201f6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55550/0 (socket says 172.21.15.7:55550) 2024-08-19T00:39:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff325400640 1 -- 172.21.15.7:0/1584627504 learned_addr learned my addr 172.21.15.7:0/1584627504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.454+0000 7ff325e00640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3200b4380 0x7ff320156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff326800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff32015f5b0 0x7ff3201f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff325400640 1 -- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3200b4380 msgr2=0x7ff320156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff325400640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3200b4380 0x7ff320156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff325400640 1 -- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff32015f5b0 msgr2=0x7ff3201f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff325400640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff32015f5b0 0x7ff3201f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff325400640 1 -- 172.21.15.7:0/1584627504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3201f5e60 con 0x7ff3200d03c0 2024-08-19T00:39:04.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff326800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff32015f5b0 0x7ff3201f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:04.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff325400640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3200d03c0 0x7ff3201f6f00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff31000d800 tx=0x7ff31000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:04.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff31a000640 1 -- 172.21.15.7:0/1584627504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31000b6c0 con 0x7ff3200d03c0 2024-08-19T00:39:04.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff31a000640 1 -- 172.21.15.7:0/1584627504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310019070 con 0x7ff3200d03c0 2024-08-19T00:39:04.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff31a000640 1 -- 172.21.15.7:0/1584627504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31000ba80 con 0x7ff3200d03c0 2024-08-19T00:39:04.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3201f6140 con 0x7ff3200d03c0 2024-08-19T00:39:04.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.455+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3201f6700 con 0x7ff3200d03c0 2024-08-19T00:39:04.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.456+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3200d0820 con 0x7ff3200d03c0 2024-08-19T00:39:04.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.457+0000 7ff31a000640 1 -- 172.21.15.7:0/1584627504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff31000bc20 con 0x7ff3200d03c0 2024-08-19T00:39:04.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.458+0000 7ff31a000640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff30406be30 0x7ff30406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.458+0000 7ff31a000640 1 -- 172.21.15.7:0/1584627504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff31008b300 con 0x7ff3200d03c0 2024-08-19T00:39:04.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.458+0000 7ff325e00640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff30406be30 0x7ff30406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.459+0000 7ff325e00640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff30406be30 0x7ff30406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff314034000 tx=0x7ff31402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:04.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.463+0000 7ff31a000640 1 -- 172.21.15.7:0/1584627504 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff310059ca0 con 0x7ff3200d03c0 2024-08-19T00:39:04.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.644+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff320156a70 con 0x7ff30406be30 2024-08-19T00:39:04.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.650+0000 7ff31a000640 1 -- 172.21.15.7:0/1584627504 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7ff31407f850 con 0x7ff30406be30 2024-08-19T00:39:04.656 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:04.658 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff30406be30 msgr2=0x7ff30406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff30406be30 0x7ff30406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff314034000 tx=0x7ff31402e000 comp rx=0 tx=0).stop 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3200d03c0 msgr2=0x7ff3201f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3200d03c0 0x7ff3201f6f00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff31000d800 tx=0x7ff31000dcc0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 shutdown_connections 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff30406be30 0x7ff30406e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff32015f5b0 0x7ff3201f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3200d03c0 0x7ff3201f6f00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 --2- 172.21.15.7:0/1584627504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3200b4380 0x7ff320156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 >> 172.21.15.7:0/1584627504 conn(0x7ff32006bc70 msgr2=0x7ff320074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:04.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 shutdown_connections 2024-08-19T00:39:04.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.654+0000 7ff328800640 1 -- 172.21.15.7:0/1584627504 wait complete. 2024-08-19T00:39:04.672 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-08-19T00:39:03.283339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238184,"kb_used_data":5352,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736536,"statfs":{"total":773094113280,"available":772850212864,"internally_reserved":0,"allocated":5480448,"data_stored":2905660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001896"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912320+0000","last_change":"2024-08-19T00:38:55.365608+0000","last_active":"2024-08-19T00:38:56.912320+0000","last_peered":"2024-08-19T00:38:56.912320+0000","last_clean":"2024-08-19T00:38:56.912320+0000","last_became_active":"2024-08-19T00:38:55.365343+0000","last_became_peered":"2024-08-19T00:38:55.365343+0000","last_unstale":"2024-08-19T00:38:56.912320+0000","last_undegraded":"2024-08-19T00:38:56.912320+0000","last_fullsized":"2024-08-19T00:38:56.912320+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:27.147524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911904+0000","last_change":"2024-08-19T00:38:55.368096+0000","last_active":"2024-08-19T00:38:56.911904+0000","last_peered":"2024-08-19T00:38:56.911904+0000","last_clean":"2024-08-19T00:38:56.911904+0000","last_became_active":"2024-08-19T00:38:55.367790+0000","last_became_peered":"2024-08-19T00:38:55.367790+0000","last_unstale":"2024-08-19T00:38:56.911904+0000","last_undegraded":"2024-08-19T00:38:56.911904+0000","last_fullsized":"2024-08-19T00:38:56.911904+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:45.578283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912021+0000","last_change":"2024-08-19T00:38:55.368217+0000","last_active":"2024-08-19T00:38:56.912021+0000","last_peered":"2024-08-19T00:38:56.912021+0000","last_clean":"2024-08-19T00:38:56.912021+0000","last_became_active":"2024-08-19T00:38:55.367862+0000","last_became_peered":"2024-08-19T00:38:55.367862+0000","last_unstale":"2024-08-19T00:38:56.912021+0000","last_undegraded":"2024-08-19T00:38:56.912021+0000","last_fullsized":"2024-08-19T00:38:56.912021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:27:31.750287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352016+0000","last_change":"2024-08-19T00:38:55.351815+0000","last_active":"2024-08-19T00:38:56.352016+0000","last_peered":"2024-08-19T00:38:56.352016+0000","last_clean":"2024-08-19T00:38:56.352016+0000","last_became_active":"2024-08-19T00:38:55.351543+0000","last_became_peered":"2024-08-19T00:38:55.351543+0000","last_unstale":"2024-08-19T00:38:56.352016+0000","last_undegraded":"2024-08-19T00:38:56.352016+0000","last_fullsized":"2024-08-19T00:38:56.352016+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:24.760260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910968+0000","last_change":"2024-08-19T00:38:55.366548+0000","last_active":"2024-08-19T00:38:56.910968+0000","last_peered":"2024-08-19T00:38:56.910968+0000","last_clean":"2024-08-19T00:38:56.910968+0000","last_became_active":"2024-08-19T00:38:55.366277+0000","last_became_peered":"2024-08-19T00:38:55.366277+0000","last_unstale":"2024-08-19T00:38:56.910968+0000","last_undegraded":"2024-08-19T00:38:56.910968+0000","last_fullsized":"2024-08-19T00:38:56.910968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:14:03.959589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910808+0000","last_change":"2024-08-19T00:38:55.368233+0000","last_active":"2024-08-19T00:38:56.910808+0000","last_peered":"2024-08-19T00:38:56.910808+0000","last_clean":"2024-08-19T00:38:56.910808+0000","last_became_active":"2024-08-19T00:38:55.367933+0000","last_became_peered":"2024-08-19T00:38:55.367933+0000","last_unstale":"2024-08-19T00:38:56.910808+0000","last_undegraded":"2024-08-19T00:38:56.910808+0000","last_fullsized":"2024-08-19T00:38:56.910808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:47.933697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.346868+0000","last_change":"2024-08-19T00:38:55.349520+0000","last_active":"2024-08-19T00:38:56.346868+0000","last_peered":"2024-08-19T00:38:56.346868+0000","last_clean":"2024-08-19T00:38:56.346868+0000","last_became_active":"2024-08-19T00:38:55.346092+0000","last_became_peered":"2024-08-19T00:38:55.346092+0000","last_unstale":"2024-08-19T00:38:56.346868+0000","last_undegraded":"2024-08-19T00:38:56.346868+0000","last_fullsized":"2024-08-19T00:38:56.346868+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:20.196135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.351844+0000","last_change":"2024-08-19T00:38:55.353968+0000","last_active":"2024-08-19T00:38:56.351844+0000","last_peered":"2024-08-19T00:38:56.351844+0000","last_clean":"2024-08-19T00:38:56.351844+0000","last_became_active":"2024-08-19T00:38:55.353648+0000","last_became_peered":"2024-08-19T00:38:55.353648+0000","last_unstale":"2024-08-19T00:38:56.351844+0000","last_undegraded":"2024-08-19T00:38:56.351844+0000","last_fullsized":"2024-08-19T00:38:56.351844+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.525982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911081+0000","last_change":"2024-08-19T00:38:55.367544+0000","last_active":"2024-08-19T00:38:56.911081+0000","last_peered":"2024-08-19T00:38:56.911081+0000","last_clean":"2024-08-19T00:38:56.911081+0000","last_became_active":"2024-08-19T00:38:55.365429+0000","last_became_peered":"2024-08-19T00:38:55.365429+0000","last_unstale":"2024-08-19T00:38:56.911081+0000","last_undegraded":"2024-08-19T00:38:56.911081+0000","last_fullsized":"2024-08-19T00:38:56.911081+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:45.578283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826930+0000","last_change":"2024-08-19T00:38:55.360768+0000","last_active":"2024-08-19T00:38:56.826930+0000","last_peered":"2024-08-19T00:38:56.826930+0000","last_clean":"2024-08-19T00:38:56.826930+0000","last_became_active":"2024-08-19T00:38:55.360454+0000","last_became_peered":"2024-08-19T00:38:55.360454+0000","last_unstale":"2024-08-19T00:38:56.826930+0000","last_undegraded":"2024-08-19T00:38:56.826930+0000","last_fullsized":"2024-08-19T00:38:56.826930+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:18.229211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352188+0000","last_change":"2024-08-19T00:38:55.360988+0000","last_active":"2024-08-19T00:38:56.352188+0000","last_peered":"2024-08-19T00:38:56.352188+0000","last_clean":"2024-08-19T00:38:56.352188+0000","last_became_active":"2024-08-19T00:38:55.360734+0000","last_became_peered":"2024-08-19T00:38:55.360734+0000","last_unstale":"2024-08-19T00:38:56.352188+0000","last_undegraded":"2024-08-19T00:38:56.352188+0000","last_fullsized":"2024-08-19T00:38:56.352188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:04.577588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911568+0000","last_change":"2024-08-19T00:38:55.358792+0000","last_active":"2024-08-19T00:38:56.911568+0000","last_peered":"2024-08-19T00:38:56.911568+0000","last_clean":"2024-08-19T00:38:56.911568+0000","last_became_active":"2024-08-19T00:38:55.358485+0000","last_became_peered":"2024-08-19T00:38:55.358485+0000","last_unstale":"2024-08-19T00:38:56.911568+0000","last_undegraded":"2024-08-19T00:38:56.911568+0000","last_fullsized":"2024-08-19T00:38:56.911568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:17.522387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910810+0000","last_change":"2024-08-19T00:38:55.366872+0000","last_active":"2024-08-19T00:38:56.910810+0000","last_peered":"2024-08-19T00:38:56.910810+0000","last_clean":"2024-08-19T00:38:56.910810+0000","last_became_active":"2024-08-19T00:38:55.366616+0000","last_became_peered":"2024-08-19T00:38:55.366616+0000","last_unstale":"2024-08-19T00:38:56.910810+0000","last_undegraded":"2024-08-19T00:38:56.910810+0000","last_fullsized":"2024-08-19T00:38:56.910810+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:17.522387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352427+0000","last_change":"2024-08-19T00:38:55.357018+0000","last_active":"2024-08-19T00:38:56.352427+0000","last_peered":"2024-08-19T00:38:56.352427+0000","last_clean":"2024-08-19T00:38:56.352427+0000","last_became_active":"2024-08-19T00:38:55.355619+0000","last_became_peered":"2024-08-19T00:38:55.355619+0000","last_unstale":"2024-08-19T00:38:56.352427+0000","last_undegraded":"2024-08-19T00:38:56.352427+0000","last_fullsized":"2024-08-19T00:38:56.352427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:08.352128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352504+0000","last_change":"2024-08-19T00:38:55.361783+0000","last_active":"2024-08-19T00:38:56.352504+0000","last_peered":"2024-08-19T00:38:56.352504+0000","last_clean":"2024-08-19T00:38:56.352504+0000","last_became_active":"2024-08-19T00:38:55.361467+0000","last_became_peered":"2024-08-19T00:38:55.361467+0000","last_unstale":"2024-08-19T00:38:56.352504+0000","last_undegraded":"2024-08-19T00:38:56.352504+0000","last_fullsized":"2024-08-19T00:38:56.352504+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:19.047295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910975+0000","last_change":"2024-08-19T00:38:55.357081+0000","last_active":"2024-08-19T00:38:56.910975+0000","last_peered":"2024-08-19T00:38:56.910975+0000","last_clean":"2024-08-19T00:38:56.910975+0000","last_became_active":"2024-08-19T00:38:55.356787+0000","last_became_peered":"2024-08-19T00:38:55.356787+0000","last_unstale":"2024-08-19T00:38:56.910975+0000","last_undegraded":"2024-08-19T00:38:56.910975+0000","last_fullsized":"2024-08-19T00:38:56.910975+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:45.952752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912196+0000","last_change":"2024-08-19T00:38:55.373264+0000","last_active":"2024-08-19T00:38:56.912196+0000","last_peered":"2024-08-19T00:38:56.912196+0000","last_clean":"2024-08-19T00:38:56.912196+0000","last_became_active":"2024-08-19T00:38:55.370587+0000","last_became_peered":"2024-08-19T00:38:55.370587+0000","last_unstale":"2024-08-19T00:38:56.912196+0000","last_undegraded":"2024-08-19T00:38:56.912196+0000","last_fullsized":"2024-08-19T00:38:56.912196+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:14:03.959589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912617+0000","last_change":"2024-08-19T00:38:55.369618+0000","last_active":"2024-08-19T00:38:56.912617+0000","last_peered":"2024-08-19T00:38:56.912617+0000","last_clean":"2024-08-19T00:38:56.912617+0000","last_became_active":"2024-08-19T00:38:55.369327+0000","last_became_peered":"2024-08-19T00:38:55.369327+0000","last_unstale":"2024-08-19T00:38:56.912617+0000","last_undegraded":"2024-08-19T00:38:56.912617+0000","last_fullsized":"2024-08-19T00:38:56.912617+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:19.052038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911618+0000","last_change":"2024-08-19T00:38:55.368607+0000","last_active":"2024-08-19T00:38:56.911618+0000","last_peered":"2024-08-19T00:38:56.911618+0000","last_clean":"2024-08-19T00:38:56.911618+0000","last_became_active":"2024-08-19T00:38:55.366380+0000","last_became_peered":"2024-08-19T00:38:55.366380+0000","last_unstale":"2024-08-19T00:38:56.911618+0000","last_undegraded":"2024-08-19T00:38:56.911618+0000","last_fullsized":"2024-08-19T00:38:56.911618+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.525982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826737+0000","last_change":"2024-08-19T00:38:55.358227+0000","last_active":"2024-08-19T00:38:56.826737+0000","last_peered":"2024-08-19T00:38:56.826737+0000","last_clean":"2024-08-19T00:38:56.826737+0000","last_became_active":"2024-08-19T00:38:55.357710+0000","last_became_peered":"2024-08-19T00:38:55.357710+0000","last_unstale":"2024-08-19T00:38:56.826737+0000","last_undegraded":"2024-08-19T00:38:56.826737+0000","last_fullsized":"2024-08-19T00:38:56.826737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:29.309382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352583+0000","last_change":"2024-08-19T00:38:55.353918+0000","last_active":"2024-08-19T00:38:56.352583+0000","last_peered":"2024-08-19T00:38:56.352583+0000","last_clean":"2024-08-19T00:38:56.352583+0000","last_became_active":"2024-08-19T00:38:55.353589+0000","last_became_peered":"2024-08-19T00:38:55.353589+0000","last_unstale":"2024-08-19T00:38:56.352583+0000","last_undegraded":"2024-08-19T00:38:56.352583+0000","last_fullsized":"2024-08-19T00:38:56.352583+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:17.956080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352717+0000","last_change":"2024-08-19T00:38:55.361688+0000","last_active":"2024-08-19T00:38:56.352717+0000","last_peered":"2024-08-19T00:38:56.352717+0000","last_clean":"2024-08-19T00:38:56.352717+0000","last_became_active":"2024-08-19T00:38:55.361383+0000","last_became_peered":"2024-08-19T00:38:55.361383+0000","last_unstale":"2024-08-19T00:38:56.352717+0000","last_undegraded":"2024-08-19T00:38:56.352717+0000","last_fullsized":"2024-08-19T00:38:56.352717+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:52.057455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.346973+0000","last_change":"2024-08-19T00:38:55.346939+0000","last_active":"2024-08-19T00:38:56.346973+0000","last_peered":"2024-08-19T00:38:56.346973+0000","last_clean":"2024-08-19T00:38:56.346973+0000","last_became_active":"2024-08-19T00:38:55.346110+0000","last_became_peered":"2024-08-19T00:38:55.346110+0000","last_unstale":"2024-08-19T00:38:56.346973+0000","last_undegraded":"2024-08-19T00:38:56.346973+0000","last_fullsized":"2024-08-19T00:38:56.346973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:00.774449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911256+0000","last_change":"2024-08-19T00:38:55.362284+0000","last_active":"2024-08-19T00:38:56.911256+0000","last_peered":"2024-08-19T00:38:56.911256+0000","last_clean":"2024-08-19T00:38:56.911256+0000","last_became_active":"2024-08-19T00:38:55.362050+0000","last_became_peered":"2024-08-19T00:38:55.362050+0000","last_unstale":"2024-08-19T00:38:56.911256+0000","last_undegraded":"2024-08-19T00:38:56.911256+0000","last_fullsized":"2024-08-19T00:38:56.911256+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:16.729039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912462+0000","last_change":"2024-08-19T00:38:55.365602+0000","last_active":"2024-08-19T00:38:56.912462+0000","last_peered":"2024-08-19T00:38:56.912462+0000","last_clean":"2024-08-19T00:38:56.912462+0000","last_became_active":"2024-08-19T00:38:55.365272+0000","last_became_peered":"2024-08-19T00:38:55.365272+0000","last_unstale":"2024-08-19T00:38:56.912462+0000","last_undegraded":"2024-08-19T00:38:56.912462+0000","last_fullsized":"2024-08-19T00:38:56.912462+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:24.760260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352167+0000","last_change":"2024-08-19T00:38:55.356802+0000","last_active":"2024-08-19T00:38:56.352167+0000","last_peered":"2024-08-19T00:38:56.352167+0000","last_clean":"2024-08-19T00:38:56.352167+0000","last_became_active":"2024-08-19T00:38:55.356507+0000","last_became_peered":"2024-08-19T00:38:55.356507+0000","last_unstale":"2024-08-19T00:38:56.352167+0000","last_undegraded":"2024-08-19T00:38:56.352167+0000","last_fullsized":"2024-08-19T00:38:56.352167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:31.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347483+0000","last_change":"2024-08-19T00:38:55.359968+0000","last_active":"2024-08-19T00:38:56.347483+0000","last_peered":"2024-08-19T00:38:56.347483+0000","last_clean":"2024-08-19T00:38:56.347483+0000","last_became_active":"2024-08-19T00:38:55.359549+0000","last_became_peered":"2024-08-19T00:38:55.359549+0000","last_unstale":"2024-08-19T00:38:56.347483+0000","last_undegraded":"2024-08-19T00:38:56.347483+0000","last_fullsized":"2024-08-19T00:38:56.347483+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:59.936973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347304+0000","last_change":"2024-08-19T00:38:55.355459+0000","last_active":"2024-08-19T00:38:56.347304+0000","last_peered":"2024-08-19T00:38:56.347304+0000","last_clean":"2024-08-19T00:38:56.347304+0000","last_became_active":"2024-08-19T00:38:55.355015+0000","last_became_peered":"2024-08-19T00:38:55.355015+0000","last_unstale":"2024-08-19T00:38:56.347304+0000","last_undegraded":"2024-08-19T00:38:56.347304+0000","last_fullsized":"2024-08-19T00:38:56.347304+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:04.397156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911110+0000","last_change":"2024-08-19T00:38:55.356349+0000","last_active":"2024-08-19T00:38:56.911110+0000","last_peered":"2024-08-19T00:38:56.911110+0000","last_clean":"2024-08-19T00:38:56.911110+0000","last_became_active":"2024-08-19T00:38:55.356055+0000","last_became_peered":"2024-08-19T00:38:55.356055+0000","last_unstale":"2024-08-19T00:38:56.911110+0000","last_undegraded":"2024-08-19T00:38:56.911110+0000","last_fullsized":"2024-08-19T00:38:56.911110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:24.208382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911469+0000","last_change":"2024-08-19T00:38:55.373641+0000","last_active":"2024-08-19T00:38:56.911469+0000","last_peered":"2024-08-19T00:38:56.911469+0000","last_clean":"2024-08-19T00:38:56.911469+0000","last_became_active":"2024-08-19T00:38:55.369794+0000","last_became_peered":"2024-08-19T00:38:55.369794+0000","last_unstale":"2024-08-19T00:38:56.911469+0000","last_undegraded":"2024-08-19T00:38:56.911469+0000","last_fullsized":"2024-08-19T00:38:56.911469+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:58.431758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910628+0000","last_change":"2024-08-19T00:38:55.355851+0000","last_active":"2024-08-19T00:38:56.910628+0000","last_peered":"2024-08-19T00:38:56.910628+0000","last_clean":"2024-08-19T00:38:56.910628+0000","last_became_active":"2024-08-19T00:38:55.355581+0000","last_became_peered":"2024-08-19T00:38:55.355581+0000","last_unstale":"2024-08-19T00:38:56.910628+0000","last_undegraded":"2024-08-19T00:38:56.910628+0000","last_fullsized":"2024-08-19T00:38:56.910628+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:58.431758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352009+0000","last_change":"2024-08-19T00:38:55.355608+0000","last_active":"2024-08-19T00:38:56.352009+0000","last_peered":"2024-08-19T00:38:56.352009+0000","last_clean":"2024-08-19T00:38:56.352009+0000","last_became_active":"2024-08-19T00:38:55.354582+0000","last_became_peered":"2024-08-19T00:38:55.354582+0000","last_unstale":"2024-08-19T00:38:56.352009+0000","last_undegraded":"2024-08-19T00:38:56.352009+0000","last_fullsized":"2024-08-19T00:38:56.352009+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:27.147524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.353067+0000","last_change":"2024-08-19T00:38:55.364717+0000","last_active":"2024-08-19T00:38:56.353067+0000","last_peered":"2024-08-19T00:38:56.353067+0000","last_clean":"2024-08-19T00:38:56.353067+0000","last_became_active":"2024-08-19T00:38:55.364433+0000","last_became_peered":"2024-08-19T00:38:55.364433+0000","last_unstale":"2024-08-19T00:38:56.353067+0000","last_undegraded":"2024-08-19T00:38:56.353067+0000","last_fullsized":"2024-08-19T00:38:56.353067+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:34.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911083+0000","last_change":"2024-08-19T00:38:54.351258+0000","last_active":"2024-08-19T00:38:56.911083+0000","last_peered":"2024-08-19T00:38:56.911083+0000","last_clean":"2024-08-19T00:38:56.911083+0000","last_became_active":"2024-08-19T00:38:54.350541+0000","last_became_peered":"2024-08-19T00:38:54.350541+0000","last_unstale":"2024-08-19T00:38:56.911083+0000","last_undegraded":"2024-08-19T00:38:56.911083+0000","last_fullsized":"2024-08-19T00:38:56.911083+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912601+0000","last_change":"2024-08-19T00:38:55.356145+0000","last_active":"2024-08-19T00:38:56.912601+0000","last_peered":"2024-08-19T00:38:56.912601+0000","last_clean":"2024-08-19T00:38:56.912601+0000","last_became_active":"2024-08-19T00:38:55.355768+0000","last_became_peered":"2024-08-19T00:38:55.355768+0000","last_unstale":"2024-08-19T00:38:56.912601+0000","last_undegraded":"2024-08-19T00:38:56.912601+0000","last_fullsized":"2024-08-19T00:38:56.912601+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:31.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347174+0000","last_change":"2024-08-19T00:38:54.341106+0000","last_active":"2024-08-19T00:38:56.347174+0000","last_peered":"2024-08-19T00:38:56.347174+0000","last_clean":"2024-08-19T00:38:56.347174+0000","last_became_active":"2024-08-19T00:38:54.340815+0000","last_became_peered":"2024-08-19T00:38:54.340815+0000","last_unstale":"2024-08-19T00:38:56.347174+0000","last_undegraded":"2024-08-19T00:38:56.347174+0000","last_fullsized":"2024-08-19T00:38:56.347174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:03.570708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911682+0000","last_change":"2024-08-19T00:38:55.368701+0000","last_active":"2024-08-19T00:38:56.911682+0000","last_peered":"2024-08-19T00:38:56.911682+0000","last_clean":"2024-08-19T00:38:56.911682+0000","last_became_active":"2024-08-19T00:38:55.368418+0000","last_became_peered":"2024-08-19T00:38:55.368418+0000","last_unstale":"2024-08-19T00:38:56.911682+0000","last_undegraded":"2024-08-19T00:38:56.911682+0000","last_fullsized":"2024-08-19T00:38:56.911682+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:47.933697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911093+0000","last_change":"2024-08-19T00:38:54.347121+0000","last_active":"2024-08-19T00:38:56.911093+0000","last_peered":"2024-08-19T00:38:56.911093+0000","last_clean":"2024-08-19T00:38:56.911093+0000","last_became_active":"2024-08-19T00:38:54.346853+0000","last_became_peered":"2024-08-19T00:38:54.346853+0000","last_unstale":"2024-08-19T00:38:56.911093+0000","last_undegraded":"2024-08-19T00:38:56.911093+0000","last_fullsized":"2024-08-19T00:38:56.911093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:43.051258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352305+0000","last_change":"2024-08-19T00:38:55.348848+0000","last_active":"2024-08-19T00:38:56.352305+0000","last_peered":"2024-08-19T00:38:56.352305+0000","last_clean":"2024-08-19T00:38:56.352305+0000","last_became_active":"2024-08-19T00:38:55.348438+0000","last_became_peered":"2024-08-19T00:38:55.348438+0000","last_unstale":"2024-08-19T00:38:56.352305+0000","last_undegraded":"2024-08-19T00:38:56.352305+0000","last_fullsized":"2024-08-19T00:38:56.352305+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:11.903401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347400+0000","last_change":"2024-08-19T00:38:54.336448+0000","last_active":"2024-08-19T00:38:56.347400+0000","last_peered":"2024-08-19T00:38:56.347400+0000","last_clean":"2024-08-19T00:38:56.347400+0000","last_became_active":"2024-08-19T00:38:54.336119+0000","last_became_peered":"2024-08-19T00:38:54.336119+0000","last_unstale":"2024-08-19T00:38:56.347400+0000","last_undegraded":"2024-08-19T00:38:56.347400+0000","last_fullsized":"2024-08-19T00:38:56.347400+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:23.753380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347032+0000","last_change":"2024-08-19T00:38:55.363262+0000","last_active":"2024-08-19T00:38:56.347032+0000","last_peered":"2024-08-19T00:38:56.347032+0000","last_clean":"2024-08-19T00:38:56.347032+0000","last_became_active":"2024-08-19T00:38:55.362976+0000","last_became_peered":"2024-08-19T00:38:55.362976+0000","last_unstale":"2024-08-19T00:38:56.347032+0000","last_undegraded":"2024-08-19T00:38:56.347032+0000","last_fullsized":"2024-08-19T00:38:56.347032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:33:03.679317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911059+0000","last_change":"2024-08-19T00:38:54.342546+0000","last_active":"2024-08-19T00:38:56.911059+0000","last_peered":"2024-08-19T00:38:56.911059+0000","last_clean":"2024-08-19T00:38:56.911059+0000","last_became_active":"2024-08-19T00:38:54.342242+0000","last_became_peered":"2024-08-19T00:38:54.342242+0000","last_unstale":"2024-08-19T00:38:56.911059+0000","last_undegraded":"2024-08-19T00:38:56.911059+0000","last_fullsized":"2024-08-19T00:38:56.911059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:23.899300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826672+0000","last_change":"2024-08-19T00:38:55.362155+0000","last_active":"2024-08-19T00:38:56.826672+0000","last_peered":"2024-08-19T00:38:56.826672+0000","last_clean":"2024-08-19T00:38:56.826672+0000","last_became_active":"2024-08-19T00:38:55.361872+0000","last_became_peered":"2024-08-19T00:38:55.361872+0000","last_unstale":"2024-08-19T00:38:56.826672+0000","last_undegraded":"2024-08-19T00:38:56.826672+0000","last_fullsized":"2024-08-19T00:38:56.826672+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:11.903401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347080+0000","last_change":"2024-08-19T00:38:54.349377+0000","last_active":"2024-08-19T00:38:56.347080+0000","last_peered":"2024-08-19T00:38:56.347080+0000","last_clean":"2024-08-19T00:38:56.347080+0000","last_became_active":"2024-08-19T00:38:54.349118+0000","last_became_peered":"2024-08-19T00:38:54.349118+0000","last_unstale":"2024-08-19T00:38:56.347080+0000","last_undegraded":"2024-08-19T00:38:56.347080+0000","last_fullsized":"2024-08-19T00:38:56.347080+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:32.519103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826245+0000","last_change":"2024-08-19T00:38:55.359167+0000","last_active":"2024-08-19T00:38:56.826245+0000","last_peered":"2024-08-19T00:38:56.826245+0000","last_clean":"2024-08-19T00:38:56.826245+0000","last_became_active":"2024-08-19T00:38:55.357746+0000","last_became_peered":"2024-08-19T00:38:55.357746+0000","last_unstale":"2024-08-19T00:38:56.826245+0000","last_undegraded":"2024-08-19T00:38:56.826245+0000","last_fullsized":"2024-08-19T00:38:56.826245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:31.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911058+0000","last_change":"2024-08-19T00:38:54.344490+0000","last_active":"2024-08-19T00:38:56.911058+0000","last_peered":"2024-08-19T00:38:56.911058+0000","last_clean":"2024-08-19T00:38:56.911058+0000","last_became_active":"2024-08-19T00:38:54.344198+0000","last_became_peered":"2024-08-19T00:38:54.344198+0000","last_unstale":"2024-08-19T00:38:56.911058+0000","last_undegraded":"2024-08-19T00:38:56.911058+0000","last_fullsized":"2024-08-19T00:38:56.911058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:11.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347032+0000","last_change":"2024-08-19T00:38:55.359682+0000","last_active":"2024-08-19T00:38:56.347032+0000","last_peered":"2024-08-19T00:38:56.347032+0000","last_clean":"2024-08-19T00:38:56.347032+0000","last_became_active":"2024-08-19T00:38:55.359345+0000","last_became_peered":"2024-08-19T00:38:55.359345+0000","last_unstale":"2024-08-19T00:38:56.347032+0000","last_undegraded":"2024-08-19T00:38:56.347032+0000","last_fullsized":"2024-08-19T00:38:56.347032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:56:56.662915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826368+0000","last_change":"2024-08-19T00:38:54.344307+0000","last_active":"2024-08-19T00:38:56.826368+0000","last_peered":"2024-08-19T00:38:56.826368+0000","last_clean":"2024-08-19T00:38:56.826368+0000","last_became_active":"2024-08-19T00:38:54.344000+0000","last_became_peered":"2024-08-19T00:38:54.344000+0000","last_unstale":"2024-08-19T00:38:56.826368+0000","last_undegraded":"2024-08-19T00:38:56.826368+0000","last_fullsized":"2024-08-19T00:38:56.826368+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:52.595506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912787+0000","last_change":"2024-08-19T00:38:55.368054+0000","last_active":"2024-08-19T00:38:56.912787+0000","last_peered":"2024-08-19T00:38:56.912787+0000","last_clean":"2024-08-19T00:38:56.912787+0000","last_became_active":"2024-08-19T00:38:55.365363+0000","last_became_peered":"2024-08-19T00:38:55.365363+0000","last_unstale":"2024-08-19T00:38:56.912787+0000","last_undegraded":"2024-08-19T00:38:56.912787+0000","last_fullsized":"2024-08-19T00:38:56.912787+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:23.290422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912335+0000","last_change":"2024-08-19T00:38:54.347355+0000","last_active":"2024-08-19T00:38:56.912335+0000","last_peered":"2024-08-19T00:38:56.912335+0000","last_clean":"2024-08-19T00:38:56.912335+0000","last_became_active":"2024-08-19T00:38:54.344875+0000","last_became_peered":"2024-08-19T00:38:54.344875+0000","last_unstale":"2024-08-19T00:38:56.912335+0000","last_undegraded":"2024-08-19T00:38:56.912335+0000","last_fullsized":"2024-08-19T00:38:56.912335+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:17.233366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912241+0000","last_change":"2024-08-19T00:38:55.373258+0000","last_active":"2024-08-19T00:38:56.912241+0000","last_peered":"2024-08-19T00:38:56.912241+0000","last_clean":"2024-08-19T00:38:56.912241+0000","last_became_active":"2024-08-19T00:38:55.372972+0000","last_became_peered":"2024-08-19T00:38:55.372972+0000","last_unstale":"2024-08-19T00:38:56.912241+0000","last_undegraded":"2024-08-19T00:38:56.912241+0000","last_fullsized":"2024-08-19T00:38:56.912241+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:34.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826903+0000","last_change":"2024-08-19T00:38:54.351964+0000","last_active":"2024-08-19T00:38:56.826903+0000","last_peered":"2024-08-19T00:38:56.826903+0000","last_clean":"2024-08-19T00:38:56.826903+0000","last_became_active":"2024-08-19T00:38:54.351662+0000","last_became_peered":"2024-08-19T00:38:54.351662+0000","last_unstale":"2024-08-19T00:38:56.826903+0000","last_undegraded":"2024-08-19T00:38:56.826903+0000","last_fullsized":"2024-08-19T00:38:56.826903+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:46.926817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352230+0000","last_change":"2024-08-19T00:38:55.362632+0000","last_active":"2024-08-19T00:38:56.352230+0000","last_peered":"2024-08-19T00:38:56.352230+0000","last_clean":"2024-08-19T00:38:56.352230+0000","last_became_active":"2024-08-19T00:38:55.362348+0000","last_became_peered":"2024-08-19T00:38:55.362348+0000","last_unstale":"2024-08-19T00:38:56.352230+0000","last_undegraded":"2024-08-19T00:38:56.352230+0000","last_fullsized":"2024-08-19T00:38:56.352230+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:39.381949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911504+0000","last_change":"2024-08-19T00:38:54.347070+0000","last_active":"2024-08-19T00:38:56.911504+0000","last_peered":"2024-08-19T00:38:56.911504+0000","last_clean":"2024-08-19T00:38:56.911504+0000","last_became_active":"2024-08-19T00:38:54.346775+0000","last_became_peered":"2024-08-19T00:38:54.346775+0000","last_unstale":"2024-08-19T00:38:56.911504+0000","last_undegraded":"2024-08-19T00:38:56.911504+0000","last_fullsized":"2024-08-19T00:38:56.911504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:02.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347173+0000","last_change":"2024-08-19T00:38:55.351766+0000","last_active":"2024-08-19T00:38:56.347173+0000","last_peered":"2024-08-19T00:38:56.347173+0000","last_clean":"2024-08-19T00:38:56.347173+0000","last_became_active":"2024-08-19T00:38:55.350982+0000","last_became_peered":"2024-08-19T00:38:55.350982+0000","last_unstale":"2024-08-19T00:38:56.347173+0000","last_undegraded":"2024-08-19T00:38:56.347173+0000","last_fullsized":"2024-08-19T00:38:56.347173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:01:50.438694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826874+0000","last_change":"2024-08-19T00:38:54.346097+0000","last_active":"2024-08-19T00:38:56.826874+0000","last_peered":"2024-08-19T00:38:56.826874+0000","last_clean":"2024-08-19T00:38:56.826874+0000","last_became_active":"2024-08-19T00:38:54.343893+0000","last_became_peered":"2024-08-19T00:38:54.343893+0000","last_unstale":"2024-08-19T00:38:56.826874+0000","last_undegraded":"2024-08-19T00:38:56.826874+0000","last_fullsized":"2024-08-19T00:38:56.826874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:16.515507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912108+0000","last_change":"2024-08-19T00:38:55.369953+0000","last_active":"2024-08-19T00:38:56.912108+0000","last_peered":"2024-08-19T00:38:56.912108+0000","last_clean":"2024-08-19T00:38:56.912108+0000","last_became_active":"2024-08-19T00:38:55.369703+0000","last_became_peered":"2024-08-19T00:38:55.369703+0000","last_unstale":"2024-08-19T00:38:56.912108+0000","last_undegraded":"2024-08-19T00:38:56.912108+0000","last_fullsized":"2024-08-19T00:38:56.912108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:08.941914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352836+0000","last_change":"2024-08-19T00:38:54.343418+0000","last_active":"2024-08-19T00:38:56.352836+0000","last_peered":"2024-08-19T00:38:56.352836+0000","last_clean":"2024-08-19T00:38:56.352836+0000","last_became_active":"2024-08-19T00:38:54.343059+0000","last_became_peered":"2024-08-19T00:38:54.343059+0000","last_unstale":"2024-08-19T00:38:56.352836+0000","last_undegraded":"2024-08-19T00:38:56.352836+0000","last_fullsized":"2024-08-19T00:38:56.352836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:36:26.133647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352723+0000","last_change":"2024-08-19T00:38:55.353313+0000","last_active":"2024-08-19T00:38:56.352723+0000","last_peered":"2024-08-19T00:38:56.352723+0000","last_clean":"2024-08-19T00:38:56.352723+0000","last_became_active":"2024-08-19T00:38:55.352968+0000","last_became_peered":"2024-08-19T00:38:55.352968+0000","last_unstale":"2024-08-19T00:38:56.352723+0000","last_undegraded":"2024-08-19T00:38:56.352723+0000","last_fullsized":"2024-08-19T00:38:56.352723+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:27:31.750287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910913+0000","last_change":"2024-08-19T00:38:54.345428+0000","last_active":"2024-08-19T00:38:56.910913+0000","last_peered":"2024-08-19T00:38:56.910913+0000","last_clean":"2024-08-19T00:38:56.910913+0000","last_became_active":"2024-08-19T00:38:54.345122+0000","last_became_peered":"2024-08-19T00:38:54.345122+0000","last_unstale":"2024-08-19T00:38:56.910913+0000","last_undegraded":"2024-08-19T00:38:56.910913+0000","last_fullsized":"2024-08-19T00:38:56.910913+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:59.537586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.351719+0000","last_change":"2024-08-19T00:38:55.364866+0000","last_active":"2024-08-19T00:38:56.351719+0000","last_peered":"2024-08-19T00:38:56.351719+0000","last_clean":"2024-08-19T00:38:56.351719+0000","last_became_active":"2024-08-19T00:38:55.364575+0000","last_became_peered":"2024-08-19T00:38:55.364575+0000","last_unstale":"2024-08-19T00:38:56.351719+0000","last_undegraded":"2024-08-19T00:38:56.351719+0000","last_fullsized":"2024-08-19T00:38:56.351719+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:54.872101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910622+0000","last_change":"2024-08-19T00:38:54.349434+0000","last_active":"2024-08-19T00:38:56.910622+0000","last_peered":"2024-08-19T00:38:56.910622+0000","last_clean":"2024-08-19T00:38:56.910622+0000","last_became_active":"2024-08-19T00:38:54.349177+0000","last_became_peered":"2024-08-19T00:38:54.349177+0000","last_unstale":"2024-08-19T00:38:56.910622+0000","last_undegraded":"2024-08-19T00:38:56.910622+0000","last_fullsized":"2024-08-19T00:38:56.910622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:06.714649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912146+0000","last_change":"2024-08-19T00:38:55.357494+0000","last_active":"2024-08-19T00:38:56.912146+0000","last_peered":"2024-08-19T00:38:56.912146+0000","last_clean":"2024-08-19T00:38:56.912146+0000","last_became_active":"2024-08-19T00:38:55.357137+0000","last_became_peered":"2024-08-19T00:38:55.357137+0000","last_unstale":"2024-08-19T00:38:56.912146+0000","last_undegraded":"2024-08-19T00:38:56.912146+0000","last_fullsized":"2024-08-19T00:38:56.912146+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:34.305402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826419+0000","last_change":"2024-08-19T00:38:54.346829+0000","last_active":"2024-08-19T00:38:56.826419+0000","last_peered":"2024-08-19T00:38:56.826419+0000","last_clean":"2024-08-19T00:38:56.826419+0000","last_became_active":"2024-08-19T00:38:54.346572+0000","last_became_peered":"2024-08-19T00:38:54.346572+0000","last_unstale":"2024-08-19T00:38:56.826419+0000","last_undegraded":"2024-08-19T00:38:56.826419+0000","last_fullsized":"2024-08-19T00:38:56.826419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:15.722159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.353081+0000","last_change":"2024-08-19T00:38:55.363515+0000","last_active":"2024-08-19T00:38:56.353081+0000","last_peered":"2024-08-19T00:38:56.353081+0000","last_clean":"2024-08-19T00:38:56.353081+0000","last_became_active":"2024-08-19T00:38:55.363203+0000","last_became_peered":"2024-08-19T00:38:55.363203+0000","last_unstale":"2024-08-19T00:38:56.353081+0000","last_undegraded":"2024-08-19T00:38:56.353081+0000","last_fullsized":"2024-08-19T00:38:56.353081+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:19.052038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352679+0000","last_change":"2024-08-19T00:38:54.349597+0000","last_active":"2024-08-19T00:38:56.352679+0000","last_peered":"2024-08-19T00:38:56.352679+0000","last_clean":"2024-08-19T00:38:56.352679+0000","last_became_active":"2024-08-19T00:38:54.348927+0000","last_became_peered":"2024-08-19T00:38:54.348927+0000","last_unstale":"2024-08-19T00:38:56.352679+0000","last_undegraded":"2024-08-19T00:38:56.352679+0000","last_fullsized":"2024-08-19T00:38:56.352679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.353032+0000","last_change":"2024-08-19T00:38:55.367235+0000","last_active":"2024-08-19T00:38:56.353032+0000","last_peered":"2024-08-19T00:38:56.353032+0000","last_clean":"2024-08-19T00:38:56.353032+0000","last_became_active":"2024-08-19T00:38:55.366851+0000","last_became_peered":"2024-08-19T00:38:55.366851+0000","last_unstale":"2024-08-19T00:38:56.353032+0000","last_undegraded":"2024-08-19T00:38:56.353032+0000","last_fullsized":"2024-08-19T00:38:56.353032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:08.941914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912764+0000","last_change":"2024-08-19T00:38:54.346271+0000","last_active":"2024-08-19T00:38:56.912764+0000","last_peered":"2024-08-19T00:38:56.912764+0000","last_clean":"2024-08-19T00:38:56.912764+0000","last_became_active":"2024-08-19T00:38:54.346017+0000","last_became_peered":"2024-08-19T00:38:54.346017+0000","last_unstale":"2024-08-19T00:38:56.912764+0000","last_undegraded":"2024-08-19T00:38:56.912764+0000","last_fullsized":"2024-08-19T00:38:56.912764+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:51.200617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911826+0000","last_change":"2024-08-19T00:38:55.365805+0000","last_active":"2024-08-19T00:38:56.911826+0000","last_peered":"2024-08-19T00:38:56.911826+0000","last_clean":"2024-08-19T00:38:56.911826+0000","last_became_active":"2024-08-19T00:38:55.365535+0000","last_became_peered":"2024-08-19T00:38:55.365535+0000","last_unstale":"2024-08-19T00:38:56.911826+0000","last_undegraded":"2024-08-19T00:38:56.911826+0000","last_fullsized":"2024-08-19T00:38:56.911826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:31.252041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912140+0000","last_change":"2024-08-19T00:38:54.350148+0000","last_active":"2024-08-19T00:38:56.912140+0000","last_peered":"2024-08-19T00:38:56.912140+0000","last_clean":"2024-08-19T00:38:56.912140+0000","last_became_active":"2024-08-19T00:38:54.347799+0000","last_became_peered":"2024-08-19T00:38:54.347799+0000","last_unstale":"2024-08-19T00:38:56.912140+0000","last_undegraded":"2024-08-19T00:38:56.912140+0000","last_fullsized":"2024-08-19T00:38:56.912140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:35.960033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912001+0000","last_change":"2024-08-19T00:38:55.367415+0000","last_active":"2024-08-19T00:38:56.912001+0000","last_peered":"2024-08-19T00:38:56.912001+0000","last_clean":"2024-08-19T00:38:56.912001+0000","last_became_active":"2024-08-19T00:38:55.363243+0000","last_became_peered":"2024-08-19T00:38:55.363243+0000","last_unstale":"2024-08-19T00:38:56.912001+0000","last_undegraded":"2024-08-19T00:38:56.912001+0000","last_fullsized":"2024-08-19T00:38:56.912001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:52.057455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910706+0000","last_change":"2024-08-19T00:38:54.350844+0000","last_active":"2024-08-19T00:38:56.910706+0000","last_peered":"2024-08-19T00:38:56.910706+0000","last_clean":"2024-08-19T00:38:56.910706+0000","last_became_active":"2024-08-19T00:38:54.350579+0000","last_became_peered":"2024-08-19T00:38:54.350579+0000","last_unstale":"2024-08-19T00:38:56.910706+0000","last_undegraded":"2024-08-19T00:38:56.910706+0000","last_fullsized":"2024-08-19T00:38:56.910706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:55.553420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826372+0000","last_change":"2024-08-19T00:38:55.359676+0000","last_active":"2024-08-19T00:38:56.826372+0000","last_peered":"2024-08-19T00:38:56.826372+0000","last_clean":"2024-08-19T00:38:56.826372+0000","last_became_active":"2024-08-19T00:38:55.358946+0000","last_became_peered":"2024-08-19T00:38:55.358946+0000","last_unstale":"2024-08-19T00:38:56.826372+0000","last_undegraded":"2024-08-19T00:38:56.826372+0000","last_fullsized":"2024-08-19T00:38:56.826372+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:04.577588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826528+0000","last_change":"2024-08-19T00:38:54.351955+0000","last_active":"2024-08-19T00:38:56.826528+0000","last_peered":"2024-08-19T00:38:56.826528+0000","last_clean":"2024-08-19T00:38:56.826528+0000","last_became_active":"2024-08-19T00:38:54.351347+0000","last_became_peered":"2024-08-19T00:38:54.351347+0000","last_unstale":"2024-08-19T00:38:56.826528+0000","last_undegraded":"2024-08-19T00:38:56.826528+0000","last_fullsized":"2024-08-19T00:38:56.826528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:57.424878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910909+0000","last_change":"2024-08-19T00:38:55.359543+0000","last_active":"2024-08-19T00:38:56.910909+0000","last_peered":"2024-08-19T00:38:56.910909+0000","last_clean":"2024-08-19T00:38:56.910909+0000","last_became_active":"2024-08-19T00:38:55.359167+0000","last_became_peered":"2024-08-19T00:38:55.359167+0000","last_unstale":"2024-08-19T00:38:56.910909+0000","last_undegraded":"2024-08-19T00:38:56.910909+0000","last_fullsized":"2024-08-19T00:38:56.910909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:31.252041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910884+0000","last_change":"2024-08-19T00:38:54.351507+0000","last_active":"2024-08-19T00:38:56.910884+0000","last_peered":"2024-08-19T00:38:56.910884+0000","last_clean":"2024-08-19T00:38:56.910884+0000","last_became_active":"2024-08-19T00:38:54.350965+0000","last_became_peered":"2024-08-19T00:38:54.350965+0000","last_unstale":"2024-08-19T00:38:56.910884+0000","last_undegraded":"2024-08-19T00:38:56.910884+0000","last_fullsized":"2024-08-19T00:38:56.910884+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:33.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352708+0000","last_change":"2024-08-19T00:38:55.360163+0000","last_active":"2024-08-19T00:38:56.352708+0000","last_peered":"2024-08-19T00:38:56.352708+0000","last_clean":"2024-08-19T00:38:56.352708+0000","last_became_active":"2024-08-19T00:38:55.359891+0000","last_became_peered":"2024-08-19T00:38:55.359891+0000","last_unstale":"2024-08-19T00:38:56.352708+0000","last_undegraded":"2024-08-19T00:38:56.352708+0000","last_fullsized":"2024-08-19T00:38:56.352708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:48.815166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826210+0000","last_change":"2024-08-19T00:38:54.345173+0000","last_active":"2024-08-19T00:38:56.826210+0000","last_peered":"2024-08-19T00:38:56.826210+0000","last_clean":"2024-08-19T00:38:56.826210+0000","last_became_active":"2024-08-19T00:38:54.344931+0000","last_became_peered":"2024-08-19T00:38:54.344931+0000","last_unstale":"2024-08-19T00:38:56.826210+0000","last_undegraded":"2024-08-19T00:38:56.826210+0000","last_fullsized":"2024-08-19T00:38:56.826210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:59.537586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.353007+0000","last_change":"2024-08-19T00:38:55.362677+0000","last_active":"2024-08-19T00:38:56.353007+0000","last_peered":"2024-08-19T00:38:56.353007+0000","last_clean":"2024-08-19T00:38:56.353007+0000","last_became_active":"2024-08-19T00:38:55.362409+0000","last_became_peered":"2024-08-19T00:38:55.362409+0000","last_unstale":"2024-08-19T00:38:56.353007+0000","last_undegraded":"2024-08-19T00:38:56.353007+0000","last_fullsized":"2024-08-19T00:38:56.353007+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:35:32.448600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.346808+0000","last_change":"2024-08-19T00:38:54.345007+0000","last_active":"2024-08-19T00:38:56.346808+0000","last_peered":"2024-08-19T00:38:56.346808+0000","last_clean":"2024-08-19T00:38:56.346808+0000","last_became_active":"2024-08-19T00:38:54.344731+0000","last_became_peered":"2024-08-19T00:38:54.344731+0000","last_unstale":"2024-08-19T00:38:56.346808+0000","last_undegraded":"2024-08-19T00:38:56.346808+0000","last_fullsized":"2024-08-19T00:38:56.346808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:23.201503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347042+0000","last_change":"2024-08-19T00:38:55.360591+0000","last_active":"2024-08-19T00:38:56.347042+0000","last_peered":"2024-08-19T00:38:56.347042+0000","last_clean":"2024-08-19T00:38:56.347042+0000","last_became_active":"2024-08-19T00:38:55.359520+0000","last_became_peered":"2024-08-19T00:38:55.359520+0000","last_unstale":"2024-08-19T00:38:56.347042+0000","last_undegraded":"2024-08-19T00:38:56.347042+0000","last_fullsized":"2024-08-19T00:38:56.347042+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:57:57.766032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352445+0000","last_change":"2024-08-19T00:38:54.349998+0000","last_active":"2024-08-19T00:38:56.352445+0000","last_peered":"2024-08-19T00:38:56.352445+0000","last_clean":"2024-08-19T00:38:56.352445+0000","last_became_active":"2024-08-19T00:38:54.349609+0000","last_became_peered":"2024-08-19T00:38:54.349609+0000","last_unstale":"2024-08-19T00:38:56.352445+0000","last_undegraded":"2024-08-19T00:38:56.352445+0000","last_fullsized":"2024-08-19T00:38:56.352445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:11.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826805+0000","last_change":"2024-08-19T00:38:55.363673+0000","last_active":"2024-08-19T00:38:56.826805+0000","last_peered":"2024-08-19T00:38:56.826805+0000","last_clean":"2024-08-19T00:38:56.826805+0000","last_became_active":"2024-08-19T00:38:55.363356+0000","last_became_peered":"2024-08-19T00:38:55.363356+0000","last_unstale":"2024-08-19T00:38:56.826805+0000","last_undegraded":"2024-08-19T00:38:56.826805+0000","last_fullsized":"2024-08-19T00:38:56.826805+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:08.352128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911343+0000","last_change":"2024-08-19T00:38:54.353417+0000","last_active":"2024-08-19T00:38:56.911343+0000","last_peered":"2024-08-19T00:38:56.911343+0000","last_clean":"2024-08-19T00:38:56.911343+0000","last_became_active":"2024-08-19T00:38:54.353149+0000","last_became_peered":"2024-08-19T00:38:54.353149+0000","last_unstale":"2024-08-19T00:38:56.911343+0000","last_undegraded":"2024-08-19T00:38:56.911343+0000","last_fullsized":"2024-08-19T00:38:56.911343+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:52.595506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347329+0000","last_change":"2024-08-19T00:38:55.351985+0000","last_active":"2024-08-19T00:38:56.347329+0000","last_peered":"2024-08-19T00:38:56.347329+0000","last_clean":"2024-08-19T00:38:56.347329+0000","last_became_active":"2024-08-19T00:38:55.351329+0000","last_became_peered":"2024-08-19T00:38:55.351329+0000","last_unstale":"2024-08-19T00:38:56.347329+0000","last_undegraded":"2024-08-19T00:38:56.347329+0000","last_fullsized":"2024-08-19T00:38:56.347329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:37.528158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352966+0000","last_change":"2024-08-19T00:38:54.348067+0000","last_active":"2024-08-19T00:38:56.352966+0000","last_peered":"2024-08-19T00:38:56.352966+0000","last_clean":"2024-08-19T00:38:56.352966+0000","last_became_active":"2024-08-19T00:38:54.347686+0000","last_became_peered":"2024-08-19T00:38:54.347686+0000","last_unstale":"2024-08-19T00:38:56.352966+0000","last_undegraded":"2024-08-19T00:38:56.352966+0000","last_fullsized":"2024-08-19T00:38:56.352966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:17.233366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.826460+0000","last_change":"2024-08-19T00:38:55.357095+0000","last_active":"2024-08-19T00:38:56.826460+0000","last_peered":"2024-08-19T00:38:56.826460+0000","last_clean":"2024-08-19T00:38:56.826460+0000","last_became_active":"2024-08-19T00:38:55.356818+0000","last_became_peered":"2024-08-19T00:38:55.356818+0000","last_unstale":"2024-08-19T00:38:56.826460+0000","last_undegraded":"2024-08-19T00:38:56.826460+0000","last_fullsized":"2024-08-19T00:38:56.826460+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:39.381949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911119+0000","last_change":"2024-08-19T00:38:54.348542+0000","last_active":"2024-08-19T00:38:56.911119+0000","last_peered":"2024-08-19T00:38:56.911119+0000","last_clean":"2024-08-19T00:38:56.911119+0000","last_became_active":"2024-08-19T00:38:54.348292+0000","last_became_peered":"2024-08-19T00:38:54.348292+0000","last_unstale":"2024-08-19T00:38:56.911119+0000","last_undegraded":"2024-08-19T00:38:56.911119+0000","last_fullsized":"2024-08-19T00:38:56.911119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:37.514345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352366+0000","last_change":"2024-08-19T00:38:55.356255+0000","last_active":"2024-08-19T00:38:56.352366+0000","last_peered":"2024-08-19T00:38:56.352366+0000","last_clean":"2024-08-19T00:38:56.352366+0000","last_became_active":"2024-08-19T00:38:55.353686+0000","last_became_peered":"2024-08-19T00:38:55.353686+0000","last_unstale":"2024-08-19T00:38:56.352366+0000","last_undegraded":"2024-08-19T00:38:56.352366+0000","last_fullsized":"2024-08-19T00:38:56.352366+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:29.309382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347191+0000","last_change":"2024-08-19T00:38:54.347335+0000","last_active":"2024-08-19T00:38:56.347191+0000","last_peered":"2024-08-19T00:38:56.347191+0000","last_clean":"2024-08-19T00:38:56.347191+0000","last_became_active":"2024-08-19T00:38:54.347065+0000","last_became_peered":"2024-08-19T00:38:54.347065+0000","last_unstale":"2024-08-19T00:38:56.347191+0000","last_undegraded":"2024-08-19T00:38:56.347191+0000","last_fullsized":"2024-08-19T00:38:56.347191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:26.140645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.911972+0000","last_change":"2024-08-19T00:38:55.367234+0000","last_active":"2024-08-19T00:38:56.911972+0000","last_peered":"2024-08-19T00:38:56.911972+0000","last_clean":"2024-08-19T00:38:56.911972+0000","last_became_active":"2024-08-19T00:38:55.365804+0000","last_became_peered":"2024-08-19T00:38:55.365804+0000","last_unstale":"2024-08-19T00:38:56.911972+0000","last_undegraded":"2024-08-19T00:38:56.911972+0000","last_fullsized":"2024-08-19T00:38:56.911972+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:54.872101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.910784+0000","last_change":"2024-08-19T00:38:54.350331+0000","last_active":"2024-08-19T00:38:56.910784+0000","last_peered":"2024-08-19T00:38:56.910784+0000","last_clean":"2024-08-19T00:38:56.910784+0000","last_became_active":"2024-08-19T00:38:54.349006+0000","last_became_peered":"2024-08-19T00:38:54.349006+0000","last_unstale":"2024-08-19T00:38:56.910784+0000","last_undegraded":"2024-08-19T00:38:56.910784+0000","last_fullsized":"2024-08-19T00:38:56.910784+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:02.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912265+0000","last_change":"2024-08-19T00:38:55.363963+0000","last_active":"2024-08-19T00:38:56.912265+0000","last_peered":"2024-08-19T00:38:56.912265+0000","last_clean":"2024-08-19T00:38:56.912265+0000","last_became_active":"2024-08-19T00:38:55.363685+0000","last_became_peered":"2024-08-19T00:38:55.363685+0000","last_unstale":"2024-08-19T00:38:56.912265+0000","last_undegraded":"2024-08-19T00:38:56.912265+0000","last_fullsized":"2024-08-19T00:38:56.912265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:45.952752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352477+0000","last_change":"2024-08-19T00:38:54.351356+0000","last_active":"2024-08-19T00:38:56.352477+0000","last_peered":"2024-08-19T00:38:56.352477+0000","last_clean":"2024-08-19T00:38:56.352477+0000","last_became_active":"2024-08-19T00:38:54.350850+0000","last_became_peered":"2024-08-19T00:38:54.350850+0000","last_unstale":"2024-08-19T00:38:56.352477+0000","last_undegraded":"2024-08-19T00:38:56.352477+0000","last_fullsized":"2024-08-19T00:38:56.352477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:24.518023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.352441+0000","last_change":"2024-08-19T00:38:55.349883+0000","last_active":"2024-08-19T00:38:56.352441+0000","last_peered":"2024-08-19T00:38:56.352441+0000","last_clean":"2024-08-19T00:38:56.352441+0000","last_became_active":"2024-08-19T00:38:55.349343+0000","last_became_peered":"2024-08-19T00:38:55.349343+0000","last_unstale":"2024-08-19T00:38:56.352441+0000","last_undegraded":"2024-08-19T00:38:56.352441+0000","last_fullsized":"2024-08-19T00:38:56.352441+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:54.320224+0000","last_clean_scrub_stamp":"2024-08-19T00:38:54.320224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:18.229211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.347144+0000","last_change":"2024-08-19T00:38:54.347205+0000","last_active":"2024-08-19T00:38:56.347144+0000","last_peered":"2024-08-19T00:38:56.347144+0000","last_clean":"2024-08-19T00:38:56.347144+0000","last_became_active":"2024-08-19T00:38:54.344536+0000","last_became_peered":"2024-08-19T00:38:54.344536+0000","last_unstale":"2024-08-19T00:38:56.347144+0000","last_undegraded":"2024-08-19T00:38:56.347144+0000","last_fullsized":"2024-08-19T00:38:56.347144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:38:53.313344+0000","last_clean_scrub_stamp":"2024-08-19T00:38:53.313344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:30.256334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-19T00:38:56.912086+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:38:56.912086+0000","last_peered":"2024-08-19T00:38:56.912086+0000","last_clean":"2024-08-19T00:38:56.912086+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:38:56.912086+0000","last_undegraded":"2024-08-19T00:38:56.912086+0000","last_fullsized":"2024-08-19T00:38:56.912086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":215047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":215629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":805403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":216717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":540672,"data_stored":216625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":532480,"data_stored":215103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":805451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":215685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:04.677 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:39:04.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-19T00:39:04.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.873+0000 7f2733a00640 1 Processor -- start 2024-08-19T00:39:04.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.873+0000 7f2733a00640 1 -- start start 2024-08-19T00:39:04.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2733a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f272c0b5130 0x7f272c0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2733a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c15c390 0x7f272c0af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2733a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272c0acef0 con 0x7f272c15bfb0 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2733a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f272c0af650 con 0x7f272c0b5130 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2733a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f272c0ad790 con 0x7f272c15c390 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2731000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f272c15bfb0 0x7f272c0b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40242/0 (socket says 172.21.15.7:40242) 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2731000640 1 -- 172.21.15.7:0/969488020 learned_addr learned my addr 172.21.15.7:0/969488020 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f2731a00640 1 --2- 172.21.15.7:0/969488020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c15c390 0x7f272c0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f272be00640 1 --2- 172.21.15.7:0/969488020 >> v2:172.21.15.162:3300/0 conn(0x7f272c0b5130 0x7f272c0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f272b400640 1 -- 172.21.15.7:0/969488020 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3282634601 0 0) 0x7f272c0acef0 con 0x7f272c15bfb0 2024-08-19T00:39:04.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.875+0000 7f272b400640 1 -- 172.21.15.7:0/969488020 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2714003520 con 0x7f272c15bfb0 2024-08-19T00:39:04.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.876+0000 7f2731a00640 1 -- 172.21.15.7:0/969488020 >> v2:172.21.15.162:3300/0 conn(0x7f272c0b5130 msgr2=0x7f272c0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:04.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.876+0000 7f2731a00640 1 --2- 172.21.15.7:0/969488020 >> v2:172.21.15.162:3300/0 conn(0x7f272c0b5130 0x7f272c0aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.876+0000 7f2731a00640 1 -- 172.21.15.7:0/969488020 >> v1:172.21.15.7:6789/0 conn(0x7f272c15bfb0 legacy=0x7f272c0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.876+0000 7f2731a00640 1 -- 172.21.15.7:0/969488020 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c0ad1d0 con 0x7f272c15c390 2024-08-19T00:39:04.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.876+0000 7f272be00640 1 --2- 172.21.15.7:0/969488020 >> v2:172.21.15.162:3300/0 conn(0x7f272c0b5130 0x7f272c0aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:04.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.877+0000 7f2731a00640 1 --2- 172.21.15.7:0/969488020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c15c390 0x7f272c0af110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2724009d90 tx=0x7f272402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1a0812dba9c6a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:04.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.877+0000 7f272b400640 1 -- 172.21.15.7:0/969488020 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724007740 con 0x7f272c15c390 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.877+0000 7f272b400640 1 -- 172.21.15.7:0/969488020 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27240078e0 con 0x7f272c15c390 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.877+0000 7f272b400640 1 -- 172.21.15.7:0/969488020 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724007c90 con 0x7f272c15c390 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 -- 172.21.15.7:0/969488020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c15c390 msgr2=0x7f272c0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 --2- 172.21.15.7:0/969488020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c15c390 0x7f272c0af110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2724009d90 tx=0x7f272402a660 comp rx=0 tx=0).stop 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 -- 172.21.15.7:0/969488020 shutdown_connections 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 --2- 172.21.15.7:0/969488020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c15c390 0x7f272c0af110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 --2- 172.21.15.7:0/969488020 >> v2:172.21.15.162:3300/0 conn(0x7f272c0b5130 0x7f272c0aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 -- 172.21.15.7:0/969488020 >> 172.21.15.7:0/969488020 conn(0x7f272c0b2300 msgr2=0x7f272c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 -- 172.21.15.7:0/969488020 shutdown_connections 2024-08-19T00:39:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.878+0000 7f2733a00640 1 -- 172.21.15.7:0/969488020 wait complete. 2024-08-19T00:39:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.879+0000 7f2733a00640 1 Processor -- start 2024-08-19T00:39:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.880+0000 7f2733a00640 1 -- start start 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2733a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0b5130 0x7f272c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2733a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c15bfb0 0x7f272c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2733a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c15c390 0x7f272c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2733a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f272c072040 con 0x7f272c15bfb0 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2733a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f272c071b20 con 0x7f272c15c390 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2733a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f272c0721c0 con 0x7f272c0b5130 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c15bfb0 0x7f272c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c15bfb0 0x7f272c158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55562/0 (socket says 172.21.15.7:55562) 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 -- 172.21.15.7:0/2443514928 learned_addr learned my addr 172.21.15.7:0/2443514928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2731000640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0b5130 0x7f272c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f2731a00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c15c390 0x7f272c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 -- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0b5130 msgr2=0x7f272c15a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0b5130 0x7f272c15a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 -- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c15c390 msgr2=0x7f272c1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c15c390 0x7f272c1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.881+0000 7f272be00640 1 -- 172.21.15.7:0/2443514928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c159630 con 0x7f272c15bfb0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.882+0000 7f272be00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c15bfb0 0x7f272c158fa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f271800ebe0 tx=0x7f271800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.882+0000 7f2728c00640 1 -- 172.21.15.7:0/2443514928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2718017070 con 0x7f272c15bfb0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.882+0000 7f2728c00640 1 -- 172.21.15.7:0/2443514928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271800cc30 con 0x7f272c15bfb0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.882+0000 7f2728c00640 1 -- 172.21.15.7:0/2443514928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2718013470 con 0x7f272c15bfb0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.882+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c159910 con 0x7f272c15bfb0 2024-08-19T00:39:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.882+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c159ed0 con 0x7f272c15bfb0 2024-08-19T00:39:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.883+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272c0ae1f0 con 0x7f272c15bfb0 2024-08-19T00:39:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.884+0000 7f2728c00640 1 -- 172.21.15.7:0/2443514928 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f271801a070 con 0x7f272c15bfb0 2024-08-19T00:39:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.885+0000 7f2728c00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f270c06be30 0x7f270c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.885+0000 7f2728c00640 1 -- 172.21.15.7:0/2443514928 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f271808b200 con 0x7f272c15bfb0 2024-08-19T00:39:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.885+0000 7f2731000640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f270c06be30 0x7f270c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.886+0000 7f2731000640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f270c06be30 0x7f270c06e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2720005880 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:04.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:04.890+0000 7f2728c00640 1 -- 172.21.15.7:0/2443514928 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f272c0ae1f0 con 0x7f272c15bfb0 2024-08-19T00:39:05.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.138+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f272c0b3e00 con 0x7f272c15bfb0 2024-08-19T00:39:05.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.141+0000 7f2728c00640 1 -- 172.21.15.7:0/2443514928 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f2718059b10 con 0x7f272c15bfb0 2024-08-19T00:39:05.144 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-08-19T00:39:05.144 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:39:05.144 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-08-19T00:39:05.144 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-08-19T00:39:05.144 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-19T00:39:05.144 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-08-19T00:39:05.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f270c06be30 msgr2=0x7f270c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f270c06be30 0x7f270c06e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2720005880 tx=0x7f2720009040 comp rx=0 tx=0).stop 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c15bfb0 msgr2=0x7f272c158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c15bfb0 0x7f272c158fa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f271800ebe0 tx=0x7f271800c520 comp rx=0 tx=0).stop 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 shutdown_connections 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f270c06be30 0x7f270c06e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c15c390 0x7f272c1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f272c15bfb0 0x7f272c158fa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 --2- 172.21.15.7:0/2443514928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0b5130 0x7f272c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 >> 172.21.15.7:0/2443514928 conn(0x7f272c0b2300 msgr2=0x7f272c0afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.143+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 shutdown_connections 2024-08-19T00:39:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.144+0000 7f2733a00640 1 -- 172.21.15.7:0/2443514928 wait complete. 2024-08-19T00:39:05.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.316+0000 7f575f200640 1 Processor -- start 2024-08-19T00:39:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.317+0000 7f575f200640 1 -- start start 2024-08-19T00:39:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f57600b4750 0x7f57600d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57600d0c40 0x7f576009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f57600d10b0 con 0x7f57600d0c40 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f576006d4e0 con 0x7f57600b4750 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f576006d7c0 con 0x7f576015e470 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57600d0c40 0x7f576009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57600d0c40 0x7f576009aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55570/0 (socket says 172.21.15.7:55570) 2024-08-19T00:39:05.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575e800640 1 -- 172.21.15.7:0/1658719376 learned_addr learned my addr 172.21.15.7:0/1658719376 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575d400640 1 --2- 172.21.15.7:0/1658719376 >> v2:172.21.15.162:3300/0 conn(0x7f57600b4750 0x7f57600d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.318+0000 7f575de00640 1 --2- 172.21.15.7:0/1658719376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.319+0000 7f575e800640 1 -- 172.21.15.7:0/1658719376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 msgr2=0x7f57600d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.319+0000 7f575e800640 1 --2- 172.21.15.7:0/1658719376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.319+0000 7f575e800640 1 -- 172.21.15.7:0/1658719376 >> v2:172.21.15.162:3300/0 conn(0x7f57600b4750 msgr2=0x7f57600d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.319+0000 7f575e800640 1 --2- 172.21.15.7:0/1658719376 >> v2:172.21.15.162:3300/0 conn(0x7f57600b4750 0x7f57600d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.319+0000 7f575e800640 1 -- 172.21.15.7:0/1658719376 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576006daa0 con 0x7f57600d0c40 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.319+0000 7f575de00640 1 --2- 172.21.15.7:0/1658719376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575e800640 1 --2- 172.21.15.7:0/1658719376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f576009aa70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5760073430 tx=0x7f575802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36773e34c37af7a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575ca00640 1 -- 172.21.15.7:0/1658719376 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758036070 con 0x7f57600d0c40 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575ca00640 1 -- 172.21.15.7:0/1658719376 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758031600 con 0x7f57600d0c40 2024-08-19T00:39:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575ca00640 1 -- 172.21.15.7:0/1658719376 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57580319d0 con 0x7f57600d0c40 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575f200640 1 -- 172.21.15.7:0/1658719376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 msgr2=0x7f576009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575f200640 1 --2- 172.21.15.7:0/1658719376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f576009aa70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5760073430 tx=0x7f575802a6a0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575f200640 1 -- 172.21.15.7:0/1658719376 shutdown_connections 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575f200640 1 --2- 172.21.15.7:0/1658719376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f576009aa70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575f200640 1 --2- 172.21.15.7:0/1658719376 >> v2:172.21.15.162:3300/0 conn(0x7f57600b4750 0x7f57600d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575f200640 1 --2- 172.21.15.7:0/1658719376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.320+0000 7f575f200640 1 -- 172.21.15.7:0/1658719376 >> 172.21.15.7:0/1658719376 conn(0x7f57600b3a70 msgr2=0x7f57600b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.321+0000 7f575f200640 1 -- 172.21.15.7:0/1658719376 shutdown_connections 2024-08-19T00:39:05.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.321+0000 7f575f200640 1 -- 172.21.15.7:0/1658719376 wait complete. 2024-08-19T00:39:05.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.322+0000 7f575f200640 1 Processor -- start 2024-08-19T00:39:05.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.322+0000 7f575f200640 1 -- start start 2024-08-19T00:39:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57600b4750 0x7f57600c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f5760158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f576009afb0 con 0x7f57600d0c40 2024-08-19T00:39:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f576006d1d0 con 0x7f57600b4750 2024-08-19T00:39:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f576009b130 con 0x7f576015e470 2024-08-19T00:39:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f5760158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f5760158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55584/0 (socket says 172.21.15.7:55584) 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.323+0000 7f575d400640 1 -- 172.21.15.7:0/3721841658 learned_addr learned my addr 172.21.15.7:0/3721841658 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575de00640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57600b4750 0x7f57600c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575e800640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575d400640 1 -- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 msgr2=0x7f57600c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575d400640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575d400640 1 -- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57600b4750 msgr2=0x7f57600c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575d400640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57600b4750 0x7f57600c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575d400640 1 -- 172.21.15.7:0/3721841658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57600c7b70 con 0x7f57600d0c40 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575d400640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f5760158030 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f574c00d800 tx=0x7f574c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f5756000640 1 -- 172.21.15.7:0/3721841658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00b6c0 con 0x7f57600d0c40 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f5756000640 1 -- 172.21.15.7:0/3721841658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c019070 con 0x7f57600d0c40 2024-08-19T00:39:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57600c7e50 con 0x7f57600d0c40 2024-08-19T00:39:05.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.324+0000 7f5756000640 1 -- 172.21.15.7:0/3721841658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00baa0 con 0x7f57600d0c40 2024-08-19T00:39:05.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.325+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57600c8410 con 0x7f57600d0c40 2024-08-19T00:39:05.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.326+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576009aa70 con 0x7f57600d0c40 2024-08-19T00:39:05.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.326+0000 7f5756000640 1 -- 172.21.15.7:0/3721841658 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f574c00bc40 con 0x7f57600d0c40 2024-08-19T00:39:05.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.327+0000 7f5756000640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f574006be30 0x7f574006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:05.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.327+0000 7f5756000640 1 -- 172.21.15.7:0/3721841658 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f574c08b310 con 0x7f57600d0c40 2024-08-19T00:39:05.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.328+0000 7f575de00640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f574006be30 0x7f574006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:05.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.328+0000 7f575de00640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f574006be30 0x7f574006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f575000a8d0 tx=0x7f5750008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:05.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.332+0000 7f5756000640 1 -- 172.21.15.7:0/3721841658 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f574c059cb0 con 0x7f57600d0c40 2024-08-19T00:39:05.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.550+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57600b10a0 con 0x7f57600d0c40 2024-08-19T00:39:05.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.551+0000 7f5756000640 1 -- 172.21.15.7:0/3721841658 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5217 (secure 0 0 0) 0x7f574c0595b0 con 0x7f57600d0c40 2024-08-19T00:39:05.554 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:05.554 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"btime":"2024-08-19T00:38:58:370924+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:38:57.793158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5319":{"gid":5319,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/484605249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":484605249},{"type":"v1","addr":"172.21.15.7:6837","nonce":484605249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5319,"qdb_cluster":[5319]},"id":3}]} 2024-08-19T00:39:05.554 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-08-19T00:39:05.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f574006be30 msgr2=0x7f574006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:05.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f574006be30 0x7f574006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f575000a8d0 tx=0x7f5750008040 comp rx=0 tx=0).stop 2024-08-19T00:39:05.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 msgr2=0x7f5760158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:05.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f5760158030 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f574c00d800 tx=0x7f574c00dcc0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 shutdown_connections 2024-08-19T00:39:05.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f574006be30 0x7f574006e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015e470 0x7f57600c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57600d0c40 0x7f5760158030 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 --2- 172.21.15.7:0/3721841658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57600b4750 0x7f57600c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:05.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 >> 172.21.15.7:0/3721841658 conn(0x7f57600b3a70 msgr2=0x7f57600b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:05.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 shutdown_connections 2024-08-19T00:39:05.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:05.553+0000 7f575f200640 1 -- 172.21.15.7:0/3721841658 wait complete. 2024-08-19T00:39:05.975 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:38:54.761189+0000', 'modified': '2024-08-19T00:38:57.793158+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5319}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5319': {'gid': 5319, 'name': 'c', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6837/484605249', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 484605249}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 484605249}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5319, 'qdb_cluster': [5319]} 2024-08-19T00:39:05.975 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:39:05.975 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:39:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.131+0000 7f4ca7e00640 1 Processor -- start 2024-08-19T00:39:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.132+0000 7f4ca7e00640 1 -- start start 2024-08-19T00:39:06.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4ca7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca00ce500 0x7f4ca00ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4ca7e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca006f7f0 con 0x7f4ca0159bf0 2024-08-19T00:39:06.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4ca7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca006f510 con 0x7f4ca00d03c0 2024-08-19T00:39:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4ca7e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca00cee80 con 0x7f4ca00ce500 2024-08-19T00:39:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4ca5400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4ca0159bf0 0x7f4ca0073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40258/0 (socket says 172.21.15.7:40258) 2024-08-19T00:39:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4ca5400640 1 -- 172.21.15.7:0/1175448362 learned_addr learned my addr 172.21.15.7:0/1175448362 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:06.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca00ce500 0x7f4ca00ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889430200 0 0) 0x7f4ca006f7f0 con 0x7f4ca0159bf0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.133+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c88003520 con 0x7f4ca0159bf0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107531400 0 0) 0x7f4ca006f510 con 0x7f4ca00d03c0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ca006f7f0 con 0x7f4ca00d03c0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1402345010 0 0) 0x7f4c88003520 con 0x7f4ca0159bf0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca00ce500 msgr2=0x7f4ca00ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca00ce500 0x7f4ca00ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 >> v1:172.21.15.162:6789/0 conn(0x7f4ca00d03c0 legacy=0x7f4ca006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca0072980 con 0x7f4ca0159bf0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f4c94001670 con 0x7f4ca0159bf0 2024-08-19T00:39:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca00ce500 0x7f4ca00ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 >> v1:172.21.15.7:6789/0 conn(0x7f4ca0159bf0 legacy=0x7f4ca0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88003b70 0x7f4c88003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c88004800 0x7f4c88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c880051c0 0x7f4c8800fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca00cee80 con 0x7f4c88004800 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88010440 con 0x7f4c880051c0 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c88010640 con 0x7f4c88003b70 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c88004800 0x7f4c88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4ca5400640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88003b70 0x7f4c88003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.134+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c880051c0 0x7f4c8800fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.135+0000 7f4ca4a00640 1 -- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88003b70 msgr2=0x7f4c88003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.135+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88003b70 0x7f4c88003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.135+0000 7f4ca4a00640 1 -- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c880051c0 msgr2=0x7f4c8800fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.135+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c880051c0 0x7f4c8800fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.135+0000 7f4ca4a00640 1 -- 172.21.15.7:0/1175448362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c88003520 con 0x7f4c88004800 2024-08-19T00:39:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.135+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c880051c0 0x7f4c8800fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.136+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c88004800 0x7f4c88004c80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00b1cc0 tx=0x7f4c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924d84a6754bed3e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.136+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c036070 con 0x7f4c88004800 2024-08-19T00:39:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.136+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8c004030 con 0x7f4c88004800 2024-08-19T00:39:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.136+0000 7f4c9fe00640 1 -- 172.21.15.7:0/1175448362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0097f0 con 0x7f4c88004800 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.137+0000 7f4ca7e00640 1 -- 172.21.15.7:0/1175448362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c88004800 msgr2=0x7f4c88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.137+0000 7f4ca7e00640 1 --2- 172.21.15.7:0/1175448362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c88004800 0x7f4c88004c80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00b1cc0 tx=0x7f4c88005830 comp rx=0 tx=0).stop 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.137+0000 7f4ca5e00640 1 -- 172.21.15.7:0/1175448362 reap_dead start 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.137+0000 7f4ca7e00640 1 -- 172.21.15.7:0/1175448362 shutdown_connections 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.137+0000 7f4ca7e00640 1 -- 172.21.15.7:0/1175448362 >> 172.21.15.7:0/1175448362 conn(0x7f4ca006bc70 msgr2=0x7f4ca006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.137+0000 7f4ca7e00640 1 -- 172.21.15.7:0/1175448362 shutdown_connections 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.137+0000 7f4ca7e00640 1 -- 172.21.15.7:0/1175448362 wait complete. 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.138+0000 7f4ca7e00640 1 Processor -- start 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.139+0000 7f4ca7e00640 1 -- start start 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.139+0000 7f4ca7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88004800 0x7f4ca014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca0151d50 0x7f4ca0160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca0153390 0x7f4ca0153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0073b70 con 0x7f4ca0151d50 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0072f40 con 0x7f4ca0153390 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca7e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca0159fd0 con 0x7f4c88004800 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca0151d50 0x7f4ca0160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca0151d50 0x7f4ca0160490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55614/0 (socket says 172.21.15.7:55614) 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 -- 172.21.15.7:0/2202927564 learned_addr learned my addr 172.21.15.7:0/2202927564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca5400640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88004800 0x7f4ca014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca0153390 0x7f4ca0153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 -- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88004800 msgr2=0x7f4ca014c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88004800 0x7f4ca014c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 -- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca0153390 msgr2=0x7f4ca0153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca0153390 0x7f4ca0153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.140+0000 7f4ca4a00640 1 -- 172.21.15.7:0/2202927564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca01522f0 con 0x7f4ca0151d50 2024-08-19T00:39:06.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.141+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca0151d50 0x7f4ca0160490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c034040 tx=0x7f4c8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.141+0000 7f4c9d600640 1 -- 172.21.15.7:0/2202927564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c040020 con 0x7f4ca0151d50 2024-08-19T00:39:06.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.141+0000 7f4c9d600640 1 -- 172.21.15.7:0/2202927564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8c003990 con 0x7f4ca0151d50 2024-08-19T00:39:06.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.141+0000 7f4c9d600640 1 -- 172.21.15.7:0/2202927564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c036040 con 0x7f4ca0151d50 2024-08-19T00:39:06.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.141+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca01525d0 con 0x7f4ca0151d50 2024-08-19T00:39:06.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.141+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca0152b90 con 0x7f4ca0151d50 2024-08-19T00:39:06.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.143+0000 7f4c9d600640 1 -- 172.21.15.7:0/2202927564 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c8c043020 con 0x7f4ca0151d50 2024-08-19T00:39:06.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.144+0000 7f4c9d600640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c8006be30 0x7f4c8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.144+0000 7f4c9d600640 1 -- 172.21.15.7:0/2202927564 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4c8c0aafa0 con 0x7f4ca0151d50 2024-08-19T00:39:06.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.144+0000 7f4ca5400640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c8006be30 0x7f4c8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.145+0000 7f4ca5400640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c8006be30 0x7f4c8006e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c94007c00 tx=0x7f4c94001e50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.145+0000 7f4caabef740 1 Processor -- start 2024-08-19T00:39:06.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.145+0000 7f4caabef740 1 -- start start 2024-08-19T00:39:06.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2ae9b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4caabef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aebe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2aeb3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4caabef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec2add3ba0 con 0x55ec2aebe470 2024-08-19T00:39:06.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec2ad6c230 con 0x55ec2ae9af50 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ec2adcfb60 con 0x55ec2aebedd0 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aebe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aebe890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55624/0 (socket says 172.21.15.7:55624) 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4ca4a00640 1 -- 172.21.15.7:0/1719939653 learned_addr learned my addr 172.21.15.7:0/1719939653 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2aeb3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.146+0000 7f4ca5400640 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2ae9b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4ca4a00640 1 -- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 msgr2=0x55ec2aeb3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2aeb3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4ca4a00640 1 -- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 msgr2=0x55ec2ae9b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2ae9b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4ca4a00640 1 -- 172.21.15.7:0/1719939653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2ad9dbb0 con 0x55ec2aebe470 2024-08-19T00:39:06.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2aeb3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:06.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aebe890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c078f30 tx=0x7f4c8c078f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7264f8cc3c824e33 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4c91c00640 1 -- 172.21.15.7:0/1719939653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c081e20 con 0x55ec2aebe470 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4c91c00640 1 -- 172.21.15.7:0/1719939653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0775f0 con 0x55ec2aebe470 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.147+0000 7f4c91c00640 1 -- 172.21.15.7:0/1719939653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c091180 con 0x55ec2aebe470 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 -- 172.21.15.7:0/1719939653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 msgr2=0x55ec2aebe890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aebe890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c078f30 tx=0x7f4c8c078f60 comp rx=0 tx=0).stop 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 -- 172.21.15.7:0/1719939653 shutdown_connections 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2aeb3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aebe890 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 --2- 172.21.15.7:0/1719939653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2ae9b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 -- 172.21.15.7:0/1719939653 >> 172.21.15.7:0/1719939653 conn(0x55ec2ae38110 msgr2=0x55ec2aeb5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 -- 172.21.15.7:0/1719939653 shutdown_connections 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.148+0000 7f4caabef740 1 -- 172.21.15.7:0/1719939653 wait complete. 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.149+0000 7f4caabef740 1 -- start start 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.149+0000 7f4caabef740 1 Processor -- start 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2ae9af50 0x55ec2ae8ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4caabef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2ae8e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebedd0 0x55ec2ae6c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4caabef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec2adcfb60 con 0x55ec2aebe470 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec2ad8f250 con 0x55ec2aebedd0 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ec2add3ba0 con 0x55ec2ae9af50 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4caabef740 10 client.0 _ll_register_callbacks cb 0x55ec2ad93740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:06.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2ae8e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2ae8e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55640/0 (socket says 172.21.15.7:55640) 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 -- 172.21.15.7:0/846672669 learned_addr learned my addr 172.21.15.7:0/846672669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca5400640 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2ae9af50 0x55ec2ae8ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebedd0 0x55ec2ae6c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 -- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2ae9af50 msgr2=0x55ec2ae8ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2ae9af50 0x55ec2ae8ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 -- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebedd0 msgr2=0x55ec2ae6c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebedd0 0x55ec2ae6c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.150+0000 7f4ca4a00640 1 -- 172.21.15.7:0/846672669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2aae72d0 con 0x55ec2aebe470 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2ae8e1b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c078ff0 tx=0x7f4c8c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca8de62529f6e45 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4c86000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4c86000640 1 -- 172.21.15.7:0/846672669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c096060 con 0x55ec2aebe470 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4c86000640 1 -- 172.21.15.7:0/846672669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4c8c07d0d0 con 0x55ec2aebe470 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c8c0775f0 con 0x55ec2aebe470 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4c86000640 1 -- 172.21.15.7:0/846672669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4c8c081e20 con 0x55ec2aebe470 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4caabef740 10 client.5463 fetch_fsmap learned FSMap version 30 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55ec2abb16b0 con 0x55ec2aebe470 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4c86000640 1 -- 172.21.15.7:0/846672669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0775f0 con 0x55ec2aebe470 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4c86000640 1 -- 172.21.15.7:0/846672669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f4c8c078740 con 0x55ec2aebe470 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4caabef740 10 client.5463 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4caabef740 10 client.5463 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:39:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.151+0000 7f4caabef740 20 client.5463 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.152+0000 7f4caabef740 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2aeb0c20 0x55ec2aed2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.152+0000 7f4caabef740 4 client.5463 mds_command: new command op to 5319 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.152+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 --> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec2ade12d0 con 0x55ec2aeb0c20 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.152+0000 7f4ca5400640 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2aeb0c20 0x55ec2aed2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.152+0000 7f4ca5400640 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2aeb0c20 0x55ec2aed2f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc1d94b203d4436 server_cookie=61472c1b8a267e7a in_seq=0 out_seq=0 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.152+0000 7f4c86000640 10 client.5463 ms_handle_connect on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.153+0000 7f4c86000640 1 -- 172.21.15.7:0/846672669 <== mds.0 v2:172.21.15.7:6835/484605249 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec2ade12d0 con 0x55ec2aeb0c20 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.153+0000 7f4c86000640 10 client.5463 handle_command_reply: tid=0 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.153+0000 7f4caabef740 1 client.5463 shutdown 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.153+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 msgr2=0x55ec2ae8e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.153+0000 7f4caabef740 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2ae8e1b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c078ff0 tx=0x7f4c8c009190 comp rx=0 tx=0).stop 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 shutdown_connections 2024-08-19T00:39:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2aeb0c20 0x55ec2aed2f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebedd0 0x55ec2ae6c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2ae8e1b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 --2- 172.21.15.7:0/846672669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2ae9af50 0x55ec2ae8ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4c86000640 0 client.5463 ms_handle_reset on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 >> 172.21.15.7:0/846672669 conn(0x55ec2ae38110 msgr2=0x55ec2aeb75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 shutdown_connections 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 1 -- 172.21.15.7:0/846672669 wait complete. 2024-08-19T00:39:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.154+0000 7f4caabef740 20 client.5463 trim_cache size 0 max 16384 2024-08-19T00:39:06.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.173+0000 7f4caabef740 1 Processor -- start 2024-08-19T00:39:06.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.173+0000 7f4caabef740 1 -- start start 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4caabef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2ae9af50 0x55ec2aeb1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebe470 0x55ec2ae70f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae71440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4caabef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01fbeb0 con 0x55ec2ae9af50 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca015f520 con 0x55ec2aebe470 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca01fb860 con 0x55ec2aebedd0 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2ae9af50 0x55ec2aeb1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2ae9af50 0x55ec2aeb1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55654/0 (socket says 172.21.15.7:55654) 2024-08-19T00:39:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 -- 172.21.15.7:0/638705661 learned_addr learned my addr 172.21.15.7:0/638705661 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae71440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebe470 0x55ec2ae70f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 -- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 msgr2=0x55ec2ae71440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae71440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 -- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebe470 msgr2=0x55ec2ae70f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebe470 0x55ec2ae70f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca5400640 1 -- 172.21.15.7:0/638705661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2aeb2a00 con 0x55ec2ae9af50 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.174+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebe470 0x55ec2ae70f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4ca5400640 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2ae9af50 0x55ec2aeb1860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55ec2aeac880 tx=0x7f4c9400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5659257b13f425b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4c91200640 1 -- 172.21.15.7:0/638705661 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c940077c0 con 0x55ec2ae9af50 2024-08-19T00:39:06.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4c91200640 1 -- 172.21.15.7:0/638705661 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c94015890 con 0x55ec2ae9af50 2024-08-19T00:39:06.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4c91200640 1 -- 172.21.15.7:0/638705661 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94015c40 con 0x55ec2ae9af50 2024-08-19T00:39:06.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4caabef740 1 -- 172.21.15.7:0/638705661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2ae9af50 msgr2=0x55ec2aeb1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4caabef740 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2ae9af50 0x55ec2aeb1860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55ec2aeac880 tx=0x7f4c9400c000 comp rx=0 tx=0).stop 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4caabef740 1 -- 172.21.15.7:0/638705661 shutdown_connections 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4caabef740 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae71440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4caabef740 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2aebe470 0x55ec2ae70f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4caabef740 1 --2- 172.21.15.7:0/638705661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2ae9af50 0x55ec2aeb1860 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.175+0000 7f4caabef740 1 -- 172.21.15.7:0/638705661 >> 172.21.15.7:0/638705661 conn(0x55ec2ae38110 msgr2=0x55ec2ae96210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.176+0000 7f4caabef740 1 -- 172.21.15.7:0/638705661 shutdown_connections 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.176+0000 7f4caabef740 1 -- 172.21.15.7:0/638705661 wait complete. 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.176+0000 7f4caabef740 1 -- start start 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.176+0000 7f4caabef740 1 Processor -- start 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2aec7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4caabef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aecc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4caabef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae8f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4caabef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec2ae8f040 con 0x55ec2aebe470 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec2ad6c230 con 0x55ec2ae9af50 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4caabef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ec2ae980a0 con 0x55ec2aebedd0 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4caabef740 10 client.0 _ll_register_callbacks cb 0x7f4c8c078e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.177+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aecc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aecc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55660/0 (socket says 172.21.15.7:55660) 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 -- 172.21.15.7:0/3223116769 learned_addr learned my addr 172.21.15.7:0/3223116769 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca5400640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2aec7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae8f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 -- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 msgr2=0x55ec2ae8f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae8f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 -- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 msgr2=0x55ec2aec7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2aec7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 -- 172.21.15.7:0/3223116769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2aec84d0 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca5e00640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae8f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4ca4a00640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aecc740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c078bc0 tx=0x7f4c8c075590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95452d348c235355 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4c86000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4c86000640 1 -- 172.21.15.7:0/3223116769 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c07d2d0 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4c86000640 1 -- 172.21.15.7:0/3223116769 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4c8c075040 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.178+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c94015890 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4c86000640 1 -- 172.21.15.7:0/3223116769 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4c8c0792f0 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 10 client.5469 fetch_fsmap learned FSMap version 30 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55ec2aec84d0 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4c86000640 1 -- 172.21.15.7:0/3223116769 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c94015890 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4c86000640 1 -- 172.21.15.7:0/3223116769 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f4c8c075240 con 0x55ec2aebe470 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 10 client.5469 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:39:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 10 client.5469 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:39:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 20 client.5469 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2ae70fc0 0x55ec2ae713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 4 client.5469 mds_command: new command op to 5319 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:39:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 --> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] -- command(tid 0: {"prefix": "status"}) -- 0x55ec2ae6a9f0 con 0x55ec2ae70fc0 2024-08-19T00:39:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.179+0000 7f4ca5400640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2ae70fc0 0x55ec2ae713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4ca5400640 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2ae70fc0 0x55ec2ae713a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf67db9a79685baf server_cookie=19eb85a20376e311 in_seq=0 out_seq=0 2024-08-19T00:39:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4c86000640 10 client.5469 ms_handle_connect on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4c86000640 1 -- 172.21.15.7:0/3223116769 <== mds.0 v2:172.21.15.7:6835/484605249 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55ec2ae6a9f0 con 0x55ec2ae70fc0 2024-08-19T00:39:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4c86000640 10 client.5469 handle_command_reply: tid=0 2024-08-19T00:39:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 client.5469 shutdown 2024-08-19T00:39:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 msgr2=0x55ec2aecc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aecc740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c078bc0 tx=0x7f4c8c075590 comp rx=0 tx=0).stop 2024-08-19T00:39:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 shutdown_connections 2024-08-19T00:39:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55ec2ae70fc0 0x55ec2ae713a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ec2aebedd0 0x55ec2ae8f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec2aebe470 0x55ec2aecc740 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 --2- 172.21.15.7:0/3223116769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec2ae9af50 0x55ec2aec7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4c86000640 0 client.5469 ms_handle_reset on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.180+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 >> 172.21.15.7:0/3223116769 conn(0x55ec2ae38110 msgr2=0x55ec2aeb9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.181+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 shutdown_connections 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.181+0000 7f4caabef740 1 -- 172.21.15.7:0/3223116769 wait complete. 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.181+0000 7f4caabef740 20 client.5469 trim_cache size 0 max 16384 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:39:06.188 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5319, 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 10.836910735, 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 30, 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 45, 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 45, 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 15.518553686000001 2024-08-19T00:39:06.189 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:39:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.181+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c8006be30 msgr2=0x7f4c8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.181+0000 7f4ca7e00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c8006be30 0x7f4c8006e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c94007c00 tx=0x7f4c94001e50 comp rx=0 tx=0).stop 2024-08-19T00:39:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.181+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca0151d50 msgr2=0x7f4ca0160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.181+0000 7f4ca7e00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca0151d50 0x7f4ca0160490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c034040 tx=0x7f4c8c004730 comp rx=0 tx=0).stop 2024-08-19T00:39:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 shutdown_connections 2024-08-19T00:39:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c8006be30 0x7f4c8006e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca0153390 0x7f4ca0153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca0151d50 0x7f4ca0160490 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 --2- 172.21.15.7:0/2202927564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c88004800 0x7f4ca014c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 >> 172.21.15.7:0/2202927564 conn(0x7f4ca006bc70 msgr2=0x7f4ca00d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 shutdown_connections 2024-08-19T00:39:06.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.182+0000 7f4ca7e00640 1 -- 172.21.15.7:0/2202927564 wait complete. 2024-08-19T00:39:06.201 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:39:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.355+0000 7f312ce00640 1 Processor -- start 2024-08-19T00:39:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.355+0000 7f312ce00640 1 -- start start 2024-08-19T00:39:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f312ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f312806d960 0x7f31280b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f312ce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31280d5240 con 0x7f3128161ba0 2024-08-19T00:39:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f312ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31280b39c0 con 0x7f31280d2ba0 2024-08-19T00:39:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f312ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f31280b36e0 con 0x7f312806d960 2024-08-19T00:39:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f3125e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3128161ba0 0x7f31280d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40270/0 (socket says 172.21.15.7:40270) 2024-08-19T00:39:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f3125e00640 1 -- 172.21.15.7:0/3613587218 learned_addr learned my addr 172.21.15.7:0/3613587218 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f311fe00640 1 --2- 172.21.15.7:0/3613587218 >> v2:172.21.15.7:3300/0 conn(0x7f312806d960 0x7f31280b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f311fe00640 1 -- 172.21.15.7:0/3613587218 >> v1:172.21.15.162:6789/0 conn(0x7f31280d2ba0 legacy=0x7f31280b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f311fe00640 1 -- 172.21.15.7:0/3613587218 >> v1:172.21.15.7:6789/0 conn(0x7f3128161ba0 legacy=0x7f31280d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f3125400640 1 -- 172.21.15.7:0/3613587218 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141983379 0 0) 0x7f31280d5240 con 0x7f3128161ba0 2024-08-19T00:39:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.357+0000 7f311fe00640 1 -- 172.21.15.7:0/3613587218 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312806e3a0 con 0x7f312806d960 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.358+0000 7f311fe00640 1 --2- 172.21.15.7:0/3613587218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280b2100 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31100097a0 tx=0x7f311002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ace72cac46c215d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f3125400640 1 -- 172.21.15.7:0/3613587218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110037070 con 0x7f312806d960 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f3125400640 1 -- 172.21.15.7:0/3613587218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3110032440 con 0x7f312806d960 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f3125400640 1 -- 172.21.15.7:0/3613587218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110032810 con 0x7f312806d960 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f312ce00640 1 -- 172.21.15.7:0/3613587218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 msgr2=0x7f31280b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f312ce00640 1 --2- 172.21.15.7:0/3613587218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280b2100 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31100097a0 tx=0x7f311002a230 comp rx=0 tx=0).stop 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f312ce00640 1 -- 172.21.15.7:0/3613587218 shutdown_connections 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f312ce00640 1 --2- 172.21.15.7:0/3613587218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280b2100 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f312ce00640 1 -- 172.21.15.7:0/3613587218 >> 172.21.15.7:0/3613587218 conn(0x7f312808c000 msgr2=0x7f31280d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f312ce00640 1 -- 172.21.15.7:0/3613587218 shutdown_connections 2024-08-19T00:39:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.359+0000 7f312ce00640 1 -- 172.21.15.7:0/3613587218 wait complete. 2024-08-19T00:39:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.361+0000 7f312ce00640 1 Processor -- start 2024-08-19T00:39:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.361+0000 7f312ce00640 1 -- start start 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f312ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f312ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31280d2ba0 0x7f3128156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f312ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3128161ba0 0x7f31280b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f312ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3128161f80 con 0x7f312806d960 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f312ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31280b1be0 con 0x7f31280d2ba0 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f312ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3128162100 con 0x7f3128161ba0 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f3125e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f3125e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55676/0 (socket says 172.21.15.7:55676) 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f3125e00640 1 -- 172.21.15.7:0/3346357773 learned_addr learned my addr 172.21.15.7:0/3346357773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f3126800640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3128161ba0 0x7f31280b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.362+0000 7f311fe00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31280d2ba0 0x7f3128156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f3125e00640 1 -- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3128161ba0 msgr2=0x7f31280b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f3125e00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3128161ba0 0x7f31280b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f3125e00640 1 -- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31280d2ba0 msgr2=0x7f3128156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f3125e00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31280d2ba0 0x7f3128156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f3125e00640 1 -- 172.21.15.7:0/3346357773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31280b85c0 con 0x7f312806d960 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f311fe00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31280d2ba0 0x7f3128156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f3125e00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280caab0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f311800c3f0 tx=0x7f311800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f311e000640 1 -- 172.21.15.7:0/3346357773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118017070 con 0x7f312806d960 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f311e000640 1 -- 172.21.15.7:0/3346357773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3118005ce0 con 0x7f312806d960 2024-08-19T00:39:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f311e000640 1 -- 172.21.15.7:0/3346357773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118007310 con 0x7f312806d960 2024-08-19T00:39:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31280b7d20 con 0x7f312806d960 2024-08-19T00:39:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.363+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31280b82e0 con 0x7f312806d960 2024-08-19T00:39:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.364+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31280d4b30 con 0x7f312806d960 2024-08-19T00:39:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.365+0000 7f311e000640 1 -- 172.21.15.7:0/3346357773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f311801a070 con 0x7f312806d960 2024-08-19T00:39:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.366+0000 7f311e000640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f310406be60 0x7f310406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.366+0000 7f311e000640 1 -- 172.21.15.7:0/3346357773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f311808a280 con 0x7f312806d960 2024-08-19T00:39:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.367+0000 7f311fe00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f310406be60 0x7f310406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.367+0000 7f311fe00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f310406be60 0x7f310406e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3110034000 tx=0x7f311002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.370+0000 7f311e000640 1 -- 172.21.15.7:0/3346357773 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3118058bb0 con 0x7f312806d960 2024-08-19T00:39:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.592+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31280cfa70 con 0x7f312806d960 2024-08-19T00:39:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.593+0000 7f311e000640 1 -- 172.21.15.7:0/3346357773 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7f31180584b0 con 0x7f312806d960 2024-08-19T00:39:06.595 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:39:06.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f310406be60 msgr2=0x7f310406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f310406be60 0x7f310406e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3110034000 tx=0x7f311002e000 comp rx=0 tx=0).stop 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 msgr2=0x7f31280caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280caab0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f311800c3f0 tx=0x7f311800c8b0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 shutdown_connections 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f310406be60 0x7f310406e320 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3128161ba0 0x7f31280b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31280d2ba0 0x7f3128156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 --2- 172.21.15.7:0/3346357773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f312806d960 0x7f31280caab0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 >> 172.21.15.7:0/3346357773 conn(0x7f312808c000 msgr2=0x7f3128074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 shutdown_connections 2024-08-19T00:39:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06.595+0000 7f312ce00640 1 -- 172.21.15.7:0/3346357773 wait complete. 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:39:06.613 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:06.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:06.614 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:39:06.650 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:39:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:39:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:39:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:39:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:06.650 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42715sec preferred_lft 42715sec 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:39:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:39:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:06.653 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:39:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:39:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:39:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:06.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:06.653 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:39:06.745 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:39:06.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:06.748 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:39:06.784 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:39:06.784 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:39:06.785 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:39:06.785 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:39:06.785 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:39:06.785 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:39:06.785 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:39:06.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:39:06.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:39:06.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:39:06.785 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:39:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:39:06.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:06.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:06.983 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:39:07.018 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:39:07.019 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:39:07.019 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:07.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:07.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:39:07.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:39:07.116 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:07.151 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:07.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:39:07.152 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:07.226 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:39:07.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:07.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:07.356 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:07.356 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:07.356 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:07.371 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:07.371 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:07.372 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:07.372 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:39:07.372 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:39:07.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:39:07.395 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:39:07.395 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:39:07.396 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:39:07.396 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:39:07.396 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:39:07.398 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:39:07.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:07.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:07.455 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:39:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:39:07.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:07.551 INFO:teuthology.orchestra.run.smithi007.stdout:client5051 2024-08-19T00:39:07.551 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:07.551 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:07.587 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p a/b') 2024-08-19T00:39:07.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:39:07.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:07.728 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-08-19T00:39:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.885+0000 7f2b4b600640 1 Processor -- start 2024-08-19T00:39:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.885+0000 7f2b4b600640 1 -- start start 2024-08-19T00:39:07.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b4b600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4415bfb0 0x7f2b440b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b4b600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b440b5130 0x7f2b440aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b4b600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b440acef0 con 0x7f2b4415c390 2024-08-19T00:39:07.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b4b600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2b440ad790 con 0x7f2b440b5130 2024-08-19T00:39:07.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b4b600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b440ad1d0 con 0x7f2b4415bfb0 2024-08-19T00:39:07.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b43e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b440b5130 0x7f2b440aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b43e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b440b5130 0x7f2b440aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55682/0 (socket says 172.21.15.7:55682) 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b43e00640 1 -- 172.21.15.7:0/1345866461 learned_addr learned my addr 172.21.15.7:0/1345866461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.886+0000 7f2b48c00640 1 --2- 172.21.15.7:0/1345866461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4415bfb0 0x7f2b440b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.887+0000 7f2b43e00640 1 -- 172.21.15.7:0/1345866461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4415bfb0 msgr2=0x7f2b440b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.887+0000 7f2b43e00640 1 --2- 172.21.15.7:0/1345866461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4415bfb0 0x7f2b440b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.887+0000 7f2b43e00640 1 -- 172.21.15.7:0/1345866461 >> v1:172.21.15.162:6789/0 conn(0x7f2b4415c390 legacy=0x7f2b4415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.887+0000 7f2b43e00640 1 -- 172.21.15.7:0/1345866461 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b440ad4b0 con 0x7f2b440b5130 2024-08-19T00:39:07.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.887+0000 7f2b48c00640 1 --2- 172.21.15.7:0/1345866461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4415bfb0 0x7f2b440b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:07.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.888+0000 7f2b43e00640 1 --2- 172.21.15.7:0/1345866461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b440b5130 0x7f2b440aebd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009870 tx=0x7f2b3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddaf9602eebeb74 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:07.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.888+0000 7f2b43400640 1 -- 172.21.15.7:0/1345866461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30037070 con 0x7f2b440b5130 2024-08-19T00:39:07.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.888+0000 7f2b43400640 1 -- 172.21.15.7:0/1345866461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b30032440 con 0x7f2b440b5130 2024-08-19T00:39:07.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.888+0000 7f2b43400640 1 -- 172.21.15.7:0/1345866461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30032810 con 0x7f2b440b5130 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.888+0000 7f2b4b600640 1 -- 172.21.15.7:0/1345866461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b440b5130 msgr2=0x7f2b440aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.888+0000 7f2b4b600640 1 --2- 172.21.15.7:0/1345866461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b440b5130 0x7f2b440aebd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009870 tx=0x7f2b3002a270 comp rx=0 tx=0).stop 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.889+0000 7f2b4b600640 1 -- 172.21.15.7:0/1345866461 shutdown_connections 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.889+0000 7f2b4b600640 1 --2- 172.21.15.7:0/1345866461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b440b5130 0x7f2b440aebd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.889+0000 7f2b4b600640 1 --2- 172.21.15.7:0/1345866461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4415bfb0 0x7f2b440b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.889+0000 7f2b4b600640 1 -- 172.21.15.7:0/1345866461 >> 172.21.15.7:0/1345866461 conn(0x7f2b440b2300 msgr2=0x7f2b4406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.889+0000 7f2b4b600640 1 -- 172.21.15.7:0/1345866461 shutdown_connections 2024-08-19T00:39:07.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.889+0000 7f2b4b600640 1 -- 172.21.15.7:0/1345866461 wait complete. 2024-08-19T00:39:07.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.890+0000 7f2b4b600640 1 Processor -- start 2024-08-19T00:39:07.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.890+0000 7f2b4b600640 1 -- start start 2024-08-19T00:39:07.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.891+0000 7f2b4b600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b440b5130 0x7f2b4409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.891+0000 7f2b4b600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4415bfb0 0x7f2b441506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.891+0000 7f2b4b600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4415c390 0x7f2b44150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.891+0000 7f2b4b600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440b44c0 con 0x7f2b4415c390 2024-08-19T00:39:07.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.891+0000 7f2b4b600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440b4340 con 0x7f2b4415bfb0 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.891+0000 7f2b4b600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b44073050 con 0x7f2b440b5130 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4415c390 0x7f2b44150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4415c390 0x7f2b44150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55698/0 (socket says 172.21.15.7:55698) 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 -- 172.21.15.7:0/3449195608 learned_addr learned my addr 172.21.15.7:0/3449195608 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b48c00640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b440b5130 0x7f2b4409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b43e00640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4415bfb0 0x7f2b441506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 -- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b440b5130 msgr2=0x7f2b4409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b440b5130 0x7f2b4409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 -- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4415bfb0 msgr2=0x7f2b441506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4415bfb0 0x7f2b441506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 -- 172.21.15.7:0/3449195608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4415f850 con 0x7f2b4415c390 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.892+0000 7f2b49600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4415c390 0x7f2b44150bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c730 tx=0x7f2b3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.893+0000 7f2b40c00640 1 -- 172.21.15.7:0/3449195608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c003b70 con 0x7f2b4415c390 2024-08-19T00:39:07.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.893+0000 7f2b40c00640 1 -- 172.21.15.7:0/3449195608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c003d10 con 0x7f2b4415c390 2024-08-19T00:39:07.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.893+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4409db60 con 0x7f2b4415c390 2024-08-19T00:39:07.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.893+0000 7f2b40c00640 1 -- 172.21.15.7:0/3449195608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00aa90 con 0x7f2b4415c390 2024-08-19T00:39:07.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.893+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4409d5a0 con 0x7f2b4415c390 2024-08-19T00:39:07.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.896+0000 7f2b40c00640 1 -- 172.21.15.7:0/3449195608 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b3c00ac30 con 0x7f2b4415c390 2024-08-19T00:39:07.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.896+0000 7f2b40c00640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b2406be30 0x7f2b2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.897+0000 7f2b40c00640 1 -- 172.21.15.7:0/3449195608 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f2b3c08acd0 con 0x7f2b4415c390 2024-08-19T00:39:07.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.897+0000 7f2b48c00640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b2406be30 0x7f2b2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.897+0000 7f2b4e3ee740 1 Processor -- start 2024-08-19T00:39:07.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.897+0000 7f2b4e3ee740 1 -- start start 2024-08-19T00:39:07.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.897+0000 7f2b48c00640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b2406be30 0x7f2b2406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b38006fd0 tx=0x7f2b38008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b76fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b2ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b31d10 0x55cab4b73ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cab4a92de0 con 0x55cab4b31d10 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cab4a2b0e0 con 0x55cab4b2dd00 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55cab4a8eda0 con 0x55cab4b76bf0 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b31d10 0x55cab4b73ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b31d10 0x55cab4b73ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55706/0 (socket says 172.21.15.7:55706) 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b49600640 1 -- 172.21.15.7:0/230449185 learned_addr learned my addr 172.21.15.7:0/230449185 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b43e00640 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b2ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.898+0000 7f2b48c00640 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b76fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b49600640 1 -- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 msgr2=0x55cab4b76fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b49600640 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b76fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b49600640 1 -- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 msgr2=0x55cab4b2ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b49600640 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b2ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b49600640 1 -- 172.21.15.7:0/230449185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cab48707d0 con 0x55cab4b31d10 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b49600640 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b31d10 0x55cab4b73ab0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0553f0 tx=0x7f2b3c00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de01e72125e275e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b35200640 1 -- 172.21.15.7:0/230449185 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c087070 con 0x55cab4b31d10 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b35200640 1 -- 172.21.15.7:0/230449185 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c061ac0 con 0x55cab4b31d10 2024-08-19T00:39:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.899+0000 7f2b35200640 1 -- 172.21.15.7:0/230449185 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c055600 con 0x55cab4b31d10 2024-08-19T00:39:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/230449185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b31d10 msgr2=0x55cab4b73ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b31d10 0x55cab4b73ab0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0553f0 tx=0x7f2b3c00ce40 comp rx=0 tx=0).stop 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/230449185 shutdown_connections 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b31d10 0x55cab4b73ab0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b2ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/230449185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b76fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/230449185 >> 172.21.15.7:0/230449185 conn(0x55cab4af6ff0 msgr2=0x55cab4b75250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/230449185 shutdown_connections 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.900+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/230449185 wait complete. 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.901+0000 7f2b4e3ee740 1 -- start start 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.901+0000 7f2b4e3ee740 1 Processor -- start 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b88410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b31d10 0x55cab4b88950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b59f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cab4b73040 con 0x55cab4b76bf0 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cab4a4e180 con 0x55cab4b2dd00 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55cab4b58050 con 0x55cab4b31d10 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b4e3ee740 10 client.0 _ll_register_callbacks cb 0x55cab4a3a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b59f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b59f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55722/0 (socket says 172.21.15.7:55722) 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b49600640 1 -- 172.21.15.7:0/221262357 learned_addr learned my addr 172.21.15.7:0/221262357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b48c00640 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b88410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.902+0000 7f2b43e00640 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b31d10 0x55cab4b88950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b49600640 1 -- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b31d10 msgr2=0x55cab4b88950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b49600640 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b31d10 0x55cab4b88950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b49600640 1 -- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 msgr2=0x55cab4b88410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b49600640 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b88410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b49600640 1 -- 172.21.15.7:0/221262357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cab47a63f0 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b49600640 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b59f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0553f0 tx=0x7f2b3c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a2cc4f779e8916 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b29600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b29600640 1 -- 172.21.15.7:0/221262357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c087030 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b29600640 1 -- 172.21.15.7:0/221262357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f2b3c055600 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b3c061ac0 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b29600640 1 -- 172.21.15.7:0/221262357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2b3c080050 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b4e3ee740 10 client.5490 fetch_fsmap learned FSMap version 30 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55cab47660f0 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.903+0000 7f2b29600640 1 -- 172.21.15.7:0/221262357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c061ac0 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b29600640 1 -- 172.21.15.7:0/221262357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f2b3c0583e0 con 0x55cab4b76bf0 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b4e3ee740 10 client.5490 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b4e3ee740 10 client.5490 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-19T00:39:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b4e3ee740 20 client.5490 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b89020 0x55cab4b48710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b4e3ee740 4 client.5490 mds_command: new command op to 5319 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:39:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 --> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cab4aa0510 con 0x55cab4b89020 2024-08-19T00:39:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.904+0000 7f2b48c00640 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b89020 0x55cab4b48710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.905+0000 7f2b48c00640 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b89020 0x55cab4b48710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9efe9fedc173736e server_cookie=7149f3a617101c6f in_seq=0 out_seq=0 2024-08-19T00:39:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.905+0000 7f2b29600640 10 client.5490 ms_handle_connect on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.905+0000 7f2b29600640 1 -- 172.21.15.7:0/221262357 <== mds.0 v2:172.21.15.7:6835/484605249 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cab4aa0510 con 0x55cab4b89020 2024-08-19T00:39:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.905+0000 7f2b29600640 10 client.5490 handle_command_reply: tid=0 2024-08-19T00:39:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.905+0000 7f2b4e3ee740 1 client.5490 shutdown 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.905+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 msgr2=0x55cab4b59f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b59f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0553f0 tx=0x7f2b3c011000 comp rx=0 tx=0).stop 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 shutdown_connections 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b89020 0x55cab4b48710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b59f00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b31d10 0x55cab4b88950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/221262357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b2dd00 0x55cab4b88410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b29600640 0 client.5490 ms_handle_reset on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 >> 172.21.15.7:0/221262357 conn(0x55cab4af6ff0 msgr2=0x55cab4b77860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 shutdown_connections 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/221262357 wait complete. 2024-08-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.906+0000 7f2b4e3ee740 20 client.5490 trim_cache size 0 max 16384 2024-08-19T00:39:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.921+0000 7f2b4e3ee740 1 Processor -- start 2024-08-19T00:39:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.921+0000 7f2b4e3ee740 1 -- start start 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.922+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b2dd00 0x55cab4b30d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.922+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.922+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b71550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.922+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44200860 con 0x55cab4b2dd00 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.922+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441ff870 con 0x55cab4b31d10 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.922+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4415dd40 con 0x55cab4b76bf0 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.922+0000 7f2b48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b2dd00 0x55cab4b30d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b2dd00 0x55cab4b30d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55732/0 (socket says 172.21.15.7:55732) 2024-08-19T00:39:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 -- 172.21.15.7:0/2087661113 learned_addr learned my addr 172.21.15.7:0/2087661113 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b43e00640 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b49600640 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b71550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 -- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 msgr2=0x55cab4b71550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b71550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 -- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 msgr2=0x55cab4b6b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 -- 172.21.15.7:0/2087661113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cab4a4c260 con 0x55cab4b2dd00 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b43e00640 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b49600640 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b71550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b48c00640 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b2dd00 0x55cab4b30d30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2b38011910 tx=0x7f2b38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697514456539211 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.923+0000 7f2b2be00640 1 -- 172.21.15.7:0/2087661113 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3800f040 con 0x55cab4b2dd00 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b2be00640 1 -- 172.21.15.7:0/2087661113 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3801a040 con 0x55cab4b2dd00 2024-08-19T00:39:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b2be00640 1 -- 172.21.15.7:0/2087661113 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38011a00 con 0x55cab4b2dd00 2024-08-19T00:39:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/2087661113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b2dd00 msgr2=0x55cab4b30d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b2dd00 0x55cab4b30d30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2b38011910 tx=0x7f2b38017000 comp rx=0 tx=0).stop 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/2087661113 shutdown_connections 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b76bf0 0x55cab4b71550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/2087661113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b2dd00 0x55cab4b30d30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/2087661113 >> 172.21.15.7:0/2087661113 conn(0x55cab4af6ff0 msgr2=0x55cab4b77860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/2087661113 shutdown_connections 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.924+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/2087661113 wait complete. 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.925+0000 7f2b4e3ee740 1 -- start start 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.925+0000 7f2b4e3ee740 1 Processor -- start 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b2dd00 0x55cab4bf08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b4e3ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b96740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cab4a98060 con 0x55cab4b76bf0 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4415e390 con 0x55cab4b31d10 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b4e3ee740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55cab4909940 con 0x55cab4b2dd00 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b4e3ee740 10 client.0 _ll_register_callbacks cb 0x7f2b3c085070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b96740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b96740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55738/0 (socket says 172.21.15.7:55738) 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b49600640 1 -- 172.21.15.7:0/1263422272 learned_addr learned my addr 172.21.15.7:0/1263422272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b43e00640 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.926+0000 7f2b48c00640 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b2dd00 0x55cab4bf08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b49600640 1 -- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b2dd00 msgr2=0x55cab4bf08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b49600640 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b2dd00 0x55cab4bf08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b49600640 1 -- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 msgr2=0x55cab4b6ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b49600640 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b49600640 1 -- 172.21.15.7:0/1263422272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cab4b70620 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b49600640 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b96740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c061590 tx=0x7f2b3c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc949d7dcfaa9b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b29600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b29600640 1 -- 172.21.15.7:0/1263422272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c087070 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b29600640 1 -- 172.21.15.7:0/1263422272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f2b3c082ac0 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b3801a040 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b29600640 1 -- 172.21.15.7:0/1263422272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2b3c055230 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b4e3ee740 10 client.5496 fetch_fsmap learned FSMap version 30 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.927+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55cab4b70620 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b29600640 1 -- 172.21.15.7:0/1263422272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3801a040 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b29600640 1 -- 172.21.15.7:0/1263422272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f2b3c082cc0 con 0x55cab4b76bf0 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b4e3ee740 10 client.5496 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b4e3ee740 10 client.5496 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-19T00:39:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b4e3ee740 20 client.5496 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b731c0 0x55cab4b96c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b4e3ee740 4 client.5496 mds_command: new command op to 5319 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:39:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 --> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cab4a9a860 con 0x55cab4b731c0 2024-08-19T00:39:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b48c00640 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b731c0 0x55cab4b96c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b48c00640 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b731c0 0x55cab4b96c80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5be004583131053 server_cookie=ea7247423f8321b2 in_seq=0 out_seq=0 2024-08-19T00:39:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.928+0000 7f2b29600640 10 client.5496 ms_handle_connect on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b29600640 1 -- 172.21.15.7:0/1263422272 <== mds.0 v2:172.21.15.7:6835/484605249 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cab4a9a860 con 0x55cab4b731c0 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b29600640 10 client.5496 handle_command_reply: tid=0 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 client.5496 shutdown 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 msgr2=0x55cab4b96740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b96740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c061590 tx=0x7f2b3c0014a0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 shutdown_connections 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:6835/484605249,v1:172.21.15.7:6837/484605249] conn(0x55cab4b731c0 0x55cab4b96c80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cab4b76bf0 0x55cab4b96740 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cab4b31d10 0x55cab4b6ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 --2- 172.21.15.7:0/1263422272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cab4b2dd00 0x55cab4bf08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 >> 172.21.15.7:0/1263422272 conn(0x55cab4af6ff0 msgr2=0x55cab4b561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b29600640 0 client.5496 ms_handle_reset on v2:172.21.15.7:6835/484605249 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 shutdown_connections 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 1 -- 172.21.15.7:0/1263422272 wait complete. 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.938+0000 7f2b4e3ee740 20 client.5496 trim_cache size 0 max 16384 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-08-19T00:39:07.942 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:39:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b2406be30 msgr2=0x7f2b2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b2406be30 0x7f2b2406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b38006fd0 tx=0x7f2b38008040 comp rx=0 tx=0).stop 2024-08-19T00:39:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4415c390 msgr2=0x7f2b44150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4415c390 0x7f2b44150bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c730 tx=0x7f2b3c00cbf0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 shutdown_connections 2024-08-19T00:39:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b2406be30 0x7f2b2406e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b4415c390 0x7f2b44150bf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4415bfb0 0x7f2b441506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 --2- 172.21.15.7:0/3449195608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b440b5130 0x7f2b4409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 >> 172.21.15.7:0/3449195608 conn(0x7f2b440b2300 msgr2=0x7f2b44071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 shutdown_connections 2024-08-19T00:39:07.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:07.939+0000 7f2b4b600640 1 -- 172.21.15.7:0/3449195608 wait complete. 2024-08-19T00:39:07.958 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_abort_on_newly_corrupt_dentry False 2024-08-19T00:39:08.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.116+0000 7fee18200640 1 Processor -- start 2024-08-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.116+0000 7fee18200640 1 -- start start 2024-08-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee18200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10158cd0 0x7fee10072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee18200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee10072ff0 0x7fee100add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee18200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fee100ae2b0 0x7fee1015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee18200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fee10073430 con 0x7fee10072ff0 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee18200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fee100aeae0 con 0x7fee100ae2b0 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee18200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee100aedc0 con 0x7fee10158cd0 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee14e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee10072ff0 0x7fee100add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee14e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee10072ff0 0x7fee100add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55750/0 (socket says 172.21.15.7:55750) 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee14e00640 1 -- 172.21.15.7:0/58406066 learned_addr learned my addr 172.21.15.7:0/58406066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.117+0000 7fee16200640 1 --2- 172.21.15.7:0/58406066 >> v2:172.21.15.162:3300/0 conn(0x7fee100ae2b0 0x7fee1015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.118+0000 7fee15800640 1 --2- 172.21.15.7:0/58406066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10158cd0 0x7fee10072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.118+0000 7fee14e00640 1 -- 172.21.15.7:0/58406066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10158cd0 msgr2=0x7fee10072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.118+0000 7fee14e00640 1 --2- 172.21.15.7:0/58406066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10158cd0 0x7fee10072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.118+0000 7fee14e00640 1 -- 172.21.15.7:0/58406066 >> v2:172.21.15.162:3300/0 conn(0x7fee100ae2b0 msgr2=0x7fee1015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.118+0000 7fee14e00640 1 --2- 172.21.15.7:0/58406066 >> v2:172.21.15.162:3300/0 conn(0x7fee100ae2b0 0x7fee1015ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.118+0000 7fee14e00640 1 -- 172.21.15.7:0/58406066 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee100af0a0 con 0x7fee10072ff0 2024-08-19T00:39:08.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.118+0000 7fee15800640 1 --2- 172.21.15.7:0/58406066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10158cd0 0x7fee10072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.119+0000 7fee14e00640 1 --2- 172.21.15.7:0/58406066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee10072ff0 0x7fee100add70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee100cfa40 tx=0x7fedfc02c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36a016d3b628971 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.119+0000 7fee0fe00640 1 -- 172.21.15.7:0/58406066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc039070 con 0x7fee10072ff0 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.119+0000 7fee0fe00640 1 -- 172.21.15.7:0/58406066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc0316b0 con 0x7fee10072ff0 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.119+0000 7fee0fe00640 1 -- 172.21.15.7:0/58406066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc031a80 con 0x7fee10072ff0 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 -- 172.21.15.7:0/58406066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee10072ff0 msgr2=0x7fee100add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 --2- 172.21.15.7:0/58406066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee10072ff0 0x7fee100add70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee100cfa40 tx=0x7fedfc02c780 comp rx=0 tx=0).stop 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 -- 172.21.15.7:0/58406066 shutdown_connections 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 --2- 172.21.15.7:0/58406066 >> v2:172.21.15.162:3300/0 conn(0x7fee100ae2b0 0x7fee1015ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 --2- 172.21.15.7:0/58406066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee10072ff0 0x7fee100add70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 --2- 172.21.15.7:0/58406066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10158cd0 0x7fee10072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 -- 172.21.15.7:0/58406066 >> 172.21.15.7:0/58406066 conn(0x7fee100b2300 msgr2=0x7fee1006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 -- 172.21.15.7:0/58406066 shutdown_connections 2024-08-19T00:39:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.120+0000 7fee18200640 1 -- 172.21.15.7:0/58406066 wait complete. 2024-08-19T00:39:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.122+0000 7fee18200640 1 Processor -- start 2024-08-19T00:39:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.122+0000 7fee18200640 1 -- start start 2024-08-19T00:39:08.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee18200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10072ff0 0x7fee100cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee18200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee100ae2b0 0x7fee1014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee18200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee100cdc40 0x7fee1014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee18200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee100ae700 con 0x7fee100cdc40 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee18200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee100af660 con 0x7fee100ae2b0 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee18200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee100ae880 con 0x7fee10072ff0 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee100cdc40 0x7fee1014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee100cdc40 0x7fee1014d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55758/0 (socket says 172.21.15.7:55758) 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 -- 172.21.15.7:0/3832060966 learned_addr learned my addr 172.21.15.7:0/3832060966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee15800640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10072ff0 0x7fee100cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee14e00640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee100ae2b0 0x7fee1014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 -- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10072ff0 msgr2=0x7fee100cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10072ff0 0x7fee100cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 -- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee100ae2b0 msgr2=0x7fee1014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee100ae2b0 0x7fee1014c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee16200640 1 -- 172.21.15.7:0/3832060966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee10157590 con 0x7fee100cdc40 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee14e00640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee100ae2b0 0x7fee1014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.123+0000 7fee15800640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10072ff0 0x7fee100cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.124+0000 7fee16200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee100cdc40 0x7fee1014d650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fee0800ef00 tx=0x7fee0800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.124+0000 7fee0d600640 1 -- 172.21.15.7:0/3832060966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08018020 con 0x7fee100cdc40 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.124+0000 7fee0d600640 1 -- 172.21.15.7:0/3832060966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee08014400 con 0x7fee100cdc40 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.124+0000 7fee0d600640 1 -- 172.21.15.7:0/3832060966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee080147f0 con 0x7fee100cdc40 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.124+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee10157870 con 0x7fee100cdc40 2024-08-19T00:39:08.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.124+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee10157e30 con 0x7fee100cdc40 2024-08-19T00:39:08.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.125+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee10158530 con 0x7fee100cdc40 2024-08-19T00:39:08.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.126+0000 7fee0d600640 1 -- 172.21.15.7:0/3832060966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee08005d10 con 0x7fee100cdc40 2024-08-19T00:39:08.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.128+0000 7fee0d600640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedf006be60 0x7fedf006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.128+0000 7fee0d600640 1 -- 172.21.15.7:0/3832060966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fee0808b830 con 0x7fee100cdc40 2024-08-19T00:39:08.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.128+0000 7fee15800640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedf006be60 0x7fedf006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.128+0000 7fee15800640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedf006be60 0x7fedf006e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee04006fd0 tx=0x7fee04008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:08.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.132+0000 7fee0d600640 1 -- 172.21.15.7:0/3832060966 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fee10158530 con 0x7fee100cdc40 2024-08-19T00:39:08.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.315+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}] v 0) -- 0x7fee100add70 con 0x7fee100cdc40 2024-08-19T00:39:08.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.319+0000 7fee0d600640 1 -- 172.21.15.7:0/3832060966 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}]=0 v13)=0 v13) ==== 135+0+0 (secure 0 0 0) 0x7fee08022030 con 0x7fee100cdc40 2024-08-19T00:39:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedf006be60 msgr2=0x7fedf006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedf006be60 0x7fedf006e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee04006fd0 tx=0x7fee04008040 comp rx=0 tx=0).stop 2024-08-19T00:39:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee100cdc40 msgr2=0x7fee1014d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee100cdc40 0x7fee1014d650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fee0800ef00 tx=0x7fee0800b480 comp rx=0 tx=0).stop 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 shutdown_connections 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedf006be60 0x7fedf006e320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee100cdc40 0x7fee1014d650 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee100ae2b0 0x7fee1014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 --2- 172.21.15.7:0/3832060966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee10072ff0 0x7fee100cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 >> 172.21.15.7:0/3832060966 conn(0x7fee100b2300 msgr2=0x7fee1015e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 shutdown_connections 2024-08-19T00:39:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.321+0000 7fee18200640 1 -- 172.21.15.7:0/3832060966 wait complete. 2024-08-19T00:39:08.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_rename_corrupt_dentry_first 1.0 2024-08-19T00:39:08.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.499+0000 7fcd59600640 1 Processor -- start 2024-08-19T00:39:08.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.499+0000 7fcd59600640 1 -- start start 2024-08-19T00:39:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.500+0000 7fcd59600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd54158cd0 0x7fcd54072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.500+0000 7fcd59600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd540aeae0 con 0x7fcd540ae480 2024-08-19T00:39:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.500+0000 7fcd59600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd540aedc0 con 0x7fcd54072ff0 2024-08-19T00:39:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.500+0000 7fcd59600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcd54073460 con 0x7fcd54158cd0 2024-08-19T00:39:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.501+0000 7fcd53400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcd540ae480 0x7fcd540b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40282/0 (socket says 172.21.15.7:40282) 2024-08-19T00:39:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.501+0000 7fcd53400640 1 -- 172.21.15.7:0/1792188219 learned_addr learned my addr 172.21.15.7:0/1792188219 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:08.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.501+0000 7fcd52a00640 1 --2- 172.21.15.7:0/1792188219 >> v2:172.21.15.162:3300/0 conn(0x7fcd54158cd0 0x7fcd54072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.501+0000 7fcd51600640 1 -- 172.21.15.7:0/1792188219 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850642548 0 0) 0x7fcd540aeae0 con 0x7fcd540ae480 2024-08-19T00:39:08.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.501+0000 7fcd51600640 1 -- 172.21.15.7:0/1792188219 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd38003520 con 0x7fcd540ae480 2024-08-19T00:39:08.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.501+0000 7fcd51600640 1 -- 172.21.15.7:0/1792188219 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958856717 0 0) 0x7fcd540aedc0 con 0x7fcd54072ff0 2024-08-19T00:39:08.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.502+0000 7fcd51600640 1 -- 172.21.15.7:0/1792188219 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd540aeae0 con 0x7fcd54072ff0 2024-08-19T00:39:08.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.502+0000 7fcd52a00640 1 -- 172.21.15.7:0/1792188219 >> v1:172.21.15.162:6789/0 conn(0x7fcd54072ff0 legacy=0x7fcd540add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.502+0000 7fcd52a00640 1 -- 172.21.15.7:0/1792188219 >> v1:172.21.15.7:6789/0 conn(0x7fcd540ae480 legacy=0x7fcd540b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.502+0000 7fcd52a00640 1 -- 172.21.15.7:0/1792188219 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd540af0a0 con 0x7fcd54158cd0 2024-08-19T00:39:08.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.503+0000 7fcd52a00640 1 --2- 172.21.15.7:0/1792188219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd54158cd0 0x7fcd54072ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097a0 tx=0x7fcd4402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f74aefffd47d2fcc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:08.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.503+0000 7fcd51600640 1 -- 172.21.15.7:0/1792188219 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd44037070 con 0x7fcd54158cd0 2024-08-19T00:39:08.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.503+0000 7fcd51600640 1 -- 172.21.15.7:0/1792188219 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd44032440 con 0x7fcd54158cd0 2024-08-19T00:39:08.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.503+0000 7fcd51600640 1 -- 172.21.15.7:0/1792188219 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4402ae60 con 0x7fcd54158cd0 2024-08-19T00:39:08.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.504+0000 7fcd59600640 1 -- 172.21.15.7:0/1792188219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd54158cd0 msgr2=0x7fcd54072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.504+0000 7fcd59600640 1 --2- 172.21.15.7:0/1792188219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd54158cd0 0x7fcd54072ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097a0 tx=0x7fcd4402a110 comp rx=0 tx=0).stop 2024-08-19T00:39:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.504+0000 7fcd59600640 1 -- 172.21.15.7:0/1792188219 shutdown_connections 2024-08-19T00:39:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.504+0000 7fcd59600640 1 --2- 172.21.15.7:0/1792188219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd54158cd0 0x7fcd54072ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.504+0000 7fcd59600640 1 -- 172.21.15.7:0/1792188219 >> 172.21.15.7:0/1792188219 conn(0x7fcd540b2300 msgr2=0x7fcd5406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.504+0000 7fcd59600640 1 -- 172.21.15.7:0/1792188219 shutdown_connections 2024-08-19T00:39:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.504+0000 7fcd59600640 1 -- 172.21.15.7:0/1792188219 wait complete. 2024-08-19T00:39:08.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.505+0000 7fcd59600640 1 Processor -- start 2024-08-19T00:39:08.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.506+0000 7fcd59600640 1 -- start start 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.506+0000 7fcd59600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd54072ff0 0x7fcd54157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd59600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd540ae480 0x7fcd5415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd59600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd541f83e0 0x7fcd54155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd59600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcd540b3860 con 0x7fcd54072ff0 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd59600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd540af660 con 0x7fcd540ae480 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd59600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd540b39e0 con 0x7fcd541f83e0 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd54072ff0 0x7fcd54157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd54072ff0 0x7fcd54157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55762/0 (socket says 172.21.15.7:55762) 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 -- 172.21.15.7:0/2304600556 learned_addr learned my addr 172.21.15.7:0/2304600556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52000640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd540ae480 0x7fcd5415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd53400640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd541f83e0 0x7fcd54155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 -- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd541f83e0 msgr2=0x7fcd54155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd541f83e0 0x7fcd54155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 -- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd540ae480 msgr2=0x7fcd5415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd540ae480 0x7fcd5415dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52a00640 1 -- 172.21.15.7:0/2304600556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd541550e0 con 0x7fcd54072ff0 2024-08-19T00:39:08.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.507+0000 7fcd52000640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd540ae480 0x7fcd5415dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.508+0000 7fcd52a00640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd54072ff0 0x7fcd54157b90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098c0 tx=0x7fcd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.508+0000 7fcd4aa00640 1 -- 172.21.15.7:0/2304600556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd44041030 con 0x7fcd54072ff0 2024-08-19T00:39:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.508+0000 7fcd4aa00640 1 -- 172.21.15.7:0/2304600556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4403d4e0 con 0x7fcd54072ff0 2024-08-19T00:39:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.508+0000 7fcd4aa00640 1 -- 172.21.15.7:0/2304600556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd44037040 con 0x7fcd54072ff0 2024-08-19T00:39:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.508+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd54158270 con 0x7fcd54072ff0 2024-08-19T00:39:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.508+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd54155660 con 0x7fcd54072ff0 2024-08-19T00:39:08.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.509+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd540add70 con 0x7fcd54072ff0 2024-08-19T00:39:08.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.510+0000 7fcd4aa00640 1 -- 172.21.15.7:0/2304600556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd44044070 con 0x7fcd54072ff0 2024-08-19T00:39:08.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.511+0000 7fcd4aa00640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd3406be60 0x7fcd3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:08.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.511+0000 7fcd4aa00640 1 -- 172.21.15.7:0/2304600556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fcd440ab4f0 con 0x7fcd54072ff0 2024-08-19T00:39:08.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.511+0000 7fcd52000640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd3406be60 0x7fcd3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:08.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.512+0000 7fcd52000640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd3406be60 0x7fcd3406e320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd541f7930 tx=0x7fcd40009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:08.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.515+0000 7fcd4aa00640 1 -- 172.21.15.7:0/2304600556 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcd44044e40 con 0x7fcd54072ff0 2024-08-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.703+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}] v 0) -- 0x7fcd540cfd30 con 0x7fcd54072ff0 2024-08-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.707+0000 7fcd4aa00640 1 -- 172.21.15.7:0/2304600556 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}]=0 v14)=0 v14) ==== 138+0+0 (secure 0 0 0) 0x7fcd44079e10 con 0x7fcd54072ff0 2024-08-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.709+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd3406be60 msgr2=0x7fcd3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.709+0000 7fcd59600640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd3406be60 0x7fcd3406e320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd541f7930 tx=0x7fcd40009040 comp rx=0 tx=0).stop 2024-08-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.709+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd54072ff0 msgr2=0x7fcd54157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.709+0000 7fcd59600640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd54072ff0 0x7fcd54157b90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098c0 tx=0x7fcd440046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.709+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 shutdown_connections 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.709+0000 7fcd59600640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd3406be60 0x7fcd3406e320 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.710+0000 7fcd59600640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd541f83e0 0x7fcd54155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.710+0000 7fcd59600640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd540ae480 0x7fcd5415dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.710+0000 7fcd59600640 1 --2- 172.21.15.7:0/2304600556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd54072ff0 0x7fcd54157b90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.710+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 >> 172.21.15.7:0/2304600556 conn(0x7fcd540b2300 msgr2=0x7fcd54154900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.710+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 shutdown_connections 2024-08-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:08.710+0000 7fcd59600640 1 -- 172.21.15.7:0/2304600556 wait complete. 2024-08-19T00:39:13.730 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mv a/b a/c; sync .') 2024-08-19T00:39:13.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:39:13.825 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:39:13.822+0000 7face6e00640 -1 mds.0.cache.den(0x10000000000 c) newly corrupt dentry to be committed: [dentry #0x1/a/c [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5051:44 nref=7 cr=0x559f70bf2a80)) (dversion lock w=1 last_client=5051) pv=4 v=3 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x559f70b4d400] 2024-08-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:13.836 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:13.837 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:13.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:39:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.069+0000 7f0394000640 1 Processor -- start 2024-08-19T00:39:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.069+0000 7f0394000640 1 -- start start 2024-08-19T00:39:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.070+0000 7f0394000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f038c09aa70 0x7f038c09ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.070+0000 7f0394000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f038c0d0290 0x7f038c0d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.070+0000 7f0394000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c09b390 con 0x7f038c09b730 2024-08-19T00:39:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.070+0000 7f0394000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f038c15ec30 con 0x7f038c09aa70 2024-08-19T00:39:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.070+0000 7f0394000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f038c15ef10 con 0x7f038c0d0290 2024-08-19T00:39:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.070+0000 7f0391600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f038c09aa70 0x7f038c09ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0391600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f038c09aa70 0x7f038c09ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45920/0 (socket says 172.21.15.7:45920) 2024-08-19T00:39:14.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0391600640 1 -- 172.21.15.7:0/556534721 learned_addr learned my addr 172.21.15.7:0/556534721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:14.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0390c00640 1 --1- 172.21.15.7:0/556534721 >> v1:172.21.15.7:6789/0 conn(0x7f038c09b730 0x7f038c06fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46330/0 (socket says 172.21.15.7:46330) 2024-08-19T00:39:14.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0392000640 1 --2- 172.21.15.7:0/556534721 >> v2:172.21.15.162:3300/0 conn(0x7f038c0d0290 0x7f038c0d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0391600640 1 -- 172.21.15.7:0/556534721 >> v2:172.21.15.162:3300/0 conn(0x7f038c0d0290 msgr2=0x7f038c0d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0391600640 1 --2- 172.21.15.7:0/556534721 >> v2:172.21.15.162:3300/0 conn(0x7f038c0d0290 0x7f038c0d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0391600640 1 -- 172.21.15.7:0/556534721 >> v1:172.21.15.7:6789/0 conn(0x7f038c09b730 legacy=0x7f038c06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.071+0000 7f0391600640 1 -- 172.21.15.7:0/556534721 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c15f1f0 con 0x7f038c09aa70 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.072+0000 7f0391600640 1 --2- 172.21.15.7:0/556534721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c09aa70 0x7f038c09ae50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f038c0730f0 tx=0x7f038002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2def590041bb6c6a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.072+0000 7f038be00640 1 -- 172.21.15.7:0/556534721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380037070 con 0x7f038c09aa70 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.072+0000 7f038be00640 1 -- 172.21.15.7:0/556534721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0380032440 con 0x7f038c09aa70 2024-08-19T00:39:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.072+0000 7f038be00640 1 -- 172.21.15.7:0/556534721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380032810 con 0x7f038c09aa70 2024-08-19T00:39:14.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 -- 172.21.15.7:0/556534721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c09aa70 msgr2=0x7f038c09ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 --2- 172.21.15.7:0/556534721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c09aa70 0x7f038c09ae50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f038c0730f0 tx=0x7f038002a270 comp rx=0 tx=0).stop 2024-08-19T00:39:14.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 -- 172.21.15.7:0/556534721 shutdown_connections 2024-08-19T00:39:14.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 --2- 172.21.15.7:0/556534721 >> v2:172.21.15.162:3300/0 conn(0x7f038c0d0290 0x7f038c0d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 --2- 172.21.15.7:0/556534721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c09aa70 0x7f038c09ae50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 -- 172.21.15.7:0/556534721 >> 172.21.15.7:0/556534721 conn(0x7f038c0d2190 msgr2=0x7f038c0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 -- 172.21.15.7:0/556534721 shutdown_connections 2024-08-19T00:39:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.073+0000 7f0394000640 1 -- 172.21.15.7:0/556534721 wait complete. 2024-08-19T00:39:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.075+0000 7f0394000640 1 Processor -- start 2024-08-19T00:39:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.075+0000 7f0394000640 1 -- start start 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0394000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c09aa70 0x7f038c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0394000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c09b730 0x7f038c1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0394000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c0d0290 0x7f038c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0394000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0d0c60 con 0x7f038c0d0290 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0394000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f038c15e8f0 con 0x7f038c09aa70 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0394000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f038c0d0de0 con 0x7f038c09b730 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0392000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c0d0290 0x7f038c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0392000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c0d0290 0x7f038c159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45936/0 (socket says 172.21.15.7:45936) 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0392000640 1 -- 172.21.15.7:0/753892900 learned_addr learned my addr 172.21.15.7:0/753892900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0390c00640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c09b730 0x7f038c1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.076+0000 7f0391600640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c09aa70 0x7f038c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0392000640 1 -- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c09b730 msgr2=0x7f038c1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0392000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c09b730 0x7f038c1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0392000640 1 -- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c09aa70 msgr2=0x7f038c0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0392000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c09aa70 0x7f038c0b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0392000640 1 -- 172.21.15.7:0/753892900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c158260 con 0x7f038c0d0290 2024-08-19T00:39:14.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0390c00640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c09b730 0x7f038c1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0392000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c0d0290 0x7f038c159c10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f038400efc0 tx=0x7f038400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0389600640 1 -- 172.21.15.7:0/753892900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384018020 con 0x7f038c0d0290 2024-08-19T00:39:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0389600640 1 -- 172.21.15.7:0/753892900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0384014480 con 0x7f038c0d0290 2024-08-19T00:39:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0389600640 1 -- 172.21.15.7:0/753892900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384014870 con 0x7f038c0d0290 2024-08-19T00:39:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c158540 con 0x7f038c0d0290 2024-08-19T00:39:14.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.077+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c0b6af0 con 0x7f038c0d0290 2024-08-19T00:39:14.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.078+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c0b6cf0 con 0x7f038c0d0290 2024-08-19T00:39:14.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.079+0000 7f0389600640 1 -- 172.21.15.7:0/753892900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0384005d10 con 0x7f038c0d0290 2024-08-19T00:39:14.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.080+0000 7f0389600640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036c06be30 0x7f036c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.080+0000 7f0389600640 1 -- 172.21.15.7:0/753892900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f038408bba0 con 0x7f038c0d0290 2024-08-19T00:39:14.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.080+0000 7f0391600640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036c06be30 0x7f036c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.081+0000 7f0391600640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036c06be30 0x7f036c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0380034000 tx=0x7f038002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:14.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.085+0000 7f0389600640 1 -- 172.21.15.7:0/753892900 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f038c0b6cf0 con 0x7f038c0d0290 2024-08-19T00:39:14.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.281+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f038c09ae50 con 0x7f038c0d0290 2024-08-19T00:39:14.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.281+0000 7f0389600640 1 -- 172.21.15.7:0/753892900 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7f0384022030 con 0x7f038c0d0290 2024-08-19T00:39:14.284 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:39:14.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.283+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036c06be30 msgr2=0x7f036c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.283+0000 7f0394000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036c06be30 0x7f036c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0380034000 tx=0x7f038002e000 comp rx=0 tx=0).stop 2024-08-19T00:39:14.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.283+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c0d0290 msgr2=0x7f038c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.283+0000 7f0394000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c0d0290 0x7f038c159c10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f038400efc0 tx=0x7f038400c490 comp rx=0 tx=0).stop 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.283+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 shutdown_connections 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.284+0000 7f0394000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036c06be30 0x7f036c06e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.284+0000 7f0394000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c0d0290 0x7f038c159c10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.284+0000 7f0394000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c09b730 0x7f038c1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.284+0000 7f0394000640 1 --2- 172.21.15.7:0/753892900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c09aa70 0x7f038c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.284+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 >> 172.21.15.7:0/753892900 conn(0x7f038c0d2190 msgr2=0x7f038c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.284+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 shutdown_connections 2024-08-19T00:39:14.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.284+0000 7f0394000640 1 -- 172.21.15.7:0/753892900 wait complete. 2024-08-19T00:39:14.303 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:39:14.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:14.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:14.370 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:39:14.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:14.370 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:39:14.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.601+0000 7f9ebca00640 1 Processor -- start 2024-08-19T00:39:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.601+0000 7f9ebca00640 1 -- start start 2024-08-19T00:39:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.602+0000 7f9ebca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9eb8159bf0 0x7f9eb8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.602+0000 7f9ebca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb80739a0 0x7f9eb80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.602+0000 7f9ebca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9eb80cea40 0x7f9eb80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.602+0000 7f9ebca00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb806f7f0 con 0x7f9eb80cea40 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.602+0000 7f9ebca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb806f510 con 0x7f9eb8159bf0 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.602+0000 7f9ebca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb8072980 con 0x7f9eb80739a0 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9eb80cea40 0x7f9eb80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9eb80cea40 0x7f9eb80d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45938/0 (socket says 172.21.15.7:45938) 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 -- 172.21.15.7:0/994377449 learned_addr learned my addr 172.21.15.7:0/994377449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb5e00640 1 --2- 172.21.15.7:0/994377449 >> v2:172.21.15.162:3300/0 conn(0x7f9eb8159bf0 0x7f9eb8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eafe00640 1 --2- 172.21.15.7:0/994377449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb80739a0 0x7f9eb80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 -- 172.21.15.7:0/994377449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb80739a0 msgr2=0x7f9eb80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 --2- 172.21.15.7:0/994377449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb80739a0 0x7f9eb80ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 -- 172.21.15.7:0/994377449 >> v2:172.21.15.162:3300/0 conn(0x7f9eb8159bf0 msgr2=0x7f9eb8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 --2- 172.21.15.7:0/994377449 >> v2:172.21.15.162:3300/0 conn(0x7f9eb8159bf0 0x7f9eb8073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.603+0000 7f9eb6800640 1 -- 172.21.15.7:0/994377449 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb8072c60 con 0x7f9eb80cea40 2024-08-19T00:39:14.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.604+0000 7f9eb6800640 1 --2- 172.21.15.7:0/994377449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80d03c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9eb806d280 tx=0x7f9eb002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9538c6233007bcc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9eb5400640 1 -- 172.21.15.7:0/994377449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0036070 con 0x7f9eb80cea40 2024-08-19T00:39:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9eb5400640 1 -- 172.21.15.7:0/994377449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb0031600 con 0x7f9eb80cea40 2024-08-19T00:39:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9eb5400640 1 -- 172.21.15.7:0/994377449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00319d0 con 0x7f9eb80cea40 2024-08-19T00:39:14.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 -- 172.21.15.7:0/994377449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 msgr2=0x7f9eb80d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 --2- 172.21.15.7:0/994377449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80d03c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9eb806d280 tx=0x7f9eb002a610 comp rx=0 tx=0).stop 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 -- 172.21.15.7:0/994377449 shutdown_connections 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 --2- 172.21.15.7:0/994377449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80d03c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 --2- 172.21.15.7:0/994377449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb80739a0 0x7f9eb80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 --2- 172.21.15.7:0/994377449 >> v2:172.21.15.162:3300/0 conn(0x7f9eb8159bf0 0x7f9eb8073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 -- 172.21.15.7:0/994377449 >> 172.21.15.7:0/994377449 conn(0x7f9eb806bc70 msgr2=0x7f9eb806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 -- 172.21.15.7:0/994377449 shutdown_connections 2024-08-19T00:39:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.605+0000 7f9ebca00640 1 -- 172.21.15.7:0/994377449 wait complete. 2024-08-19T00:39:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.607+0000 7f9ebca00640 1 Processor -- start 2024-08-19T00:39:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.607+0000 7f9ebca00640 1 -- start start 2024-08-19T00:39:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9ebca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb80739a0 0x7f9eb8148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9ebca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9ebca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb8159bf0 0x7f9eb80cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9ebca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb815a150 con 0x7f9eb80cea40 2024-08-19T00:39:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9ebca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb8159fd0 con 0x7f9eb80739a0 2024-08-19T00:39:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9ebca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb80d0900 con 0x7f9eb8159bf0 2024-08-19T00:39:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9eafe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9eafe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45950/0 (socket says 172.21.15.7:45950) 2024-08-19T00:39:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.608+0000 7f9eafe00640 1 -- 172.21.15.7:0/384543458 learned_addr learned my addr 172.21.15.7:0/384543458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eb6800640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb8159bf0 0x7f9eb80cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eafe00640 1 -- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb8159bf0 msgr2=0x7f9eb80cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eb5e00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb80739a0 0x7f9eb8148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eafe00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb8159bf0 0x7f9eb80cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eafe00640 1 -- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb80739a0 msgr2=0x7f9eb8148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eafe00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb80739a0 0x7f9eb8148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eafe00640 1 -- 172.21.15.7:0/384543458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb8148990 con 0x7f9eb80cea40 2024-08-19T00:39:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eb6800640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb8159bf0 0x7f9eb80cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eb5e00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb80739a0 0x7f9eb8148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eafe00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80cee20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000e870 tx=0x7f9ea000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eae000640 1 -- 172.21.15.7:0/384543458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0017070 con 0x7f9eb80cea40 2024-08-19T00:39:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eae000640 1 -- 172.21.15.7:0/384543458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea000c940 con 0x7f9eb80cea40 2024-08-19T00:39:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb809dda0 con 0x7f9eb80cea40 2024-08-19T00:39:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9eae000640 1 -- 172.21.15.7:0/384543458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000cd10 con 0x7f9eb80cea40 2024-08-19T00:39:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.609+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb809cfe0 con 0x7f9eb80cea40 2024-08-19T00:39:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.611+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb80d03c0 con 0x7f9eb80cea40 2024-08-19T00:39:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.612+0000 7f9eae000640 1 -- 172.21.15.7:0/384543458 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ea001a070 con 0x7f9eb80cea40 2024-08-19T00:39:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.612+0000 7f9eae000640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9406be30 0x7f9e9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:14.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.612+0000 7f9eae000640 1 -- 172.21.15.7:0/384543458 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9ea008acb0 con 0x7f9eb80cea40 2024-08-19T00:39:14.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.613+0000 7f9eb5e00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9406be30 0x7f9e9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:14.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.613+0000 7f9eb5e00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9406be30 0x7f9e9406e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009a40 tx=0x7f9ea8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.617+0000 7f9eae000640 1 -- 172.21.15.7:0/384543458 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9eb8148990 con 0x7f9eb80cea40 2024-08-19T00:39:14.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.837+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eb8160940 con 0x7f9eb80cea40 2024-08-19T00:39:14.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.837+0000 7f9eae000640 1 -- 172.21.15.7:0/384543458 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5217 (secure 0 0 0) 0x7f9ea00596f0 con 0x7f9eb80cea40 2024-08-19T00:39:14.840 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:14.841 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"btime":"2024-08-19T00:38:58:370924+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:38:57.793158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5319":{"gid":5319,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/484605249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":484605249},{"type":"v1","addr":"172.21.15.7:6837","nonce":484605249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5319,"qdb_cluster":[5319]},"id":3}]} 2024-08-19T00:39:14.841 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9406be30 msgr2=0x7f9e9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9406be30 0x7f9e9406e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009a40 tx=0x7f9ea8008040 comp rx=0 tx=0).stop 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 msgr2=0x7f9eb80cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80cee20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000e870 tx=0x7f9ea000ed30 comp rx=0 tx=0).stop 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 shutdown_connections 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9406be30 0x7f9e9406e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb8159bf0 0x7f9eb80cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb80cea40 0x7f9eb80cee20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 --2- 172.21.15.7:0/384543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb80739a0 0x7f9eb8148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 >> 172.21.15.7:0/384543458 conn(0x7f9eb806bc70 msgr2=0x7f9eb815a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:14.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 shutdown_connections 2024-08-19T00:39:14.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:14.840+0000 7f9ebca00640 1 -- 172.21.15.7:0/384543458 wait complete. 2024-08-19T00:39:14.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.013+0000 7fce53c00640 1 Processor -- start 2024-08-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.014+0000 7fce53c00640 1 -- start start 2024-08-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce53c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce53c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4c0cdfb0 con 0x7fce4c0d03c0 2024-08-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce53c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4c0ce290 con 0x7fce4c06e710 2024-08-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce53c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c0cebc0 con 0x7fce4c071980 2024-08-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce51200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fce4c0d03c0 0x7fce4c0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46332/0 (socket says 172.21.15.7:46332) 2024-08-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce51200640 1 -- 172.21.15.7:0/210083204 learned_addr learned my addr 172.21.15.7:0/210083204 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce51c00640 1 --2- 172.21.15.7:0/210083204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820768048 0 0) 0x7fce4c0cdfb0 con 0x7fce4c0d03c0 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.015+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce34003520 con 0x7fce4c0d03c0 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.016+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538960359 0 0) 0x7fce4c0ce290 con 0x7fce4c06e710 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.016+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce4c0cdfb0 con 0x7fce4c06e710 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.016+0000 7fce51c00640 1 -- 172.21.15.7:0/210083204 >> v1:172.21.15.162:6789/0 conn(0x7fce4c06e710 legacy=0x7fce4c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.016+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1395720269 0 0) 0x7fce34003520 con 0x7fce4c0d03c0 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.016+0000 7fce51c00640 1 -- 172.21.15.7:0/210083204 >> v1:172.21.15.7:6789/0 conn(0x7fce4c0d03c0 legacy=0x7fce4c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.016+0000 7fce51c00640 1 -- 172.21.15.7:0/210083204 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c0ce570 con 0x7fce4c071980 2024-08-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.017+0000 7fce51c00640 1 --2- 172.21.15.7:0/210083204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0cf050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce44009df0 tx=0x7fce4402a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae5f902f4e6abc49 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.017+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40001670 con 0x7fce4c071980 2024-08-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.017+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44007540 con 0x7fce4c071980 2024-08-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.017+0000 7fce4b400640 1 -- 172.21.15.7:0/210083204 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce440076f0 con 0x7fce4c071980 2024-08-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.018+0000 7fce53c00640 1 -- 172.21.15.7:0/210083204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 msgr2=0x7fce4c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.018+0000 7fce53c00640 1 --2- 172.21.15.7:0/210083204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0cf050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce44009df0 tx=0x7fce4402a6a0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.018+0000 7fce53c00640 1 -- 172.21.15.7:0/210083204 shutdown_connections 2024-08-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.018+0000 7fce53c00640 1 --2- 172.21.15.7:0/210083204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0cf050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.018+0000 7fce53c00640 1 -- 172.21.15.7:0/210083204 >> 172.21.15.7:0/210083204 conn(0x7fce4c06bc70 msgr2=0x7fce4c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.018+0000 7fce53c00640 1 -- 172.21.15.7:0/210083204 shutdown_connections 2024-08-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.018+0000 7fce53c00640 1 -- 172.21.15.7:0/210083204 wait complete. 2024-08-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.020+0000 7fce53c00640 1 Processor -- start 2024-08-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.020+0000 7fce53c00640 1 -- start start 2024-08-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce53c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce4c06e710 0x7fce4c099ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce53c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce53c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce4c0d03c0 0x7fce4c0c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce53c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c073c60 con 0x7fce4c06e710 2024-08-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce53c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c073ae0 con 0x7fce4c0d03c0 2024-08-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce53c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c0cf590 con 0x7fce4c071980 2024-08-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce4c06e710 0x7fce4c099ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce4c06e710 0x7fce4c099ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45964/0 (socket says 172.21.15.7:45964) 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 -- 172.21.15.7:0/1100699114 learned_addr learned my addr 172.21.15.7:0/1100699114 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce4c0d03c0 0x7fce4c0c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce4be00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 -- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 msgr2=0x7fce4c0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 -- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce4c0d03c0 msgr2=0x7fce4c0c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce4c0d03c0 0x7fce4c0c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.021+0000 7fce51200640 1 -- 172.21.15.7:0/1100699114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c156c10 con 0x7fce4c06e710 2024-08-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.022+0000 7fce51200640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce4c06e710 0x7fce4c099ac0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c5d0 tx=0x7fce4000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.022+0000 7fce48c00640 1 -- 172.21.15.7:0/1100699114 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40017070 con 0x7fce4c06e710 2024-08-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.022+0000 7fce48c00640 1 -- 172.21.15.7:0/1100699114 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce40005ce0 con 0x7fce4c06e710 2024-08-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.022+0000 7fce48c00640 1 -- 172.21.15.7:0/1100699114 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce400072b0 con 0x7fce4c06e710 2024-08-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.022+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c156eb0 con 0x7fce4c06e710 2024-08-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.022+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c157470 con 0x7fce4c06e710 2024-08-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.023+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce4c073140 con 0x7fce4c06e710 2024-08-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.024+0000 7fce48c00640 1 -- 172.21.15.7:0/1100699114 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce4001a070 con 0x7fce4c06e710 2024-08-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.025+0000 7fce48c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2c06be30 0x7fce2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.025+0000 7fce48c00640 1 -- 172.21.15.7:0/1100699114 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fce4008a440 con 0x7fce4c06e710 2024-08-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.025+0000 7fce4be00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2c06be30 0x7fce2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.026+0000 7fce4be00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2c06be30 0x7fce2c06e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fce4c1584f0 tx=0x7fce38009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.029+0000 7fce48c00640 1 -- 172.21.15.7:0/1100699114 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fce40058d60 con 0x7fce4c06e710 2024-08-19T00:39:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.251+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce4c0d0cd0 con 0x7fce4c06e710 2024-08-19T00:39:15.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.251+0000 7fce48c00640 1 -- 172.21.15.7:0/1100699114 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5217 (secure 0 0 0) 0x7fce40058660 con 0x7fce4c06e710 2024-08-19T00:39:15.254 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:15.254 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"btime":"2024-08-19T00:38:58:370924+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:38:57.793158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5319":{"gid":5319,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/484605249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":484605249},{"type":"v1","addr":"172.21.15.7:6837","nonce":484605249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5319,"qdb_cluster":[5319]},"id":3}]} 2024-08-19T00:39:15.255 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2c06be30 msgr2=0x7fce2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2c06be30 0x7fce2c06e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fce4c1584f0 tx=0x7fce38009040 comp rx=0 tx=0).stop 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce4c06e710 msgr2=0x7fce4c099ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce4c06e710 0x7fce4c099ac0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c5d0 tx=0x7fce4000ca90 comp rx=0 tx=0).stop 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 shutdown_connections 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2c06be30 0x7fce2c06e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce4c0d03c0 0x7fce4c0c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4c071980 0x7fce4c0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 --2- 172.21.15.7:0/1100699114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce4c06e710 0x7fce4c099ac0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 >> 172.21.15.7:0/1100699114 conn(0x7fce4c06bc70 msgr2=0x7fce4c15abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:15.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 shutdown_connections 2024-08-19T00:39:15.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.254+0000 7fce53c00640 1 -- 172.21.15.7:0/1100699114 wait complete. 2024-08-19T00:39:15.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /a 0 2024-08-19T00:39:15.448 INFO:teuthology.orchestra.run.smithi007.stdout:[{"ino":1099511627776,"rdev":0,"ctime":"2024-08-19T00:39:13.821811+0000","btime":"2024-08-19T00:39:07.712902+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-19T00:39:13.821811+0000","atime":"2024-08-19T00:39:07.712902+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-19T00:39:13.821811+0000","num_files":0,"num_subdirs":1,"change_attr":3},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-08-19T00:39:13.821811+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-08-19T00:39:13.821811+0000"},"version":9,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":0,"dirtyparent":0,"dirty":1,"authpin":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/a","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"7","version":"7","committing_version":"3","committed_version":"3","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"a/c","alternate_name":"","path_ino":1,"snap_first":18446744073709551606,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627777,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"a/b","alternate_name":"","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":5,"projected_version":5,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":0,"dirty":1,"authpin":0},"nref":1,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-08-19T00:39:15.450 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2024-08-19T00:39:13.821811+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2024-08-19T00:39:07.712902+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-19T00:39:07.712902+0000", "change_attr": 3, "client_caps": [], "client_ranges": [], "ctime": "2024-08-19T00:39:13.821811+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "3", "committing_version": "3", "dentries": [ { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "a/c", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 18446744073709551606, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": {}, "nref": 1, "path": "a/b", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 0, "lock": 0, "request": 0 }, "projected_version": 5, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 5, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/a", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-08-19T00:39:13.821811+0000", "num_files": 0, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-08-19T00:39:13.821811+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 0, "dirfrag": 1, "dirty": 1, "dirtyparent": 0, "lock": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-08-19T00:39:13.821811+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 9, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-08-19T00:39:15.450 DEBUG:tasks.cephfs.test_damage:[{'ino': 1099511627776, 'rdev': 0, 'ctime': '2024-08-19T00:39:13.821811+0000', 'btime': '2024-08-19T00:39:07.712902+0000', 'mode': 16877, 'uid': 1000, 'gid': 1333, 'nlink': 1, 'dir_layout': {'dir_hash': 2, 'unused1': 0, 'unused2': 0, 'unused3': 0}, 'layout': {'stripe_unit': 0, 'stripe_count': 0, 'object_size': 0, 'pool_id': -1, 'pool_ns': ''}, 'old_pools': [], 'size': 0, 'truncate_seq': 1, 'truncate_size': 18446744073709551615, 'truncate_from': 0, 'truncate_pending': 0, 'mtime': '2024-08-19T00:39:13.821811+0000', 'atime': '2024-08-19T00:39:07.712902+0000', 'time_warp_seq': 0, 'change_attr': 3, 'export_pin': -1, 'export_ephemeral_random_pin': 0, 'export_ephemeral_distributed_pin': False, 'quiesce_block': False, 'client_ranges': [], 'dirstat': {'version': 0, 'mtime': '2024-08-19T00:39:13.821811+0000', 'num_files': 0, 'num_subdirs': 1, 'change_attr': 3}, 'rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-08-19T00:39:13.821811+0000'}, 'accounted_rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-08-19T00:39:13.821811+0000'}, 'version': 9, 'file_data_version': 0, 'xattr_version': 1, 'backtrace_version': 2, 'stray_prior_path': '', 'max_size_ever': 0, 'quota': {'max_bytes': 0, 'max_files': 0}, 'last_scrub_stamp': '0.000000', 'last_scrub_version': 0, 'symlink': '', 'xattrs': [{'key': 'security.selinux', 'val': 'unconfined_u:object_r:unlabeled_t:s0\x00'}], 'dirfragtree': {'splits': []}, 'old_inodes': [], 'oldest_snap': 18446744073709551614, 'damage_flags': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'dirfrag': 1, 'caps': 0, 'dirtyparent': 0, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'iversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'authlock': {}, 'linklock': {}, 'dirfragtreelock': {}, 'filelock': {}, 'xattrlock': {}, 'snaplock': {}, 'nestlock': {'gather_set': [], 'state': 'lock', 'type': 'inest', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'flocklock': {}, 'policylock': {}, 'quiescelock': {'gather_set': [], 'state': 'lock', 'type': 'iquiesce', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty'], 'client_caps': [], 'loner': -1, 'want_loner': -1, 'mds_caps_wanted': [], 'dirfrags': [{'path': '/a', 'dirfrag': '0x10000000000', 'snapid_first': 2, 'projected_version': '7', 'version': '7', 'committing_version': '3', 'committed_version': '3', 'is_rep': False, 'dir_auth': '', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'dentries': [{'path': 'a/c', 'alternate_name': '', 'path_ino': 1, 'snap_first': 18446744073709551606, 'snap_last': 18446744073709551614, 'is_primary': True, 'is_remote': False, 'is_null': False, 'is_new': False, 'inode': 1099511627777, 'remote_type': '', 'version': 4, 'projected_version': 4, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'inodepin': 1, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}, {'path': 'a/b', 'alternate_name': '', 'path_ino': 1, 'snap_first': 2, 'snap_last': 18446744073709551614, 'is_primary': False, 'is_remote': False, 'is_null': True, 'is_new': False, 'inode': 0, 'remote_type': '', 'version': 5, 'projected_version': 5, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'inodepin': 0, 'dirty': 1, 'authpin': 0}, 'nref': 1, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}]}], 'is_subvolume': False}] 2024-08-19T00:39:15.450 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:39:15.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.606+0000 7feb90600640 1 Processor -- start 2024-08-19T00:39:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.606+0000 7feb90600640 1 -- start start 2024-08-19T00:39:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb90600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb8806e710 0x7feb88071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb90600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb880cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb90600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb880cdfb0 con 0x7feb880d03c0 2024-08-19T00:39:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb90600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7feb880cebc0 con 0x7feb8806e710 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb90600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb880ce290 con 0x7feb880b3750 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb8dc00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feb880d03c0 0x7feb880d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46348/0 (socket says 172.21.15.7:46348) 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb8dc00640 1 -- 172.21.15.7:0/3092634431 learned_addr learned my addr 172.21.15.7:0/3092634431 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb8d200640 1 --2- 172.21.15.7:0/3092634431 >> v2:172.21.15.7:3300/0 conn(0x7feb8806e710 0x7feb88071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.607+0000 7feb8e600640 1 --2- 172.21.15.7:0/3092634431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb880cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.608+0000 7feb87e00640 1 -- 172.21.15.7:0/3092634431 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741039364 0 0) 0x7feb880cdfb0 con 0x7feb880d03c0 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.608+0000 7feb87e00640 1 -- 172.21.15.7:0/3092634431 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb70003520 con 0x7feb880d03c0 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.608+0000 7feb8d200640 1 -- 172.21.15.7:0/3092634431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 msgr2=0x7feb880cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.608+0000 7feb8d200640 1 --2- 172.21.15.7:0/3092634431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb880cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.608+0000 7feb8d200640 1 -- 172.21.15.7:0/3092634431 >> v1:172.21.15.7:6789/0 conn(0x7feb880d03c0 legacy=0x7feb880d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.608+0000 7feb8d200640 1 -- 172.21.15.7:0/3092634431 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb880ce570 con 0x7feb8806e710 2024-08-19T00:39:15.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.609+0000 7feb8d200640 1 --2- 172.21.15.7:0/3092634431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88071980 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7feb740097d0 tx=0x7feb7402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b9b40498cfc38b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:15.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.609+0000 7feb87e00640 1 -- 172.21.15.7:0/3092634431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74037070 con 0x7feb8806e710 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.609+0000 7feb87e00640 1 -- 172.21.15.7:0/3092634431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74032440 con 0x7feb8806e710 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.609+0000 7feb87e00640 1 -- 172.21.15.7:0/3092634431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74032810 con 0x7feb8806e710 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 -- 172.21.15.7:0/3092634431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 msgr2=0x7feb88071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 --2- 172.21.15.7:0/3092634431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88071980 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7feb740097d0 tx=0x7feb7402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 -- 172.21.15.7:0/3092634431 shutdown_connections 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 --2- 172.21.15.7:0/3092634431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb880cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 --2- 172.21.15.7:0/3092634431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88071980 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 -- 172.21.15.7:0/3092634431 >> 172.21.15.7:0/3092634431 conn(0x7feb8806bc70 msgr2=0x7feb8806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 -- 172.21.15.7:0/3092634431 shutdown_connections 2024-08-19T00:39:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.610+0000 7feb90600640 1 -- 172.21.15.7:0/3092634431 wait complete. 2024-08-19T00:39:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.611+0000 7feb90600640 1 Processor -- start 2024-08-19T00:39:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.612+0000 7feb90600640 1 -- start start 2024-08-19T00:39:15.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.612+0000 7feb90600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.612+0000 7feb90600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb8809bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.612+0000 7feb90600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb880d03c0 0x7feb8809c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb90600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb88073c60 con 0x7feb8806e710 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb90600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb88073ae0 con 0x7feb880d03c0 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb90600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb880b3be0 con 0x7feb880b3750 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45980/0 (socket says 172.21.15.7:45980) 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 -- 172.21.15.7:0/3484003767 learned_addr learned my addr 172.21.15.7:0/3484003767 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8d200640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb8809bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8e600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb880d03c0 0x7feb8809c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 -- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 msgr2=0x7feb8809bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb8809bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 -- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb880d03c0 msgr2=0x7feb8809c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb880d03c0 0x7feb8809c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 -- 172.21.15.7:0/3484003767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8815ab30 con 0x7feb8806e710 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.613+0000 7feb8dc00640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88159b10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00c460 tx=0x7feb7c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.614+0000 7feb85600640 1 -- 172.21.15.7:0/3484003767 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c017070 con 0x7feb8806e710 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.614+0000 7feb85600640 1 -- 172.21.15.7:0/3484003767 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c005ce0 con 0x7feb8806e710 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.614+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8809daf0 con 0x7feb8806e710 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.614+0000 7feb85600640 1 -- 172.21.15.7:0/3484003767 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c007290 con 0x7feb8806e710 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.614+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8809e070 con 0x7feb8806e710 2024-08-19T00:39:15.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.615+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb88071980 con 0x7feb8806e710 2024-08-19T00:39:15.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.616+0000 7feb85600640 1 -- 172.21.15.7:0/3484003767 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb7c01a070 con 0x7feb8806e710 2024-08-19T00:39:15.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.617+0000 7feb85600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb6806be30 0x7feb6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:15.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.617+0000 7feb85600640 1 -- 172.21.15.7:0/3484003767 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7feb7c08a2c0 con 0x7feb8806e710 2024-08-19T00:39:15.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.617+0000 7feb8d200640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb6806be30 0x7feb6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:15.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.618+0000 7feb8d200640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb6806be30 0x7feb6806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb74034000 tx=0x7feb7402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:15.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.622+0000 7feb85600640 1 -- 172.21.15.7:0/3484003767 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feb7c058bd0 con 0x7feb8806e710 2024-08-19T00:39:15.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.842+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feb880ad4c0 con 0x7feb8806e710 2024-08-19T00:39:15.845 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:39:15.842+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:39:15.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.844+0000 7feb85600640 1 -- 172.21.15.7:0/3484003767 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7feb7c0584d0 con 0x7feb8806e710 2024-08-19T00:39:15.847 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb6806be30 msgr2=0x7feb6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb6806be30 0x7feb6806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb74034000 tx=0x7feb7402e000 comp rx=0 tx=0).stop 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 msgr2=0x7feb88159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88159b10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00c460 tx=0x7feb7c00c920 comp rx=0 tx=0).stop 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 shutdown_connections 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb6806be30 0x7feb6806e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb880d03c0 0x7feb8809c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb880b3750 0x7feb8809bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 --2- 172.21.15.7:0/3484003767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb8806e710 0x7feb88159b10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:15.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 >> 172.21.15.7:0/3484003767 conn(0x7feb8806bc70 msgr2=0x7feb88073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:15.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 shutdown_connections 2024-08-19T00:39:15.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:15.848+0000 7feb90600640 1 -- 172.21.15.7:0/3484003767 wait complete. 2024-08-19T00:39:15.857 INFO:tasks.ceph.mds.c.smithi007.stderr: -4351> 2024-08-19T00:38:57.320+0000 7face3c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:39:15.866 INFO:tasks.ceph.mds.c.smithi007.stderr: -349> 2024-08-19T00:39:13.822+0000 7face6e00640 -1 mds.0.cache.den(0x10000000000 c) newly corrupt dentry to be committed: [dentry #0x1/a/c [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5051:44 nref=7 cr=0x559f70bf2a80)) (dversion lock w=1 last_client=5051) pv=4 v=3 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x559f70b4d400] 2024-08-19T00:39:15.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-08-19T00:39:15.911 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:39:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.028+0000 7f0db9400640 1 Processor -- start 2024-08-19T00:39:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.028+0000 7f0db9400640 1 -- start start 2024-08-19T00:39:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db406d600 0x7f0db406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db9400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0db415cca0 0x7f0db415d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db9400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db406df60 con 0x7f0db415bd70 2024-08-19T00:39:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db9400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0db4073140 con 0x7f0db415cca0 2024-08-19T00:39:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0db40733f0 con 0x7f0db406d600 2024-08-19T00:39:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db3e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0db415bd70 0x7f0db4072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46352/0 (socket says 172.21.15.7:46352) 2024-08-19T00:39:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db3e00640 1 -- 172.21.15.7:0/4199236650 learned_addr learned my addr 172.21.15.7:0/4199236650 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db8a00640 1 --2- 172.21.15.7:0/4199236650 >> v2:172.21.15.162:3300/0 conn(0x7f0db415cca0 0x7f0db415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0dab400640 1 --2- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db406d600 0x7f0db406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db3400640 1 -- 172.21.15.7:0/4199236650 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094432256 0 0) 0x7f0db406df60 con 0x7f0db415bd70 2024-08-19T00:39:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db3400640 1 -- 172.21.15.7:0/4199236650 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d98003520 con 0x7f0db415bd70 2024-08-19T00:39:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db8a00640 1 -- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db406d600 msgr2=0x7f0db406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db8a00640 1 --2- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db406d600 0x7f0db406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db8a00640 1 -- 172.21.15.7:0/4199236650 >> v1:172.21.15.7:6789/0 conn(0x7f0db415bd70 legacy=0x7f0db4072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.030+0000 7f0db8a00640 1 -- 172.21.15.7:0/4199236650 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db40736d0 con 0x7f0db415cca0 2024-08-19T00:39:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.031+0000 7f0db8a00640 1 --2- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db415cca0 0x7f0db415d130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a24fa7922dc8d9e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db3400640 1 -- 172.21.15.7:0/4199236650 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac02ae60 con 0x7f0db415cca0 2024-08-19T00:39:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db3400640 1 -- 172.21.15.7:0/4199236650 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac007740 con 0x7f0db415cca0 2024-08-19T00:39:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db3400640 1 -- 172.21.15.7:0/4199236650 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac007b10 con 0x7f0db415cca0 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db9400640 1 -- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db415cca0 msgr2=0x7f0db415d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db9400640 1 --2- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db415cca0 0x7f0db415d130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac02a680 comp rx=0 tx=0).stop 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db9400640 1 -- 172.21.15.7:0/4199236650 shutdown_connections 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db9400640 1 --2- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db415cca0 0x7f0db415d130 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db9400640 1 --2- 172.21.15.7:0/4199236650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db406d600 0x7f0db406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.032+0000 7f0db9400640 1 -- 172.21.15.7:0/4199236650 >> 172.21.15.7:0/4199236650 conn(0x7f0db406b850 msgr2=0x7f0db406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.033+0000 7f0db9400640 1 -- 172.21.15.7:0/4199236650 shutdown_connections 2024-08-19T00:39:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.033+0000 7f0db9400640 1 -- 172.21.15.7:0/4199236650 wait complete. 2024-08-19T00:39:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.034+0000 7f0db9400640 1 Processor -- start 2024-08-19T00:39:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.034+0000 7f0db9400640 1 -- start start 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.035+0000 7f0db9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db406d600 0x7f0db4151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.035+0000 7f0db9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0db415bd70 0x7f0db4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.035+0000 7f0db9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db415cca0 0x7f0db40ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.035+0000 7f0db9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0db415c780 con 0x7f0db415bd70 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.035+0000 7f0db9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0db415c4a0 con 0x7f0db406d600 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.035+0000 7f0db9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0db415c150 con 0x7f0db415cca0 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0db415bd70 0x7f0db4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0db415bd70 0x7f0db4157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46008/0 (socket says 172.21.15.7:46008) 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 -- 172.21.15.7:0/4024428787 learned_addr learned my addr 172.21.15.7:0/4024428787 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0db3e00640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db406d600 0x7f0db4151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0db8a00640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db415cca0 0x7f0db40ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 -- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db415cca0 msgr2=0x7f0db40ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db415cca0 0x7f0db40ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 -- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db406d600 msgr2=0x7f0db4151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db406d600 0x7f0db4151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 -- 172.21.15.7:0/4024428787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db4155b80 con 0x7f0db415bd70 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0db8a00640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db415cca0 0x7f0db40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0db3e00640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db406d600 0x7f0db4151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.036+0000 7f0dab400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0db415bd70 0x7f0db4157d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00e9e0 tx=0x7f0d9c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.037+0000 7f0db0c00640 1 -- 172.21.15.7:0/4024428787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c017070 con 0x7f0db415bd70 2024-08-19T00:39:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.037+0000 7f0db0c00640 1 -- 172.21.15.7:0/4024428787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9c00c9d0 con 0x7f0db415bd70 2024-08-19T00:39:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.037+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db4152110 con 0x7f0db415bd70 2024-08-19T00:39:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.037+0000 7f0db0c00640 1 -- 172.21.15.7:0/4024428787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00cdc0 con 0x7f0db415bd70 2024-08-19T00:39:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.037+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db4158e10 con 0x7f0db415bd70 2024-08-19T00:39:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.038+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db406e3a0 con 0x7f0db415bd70 2024-08-19T00:39:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.039+0000 7f0db0c00640 1 -- 172.21.15.7:0/4024428787 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d9c01a070 con 0x7f0db415bd70 2024-08-19T00:39:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.040+0000 7f0db0c00640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0d9006be30 0x7f0d9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.040+0000 7f0db0c00640 1 -- 172.21.15.7:0/4024428787 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f0d9c08ae70 con 0x7f0db415bd70 2024-08-19T00:39:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.040+0000 7f0db3e00640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0d9006be30 0x7f0d9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.041+0000 7f0db3e00640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0d9006be30 0x7f0d9006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0da4007fd0 tx=0x7f0da4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.044+0000 7f0db0c00640 1 -- 172.21.15.7:0/4024428787 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0db4155b80 con 0x7f0db415bd70 2024-08-19T00:39:16.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.229+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7f0db4072ea0 con 0x7f0db415bd70 2024-08-19T00:39:16.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.233+0000 7f0db0c00640 1 -- 172.21.15.7:0/4024428787 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f0d9c059850 con 0x7f0db415bd70 2024-08-19T00:39:16.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.235+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0d9006be30 msgr2=0x7f0d9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.235+0000 7f0db9400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0d9006be30 0x7f0d9006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0da4007fd0 tx=0x7f0da4009040 comp rx=0 tx=0).stop 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.235+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0db415bd70 msgr2=0x7f0db4157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.235+0000 7f0db9400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0db415bd70 0x7f0db4157d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00e9e0 tx=0x7f0d9c00eea0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 shutdown_connections 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0d9006be30 0x7f0d9006e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0db415cca0 0x7f0db40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0db415bd70 0x7f0db4157d90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 --2- 172.21.15.7:0/4024428787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db406d600 0x7f0db4151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 >> 172.21.15.7:0/4024428787 conn(0x7f0db406b850 msgr2=0x7f0db40b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:16.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 shutdown_connections 2024-08-19T00:39:16.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.236+0000 7f0db9400640 1 -- 172.21.15.7:0/4024428787 wait complete. 2024-08-19T00:39:16.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_abort_on_newly_corrupt_dentry False 2024-08-19T00:39:16.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.451+0000 7f231e800640 1 Processor -- start 2024-08-19T00:39:16.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.451+0000 7f231e800640 1 -- start start 2024-08-19T00:39:16.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.452+0000 7f231e800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 0x7f23180b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.452+0000 7f231e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f23180d27b0 0x7f23180d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.452+0000 7f231e800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23180d3110 con 0x7f23180b4150 2024-08-19T00:39:16.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.452+0000 7f231e800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f23180b4df0 con 0x7f23180d27b0 2024-08-19T00:39:16.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.452+0000 7f231e800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23180b50d0 con 0x7f231815e3e0 2024-08-19T00:39:16.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f231de00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f23180b4150 0x7f23180b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46368/0 (socket says 172.21.15.7:46368) 2024-08-19T00:39:16.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f231de00640 1 -- 172.21.15.7:0/906801415 learned_addr learned my addr 172.21.15.7:0/906801415 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f231d400640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 0x7f23180b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f231ca00640 1 --2- 172.21.15.7:0/906801415 >> v2:172.21.15.162:3300/0 conn(0x7f23180d27b0 0x7f23180d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185113780 0 0) 0x7f23180d3110 con 0x7f23180b4150 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2300003520 con 0x7f23180b4150 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2512688389 0 0) 0x7f2300003520 con 0x7f23180b4150 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 msgr2=0x7f23180b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 0x7f23180b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 >> v2:172.21.15.162:3300/0 conn(0x7f23180d27b0 msgr2=0x7f23180d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 --2- 172.21.15.7:0/906801415 >> v2:172.21.15.162:3300/0 conn(0x7f23180d27b0 0x7f23180d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23180cf1e0 con 0x7f23180b4150 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f23100019f0 con 0x7f23180b4150 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.453+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 >> v1:172.21.15.7:6789/0 conn(0x7f23180b4150 legacy=0x7f23180b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f2317e00640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f2317e00640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 0x7f2300004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f2317e00640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2300004d40 0x7f23000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f23180b4df0 con 0x7f23000039b0 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f23180b50d0 con 0x7f2300004d40 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f230000b9c0 con 0x7f231815e3e0 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231d400640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231ca00640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 0x7f2300004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231de00640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2300004d40 0x7f23000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231d400640 1 -- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 msgr2=0x7f2300004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231d400640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f231815e3e0 0x7f2300004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231d400640 1 -- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2300004d40 msgr2=0x7f23000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231d400640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2300004d40 0x7f23000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.454+0000 7f231d400640 1 -- 172.21.15.7:0/906801415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2300003520 con 0x7f23000039b0 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.455+0000 7f231d400640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f230c009ac0 tx=0x7f2300005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a73913948bad118 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c036070 con 0x7f23000039b0 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230c031400 con 0x7f23000039b0 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f2317e00640 1 -- 172.21.15.7:0/906801415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c009690 con 0x7f23000039b0 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f231e800640 1 -- 172.21.15.7:0/906801415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23000039b0 msgr2=0x7f2300003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f231e800640 1 --2- 172.21.15.7:0/906801415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f230c009ac0 tx=0x7f2300005830 comp rx=0 tx=0).stop 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f231de00640 1 -- 172.21.15.7:0/906801415 reap_dead start 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f231e800640 1 -- 172.21.15.7:0/906801415 shutdown_connections 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f231e800640 1 -- 172.21.15.7:0/906801415 >> 172.21.15.7:0/906801415 conn(0x7f231808dbe0 msgr2=0x7f231809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f231e800640 1 -- 172.21.15.7:0/906801415 shutdown_connections 2024-08-19T00:39:16.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.456+0000 7f231e800640 1 -- 172.21.15.7:0/906801415 wait complete. 2024-08-19T00:39:16.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.458+0000 7f231e800640 1 Processor -- start 2024-08-19T00:39:16.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.458+0000 7f231e800640 1 -- start start 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231e800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23000039b0 0x7f23181f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23181614c0 0x7f2318157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23181f3ee0 0x7f23180cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231e800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f23180b0e60 con 0x7f23181f3ee0 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f23180cee90 con 0x7f23181614c0 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231e800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23180b0fe0 con 0x7f23000039b0 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23181f3ee0 0x7f23180cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23181f3ee0 0x7f23180cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46022/0 (socket says 172.21.15.7:46022) 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231de00640 1 -- 172.21.15.7:0/126164208 learned_addr learned my addr 172.21.15.7:0/126164208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231d400640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23000039b0 0x7f23181f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.459+0000 7f231ca00640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23181614c0 0x7f2318157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231de00640 1 -- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23000039b0 msgr2=0x7f23181f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231de00640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23000039b0 0x7f23181f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231de00640 1 -- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23181614c0 msgr2=0x7f2318157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231de00640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23181614c0 0x7f2318157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231de00640 1 -- 172.21.15.7:0/126164208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23181f4790 con 0x7f23181f3ee0 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231de00640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23181f3ee0 0x7f23180cb2a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f231808e0b0 tx=0x7f2310007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f2315600640 1 -- 172.21.15.7:0/126164208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310017020 con 0x7f23181f3ee0 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f2315600640 1 -- 172.21.15.7:0/126164208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231000aa70 con 0x7f23181f3ee0 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f2315600640 1 -- 172.21.15.7:0/126164208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231000ae60 con 0x7f23181f3ee0 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23181f4a70 con 0x7f23181f3ee0 2024-08-19T00:39:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.460+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2318157c50 con 0x7f23181f3ee0 2024-08-19T00:39:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.461+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23180b13c0 con 0x7f23181f3ee0 2024-08-19T00:39:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.462+0000 7f2315600640 1 -- 172.21.15.7:0/126164208 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f231001a020 con 0x7f23181f3ee0 2024-08-19T00:39:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.463+0000 7f2315600640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22f806be30 0x7f22f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.463+0000 7f2315600640 1 -- 172.21.15.7:0/126164208 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f231008b690 con 0x7f23181f3ee0 2024-08-19T00:39:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.464+0000 7f231d400640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22f806be30 0x7f22f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.464+0000 7f231d400640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22f806be30 0x7f22f806e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f230c033000 tx=0x7f230c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.468+0000 7f2315600640 1 -- 172.21.15.7:0/126164208 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2310021020 con 0x7f23181f3ee0 2024-08-19T00:39:16.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.651+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}] v 0) -- 0x7f231806cc20 con 0x7f23181f3ee0 2024-08-19T00:39:16.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.652+0000 7f2315600640 1 -- 172.21.15.7:0/126164208 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}]=0 v15)=0 v15) ==== 135+0+0 (secure 0 0 0) 0x7f2310059980 con 0x7f23181f3ee0 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22f806be30 msgr2=0x7f22f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22f806be30 0x7f22f806e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f230c033000 tx=0x7f230c008030 comp rx=0 tx=0).stop 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23181f3ee0 msgr2=0x7f23180cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23181f3ee0 0x7f23180cb2a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f231808e0b0 tx=0x7f2310007b20 comp rx=0 tx=0).stop 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 shutdown_connections 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22f806be30 0x7f22f806e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23181f3ee0 0x7f23180cb2a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23181614c0 0x7f2318157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 --2- 172.21.15.7:0/126164208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23000039b0 0x7f23181f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 >> 172.21.15.7:0/126164208 conn(0x7f231808dbe0 msgr2=0x7f23180cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 shutdown_connections 2024-08-19T00:39:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.654+0000 7f231e800640 1 -- 172.21.15.7:0/126164208 wait complete. 2024-08-19T00:39:16.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:39:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.831+0000 7f478f200640 1 Processor -- start 2024-08-19T00:39:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.831+0000 7f478f200640 1 -- start start 2024-08-19T00:39:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.832+0000 7f478f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f47880b5130 0x7f47880aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.832+0000 7f478f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 0x7f47880af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.832+0000 7f478f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47880acef0 con 0x7f478815bfb0 2024-08-19T00:39:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.832+0000 7f478f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f47880af650 con 0x7f47880b5130 2024-08-19T00:39:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.832+0000 7f478f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47880ad790 con 0x7f478815c390 2024-08-19T00:39:16.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f478815bfb0 0x7f47880b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46374/0 (socket says 172.21.15.7:46374) 2024-08-19T00:39:16.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787e00640 1 -- 172.21.15.7:0/3836207061 learned_addr learned my addr 172.21.15.7:0/3836207061 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f477f400640 1 --2- 172.21.15.7:0/3836207061 >> v2:172.21.15.162:3300/0 conn(0x7f47880b5130 0x7f47880aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f478d200640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 0x7f47880af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393205128 0 0) 0x7f47880acef0 con 0x7f478815bfb0 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f476c003520 con 0x7f478815bfb0 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1452338746 0 0) 0x7f476c003520 con 0x7f478815bfb0 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 msgr2=0x7f47880af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 0x7f47880af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 >> v2:172.21.15.162:3300/0 conn(0x7f47880b5130 msgr2=0x7f47880aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 --2- 172.21.15.7:0/3836207061 >> v2:172.21.15.162:3300/0 conn(0x7f47880b5130 0x7f47880aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47880ad1d0 con 0x7f478815bfb0 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.833+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f4778001670 con 0x7f478815bfb0 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 >> v1:172.21.15.7:6789/0 conn(0x7f478815bfb0 legacy=0x7f47880b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787400640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039b0 0x7f476c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787400640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 0x7f476c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787400640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c004d40 0x7f476c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47880af650 con 0x7f476c004d40 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47880ad790 con 0x7f476c0039b0 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f476c00b9c0 con 0x7f478815c390 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f478d200640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c004d40 0x7f476c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f4787e00640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039b0 0x7f476c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f477f400640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 0x7f476c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f478d200640 1 -- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 msgr2=0x7f476c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f478d200640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f478815c390 0x7f476c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f478d200640 1 -- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039b0 msgr2=0x7f476c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:16.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f478d200640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039b0 0x7f476c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.834+0000 7f478d200640 1 -- 172.21.15.7:0/3836207061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c003520 con 0x7f476c004d40 2024-08-19T00:39:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.835+0000 7f478d200640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c004d40 0x7f476c0051c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f478000e170 tx=0x7f476c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161595556da84385 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780034020 con 0x7f476c004d40 2024-08-19T00:39:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47800305f0 con 0x7f476c004d40 2024-08-19T00:39:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f4787400640 1 -- 172.21.15.7:0/3836207061 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780009c10 con 0x7f476c004d40 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f478f200640 1 -- 172.21.15.7:0/3836207061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c004d40 msgr2=0x7f476c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f478f200640 1 --2- 172.21.15.7:0/3836207061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c004d40 0x7f476c0051c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f478000e170 tx=0x7f476c005830 comp rx=0 tx=0).stop 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f478d200640 1 -- 172.21.15.7:0/3836207061 reap_dead start 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f478f200640 1 -- 172.21.15.7:0/3836207061 shutdown_connections 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f478f200640 1 -- 172.21.15.7:0/3836207061 >> 172.21.15.7:0/3836207061 conn(0x7f47880b2300 msgr2=0x7f478806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f478f200640 1 -- 172.21.15.7:0/3836207061 shutdown_connections 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.836+0000 7f478f200640 1 -- 172.21.15.7:0/3836207061 wait complete. 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.838+0000 7f478f200640 1 Processor -- start 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.838+0000 7f478f200640 1 -- start start 2024-08-19T00:39:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.839+0000 7f478f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476c004d40 0x7f4788152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.839+0000 7f478f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4788153a90 0x7f478809c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.839+0000 7f478f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4788153540 0x7f478809cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.839+0000 7f478f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47880af110 con 0x7f4788153a90 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.839+0000 7f478f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4788071b20 con 0x7f4788153540 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.839+0000 7f478f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47880af290 con 0x7f476c004d40 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4788153a90 0x7f478809c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4788153a90 0x7f478809c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46052/0 (socket says 172.21.15.7:46052) 2024-08-19T00:39:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 -- 172.21.15.7:0/3913908875 learned_addr learned my addr 172.21.15.7:0/3913908875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f4787e00640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476c004d40 0x7f4788152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f478d200640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4788153540 0x7f478809cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 -- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476c004d40 msgr2=0x7f4788152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476c004d40 0x7f4788152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 -- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4788153540 msgr2=0x7f478809cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4788153540 0x7f478809cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 -- 172.21.15.7:0/3913908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47880caa00 con 0x7f4788153a90 2024-08-19T00:39:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.840+0000 7f477f400640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4788153a90 0x7f478809c7f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4770011a70 tx=0x7f4770011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.841+0000 7f4784c00640 1 -- 172.21.15.7:0/3913908875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477000fb50 con 0x7f4788153a90 2024-08-19T00:39:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.841+0000 7f4784c00640 1 -- 172.21.15.7:0/3913908875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477000fcf0 con 0x7f4788153a90 2024-08-19T00:39:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.841+0000 7f4784c00640 1 -- 172.21.15.7:0/3913908875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477000fea0 con 0x7f4788153a90 2024-08-19T00:39:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.841+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478809bcb0 con 0x7f4788153a90 2024-08-19T00:39:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.841+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478809c270 con 0x7f4788153a90 2024-08-19T00:39:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.842+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47880aebd0 con 0x7f4788153a90 2024-08-19T00:39:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.843+0000 7f4784c00640 1 -- 172.21.15.7:0/3913908875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4770012040 con 0x7f4788153a90 2024-08-19T00:39:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.844+0000 7f4784c00640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f476406be30 0x7f476406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.844+0000 7f4784c00640 1 -- 172.21.15.7:0/3913908875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f477008b4e0 con 0x7f4788153a90 2024-08-19T00:39:16.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.844+0000 7f4787e00640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f476406be30 0x7f476406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:16.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.844+0000 7f4787e00640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f476406be30 0x7f476406e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4778007d70 tx=0x7f47780078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:16.848+0000 7f4784c00640 1 -- 172.21.15.7:0/3913908875 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4770019030 con 0x7f4788153a90 2024-08-19T00:39:17.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.071+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f4788154680 con 0x7f4788153a90 2024-08-19T00:39:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.855+0000 7f4784c00640 1 -- 172.21.15.7:0/3913908875 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v33) ==== 162+0+0 (secure 0 0 0) 0x7f47700597d0 con 0x7f4788153a90 2024-08-19T00:39:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:39:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f476406be30 msgr2=0x7f476406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f476406be30 0x7f476406e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4778007d70 tx=0x7f47780078f0 comp rx=0 tx=0).stop 2024-08-19T00:39:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4788153a90 msgr2=0x7f478809c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4788153a90 0x7f478809c7f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4770011a70 tx=0x7f4770011f30 comp rx=0 tx=0).stop 2024-08-19T00:39:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 shutdown_connections 2024-08-19T00:39:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f476406be30 0x7f476406e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4788153540 0x7f478809cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4788153a90 0x7f478809c7f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.858+0000 7f478f200640 1 --2- 172.21.15.7:0/3913908875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476c004d40 0x7f4788152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.859+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 >> 172.21.15.7:0/3913908875 conn(0x7f47880b2300 msgr2=0x7f47880720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.859+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 shutdown_connections 2024-08-19T00:39:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:17.859+0000 7f478f200640 1 -- 172.21.15.7:0/3913908875 wait complete. 2024-08-19T00:39:17.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:18.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.041+0000 7f5f57200640 1 Processor -- start 2024-08-19T00:39:18.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.041+0000 7f5f57200640 1 -- start start 2024-08-19T00:39:18.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.042+0000 7f5f57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e360 0x7f5f5815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.042+0000 7f5f57200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f580d2af0 0x7f5f580d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.042+0000 7f5f57200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f580b3ab0 con 0x7f5f5815e740 2024-08-19T00:39:18.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.042+0000 7f5f57200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5f580d3490 con 0x7f5f580d2af0 2024-08-19T00:39:18.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.042+0000 7f5f57200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5815f460 con 0x7f5f5815e360 2024-08-19T00:39:18.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.042+0000 7f5f55400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f580d2af0 0x7f5f580d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.043+0000 7f5f55400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f580d2af0 0x7f5f580d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46060/0 (socket says 172.21.15.7:46060) 2024-08-19T00:39:18.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.043+0000 7f5f55400640 1 -- 172.21.15.7:0/1973948770 learned_addr learned my addr 172.21.15.7:0/1973948770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.043+0000 7f5f55e00640 1 --2- 172.21.15.7:0/1973948770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e360 0x7f5f5815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.043+0000 7f5f55400640 1 -- 172.21.15.7:0/1973948770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e360 msgr2=0x7f5f5815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.043+0000 7f5f55400640 1 --2- 172.21.15.7:0/1973948770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e360 0x7f5f5815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.043+0000 7f5f55400640 1 -- 172.21.15.7:0/1973948770 >> v1:172.21.15.162:6789/0 conn(0x7f5f5815e740 legacy=0x7f5f5815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.043+0000 7f5f55400640 1 -- 172.21.15.7:0/1973948770 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5815f740 con 0x7f5f580d2af0 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.044+0000 7f5f55400640 1 --2- 172.21.15.7:0/1973948770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580d2f50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009870 tx=0x7f5f4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbee74c758b2a621 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.044+0000 7f5f54a00640 1 -- 172.21.15.7:0/1973948770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44037070 con 0x7f5f580d2af0 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.044+0000 7f5f54a00640 1 -- 172.21.15.7:0/1973948770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f44032440 con 0x7f5f580d2af0 2024-08-19T00:39:18.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.044+0000 7f5f54a00640 1 -- 172.21.15.7:0/1973948770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44032810 con 0x7f5f580d2af0 2024-08-19T00:39:18.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 -- 172.21.15.7:0/1973948770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 msgr2=0x7f5f580d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 --2- 172.21.15.7:0/1973948770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580d2f50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009870 tx=0x7f5f4402a270 comp rx=0 tx=0).stop 2024-08-19T00:39:18.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 -- 172.21.15.7:0/1973948770 shutdown_connections 2024-08-19T00:39:18.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 --2- 172.21.15.7:0/1973948770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580d2f50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 --2- 172.21.15.7:0/1973948770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e360 0x7f5f5815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 -- 172.21.15.7:0/1973948770 >> 172.21.15.7:0/1973948770 conn(0x7f5f5808dbf0 msgr2=0x7f5f5809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 -- 172.21.15.7:0/1973948770 shutdown_connections 2024-08-19T00:39:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.045+0000 7f5f57200640 1 -- 172.21.15.7:0/1973948770 wait complete. 2024-08-19T00:39:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.047+0000 7f5f57200640 1 Processor -- start 2024-08-19T00:39:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.047+0000 7f5f57200640 1 -- start start 2024-08-19T00:39:18.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f57200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f57200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f5815e360 0x7f5f5815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e740 0x7f5f580cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f57200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f580d2300 con 0x7f5f580d2af0 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f57200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f580b4040 con 0x7f5f5815e360 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f57200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f580b4560 con 0x7f5f5815e740 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f55e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f55e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46074/0 (socket says 172.21.15.7:46074) 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f55e00640 1 -- 172.21.15.7:0/366302940 learned_addr learned my addr 172.21.15.7:0/366302940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f56800640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e740 0x7f5f580cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f55e00640 1 -- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e740 msgr2=0x7f5f580cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f55400640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f5815e360 0x7f5f5815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f55e00640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e740 0x7f5f580cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.048+0000 7f5f55e00640 1 -- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f5815e360 msgr2=0x7f5f5815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f55e00640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f5815e360 0x7f5f5815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f55e00640 1 -- 172.21.15.7:0/366302940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5815b340 con 0x7f5f580d2af0 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f56800640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e740 0x7f5f580cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f55400640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f5815e360 0x7f5f5815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f55e00640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580b8cf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800e9b0 tx=0x7f5f4800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f4e000640 1 -- 172.21.15.7:0/366302940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48017070 con 0x7f5f580d2af0 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f4e000640 1 -- 172.21.15.7:0/366302940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4800c9a0 con 0x7f5f580d2af0 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f4e000640 1 -- 172.21.15.7:0/366302940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800cd90 con 0x7f5f580d2af0 2024-08-19T00:39:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f580cdbc0 con 0x7f5f580d2af0 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.049+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f580b8210 con 0x7f5f580d2af0 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.050+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f580d2f50 con 0x7f5f580d2af0 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.051+0000 7f5f4e000640 1 -- 172.21.15.7:0/366302940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f4801a070 con 0x7f5f580d2af0 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.052+0000 7f5f4e000640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f3806be30 0x7f5f3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.052+0000 7f5f4e000640 1 -- 172.21.15.7:0/366302940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f5f4808af00 con 0x7f5f580d2af0 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.052+0000 7f5f55400640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f3806be30 0x7f5f3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.053+0000 7f5f55400640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f3806be30 0x7f5f3806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f44034000 tx=0x7f5f4402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.057+0000 7f5f4e000640 1 -- 172.21.15.7:0/366302940 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5f48059840 con 0x7f5f580d2af0 2024-08-19T00:39:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.278+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f580d50d0 con 0x7f5f580d2af0 2024-08-19T00:39:18.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.278+0000 7f5f4e000640 1 -- 172.21.15.7:0/366302940 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5214 (secure 0 0 0) 0x7f5f48059140 con 0x7f5f580d2af0 2024-08-19T00:39:18.281 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:18.281 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":34,"btime":"2024-08-19T00:39:17:860440+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:17.860420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-08-19T00:39:18.282 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 34 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f3806be30 msgr2=0x7f5f3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f3806be30 0x7f5f3806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5f44034000 tx=0x7f5f4402e000 comp rx=0 tx=0).stop 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 msgr2=0x7f5f580b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580b8cf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800e9b0 tx=0x7f5f4800ee70 comp rx=0 tx=0).stop 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 shutdown_connections 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5f3806be30 0x7f5f3806e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f5815e740 0x7f5f580cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f5815e360 0x7f5f5815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 --2- 172.21.15.7:0/366302940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f580d2af0 0x7f5f580b8cf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 >> 172.21.15.7:0/366302940 conn(0x7f5f5808dbf0 msgr2=0x7f5f580b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 shutdown_connections 2024-08-19T00:39:18.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.281+0000 7f5f57200640 1 -- 172.21.15.7:0/366302940 wait complete. 2024-08-19T00:39:18.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-08-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.457+0000 7f28e8e00640 1 Processor -- start 2024-08-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.458+0000 7f28e8e00640 1 -- start start 2024-08-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e8e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f28e4161c90 0x7f28e40cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e8e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e406e750 con 0x7f28e40d2c10 2024-08-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e8e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e40cf500 con 0x7f28e406e330 2024-08-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e8e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f28e40d0110 con 0x7f28e4161c90 2024-08-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f28e4161c90 0x7f28e40cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e2800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f28e40d2c10 0x7f28e406ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46386/0 (socket says 172.21.15.7:46386) 2024-08-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f28e4161c90 0x7f28e40cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46086/0 (socket says 172.21.15.7:46086) 2024-08-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e2800640 1 -- 172.21.15.7:0/807213788 learned_addr learned my addr 172.21.15.7:0/807213788 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e1e00640 1 -- 172.21.15.7:0/807213788 >> v1:172.21.15.162:6789/0 conn(0x7f28e406e330 legacy=0x7f28e40d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e1e00640 1 -- 172.21.15.7:0/807213788 >> v1:172.21.15.7:6789/0 conn(0x7f28e40d2c10 legacy=0x7f28e406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.460+0000 7f28e1e00640 1 -- 172.21.15.7:0/807213788 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e40cf7e0 con 0x7f28e4161c90 2024-08-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.459+0000 7f28e1400640 1 -- 172.21.15.7:0/807213788 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160718819 0 0) 0x7f28e406e750 con 0x7f28e40d2c10 2024-08-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.460+0000 7f28e1e00640 1 --2- 172.21.15.7:0/807213788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e4161c90 0x7f28e40cef00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f28d40097a0 tx=0x7f28d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f0790e99771c8d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e1400640 1 -- 172.21.15.7:0/807213788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4037070 con 0x7f28e4161c90 2024-08-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e1400640 1 -- 172.21.15.7:0/807213788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4032440 con 0x7f28e4161c90 2024-08-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e1400640 1 -- 172.21.15.7:0/807213788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4032810 con 0x7f28e4161c90 2024-08-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e8e00640 1 -- 172.21.15.7:0/807213788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e4161c90 msgr2=0x7f28e40cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e8e00640 1 --2- 172.21.15.7:0/807213788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e4161c90 0x7f28e40cef00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f28d40097a0 tx=0x7f28d402a230 comp rx=0 tx=0).stop 2024-08-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e8e00640 1 -- 172.21.15.7:0/807213788 shutdown_connections 2024-08-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e8e00640 1 --2- 172.21.15.7:0/807213788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e4161c90 0x7f28e40cef00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e8e00640 1 -- 172.21.15.7:0/807213788 >> 172.21.15.7:0/807213788 conn(0x7f28e408c000 msgr2=0x7f28e40d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e8e00640 1 -- 172.21.15.7:0/807213788 shutdown_connections 2024-08-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.461+0000 7f28e8e00640 1 -- 172.21.15.7:0/807213788 wait complete. 2024-08-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.463+0000 7f28e8e00640 1 Processor -- start 2024-08-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.463+0000 7f28e8e00640 1 -- start start 2024-08-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e406e330 0x7f28e415c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28e40d2c10 0x7f28e415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e4161c90 0x7f28e40cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e8e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4162070 con 0x7f28e406e330 2024-08-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28e40cfda0 con 0x7f28e4161c90 2024-08-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28e41621f0 con 0x7f28e40d2c10 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e406e330 0x7f28e415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e406e330 0x7f28e415c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46090/0 (socket says 172.21.15.7:46090) 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.464+0000 7f28e1e00640 1 -- 172.21.15.7:0/3830120279 learned_addr learned my addr 172.21.15.7:0/3830120279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28d9400640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28e40d2c10 0x7f28e415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e2800640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e4161c90 0x7f28e40cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e1e00640 1 -- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28e40d2c10 msgr2=0x7f28e415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28e40d2c10 0x7f28e415a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e1e00640 1 -- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e4161c90 msgr2=0x7f28e40cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e4161c90 0x7f28e40cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e1e00640 1 -- 172.21.15.7:0/3830120279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e40ccbe0 con 0x7f28e406e330 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e406e330 0x7f28e415c860 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f28d4000c00 tx=0x7f28d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28daa00640 1 -- 172.21.15.7:0/3830120279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4037040 con 0x7f28e406e330 2024-08-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28daa00640 1 -- 172.21.15.7:0/3830120279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4042070 con 0x7f28e406e330 2024-08-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e40b7760 con 0x7f28e406e330 2024-08-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.465+0000 7f28daa00640 1 -- 172.21.15.7:0/3830120279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4030a70 con 0x7f28e406e330 2024-08-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.466+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e40b7d20 con 0x7f28e406e330 2024-08-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.468+0000 7f28daa00640 1 -- 172.21.15.7:0/3830120279 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28d4030c10 con 0x7f28e406e330 2024-08-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.469+0000 7f28daa00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f28c006be30 0x7f28c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.469+0000 7f28daa00640 1 -- 172.21.15.7:0/3830120279 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f28d40ab9b0 con 0x7f28e406e330 2024-08-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.469+0000 7f28d9400640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f28c006be30 0x7f28c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.469+0000 7f28ebe87740 1 Processor -- start 2024-08-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.469+0000 7f28ebe87740 1 -- start start 2024-08-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.469+0000 7f28d9400640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f28c006be30 0x7f28c006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000f60 tx=0x7f28cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd767fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd71bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd764ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28ebe87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5583dd683de0 con 0x5583dd767bf0 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5583dd61c0e0 con 0x5583dd71ed00 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5583dd67fda0 con 0x5583dd722d10 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd767fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd767fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46096/0 (socket says 172.21.15.7:46096) 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.470+0000 7f28e1e00640 1 -- 172.21.15.7:0/3270841437 learned_addr learned my addr 172.21.15.7:0/3270841437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28d9400640 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd71bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28e2800640 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd764ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28e1e00640 1 -- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 msgr2=0x5583dd764ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd764ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28e1e00640 1 -- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 msgr2=0x5583dd71bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd71bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28e1e00640 1 -- 172.21.15.7:0/3270841437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583dd4617d0 con 0x5583dd767bf0 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd767fd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f28d40798f0 tx=0x7f28d4079af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e7d8ad30e779cd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28d2a00640 1 -- 172.21.15.7:0/3270841437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d407a2f0 con 0x5583dd767bf0 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28d2a00640 1 -- 172.21.15.7:0/3270841437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4079bf0 con 0x5583dd767bf0 2024-08-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.471+0000 7f28d2a00640 1 -- 172.21.15.7:0/3270841437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d407dfa0 con 0x5583dd767bf0 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 -- 172.21.15.7:0/3270841437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 msgr2=0x5583dd767fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd767fd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f28d40798f0 tx=0x7f28d4079af0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 -- 172.21.15.7:0/3270841437 shutdown_connections 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd764ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd71bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3270841437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd767fd0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 -- 172.21.15.7:0/3270841437 >> 172.21.15.7:0/3270841437 conn(0x5583dd6e7ff0 msgr2=0x5583dd766250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 -- 172.21.15.7:0/3270841437 shutdown_connections 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.472+0000 7f28ebe87740 1 -- 172.21.15.7:0/3270841437 wait complete. 2024-08-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.473+0000 7f28ebe87740 1 -- start start 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.473+0000 7f28ebe87740 1 Processor -- start 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd71ed00 0x5583dd74aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd73ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28ebe87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5583dd764040 con 0x5583dd767bf0 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5583dd63f180 con 0x5583dd722d10 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5583dd749050 con 0x5583dd71ed00 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28ebe87740 10 client.0 _ll_register_callbacks cb 0x5583dd62b4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28e2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd73ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28e2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd73ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46106/0 (socket says 172.21.15.7:46106) 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28e2800640 1 -- 172.21.15.7:0/2737560544 learned_addr learned my addr 172.21.15.7:0/2737560544 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.474+0000 7f28d9400640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e1e00640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd71ed00 0x5583dd74aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e2800640 1 -- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd71ed00 msgr2=0x5583dd74aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e2800640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd71ed00 0x5583dd74aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e2800640 1 -- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 msgr2=0x5583dd7606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e2800640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e2800640 1 -- 172.21.15.7:0/2737560544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583dd3973f0 con 0x5583dd767bf0 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e1e00640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd71ed00 0x5583dd74aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28e2800640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd73ca90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f28dc007920 tx=0x7f28dc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65aba3e638d8cd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28c7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28c7400640 1 -- 172.21.15.7:0/2737560544 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc013570 con 0x5583dd767bf0 2024-08-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28c7400640 1 -- 172.21.15.7:0/2737560544 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f28dc013710 con 0x5583dd767bf0 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28d4079bf0 con 0x5583dd767bf0 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.475+0000 7f28c7400640 1 -- 172.21.15.7:0/2737560544 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f28dc021050 con 0x5583dd767bf0 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 10 client.5583 fetch_fsmap learned FSMap version 34 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5583dd3570f0 con 0x5583dd767bf0 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28c7400640 1 -- 172.21.15.7:0/2737560544 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4079bf0 con 0x5583dd767bf0 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28c7400640 1 -- 172.21.15.7:0/2737560544 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f28dc024020 con 0x5583dd767bf0 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 10 client.5583 fetch_fsmap finished waiting for FSMap version 34 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 10 client.5583 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 20 client.5583 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd760be0 0x5583dd7629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 4 client.5583 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 --> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583dd691510 con 0x5583dd760be0 2024-08-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.476+0000 7f28e1e00640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd760be0 0x5583dd7629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.477+0000 7f28e1e00640 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd760be0 0x5583dd7629b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b710f02495e029e server_cookie=68efcee98c34ffe1 in_seq=0 out_seq=0 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.477+0000 7f28c7400640 10 client.5583 ms_handle_connect on v2:172.21.15.7:6835/4241307956 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28c7400640 1 -- 172.21.15.7:0/2737560544 <== mds.0 v2:172.21.15.7:6835/4241307956 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583dd691510 con 0x5583dd760be0 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28c7400640 10 client.5583 handle_command_reply: tid=0 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 client.5583 shutdown 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 msgr2=0x5583dd73ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd73ca90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f28dc007920 tx=0x7f28dc001a00 comp rx=0 tx=0).stop 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 shutdown_connections 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd760be0 0x5583dd7629b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd73ca90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 --2- 172.21.15.7:0/2737560544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd71ed00 0x5583dd74aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 >> 172.21.15.7:0/2737560544 conn(0x5583dd6e7ff0 msgr2=0x5583dd766a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28c7400640 0 client.5583 ms_handle_reset on v2:172.21.15.7:6835/4241307956 2024-08-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 shutdown_connections 2024-08-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 1 -- 172.21.15.7:0/2737560544 wait complete. 2024-08-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.478+0000 7f28ebe87740 20 client.5583 trim_cache size 0 max 16384 2024-08-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.494+0000 7f28ebe87740 1 Processor -- start 2024-08-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.494+0000 7f28ebe87740 1 -- start start 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd71ed00 0x5583dd788d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7da280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd767bf0 0x5583dd7203e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28ebe87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f28e42008b0 con 0x5583dd71ed00 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ff930 con 0x5583dd722d10 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28e41feed0 con 0x5583dd767bf0 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd71ed00 0x5583dd788d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd71ed00 0x5583dd788d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46112/0 (socket says 172.21.15.7:46112) 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 -- 172.21.15.7:0/1172664512 learned_addr learned my addr 172.21.15.7:0/1172664512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28d9400640 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7da280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e2800640 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd767bf0 0x5583dd7203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 -- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd767bf0 msgr2=0x5583dd7203e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd767bf0 0x5583dd7203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 -- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 msgr2=0x5583dd7da280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7da280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.495+0000 7f28e1e00640 1 -- 172.21.15.7:0/1172664512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583dd760a10 con 0x5583dd71ed00 2024-08-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28e1e00640 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd71ed00 0x5583dd788d20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f28d40798f0 tx=0x7f28d4090000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233e316403411a5b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28d2000640 1 -- 172.21.15.7:0/1172664512 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d407dfa0 con 0x5583dd71ed00 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28d2000640 1 -- 172.21.15.7:0/1172664512 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4091e50 con 0x5583dd71ed00 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28d2000640 1 -- 172.21.15.7:0/1172664512 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4079bf0 con 0x5583dd71ed00 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 -- 172.21.15.7:0/1172664512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd71ed00 msgr2=0x5583dd788d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd71ed00 0x5583dd788d20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f28d40798f0 tx=0x7f28d4090000 comp rx=0 tx=0).stop 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 -- 172.21.15.7:0/1172664512 shutdown_connections 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd767bf0 0x5583dd7203e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd722d10 0x5583dd7da280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 --2- 172.21.15.7:0/1172664512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd71ed00 0x5583dd788d20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 -- 172.21.15.7:0/1172664512 >> 172.21.15.7:0/1172664512 conn(0x5583dd6e7ff0 msgr2=0x5583dd7629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 -- 172.21.15.7:0/1172664512 shutdown_connections 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.496+0000 7f28ebe87740 1 -- 172.21.15.7:0/1172664512 wait complete. 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.497+0000 7f28ebe87740 1 -- start start 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.497+0000 7f28ebe87740 1 Processor -- start 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd777f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd7c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28ebe87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd75c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28ebe87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5583dd71d0d0 con 0x5583dd767bf0 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ff370 con 0x5583dd71ed00 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28ebe87740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5583dd75e2f0 con 0x5583dd722d10 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28ebe87740 10 client.0 _ll_register_callbacks cb 0x7f28dc005c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28e2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd75c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd777f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.498+0000 7f28d9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd7c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd777f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:48416/0 (socket says 172.21.15.7:48416) 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e1e00640 1 -- 172.21.15.7:0/3995153211 learned_addr learned my addr 172.21.15.7:0/3995153211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e2800640 1 -- 172.21.15.7:0/3995153211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 msgr2=0x5583dd7c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e2800640 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd7c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e2800640 1 -- 172.21.15.7:0/3995153211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 msgr2=0x5583dd777f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e2800640 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd777f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e2800640 1 -- 172.21.15.7:0/3995153211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583dd778ea0 con 0x5583dd767bf0 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd777f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28e2800640 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd75c2e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x5583dd62b4b0 tx=0x7f28dc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526222b788234aa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28c7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28c7400640 1 -- 172.21.15.7:0/3995153211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc013800 con 0x5583dd767bf0 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28c7400640 1 -- 172.21.15.7:0/3995153211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f28dc004b60 con 0x5583dd767bf0 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.499+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28d4091e50 con 0x5583dd767bf0 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28c7400640 1 -- 172.21.15.7:0/3995153211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f28dc004d60 con 0x5583dd767bf0 2024-08-19T00:39:18.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 10 client.5589 fetch_fsmap learned FSMap version 34 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5583dd7c3410 con 0x5583dd767bf0 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28c7400640 1 -- 172.21.15.7:0/3995153211 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d4091e50 con 0x5583dd767bf0 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28c7400640 1 -- 172.21.15.7:0/3995153211 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f28dc024070 con 0x5583dd767bf0 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 10 client.5589 fetch_fsmap finished waiting for FSMap version 34 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 10 client.5589 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 20 client.5589 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd7c39c0 0x5583dd75c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 4 client.5589 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 --> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583dd68b860 con 0x5583dd7c39c0 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.500+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd7c39c0 0x5583dd75c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28e1e00640 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd7c39c0 0x5583dd75c820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cb76867a772cbc4 server_cookie=8c4b65c722e29bf9 in_seq=0 out_seq=0 2024-08-19T00:39:18.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28c7400640 10 client.5589 ms_handle_connect on v2:172.21.15.7:6835/4241307956 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28c7400640 1 -- 172.21.15.7:0/3995153211 <== mds.0 v2:172.21.15.7:6835/4241307956 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583dd68b860 con 0x5583dd7c39c0 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28c7400640 10 client.5589 handle_command_reply: tid=0 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 client.5589 shutdown 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 msgr2=0x5583dd75c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd75c2e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x5583dd62b4b0 tx=0x7f28dc001250 comp rx=0 tx=0).stop 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 shutdown_connections 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:6835/4241307956,v1:172.21.15.7:6837/4241307956] conn(0x5583dd7c39c0 0x5583dd75c820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dd767bf0 0x5583dd75c2e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5583dd722d10 0x5583dd7c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 --2- 172.21.15.7:0/3995153211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5583dd71ed00 0x5583dd777f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28c7400640 0 client.5589 ms_handle_reset on v2:172.21.15.7:6835/4241307956 2024-08-19T00:39:18.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.501+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 >> 172.21.15.7:0/3995153211 conn(0x5583dd6e7ff0 msgr2=0x5583dd74ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 shutdown_connections 2024-08-19T00:39:18.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28ebe87740 1 -- 172.21.15.7:0/3995153211 wait complete. 2024-08-19T00:39:18.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28ebe87740 20 client.5589 trim_cache size 0 max 16384 2024-08-19T00:39:18.511 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:39:18.511 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-08-19T00:39:18.511 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-08-19T00:39:18.511 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:39:18.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f28c006be30 msgr2=0x7f28c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f28c006be30 0x7f28c006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000f60 tx=0x7f28cc009040 comp rx=0 tx=0).stop 2024-08-19T00:39:18.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e406e330 msgr2=0x7f28e415c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e406e330 0x7f28e415c860 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f28d4000c00 tx=0x7f28d40046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 shutdown_connections 2024-08-19T00:39:18.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f28c006be30 0x7f28c006e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e4161c90 0x7f28e40cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28e40d2c10 0x7f28e415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 --2- 172.21.15.7:0/3830120279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e406e330 0x7f28e415c860 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.502+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 >> 172.21.15.7:0/3830120279 conn(0x7f28e408c000 msgr2=0x7f28e406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.503+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 shutdown_connections 2024-08-19T00:39:18.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.503+0000 7f28e8e00640 1 -- 172.21.15.7:0/3830120279 wait complete. 2024-08-19T00:39:18.521 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.675+0000 7f4dd8600640 1 Processor -- start 2024-08-19T00:39:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.675+0000 7f4dd8600640 1 -- start start 2024-08-19T00:39:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd8600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd8600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4dd009b730 0x7f4dd006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd8600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd009b390 con 0x7f4dd0161f20 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd8600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd015ec30 con 0x7f4dd009b730 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd8600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd015ef10 con 0x7f4dd009aa70 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd5200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4dd009b730 0x7f4dd006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd5200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4dd009b730 0x7f4dd006fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46130/0 (socket says 172.21.15.7:46130) 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd5200640 1 -- 172.21.15.7:0/2550418845 learned_addr learned my addr 172.21.15.7:0/2550418845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.676+0000 7f4dd5c00640 1 --2- 172.21.15.7:0/2550418845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.677+0000 7f4dd5200640 1 -- 172.21.15.7:0/2550418845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 msgr2=0x7f4dd009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.677+0000 7f4dd5200640 1 --2- 172.21.15.7:0/2550418845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd009ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.677+0000 7f4dd5200640 1 -- 172.21.15.7:0/2550418845 >> v1:172.21.15.162:6789/0 conn(0x7f4dd0161f20 legacy=0x7f4dd01623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.677+0000 7f4dd5200640 1 -- 172.21.15.7:0/2550418845 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd015f1f0 con 0x7f4dd009b730 2024-08-19T00:39:18.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.678+0000 7f4dd5200640 1 --2- 172.21.15.7:0/2550418845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd006fc30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0098a0 tx=0x7f4dbc02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d542594499b6f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.678+0000 7f4dcfe00640 1 -- 172.21.15.7:0/2550418845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc037070 con 0x7f4dd009b730 2024-08-19T00:39:18.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.678+0000 7f4dcfe00640 1 -- 172.21.15.7:0/2550418845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc032440 con 0x7f4dd009b730 2024-08-19T00:39:18.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.678+0000 7f4dcfe00640 1 -- 172.21.15.7:0/2550418845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc032810 con 0x7f4dd009b730 2024-08-19T00:39:18.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.678+0000 7f4dd8600640 1 -- 172.21.15.7:0/2550418845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 msgr2=0x7f4dd006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.678+0000 7f4dd8600640 1 --2- 172.21.15.7:0/2550418845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd006fc30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0098a0 tx=0x7f4dbc02a290 comp rx=0 tx=0).stop 2024-08-19T00:39:18.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.679+0000 7f4dd8600640 1 -- 172.21.15.7:0/2550418845 shutdown_connections 2024-08-19T00:39:18.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.679+0000 7f4dd8600640 1 --2- 172.21.15.7:0/2550418845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd006fc30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.679+0000 7f4dd8600640 1 --2- 172.21.15.7:0/2550418845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.679+0000 7f4dd8600640 1 -- 172.21.15.7:0/2550418845 >> 172.21.15.7:0/2550418845 conn(0x7f4dd00d2190 msgr2=0x7f4dd00d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.679+0000 7f4dd8600640 1 -- 172.21.15.7:0/2550418845 shutdown_connections 2024-08-19T00:39:18.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.679+0000 7f4dd8600640 1 -- 172.21.15.7:0/2550418845 wait complete. 2024-08-19T00:39:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.680+0000 7f4dd8600640 1 Processor -- start 2024-08-19T00:39:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.680+0000 7f4dd8600640 1 -- start start 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd8600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd8600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd00cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd8600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd0161f20 0x7f4dd00cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd8600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd015e8f0 con 0x7f4dd009b730 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd8600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd0070170 con 0x7f4dd0161f20 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd8600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd0162ae0 con 0x7f4dd009aa70 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd00cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd00cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46142/0 (socket says 172.21.15.7:46142) 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.681+0000 7f4dd5200640 1 -- 172.21.15.7:0/3285725143 learned_addr learned my addr 172.21.15.7:0/3285725143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd5c00640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd6600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd0161f20 0x7f4dd00cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd5200640 1 -- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 msgr2=0x7f4dd014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd5200640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd014e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd5200640 1 -- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd0161f20 msgr2=0x7f4dd00cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd5200640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd0161f20 0x7f4dd00cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd5200640 1 -- 172.21.15.7:0/3285725143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd0160520 con 0x7f4dd009b730 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd6600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd0161f20 0x7f4dd00cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dd5200640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd00cc8c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000c00 tx=0x7f4dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.682+0000 7f4dcd600640 1 -- 172.21.15.7:0/3285725143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc037040 con 0x7f4dd009b730 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.683+0000 7f4dcd600640 1 -- 172.21.15.7:0/3285725143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc0304c0 con 0x7f4dd009b730 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.683+0000 7f4dcd600640 1 -- 172.21.15.7:0/3285725143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0308b0 con 0x7f4dd009b730 2024-08-19T00:39:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.683+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd0160800 con 0x7f4dd009b730 2024-08-19T00:39:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.683+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd0160dc0 con 0x7f4dd009b730 2024-08-19T00:39:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.684+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd009ae50 con 0x7f4dd009b730 2024-08-19T00:39:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.685+0000 7f4dcd600640 1 -- 172.21.15.7:0/3285725143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4dbc044020 con 0x7f4dd009b730 2024-08-19T00:39:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.686+0000 7f4dcd600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4db006be30 0x7f4db006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.686+0000 7f4dcd600640 1 -- 172.21.15.7:0/3285725143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f4dbc0aaf30 con 0x7f4dd009b730 2024-08-19T00:39:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.686+0000 7f4dd5c00640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4db006be30 0x7f4db006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.687+0000 7f4dd5c00640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4db006be30 0x7f4db006e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.690+0000 7f4dcd600640 1 -- 172.21.15.7:0/3285725143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4dbc04b020 con 0x7f4dd009b730 2024-08-19T00:39:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.909+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dd00d2cb0 con 0x7f4dd009b730 2024-08-19T00:39:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.910+0000 7f4dcd600640 1 -- 172.21.15.7:0/3285725143 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5217 (secure 0 0 0) 0x7f4dbc079880 con 0x7f4dd009b730 2024-08-19T00:39:18.913 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:18.913 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":35,"btime":"2024-08-19T00:39:18:862045+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:17.872379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-08-19T00:39:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 35 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4db006be30 msgr2=0x7f4db006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4db006be30 0x7f4db006e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4008040 comp rx=0 tx=0).stop 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 msgr2=0x7f4dd00cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd00cc8c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000c00 tx=0x7f4dbc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 shutdown_connections 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4db006be30 0x7f4db006e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd0161f20 0x7f4dd00cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd009b730 0x7f4dd00cc8c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 --2- 172.21.15.7:0/3285725143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd009aa70 0x7f4dd014e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 >> 172.21.15.7:0/3285725143 conn(0x7f4dd00d2190 msgr2=0x7f4dd006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 shutdown_connections 2024-08-19T00:39:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:18.912+0000 7f4dd8600640 1 -- 172.21.15.7:0/3285725143 wait complete. 2024-08-19T00:39:18.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.084+0000 7f4981e00640 1 Processor -- start 2024-08-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.084+0000 7f4981e00640 1 -- start start 2024-08-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.085+0000 7f4981e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f497c15e360 0x7f497c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.085+0000 7f4981e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15ee50 0x7f497c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.085+0000 7f4981e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c0b3ab0 con 0x7f497c0d2af0 2024-08-19T00:39:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.085+0000 7f4981e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f497c15f460 con 0x7f497c15e360 2024-08-19T00:39:19.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.085+0000 7f4981e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f497c15f740 con 0x7f497c15ee50 2024-08-19T00:39:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.085+0000 7f4981400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15ee50 0x7f497c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4981400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15ee50 0x7f497c0d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52900/0 (socket says 172.21.15.7:52900) 2024-08-19T00:39:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4980a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f497c15e360 0x7f497c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4981400640 1 -- 172.21.15.7:0/1669222432 learned_addr learned my addr 172.21.15.7:0/1669222432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:19.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f497be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f497c0d2af0 0x7f497c15e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:42338/0 (socket says 172.21.15.7:42338) 2024-08-19T00:39:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4980a00640 1 -- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15ee50 msgr2=0x7f497c0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4980a00640 1 --2- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15ee50 0x7f497c0d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4980a00640 1 -- 172.21.15.7:0/1669222432 >> v1:172.21.15.162:6789/0 conn(0x7f497c0d2af0 legacy=0x7f497c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f497b400640 1 -- 172.21.15.7:0/1669222432 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787009064 0 0) 0x7f497c0b3ab0 con 0x7f497c0d2af0 2024-08-19T00:39:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4980a00640 1 -- 172.21.15.7:0/1669222432 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c0b3d60 con 0x7f497c15e360 2024-08-19T00:39:19.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.086+0000 7f4981400640 1 --2- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15ee50 0x7f497c0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.087+0000 7f4980a00640 1 --2- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15e360 0x7f497c15fab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49700097a0 tx=0x7f497002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b6952549193ca2a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f497b400640 1 -- 172.21.15.7:0/1669222432 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970037070 con 0x7f497c15e360 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f497b400640 1 -- 172.21.15.7:0/1669222432 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970032440 con 0x7f497c15e360 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f497b400640 1 -- 172.21.15.7:0/1669222432 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970032810 con 0x7f497c15e360 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f4981e00640 1 -- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15e360 msgr2=0x7f497c15fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f4981e00640 1 --2- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15e360 0x7f497c15fab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49700097a0 tx=0x7f497002a180 comp rx=0 tx=0).stop 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f4981e00640 1 -- 172.21.15.7:0/1669222432 shutdown_connections 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f4981e00640 1 --2- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15ee50 0x7f497c0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f4981e00640 1 --2- 172.21.15.7:0/1669222432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15e360 0x7f497c15fab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f4981e00640 1 -- 172.21.15.7:0/1669222432 >> 172.21.15.7:0/1669222432 conn(0x7f497c08dbf0 msgr2=0x7f497c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.088+0000 7f4981e00640 1 -- 172.21.15.7:0/1669222432 shutdown_connections 2024-08-19T00:39:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.089+0000 7f4981e00640 1 -- 172.21.15.7:0/1669222432 wait complete. 2024-08-19T00:39:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.090+0000 7f4981e00640 1 Processor -- start 2024-08-19T00:39:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.090+0000 7f4981e00640 1 -- start start 2024-08-19T00:39:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4981e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497c0d2af0 0x7f497c1f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4981e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15e360 0x7f497c0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4981e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15ee50 0x7f497c1f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4981e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0b4560 con 0x7f497c0d2af0 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4981e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0d2300 con 0x7f497c15ee50 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4981e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f497c0b46e0 con 0x7f497c15e360 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4980a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497c0d2af0 0x7f497c1f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4980a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497c0d2af0 0x7f497c1f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46144/0 (socket says 172.21.15.7:46144) 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.091+0000 7f4980a00640 1 -- 172.21.15.7:0/2603731820 learned_addr learned my addr 172.21.15.7:0/2603731820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4981400640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15ee50 0x7f497c1f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f497be00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15e360 0x7f497c0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4980a00640 1 -- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15e360 msgr2=0x7f497c0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4980a00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15e360 0x7f497c0cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4980a00640 1 -- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15ee50 msgr2=0x7f497c1f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4980a00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15ee50 0x7f497c1f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4980a00640 1 -- 172.21.15.7:0/2603731820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c0d0300 con 0x7f497c0d2af0 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f497be00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15e360 0x7f497c0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4980a00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497c0d2af0 0x7f497c1f4140 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f49700097a0 tx=0x7f49700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4978c00640 1 -- 172.21.15.7:0/2603731820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970037050 con 0x7f497c0d2af0 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4978c00640 1 -- 172.21.15.7:0/2603731820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970038040 con 0x7f497c0d2af0 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.092+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c0d05a0 con 0x7f497c0d2af0 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.093+0000 7f4978c00640 1 -- 172.21.15.7:0/2603731820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970004490 con 0x7f497c0d2af0 2024-08-19T00:39:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.093+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c0d0b60 con 0x7f497c0d2af0 2024-08-19T00:39:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.094+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c15fab0 con 0x7f497c0d2af0 2024-08-19T00:39:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.095+0000 7f4978c00640 1 -- 172.21.15.7:0/2603731820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f497003c6d0 con 0x7f497c0d2af0 2024-08-19T00:39:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.095+0000 7f4978c00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f495c06be30 0x7f495c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.096+0000 7f4978c00640 1 -- 172.21.15.7:0/2603731820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f49700ab7f0 con 0x7f497c0d2af0 2024-08-19T00:39:19.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.096+0000 7f497be00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f495c06be30 0x7f495c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.096+0000 7f497be00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f495c06be30 0x7f495c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4968000f60 tx=0x7f4968007c30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:19.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.100+0000 7f4978c00640 1 -- 172.21.15.7:0/2603731820 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f497007a1d0 con 0x7f497c0d2af0 2024-08-19T00:39:19.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.324+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f497c0d50d0 con 0x7f497c0d2af0 2024-08-19T00:39:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.324+0000 7f4978c00640 1 -- 172.21.15.7:0/2603731820 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5217 (secure 0 0 0) 0x7f4970079ad0 con 0x7f497c0d2af0 2024-08-19T00:39:19.328 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:19.328 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":35,"btime":"2024-08-19T00:39:18:862045+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:17.872379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-08-19T00:39:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 35 2024-08-19T00:39:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f495c06be30 msgr2=0x7f495c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f495c06be30 0x7f495c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4968000f60 tx=0x7f4968007c30 comp rx=0 tx=0).stop 2024-08-19T00:39:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497c0d2af0 msgr2=0x7f497c1f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497c0d2af0 0x7f497c1f4140 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f49700097a0 tx=0x7f49700046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 shutdown_connections 2024-08-19T00:39:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f495c06be30 0x7f495c06e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497c15ee50 0x7f497c1f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497c15e360 0x7f497c0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 --2- 172.21.15.7:0/2603731820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497c0d2af0 0x7f497c1f4140 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 >> 172.21.15.7:0/2603731820 conn(0x7f497c08dbf0 msgr2=0x7f497c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:19.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 shutdown_connections 2024-08-19T00:39:19.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.327+0000 7f4981e00640 1 -- 172.21.15.7:0/2603731820 wait complete. 2024-08-19T00:39:19.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.502+0000 7f14e5200640 1 Processor -- start 2024-08-19T00:39:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.502+0000 7f14e5200640 1 -- start start 2024-08-19T00:39:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.503+0000 7f14e5200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f14e00d3200 0x7f14e015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.503+0000 7f14e5200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e00b3ab0 con 0x7f14e015e360 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.503+0000 7f14e5200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e015f460 con 0x7f14e015e740 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.503+0000 7f14e5200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f14e015f740 con 0x7f14e00d3200 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.503+0000 7f14df400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14e015e360 0x7f14e00d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46392/0 (socket says 172.21.15.7:46392) 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.503+0000 7f14df400640 1 -- 172.21.15.7:0/2232721944 learned_addr learned my addr 172.21.15.7:0/2232721944 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.503+0000 7f14dea00640 1 --2- 172.21.15.7:0/2232721944 >> v2:172.21.15.7:3300/0 conn(0x7f14e00d3200 0x7f14e015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.504+0000 7f14de000640 1 -- 172.21.15.7:0/2232721944 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133851793 0 0) 0x7f14e00b3ab0 con 0x7f14e015e360 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.504+0000 7f14de000640 1 -- 172.21.15.7:0/2232721944 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14c4003520 con 0x7f14e015e360 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.504+0000 7f14dea00640 1 -- 172.21.15.7:0/2232721944 >> v1:172.21.15.162:6789/0 conn(0x7f14e015e740 legacy=0x7f14e015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.504+0000 7f14dea00640 1 -- 172.21.15.7:0/2232721944 >> v1:172.21.15.7:6789/0 conn(0x7f14e015e360 legacy=0x7f14e00d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.504+0000 7f14dea00640 1 -- 172.21.15.7:0/2232721944 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e00b3d60 con 0x7f14e00d3200 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.505+0000 7f14dea00640 1 --2- 172.21.15.7:0/2232721944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e00d3200 0x7f14e015fab0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0097a0 tx=0x7f14cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720653f732cd679a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.505+0000 7f14de000640 1 -- 172.21.15.7:0/2232721944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc037070 con 0x7f14e00d3200 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.505+0000 7f14de000640 1 -- 172.21.15.7:0/2232721944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14cc032440 con 0x7f14e00d3200 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.505+0000 7f14de000640 1 -- 172.21.15.7:0/2232721944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc032810 con 0x7f14e00d3200 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.506+0000 7f14e5200640 1 -- 172.21.15.7:0/2232721944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e00d3200 msgr2=0x7f14e015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.506+0000 7f14e5200640 1 --2- 172.21.15.7:0/2232721944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e00d3200 0x7f14e015fab0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0097a0 tx=0x7f14cc02a230 comp rx=0 tx=0).stop 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.506+0000 7f14e5200640 1 -- 172.21.15.7:0/2232721944 shutdown_connections 2024-08-19T00:39:19.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.506+0000 7f14e5200640 1 --2- 172.21.15.7:0/2232721944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e00d3200 0x7f14e015fab0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.506+0000 7f14e5200640 1 -- 172.21.15.7:0/2232721944 >> 172.21.15.7:0/2232721944 conn(0x7f14e008dbf0 msgr2=0x7f14e009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:19.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.506+0000 7f14e5200640 1 -- 172.21.15.7:0/2232721944 shutdown_connections 2024-08-19T00:39:19.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.506+0000 7f14e5200640 1 -- 172.21.15.7:0/2232721944 wait complete. 2024-08-19T00:39:19.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.507+0000 7f14e5200640 1 Processor -- start 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.508+0000 7f14e5200640 1 -- start start 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.508+0000 7f14e5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e00d3200 0x7f14e0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.508+0000 7f14e5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e015e360 0x7f14e00cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.508+0000 7f14e5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e015e740 0x7f14e0156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.508+0000 7f14e5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14e00b4560 con 0x7f14e015e360 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.508+0000 7f14e5200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14e00d2300 con 0x7f14e015e740 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.508+0000 7f14e5200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14e00b46e0 con 0x7f14e00d3200 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e015e360 0x7f14e00cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e015e360 0x7f14e00cfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46160/0 (socket says 172.21.15.7:46160) 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 -- 172.21.15.7:0/3294156387 learned_addr learned my addr 172.21.15.7:0/3294156387 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14df400640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e00d3200 0x7f14e0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dfe00640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e015e740 0x7f14e0156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 -- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e00d3200 msgr2=0x7f14e0156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e00d3200 0x7f14e0156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 -- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e015e740 msgr2=0x7f14e0156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e015e740 0x7f14e0156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 -- 172.21.15.7:0/3294156387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e0156eb0 con 0x7f14e015e360 2024-08-19T00:39:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14df400640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e00d3200 0x7f14e0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.509+0000 7f14dea00640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e015e360 0x7f14e00cfa50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f14cc035040 tx=0x7f14cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.510+0000 7f14d7400640 1 -- 172.21.15.7:0/3294156387 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc037040 con 0x7f14e015e360 2024-08-19T00:39:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.510+0000 7f14d7400640 1 -- 172.21.15.7:0/3294156387 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14cc030500 con 0x7f14e015e360 2024-08-19T00:39:19.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.510+0000 7f14d7400640 1 -- 172.21.15.7:0/3294156387 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0308d0 con 0x7f14e015e360 2024-08-19T00:39:19.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.510+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e00d0a30 con 0x7f14e015e360 2024-08-19T00:39:19.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.510+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e00cf250 con 0x7f14e015e360 2024-08-19T00:39:19.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.511+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e015fab0 con 0x7f14e015e360 2024-08-19T00:39:19.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.512+0000 7f14d7400640 1 -- 172.21.15.7:0/3294156387 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14cc044020 con 0x7f14e015e360 2024-08-19T00:39:19.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.513+0000 7f14d7400640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c006be30 0x7f14c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:19.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.513+0000 7f14d7400640 1 -- 172.21.15.7:0/3294156387 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f14cc0ab1b0 con 0x7f14e015e360 2024-08-19T00:39:19.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.513+0000 7f14df400640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c006be30 0x7f14c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:19.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.514+0000 7f14df400640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c006be30 0x7f14c006e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f14d00011e0 tx=0x7f14d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:19.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.517+0000 7f14d7400640 1 -- 172.21.15.7:0/3294156387 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f14cc079a60 con 0x7f14e015e360 2024-08-19T00:39:19.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.737+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14e00d50d0 con 0x7f14e015e360 2024-08-19T00:39:19.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.738+0000 7f14d7400640 1 -- 172.21.15.7:0/3294156387 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5217 (secure 0 0 0) 0x7f14cc079360 con 0x7f14e015e360 2024-08-19T00:39:19.741 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:19.741 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":35,"btime":"2024-08-19T00:39:18:862045+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:17.872379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-08-19T00:39:19.741 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 35 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c006be30 msgr2=0x7f14c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c006be30 0x7f14c006e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f14d00011e0 tx=0x7f14d0009040 comp rx=0 tx=0).stop 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e015e360 msgr2=0x7f14e00cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e015e360 0x7f14e00cfa50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f14cc035040 tx=0x7f14cc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 shutdown_connections 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14c006be30 0x7f14c006e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14e015e740 0x7f14e0156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14e015e360 0x7f14e00cfa50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 --2- 172.21.15.7:0/3294156387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14e00d3200 0x7f14e0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 >> 172.21.15.7:0/3294156387 conn(0x7f14e008dbf0 msgr2=0x7f14e015d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 shutdown_connections 2024-08-19T00:39:19.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:19.740+0000 7f14e5200640 1 -- 172.21.15.7:0/3294156387 wait complete. 2024-08-19T00:39:19.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /a 0 2024-08-19T00:39:19.937 INFO:teuthology.orchestra.run.smithi007.stdout:[{"ino":1099511627776,"rdev":0,"ctime":"2024-08-19T00:39:13.821811+0000","btime":"2024-08-19T00:39:07.712902+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-19T00:39:13.821811+0000","atime":"2024-08-19T00:39:07.712902+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-19T00:39:13.821811+0000","num_files":0,"num_subdirs":1,"change_attr":3},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-08-19T00:39:13.821811+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2024-08-19T00:39:13.821811+0000"},"version":9,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirtyscattered":1,"dirfrag":1,"dirty":1},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/a","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"7","version":"7","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1},"nref":1,"dentries":[{"path":"a/c","alternate_name":"","path_ino":1,"snap_first":18446744073709551606,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627777,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"inodepin":1,"dirty":1},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"a/b","alternate_name":"","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":5,"projected_version":5,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirty":1},"nref":1,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-08-19T00:39:19.937 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2024-08-19T00:39:13.821811+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2024-08-19T00:39:07.712902+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-19T00:39:07.712902+0000", "change_attr": 3, "client_caps": [], "client_ranges": [], "ctime": "2024-08-19T00:39:13.821811+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "a/c", "path_ino": 1, "pins": { "dirty": 1, "inodepin": 1 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 18446744073709551606, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": {}, "nref": 1, "path": "a/b", "path_ino": 1, "pins": { "dirty": 1 }, "projected_version": 5, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 5, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/a", "pins": { "child": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2024-08-19T00:39:13.821811+0000", "num_files": 0, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-08-19T00:39:13.821811+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "dirfrag": 1, "dirty": 1, "dirtyscattered": 1 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-08-19T00:39:13.821811+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 9, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-08-19T00:39:19.938 DEBUG:tasks.cephfs.test_damage:[{'ino': 1099511627776, 'rdev': 0, 'ctime': '2024-08-19T00:39:13.821811+0000', 'btime': '2024-08-19T00:39:07.712902+0000', 'mode': 16877, 'uid': 1000, 'gid': 1333, 'nlink': 1, 'dir_layout': {'dir_hash': 2, 'unused1': 0, 'unused2': 0, 'unused3': 0}, 'layout': {'stripe_unit': 0, 'stripe_count': 0, 'object_size': 0, 'pool_id': -1, 'pool_ns': ''}, 'old_pools': [], 'size': 0, 'truncate_seq': 1, 'truncate_size': 18446744073709551615, 'truncate_from': 0, 'truncate_pending': 0, 'mtime': '2024-08-19T00:39:13.821811+0000', 'atime': '2024-08-19T00:39:07.712902+0000', 'time_warp_seq': 0, 'change_attr': 3, 'export_pin': -1, 'export_ephemeral_random_pin': 0, 'export_ephemeral_distributed_pin': False, 'quiesce_block': False, 'client_ranges': [], 'dirstat': {'version': 0, 'mtime': '2024-08-19T00:39:13.821811+0000', 'num_files': 0, 'num_subdirs': 1, 'change_attr': 3}, 'rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-08-19T00:39:13.821811+0000'}, 'accounted_rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2024-08-19T00:39:13.821811+0000'}, 'version': 9, 'file_data_version': 0, 'xattr_version': 1, 'backtrace_version': 2, 'stray_prior_path': '', 'max_size_ever': 0, 'quota': {'max_bytes': 0, 'max_files': 0}, 'last_scrub_stamp': '0.000000', 'last_scrub_version': 0, 'symlink': '', 'xattrs': [{'key': 'security.selinux', 'val': 'unconfined_u:object_r:unlabeled_t:s0\x00'}], 'dirfragtree': {'splits': []}, 'old_inodes': [], 'oldest_snap': 18446744073709551614, 'damage_flags': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'dirtyscattered': 1, 'dirfrag': 1, 'dirty': 1}, 'nref': 3, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'iversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'authlock': {}, 'linklock': {}, 'dirfragtreelock': {}, 'filelock': {}, 'xattrlock': {}, 'snaplock': {}, 'nestlock': {'gather_set': [], 'state': 'lock', 'type': 'inest', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'flocklock': {}, 'policylock': {}, 'quiescelock': {'gather_set': [], 'state': 'lock', 'type': 'iquiesce', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty'], 'client_caps': [], 'loner': -1, 'want_loner': -1, 'mds_caps_wanted': [], 'dirfrags': [{'path': '/a', 'dirfrag': '0x10000000000', 'snapid_first': 2, 'projected_version': '7', 'version': '7', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '', 'states': ['auth'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1}, 'nref': 1, 'dentries': [{'path': 'a/c', 'alternate_name': '', 'path_ino': 1, 'snap_first': 18446744073709551606, 'snap_last': 18446744073709551614, 'is_primary': True, 'is_remote': False, 'is_null': False, 'is_new': False, 'inode': 1099511627777, 'remote_type': '', 'version': 4, 'projected_version': 4, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'inodepin': 1, 'dirty': 1}, 'nref': 2, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}, {'path': 'a/b', 'alternate_name': '', 'path_ino': 1, 'snap_first': 2, 'snap_last': 18446744073709551614, 'is_primary': False, 'is_remote': False, 'is_null': True, 'is_new': False, 'inode': 0, 'remote_type': '', 'version': 5, 'projected_version': 5, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'dirty': 1}, 'nref': 1, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'type': 'dversion', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}]}], 'is_subvolume': False}] 2024-08-19T00:39:19.938 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:39:19.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:39:20.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:39:20.123 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:39:20.123 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:39:20.123 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:20.123 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:20.158 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:39:20.159 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:39:20.159 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:39:20.159 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:20.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:39:20.197 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:39:20.197 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:20.197 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:20.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:39:20.234 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:39:20.234 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:39:20.234 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:20.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:39:20.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.428+0000 7f2b88000640 1 Processor -- start 2024-08-19T00:39:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.428+0000 7f2b88000640 1 -- start start 2024-08-19T00:39:20.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b88000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b80159bf0 0x7f2b80073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b88000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b800cec10 0x7f2b800d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b88000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8006f7f0 con 0x7f2b800739a0 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b88000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8006f510 con 0x7f2b80159bf0 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b88000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2b80072980 con 0x7f2b800cec10 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b85600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b80159bf0 0x7f2b80073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b85600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b80159bf0 0x7f2b80073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46162/0 (socket says 172.21.15.7:46162) 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.429+0000 7f2b85600640 1 -- 172.21.15.7:0/3827592733 learned_addr learned my addr 172.21.15.7:0/3827592733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.430+0000 7f2b86000640 1 --2- 172.21.15.7:0/3827592733 >> v2:172.21.15.162:3300/0 conn(0x7f2b800cec10 0x7f2b800d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.430+0000 7f2b85600640 1 -- 172.21.15.7:0/3827592733 >> v2:172.21.15.162:3300/0 conn(0x7f2b800cec10 msgr2=0x7f2b800d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.430+0000 7f2b85600640 1 --2- 172.21.15.7:0/3827592733 >> v2:172.21.15.162:3300/0 conn(0x7f2b800cec10 0x7f2b800d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.430+0000 7f2b85600640 1 -- 172.21.15.7:0/3827592733 >> v1:172.21.15.162:6789/0 conn(0x7f2b800739a0 legacy=0x7f2b800ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.430+0000 7f2b85600640 1 -- 172.21.15.7:0/3827592733 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b80072c60 con 0x7f2b80159bf0 2024-08-19T00:39:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.431+0000 7f2b85600640 1 --2- 172.21.15.7:0/3827592733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b80159bf0 0x7f2b80073460 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2b800d0f80 tx=0x7f2b7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d5c135b9aa92e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.431+0000 7f2b7fe00640 1 -- 172.21.15.7:0/3827592733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74037070 con 0x7f2b80159bf0 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.431+0000 7f2b7fe00640 1 -- 172.21.15.7:0/3827592733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74032440 con 0x7f2b80159bf0 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.431+0000 7f2b7fe00640 1 -- 172.21.15.7:0/3827592733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74032810 con 0x7f2b80159bf0 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 -- 172.21.15.7:0/3827592733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b80159bf0 msgr2=0x7f2b80073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 --2- 172.21.15.7:0/3827592733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b80159bf0 0x7f2b80073460 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2b800d0f80 tx=0x7f2b7402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 -- 172.21.15.7:0/3827592733 shutdown_connections 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 --2- 172.21.15.7:0/3827592733 >> v2:172.21.15.162:3300/0 conn(0x7f2b800cec10 0x7f2b800d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 --2- 172.21.15.7:0/3827592733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b80159bf0 0x7f2b80073460 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 -- 172.21.15.7:0/3827592733 >> 172.21.15.7:0/3827592733 conn(0x7f2b8006bc70 msgr2=0x7f2b8006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 -- 172.21.15.7:0/3827592733 shutdown_connections 2024-08-19T00:39:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.432+0000 7f2b88000640 1 -- 172.21.15.7:0/3827592733 wait complete. 2024-08-19T00:39:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.433+0000 7f2b88000640 1 Processor -- start 2024-08-19T00:39:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.434+0000 7f2b88000640 1 -- start start 2024-08-19T00:39:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.434+0000 7f2b88000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b800739a0 0x7f2b801435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.434+0000 7f2b88000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b80159bf0 0x7f2b801f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.434+0000 7f2b88000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8009c240 0x7f2b8015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.434+0000 7f2b88000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8015a150 con 0x7f2b8009c240 2024-08-19T00:39:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.434+0000 7f2b88000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b80159fd0 con 0x7f2b800739a0 2024-08-19T00:39:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.434+0000 7f2b88000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b800d0900 con 0x7f2b80159bf0 2024-08-19T00:39:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8009c240 0x7f2b8015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8009c240 0x7f2b8015edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46168/0 (socket says 172.21.15.7:46168) 2024-08-19T00:39:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 -- 172.21.15.7:0/4162197503 learned_addr learned my addr 172.21.15.7:0/4162197503 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b84c00640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b80159bf0 0x7f2b801f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b85600640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b800739a0 0x7f2b801435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 -- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b80159bf0 msgr2=0x7f2b801f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b80159bf0 0x7f2b801f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 -- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b800739a0 msgr2=0x7f2b801435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b800739a0 0x7f2b801435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 -- 172.21.15.7:0/4162197503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b80140b60 con 0x7f2b8009c240 2024-08-19T00:39:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.435+0000 7f2b86000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8009c240 0x7f2b8015edb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800efc0 tx=0x7f2b7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.436+0000 7f2b7d600640 1 -- 172.21.15.7:0/4162197503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78018020 con 0x7f2b8009c240 2024-08-19T00:39:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.436+0000 7f2b7d600640 1 -- 172.21.15.7:0/4162197503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78014480 con 0x7f2b8009c240 2024-08-19T00:39:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.436+0000 7f2b7d600640 1 -- 172.21.15.7:0/4162197503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78014870 con 0x7f2b8009c240 2024-08-19T00:39:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.436+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b80143af0 con 0x7f2b8009c240 2024-08-19T00:39:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.436+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b801410e0 con 0x7f2b8009c240 2024-08-19T00:39:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.437+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b800d0c90 con 0x7f2b8009c240 2024-08-19T00:39:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.438+0000 7f2b7d600640 1 -- 172.21.15.7:0/4162197503 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b78005d10 con 0x7f2b8009c240 2024-08-19T00:39:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.439+0000 7f2b7d600640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6006be60 0x7f2b6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.439+0000 7f2b7d600640 1 -- 172.21.15.7:0/4162197503 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f2b7808bc50 con 0x7f2b8009c240 2024-08-19T00:39:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.439+0000 7f2b85600640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6006be60 0x7f2b6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.440+0000 7f2b85600640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6006be60 0x7f2b6006e320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b74034000 tx=0x7f2b7402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.444+0000 7f2b7d600640 1 -- 172.21.15.7:0/4162197503 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2b78022030 con 0x7f2b8009c240 2024-08-19T00:39:20.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.666+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b801604a0 con 0x7f2b8009c240 2024-08-19T00:39:20.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.667+0000 7f2b7d600640 1 -- 172.21.15.7:0/4162197503 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5214 (secure 0 0 0) 0x7f2b78010040 con 0x7f2b8009c240 2024-08-19T00:39:20.670 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:20.670 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":36,"btime":"2024-08-19T00:39:19:863832+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:18.865058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-08-19T00:39:20.670 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 36 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6006be60 msgr2=0x7f2b6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6006be60 0x7f2b6006e320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b74034000 tx=0x7f2b7402e000 comp rx=0 tx=0).stop 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8009c240 msgr2=0x7f2b8015edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8009c240 0x7f2b8015edb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800efc0 tx=0x7f2b7800c490 comp rx=0 tx=0).stop 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 shutdown_connections 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6006be60 0x7f2b6006e320 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8009c240 0x7f2b8015edb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b80159bf0 0x7f2b801f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 --2- 172.21.15.7:0/4162197503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b800739a0 0x7f2b801435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 >> 172.21.15.7:0/4162197503 conn(0x7f2b8006bc70 msgr2=0x7f2b8015b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 shutdown_connections 2024-08-19T00:39:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.669+0000 7f2b88000640 1 -- 172.21.15.7:0/4162197503 wait complete. 2024-08-19T00:39:20.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.841+0000 7f3d7c000640 1 Processor -- start 2024-08-19T00:39:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.841+0000 7f3d7c000640 1 -- start start 2024-08-19T00:39:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d7c000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3d7406c480 0x7f3d740b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d7c000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d740d0320 con 0x7f3d7406b850 2024-08-19T00:39:20.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d7c000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d740b0cf0 con 0x7f3d74161a30 2024-08-19T00:39:20.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d7c000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3d740b3cf0 con 0x7f3d7406c480 2024-08-19T00:39:20.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d7a000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3d7406b850 0x7f3d740b14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46402/0 (socket says 172.21.15.7:46402) 2024-08-19T00:39:20.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d7a000640 1 -- 172.21.15.7:0/855993770 learned_addr learned my addr 172.21.15.7:0/855993770 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:20.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d78c00640 1 --2- 172.21.15.7:0/855993770 >> v2:172.21.15.162:3300/0 conn(0x7f3d7406c480 0x7f3d740b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d73e00640 1 -- 172.21.15.7:0/855993770 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621306445 0 0) 0x7f3d740d0320 con 0x7f3d7406b850 2024-08-19T00:39:20.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.843+0000 7f3d73e00640 1 -- 172.21.15.7:0/855993770 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d5c003520 con 0x7f3d7406b850 2024-08-19T00:39:20.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.844+0000 7f3d78c00640 1 -- 172.21.15.7:0/855993770 >> v1:172.21.15.162:6789/0 conn(0x7f3d74161a30 legacy=0x7f3d740b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.844+0000 7f3d78c00640 1 -- 172.21.15.7:0/855993770 >> v1:172.21.15.7:6789/0 conn(0x7f3d7406b850 legacy=0x7f3d740b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.844+0000 7f3d78c00640 1 -- 172.21.15.7:0/855993770 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d740d05c0 con 0x7f3d7406c480 2024-08-19T00:39:20.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.845+0000 7f3d78c00640 1 --2- 172.21.15.7:0/855993770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7406c480 0x7f3d740b37b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097a0 tx=0x7f3d6002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39d6fec03c82e3c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:20.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.845+0000 7f3d73e00640 1 -- 172.21.15.7:0/855993770 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60037070 con 0x7f3d7406c480 2024-08-19T00:39:20.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.845+0000 7f3d73e00640 1 -- 172.21.15.7:0/855993770 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d60032640 con 0x7f3d7406c480 2024-08-19T00:39:20.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.845+0000 7f3d73e00640 1 -- 172.21.15.7:0/855993770 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60032a10 con 0x7f3d7406c480 2024-08-19T00:39:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.845+0000 7f3d7c000640 1 -- 172.21.15.7:0/855993770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7406c480 msgr2=0x7f3d740b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.845+0000 7f3d7c000640 1 --2- 172.21.15.7:0/855993770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7406c480 0x7f3d740b37b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097a0 tx=0x7f3d6002a2c0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.846+0000 7f3d7c000640 1 -- 172.21.15.7:0/855993770 shutdown_connections 2024-08-19T00:39:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.846+0000 7f3d7c000640 1 --2- 172.21.15.7:0/855993770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7406c480 0x7f3d740b37b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.846+0000 7f3d7c000640 1 -- 172.21.15.7:0/855993770 >> 172.21.15.7:0/855993770 conn(0x7f3d740b6840 msgr2=0x7f3d740b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.846+0000 7f3d7c000640 1 -- 172.21.15.7:0/855993770 shutdown_connections 2024-08-19T00:39:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.846+0000 7f3d7c000640 1 -- 172.21.15.7:0/855993770 wait complete. 2024-08-19T00:39:20.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.847+0000 7f3d7c000640 1 Processor -- start 2024-08-19T00:39:20.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.847+0000 7f3d7c000640 1 -- start start 2024-08-19T00:39:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.848+0000 7f3d7c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7406b850 0x7f3d74147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.848+0000 7f3d7c000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d7406c480 0x7f3d740ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.848+0000 7f3d7c000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d74161a30 0x7f3d740af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.848+0000 7f3d7c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740d0b80 con 0x7f3d7406b850 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.848+0000 7f3d7c000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740b0f90 con 0x7f3d74161a30 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.848+0000 7f3d7c000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d74161e10 con 0x7f3d7406c480 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.848+0000 7f3d79600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7406b850 0x7f3d74147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7406b850 0x7f3d74147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46174/0 (socket says 172.21.15.7:46174) 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 -- 172.21.15.7:0/1716519459 learned_addr learned my addr 172.21.15.7:0/1716519459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d78c00640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d7406c480 0x7f3d740ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d7a000640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d74161a30 0x7f3d740af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 -- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d7406c480 msgr2=0x7f3d740ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d7406c480 0x7f3d740ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 -- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d74161a30 msgr2=0x7f3d740af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d74161a30 0x7f3d740af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 -- 172.21.15.7:0/1716519459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d740cbf80 con 0x7f3d7406b850 2024-08-19T00:39:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d79600640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7406b850 0x7f3d74147470 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c3c0 tx=0x7f3d6800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.849+0000 7f3d71600640 1 -- 172.21.15.7:0/1716519459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d680052d0 con 0x7f3d7406b850 2024-08-19T00:39:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.850+0000 7f3d71600640 1 -- 172.21.15.7:0/1716519459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d68005490 con 0x7f3d7406b850 2024-08-19T00:39:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.850+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d740cb340 con 0x7f3d7406b850 2024-08-19T00:39:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.850+0000 7f3d71600640 1 -- 172.21.15.7:0/1716519459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68007260 con 0x7f3d7406b850 2024-08-19T00:39:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.850+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d740cc510 con 0x7f3d7406b850 2024-08-19T00:39:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.851+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d740b37b0 con 0x7f3d7406b850 2024-08-19T00:39:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.852+0000 7f3d71600640 1 -- 172.21.15.7:0/1716519459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d68007400 con 0x7f3d7406b850 2024-08-19T00:39:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.852+0000 7f3d71600640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be60 0x7f3d5406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.853+0000 7f3d71600640 1 -- 172.21.15.7:0/1716519459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f3d6808a2d0 con 0x7f3d7406b850 2024-08-19T00:39:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.853+0000 7f3d78c00640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be60 0x7f3d5406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.853+0000 7f3d78c00640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be60 0x7f3d5406e320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3d60034000 tx=0x7f3d6002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:20.857+0000 7f3d71600640 1 -- 172.21.15.7:0/1716519459 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3d680585c0 con 0x7f3d7406b850 2024-08-19T00:39:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.079+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d740ce2f0 con 0x7f3d7406b850 2024-08-19T00:39:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.080+0000 7f3d71600640 1 -- 172.21.15.7:0/1716519459 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5221 (secure 0 0 0) 0x7f3d6808a0d0 con 0x7f3d7406b850 2024-08-19T00:39:21.083 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:21.083 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"btime":"2024-08-19T00:39:20:869278+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:20.869272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-08-19T00:39:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 37 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be60 msgr2=0x7f3d5406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be60 0x7f3d5406e320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3d60034000 tx=0x7f3d6002e000 comp rx=0 tx=0).stop 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7406b850 msgr2=0x7f3d74147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7406b850 0x7f3d74147470 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c3c0 tx=0x7f3d6800c880 comp rx=0 tx=0).stop 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 shutdown_connections 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be60 0x7f3d5406e320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d74161a30 0x7f3d740af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d7406c480 0x7f3d740ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 --2- 172.21.15.7:0/1716519459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7406b850 0x7f3d74147470 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 >> 172.21.15.7:0/1716519459 conn(0x7f3d740b6840 msgr2=0x7f3d740b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 shutdown_connections 2024-08-19T00:39:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.082+0000 7f3d7c000640 1 -- 172.21.15.7:0/1716519459 wait complete. 2024-08-19T00:39:21.102 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:39:21.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.255+0000 7fdd3e400640 1 Processor -- start 2024-08-19T00:39:21.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.255+0000 7fdd3e400640 1 -- start start 2024-08-19T00:39:21.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.256+0000 7fdd3e400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 0x7fdd38071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.256+0000 7fdd3e400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd380cdfb0 con 0x7fdd3806e710 2024-08-19T00:39:21.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.256+0000 7fdd3e400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd380ce290 con 0x7fdd380b3750 2024-08-19T00:39:21.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.256+0000 7fdd3e400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd380cebc0 con 0x7fdd380d03c0 2024-08-19T00:39:21.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd2ea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdd3806e710 0x7fdd380d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46408/0 (socket says 172.21.15.7:46408) 2024-08-19T00:39:21.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd2ea00640 1 -- 172.21.15.7:0/651128413 learned_addr learned my addr 172.21.15.7:0/651128413 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:21.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd37400640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 0x7fdd38071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822403356 0 0) 0x7fdd380cdfb0 con 0x7fdd3806e710 2024-08-19T00:39:21.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd1c003520 con 0x7fdd3806e710 2024-08-19T00:39:21.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833683489 0 0) 0x7fdd380ce290 con 0x7fdd380b3750 2024-08-19T00:39:21.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd380cdfb0 con 0x7fdd380b3750 2024-08-19T00:39:21.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3971729872 0 0) 0x7fdd1c003520 con 0x7fdd3806e710 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 msgr2=0x7fdd38071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 0x7fdd38071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.257+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 >> v1:172.21.15.162:6789/0 conn(0x7fdd380b3750 legacy=0x7fdd380cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380ce570 con 0x7fdd3806e710 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fdd20001670 con 0x7fdd3806e710 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 >> v1:172.21.15.7:6789/0 conn(0x7fdd3806e710 legacy=0x7fdd380d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c003b70 0x7fdd1c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 0x7fdd1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd1c004d40 0x7fdd1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd380cebc0 con 0x7fdd1c004d40 2024-08-19T00:39:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c00ba70 con 0x7fdd1c003b70 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c00bc20 con 0x7fdd380d03c0 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd37400640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c003b70 0x7fdd1c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd37e00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd1c004d40 0x7fdd1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd2ea00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 0x7fdd1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd37e00640 1 -- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 msgr2=0x7fdd1c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd37e00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd380d03c0 0x7fdd1c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd37e00640 1 -- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c003b70 msgr2=0x7fdd1c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd37e00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c003b70 0x7fdd1c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.258+0000 7fdd37e00640 1 -- 172.21.15.7:0/651128413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c003520 con 0x7fdd1c004d40 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.259+0000 7fdd37e00640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd1c004d40 0x7fdd1c0051c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdd30001fd0 tx=0x7fdd1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2209f65ceff47ac server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30001bf0 con 0x7fdd1c004d40 2024-08-19T00:39:21.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd30003b70 con 0x7fdd1c004d40 2024-08-19T00:39:21.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd36a00640 1 -- 172.21.15.7:0/651128413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300050d0 con 0x7fdd1c004d40 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd3e400640 1 -- 172.21.15.7:0/651128413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd1c004d40 msgr2=0x7fdd1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd3e400640 1 --2- 172.21.15.7:0/651128413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd1c004d40 0x7fdd1c0051c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdd30001fd0 tx=0x7fdd1c005830 comp rx=0 tx=0).stop 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd37e00640 1 -- 172.21.15.7:0/651128413 reap_dead start 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd3e400640 1 -- 172.21.15.7:0/651128413 shutdown_connections 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd3e400640 1 -- 172.21.15.7:0/651128413 >> 172.21.15.7:0/651128413 conn(0x7fdd3806bc70 msgr2=0x7fdd3806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd3e400640 1 -- 172.21.15.7:0/651128413 shutdown_connections 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.260+0000 7fdd3e400640 1 -- 172.21.15.7:0/651128413 wait complete. 2024-08-19T00:39:21.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.262+0000 7fdd3e400640 1 Processor -- start 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.262+0000 7fdd3e400640 1 -- start start 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd3e400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c004d40 0x7fdd38154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd3e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd381552a0 0x7fdd38154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd3e400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd38099820 0x7fdd38098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd3e400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38073c60 con 0x7fdd381552a0 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd3e400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38073ae0 con 0x7fdd1c004d40 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd3e400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd380b3be0 con 0x7fdd38099820 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd2ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd381552a0 0x7fdd38154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd2ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd381552a0 0x7fdd38154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46204/0 (socket says 172.21.15.7:46204) 2024-08-19T00:39:21.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.263+0000 7fdd2ea00640 1 -- 172.21.15.7:0/1062484212 learned_addr learned my addr 172.21.15.7:0/1062484212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd37400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c004d40 0x7fdd38154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd37e00640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd38099820 0x7fdd38098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2ea00640 1 -- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd38099820 msgr2=0x7fdd38098ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2ea00640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd38099820 0x7fdd38098ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2ea00640 1 -- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c004d40 msgr2=0x7fdd38154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2ea00640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c004d40 0x7fdd38154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2ea00640 1 -- 172.21.15.7:0/1062484212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380b0810 con 0x7fdd381552a0 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd37e00640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd38099820 0x7fdd38098ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2ea00640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd381552a0 0x7fdd38154b90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdd20007340 tx=0x7fdd20007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2fe00640 1 -- 172.21.15.7:0/1062484212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000f940 con 0x7fdd381552a0 2024-08-19T00:39:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2fe00640 1 -- 172.21.15.7:0/1062484212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd20018070 con 0x7fdd381552a0 2024-08-19T00:39:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd2fe00640 1 -- 172.21.15.7:0/1062484212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000fd40 con 0x7fdd381552a0 2024-08-19T00:39:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd380b0af0 con 0x7fdd381552a0 2024-08-19T00:39:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.264+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd38098ff0 con 0x7fdd381552a0 2024-08-19T00:39:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.266+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd38070320 con 0x7fdd381552a0 2024-08-19T00:39:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.267+0000 7fdd2fe00640 1 -- 172.21.15.7:0/1062484212 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd2001d460 con 0x7fdd381552a0 2024-08-19T00:39:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.267+0000 7fdd2fe00640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd1406be30 0x7fdd1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.267+0000 7fdd2fe00640 1 -- 172.21.15.7:0/1062484212 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7fdd2008afd0 con 0x7fdd381552a0 2024-08-19T00:39:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.268+0000 7fdd37400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd1406be30 0x7fdd1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.268+0000 7fdd37400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd1406be30 0x7fdd1406e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdd3814c360 tx=0x7fdd28009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.272+0000 7fdd2fe00640 1 -- 172.21.15.7:0/1062484212 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdd38070320 con 0x7fdd381552a0 2024-08-19T00:39:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.457+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd380b3230 con 0x7fdd381552a0 2024-08-19T00:39:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.458+0000 7fdd2fe00640 1 -- 172.21.15.7:0/1062484212 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16698 (secure 0 0 0) 0x7fdd380b3230 con 0x7fdd381552a0 2024-08-19T00:39:21.461 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:21.461 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:39:15.844255+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:38:52.558342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-08-19T00:38:53.760748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/484605249":"2024-08-20T00:39:15.844230+0000","172.21.15.7:6835/484605249":"2024-08-20T00:39:15.844230+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:39:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd1406be30 msgr2=0x7fdd1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd1406be30 0x7fdd1406e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdd3814c360 tx=0x7fdd28009190 comp rx=0 tx=0).stop 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd381552a0 msgr2=0x7fdd38154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd381552a0 0x7fdd38154b90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdd20007340 tx=0x7fdd20007740 comp rx=0 tx=0).stop 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 shutdown_connections 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd1406be30 0x7fdd1406e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd38099820 0x7fdd38098ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd381552a0 0x7fdd38154b90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 --2- 172.21.15.7:0/1062484212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd1c004d40 0x7fdd38154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 >> 172.21.15.7:0/1062484212 conn(0x7fdd3806bc70 msgr2=0x7fdd3815ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 shutdown_connections 2024-08-19T00:39:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.461+0000 7fdd3e400640 1 -- 172.21.15.7:0/1062484212 wait complete. 2024-08-19T00:39:21.480 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:39:21.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.634+0000 7fc1e6a00640 1 Processor -- start 2024-08-19T00:39:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.635+0000 7fc1e6a00640 1 -- start start 2024-08-19T00:39:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1e6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e00b4a90 0x7fc1e00d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1e6a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e00b50b0 con 0x7fc1e015f5b0 2024-08-19T00:39:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1e6a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e00cead0 con 0x7fc1e00d03c0 2024-08-19T00:39:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1e6a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e015f990 con 0x7fc1e00b4a90 2024-08-19T00:39:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1dfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc1e015f5b0 0x7fc1e00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46410/0 (socket says 172.21.15.7:46410) 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1dfe00640 1 -- 172.21.15.7:0/2659464198 learned_addr learned my addr 172.21.15.7:0/2659464198 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1e4a00640 1 --2- 172.21.15.7:0/2659464198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e00b4a90 0x7fc1e00d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1dea00640 1 -- 172.21.15.7:0/2659464198 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568653118 0 0) 0x7fc1e00b50b0 con 0x7fc1e015f5b0 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.636+0000 7fc1dea00640 1 -- 172.21.15.7:0/2659464198 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c4003520 con 0x7fc1e015f5b0 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.637+0000 7fc1e4a00640 1 -- 172.21.15.7:0/2659464198 >> v1:172.21.15.162:6789/0 conn(0x7fc1e00d03c0 legacy=0x7fc1e00b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.637+0000 7fc1dea00640 1 -- 172.21.15.7:0/2659464198 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946558827 0 0) 0x7fc1e00cead0 con 0x7fc1e00d03c0 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.637+0000 7fc1e4a00640 1 -- 172.21.15.7:0/2659464198 >> v1:172.21.15.7:6789/0 conn(0x7fc1e015f5b0 legacy=0x7fc1e00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.637+0000 7fc1e4a00640 1 -- 172.21.15.7:0/2659464198 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e00cedb0 con 0x7fc1e00b4a90 2024-08-19T00:39:21.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.638+0000 7fc1e4a00640 1 --2- 172.21.15.7:0/2659464198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e00b4a90 0x7fc1e00d0800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009dc0 tx=0x7fc1d802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45dd4601ecca90d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:21.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.638+0000 7fc1dea00640 1 -- 172.21.15.7:0/2659464198 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d802ae60 con 0x7fc1e00b4a90 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.638+0000 7fc1dea00640 1 -- 172.21.15.7:0/2659464198 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d8007740 con 0x7fc1e00b4a90 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.638+0000 7fc1dea00640 1 -- 172.21.15.7:0/2659464198 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8007af0 con 0x7fc1e00b4a90 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.638+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2659464198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e00b4a90 msgr2=0x7fc1e00d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.638+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2659464198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e00b4a90 0x7fc1e00d0800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009dc0 tx=0x7fc1d802a640 comp rx=0 tx=0).stop 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.639+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2659464198 shutdown_connections 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.639+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2659464198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e00b4a90 0x7fc1e00d0800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.639+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2659464198 >> 172.21.15.7:0/2659464198 conn(0x7fc1e006bc70 msgr2=0x7fc1e006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.639+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2659464198 shutdown_connections 2024-08-19T00:39:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.639+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2659464198 wait complete. 2024-08-19T00:39:21.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.640+0000 7fc1e6a00640 1 Processor -- start 2024-08-19T00:39:21.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.640+0000 7fc1e6a00640 1 -- start start 2024-08-19T00:39:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.641+0000 7fc1e6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1e00b4a90 0x7fc1e013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.641+0000 7fc1e6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e00d03c0 0x7fc1e014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.641+0000 7fc1e6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e015f5b0 0x7fc1e0161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.641+0000 7fc1e6a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e006ea70 con 0x7fc1e00b4a90 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.641+0000 7fc1e6a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e006e8f0 con 0x7fc1e00d03c0 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.641+0000 7fc1e6a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e006ebf0 con 0x7fc1e015f5b0 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.641+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1e00b4a90 0x7fc1e013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1e00b4a90 0x7fc1e013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46206/0 (socket says 172.21.15.7:46206) 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 -- 172.21.15.7:0/2520124362 learned_addr learned my addr 172.21.15.7:0/2520124362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1e4a00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e015f5b0 0x7fc1e0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1df400640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e00d03c0 0x7fc1e014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 -- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e015f5b0 msgr2=0x7fc1e0161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e015f5b0 0x7fc1e0161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 -- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e00d03c0 msgr2=0x7fc1e014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e00d03c0 0x7fc1e014ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 -- 172.21.15.7:0/2520124362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e014dd20 con 0x7fc1e00b4a90 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.642+0000 7fc1dfe00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1e00b4a90 0x7fc1e013ffd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c390 tx=0x7fc1d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.643+0000 7fc1d7e00640 1 -- 172.21.15.7:0/2520124362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0017070 con 0x7fc1e00b4a90 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.643+0000 7fc1d7e00640 1 -- 172.21.15.7:0/2520124362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0005ce0 con 0x7fc1e00b4a90 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.643+0000 7fc1d7e00640 1 -- 172.21.15.7:0/2520124362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00072f0 con 0x7fc1e00b4a90 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.643+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e01f5180 con 0x7fc1e00b4a90 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.643+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e013f4f0 con 0x7fc1e00b4a90 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.644+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e006f0e0 con 0x7fc1e00b4a90 2024-08-19T00:39:21.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.645+0000 7fc1d7e00640 1 -- 172.21.15.7:0/2520124362 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1d001a070 con 0x7fc1e00b4a90 2024-08-19T00:39:21.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.645+0000 7fc1d7e00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1c006be30 0x7fc1c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:21.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.646+0000 7fc1d7e00640 1 -- 172.21.15.7:0/2520124362 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7fc1d008a260 con 0x7fc1e00b4a90 2024-08-19T00:39:21.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.646+0000 7fc1df400640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1c006be30 0x7fc1c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:21.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.646+0000 7fc1df400640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1c006be30 0x7fc1c006e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc1e014df30 tx=0x7fc1cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.650+0000 7fc1d7e00640 1 -- 172.21.15.7:0/2520124362 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc1d0058550 con 0x7fc1e00b4a90 2024-08-19T00:39:21.859 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:39:21.856+0000 7f2749e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:39:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.869+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1e00ce5b0 con 0x7fc1e00b4a90 2024-08-19T00:39:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.870+0000 7fc1d7e00640 1 -- 172.21.15.7:0/2520124362 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5221 (secure 0 0 0) 0x7fc1d005c850 con 0x7fc1e00b4a90 2024-08-19T00:39:21.873 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:21.873 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"btime":"2024-08-19T00:39:20:869278+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:20.869272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-08-19T00:39:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 37 2024-08-19T00:39:21.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1c006be30 msgr2=0x7fc1c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1c006be30 0x7fc1c006e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc1e014df30 tx=0x7fc1cc009040 comp rx=0 tx=0).stop 2024-08-19T00:39:21.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1e00b4a90 msgr2=0x7fc1e013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1e00b4a90 0x7fc1e013ffd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c390 tx=0x7fc1d000c850 comp rx=0 tx=0).stop 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 shutdown_connections 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1c006be30 0x7fc1c006e2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1e015f5b0 0x7fc1e0161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e00d03c0 0x7fc1e014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 --2- 172.21.15.7:0/2520124362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1e00b4a90 0x7fc1e013ffd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.872+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 >> 172.21.15.7:0/2520124362 conn(0x7fc1e006bc70 msgr2=0x7fc1e0074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.873+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 shutdown_connections 2024-08-19T00:39:21.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:21.873+0000 7fc1e6a00640 1 -- 172.21.15.7:0/2520124362 wait complete. 2024-08-19T00:39:21.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.045+0000 7f5d96600640 1 Processor -- start 2024-08-19T00:39:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.045+0000 7f5d96600640 1 -- start start 2024-08-19T00:39:22.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.046+0000 7f5d96600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5d9006cad0 0x7f5d900af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.046+0000 7f5d96600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d9015dc30 0x7f5d9015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.046+0000 7f5d96600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d900ae780 con 0x7f5d9006ceb0 2024-08-19T00:39:22.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.046+0000 7f5d96600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5d900b5dd0 con 0x7f5d9006cad0 2024-08-19T00:39:22.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.046+0000 7f5d96600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5d900aea00 con 0x7f5d9015dc30 2024-08-19T00:39:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5d9006cad0 0x7f5d900af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8ea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5d9006ceb0 0x7f5d900b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46426/0 (socket says 172.21.15.7:46426) 2024-08-19T00:39:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8ea00640 1 -- 172.21.15.7:0/1232431933 learned_addr learned my addr 172.21.15.7:0/1232431933 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8fe00640 1 --2- 172.21.15.7:0/1232431933 >> v2:172.21.15.162:3300/0 conn(0x7f5d9015dc30 0x7f5d9015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8f400640 1 -- 172.21.15.7:0/1232431933 >> v2:172.21.15.162:3300/0 conn(0x7f5d9015dc30 msgr2=0x7f5d9015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8f400640 1 --2- 172.21.15.7:0/1232431933 >> v2:172.21.15.162:3300/0 conn(0x7f5d9015dc30 0x7f5d9015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8f400640 1 -- 172.21.15.7:0/1232431933 >> v1:172.21.15.7:6789/0 conn(0x7f5d9006ceb0 legacy=0x7f5d900b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8f400640 1 -- 172.21.15.7:0/1232431933 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900aece0 con 0x7f5d9006cad0 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.047+0000 7f5d8fe00640 1 --2- 172.21.15.7:0/1232431933 >> v2:172.21.15.162:3300/0 conn(0x7f5d9015dc30 0x7f5d9015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.048+0000 7f5d8f400640 1 --2- 172.21.15.7:0/1232431933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006cad0 0x7f5d900af7c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5d800097a0 tx=0x7f5d8002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf6b072d19d4c5c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.048+0000 7f5d8e000640 1 -- 172.21.15.7:0/1232431933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80037070 con 0x7f5d9006cad0 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.048+0000 7f5d8e000640 1 -- 172.21.15.7:0/1232431933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8002ae50 con 0x7f5d9006cad0 2024-08-19T00:39:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.048+0000 7f5d8e000640 1 -- 172.21.15.7:0/1232431933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80032660 con 0x7f5d9006cad0 2024-08-19T00:39:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 -- 172.21.15.7:0/1232431933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006cad0 msgr2=0x7f5d900af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 --2- 172.21.15.7:0/1232431933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006cad0 0x7f5d900af7c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5d800097a0 tx=0x7f5d8002a140 comp rx=0 tx=0).stop 2024-08-19T00:39:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 -- 172.21.15.7:0/1232431933 shutdown_connections 2024-08-19T00:39:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 --2- 172.21.15.7:0/1232431933 >> v2:172.21.15.162:3300/0 conn(0x7f5d9015dc30 0x7f5d9015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 --2- 172.21.15.7:0/1232431933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006cad0 0x7f5d900af7c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 -- 172.21.15.7:0/1232431933 >> 172.21.15.7:0/1232431933 conn(0x7f5d900721b0 msgr2=0x7f5d900725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 -- 172.21.15.7:0/1232431933 shutdown_connections 2024-08-19T00:39:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.049+0000 7f5d96600640 1 -- 172.21.15.7:0/1232431933 wait complete. 2024-08-19T00:39:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.051+0000 7f5d96600640 1 Processor -- start 2024-08-19T00:39:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.051+0000 7f5d96600640 1 -- start start 2024-08-19T00:39:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d96600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d9006cad0 0x7f5d90153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d96600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006ceb0 0x7f5d90148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d96600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d9015dc30 0x7f5d90153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d96600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900afd00 con 0x7f5d9006ceb0 2024-08-19T00:39:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d96600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900af2a0 con 0x7f5d9015dc30 2024-08-19T00:39:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d96600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9015e600 con 0x7f5d9006cad0 2024-08-19T00:39:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d8ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006ceb0 0x7f5d90148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d8ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006ceb0 0x7f5d90148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46232/0 (socket says 172.21.15.7:46232) 2024-08-19T00:39:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d8ea00640 1 -- 172.21.15.7:0/658637455 learned_addr learned my addr 172.21.15.7:0/658637455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d8fe00640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d9015dc30 0x7f5d90153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.052+0000 7f5d8f400640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d9006cad0 0x7f5d90153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d8ea00640 1 -- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d9006cad0 msgr2=0x7f5d90153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d8ea00640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d9006cad0 0x7f5d90153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d8ea00640 1 -- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d9015dc30 msgr2=0x7f5d90153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d8ea00640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d9015dc30 0x7f5d90153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d8ea00640 1 -- 172.21.15.7:0/658637455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d90152160 con 0x7f5d9006ceb0 2024-08-19T00:39:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d8ea00640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006ceb0 0x7f5d90148320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c430 tx=0x7f5d7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d87400640 1 -- 172.21.15.7:0/658637455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c017070 con 0x7f5d9006ceb0 2024-08-19T00:39:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d87400640 1 -- 172.21.15.7:0/658637455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c005ce0 con 0x7f5d9006ceb0 2024-08-19T00:39:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d87400640 1 -- 172.21.15.7:0/658637455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0072f0 con 0x7f5d9006ceb0 2024-08-19T00:39:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9015ccf0 con 0x7f5d9006ceb0 2024-08-19T00:39:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.053+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9015d2b0 con 0x7f5d9006ceb0 2024-08-19T00:39:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.054+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d900b5bf0 con 0x7f5d9006ceb0 2024-08-19T00:39:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.055+0000 7f5d87400640 1 -- 172.21.15.7:0/658637455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d7c01a070 con 0x7f5d9006ceb0 2024-08-19T00:39:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.056+0000 7f5d87400640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d7006be30 0x7f5d7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.056+0000 7f5d87400640 1 -- 172.21.15.7:0/658637455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f5d7c08a350 con 0x7f5d9006ceb0 2024-08-19T00:39:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.056+0000 7f5d8f400640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d7006be30 0x7f5d7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.057+0000 7f5d8f400640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d7006be30 0x7f5d7006e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5d80034000 tx=0x7f5d8002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.061+0000 7f5d87400640 1 -- 172.21.15.7:0/658637455 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5d900b5bf0 con 0x7f5d9006ceb0 2024-08-19T00:39:22.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.280+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d900b4a00 con 0x7f5d9006ceb0 2024-08-19T00:39:22.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.281+0000 7f5d87400640 1 -- 172.21.15.7:0/658637455 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5221 (secure 0 0 0) 0x7f5d900ae780 con 0x7f5d9006ceb0 2024-08-19T00:39:22.284 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:22.284 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"btime":"2024-08-19T00:39:20:869278+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:38:54.761189+0000","modified":"2024-08-19T00:39:20.869272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/4241307956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4241307956},{"type":"v1","addr":"172.21.15.7:6837","nonce":4241307956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-08-19T00:39:22.284 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 37 2024-08-19T00:39:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d7006be30 msgr2=0x7f5d7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d7006be30 0x7f5d7006e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5d80034000 tx=0x7f5d8002e000 comp rx=0 tx=0).stop 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006ceb0 msgr2=0x7f5d90148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006ceb0 0x7f5d90148320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c430 tx=0x7f5d7c00c8f0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 shutdown_connections 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d7006be30 0x7f5d7006e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d9015dc30 0x7f5d90153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d9006ceb0 0x7f5d90148320 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 --2- 172.21.15.7:0/658637455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d9006cad0 0x7f5d90153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 >> 172.21.15.7:0/658637455 conn(0x7f5d900721b0 msgr2=0x7f5d900b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 shutdown_connections 2024-08-19T00:39:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.283+0000 7f5d96600640 1 -- 172.21.15.7:0/658637455 wait complete. 2024-08-19T00:39:22.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:39:22.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.456+0000 7fece6400640 1 Processor -- start 2024-08-19T00:39:22.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.456+0000 7fece6400640 1 -- start start 2024-08-19T00:39:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.457+0000 7fece6400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fece0159bf0 0x7fece0073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.457+0000 7fece6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece00cec10 0x7fece00d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.457+0000 7fece6400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece006f7f0 con 0x7fece00739a0 2024-08-19T00:39:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.457+0000 7fece6400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fece006f510 con 0x7fece0159bf0 2024-08-19T00:39:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.457+0000 7fece6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fece0072980 con 0x7fece00cec10 2024-08-19T00:39:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fece0159bf0 0x7fece0073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fece0159bf0 0x7fece0073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46242/0 (socket says 172.21.15.7:46242) 2024-08-19T00:39:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdf400640 1 -- 172.21.15.7:0/4135883632 learned_addr learned my addr 172.21.15.7:0/4135883632 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdfe00640 1 --2- 172.21.15.7:0/4135883632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece00cec10 0x7fece00d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdf400640 1 -- 172.21.15.7:0/4135883632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece00cec10 msgr2=0x7fece00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdf400640 1 --2- 172.21.15.7:0/4135883632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece00cec10 0x7fece00d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdf400640 1 -- 172.21.15.7:0/4135883632 >> v1:172.21.15.162:6789/0 conn(0x7fece00739a0 legacy=0x7fece00ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.458+0000 7fecdf400640 1 -- 172.21.15.7:0/4135883632 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece0072c60 con 0x7fece0159bf0 2024-08-19T00:39:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.459+0000 7fecdf400640 1 --2- 172.21.15.7:0/4135883632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece0073460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009870 tx=0x7fecd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d593bedb5762e984 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.459+0000 7fecdea00640 1 -- 172.21.15.7:0/4135883632 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0037070 con 0x7fece0159bf0 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.459+0000 7fecdea00640 1 -- 172.21.15.7:0/4135883632 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd0032440 con 0x7fece0159bf0 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.459+0000 7fecdea00640 1 -- 172.21.15.7:0/4135883632 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0032810 con 0x7fece0159bf0 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 -- 172.21.15.7:0/4135883632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 msgr2=0x7fece0073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 --2- 172.21.15.7:0/4135883632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece0073460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009870 tx=0x7fecd002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 -- 172.21.15.7:0/4135883632 shutdown_connections 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 --2- 172.21.15.7:0/4135883632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece00cec10 0x7fece00d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 --2- 172.21.15.7:0/4135883632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece0073460 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 -- 172.21.15.7:0/4135883632 >> 172.21.15.7:0/4135883632 conn(0x7fece006bc70 msgr2=0x7fece006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 -- 172.21.15.7:0/4135883632 shutdown_connections 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.460+0000 7fece6400640 1 -- 172.21.15.7:0/4135883632 wait complete. 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.462+0000 7fece6400640 1 Processor -- start 2024-08-19T00:39:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.462+0000 7fece6400640 1 -- start start 2024-08-19T00:39:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fece6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fece00739a0 0x7fece013d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fece6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fece6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece01501a0 0x7fece013f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fece6400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fece015a150 con 0x7fece0159bf0 2024-08-19T00:39:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fece6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fece0159fd0 con 0x7fece00739a0 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fece6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fece00d0900 con 0x7fece01501a0 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece014efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46258/0 (socket says 172.21.15.7:46258) 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 -- 172.21.15.7:0/2258526316 learned_addr learned my addr 172.21.15.7:0/2258526316 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecdfe00640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece01501a0 0x7fece013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecdf400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fece00739a0 0x7fece013d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 -- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece01501a0 msgr2=0x7fece013f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece01501a0 0x7fece013f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 -- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fece00739a0 msgr2=0x7fece013d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fece00739a0 0x7fece013d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecd7e00640 1 -- 172.21.15.7:0/2258526316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece0155ec0 con 0x7fece0159bf0 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecdfe00640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece01501a0 0x7fece013f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.463+0000 7fecdf400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fece00739a0 0x7fece013d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.464+0000 7fecd7e00640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece014efe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fecc800c3c0 tx=0x7fecc800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.464+0000 7fecd7400640 1 -- 172.21.15.7:0/2258526316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc80052d0 con 0x7fece0159bf0 2024-08-19T00:39:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.464+0000 7fecd7400640 1 -- 172.21.15.7:0/2258526316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc8005490 con 0x7fece0159bf0 2024-08-19T00:39:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.464+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece01561a0 con 0x7fece0159bf0 2024-08-19T00:39:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.464+0000 7fecd7400640 1 -- 172.21.15.7:0/2258526316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8007260 con 0x7fece0159bf0 2024-08-19T00:39:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.464+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece0153200 con 0x7fece0159bf0 2024-08-19T00:39:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.465+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece0068c00 con 0x7fece0159bf0 2024-08-19T00:39:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.466+0000 7fecd7400640 1 -- 172.21.15.7:0/2258526316 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecc8007400 con 0x7fece0159bf0 2024-08-19T00:39:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.467+0000 7fecd7400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecbc06be60 0x7fecbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.467+0000 7fecd7400640 1 -- 172.21.15.7:0/2258526316 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7fecc808a350 con 0x7fece0159bf0 2024-08-19T00:39:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.467+0000 7fecdf400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecbc06be60 0x7fecbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.468+0000 7fecdf400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecbc06be60 0x7fecbc06e320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fecd0034000 tx=0x7fecd002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.471+0000 7fecd7400640 1 -- 172.21.15.7:0/2258526316 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fecc8058c90 con 0x7fece0159bf0 2024-08-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.655+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fece00d0cd0 con 0x7fece0159bf0 2024-08-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.656+0000 7fecd7400640 1 -- 172.21.15.7:0/2258526316 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16698 (secure 0 0 0) 0x7fecc8058590 con 0x7fece0159bf0 2024-08-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:39:15.844255+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:38:52.558342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-08-19T00:38:53.760748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/484605249":"2024-08-20T00:39:15.844230+0000","172.21.15.7:6835/484605249":"2024-08-20T00:39:15.844230+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecbc06be60 msgr2=0x7fecbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecbc06be60 0x7fecbc06e320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fecd0034000 tx=0x7fecd002e000 comp rx=0 tx=0).stop 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 msgr2=0x7fece014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece014efe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fecc800c3c0 tx=0x7fecc800c880 comp rx=0 tx=0).stop 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 shutdown_connections 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecbc06be60 0x7fecbc06e320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fece01501a0 0x7fece013f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fece0159bf0 0x7fece014efe0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 --2- 172.21.15.7:0/2258526316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fece00739a0 0x7fece013d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 >> 172.21.15.7:0/2258526316 conn(0x7fece006bc70 msgr2=0x7fece00cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 shutdown_connections 2024-08-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.659+0000 7fece6400640 1 -- 172.21.15.7:0/2258526316 wait complete. 2024-08-19T00:39:22.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:39:22.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.833+0000 7f859ec00640 1 Processor -- start 2024-08-19T00:39:22.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.833+0000 7f859ec00640 1 -- start start 2024-08-19T00:39:22.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.834+0000 7f859ec00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8598071980 0x7f85980cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.834+0000 7f859ec00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85980cdfb0 con 0x7f85980d03c0 2024-08-19T00:39:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.834+0000 7f859ec00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85980ce290 con 0x7f859806e710 2024-08-19T00:39:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.834+0000 7f859ec00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f85980cebc0 con 0x7f8598071980 2024-08-19T00:39:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.834+0000 7f8597e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f85980d03c0 0x7f85980d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46438/0 (socket says 172.21.15.7:46438) 2024-08-19T00:39:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.834+0000 7f8597e00640 1 -- 172.21.15.7:0/1212043806 learned_addr learned my addr 172.21.15.7:0/1212043806 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:22.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.834+0000 7f859cc00640 1 --2- 172.21.15.7:0/1212043806 >> v2:172.21.15.7:3300/0 conn(0x7f8598071980 0x7f85980cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.835+0000 7f8597400640 1 -- 172.21.15.7:0/1212043806 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364721946 0 0) 0x7f85980cdfb0 con 0x7f85980d03c0 2024-08-19T00:39:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.835+0000 7f8597400640 1 -- 172.21.15.7:0/1212043806 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f857c003520 con 0x7f85980d03c0 2024-08-19T00:39:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.835+0000 7f859cc00640 1 -- 172.21.15.7:0/1212043806 >> v1:172.21.15.162:6789/0 conn(0x7f859806e710 legacy=0x7f85980b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.835+0000 7f859cc00640 1 -- 172.21.15.7:0/1212043806 >> v1:172.21.15.7:6789/0 conn(0x7f85980d03c0 legacy=0x7f85980d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.835+0000 7f859cc00640 1 -- 172.21.15.7:0/1212043806 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85980ce570 con 0x7f8598071980 2024-08-19T00:39:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.836+0000 7f859cc00640 1 --2- 172.21.15.7:0/1212043806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8598071980 0x7f85980cf050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8590009dc0 tx=0x7f859002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fd6344dd0d623d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.836+0000 7f8597400640 1 -- 172.21.15.7:0/1212043806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590007740 con 0x7f8598071980 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.836+0000 7f8597400640 1 -- 172.21.15.7:0/1212043806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85900078e0 con 0x7f8598071980 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.836+0000 7f8597400640 1 -- 172.21.15.7:0/1212043806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590007cb0 con 0x7f8598071980 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.836+0000 7f859ec00640 1 -- 172.21.15.7:0/1212043806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8598071980 msgr2=0x7f85980cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.836+0000 7f859ec00640 1 --2- 172.21.15.7:0/1212043806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8598071980 0x7f85980cf050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8590009dc0 tx=0x7f859002a730 comp rx=0 tx=0).stop 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.837+0000 7f859ec00640 1 -- 172.21.15.7:0/1212043806 shutdown_connections 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.837+0000 7f859ec00640 1 --2- 172.21.15.7:0/1212043806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8598071980 0x7f85980cf050 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.837+0000 7f859ec00640 1 -- 172.21.15.7:0/1212043806 >> 172.21.15.7:0/1212043806 conn(0x7f859806bc70 msgr2=0x7f859806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.837+0000 7f859ec00640 1 -- 172.21.15.7:0/1212043806 shutdown_connections 2024-08-19T00:39:22.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.837+0000 7f859ec00640 1 -- 172.21.15.7:0/1212043806 wait complete. 2024-08-19T00:39:22.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.838+0000 7f859ec00640 1 Processor -- start 2024-08-19T00:39:22.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.838+0000 7f859ec00640 1 -- start start 2024-08-19T00:39:22.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.839+0000 7f859ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f859806e710 0x7f85980b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.839+0000 7f859ec00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8598071980 0x7f85981f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.839+0000 7f859ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85980d03c0 0x7f85981f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.839+0000 7f859ec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8598073c60 con 0x7f85980d03c0 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.839+0000 7f859ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8598073ae0 con 0x7f859806e710 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.839+0000 7f859ec00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f85980cf590 con 0x7f8598071980 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85980d03c0 0x7f85981f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85980d03c0 0x7f85981f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46272/0 (socket says 172.21.15.7:46272) 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 -- 172.21.15.7:0/3750959117 learned_addr learned my addr 172.21.15.7:0/3750959117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f8597e00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f859806e710 0x7f85980b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f858fe00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8598071980 0x7f85981f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 -- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8598071980 msgr2=0x7f85981f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8598071980 0x7f85981f73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 -- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f859806e710 msgr2=0x7f85980b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f859806e710 0x7f85980b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 -- 172.21.15.7:0/3750959117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859814b370 con 0x7f85980d03c0 2024-08-19T00:39:22.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.840+0000 7f859cc00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85980d03c0 0x7f85981f7930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8590009ee0 tx=0x7f8590004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.841+0000 7f8594c00640 1 -- 172.21.15.7:0/3750959117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590040070 con 0x7f85980d03c0 2024-08-19T00:39:22.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.841+0000 7f8594c00640 1 -- 172.21.15.7:0/3750959117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8590031bc0 con 0x7f85980d03c0 2024-08-19T00:39:22.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.841+0000 7f8594c00640 1 -- 172.21.15.7:0/3750959117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590045460 con 0x7f85980d03c0 2024-08-19T00:39:22.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.841+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859815d440 con 0x7f85980d03c0 2024-08-19T00:39:22.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.841+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859814b8f0 con 0x7f85980d03c0 2024-08-19T00:39:22.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.842+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85980cf050 con 0x7f85980d03c0 2024-08-19T00:39:22.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.843+0000 7f8594c00640 1 -- 172.21.15.7:0/3750959117 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8590039040 con 0x7f85980d03c0 2024-08-19T00:39:22.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.844+0000 7f8594c00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f857406be30 0x7f857406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:22.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.844+0000 7f8594c00640 1 -- 172.21.15.7:0/3750959117 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f85900ac570 con 0x7f85980d03c0 2024-08-19T00:39:22.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.844+0000 7f8597e00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f857406be30 0x7f857406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:22.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.845+0000 7f8597e00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f857406be30 0x7f857406e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85880011e0 tx=0x7f8588007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:22.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:22.849+0000 7f8594c00640 1 -- 172.21.15.7:0/3750959117 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f859007a860 con 0x7f85980d03c0 2024-08-19T00:39:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.068+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f859806c980 con 0x7f85980d03c0 2024-08-19T00:39:23.071 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:39:23.069+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:39:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.071+0000 7f8594c00640 1 -- 172.21.15.7:0/3750959117 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7f859007eb60 con 0x7f85980d03c0 2024-08-19T00:39:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:39:23.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f857406be30 msgr2=0x7f857406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f857406be30 0x7f857406e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85880011e0 tx=0x7f8588007d30 comp rx=0 tx=0).stop 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85980d03c0 msgr2=0x7f85981f7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85980d03c0 0x7f85981f7930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8590009ee0 tx=0x7f8590004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 shutdown_connections 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f857406be30 0x7f857406e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85980d03c0 0x7f85981f7930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8598071980 0x7f85981f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 --2- 172.21.15.7:0/3750959117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f859806e710 0x7f85980b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.074+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 >> 172.21.15.7:0/3750959117 conn(0x7f859806bc70 msgr2=0x7f859806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.075+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 shutdown_connections 2024-08-19T00:39:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.075+0000 7f859ec00640 1 -- 172.21.15.7:0/3750959117 wait complete. 2024-08-19T00:39:23.081 INFO:tasks.ceph.mds.c.smithi007.stderr: -67> 2024-08-19T00:39:21.856+0000 7f2749e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:39:23.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:39:23.122 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.252+0000 7f8012400640 1 Processor -- start 2024-08-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.252+0000 7f8012400640 1 -- start start 2024-08-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.253+0000 7f8012400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.253+0000 7f8012400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800c0d3110 con 0x7f800c15e3e0 2024-08-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.253+0000 7f8012400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800c0b4df0 con 0x7f800c0b4150 2024-08-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.253+0000 7f8012400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f800c0b50d0 con 0x7f800c0d27b0 2024-08-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.253+0000 7f8011000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f800c15e3e0 0x7f800c0b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46448/0 (socket says 172.21.15.7:46448) 2024-08-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.253+0000 7f8011000640 1 -- 172.21.15.7:0/3486938309 learned_addr learned my addr 172.21.15.7:0/3486938309 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800be00640 1 --2- 172.21.15.7:0/3486938309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800b400640 1 -- 172.21.15.7:0/3486938309 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499716765 0 0) 0x7f800c0d3110 con 0x7f800c15e3e0 2024-08-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800b400640 1 -- 172.21.15.7:0/3486938309 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff4003520 con 0x7f800c15e3e0 2024-08-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800b400640 1 -- 172.21.15.7:0/3486938309 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647358503 0 0) 0x7f800c0b4df0 con 0x7f800c0b4150 2024-08-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800b400640 1 -- 172.21.15.7:0/3486938309 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f800c0d3110 con 0x7f800c0b4150 2024-08-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800be00640 1 -- 172.21.15.7:0/3486938309 >> v1:172.21.15.162:6789/0 conn(0x7f800c0b4150 legacy=0x7f800c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800be00640 1 -- 172.21.15.7:0/3486938309 >> v1:172.21.15.7:6789/0 conn(0x7f800c15e3e0 legacy=0x7f800c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.254+0000 7f800be00640 1 -- 172.21.15.7:0/3486938309 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c0cf1e0 con 0x7f800c0d27b0 2024-08-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.255+0000 7f800be00640 1 --2- 172.21.15.7:0/3486938309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c0d2bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80097d0 tx=0x7f7ff802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a027f7dcbf8bdf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f800b400640 1 -- 172.21.15.7:0/3486938309 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8037070 con 0x7f800c0d27b0 2024-08-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f800b400640 1 -- 172.21.15.7:0/3486938309 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff8032440 con 0x7f800c0d27b0 2024-08-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f800b400640 1 -- 172.21.15.7:0/3486938309 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8032810 con 0x7f800c0d27b0 2024-08-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f8012400640 1 -- 172.21.15.7:0/3486938309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 msgr2=0x7f800c0d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f8012400640 1 --2- 172.21.15.7:0/3486938309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c0d2bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80097d0 tx=0x7f7ff802a200 comp rx=0 tx=0).stop 2024-08-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f8012400640 1 -- 172.21.15.7:0/3486938309 shutdown_connections 2024-08-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f8012400640 1 --2- 172.21.15.7:0/3486938309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c0d2bd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f8012400640 1 -- 172.21.15.7:0/3486938309 >> 172.21.15.7:0/3486938309 conn(0x7f800c08dbe0 msgr2=0x7f800c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.256+0000 7f8012400640 1 -- 172.21.15.7:0/3486938309 shutdown_connections 2024-08-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.257+0000 7f8012400640 1 -- 172.21.15.7:0/3486938309 wait complete. 2024-08-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.258+0000 7f8012400640 1 Processor -- start 2024-08-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.258+0000 7f8012400640 1 -- start start 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.259+0000 7f8012400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f800c0b4150 0x7f800c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.259+0000 7f8012400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.259+0000 7f8012400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c15e3e0 0x7f800c160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.259+0000 7f8012400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f800c0cf9e0 con 0x7f800c0b4150 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.259+0000 7f8012400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f800c0cee90 con 0x7f800c15e3e0 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.259+0000 7f8012400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f800c0cfb60 con 0x7f800c0d27b0 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f800c0b4150 0x7f800c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f800c0b4150 0x7f800c159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46300/0 (socket says 172.21.15.7:46300) 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 -- 172.21.15.7:0/1959616197 learned_addr learned my addr 172.21.15.7:0/1959616197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f800be00640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011a00640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c15e3e0 0x7f800c160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 -- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 msgr2=0x7f800c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 -- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c15e3e0 msgr2=0x7f800c160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c15e3e0 0x7f800c160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 -- 172.21.15.7:0/1959616197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c15a320 con 0x7f800c0b4150 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011a00640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c15e3e0 0x7f800c160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.260+0000 7f8011000640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f800c0b4150 0x7f800c159de0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f800000c440 tx=0x7f800000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.261+0000 7f8008c00640 1 -- 172.21.15.7:0/1959616197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000017070 con 0x7f800c0b4150 2024-08-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.261+0000 7f8008c00640 1 -- 172.21.15.7:0/1959616197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8000005ce0 con 0x7f800c0b4150 2024-08-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.261+0000 7f8008c00640 1 -- 172.21.15.7:0/1959616197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000007270 con 0x7f800c0b4150 2024-08-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.261+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c0cb7d0 con 0x7f800c0b4150 2024-08-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.261+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c0cbd90 con 0x7f800c0b4150 2024-08-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.262+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c0d2bd0 con 0x7f800c0b4150 2024-08-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.263+0000 7f8008c00640 1 -- 172.21.15.7:0/1959616197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f800001a070 con 0x7f800c0b4150 2024-08-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.264+0000 7f8008c00640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7fec06be30 0x7f7fec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.264+0000 7f8008c00640 1 -- 172.21.15.7:0/1959616197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5881+0+0 (secure 0 0 0) 0x7f800008a1a0 con 0x7f800c0b4150 2024-08-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.264+0000 7f800be00640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7fec06be30 0x7f7fec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.265+0000 7f800be00640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7fec06be30 0x7f7fec06e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8034000 tx=0x7f7ff802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.269+0000 7f8008c00640 1 -- 172.21.15.7:0/1959616197 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8000058440 con 0x7f800c0b4150 2024-08-19T00:39:23.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:23.490+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f800c09d7e0 con 0x7f800c0b4150 2024-08-19T00:39:24.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.076+0000 7f8008c00640 1 -- 172.21.15.7:0/1959616197 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f800005c740 con 0x7f800c0b4150 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7fec06be30 msgr2=0x7f7fec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7fec06be30 0x7f7fec06e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8034000 tx=0x7f7ff802e000 comp rx=0 tx=0).stop 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f800c0b4150 msgr2=0x7f800c159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f800c0b4150 0x7f800c159de0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f800000c440 tx=0x7f800000c900 comp rx=0 tx=0).stop 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 shutdown_connections 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7fec06be30 0x7f7fec06e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c15e3e0 0x7f800c160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0d27b0 0x7f800c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 --2- 172.21.15.7:0/1959616197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f800c0b4150 0x7f800c159de0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 >> 172.21.15.7:0/1959616197 conn(0x7f800c08dbe0 msgr2=0x7f800c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 shutdown_connections 2024-08-19T00:39:24.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.079+0000 7f8012400640 1 -- 172.21.15.7:0/1959616197 wait complete. 2024-08-19T00:39:24.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:39:24.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.302+0000 7f2e75000640 1 Processor -- start 2024-08-19T00:39:24.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.302+0000 7f2e75000640 1 -- start start 2024-08-19T00:39:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e75000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7015e4e0 0x7f2e700d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e75000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e700d2cf0 0x7f2e700d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e75000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e700d44d0 0x7f2e700d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e75000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2e70161e90 con 0x7f2e700d44d0 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e75000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2e70162a10 con 0x7f2e700d2cf0 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e75000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2e700d3130 con 0x7f2e7015e4e0 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e700d44d0 0x7f2e700d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e700d44d0 0x7f2e700d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41434/0 (socket says 172.21.15.7:41434) 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 -- 172.21.15.7:0/2124052614 learned_addr learned my addr 172.21.15.7:0/2124052614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6f400640 1 --2- 172.21.15.7:0/2124052614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7015e4e0 0x7f2e700d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6ea00640 1 --2- 172.21.15.7:0/2124052614 >> v2:172.21.15.162:3300/0 conn(0x7f2e700d2cf0 0x7f2e700d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 -- 172.21.15.7:0/2124052614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7015e4e0 msgr2=0x7f2e700d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:24.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 --2- 172.21.15.7:0/2124052614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7015e4e0 0x7f2e700d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 -- 172.21.15.7:0/2124052614 >> v2:172.21.15.162:3300/0 conn(0x7f2e700d2cf0 msgr2=0x7f2e700d3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:24.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 --2- 172.21.15.7:0/2124052614 >> v2:172.21.15.162:3300/0 conn(0x7f2e700d2cf0 0x7f2e700d3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.303+0000 7f2e6fe00640 1 -- 172.21.15.7:0/2124052614 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e701620e0 con 0x7f2e700d44d0 2024-08-19T00:39:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.304+0000 7f2e6fe00640 1 --2- 172.21.15.7:0/2124052614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d44d0 0x7f2e700d0be0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2e7008e960 tx=0x7f2e6802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d019841eb5ff3243 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.304+0000 7f2e6e000640 1 -- 172.21.15.7:0/2124052614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68036070 con 0x7f2e700d44d0 2024-08-19T00:39:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.304+0000 7f2e6e000640 1 -- 172.21.15.7:0/2124052614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e68031600 con 0x7f2e700d44d0 2024-08-19T00:39:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.304+0000 7f2e6e000640 1 -- 172.21.15.7:0/2124052614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e680319d0 con 0x7f2e700d44d0 2024-08-19T00:39:24.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 -- 172.21.15.7:0/2124052614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d44d0 msgr2=0x7f2e700d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 --2- 172.21.15.7:0/2124052614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d44d0 0x7f2e700d0be0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2e7008e960 tx=0x7f2e6802a610 comp rx=0 tx=0).stop 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 -- 172.21.15.7:0/2124052614 shutdown_connections 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 --2- 172.21.15.7:0/2124052614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d44d0 0x7f2e700d0be0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 --2- 172.21.15.7:0/2124052614 >> v2:172.21.15.162:3300/0 conn(0x7f2e700d2cf0 0x7f2e700d3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 --2- 172.21.15.7:0/2124052614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7015e4e0 0x7f2e700d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 -- 172.21.15.7:0/2124052614 >> 172.21.15.7:0/2124052614 conn(0x7f2e7008dbe0 msgr2=0x7f2e7009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 -- 172.21.15.7:0/2124052614 shutdown_connections 2024-08-19T00:39:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 -- 172.21.15.7:0/2124052614 wait complete. 2024-08-19T00:39:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.306+0000 7f2e75000640 1 Processor -- start 2024-08-19T00:39:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.307+0000 7f2e75000640 1 -- start start 2024-08-19T00:39:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.307+0000 7f2e75000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d2cf0 0x7f2e7015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.307+0000 7f2e75000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e700d44d0 0x7f2e700b9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.307+0000 7f2e75000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e7015e4e0 0x7f2e7006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:24.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.307+0000 7f2e75000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e700d4980 con 0x7f2e700d2cf0 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.307+0000 7f2e75000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e701626a0 con 0x7f2e7015e4e0 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.307+0000 7f2e75000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2e700d1120 con 0x7f2e700d44d0 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d2cf0 0x7f2e7015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d2cf0 0x7f2e7015ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41440/0 (socket says 172.21.15.7:41440) 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 -- 172.21.15.7:0/2586900301 learned_addr learned my addr 172.21.15.7:0/2586900301 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6ea00640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e700d44d0 0x7f2e700b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6fe00640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e7015e4e0 0x7f2e7006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 -- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e700d44d0 msgr2=0x7f2e700b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e700d44d0 0x7f2e700b9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 -- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e7015e4e0 msgr2=0x7f2e7006cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e7015e4e0 0x7f2e7006cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 -- 172.21.15.7:0/2586900301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e700b9f60 con 0x7f2e700d2cf0 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6fe00640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e7015e4e0 0x7f2e7006cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.308+0000 7f2e6f400640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d2cf0 0x7f2e7015ba70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000d620 tx=0x7f2e6000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.309+0000 7f2e67400640 1 -- 172.21.15.7:0/2586900301 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000b620 con 0x7f2e700d2cf0 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.309+0000 7f2e67400640 1 -- 172.21.15.7:0/2586900301 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e60019070 con 0x7f2e700d2cf0 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.309+0000 7f2e67400640 1 -- 172.21.15.7:0/2586900301 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000ba00 con 0x7f2e700d2cf0 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.309+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7015eb10 con 0x7f2e700d2cf0 2024-08-19T00:39:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.309+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7015f0d0 con 0x7f2e700d2cf0 2024-08-19T00:39:24.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.310+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e700cf7c0 con 0x7f2e700d2cf0 2024-08-19T00:39:24.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.311+0000 7f2e67400640 1 -- 172.21.15.7:0/2586900301 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e6000bba0 con 0x7f2e700d2cf0 2024-08-19T00:39:24.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.312+0000 7f2e67400640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:24.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.313+0000 7f2e67400640 1 -- 172.21.15.7:0/2586900301 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5881+0+0 (secure 0 0 0) 0x7f2e6008b270 con 0x7f2e700d2cf0 2024-08-19T00:39:24.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.313+0000 7f2e6ea00640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be30 0x7f2e5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:24.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.313+0000 7f2e6ea00640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be30 0x7f2e5006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e701f7b60 tx=0x7f2e5c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:24.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.317+0000 7f2e67400640 1 -- 172.21.15.7:0/2586900301 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2e60059b60 con 0x7f2e700d2cf0 2024-08-19T00:39:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:24.500+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2e700cf4e0 con 0x7f2e700d2cf0 2024-08-19T00:39:25.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.079+0000 7f2e67400640 1 -- 172.21.15.7:0/2586900301 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7f2e60059460 con 0x7f2e700d2cf0 2024-08-19T00:39:25.081 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:39:25.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be30 msgr2=0x7f2e5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:25.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be30 0x7f2e5006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e701f7b60 tx=0x7f2e5c008040 comp rx=0 tx=0).stop 2024-08-19T00:39:25.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d2cf0 msgr2=0x7f2e7015ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:25.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d2cf0 0x7f2e7015ba70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000d620 tx=0x7f2e6000dae0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 shutdown_connections 2024-08-19T00:39:25.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be30 0x7f2e5006e2f0 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e701f7b60 tx=0x7f2e5c008040 comp rx=0 tx=0).stop 2024-08-19T00:39:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e7015e4e0 0x7f2e7006cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e700d44d0 0x7f2e700b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 --2- 172.21.15.7:0/2586900301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e700d2cf0 0x7f2e7015ba70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.084+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 >> 172.21.15.7:0/2586900301 conn(0x7f2e7008dbe0 msgr2=0x7f2e70074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.086+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 shutdown_connections 2024-08-19T00:39:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.086+0000 7f2e75000640 1 -- 172.21.15.7:0/2586900301 wait complete. 2024-08-19T00:39:25.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:39:25.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.274+0000 7f2a0de00640 1 Processor -- start 2024-08-19T00:39:25.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.274+0000 7f2a0de00640 1 -- start start 2024-08-19T00:39:25.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a080d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:25.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a0de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a080d2cf0 0x7f2a080d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:25.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a0de00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a081620e0 con 0x7f2a080d44d0 2024-08-19T00:39:25.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a0de00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2a08161e90 con 0x7f2a080d2cf0 2024-08-19T00:39:25.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a0de00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a08162a10 con 0x7f2a0815e4e0 2024-08-19T00:39:25.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a07e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a080d2cf0 0x7f2a080d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:25.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a07e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a080d2cf0 0x7f2a080d3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41450/0 (socket says 172.21.15.7:41450) 2024-08-19T00:39:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.275+0000 7f2a07e00640 1 -- 172.21.15.7:0/1328793297 learned_addr learned my addr 172.21.15.7:0/1328793297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.276+0000 7f2a07e00640 1 -- 172.21.15.7:0/1328793297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 msgr2=0x7f2a080d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.276+0000 7f2a0ca00640 1 --2- 172.21.15.7:0/1328793297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a080d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.276+0000 7f2a07e00640 1 --2- 172.21.15.7:0/1328793297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a080d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.276+0000 7f2a07e00640 1 -- 172.21.15.7:0/1328793297 >> v1:172.21.15.162:6789/0 conn(0x7f2a080d44d0 legacy=0x7f2a080d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.276+0000 7f2a07e00640 1 -- 172.21.15.7:0/1328793297 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081623c0 con 0x7f2a080d2cf0 2024-08-19T00:39:25.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.277+0000 7f2a07e00640 1 --2- 172.21.15.7:0/1328793297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d2cf0 0x7f2a080d3f90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009870 tx=0x7f29f402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e80271e65472c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:25.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.277+0000 7f2a07400640 1 -- 172.21.15.7:0/1328793297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4037070 con 0x7f2a080d2cf0 2024-08-19T00:39:25.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.277+0000 7f2a07400640 1 -- 172.21.15.7:0/1328793297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f4032440 con 0x7f2a080d2cf0 2024-08-19T00:39:25.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.277+0000 7f2a07400640 1 -- 172.21.15.7:0/1328793297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4032810 con 0x7f2a080d2cf0 2024-08-19T00:39:25.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 -- 172.21.15.7:0/1328793297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d2cf0 msgr2=0x7f2a080d3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:25.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1328793297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d2cf0 0x7f2a080d3f90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009870 tx=0x7f29f402a180 comp rx=0 tx=0).stop 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 -- 172.21.15.7:0/1328793297 shutdown_connections 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1328793297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d2cf0 0x7f2a080d3f90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1328793297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a080d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 -- 172.21.15.7:0/1328793297 >> 172.21.15.7:0/1328793297 conn(0x7f2a0808dbe0 msgr2=0x7f2a0809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 -- 172.21.15.7:0/1328793297 shutdown_connections 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.278+0000 7f2a0de00640 1 -- 172.21.15.7:0/1328793297 wait complete. 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.279+0000 7f2a0de00640 1 Processor -- start 2024-08-19T00:39:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.279+0000 7f2a0de00640 1 -- start start 2024-08-19T00:39:25.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.280+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a080d2cf0 0x7f2a081f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:25.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.280+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d44d0 0x7f2a081558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.280+0000 7f2a0de00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a08155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.280+0000 7f2a0de00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080d4980 con 0x7f2a080d44d0 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.280+0000 7f2a0de00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080d3130 con 0x7f2a080d2cf0 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.280+0000 7f2a0de00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a080b5390 con 0x7f2a0815e4e0 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d44d0 0x7f2a081558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d44d0 0x7f2a081558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41452/0 (socket says 172.21.15.7:41452) 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 -- 172.21.15.7:0/1716000146 learned_addr learned my addr 172.21.15.7:0/1716000146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a0ca00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a080d2cf0 0x7f2a081f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a0d400640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a08155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 -- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 msgr2=0x7f2a08155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a08155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 -- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a080d2cf0 msgr2=0x7f2a081f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a080d2cf0 0x7f2a081f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 -- 172.21.15.7:0/1716000146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0815a920 con 0x7f2a080d44d0 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.281+0000 7f2a07e00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d44d0 0x7f2a081558c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000c00 tx=0x7f29f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.282+0000 7f2a04c00640 1 -- 172.21.15.7:0/1716000146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4037040 con 0x7f2a080d44d0 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.282+0000 7f2a04c00640 1 -- 172.21.15.7:0/1716000146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f4042070 con 0x7f2a080d44d0 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.282+0000 7f2a04c00640 1 -- 172.21.15.7:0/1716000146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4030bd0 con 0x7f2a080d44d0 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.282+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a080b97a0 con 0x7f2a080d44d0 2024-08-19T00:39:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.282+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a080b9d60 con 0x7f2a080d44d0 2024-08-19T00:39:25.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.283+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a080d3f90 con 0x7f2a080d44d0 2024-08-19T00:39:25.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.284+0000 7f2a04c00640 1 -- 172.21.15.7:0/1716000146 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29f4047460 con 0x7f2a080d44d0 2024-08-19T00:39:25.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.285+0000 7f2a04c00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29e806be30 0x7f29e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:25.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.285+0000 7f2a04c00640 1 -- 172.21.15.7:0/1716000146 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5443+0+0 (secure 0 0 0) 0x7f29f40ab910 con 0x7f2a080d44d0 2024-08-19T00:39:25.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.285+0000 7f2a0ca00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29e806be30 0x7f29e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:25.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.286+0000 7f2a0ca00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29e806be30 0x7f29e806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00aa20 tx=0x7f29fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:25.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.290+0000 7f2a04c00640 1 -- 172.21.15.7:0/1716000146 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2a0815a920 con 0x7f2a080d44d0 2024-08-19T00:39:25.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:25.475+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2a080b5fd0 con 0x7f2a080d44d0 2024-08-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.084+0000 7f2a04c00640 1 -- 172.21.15.7:0/1716000146 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7f29f407a3b0 con 0x7f2a080d44d0 2024-08-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-08-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.088+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29e806be30 msgr2=0x7f29e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.088+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29e806be30 0x7f29e806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00aa20 tx=0x7f29fc008040 comp rx=0 tx=0).stop 2024-08-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.088+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d44d0 msgr2=0x7f2a081558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.088+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d44d0 0x7f2a081558c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000c00 tx=0x7f29f40046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.090+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 shutdown_connections 2024-08-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.090+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29e806be30 0x7f29e806e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.090+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a0815e4e0 0x7f2a08155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.090+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080d44d0 0x7f2a081558c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.090+0000 7f2a0de00640 1 --2- 172.21.15.7:0/1716000146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a080d2cf0 0x7f2a081f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.090+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 >> 172.21.15.7:0/1716000146 conn(0x7f2a0808dbe0 msgr2=0x7f2a080b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.091+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 shutdown_connections 2024-08-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.091+0000 7f2a0de00640 1 -- 172.21.15.7:0/1716000146 wait complete. 2024-08-19T00:39:26.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-08-19T00:39:26.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.274+0000 7fc849a00640 1 Processor -- start 2024-08-19T00:39:26.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.274+0000 7fc849a00640 1 -- start start 2024-08-19T00:39:26.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc849a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8440b5130 0x7fc8440aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc849a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc84415c390 0x7fc8440af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc849a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8440acef0 con 0x7fc84415bfb0 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc849a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc8440af650 con 0x7fc84415c390 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc849a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440ad790 con 0x7fc8440b5130 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc83be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8440b5130 0x7fc8440aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc83be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8440b5130 0x7fc8440aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:42856/0 (socket says 172.21.15.7:42856) 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc83be00640 1 -- 172.21.15.7:0/1898453084 learned_addr learned my addr 172.21.15.7:0/1898453084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.276+0000 7fc843400640 1 --2- 172.21.15.7:0/1898453084 >> v2:172.21.15.162:3300/0 conn(0x7fc84415c390 0x7fc8440af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.277+0000 7fc83be00640 1 -- 172.21.15.7:0/1898453084 >> v2:172.21.15.162:3300/0 conn(0x7fc84415c390 msgr2=0x7fc8440af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.277+0000 7fc83be00640 1 --2- 172.21.15.7:0/1898453084 >> v2:172.21.15.162:3300/0 conn(0x7fc84415c390 0x7fc8440af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.277+0000 7fc83be00640 1 -- 172.21.15.7:0/1898453084 >> v1:172.21.15.162:6789/0 conn(0x7fc84415bfb0 legacy=0x7fc8440b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.277+0000 7fc83be00640 1 -- 172.21.15.7:0/1898453084 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440ad1d0 con 0x7fc8440b5130 2024-08-19T00:39:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.277+0000 7fc843400640 1 --2- 172.21.15.7:0/1898453084 >> v2:172.21.15.162:3300/0 conn(0x7fc84415c390 0x7fc8440af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.278+0000 7fc83be00640 1 --2- 172.21.15.7:0/1898453084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8440b5130 0x7fc8440aebd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009870 tx=0x7fc82c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a9f89ce95bf345 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:26.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.278+0000 7fc842000640 1 -- 172.21.15.7:0/1898453084 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c037070 con 0x7fc8440b5130 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.278+0000 7fc842000640 1 -- 172.21.15.7:0/1898453084 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c032440 con 0x7fc8440b5130 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.278+0000 7fc842000640 1 -- 172.21.15.7:0/1898453084 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c032810 con 0x7fc8440b5130 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 -- 172.21.15.7:0/1898453084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8440b5130 msgr2=0x7fc8440aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 --2- 172.21.15.7:0/1898453084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8440b5130 0x7fc8440aebd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009870 tx=0x7fc82c02a250 comp rx=0 tx=0).stop 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 -- 172.21.15.7:0/1898453084 shutdown_connections 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 --2- 172.21.15.7:0/1898453084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8440b5130 0x7fc8440aebd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 --2- 172.21.15.7:0/1898453084 >> v2:172.21.15.162:3300/0 conn(0x7fc84415c390 0x7fc8440af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 -- 172.21.15.7:0/1898453084 >> 172.21.15.7:0/1898453084 conn(0x7fc8440b2300 msgr2=0x7fc84406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 -- 172.21.15.7:0/1898453084 shutdown_connections 2024-08-19T00:39:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.279+0000 7fc849a00640 1 -- 172.21.15.7:0/1898453084 wait complete. 2024-08-19T00:39:26.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.280+0000 7fc849a00640 1 Processor -- start 2024-08-19T00:39:26.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.280+0000 7fc849a00640 1 -- start start 2024-08-19T00:39:26.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.281+0000 7fc849a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8440b5130 0x7fc84415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.281+0000 7fc849a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc84415bfb0 0x7fc8440b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.281+0000 7fc849a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84415c390 0x7fc8441560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.281+0000 7fc849a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc844072040 con 0x7fc84415bfb0 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.281+0000 7fc849a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc844071b20 con 0x7fc8440b5130 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.281+0000 7fc849a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440721c0 con 0x7fc84415c390 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc84415bfb0 0x7fc8440b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc84415bfb0 0x7fc8440b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41458/0 (socket says 172.21.15.7:41458) 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 -- 172.21.15.7:0/1972973171 learned_addr learned my addr 172.21.15.7:0/1972973171 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc843400640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84415c390 0x7fc8441560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc842a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8440b5130 0x7fc84415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 -- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84415c390 msgr2=0x7fc8441560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84415c390 0x7fc8441560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 -- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8440b5130 msgr2=0x7fc84415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8440b5130 0x7fc84415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 -- 172.21.15.7:0/1972973171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440afed0 con 0x7fc84415bfb0 2024-08-19T00:39:26.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.282+0000 7fc83be00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc84415bfb0 0x7fc8440b0f70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000c00 tx=0x7fc82c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:26.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.283+0000 7fc83aa00640 1 -- 172.21.15.7:0/1972973171 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c037040 con 0x7fc84415bfb0 2024-08-19T00:39:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.283+0000 7fc83aa00640 1 -- 172.21.15.7:0/1972973171 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c042070 con 0x7fc84415bfb0 2024-08-19T00:39:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.283+0000 7fc83aa00640 1 -- 172.21.15.7:0/1972973171 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c030880 con 0x7fc84415bfb0 2024-08-19T00:39:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.283+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8440b01b0 con 0x7fc84415bfb0 2024-08-19T00:39:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.283+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8440b0770 con 0x7fc84415bfb0 2024-08-19T00:39:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.284+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8440b3e00 con 0x7fc84415bfb0 2024-08-19T00:39:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.285+0000 7fc83aa00640 1 -- 172.21.15.7:0/1972973171 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc82c030a20 con 0x7fc84415bfb0 2024-08-19T00:39:26.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.286+0000 7fc83aa00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc82006be60 0x7fc82006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.286+0000 7fc83aa00640 1 -- 172.21.15.7:0/1972973171 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7fc82c0ab4f0 con 0x7fc84415bfb0 2024-08-19T00:39:26.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.286+0000 7fc842a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc82006be60 0x7fc82006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.287+0000 7fc842a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc82006be60 0x7fc82006e320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc834001640 tx=0x7fc834009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:26.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.290+0000 7fc83aa00640 1 -- 172.21.15.7:0/1972973171 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc82c07a0a0 con 0x7fc84415bfb0 2024-08-19T00:39:26.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.475+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7fc844157d00 con 0x7fc84415bfb0 2024-08-19T00:39:26.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.475+0000 7fc83aa00640 1 -- 172.21.15.7:0/1972973171 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fc82c0799a0 con 0x7fc84415bfb0 2024-08-19T00:39:26.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc82006be60 msgr2=0x7fc82006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc82006be60 0x7fc82006e320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc834001640 tx=0x7fc834009040 comp rx=0 tx=0).stop 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc84415bfb0 msgr2=0x7fc8440b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc84415bfb0 0x7fc8440b0f70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000c00 tx=0x7fc82c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 shutdown_connections 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc82006be60 0x7fc82006e320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84415c390 0x7fc8441560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc84415bfb0 0x7fc8440b0f70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 --2- 172.21.15.7:0/1972973171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8440b5130 0x7fc84415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 >> 172.21.15.7:0/1972973171 conn(0x7fc8440b2300 msgr2=0x7fc84415fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 shutdown_connections 2024-08-19T00:39:26.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.478+0000 7fc849a00640 1 -- 172.21.15.7:0/1972973171 wait complete. 2024-08-19T00:39:26.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_abort_on_newly_corrupt_dentry 2024-08-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.655+0000 7f4f4fa00640 1 Processor -- start 2024-08-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.655+0000 7f4f4fa00640 1 -- start start 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.656+0000 7f4f4fa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f4815bfb0 0x7f4f480b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4fa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4f4815c390 0x7f4f48072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4fa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f480acef0 con 0x7f4f480b5130 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4fa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4f480ad790 con 0x7f4f4815bfb0 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4fa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4f480ad1d0 con 0x7f4f4815c390 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f4815bfb0 0x7f4f480b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f4815bfb0 0x7f4f480b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41474/0 (socket says 172.21.15.7:41474) 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4d000640 1 -- 172.21.15.7:0/790762335 learned_addr learned my addr 172.21.15.7:0/790762335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4da00640 1 --2- 172.21.15.7:0/790762335 >> v2:172.21.15.162:3300/0 conn(0x7f4f4815c390 0x7f4f48072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4d000640 1 -- 172.21.15.7:0/790762335 >> v2:172.21.15.162:3300/0 conn(0x7f4f4815c390 msgr2=0x7f4f48072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4d000640 1 --2- 172.21.15.7:0/790762335 >> v2:172.21.15.162:3300/0 conn(0x7f4f4815c390 0x7f4f48072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4d000640 1 -- 172.21.15.7:0/790762335 >> v1:172.21.15.162:6789/0 conn(0x7f4f480b5130 legacy=0x7f4f480aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.657+0000 7f4f4d000640 1 -- 172.21.15.7:0/790762335 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f480ad4b0 con 0x7f4f4815bfb0 2024-08-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.658+0000 7f4f4d000640 1 --2- 172.21.15.7:0/790762335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f480b3e00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4f480ae430 tx=0x7f4f3c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5ec5141e40df51 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f47400640 1 -- 172.21.15.7:0/790762335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c037070 con 0x7f4f4815bfb0 2024-08-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f47400640 1 -- 172.21.15.7:0/790762335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c032440 con 0x7f4f4815bfb0 2024-08-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f47400640 1 -- 172.21.15.7:0/790762335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c032810 con 0x7f4f4815bfb0 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 -- 172.21.15.7:0/790762335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 msgr2=0x7f4f480b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/790762335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f480b3e00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4f480ae430 tx=0x7f4f3c02a230 comp rx=0 tx=0).stop 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 -- 172.21.15.7:0/790762335 shutdown_connections 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/790762335 >> v2:172.21.15.162:3300/0 conn(0x7f4f4815c390 0x7f4f48072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/790762335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f480b3e00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 -- 172.21.15.7:0/790762335 >> 172.21.15.7:0/790762335 conn(0x7f4f480b2300 msgr2=0x7f4f4806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 -- 172.21.15.7:0/790762335 shutdown_connections 2024-08-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.659+0000 7f4f4fa00640 1 -- 172.21.15.7:0/790762335 wait complete. 2024-08-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.661+0000 7f4f4fa00640 1 Processor -- start 2024-08-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.661+0000 7f4f4fa00640 1 -- start start 2024-08-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f4fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f480b5130 0x7f4f48150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f4fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f48159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f4fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f4815c390 0x7f4f481e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f4fa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f480b44c0 con 0x7f4f4815bfb0 2024-08-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f4fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f480b4340 con 0x7f4f4815c390 2024-08-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f4fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4f480af2e0 con 0x7f4f480b5130 2024-08-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f48159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f48159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41476/0 (socket says 172.21.15.7:41476) 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f47e00640 1 -- 172.21.15.7:0/3544541663 learned_addr learned my addr 172.21.15.7:0/3544541663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.662+0000 7f4f4d000640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f480b5130 0x7f4f48150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f4da00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f4815c390 0x7f4f481e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f47e00640 1 -- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f480b5130 msgr2=0x7f4f48150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f47e00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f480b5130 0x7f4f48150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f47e00640 1 -- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f4815c390 msgr2=0x7f4f481e90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f47e00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f4815c390 0x7f4f481e90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f47e00640 1 -- 172.21.15.7:0/3544541663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f481e6df0 con 0x7f4f4815bfb0 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f47e00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f48159330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400c460 tx=0x7f4f3400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f44c00640 1 -- 172.21.15.7:0/3544541663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34016020 con 0x7f4f4815bfb0 2024-08-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f44c00640 1 -- 172.21.15.7:0/3544541663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f34012870 con 0x7f4f4815bfb0 2024-08-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f44c00640 1 -- 172.21.15.7:0/3544541663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34012c60 con 0x7f4f4815bfb0 2024-08-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.663+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4815a670 con 0x7f4f4815bfb0 2024-08-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.664+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4815abf0 con 0x7f4f4815bfb0 2024-08-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.665+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4815ae30 con 0x7f4f4815bfb0 2024-08-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.666+0000 7f4f44c00640 1 -- 172.21.15.7:0/3544541663 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f34019020 con 0x7f4f4815bfb0 2024-08-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.666+0000 7f4f44c00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.667+0000 7f4f44c00640 1 -- 172.21.15.7:0/3544541663 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f4f3408a7b0 con 0x7f4f4815bfb0 2024-08-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.667+0000 7f4f4d000640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.667+0000 7f4f4d000640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c034000 tx=0x7f4f3c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.671+0000 7f4f44c00640 1 -- 172.21.15.7:0/3544541663 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4f4815ae30 con 0x7f4f4815bfb0 2024-08-19T00:39:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.854+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_abort_on_newly_corrupt_dentry"} v 0) -- 0x7f4f480b3e00 con 0x7f4f4815bfb0 2024-08-19T00:39:26.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.858+0000 7f4f44c00640 1 -- 172.21.15.7:0/3544541663 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_abort_on_newly_corrupt_dentry"}]=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f4f34020030 con 0x7f4f4815bfb0 2024-08-19T00:39:26.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f2806be30 msgr2=0x7f4f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c034000 tx=0x7f4f3c02e000 comp rx=0 tx=0).stop 2024-08-19T00:39:26.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 msgr2=0x7f4f48159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:26.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f48159330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400c460 tx=0x7f4f3400c920 comp rx=0 tx=0).stop 2024-08-19T00:39:26.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 shutdown_connections 2024-08-19T00:39:26.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f4815c390 0x7f4f481e90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f4815bfb0 0x7f4f48159330 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 --2- 172.21.15.7:0/3544541663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f480b5130 0x7f4f48150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:26.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 >> 172.21.15.7:0/3544541663 conn(0x7f4f480b2300 msgr2=0x7f4f48071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:26.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 shutdown_connections 2024-08-19T00:39:26.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:26.860+0000 7f4f4fa00640 1 -- 172.21.15.7:0/3544541663 wait complete. 2024-08-19T00:39:26.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-19T00:39:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.036+0000 7f1a70a00640 1 Processor -- start 2024-08-19T00:39:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.036+0000 7f1a70a00640 1 -- start start 2024-08-19T00:39:27.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.037+0000 7f1a70a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a6c15e3e0 0x7f1a6c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.037+0000 7f1a70a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0d27b0 0x7f1a6c0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.037+0000 7f1a70a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1a6c0b4150 0x7f1a6c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.037+0000 7f1a70a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c0d3110 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.037+0000 7f1a70a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c0b4b20 con 0x7f1a6c0b4150 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.037+0000 7f1a70a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c0b4df0 con 0x7f1a6c0d27b0 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a6c15e3e0 0x7f1a6c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a6c15e3e0 0x7f1a6c0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41482/0 (socket says 172.21.15.7:41482) 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 -- 172.21.15.7:0/3179916863 learned_addr learned my addr 172.21.15.7:0/3179916863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a63e00640 1 --2- 172.21.15.7:0/3179916863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0d27b0 0x7f1a6c0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6be00640 1 --2- 172.21.15.7:0/3179916863 >> v2:172.21.15.162:3300/0 conn(0x7f1a6c0b4150 0x7f1a6c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 -- 172.21.15.7:0/3179916863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0d27b0 msgr2=0x7f1a6c0d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:27.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 --2- 172.21.15.7:0/3179916863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0d27b0 0x7f1a6c0d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 -- 172.21.15.7:0/3179916863 >> v2:172.21.15.162:3300/0 conn(0x7f1a6c0b4150 msgr2=0x7f1a6c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:27.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 --2- 172.21.15.7:0/3179916863 >> v2:172.21.15.162:3300/0 conn(0x7f1a6c0b4150 0x7f1a6c0b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6b400640 1 -- 172.21.15.7:0/3179916863 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c0b50d0 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.038+0000 7f1a6be00640 1 --2- 172.21.15.7:0/3179916863 >> v2:172.21.15.162:3300/0 conn(0x7f1a6c0b4150 0x7f1a6c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.039+0000 7f1a6b400640 1 --2- 172.21.15.7:0/3179916863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c0b0e60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c161d70 tx=0x7f1a5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c101840d9467e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.039+0000 7f1a6aa00640 1 -- 172.21.15.7:0/3179916863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c037070 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.039+0000 7f1a6aa00640 1 -- 172.21.15.7:0/3179916863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c032440 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.039+0000 7f1a6aa00640 1 -- 172.21.15.7:0/3179916863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c032810 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 -- 172.21.15.7:0/3179916863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 msgr2=0x7f1a6c0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 --2- 172.21.15.7:0/3179916863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c0b0e60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c161d70 tx=0x7f1a5c02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 -- 172.21.15.7:0/3179916863 shutdown_connections 2024-08-19T00:39:27.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 --2- 172.21.15.7:0/3179916863 >> v2:172.21.15.162:3300/0 conn(0x7f1a6c0b4150 0x7f1a6c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 --2- 172.21.15.7:0/3179916863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0d27b0 0x7f1a6c0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 --2- 172.21.15.7:0/3179916863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c0b0e60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 -- 172.21.15.7:0/3179916863 >> 172.21.15.7:0/3179916863 conn(0x7f1a6c08dbe0 msgr2=0x7f1a6c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:27.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 -- 172.21.15.7:0/3179916863 shutdown_connections 2024-08-19T00:39:27.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.040+0000 7f1a70a00640 1 -- 172.21.15.7:0/3179916863 wait complete. 2024-08-19T00:39:27.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.042+0000 7f1a70a00640 1 Processor -- start 2024-08-19T00:39:27.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.042+0000 7f1a70a00640 1 -- start start 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a70a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0b4150 0x7f1a6c156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a70a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6c0d27b0 0x7f1a6c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a70a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a70a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0cee90 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a70a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0cf4c0 con 0x7f1a6c0d27b0 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a70a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c0b13a0 con 0x7f1a6c0b4150 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41494/0 (socket says 172.21.15.7:41494) 2024-08-19T00:39:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 -- 172.21.15.7:0/1665785377 learned_addr learned my addr 172.21.15.7:0/1665785377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:27.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a63e00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6c0d27b0 0x7f1a6c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6b400640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0b4150 0x7f1a6c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 -- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0b4150 msgr2=0x7f1a6c156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0b4150 0x7f1a6c156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 -- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6c0d27b0 msgr2=0x7f1a6c0cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6c0d27b0 0x7f1a6c0cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.043+0000 7f1a6be00640 1 -- 172.21.15.7:0/1665785377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c0b90f0 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.044+0000 7f1a6be00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c157060 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400cef0 tx=0x7f1a6400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:27.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.044+0000 7f1a63400640 1 -- 172.21.15.7:0/1665785377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6401a070 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.044+0000 7f1a63400640 1 -- 172.21.15.7:0/1665785377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6400d860 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.044+0000 7f1a63400640 1 -- 172.21.15.7:0/1665785377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6400dc50 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.044+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c0b8050 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.044+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c0b8610 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.045+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6c0d2bd0 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.046+0000 7f1a63400640 1 -- 172.21.15.7:0/1665785377 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a6401d070 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.047+0000 7f1a63400640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a4806be30 0x7f1a4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.047+0000 7f1a63400640 1 -- 172.21.15.7:0/1665785377 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f1a6408b400 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.047+0000 7f1a6b400640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a4806be30 0x7f1a4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.048+0000 7f1a6b400640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a4806be30 0x7f1a4806e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c034000 tx=0x7f1a5c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:27.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.051+0000 7f1a63400640 1 -- 172.21.15.7:0/1665785377 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1a64059ab0 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.234+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f1a6c0a21d0 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.238+0000 7f1a63400640 1 -- 172.21.15.7:0/1665785377 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f1a6405ddb0 con 0x7f1a6c15e3e0 2024-08-19T00:39:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a4806be30 msgr2=0x7f1a4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a4806be30 0x7f1a4806e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c034000 tx=0x7f1a5c02e000 comp rx=0 tx=0).stop 2024-08-19T00:39:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 msgr2=0x7f1a6c157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c157060 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400cef0 tx=0x7f1a6400a710 comp rx=0 tx=0).stop 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 shutdown_connections 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a4806be30 0x7f1a4806e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a6c15e3e0 0x7f1a6c157060 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6c0d27b0 0x7f1a6c0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 --2- 172.21.15.7:0/1665785377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a6c0b4150 0x7f1a6c156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 >> 172.21.15.7:0/1665785377 conn(0x7f1a6c08dbe0 msgr2=0x7f1a6c0d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 shutdown_connections 2024-08-19T00:39:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.240+0000 7f1a70a00640 1 -- 172.21.15.7:0/1665785377 wait complete. 2024-08-19T00:39:27.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing' 2024-08-19T00:39:27.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.415+0000 7f7811800640 1 Processor -- start 2024-08-19T00:39:27.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.415+0000 7f7811800640 1 -- start start 2024-08-19T00:39:27.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f7811800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f780c0d03c0 0x7f780c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f7811800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f780c06e710 0x7f780c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f7811800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780c0d0ce0 con 0x7f780c0b3750 2024-08-19T00:39:27.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f7811800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f780c0cebc0 con 0x7f780c06e710 2024-08-19T00:39:27.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f7811800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f780c0cdfb0 con 0x7f780c0d03c0 2024-08-19T00:39:27.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f7803e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f780c06e710 0x7f780c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f780b400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f780c0b3750 0x7f780c0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53878/0 (socket says 172.21.15.7:53878) 2024-08-19T00:39:27.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.416+0000 7f780b400640 1 -- 172.21.15.7:0/1893656765 learned_addr learned my addr 172.21.15.7:0/1893656765 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:27.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.417+0000 7f780aa00640 1 --2- 172.21.15.7:0/1893656765 >> v2:172.21.15.162:3300/0 conn(0x7f780c0d03c0 0x7f780c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.417+0000 7f7803e00640 1 -- 172.21.15.7:0/1893656765 >> v2:172.21.15.162:3300/0 conn(0x7f780c0d03c0 msgr2=0x7f780c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.417+0000 7f7803e00640 1 --2- 172.21.15.7:0/1893656765 >> v2:172.21.15.162:3300/0 conn(0x7f780c0d03c0 0x7f780c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.417+0000 7f7803e00640 1 -- 172.21.15.7:0/1893656765 >> v1:172.21.15.7:6789/0 conn(0x7f780c0b3750 legacy=0x7f780c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.417+0000 7f7803e00640 1 -- 172.21.15.7:0/1893656765 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c0ce290 con 0x7f780c06e710 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.417+0000 7f780a000640 1 -- 172.21.15.7:0/1893656765 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398461109 0 0) 0x7f780c0d0ce0 con 0x7f780c0b3750 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.418+0000 7f7803e00640 1 --2- 172.21.15.7:0/1893656765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c06e710 0x7f780c0d07a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f77f40097a0 tx=0x7f77f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2f0a0fa3c18253 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.418+0000 7f780a000640 1 -- 172.21.15.7:0/1893656765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4037070 con 0x7f780c06e710 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.418+0000 7f780a000640 1 -- 172.21.15.7:0/1893656765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4032440 con 0x7f780c06e710 2024-08-19T00:39:27.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.418+0000 7f780a000640 1 -- 172.21.15.7:0/1893656765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4032810 con 0x7f780c06e710 2024-08-19T00:39:27.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 -- 172.21.15.7:0/1893656765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c06e710 msgr2=0x7f780c0d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 --2- 172.21.15.7:0/1893656765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c06e710 0x7f780c0d07a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f77f40097a0 tx=0x7f77f402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 -- 172.21.15.7:0/1893656765 shutdown_connections 2024-08-19T00:39:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 --2- 172.21.15.7:0/1893656765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c06e710 0x7f780c0d07a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 --2- 172.21.15.7:0/1893656765 >> v2:172.21.15.162:3300/0 conn(0x7f780c0d03c0 0x7f780c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 -- 172.21.15.7:0/1893656765 >> 172.21.15.7:0/1893656765 conn(0x7f780c06bc70 msgr2=0x7f780c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 -- 172.21.15.7:0/1893656765 shutdown_connections 2024-08-19T00:39:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.419+0000 7f7811800640 1 -- 172.21.15.7:0/1893656765 wait complete. 2024-08-19T00:39:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.421+0000 7f7811800640 1 Processor -- start 2024-08-19T00:39:27.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.421+0000 7f7811800640 1 -- start start 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7811800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f780c06e710 0x7f780c1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7811800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c0b3750 0x7f780c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7811800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f780c0d03c0 0x7f780c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7811800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f780c073ae0 con 0x7f780c0b3750 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7811800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f780c0ce850 con 0x7f780c0d03c0 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7811800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f780c073c60 con 0x7f780c06e710 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c0b3750 0x7f780c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c0b3750 0x7f780c156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41512/0 (socket says 172.21.15.7:41512) 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 -- 172.21.15.7:0/3559027046 learned_addr learned my addr 172.21.15.7:0/3559027046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f780aa00640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f780c06e710 0x7f780c1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f780b400640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f780c0d03c0 0x7f780c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 -- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f780c06e710 msgr2=0x7f780c1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f780c06e710 0x7f780c1560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 -- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f780c0d03c0 msgr2=0x7f780c0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f780c0d03c0 0x7f780c0ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.422+0000 7f7803e00640 1 -- 172.21.15.7:0/3559027046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c157850 con 0x7f780c0b3750 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.423+0000 7f7803e00640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c0b3750 0x7f780c156d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f77f4035040 tx=0x7f77f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.423+0000 7f7802a00640 1 -- 172.21.15.7:0/3559027046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4037040 con 0x7f780c0b3750 2024-08-19T00:39:27.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.423+0000 7f7802a00640 1 -- 172.21.15.7:0/3559027046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4030500 con 0x7f780c0b3750 2024-08-19T00:39:27.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.423+0000 7f7802a00640 1 -- 172.21.15.7:0/3559027046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4030910 con 0x7f780c0b3750 2024-08-19T00:39:27.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.423+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780c157b30 con 0x7f780c0b3750 2024-08-19T00:39:27.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.423+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780c09c5d0 con 0x7f780c0b3750 2024-08-19T00:39:27.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.424+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780c0b3b80 con 0x7f780c0b3750 2024-08-19T00:39:27.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.425+0000 7f7802a00640 1 -- 172.21.15.7:0/3559027046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77f4044020 con 0x7f780c0b3750 2024-08-19T00:39:27.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.426+0000 7f7802a00640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f77e806be60 0x7f77e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:27.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.426+0000 7f7802a00640 1 -- 172.21.15.7:0/3559027046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f77f40aae60 con 0x7f780c0b3750 2024-08-19T00:39:27.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.427+0000 7f780aa00640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f77e806be60 0x7f77e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:27.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.427+0000 7f780aa00640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f77e806be60 0x7f77e806e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f780c15eb40 tx=0x7f77fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:27.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.431+0000 7f7802a00640 1 -- 172.21.15.7:0/3559027046 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f77f4079aa0 con 0x7f780c0b3750 2024-08-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:27.684+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]} v 0) -- 0x7f780c06e340 con 0x7f780c0b3750 2024-08-19T00:39:28.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.088+0000 7f7802a00640 1 -- 172.21.15.7:0/3559027046 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]}]=0 v149) ==== 141+0+0 (secure 0 0 0) 0x7f77f40793a0 con 0x7f780c0b3750 2024-08-19T00:39:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f77e806be60 msgr2=0x7f77e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f77e806be60 0x7f77e806e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f780c15eb40 tx=0x7f77fc008040 comp rx=0 tx=0).stop 2024-08-19T00:39:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c0b3750 msgr2=0x7f780c156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c0b3750 0x7f780c156d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f77f4035040 tx=0x7f77f40046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 shutdown_connections 2024-08-19T00:39:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f77e806be60 0x7f77e806e320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f780c0d03c0 0x7f780c0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f780c0b3750 0x7f780c156d90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 --2- 172.21.15.7:0/3559027046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f780c06e710 0x7f780c1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.090+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 >> 172.21.15.7:0/3559027046 conn(0x7f780c06bc70 msgr2=0x7f780c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.091+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 shutdown_connections 2024-08-19T00:39:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.091+0000 7f7811800640 1 -- 172.21.15.7:0/3559027046 wait complete. 2024-08-19T00:39:28.109 INFO:tasks.cephfs_test_runner:That the MDS won't abort when the dentry is already known to be damaged. ... ok 2024-08-19T00:39:28.109 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_precommit (tasks.cephfs.test_damage.TestDamage) That the MDS won't write a dentry with new damage to CDentry::first 2024-08-19T00:39:28.109 INFO:tasks.cephfs_test_runner:test_dentry_first_precommit (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:39:28.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:39:28.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.267+0000 7fdee6400640 1 Processor -- start 2024-08-19T00:39:28.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.267+0000 7fdee6400640 1 -- start start 2024-08-19T00:39:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.268+0000 7fdee6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 0x7fdee0161100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.268+0000 7fdee6400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee006d880 con 0x7fdee00d4e00 2024-08-19T00:39:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.268+0000 7fdee6400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee00cf250 con 0x7fdee006e520 2024-08-19T00:39:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.268+0000 7fdee6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdee00cf020 con 0x7fdee00d15a0 2024-08-19T00:39:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fded6a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdee00d4e00 0x7fdee00d0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53892/0 (socket says 172.21.15.7:53892) 2024-08-19T00:39:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fded6a00640 1 -- 172.21.15.7:0/140947527 learned_addr learned my addr 172.21.15.7:0/140947527 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedfe00640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 0x7fdee0161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174672165 0 0) 0x7fdee006d880 con 0x7fdee00d4e00 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec4003520 con 0x7fdee00d4e00 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98853640 0 0) 0x7fdee00cf250 con 0x7fdee006e520 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee006d880 con 0x7fdee006e520 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1945716578 0 0) 0x7fdec4003520 con 0x7fdee00d4e00 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 msgr2=0x7fdee0161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 0x7fdee0161100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 >> v1:172.21.15.162:6789/0 conn(0x7fdee006e520 legacy=0x7fdee00d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee00cf530 con 0x7fdee00d4e00 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fdec8001670 con 0x7fdee00d4e00 2024-08-19T00:39:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 >> v1:172.21.15.7:6789/0 conn(0x7fdee00d4e00 legacy=0x7fdee00d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.269+0000 7fdedea00640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdec4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedea00640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdec4004800 0x7fdec4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedea00640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 0x7fdec40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdec400ba70 con 0x7fdec4003b70 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdec400bbf0 con 0x7fdec4004800 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdec400bdf0 con 0x7fdee00d15a0 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedf400640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdec4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedfe00640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 0x7fdec40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fded6a00640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdec4004800 0x7fdec4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedf400640 1 -- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 msgr2=0x7fdec40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedf400640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00d15a0 0x7fdec40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedf400640 1 -- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdec4004800 msgr2=0x7fdec4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedf400640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdec4004800 0x7fdec4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.270+0000 7fdedf400640 1 -- 172.21.15.7:0/140947527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec4003520 con 0x7fdec4003b70 2024-08-19T00:39:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.271+0000 7fdedf400640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdec4003f70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fded00018a0 tx=0x7fdec4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbc20e9333c836 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00014f0 con 0x7fdec4003b70 2024-08-19T00:39:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded00052d0 con 0x7fdec4003b70 2024-08-19T00:39:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdedea00640 1 -- 172.21.15.7:0/140947527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded002ac40 con 0x7fdec4003b70 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdee6400640 1 -- 172.21.15.7:0/140947527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 msgr2=0x7fdec4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdee6400640 1 --2- 172.21.15.7:0/140947527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdec4003f70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fded00018a0 tx=0x7fdec4005830 comp rx=0 tx=0).stop 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdedfe00640 1 -- 172.21.15.7:0/140947527 reap_dead start 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdee6400640 1 -- 172.21.15.7:0/140947527 shutdown_connections 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdee6400640 1 -- 172.21.15.7:0/140947527 >> 172.21.15.7:0/140947527 conn(0x7fdee009d710 msgr2=0x7fdee00d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdee6400640 1 -- 172.21.15.7:0/140947527 shutdown_connections 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.272+0000 7fdee6400640 1 -- 172.21.15.7:0/140947527 wait complete. 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.274+0000 7fdee6400640 1 Processor -- start 2024-08-19T00:39:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.274+0000 7fdee6400640 1 -- start start 2024-08-19T00:39:28.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.275+0000 7fdee6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdee00ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.275+0000 7fdee6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00ce350 0x7fdee00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.275+0000 7fdee6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee00b60b0 0x7fdee01e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.275+0000 7fdee6400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00cfaf0 con 0x7fdec4003b70 2024-08-19T00:39:28.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.275+0000 7fdee6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00cfe60 con 0x7fdee00b60b0 2024-08-19T00:39:28.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.275+0000 7fdee6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdee00d02f0 con 0x7fdee00ce350 2024-08-19T00:39:28.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdee00ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fded6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00ce350 0x7fdee00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdee00ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41522/0 (socket says 172.21.15.7:41522) 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 -- 172.21.15.7:0/2089402026 learned_addr learned my addr 172.21.15.7:0/2089402026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedfe00640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee00b60b0 0x7fdee01e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 -- 172.21.15.7:0/2089402026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00ce350 msgr2=0x7fdee00cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00ce350 0x7fdee00cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 -- 172.21.15.7:0/2089402026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee00b60b0 msgr2=0x7fdee01e57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee00b60b0 0x7fdee01e57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 -- 172.21.15.7:0/2089402026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee00cc620 con 0x7fdec4003b70 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.276+0000 7fdedf400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdee00ca580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fded00019c0 tx=0x7fded00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.277+0000 7fded7e00640 1 -- 172.21.15.7:0/2089402026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0040020 con 0x7fdec4003b70 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.277+0000 7fded7e00640 1 -- 172.21.15.7:0/2089402026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded0005480 con 0x7fdec4003b70 2024-08-19T00:39:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.277+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee00cc8c0 con 0x7fdec4003b70 2024-08-19T00:39:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.277+0000 7fded7e00640 1 -- 172.21.15.7:0/2089402026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00014f0 con 0x7fdec4003b70 2024-08-19T00:39:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.277+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee00cce80 con 0x7fdec4003b70 2024-08-19T00:39:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.278+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee00d2f10 con 0x7fdec4003b70 2024-08-19T00:39:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.279+0000 7fded7e00640 1 -- 172.21.15.7:0/2089402026 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fded0043020 con 0x7fdec4003b70 2024-08-19T00:39:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.280+0000 7fded7e00640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.280+0000 7fded7e00640 1 -- 172.21.15.7:0/2089402026 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7fded00aadc0 con 0x7fdec4003b70 2024-08-19T00:39:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.280+0000 7fded6a00640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.281+0000 7fded6a00640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdebc06be60 0x7fdebc06e320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000c00 tx=0x7fdec8001b30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:28.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.284+0000 7fded7e00640 1 -- 172.21.15.7:0/2089402026 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fded004a020 con 0x7fdec4003b70 2024-08-19T00:39:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.468+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdee00d52d0 con 0x7fdec4003b70 2024-08-19T00:39:28.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.469+0000 7fded7e00640 1 -- 172.21.15.7:0/2089402026 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13108 (secure 0 0 0) 0x7fded0079320 con 0x7fdec4003b70 2024-08-19T00:39:28.471 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:28.471 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":49,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:39:26.080185+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/4241307956":"2024-08-20T00:39:23.070581+0000","172.21.15.7:6835/4241307956":"2024-08-20T00:39:23.070581+0000","172.21.15.7:6837/484605249":"2024-08-20T00:39:15.844230+0000","172.21.15.7:6835/484605249":"2024-08-20T00:39:15.844230+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:39:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.471+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdebc06be60 msgr2=0x7fdebc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.471+0000 7fdee6400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdebc06be60 0x7fdebc06e320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000c00 tx=0x7fdec8001b30 comp rx=0 tx=0).stop 2024-08-19T00:39:28.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.471+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 msgr2=0x7fdee00ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.471+0000 7fdee6400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdee00ca580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fded00019c0 tx=0x7fded00012d0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 shutdown_connections 2024-08-19T00:39:28.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee00b60b0 0x7fdee01e57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdee00ce350 0x7fdee00cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 --2- 172.21.15.7:0/2089402026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdec4003b70 0x7fdee00ca580 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 >> 172.21.15.7:0/2089402026 conn(0x7fdee009d710 msgr2=0x7fdee00b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:28.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 shutdown_connections 2024-08-19T00:39:28.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.472+0000 7fdee6400640 1 -- 172.21.15.7:0/2089402026 wait complete. 2024-08-19T00:39:28.490 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:36:51.315746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:39:28.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T00:39:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.648+0000 7f38f8a00640 1 Processor -- start 2024-08-19T00:39:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.648+0000 7f38f8a00640 1 -- start start 2024-08-19T00:39:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.649+0000 7f38f8a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38f406da50 0x7f38f415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.649+0000 7f38f8a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38f4073140 con 0x7f38f415bd70 2024-08-19T00:39:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.649+0000 7f38f8a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38f40733f0 con 0x7f38f406d600 2024-08-19T00:39:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.649+0000 7f38f8a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f38f40736d0 con 0x7f38f406da50 2024-08-19T00:39:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.649+0000 7f38f3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38f406da50 0x7f38f415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.649+0000 7f38f3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38f406da50 0x7f38f415d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41536/0 (socket says 172.21.15.7:41536) 2024-08-19T00:39:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.649+0000 7f38f3200640 1 -- 172.21.15.7:0/3170478685 learned_addr learned my addr 172.21.15.7:0/3170478685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.650+0000 7f38f3200640 1 -- 172.21.15.7:0/3170478685 >> v1:172.21.15.162:6789/0 conn(0x7f38f406d600 legacy=0x7f38f415cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.650+0000 7f38f3200640 1 -- 172.21.15.7:0/3170478685 >> v1:172.21.15.7:6789/0 conn(0x7f38f415bd70 legacy=0x7f38f4072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.650+0000 7f38f3200640 1 -- 172.21.15.7:0/3170478685 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f40739b0 con 0x7f38f406da50 2024-08-19T00:39:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.650+0000 7f38f1e00640 1 -- 172.21.15.7:0/3170478685 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386627296 0 0) 0x7f38f4073140 con 0x7f38f415bd70 2024-08-19T00:39:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.651+0000 7f38f3200640 1 --2- 172.21.15.7:0/3170478685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f406da50 0x7f38f415d3b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009870 tx=0x7f38ec02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aedf76bce6688f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.651+0000 7f38f1e00640 1 -- 172.21.15.7:0/3170478685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec037070 con 0x7f38f406da50 2024-08-19T00:39:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.651+0000 7f38f1e00640 1 -- 172.21.15.7:0/3170478685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ec02ae50 con 0x7f38f406da50 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.651+0000 7f38f1e00640 1 -- 172.21.15.7:0/3170478685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec032860 con 0x7f38f406da50 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.652+0000 7f38f8a00640 1 -- 172.21.15.7:0/3170478685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f406da50 msgr2=0x7f38f415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.652+0000 7f38f8a00640 1 --2- 172.21.15.7:0/3170478685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f406da50 0x7f38f415d3b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009870 tx=0x7f38ec02a300 comp rx=0 tx=0).stop 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.652+0000 7f38f8a00640 1 -- 172.21.15.7:0/3170478685 shutdown_connections 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.652+0000 7f38f8a00640 1 --2- 172.21.15.7:0/3170478685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f406da50 0x7f38f415d3b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.652+0000 7f38f8a00640 1 -- 172.21.15.7:0/3170478685 >> 172.21.15.7:0/3170478685 conn(0x7f38f406b850 msgr2=0x7f38f406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.652+0000 7f38f8a00640 1 -- 172.21.15.7:0/3170478685 shutdown_connections 2024-08-19T00:39:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.652+0000 7f38f8a00640 1 -- 172.21.15.7:0/3170478685 wait complete. 2024-08-19T00:39:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.654+0000 7f38f8a00640 1 Processor -- start 2024-08-19T00:39:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.654+0000 7f38f8a00640 1 -- start start 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f8a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38f406d600 0x7f38f4151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38f406da50 0x7f38f41f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f415bd70 0x7f38f40ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f8a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38f406dec0 con 0x7f38f415bd70 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38f415c780 con 0x7f38f406da50 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f8a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38f415c150 con 0x7f38f406d600 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f415bd70 0x7f38f40ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f415bd70 0x7f38f40ada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41544/0 (socket says 172.21.15.7:41544) 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 -- 172.21.15.7:0/2153223894 learned_addr learned my addr 172.21.15.7:0/2153223894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f2800640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38f406d600 0x7f38f4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38e9e00640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38f406da50 0x7f38f41f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 -- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38f406d600 msgr2=0x7f38f4151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38f406d600 0x7f38f4151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 -- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38f406da50 msgr2=0x7f38f41f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38f406da50 0x7f38f41f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.655+0000 7f38f3200640 1 -- 172.21.15.7:0/2153223894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f41f73c0 con 0x7f38f415bd70 2024-08-19T00:39:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.656+0000 7f38f3200640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f415bd70 0x7f38f40ada10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02a340 tx=0x7f38ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.656+0000 7f38eb400640 1 -- 172.21.15.7:0/2153223894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec041070 con 0x7f38f415bd70 2024-08-19T00:39:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.656+0000 7f38eb400640 1 -- 172.21.15.7:0/2153223894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ec03c890 con 0x7f38f415bd70 2024-08-19T00:39:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.656+0000 7f38eb400640 1 -- 172.21.15.7:0/2153223894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec037040 con 0x7f38f415bd70 2024-08-19T00:39:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.656+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f41f76a0 con 0x7f38f415bd70 2024-08-19T00:39:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.656+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f41f7c60 con 0x7f38f415bd70 2024-08-19T00:39:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.657+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f406e3a0 con 0x7f38f415bd70 2024-08-19T00:39:28.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.658+0000 7f38eb400640 1 -- 172.21.15.7:0/2153223894 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38ec044070 con 0x7f38f415bd70 2024-08-19T00:39:28.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.659+0000 7f38eb400640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:28.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.659+0000 7f38eb400640 1 -- 172.21.15.7:0/2153223894 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f38ec0ab770 con 0x7f38f415bd70 2024-08-19T00:39:28.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.659+0000 7f38f2800640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:28.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.660+0000 7f38f2800640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f38d006be30 0x7f38d006e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38f4155b50 tx=0x7f38e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:28.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.663+0000 7f38eb400640 1 -- 172.21.15.7:0/2153223894 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f38ec07a440 con 0x7f38f415bd70 2024-08-19T00:39:28.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.845+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f38f415b430 con 0x7f38f415bd70 2024-08-19T00:39:28.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.845+0000 7f38eb400640 1 -- 172.21.15.7:0/2153223894 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f38ec079d40 con 0x7f38f415bd70 2024-08-19T00:39:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-08-19T00:39:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f38d006be30 msgr2=0x7f38d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f38d006be30 0x7f38d006e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38f4155b50 tx=0x7f38e4009040 comp rx=0 tx=0).stop 2024-08-19T00:39:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f415bd70 msgr2=0x7f38f40ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f415bd70 0x7f38f40ada10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02a340 tx=0x7f38ec0046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 shutdown_connections 2024-08-19T00:39:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f415bd70 0x7f38f40ada10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38f406da50 0x7f38f41f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 --2- 172.21.15.7:0/2153223894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38f406d600 0x7f38f4151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 >> 172.21.15.7:0/2153223894 conn(0x7f38f406b850 msgr2=0x7f38f40afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 shutdown_connections 2024-08-19T00:39:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:28.847+0000 7f38f8a00640 1 -- 172.21.15.7:0/2153223894 wait complete. 2024-08-19T00:39:28.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit' 2024-08-19T00:39:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.022+0000 7f5159800640 1 Processor -- start 2024-08-19T00:39:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.022+0000 7f5159800640 1 -- start start 2024-08-19T00:39:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.023+0000 7f5159800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515413dc30 0x7f5154140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.023+0000 7f5159800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f515406dd10 0x7f51540ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.023+0000 7f5159800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515415e930 con 0x7f5154140640 2024-08-19T00:39:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.024+0000 7f5159800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f515415ec10 con 0x7f515406dd10 2024-08-19T00:39:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.024+0000 7f5159800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f515415eef0 con 0x7f515413dc30 2024-08-19T00:39:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.024+0000 7f5153e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515413dc30 0x7f5154140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.024+0000 7f5158e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f515406dd10 0x7f51540ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.024+0000 7f514be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5154140640 0x7f515406d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:54456/0 (socket says 172.21.15.7:54456) 2024-08-19T00:39:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.024+0000 7f514be00640 1 -- 172.21.15.7:0/940829792 learned_addr learned my addr 172.21.15.7:0/940829792 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.025+0000 7f5153e00640 1 -- 172.21.15.7:0/940829792 >> v2:172.21.15.162:3300/0 conn(0x7f515406dd10 msgr2=0x7f51540ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.025+0000 7f5153e00640 1 --2- 172.21.15.7:0/940829792 >> v2:172.21.15.162:3300/0 conn(0x7f515406dd10 0x7f51540ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.025+0000 7f5153e00640 1 -- 172.21.15.7:0/940829792 >> v1:172.21.15.162:6789/0 conn(0x7f5154140640 legacy=0x7f515406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.025+0000 7f5153e00640 1 -- 172.21.15.7:0/940829792 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515415f1d0 con 0x7f515413dc30 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.026+0000 7f5153e00640 1 --2- 172.21.15.7:0/940829792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515413dc30 0x7f5154140ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51440097a0 tx=0x7f514402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ee9c0c5ad5f7e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.026+0000 7f5153400640 1 -- 172.21.15.7:0/940829792 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144037070 con 0x7f515413dc30 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.026+0000 7f5153400640 1 -- 172.21.15.7:0/940829792 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5144032440 con 0x7f515413dc30 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.026+0000 7f5153400640 1 -- 172.21.15.7:0/940829792 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144032810 con 0x7f515413dc30 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.026+0000 7f5159800640 1 -- 172.21.15.7:0/940829792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515413dc30 msgr2=0x7f5154140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.026+0000 7f5159800640 1 --2- 172.21.15.7:0/940829792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515413dc30 0x7f5154140ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51440097a0 tx=0x7f514402a180 comp rx=0 tx=0).stop 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.027+0000 7f5159800640 1 -- 172.21.15.7:0/940829792 shutdown_connections 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.027+0000 7f5159800640 1 --2- 172.21.15.7:0/940829792 >> v2:172.21.15.162:3300/0 conn(0x7f515406dd10 0x7f51540ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.027+0000 7f5159800640 1 --2- 172.21.15.7:0/940829792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515413dc30 0x7f5154140ce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.027+0000 7f5159800640 1 -- 172.21.15.7:0/940829792 >> 172.21.15.7:0/940829792 conn(0x7f515406b850 msgr2=0x7f515406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.027+0000 7f5159800640 1 -- 172.21.15.7:0/940829792 shutdown_connections 2024-08-19T00:39:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.027+0000 7f5159800640 1 -- 172.21.15.7:0/940829792 wait complete. 2024-08-19T00:39:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.028+0000 7f5159800640 1 Processor -- start 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.028+0000 7f5159800640 1 -- start start 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.029+0000 7f5159800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515406dd10 0x7f51541365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.029+0000 7f5159800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f515413dc30 0x7f515413f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.029+0000 7f5159800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5154140640 0x7f515413f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.029+0000 7f5159800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51541413a0 con 0x7f515413dc30 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.029+0000 7f5159800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5154141220 con 0x7f5154140640 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.029+0000 7f5159800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f515413e010 con 0x7f515406dd10 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.029+0000 7f514be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f515413dc30 0x7f515413f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f515413dc30 0x7f515413f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41558/0 (socket says 172.21.15.7:41558) 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 -- 172.21.15.7:0/1676682793 learned_addr learned my addr 172.21.15.7:0/1676682793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f5153e00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515406dd10 0x7f51541365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f5158e00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5154140640 0x7f515413f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 -- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515406dd10 msgr2=0x7f51541365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515406dd10 0x7f51541365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 -- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5154140640 msgr2=0x7f515413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5154140640 0x7f515413f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 -- 172.21.15.7:0/1676682793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5154138210 con 0x7f515413dc30 2024-08-19T00:39:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f514be00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f515413dc30 0x7f515413f2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c3c0 tx=0x7f513c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.030+0000 7f5150c00640 1 -- 172.21.15.7:0/1676682793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c017070 con 0x7f515413dc30 2024-08-19T00:39:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.031+0000 7f5150c00640 1 -- 172.21.15.7:0/1676682793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513c005ce0 con 0x7f515413dc30 2024-08-19T00:39:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.031+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5154166e70 con 0x7f515413dc30 2024-08-19T00:39:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.031+0000 7f5150c00640 1 -- 172.21.15.7:0/1676682793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0072f0 con 0x7f515413dc30 2024-08-19T00:39:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.031+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5154167430 con 0x7f515413dc30 2024-08-19T00:39:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.032+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5154140ce0 con 0x7f515413dc30 2024-08-19T00:39:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.033+0000 7f5150c00640 1 -- 172.21.15.7:0/1676682793 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f513c01a070 con 0x7f515413dc30 2024-08-19T00:39:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.034+0000 7f5150c00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f513006be60 0x7f513006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.034+0000 7f5150c00640 1 -- 172.21.15.7:0/1676682793 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f513c089f90 con 0x7f515413dc30 2024-08-19T00:39:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.034+0000 7f5153e00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f513006be60 0x7f513006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.034+0000 7f5153e00640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f513006be60 0x7f513006e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5144034000 tx=0x7f514402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.038+0000 7f5150c00640 1 -- 172.21.15.7:0/1676682793 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f513c058470 con 0x7f515413dc30 2024-08-19T00:39:29.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:29.294+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]} v 0) -- 0x7f5154136b10 con 0x7f515413dc30 2024-08-19T00:39:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.095+0000 7f5150c00640 1 -- 172.21.15.7:0/1676682793 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]}]=0 v151) ==== 145+0+0 (secure 0 0 0) 0x7f513c05c770 con 0x7f515413dc30 2024-08-19T00:39:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f513006be60 msgr2=0x7f513006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f513006be60 0x7f513006e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5144034000 tx=0x7f514402e000 comp rx=0 tx=0).stop 2024-08-19T00:39:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f515413dc30 msgr2=0x7f515413f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f515413dc30 0x7f515413f2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c3c0 tx=0x7f513c00c880 comp rx=0 tx=0).stop 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 shutdown_connections 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f513006be60 0x7f513006e320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5154140640 0x7f515413f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f515413dc30 0x7f515413f2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.098+0000 7f5159800640 1 --2- 172.21.15.7:0/1676682793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515406dd10 0x7f51541365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.099+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 >> 172.21.15.7:0/1676682793 conn(0x7f515406b850 msgr2=0x7f515415dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.099+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 shutdown_connections 2024-08-19T00:39:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.099+0000 7f5159800640 1 -- 172.21.15.7:0/1676682793 wait complete. 2024-08-19T00:39:30.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-19T00:39:30.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.281+0000 7f80b9400640 1 Processor -- start 2024-08-19T00:39:30.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.282+0000 7f80b9400640 1 -- start start 2024-08-19T00:39:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80b9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b40b5130 0x7f80b40aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80b9400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b40acef0 con 0x7f80b415bfb0 2024-08-19T00:39:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80b9400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b40ad1d0 con 0x7f80b415c390 2024-08-19T00:39:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80b9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80b40ad790 con 0x7f80b40b5130 2024-08-19T00:39:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80b2800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f80b415bfb0 0x7f80b40b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53904/0 (socket says 172.21.15.7:53904) 2024-08-19T00:39:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80b2800640 1 -- 172.21.15.7:0/3661993632 learned_addr learned my addr 172.21.15.7:0/3661993632 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:30.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80abe00640 1 --2- 172.21.15.7:0/3661993632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b40b5130 0x7f80b40aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:30.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.283+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614246516 0 0) 0x7f80b40acef0 con 0x7f80b415bfb0 2024-08-19T00:39:30.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.284+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8098003520 con 0x7f80b415bfb0 2024-08-19T00:39:30.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.284+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187444269 0 0) 0x7f80b40ad1d0 con 0x7f80b415c390 2024-08-19T00:39:30.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.284+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80b40acef0 con 0x7f80b415c390 2024-08-19T00:39:30.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.284+0000 7f80abe00640 1 -- 172.21.15.7:0/3661993632 >> v1:172.21.15.162:6789/0 conn(0x7f80b415c390 legacy=0x7f80b4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.284+0000 7f80abe00640 1 -- 172.21.15.7:0/3661993632 >> v1:172.21.15.7:6789/0 conn(0x7f80b415bfb0 legacy=0x7f80b40b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.284+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218274992 0 0) 0x7f8098003520 con 0x7f80b415bfb0 2024-08-19T00:39:30.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.284+0000 7f80abe00640 1 -- 172.21.15.7:0/3661993632 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b40ad4b0 con 0x7f80b40b5130 2024-08-19T00:39:30.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.285+0000 7f80abe00640 1 --2- 172.21.15.7:0/3661993632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b40b5130 0x7f80b40aebd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f809c0097d0 tx=0x7f809c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c26aa632c86abd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:30.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.285+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c037070 con 0x7f80b40b5130 2024-08-19T00:39:30.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.285+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c02ac30 con 0x7f80b40b5130 2024-08-19T00:39:30.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b1e00640 1 -- 172.21.15.7:0/3661993632 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4001670 con 0x7f80b40b5130 2024-08-19T00:39:30.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b9400640 1 -- 172.21.15.7:0/3661993632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b40b5130 msgr2=0x7f80b40aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b9400640 1 --2- 172.21.15.7:0/3661993632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b40b5130 0x7f80b40aebd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f809c0097d0 tx=0x7f809c02a1a0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b9400640 1 -- 172.21.15.7:0/3661993632 shutdown_connections 2024-08-19T00:39:30.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b9400640 1 --2- 172.21.15.7:0/3661993632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b40b5130 0x7f80b40aebd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b9400640 1 -- 172.21.15.7:0/3661993632 >> 172.21.15.7:0/3661993632 conn(0x7f80b40b2300 msgr2=0x7f80b406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b9400640 1 -- 172.21.15.7:0/3661993632 shutdown_connections 2024-08-19T00:39:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.286+0000 7f80b9400640 1 -- 172.21.15.7:0/3661993632 wait complete. 2024-08-19T00:39:30.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.288+0000 7f80b9400640 1 Processor -- start 2024-08-19T00:39:30.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.288+0000 7f80b9400640 1 -- start start 2024-08-19T00:39:30.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80b40b5130 0x7f80b415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:30.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b415bfb0 0x7f80b40724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:30.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b415c390 0x7f80b4150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:30.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80b40af290 con 0x7f80b415c390 2024-08-19T00:39:30.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80b40af110 con 0x7f80b40b5130 2024-08-19T00:39:30.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80b40af410 con 0x7f80b415bfb0 2024-08-19T00:39:30.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b415c390 0x7f80b4150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:30.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b415c390 0x7f80b4150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41560/0 (socket says 172.21.15.7:41560) 2024-08-19T00:39:30.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b3200640 1 -- 172.21.15.7:0/1920457452 learned_addr learned my addr 172.21.15.7:0/1920457452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:30.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80b2800640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80b40b5130 0x7f80b415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:30.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.289+0000 7f80abe00640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b415bfb0 0x7f80b40724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:30.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80b3200640 1 -- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b415bfb0 msgr2=0x7f80b40724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80b3200640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b415bfb0 0x7f80b40724f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80b3200640 1 -- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80b40b5130 msgr2=0x7f80b415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80b3200640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80b40b5130 0x7f80b415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80b3200640 1 -- 172.21.15.7:0/1920457452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b415e3f0 con 0x7f80b415c390 2024-08-19T00:39:30.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80b3200640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b415c390 0x7f80b4150400 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c6e0 tx=0x7f80ac00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:30.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80aaa00640 1 -- 172.21.15.7:0/1920457452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac003b70 con 0x7f80b415c390 2024-08-19T00:39:30.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80aaa00640 1 -- 172.21.15.7:0/1920457452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac003d10 con 0x7f80b415c390 2024-08-19T00:39:30.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80aaa00640 1 -- 172.21.15.7:0/1920457452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac005310 con 0x7f80b415c390 2024-08-19T00:39:30.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.290+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b415e6d0 con 0x7f80b415c390 2024-08-19T00:39:30.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.291+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b415ec90 con 0x7f80b415c390 2024-08-19T00:39:30.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.291+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b41f5150 con 0x7f80b415c390 2024-08-19T00:39:30.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.292+0000 7f80aaa00640 1 -- 172.21.15.7:0/1920457452 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80ac0054b0 con 0x7f80b415c390 2024-08-19T00:39:30.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.293+0000 7f80aaa00640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f809006be30 0x7f809006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:30.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.293+0000 7f80aaa00640 1 -- 172.21.15.7:0/1920457452 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f80ac08a9b0 con 0x7f80b415c390 2024-08-19T00:39:30.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.294+0000 7f80b2800640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f809006be30 0x7f809006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:30.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.294+0000 7f80b2800640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f809006be30 0x7f809006e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80a4001eb0 tx=0x7f80a40016d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:30.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.297+0000 7f80aaa00640 1 -- 172.21.15.7:0/1920457452 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f80ac058f10 con 0x7f80b415c390 2024-08-19T00:39:30.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.481+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f80b40aebd0 con 0x7f80b415c390 2024-08-19T00:39:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.485+0000 7f80aaa00640 1 -- 172.21.15.7:0/1920457452 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f80ac05d210 con 0x7f80b415c390 2024-08-19T00:39:30.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f809006be30 msgr2=0x7f809006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f809006be30 0x7f809006e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80a4001eb0 tx=0x7f80a40016d0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b415c390 msgr2=0x7f80b4150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b415c390 0x7f80b4150400 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c6e0 tx=0x7f80ac00cba0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 shutdown_connections 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f809006be30 0x7f809006e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b415c390 0x7f80b4150400 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80b415bfb0 0x7f80b40724f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 --2- 172.21.15.7:0/1920457452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80b40b5130 0x7f80b415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 >> 172.21.15.7:0/1920457452 conn(0x7f80b40b2300 msgr2=0x7f80b4158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 shutdown_connections 2024-08-19T00:39:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:30.487+0000 7f80b9400640 1 -- 172.21.15.7:0/1920457452 wait complete. 2024-08-19T00:39:30.508 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:39:30.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:39:30.616 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:39:30.719 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:39:30.720 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:30.720 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:30.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:39:30.756 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:39:30.756 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:30.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:39:30.796 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:30.797 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:30.832 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:39:30.833 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:39:30.833 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:30.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:39:30.876 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-19T00:39:30.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:31.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.032+0000 7f3ee2800640 1 Processor -- start 2024-08-19T00:39:31.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.032+0000 7f3ee2800640 1 -- start start 2024-08-19T00:39:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.033+0000 7f3ee2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3edc0d03c0 0x7f3edc071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.033+0000 7f3ee2800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc0cdfb0 con 0x7f3edc0b3750 2024-08-19T00:39:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.033+0000 7f3ee2800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc0ce290 con 0x7f3edc06e710 2024-08-19T00:39:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.033+0000 7f3ee2800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3edc0cebc0 con 0x7f3edc0d03c0 2024-08-19T00:39:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.034+0000 7f3edb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3edc0d03c0 0x7f3edc071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.034+0000 7f3edb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3edc0d03c0 0x7f3edc071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41574/0 (socket says 172.21.15.7:41574) 2024-08-19T00:39:31.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.034+0000 7f3edb400640 1 -- 172.21.15.7:0/625260635 learned_addr learned my addr 172.21.15.7:0/625260635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:31.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.034+0000 7f3edbe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3edc0b3750 0x7f3edc0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53912/0 (socket says 172.21.15.7:53912) 2024-08-19T00:39:31.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.034+0000 7f3edb400640 1 -- 172.21.15.7:0/625260635 >> v1:172.21.15.162:6789/0 conn(0x7f3edc06e710 legacy=0x7f3edc0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.034+0000 7f3edb400640 1 -- 172.21.15.7:0/625260635 >> v1:172.21.15.7:6789/0 conn(0x7f3edc0b3750 legacy=0x7f3edc0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.034+0000 7f3edb400640 1 -- 172.21.15.7:0/625260635 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc0ce570 con 0x7f3edc0d03c0 2024-08-19T00:39:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.035+0000 7f3edb400640 1 --2- 172.21.15.7:0/625260635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc071980 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098a0 tx=0x7f3ecc02a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e5f4553681bee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.035+0000 7f3edaa00640 1 -- 172.21.15.7:0/625260635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc037070 con 0x7f3edc0d03c0 2024-08-19T00:39:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.035+0000 7f3edaa00640 1 -- 172.21.15.7:0/625260635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc032640 con 0x7f3edc0d03c0 2024-08-19T00:39:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.035+0000 7f3edaa00640 1 -- 172.21.15.7:0/625260635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc032a10 con 0x7f3edc0d03c0 2024-08-19T00:39:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.036+0000 7f3ee2800640 1 -- 172.21.15.7:0/625260635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 msgr2=0x7f3edc071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.036+0000 7f3ee2800640 1 --2- 172.21.15.7:0/625260635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc071980 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098a0 tx=0x7f3ecc02a320 comp rx=0 tx=0).stop 2024-08-19T00:39:31.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.036+0000 7f3ee2800640 1 -- 172.21.15.7:0/625260635 shutdown_connections 2024-08-19T00:39:31.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.036+0000 7f3ee2800640 1 --2- 172.21.15.7:0/625260635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc071980 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.036+0000 7f3ee2800640 1 -- 172.21.15.7:0/625260635 >> 172.21.15.7:0/625260635 conn(0x7f3edc06bc70 msgr2=0x7f3edc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:31.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.036+0000 7f3ee2800640 1 -- 172.21.15.7:0/625260635 shutdown_connections 2024-08-19T00:39:31.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.036+0000 7f3ee2800640 1 -- 172.21.15.7:0/625260635 wait complete. 2024-08-19T00:39:31.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.038+0000 7f3ee2800640 1 Processor -- start 2024-08-19T00:39:31.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.038+0000 7f3ee2800640 1 -- start start 2024-08-19T00:39:31.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3ee2800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc06e710 0x7f3edc15de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3ee2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0b3750 0x7f3edc153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3ee2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3ee2800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc073c60 con 0x7f3edc0d03c0 2024-08-19T00:39:31.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3ee2800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc073ae0 con 0x7f3edc0b3750 2024-08-19T00:39:31.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3ee2800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0b3be0 con 0x7f3edc06e710 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3edbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3edbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc1536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41586/0 (socket says 172.21.15.7:41586) 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3edbe00640 1 -- 172.21.15.7:0/3837595072 learned_addr learned my addr 172.21.15.7:0/3837595072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3ed3e00640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0b3750 0x7f3edc153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.039+0000 7f3edb400640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc06e710 0x7f3edc15de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3edbe00640 1 -- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc06e710 msgr2=0x7f3edc15de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3edbe00640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc06e710 0x7f3edc15de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3edbe00640 1 -- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0b3750 msgr2=0x7f3edc153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3edbe00640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0b3750 0x7f3edc153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3edbe00640 1 -- 172.21.15.7:0/3837595072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc15e400 con 0x7f3edc0d03c0 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3edb400640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc06e710 0x7f3edc15de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3edbe00640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc1536d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400c780 tx=0x7f3ed400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3ed3400640 1 -- 172.21.15.7:0/3837595072 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4017070 con 0x7f3edc0d03c0 2024-08-19T00:39:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3ed3400640 1 -- 172.21.15.7:0/3837595072 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed400a640 con 0x7f3edc0d03c0 2024-08-19T00:39:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3ed3400640 1 -- 172.21.15.7:0/3837595072 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400aa30 con 0x7f3edc0d03c0 2024-08-19T00:39:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3edc1f79e0 con 0x7f3edc0d03c0 2024-08-19T00:39:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.040+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3edc1f7fa0 con 0x7f3edc0d03c0 2024-08-19T00:39:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.041+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3edc071980 con 0x7f3edc0d03c0 2024-08-19T00:39:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.042+0000 7f3ed3400640 1 -- 172.21.15.7:0/3837595072 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ed401a070 con 0x7f3edc0d03c0 2024-08-19T00:39:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.043+0000 7f3ed3400640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.043+0000 7f3ed3400640 1 -- 172.21.15.7:0/3837595072 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f3ed408a120 con 0x7f3edc0d03c0 2024-08-19T00:39:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.044+0000 7f3edb400640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.044+0000 7f3edb400640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc034000 tx=0x7f3ecc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:31.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.048+0000 7f3ed3400640 1 -- 172.21.15.7:0/3837595072 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3ed4058710 con 0x7f3edc0d03c0 2024-08-19T00:39:31.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.269+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3edc15acb0 con 0x7f3edc0d03c0 2024-08-19T00:39:31.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.269+0000 7f3ed3400640 1 -- 172.21.15.7:0/3837595072 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+3908 (secure 0 0 0) 0x7f3ed405ca10 con 0x7f3edc0d03c0 2024-08-19T00:39:31.271 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:31.271 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"btime":"2024-08-19T00:39:24:073168+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3334968290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3334968290},{"type":"v1","addr":"172.21.15.162:6835","nonce":3334968290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5310,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/899264276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":899264276},{"type":"v1","addr":"172.21.15.7:6836","nonce":899264276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3675670225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3675670225},{"type":"v1","addr":"172.21.15.162:6834","nonce":3675670225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2669984385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2669984385},{"type":"v1","addr":"172.21.15.7:6837","nonce":2669984385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[]} 2024-08-19T00:39:31.271 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 39 2024-08-19T00:39:31.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 msgr2=0x7f3eb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc034000 tx=0x7f3ecc02e000 comp rx=0 tx=0).stop 2024-08-19T00:39:31.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 msgr2=0x7f3edc1536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc1536d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400c780 tx=0x7f3ed400cc40 comp rx=0 tx=0).stop 2024-08-19T00:39:31.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 shutdown_connections 2024-08-19T00:39:31.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc0d03c0 0x7f3edc1536d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0b3750 0x7f3edc153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 --2- 172.21.15.7:0/3837595072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc06e710 0x7f3edc15de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.271+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 >> 172.21.15.7:0/3837595072 conn(0x7f3edc06bc70 msgr2=0x7f3edc0af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:31.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.272+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 shutdown_connections 2024-08-19T00:39:31.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.272+0000 7f3ee2800640 1 -- 172.21.15.7:0/3837595072 wait complete. 2024-08-19T00:39:31.290 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:39:31.290 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-19T00:39:31.290 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:39:31.290 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:39:31.290 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:39:31.290 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-19T00:39:31.291 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:39:31.291 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:39:31.291 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-19T00:39:31.291 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-19T00:39:31.291 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-19T00:39:31.291 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:39:31.291 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-19T00:39:31.292 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-19T00:39:31.292 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-19T00:39:31.292 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:39:31.305 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:39:31.306 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:39:31.306 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:39:31.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:39:31.308 INFO:tasks.ceph.mds.b:Stopped 2024-08-19T00:39:31.308 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-19T00:39:31.309 INFO:tasks.ceph.mds.d:Stopped 2024-08-19T00:39:31.309 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-19T00:39:31.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:39:31.351 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:39:31.351 DEBUG:teuthology.parallel:result is None 2024-08-19T00:39:31.353 INFO:tasks.ceph.mds.b:Started 2024-08-19T00:39:31.354 DEBUG:teuthology.parallel:result is None 2024-08-19T00:39:31.355 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:39:31.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:39:31.356 DEBUG:teuthology.parallel:result is None 2024-08-19T00:39:31.357 INFO:tasks.ceph.mds.d:Started 2024-08-19T00:39:31.357 DEBUG:teuthology.parallel:result is None 2024-08-19T00:39:31.357 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-19T00:39:31.485 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:39:31.485 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:39:31.486 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:39:31.486 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:39:31.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.562+0000 7f37c6a00640 1 Processor -- start 2024-08-19T00:39:31.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.562+0000 7f37c6a00640 1 -- start start 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37c00d27b0 0x7f37c00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c00b4150 0x7f37c00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c6a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c00b4b20 con 0x7f37c015e3e0 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c6a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f37c00d3140 con 0x7f37c00d27b0 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c6a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37c00b4df0 con 0x7f37c00b4150 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37c00d27b0 0x7f37c00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37c00d27b0 0x7f37c00d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41648/0 (socket says 172.21.15.7:41648) 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c4c00640 1 -- 172.21.15.7:0/2838568423 learned_addr learned my addr 172.21.15.7:0/2838568423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.563+0000 7f37c6000640 1 --2- 172.21.15.7:0/2838568423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c00b4150 0x7f37c00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.564+0000 7f37c4c00640 1 -- 172.21.15.7:0/2838568423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c00b4150 msgr2=0x7f37c00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:31.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.564+0000 7f37c4c00640 1 --2- 172.21.15.7:0/2838568423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c00b4150 0x7f37c00b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.564+0000 7f37c4c00640 1 -- 172.21.15.7:0/2838568423 >> v1:172.21.15.162:6789/0 conn(0x7f37c015e3e0 legacy=0x7f37c00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.564+0000 7f37c4c00640 1 -- 172.21.15.7:0/2838568423 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c00b50d0 con 0x7f37c00d27b0 2024-08-19T00:39:31.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.564+0000 7f37bfe00640 1 -- 172.21.15.7:0/2838568423 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807143501 0 0) 0x7f37c00b4b20 con 0x7f37c015e3e0 2024-08-19T00:39:31.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.565+0000 7f37c4c00640 1 --2- 172.21.15.7:0/2838568423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00d27b0 0x7f37c00d2c00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098a0 tx=0x7f37ac02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfc4923ba5c58db server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:31.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.565+0000 7f37bfe00640 1 -- 172.21.15.7:0/2838568423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac037070 con 0x7f37c00d27b0 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.565+0000 7f37bfe00640 1 -- 172.21.15.7:0/2838568423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac032440 con 0x7f37c00d27b0 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.565+0000 7f37bfe00640 1 -- 172.21.15.7:0/2838568423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac032810 con 0x7f37c00d27b0 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 -- 172.21.15.7:0/2838568423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00d27b0 msgr2=0x7f37c00d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 --2- 172.21.15.7:0/2838568423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00d27b0 0x7f37c00d2c00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098a0 tx=0x7f37ac02a290 comp rx=0 tx=0).stop 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 -- 172.21.15.7:0/2838568423 shutdown_connections 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 --2- 172.21.15.7:0/2838568423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c00b4150 0x7f37c00b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 --2- 172.21.15.7:0/2838568423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00d27b0 0x7f37c00d2c00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 -- 172.21.15.7:0/2838568423 >> 172.21.15.7:0/2838568423 conn(0x7f37c008dbe0 msgr2=0x7f37c009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 -- 172.21.15.7:0/2838568423 shutdown_connections 2024-08-19T00:39:31.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.566+0000 7f37c6a00640 1 -- 172.21.15.7:0/2838568423 wait complete. 2024-08-19T00:39:31.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.567+0000 7f37c6a00640 1 Processor -- start 2024-08-19T00:39:31.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.567+0000 7f37c6a00640 1 -- start start 2024-08-19T00:39:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.568+0000 7f37c6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00b4150 0x7f37c009ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.568+0000 7f37c6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c00d27b0 0x7f37c0153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.568+0000 7f37c6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c015e3e0 0x7f37c00b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.568+0000 7f37c6a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37c00cee90 con 0x7f37c00b4150 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.568+0000 7f37c6a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37c00cf4c0 con 0x7f37c00d27b0 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.568+0000 7f37c6a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37c00cf9e0 con 0x7f37c015e3e0 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00b4150 0x7f37c009ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00b4150 0x7f37c009ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41664/0 (socket says 172.21.15.7:41664) 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 -- 172.21.15.7:0/1693762854 learned_addr learned my addr 172.21.15.7:0/1693762854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 -- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c015e3e0 msgr2=0x7f37c00b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c6000640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c015e3e0 0x7f37c00b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c4c00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c00d27b0 0x7f37c0153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c015e3e0 0x7f37c00b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 -- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c00d27b0 msgr2=0x7f37c0153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:31.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c00d27b0 0x7f37c0153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:31.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 -- 172.21.15.7:0/1693762854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c0153dc0 con 0x7f37c00b4150 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c6000640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c015e3e0 0x7f37c00b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c4c00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c00d27b0 0x7f37c0153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.569+0000 7f37c5600640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00b4150 0x7f37c009ee80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c410 tx=0x7f37b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.570+0000 7f37bd600640 1 -- 172.21.15.7:0/1693762854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4017070 con 0x7f37c00b4150 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.570+0000 7f37bd600640 1 -- 172.21.15.7:0/1693762854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b40035f0 con 0x7f37c00b4150 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.570+0000 7f37bd600640 1 -- 172.21.15.7:0/1693762854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b40039e0 con 0x7f37c00b4150 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.570+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c00b9390 con 0x7f37c00b4150 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.570+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c009f820 con 0x7f37c00b4150 2024-08-19T00:39:31.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.571+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c00d2c00 con 0x7f37c00b4150 2024-08-19T00:39:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.572+0000 7f37bd600640 1 -- 172.21.15.7:0/1693762854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37b401a070 con 0x7f37c00b4150 2024-08-19T00:39:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.573+0000 7f37bd600640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37a006be30 0x7f37a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.573+0000 7f37bd600640 1 -- 172.21.15.7:0/1693762854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5029+0+0 (secure 0 0 0) 0x7f37b408a0c0 con 0x7f37c00b4150 2024-08-19T00:39:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.573+0000 7f37c4c00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37a006be30 0x7f37a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:31.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.573+0000 7f37c4c00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37a006be30 0x7f37a006e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f37ac034000 tx=0x7f37ac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:31.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.577+0000 7f37bd600640 1 -- 172.21.15.7:0/1693762854 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f37c0153dc0 con 0x7f37c00b4150 2024-08-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:31.774+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f37c00b4810 con 0x7f37c00b4150 2024-08-19T00:39:32.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.109+0000 7f37bd600640 1 -- 172.21.15.7:0/1693762854 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f37b4058c70 con 0x7f37c00b4150 2024-08-19T00:39:32.111 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37a006be30 msgr2=0x7f37a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37a006be30 0x7f37a006e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f37ac034000 tx=0x7f37ac02e000 comp rx=0 tx=0).stop 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00b4150 msgr2=0x7f37c009ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00b4150 0x7f37c009ee80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c410 tx=0x7f37b400c8d0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 shutdown_connections 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37a006be30 0x7f37a006e2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37c015e3e0 0x7f37c00b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c00d27b0 0x7f37c0153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 --2- 172.21.15.7:0/1693762854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c00b4150 0x7f37c009ee80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 >> 172.21.15.7:0/1693762854 conn(0x7f37c008dbe0 msgr2=0x7f37c00b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 shutdown_connections 2024-08-19T00:39:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.113+0000 7f37c6a00640 1 -- 172.21.15.7:0/1693762854 wait complete. 2024-08-19T00:39:32.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.330+0000 7f7849600640 1 Processor -- start 2024-08-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.330+0000 7f7849600640 1 -- start start 2024-08-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.331+0000 7f7849600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f784406d600 0x7f784406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.331+0000 7f7849600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784415e640 0x7f784415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.331+0000 7f7849600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784415f010 con 0x7f7844147ac0 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.331+0000 7f7849600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7844072d80 con 0x7f784406d600 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.331+0000 7f7849600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f78440b4990 con 0x7f784415e640 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f783be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f784406d600 0x7f784406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f7848c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784415e640 0x7f784415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f7843e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7844147ac0 0x7f78440b4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:54518/0 (socket says 172.21.15.7:54518) 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f7843e00640 1 -- 172.21.15.7:0/680177706 learned_addr learned my addr 172.21.15.7:0/680177706 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f7848c00640 1 -- 172.21.15.7:0/680177706 >> v2:172.21.15.162:3300/0 conn(0x7f784406d600 msgr2=0x7f784406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f7848c00640 1 --2- 172.21.15.7:0/680177706 >> v2:172.21.15.162:3300/0 conn(0x7f784406d600 0x7f784406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f7848c00640 1 -- 172.21.15.7:0/680177706 >> v1:172.21.15.162:6789/0 conn(0x7f7844147ac0 legacy=0x7f78440b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f7848c00640 1 -- 172.21.15.7:0/680177706 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784415f290 con 0x7f784415e640 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.332+0000 7f783be00640 1 --2- 172.21.15.7:0/680177706 >> v2:172.21.15.162:3300/0 conn(0x7f784406d600 0x7f784406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.333+0000 7f7848c00640 1 --2- 172.21.15.7:0/680177706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784415e640 0x7f784415ead0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f783c009d90 tx=0x7f783c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb80c28bb6d406f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.333+0000 7f7843400640 1 -- 172.21.15.7:0/680177706 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c031600 con 0x7f784415e640 2024-08-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.333+0000 7f7843400640 1 -- 172.21.15.7:0/680177706 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c0317a0 con 0x7f784415e640 2024-08-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.333+0000 7f7843400640 1 -- 172.21.15.7:0/680177706 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c031b70 con 0x7f784415e640 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 -- 172.21.15.7:0/680177706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784415e640 msgr2=0x7f784415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 --2- 172.21.15.7:0/680177706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784415e640 0x7f784415ead0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f783c009d90 tx=0x7f783c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 -- 172.21.15.7:0/680177706 shutdown_connections 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 --2- 172.21.15.7:0/680177706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784415e640 0x7f784415ead0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 --2- 172.21.15.7:0/680177706 >> v2:172.21.15.162:3300/0 conn(0x7f784406d600 0x7f784406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 -- 172.21.15.7:0/680177706 >> 172.21.15.7:0/680177706 conn(0x7f784406b850 msgr2=0x7f784406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 -- 172.21.15.7:0/680177706 shutdown_connections 2024-08-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.334+0000 7f7849600640 1 -- 172.21.15.7:0/680177706 wait complete. 2024-08-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.336+0000 7f7849600640 1 Processor -- start 2024-08-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.336+0000 7f7849600640 1 -- start start 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7849600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784406d600 0x7f7844142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7849600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7844147ac0 0x7f78441400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7849600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784415e640 0x7f78440c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7849600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78440b4340 con 0x7f784415e640 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7849600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f784406df80 con 0x7f7844147ac0 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7849600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f78440b4620 con 0x7f784406d600 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7848c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784415e640 0x7f78440c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7848c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784415e640 0x7f78440c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41674/0 (socket says 172.21.15.7:41674) 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7848c00640 1 -- 172.21.15.7:0/2010910696 learned_addr learned my addr 172.21.15.7:0/2010910696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f7843e00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784406d600 0x7f7844142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.337+0000 7f783be00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7844147ac0 0x7f78441400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7843e00640 1 -- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7844147ac0 msgr2=0x7f78441400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7843e00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7844147ac0 0x7f78441400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7843e00640 1 -- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784415e640 msgr2=0x7f78440c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7843e00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784415e640 0x7f78440c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7843e00640 1 -- 172.21.15.7:0/2010910696 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78441425b0 con 0x7f784406d600 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7848c00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784415e640 0x7f78440c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7843e00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784406d600 0x7f7844142070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f783400c440 tx=0x7f7834001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7840c00640 1 -- 172.21.15.7:0/2010910696 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834017070 con 0x7f784406d600 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7840c00640 1 -- 172.21.15.7:0/2010910696 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834005ce0 con 0x7f784406d600 2024-08-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7840c00640 1 -- 172.21.15.7:0/2010910696 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340072d0 con 0x7f784406d600 2024-08-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.338+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784412eea0 con 0x7f784406d600 2024-08-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.339+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f784412f460 con 0x7f784406d600 2024-08-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.340+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784406da40 con 0x7f784406d600 2024-08-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.341+0000 7f7840c00640 1 -- 172.21.15.7:0/2010910696 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f783401a070 con 0x7f784406d600 2024-08-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.341+0000 7f7840c00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f782006be30 0x7f782006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.342+0000 7f7840c00640 1 -- 172.21.15.7:0/2010910696 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f7834089dd0 con 0x7f784406d600 2024-08-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.342+0000 7f783be00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f782006be30 0x7f782006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.342+0000 7f783be00640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f782006be30 0x7f782006e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f782c009560 tx=0x7f782c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.347+0000 7f7840c00640 1 -- 172.21.15.7:0/2010910696 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f784415f010 con 0x7f784406d600 2024-08-19T00:39:32.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.600+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f78440aed30 con 0x7f784406d600 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.601+0000 7f7840c00640 1 -- 172.21.15.7:0/2010910696 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f78340583e0 con 0x7f784406d600 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g==", 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.603 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA==", 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ==", 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-08-19T00:39:32.605 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA==", 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA==", 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.606 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ==", 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ==", 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w==", 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.608 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg==", 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ==", 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA==", 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.610 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA==", 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA==", 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA==", 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.612 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ==", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:39:32.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg==", 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:39:32.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8Jmuq0sEBAA7n5q8IKlS3tRogqIwCSCeQ==", 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:39:32.615 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ==", 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-08-19T00:39:32.616 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg==", 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-08-19T00:39:32.617 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:39:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.603+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f782006be30 msgr2=0x7f782006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.603+0000 7f7849600640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f782006be30 0x7f782006e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f782c009560 tx=0x7f782c009190 comp rx=0 tx=0).stop 2024-08-19T00:39:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.603+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784406d600 msgr2=0x7f7844142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.603+0000 7f7849600640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784406d600 0x7f7844142070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f783400c440 tx=0x7f7834001e70 comp rx=0 tx=0).stop 2024-08-19T00:39:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 shutdown_connections 2024-08-19T00:39:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f782006be30 0x7f782006e2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784415e640 0x7f78440c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7844147ac0 0x7f78441400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 --2- 172.21.15.7:0/2010910696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784406d600 0x7f7844142070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 >> 172.21.15.7:0/2010910696 conn(0x7f784406b850 msgr2=0x7f7844074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 shutdown_connections 2024-08-19T00:39:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.604+0000 7f7849600640 1 -- 172.21.15.7:0/2010910696 wait complete. 2024-08-19T00:39:32.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-19T00:39:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.777+0000 7f41c8c00640 1 Processor -- start 2024-08-19T00:39:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.777+0000 7f41c8c00640 1 -- start start 2024-08-19T00:39:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.778+0000 7f41c8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.778+0000 7f41c8c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f41c415d490 0x7f41c40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.778+0000 7f41c8c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c40ccd40 con 0x7f41c415c510 2024-08-19T00:39:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.778+0000 7f41c8c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f41c415d210 con 0x7f41c415d490 2024-08-19T00:39:32.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.778+0000 7f41c8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41c409b370 con 0x7f41c415c8f0 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c2800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f41c415d490 0x7f41c40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c1e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41b9400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f41c415c510 0x7f41c409aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:54526/0 (socket says 172.21.15.7:54526) 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41b9400640 1 -- 172.21.15.7:0/2599958301 learned_addr learned my addr 172.21.15.7:0/2599958301 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c2800640 1 -- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 msgr2=0x7f41c415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c2800640 1 --2- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c2800640 1 -- 172.21.15.7:0/2599958301 >> v1:172.21.15.162:6789/0 conn(0x7f41c415c510 legacy=0x7f41c409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c2800640 1 -- 172.21.15.7:0/2599958301 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c409b650 con 0x7f41c415d490 2024-08-19T00:39:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c1400640 1 -- 172.21.15.7:0/2599958301 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551405220 0 0) 0x7f41c40ccd40 con 0x7f41c415c510 2024-08-19T00:39:32.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.779+0000 7f41c1e00640 1 --2- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.780+0000 7f41c2800640 1 --2- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415d490 0x7f41c40cd220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77422da4d67e6345 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c1400640 1 -- 172.21.15.7:0/2599958301 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007740 con 0x7f41c415d490 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c1400640 1 -- 172.21.15.7:0/2599958301 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc0078e0 con 0x7f41c415d490 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c1400640 1 -- 172.21.15.7:0/2599958301 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007cb0 con 0x7f41c415d490 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 -- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415d490 msgr2=0x7f41c40cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 --2- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415d490 0x7f41c40cd220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc02a680 comp rx=0 tx=0).stop 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 -- 172.21.15.7:0/2599958301 shutdown_connections 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 --2- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415d490 0x7f41c40cd220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 --2- 172.21.15.7:0/2599958301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 -- 172.21.15.7:0/2599958301 >> 172.21.15.7:0/2599958301 conn(0x7f41c40d2190 msgr2=0x7f41c40d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:32.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 -- 172.21.15.7:0/2599958301 shutdown_connections 2024-08-19T00:39:32.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.781+0000 7f41c8c00640 1 -- 172.21.15.7:0/2599958301 wait complete. 2024-08-19T00:39:32.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.783+0000 7f41c8c00640 1 Processor -- start 2024-08-19T00:39:32.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.783+0000 7f41c8c00640 1 -- start start 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415c510 0x7f41c40c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c40b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41c415d490 0x7f41c40b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c8c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41c40cd760 con 0x7f41c415d490 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41c409bc10 con 0x7f41c415c510 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41c40cd8e0 con 0x7f41c415c8f0 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41c415d490 0x7f41c40b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41c415d490 0x7f41c40b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41690/0 (socket says 172.21.15.7:41690) 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c2800640 1 -- 172.21.15.7:0/449995616 learned_addr learned my addr 172.21.15.7:0/449995616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41c1e00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415c510 0x7f41c40c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.784+0000 7f41b9400640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c40b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c2800640 1 -- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 msgr2=0x7f41c40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c2800640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c40b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c2800640 1 -- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415c510 msgr2=0x7f41c40c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c2800640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415c510 0x7f41c40c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c2800640 1 -- 172.21.15.7:0/449995616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c40c7a40 con 0x7f41c415d490 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c1e00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415c510 0x7f41c40c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c2800640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41c415d490 0x7f41c40b5580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41baa00640 1 -- 172.21.15.7:0/449995616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc03f070 con 0x7f41c415d490 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41baa00640 1 -- 172.21.15.7:0/449995616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc031c40 con 0x7f41c415d490 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41baa00640 1 -- 172.21.15.7:0/449995616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc009410 con 0x7f41c415d490 2024-08-19T00:39:32.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c40c7d20 con 0x7f41c415d490 2024-08-19T00:39:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.785+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c4148b10 con 0x7f41c415d490 2024-08-19T00:39:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.787+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c4075750 con 0x7f41c415d490 2024-08-19T00:39:32.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.787+0000 7f41baa00640 1 -- 172.21.15.7:0/449995616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41bc003990 con 0x7f41c415d490 2024-08-19T00:39:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.788+0000 7f41baa00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41a006be30 0x7f41a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.788+0000 7f41baa00640 1 -- 172.21.15.7:0/449995616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f41bc0ab8d0 con 0x7f41c415d490 2024-08-19T00:39:32.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.789+0000 7f41c1e00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41a006be30 0x7f41a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:32.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.789+0000 7f41c1e00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41a006be30 0x7f41a006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009560 tx=0x7f41b4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.793+0000 7f41baa00640 1 -- 172.21.15.7:0/449995616 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f41c4075750 con 0x7f41c415d490 2024-08-19T00:39:32.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.979+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f41c415ccd0 con 0x7f41c415d490 2024-08-19T00:39:32.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.980+0000 7f41baa00640 1 -- 172.21.15.7:0/449995616 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7f41bc079ee0 con 0x7f41c415d490 2024-08-19T00:39:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:32.982 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:39:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:39:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-08-19T00:39:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-08-19T00:39:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:39:32.982 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:39:32.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41a006be30 msgr2=0x7f41a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41a006be30 0x7f41a006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009560 tx=0x7f41b4009190 comp rx=0 tx=0).stop 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41c415d490 msgr2=0x7f41c40b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41c415d490 0x7f41c40b5580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 shutdown_connections 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f41a006be30 0x7f41a006e2f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41c415d490 0x7f41c40b5580 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41c415c8f0 0x7f41c40b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 --2- 172.21.15.7:0/449995616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c415c510 0x7f41c40c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 >> 172.21.15.7:0/449995616 conn(0x7f41c40d2190 msgr2=0x7f41c4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 shutdown_connections 2024-08-19T00:39:32.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:32.982+0000 7f41c8c00640 1 -- 172.21.15.7:0/449995616 wait complete. 2024-08-19T00:39:33.000 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:39:33.000 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:39:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.161+0000 7faa3b200640 1 Processor -- start 2024-08-19T00:39:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.161+0000 7faa3b200640 1 -- start start 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.162+0000 7faa3b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa34162d40 0x7faa340d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.162+0000 7faa3b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faa340d1120 0x7faa340ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.162+0000 7faa3b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa34163120 con 0x7faa340d4ff0 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.162+0000 7faa3b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7faa340d1700 con 0x7faa340d1120 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.162+0000 7faa3b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa340d25d0 con 0x7faa34162d40 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa39200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faa340d1120 0x7faa340ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa39200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faa340d1120 0x7faa340ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41704/0 (socket says 172.21.15.7:41704) 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa39200640 1 -- 172.21.15.7:0/1246363267 learned_addr learned my addr 172.21.15.7:0/1246363267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa33e00640 1 --2- 172.21.15.7:0/1246363267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa34162d40 0x7faa340d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa39200640 1 -- 172.21.15.7:0/1246363267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa34162d40 msgr2=0x7faa340d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa39200640 1 --2- 172.21.15.7:0/1246363267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa34162d40 0x7faa340d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa39200640 1 -- 172.21.15.7:0/1246363267 >> v1:172.21.15.162:6789/0 conn(0x7faa340d4ff0 legacy=0x7faa340d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.163+0000 7faa39200640 1 -- 172.21.15.7:0/1246363267 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa340b4fa0 con 0x7faa340d1120 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.164+0000 7faa39200640 1 --2- 172.21.15.7:0/1246363267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa340d1120 0x7faa340ceea0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009e50 tx=0x7faa2c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e813a0e7a106b99b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.164+0000 7faa32a00640 1 -- 172.21.15.7:0/1246363267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c036070 con 0x7faa340d1120 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.164+0000 7faa32a00640 1 -- 172.21.15.7:0/1246363267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2c031600 con 0x7faa340d1120 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.164+0000 7faa32a00640 1 -- 172.21.15.7:0/1246363267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c0319d0 con 0x7faa340d1120 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 -- 172.21.15.7:0/1246363267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa340d1120 msgr2=0x7faa340ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 --2- 172.21.15.7:0/1246363267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa340d1120 0x7faa340ceea0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009e50 tx=0x7faa2c02a680 comp rx=0 tx=0).stop 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 -- 172.21.15.7:0/1246363267 shutdown_connections 2024-08-19T00:39:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 --2- 172.21.15.7:0/1246363267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa340d1120 0x7faa340ceea0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 --2- 172.21.15.7:0/1246363267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa34162d40 0x7faa340d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 -- 172.21.15.7:0/1246363267 >> 172.21.15.7:0/1246363267 conn(0x7faa3409d6f0 msgr2=0x7faa340d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 -- 172.21.15.7:0/1246363267 shutdown_connections 2024-08-19T00:39:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.165+0000 7faa3b200640 1 -- 172.21.15.7:0/1246363267 wait complete. 2024-08-19T00:39:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.167+0000 7faa3b200640 1 Processor -- start 2024-08-19T00:39:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.167+0000 7faa3b200640 1 -- start start 2024-08-19T00:39:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa3b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa340d1120 0x7faa341f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa3b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa340d4ff0 0x7faa341f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa3b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa34162d40 0x7faa340ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa3b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa340b56e0 con 0x7faa34162d40 2024-08-19T00:39:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa3b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa340b5560 con 0x7faa340d4ff0 2024-08-19T00:39:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa3b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa340cf3e0 con 0x7faa340d1120 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa34162d40 0x7faa340ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa34162d40 0x7faa340ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41720/0 (socket says 172.21.15.7:41720) 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 -- 172.21.15.7:0/810752392 learned_addr learned my addr 172.21.15.7:0/810752392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa33e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa340d1120 0x7faa341f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa33400640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa340d4ff0 0x7faa341f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 -- 172.21.15.7:0/810752392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa340d1120 msgr2=0x7faa341f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa340d1120 0x7faa341f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 -- 172.21.15.7:0/810752392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa340d4ff0 msgr2=0x7faa341f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa340d4ff0 0x7faa341f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.168+0000 7faa39200640 1 -- 172.21.15.7:0/810752392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa341f7df0 con 0x7faa34162d40 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.169+0000 7faa39200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa34162d40 0x7faa340ca2e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7faa2c034040 tx=0x7faa2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:33.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.169+0000 7faa2be00640 1 -- 172.21.15.7:0/810752392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c036050 con 0x7faa34162d40 2024-08-19T00:39:33.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.169+0000 7faa2be00640 1 -- 172.21.15.7:0/810752392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2c042070 con 0x7faa34162d40 2024-08-19T00:39:33.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.169+0000 7faa2be00640 1 -- 172.21.15.7:0/810752392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c009510 con 0x7faa34162d40 2024-08-19T00:39:33.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.169+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa340cadd0 con 0x7faa34162d40 2024-08-19T00:39:33.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.169+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3415cb50 con 0x7faa34162d40 2024-08-19T00:39:33.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.170+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3415c6a0 con 0x7faa34162d40 2024-08-19T00:39:33.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.171+0000 7faa2be00640 1 -- 172.21.15.7:0/810752392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa2c007bf0 con 0x7faa34162d40 2024-08-19T00:39:33.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.172+0000 7faa2be00640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa1406be30 0x7faa1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:33.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.172+0000 7faa2be00640 1 -- 172.21.15.7:0/810752392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7faa2c0ab810 con 0x7faa34162d40 2024-08-19T00:39:33.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.173+0000 7faa33e00640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa1406be30 0x7faa1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:33.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.173+0000 7faa33e00640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa1406be30 0x7faa1406e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa24009aa0 tx=0x7faa24009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:33.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.177+0000 7faa2be00640 1 -- 172.21.15.7:0/810752392 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faa2c079eb0 con 0x7faa34162d40 2024-08-19T00:39:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:33.361+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7faa340ceea0 con 0x7faa34162d40 2024-08-19T00:39:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.118+0000 7faa2be00640 1 -- 172.21.15.7:0/810752392 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7faa2c07e1b0 con 0x7faa34162d40 2024-08-19T00:39:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-08-19T00:39:34.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.121+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa1406be30 msgr2=0x7faa1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:34.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.121+0000 7faa3b200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa1406be30 0x7faa1406e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa24009aa0 tx=0x7faa24009190 comp rx=0 tx=0).stop 2024-08-19T00:39:34.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.121+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa34162d40 msgr2=0x7faa340ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.121+0000 7faa3b200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa34162d40 0x7faa340ca2e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7faa2c034040 tx=0x7faa2c004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 shutdown_connections 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa1406be30 0x7faa1406e2f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa34162d40 0x7faa340ca2e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa340d4ff0 0x7faa341f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 --2- 172.21.15.7:0/810752392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa340d1120 0x7faa341f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 >> 172.21.15.7:0/810752392 conn(0x7faa3409d6f0 msgr2=0x7faa340d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 shutdown_connections 2024-08-19T00:39:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.122+0000 7faa3b200640 1 -- 172.21.15.7:0/810752392 wait complete. 2024-08-19T00:39:34.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:39:34.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.312+0000 7f75f2400640 1 Processor -- start 2024-08-19T00:39:34.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.312+0000 7f75f2400640 1 -- start start 2024-08-19T00:39:34.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.313+0000 7f75f2400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75ec15e3e0 0x7f75ec0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:34.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.313+0000 7f75f2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec0d27b0 0x7f75ec0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:34.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.313+0000 7f75f2400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec0d3110 con 0x7f75ec0b4150 2024-08-19T00:39:34.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.313+0000 7f75f2400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec0b4df0 con 0x7f75ec15e3e0 2024-08-19T00:39:34.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.313+0000 7f75f2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0b50d0 con 0x7f75ec0d27b0 2024-08-19T00:39:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75f1000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75ec15e3e0 0x7f75ec0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75f1a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f75ec0b4150 0x7f75ec0b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45516/0 (socket says 172.21.15.7:45516) 2024-08-19T00:39:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75f1a00640 1 -- 172.21.15.7:0/1575363610 learned_addr learned my addr 172.21.15.7:0/1575363610 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75ebe00640 1 --2- 172.21.15.7:0/1575363610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec0d27b0 0x7f75ec0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75f1000640 1 -- 172.21.15.7:0/1575363610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec0d27b0 msgr2=0x7f75ec0d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75f1000640 1 --2- 172.21.15.7:0/1575363610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec0d27b0 0x7f75ec0d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75f1000640 1 -- 172.21.15.7:0/1575363610 >> v1:172.21.15.7:6789/0 conn(0x7f75ec0b4150 legacy=0x7f75ec0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75f1000640 1 -- 172.21.15.7:0/1575363610 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0cf1e0 con 0x7f75ec15e3e0 2024-08-19T00:39:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75ebe00640 1 --2- 172.21.15.7:0/1575363610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec0d27b0 0x7f75ec0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.314+0000 7f75eb400640 1 -- 172.21.15.7:0/1575363610 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005351586 0 0) 0x7f75ec0d3110 con 0x7f75ec0b4150 2024-08-19T00:39:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.315+0000 7f75f1000640 1 --2- 172.21.15.7:0/1575363610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec15e3e0 0x7f75ec0b0e60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f75e00097a0 tx=0x7f75e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae2950b77c5be1e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75eb400640 1 -- 172.21.15.7:0/1575363610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0037070 con 0x7f75ec15e3e0 2024-08-19T00:39:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75eb400640 1 -- 172.21.15.7:0/1575363610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e0032440 con 0x7f75ec15e3e0 2024-08-19T00:39:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75eb400640 1 -- 172.21.15.7:0/1575363610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0032810 con 0x7f75ec15e3e0 2024-08-19T00:39:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 -- 172.21.15.7:0/1575363610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec15e3e0 msgr2=0x7f75ec0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 --2- 172.21.15.7:0/1575363610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec15e3e0 0x7f75ec0b0e60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f75e00097a0 tx=0x7f75e002a180 comp rx=0 tx=0).stop 2024-08-19T00:39:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 -- 172.21.15.7:0/1575363610 shutdown_connections 2024-08-19T00:39:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 --2- 172.21.15.7:0/1575363610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec0d27b0 0x7f75ec0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 --2- 172.21.15.7:0/1575363610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec15e3e0 0x7f75ec0b0e60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 -- 172.21.15.7:0/1575363610 >> 172.21.15.7:0/1575363610 conn(0x7f75ec08dbe0 msgr2=0x7f75ec09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 -- 172.21.15.7:0/1575363610 shutdown_connections 2024-08-19T00:39:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.316+0000 7f75f2400640 1 -- 172.21.15.7:0/1575363610 wait complete. 2024-08-19T00:39:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.318+0000 7f75f2400640 1 Processor -- start 2024-08-19T00:39:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.318+0000 7f75f2400640 1 -- start start 2024-08-19T00:39:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec0b4150 0x7f75ec15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec0d27b0 0x7f75ec0b8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec15e3e0 0x7f75ec1e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0b13a0 con 0x7f75ec0b4150 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0cee90 con 0x7f75ec0d27b0 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0cf9e0 con 0x7f75ec15e3e0 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec0b4150 0x7f75ec15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec0b4150 0x7f75ec15cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41432/0 (socket says 172.21.15.7:41432) 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.319+0000 7f75f1000640 1 -- 172.21.15.7:0/1137964820 learned_addr learned my addr 172.21.15.7:0/1137964820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75ebe00640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec0d27b0 0x7f75ec0b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75f1a00640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec15e3e0 0x7f75ec1e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75f1000640 1 -- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec15e3e0 msgr2=0x7f75ec1e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75f1000640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec15e3e0 0x7f75ec1e9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75f1000640 1 -- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec0d27b0 msgr2=0x7f75ec0b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:34.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75f1000640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec0d27b0 0x7f75ec0b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:34.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75f1000640 1 -- 172.21.15.7:0/1137964820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0b71a0 con 0x7f75ec0b4150 2024-08-19T00:39:34.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75ebe00640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec0d27b0 0x7f75ec0b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75f1000640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec0b4150 0x7f75ec15cf60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f75e00097a0 tx=0x7f75e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75e8c00640 1 -- 172.21.15.7:0/1137964820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0037040 con 0x7f75ec0b4150 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.320+0000 7f75e8c00640 1 -- 172.21.15.7:0/1137964820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e0004030 con 0x7f75ec0b4150 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.321+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec0b7480 con 0x7f75ec0b4150 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.321+0000 7f75e8c00640 1 -- 172.21.15.7:0/1137964820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0006e10 con 0x7f75ec0b4150 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.321+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec0b7a40 con 0x7f75ec0b4150 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.322+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec0b0e60 con 0x7f75ec0b4150 2024-08-19T00:39:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.323+0000 7f75e8c00640 1 -- 172.21.15.7:0/1137964820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75e0030770 con 0x7f75ec0b4150 2024-08-19T00:39:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.324+0000 7f75e8c00640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f75cc06be30 0x7f75cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.324+0000 7f75e8c00640 1 -- 172.21.15.7:0/1137964820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7f75e00ac700 con 0x7f75ec0b4150 2024-08-19T00:39:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.324+0000 7f75ebe00640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f75cc06be30 0x7f75cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.325+0000 7f75ebe00640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f75cc06be30 0x7f75cc06e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f75d8006fd0 tx=0x7f75d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:34.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.328+0000 7f75e8c00640 1 -- 172.21.15.7:0/1137964820 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f75e007b390 con 0x7f75ec0b4150 2024-08-19T00:39:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:34.511+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f75ec0d1a40 con 0x7f75ec0b4150 2024-08-19T00:39:35.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.125+0000 7f75e8c00640 1 -- 172.21.15.7:0/1137964820 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f75e007ac90 con 0x7f75ec0b4150 2024-08-19T00:39:35.127 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-08-19T00:39:35.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.128+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f75cc06be30 msgr2=0x7f75cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:35.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.128+0000 7f75f2400640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f75cc06be30 0x7f75cc06e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f75d8006fd0 tx=0x7f75d8008040 comp rx=0 tx=0).stop 2024-08-19T00:39:35.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.128+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec0b4150 msgr2=0x7f75ec15cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:35.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.128+0000 7f75f2400640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec0b4150 0x7f75ec15cf60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f75e00097a0 tx=0x7f75e00046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 shutdown_connections 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f75cc06be30 0x7f75cc06e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec15e3e0 0x7f75ec1e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec0d27b0 0x7f75ec0b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 --2- 172.21.15.7:0/1137964820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75ec0b4150 0x7f75ec15cf60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 >> 172.21.15.7:0/1137964820 conn(0x7f75ec08dbe0 msgr2=0x7f75ec0b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 shutdown_connections 2024-08-19T00:39:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.129+0000 7f75f2400640 1 -- 172.21.15.7:0/1137964820 wait complete. 2024-08-19T00:39:35.164 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:39:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.326+0000 7f5569a00640 1 Processor -- start 2024-08-19T00:39:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.326+0000 7f5569a00640 1 -- start start 2024-08-19T00:39:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.327+0000 7f5569a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f556406d770 0x7f556406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.327+0000 7f5569a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640ccc40 0x7f55640b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.327+0000 7f5569a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556406e090 con 0x7f55640b5da0 2024-08-19T00:39:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.327+0000 7f5569a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f55640b6f70 con 0x7f556406d770 2024-08-19T00:39:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.327+0000 7f5569a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55640b7250 con 0x7f55640ccc40 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5562a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f556406d770 0x7f556406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5562000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f55640b5da0 0x7f55640b61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45520/0 (socket says 172.21.15.7:45520) 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5562000640 1 -- 172.21.15.7:0/1148274209 learned_addr learned my addr 172.21.15.7:0/1148274209 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5563400640 1 --2- 172.21.15.7:0/1148274209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640ccc40 0x7f55640b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5562a00640 1 -- 172.21.15.7:0/1148274209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640ccc40 msgr2=0x7f55640b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5562a00640 1 --2- 172.21.15.7:0/1148274209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640ccc40 0x7f55640b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5562a00640 1 -- 172.21.15.7:0/1148274209 >> v1:172.21.15.7:6789/0 conn(0x7f55640b5da0 legacy=0x7f55640b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.328+0000 7f5562a00640 1 -- 172.21.15.7:0/1148274209 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640cb430 con 0x7f556406d770 2024-08-19T00:39:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.329+0000 7f5562a00640 1 --2- 172.21.15.7:0/1148274209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f556406db50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f55540097a0 tx=0x7f555402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef7c6bcbe5391a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.329+0000 7f5561600640 1 -- 172.21.15.7:0/1148274209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554037070 con 0x7f556406d770 2024-08-19T00:39:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.329+0000 7f5561600640 1 -- 172.21.15.7:0/1148274209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554032440 con 0x7f556406d770 2024-08-19T00:39:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.329+0000 7f5561600640 1 -- 172.21.15.7:0/1148274209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554032810 con 0x7f556406d770 2024-08-19T00:39:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 -- 172.21.15.7:0/1148274209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 msgr2=0x7f556406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 --2- 172.21.15.7:0/1148274209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f556406db50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f55540097a0 tx=0x7f555402a180 comp rx=0 tx=0).stop 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 -- 172.21.15.7:0/1148274209 shutdown_connections 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 --2- 172.21.15.7:0/1148274209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640ccc40 0x7f55640b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 --2- 172.21.15.7:0/1148274209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f556406db50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 -- 172.21.15.7:0/1148274209 >> 172.21.15.7:0/1148274209 conn(0x7f55640d2180 msgr2=0x7f55640d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 -- 172.21.15.7:0/1148274209 shutdown_connections 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.330+0000 7f5569a00640 1 -- 172.21.15.7:0/1148274209 wait complete. 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.332+0000 7f5569a00640 1 Processor -- start 2024-08-19T00:39:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.332+0000 7f5569a00640 1 -- start start 2024-08-19T00:39:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5569a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f5564155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5569a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640b5da0 0x7f55641553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5569a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55640ccc40 0x7f55641f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5569a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f556415ea10 con 0x7f556406d770 2024-08-19T00:39:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5569a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f556406f9a0 con 0x7f55640ccc40 2024-08-19T00:39:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5569a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f556406d370 con 0x7f55640b5da0 2024-08-19T00:39:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5562a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f5564155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5562a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f5564155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41444/0 (socket says 172.21.15.7:41444) 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5562a00640 1 -- 172.21.15.7:0/1893361853 learned_addr learned my addr 172.21.15.7:0/1893361853 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5563400640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55640ccc40 0x7f55641f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.333+0000 7f5562000640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640b5da0 0x7f55641553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5562a00640 1 -- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640b5da0 msgr2=0x7f55641553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5562a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640b5da0 0x7f55641553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5562a00640 1 -- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55640ccc40 msgr2=0x7f55641f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5562a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55640ccc40 0x7f55641f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5562a00640 1 -- 172.21.15.7:0/1893361853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556409f8b0 con 0x7f556406d770 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5563400640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55640ccc40 0x7f55641f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5562000640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640b5da0 0x7f55641553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5562a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f5564155980 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5554035040 tx=0x7f55540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f555aa00640 1 -- 172.21.15.7:0/1893361853 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554037040 con 0x7f556406d770 2024-08-19T00:39:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f555aa00640 1 -- 172.21.15.7:0/1893361853 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554030500 con 0x7f556406d770 2024-08-19T00:39:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556409fb30 con 0x7f556406d770 2024-08-19T00:39:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f555aa00640 1 -- 172.21.15.7:0/1893361853 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554030910 con 0x7f556406d770 2024-08-19T00:39:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.334+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55640ced70 con 0x7f556406d770 2024-08-19T00:39:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.335+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55640d2ca0 con 0x7f556406d770 2024-08-19T00:39:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.337+0000 7f555aa00640 1 -- 172.21.15.7:0/1893361853 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5554044020 con 0x7f556406d770 2024-08-19T00:39:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.338+0000 7f555aa00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.338+0000 7f555aa00640 1 -- 172.21.15.7:0/1893361853 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7f55540ab0f0 con 0x7f556406d770 2024-08-19T00:39:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.338+0000 7f5562000640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.339+0000 7f5562000640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f55641e7d80 tx=0x7f5550009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:35.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.343+0000 7f555aa00640 1 -- 172.21.15.7:0/1893361853 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f556409f8b0 con 0x7f556406d770 2024-08-19T00:39:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:35.565+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f55640b3300 con 0x7f556406d770 2024-08-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.140+0000 7f555aa00640 1 -- 172.21.15.7:0/1893361853 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v42) ==== 172+0+0 (secure 0 0 0) 0x7f5554079b00 con 0x7f556406d770 2024-08-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 8 and data pool 9 2024-08-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.147+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 msgr2=0x7f554406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.147+0000 7f5569a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f55641e7d80 tx=0x7f5550009040 comp rx=0 tx=0).stop 2024-08-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.147+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 msgr2=0x7f5564155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.147+0000 7f5569a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f5564155980 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5554035040 tx=0x7f55540046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.148+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 shutdown_connections 2024-08-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.148+0000 7f5569a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.148+0000 7f5569a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55640ccc40 0x7f55641f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.148+0000 7f5569a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55640b5da0 0x7f55641553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.148+0000 7f5569a00640 1 --2- 172.21.15.7:0/1893361853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f556406d770 0x7f5564155980 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.148+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 >> 172.21.15.7:0/1893361853 conn(0x7f55640d2180 msgr2=0x7f5564070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.149+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 shutdown_connections 2024-08-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.149+0000 7f5569a00640 1 -- 172.21.15.7:0/1893361853 wait complete. 2024-08-19T00:39:36.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:39:36.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.337+0000 7feb3e400640 1 Processor -- start 2024-08-19T00:39:36.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.337+0000 7feb3e400640 1 -- start start 2024-08-19T00:39:36.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.338+0000 7feb3e400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb38159bf0 0x7feb38073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb3e400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feb380cec10 0x7feb380d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb3e400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3806f7f0 con 0x7feb380739a0 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb3e400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7feb3806f510 con 0x7feb38159bf0 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb3e400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feb38072980 con 0x7feb380cec10 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb38159bf0 0x7feb38073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb38159bf0 0x7feb38073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41460/0 (socket says 172.21.15.7:41460) 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37400640 1 -- 172.21.15.7:0/516033219 learned_addr learned my addr 172.21.15.7:0/516033219 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37e00640 1 --2- 172.21.15.7:0/516033219 >> v2:172.21.15.162:3300/0 conn(0x7feb380cec10 0x7feb380d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37400640 1 -- 172.21.15.7:0/516033219 >> v2:172.21.15.162:3300/0 conn(0x7feb380cec10 msgr2=0x7feb380d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37400640 1 --2- 172.21.15.7:0/516033219 >> v2:172.21.15.162:3300/0 conn(0x7feb380cec10 0x7feb380d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37400640 1 -- 172.21.15.7:0/516033219 >> v1:172.21.15.162:6789/0 conn(0x7feb380739a0 legacy=0x7feb380ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.339+0000 7feb37400640 1 -- 172.21.15.7:0/516033219 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb38072c60 con 0x7feb38159bf0 2024-08-19T00:39:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.340+0000 7feb37400640 1 --2- 172.21.15.7:0/516033219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb38073460 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feb380d0f80 tx=0x7feb2802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db82ef9d749ef97 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb36a00640 1 -- 172.21.15.7:0/516033219 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28037070 con 0x7feb38159bf0 2024-08-19T00:39:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb36a00640 1 -- 172.21.15.7:0/516033219 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb28032440 con 0x7feb38159bf0 2024-08-19T00:39:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb36a00640 1 -- 172.21.15.7:0/516033219 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28032810 con 0x7feb38159bf0 2024-08-19T00:39:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 -- 172.21.15.7:0/516033219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 msgr2=0x7feb38073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 --2- 172.21.15.7:0/516033219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb38073460 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feb380d0f80 tx=0x7feb2802a1f0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 -- 172.21.15.7:0/516033219 shutdown_connections 2024-08-19T00:39:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 --2- 172.21.15.7:0/516033219 >> v2:172.21.15.162:3300/0 conn(0x7feb380cec10 0x7feb380d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 --2- 172.21.15.7:0/516033219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb38073460 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 -- 172.21.15.7:0/516033219 >> 172.21.15.7:0/516033219 conn(0x7feb3806bc70 msgr2=0x7feb3806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 -- 172.21.15.7:0/516033219 shutdown_connections 2024-08-19T00:39:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.341+0000 7feb3e400640 1 -- 172.21.15.7:0/516033219 wait complete. 2024-08-19T00:39:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.343+0000 7feb3e400640 1 Processor -- start 2024-08-19T00:39:36.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.343+0000 7feb3e400640 1 -- start start 2024-08-19T00:39:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb3e400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb380739a0 0x7feb3809c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb3e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb381f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb3e400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3814e840 0x7feb381f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb3e400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb3815a150 con 0x7feb38159bf0 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb3e400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb38159fd0 con 0x7feb380739a0 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb3e400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb380d0900 con 0x7feb3814e840 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb2fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb381f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb2fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb381f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41468/0 (socket says 172.21.15.7:41468) 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.344+0000 7feb2fe00640 1 -- 172.21.15.7:0/369080595 learned_addr learned my addr 172.21.15.7:0/369080595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb37400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb380739a0 0x7feb3809c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb37e00640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3814e840 0x7feb381f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2fe00640 1 -- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3814e840 msgr2=0x7feb381f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2fe00640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3814e840 0x7feb381f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2fe00640 1 -- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb380739a0 msgr2=0x7feb3809c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2fe00640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb380739a0 0x7feb3809c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2fe00640 1 -- 172.21.15.7:0/369080595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb381f5da0 con 0x7feb38159bf0 2024-08-19T00:39:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2fe00640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb381f5620 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c3c0 tx=0x7feb2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2f400640 1 -- 172.21.15.7:0/369080595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb200052d0 con 0x7feb38159bf0 2024-08-19T00:39:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2f400640 1 -- 172.21.15.7:0/369080595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb20005490 con 0x7feb38159bf0 2024-08-19T00:39:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb2f400640 1 -- 172.21.15.7:0/369080595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20007260 con 0x7feb38159bf0 2024-08-19T00:39:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.345+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb381f6080 con 0x7feb38159bf0 2024-08-19T00:39:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.346+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3809a430 con 0x7feb38159bf0 2024-08-19T00:39:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.347+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3809a630 con 0x7feb38159bf0 2024-08-19T00:39:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.348+0000 7feb2f400640 1 -- 172.21.15.7:0/369080595 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb20007400 con 0x7feb38159bf0 2024-08-19T00:39:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.348+0000 7feb2f400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1406be30 0x7feb1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.349+0000 7feb2f400640 1 -- 172.21.15.7:0/369080595 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7feb2008a3b0 con 0x7feb38159bf0 2024-08-19T00:39:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.349+0000 7feb37400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1406be30 0x7feb1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.349+0000 7feb37400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1406be30 0x7feb1406e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb28034000 tx=0x7feb2802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:36.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.353+0000 7feb2f400640 1 -- 172.21.15.7:0/369080595 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feb3809a630 con 0x7feb38159bf0 2024-08-19T00:39:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.536+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb380d0c90 con 0x7feb38159bf0 2024-08-19T00:39:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.537+0000 7feb2f400640 1 -- 172.21.15.7:0/369080595 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16642 (secure 0 0 0) 0x7feb20058cc0 con 0x7feb38159bf0 2024-08-19T00:39:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:36.539 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:39:35.566335+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:39:33.403543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-08-19T00:39:34.553083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1406be30 msgr2=0x7feb1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1406be30 0x7feb1406e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb28034000 tx=0x7feb2802e000 comp rx=0 tx=0).stop 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 msgr2=0x7feb381f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb381f5620 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c3c0 tx=0x7feb2000c880 comp rx=0 tx=0).stop 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 shutdown_connections 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1406be30 0x7feb1406e2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3814e840 0x7feb381f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb38159bf0 0x7feb381f5620 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 --2- 172.21.15.7:0/369080595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb380739a0 0x7feb3809c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 >> 172.21.15.7:0/369080595 conn(0x7feb3806bc70 msgr2=0x7feb380cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 shutdown_connections 2024-08-19T00:39:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.539+0000 7feb3e400640 1 -- 172.21.15.7:0/369080595 wait complete. 2024-08-19T00:39:36.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.712+0000 7fc841200640 1 Processor -- start 2024-08-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.712+0000 7fc841200640 1 -- start start 2024-08-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.713+0000 7fc841200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc83c15e480 0x7fc83c0d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.713+0000 7fc841200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d3010 0x7fc83c0d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.713+0000 7fc841200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc83c0b57e0 0x7fc83c0d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.713+0000 7fc841200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc83c0d1a20 con 0x7fc83c0b57e0 2024-08-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.713+0000 7fc841200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc83c0d1460 con 0x7fc83c15e480 2024-08-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.713+0000 7fc841200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c0d1740 con 0x7fc83c0d3010 2024-08-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.713+0000 7fc83be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc83c0b57e0 0x7fc83c0d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc83c0b57e0 0x7fc83c0d46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41484/0 (socket says 172.21.15.7:41484) 2024-08-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83be00640 1 -- 172.21.15.7:0/1938162855 learned_addr learned my addr 172.21.15.7:0/1938162855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83aa00640 1 --2- 172.21.15.7:0/1938162855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d3010 0x7fc83c0d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83b400640 1 --2- 172.21.15.7:0/1938162855 >> v2:172.21.15.162:3300/0 conn(0x7fc83c15e480 0x7fc83c0d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83be00640 1 -- 172.21.15.7:0/1938162855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d3010 msgr2=0x7fc83c0d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83be00640 1 --2- 172.21.15.7:0/1938162855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d3010 0x7fc83c0d4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83be00640 1 -- 172.21.15.7:0/1938162855 >> v2:172.21.15.162:3300/0 conn(0x7fc83c15e480 msgr2=0x7fc83c0d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83be00640 1 --2- 172.21.15.7:0/1938162855 >> v2:172.21.15.162:3300/0 conn(0x7fc83c15e480 0x7fc83c0d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.714+0000 7fc83be00640 1 -- 172.21.15.7:0/1938162855 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c0d2af0 con 0x7fc83c0b57e0 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.715+0000 7fc83be00640 1 --2- 172.21.15.7:0/1938162855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c0d46b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0d1ca0 tx=0x7fc83402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bcfa7b88d0d2b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.715+0000 7fc83a000640 1 -- 172.21.15.7:0/1938162855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834036070 con 0x7fc83c0b57e0 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.715+0000 7fc83a000640 1 -- 172.21.15.7:0/1938162855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834031600 con 0x7fc83c0b57e0 2024-08-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.715+0000 7fc83a000640 1 -- 172.21.15.7:0/1938162855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340319d0 con 0x7fc83c0b57e0 2024-08-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 -- 172.21.15.7:0/1938162855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 msgr2=0x7fc83c0d46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 --2- 172.21.15.7:0/1938162855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c0d46b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0d1ca0 tx=0x7fc83402a610 comp rx=0 tx=0).stop 2024-08-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 -- 172.21.15.7:0/1938162855 shutdown_connections 2024-08-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 --2- 172.21.15.7:0/1938162855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c0d46b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 --2- 172.21.15.7:0/1938162855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d3010 0x7fc83c0d4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 --2- 172.21.15.7:0/1938162855 >> v2:172.21.15.162:3300/0 conn(0x7fc83c15e480 0x7fc83c0d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 -- 172.21.15.7:0/1938162855 >> 172.21.15.7:0/1938162855 conn(0x7fc83c08dbf0 msgr2=0x7fc83c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 -- 172.21.15.7:0/1938162855 shutdown_connections 2024-08-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.716+0000 7fc841200640 1 -- 172.21.15.7:0/1938162855 wait complete. 2024-08-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.718+0000 7fc841200640 1 Processor -- start 2024-08-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.718+0000 7fc841200640 1 -- start start 2024-08-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc841200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc841200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c0d3010 0x7fc83c0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc841200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c15e480 0x7fc83c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc841200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c162050 con 0x7fc83c0b57e0 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc841200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c161ed0 con 0x7fc83c0d3010 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc841200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c1621d0 con 0x7fc83c15e480 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c15a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41486/0 (socket says 172.21.15.7:41486) 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 -- 172.21.15.7:0/2163610870 learned_addr learned my addr 172.21.15.7:0/2163610870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83aa00640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c0d3010 0x7fc83c0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83be00640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c15e480 0x7fc83c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 -- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c15e480 msgr2=0x7fc83c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c15e480 0x7fc83c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 -- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c0d3010 msgr2=0x7fc83c0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c0d3010 0x7fc83c0b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83b400640 1 -- 172.21.15.7:0/2163610870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c0c7d10 con 0x7fc83c0b57e0 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.719+0000 7fc83be00640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c15e480 0x7fc83c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.720+0000 7fc83b400640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c15a420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e870 tx=0x7fc82c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.720+0000 7fc833400640 1 -- 172.21.15.7:0/2163610870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c017070 con 0x7fc83c0b57e0 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.720+0000 7fc833400640 1 -- 172.21.15.7:0/2163610870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c00c940 con 0x7fc83c0b57e0 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.720+0000 7fc833400640 1 -- 172.21.15.7:0/2163610870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00cd30 con 0x7fc83c0b57e0 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.720+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83c0c7fd0 con 0x7fc83c0b57e0 2024-08-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.720+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83c1f4a00 con 0x7fc83c0b57e0 2024-08-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.721+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c0d20e0 con 0x7fc83c0b57e0 2024-08-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.722+0000 7fc833400640 1 -- 172.21.15.7:0/2163610870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc82c01a070 con 0x7fc83c0b57e0 2024-08-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.723+0000 7fc833400640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.723+0000 7fc833400640 1 -- 172.21.15.7:0/2163610870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7fc82c08ad20 con 0x7fc83c0b57e0 2024-08-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.723+0000 7fc83aa00640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.724+0000 7fc83aa00640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0cfa30 tx=0x7fc828008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.727+0000 7fc833400640 1 -- 172.21.15.7:0/2163610870 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc82c0596c0 con 0x7fc83c0b57e0 2024-08-19T00:39:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.913+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc83c063100 con 0x7fc83c0b57e0 2024-08-19T00:39:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.914+0000 7fc833400640 1 -- 172.21.15.7:0/2163610870 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16642 (secure 0 0 0) 0x7fc82c058fc0 con 0x7fc83c0b57e0 2024-08-19T00:39:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:36.916 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:39:35.566335+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:39:33.403543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-08-19T00:39:34.553083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.916+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 msgr2=0x7fc81c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.916+0000 7fc841200640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0cfa30 tx=0x7fc828008040 comp rx=0 tx=0).stop 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.916+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 msgr2=0x7fc83c15a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.916+0000 7fc841200640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c15a420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e870 tx=0x7fc82c00ed30 comp rx=0 tx=0).stop 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 shutdown_connections 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c15e480 0x7fc83c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c0d3010 0x7fc83c0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 --2- 172.21.15.7:0/2163610870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b57e0 0x7fc83c15a420 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 >> 172.21.15.7:0/2163610870 conn(0x7fc83c08dbf0 msgr2=0x7fc83c15d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 shutdown_connections 2024-08-19T00:39:36.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:36.917+0000 7fc841200640 1 -- 172.21.15.7:0/2163610870 wait complete. 2024-08-19T00:39:36.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.092+0000 7f8659e00640 1 Processor -- start 2024-08-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.092+0000 7f8659e00640 1 -- start start 2024-08-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.093+0000 7f8659e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86540731c0 0x7f86540add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.093+0000 7f8659e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86540aeae0 con 0x7f86540ae2b0 2024-08-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.093+0000 7f8659e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86540aedc0 con 0x7f8654158cd0 2024-08-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.093+0000 7f8659e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f86540af0a0 con 0x7f86540731c0 2024-08-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f8653400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f86540ae2b0 0x7f86540b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45536/0 (socket says 172.21.15.7:45536) 2024-08-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f8653400640 1 -- 172.21.15.7:0/3942804450 learned_addr learned my addr 172.21.15.7:0/3942804450 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f864be00640 1 --2- 172.21.15.7:0/3942804450 >> v2:172.21.15.7:3300/0 conn(0x7f86540731c0 0x7f86540add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f8652000640 1 -- 172.21.15.7:0/3942804450 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777498331 0 0) 0x7f86540aeae0 con 0x7f86540ae2b0 2024-08-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f8652000640 1 -- 172.21.15.7:0/3942804450 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8638003520 con 0x7f86540ae2b0 2024-08-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f8652000640 1 -- 172.21.15.7:0/3942804450 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931231100 0 0) 0x7f86540aedc0 con 0x7f8654158cd0 2024-08-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f864be00640 1 -- 172.21.15.7:0/3942804450 >> v1:172.21.15.162:6789/0 conn(0x7f8654158cd0 legacy=0x7f8654072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f864be00640 1 -- 172.21.15.7:0/3942804450 >> v1:172.21.15.7:6789/0 conn(0x7f86540ae2b0 legacy=0x7f86540b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.094+0000 7f864be00640 1 -- 172.21.15.7:0/3942804450 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86540af380 con 0x7f86540731c0 2024-08-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f864be00640 1 --2- 172.21.15.7:0/3942804450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540731c0 0x7f86540add70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097a0 tx=0x7f863c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd97e62148af1df9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8652000640 1 -- 172.21.15.7:0/3942804450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c037070 con 0x7f86540731c0 2024-08-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8652000640 1 -- 172.21.15.7:0/3942804450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c032440 con 0x7f86540731c0 2024-08-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8652000640 1 -- 172.21.15.7:0/3942804450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c02ae60 con 0x7f86540731c0 2024-08-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8659e00640 1 -- 172.21.15.7:0/3942804450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540731c0 msgr2=0x7f86540add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8659e00640 1 --2- 172.21.15.7:0/3942804450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540731c0 0x7f86540add70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097a0 tx=0x7f863c02a110 comp rx=0 tx=0).stop 2024-08-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8659e00640 1 -- 172.21.15.7:0/3942804450 shutdown_connections 2024-08-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8659e00640 1 --2- 172.21.15.7:0/3942804450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540731c0 0x7f86540add70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.096+0000 7f8659e00640 1 -- 172.21.15.7:0/3942804450 >> 172.21.15.7:0/3942804450 conn(0x7f86540b2300 msgr2=0x7f865406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.097+0000 7f8659e00640 1 -- 172.21.15.7:0/3942804450 shutdown_connections 2024-08-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.097+0000 7f8659e00640 1 -- 172.21.15.7:0/3942804450 wait complete. 2024-08-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.098+0000 7f8659e00640 1 Processor -- start 2024-08-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.098+0000 7f8659e00640 1 -- start start 2024-08-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f8659e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540731c0 0x7f865414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f8659e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540ae2b0 0x7f865409bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f8659e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f865409c220 0x7f865415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f8659e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86540b3860 con 0x7f86540ae2b0 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f8659e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86540ae760 con 0x7f86540731c0 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f8659e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f86540b39e0 con 0x7f865409c220 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f864be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540ae2b0 0x7f865409bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f864be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540ae2b0 0x7f865409bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41498/0 (socket says 172.21.15.7:41498) 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.099+0000 7f864be00640 1 -- 172.21.15.7:0/4047159665 learned_addr learned my addr 172.21.15.7:0/4047159665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f8653400640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f865409c220 0x7f865415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f8652a00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540731c0 0x7f865414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864be00640 1 -- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f865409c220 msgr2=0x7f865415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864be00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f865409c220 0x7f865415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864be00640 1 -- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540731c0 msgr2=0x7f865414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864be00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540731c0 0x7f865414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864be00640 1 -- 172.21.15.7:0/4047159665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865409c7a0 con 0x7f86540ae2b0 2024-08-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f8652a00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540731c0 0x7f865414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f8653400640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f865409c220 0x7f865415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864be00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540ae2b0 0x7f865409bce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f863c0098c0 tx=0x7f863c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864b400640 1 -- 172.21.15.7:0/4047159665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c041020 con 0x7f86540ae2b0 2024-08-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f864b400640 1 -- 172.21.15.7:0/4047159665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c03d6e0 con 0x7f86540ae2b0 2024-08-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.100+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865409ca80 con 0x7f86540ae2b0 2024-08-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.101+0000 7f864b400640 1 -- 172.21.15.7:0/4047159665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c037040 con 0x7f86540ae2b0 2024-08-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.101+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865409d040 con 0x7f86540ae2b0 2024-08-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.102+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86540add70 con 0x7f86540ae2b0 2024-08-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.102+0000 7f864b400640 1 -- 172.21.15.7:0/4047159665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f863c044020 con 0x7f86540ae2b0 2024-08-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.103+0000 7f864b400640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f863006be30 0x7f863006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.103+0000 7f864b400640 1 -- 172.21.15.7:0/4047159665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f863c0ab740 con 0x7f86540ae2b0 2024-08-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.104+0000 7f8652a00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f863006be30 0x7f863006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.104+0000 7f8652a00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f863006be30 0x7f863006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8644000f60 tx=0x7f8644009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.108+0000 7f864b400640 1 -- 172.21.15.7:0/4047159665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f863c04b030 con 0x7f86540ae2b0 2024-08-19T00:39:37.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:37.332+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f86540cfd30 con 0x7f86540ae2b0 2024-08-19T00:39:38.120 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:39:38.119+0000 7f33d1a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:39:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.150+0000 7f864b400640 1 -- 172.21.15.7:0/4047159665 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) ==== 118+0+0 (secure 0 0 0) 0x7f863c07a0e0 con 0x7f86540ae2b0 2024-08-19T00:39:38.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.153+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f863006be30 msgr2=0x7f863006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:38.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.153+0000 7f8659e00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f863006be30 0x7f863006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8644000f60 tx=0x7f8644009040 comp rx=0 tx=0).stop 2024-08-19T00:39:38.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.153+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540ae2b0 msgr2=0x7f865409bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.153+0000 7f8659e00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540ae2b0 0x7f865409bce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f863c0098c0 tx=0x7f863c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.153+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 shutdown_connections 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.153+0000 7f8659e00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f863006be30 0x7f863006e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.153+0000 7f8659e00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f865409c220 0x7f865415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.154+0000 7f8659e00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86540ae2b0 0x7f865409bce0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.154+0000 7f8659e00640 1 --2- 172.21.15.7:0/4047159665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540731c0 0x7f865414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.154+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 >> 172.21.15.7:0/4047159665 conn(0x7f86540b2300 msgr2=0x7f86540b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.154+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 shutdown_connections 2024-08-19T00:39:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.154+0000 7f8659e00640 1 -- 172.21.15.7:0/4047159665 wait complete. 2024-08-19T00:39:38.175 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-19T00:39:38.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-19T00:39:38.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.338+0000 7f6579000640 1 Processor -- start 2024-08-19T00:39:38.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.338+0000 7f6579000640 1 -- start start 2024-08-19T00:39:38.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.339+0000 7f6579000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f657406d600 0x7f657406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:38.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.339+0000 7f6579000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657415e640 0x7f657415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:38.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.339+0000 7f6579000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657415f010 con 0x7f6574147ac0 2024-08-19T00:39:38.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.339+0000 7f6579000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6574072d80 con 0x7f657406d600 2024-08-19T00:39:38.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.339+0000 7f6579000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65740b4990 con 0x7f657415e640 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f656be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f657406d600 0x7f657406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f6573e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657415e640 0x7f657415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f6573e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657415e640 0x7f657415ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:45960/0 (socket says 172.21.15.7:45960) 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f6573e00640 1 -- 172.21.15.7:0/3658084355 learned_addr learned my addr 172.21.15.7:0/3658084355 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f656be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f657406d600 0x7f657406da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:54790/0 (socket says 172.21.15.7:54790) 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f6573e00640 1 -- 172.21.15.7:0/3658084355 >> v2:172.21.15.162:3300/0 conn(0x7f657406d600 msgr2=0x7f657406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f6573e00640 1 --2- 172.21.15.7:0/3658084355 >> v2:172.21.15.162:3300/0 conn(0x7f657406d600 0x7f657406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f6573e00640 1 -- 172.21.15.7:0/3658084355 >> v1:172.21.15.162:6789/0 conn(0x7f6574147ac0 legacy=0x7f65740b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:38.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.340+0000 7f6573e00640 1 -- 172.21.15.7:0/3658084355 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657415f290 con 0x7f657415e640 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.341+0000 7f6573e00640 1 --2- 172.21.15.7:0/3658084355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657415e640 0x7f657415ead0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f656c009e50 tx=0x7f656c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b00b1f5a9445216d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.341+0000 7f6572a00640 1 -- 172.21.15.7:0/3658084355 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c036070 con 0x7f657415e640 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.341+0000 7f6572a00640 1 -- 172.21.15.7:0/3658084355 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656c031600 con 0x7f657415e640 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.341+0000 7f6572a00640 1 -- 172.21.15.7:0/3658084355 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0319d0 con 0x7f657415e640 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 -- 172.21.15.7:0/3658084355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657415e640 msgr2=0x7f657415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 --2- 172.21.15.7:0/3658084355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657415e640 0x7f657415ead0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f656c009e50 tx=0x7f656c02a680 comp rx=0 tx=0).stop 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 -- 172.21.15.7:0/3658084355 shutdown_connections 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 --2- 172.21.15.7:0/3658084355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657415e640 0x7f657415ead0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 --2- 172.21.15.7:0/3658084355 >> v2:172.21.15.162:3300/0 conn(0x7f657406d600 0x7f657406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 -- 172.21.15.7:0/3658084355 >> 172.21.15.7:0/3658084355 conn(0x7f657406b850 msgr2=0x7f657406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:38.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 -- 172.21.15.7:0/3658084355 shutdown_connections 2024-08-19T00:39:38.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.342+0000 7f6579000640 1 -- 172.21.15.7:0/3658084355 wait complete. 2024-08-19T00:39:38.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.344+0000 7f6579000640 1 Processor -- start 2024-08-19T00:39:38.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.344+0000 7f6579000640 1 -- start start 2024-08-19T00:39:38.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6579000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657406d600 0x7f65740c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6579000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6574147ac0 0x7f657413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6579000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f657415e640 0x7f65741520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6579000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65740b4340 con 0x7f6574147ac0 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6579000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f657406df80 con 0x7f657415e640 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6579000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65740b4620 con 0x7f657406d600 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f656be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6574147ac0 0x7f657413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f656be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6574147ac0 0x7f657413f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41506/0 (socket says 172.21.15.7:41506) 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f656be00640 1 -- 172.21.15.7:0/2930728412 learned_addr learned my addr 172.21.15.7:0/2930728412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6573e00640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f657415e640 0x7f65741520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.345+0000 7f6573400640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657406d600 0x7f65740c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656be00640 1 -- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657406d600 msgr2=0x7f65740c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656be00640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657406d600 0x7f65740c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656be00640 1 -- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f657415e640 msgr2=0x7f65741520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656be00640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f657415e640 0x7f65741520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656be00640 1 -- 172.21.15.7:0/2930728412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657413fde0 con 0x7f6574147ac0 2024-08-19T00:39:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656be00640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6574147ac0 0x7f657413f8a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f655c00e870 tx=0x7f655c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656b400640 1 -- 172.21.15.7:0/2930728412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c017070 con 0x7f6574147ac0 2024-08-19T00:39:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656b400640 1 -- 172.21.15.7:0/2930728412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655c00c940 con 0x7f6574147ac0 2024-08-19T00:39:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6574140080 con 0x7f6574147ac0 2024-08-19T00:39:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.346+0000 7f656b400640 1 -- 172.21.15.7:0/2930728412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c00cd30 con 0x7f6574147ac0 2024-08-19T00:39:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.347+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6574140640 con 0x7f6574147ac0 2024-08-19T00:39:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.348+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657406da40 con 0x7f6574147ac0 2024-08-19T00:39:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.349+0000 7f656b400640 1 -- 172.21.15.7:0/2930728412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f655c01a070 con 0x7f6574147ac0 2024-08-19T00:39:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.349+0000 7f656b400640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f655006be30 0x7f655006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.349+0000 7f656b400640 1 -- 172.21.15.7:0/2930728412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f655c08ad00 con 0x7f6574147ac0 2024-08-19T00:39:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.350+0000 7f6573400640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f655006be30 0x7f655006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.350+0000 7f6573400640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f655006be30 0x7f655006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6564000f60 tx=0x7f6564009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.354+0000 7f656b400640 1 -- 172.21.15.7:0/2930728412 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f655c058fc0 con 0x7f6574147ac0 2024-08-19T00:39:38.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:38.574+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f657415fe10 con 0x7f6574147ac0 2024-08-19T00:39:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.164+0000 7f656b400640 1 -- 172.21.15.7:0/2930728412 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f655c05d2c0 con 0x7f6574147ac0 2024-08-19T00:39:39.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.166+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f655006be30 msgr2=0x7f655006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.166+0000 7f6579000640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f655006be30 0x7f655006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6564000f60 tx=0x7f6564009040 comp rx=0 tx=0).stop 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.166+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6574147ac0 msgr2=0x7f657413f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.166+0000 7f6579000640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6574147ac0 0x7f657413f8a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f655c00e870 tx=0x7f655c00ed30 comp rx=0 tx=0).stop 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 shutdown_connections 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f655006be30 0x7f655006e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f657415e640 0x7f65741520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6574147ac0 0x7f657413f8a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 --2- 172.21.15.7:0/2930728412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657406d600 0x7f65740c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 >> 172.21.15.7:0/2930728412 conn(0x7f657406b850 msgr2=0x7f65741462f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 shutdown_connections 2024-08-19T00:39:39.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.167+0000 7f6579000640 1 -- 172.21.15.7:0/2930728412 wait complete. 2024-08-19T00:39:39.185 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-19T00:39:39.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.343+0000 7faecb200640 1 Processor -- start 2024-08-19T00:39:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.343+0000 7faecb200640 1 -- start start 2024-08-19T00:39:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.344+0000 7faecb200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faecc0b3860 0x7faecc06c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.344+0000 7faecb200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc162bf0 con 0x7faecc0b4ab0 2024-08-19T00:39:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.344+0000 7faecb200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc161d00 con 0x7faecc147b80 2024-08-19T00:39:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.344+0000 7faecb200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faecc0cd740 con 0x7faecc0b3860 2024-08-19T00:39:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.344+0000 7faec9400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faecc0b4ab0 0x7faecc06ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45552/0 (socket says 172.21.15.7:45552) 2024-08-19T00:39:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.344+0000 7faec9400640 1 -- 172.21.15.7:0/819072613 learned_addr learned my addr 172.21.15.7:0/819072613 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.345+0000 7faeca800640 1 --2- 172.21.15.7:0/819072613 >> v2:172.21.15.162:3300/0 conn(0x7faecc0b3860 0x7faecc06c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.345+0000 7faec8a00640 1 -- 172.21.15.7:0/819072613 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756719925 0 0) 0x7faecc162bf0 con 0x7faecc0b4ab0 2024-08-19T00:39:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.345+0000 7faec8a00640 1 -- 172.21.15.7:0/819072613 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb0003520 con 0x7faecc0b4ab0 2024-08-19T00:39:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.345+0000 7faec8a00640 1 -- 172.21.15.7:0/819072613 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1089943604 0 0) 0x7faeb0003520 con 0x7faecc0b4ab0 2024-08-19T00:39:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.345+0000 7faeca800640 1 -- 172.21.15.7:0/819072613 >> v1:172.21.15.162:6789/0 conn(0x7faecc147b80 legacy=0x7faecc0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.345+0000 7faeca800640 1 -- 172.21.15.7:0/819072613 >> v1:172.21.15.7:6789/0 conn(0x7faecc0b4ab0 legacy=0x7faecc06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.345+0000 7faeca800640 1 -- 172.21.15.7:0/819072613 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc161fe0 con 0x7faecc0b3860 2024-08-19T00:39:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.346+0000 7faeca800640 1 --2- 172.21.15.7:0/819072613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b3860 0x7faecc06c260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b7e1c653b0e565 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faec8a00640 1 -- 172.21.15.7:0/819072613 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8001670 con 0x7faecc0b3860 2024-08-19T00:39:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faec8a00640 1 -- 172.21.15.7:0/819072613 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec4007540 con 0x7faecc0b3860 2024-08-19T00:39:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faec8a00640 1 -- 172.21.15.7:0/819072613 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec40078f0 con 0x7faecc0b3860 2024-08-19T00:39:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faecb200640 1 -- 172.21.15.7:0/819072613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b3860 msgr2=0x7faecc06c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faecb200640 1 --2- 172.21.15.7:0/819072613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b3860 0x7faecc06c260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec402a680 comp rx=0 tx=0).stop 2024-08-19T00:39:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faecb200640 1 -- 172.21.15.7:0/819072613 shutdown_connections 2024-08-19T00:39:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faecb200640 1 --2- 172.21.15.7:0/819072613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b3860 0x7faecc06c260 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.347+0000 7faecb200640 1 -- 172.21.15.7:0/819072613 >> 172.21.15.7:0/819072613 conn(0x7faecc0b2d70 msgr2=0x7faecc0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.348+0000 7faecb200640 1 -- 172.21.15.7:0/819072613 shutdown_connections 2024-08-19T00:39:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.348+0000 7faecb200640 1 -- 172.21.15.7:0/819072613 wait complete. 2024-08-19T00:39:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.349+0000 7faecb200640 1 Processor -- start 2024-08-19T00:39:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.349+0000 7faecb200640 1 -- start start 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faecb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faecc0b3860 0x7faecc141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faecb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b4ab0 0x7faecc140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faecb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faecc147b80 0x7faecc141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faecb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faecc162880 con 0x7faecc0b3860 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faecb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faecc1625a0 con 0x7faecc0b4ab0 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faecb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faecc0706f0 con 0x7faecc147b80 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faec9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faecc0b3860 0x7faecc141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faec9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faecc0b3860 0x7faecc141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41520/0 (socket says 172.21.15.7:41520) 2024-08-19T00:39:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.350+0000 7faec9e00640 1 -- 172.21.15.7:0/3885303617 learned_addr learned my addr 172.21.15.7:0/3885303617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faeca800640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faecc147b80 0x7faecc141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9400640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b4ab0 0x7faecc140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9e00640 1 -- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faecc147b80 msgr2=0x7faecc141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9e00640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faecc147b80 0x7faecc141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9e00640 1 -- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b4ab0 msgr2=0x7faecc140ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9e00640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b4ab0 0x7faecc140ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9e00640 1 -- 172.21.15.7:0/3885303617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc160500 con 0x7faecc0b3860 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9400640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b4ab0 0x7faecc140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec9e00640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faecc0b3860 0x7faecc141e20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faebc00c430 tx=0x7faebc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec2000640 1 -- 172.21.15.7:0/3885303617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc017070 con 0x7faecc0b3860 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec2000640 1 -- 172.21.15.7:0/3885303617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc0052d0 con 0x7faecc0b3860 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc1607e0 con 0x7faecc0b3860 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.351+0000 7faec2000640 1 -- 172.21.15.7:0/3885303617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc003830 con 0x7faecc0b3860 2024-08-19T00:39:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.352+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc160da0 con 0x7faecc0b3860 2024-08-19T00:39:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.353+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc06c260 con 0x7faecc0b3860 2024-08-19T00:39:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.354+0000 7faec2000640 1 -- 172.21.15.7:0/3885303617 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faebc01a070 con 0x7faecc0b3860 2024-08-19T00:39:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.355+0000 7faec2000640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.355+0000 7faec2000640 1 -- 172.21.15.7:0/3885303617 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7faebc08a160 con 0x7faecc0b3860 2024-08-19T00:39:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.355+0000 7faec9400640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.356+0000 7faec9400640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faecc1428c0 tx=0x7faeb8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.359+0000 7faec2000640 1 -- 172.21.15.7:0/3885303617 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faebc058420 con 0x7faecc0b3860 2024-08-19T00:39:39.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.583+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faecc073b60 con 0x7faecc0b3860 2024-08-19T00:39:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.584+0000 7faec2000640 1 -- 172.21.15.7:0/3885303617 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5220 (secure 0 0 0) 0x7faebc05c720 con 0x7faecc0b3860 2024-08-19T00:39:39.586 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:39.586 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"btime":"2024-08-19T00:39:39:157035+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:39:38.575704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3306229985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3306229985},{"type":"v1","addr":"172.21.15.7:6836","nonce":3306229985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-08-19T00:39:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-08-19T00:39:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faeac06be30 msgr2=0x7faeac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faecc1428c0 tx=0x7faeb8009040 comp rx=0 tx=0).stop 2024-08-19T00:39:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faecc0b3860 msgr2=0x7faecc141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faecc0b3860 0x7faecc141e20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faebc00c430 tx=0x7faebc00c8f0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 shutdown_connections 2024-08-19T00:39:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faecc147b80 0x7faecc141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faecc0b4ab0 0x7faecc140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 --2- 172.21.15.7:0/3885303617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faecc0b3860 0x7faecc141e20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 >> 172.21.15.7:0/3885303617 conn(0x7faecc0b2d70 msgr2=0x7faecc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 shutdown_connections 2024-08-19T00:39:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.586+0000 7faecb200640 1 -- 172.21.15.7:0/3885303617 wait complete. 2024-08-19T00:39:39.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.759+0000 7f4cfe000640 1 Processor -- start 2024-08-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.759+0000 7f4cfe000640 1 -- start start 2024-08-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.760+0000 7f4cfe000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf815e360 0x7f4cf815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.760+0000 7f4cfe000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4cf815ee50 0x7f4cf80d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.760+0000 7f4cfe000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf80b3ab0 con 0x7f4cf80d2af0 2024-08-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.760+0000 7f4cfe000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf80d3490 con 0x7f4cf815ee50 2024-08-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.760+0000 7f4cfe000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf815f460 con 0x7f4cf815e360 2024-08-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.760+0000 7f4cfd600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4cf815ee50 0x7f4cf80d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.760+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf815e360 0x7f4cf815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cfd600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4cf815ee50 0x7f4cf80d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:54828/0 (socket says 172.21.15.7:54828) 2024-08-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf815e360 0x7f4cf815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:45986/0 (socket says 172.21.15.7:45986) 2024-08-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cfd600640 1 -- 172.21.15.7:0/769001531 learned_addr learned my addr 172.21.15.7:0/769001531 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cf7e00640 1 --1- 172.21.15.7:0/769001531 >> v1:172.21.15.162:6789/0 conn(0x7f4cf80d2af0 0x7f4cf815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:38236/0 (socket says 172.21.15.7:38236) 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cfd600640 1 -- 172.21.15.7:0/769001531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf815e360 msgr2=0x7f4cf815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cfd600640 1 --2- 172.21.15.7:0/769001531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf815e360 0x7f4cf815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cfd600640 1 -- 172.21.15.7:0/769001531 >> v1:172.21.15.162:6789/0 conn(0x7f4cf80d2af0 legacy=0x7f4cf815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.761+0000 7f4cfd600640 1 -- 172.21.15.7:0/769001531 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf815f740 con 0x7f4cf815ee50 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.762+0000 7f4cfd600640 1 --2- 172.21.15.7:0/769001531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815ee50 0x7f4cf80d2f50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009e50 tx=0x7f4cf002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e39316e88d415447 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.762+0000 7f4cf7400640 1 -- 172.21.15.7:0/769001531 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0036070 con 0x7f4cf815ee50 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.762+0000 7f4cf7400640 1 -- 172.21.15.7:0/769001531 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf0031600 con 0x7f4cf815ee50 2024-08-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.762+0000 7f4cf7400640 1 -- 172.21.15.7:0/769001531 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00319d0 con 0x7f4cf815ee50 2024-08-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 -- 172.21.15.7:0/769001531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815ee50 msgr2=0x7f4cf80d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 --2- 172.21.15.7:0/769001531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815ee50 0x7f4cf80d2f50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009e50 tx=0x7f4cf002a710 comp rx=0 tx=0).stop 2024-08-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 -- 172.21.15.7:0/769001531 shutdown_connections 2024-08-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 --2- 172.21.15.7:0/769001531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815ee50 0x7f4cf80d2f50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 --2- 172.21.15.7:0/769001531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf815e360 0x7f4cf815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 -- 172.21.15.7:0/769001531 >> 172.21.15.7:0/769001531 conn(0x7f4cf808dbf0 msgr2=0x7f4cf809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 -- 172.21.15.7:0/769001531 shutdown_connections 2024-08-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.763+0000 7f4cfe000640 1 -- 172.21.15.7:0/769001531 wait complete. 2024-08-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.765+0000 7f4cfe000640 1 Processor -- start 2024-08-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.765+0000 7f4cfe000640 1 -- start start 2024-08-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfe000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf80d2af0 0x7f4cf8153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfe000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815e360 0x7f4cf80b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf815ee50 0x7f4cf80b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfe000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80d2300 con 0x7f4cf815ee50 2024-08-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfe000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80b4040 con 0x7f4cf815e360 2024-08-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfe000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf80b4560 con 0x7f4cf80d2af0 2024-08-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf815ee50 0x7f4cf80b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf815ee50 0x7f4cf80b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41528/0 (socket says 172.21.15.7:41528) 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 -- 172.21.15.7:0/3912075745 learned_addr learned my addr 172.21.15.7:0/3912075745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cf7e00640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815e360 0x7f4cf80b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfcc00640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf80d2af0 0x7f4cf8153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 -- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf80d2af0 msgr2=0x7f4cf8153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf80d2af0 0x7f4cf8153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 -- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815e360 msgr2=0x7f4cf80b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815e360 0x7f4cf80b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.766+0000 7f4cfd600640 1 -- 172.21.15.7:0/3912075745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf80cf5e0 con 0x7f4cf815ee50 2024-08-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.767+0000 7f4cfd600640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf815ee50 0x7f4cf80b1ec0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0034040 tx=0x7f4cf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.767+0000 7f4cf4c00640 1 -- 172.21.15.7:0/3912075745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0036050 con 0x7f4cf815ee50 2024-08-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.767+0000 7f4cf4c00640 1 -- 172.21.15.7:0/3912075745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf0042070 con 0x7f4cf815ee50 2024-08-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.767+0000 7f4cf4c00640 1 -- 172.21.15.7:0/3912075745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0009510 con 0x7f4cf815ee50 2024-08-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.767+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf80cf8c0 con 0x7f4cf815ee50 2024-08-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.767+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf80b9530 con 0x7f4cf815ee50 2024-08-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.768+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf80d2f50 con 0x7f4cf815ee50 2024-08-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.769+0000 7f4cf4c00640 1 -- 172.21.15.7:0/3912075745 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cf0007bf0 con 0x7f4cf815ee50 2024-08-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.770+0000 7f4cf4c00640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4cd806be30 0x7f4cd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.770+0000 7f4cf4c00640 1 -- 172.21.15.7:0/3912075745 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4cf00abc20 con 0x7f4cf815ee50 2024-08-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.770+0000 7f4cfcc00640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4cd806be30 0x7f4cd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.771+0000 7f4cfcc00640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4cd806be30 0x7f4cd806e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009b40 tx=0x7f4cec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.774+0000 7f4cf4c00640 1 -- 172.21.15.7:0/3912075745 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4cf007a090 con 0x7f4cf815ee50 2024-08-19T00:39:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.959+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cf80d50d0 con 0x7f4cf815ee50 2024-08-19T00:39:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.960+0000 7f4cf4c00640 1 -- 172.21.15.7:0/3912075745 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16629 (secure 0 0 0) 0x7f4cf007e390 con 0x7f4cf815ee50 2024-08-19T00:39:39.962 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:39.962 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:39:37.128199+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:39:33.403543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-08-19T00:39:34.553083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:39:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4cd806be30 msgr2=0x7f4cd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4cd806be30 0x7f4cd806e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009b40 tx=0x7f4cec009190 comp rx=0 tx=0).stop 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf815ee50 msgr2=0x7f4cf80b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf815ee50 0x7f4cf80b1ec0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0034040 tx=0x7f4cf0004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 shutdown_connections 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4cd806be30 0x7f4cd806e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf815ee50 0x7f4cf80b1ec0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf815e360 0x7f4cf80b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 --2- 172.21.15.7:0/3912075745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf80d2af0 0x7f4cf8153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 >> 172.21.15.7:0/3912075745 conn(0x7f4cf808dbf0 msgr2=0x7f4cf80d3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 shutdown_connections 2024-08-19T00:39:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:39.963+0000 7f4cfe000640 1 -- 172.21.15.7:0/3912075745 wait complete. 2024-08-19T00:39:39.980 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:39:39.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:40.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.135+0000 7f3069e00640 1 Processor -- start 2024-08-19T00:39:40.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.135+0000 7f3069e00640 1 -- start start 2024-08-19T00:39:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.136+0000 7f3069e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3064071980 0x7f30640cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.136+0000 7f3069e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30640cdfb0 con 0x7f306406e710 2024-08-19T00:39:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.136+0000 7f3069e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30640ce290 con 0x7f30640d03c0 2024-08-19T00:39:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.136+0000 7f3069e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f30640cebc0 con 0x7f3064071980 2024-08-19T00:39:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.136+0000 7f3062000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f306406e710 0x7f30640b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45568/0 (socket says 172.21.15.7:45568) 2024-08-19T00:39:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.136+0000 7f3062000640 1 -- 172.21.15.7:0/3549308593 learned_addr learned my addr 172.21.15.7:0/3549308593 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3063400640 1 --2- 172.21.15.7:0/3549308593 >> v2:172.21.15.162:3300/0 conn(0x7f3064071980 0x7f30640cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3061600640 1 -- 172.21.15.7:0/3549308593 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655543938 0 0) 0x7f30640cdfb0 con 0x7f306406e710 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3061600640 1 -- 172.21.15.7:0/3549308593 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3048003520 con 0x7f306406e710 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3061600640 1 -- 172.21.15.7:0/3549308593 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882738387 0 0) 0x7f30640ce290 con 0x7f30640d03c0 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3061600640 1 -- 172.21.15.7:0/3549308593 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30640cdfb0 con 0x7f30640d03c0 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3063400640 1 -- 172.21.15.7:0/3549308593 >> v1:172.21.15.162:6789/0 conn(0x7f30640d03c0 legacy=0x7f30640d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3063400640 1 -- 172.21.15.7:0/3549308593 >> v1:172.21.15.7:6789/0 conn(0x7f306406e710 legacy=0x7f30640b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.137+0000 7f3063400640 1 -- 172.21.15.7:0/3549308593 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30640ce570 con 0x7f3064071980 2024-08-19T00:39:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.138+0000 7f3063400640 1 --2- 172.21.15.7:0/3549308593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3064071980 0x7f30640cf050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f305c009dc0 tx=0x7f305c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a477085a73c7bf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3061600640 1 -- 172.21.15.7:0/3549308593 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c007740 con 0x7f3064071980 2024-08-19T00:39:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3061600640 1 -- 172.21.15.7:0/3549308593 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c0078e0 con 0x7f3064071980 2024-08-19T00:39:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3061600640 1 -- 172.21.15.7:0/3549308593 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c007cb0 con 0x7f3064071980 2024-08-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3069e00640 1 -- 172.21.15.7:0/3549308593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3064071980 msgr2=0x7f30640cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3069e00640 1 --2- 172.21.15.7:0/3549308593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3064071980 0x7f30640cf050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f305c009dc0 tx=0x7f305c02a730 comp rx=0 tx=0).stop 2024-08-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3069e00640 1 -- 172.21.15.7:0/3549308593 shutdown_connections 2024-08-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3069e00640 1 --2- 172.21.15.7:0/3549308593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3064071980 0x7f30640cf050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3069e00640 1 -- 172.21.15.7:0/3549308593 >> 172.21.15.7:0/3549308593 conn(0x7f306406bc70 msgr2=0x7f306406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3069e00640 1 -- 172.21.15.7:0/3549308593 shutdown_connections 2024-08-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.139+0000 7f3069e00640 1 -- 172.21.15.7:0/3549308593 wait complete. 2024-08-19T00:39:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.141+0000 7f3069e00640 1 Processor -- start 2024-08-19T00:39:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.141+0000 7f3069e00640 1 -- start start 2024-08-19T00:39:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3069e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306406e710 0x7f30641f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3069e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064071980 0x7f3064159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3069e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30640d03c0 0x7f306415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3069e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3064073c60 con 0x7f30640d03c0 2024-08-19T00:39:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3069e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3064073ae0 con 0x7f306406e710 2024-08-19T00:39:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3069e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30640cf590 con 0x7f3064071980 2024-08-19T00:39:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3063400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30640d03c0 0x7f306415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3063400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30640d03c0 0x7f306415a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41538/0 (socket says 172.21.15.7:41538) 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3063400640 1 -- 172.21.15.7:0/3686261100 learned_addr learned my addr 172.21.15.7:0/3686261100 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3062000640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064071980 0x7f3064159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.142+0000 7f3062a00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306406e710 0x7f30641f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3063400640 1 -- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064071980 msgr2=0x7f3064159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3063400640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064071980 0x7f3064159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3063400640 1 -- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306406e710 msgr2=0x7f30641f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3063400640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306406e710 0x7f30641f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3063400640 1 -- 172.21.15.7:0/3686261100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3064157fb0 con 0x7f30640d03c0 2024-08-19T00:39:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3063400640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30640d03c0 0x7f306415a320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f305c009ee0 tx=0x7f305c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f305b400640 1 -- 172.21.15.7:0/3686261100 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c040070 con 0x7f30640d03c0 2024-08-19T00:39:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f305b400640 1 -- 172.21.15.7:0/3686261100 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c031c60 con 0x7f30640d03c0 2024-08-19T00:39:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f305b400640 1 -- 172.21.15.7:0/3686261100 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c009450 con 0x7f30640d03c0 2024-08-19T00:39:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3064158290 con 0x7f30640d03c0 2024-08-19T00:39:40.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.143+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3064158850 con 0x7f30640d03c0 2024-08-19T00:39:40.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.144+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30640ce290 con 0x7f30640d03c0 2024-08-19T00:39:40.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.145+0000 7f305b400640 1 -- 172.21.15.7:0/3686261100 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f305c039040 con 0x7f30640d03c0 2024-08-19T00:39:40.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.147+0000 7f305b400640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.147+0000 7f305b400640 1 -- 172.21.15.7:0/3686261100 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f305c0abdd0 con 0x7f30640d03c0 2024-08-19T00:39:40.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.147+0000 7f3062a00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.148+0000 7f3062a00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f304406be30 0x7f304406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3054007fd0 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.151+0000 7f305b400640 1 -- 172.21.15.7:0/3686261100 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f305c07a090 con 0x7f30640d03c0 2024-08-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.331+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3064073560 con 0x7f304406be30 2024-08-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.338+0000 7f305b400640 1 -- 172.21.15.7:0/3686261100 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246637 (secure 0 0 0) 0x7f3064073560 con 0x7f304406be30 2024-08-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f304406be30 msgr2=0x7f304406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f304406be30 0x7f304406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3054007fd0 tx=0x7f3054009040 comp rx=0 tx=0).stop 2024-08-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30640d03c0 msgr2=0x7f306415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30640d03c0 0x7f306415a320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f305c009ee0 tx=0x7f305c004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 shutdown_connections 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30640d03c0 0x7f306415a320 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064071980 0x7f3064159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 --2- 172.21.15.7:0/3686261100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306406e710 0x7f30641f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 >> 172.21.15.7:0/3686261100 conn(0x7f306406bc70 msgr2=0x7f306406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 shutdown_connections 2024-08-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.342+0000 7f3069e00640 1 -- 172.21.15.7:0/3686261100 wait complete. 2024-08-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-08-19T00:39:39.290537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243208,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731512,"statfs":{"total":773094113280,"available":772845068288,"internally_reserved":0,"allocated":6389760,"data_stored":3316150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.171220"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143209+0000","last_change":"2024-08-19T00:39:35.143209+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143209+0000","last_undegraded":"2024-08-19T00:39:35.143209+0000","last_fullsized":"2024-08-19T00:39:35.143209+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133535+0000","last_change":"2024-08-19T00:39:35.133535+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133535+0000","last_undegraded":"2024-08-19T00:39:35.133535+0000","last_fullsized":"2024-08-19T00:39:35.133535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.135354+0000","last_change":"2024-08-19T00:39:35.135354+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.135354+0000","last_undegraded":"2024-08-19T00:39:35.135354+0000","last_fullsized":"2024-08-19T00:39:35.135354+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134415+0000","last_change":"2024-08-19T00:39:35.134415+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134415+0000","last_undegraded":"2024-08-19T00:39:35.134415+0000","last_fullsized":"2024-08-19T00:39:35.134415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142907+0000","last_change":"2024-08-19T00:39:35.142907+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142907+0000","last_undegraded":"2024-08-19T00:39:35.142907+0000","last_fullsized":"2024-08-19T00:39:35.142907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141638+0000","last_change":"2024-08-19T00:39:35.141638+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141638+0000","last_undegraded":"2024-08-19T00:39:35.141638+0000","last_fullsized":"2024-08-19T00:39:35.141638+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136287+0000","last_change":"2024-08-19T00:39:35.136287+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136287+0000","last_undegraded":"2024-08-19T00:39:35.136287+0000","last_fullsized":"2024-08-19T00:39:35.136287+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.139150+0000","last_change":"2024-08-19T00:39:35.139150+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.139150+0000","last_undegraded":"2024-08-19T00:39:35.139150+0000","last_fullsized":"2024-08-19T00:39:35.139150+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143425+0000","last_change":"2024-08-19T00:39:35.143425+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143425+0000","last_undegraded":"2024-08-19T00:39:35.143425+0000","last_fullsized":"2024-08-19T00:39:35.143425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141185+0000","last_change":"2024-08-19T00:39:35.141185+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141185+0000","last_undegraded":"2024-08-19T00:39:35.141185+0000","last_fullsized":"2024-08-19T00:39:35.141185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133143+0000","last_change":"2024-08-19T00:39:35.133143+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133143+0000","last_undegraded":"2024-08-19T00:39:35.133143+0000","last_fullsized":"2024-08-19T00:39:35.133143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140146+0000","last_change":"2024-08-19T00:39:35.140146+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140146+0000","last_undegraded":"2024-08-19T00:39:35.140146+0000","last_fullsized":"2024-08-19T00:39:35.140146+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133578+0000","last_change":"2024-08-19T00:39:35.133578+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133578+0000","last_undegraded":"2024-08-19T00:39:35.133578+0000","last_fullsized":"2024-08-19T00:39:35.133578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134447+0000","last_change":"2024-08-19T00:39:35.134447+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134447+0000","last_undegraded":"2024-08-19T00:39:35.134447+0000","last_fullsized":"2024-08-19T00:39:35.134447+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131380+0000","last_change":"2024-08-19T00:39:35.131380+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131380+0000","last_undegraded":"2024-08-19T00:39:35.131380+0000","last_fullsized":"2024-08-19T00:39:35.131380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140063+0000","last_change":"2024-08-19T00:39:35.140063+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140063+0000","last_undegraded":"2024-08-19T00:39:35.140063+0000","last_fullsized":"2024-08-19T00:39:35.140063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142686+0000","last_change":"2024-08-19T00:39:35.142686+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142686+0000","last_undegraded":"2024-08-19T00:39:35.142686+0000","last_fullsized":"2024-08-19T00:39:35.142686+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133141+0000","last_change":"2024-08-19T00:39:35.133141+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133141+0000","last_undegraded":"2024-08-19T00:39:35.133141+0000","last_fullsized":"2024-08-19T00:39:35.133141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132860+0000","last_change":"2024-08-19T00:39:35.132860+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132860+0000","last_undegraded":"2024-08-19T00:39:35.132860+0000","last_fullsized":"2024-08-19T00:39:35.132860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132727+0000","last_change":"2024-08-19T00:39:35.132727+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132727+0000","last_undegraded":"2024-08-19T00:39:35.132727+0000","last_fullsized":"2024-08-19T00:39:35.132727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132589+0000","last_change":"2024-08-19T00:39:35.132589+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132589+0000","last_undegraded":"2024-08-19T00:39:35.132589+0000","last_fullsized":"2024-08-19T00:39:35.132589+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.130767+0000","last_change":"2024-08-19T00:39:35.130767+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.130767+0000","last_undegraded":"2024-08-19T00:39:35.130767+0000","last_fullsized":"2024-08-19T00:39:35.130767+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133144+0000","last_change":"2024-08-19T00:39:35.133144+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133144+0000","last_undegraded":"2024-08-19T00:39:35.133144+0000","last_fullsized":"2024-08-19T00:39:35.133144+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143039+0000","last_change":"2024-08-19T00:39:35.143039+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143039+0000","last_undegraded":"2024-08-19T00:39:35.143039+0000","last_fullsized":"2024-08-19T00:39:35.143039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133564+0000","last_change":"2024-08-19T00:39:35.133564+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133564+0000","last_undegraded":"2024-08-19T00:39:35.133564+0000","last_fullsized":"2024-08-19T00:39:35.133564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133210+0000","last_change":"2024-08-19T00:39:35.133210+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133210+0000","last_undegraded":"2024-08-19T00:39:35.133210+0000","last_fullsized":"2024-08-19T00:39:35.133210+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132264+0000","last_change":"2024-08-19T00:39:35.132264+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132264+0000","last_undegraded":"2024-08-19T00:39:35.132264+0000","last_fullsized":"2024-08-19T00:39:35.132264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.138426+0000","last_change":"2024-08-19T00:39:35.138426+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.138426+0000","last_undegraded":"2024-08-19T00:39:35.138426+0000","last_fullsized":"2024-08-19T00:39:35.138426+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141515+0000","last_change":"2024-08-19T00:39:35.141515+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141515+0000","last_undegraded":"2024-08-19T00:39:35.141515+0000","last_fullsized":"2024-08-19T00:39:35.141515+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134196+0000","last_change":"2024-08-19T00:39:35.134196+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134196+0000","last_undegraded":"2024-08-19T00:39:35.134196+0000","last_fullsized":"2024-08-19T00:39:35.134196+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132948+0000","last_change":"2024-08-19T00:39:35.132948+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132948+0000","last_undegraded":"2024-08-19T00:39:35.132948+0000","last_fullsized":"2024-08-19T00:39:35.132948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131384+0000","last_change":"2024-08-19T00:39:35.131384+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131384+0000","last_undegraded":"2024-08-19T00:39:35.131384+0000","last_fullsized":"2024-08-19T00:39:35.131384+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140653+0000","last_change":"2024-08-19T00:39:35.140653+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140653+0000","last_undegraded":"2024-08-19T00:39:35.140653+0000","last_fullsized":"2024-08-19T00:39:35.140653+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154201+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:35.154201+0000","last_peered":"2024-08-19T00:39:35.154201+0000","last_clean":"2024-08-19T00:39:35.154201+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:35.154201+0000","last_undegraded":"2024-08-19T00:39:35.154201+0000","last_fullsized":"2024-08-19T00:39:35.154201+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:06.673602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141845+0000","last_change":"2024-08-19T00:39:35.141845+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141845+0000","last_undegraded":"2024-08-19T00:39:35.141845+0000","last_fullsized":"2024-08-19T00:39:35.141845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.151752+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:35.151752+0000","last_peered":"2024-08-19T00:39:35.151752+0000","last_clean":"2024-08-19T00:39:35.151752+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:35.151752+0000","last_undegraded":"2024-08-19T00:39:35.151752+0000","last_fullsized":"2024-08-19T00:39:35.151752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:06:18.313346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137899+0000","last_change":"2024-08-19T00:39:35.137899+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137899+0000","last_undegraded":"2024-08-19T00:39:35.137899+0000","last_fullsized":"2024-08-19T00:39:35.137899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155245+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:35.155245+0000","last_peered":"2024-08-19T00:39:35.155245+0000","last_clean":"2024-08-19T00:39:35.155245+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:35.155245+0000","last_undegraded":"2024-08-19T00:39:35.155245+0000","last_fullsized":"2024-08-19T00:39:35.155245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:48.144249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143578+0000","last_change":"2024-08-19T00:39:35.143578+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143578+0000","last_undegraded":"2024-08-19T00:39:35.143578+0000","last_fullsized":"2024-08-19T00:39:35.143578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153602+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:35.153602+0000","last_peered":"2024-08-19T00:39:35.153602+0000","last_clean":"2024-08-19T00:39:35.153602+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:35.153602+0000","last_undegraded":"2024-08-19T00:39:35.153602+0000","last_fullsized":"2024-08-19T00:39:35.153602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137541+0000","last_change":"2024-08-19T00:39:35.137541+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137541+0000","last_undegraded":"2024-08-19T00:39:35.137541+0000","last_fullsized":"2024-08-19T00:39:35.137541+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.149168+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:35.149168+0000","last_peered":"2024-08-19T00:39:35.149168+0000","last_clean":"2024-08-19T00:39:35.149168+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:35.149168+0000","last_undegraded":"2024-08-19T00:39:35.149168+0000","last_fullsized":"2024-08-19T00:39:35.149168+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:58.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131718+0000","last_change":"2024-08-19T00:39:35.131718+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131718+0000","last_undegraded":"2024-08-19T00:39:35.131718+0000","last_fullsized":"2024-08-19T00:39:35.131718+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.156831+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:35.156831+0000","last_peered":"2024-08-19T00:39:35.156831+0000","last_clean":"2024-08-19T00:39:35.156831+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:35.156831+0000","last_undegraded":"2024-08-19T00:39:35.156831+0000","last_fullsized":"2024-08-19T00:39:35.156831+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:58.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133339+0000","last_change":"2024-08-19T00:39:35.133339+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133339+0000","last_undegraded":"2024-08-19T00:39:35.133339+0000","last_fullsized":"2024-08-19T00:39:35.133339+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154756+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:35.154756+0000","last_peered":"2024-08-19T00:39:35.154756+0000","last_clean":"2024-08-19T00:39:35.154756+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:35.154756+0000","last_undegraded":"2024-08-19T00:39:35.154756+0000","last_fullsized":"2024-08-19T00:39:35.154756+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:34:40.336587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140608+0000","last_change":"2024-08-19T00:39:35.140608+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140608+0000","last_undegraded":"2024-08-19T00:39:35.140608+0000","last_fullsized":"2024-08-19T00:39:35.140608+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.141769+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:35.141769+0000","last_peered":"2024-08-19T00:39:35.141769+0000","last_clean":"2024-08-19T00:39:35.141769+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:35.141769+0000","last_undegraded":"2024-08-19T00:39:35.141769+0000","last_fullsized":"2024-08-19T00:39:35.141769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131390+0000","last_change":"2024-08-19T00:39:35.131390+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131390+0000","last_undegraded":"2024-08-19T00:39:35.131390+0000","last_fullsized":"2024-08-19T00:39:35.131390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155279+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:35.155279+0000","last_peered":"2024-08-19T00:39:35.155279+0000","last_clean":"2024-08-19T00:39:35.155279+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:35.155279+0000","last_undegraded":"2024-08-19T00:39:35.155279+0000","last_fullsized":"2024-08-19T00:39:35.155279+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136895+0000","last_change":"2024-08-19T00:39:35.136895+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136895+0000","last_undegraded":"2024-08-19T00:39:35.136895+0000","last_fullsized":"2024-08-19T00:39:35.136895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155047+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:35.155047+0000","last_peered":"2024-08-19T00:39:35.155047+0000","last_clean":"2024-08-19T00:39:35.155047+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:35.155047+0000","last_undegraded":"2024-08-19T00:39:35.155047+0000","last_fullsized":"2024-08-19T00:39:35.155047+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:43.215883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137169+0000","last_change":"2024-08-19T00:39:35.137169+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137169+0000","last_undegraded":"2024-08-19T00:39:35.137169+0000","last_fullsized":"2024-08-19T00:39:35.137169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153528+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:35.153528+0000","last_peered":"2024-08-19T00:39:35.153528+0000","last_clean":"2024-08-19T00:39:35.153528+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:35.153528+0000","last_undegraded":"2024-08-19T00:39:35.153528+0000","last_fullsized":"2024-08-19T00:39:35.153528+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133203+0000","last_change":"2024-08-19T00:39:35.133203+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133203+0000","last_undegraded":"2024-08-19T00:39:35.133203+0000","last_fullsized":"2024-08-19T00:39:35.133203+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.142372+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:35.142372+0000","last_peered":"2024-08-19T00:39:35.142372+0000","last_clean":"2024-08-19T00:39:35.142372+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:35.142372+0000","last_undegraded":"2024-08-19T00:39:35.142372+0000","last_fullsized":"2024-08-19T00:39:35.142372+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142994+0000","last_change":"2024-08-19T00:39:35.142994+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142994+0000","last_undegraded":"2024-08-19T00:39:35.142994+0000","last_fullsized":"2024-08-19T00:39:35.142994+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154235+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:35.154235+0000","last_peered":"2024-08-19T00:39:35.154235+0000","last_clean":"2024-08-19T00:39:35.154235+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:35.154235+0000","last_undegraded":"2024-08-19T00:39:35.154235+0000","last_fullsized":"2024-08-19T00:39:35.154235+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134633+0000","last_change":"2024-08-19T00:39:35.134633+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134633+0000","last_undegraded":"2024-08-19T00:39:35.134633+0000","last_fullsized":"2024-08-19T00:39:35.134633+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153561+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:35.153561+0000","last_peered":"2024-08-19T00:39:35.153561+0000","last_clean":"2024-08-19T00:39:35.153561+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:35.153561+0000","last_undegraded":"2024-08-19T00:39:35.153561+0000","last_fullsized":"2024-08-19T00:39:35.153561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141165+0000","last_change":"2024-08-19T00:39:35.141165+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141165+0000","last_undegraded":"2024-08-19T00:39:35.141165+0000","last_fullsized":"2024-08-19T00:39:35.141165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.151452+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:35.151452+0000","last_peered":"2024-08-19T00:39:35.151452+0000","last_clean":"2024-08-19T00:39:35.151452+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:35.151452+0000","last_undegraded":"2024-08-19T00:39:35.151452+0000","last_fullsized":"2024-08-19T00:39:35.151452+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132663+0000","last_change":"2024-08-19T00:39:35.132663+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132663+0000","last_undegraded":"2024-08-19T00:39:35.132663+0000","last_fullsized":"2024-08-19T00:39:35.132663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.141957+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:35.141957+0000","last_peered":"2024-08-19T00:39:35.141957+0000","last_clean":"2024-08-19T00:39:35.141957+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:35.141957+0000","last_undegraded":"2024-08-19T00:39:35.141957+0000","last_fullsized":"2024-08-19T00:39:35.141957+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132720+0000","last_change":"2024-08-19T00:39:35.132720+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132720+0000","last_undegraded":"2024-08-19T00:39:35.132720+0000","last_fullsized":"2024-08-19T00:39:35.132720+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152759+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:35.152759+0000","last_peered":"2024-08-19T00:39:35.152759+0000","last_clean":"2024-08-19T00:39:35.152759+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:35.152759+0000","last_undegraded":"2024-08-19T00:39:35.152759+0000","last_fullsized":"2024-08-19T00:39:35.152759+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:34:40.336587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136481+0000","last_change":"2024-08-19T00:39:35.136481+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136481+0000","last_undegraded":"2024-08-19T00:39:35.136481+0000","last_fullsized":"2024-08-19T00:39:35.136481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155025+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:35.155025+0000","last_peered":"2024-08-19T00:39:35.155025+0000","last_clean":"2024-08-19T00:39:35.155025+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:35.155025+0000","last_undegraded":"2024-08-19T00:39:35.155025+0000","last_fullsized":"2024-08-19T00:39:35.155025+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:49.564189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133061+0000","last_change":"2024-08-19T00:39:35.133061+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133061+0000","last_undegraded":"2024-08-19T00:39:35.133061+0000","last_fullsized":"2024-08-19T00:39:35.133061+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155164+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:35.155164+0000","last_peered":"2024-08-19T00:39:35.155164+0000","last_clean":"2024-08-19T00:39:35.155164+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:35.155164+0000","last_undegraded":"2024-08-19T00:39:35.155164+0000","last_fullsized":"2024-08-19T00:39:35.155164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132623+0000","last_change":"2024-08-19T00:39:35.132623+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132623+0000","last_undegraded":"2024-08-19T00:39:35.132623+0000","last_fullsized":"2024-08-19T00:39:35.132623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155169+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:35.155169+0000","last_peered":"2024-08-19T00:39:35.155169+0000","last_clean":"2024-08-19T00:39:35.155169+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:35.155169+0000","last_undegraded":"2024-08-19T00:39:35.155169+0000","last_fullsized":"2024-08-19T00:39:35.155169+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:06.343511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142500+0000","last_change":"2024-08-19T00:39:35.142500+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142500+0000","last_undegraded":"2024-08-19T00:39:35.142500+0000","last_fullsized":"2024-08-19T00:39:35.142500+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.146638+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:35.146638+0000","last_peered":"2024-08-19T00:39:35.146638+0000","last_clean":"2024-08-19T00:39:35.146638+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:35.146638+0000","last_undegraded":"2024-08-19T00:39:35.146638+0000","last_fullsized":"2024-08-19T00:39:35.146638+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:40.566571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141020+0000","last_change":"2024-08-19T00:39:35.141020+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141020+0000","last_undegraded":"2024-08-19T00:39:35.141020+0000","last_fullsized":"2024-08-19T00:39:35.141020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154203+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:35.154203+0000","last_peered":"2024-08-19T00:39:35.154203+0000","last_clean":"2024-08-19T00:39:35.154203+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:35.154203+0000","last_undegraded":"2024-08-19T00:39:35.154203+0000","last_fullsized":"2024-08-19T00:39:35.154203+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:13.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137908+0000","last_change":"2024-08-19T00:39:35.137908+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137908+0000","last_undegraded":"2024-08-19T00:39:35.137908+0000","last_fullsized":"2024-08-19T00:39:35.137908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154789+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:35.154789+0000","last_peered":"2024-08-19T00:39:35.154789+0000","last_clean":"2024-08-19T00:39:35.154789+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:35.154789+0000","last_undegraded":"2024-08-19T00:39:35.154789+0000","last_fullsized":"2024-08-19T00:39:35.154789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:33.394507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132194+0000","last_change":"2024-08-19T00:39:35.132194+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132194+0000","last_undegraded":"2024-08-19T00:39:35.132194+0000","last_fullsized":"2024-08-19T00:39:35.132194+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152738+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:35.152738+0000","last_peered":"2024-08-19T00:39:35.152738+0000","last_clean":"2024-08-19T00:39:35.152738+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:35.152738+0000","last_undegraded":"2024-08-19T00:39:35.152738+0000","last_fullsized":"2024-08-19T00:39:35.152738+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:40:13.874451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134782+0000","last_change":"2024-08-19T00:39:35.134782+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134782+0000","last_undegraded":"2024-08-19T00:39:35.134782+0000","last_fullsized":"2024-08-19T00:39:35.134782+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.156803+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:35.156803+0000","last_peered":"2024-08-19T00:39:35.156803+0000","last_clean":"2024-08-19T00:39:35.156803+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:35.156803+0000","last_undegraded":"2024-08-19T00:39:35.156803+0000","last_fullsized":"2024-08-19T00:39:35.156803+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:58.021332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132061+0000","last_change":"2024-08-19T00:39:35.132061+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132061+0000","last_undegraded":"2024-08-19T00:39:35.132061+0000","last_fullsized":"2024-08-19T00:39:35.132061+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155260+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:35.155260+0000","last_peered":"2024-08-19T00:39:35.155260+0000","last_clean":"2024-08-19T00:39:35.155260+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:35.155260+0000","last_undegraded":"2024-08-19T00:39:35.155260+0000","last_fullsized":"2024-08-19T00:39:35.155260+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137067+0000","last_change":"2024-08-19T00:39:35.137067+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137067+0000","last_undegraded":"2024-08-19T00:39:35.137067+0000","last_fullsized":"2024-08-19T00:39:35.137067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.150228+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:35.150228+0000","last_peered":"2024-08-19T00:39:35.150228+0000","last_clean":"2024-08-19T00:39:35.150228+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:35.150228+0000","last_undegraded":"2024-08-19T00:39:35.150228+0000","last_fullsized":"2024-08-19T00:39:35.150228+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140593+0000","last_change":"2024-08-19T00:39:35.140593+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140593+0000","last_undegraded":"2024-08-19T00:39:35.140593+0000","last_fullsized":"2024-08-19T00:39:35.140593+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152703+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:35.152703+0000","last_peered":"2024-08-19T00:39:35.152703+0000","last_clean":"2024-08-19T00:39:35.152703+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:35.152703+0000","last_undegraded":"2024-08-19T00:39:35.152703+0000","last_fullsized":"2024-08-19T00:39:35.152703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:33.394507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131766+0000","last_change":"2024-08-19T00:39:35.131766+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131766+0000","last_undegraded":"2024-08-19T00:39:35.131766+0000","last_fullsized":"2024-08-19T00:39:35.131766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154156+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:35.154156+0000","last_peered":"2024-08-19T00:39:35.154156+0000","last_clean":"2024-08-19T00:39:35.154156+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:35.154156+0000","last_undegraded":"2024-08-19T00:39:35.154156+0000","last_fullsized":"2024-08-19T00:39:35.154156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137170+0000","last_change":"2024-08-19T00:39:35.137170+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137170+0000","last_undegraded":"2024-08-19T00:39:35.137170+0000","last_fullsized":"2024-08-19T00:39:35.137170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154923+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:35.154923+0000","last_peered":"2024-08-19T00:39:35.154923+0000","last_clean":"2024-08-19T00:39:35.154923+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:35.154923+0000","last_undegraded":"2024-08-19T00:39:35.154923+0000","last_fullsized":"2024-08-19T00:39:35.154923+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:09.101503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132459+0000","last_change":"2024-08-19T00:39:35.132459+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132459+0000","last_undegraded":"2024-08-19T00:39:35.132459+0000","last_fullsized":"2024-08-19T00:39:35.132459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.147663+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:35.147663+0000","last_peered":"2024-08-19T00:39:35.147663+0000","last_clean":"2024-08-19T00:39:35.147663+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:35.147663+0000","last_undegraded":"2024-08-19T00:39:35.147663+0000","last_fullsized":"2024-08-19T00:39:35.147663+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:57.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136290+0000","last_change":"2024-08-19T00:39:35.136290+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136290+0000","last_undegraded":"2024-08-19T00:39:35.136290+0000","last_fullsized":"2024-08-19T00:39:35.136290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.150599+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:35.150599+0000","last_peered":"2024-08-19T00:39:35.150599+0000","last_clean":"2024-08-19T00:39:35.150599+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:35.150599+0000","last_undegraded":"2024-08-19T00:39:35.150599+0000","last_fullsized":"2024-08-19T00:39:35.150599+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:37.558154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.143841+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:35.143841+0000","last_peered":"2024-08-19T00:39:35.143841+0000","last_clean":"2024-08-19T00:39:35.143841+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:35.143841+0000","last_undegraded":"2024-08-19T00:39:35.143841+0000","last_fullsized":"2024-08-19T00:39:35.143841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":862001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":271633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":855726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:40.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.554+0000 7f9842a00640 1 Processor -- start 2024-08-19T00:39:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.555+0000 7f9842a00640 1 -- start start 2024-08-19T00:39:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f9842a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f9842a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983c06f7f0 con 0x7f983c0739a0 2024-08-19T00:39:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f9842a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983c06f510 con 0x7f983c0cec10 2024-08-19T00:39:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f9842a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f983c072980 con 0x7f983c159bf0 2024-08-19T00:39:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f9833e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f983c0739a0 0x7f983c0ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45584/0 (socket says 172.21.15.7:45584) 2024-08-19T00:39:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f9833e00640 1 -- 172.21.15.7:0/2400000728 learned_addr learned my addr 172.21.15.7:0/2400000728 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f983be00640 1 --2- 172.21.15.7:0/2400000728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.556+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421492225 0 0) 0x7f983c06f7f0 con 0x7f983c0739a0 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.557+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9820003520 con 0x7f983c0739a0 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.557+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809706922 0 0) 0x7f983c06f510 con 0x7f983c0cec10 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.557+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f983c06f7f0 con 0x7f983c0cec10 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.557+0000 7f983be00640 1 -- 172.21.15.7:0/2400000728 >> v1:172.21.15.162:6789/0 conn(0x7f983c0cec10 legacy=0x7f983c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.557+0000 7f983be00640 1 -- 172.21.15.7:0/2400000728 >> v1:172.21.15.7:6789/0 conn(0x7f983c0739a0 legacy=0x7f983c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.557+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3761563833 0 0) 0x7f9820003520 con 0x7f983c0739a0 2024-08-19T00:39:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.557+0000 7f983be00640 1 -- 172.21.15.7:0/2400000728 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c072c60 con 0x7f983c159bf0 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.558+0000 7f983be00640 1 --2- 172.21.15.7:0/2400000728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c073460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f982c0097d0 tx=0x7f982c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6882d58b2951346 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.558+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c037070 con 0x7f983c159bf0 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c02ab90 con 0x7f983c159bf0 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f983b400640 1 -- 172.21.15.7:0/2400000728 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824001670 con 0x7f983c159bf0 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f9842a00640 1 -- 172.21.15.7:0/2400000728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 msgr2=0x7f983c073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f9842a00640 1 --2- 172.21.15.7:0/2400000728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c073460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f982c0097d0 tx=0x7f982c02a100 comp rx=0 tx=0).stop 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f9842a00640 1 -- 172.21.15.7:0/2400000728 shutdown_connections 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f9842a00640 1 --2- 172.21.15.7:0/2400000728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c073460 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f9842a00640 1 -- 172.21.15.7:0/2400000728 >> 172.21.15.7:0/2400000728 conn(0x7f983c06bc70 msgr2=0x7f983c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f9842a00640 1 -- 172.21.15.7:0/2400000728 shutdown_connections 2024-08-19T00:39:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.559+0000 7f9842a00640 1 -- 172.21.15.7:0/2400000728 wait complete. 2024-08-19T00:39:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.561+0000 7f9842a00640 1 Processor -- start 2024-08-19T00:39:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.561+0000 7f9842a00640 1 -- start start 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9842a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0739a0 0x7f983c1f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9842a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9842a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f983c150650 0x7f983c1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9842a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f983c15a150 con 0x7f983c0739a0 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9842a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f983c159fd0 con 0x7f983c150650 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9842a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f983c0d0ad0 con 0x7f983c159bf0 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0739a0 0x7f983c1f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0739a0 0x7f983c1f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41546/0 (socket says 172.21.15.7:41546) 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 -- 172.21.15.7:0/3946094961 learned_addr learned my addr 172.21.15.7:0/3946094961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9833e00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 -- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 msgr2=0x7f983c153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 -- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f983c150650 msgr2=0x7f983c1483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f9840a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f983c150650 0x7f983c1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f983c150650 0x7f983c1483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.562+0000 7f983be00640 1 -- 172.21.15.7:0/3946094961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c148900 con 0x7f983c0739a0 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f9833e00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f9840a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f983c150650 0x7f983c1483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f983be00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0739a0 0x7f983c1f40a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f982c0097d0 tx=0x7f982c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f9838c00640 1 -- 172.21.15.7:0/3946094961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c037050 con 0x7f983c0739a0 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f9838c00640 1 -- 172.21.15.7:0/3946094961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c043070 con 0x7f983c0739a0 2024-08-19T00:39:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f9838c00640 1 -- 172.21.15.7:0/3946094961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c03ca50 con 0x7f983c0739a0 2024-08-19T00:39:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983c151320 con 0x7f983c0739a0 2024-08-19T00:39:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.563+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983c156340 con 0x7f983c0739a0 2024-08-19T00:39:40.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.564+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983c073460 con 0x7f983c0739a0 2024-08-19T00:39:40.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.565+0000 7f9838c00640 1 -- 172.21.15.7:0/3946094961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f982c03cbf0 con 0x7f983c0739a0 2024-08-19T00:39:40.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.566+0000 7f9838c00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f981806be60 0x7f981806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.566+0000 7f9838c00640 1 -- 172.21.15.7:0/3946094961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f982c0ab9e0 con 0x7f983c0739a0 2024-08-19T00:39:40.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.566+0000 7f9833e00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f981806be60 0x7f981806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.567+0000 7f9833e00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f981806be60 0x7f981806e320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f983c150590 tx=0x7f9824009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.570+0000 7f9838c00640 1 -- 172.21.15.7:0/3946094961 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f982c07a4a0 con 0x7f983c0739a0 2024-08-19T00:39:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.751+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f983c151600 con 0x7f981806be60 2024-08-19T00:39:40.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.757+0000 7f9838c00640 1 -- 172.21.15.7:0/3946094961 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246637 (secure 0 0 0) 0x7f9824001b40 con 0x7f981806be60 2024-08-19T00:39:40.762 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:40.763 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f981806be60 msgr2=0x7f981806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f981806be60 0x7f981806e320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f983c150590 tx=0x7f9824009040 comp rx=0 tx=0).stop 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0739a0 msgr2=0x7f983c1f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0739a0 0x7f983c1f40a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f982c0097d0 tx=0x7f982c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 shutdown_connections 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f981806be60 0x7f981806e320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f983c150650 0x7f983c1483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f983c159bf0 0x7f983c153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 --2- 172.21.15.7:0/3946094961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0739a0 0x7f983c1f40a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.761+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 >> 172.21.15.7:0/3946094961 conn(0x7f983c06bc70 msgr2=0x7f983c15a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:40.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.762+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 shutdown_connections 2024-08-19T00:39:40.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.762+0000 7f9842a00640 1 -- 172.21.15.7:0/3946094961 wait complete. 2024-08-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-08-19T00:39:39.290537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243208,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731512,"statfs":{"total":773094113280,"available":772845068288,"internally_reserved":0,"allocated":6389760,"data_stored":3316150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.171220"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143209+0000","last_change":"2024-08-19T00:39:35.143209+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143209+0000","last_undegraded":"2024-08-19T00:39:35.143209+0000","last_fullsized":"2024-08-19T00:39:35.143209+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133535+0000","last_change":"2024-08-19T00:39:35.133535+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133535+0000","last_undegraded":"2024-08-19T00:39:35.133535+0000","last_fullsized":"2024-08-19T00:39:35.133535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.135354+0000","last_change":"2024-08-19T00:39:35.135354+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.135354+0000","last_undegraded":"2024-08-19T00:39:35.135354+0000","last_fullsized":"2024-08-19T00:39:35.135354+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134415+0000","last_change":"2024-08-19T00:39:35.134415+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134415+0000","last_undegraded":"2024-08-19T00:39:35.134415+0000","last_fullsized":"2024-08-19T00:39:35.134415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142907+0000","last_change":"2024-08-19T00:39:35.142907+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142907+0000","last_undegraded":"2024-08-19T00:39:35.142907+0000","last_fullsized":"2024-08-19T00:39:35.142907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141638+0000","last_change":"2024-08-19T00:39:35.141638+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141638+0000","last_undegraded":"2024-08-19T00:39:35.141638+0000","last_fullsized":"2024-08-19T00:39:35.141638+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136287+0000","last_change":"2024-08-19T00:39:35.136287+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136287+0000","last_undegraded":"2024-08-19T00:39:35.136287+0000","last_fullsized":"2024-08-19T00:39:35.136287+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.139150+0000","last_change":"2024-08-19T00:39:35.139150+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.139150+0000","last_undegraded":"2024-08-19T00:39:35.139150+0000","last_fullsized":"2024-08-19T00:39:35.139150+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143425+0000","last_change":"2024-08-19T00:39:35.143425+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143425+0000","last_undegraded":"2024-08-19T00:39:35.143425+0000","last_fullsized":"2024-08-19T00:39:35.143425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141185+0000","last_change":"2024-08-19T00:39:35.141185+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141185+0000","last_undegraded":"2024-08-19T00:39:35.141185+0000","last_fullsized":"2024-08-19T00:39:35.141185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133143+0000","last_change":"2024-08-19T00:39:35.133143+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133143+0000","last_undegraded":"2024-08-19T00:39:35.133143+0000","last_fullsized":"2024-08-19T00:39:35.133143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140146+0000","last_change":"2024-08-19T00:39:35.140146+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140146+0000","last_undegraded":"2024-08-19T00:39:35.140146+0000","last_fullsized":"2024-08-19T00:39:35.140146+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133578+0000","last_change":"2024-08-19T00:39:35.133578+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133578+0000","last_undegraded":"2024-08-19T00:39:35.133578+0000","last_fullsized":"2024-08-19T00:39:35.133578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134447+0000","last_change":"2024-08-19T00:39:35.134447+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134447+0000","last_undegraded":"2024-08-19T00:39:35.134447+0000","last_fullsized":"2024-08-19T00:39:35.134447+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131380+0000","last_change":"2024-08-19T00:39:35.131380+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131380+0000","last_undegraded":"2024-08-19T00:39:35.131380+0000","last_fullsized":"2024-08-19T00:39:35.131380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140063+0000","last_change":"2024-08-19T00:39:35.140063+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140063+0000","last_undegraded":"2024-08-19T00:39:35.140063+0000","last_fullsized":"2024-08-19T00:39:35.140063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142686+0000","last_change":"2024-08-19T00:39:35.142686+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142686+0000","last_undegraded":"2024-08-19T00:39:35.142686+0000","last_fullsized":"2024-08-19T00:39:35.142686+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133141+0000","last_change":"2024-08-19T00:39:35.133141+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133141+0000","last_undegraded":"2024-08-19T00:39:35.133141+0000","last_fullsized":"2024-08-19T00:39:35.133141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132860+0000","last_change":"2024-08-19T00:39:35.132860+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132860+0000","last_undegraded":"2024-08-19T00:39:35.132860+0000","last_fullsized":"2024-08-19T00:39:35.132860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132727+0000","last_change":"2024-08-19T00:39:35.132727+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132727+0000","last_undegraded":"2024-08-19T00:39:35.132727+0000","last_fullsized":"2024-08-19T00:39:35.132727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132589+0000","last_change":"2024-08-19T00:39:35.132589+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132589+0000","last_undegraded":"2024-08-19T00:39:35.132589+0000","last_fullsized":"2024-08-19T00:39:35.132589+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.130767+0000","last_change":"2024-08-19T00:39:35.130767+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.130767+0000","last_undegraded":"2024-08-19T00:39:35.130767+0000","last_fullsized":"2024-08-19T00:39:35.130767+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133144+0000","last_change":"2024-08-19T00:39:35.133144+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133144+0000","last_undegraded":"2024-08-19T00:39:35.133144+0000","last_fullsized":"2024-08-19T00:39:35.133144+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143039+0000","last_change":"2024-08-19T00:39:35.143039+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143039+0000","last_undegraded":"2024-08-19T00:39:35.143039+0000","last_fullsized":"2024-08-19T00:39:35.143039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133564+0000","last_change":"2024-08-19T00:39:35.133564+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133564+0000","last_undegraded":"2024-08-19T00:39:35.133564+0000","last_fullsized":"2024-08-19T00:39:35.133564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133210+0000","last_change":"2024-08-19T00:39:35.133210+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133210+0000","last_undegraded":"2024-08-19T00:39:35.133210+0000","last_fullsized":"2024-08-19T00:39:35.133210+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132264+0000","last_change":"2024-08-19T00:39:35.132264+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132264+0000","last_undegraded":"2024-08-19T00:39:35.132264+0000","last_fullsized":"2024-08-19T00:39:35.132264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.138426+0000","last_change":"2024-08-19T00:39:35.138426+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.138426+0000","last_undegraded":"2024-08-19T00:39:35.138426+0000","last_fullsized":"2024-08-19T00:39:35.138426+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141515+0000","last_change":"2024-08-19T00:39:35.141515+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141515+0000","last_undegraded":"2024-08-19T00:39:35.141515+0000","last_fullsized":"2024-08-19T00:39:35.141515+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134196+0000","last_change":"2024-08-19T00:39:35.134196+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134196+0000","last_undegraded":"2024-08-19T00:39:35.134196+0000","last_fullsized":"2024-08-19T00:39:35.134196+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132948+0000","last_change":"2024-08-19T00:39:35.132948+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132948+0000","last_undegraded":"2024-08-19T00:39:35.132948+0000","last_fullsized":"2024-08-19T00:39:35.132948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131384+0000","last_change":"2024-08-19T00:39:35.131384+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131384+0000","last_undegraded":"2024-08-19T00:39:35.131384+0000","last_fullsized":"2024-08-19T00:39:35.131384+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140653+0000","last_change":"2024-08-19T00:39:35.140653+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140653+0000","last_undegraded":"2024-08-19T00:39:35.140653+0000","last_fullsized":"2024-08-19T00:39:35.140653+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154201+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:35.154201+0000","last_peered":"2024-08-19T00:39:35.154201+0000","last_clean":"2024-08-19T00:39:35.154201+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:35.154201+0000","last_undegraded":"2024-08-19T00:39:35.154201+0000","last_fullsized":"2024-08-19T00:39:35.154201+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:06.673602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141845+0000","last_change":"2024-08-19T00:39:35.141845+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141845+0000","last_undegraded":"2024-08-19T00:39:35.141845+0000","last_fullsized":"2024-08-19T00:39:35.141845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.151752+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:35.151752+0000","last_peered":"2024-08-19T00:39:35.151752+0000","last_clean":"2024-08-19T00:39:35.151752+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:35.151752+0000","last_undegraded":"2024-08-19T00:39:35.151752+0000","last_fullsized":"2024-08-19T00:39:35.151752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:06:18.313346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137899+0000","last_change":"2024-08-19T00:39:35.137899+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137899+0000","last_undegraded":"2024-08-19T00:39:35.137899+0000","last_fullsized":"2024-08-19T00:39:35.137899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155245+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:35.155245+0000","last_peered":"2024-08-19T00:39:35.155245+0000","last_clean":"2024-08-19T00:39:35.155245+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:35.155245+0000","last_undegraded":"2024-08-19T00:39:35.155245+0000","last_fullsized":"2024-08-19T00:39:35.155245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:48.144249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143578+0000","last_change":"2024-08-19T00:39:35.143578+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143578+0000","last_undegraded":"2024-08-19T00:39:35.143578+0000","last_fullsized":"2024-08-19T00:39:35.143578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153602+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:35.153602+0000","last_peered":"2024-08-19T00:39:35.153602+0000","last_clean":"2024-08-19T00:39:35.153602+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:35.153602+0000","last_undegraded":"2024-08-19T00:39:35.153602+0000","last_fullsized":"2024-08-19T00:39:35.153602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137541+0000","last_change":"2024-08-19T00:39:35.137541+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137541+0000","last_undegraded":"2024-08-19T00:39:35.137541+0000","last_fullsized":"2024-08-19T00:39:35.137541+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.149168+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:35.149168+0000","last_peered":"2024-08-19T00:39:35.149168+0000","last_clean":"2024-08-19T00:39:35.149168+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:35.149168+0000","last_undegraded":"2024-08-19T00:39:35.149168+0000","last_fullsized":"2024-08-19T00:39:35.149168+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:58.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131718+0000","last_change":"2024-08-19T00:39:35.131718+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131718+0000","last_undegraded":"2024-08-19T00:39:35.131718+0000","last_fullsized":"2024-08-19T00:39:35.131718+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.156831+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:35.156831+0000","last_peered":"2024-08-19T00:39:35.156831+0000","last_clean":"2024-08-19T00:39:35.156831+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:35.156831+0000","last_undegraded":"2024-08-19T00:39:35.156831+0000","last_fullsized":"2024-08-19T00:39:35.156831+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:58.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133339+0000","last_change":"2024-08-19T00:39:35.133339+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133339+0000","last_undegraded":"2024-08-19T00:39:35.133339+0000","last_fullsized":"2024-08-19T00:39:35.133339+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154756+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:35.154756+0000","last_peered":"2024-08-19T00:39:35.154756+0000","last_clean":"2024-08-19T00:39:35.154756+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:35.154756+0000","last_undegraded":"2024-08-19T00:39:35.154756+0000","last_fullsized":"2024-08-19T00:39:35.154756+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:34:40.336587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140608+0000","last_change":"2024-08-19T00:39:35.140608+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140608+0000","last_undegraded":"2024-08-19T00:39:35.140608+0000","last_fullsized":"2024-08-19T00:39:35.140608+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.141769+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:35.141769+0000","last_peered":"2024-08-19T00:39:35.141769+0000","last_clean":"2024-08-19T00:39:35.141769+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:35.141769+0000","last_undegraded":"2024-08-19T00:39:35.141769+0000","last_fullsized":"2024-08-19T00:39:35.141769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131390+0000","last_change":"2024-08-19T00:39:35.131390+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131390+0000","last_undegraded":"2024-08-19T00:39:35.131390+0000","last_fullsized":"2024-08-19T00:39:35.131390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155279+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:35.155279+0000","last_peered":"2024-08-19T00:39:35.155279+0000","last_clean":"2024-08-19T00:39:35.155279+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:35.155279+0000","last_undegraded":"2024-08-19T00:39:35.155279+0000","last_fullsized":"2024-08-19T00:39:35.155279+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136895+0000","last_change":"2024-08-19T00:39:35.136895+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136895+0000","last_undegraded":"2024-08-19T00:39:35.136895+0000","last_fullsized":"2024-08-19T00:39:35.136895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155047+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:35.155047+0000","last_peered":"2024-08-19T00:39:35.155047+0000","last_clean":"2024-08-19T00:39:35.155047+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:35.155047+0000","last_undegraded":"2024-08-19T00:39:35.155047+0000","last_fullsized":"2024-08-19T00:39:35.155047+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:43.215883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137169+0000","last_change":"2024-08-19T00:39:35.137169+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137169+0000","last_undegraded":"2024-08-19T00:39:35.137169+0000","last_fullsized":"2024-08-19T00:39:35.137169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153528+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:35.153528+0000","last_peered":"2024-08-19T00:39:35.153528+0000","last_clean":"2024-08-19T00:39:35.153528+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:35.153528+0000","last_undegraded":"2024-08-19T00:39:35.153528+0000","last_fullsized":"2024-08-19T00:39:35.153528+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133203+0000","last_change":"2024-08-19T00:39:35.133203+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133203+0000","last_undegraded":"2024-08-19T00:39:35.133203+0000","last_fullsized":"2024-08-19T00:39:35.133203+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.142372+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:35.142372+0000","last_peered":"2024-08-19T00:39:35.142372+0000","last_clean":"2024-08-19T00:39:35.142372+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:35.142372+0000","last_undegraded":"2024-08-19T00:39:35.142372+0000","last_fullsized":"2024-08-19T00:39:35.142372+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142994+0000","last_change":"2024-08-19T00:39:35.142994+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142994+0000","last_undegraded":"2024-08-19T00:39:35.142994+0000","last_fullsized":"2024-08-19T00:39:35.142994+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154235+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:35.154235+0000","last_peered":"2024-08-19T00:39:35.154235+0000","last_clean":"2024-08-19T00:39:35.154235+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:35.154235+0000","last_undegraded":"2024-08-19T00:39:35.154235+0000","last_fullsized":"2024-08-19T00:39:35.154235+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134633+0000","last_change":"2024-08-19T00:39:35.134633+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134633+0000","last_undegraded":"2024-08-19T00:39:35.134633+0000","last_fullsized":"2024-08-19T00:39:35.134633+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153561+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:35.153561+0000","last_peered":"2024-08-19T00:39:35.153561+0000","last_clean":"2024-08-19T00:39:35.153561+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:35.153561+0000","last_undegraded":"2024-08-19T00:39:35.153561+0000","last_fullsized":"2024-08-19T00:39:35.153561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141165+0000","last_change":"2024-08-19T00:39:35.141165+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141165+0000","last_undegraded":"2024-08-19T00:39:35.141165+0000","last_fullsized":"2024-08-19T00:39:35.141165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.151452+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:35.151452+0000","last_peered":"2024-08-19T00:39:35.151452+0000","last_clean":"2024-08-19T00:39:35.151452+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:35.151452+0000","last_undegraded":"2024-08-19T00:39:35.151452+0000","last_fullsized":"2024-08-19T00:39:35.151452+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132663+0000","last_change":"2024-08-19T00:39:35.132663+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132663+0000","last_undegraded":"2024-08-19T00:39:35.132663+0000","last_fullsized":"2024-08-19T00:39:35.132663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.141957+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:35.141957+0000","last_peered":"2024-08-19T00:39:35.141957+0000","last_clean":"2024-08-19T00:39:35.141957+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:35.141957+0000","last_undegraded":"2024-08-19T00:39:35.141957+0000","last_fullsized":"2024-08-19T00:39:35.141957+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132720+0000","last_change":"2024-08-19T00:39:35.132720+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132720+0000","last_undegraded":"2024-08-19T00:39:35.132720+0000","last_fullsized":"2024-08-19T00:39:35.132720+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152759+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:35.152759+0000","last_peered":"2024-08-19T00:39:35.152759+0000","last_clean":"2024-08-19T00:39:35.152759+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:35.152759+0000","last_undegraded":"2024-08-19T00:39:35.152759+0000","last_fullsized":"2024-08-19T00:39:35.152759+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:34:40.336587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136481+0000","last_change":"2024-08-19T00:39:35.136481+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136481+0000","last_undegraded":"2024-08-19T00:39:35.136481+0000","last_fullsized":"2024-08-19T00:39:35.136481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155025+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:35.155025+0000","last_peered":"2024-08-19T00:39:35.155025+0000","last_clean":"2024-08-19T00:39:35.155025+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:35.155025+0000","last_undegraded":"2024-08-19T00:39:35.155025+0000","last_fullsized":"2024-08-19T00:39:35.155025+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:49.564189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133061+0000","last_change":"2024-08-19T00:39:35.133061+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133061+0000","last_undegraded":"2024-08-19T00:39:35.133061+0000","last_fullsized":"2024-08-19T00:39:35.133061+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155164+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:35.155164+0000","last_peered":"2024-08-19T00:39:35.155164+0000","last_clean":"2024-08-19T00:39:35.155164+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:35.155164+0000","last_undegraded":"2024-08-19T00:39:35.155164+0000","last_fullsized":"2024-08-19T00:39:35.155164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132623+0000","last_change":"2024-08-19T00:39:35.132623+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132623+0000","last_undegraded":"2024-08-19T00:39:35.132623+0000","last_fullsized":"2024-08-19T00:39:35.132623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155169+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:35.155169+0000","last_peered":"2024-08-19T00:39:35.155169+0000","last_clean":"2024-08-19T00:39:35.155169+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:35.155169+0000","last_undegraded":"2024-08-19T00:39:35.155169+0000","last_fullsized":"2024-08-19T00:39:35.155169+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:06.343511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142500+0000","last_change":"2024-08-19T00:39:35.142500+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142500+0000","last_undegraded":"2024-08-19T00:39:35.142500+0000","last_fullsized":"2024-08-19T00:39:35.142500+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.146638+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:35.146638+0000","last_peered":"2024-08-19T00:39:35.146638+0000","last_clean":"2024-08-19T00:39:35.146638+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:35.146638+0000","last_undegraded":"2024-08-19T00:39:35.146638+0000","last_fullsized":"2024-08-19T00:39:35.146638+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:40.566571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141020+0000","last_change":"2024-08-19T00:39:35.141020+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141020+0000","last_undegraded":"2024-08-19T00:39:35.141020+0000","last_fullsized":"2024-08-19T00:39:35.141020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154203+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:35.154203+0000","last_peered":"2024-08-19T00:39:35.154203+0000","last_clean":"2024-08-19T00:39:35.154203+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:35.154203+0000","last_undegraded":"2024-08-19T00:39:35.154203+0000","last_fullsized":"2024-08-19T00:39:35.154203+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:13.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137908+0000","last_change":"2024-08-19T00:39:35.137908+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137908+0000","last_undegraded":"2024-08-19T00:39:35.137908+0000","last_fullsized":"2024-08-19T00:39:35.137908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154789+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:35.154789+0000","last_peered":"2024-08-19T00:39:35.154789+0000","last_clean":"2024-08-19T00:39:35.154789+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:35.154789+0000","last_undegraded":"2024-08-19T00:39:35.154789+0000","last_fullsized":"2024-08-19T00:39:35.154789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:33.394507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132194+0000","last_change":"2024-08-19T00:39:35.132194+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132194+0000","last_undegraded":"2024-08-19T00:39:35.132194+0000","last_fullsized":"2024-08-19T00:39:35.132194+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152738+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:35.152738+0000","last_peered":"2024-08-19T00:39:35.152738+0000","last_clean":"2024-08-19T00:39:35.152738+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:35.152738+0000","last_undegraded":"2024-08-19T00:39:35.152738+0000","last_fullsized":"2024-08-19T00:39:35.152738+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:40:13.874451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134782+0000","last_change":"2024-08-19T00:39:35.134782+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134782+0000","last_undegraded":"2024-08-19T00:39:35.134782+0000","last_fullsized":"2024-08-19T00:39:35.134782+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.156803+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:35.156803+0000","last_peered":"2024-08-19T00:39:35.156803+0000","last_clean":"2024-08-19T00:39:35.156803+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:35.156803+0000","last_undegraded":"2024-08-19T00:39:35.156803+0000","last_fullsized":"2024-08-19T00:39:35.156803+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:58.021332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132061+0000","last_change":"2024-08-19T00:39:35.132061+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132061+0000","last_undegraded":"2024-08-19T00:39:35.132061+0000","last_fullsized":"2024-08-19T00:39:35.132061+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155260+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:35.155260+0000","last_peered":"2024-08-19T00:39:35.155260+0000","last_clean":"2024-08-19T00:39:35.155260+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:35.155260+0000","last_undegraded":"2024-08-19T00:39:35.155260+0000","last_fullsized":"2024-08-19T00:39:35.155260+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137067+0000","last_change":"2024-08-19T00:39:35.137067+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137067+0000","last_undegraded":"2024-08-19T00:39:35.137067+0000","last_fullsized":"2024-08-19T00:39:35.137067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.150228+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:35.150228+0000","last_peered":"2024-08-19T00:39:35.150228+0000","last_clean":"2024-08-19T00:39:35.150228+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:35.150228+0000","last_undegraded":"2024-08-19T00:39:35.150228+0000","last_fullsized":"2024-08-19T00:39:35.150228+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140593+0000","last_change":"2024-08-19T00:39:35.140593+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140593+0000","last_undegraded":"2024-08-19T00:39:35.140593+0000","last_fullsized":"2024-08-19T00:39:35.140593+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152703+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:35.152703+0000","last_peered":"2024-08-19T00:39:35.152703+0000","last_clean":"2024-08-19T00:39:35.152703+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:35.152703+0000","last_undegraded":"2024-08-19T00:39:35.152703+0000","last_fullsized":"2024-08-19T00:39:35.152703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:33.394507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131766+0000","last_change":"2024-08-19T00:39:35.131766+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131766+0000","last_undegraded":"2024-08-19T00:39:35.131766+0000","last_fullsized":"2024-08-19T00:39:35.131766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154156+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:35.154156+0000","last_peered":"2024-08-19T00:39:35.154156+0000","last_clean":"2024-08-19T00:39:35.154156+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:35.154156+0000","last_undegraded":"2024-08-19T00:39:35.154156+0000","last_fullsized":"2024-08-19T00:39:35.154156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137170+0000","last_change":"2024-08-19T00:39:35.137170+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137170+0000","last_undegraded":"2024-08-19T00:39:35.137170+0000","last_fullsized":"2024-08-19T00:39:35.137170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154923+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:35.154923+0000","last_peered":"2024-08-19T00:39:35.154923+0000","last_clean":"2024-08-19T00:39:35.154923+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:35.154923+0000","last_undegraded":"2024-08-19T00:39:35.154923+0000","last_fullsized":"2024-08-19T00:39:35.154923+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:09.101503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132459+0000","last_change":"2024-08-19T00:39:35.132459+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132459+0000","last_undegraded":"2024-08-19T00:39:35.132459+0000","last_fullsized":"2024-08-19T00:39:35.132459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.147663+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:35.147663+0000","last_peered":"2024-08-19T00:39:35.147663+0000","last_clean":"2024-08-19T00:39:35.147663+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:35.147663+0000","last_undegraded":"2024-08-19T00:39:35.147663+0000","last_fullsized":"2024-08-19T00:39:35.147663+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:57.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136290+0000","last_change":"2024-08-19T00:39:35.136290+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136290+0000","last_undegraded":"2024-08-19T00:39:35.136290+0000","last_fullsized":"2024-08-19T00:39:35.136290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.150599+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:35.150599+0000","last_peered":"2024-08-19T00:39:35.150599+0000","last_clean":"2024-08-19T00:39:35.150599+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:35.150599+0000","last_undegraded":"2024-08-19T00:39:35.150599+0000","last_fullsized":"2024-08-19T00:39:35.150599+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:37.558154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.143841+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:35.143841+0000","last_peered":"2024-08-19T00:39:35.143841+0000","last_clean":"2024-08-19T00:39:35.143841+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:35.143841+0000","last_undegraded":"2024-08-19T00:39:35.143841+0000","last_fullsized":"2024-08-19T00:39:35.143841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":862001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":271633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":855726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:40.782 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.972+0000 7fe086a00640 1 Processor -- start 2024-08-19T00:39:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.973+0000 7fe086a00640 1 -- start start 2024-08-19T00:39:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe086a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0800d03c0 0x7fe080071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe086a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe08006e710 0x7fe0800d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe086a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0800d0ce0 con 0x7fe0800b3750 2024-08-19T00:39:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe086a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe0800cebc0 con 0x7fe08006e710 2024-08-19T00:39:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe086a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0800cdfb0 con 0x7fe0800d03c0 2024-08-19T00:39:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe077e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe08006e710 0x7fe0800d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe084a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe0800b3750 0x7fe0800cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45588/0 (socket says 172.21.15.7:45588) 2024-08-19T00:39:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe084a00640 1 -- 172.21.15.7:0/807147295 learned_addr learned my addr 172.21.15.7:0/807147295 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.974+0000 7fe07fe00640 1 --2- 172.21.15.7:0/807147295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0800d03c0 0x7fe080071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.975+0000 7fe077e00640 1 -- 172.21.15.7:0/807147295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0800d03c0 msgr2=0x7fe080071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.975+0000 7fe077e00640 1 --2- 172.21.15.7:0/807147295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0800d03c0 0x7fe080071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.975+0000 7fe077e00640 1 -- 172.21.15.7:0/807147295 >> v1:172.21.15.7:6789/0 conn(0x7fe0800b3750 legacy=0x7fe0800cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.975+0000 7fe077e00640 1 -- 172.21.15.7:0/807147295 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0800ce290 con 0x7fe08006e710 2024-08-19T00:39:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.975+0000 7fe07f400640 1 -- 172.21.15.7:0/807147295 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315727265 0 0) 0x7fe0800d0ce0 con 0x7fe0800b3750 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.976+0000 7fe077e00640 1 --2- 172.21.15.7:0/807147295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08006e710 0x7fe0800d07a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe0680097a0 tx=0x7fe06802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e1bde2576d29aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.976+0000 7fe07f400640 1 -- 172.21.15.7:0/807147295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068037070 con 0x7fe08006e710 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.976+0000 7fe07f400640 1 -- 172.21.15.7:0/807147295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe068032440 con 0x7fe08006e710 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.976+0000 7fe07f400640 1 -- 172.21.15.7:0/807147295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068032810 con 0x7fe08006e710 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.976+0000 7fe086a00640 1 -- 172.21.15.7:0/807147295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08006e710 msgr2=0x7fe0800d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.976+0000 7fe086a00640 1 --2- 172.21.15.7:0/807147295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08006e710 0x7fe0800d07a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe0680097a0 tx=0x7fe06802a180 comp rx=0 tx=0).stop 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.977+0000 7fe086a00640 1 -- 172.21.15.7:0/807147295 shutdown_connections 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.977+0000 7fe086a00640 1 --2- 172.21.15.7:0/807147295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08006e710 0x7fe0800d07a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.977+0000 7fe086a00640 1 --2- 172.21.15.7:0/807147295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0800d03c0 0x7fe080071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.977+0000 7fe086a00640 1 -- 172.21.15.7:0/807147295 >> 172.21.15.7:0/807147295 conn(0x7fe08006bc70 msgr2=0x7fe08006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.977+0000 7fe086a00640 1 -- 172.21.15.7:0/807147295 shutdown_connections 2024-08-19T00:39:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.977+0000 7fe086a00640 1 -- 172.21.15.7:0/807147295 wait complete. 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.978+0000 7fe086a00640 1 Processor -- start 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.978+0000 7fe086a00640 1 -- start start 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.979+0000 7fe086a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08006e710 0x7fe0800cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.979+0000 7fe086a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0800b3750 0x7fe0801f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.979+0000 7fe086a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0800d03c0 0x7fe0801584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.979+0000 7fe086a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe080073ae0 con 0x7fe0800d03c0 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.979+0000 7fe086a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0800ce850 con 0x7fe0800b3750 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.979+0000 7fe086a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe080073c60 con 0x7fe08006e710 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0800d03c0 0x7fe0801584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe07fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08006e710 0x7fe0800cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0800d03c0 0x7fe0801584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41556/0 (socket says 172.21.15.7:41556) 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 -- 172.21.15.7:0/2355524641 learned_addr learned my addr 172.21.15.7:0/2355524641 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe077e00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0800b3750 0x7fe0801f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 -- 172.21.15.7:0/2355524641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08006e710 msgr2=0x7fe0800cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08006e710 0x7fe0800cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 -- 172.21.15.7:0/2355524641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0800b3750 msgr2=0x7fe0801f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0800b3750 0x7fe0801f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 -- 172.21.15.7:0/2355524641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0800cad30 con 0x7fe0800d03c0 2024-08-19T00:39:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.980+0000 7fe084a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0800d03c0 0x7fe0801584a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe07800c7a0 tx=0x7fe07800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.981+0000 7fe07cc00640 1 -- 172.21.15.7:0/2355524641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078018070 con 0x7fe0800d03c0 2024-08-19T00:39:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.981+0000 7fe07cc00640 1 -- 172.21.15.7:0/2355524641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07800a640 con 0x7fe0800d03c0 2024-08-19T00:39:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.981+0000 7fe07cc00640 1 -- 172.21.15.7:0/2355524641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07800aab0 con 0x7fe0800d03c0 2024-08-19T00:39:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.981+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0800cb010 con 0x7fe0800d03c0 2024-08-19T00:39:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.981+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0800ca950 con 0x7fe0800d03c0 2024-08-19T00:39:40.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.982+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0800b3be0 con 0x7fe0800d03c0 2024-08-19T00:39:40.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.983+0000 7fe07cc00640 1 -- 172.21.15.7:0/2355524641 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe07800ac50 con 0x7fe0800d03c0 2024-08-19T00:39:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.983+0000 7fe07cc00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe05c06be30 0x7fe05c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.984+0000 7fe07cc00640 1 -- 172.21.15.7:0/2355524641 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe07808a4d0 con 0x7fe0800d03c0 2024-08-19T00:39:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.984+0000 7fe07fe00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe05c06be30 0x7fe05c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.984+0000 7fe07fe00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe05c06be30 0x7fe05c06e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe0801f78e0 tx=0x7fe070009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:40.988+0000 7fe07cc00640 1 -- 172.21.15.7:0/2355524641 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe078058790 con 0x7fe0800d03c0 2024-08-19T00:39:41.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.170+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe08015a750 con 0x7fe05c06be30 2024-08-19T00:39:41.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.176+0000 7fe07cc00640 1 -- 172.21.15.7:0/2355524641 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246637 (secure 0 0 0) 0x7fe08015a750 con 0x7fe05c06be30 2024-08-19T00:39:41.182 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:41.183 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.180+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe05c06be30 msgr2=0x7fe05c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.180+0000 7fe086a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe05c06be30 0x7fe05c06e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe0801f78e0 tx=0x7fe070009190 comp rx=0 tx=0).stop 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.180+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0800d03c0 msgr2=0x7fe0801584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.180+0000 7fe086a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0800d03c0 0x7fe0801584a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe07800c7a0 tx=0x7fe07800cc60 comp rx=0 tx=0).stop 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 shutdown_connections 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe05c06be30 0x7fe05c06e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0800d03c0 0x7fe0801584a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0800b3750 0x7fe0801f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 --2- 172.21.15.7:0/2355524641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08006e710 0x7fe0800cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 >> 172.21.15.7:0/2355524641 conn(0x7fe08006bc70 msgr2=0x7fe0800b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 shutdown_connections 2024-08-19T00:39:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.181+0000 7fe086a00640 1 -- 172.21.15.7:0/2355524641 wait complete. 2024-08-19T00:39:41.198 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-08-19T00:39:39.290537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243208,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731512,"statfs":{"total":773094113280,"available":772845068288,"internally_reserved":0,"allocated":6389760,"data_stored":3316150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.171220"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143209+0000","last_change":"2024-08-19T00:39:35.143209+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143209+0000","last_undegraded":"2024-08-19T00:39:35.143209+0000","last_fullsized":"2024-08-19T00:39:35.143209+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133535+0000","last_change":"2024-08-19T00:39:35.133535+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133535+0000","last_undegraded":"2024-08-19T00:39:35.133535+0000","last_fullsized":"2024-08-19T00:39:35.133535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.135354+0000","last_change":"2024-08-19T00:39:35.135354+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.135354+0000","last_undegraded":"2024-08-19T00:39:35.135354+0000","last_fullsized":"2024-08-19T00:39:35.135354+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134415+0000","last_change":"2024-08-19T00:39:35.134415+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134415+0000","last_undegraded":"2024-08-19T00:39:35.134415+0000","last_fullsized":"2024-08-19T00:39:35.134415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142907+0000","last_change":"2024-08-19T00:39:35.142907+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142907+0000","last_undegraded":"2024-08-19T00:39:35.142907+0000","last_fullsized":"2024-08-19T00:39:35.142907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141638+0000","last_change":"2024-08-19T00:39:35.141638+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141638+0000","last_undegraded":"2024-08-19T00:39:35.141638+0000","last_fullsized":"2024-08-19T00:39:35.141638+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136287+0000","last_change":"2024-08-19T00:39:35.136287+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136287+0000","last_undegraded":"2024-08-19T00:39:35.136287+0000","last_fullsized":"2024-08-19T00:39:35.136287+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.139150+0000","last_change":"2024-08-19T00:39:35.139150+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.139150+0000","last_undegraded":"2024-08-19T00:39:35.139150+0000","last_fullsized":"2024-08-19T00:39:35.139150+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143425+0000","last_change":"2024-08-19T00:39:35.143425+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143425+0000","last_undegraded":"2024-08-19T00:39:35.143425+0000","last_fullsized":"2024-08-19T00:39:35.143425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141185+0000","last_change":"2024-08-19T00:39:35.141185+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141185+0000","last_undegraded":"2024-08-19T00:39:35.141185+0000","last_fullsized":"2024-08-19T00:39:35.141185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133143+0000","last_change":"2024-08-19T00:39:35.133143+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133143+0000","last_undegraded":"2024-08-19T00:39:35.133143+0000","last_fullsized":"2024-08-19T00:39:35.133143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140146+0000","last_change":"2024-08-19T00:39:35.140146+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140146+0000","last_undegraded":"2024-08-19T00:39:35.140146+0000","last_fullsized":"2024-08-19T00:39:35.140146+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133578+0000","last_change":"2024-08-19T00:39:35.133578+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133578+0000","last_undegraded":"2024-08-19T00:39:35.133578+0000","last_fullsized":"2024-08-19T00:39:35.133578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134447+0000","last_change":"2024-08-19T00:39:35.134447+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134447+0000","last_undegraded":"2024-08-19T00:39:35.134447+0000","last_fullsized":"2024-08-19T00:39:35.134447+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131380+0000","last_change":"2024-08-19T00:39:35.131380+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131380+0000","last_undegraded":"2024-08-19T00:39:35.131380+0000","last_fullsized":"2024-08-19T00:39:35.131380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140063+0000","last_change":"2024-08-19T00:39:35.140063+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140063+0000","last_undegraded":"2024-08-19T00:39:35.140063+0000","last_fullsized":"2024-08-19T00:39:35.140063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142686+0000","last_change":"2024-08-19T00:39:35.142686+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142686+0000","last_undegraded":"2024-08-19T00:39:35.142686+0000","last_fullsized":"2024-08-19T00:39:35.142686+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133141+0000","last_change":"2024-08-19T00:39:35.133141+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133141+0000","last_undegraded":"2024-08-19T00:39:35.133141+0000","last_fullsized":"2024-08-19T00:39:35.133141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132860+0000","last_change":"2024-08-19T00:39:35.132860+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132860+0000","last_undegraded":"2024-08-19T00:39:35.132860+0000","last_fullsized":"2024-08-19T00:39:35.132860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132727+0000","last_change":"2024-08-19T00:39:35.132727+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132727+0000","last_undegraded":"2024-08-19T00:39:35.132727+0000","last_fullsized":"2024-08-19T00:39:35.132727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132589+0000","last_change":"2024-08-19T00:39:35.132589+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132589+0000","last_undegraded":"2024-08-19T00:39:35.132589+0000","last_fullsized":"2024-08-19T00:39:35.132589+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.130767+0000","last_change":"2024-08-19T00:39:35.130767+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.130767+0000","last_undegraded":"2024-08-19T00:39:35.130767+0000","last_fullsized":"2024-08-19T00:39:35.130767+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133144+0000","last_change":"2024-08-19T00:39:35.133144+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133144+0000","last_undegraded":"2024-08-19T00:39:35.133144+0000","last_fullsized":"2024-08-19T00:39:35.133144+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143039+0000","last_change":"2024-08-19T00:39:35.143039+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143039+0000","last_undegraded":"2024-08-19T00:39:35.143039+0000","last_fullsized":"2024-08-19T00:39:35.143039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133564+0000","last_change":"2024-08-19T00:39:35.133564+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133564+0000","last_undegraded":"2024-08-19T00:39:35.133564+0000","last_fullsized":"2024-08-19T00:39:35.133564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133210+0000","last_change":"2024-08-19T00:39:35.133210+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133210+0000","last_undegraded":"2024-08-19T00:39:35.133210+0000","last_fullsized":"2024-08-19T00:39:35.133210+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132264+0000","last_change":"2024-08-19T00:39:35.132264+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132264+0000","last_undegraded":"2024-08-19T00:39:35.132264+0000","last_fullsized":"2024-08-19T00:39:35.132264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.138426+0000","last_change":"2024-08-19T00:39:35.138426+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.138426+0000","last_undegraded":"2024-08-19T00:39:35.138426+0000","last_fullsized":"2024-08-19T00:39:35.138426+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141515+0000","last_change":"2024-08-19T00:39:35.141515+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141515+0000","last_undegraded":"2024-08-19T00:39:35.141515+0000","last_fullsized":"2024-08-19T00:39:35.141515+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134196+0000","last_change":"2024-08-19T00:39:35.134196+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134196+0000","last_undegraded":"2024-08-19T00:39:35.134196+0000","last_fullsized":"2024-08-19T00:39:35.134196+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132948+0000","last_change":"2024-08-19T00:39:35.132948+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132948+0000","last_undegraded":"2024-08-19T00:39:35.132948+0000","last_fullsized":"2024-08-19T00:39:35.132948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131384+0000","last_change":"2024-08-19T00:39:35.131384+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131384+0000","last_undegraded":"2024-08-19T00:39:35.131384+0000","last_fullsized":"2024-08-19T00:39:35.131384+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140653+0000","last_change":"2024-08-19T00:39:35.140653+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140653+0000","last_undegraded":"2024-08-19T00:39:35.140653+0000","last_fullsized":"2024-08-19T00:39:35.140653+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154201+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:35.154201+0000","last_peered":"2024-08-19T00:39:35.154201+0000","last_clean":"2024-08-19T00:39:35.154201+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:35.154201+0000","last_undegraded":"2024-08-19T00:39:35.154201+0000","last_fullsized":"2024-08-19T00:39:35.154201+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:06.673602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141845+0000","last_change":"2024-08-19T00:39:35.141845+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141845+0000","last_undegraded":"2024-08-19T00:39:35.141845+0000","last_fullsized":"2024-08-19T00:39:35.141845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.151752+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:35.151752+0000","last_peered":"2024-08-19T00:39:35.151752+0000","last_clean":"2024-08-19T00:39:35.151752+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:35.151752+0000","last_undegraded":"2024-08-19T00:39:35.151752+0000","last_fullsized":"2024-08-19T00:39:35.151752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:06:18.313346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137899+0000","last_change":"2024-08-19T00:39:35.137899+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137899+0000","last_undegraded":"2024-08-19T00:39:35.137899+0000","last_fullsized":"2024-08-19T00:39:35.137899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155245+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:35.155245+0000","last_peered":"2024-08-19T00:39:35.155245+0000","last_clean":"2024-08-19T00:39:35.155245+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:35.155245+0000","last_undegraded":"2024-08-19T00:39:35.155245+0000","last_fullsized":"2024-08-19T00:39:35.155245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:48.144249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.143578+0000","last_change":"2024-08-19T00:39:35.143578+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.143578+0000","last_undegraded":"2024-08-19T00:39:35.143578+0000","last_fullsized":"2024-08-19T00:39:35.143578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153602+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:35.153602+0000","last_peered":"2024-08-19T00:39:35.153602+0000","last_clean":"2024-08-19T00:39:35.153602+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:35.153602+0000","last_undegraded":"2024-08-19T00:39:35.153602+0000","last_fullsized":"2024-08-19T00:39:35.153602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137541+0000","last_change":"2024-08-19T00:39:35.137541+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137541+0000","last_undegraded":"2024-08-19T00:39:35.137541+0000","last_fullsized":"2024-08-19T00:39:35.137541+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.149168+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:35.149168+0000","last_peered":"2024-08-19T00:39:35.149168+0000","last_clean":"2024-08-19T00:39:35.149168+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:35.149168+0000","last_undegraded":"2024-08-19T00:39:35.149168+0000","last_fullsized":"2024-08-19T00:39:35.149168+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:58.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131718+0000","last_change":"2024-08-19T00:39:35.131718+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131718+0000","last_undegraded":"2024-08-19T00:39:35.131718+0000","last_fullsized":"2024-08-19T00:39:35.131718+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.156831+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:35.156831+0000","last_peered":"2024-08-19T00:39:35.156831+0000","last_clean":"2024-08-19T00:39:35.156831+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:35.156831+0000","last_undegraded":"2024-08-19T00:39:35.156831+0000","last_fullsized":"2024-08-19T00:39:35.156831+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:58.839417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133339+0000","last_change":"2024-08-19T00:39:35.133339+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133339+0000","last_undegraded":"2024-08-19T00:39:35.133339+0000","last_fullsized":"2024-08-19T00:39:35.133339+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154756+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:35.154756+0000","last_peered":"2024-08-19T00:39:35.154756+0000","last_clean":"2024-08-19T00:39:35.154756+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:35.154756+0000","last_undegraded":"2024-08-19T00:39:35.154756+0000","last_fullsized":"2024-08-19T00:39:35.154756+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:34:40.336587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140608+0000","last_change":"2024-08-19T00:39:35.140608+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140608+0000","last_undegraded":"2024-08-19T00:39:35.140608+0000","last_fullsized":"2024-08-19T00:39:35.140608+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.141769+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:35.141769+0000","last_peered":"2024-08-19T00:39:35.141769+0000","last_clean":"2024-08-19T00:39:35.141769+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:35.141769+0000","last_undegraded":"2024-08-19T00:39:35.141769+0000","last_fullsized":"2024-08-19T00:39:35.141769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131390+0000","last_change":"2024-08-19T00:39:35.131390+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131390+0000","last_undegraded":"2024-08-19T00:39:35.131390+0000","last_fullsized":"2024-08-19T00:39:35.131390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155279+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:35.155279+0000","last_peered":"2024-08-19T00:39:35.155279+0000","last_clean":"2024-08-19T00:39:35.155279+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:35.155279+0000","last_undegraded":"2024-08-19T00:39:35.155279+0000","last_fullsized":"2024-08-19T00:39:35.155279+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136895+0000","last_change":"2024-08-19T00:39:35.136895+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136895+0000","last_undegraded":"2024-08-19T00:39:35.136895+0000","last_fullsized":"2024-08-19T00:39:35.136895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155047+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:35.155047+0000","last_peered":"2024-08-19T00:39:35.155047+0000","last_clean":"2024-08-19T00:39:35.155047+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:35.155047+0000","last_undegraded":"2024-08-19T00:39:35.155047+0000","last_fullsized":"2024-08-19T00:39:35.155047+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:43.215883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137169+0000","last_change":"2024-08-19T00:39:35.137169+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137169+0000","last_undegraded":"2024-08-19T00:39:35.137169+0000","last_fullsized":"2024-08-19T00:39:35.137169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153528+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:35.153528+0000","last_peered":"2024-08-19T00:39:35.153528+0000","last_clean":"2024-08-19T00:39:35.153528+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:35.153528+0000","last_undegraded":"2024-08-19T00:39:35.153528+0000","last_fullsized":"2024-08-19T00:39:35.153528+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133203+0000","last_change":"2024-08-19T00:39:35.133203+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133203+0000","last_undegraded":"2024-08-19T00:39:35.133203+0000","last_fullsized":"2024-08-19T00:39:35.133203+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.142372+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:35.142372+0000","last_peered":"2024-08-19T00:39:35.142372+0000","last_clean":"2024-08-19T00:39:35.142372+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:35.142372+0000","last_undegraded":"2024-08-19T00:39:35.142372+0000","last_fullsized":"2024-08-19T00:39:35.142372+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142994+0000","last_change":"2024-08-19T00:39:35.142994+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142994+0000","last_undegraded":"2024-08-19T00:39:35.142994+0000","last_fullsized":"2024-08-19T00:39:35.142994+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154235+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:35.154235+0000","last_peered":"2024-08-19T00:39:35.154235+0000","last_clean":"2024-08-19T00:39:35.154235+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:35.154235+0000","last_undegraded":"2024-08-19T00:39:35.154235+0000","last_fullsized":"2024-08-19T00:39:35.154235+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134633+0000","last_change":"2024-08-19T00:39:35.134633+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134633+0000","last_undegraded":"2024-08-19T00:39:35.134633+0000","last_fullsized":"2024-08-19T00:39:35.134633+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.153561+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:35.153561+0000","last_peered":"2024-08-19T00:39:35.153561+0000","last_clean":"2024-08-19T00:39:35.153561+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:35.153561+0000","last_undegraded":"2024-08-19T00:39:35.153561+0000","last_fullsized":"2024-08-19T00:39:35.153561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141165+0000","last_change":"2024-08-19T00:39:35.141165+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141165+0000","last_undegraded":"2024-08-19T00:39:35.141165+0000","last_fullsized":"2024-08-19T00:39:35.141165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.151452+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:35.151452+0000","last_peered":"2024-08-19T00:39:35.151452+0000","last_clean":"2024-08-19T00:39:35.151452+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:35.151452+0000","last_undegraded":"2024-08-19T00:39:35.151452+0000","last_fullsized":"2024-08-19T00:39:35.151452+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132663+0000","last_change":"2024-08-19T00:39:35.132663+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132663+0000","last_undegraded":"2024-08-19T00:39:35.132663+0000","last_fullsized":"2024-08-19T00:39:35.132663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.141957+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:35.141957+0000","last_peered":"2024-08-19T00:39:35.141957+0000","last_clean":"2024-08-19T00:39:35.141957+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:35.141957+0000","last_undegraded":"2024-08-19T00:39:35.141957+0000","last_fullsized":"2024-08-19T00:39:35.141957+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132720+0000","last_change":"2024-08-19T00:39:35.132720+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132720+0000","last_undegraded":"2024-08-19T00:39:35.132720+0000","last_fullsized":"2024-08-19T00:39:35.132720+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152759+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:35.152759+0000","last_peered":"2024-08-19T00:39:35.152759+0000","last_clean":"2024-08-19T00:39:35.152759+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:35.152759+0000","last_undegraded":"2024-08-19T00:39:35.152759+0000","last_fullsized":"2024-08-19T00:39:35.152759+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:34:40.336587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136481+0000","last_change":"2024-08-19T00:39:35.136481+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136481+0000","last_undegraded":"2024-08-19T00:39:35.136481+0000","last_fullsized":"2024-08-19T00:39:35.136481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155025+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:35.155025+0000","last_peered":"2024-08-19T00:39:35.155025+0000","last_clean":"2024-08-19T00:39:35.155025+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:35.155025+0000","last_undegraded":"2024-08-19T00:39:35.155025+0000","last_fullsized":"2024-08-19T00:39:35.155025+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:49.564189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.133061+0000","last_change":"2024-08-19T00:39:35.133061+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.133061+0000","last_undegraded":"2024-08-19T00:39:35.133061+0000","last_fullsized":"2024-08-19T00:39:35.133061+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155164+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:35.155164+0000","last_peered":"2024-08-19T00:39:35.155164+0000","last_clean":"2024-08-19T00:39:35.155164+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:35.155164+0000","last_undegraded":"2024-08-19T00:39:35.155164+0000","last_fullsized":"2024-08-19T00:39:35.155164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132623+0000","last_change":"2024-08-19T00:39:35.132623+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132623+0000","last_undegraded":"2024-08-19T00:39:35.132623+0000","last_fullsized":"2024-08-19T00:39:35.132623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155169+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:35.155169+0000","last_peered":"2024-08-19T00:39:35.155169+0000","last_clean":"2024-08-19T00:39:35.155169+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:35.155169+0000","last_undegraded":"2024-08-19T00:39:35.155169+0000","last_fullsized":"2024-08-19T00:39:35.155169+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:06.343511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.142500+0000","last_change":"2024-08-19T00:39:35.142500+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.142500+0000","last_undegraded":"2024-08-19T00:39:35.142500+0000","last_fullsized":"2024-08-19T00:39:35.142500+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.146638+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:35.146638+0000","last_peered":"2024-08-19T00:39:35.146638+0000","last_clean":"2024-08-19T00:39:35.146638+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:35.146638+0000","last_undegraded":"2024-08-19T00:39:35.146638+0000","last_fullsized":"2024-08-19T00:39:35.146638+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:27:40.566571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.141020+0000","last_change":"2024-08-19T00:39:35.141020+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.141020+0000","last_undegraded":"2024-08-19T00:39:35.141020+0000","last_fullsized":"2024-08-19T00:39:35.141020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154203+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:35.154203+0000","last_peered":"2024-08-19T00:39:35.154203+0000","last_clean":"2024-08-19T00:39:35.154203+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:35.154203+0000","last_undegraded":"2024-08-19T00:39:35.154203+0000","last_fullsized":"2024-08-19T00:39:35.154203+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:13.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137908+0000","last_change":"2024-08-19T00:39:35.137908+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137908+0000","last_undegraded":"2024-08-19T00:39:35.137908+0000","last_fullsized":"2024-08-19T00:39:35.137908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154789+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:35.154789+0000","last_peered":"2024-08-19T00:39:35.154789+0000","last_clean":"2024-08-19T00:39:35.154789+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:35.154789+0000","last_undegraded":"2024-08-19T00:39:35.154789+0000","last_fullsized":"2024-08-19T00:39:35.154789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:33.394507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132194+0000","last_change":"2024-08-19T00:39:35.132194+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132194+0000","last_undegraded":"2024-08-19T00:39:35.132194+0000","last_fullsized":"2024-08-19T00:39:35.132194+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152738+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:35.152738+0000","last_peered":"2024-08-19T00:39:35.152738+0000","last_clean":"2024-08-19T00:39:35.152738+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:35.152738+0000","last_undegraded":"2024-08-19T00:39:35.152738+0000","last_fullsized":"2024-08-19T00:39:35.152738+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:40:13.874451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.134782+0000","last_change":"2024-08-19T00:39:35.134782+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.134782+0000","last_undegraded":"2024-08-19T00:39:35.134782+0000","last_fullsized":"2024-08-19T00:39:35.134782+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.156803+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:35.156803+0000","last_peered":"2024-08-19T00:39:35.156803+0000","last_clean":"2024-08-19T00:39:35.156803+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:35.156803+0000","last_undegraded":"2024-08-19T00:39:35.156803+0000","last_fullsized":"2024-08-19T00:39:35.156803+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:58.021332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132061+0000","last_change":"2024-08-19T00:39:35.132061+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132061+0000","last_undegraded":"2024-08-19T00:39:35.132061+0000","last_fullsized":"2024-08-19T00:39:35.132061+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.155260+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:35.155260+0000","last_peered":"2024-08-19T00:39:35.155260+0000","last_clean":"2024-08-19T00:39:35.155260+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:35.155260+0000","last_undegraded":"2024-08-19T00:39:35.155260+0000","last_fullsized":"2024-08-19T00:39:35.155260+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137067+0000","last_change":"2024-08-19T00:39:35.137067+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137067+0000","last_undegraded":"2024-08-19T00:39:35.137067+0000","last_fullsized":"2024-08-19T00:39:35.137067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.150228+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:35.150228+0000","last_peered":"2024-08-19T00:39:35.150228+0000","last_clean":"2024-08-19T00:39:35.150228+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:35.150228+0000","last_undegraded":"2024-08-19T00:39:35.150228+0000","last_fullsized":"2024-08-19T00:39:35.150228+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.140593+0000","last_change":"2024-08-19T00:39:35.140593+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.140593+0000","last_undegraded":"2024-08-19T00:39:35.140593+0000","last_fullsized":"2024-08-19T00:39:35.140593+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.152703+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:35.152703+0000","last_peered":"2024-08-19T00:39:35.152703+0000","last_clean":"2024-08-19T00:39:35.152703+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:35.152703+0000","last_undegraded":"2024-08-19T00:39:35.152703+0000","last_fullsized":"2024-08-19T00:39:35.152703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:33.394507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.131766+0000","last_change":"2024-08-19T00:39:35.131766+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.131766+0000","last_undegraded":"2024-08-19T00:39:35.131766+0000","last_fullsized":"2024-08-19T00:39:35.131766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154156+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:35.154156+0000","last_peered":"2024-08-19T00:39:35.154156+0000","last_clean":"2024-08-19T00:39:35.154156+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:35.154156+0000","last_undegraded":"2024-08-19T00:39:35.154156+0000","last_fullsized":"2024-08-19T00:39:35.154156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.137170+0000","last_change":"2024-08-19T00:39:35.137170+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.137170+0000","last_undegraded":"2024-08-19T00:39:35.137170+0000","last_fullsized":"2024-08-19T00:39:35.137170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.154923+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:35.154923+0000","last_peered":"2024-08-19T00:39:35.154923+0000","last_clean":"2024-08-19T00:39:35.154923+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:35.154923+0000","last_undegraded":"2024-08-19T00:39:35.154923+0000","last_fullsized":"2024-08-19T00:39:35.154923+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:09.101503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.132459+0000","last_change":"2024-08-19T00:39:35.132459+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.132459+0000","last_undegraded":"2024-08-19T00:39:35.132459+0000","last_fullsized":"2024-08-19T00:39:35.132459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.147663+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:35.147663+0000","last_peered":"2024-08-19T00:39:35.147663+0000","last_clean":"2024-08-19T00:39:35.147663+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:35.147663+0000","last_undegraded":"2024-08-19T00:39:35.147663+0000","last_fullsized":"2024-08-19T00:39:35.147663+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:57.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-08-19T00:39:35.136290+0000","last_change":"2024-08-19T00:39:35.136290+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:35.136290+0000","last_undegraded":"2024-08-19T00:39:35.136290+0000","last_fullsized":"2024-08-19T00:39:35.136290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.150599+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:35.150599+0000","last_peered":"2024-08-19T00:39:35.150599+0000","last_clean":"2024-08-19T00:39:35.150599+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:35.150599+0000","last_undegraded":"2024-08-19T00:39:35.150599+0000","last_fullsized":"2024-08-19T00:39:35.150599+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:37.558154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-19T00:39:35.143841+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:35.143841+0000","last_peered":"2024-08-19T00:39:35.143841+0000","last_clean":"2024-08-19T00:39:35.143841+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:35.143841+0000","last_undegraded":"2024-08-19T00:39:35.143841+0000","last_fullsized":"2024-08-19T00:39:35.143841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":862001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":271633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":855726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":265358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.143209+0000', 'last_change': '2024-08-19T00:39:35.143209+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.143209+0000', 'last_undegraded': '2024-08-19T00:39:35.143209+0000', 'last_fullsized': '2024-08-19T00:39:35.143209+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133535+0000', 'last_change': '2024-08-19T00:39:35.133535+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133535+0000', 'last_undegraded': '2024-08-19T00:39:35.133535+0000', 'last_fullsized': '2024-08-19T00:39:35.133535+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.135354+0000', 'last_change': '2024-08-19T00:39:35.135354+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.135354+0000', 'last_undegraded': '2024-08-19T00:39:35.135354+0000', 'last_fullsized': '2024-08-19T00:39:35.135354+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-08-19T00:39:41.202 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.134415+0000', 'last_change': '2024-08-19T00:39:35.134415+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.134415+0000', 'last_undegraded': '2024-08-19T00:39:35.134415+0000', 'last_fullsized': '2024-08-19T00:39:35.134415+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.142907+0000', 'last_change': '2024-08-19T00:39:35.142907+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.142907+0000', 'last_undegraded': '2024-08-19T00:39:35.142907+0000', 'last_fullsized': '2024-08-19T00:39:35.142907+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.141638+0000', 'last_change': '2024-08-19T00:39:35.141638+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.141638+0000', 'last_undegraded': '2024-08-19T00:39:35.141638+0000', 'last_fullsized': '2024-08-19T00:39:35.141638+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.136287+0000', 'last_change': '2024-08-19T00:39:35.136287+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.136287+0000', 'last_undegraded': '2024-08-19T00:39:35.136287+0000', 'last_fullsized': '2024-08-19T00:39:35.136287+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.139150+0000', 'last_change': '2024-08-19T00:39:35.139150+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.139150+0000', 'last_undegraded': '2024-08-19T00:39:35.139150+0000', 'last_fullsized': '2024-08-19T00:39:35.139150+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-08-19T00:39:41.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.143425+0000', 'last_change': '2024-08-19T00:39:35.143425+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.143425+0000', 'last_undegraded': '2024-08-19T00:39:35.143425+0000', 'last_fullsized': '2024-08-19T00:39:35.143425+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.141185+0000', 'last_change': '2024-08-19T00:39:35.141185+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.141185+0000', 'last_undegraded': '2024-08-19T00:39:35.141185+0000', 'last_fullsized': '2024-08-19T00:39:35.141185+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133143+0000', 'last_change': '2024-08-19T00:39:35.133143+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133143+0000', 'last_undegraded': '2024-08-19T00:39:35.133143+0000', 'last_fullsized': '2024-08-19T00:39:35.133143+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.140146+0000', 'last_change': '2024-08-19T00:39:35.140146+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.140146+0000', 'last_undegraded': '2024-08-19T00:39:35.140146+0000', 'last_fullsized': '2024-08-19T00:39:35.140146+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133578+0000', 'last_change': '2024-08-19T00:39:35.133578+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133578+0000', 'last_undegraded': '2024-08-19T00:39:35.133578+0000', 'last_fullsized': '2024-08-19T00:39:35.133578+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-08-19T00:39:41.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.134447+0000', 'last_change': '2024-08-19T00:39:35.134447+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.134447+0000', 'last_undegraded': '2024-08-19T00:39:35.134447+0000', 'last_fullsized': '2024-08-19T00:39:35.134447+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.131380+0000', 'last_change': '2024-08-19T00:39:35.131380+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.131380+0000', 'last_undegraded': '2024-08-19T00:39:35.131380+0000', 'last_fullsized': '2024-08-19T00:39:35.131380+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.140063+0000', 'last_change': '2024-08-19T00:39:35.140063+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.140063+0000', 'last_undegraded': '2024-08-19T00:39:35.140063+0000', 'last_fullsized': '2024-08-19T00:39:35.140063+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.142686+0000', 'last_change': '2024-08-19T00:39:35.142686+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.142686+0000', 'last_undegraded': '2024-08-19T00:39:35.142686+0000', 'last_fullsized': '2024-08-19T00:39:35.142686+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133141+0000', 'last_change': '2024-08-19T00:39:35.133141+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133141+0000', 'last_undegraded': '2024-08-19T00:39:35.133141+0000', 'last_fullsized': '2024-08-19T00:39:35.133141+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-08-19T00:39:41.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132860+0000', 'last_change': '2024-08-19T00:39:35.132860+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132860+0000', 'last_undegraded': '2024-08-19T00:39:35.132860+0000', 'last_fullsized': '2024-08-19T00:39:35.132860+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132727+0000', 'last_change': '2024-08-19T00:39:35.132727+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132727+0000', 'last_undegraded': '2024-08-19T00:39:35.132727+0000', 'last_fullsized': '2024-08-19T00:39:35.132727+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132589+0000', 'last_change': '2024-08-19T00:39:35.132589+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132589+0000', 'last_undegraded': '2024-08-19T00:39:35.132589+0000', 'last_fullsized': '2024-08-19T00:39:35.132589+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.130767+0000', 'last_change': '2024-08-19T00:39:35.130767+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.130767+0000', 'last_undegraded': '2024-08-19T00:39:35.130767+0000', 'last_fullsized': '2024-08-19T00:39:35.130767+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133144+0000', 'last_change': '2024-08-19T00:39:35.133144+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133144+0000', 'last_undegraded': '2024-08-19T00:39:35.133144+0000', 'last_fullsized': '2024-08-19T00:39:35.133144+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.143039+0000', 'last_change': '2024-08-19T00:39:35.143039+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.143039+0000', 'last_undegraded': '2024-08-19T00:39:35.143039+0000', 'last_fullsized': '2024-08-19T00:39:35.143039+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:41.206 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133564+0000', 'last_change': '2024-08-19T00:39:35.133564+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133564+0000', 'last_undegraded': '2024-08-19T00:39:35.133564+0000', 'last_fullsized': '2024-08-19T00:39:35.133564+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133210+0000', 'last_change': '2024-08-19T00:39:35.133210+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133210+0000', 'last_undegraded': '2024-08-19T00:39:35.133210+0000', 'last_fullsized': '2024-08-19T00:39:35.133210+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132264+0000', 'last_change': '2024-08-19T00:39:35.132264+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132264+0000', 'last_undegraded': '2024-08-19T00:39:35.132264+0000', 'last_fullsized': '2024-08-19T00:39:35.132264+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.138426+0000', 'last_change': '2024-08-19T00:39:35.138426+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.138426+0000', 'last_undegraded': '2024-08-19T00:39:35.138426+0000', 'last_fullsized': '2024-08-19T00:39:35.138426+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.141515+0000', 'last_change': '2024-08-19T00:39:35.141515+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.141515+0000', 'last_undegraded': '2024-08-19T00:39:35.141515+0000', 'last_fullsized': '2024-08-19T00:39:35.141515+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-08-19T00:39:41.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.134196+0000', 'last_change': '2024-08-19T00:39:35.134196+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.134196+0000', 'last_undegraded': '2024-08-19T00:39:35.134196+0000', 'last_fullsized': '2024-08-19T00:39:35.134196+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132948+0000', 'last_change': '2024-08-19T00:39:35.132948+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132948+0000', 'last_undegraded': '2024-08-19T00:39:35.132948+0000', 'last_fullsized': '2024-08-19T00:39:35.132948+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.131384+0000', 'last_change': '2024-08-19T00:39:35.131384+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.131384+0000', 'last_undegraded': '2024-08-19T00:39:35.131384+0000', 'last_fullsized': '2024-08-19T00:39:35.131384+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.140653+0000', 'last_change': '2024-08-19T00:39:35.140653+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.140653+0000', 'last_undegraded': '2024-08-19T00:39:35.140653+0000', 'last_fullsized': '2024-08-19T00:39:35.140653+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.141845+0000', 'last_change': '2024-08-19T00:39:35.141845+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.141845+0000', 'last_undegraded': '2024-08-19T00:39:35.141845+0000', 'last_fullsized': '2024-08-19T00:39:35.141845+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.137899+0000', 'last_change': '2024-08-19T00:39:35.137899+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.137899+0000', 'last_undegraded': '2024-08-19T00:39:35.137899+0000', 'last_fullsized': '2024-08-19T00:39:35.137899+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-08-19T00:39:41.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.143578+0000', 'last_change': '2024-08-19T00:39:35.143578+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.143578+0000', 'last_undegraded': '2024-08-19T00:39:35.143578+0000', 'last_fullsized': '2024-08-19T00:39:35.143578+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.137541+0000', 'last_change': '2024-08-19T00:39:35.137541+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.137541+0000', 'last_undegraded': '2024-08-19T00:39:35.137541+0000', 'last_fullsized': '2024-08-19T00:39:35.137541+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.131718+0000', 'last_change': '2024-08-19T00:39:35.131718+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.131718+0000', 'last_undegraded': '2024-08-19T00:39:35.131718+0000', 'last_fullsized': '2024-08-19T00:39:35.131718+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133339+0000', 'last_change': '2024-08-19T00:39:35.133339+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133339+0000', 'last_undegraded': '2024-08-19T00:39:35.133339+0000', 'last_fullsized': '2024-08-19T00:39:35.133339+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.140608+0000', 'last_change': '2024-08-19T00:39:35.140608+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.140608+0000', 'last_undegraded': '2024-08-19T00:39:35.140608+0000', 'last_fullsized': '2024-08-19T00:39:35.140608+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.131390+0000', 'last_change': '2024-08-19T00:39:35.131390+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.131390+0000', 'last_undegraded': '2024-08-19T00:39:35.131390+0000', 'last_fullsized': '2024-08-19T00:39:35.131390+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:41.209 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.136895+0000', 'last_change': '2024-08-19T00:39:35.136895+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.136895+0000', 'last_undegraded': '2024-08-19T00:39:35.136895+0000', 'last_fullsized': '2024-08-19T00:39:35.136895+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.137169+0000', 'last_change': '2024-08-19T00:39:35.137169+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.137169+0000', 'last_undegraded': '2024-08-19T00:39:35.137169+0000', 'last_fullsized': '2024-08-19T00:39:35.137169+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133203+0000', 'last_change': '2024-08-19T00:39:35.133203+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133203+0000', 'last_undegraded': '2024-08-19T00:39:35.133203+0000', 'last_fullsized': '2024-08-19T00:39:35.133203+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.142994+0000', 'last_change': '2024-08-19T00:39:35.142994+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.142994+0000', 'last_undegraded': '2024-08-19T00:39:35.142994+0000', 'last_fullsized': '2024-08-19T00:39:35.142994+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.134633+0000', 'last_change': '2024-08-19T00:39:35.134633+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.134633+0000', 'last_undegraded': '2024-08-19T00:39:35.134633+0000', 'last_fullsized': '2024-08-19T00:39:35.134633+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.210 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.141165+0000', 'last_change': '2024-08-19T00:39:35.141165+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.141165+0000', 'last_undegraded': '2024-08-19T00:39:35.141165+0000', 'last_fullsized': '2024-08-19T00:39:35.141165+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132663+0000', 'last_change': '2024-08-19T00:39:35.132663+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132663+0000', 'last_undegraded': '2024-08-19T00:39:35.132663+0000', 'last_fullsized': '2024-08-19T00:39:35.132663+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132720+0000', 'last_change': '2024-08-19T00:39:35.132720+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132720+0000', 'last_undegraded': '2024-08-19T00:39:35.132720+0000', 'last_fullsized': '2024-08-19T00:39:35.132720+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.136481+0000', 'last_change': '2024-08-19T00:39:35.136481+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.136481+0000', 'last_undegraded': '2024-08-19T00:39:35.136481+0000', 'last_fullsized': '2024-08-19T00:39:35.136481+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.133061+0000', 'last_change': '2024-08-19T00:39:35.133061+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.133061+0000', 'last_undegraded': '2024-08-19T00:39:35.133061+0000', 'last_fullsized': '2024-08-19T00:39:35.133061+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-08-19T00:39:41.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132623+0000', 'last_change': '2024-08-19T00:39:35.132623+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132623+0000', 'last_undegraded': '2024-08-19T00:39:35.132623+0000', 'last_fullsized': '2024-08-19T00:39:35.132623+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.142500+0000', 'last_change': '2024-08-19T00:39:35.142500+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.142500+0000', 'last_undegraded': '2024-08-19T00:39:35.142500+0000', 'last_fullsized': '2024-08-19T00:39:35.142500+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.141020+0000', 'last_change': '2024-08-19T00:39:35.141020+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.141020+0000', 'last_undegraded': '2024-08-19T00:39:35.141020+0000', 'last_fullsized': '2024-08-19T00:39:35.141020+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.137908+0000', 'last_change': '2024-08-19T00:39:35.137908+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.137908+0000', 'last_undegraded': '2024-08-19T00:39:35.137908+0000', 'last_fullsized': '2024-08-19T00:39:35.137908+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132194+0000', 'last_change': '2024-08-19T00:39:35.132194+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132194+0000', 'last_undegraded': '2024-08-19T00:39:35.132194+0000', 'last_fullsized': '2024-08-19T00:39:35.132194+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.134782+0000', 'last_change': '2024-08-19T00:39:35.134782+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.134782+0000', 'last_undegraded': '2024-08-19T00:39:35.134782+0000', 'last_fullsized': '2024-08-19T00:39:35.134782+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-08-19T00:39:41.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132061+0000', 'last_change': '2024-08-19T00:39:35.132061+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132061+0000', 'last_undegraded': '2024-08-19T00:39:35.132061+0000', 'last_fullsized': '2024-08-19T00:39:35.132061+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.137067+0000', 'last_change': '2024-08-19T00:39:35.137067+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.137067+0000', 'last_undegraded': '2024-08-19T00:39:35.137067+0000', 'last_fullsized': '2024-08-19T00:39:35.137067+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.140593+0000', 'last_change': '2024-08-19T00:39:35.140593+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.140593+0000', 'last_undegraded': '2024-08-19T00:39:35.140593+0000', 'last_fullsized': '2024-08-19T00:39:35.140593+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.131766+0000', 'last_change': '2024-08-19T00:39:35.131766+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.131766+0000', 'last_undegraded': '2024-08-19T00:39:35.131766+0000', 'last_fullsized': '2024-08-19T00:39:35.131766+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.137170+0000', 'last_change': '2024-08-19T00:39:35.137170+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.137170+0000', 'last_undegraded': '2024-08-19T00:39:35.137170+0000', 'last_fullsized': '2024-08-19T00:39:35.137170+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.132459+0000', 'last_change': '2024-08-19T00:39:35.132459+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.132459+0000', 'last_undegraded': '2024-08-19T00:39:35.132459+0000', 'last_fullsized': '2024-08-19T00:39:35.132459+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-19T00:39:41.213 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-08-19T00:39:41.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:39:35.136290+0000', 'last_change': '2024-08-19T00:39:35.136290+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:35.136290+0000', 'last_undegraded': '2024-08-19T00:39:35.136290+0000', 'last_fullsized': '2024-08-19T00:39:35.136290+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:39:41.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.394+0000 7fe9eb200640 1 Processor -- start 2024-08-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.394+0000 7fe9eb200640 1 -- start start 2024-08-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.395+0000 7fe9eb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 0x7fe9ec0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.395+0000 7fe9eb200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe9ec0b4750 0x7fe9ec0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.395+0000 7fe9eb200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec0d10b0 con 0x7fe9ec0d0c40 2024-08-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.395+0000 7fe9eb200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec06d4e0 con 0x7fe9ec0b4750 2024-08-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.395+0000 7fe9eb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec06d7c0 con 0x7fe9ec15e470 2024-08-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.395+0000 7fe9ea800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe9ec0d0c40 0x7fe9ec09aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45594/0 (socket says 172.21.15.7:45594) 2024-08-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.395+0000 7fe9ea800640 1 -- 172.21.15.7:0/2371100710 learned_addr learned my addr 172.21.15.7:0/2371100710 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e3e00640 1 --2- 172.21.15.7:0/2371100710 >> v2:172.21.15.162:3300/0 conn(0x7fe9ec0b4750 0x7fe9ec0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 0x7fe9ec0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215152528 0 0) 0x7fe9ec0d10b0 con 0x7fe9ec0d0c40 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9d0003520 con 0x7fe9ec0d0c40 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812459984 0 0) 0x7fe9d0003520 con 0x7fe9ec0d0c40 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 msgr2=0x7fe9ec0d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 0x7fe9ec0d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 >> v2:172.21.15.162:3300/0 conn(0x7fe9ec0b4750 msgr2=0x7fe9ec0d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 --2- 172.21.15.7:0/2371100710 >> v2:172.21.15.162:3300/0 conn(0x7fe9ec0b4750 0x7fe9ec0d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec06daa0 con 0x7fe9ec0d0c40 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fe9e40019f0 con 0x7fe9ec0d0c40 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e3e00640 1 --2- 172.21.15.7:0/2371100710 >> v2:172.21.15.162:3300/0 conn(0x7fe9ec0b4750 0x7fe9ec0d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 >> v1:172.21.15.7:6789/0 conn(0x7fe9ec0d0c40 legacy=0x7fe9ec09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 0x7fe9d00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d0003f80 0x7fe9d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d0004d40 0x7fe9d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec06d4e0 con 0x7fe9d0004d40 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec06d7c0 con 0x7fe9d0003f80 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.396+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d000b9c0 con 0x7fe9ec15e470 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9ea800640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d0004d40 0x7fe9d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 0x7fe9d00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9e3e00640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d0003f80 0x7fe9d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9e9e00640 1 -- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d0003f80 msgr2=0x7fe9d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d0003f80 0x7fe9d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9e9e00640 1 -- 172.21.15.7:0/2371100710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d0004d40 msgr2=0x7fe9d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d0004d40 0x7fe9d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9e9e00640 1 -- 172.21.15.7:0/2371100710 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d0003520 con 0x7fe9ec15e470 2024-08-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.397+0000 7fe9ea800640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9d0004d40 0x7fe9d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.398+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 0x7fe9d00039b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009af0 tx=0x7fe9d0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771b87e7848281d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.398+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc036070 con 0x7fe9ec15e470 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.398+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc031400 con 0x7fe9ec15e470 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.398+0000 7fe9e9400640 1 -- 172.21.15.7:0/2371100710 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc009690 con 0x7fe9ec15e470 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.399+0000 7fe9eb200640 1 -- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 msgr2=0x7fe9d00039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.399+0000 7fe9eb200640 1 --2- 172.21.15.7:0/2371100710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec15e470 0x7fe9d00039b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009af0 tx=0x7fe9d0005830 comp rx=0 tx=0).stop 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.399+0000 7fe9ea800640 1 -- 172.21.15.7:0/2371100710 reap_dead start 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.399+0000 7fe9eb200640 1 -- 172.21.15.7:0/2371100710 shutdown_connections 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.399+0000 7fe9eb200640 1 -- 172.21.15.7:0/2371100710 >> 172.21.15.7:0/2371100710 conn(0x7fe9ec0b3a70 msgr2=0x7fe9ec0b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.399+0000 7fe9eb200640 1 -- 172.21.15.7:0/2371100710 shutdown_connections 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.399+0000 7fe9eb200640 1 -- 172.21.15.7:0/2371100710 wait complete. 2024-08-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.401+0000 7fe9eb200640 1 Processor -- start 2024-08-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.401+0000 7fe9eb200640 1 -- start start 2024-08-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9eb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec15e470 0x7fe9ec152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9eb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9ec1533b0 0x7fe9ec0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9eb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0cb760 0x7fe9ec0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9eb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec071070 con 0x7fe9ec1533b0 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9eb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec06d1d0 con 0x7fe9ec15e470 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9eb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec0711f0 con 0x7fe9ec0cb760 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9ec1533b0 0x7fe9ec0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9ec1533b0 0x7fe9ec0cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41576/0 (socket says 172.21.15.7:41576) 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9e3e00640 1 -- 172.21.15.7:0/2916170127 learned_addr learned my addr 172.21.15.7:0/2916170127 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec15e470 0x7fe9ec152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9ea800640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0cb760 0x7fe9ec0c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9e3e00640 1 -- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0cb760 msgr2=0x7fe9ec0c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.402+0000 7fe9e3e00640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0cb760 0x7fe9ec0c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9e3e00640 1 -- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec15e470 msgr2=0x7fe9ec152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9e3e00640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec15e470 0x7fe9ec152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9e3e00640 1 -- 172.21.15.7:0/2916170127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec0b75c0 con 0x7fe9ec1533b0 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9e3e00640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9ec1533b0 0x7fe9ec0cb220 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4011a60 tx=0x7fe9d4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9e2000640 1 -- 172.21.15.7:0/2916170127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400fc70 con 0x7fe9ec1533b0 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9e2000640 1 -- 172.21.15.7:0/2916170127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d400fe10 con 0x7fe9ec1533b0 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9e2000640 1 -- 172.21.15.7:0/2916170127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4004270 con 0x7fe9ec1533b0 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec0b0610 con 0x7fe9ec1533b0 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.403+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec0b7b40 con 0x7fe9ec1533b0 2024-08-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.404+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec0b7d80 con 0x7fe9ec1533b0 2024-08-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.405+0000 7fe9e2000640 1 -- 172.21.15.7:0/2916170127 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9d4012040 con 0x7fe9ec1533b0 2024-08-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.406+0000 7fe9e2000640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9c806be60 0x7fe9c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.406+0000 7fe9e2000640 1 -- 172.21.15.7:0/2916170127 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe9d408b220 con 0x7fe9ec1533b0 2024-08-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.406+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9c806be60 0x7fe9c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.407+0000 7fe9e9e00640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9c806be60 0x7fe9c806e320 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc033000 tx=0x7fe9dc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:41.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.410+0000 7fe9e2000640 1 -- 172.21.15.7:0/2916170127 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe9d4019070 con 0x7fe9ec1533b0 2024-08-19T00:39:41.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.661+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe9ec0d01c0 con 0x7fe9ec1533b0 2024-08-19T00:39:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.661+0000 7fe9e2000640 1 -- 172.21.15.7:0/2916170127 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1474 (secure 0 0 0) 0x7fe9d4059bc0 con 0x7fe9ec1533b0 2024-08-19T00:39:41.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:41.663 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":183,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1724027810,"num_in_osds":8,"osd_in_since":1724027801,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":249397248,"bytes_avail":772844716032,"bytes_total":773094113280,"write_bytes_sec":2325,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":46,"btime":"2024-08-19T00:39:39:157035+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5757}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-08-19T00:39:23.288192+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-19T00:39:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9c806be60 msgr2=0x7fe9c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9c806be60 0x7fe9c806e320 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc033000 tx=0x7fe9dc008030 comp rx=0 tx=0).stop 2024-08-19T00:39:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9ec1533b0 msgr2=0x7fe9ec0cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9ec1533b0 0x7fe9ec0cb220 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4011a60 tx=0x7fe9d4011f20 comp rx=0 tx=0).stop 2024-08-19T00:39:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 shutdown_connections 2024-08-19T00:39:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9c806be60 0x7fe9c806e320 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0cb760 0x7fe9ec0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9ec1533b0 0x7fe9ec0cb220 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 --2- 172.21.15.7:0/2916170127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec15e470 0x7fe9ec152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 >> 172.21.15.7:0/2916170127 conn(0x7fe9ec0b3a70 msgr2=0x7fe9ec074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.663+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 shutdown_connections 2024-08-19T00:39:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.664+0000 7fe9eb200640 1 -- 172.21.15.7:0/2916170127 wait complete. 2024-08-19T00:39:41.681 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-19T00:39:41.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.836+0000 7fe259400640 1 Processor -- start 2024-08-19T00:39:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.836+0000 7fe259400640 1 -- start start 2024-08-19T00:39:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe259400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe25415e360 0x7fe25415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe259400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2540d2af0 0x7fe2540d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe259400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe25415e740 0x7fe25415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe259400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe2540d3490 con 0x7fe25415e360 2024-08-19T00:39:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe259400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe2540b3ab0 con 0x7fe25415e740 2024-08-19T00:39:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe259400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe25415f460 con 0x7fe2540d2af0 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe253e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe25415e360 0x7fe25415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe253e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe25415e360 0x7fe25415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41588/0 (socket says 172.21.15.7:41588) 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe253e00640 1 -- 172.21.15.7:0/2449915193 learned_addr learned my addr 172.21.15.7:0/2449915193 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe253400640 1 --2- 172.21.15.7:0/2449915193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2540d2af0 0x7fe2540d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.837+0000 7fe258a00640 1 --2- 172.21.15.7:0/2449915193 >> v2:172.21.15.162:3300/0 conn(0x7fe25415e740 0x7fe25415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.838+0000 7fe253e00640 1 -- 172.21.15.7:0/2449915193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2540d2af0 msgr2=0x7fe2540d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.838+0000 7fe253e00640 1 --2- 172.21.15.7:0/2449915193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2540d2af0 0x7fe2540d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.838+0000 7fe253e00640 1 -- 172.21.15.7:0/2449915193 >> v2:172.21.15.162:3300/0 conn(0x7fe25415e740 msgr2=0x7fe25415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.838+0000 7fe253e00640 1 --2- 172.21.15.7:0/2449915193 >> v2:172.21.15.162:3300/0 conn(0x7fe25415e740 0x7fe25415ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.838+0000 7fe253e00640 1 -- 172.21.15.7:0/2449915193 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25415f740 con 0x7fe25415e360 2024-08-19T00:39:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.839+0000 7fe253e00640 1 --2- 172.21.15.7:0/2449915193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe25415e360 0x7fe25415fab0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe25408d500 tx=0x7fe24402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79220b8defc2c58b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.839+0000 7fe252a00640 1 -- 172.21.15.7:0/2449915193 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244037070 con 0x7fe25415e360 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.839+0000 7fe252a00640 1 -- 172.21.15.7:0/2449915193 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe244032440 con 0x7fe25415e360 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.839+0000 7fe252a00640 1 -- 172.21.15.7:0/2449915193 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244032810 con 0x7fe25415e360 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 -- 172.21.15.7:0/2449915193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe25415e360 msgr2=0x7fe25415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 --2- 172.21.15.7:0/2449915193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe25415e360 0x7fe25415fab0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe25408d500 tx=0x7fe24402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 -- 172.21.15.7:0/2449915193 shutdown_connections 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 --2- 172.21.15.7:0/2449915193 >> v2:172.21.15.162:3300/0 conn(0x7fe25415e740 0x7fe25415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 --2- 172.21.15.7:0/2449915193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2540d2af0 0x7fe2540d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 --2- 172.21.15.7:0/2449915193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe25415e360 0x7fe25415fab0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 -- 172.21.15.7:0/2449915193 >> 172.21.15.7:0/2449915193 conn(0x7fe25408dbf0 msgr2=0x7fe25409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 -- 172.21.15.7:0/2449915193 shutdown_connections 2024-08-19T00:39:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.840+0000 7fe259400640 1 -- 172.21.15.7:0/2449915193 wait complete. 2024-08-19T00:39:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.841+0000 7fe259400640 1 Processor -- start 2024-08-19T00:39:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.841+0000 7fe259400640 1 -- start start 2024-08-19T00:39:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.842+0000 7fe259400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2540d2af0 0x7fe2540ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.842+0000 7fe259400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe25415e360 0x7fe2540b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.842+0000 7fe259400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25415e740 0x7fe2540b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.842+0000 7fe259400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe25415f110 con 0x7fe2540d2af0 2024-08-19T00:39:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.842+0000 7fe259400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2540b4040 con 0x7fe25415e740 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.842+0000 7fe259400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2540d2300 con 0x7fe25415e360 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2540d2af0 0x7fe2540ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2540d2af0 0x7fe2540ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41600/0 (socket says 172.21.15.7:41600) 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 -- 172.21.15.7:0/528412769 learned_addr learned my addr 172.21.15.7:0/528412769 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe25415e360 0x7fe2540b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe258a00640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25415e740 0x7fe2540b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 -- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe25415e360 msgr2=0x7fe2540b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe25415e360 0x7fe2540b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 -- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25415e740 msgr2=0x7fe2540b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25415e740 0x7fe2540b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 -- 172.21.15.7:0/528412769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25415ace0 con 0x7fe2540d2af0 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe25415e360 0x7fe2540b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe258a00640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25415e740 0x7fe2540b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.843+0000 7fe253e00640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2540d2af0 0x7fe2540ca260 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe24402a220 tx=0x7fe2440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.844+0000 7fe24be00640 1 -- 172.21.15.7:0/528412769 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244041020 con 0x7fe2540d2af0 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.844+0000 7fe24be00640 1 -- 172.21.15.7:0/528412769 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2440306c0 con 0x7fe2540d2af0 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.844+0000 7fe24be00640 1 -- 172.21.15.7:0/528412769 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244037040 con 0x7fe2540d2af0 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.844+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25415afc0 con 0x7fe2540d2af0 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.844+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2540b11f0 con 0x7fe2540d2af0 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.845+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2540d2f50 con 0x7fe2540d2af0 2024-08-19T00:39:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.846+0000 7fe24be00640 1 -- 172.21.15.7:0/528412769 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe244044020 con 0x7fe2540d2af0 2024-08-19T00:39:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.847+0000 7fe24be00640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe23406be30 0x7fe23406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.847+0000 7fe24be00640 1 -- 172.21.15.7:0/528412769 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe2440ab6a0 con 0x7fe2540d2af0 2024-08-19T00:39:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.847+0000 7fe253400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe23406be30 0x7fe23406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.847+0000 7fe253400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe23406be30 0x7fe23406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe2541f7c00 tx=0x7fe240008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:41.851+0000 7fe24be00640 1 -- 172.21.15.7:0/528412769 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe24404b030 con 0x7fe2540d2af0 2024-08-19T00:39:42.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.032+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2540d50d0 con 0x7fe23406be30 2024-08-19T00:39:42.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.038+0000 7fe24be00640 1 -- 172.21.15.7:0/528412769 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251963 (secure 0 0 0) 0x7fe2540d50d0 con 0x7fe23406be30 2024-08-19T00:39:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:42.044 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe23406be30 msgr2=0x7fe23406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe23406be30 0x7fe23406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe2541f7c00 tx=0x7fe240008040 comp rx=0 tx=0).stop 2024-08-19T00:39:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2540d2af0 msgr2=0x7fe2540ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2540d2af0 0x7fe2540ca260 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe24402a220 tx=0x7fe2440046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 shutdown_connections 2024-08-19T00:39:42.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe23406be30 0x7fe23406e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:42.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25415e740 0x7fe2540b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:42.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe25415e360 0x7fe2540b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:42.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 --2- 172.21.15.7:0/528412769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2540d2af0 0x7fe2540ca260 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:42.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 >> 172.21.15.7:0/528412769 conn(0x7fe25408dbf0 msgr2=0x7fe2540b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:42.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.042+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 shutdown_connections 2024-08-19T00:39:42.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:42.043+0000 7fe259400640 1 -- 172.21.15.7:0/528412769 wait complete. 2024-08-19T00:39:42.060 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-08-19T00:39:41.290833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243552,"kb_used_data":6568,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731168,"statfs":{"total":773094113280,"available":772844716032,"internally_reserved":0,"allocated":6725632,"data_stored":3463220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.164092"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159648+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:37.159648+0000","last_peered":"2024-08-19T00:39:37.159648+0000","last_clean":"2024-08-19T00:39:37.159648+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:37.159648+0000","last_undegraded":"2024-08-19T00:39:37.159648+0000","last_fullsized":"2024-08-19T00:39:37.159648+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.696250+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:37.696250+0000","last_peered":"2024-08-19T00:39:37.696250+0000","last_clean":"2024-08-19T00:39:37.696250+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:37.696250+0000","last_undegraded":"2024-08-19T00:39:37.696250+0000","last_fullsized":"2024-08-19T00:39:37.696250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162625+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:37.162625+0000","last_peered":"2024-08-19T00:39:37.162625+0000","last_clean":"2024-08-19T00:39:37.162625+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:37.162625+0000","last_undegraded":"2024-08-19T00:39:37.162625+0000","last_fullsized":"2024-08-19T00:39:37.162625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133099+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:37.133099+0000","last_peered":"2024-08-19T00:39:37.133099+0000","last_clean":"2024-08-19T00:39:37.133099+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:37.133099+0000","last_undegraded":"2024-08-19T00:39:37.133099+0000","last_fullsized":"2024-08-19T00:39:37.133099+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159196+0000","last_change":"2024-08-19T00:39:36.153260+0000","last_active":"2024-08-19T00:39:37.159196+0000","last_peered":"2024-08-19T00:39:37.159196+0000","last_clean":"2024-08-19T00:39:37.159196+0000","last_became_active":"2024-08-19T00:39:36.152929+0000","last_became_peered":"2024-08-19T00:39:36.152929+0000","last_unstale":"2024-08-19T00:39:37.159196+0000","last_undegraded":"2024-08-19T00:39:37.159196+0000","last_fullsized":"2024-08-19T00:39:37.159196+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159095+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:37.159095+0000","last_peered":"2024-08-19T00:39:37.159095+0000","last_clean":"2024-08-19T00:39:37.159095+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:37.159095+0000","last_undegraded":"2024-08-19T00:39:37.159095+0000","last_fullsized":"2024-08-19T00:39:37.159095+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132333+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:37.132333+0000","last_peered":"2024-08-19T00:39:37.132333+0000","last_clean":"2024-08-19T00:39:37.132333+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:37.132333+0000","last_undegraded":"2024-08-19T00:39:37.132333+0000","last_fullsized":"2024-08-19T00:39:37.132333+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133661+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:37.133661+0000","last_peered":"2024-08-19T00:39:37.133661+0000","last_clean":"2024-08-19T00:39:37.133661+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:37.133661+0000","last_undegraded":"2024-08-19T00:39:37.133661+0000","last_fullsized":"2024-08-19T00:39:37.133661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133712+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:37.133712+0000","last_peered":"2024-08-19T00:39:37.133712+0000","last_clean":"2024-08-19T00:39:37.133712+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:37.133712+0000","last_undegraded":"2024-08-19T00:39:37.133712+0000","last_fullsized":"2024-08-19T00:39:37.133712+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159524+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:37.159524+0000","last_peered":"2024-08-19T00:39:37.159524+0000","last_clean":"2024-08-19T00:39:37.159524+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:37.159524+0000","last_undegraded":"2024-08-19T00:39:37.159524+0000","last_fullsized":"2024-08-19T00:39:37.159524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695499+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:37.695499+0000","last_peered":"2024-08-19T00:39:37.695499+0000","last_clean":"2024-08-19T00:39:37.695499+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:37.695499+0000","last_undegraded":"2024-08-19T00:39:37.695499+0000","last_fullsized":"2024-08-19T00:39:37.695499+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133851+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:37.133851+0000","last_peered":"2024-08-19T00:39:37.133851+0000","last_clean":"2024-08-19T00:39:37.133851+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:37.133851+0000","last_undegraded":"2024-08-19T00:39:37.133851+0000","last_fullsized":"2024-08-19T00:39:37.133851+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694729+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:37.694729+0000","last_peered":"2024-08-19T00:39:37.694729+0000","last_clean":"2024-08-19T00:39:37.694729+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:37.694729+0000","last_undegraded":"2024-08-19T00:39:37.694729+0000","last_fullsized":"2024-08-19T00:39:37.694729+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162300+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:37.162300+0000","last_peered":"2024-08-19T00:39:37.162300+0000","last_clean":"2024-08-19T00:39:37.162300+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:37.162300+0000","last_undegraded":"2024-08-19T00:39:37.162300+0000","last_fullsized":"2024-08-19T00:39:37.162300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694701+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:37.694701+0000","last_peered":"2024-08-19T00:39:37.694701+0000","last_clean":"2024-08-19T00:39:37.694701+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:37.694701+0000","last_undegraded":"2024-08-19T00:39:37.694701+0000","last_fullsized":"2024-08-19T00:39:37.694701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159055+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:37.159055+0000","last_peered":"2024-08-19T00:39:37.159055+0000","last_clean":"2024-08-19T00:39:37.159055+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:37.159055+0000","last_undegraded":"2024-08-19T00:39:37.159055+0000","last_fullsized":"2024-08-19T00:39:37.159055+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159752+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:37.159752+0000","last_peered":"2024-08-19T00:39:37.159752+0000","last_clean":"2024-08-19T00:39:37.159752+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:37.159752+0000","last_undegraded":"2024-08-19T00:39:37.159752+0000","last_fullsized":"2024-08-19T00:39:37.159752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162713+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:37.162713+0000","last_peered":"2024-08-19T00:39:37.162713+0000","last_clean":"2024-08-19T00:39:37.162713+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:37.162713+0000","last_undegraded":"2024-08-19T00:39:37.162713+0000","last_fullsized":"2024-08-19T00:39:37.162713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695998+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:37.695998+0000","last_peered":"2024-08-19T00:39:37.695998+0000","last_clean":"2024-08-19T00:39:37.695998+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:37.695998+0000","last_undegraded":"2024-08-19T00:39:37.695998+0000","last_fullsized":"2024-08-19T00:39:37.695998+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695316+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:37.695316+0000","last_peered":"2024-08-19T00:39:37.695316+0000","last_clean":"2024-08-19T00:39:37.695316+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:37.695316+0000","last_undegraded":"2024-08-19T00:39:37.695316+0000","last_fullsized":"2024-08-19T00:39:37.695316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694706+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:37.694706+0000","last_peered":"2024-08-19T00:39:37.694706+0000","last_clean":"2024-08-19T00:39:37.694706+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:37.694706+0000","last_undegraded":"2024-08-19T00:39:37.694706+0000","last_fullsized":"2024-08-19T00:39:37.694706+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695995+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:37.695995+0000","last_peered":"2024-08-19T00:39:37.695995+0000","last_clean":"2024-08-19T00:39:37.695995+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:37.695995+0000","last_undegraded":"2024-08-19T00:39:37.695995+0000","last_fullsized":"2024-08-19T00:39:37.695995+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132388+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:37.132388+0000","last_peered":"2024-08-19T00:39:37.132388+0000","last_clean":"2024-08-19T00:39:37.132388+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:37.132388+0000","last_undegraded":"2024-08-19T00:39:37.132388+0000","last_fullsized":"2024-08-19T00:39:37.132388+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133389+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:37.133389+0000","last_peered":"2024-08-19T00:39:37.133389+0000","last_clean":"2024-08-19T00:39:37.133389+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:37.133389+0000","last_undegraded":"2024-08-19T00:39:37.133389+0000","last_fullsized":"2024-08-19T00:39:37.133389+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.696235+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:37.696235+0000","last_peered":"2024-08-19T00:39:37.696235+0000","last_clean":"2024-08-19T00:39:37.696235+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:37.696235+0000","last_undegraded":"2024-08-19T00:39:37.696235+0000","last_fullsized":"2024-08-19T00:39:37.696235+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694991+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:37.694991+0000","last_peered":"2024-08-19T00:39:37.694991+0000","last_clean":"2024-08-19T00:39:37.694991+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:37.694991+0000","last_undegraded":"2024-08-19T00:39:37.694991+0000","last_fullsized":"2024-08-19T00:39:37.694991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.696123+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:37.696123+0000","last_peered":"2024-08-19T00:39:37.696123+0000","last_clean":"2024-08-19T00:39:37.696123+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:37.696123+0000","last_undegraded":"2024-08-19T00:39:37.696123+0000","last_fullsized":"2024-08-19T00:39:37.696123+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134136+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:37.134136+0000","last_peered":"2024-08-19T00:39:37.134136+0000","last_clean":"2024-08-19T00:39:37.134136+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:37.134136+0000","last_undegraded":"2024-08-19T00:39:37.134136+0000","last_fullsized":"2024-08-19T00:39:37.134136+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133991+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:37.133991+0000","last_peered":"2024-08-19T00:39:37.133991+0000","last_clean":"2024-08-19T00:39:37.133991+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.133991+0000","last_undegraded":"2024-08-19T00:39:37.133991+0000","last_fullsized":"2024-08-19T00:39:37.133991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132533+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:37.132533+0000","last_peered":"2024-08-19T00:39:37.132533+0000","last_clean":"2024-08-19T00:39:37.132533+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:37.132533+0000","last_undegraded":"2024-08-19T00:39:37.132533+0000","last_fullsized":"2024-08-19T00:39:37.132533+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695777+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:37.695777+0000","last_peered":"2024-08-19T00:39:37.695777+0000","last_clean":"2024-08-19T00:39:37.695777+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:37.695777+0000","last_undegraded":"2024-08-19T00:39:37.695777+0000","last_fullsized":"2024-08-19T00:39:37.695777+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695134+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:37.695134+0000","last_peered":"2024-08-19T00:39:37.695134+0000","last_clean":"2024-08-19T00:39:37.695134+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:37.695134+0000","last_undegraded":"2024-08-19T00:39:37.695134+0000","last_fullsized":"2024-08-19T00:39:37.695134+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159615+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:37.159615+0000","last_peered":"2024-08-19T00:39:37.159615+0000","last_clean":"2024-08-19T00:39:37.159615+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:37.159615+0000","last_undegraded":"2024-08-19T00:39:37.159615+0000","last_fullsized":"2024-08-19T00:39:37.159615+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695786+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:37.695786+0000","last_peered":"2024-08-19T00:39:37.695786+0000","last_clean":"2024-08-19T00:39:37.695786+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:37.695786+0000","last_undegraded":"2024-08-19T00:39:37.695786+0000","last_fullsized":"2024-08-19T00:39:37.695786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159764+0000","last_change":"2024-08-19T00:39:36.162607+0000","last_active":"2024-08-19T00:39:37.159764+0000","last_peered":"2024-08-19T00:39:37.159764+0000","last_clean":"2024-08-19T00:39:37.159764+0000","last_became_active":"2024-08-19T00:39:36.162029+0000","last_became_peered":"2024-08-19T00:39:36.162029+0000","last_unstale":"2024-08-19T00:39:37.159764+0000","last_undegraded":"2024-08-19T00:39:37.159764+0000","last_fullsized":"2024-08-19T00:39:37.159764+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.696162+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:37.696162+0000","last_peered":"2024-08-19T00:39:37.696162+0000","last_clean":"2024-08-19T00:39:37.696162+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:37.696162+0000","last_undegraded":"2024-08-19T00:39:37.696162+0000","last_fullsized":"2024-08-19T00:39:37.696162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134299+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:37.134299+0000","last_peered":"2024-08-19T00:39:37.134299+0000","last_clean":"2024-08-19T00:39:37.134299+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:37.134299+0000","last_undegraded":"2024-08-19T00:39:37.134299+0000","last_fullsized":"2024-08-19T00:39:37.134299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159539+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:37.159539+0000","last_peered":"2024-08-19T00:39:37.159539+0000","last_clean":"2024-08-19T00:39:37.159539+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:37.159539+0000","last_undegraded":"2024-08-19T00:39:37.159539+0000","last_fullsized":"2024-08-19T00:39:37.159539+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159422+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:37.159422+0000","last_peered":"2024-08-19T00:39:37.159422+0000","last_clean":"2024-08-19T00:39:37.159422+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:37.159422+0000","last_undegraded":"2024-08-19T00:39:37.159422+0000","last_fullsized":"2024-08-19T00:39:37.159422+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133032+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:37.133032+0000","last_peered":"2024-08-19T00:39:37.133032+0000","last_clean":"2024-08-19T00:39:37.133032+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:37.133032+0000","last_undegraded":"2024-08-19T00:39:37.133032+0000","last_fullsized":"2024-08-19T00:39:37.133032+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133710+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:37.133710+0000","last_peered":"2024-08-19T00:39:37.133710+0000","last_clean":"2024-08-19T00:39:37.133710+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:37.133710+0000","last_undegraded":"2024-08-19T00:39:37.133710+0000","last_fullsized":"2024-08-19T00:39:37.133710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162424+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:37.162424+0000","last_peered":"2024-08-19T00:39:37.162424+0000","last_clean":"2024-08-19T00:39:37.162424+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:37.162424+0000","last_undegraded":"2024-08-19T00:39:37.162424+0000","last_fullsized":"2024-08-19T00:39:37.162424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695411+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:37.695411+0000","last_peered":"2024-08-19T00:39:37.695411+0000","last_clean":"2024-08-19T00:39:37.695411+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:37.695411+0000","last_undegraded":"2024-08-19T00:39:37.695411+0000","last_fullsized":"2024-08-19T00:39:37.695411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159213+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:37.159213+0000","last_peered":"2024-08-19T00:39:37.159213+0000","last_clean":"2024-08-19T00:39:37.159213+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:37.159213+0000","last_undegraded":"2024-08-19T00:39:37.159213+0000","last_fullsized":"2024-08-19T00:39:37.159213+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162288+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:37.162288+0000","last_peered":"2024-08-19T00:39:37.162288+0000","last_clean":"2024-08-19T00:39:37.162288+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:37.162288+0000","last_undegraded":"2024-08-19T00:39:37.162288+0000","last_fullsized":"2024-08-19T00:39:37.162288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133485+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:37.133485+0000","last_peered":"2024-08-19T00:39:37.133485+0000","last_clean":"2024-08-19T00:39:37.133485+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:37.133485+0000","last_undegraded":"2024-08-19T00:39:37.133485+0000","last_fullsized":"2024-08-19T00:39:37.133485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159045+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:37.159045+0000","last_peered":"2024-08-19T00:39:37.159045+0000","last_clean":"2024-08-19T00:39:37.159045+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:37.159045+0000","last_undegraded":"2024-08-19T00:39:37.159045+0000","last_fullsized":"2024-08-19T00:39:37.159045+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694609+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:37.694609+0000","last_peered":"2024-08-19T00:39:37.694609+0000","last_clean":"2024-08-19T00:39:37.694609+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:37.694609+0000","last_undegraded":"2024-08-19T00:39:37.694609+0000","last_fullsized":"2024-08-19T00:39:37.694609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694988+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:37.694988+0000","last_peered":"2024-08-19T00:39:37.694988+0000","last_clean":"2024-08-19T00:39:37.694988+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:37.694988+0000","last_undegraded":"2024-08-19T00:39:37.694988+0000","last_fullsized":"2024-08-19T00:39:37.694988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133755+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:37.133755+0000","last_peered":"2024-08-19T00:39:37.133755+0000","last_clean":"2024-08-19T00:39:37.133755+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:37.133755+0000","last_undegraded":"2024-08-19T00:39:37.133755+0000","last_fullsized":"2024-08-19T00:39:37.133755+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162623+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:37.162623+0000","last_peered":"2024-08-19T00:39:37.162623+0000","last_clean":"2024-08-19T00:39:37.162623+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:37.162623+0000","last_undegraded":"2024-08-19T00:39:37.162623+0000","last_fullsized":"2024-08-19T00:39:37.162623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133915+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:37.133915+0000","last_peered":"2024-08-19T00:39:37.133915+0000","last_clean":"2024-08-19T00:39:37.133915+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:37.133915+0000","last_undegraded":"2024-08-19T00:39:37.133915+0000","last_fullsized":"2024-08-19T00:39:37.133915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134374+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:37.134374+0000","last_peered":"2024-08-19T00:39:37.134374+0000","last_clean":"2024-08-19T00:39:37.134374+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:37.134374+0000","last_undegraded":"2024-08-19T00:39:37.134374+0000","last_fullsized":"2024-08-19T00:39:37.134374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132879+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:37.132879+0000","last_peered":"2024-08-19T00:39:37.132879+0000","last_clean":"2024-08-19T00:39:37.132879+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:37.132879+0000","last_undegraded":"2024-08-19T00:39:37.132879+0000","last_fullsized":"2024-08-19T00:39:37.132879+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132782+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:37.132782+0000","last_peered":"2024-08-19T00:39:37.132782+0000","last_clean":"2024-08-19T00:39:37.132782+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:37.132782+0000","last_undegraded":"2024-08-19T00:39:37.132782+0000","last_fullsized":"2024-08-19T00:39:37.132782+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694922+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:37.694922+0000","last_peered":"2024-08-19T00:39:37.694922+0000","last_clean":"2024-08-19T00:39:37.694922+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:37.694922+0000","last_undegraded":"2024-08-19T00:39:37.694922+0000","last_fullsized":"2024-08-19T00:39:37.694922+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133483+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:37.133483+0000","last_peered":"2024-08-19T00:39:37.133483+0000","last_clean":"2024-08-19T00:39:37.133483+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:37.133483+0000","last_undegraded":"2024-08-19T00:39:37.133483+0000","last_fullsized":"2024-08-19T00:39:37.133483+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134099+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:37.134099+0000","last_peered":"2024-08-19T00:39:37.134099+0000","last_clean":"2024-08-19T00:39:37.134099+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:37.134099+0000","last_undegraded":"2024-08-19T00:39:37.134099+0000","last_fullsized":"2024-08-19T00:39:37.134099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162429+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:37.162429+0000","last_peered":"2024-08-19T00:39:37.162429+0000","last_clean":"2024-08-19T00:39:37.162429+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:37.162429+0000","last_undegraded":"2024-08-19T00:39:37.162429+0000","last_fullsized":"2024-08-19T00:39:37.162429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132582+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:37.132582+0000","last_peered":"2024-08-19T00:39:37.132582+0000","last_clean":"2024-08-19T00:39:37.132582+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:37.132582+0000","last_undegraded":"2024-08-19T00:39:37.132582+0000","last_fullsized":"2024-08-19T00:39:37.132582+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133453+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:37.133453+0000","last_peered":"2024-08-19T00:39:37.133453+0000","last_clean":"2024-08-19T00:39:37.133453+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:37.133453+0000","last_undegraded":"2024-08-19T00:39:37.133453+0000","last_fullsized":"2024-08-19T00:39:37.133453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132480+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:37.132480+0000","last_peered":"2024-08-19T00:39:37.132480+0000","last_clean":"2024-08-19T00:39:37.132480+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:37.132480+0000","last_undegraded":"2024-08-19T00:39:37.132480+0000","last_fullsized":"2024-08-19T00:39:37.132480+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132494+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:37.132494+0000","last_peered":"2024-08-19T00:39:37.132494+0000","last_clean":"2024-08-19T00:39:37.132494+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:37.132494+0000","last_undegraded":"2024-08-19T00:39:37.132494+0000","last_fullsized":"2024-08-19T00:39:37.132494+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132317+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:37.132317+0000","last_peered":"2024-08-19T00:39:37.132317+0000","last_clean":"2024-08-19T00:39:37.132317+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:37.132317+0000","last_undegraded":"2024-08-19T00:39:37.132317+0000","last_fullsized":"2024-08-19T00:39:37.132317+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162769+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:37.162769+0000","last_peered":"2024-08-19T00:39:37.162769+0000","last_clean":"2024-08-19T00:39:37.162769+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.162769+0000","last_undegraded":"2024-08-19T00:39:37.162769+0000","last_fullsized":"2024-08-19T00:39:37.162769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.696251+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:37.696251+0000","last_peered":"2024-08-19T00:39:37.696251+0000","last_clean":"2024-08-19T00:39:37.696251+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:37.696251+0000","last_undegraded":"2024-08-19T00:39:37.696251+0000","last_fullsized":"2024-08-19T00:39:37.696251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162717+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:37.162717+0000","last_peered":"2024-08-19T00:39:37.162717+0000","last_clean":"2024-08-19T00:39:37.162717+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:37.162717+0000","last_undegraded":"2024-08-19T00:39:37.162717+0000","last_fullsized":"2024-08-19T00:39:37.162717+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134321+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:37.134321+0000","last_peered":"2024-08-19T00:39:37.134321+0000","last_clean":"2024-08-19T00:39:37.134321+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:37.134321+0000","last_undegraded":"2024-08-19T00:39:37.134321+0000","last_fullsized":"2024-08-19T00:39:37.134321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695520+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:37.695520+0000","last_peered":"2024-08-19T00:39:37.695520+0000","last_clean":"2024-08-19T00:39:37.695520+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:37.695520+0000","last_undegraded":"2024-08-19T00:39:37.695520+0000","last_fullsized":"2024-08-19T00:39:37.695520+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162693+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:37.162693+0000","last_peered":"2024-08-19T00:39:37.162693+0000","last_clean":"2024-08-19T00:39:37.162693+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:37.162693+0000","last_undegraded":"2024-08-19T00:39:37.162693+0000","last_fullsized":"2024-08-19T00:39:37.162693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.132797+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:37.132797+0000","last_peered":"2024-08-19T00:39:37.132797+0000","last_clean":"2024-08-19T00:39:37.132797+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:37.132797+0000","last_undegraded":"2024-08-19T00:39:37.132797+0000","last_fullsized":"2024-08-19T00:39:37.132797+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134432+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:37.134432+0000","last_peered":"2024-08-19T00:39:37.134432+0000","last_clean":"2024-08-19T00:39:37.134432+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:37.134432+0000","last_undegraded":"2024-08-19T00:39:37.134432+0000","last_fullsized":"2024-08-19T00:39:37.134432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133680+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:37.133680+0000","last_peered":"2024-08-19T00:39:37.133680+0000","last_clean":"2024-08-19T00:39:37.133680+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:37.133680+0000","last_undegraded":"2024-08-19T00:39:37.133680+0000","last_fullsized":"2024-08-19T00:39:37.133680+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695460+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:37.695460+0000","last_peered":"2024-08-19T00:39:37.695460+0000","last_clean":"2024-08-19T00:39:37.695460+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:37.695460+0000","last_undegraded":"2024-08-19T00:39:37.695460+0000","last_fullsized":"2024-08-19T00:39:37.695460+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134154+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:37.134154+0000","last_peered":"2024-08-19T00:39:37.134154+0000","last_clean":"2024-08-19T00:39:37.134154+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:37.134154+0000","last_undegraded":"2024-08-19T00:39:37.134154+0000","last_fullsized":"2024-08-19T00:39:37.134154+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133819+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:37.133819+0000","last_peered":"2024-08-19T00:39:37.133819+0000","last_clean":"2024-08-19T00:39:37.133819+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:37.133819+0000","last_undegraded":"2024-08-19T00:39:37.133819+0000","last_fullsized":"2024-08-19T00:39:37.133819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133681+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:37.133681+0000","last_peered":"2024-08-19T00:39:37.133681+0000","last_clean":"2024-08-19T00:39:37.133681+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:37.133681+0000","last_undegraded":"2024-08-19T00:39:37.133681+0000","last_fullsized":"2024-08-19T00:39:37.133681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133482+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:37.133482+0000","last_peered":"2024-08-19T00:39:37.133482+0000","last_clean":"2024-08-19T00:39:37.133482+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:37.133482+0000","last_undegraded":"2024-08-19T00:39:37.133482+0000","last_fullsized":"2024-08-19T00:39:37.133482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162876+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:37.162876+0000","last_peered":"2024-08-19T00:39:37.162876+0000","last_clean":"2024-08-19T00:39:37.162876+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:37.162876+0000","last_undegraded":"2024-08-19T00:39:37.162876+0000","last_fullsized":"2024-08-19T00:39:37.162876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.696336+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:37.696336+0000","last_peered":"2024-08-19T00:39:37.696336+0000","last_clean":"2024-08-19T00:39:37.696336+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:37.696336+0000","last_undegraded":"2024-08-19T00:39:37.696336+0000","last_fullsized":"2024-08-19T00:39:37.696336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162863+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:37.162863+0000","last_peered":"2024-08-19T00:39:37.162863+0000","last_clean":"2024-08-19T00:39:37.162863+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:37.162863+0000","last_undegraded":"2024-08-19T00:39:37.162863+0000","last_fullsized":"2024-08-19T00:39:37.162863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159702+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:37.159702+0000","last_peered":"2024-08-19T00:39:37.159702+0000","last_clean":"2024-08-19T00:39:37.159702+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:37.159702+0000","last_undegraded":"2024-08-19T00:39:37.159702+0000","last_fullsized":"2024-08-19T00:39:37.159702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695634+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:37.695634+0000","last_peered":"2024-08-19T00:39:37.695634+0000","last_clean":"2024-08-19T00:39:37.695634+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:37.695634+0000","last_undegraded":"2024-08-19T00:39:37.695634+0000","last_fullsized":"2024-08-19T00:39:37.695634+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133590+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:37.133590+0000","last_peered":"2024-08-19T00:39:37.133590+0000","last_clean":"2024-08-19T00:39:37.133590+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:37.133590+0000","last_undegraded":"2024-08-19T00:39:37.133590+0000","last_fullsized":"2024-08-19T00:39:37.133590+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134080+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:37.134080+0000","last_peered":"2024-08-19T00:39:37.134080+0000","last_clean":"2024-08-19T00:39:37.134080+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:37.134080+0000","last_undegraded":"2024-08-19T00:39:37.134080+0000","last_fullsized":"2024-08-19T00:39:37.134080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162526+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:37.162526+0000","last_peered":"2024-08-19T00:39:37.162526+0000","last_clean":"2024-08-19T00:39:37.162526+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:37.162526+0000","last_undegraded":"2024-08-19T00:39:37.162526+0000","last_fullsized":"2024-08-19T00:39:37.162526+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159193+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:37.159193+0000","last_peered":"2024-08-19T00:39:37.159193+0000","last_clean":"2024-08-19T00:39:37.159193+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:37.159193+0000","last_undegraded":"2024-08-19T00:39:37.159193+0000","last_fullsized":"2024-08-19T00:39:37.159193+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695557+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:37.695557+0000","last_peered":"2024-08-19T00:39:37.695557+0000","last_clean":"2024-08-19T00:39:37.695557+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:37.695557+0000","last_undegraded":"2024-08-19T00:39:37.695557+0000","last_fullsized":"2024-08-19T00:39:37.695557+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694933+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:37.694933+0000","last_peered":"2024-08-19T00:39:37.694933+0000","last_clean":"2024-08-19T00:39:37.694933+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:37.694933+0000","last_undegraded":"2024-08-19T00:39:37.694933+0000","last_fullsized":"2024-08-19T00:39:37.694933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162321+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:37.162321+0000","last_peered":"2024-08-19T00:39:37.162321+0000","last_clean":"2024-08-19T00:39:37.162321+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:37.162321+0000","last_undegraded":"2024-08-19T00:39:37.162321+0000","last_fullsized":"2024-08-19T00:39:37.162321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133674+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:37.133674+0000","last_peered":"2024-08-19T00:39:37.133674+0000","last_clean":"2024-08-19T00:39:37.133674+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:37.133674+0000","last_undegraded":"2024-08-19T00:39:37.133674+0000","last_fullsized":"2024-08-19T00:39:37.133674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.159003+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:37.159003+0000","last_peered":"2024-08-19T00:39:37.159003+0000","last_clean":"2024-08-19T00:39:37.159003+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:37.159003+0000","last_undegraded":"2024-08-19T00:39:37.159003+0000","last_fullsized":"2024-08-19T00:39:37.159003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.695947+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:37.695947+0000","last_peered":"2024-08-19T00:39:37.695947+0000","last_clean":"2024-08-19T00:39:37.695947+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:37.695947+0000","last_undegraded":"2024-08-19T00:39:37.695947+0000","last_fullsized":"2024-08-19T00:39:37.695947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133877+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:37.133877+0000","last_peered":"2024-08-19T00:39:37.133877+0000","last_clean":"2024-08-19T00:39:37.133877+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:37.133877+0000","last_undegraded":"2024-08-19T00:39:37.133877+0000","last_fullsized":"2024-08-19T00:39:37.133877+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133936+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:37.133936+0000","last_peered":"2024-08-19T00:39:37.133936+0000","last_clean":"2024-08-19T00:39:37.133936+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:37.133936+0000","last_undegraded":"2024-08-19T00:39:37.133936+0000","last_fullsized":"2024-08-19T00:39:37.133936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694635+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:37.694635+0000","last_peered":"2024-08-19T00:39:37.694635+0000","last_clean":"2024-08-19T00:39:37.694635+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:37.694635+0000","last_undegraded":"2024-08-19T00:39:37.694635+0000","last_fullsized":"2024-08-19T00:39:37.694635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133563+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:37.133563+0000","last_peered":"2024-08-19T00:39:37.133563+0000","last_clean":"2024-08-19T00:39:37.133563+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:37.133563+0000","last_undegraded":"2024-08-19T00:39:37.133563+0000","last_fullsized":"2024-08-19T00:39:37.133563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":284800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":284730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":875110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":285324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":284798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":286480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":875658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":286320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:45.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:45.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.231+0000 7fc5f3e00640 1 Processor -- start 2024-08-19T00:39:45.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.231+0000 7fc5f3e00640 1 -- start start 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f4147a80 0x7fc5f406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5f40b4320 0x7fc5f415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f406d6a0 con 0x7fc5f40b5940 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f406d980 con 0x7fc5f40b4320 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f406dc60 con 0x7fc5f4147a80 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5f40b4320 0x7fc5f415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5f40b4320 0x7fc5f415edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39500/0 (socket says 172.21.15.7:39500) 2024-08-19T00:39:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.232+0000 7fc5f3400640 1 -- 172.21.15.7:0/3739593520 learned_addr learned my addr 172.21.15.7:0/3739593520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:45.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.233+0000 7fc5f2a00640 1 --2- 172.21.15.7:0/3739593520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f4147a80 0x7fc5f406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.233+0000 7fc5f3400640 1 -- 172.21.15.7:0/3739593520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f4147a80 msgr2=0x7fc5f406ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:45.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.233+0000 7fc5f3400640 1 --2- 172.21.15.7:0/3739593520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f4147a80 0x7fc5f406ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.233+0000 7fc5f3400640 1 -- 172.21.15.7:0/3739593520 >> v1:172.21.15.162:6789/0 conn(0x7fc5f40b5940 legacy=0x7fc5f40b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:45.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.233+0000 7fc5f3400640 1 -- 172.21.15.7:0/3739593520 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f406df40 con 0x7fc5f40b4320 2024-08-19T00:39:45.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.233+0000 7fc5f2a00640 1 --2- 172.21.15.7:0/3739593520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f4147a80 0x7fc5f406ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:45.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.234+0000 7fc5f3400640 1 --2- 172.21.15.7:0/3739593520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f40b4320 0x7fc5f415edf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009e50 tx=0x7fc5ec02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c1c864559325b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:45.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.234+0000 7fc5f2000640 1 -- 172.21.15.7:0/3739593520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec036070 con 0x7fc5f40b4320 2024-08-19T00:39:45.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.234+0000 7fc5f2000640 1 -- 172.21.15.7:0/3739593520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ec031600 con 0x7fc5f40b4320 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.234+0000 7fc5f2000640 1 -- 172.21.15.7:0/3739593520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0319d0 con 0x7fc5f40b4320 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 -- 172.21.15.7:0/3739593520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f40b4320 msgr2=0x7fc5f415edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/3739593520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f40b4320 0x7fc5f415edf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009e50 tx=0x7fc5ec02a6c0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 -- 172.21.15.7:0/3739593520 shutdown_connections 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/3739593520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f40b4320 0x7fc5f415edf0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/3739593520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f4147a80 0x7fc5f406ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 -- 172.21.15.7:0/3739593520 >> 172.21.15.7:0/3739593520 conn(0x7fc5f40b74a0 msgr2=0x7fc5f40b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 -- 172.21.15.7:0/3739593520 shutdown_connections 2024-08-19T00:39:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.235+0000 7fc5f3e00640 1 -- 172.21.15.7:0/3739593520 wait complete. 2024-08-19T00:39:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.236+0000 7fc5f3e00640 1 Processor -- start 2024-08-19T00:39:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.237+0000 7fc5f3e00640 1 -- start start 2024-08-19T00:39:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.237+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f40b4320 0x7fc5f415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.237+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f40b5940 0x7fc5f40cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.237+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f4147a80 0x7fc5f40d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.237+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4147e60 con 0x7fc5f4147a80 2024-08-19T00:39:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.237+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f406d3b0 con 0x7fc5f40b4320 2024-08-19T00:39:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.237+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f4147fe0 con 0x7fc5f40b5940 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f4147a80 0x7fc5f40d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f4147a80 0x7fc5f40d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39510/0 (socket says 172.21.15.7:39510) 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 -- 172.21.15.7:0/2354818630 learned_addr learned my addr 172.21.15.7:0/2354818630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f2a00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f40b4320 0x7fc5f415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5ebe00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f40b5940 0x7fc5f40cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 -- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f40b5940 msgr2=0x7fc5f40cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f40b5940 0x7fc5f40cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 -- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f40b4320 msgr2=0x7fc5f415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f40b4320 0x7fc5f415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 -- 172.21.15.7:0/2354818630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40cba30 con 0x7fc5f4147a80 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.238+0000 7fc5f3400640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f4147a80 0x7fc5f40d1400 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009e50 tx=0x7fc5ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.239+0000 7fc5eaa00640 1 -- 172.21.15.7:0/2354818630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec036050 con 0x7fc5f4147a80 2024-08-19T00:39:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.239+0000 7fc5eaa00640 1 -- 172.21.15.7:0/2354818630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ec042070 con 0x7fc5f4147a80 2024-08-19T00:39:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.239+0000 7fc5eaa00640 1 -- 172.21.15.7:0/2354818630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec009510 con 0x7fc5f4147a80 2024-08-19T00:39:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.239+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f40cbd10 con 0x7fc5f4147a80 2024-08-19T00:39:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.239+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f40cc2d0 con 0x7fc5f4147a80 2024-08-19T00:39:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.240+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f412c560 con 0x7fc5f4147a80 2024-08-19T00:39:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.241+0000 7fc5eaa00640 1 -- 172.21.15.7:0/2354818630 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5ec007bd0 con 0x7fc5f4147a80 2024-08-19T00:39:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.242+0000 7fc5eaa00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d006be30 0x7fc5d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.242+0000 7fc5eaa00640 1 -- 172.21.15.7:0/2354818630 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5767+0+0 (secure 0 0 0) 0x7fc5ec0abd70 con 0x7fc5f4147a80 2024-08-19T00:39:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.242+0000 7fc5f2a00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d006be30 0x7fc5d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.243+0000 7fc5f2a00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d006be30 0x7fc5d006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400aac0 tx=0x7fc5e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:45.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.246+0000 7fc5eaa00640 1 -- 172.21.15.7:0/2354818630 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc5ec07a6d0 con 0x7fc5f4147a80 2024-08-19T00:39:45.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.436+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5f412c280 con 0x7fc5d006be30 2024-08-19T00:39:45.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.442+0000 7fc5eaa00640 1 -- 172.21.15.7:0/2354818630 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251717 (secure 0 0 0) 0x7fc5f412c280 con 0x7fc5d006be30 2024-08-19T00:39:45.446 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:45.448 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.445+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d006be30 msgr2=0x7fc5d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.445+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d006be30 0x7fc5d006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400aac0 tx=0x7fc5e4008040 comp rx=0 tx=0).stop 2024-08-19T00:39:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.445+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f4147a80 msgr2=0x7fc5f40d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.445+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f4147a80 0x7fc5f40d1400 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009e50 tx=0x7fc5ec004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 shutdown_connections 2024-08-19T00:39:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d006be30 0x7fc5d006e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f4147a80 0x7fc5f40d1400 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f40b5940 0x7fc5f40cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 --2- 172.21.15.7:0/2354818630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f40b4320 0x7fc5f415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 >> 172.21.15.7:0/2354818630 conn(0x7fc5f40b74a0 msgr2=0x7fc5f412ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:45.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 shutdown_connections 2024-08-19T00:39:45.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.446+0000 7fc5f3e00640 1 -- 172.21.15.7:0/2354818630 wait complete. 2024-08-19T00:39:45.463 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-08-19T00:39:45.372919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243600,"kb_used_data":6628,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731120,"statfs":{"total":773094113280,"available":772844666880,"internally_reserved":0,"allocated":6787072,"data_stored":3493345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.082689"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371678+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:44.371678+0000","last_peered":"2024-08-19T00:39:44.371678+0000","last_clean":"2024-08-19T00:39:44.371678+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:44.371678+0000","last_undegraded":"2024-08-19T00:39:44.371678+0000","last_fullsized":"2024-08-19T00:39:44.371678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370966+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:44.370966+0000","last_peered":"2024-08-19T00:39:44.370966+0000","last_clean":"2024-08-19T00:39:44.370966+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:44.370966+0000","last_undegraded":"2024-08-19T00:39:44.370966+0000","last_fullsized":"2024-08-19T00:39:44.370966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162625+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:37.162625+0000","last_peered":"2024-08-19T00:39:37.162625+0000","last_clean":"2024-08-19T00:39:37.162625+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:37.162625+0000","last_undegraded":"2024-08-19T00:39:37.162625+0000","last_fullsized":"2024-08-19T00:39:37.162625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368733+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:44.368733+0000","last_peered":"2024-08-19T00:39:44.368733+0000","last_clean":"2024-08-19T00:39:44.368733+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:44.368733+0000","last_undegraded":"2024-08-19T00:39:44.368733+0000","last_fullsized":"2024-08-19T00:39:44.368733+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.135051+0000","last_change":"2024-08-19T00:39:45.312229+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.135051+0000","last_undegraded":"2024-08-19T00:39:36.135051+0000","last_fullsized":"2024-08-19T00:39:36.135051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370452+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:44.370452+0000","last_peered":"2024-08-19T00:39:44.370452+0000","last_clean":"2024-08-19T00:39:44.370452+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:44.370452+0000","last_undegraded":"2024-08-19T00:39:44.370452+0000","last_fullsized":"2024-08-19T00:39:44.370452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368316+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:44.368316+0000","last_peered":"2024-08-19T00:39:44.368316+0000","last_clean":"2024-08-19T00:39:44.368316+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:44.368316+0000","last_undegraded":"2024-08-19T00:39:44.368316+0000","last_fullsized":"2024-08-19T00:39:44.368316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133661+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:37.133661+0000","last_peered":"2024-08-19T00:39:37.133661+0000","last_clean":"2024-08-19T00:39:37.133661+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:37.133661+0000","last_undegraded":"2024-08-19T00:39:37.133661+0000","last_fullsized":"2024-08-19T00:39:37.133661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373880+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:44.373880+0000","last_peered":"2024-08-19T00:39:44.373880+0000","last_clean":"2024-08-19T00:39:44.373880+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:44.373880+0000","last_undegraded":"2024-08-19T00:39:44.373880+0000","last_fullsized":"2024-08-19T00:39:44.373880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371386+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:44.371386+0000","last_peered":"2024-08-19T00:39:44.371386+0000","last_clean":"2024-08-19T00:39:44.371386+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:44.371386+0000","last_undegraded":"2024-08-19T00:39:44.371386+0000","last_fullsized":"2024-08-19T00:39:44.371386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375631+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:44.375631+0000","last_peered":"2024-08-19T00:39:44.375631+0000","last_clean":"2024-08-19T00:39:44.375631+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:44.375631+0000","last_undegraded":"2024-08-19T00:39:44.375631+0000","last_fullsized":"2024-08-19T00:39:44.375631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373889+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:44.373889+0000","last_peered":"2024-08-19T00:39:44.373889+0000","last_clean":"2024-08-19T00:39:44.373889+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:44.373889+0000","last_undegraded":"2024-08-19T00:39:44.373889+0000","last_fullsized":"2024-08-19T00:39:44.373889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694729+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:37.694729+0000","last_peered":"2024-08-19T00:39:37.694729+0000","last_clean":"2024-08-19T00:39:37.694729+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:37.694729+0000","last_undegraded":"2024-08-19T00:39:37.694729+0000","last_fullsized":"2024-08-19T00:39:37.694729+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162300+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:37.162300+0000","last_peered":"2024-08-19T00:39:37.162300+0000","last_clean":"2024-08-19T00:39:37.162300+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:37.162300+0000","last_undegraded":"2024-08-19T00:39:37.162300+0000","last_fullsized":"2024-08-19T00:39:37.162300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694701+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:37.694701+0000","last_peered":"2024-08-19T00:39:37.694701+0000","last_clean":"2024-08-19T00:39:37.694701+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:37.694701+0000","last_undegraded":"2024-08-19T00:39:37.694701+0000","last_fullsized":"2024-08-19T00:39:37.694701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370368+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:44.370368+0000","last_peered":"2024-08-19T00:39:44.370368+0000","last_clean":"2024-08-19T00:39:44.370368+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:44.370368+0000","last_undegraded":"2024-08-19T00:39:44.370368+0000","last_fullsized":"2024-08-19T00:39:44.370368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371676+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:44.371676+0000","last_peered":"2024-08-19T00:39:44.371676+0000","last_clean":"2024-08-19T00:39:44.371676+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:44.371676+0000","last_undegraded":"2024-08-19T00:39:44.371676+0000","last_fullsized":"2024-08-19T00:39:44.371676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162713+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:37.162713+0000","last_peered":"2024-08-19T00:39:37.162713+0000","last_clean":"2024-08-19T00:39:37.162713+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:37.162713+0000","last_undegraded":"2024-08-19T00:39:37.162713+0000","last_fullsized":"2024-08-19T00:39:37.162713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370911+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:44.370911+0000","last_peered":"2024-08-19T00:39:44.370911+0000","last_clean":"2024-08-19T00:39:44.370911+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:44.370911+0000","last_undegraded":"2024-08-19T00:39:44.370911+0000","last_fullsized":"2024-08-19T00:39:44.370911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375576+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:44.375576+0000","last_peered":"2024-08-19T00:39:44.375576+0000","last_clean":"2024-08-19T00:39:44.375576+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:44.375576+0000","last_undegraded":"2024-08-19T00:39:44.375576+0000","last_fullsized":"2024-08-19T00:39:44.375576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694706+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:37.694706+0000","last_peered":"2024-08-19T00:39:37.694706+0000","last_clean":"2024-08-19T00:39:37.694706+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:37.694706+0000","last_undegraded":"2024-08-19T00:39:37.694706+0000","last_fullsized":"2024-08-19T00:39:37.694706+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375622+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:44.375622+0000","last_peered":"2024-08-19T00:39:44.375622+0000","last_clean":"2024-08-19T00:39:44.375622+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:44.375622+0000","last_undegraded":"2024-08-19T00:39:44.375622+0000","last_fullsized":"2024-08-19T00:39:44.375622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368371+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:44.368371+0000","last_peered":"2024-08-19T00:39:44.368371+0000","last_clean":"2024-08-19T00:39:44.368371+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:44.368371+0000","last_undegraded":"2024-08-19T00:39:44.368371+0000","last_fullsized":"2024-08-19T00:39:44.368371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372557+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:44.372557+0000","last_peered":"2024-08-19T00:39:44.372557+0000","last_clean":"2024-08-19T00:39:44.372557+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:44.372557+0000","last_undegraded":"2024-08-19T00:39:44.372557+0000","last_fullsized":"2024-08-19T00:39:44.372557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370827+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:44.370827+0000","last_peered":"2024-08-19T00:39:44.370827+0000","last_clean":"2024-08-19T00:39:44.370827+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:44.370827+0000","last_undegraded":"2024-08-19T00:39:44.370827+0000","last_fullsized":"2024-08-19T00:39:44.370827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694991+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:37.694991+0000","last_peered":"2024-08-19T00:39:37.694991+0000","last_clean":"2024-08-19T00:39:37.694991+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:37.694991+0000","last_undegraded":"2024-08-19T00:39:37.694991+0000","last_fullsized":"2024-08-19T00:39:37.694991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371103+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:44.371103+0000","last_peered":"2024-08-19T00:39:44.371103+0000","last_clean":"2024-08-19T00:39:44.371103+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:44.371103+0000","last_undegraded":"2024-08-19T00:39:44.371103+0000","last_fullsized":"2024-08-19T00:39:44.371103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134136+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:37.134136+0000","last_peered":"2024-08-19T00:39:37.134136+0000","last_clean":"2024-08-19T00:39:37.134136+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:37.134136+0000","last_undegraded":"2024-08-19T00:39:37.134136+0000","last_fullsized":"2024-08-19T00:39:37.134136+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133991+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:37.133991+0000","last_peered":"2024-08-19T00:39:37.133991+0000","last_clean":"2024-08-19T00:39:37.133991+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.133991+0000","last_undegraded":"2024-08-19T00:39:37.133991+0000","last_fullsized":"2024-08-19T00:39:37.133991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368366+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:44.368366+0000","last_peered":"2024-08-19T00:39:44.368366+0000","last_clean":"2024-08-19T00:39:44.368366+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:44.368366+0000","last_undegraded":"2024-08-19T00:39:44.368366+0000","last_fullsized":"2024-08-19T00:39:44.368366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370803+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:44.370803+0000","last_peered":"2024-08-19T00:39:44.370803+0000","last_clean":"2024-08-19T00:39:44.370803+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:44.370803+0000","last_undegraded":"2024-08-19T00:39:44.370803+0000","last_fullsized":"2024-08-19T00:39:44.370803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375350+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:44.375350+0000","last_peered":"2024-08-19T00:39:44.375350+0000","last_clean":"2024-08-19T00:39:44.375350+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:44.375350+0000","last_undegraded":"2024-08-19T00:39:44.375350+0000","last_fullsized":"2024-08-19T00:39:44.375350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371472+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:44.371472+0000","last_peered":"2024-08-19T00:39:44.371472+0000","last_clean":"2024-08-19T00:39:44.371472+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:44.371472+0000","last_undegraded":"2024-08-19T00:39:44.371472+0000","last_fullsized":"2024-08-19T00:39:44.371472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375974+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:44.375974+0000","last_peered":"2024-08-19T00:39:44.375974+0000","last_clean":"2024-08-19T00:39:44.375974+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:44.375974+0000","last_undegraded":"2024-08-19T00:39:44.375974+0000","last_fullsized":"2024-08-19T00:39:44.375974+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.138503+0000","last_change":"2024-08-19T00:39:45.312271+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.138503+0000","last_undegraded":"2024-08-19T00:39:36.138503+0000","last_fullsized":"2024-08-19T00:39:36.138503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371086+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:44.371086+0000","last_peered":"2024-08-19T00:39:44.371086+0000","last_clean":"2024-08-19T00:39:44.371086+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:44.371086+0000","last_undegraded":"2024-08-19T00:39:44.371086+0000","last_fullsized":"2024-08-19T00:39:44.371086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134299+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:37.134299+0000","last_peered":"2024-08-19T00:39:37.134299+0000","last_clean":"2024-08-19T00:39:37.134299+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:37.134299+0000","last_undegraded":"2024-08-19T00:39:37.134299+0000","last_fullsized":"2024-08-19T00:39:37.134299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371153+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:44.371153+0000","last_peered":"2024-08-19T00:39:44.371153+0000","last_clean":"2024-08-19T00:39:44.371153+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:44.371153+0000","last_undegraded":"2024-08-19T00:39:44.371153+0000","last_fullsized":"2024-08-19T00:39:44.371153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370964+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:44.370964+0000","last_peered":"2024-08-19T00:39:44.370964+0000","last_clean":"2024-08-19T00:39:44.370964+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:44.370964+0000","last_undegraded":"2024-08-19T00:39:44.370964+0000","last_fullsized":"2024-08-19T00:39:44.370964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368766+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:44.368766+0000","last_peered":"2024-08-19T00:39:44.368766+0000","last_clean":"2024-08-19T00:39:44.368766+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:44.368766+0000","last_undegraded":"2024-08-19T00:39:44.368766+0000","last_fullsized":"2024-08-19T00:39:44.368766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133710+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:37.133710+0000","last_peered":"2024-08-19T00:39:37.133710+0000","last_clean":"2024-08-19T00:39:37.133710+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:37.133710+0000","last_undegraded":"2024-08-19T00:39:37.133710+0000","last_fullsized":"2024-08-19T00:39:37.133710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162424+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:37.162424+0000","last_peered":"2024-08-19T00:39:37.162424+0000","last_clean":"2024-08-19T00:39:37.162424+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:37.162424+0000","last_undegraded":"2024-08-19T00:39:37.162424+0000","last_fullsized":"2024-08-19T00:39:37.162424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375562+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:44.375562+0000","last_peered":"2024-08-19T00:39:44.375562+0000","last_clean":"2024-08-19T00:39:44.375562+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:44.375562+0000","last_undegraded":"2024-08-19T00:39:44.375562+0000","last_fullsized":"2024-08-19T00:39:44.375562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162288+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:37.162288+0000","last_peered":"2024-08-19T00:39:37.162288+0000","last_clean":"2024-08-19T00:39:37.162288+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:37.162288+0000","last_undegraded":"2024-08-19T00:39:37.162288+0000","last_fullsized":"2024-08-19T00:39:37.162288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373644+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:44.373644+0000","last_peered":"2024-08-19T00:39:44.373644+0000","last_clean":"2024-08-19T00:39:44.373644+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:44.373644+0000","last_undegraded":"2024-08-19T00:39:44.373644+0000","last_fullsized":"2024-08-19T00:39:44.373644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370400+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:44.370400+0000","last_peered":"2024-08-19T00:39:44.370400+0000","last_clean":"2024-08-19T00:39:44.370400+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:44.370400+0000","last_undegraded":"2024-08-19T00:39:44.370400+0000","last_fullsized":"2024-08-19T00:39:44.370400+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694609+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:37.694609+0000","last_peered":"2024-08-19T00:39:37.694609+0000","last_clean":"2024-08-19T00:39:37.694609+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:37.694609+0000","last_undegraded":"2024-08-19T00:39:37.694609+0000","last_fullsized":"2024-08-19T00:39:37.694609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694988+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:37.694988+0000","last_peered":"2024-08-19T00:39:37.694988+0000","last_clean":"2024-08-19T00:39:37.694988+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:37.694988+0000","last_undegraded":"2024-08-19T00:39:37.694988+0000","last_fullsized":"2024-08-19T00:39:37.694988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374150+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:44.374150+0000","last_peered":"2024-08-19T00:39:44.374150+0000","last_clean":"2024-08-19T00:39:44.374150+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:44.374150+0000","last_undegraded":"2024-08-19T00:39:44.374150+0000","last_fullsized":"2024-08-19T00:39:44.374150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162623+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:37.162623+0000","last_peered":"2024-08-19T00:39:37.162623+0000","last_clean":"2024-08-19T00:39:37.162623+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:37.162623+0000","last_undegraded":"2024-08-19T00:39:37.162623+0000","last_fullsized":"2024-08-19T00:39:37.162623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133915+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:37.133915+0000","last_peered":"2024-08-19T00:39:37.133915+0000","last_clean":"2024-08-19T00:39:37.133915+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:37.133915+0000","last_undegraded":"2024-08-19T00:39:37.133915+0000","last_fullsized":"2024-08-19T00:39:37.133915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134374+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:37.134374+0000","last_peered":"2024-08-19T00:39:37.134374+0000","last_clean":"2024-08-19T00:39:37.134374+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:37.134374+0000","last_undegraded":"2024-08-19T00:39:37.134374+0000","last_fullsized":"2024-08-19T00:39:37.134374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368946+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:44.368946+0000","last_peered":"2024-08-19T00:39:44.368946+0000","last_clean":"2024-08-19T00:39:44.368946+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:44.368946+0000","last_undegraded":"2024-08-19T00:39:44.368946+0000","last_fullsized":"2024-08-19T00:39:44.368946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368847+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:44.368847+0000","last_peered":"2024-08-19T00:39:44.368847+0000","last_clean":"2024-08-19T00:39:44.368847+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:44.368847+0000","last_undegraded":"2024-08-19T00:39:44.368847+0000","last_fullsized":"2024-08-19T00:39:44.368847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694922+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:37.694922+0000","last_peered":"2024-08-19T00:39:37.694922+0000","last_clean":"2024-08-19T00:39:37.694922+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:37.694922+0000","last_undegraded":"2024-08-19T00:39:37.694922+0000","last_fullsized":"2024-08-19T00:39:37.694922+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373707+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:44.373707+0000","last_peered":"2024-08-19T00:39:44.373707+0000","last_clean":"2024-08-19T00:39:44.373707+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:44.373707+0000","last_undegraded":"2024-08-19T00:39:44.373707+0000","last_fullsized":"2024-08-19T00:39:44.373707+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134099+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:37.134099+0000","last_peered":"2024-08-19T00:39:37.134099+0000","last_clean":"2024-08-19T00:39:37.134099+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:37.134099+0000","last_undegraded":"2024-08-19T00:39:37.134099+0000","last_fullsized":"2024-08-19T00:39:37.134099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162429+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:37.162429+0000","last_peered":"2024-08-19T00:39:37.162429+0000","last_clean":"2024-08-19T00:39:37.162429+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:37.162429+0000","last_undegraded":"2024-08-19T00:39:37.162429+0000","last_fullsized":"2024-08-19T00:39:37.162429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368410+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:44.368410+0000","last_peered":"2024-08-19T00:39:44.368410+0000","last_clean":"2024-08-19T00:39:44.368410+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:44.368410+0000","last_undegraded":"2024-08-19T00:39:44.368410+0000","last_fullsized":"2024-08-19T00:39:44.368410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372689+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:44.372689+0000","last_peered":"2024-08-19T00:39:44.372689+0000","last_clean":"2024-08-19T00:39:44.372689+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:44.372689+0000","last_undegraded":"2024-08-19T00:39:44.372689+0000","last_fullsized":"2024-08-19T00:39:44.372689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368530+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:44.368530+0000","last_peered":"2024-08-19T00:39:44.368530+0000","last_clean":"2024-08-19T00:39:44.368530+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:44.368530+0000","last_undegraded":"2024-08-19T00:39:44.368530+0000","last_fullsized":"2024-08-19T00:39:44.368530+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368467+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:44.368467+0000","last_peered":"2024-08-19T00:39:44.368467+0000","last_clean":"2024-08-19T00:39:44.368467+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:44.368467+0000","last_undegraded":"2024-08-19T00:39:44.368467+0000","last_fullsized":"2024-08-19T00:39:44.368467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":24,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368365+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:44.368365+0000","last_peered":"2024-08-19T00:39:44.368365+0000","last_clean":"2024-08-19T00:39:44.368365+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:44.368365+0000","last_undegraded":"2024-08-19T00:39:44.368365+0000","last_fullsized":"2024-08-19T00:39:44.368365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162769+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:37.162769+0000","last_peered":"2024-08-19T00:39:37.162769+0000","last_clean":"2024-08-19T00:39:37.162769+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.162769+0000","last_undegraded":"2024-08-19T00:39:37.162769+0000","last_fullsized":"2024-08-19T00:39:37.162769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162717+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:37.162717+0000","last_peered":"2024-08-19T00:39:37.162717+0000","last_clean":"2024-08-19T00:39:37.162717+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:37.162717+0000","last_undegraded":"2024-08-19T00:39:37.162717+0000","last_fullsized":"2024-08-19T00:39:37.162717+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134321+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:37.134321+0000","last_peered":"2024-08-19T00:39:37.134321+0000","last_clean":"2024-08-19T00:39:37.134321+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:37.134321+0000","last_undegraded":"2024-08-19T00:39:37.134321+0000","last_fullsized":"2024-08-19T00:39:37.134321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370669+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:44.370669+0000","last_peered":"2024-08-19T00:39:44.370669+0000","last_clean":"2024-08-19T00:39:44.370669+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:44.370669+0000","last_undegraded":"2024-08-19T00:39:44.370669+0000","last_fullsized":"2024-08-19T00:39:44.370669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162693+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:37.162693+0000","last_peered":"2024-08-19T00:39:37.162693+0000","last_clean":"2024-08-19T00:39:37.162693+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:37.162693+0000","last_undegraded":"2024-08-19T00:39:37.162693+0000","last_fullsized":"2024-08-19T00:39:37.162693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368842+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:44.368842+0000","last_peered":"2024-08-19T00:39:44.368842+0000","last_clean":"2024-08-19T00:39:44.368842+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:44.368842+0000","last_undegraded":"2024-08-19T00:39:44.368842+0000","last_fullsized":"2024-08-19T00:39:44.368842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134432+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:37.134432+0000","last_peered":"2024-08-19T00:39:37.134432+0000","last_clean":"2024-08-19T00:39:37.134432+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:37.134432+0000","last_undegraded":"2024-08-19T00:39:37.134432+0000","last_fullsized":"2024-08-19T00:39:37.134432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373783+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:44.373783+0000","last_peered":"2024-08-19T00:39:44.373783+0000","last_clean":"2024-08-19T00:39:44.373783+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:44.373783+0000","last_undegraded":"2024-08-19T00:39:44.373783+0000","last_fullsized":"2024-08-19T00:39:44.373783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375635+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:44.375635+0000","last_peered":"2024-08-19T00:39:44.375635+0000","last_clean":"2024-08-19T00:39:44.375635+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:44.375635+0000","last_undegraded":"2024-08-19T00:39:44.375635+0000","last_fullsized":"2024-08-19T00:39:44.375635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134154+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:37.134154+0000","last_peered":"2024-08-19T00:39:37.134154+0000","last_clean":"2024-08-19T00:39:37.134154+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:37.134154+0000","last_undegraded":"2024-08-19T00:39:37.134154+0000","last_fullsized":"2024-08-19T00:39:37.134154+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133819+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:37.133819+0000","last_peered":"2024-08-19T00:39:37.133819+0000","last_clean":"2024-08-19T00:39:37.133819+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:37.133819+0000","last_undegraded":"2024-08-19T00:39:37.133819+0000","last_fullsized":"2024-08-19T00:39:37.133819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133681+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:37.133681+0000","last_peered":"2024-08-19T00:39:37.133681+0000","last_clean":"2024-08-19T00:39:37.133681+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:37.133681+0000","last_undegraded":"2024-08-19T00:39:37.133681+0000","last_fullsized":"2024-08-19T00:39:37.133681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372791+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:44.372791+0000","last_peered":"2024-08-19T00:39:44.372791+0000","last_clean":"2024-08-19T00:39:44.372791+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:44.372791+0000","last_undegraded":"2024-08-19T00:39:44.372791+0000","last_fullsized":"2024-08-19T00:39:44.372791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162876+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:37.162876+0000","last_peered":"2024-08-19T00:39:37.162876+0000","last_clean":"2024-08-19T00:39:37.162876+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:37.162876+0000","last_undegraded":"2024-08-19T00:39:37.162876+0000","last_fullsized":"2024-08-19T00:39:37.162876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371223+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:44.371223+0000","last_peered":"2024-08-19T00:39:44.371223+0000","last_clean":"2024-08-19T00:39:44.371223+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:44.371223+0000","last_undegraded":"2024-08-19T00:39:44.371223+0000","last_fullsized":"2024-08-19T00:39:44.371223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162863+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:37.162863+0000","last_peered":"2024-08-19T00:39:37.162863+0000","last_clean":"2024-08-19T00:39:37.162863+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:37.162863+0000","last_undegraded":"2024-08-19T00:39:37.162863+0000","last_fullsized":"2024-08-19T00:39:37.162863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371495+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:44.371495+0000","last_peered":"2024-08-19T00:39:44.371495+0000","last_clean":"2024-08-19T00:39:44.371495+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:44.371495+0000","last_undegraded":"2024-08-19T00:39:44.371495+0000","last_fullsized":"2024-08-19T00:39:44.371495+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371427+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:44.371427+0000","last_peered":"2024-08-19T00:39:44.371427+0000","last_clean":"2024-08-19T00:39:44.371427+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:44.371427+0000","last_undegraded":"2024-08-19T00:39:44.371427+0000","last_fullsized":"2024-08-19T00:39:44.371427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374080+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:44.374080+0000","last_peered":"2024-08-19T00:39:44.374080+0000","last_clean":"2024-08-19T00:39:44.374080+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:44.374080+0000","last_undegraded":"2024-08-19T00:39:44.374080+0000","last_fullsized":"2024-08-19T00:39:44.374080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134080+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:37.134080+0000","last_peered":"2024-08-19T00:39:37.134080+0000","last_clean":"2024-08-19T00:39:37.134080+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:37.134080+0000","last_undegraded":"2024-08-19T00:39:37.134080+0000","last_fullsized":"2024-08-19T00:39:37.134080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162526+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:37.162526+0000","last_peered":"2024-08-19T00:39:37.162526+0000","last_clean":"2024-08-19T00:39:37.162526+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:37.162526+0000","last_undegraded":"2024-08-19T00:39:37.162526+0000","last_fullsized":"2024-08-19T00:39:37.162526+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370907+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:44.370907+0000","last_peered":"2024-08-19T00:39:44.370907+0000","last_clean":"2024-08-19T00:39:44.370907+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:44.370907+0000","last_undegraded":"2024-08-19T00:39:44.370907+0000","last_fullsized":"2024-08-19T00:39:44.370907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370826+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:44.370826+0000","last_peered":"2024-08-19T00:39:44.370826+0000","last_clean":"2024-08-19T00:39:44.370826+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:44.370826+0000","last_undegraded":"2024-08-19T00:39:44.370826+0000","last_fullsized":"2024-08-19T00:39:44.370826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694933+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:37.694933+0000","last_peered":"2024-08-19T00:39:37.694933+0000","last_clean":"2024-08-19T00:39:37.694933+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:37.694933+0000","last_undegraded":"2024-08-19T00:39:37.694933+0000","last_fullsized":"2024-08-19T00:39:37.694933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162321+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:37.162321+0000","last_peered":"2024-08-19T00:39:37.162321+0000","last_clean":"2024-08-19T00:39:37.162321+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:37.162321+0000","last_undegraded":"2024-08-19T00:39:37.162321+0000","last_fullsized":"2024-08-19T00:39:37.162321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133674+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:37.133674+0000","last_peered":"2024-08-19T00:39:37.133674+0000","last_clean":"2024-08-19T00:39:37.133674+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:37.133674+0000","last_undegraded":"2024-08-19T00:39:37.133674+0000","last_fullsized":"2024-08-19T00:39:37.133674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370521+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:44.370521+0000","last_peered":"2024-08-19T00:39:44.370521+0000","last_clean":"2024-08-19T00:39:44.370521+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:44.370521+0000","last_undegraded":"2024-08-19T00:39:44.370521+0000","last_fullsized":"2024-08-19T00:39:44.370521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370949+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:44.370949+0000","last_peered":"2024-08-19T00:39:44.370949+0000","last_clean":"2024-08-19T00:39:44.370949+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:44.370949+0000","last_undegraded":"2024-08-19T00:39:44.370949+0000","last_fullsized":"2024-08-19T00:39:44.370949+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133877+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:37.133877+0000","last_peered":"2024-08-19T00:39:37.133877+0000","last_clean":"2024-08-19T00:39:37.133877+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:37.133877+0000","last_undegraded":"2024-08-19T00:39:37.133877+0000","last_fullsized":"2024-08-19T00:39:37.133877+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133936+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:37.133936+0000","last_peered":"2024-08-19T00:39:37.133936+0000","last_clean":"2024-08-19T00:39:37.133936+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:37.133936+0000","last_undegraded":"2024-08-19T00:39:37.133936+0000","last_fullsized":"2024-08-19T00:39:37.133936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694635+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:37.694635+0000","last_peered":"2024-08-19T00:39:37.694635+0000","last_clean":"2024-08-19T00:39:37.694635+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:37.694635+0000","last_undegraded":"2024-08-19T00:39:37.694635+0000","last_fullsized":"2024-08-19T00:39:37.694635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373042+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:44.373042+0000","last_peered":"2024-08-19T00:39:44.373042+0000","last_clean":"2024-08-19T00:39:44.373042+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:44.373042+0000","last_undegraded":"2024-08-19T00:39:44.373042+0000","last_fullsized":"2024-08-19T00:39:44.373042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":290825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":290755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":875110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":291349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":290823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":286480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":881683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":286320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:45.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:45.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.672+0000 7fedc3000640 1 Processor -- start 2024-08-19T00:39:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.672+0000 7fedc3000640 1 -- start start 2024-08-19T00:39:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc3000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc3000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fedbc0b3750 0x7fedbc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc3000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedbc0cdfb0 con 0x7fedbc0d03c0 2024-08-19T00:39:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc3000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fedbc0cebc0 con 0x7fedbc0b3750 2024-08-19T00:39:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc3000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc0ce290 con 0x7fedbc06e710 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc1000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fedbc0b3750 0x7fedbc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedb3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc1000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fedbc0b3750 0x7fedbc0cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:39622/0 (socket says 172.21.15.7:39622) 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedc1000640 1 -- 172.21.15.7:0/3269339928 learned_addr learned my addr 172.21.15.7:0/3269339928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.673+0000 7fedbbe00640 1 --1- 172.21.15.7:0/3269339928 >> v1:172.21.15.162:6789/0 conn(0x7fedbc0d03c0 0x7fedbc0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:57318/0 (socket says 172.21.15.7:57318) 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.674+0000 7fedc1000640 1 -- 172.21.15.7:0/3269339928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 msgr2=0x7fedbc071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.674+0000 7fedc1000640 1 --2- 172.21.15.7:0/3269339928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.674+0000 7fedc1000640 1 -- 172.21.15.7:0/3269339928 >> v1:172.21.15.162:6789/0 conn(0x7fedbc0d03c0 legacy=0x7fedbc0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.674+0000 7fedc1000640 1 -- 172.21.15.7:0/3269339928 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc0ce570 con 0x7fedbc0b3750 2024-08-19T00:39:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.674+0000 7fedbb400640 1 -- 172.21.15.7:0/3269339928 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051899690 0 0) 0x7fedbc0cdfb0 con 0x7fedbc0d03c0 2024-08-19T00:39:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.675+0000 7fedc1000640 1 --2- 172.21.15.7:0/3269339928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0b3750 0x7fedbc0cf050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009e50 tx=0x7fedb402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28be4e95a939e4ce server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.675+0000 7fedbb400640 1 -- 172.21.15.7:0/3269339928 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4036070 con 0x7fedbc0b3750 2024-08-19T00:39:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.675+0000 7fedbb400640 1 -- 172.21.15.7:0/3269339928 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb4031600 con 0x7fedbc0b3750 2024-08-19T00:39:45.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.675+0000 7fedbb400640 1 -- 172.21.15.7:0/3269339928 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40319d0 con 0x7fedbc0b3750 2024-08-19T00:39:45.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 -- 172.21.15.7:0/3269339928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0b3750 msgr2=0x7fedbc0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 --2- 172.21.15.7:0/3269339928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0b3750 0x7fedbc0cf050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009e50 tx=0x7fedb402a710 comp rx=0 tx=0).stop 2024-08-19T00:39:45.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 -- 172.21.15.7:0/3269339928 shutdown_connections 2024-08-19T00:39:45.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 --2- 172.21.15.7:0/3269339928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 --2- 172.21.15.7:0/3269339928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0b3750 0x7fedbc0cf050 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 -- 172.21.15.7:0/3269339928 >> 172.21.15.7:0/3269339928 conn(0x7fedbc06bc70 msgr2=0x7fedbc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 -- 172.21.15.7:0/3269339928 shutdown_connections 2024-08-19T00:39:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.676+0000 7fedc3000640 1 -- 172.21.15.7:0/3269339928 wait complete. 2024-08-19T00:39:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.678+0000 7fedc3000640 1 Processor -- start 2024-08-19T00:39:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.678+0000 7fedc3000640 1 -- start start 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedc3000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc09dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedc3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedbc0b3750 0x7fedbc166190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedc3000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0d03c0 0x7fedbc15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedc3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc073c60 con 0x7fedbc0b3750 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedc3000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc073ae0 con 0x7fedbc0d03c0 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedc3000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc0b3be0 con 0x7fedbc06e710 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedbc0b3750 0x7fedbc166190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedbc0b3750 0x7fedbc166190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39516/0 (socket says 172.21.15.7:39516) 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedb3e00640 1 -- 172.21.15.7:0/3423653438 learned_addr learned my addr 172.21.15.7:0/3423653438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedbbe00640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc09dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.679+0000 7fedc1000640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0d03c0 0x7fedbc15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb3e00640 1 -- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 msgr2=0x7fedbc09dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb3e00640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc09dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb3e00640 1 -- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0d03c0 msgr2=0x7fedbc15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb3e00640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0d03c0 0x7fedbc15a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb3e00640 1 -- 172.21.15.7:0/3423653438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc166be0 con 0x7fedbc0b3750 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb3e00640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedbc0b3750 0x7fedbc166190 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feda400e870 tx=0x7feda400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb8c00640 1 -- 172.21.15.7:0/3423653438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4017070 con 0x7fedbc0b3750 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb8c00640 1 -- 172.21.15.7:0/3423653438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda400c940 con 0x7fedbc0b3750 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedb8c00640 1 -- 172.21.15.7:0/3423653438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda400cd30 con 0x7fedbc0b3750 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc166ec0 con 0x7fedbc0b3750 2024-08-19T00:39:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.680+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc167480 con 0x7fedbc0b3750 2024-08-19T00:39:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.681+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedbc072b00 con 0x7fedbc0b3750 2024-08-19T00:39:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.682+0000 7fedb8c00640 1 -- 172.21.15.7:0/3423653438 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feda401a070 con 0x7fedbc0b3750 2024-08-19T00:39:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.683+0000 7fedb8c00640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed9806be30 0x7fed9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.683+0000 7fedb8c00640 1 -- 172.21.15.7:0/3423653438 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7feda408ac10 con 0x7fedbc0b3750 2024-08-19T00:39:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.683+0000 7fedbbe00640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed9806be30 0x7fed9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.684+0000 7fedbbe00640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed9806be30 0x7fed9806e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fedac000f60 tx=0x7fedac007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:45.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.688+0000 7fedb8c00640 1 -- 172.21.15.7:0/3423653438 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feda4058fc0 con 0x7fedbc0b3750 2024-08-19T00:39:45.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.870+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedbc0b2700 con 0x7fed9806be30 2024-08-19T00:39:45.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.876+0000 7fedb8c00640 1 -- 172.21.15.7:0/3423653438 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251717 (secure 0 0 0) 0x7fedbc0b2700 con 0x7fed9806be30 2024-08-19T00:39:45.881 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:45.882 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:45.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed9806be30 msgr2=0x7fed9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed9806be30 0x7fed9806e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fedac000f60 tx=0x7fedac007d50 comp rx=0 tx=0).stop 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedbc0b3750 msgr2=0x7fedbc166190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedbc0b3750 0x7fedbc166190 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feda400e870 tx=0x7feda400ed30 comp rx=0 tx=0).stop 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 shutdown_connections 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed9806be30 0x7fed9806e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedbc0d03c0 0x7fedbc15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedbc0b3750 0x7fedbc166190 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 --2- 172.21.15.7:0/3423653438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fedbc06e710 0x7fedbc09dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 >> 172.21.15.7:0/3423653438 conn(0x7fedbc06bc70 msgr2=0x7fedbc0ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 shutdown_connections 2024-08-19T00:39:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:45.880+0000 7fedc3000640 1 -- 172.21.15.7:0/3423653438 wait complete. 2024-08-19T00:39:45.898 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-08-19T00:39:45.372919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243600,"kb_used_data":6628,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731120,"statfs":{"total":773094113280,"available":772844666880,"internally_reserved":0,"allocated":6787072,"data_stored":3493345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.082689"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371678+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:44.371678+0000","last_peered":"2024-08-19T00:39:44.371678+0000","last_clean":"2024-08-19T00:39:44.371678+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:44.371678+0000","last_undegraded":"2024-08-19T00:39:44.371678+0000","last_fullsized":"2024-08-19T00:39:44.371678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370966+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:44.370966+0000","last_peered":"2024-08-19T00:39:44.370966+0000","last_clean":"2024-08-19T00:39:44.370966+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:44.370966+0000","last_undegraded":"2024-08-19T00:39:44.370966+0000","last_fullsized":"2024-08-19T00:39:44.370966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162625+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:37.162625+0000","last_peered":"2024-08-19T00:39:37.162625+0000","last_clean":"2024-08-19T00:39:37.162625+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:37.162625+0000","last_undegraded":"2024-08-19T00:39:37.162625+0000","last_fullsized":"2024-08-19T00:39:37.162625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368733+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:44.368733+0000","last_peered":"2024-08-19T00:39:44.368733+0000","last_clean":"2024-08-19T00:39:44.368733+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:44.368733+0000","last_undegraded":"2024-08-19T00:39:44.368733+0000","last_fullsized":"2024-08-19T00:39:44.368733+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.135051+0000","last_change":"2024-08-19T00:39:45.312229+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.135051+0000","last_undegraded":"2024-08-19T00:39:36.135051+0000","last_fullsized":"2024-08-19T00:39:36.135051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370452+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:44.370452+0000","last_peered":"2024-08-19T00:39:44.370452+0000","last_clean":"2024-08-19T00:39:44.370452+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:44.370452+0000","last_undegraded":"2024-08-19T00:39:44.370452+0000","last_fullsized":"2024-08-19T00:39:44.370452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368316+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:44.368316+0000","last_peered":"2024-08-19T00:39:44.368316+0000","last_clean":"2024-08-19T00:39:44.368316+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:44.368316+0000","last_undegraded":"2024-08-19T00:39:44.368316+0000","last_fullsized":"2024-08-19T00:39:44.368316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133661+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:37.133661+0000","last_peered":"2024-08-19T00:39:37.133661+0000","last_clean":"2024-08-19T00:39:37.133661+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:37.133661+0000","last_undegraded":"2024-08-19T00:39:37.133661+0000","last_fullsized":"2024-08-19T00:39:37.133661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373880+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:44.373880+0000","last_peered":"2024-08-19T00:39:44.373880+0000","last_clean":"2024-08-19T00:39:44.373880+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:44.373880+0000","last_undegraded":"2024-08-19T00:39:44.373880+0000","last_fullsized":"2024-08-19T00:39:44.373880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371386+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:44.371386+0000","last_peered":"2024-08-19T00:39:44.371386+0000","last_clean":"2024-08-19T00:39:44.371386+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:44.371386+0000","last_undegraded":"2024-08-19T00:39:44.371386+0000","last_fullsized":"2024-08-19T00:39:44.371386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375631+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:44.375631+0000","last_peered":"2024-08-19T00:39:44.375631+0000","last_clean":"2024-08-19T00:39:44.375631+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:44.375631+0000","last_undegraded":"2024-08-19T00:39:44.375631+0000","last_fullsized":"2024-08-19T00:39:44.375631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373889+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:44.373889+0000","last_peered":"2024-08-19T00:39:44.373889+0000","last_clean":"2024-08-19T00:39:44.373889+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:44.373889+0000","last_undegraded":"2024-08-19T00:39:44.373889+0000","last_fullsized":"2024-08-19T00:39:44.373889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694729+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:37.694729+0000","last_peered":"2024-08-19T00:39:37.694729+0000","last_clean":"2024-08-19T00:39:37.694729+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:37.694729+0000","last_undegraded":"2024-08-19T00:39:37.694729+0000","last_fullsized":"2024-08-19T00:39:37.694729+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162300+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:37.162300+0000","last_peered":"2024-08-19T00:39:37.162300+0000","last_clean":"2024-08-19T00:39:37.162300+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:37.162300+0000","last_undegraded":"2024-08-19T00:39:37.162300+0000","last_fullsized":"2024-08-19T00:39:37.162300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694701+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:37.694701+0000","last_peered":"2024-08-19T00:39:37.694701+0000","last_clean":"2024-08-19T00:39:37.694701+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:37.694701+0000","last_undegraded":"2024-08-19T00:39:37.694701+0000","last_fullsized":"2024-08-19T00:39:37.694701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370368+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:44.370368+0000","last_peered":"2024-08-19T00:39:44.370368+0000","last_clean":"2024-08-19T00:39:44.370368+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:44.370368+0000","last_undegraded":"2024-08-19T00:39:44.370368+0000","last_fullsized":"2024-08-19T00:39:44.370368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371676+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:44.371676+0000","last_peered":"2024-08-19T00:39:44.371676+0000","last_clean":"2024-08-19T00:39:44.371676+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:44.371676+0000","last_undegraded":"2024-08-19T00:39:44.371676+0000","last_fullsized":"2024-08-19T00:39:44.371676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162713+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:37.162713+0000","last_peered":"2024-08-19T00:39:37.162713+0000","last_clean":"2024-08-19T00:39:37.162713+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:37.162713+0000","last_undegraded":"2024-08-19T00:39:37.162713+0000","last_fullsized":"2024-08-19T00:39:37.162713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370911+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:44.370911+0000","last_peered":"2024-08-19T00:39:44.370911+0000","last_clean":"2024-08-19T00:39:44.370911+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:44.370911+0000","last_undegraded":"2024-08-19T00:39:44.370911+0000","last_fullsized":"2024-08-19T00:39:44.370911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375576+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:44.375576+0000","last_peered":"2024-08-19T00:39:44.375576+0000","last_clean":"2024-08-19T00:39:44.375576+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:44.375576+0000","last_undegraded":"2024-08-19T00:39:44.375576+0000","last_fullsized":"2024-08-19T00:39:44.375576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694706+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:37.694706+0000","last_peered":"2024-08-19T00:39:37.694706+0000","last_clean":"2024-08-19T00:39:37.694706+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:37.694706+0000","last_undegraded":"2024-08-19T00:39:37.694706+0000","last_fullsized":"2024-08-19T00:39:37.694706+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375622+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:44.375622+0000","last_peered":"2024-08-19T00:39:44.375622+0000","last_clean":"2024-08-19T00:39:44.375622+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:44.375622+0000","last_undegraded":"2024-08-19T00:39:44.375622+0000","last_fullsized":"2024-08-19T00:39:44.375622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368371+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:44.368371+0000","last_peered":"2024-08-19T00:39:44.368371+0000","last_clean":"2024-08-19T00:39:44.368371+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:44.368371+0000","last_undegraded":"2024-08-19T00:39:44.368371+0000","last_fullsized":"2024-08-19T00:39:44.368371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372557+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:44.372557+0000","last_peered":"2024-08-19T00:39:44.372557+0000","last_clean":"2024-08-19T00:39:44.372557+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:44.372557+0000","last_undegraded":"2024-08-19T00:39:44.372557+0000","last_fullsized":"2024-08-19T00:39:44.372557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370827+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:44.370827+0000","last_peered":"2024-08-19T00:39:44.370827+0000","last_clean":"2024-08-19T00:39:44.370827+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:44.370827+0000","last_undegraded":"2024-08-19T00:39:44.370827+0000","last_fullsized":"2024-08-19T00:39:44.370827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694991+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:37.694991+0000","last_peered":"2024-08-19T00:39:37.694991+0000","last_clean":"2024-08-19T00:39:37.694991+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:37.694991+0000","last_undegraded":"2024-08-19T00:39:37.694991+0000","last_fullsized":"2024-08-19T00:39:37.694991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371103+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:44.371103+0000","last_peered":"2024-08-19T00:39:44.371103+0000","last_clean":"2024-08-19T00:39:44.371103+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:44.371103+0000","last_undegraded":"2024-08-19T00:39:44.371103+0000","last_fullsized":"2024-08-19T00:39:44.371103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134136+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:37.134136+0000","last_peered":"2024-08-19T00:39:37.134136+0000","last_clean":"2024-08-19T00:39:37.134136+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:37.134136+0000","last_undegraded":"2024-08-19T00:39:37.134136+0000","last_fullsized":"2024-08-19T00:39:37.134136+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133991+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:37.133991+0000","last_peered":"2024-08-19T00:39:37.133991+0000","last_clean":"2024-08-19T00:39:37.133991+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.133991+0000","last_undegraded":"2024-08-19T00:39:37.133991+0000","last_fullsized":"2024-08-19T00:39:37.133991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368366+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:44.368366+0000","last_peered":"2024-08-19T00:39:44.368366+0000","last_clean":"2024-08-19T00:39:44.368366+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:44.368366+0000","last_undegraded":"2024-08-19T00:39:44.368366+0000","last_fullsized":"2024-08-19T00:39:44.368366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370803+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:44.370803+0000","last_peered":"2024-08-19T00:39:44.370803+0000","last_clean":"2024-08-19T00:39:44.370803+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:44.370803+0000","last_undegraded":"2024-08-19T00:39:44.370803+0000","last_fullsized":"2024-08-19T00:39:44.370803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375350+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:44.375350+0000","last_peered":"2024-08-19T00:39:44.375350+0000","last_clean":"2024-08-19T00:39:44.375350+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:44.375350+0000","last_undegraded":"2024-08-19T00:39:44.375350+0000","last_fullsized":"2024-08-19T00:39:44.375350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371472+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:44.371472+0000","last_peered":"2024-08-19T00:39:44.371472+0000","last_clean":"2024-08-19T00:39:44.371472+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:44.371472+0000","last_undegraded":"2024-08-19T00:39:44.371472+0000","last_fullsized":"2024-08-19T00:39:44.371472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375974+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:44.375974+0000","last_peered":"2024-08-19T00:39:44.375974+0000","last_clean":"2024-08-19T00:39:44.375974+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:44.375974+0000","last_undegraded":"2024-08-19T00:39:44.375974+0000","last_fullsized":"2024-08-19T00:39:44.375974+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.138503+0000","last_change":"2024-08-19T00:39:45.312271+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.138503+0000","last_undegraded":"2024-08-19T00:39:36.138503+0000","last_fullsized":"2024-08-19T00:39:36.138503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371086+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:44.371086+0000","last_peered":"2024-08-19T00:39:44.371086+0000","last_clean":"2024-08-19T00:39:44.371086+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:44.371086+0000","last_undegraded":"2024-08-19T00:39:44.371086+0000","last_fullsized":"2024-08-19T00:39:44.371086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134299+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:37.134299+0000","last_peered":"2024-08-19T00:39:37.134299+0000","last_clean":"2024-08-19T00:39:37.134299+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:37.134299+0000","last_undegraded":"2024-08-19T00:39:37.134299+0000","last_fullsized":"2024-08-19T00:39:37.134299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371153+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:44.371153+0000","last_peered":"2024-08-19T00:39:44.371153+0000","last_clean":"2024-08-19T00:39:44.371153+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:44.371153+0000","last_undegraded":"2024-08-19T00:39:44.371153+0000","last_fullsized":"2024-08-19T00:39:44.371153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370964+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:44.370964+0000","last_peered":"2024-08-19T00:39:44.370964+0000","last_clean":"2024-08-19T00:39:44.370964+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:44.370964+0000","last_undegraded":"2024-08-19T00:39:44.370964+0000","last_fullsized":"2024-08-19T00:39:44.370964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368766+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:44.368766+0000","last_peered":"2024-08-19T00:39:44.368766+0000","last_clean":"2024-08-19T00:39:44.368766+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:44.368766+0000","last_undegraded":"2024-08-19T00:39:44.368766+0000","last_fullsized":"2024-08-19T00:39:44.368766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133710+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:37.133710+0000","last_peered":"2024-08-19T00:39:37.133710+0000","last_clean":"2024-08-19T00:39:37.133710+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:37.133710+0000","last_undegraded":"2024-08-19T00:39:37.133710+0000","last_fullsized":"2024-08-19T00:39:37.133710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162424+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:37.162424+0000","last_peered":"2024-08-19T00:39:37.162424+0000","last_clean":"2024-08-19T00:39:37.162424+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:37.162424+0000","last_undegraded":"2024-08-19T00:39:37.162424+0000","last_fullsized":"2024-08-19T00:39:37.162424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375562+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:44.375562+0000","last_peered":"2024-08-19T00:39:44.375562+0000","last_clean":"2024-08-19T00:39:44.375562+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:44.375562+0000","last_undegraded":"2024-08-19T00:39:44.375562+0000","last_fullsized":"2024-08-19T00:39:44.375562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162288+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:37.162288+0000","last_peered":"2024-08-19T00:39:37.162288+0000","last_clean":"2024-08-19T00:39:37.162288+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:37.162288+0000","last_undegraded":"2024-08-19T00:39:37.162288+0000","last_fullsized":"2024-08-19T00:39:37.162288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373644+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:44.373644+0000","last_peered":"2024-08-19T00:39:44.373644+0000","last_clean":"2024-08-19T00:39:44.373644+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:44.373644+0000","last_undegraded":"2024-08-19T00:39:44.373644+0000","last_fullsized":"2024-08-19T00:39:44.373644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370400+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:44.370400+0000","last_peered":"2024-08-19T00:39:44.370400+0000","last_clean":"2024-08-19T00:39:44.370400+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:44.370400+0000","last_undegraded":"2024-08-19T00:39:44.370400+0000","last_fullsized":"2024-08-19T00:39:44.370400+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694609+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:37.694609+0000","last_peered":"2024-08-19T00:39:37.694609+0000","last_clean":"2024-08-19T00:39:37.694609+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:37.694609+0000","last_undegraded":"2024-08-19T00:39:37.694609+0000","last_fullsized":"2024-08-19T00:39:37.694609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694988+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:37.694988+0000","last_peered":"2024-08-19T00:39:37.694988+0000","last_clean":"2024-08-19T00:39:37.694988+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:37.694988+0000","last_undegraded":"2024-08-19T00:39:37.694988+0000","last_fullsized":"2024-08-19T00:39:37.694988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374150+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:44.374150+0000","last_peered":"2024-08-19T00:39:44.374150+0000","last_clean":"2024-08-19T00:39:44.374150+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:44.374150+0000","last_undegraded":"2024-08-19T00:39:44.374150+0000","last_fullsized":"2024-08-19T00:39:44.374150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162623+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:37.162623+0000","last_peered":"2024-08-19T00:39:37.162623+0000","last_clean":"2024-08-19T00:39:37.162623+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:37.162623+0000","last_undegraded":"2024-08-19T00:39:37.162623+0000","last_fullsized":"2024-08-19T00:39:37.162623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133915+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:37.133915+0000","last_peered":"2024-08-19T00:39:37.133915+0000","last_clean":"2024-08-19T00:39:37.133915+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:37.133915+0000","last_undegraded":"2024-08-19T00:39:37.133915+0000","last_fullsized":"2024-08-19T00:39:37.133915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134374+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:37.134374+0000","last_peered":"2024-08-19T00:39:37.134374+0000","last_clean":"2024-08-19T00:39:37.134374+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:37.134374+0000","last_undegraded":"2024-08-19T00:39:37.134374+0000","last_fullsized":"2024-08-19T00:39:37.134374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368946+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:44.368946+0000","last_peered":"2024-08-19T00:39:44.368946+0000","last_clean":"2024-08-19T00:39:44.368946+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:44.368946+0000","last_undegraded":"2024-08-19T00:39:44.368946+0000","last_fullsized":"2024-08-19T00:39:44.368946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368847+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:44.368847+0000","last_peered":"2024-08-19T00:39:44.368847+0000","last_clean":"2024-08-19T00:39:44.368847+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:44.368847+0000","last_undegraded":"2024-08-19T00:39:44.368847+0000","last_fullsized":"2024-08-19T00:39:44.368847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694922+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:37.694922+0000","last_peered":"2024-08-19T00:39:37.694922+0000","last_clean":"2024-08-19T00:39:37.694922+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:37.694922+0000","last_undegraded":"2024-08-19T00:39:37.694922+0000","last_fullsized":"2024-08-19T00:39:37.694922+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373707+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:44.373707+0000","last_peered":"2024-08-19T00:39:44.373707+0000","last_clean":"2024-08-19T00:39:44.373707+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:44.373707+0000","last_undegraded":"2024-08-19T00:39:44.373707+0000","last_fullsized":"2024-08-19T00:39:44.373707+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134099+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:37.134099+0000","last_peered":"2024-08-19T00:39:37.134099+0000","last_clean":"2024-08-19T00:39:37.134099+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:37.134099+0000","last_undegraded":"2024-08-19T00:39:37.134099+0000","last_fullsized":"2024-08-19T00:39:37.134099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162429+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:37.162429+0000","last_peered":"2024-08-19T00:39:37.162429+0000","last_clean":"2024-08-19T00:39:37.162429+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:37.162429+0000","last_undegraded":"2024-08-19T00:39:37.162429+0000","last_fullsized":"2024-08-19T00:39:37.162429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368410+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:44.368410+0000","last_peered":"2024-08-19T00:39:44.368410+0000","last_clean":"2024-08-19T00:39:44.368410+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:44.368410+0000","last_undegraded":"2024-08-19T00:39:44.368410+0000","last_fullsized":"2024-08-19T00:39:44.368410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372689+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:44.372689+0000","last_peered":"2024-08-19T00:39:44.372689+0000","last_clean":"2024-08-19T00:39:44.372689+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:44.372689+0000","last_undegraded":"2024-08-19T00:39:44.372689+0000","last_fullsized":"2024-08-19T00:39:44.372689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368530+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:44.368530+0000","last_peered":"2024-08-19T00:39:44.368530+0000","last_clean":"2024-08-19T00:39:44.368530+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:44.368530+0000","last_undegraded":"2024-08-19T00:39:44.368530+0000","last_fullsized":"2024-08-19T00:39:44.368530+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368467+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:44.368467+0000","last_peered":"2024-08-19T00:39:44.368467+0000","last_clean":"2024-08-19T00:39:44.368467+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:44.368467+0000","last_undegraded":"2024-08-19T00:39:44.368467+0000","last_fullsized":"2024-08-19T00:39:44.368467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":24,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368365+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:44.368365+0000","last_peered":"2024-08-19T00:39:44.368365+0000","last_clean":"2024-08-19T00:39:44.368365+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:44.368365+0000","last_undegraded":"2024-08-19T00:39:44.368365+0000","last_fullsized":"2024-08-19T00:39:44.368365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162769+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:37.162769+0000","last_peered":"2024-08-19T00:39:37.162769+0000","last_clean":"2024-08-19T00:39:37.162769+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.162769+0000","last_undegraded":"2024-08-19T00:39:37.162769+0000","last_fullsized":"2024-08-19T00:39:37.162769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162717+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:37.162717+0000","last_peered":"2024-08-19T00:39:37.162717+0000","last_clean":"2024-08-19T00:39:37.162717+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:37.162717+0000","last_undegraded":"2024-08-19T00:39:37.162717+0000","last_fullsized":"2024-08-19T00:39:37.162717+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134321+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:37.134321+0000","last_peered":"2024-08-19T00:39:37.134321+0000","last_clean":"2024-08-19T00:39:37.134321+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:37.134321+0000","last_undegraded":"2024-08-19T00:39:37.134321+0000","last_fullsized":"2024-08-19T00:39:37.134321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370669+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:44.370669+0000","last_peered":"2024-08-19T00:39:44.370669+0000","last_clean":"2024-08-19T00:39:44.370669+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:44.370669+0000","last_undegraded":"2024-08-19T00:39:44.370669+0000","last_fullsized":"2024-08-19T00:39:44.370669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162693+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:37.162693+0000","last_peered":"2024-08-19T00:39:37.162693+0000","last_clean":"2024-08-19T00:39:37.162693+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:37.162693+0000","last_undegraded":"2024-08-19T00:39:37.162693+0000","last_fullsized":"2024-08-19T00:39:37.162693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368842+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:44.368842+0000","last_peered":"2024-08-19T00:39:44.368842+0000","last_clean":"2024-08-19T00:39:44.368842+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:44.368842+0000","last_undegraded":"2024-08-19T00:39:44.368842+0000","last_fullsized":"2024-08-19T00:39:44.368842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134432+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:37.134432+0000","last_peered":"2024-08-19T00:39:37.134432+0000","last_clean":"2024-08-19T00:39:37.134432+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:37.134432+0000","last_undegraded":"2024-08-19T00:39:37.134432+0000","last_fullsized":"2024-08-19T00:39:37.134432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373783+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:44.373783+0000","last_peered":"2024-08-19T00:39:44.373783+0000","last_clean":"2024-08-19T00:39:44.373783+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:44.373783+0000","last_undegraded":"2024-08-19T00:39:44.373783+0000","last_fullsized":"2024-08-19T00:39:44.373783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375635+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:44.375635+0000","last_peered":"2024-08-19T00:39:44.375635+0000","last_clean":"2024-08-19T00:39:44.375635+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:44.375635+0000","last_undegraded":"2024-08-19T00:39:44.375635+0000","last_fullsized":"2024-08-19T00:39:44.375635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134154+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:37.134154+0000","last_peered":"2024-08-19T00:39:37.134154+0000","last_clean":"2024-08-19T00:39:37.134154+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:37.134154+0000","last_undegraded":"2024-08-19T00:39:37.134154+0000","last_fullsized":"2024-08-19T00:39:37.134154+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133819+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:37.133819+0000","last_peered":"2024-08-19T00:39:37.133819+0000","last_clean":"2024-08-19T00:39:37.133819+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:37.133819+0000","last_undegraded":"2024-08-19T00:39:37.133819+0000","last_fullsized":"2024-08-19T00:39:37.133819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133681+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:37.133681+0000","last_peered":"2024-08-19T00:39:37.133681+0000","last_clean":"2024-08-19T00:39:37.133681+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:37.133681+0000","last_undegraded":"2024-08-19T00:39:37.133681+0000","last_fullsized":"2024-08-19T00:39:37.133681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372791+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:44.372791+0000","last_peered":"2024-08-19T00:39:44.372791+0000","last_clean":"2024-08-19T00:39:44.372791+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:44.372791+0000","last_undegraded":"2024-08-19T00:39:44.372791+0000","last_fullsized":"2024-08-19T00:39:44.372791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162876+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:37.162876+0000","last_peered":"2024-08-19T00:39:37.162876+0000","last_clean":"2024-08-19T00:39:37.162876+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:37.162876+0000","last_undegraded":"2024-08-19T00:39:37.162876+0000","last_fullsized":"2024-08-19T00:39:37.162876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371223+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:44.371223+0000","last_peered":"2024-08-19T00:39:44.371223+0000","last_clean":"2024-08-19T00:39:44.371223+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:44.371223+0000","last_undegraded":"2024-08-19T00:39:44.371223+0000","last_fullsized":"2024-08-19T00:39:44.371223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162863+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:37.162863+0000","last_peered":"2024-08-19T00:39:37.162863+0000","last_clean":"2024-08-19T00:39:37.162863+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:37.162863+0000","last_undegraded":"2024-08-19T00:39:37.162863+0000","last_fullsized":"2024-08-19T00:39:37.162863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371495+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:44.371495+0000","last_peered":"2024-08-19T00:39:44.371495+0000","last_clean":"2024-08-19T00:39:44.371495+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:44.371495+0000","last_undegraded":"2024-08-19T00:39:44.371495+0000","last_fullsized":"2024-08-19T00:39:44.371495+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371427+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:44.371427+0000","last_peered":"2024-08-19T00:39:44.371427+0000","last_clean":"2024-08-19T00:39:44.371427+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:44.371427+0000","last_undegraded":"2024-08-19T00:39:44.371427+0000","last_fullsized":"2024-08-19T00:39:44.371427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374080+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:44.374080+0000","last_peered":"2024-08-19T00:39:44.374080+0000","last_clean":"2024-08-19T00:39:44.374080+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:44.374080+0000","last_undegraded":"2024-08-19T00:39:44.374080+0000","last_fullsized":"2024-08-19T00:39:44.374080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134080+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:37.134080+0000","last_peered":"2024-08-19T00:39:37.134080+0000","last_clean":"2024-08-19T00:39:37.134080+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:37.134080+0000","last_undegraded":"2024-08-19T00:39:37.134080+0000","last_fullsized":"2024-08-19T00:39:37.134080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162526+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:37.162526+0000","last_peered":"2024-08-19T00:39:37.162526+0000","last_clean":"2024-08-19T00:39:37.162526+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:37.162526+0000","last_undegraded":"2024-08-19T00:39:37.162526+0000","last_fullsized":"2024-08-19T00:39:37.162526+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370907+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:44.370907+0000","last_peered":"2024-08-19T00:39:44.370907+0000","last_clean":"2024-08-19T00:39:44.370907+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:44.370907+0000","last_undegraded":"2024-08-19T00:39:44.370907+0000","last_fullsized":"2024-08-19T00:39:44.370907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370826+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:44.370826+0000","last_peered":"2024-08-19T00:39:44.370826+0000","last_clean":"2024-08-19T00:39:44.370826+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:44.370826+0000","last_undegraded":"2024-08-19T00:39:44.370826+0000","last_fullsized":"2024-08-19T00:39:44.370826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694933+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:37.694933+0000","last_peered":"2024-08-19T00:39:37.694933+0000","last_clean":"2024-08-19T00:39:37.694933+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:37.694933+0000","last_undegraded":"2024-08-19T00:39:37.694933+0000","last_fullsized":"2024-08-19T00:39:37.694933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162321+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:37.162321+0000","last_peered":"2024-08-19T00:39:37.162321+0000","last_clean":"2024-08-19T00:39:37.162321+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:37.162321+0000","last_undegraded":"2024-08-19T00:39:37.162321+0000","last_fullsized":"2024-08-19T00:39:37.162321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133674+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:37.133674+0000","last_peered":"2024-08-19T00:39:37.133674+0000","last_clean":"2024-08-19T00:39:37.133674+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:37.133674+0000","last_undegraded":"2024-08-19T00:39:37.133674+0000","last_fullsized":"2024-08-19T00:39:37.133674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370521+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:44.370521+0000","last_peered":"2024-08-19T00:39:44.370521+0000","last_clean":"2024-08-19T00:39:44.370521+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:44.370521+0000","last_undegraded":"2024-08-19T00:39:44.370521+0000","last_fullsized":"2024-08-19T00:39:44.370521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370949+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:44.370949+0000","last_peered":"2024-08-19T00:39:44.370949+0000","last_clean":"2024-08-19T00:39:44.370949+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:44.370949+0000","last_undegraded":"2024-08-19T00:39:44.370949+0000","last_fullsized":"2024-08-19T00:39:44.370949+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133877+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:37.133877+0000","last_peered":"2024-08-19T00:39:37.133877+0000","last_clean":"2024-08-19T00:39:37.133877+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:37.133877+0000","last_undegraded":"2024-08-19T00:39:37.133877+0000","last_fullsized":"2024-08-19T00:39:37.133877+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133936+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:37.133936+0000","last_peered":"2024-08-19T00:39:37.133936+0000","last_clean":"2024-08-19T00:39:37.133936+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:37.133936+0000","last_undegraded":"2024-08-19T00:39:37.133936+0000","last_fullsized":"2024-08-19T00:39:37.133936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694635+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:37.694635+0000","last_peered":"2024-08-19T00:39:37.694635+0000","last_clean":"2024-08-19T00:39:37.694635+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:37.694635+0000","last_undegraded":"2024-08-19T00:39:37.694635+0000","last_fullsized":"2024-08-19T00:39:37.694635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373042+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:44.373042+0000","last_peered":"2024-08-19T00:39:44.373042+0000","last_clean":"2024-08-19T00:39:44.373042+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:44.373042+0000","last_undegraded":"2024-08-19T00:39:44.373042+0000","last_fullsized":"2024-08-19T00:39:44.373042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":290825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":290755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":875110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":291349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":290823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":286480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":881683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":286320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:45.952 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-08-19T00:39:45.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 58, 'state': 'peering', 'last_fresh': '2024-08-19T00:39:36.135051+0000', 'last_change': '2024-08-19T00:39:45.312229+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:36.135051+0000', 'last_undegraded': '2024-08-19T00:39:36.135051+0000', 'last_fullsized': '2024-08-19T00:39:36.135051+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 56, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:45.952 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-08-19T00:39:45.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 58, 'state': 'peering', 'last_fresh': '2024-08-19T00:39:36.138503+0000', 'last_change': '2024-08-19T00:39:45.312271+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:36.138503+0000', 'last_undegraded': '2024-08-19T00:39:36.138503+0000', 'last_fullsized': '2024-08-19T00:39:36.138503+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 56, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:45.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.107+0000 7f8337e00640 1 Processor -- start 2024-08-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.107+0000 7f8337e00640 1 -- start start 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8337e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f833815e360 0x7f833815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8337e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f833815ee50 0x7f83380d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8337e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83380b3ab0 con 0x7f83380d2af0 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8337e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f833815f460 con 0x7f833815e360 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8337e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f833815f740 con 0x7f833815ee50 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8336a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f833815e360 0x7f833815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8336000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f83380d2af0 0x7f833815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55578/0 (socket says 172.21.15.7:55578) 2024-08-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.108+0000 7f8336000640 1 -- 172.21.15.7:0/4096150976 learned_addr learned my addr 172.21.15.7:0/4096150976 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.109+0000 7f8337400640 1 --2- 172.21.15.7:0/4096150976 >> v2:172.21.15.162:3300/0 conn(0x7f833815ee50 0x7f83380d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.109+0000 7f8336a00640 1 -- 172.21.15.7:0/4096150976 >> v2:172.21.15.162:3300/0 conn(0x7f833815ee50 msgr2=0x7f83380d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.109+0000 7f8336a00640 1 --2- 172.21.15.7:0/4096150976 >> v2:172.21.15.162:3300/0 conn(0x7f833815ee50 0x7f83380d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.109+0000 7f8336a00640 1 -- 172.21.15.7:0/4096150976 >> v1:172.21.15.7:6789/0 conn(0x7f83380d2af0 legacy=0x7f833815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.109+0000 7f8336a00640 1 -- 172.21.15.7:0/4096150976 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83380b3d60 con 0x7f833815e360 2024-08-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.109+0000 7f8335600640 1 -- 172.21.15.7:0/4096150976 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296517711 0 0) 0x7f83380b3ab0 con 0x7f83380d2af0 2024-08-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.110+0000 7f8336a00640 1 --2- 172.21.15.7:0/4096150976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f833815fab0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f83380d1c20 tx=0x7f832802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af44b54bd2a50cf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.110+0000 7f8335600640 1 -- 172.21.15.7:0/4096150976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328037070 con 0x7f833815e360 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.110+0000 7f8335600640 1 -- 172.21.15.7:0/4096150976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8328032440 con 0x7f833815e360 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.110+0000 7f8335600640 1 -- 172.21.15.7:0/4096150976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328032810 con 0x7f833815e360 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 -- 172.21.15.7:0/4096150976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 msgr2=0x7f833815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 --2- 172.21.15.7:0/4096150976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f833815fab0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f83380d1c20 tx=0x7f832802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 -- 172.21.15.7:0/4096150976 shutdown_connections 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 --2- 172.21.15.7:0/4096150976 >> v2:172.21.15.162:3300/0 conn(0x7f833815ee50 0x7f83380d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 --2- 172.21.15.7:0/4096150976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f833815fab0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 -- 172.21.15.7:0/4096150976 >> 172.21.15.7:0/4096150976 conn(0x7f833808dbf0 msgr2=0x7f833809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 -- 172.21.15.7:0/4096150976 shutdown_connections 2024-08-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.111+0000 7f8337e00640 1 -- 172.21.15.7:0/4096150976 wait complete. 2024-08-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.112+0000 7f8337e00640 1 Processor -- start 2024-08-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.112+0000 7f8337e00640 1 -- start start 2024-08-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.113+0000 7f8337e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380d2af0 0x7f8338156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.113+0000 7f8337e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f83380d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.113+0000 7f8337e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f833815ee50 0x7f83380d0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.113+0000 7f8337e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83380b4560 con 0x7f833815e360 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.113+0000 7f8337e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f83380d2300 con 0x7f83380d2af0 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.113+0000 7f8337e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f83380b46e0 con 0x7f833815ee50 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f83380d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f83380d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39538/0 (socket says 172.21.15.7:39538) 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 -- 172.21.15.7:0/2056341292 learned_addr learned my addr 172.21.15.7:0/2056341292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336a00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380d2af0 0x7f8338156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8337400640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f833815ee50 0x7f83380d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 -- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f833815ee50 msgr2=0x7f83380d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f833815ee50 0x7f83380d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 -- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380d2af0 msgr2=0x7f8338156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380d2af0 0x7f8338156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 -- 172.21.15.7:0/2056341292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83380b7530 con 0x7f833815e360 2024-08-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.114+0000 7f8336000640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f83380d0050 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f832400c4d0 tx=0x7f832400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.115+0000 7f832ea00640 1 -- 172.21.15.7:0/2056341292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324018070 con 0x7f833815e360 2024-08-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.115+0000 7f832ea00640 1 -- 172.21.15.7:0/2056341292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324007500 con 0x7f833815e360 2024-08-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.115+0000 7f832ea00640 1 -- 172.21.15.7:0/2056341292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324004a20 con 0x7f833815e360 2024-08-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.115+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83380b7810 con 0x7f833815e360 2024-08-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.115+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83380b7dd0 con 0x7f833815e360 2024-08-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.116+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83380d50d0 con 0x7f833815e360 2024-08-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.117+0000 7f832ea00640 1 -- 172.21.15.7:0/2056341292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8324004bc0 con 0x7f833815e360 2024-08-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.117+0000 7f832ea00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f831806be30 0x7f831806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.118+0000 7f832ea00640 1 -- 172.21.15.7:0/2056341292 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f832408a160 con 0x7f833815e360 2024-08-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.118+0000 7f8336a00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f831806be30 0x7f831806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.118+0000 7f8336a00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f831806be30 0x7f831806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8328034000 tx=0x7f832802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.122+0000 7f832ea00640 1 -- 172.21.15.7:0/2056341292 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f83240583e0 con 0x7f833815e360 2024-08-19T00:39:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.373+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f83380d4080 con 0x7f833815e360 2024-08-19T00:39:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.375+0000 7f832ea00640 1 -- 172.21.15.7:0/2056341292 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1474 (secure 0 0 0) 0x7f832405c6e0 con 0x7f833815e360 2024-08-19T00:39:46.377 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:46.377 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1724027810,"num_in_osds":8,"osd_in_since":1724027801,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":249397248,"bytes_avail":772844716032,"bytes_total":773094113280,"write_bytes_sec":1756,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":46,"btime":"2024-08-19T00:39:39:157035+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5757}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-08-19T00:39:23.288192+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-19T00:39:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f831806be30 msgr2=0x7f831806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f831806be30 0x7f831806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8328034000 tx=0x7f832802e000 comp rx=0 tx=0).stop 2024-08-19T00:39:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 msgr2=0x7f83380d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f83380d0050 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f832400c4d0 tx=0x7f832400c990 comp rx=0 tx=0).stop 2024-08-19T00:39:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 shutdown_connections 2024-08-19T00:39:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f831806be30 0x7f831806e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f833815ee50 0x7f83380d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833815e360 0x7f83380d0050 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 --2- 172.21.15.7:0/2056341292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380d2af0 0x7f8338156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 >> 172.21.15.7:0/2056341292 conn(0x7f833808dbf0 msgr2=0x7f83381626e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 shutdown_connections 2024-08-19T00:39:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.378+0000 7f8337e00640 1 -- 172.21.15.7:0/2056341292 wait complete. 2024-08-19T00:39:46.395 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-19T00:39:46.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:46.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.551+0000 7facade00640 1 Processor -- start 2024-08-19T00:39:46.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.551+0000 7facade00640 1 -- start start 2024-08-19T00:39:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.552+0000 7facade00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faca809b730 0x7faca806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.552+0000 7facade00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca80d0290 0x7faca80d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.552+0000 7facade00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca815ec30 con 0x7faca809aa70 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.552+0000 7facade00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7faca815ef10 con 0x7faca809b730 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.552+0000 7facade00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faca815f1f0 con 0x7faca80d0290 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.552+0000 7faca6000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faca809b730 0x7faca806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.553+0000 7faca6000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faca809b730 0x7faca806fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39544/0 (socket says 172.21.15.7:39544) 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.553+0000 7faca6000640 1 -- 172.21.15.7:0/4036914202 learned_addr learned my addr 172.21.15.7:0/4036914202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.553+0000 7faca7400640 1 --2- 172.21.15.7:0/4036914202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca80d0290 0x7faca80d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.553+0000 7faca6000640 1 -- 172.21.15.7:0/4036914202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca80d0290 msgr2=0x7faca80d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.553+0000 7faca6000640 1 --2- 172.21.15.7:0/4036914202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca80d0290 0x7faca80d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.553+0000 7faca6000640 1 -- 172.21.15.7:0/4036914202 >> v1:172.21.15.162:6789/0 conn(0x7faca809aa70 legacy=0x7faca809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.553+0000 7faca6000640 1 -- 172.21.15.7:0/4036914202 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca815f4d0 con 0x7faca809b730 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.554+0000 7faca6000640 1 --2- 172.21.15.7:0/4036914202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca806fc30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fac94009870 tx=0x7fac9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1a40bf2cba807a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.554+0000 7faca5600640 1 -- 172.21.15.7:0/4036914202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94037070 con 0x7faca809b730 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.554+0000 7faca5600640 1 -- 172.21.15.7:0/4036914202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac94032440 con 0x7faca809b730 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.554+0000 7faca5600640 1 -- 172.21.15.7:0/4036914202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94032810 con 0x7faca809b730 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 -- 172.21.15.7:0/4036914202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 msgr2=0x7faca806fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 --2- 172.21.15.7:0/4036914202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca806fc30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fac94009870 tx=0x7fac9402a270 comp rx=0 tx=0).stop 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 -- 172.21.15.7:0/4036914202 shutdown_connections 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 --2- 172.21.15.7:0/4036914202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca80d0290 0x7faca80d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 --2- 172.21.15.7:0/4036914202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca806fc30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 -- 172.21.15.7:0/4036914202 >> 172.21.15.7:0/4036914202 conn(0x7faca80d2190 msgr2=0x7faca80d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 -- 172.21.15.7:0/4036914202 shutdown_connections 2024-08-19T00:39:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.555+0000 7facade00640 1 -- 172.21.15.7:0/4036914202 wait complete. 2024-08-19T00:39:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.557+0000 7facade00640 1 Processor -- start 2024-08-19T00:39:46.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.557+0000 7facade00640 1 -- start start 2024-08-19T00:39:46.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7facade00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca809aa70 0x7faca80ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7facade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7facade00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca80d0290 0x7faca80b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7facade00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faca80d0c60 con 0x7faca809b730 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7facade00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faca815e8f0 con 0x7faca80d0290 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7facade00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faca80d0de0 con 0x7faca809aa70 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7faca6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7faca6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca815a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39560/0 (socket says 172.21.15.7:39560) 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7faca6000640 1 -- 172.21.15.7:0/448075875 learned_addr learned my addr 172.21.15.7:0/448075875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7faca7400640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca80d0290 0x7faca80b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.558+0000 7faca6a00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca809aa70 0x7faca80ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7faca6000640 1 -- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca809aa70 msgr2=0x7faca80ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7faca6000640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca809aa70 0x7faca80ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7faca6000640 1 -- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca80d0290 msgr2=0x7faca80b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7faca6000640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca80d0290 0x7faca80b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7faca6000640 1 -- 172.21.15.7:0/448075875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca80b5580 con 0x7faca809b730 2024-08-19T00:39:46.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7faca6a00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca809aa70 0x7faca80ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:46.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7faca6000640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca815a6b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fac94000c00 tx=0x7fac940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7fac9f400640 1 -- 172.21.15.7:0/448075875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94037040 con 0x7faca809b730 2024-08-19T00:39:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7fac9f400640 1 -- 172.21.15.7:0/448075875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac940304c0 con 0x7faca809b730 2024-08-19T00:39:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7facade00640 1 -- 172.21.15.7:0/448075875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca80ce9b0 con 0x7faca809b730 2024-08-19T00:39:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7fac9f400640 1 -- 172.21.15.7:0/448075875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac940308b0 con 0x7faca809b730 2024-08-19T00:39:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.559+0000 7facade00640 1 -- 172.21.15.7:0/448075875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca80cd6b0 con 0x7faca809b730 2024-08-19T00:39:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.561+0000 7facade00640 1 -- 172.21.15.7:0/448075875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca80cc4c0 con 0x7faca809b730 2024-08-19T00:39:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.561+0000 7fac9f400640 1 -- 172.21.15.7:0/448075875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac94044020 con 0x7faca809b730 2024-08-19T00:39:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.562+0000 7fac9f400640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8806be60 0x7fac8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.562+0000 7fac9f400640 1 -- 172.21.15.7:0/448075875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7fac940aafa0 con 0x7faca809b730 2024-08-19T00:39:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.563+0000 7faca6a00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8806be60 0x7fac8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:46.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.563+0000 7faca6a00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8806be60 0x7fac8806e320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faca80b3ca0 tx=0x7fac98009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.566+0000 7fac9f400640 1 -- 172.21.15.7:0/448075875 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faca80cc4c0 con 0x7faca809b730 2024-08-19T00:39:46.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.747+0000 7facade00640 1 -- 172.21.15.7:0/448075875 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faca806fc30 con 0x7fac8806be60 2024-08-19T00:39:46.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.753+0000 7fac9f400640 1 -- 172.21.15.7:0/448075875 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251717 (secure 0 0 0) 0x7faca806fc30 con 0x7fac8806be60 2024-08-19T00:39:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 -- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8806be60 msgr2=0x7fac8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8806be60 0x7fac8806e320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faca80b3ca0 tx=0x7fac98009040 comp rx=0 tx=0).stop 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 -- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 msgr2=0x7faca815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca815a6b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fac94000c00 tx=0x7fac940046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 -- 172.21.15.7:0/448075875 shutdown_connections 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8806be60 0x7fac8806e320 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca80d0290 0x7faca80b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faca809b730 0x7faca815a6b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 --2- 172.21.15.7:0/448075875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faca809aa70 0x7faca80ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 -- 172.21.15.7:0/448075875 >> 172.21.15.7:0/448075875 conn(0x7faca80d2190 msgr2=0x7faca815b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 -- 172.21.15.7:0/448075875 shutdown_connections 2024-08-19T00:39:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:46.757+0000 7facade00640 1 -- 172.21.15.7:0/448075875 wait complete. 2024-08-19T00:39:46.775 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-08-19T00:39:45.372919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243600,"kb_used_data":6628,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731120,"statfs":{"total":773094113280,"available":772844666880,"internally_reserved":0,"allocated":6787072,"data_stored":3493345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.082689"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371678+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:44.371678+0000","last_peered":"2024-08-19T00:39:44.371678+0000","last_clean":"2024-08-19T00:39:44.371678+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:44.371678+0000","last_undegraded":"2024-08-19T00:39:44.371678+0000","last_fullsized":"2024-08-19T00:39:44.371678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370966+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:44.370966+0000","last_peered":"2024-08-19T00:39:44.370966+0000","last_clean":"2024-08-19T00:39:44.370966+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:44.370966+0000","last_undegraded":"2024-08-19T00:39:44.370966+0000","last_fullsized":"2024-08-19T00:39:44.370966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162625+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:37.162625+0000","last_peered":"2024-08-19T00:39:37.162625+0000","last_clean":"2024-08-19T00:39:37.162625+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:37.162625+0000","last_undegraded":"2024-08-19T00:39:37.162625+0000","last_fullsized":"2024-08-19T00:39:37.162625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368733+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:44.368733+0000","last_peered":"2024-08-19T00:39:44.368733+0000","last_clean":"2024-08-19T00:39:44.368733+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:44.368733+0000","last_undegraded":"2024-08-19T00:39:44.368733+0000","last_fullsized":"2024-08-19T00:39:44.368733+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.135051+0000","last_change":"2024-08-19T00:39:45.312229+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.135051+0000","last_undegraded":"2024-08-19T00:39:36.135051+0000","last_fullsized":"2024-08-19T00:39:36.135051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370452+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:44.370452+0000","last_peered":"2024-08-19T00:39:44.370452+0000","last_clean":"2024-08-19T00:39:44.370452+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:44.370452+0000","last_undegraded":"2024-08-19T00:39:44.370452+0000","last_fullsized":"2024-08-19T00:39:44.370452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368316+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:44.368316+0000","last_peered":"2024-08-19T00:39:44.368316+0000","last_clean":"2024-08-19T00:39:44.368316+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:44.368316+0000","last_undegraded":"2024-08-19T00:39:44.368316+0000","last_fullsized":"2024-08-19T00:39:44.368316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133661+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:37.133661+0000","last_peered":"2024-08-19T00:39:37.133661+0000","last_clean":"2024-08-19T00:39:37.133661+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:37.133661+0000","last_undegraded":"2024-08-19T00:39:37.133661+0000","last_fullsized":"2024-08-19T00:39:37.133661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373880+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:44.373880+0000","last_peered":"2024-08-19T00:39:44.373880+0000","last_clean":"2024-08-19T00:39:44.373880+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:44.373880+0000","last_undegraded":"2024-08-19T00:39:44.373880+0000","last_fullsized":"2024-08-19T00:39:44.373880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371386+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:44.371386+0000","last_peered":"2024-08-19T00:39:44.371386+0000","last_clean":"2024-08-19T00:39:44.371386+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:44.371386+0000","last_undegraded":"2024-08-19T00:39:44.371386+0000","last_fullsized":"2024-08-19T00:39:44.371386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375631+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:44.375631+0000","last_peered":"2024-08-19T00:39:44.375631+0000","last_clean":"2024-08-19T00:39:44.375631+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:44.375631+0000","last_undegraded":"2024-08-19T00:39:44.375631+0000","last_fullsized":"2024-08-19T00:39:44.375631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373889+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:44.373889+0000","last_peered":"2024-08-19T00:39:44.373889+0000","last_clean":"2024-08-19T00:39:44.373889+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:44.373889+0000","last_undegraded":"2024-08-19T00:39:44.373889+0000","last_fullsized":"2024-08-19T00:39:44.373889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694729+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:37.694729+0000","last_peered":"2024-08-19T00:39:37.694729+0000","last_clean":"2024-08-19T00:39:37.694729+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:37.694729+0000","last_undegraded":"2024-08-19T00:39:37.694729+0000","last_fullsized":"2024-08-19T00:39:37.694729+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162300+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:37.162300+0000","last_peered":"2024-08-19T00:39:37.162300+0000","last_clean":"2024-08-19T00:39:37.162300+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:37.162300+0000","last_undegraded":"2024-08-19T00:39:37.162300+0000","last_fullsized":"2024-08-19T00:39:37.162300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694701+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:37.694701+0000","last_peered":"2024-08-19T00:39:37.694701+0000","last_clean":"2024-08-19T00:39:37.694701+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:37.694701+0000","last_undegraded":"2024-08-19T00:39:37.694701+0000","last_fullsized":"2024-08-19T00:39:37.694701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370368+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:44.370368+0000","last_peered":"2024-08-19T00:39:44.370368+0000","last_clean":"2024-08-19T00:39:44.370368+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:44.370368+0000","last_undegraded":"2024-08-19T00:39:44.370368+0000","last_fullsized":"2024-08-19T00:39:44.370368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371676+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:44.371676+0000","last_peered":"2024-08-19T00:39:44.371676+0000","last_clean":"2024-08-19T00:39:44.371676+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:44.371676+0000","last_undegraded":"2024-08-19T00:39:44.371676+0000","last_fullsized":"2024-08-19T00:39:44.371676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162713+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:37.162713+0000","last_peered":"2024-08-19T00:39:37.162713+0000","last_clean":"2024-08-19T00:39:37.162713+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:37.162713+0000","last_undegraded":"2024-08-19T00:39:37.162713+0000","last_fullsized":"2024-08-19T00:39:37.162713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370911+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:44.370911+0000","last_peered":"2024-08-19T00:39:44.370911+0000","last_clean":"2024-08-19T00:39:44.370911+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:44.370911+0000","last_undegraded":"2024-08-19T00:39:44.370911+0000","last_fullsized":"2024-08-19T00:39:44.370911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375576+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:44.375576+0000","last_peered":"2024-08-19T00:39:44.375576+0000","last_clean":"2024-08-19T00:39:44.375576+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:44.375576+0000","last_undegraded":"2024-08-19T00:39:44.375576+0000","last_fullsized":"2024-08-19T00:39:44.375576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694706+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:37.694706+0000","last_peered":"2024-08-19T00:39:37.694706+0000","last_clean":"2024-08-19T00:39:37.694706+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:37.694706+0000","last_undegraded":"2024-08-19T00:39:37.694706+0000","last_fullsized":"2024-08-19T00:39:37.694706+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375622+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:44.375622+0000","last_peered":"2024-08-19T00:39:44.375622+0000","last_clean":"2024-08-19T00:39:44.375622+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:44.375622+0000","last_undegraded":"2024-08-19T00:39:44.375622+0000","last_fullsized":"2024-08-19T00:39:44.375622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368371+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:44.368371+0000","last_peered":"2024-08-19T00:39:44.368371+0000","last_clean":"2024-08-19T00:39:44.368371+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:44.368371+0000","last_undegraded":"2024-08-19T00:39:44.368371+0000","last_fullsized":"2024-08-19T00:39:44.368371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372557+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:44.372557+0000","last_peered":"2024-08-19T00:39:44.372557+0000","last_clean":"2024-08-19T00:39:44.372557+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:44.372557+0000","last_undegraded":"2024-08-19T00:39:44.372557+0000","last_fullsized":"2024-08-19T00:39:44.372557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370827+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:44.370827+0000","last_peered":"2024-08-19T00:39:44.370827+0000","last_clean":"2024-08-19T00:39:44.370827+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:44.370827+0000","last_undegraded":"2024-08-19T00:39:44.370827+0000","last_fullsized":"2024-08-19T00:39:44.370827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694991+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:37.694991+0000","last_peered":"2024-08-19T00:39:37.694991+0000","last_clean":"2024-08-19T00:39:37.694991+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:37.694991+0000","last_undegraded":"2024-08-19T00:39:37.694991+0000","last_fullsized":"2024-08-19T00:39:37.694991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371103+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:44.371103+0000","last_peered":"2024-08-19T00:39:44.371103+0000","last_clean":"2024-08-19T00:39:44.371103+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:44.371103+0000","last_undegraded":"2024-08-19T00:39:44.371103+0000","last_fullsized":"2024-08-19T00:39:44.371103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134136+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:37.134136+0000","last_peered":"2024-08-19T00:39:37.134136+0000","last_clean":"2024-08-19T00:39:37.134136+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:37.134136+0000","last_undegraded":"2024-08-19T00:39:37.134136+0000","last_fullsized":"2024-08-19T00:39:37.134136+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133991+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:37.133991+0000","last_peered":"2024-08-19T00:39:37.133991+0000","last_clean":"2024-08-19T00:39:37.133991+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.133991+0000","last_undegraded":"2024-08-19T00:39:37.133991+0000","last_fullsized":"2024-08-19T00:39:37.133991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368366+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:44.368366+0000","last_peered":"2024-08-19T00:39:44.368366+0000","last_clean":"2024-08-19T00:39:44.368366+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:44.368366+0000","last_undegraded":"2024-08-19T00:39:44.368366+0000","last_fullsized":"2024-08-19T00:39:44.368366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370803+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:44.370803+0000","last_peered":"2024-08-19T00:39:44.370803+0000","last_clean":"2024-08-19T00:39:44.370803+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:44.370803+0000","last_undegraded":"2024-08-19T00:39:44.370803+0000","last_fullsized":"2024-08-19T00:39:44.370803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375350+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:44.375350+0000","last_peered":"2024-08-19T00:39:44.375350+0000","last_clean":"2024-08-19T00:39:44.375350+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:44.375350+0000","last_undegraded":"2024-08-19T00:39:44.375350+0000","last_fullsized":"2024-08-19T00:39:44.375350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371472+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:44.371472+0000","last_peered":"2024-08-19T00:39:44.371472+0000","last_clean":"2024-08-19T00:39:44.371472+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:44.371472+0000","last_undegraded":"2024-08-19T00:39:44.371472+0000","last_fullsized":"2024-08-19T00:39:44.371472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375974+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:44.375974+0000","last_peered":"2024-08-19T00:39:44.375974+0000","last_clean":"2024-08-19T00:39:44.375974+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:44.375974+0000","last_undegraded":"2024-08-19T00:39:44.375974+0000","last_fullsized":"2024-08-19T00:39:44.375974+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.138503+0000","last_change":"2024-08-19T00:39:45.312271+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.138503+0000","last_undegraded":"2024-08-19T00:39:36.138503+0000","last_fullsized":"2024-08-19T00:39:36.138503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371086+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:44.371086+0000","last_peered":"2024-08-19T00:39:44.371086+0000","last_clean":"2024-08-19T00:39:44.371086+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:44.371086+0000","last_undegraded":"2024-08-19T00:39:44.371086+0000","last_fullsized":"2024-08-19T00:39:44.371086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134299+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:37.134299+0000","last_peered":"2024-08-19T00:39:37.134299+0000","last_clean":"2024-08-19T00:39:37.134299+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:37.134299+0000","last_undegraded":"2024-08-19T00:39:37.134299+0000","last_fullsized":"2024-08-19T00:39:37.134299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371153+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:44.371153+0000","last_peered":"2024-08-19T00:39:44.371153+0000","last_clean":"2024-08-19T00:39:44.371153+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:44.371153+0000","last_undegraded":"2024-08-19T00:39:44.371153+0000","last_fullsized":"2024-08-19T00:39:44.371153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370964+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:44.370964+0000","last_peered":"2024-08-19T00:39:44.370964+0000","last_clean":"2024-08-19T00:39:44.370964+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:44.370964+0000","last_undegraded":"2024-08-19T00:39:44.370964+0000","last_fullsized":"2024-08-19T00:39:44.370964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368766+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:44.368766+0000","last_peered":"2024-08-19T00:39:44.368766+0000","last_clean":"2024-08-19T00:39:44.368766+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:44.368766+0000","last_undegraded":"2024-08-19T00:39:44.368766+0000","last_fullsized":"2024-08-19T00:39:44.368766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133710+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:37.133710+0000","last_peered":"2024-08-19T00:39:37.133710+0000","last_clean":"2024-08-19T00:39:37.133710+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:37.133710+0000","last_undegraded":"2024-08-19T00:39:37.133710+0000","last_fullsized":"2024-08-19T00:39:37.133710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162424+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:37.162424+0000","last_peered":"2024-08-19T00:39:37.162424+0000","last_clean":"2024-08-19T00:39:37.162424+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:37.162424+0000","last_undegraded":"2024-08-19T00:39:37.162424+0000","last_fullsized":"2024-08-19T00:39:37.162424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375562+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:44.375562+0000","last_peered":"2024-08-19T00:39:44.375562+0000","last_clean":"2024-08-19T00:39:44.375562+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:44.375562+0000","last_undegraded":"2024-08-19T00:39:44.375562+0000","last_fullsized":"2024-08-19T00:39:44.375562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162288+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:37.162288+0000","last_peered":"2024-08-19T00:39:37.162288+0000","last_clean":"2024-08-19T00:39:37.162288+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:37.162288+0000","last_undegraded":"2024-08-19T00:39:37.162288+0000","last_fullsized":"2024-08-19T00:39:37.162288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373644+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:44.373644+0000","last_peered":"2024-08-19T00:39:44.373644+0000","last_clean":"2024-08-19T00:39:44.373644+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:44.373644+0000","last_undegraded":"2024-08-19T00:39:44.373644+0000","last_fullsized":"2024-08-19T00:39:44.373644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370400+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:44.370400+0000","last_peered":"2024-08-19T00:39:44.370400+0000","last_clean":"2024-08-19T00:39:44.370400+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:44.370400+0000","last_undegraded":"2024-08-19T00:39:44.370400+0000","last_fullsized":"2024-08-19T00:39:44.370400+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694609+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:37.694609+0000","last_peered":"2024-08-19T00:39:37.694609+0000","last_clean":"2024-08-19T00:39:37.694609+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:37.694609+0000","last_undegraded":"2024-08-19T00:39:37.694609+0000","last_fullsized":"2024-08-19T00:39:37.694609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694988+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:37.694988+0000","last_peered":"2024-08-19T00:39:37.694988+0000","last_clean":"2024-08-19T00:39:37.694988+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:37.694988+0000","last_undegraded":"2024-08-19T00:39:37.694988+0000","last_fullsized":"2024-08-19T00:39:37.694988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374150+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:44.374150+0000","last_peered":"2024-08-19T00:39:44.374150+0000","last_clean":"2024-08-19T00:39:44.374150+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:44.374150+0000","last_undegraded":"2024-08-19T00:39:44.374150+0000","last_fullsized":"2024-08-19T00:39:44.374150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162623+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:37.162623+0000","last_peered":"2024-08-19T00:39:37.162623+0000","last_clean":"2024-08-19T00:39:37.162623+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:37.162623+0000","last_undegraded":"2024-08-19T00:39:37.162623+0000","last_fullsized":"2024-08-19T00:39:37.162623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133915+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:37.133915+0000","last_peered":"2024-08-19T00:39:37.133915+0000","last_clean":"2024-08-19T00:39:37.133915+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:37.133915+0000","last_undegraded":"2024-08-19T00:39:37.133915+0000","last_fullsized":"2024-08-19T00:39:37.133915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134374+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:37.134374+0000","last_peered":"2024-08-19T00:39:37.134374+0000","last_clean":"2024-08-19T00:39:37.134374+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:37.134374+0000","last_undegraded":"2024-08-19T00:39:37.134374+0000","last_fullsized":"2024-08-19T00:39:37.134374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368946+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:44.368946+0000","last_peered":"2024-08-19T00:39:44.368946+0000","last_clean":"2024-08-19T00:39:44.368946+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:44.368946+0000","last_undegraded":"2024-08-19T00:39:44.368946+0000","last_fullsized":"2024-08-19T00:39:44.368946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368847+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:44.368847+0000","last_peered":"2024-08-19T00:39:44.368847+0000","last_clean":"2024-08-19T00:39:44.368847+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:44.368847+0000","last_undegraded":"2024-08-19T00:39:44.368847+0000","last_fullsized":"2024-08-19T00:39:44.368847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694922+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:37.694922+0000","last_peered":"2024-08-19T00:39:37.694922+0000","last_clean":"2024-08-19T00:39:37.694922+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:37.694922+0000","last_undegraded":"2024-08-19T00:39:37.694922+0000","last_fullsized":"2024-08-19T00:39:37.694922+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373707+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:44.373707+0000","last_peered":"2024-08-19T00:39:44.373707+0000","last_clean":"2024-08-19T00:39:44.373707+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:44.373707+0000","last_undegraded":"2024-08-19T00:39:44.373707+0000","last_fullsized":"2024-08-19T00:39:44.373707+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134099+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:37.134099+0000","last_peered":"2024-08-19T00:39:37.134099+0000","last_clean":"2024-08-19T00:39:37.134099+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:37.134099+0000","last_undegraded":"2024-08-19T00:39:37.134099+0000","last_fullsized":"2024-08-19T00:39:37.134099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162429+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:37.162429+0000","last_peered":"2024-08-19T00:39:37.162429+0000","last_clean":"2024-08-19T00:39:37.162429+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:37.162429+0000","last_undegraded":"2024-08-19T00:39:37.162429+0000","last_fullsized":"2024-08-19T00:39:37.162429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368410+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:44.368410+0000","last_peered":"2024-08-19T00:39:44.368410+0000","last_clean":"2024-08-19T00:39:44.368410+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:44.368410+0000","last_undegraded":"2024-08-19T00:39:44.368410+0000","last_fullsized":"2024-08-19T00:39:44.368410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372689+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:44.372689+0000","last_peered":"2024-08-19T00:39:44.372689+0000","last_clean":"2024-08-19T00:39:44.372689+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:44.372689+0000","last_undegraded":"2024-08-19T00:39:44.372689+0000","last_fullsized":"2024-08-19T00:39:44.372689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368530+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:44.368530+0000","last_peered":"2024-08-19T00:39:44.368530+0000","last_clean":"2024-08-19T00:39:44.368530+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:44.368530+0000","last_undegraded":"2024-08-19T00:39:44.368530+0000","last_fullsized":"2024-08-19T00:39:44.368530+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368467+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:44.368467+0000","last_peered":"2024-08-19T00:39:44.368467+0000","last_clean":"2024-08-19T00:39:44.368467+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:44.368467+0000","last_undegraded":"2024-08-19T00:39:44.368467+0000","last_fullsized":"2024-08-19T00:39:44.368467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":24,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368365+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:44.368365+0000","last_peered":"2024-08-19T00:39:44.368365+0000","last_clean":"2024-08-19T00:39:44.368365+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:44.368365+0000","last_undegraded":"2024-08-19T00:39:44.368365+0000","last_fullsized":"2024-08-19T00:39:44.368365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162769+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:37.162769+0000","last_peered":"2024-08-19T00:39:37.162769+0000","last_clean":"2024-08-19T00:39:37.162769+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.162769+0000","last_undegraded":"2024-08-19T00:39:37.162769+0000","last_fullsized":"2024-08-19T00:39:37.162769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162717+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:37.162717+0000","last_peered":"2024-08-19T00:39:37.162717+0000","last_clean":"2024-08-19T00:39:37.162717+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:37.162717+0000","last_undegraded":"2024-08-19T00:39:37.162717+0000","last_fullsized":"2024-08-19T00:39:37.162717+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134321+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:37.134321+0000","last_peered":"2024-08-19T00:39:37.134321+0000","last_clean":"2024-08-19T00:39:37.134321+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:37.134321+0000","last_undegraded":"2024-08-19T00:39:37.134321+0000","last_fullsized":"2024-08-19T00:39:37.134321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370669+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:44.370669+0000","last_peered":"2024-08-19T00:39:44.370669+0000","last_clean":"2024-08-19T00:39:44.370669+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:44.370669+0000","last_undegraded":"2024-08-19T00:39:44.370669+0000","last_fullsized":"2024-08-19T00:39:44.370669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162693+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:37.162693+0000","last_peered":"2024-08-19T00:39:37.162693+0000","last_clean":"2024-08-19T00:39:37.162693+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:37.162693+0000","last_undegraded":"2024-08-19T00:39:37.162693+0000","last_fullsized":"2024-08-19T00:39:37.162693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368842+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:44.368842+0000","last_peered":"2024-08-19T00:39:44.368842+0000","last_clean":"2024-08-19T00:39:44.368842+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:44.368842+0000","last_undegraded":"2024-08-19T00:39:44.368842+0000","last_fullsized":"2024-08-19T00:39:44.368842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134432+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:37.134432+0000","last_peered":"2024-08-19T00:39:37.134432+0000","last_clean":"2024-08-19T00:39:37.134432+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:37.134432+0000","last_undegraded":"2024-08-19T00:39:37.134432+0000","last_fullsized":"2024-08-19T00:39:37.134432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373783+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:44.373783+0000","last_peered":"2024-08-19T00:39:44.373783+0000","last_clean":"2024-08-19T00:39:44.373783+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:44.373783+0000","last_undegraded":"2024-08-19T00:39:44.373783+0000","last_fullsized":"2024-08-19T00:39:44.373783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375635+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:44.375635+0000","last_peered":"2024-08-19T00:39:44.375635+0000","last_clean":"2024-08-19T00:39:44.375635+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:44.375635+0000","last_undegraded":"2024-08-19T00:39:44.375635+0000","last_fullsized":"2024-08-19T00:39:44.375635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134154+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:37.134154+0000","last_peered":"2024-08-19T00:39:37.134154+0000","last_clean":"2024-08-19T00:39:37.134154+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:37.134154+0000","last_undegraded":"2024-08-19T00:39:37.134154+0000","last_fullsized":"2024-08-19T00:39:37.134154+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133819+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:37.133819+0000","last_peered":"2024-08-19T00:39:37.133819+0000","last_clean":"2024-08-19T00:39:37.133819+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:37.133819+0000","last_undegraded":"2024-08-19T00:39:37.133819+0000","last_fullsized":"2024-08-19T00:39:37.133819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133681+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:37.133681+0000","last_peered":"2024-08-19T00:39:37.133681+0000","last_clean":"2024-08-19T00:39:37.133681+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:37.133681+0000","last_undegraded":"2024-08-19T00:39:37.133681+0000","last_fullsized":"2024-08-19T00:39:37.133681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372791+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:44.372791+0000","last_peered":"2024-08-19T00:39:44.372791+0000","last_clean":"2024-08-19T00:39:44.372791+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:44.372791+0000","last_undegraded":"2024-08-19T00:39:44.372791+0000","last_fullsized":"2024-08-19T00:39:44.372791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162876+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:37.162876+0000","last_peered":"2024-08-19T00:39:37.162876+0000","last_clean":"2024-08-19T00:39:37.162876+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:37.162876+0000","last_undegraded":"2024-08-19T00:39:37.162876+0000","last_fullsized":"2024-08-19T00:39:37.162876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371223+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:44.371223+0000","last_peered":"2024-08-19T00:39:44.371223+0000","last_clean":"2024-08-19T00:39:44.371223+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:44.371223+0000","last_undegraded":"2024-08-19T00:39:44.371223+0000","last_fullsized":"2024-08-19T00:39:44.371223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162863+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:37.162863+0000","last_peered":"2024-08-19T00:39:37.162863+0000","last_clean":"2024-08-19T00:39:37.162863+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:37.162863+0000","last_undegraded":"2024-08-19T00:39:37.162863+0000","last_fullsized":"2024-08-19T00:39:37.162863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371495+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:44.371495+0000","last_peered":"2024-08-19T00:39:44.371495+0000","last_clean":"2024-08-19T00:39:44.371495+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:44.371495+0000","last_undegraded":"2024-08-19T00:39:44.371495+0000","last_fullsized":"2024-08-19T00:39:44.371495+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371427+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:44.371427+0000","last_peered":"2024-08-19T00:39:44.371427+0000","last_clean":"2024-08-19T00:39:44.371427+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:44.371427+0000","last_undegraded":"2024-08-19T00:39:44.371427+0000","last_fullsized":"2024-08-19T00:39:44.371427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374080+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:44.374080+0000","last_peered":"2024-08-19T00:39:44.374080+0000","last_clean":"2024-08-19T00:39:44.374080+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:44.374080+0000","last_undegraded":"2024-08-19T00:39:44.374080+0000","last_fullsized":"2024-08-19T00:39:44.374080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134080+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:37.134080+0000","last_peered":"2024-08-19T00:39:37.134080+0000","last_clean":"2024-08-19T00:39:37.134080+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:37.134080+0000","last_undegraded":"2024-08-19T00:39:37.134080+0000","last_fullsized":"2024-08-19T00:39:37.134080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162526+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:37.162526+0000","last_peered":"2024-08-19T00:39:37.162526+0000","last_clean":"2024-08-19T00:39:37.162526+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:37.162526+0000","last_undegraded":"2024-08-19T00:39:37.162526+0000","last_fullsized":"2024-08-19T00:39:37.162526+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370907+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:44.370907+0000","last_peered":"2024-08-19T00:39:44.370907+0000","last_clean":"2024-08-19T00:39:44.370907+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:44.370907+0000","last_undegraded":"2024-08-19T00:39:44.370907+0000","last_fullsized":"2024-08-19T00:39:44.370907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370826+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:44.370826+0000","last_peered":"2024-08-19T00:39:44.370826+0000","last_clean":"2024-08-19T00:39:44.370826+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:44.370826+0000","last_undegraded":"2024-08-19T00:39:44.370826+0000","last_fullsized":"2024-08-19T00:39:44.370826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694933+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:37.694933+0000","last_peered":"2024-08-19T00:39:37.694933+0000","last_clean":"2024-08-19T00:39:37.694933+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:37.694933+0000","last_undegraded":"2024-08-19T00:39:37.694933+0000","last_fullsized":"2024-08-19T00:39:37.694933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162321+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:37.162321+0000","last_peered":"2024-08-19T00:39:37.162321+0000","last_clean":"2024-08-19T00:39:37.162321+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:37.162321+0000","last_undegraded":"2024-08-19T00:39:37.162321+0000","last_fullsized":"2024-08-19T00:39:37.162321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133674+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:37.133674+0000","last_peered":"2024-08-19T00:39:37.133674+0000","last_clean":"2024-08-19T00:39:37.133674+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:37.133674+0000","last_undegraded":"2024-08-19T00:39:37.133674+0000","last_fullsized":"2024-08-19T00:39:37.133674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370521+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:44.370521+0000","last_peered":"2024-08-19T00:39:44.370521+0000","last_clean":"2024-08-19T00:39:44.370521+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:44.370521+0000","last_undegraded":"2024-08-19T00:39:44.370521+0000","last_fullsized":"2024-08-19T00:39:44.370521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370949+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:44.370949+0000","last_peered":"2024-08-19T00:39:44.370949+0000","last_clean":"2024-08-19T00:39:44.370949+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:44.370949+0000","last_undegraded":"2024-08-19T00:39:44.370949+0000","last_fullsized":"2024-08-19T00:39:44.370949+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133877+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:37.133877+0000","last_peered":"2024-08-19T00:39:37.133877+0000","last_clean":"2024-08-19T00:39:37.133877+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:37.133877+0000","last_undegraded":"2024-08-19T00:39:37.133877+0000","last_fullsized":"2024-08-19T00:39:37.133877+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133936+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:37.133936+0000","last_peered":"2024-08-19T00:39:37.133936+0000","last_clean":"2024-08-19T00:39:37.133936+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:37.133936+0000","last_undegraded":"2024-08-19T00:39:37.133936+0000","last_fullsized":"2024-08-19T00:39:37.133936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694635+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:37.694635+0000","last_peered":"2024-08-19T00:39:37.694635+0000","last_clean":"2024-08-19T00:39:37.694635+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:37.694635+0000","last_undegraded":"2024-08-19T00:39:37.694635+0000","last_fullsized":"2024-08-19T00:39:37.694635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373042+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:44.373042+0000","last_peered":"2024-08-19T00:39:44.373042+0000","last_clean":"2024-08-19T00:39:44.373042+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:44.373042+0000","last_undegraded":"2024-08-19T00:39:44.373042+0000","last_fullsized":"2024-08-19T00:39:44.373042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":290825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":290755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":875110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":291349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":290823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":286480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":881683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":286320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:49.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:49.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.947+0000 7f038f000640 1 Processor -- start 2024-08-19T00:39:49.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.947+0000 7f038f000640 1 -- start start 2024-08-19T00:39:49.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f038f000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f038815f5b0 0x7f03880cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:49.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f038f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f03880d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f038f000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03880b4380 0x7f03880b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f038f000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f03880d0d60 con 0x7f038815f5b0 2024-08-19T00:39:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f038f000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f038815f990 con 0x7f03880b4380 2024-08-19T00:39:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f038f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03880cf120 con 0x7f03880d03c0 2024-08-19T00:39:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f0387e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f038815f5b0 0x7f03880cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f0387e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f038815f5b0 0x7f03880cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39564/0 (socket says 172.21.15.7:39564) 2024-08-19T00:39:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.948+0000 7f0387e00640 1 -- 172.21.15.7:0/83456237 learned_addr learned my addr 172.21.15.7:0/83456237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f038d000640 1 --2- 172.21.15.7:0/83456237 >> v2:172.21.15.162:3300/0 conn(0x7f03880b4380 0x7f03880b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f037f400640 1 --2- 172.21.15.7:0/83456237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f03880d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f0387e00640 1 -- 172.21.15.7:0/83456237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 msgr2=0x7f03880d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f0387e00640 1 --2- 172.21.15.7:0/83456237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f03880d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f0387e00640 1 -- 172.21.15.7:0/83456237 >> v2:172.21.15.162:3300/0 conn(0x7f03880b4380 msgr2=0x7f03880b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f0387e00640 1 --2- 172.21.15.7:0/83456237 >> v2:172.21.15.162:3300/0 conn(0x7f03880b4380 0x7f03880b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:49.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f0387e00640 1 -- 172.21.15.7:0/83456237 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03880cfaf0 con 0x7f038815f5b0 2024-08-19T00:39:49.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f038d000640 1 --2- 172.21.15.7:0/83456237 >> v2:172.21.15.162:3300/0 conn(0x7f03880b4380 0x7f03880b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:49.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.949+0000 7f037f400640 1 --2- 172.21.15.7:0/83456237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f03880d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:49.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.950+0000 7f0387e00640 1 --2- 172.21.15.7:0/83456237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038815f5b0 0x7f03880cf5b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f038806e140 tx=0x7f037802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221d630ce62ead67 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:49.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.950+0000 7f0387400640 1 -- 172.21.15.7:0/83456237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378037070 con 0x7f038815f5b0 2024-08-19T00:39:49.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.950+0000 7f0387400640 1 -- 172.21.15.7:0/83456237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0378032440 con 0x7f038815f5b0 2024-08-19T00:39:49.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.950+0000 7f0387400640 1 -- 172.21.15.7:0/83456237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378032810 con 0x7f038815f5b0 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.950+0000 7f038f000640 1 -- 172.21.15.7:0/83456237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038815f5b0 msgr2=0x7f03880cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.950+0000 7f038f000640 1 --2- 172.21.15.7:0/83456237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038815f5b0 0x7f03880cf5b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f038806e140 tx=0x7f037802a140 comp rx=0 tx=0).stop 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.951+0000 7f038f000640 1 -- 172.21.15.7:0/83456237 shutdown_connections 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.951+0000 7f038f000640 1 --2- 172.21.15.7:0/83456237 >> v2:172.21.15.162:3300/0 conn(0x7f03880b4380 0x7f03880b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.951+0000 7f038f000640 1 --2- 172.21.15.7:0/83456237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f03880d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.951+0000 7f038f000640 1 --2- 172.21.15.7:0/83456237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038815f5b0 0x7f03880cf5b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.951+0000 7f038f000640 1 -- 172.21.15.7:0/83456237 >> 172.21.15.7:0/83456237 conn(0x7f038806bc70 msgr2=0x7f038806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.951+0000 7f038f000640 1 -- 172.21.15.7:0/83456237 shutdown_connections 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.951+0000 7f038f000640 1 -- 172.21.15.7:0/83456237 wait complete. 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.952+0000 7f038f000640 1 Processor -- start 2024-08-19T00:39:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.952+0000 7f038f000640 1 -- start start 2024-08-19T00:39:49.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f038f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03880b4380 0x7f038815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:49.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f038f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f0388159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f038f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038815f5b0 0x7f038815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f038f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03880cedb0 con 0x7f03880b4380 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f038f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03880cead0 con 0x7f038815f5b0 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f038f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03880b4d70 con 0x7f03880d03c0 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f0387e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03880b4380 0x7f038815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f0387e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03880b4380 0x7f038815bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39576/0 (socket says 172.21.15.7:39576) 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.953+0000 7f0387e00640 1 -- 172.21.15.7:0/101194067 learned_addr learned my addr 172.21.15.7:0/101194067 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f037f400640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f0388159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f038d000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038815f5b0 0x7f038815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f0387e00640 1 -- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 msgr2=0x7f0388159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f0387e00640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f0388159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f0387e00640 1 -- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038815f5b0 msgr2=0x7f038815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f0387e00640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038815f5b0 0x7f038815a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f0387e00640 1 -- 172.21.15.7:0/101194067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0388157c30 con 0x7f03880b4380 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f038d000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038815f5b0 0x7f038815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f0387e00640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03880b4380 0x7f038815bc60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0378000c00 tx=0x7f03780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.954+0000 7f0384c00640 1 -- 172.21.15.7:0/101194067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378037040 con 0x7f03880b4380 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.955+0000 7f0384c00640 1 -- 172.21.15.7:0/101194067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0378042070 con 0x7f03880b4380 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.955+0000 7f0384c00640 1 -- 172.21.15.7:0/101194067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378030bb0 con 0x7f03880b4380 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.955+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0388157f10 con 0x7f03880b4380 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.955+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03881584d0 con 0x7f03880b4380 2024-08-19T00:39:49.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.956+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03880d0820 con 0x7f03880b4380 2024-08-19T00:39:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.957+0000 7f0384c00640 1 -- 172.21.15.7:0/101194067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0378047460 con 0x7f03880b4380 2024-08-19T00:39:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.957+0000 7f0384c00640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036406be30 0x7f036406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.958+0000 7f0384c00640 1 -- 172.21.15.7:0/101194067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f03780abae0 con 0x7f03880b4380 2024-08-19T00:39:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.958+0000 7f037f400640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036406be30 0x7f036406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.958+0000 7f037f400640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036406be30 0x7f036406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f038806f890 tx=0x7f0370008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:49.962+0000 7f0384c00640 1 -- 172.21.15.7:0/101194067 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f037807a3b0 con 0x7f03880b4380 2024-08-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.143+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03881586a0 con 0x7f036406be30 2024-08-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.149+0000 7f0384c00640 1 -- 172.21.15.7:0/101194067 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251708 (secure 0 0 0) 0x7f03881586a0 con 0x7f036406be30 2024-08-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.153+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036406be30 msgr2=0x7f036406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.153+0000 7f038f000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036406be30 0x7f036406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f038806f890 tx=0x7f0370008040 comp rx=0 tx=0).stop 2024-08-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.153+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03880b4380 msgr2=0x7f038815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.153+0000 7f038f000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03880b4380 0x7f038815bc60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0378000c00 tx=0x7f03780046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 shutdown_connections 2024-08-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f036406be30 0x7f036406e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038815f5b0 0x7f038815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03880d03c0 0x7f0388159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 --2- 172.21.15.7:0/101194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03880b4380 0x7f038815bc60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 >> 172.21.15.7:0/101194067 conn(0x7f038806bc70 msgr2=0x7f038806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 shutdown_connections 2024-08-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.154+0000 7f038f000640 1 -- 172.21.15.7:0/101194067 wait complete. 2024-08-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-19T00:39:49.292613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243600,"kb_used_data":6628,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731120,"statfs":{"total":773094113280,"available":772844666880,"internally_reserved":0,"allocated":6787072,"data_stored":3493345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001780"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371678+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:44.371678+0000","last_peered":"2024-08-19T00:39:44.371678+0000","last_clean":"2024-08-19T00:39:44.371678+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:44.371678+0000","last_undegraded":"2024-08-19T00:39:44.371678+0000","last_fullsized":"2024-08-19T00:39:44.371678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370966+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:44.370966+0000","last_peered":"2024-08-19T00:39:44.370966+0000","last_clean":"2024-08-19T00:39:44.370966+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:44.370966+0000","last_undegraded":"2024-08-19T00:39:44.370966+0000","last_fullsized":"2024-08-19T00:39:44.370966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162625+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:37.162625+0000","last_peered":"2024-08-19T00:39:37.162625+0000","last_clean":"2024-08-19T00:39:37.162625+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:37.162625+0000","last_undegraded":"2024-08-19T00:39:37.162625+0000","last_fullsized":"2024-08-19T00:39:37.162625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368733+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:44.368733+0000","last_peered":"2024-08-19T00:39:44.368733+0000","last_clean":"2024-08-19T00:39:44.368733+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:44.368733+0000","last_undegraded":"2024-08-19T00:39:44.368733+0000","last_fullsized":"2024-08-19T00:39:44.368733+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.135051+0000","last_change":"2024-08-19T00:39:45.312229+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.135051+0000","last_undegraded":"2024-08-19T00:39:36.135051+0000","last_fullsized":"2024-08-19T00:39:36.135051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370452+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:44.370452+0000","last_peered":"2024-08-19T00:39:44.370452+0000","last_clean":"2024-08-19T00:39:44.370452+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:44.370452+0000","last_undegraded":"2024-08-19T00:39:44.370452+0000","last_fullsized":"2024-08-19T00:39:44.370452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368316+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:44.368316+0000","last_peered":"2024-08-19T00:39:44.368316+0000","last_clean":"2024-08-19T00:39:44.368316+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:44.368316+0000","last_undegraded":"2024-08-19T00:39:44.368316+0000","last_fullsized":"2024-08-19T00:39:44.368316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133661+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:37.133661+0000","last_peered":"2024-08-19T00:39:37.133661+0000","last_clean":"2024-08-19T00:39:37.133661+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:37.133661+0000","last_undegraded":"2024-08-19T00:39:37.133661+0000","last_fullsized":"2024-08-19T00:39:37.133661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373880+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:44.373880+0000","last_peered":"2024-08-19T00:39:44.373880+0000","last_clean":"2024-08-19T00:39:44.373880+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:44.373880+0000","last_undegraded":"2024-08-19T00:39:44.373880+0000","last_fullsized":"2024-08-19T00:39:44.373880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371386+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:44.371386+0000","last_peered":"2024-08-19T00:39:44.371386+0000","last_clean":"2024-08-19T00:39:44.371386+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:44.371386+0000","last_undegraded":"2024-08-19T00:39:44.371386+0000","last_fullsized":"2024-08-19T00:39:44.371386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375631+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:44.375631+0000","last_peered":"2024-08-19T00:39:44.375631+0000","last_clean":"2024-08-19T00:39:44.375631+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:44.375631+0000","last_undegraded":"2024-08-19T00:39:44.375631+0000","last_fullsized":"2024-08-19T00:39:44.375631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373889+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:44.373889+0000","last_peered":"2024-08-19T00:39:44.373889+0000","last_clean":"2024-08-19T00:39:44.373889+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:44.373889+0000","last_undegraded":"2024-08-19T00:39:44.373889+0000","last_fullsized":"2024-08-19T00:39:44.373889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694729+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:37.694729+0000","last_peered":"2024-08-19T00:39:37.694729+0000","last_clean":"2024-08-19T00:39:37.694729+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:37.694729+0000","last_undegraded":"2024-08-19T00:39:37.694729+0000","last_fullsized":"2024-08-19T00:39:37.694729+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162300+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:37.162300+0000","last_peered":"2024-08-19T00:39:37.162300+0000","last_clean":"2024-08-19T00:39:37.162300+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:37.162300+0000","last_undegraded":"2024-08-19T00:39:37.162300+0000","last_fullsized":"2024-08-19T00:39:37.162300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694701+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:37.694701+0000","last_peered":"2024-08-19T00:39:37.694701+0000","last_clean":"2024-08-19T00:39:37.694701+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:37.694701+0000","last_undegraded":"2024-08-19T00:39:37.694701+0000","last_fullsized":"2024-08-19T00:39:37.694701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370368+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:44.370368+0000","last_peered":"2024-08-19T00:39:44.370368+0000","last_clean":"2024-08-19T00:39:44.370368+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:44.370368+0000","last_undegraded":"2024-08-19T00:39:44.370368+0000","last_fullsized":"2024-08-19T00:39:44.370368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371676+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:44.371676+0000","last_peered":"2024-08-19T00:39:44.371676+0000","last_clean":"2024-08-19T00:39:44.371676+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:44.371676+0000","last_undegraded":"2024-08-19T00:39:44.371676+0000","last_fullsized":"2024-08-19T00:39:44.371676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162713+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:37.162713+0000","last_peered":"2024-08-19T00:39:37.162713+0000","last_clean":"2024-08-19T00:39:37.162713+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:37.162713+0000","last_undegraded":"2024-08-19T00:39:37.162713+0000","last_fullsized":"2024-08-19T00:39:37.162713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370911+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:44.370911+0000","last_peered":"2024-08-19T00:39:44.370911+0000","last_clean":"2024-08-19T00:39:44.370911+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:44.370911+0000","last_undegraded":"2024-08-19T00:39:44.370911+0000","last_fullsized":"2024-08-19T00:39:44.370911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375576+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:44.375576+0000","last_peered":"2024-08-19T00:39:44.375576+0000","last_clean":"2024-08-19T00:39:44.375576+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:44.375576+0000","last_undegraded":"2024-08-19T00:39:44.375576+0000","last_fullsized":"2024-08-19T00:39:44.375576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694706+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:37.694706+0000","last_peered":"2024-08-19T00:39:37.694706+0000","last_clean":"2024-08-19T00:39:37.694706+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:37.694706+0000","last_undegraded":"2024-08-19T00:39:37.694706+0000","last_fullsized":"2024-08-19T00:39:37.694706+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375622+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:44.375622+0000","last_peered":"2024-08-19T00:39:44.375622+0000","last_clean":"2024-08-19T00:39:44.375622+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:44.375622+0000","last_undegraded":"2024-08-19T00:39:44.375622+0000","last_fullsized":"2024-08-19T00:39:44.375622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368371+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:44.368371+0000","last_peered":"2024-08-19T00:39:44.368371+0000","last_clean":"2024-08-19T00:39:44.368371+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:44.368371+0000","last_undegraded":"2024-08-19T00:39:44.368371+0000","last_fullsized":"2024-08-19T00:39:44.368371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372557+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:44.372557+0000","last_peered":"2024-08-19T00:39:44.372557+0000","last_clean":"2024-08-19T00:39:44.372557+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:44.372557+0000","last_undegraded":"2024-08-19T00:39:44.372557+0000","last_fullsized":"2024-08-19T00:39:44.372557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370827+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:44.370827+0000","last_peered":"2024-08-19T00:39:44.370827+0000","last_clean":"2024-08-19T00:39:44.370827+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:44.370827+0000","last_undegraded":"2024-08-19T00:39:44.370827+0000","last_fullsized":"2024-08-19T00:39:44.370827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694991+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:37.694991+0000","last_peered":"2024-08-19T00:39:37.694991+0000","last_clean":"2024-08-19T00:39:37.694991+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:37.694991+0000","last_undegraded":"2024-08-19T00:39:37.694991+0000","last_fullsized":"2024-08-19T00:39:37.694991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371103+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:44.371103+0000","last_peered":"2024-08-19T00:39:44.371103+0000","last_clean":"2024-08-19T00:39:44.371103+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:44.371103+0000","last_undegraded":"2024-08-19T00:39:44.371103+0000","last_fullsized":"2024-08-19T00:39:44.371103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134136+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:37.134136+0000","last_peered":"2024-08-19T00:39:37.134136+0000","last_clean":"2024-08-19T00:39:37.134136+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:37.134136+0000","last_undegraded":"2024-08-19T00:39:37.134136+0000","last_fullsized":"2024-08-19T00:39:37.134136+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133991+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:37.133991+0000","last_peered":"2024-08-19T00:39:37.133991+0000","last_clean":"2024-08-19T00:39:37.133991+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.133991+0000","last_undegraded":"2024-08-19T00:39:37.133991+0000","last_fullsized":"2024-08-19T00:39:37.133991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368366+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:44.368366+0000","last_peered":"2024-08-19T00:39:44.368366+0000","last_clean":"2024-08-19T00:39:44.368366+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:44.368366+0000","last_undegraded":"2024-08-19T00:39:44.368366+0000","last_fullsized":"2024-08-19T00:39:44.368366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370803+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:44.370803+0000","last_peered":"2024-08-19T00:39:44.370803+0000","last_clean":"2024-08-19T00:39:44.370803+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:44.370803+0000","last_undegraded":"2024-08-19T00:39:44.370803+0000","last_fullsized":"2024-08-19T00:39:44.370803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375350+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:44.375350+0000","last_peered":"2024-08-19T00:39:44.375350+0000","last_clean":"2024-08-19T00:39:44.375350+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:44.375350+0000","last_undegraded":"2024-08-19T00:39:44.375350+0000","last_fullsized":"2024-08-19T00:39:44.375350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371472+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:44.371472+0000","last_peered":"2024-08-19T00:39:44.371472+0000","last_clean":"2024-08-19T00:39:44.371472+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:44.371472+0000","last_undegraded":"2024-08-19T00:39:44.371472+0000","last_fullsized":"2024-08-19T00:39:44.371472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375974+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:44.375974+0000","last_peered":"2024-08-19T00:39:44.375974+0000","last_clean":"2024-08-19T00:39:44.375974+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:44.375974+0000","last_undegraded":"2024-08-19T00:39:44.375974+0000","last_fullsized":"2024-08-19T00:39:44.375974+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.138503+0000","last_change":"2024-08-19T00:39:45.312271+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.138503+0000","last_undegraded":"2024-08-19T00:39:36.138503+0000","last_fullsized":"2024-08-19T00:39:36.138503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371086+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:44.371086+0000","last_peered":"2024-08-19T00:39:44.371086+0000","last_clean":"2024-08-19T00:39:44.371086+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:44.371086+0000","last_undegraded":"2024-08-19T00:39:44.371086+0000","last_fullsized":"2024-08-19T00:39:44.371086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134299+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:37.134299+0000","last_peered":"2024-08-19T00:39:37.134299+0000","last_clean":"2024-08-19T00:39:37.134299+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:37.134299+0000","last_undegraded":"2024-08-19T00:39:37.134299+0000","last_fullsized":"2024-08-19T00:39:37.134299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371153+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:44.371153+0000","last_peered":"2024-08-19T00:39:44.371153+0000","last_clean":"2024-08-19T00:39:44.371153+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:44.371153+0000","last_undegraded":"2024-08-19T00:39:44.371153+0000","last_fullsized":"2024-08-19T00:39:44.371153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370964+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:44.370964+0000","last_peered":"2024-08-19T00:39:44.370964+0000","last_clean":"2024-08-19T00:39:44.370964+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:44.370964+0000","last_undegraded":"2024-08-19T00:39:44.370964+0000","last_fullsized":"2024-08-19T00:39:44.370964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368766+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:44.368766+0000","last_peered":"2024-08-19T00:39:44.368766+0000","last_clean":"2024-08-19T00:39:44.368766+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:44.368766+0000","last_undegraded":"2024-08-19T00:39:44.368766+0000","last_fullsized":"2024-08-19T00:39:44.368766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133710+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:37.133710+0000","last_peered":"2024-08-19T00:39:37.133710+0000","last_clean":"2024-08-19T00:39:37.133710+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:37.133710+0000","last_undegraded":"2024-08-19T00:39:37.133710+0000","last_fullsized":"2024-08-19T00:39:37.133710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162424+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:37.162424+0000","last_peered":"2024-08-19T00:39:37.162424+0000","last_clean":"2024-08-19T00:39:37.162424+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:37.162424+0000","last_undegraded":"2024-08-19T00:39:37.162424+0000","last_fullsized":"2024-08-19T00:39:37.162424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375562+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:44.375562+0000","last_peered":"2024-08-19T00:39:44.375562+0000","last_clean":"2024-08-19T00:39:44.375562+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:44.375562+0000","last_undegraded":"2024-08-19T00:39:44.375562+0000","last_fullsized":"2024-08-19T00:39:44.375562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162288+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:37.162288+0000","last_peered":"2024-08-19T00:39:37.162288+0000","last_clean":"2024-08-19T00:39:37.162288+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:37.162288+0000","last_undegraded":"2024-08-19T00:39:37.162288+0000","last_fullsized":"2024-08-19T00:39:37.162288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373644+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:44.373644+0000","last_peered":"2024-08-19T00:39:44.373644+0000","last_clean":"2024-08-19T00:39:44.373644+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:44.373644+0000","last_undegraded":"2024-08-19T00:39:44.373644+0000","last_fullsized":"2024-08-19T00:39:44.373644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370400+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:44.370400+0000","last_peered":"2024-08-19T00:39:44.370400+0000","last_clean":"2024-08-19T00:39:44.370400+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:44.370400+0000","last_undegraded":"2024-08-19T00:39:44.370400+0000","last_fullsized":"2024-08-19T00:39:44.370400+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694609+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:37.694609+0000","last_peered":"2024-08-19T00:39:37.694609+0000","last_clean":"2024-08-19T00:39:37.694609+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:37.694609+0000","last_undegraded":"2024-08-19T00:39:37.694609+0000","last_fullsized":"2024-08-19T00:39:37.694609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694988+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:37.694988+0000","last_peered":"2024-08-19T00:39:37.694988+0000","last_clean":"2024-08-19T00:39:37.694988+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:37.694988+0000","last_undegraded":"2024-08-19T00:39:37.694988+0000","last_fullsized":"2024-08-19T00:39:37.694988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374150+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:44.374150+0000","last_peered":"2024-08-19T00:39:44.374150+0000","last_clean":"2024-08-19T00:39:44.374150+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:44.374150+0000","last_undegraded":"2024-08-19T00:39:44.374150+0000","last_fullsized":"2024-08-19T00:39:44.374150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162623+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:37.162623+0000","last_peered":"2024-08-19T00:39:37.162623+0000","last_clean":"2024-08-19T00:39:37.162623+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:37.162623+0000","last_undegraded":"2024-08-19T00:39:37.162623+0000","last_fullsized":"2024-08-19T00:39:37.162623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133915+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:37.133915+0000","last_peered":"2024-08-19T00:39:37.133915+0000","last_clean":"2024-08-19T00:39:37.133915+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:37.133915+0000","last_undegraded":"2024-08-19T00:39:37.133915+0000","last_fullsized":"2024-08-19T00:39:37.133915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134374+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:37.134374+0000","last_peered":"2024-08-19T00:39:37.134374+0000","last_clean":"2024-08-19T00:39:37.134374+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:37.134374+0000","last_undegraded":"2024-08-19T00:39:37.134374+0000","last_fullsized":"2024-08-19T00:39:37.134374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368946+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:44.368946+0000","last_peered":"2024-08-19T00:39:44.368946+0000","last_clean":"2024-08-19T00:39:44.368946+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:44.368946+0000","last_undegraded":"2024-08-19T00:39:44.368946+0000","last_fullsized":"2024-08-19T00:39:44.368946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368847+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:44.368847+0000","last_peered":"2024-08-19T00:39:44.368847+0000","last_clean":"2024-08-19T00:39:44.368847+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:44.368847+0000","last_undegraded":"2024-08-19T00:39:44.368847+0000","last_fullsized":"2024-08-19T00:39:44.368847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694922+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:37.694922+0000","last_peered":"2024-08-19T00:39:37.694922+0000","last_clean":"2024-08-19T00:39:37.694922+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:37.694922+0000","last_undegraded":"2024-08-19T00:39:37.694922+0000","last_fullsized":"2024-08-19T00:39:37.694922+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373707+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:44.373707+0000","last_peered":"2024-08-19T00:39:44.373707+0000","last_clean":"2024-08-19T00:39:44.373707+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:44.373707+0000","last_undegraded":"2024-08-19T00:39:44.373707+0000","last_fullsized":"2024-08-19T00:39:44.373707+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134099+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:37.134099+0000","last_peered":"2024-08-19T00:39:37.134099+0000","last_clean":"2024-08-19T00:39:37.134099+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:37.134099+0000","last_undegraded":"2024-08-19T00:39:37.134099+0000","last_fullsized":"2024-08-19T00:39:37.134099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162429+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:37.162429+0000","last_peered":"2024-08-19T00:39:37.162429+0000","last_clean":"2024-08-19T00:39:37.162429+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:37.162429+0000","last_undegraded":"2024-08-19T00:39:37.162429+0000","last_fullsized":"2024-08-19T00:39:37.162429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368410+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:44.368410+0000","last_peered":"2024-08-19T00:39:44.368410+0000","last_clean":"2024-08-19T00:39:44.368410+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:44.368410+0000","last_undegraded":"2024-08-19T00:39:44.368410+0000","last_fullsized":"2024-08-19T00:39:44.368410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372689+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:44.372689+0000","last_peered":"2024-08-19T00:39:44.372689+0000","last_clean":"2024-08-19T00:39:44.372689+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:44.372689+0000","last_undegraded":"2024-08-19T00:39:44.372689+0000","last_fullsized":"2024-08-19T00:39:44.372689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368530+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:44.368530+0000","last_peered":"2024-08-19T00:39:44.368530+0000","last_clean":"2024-08-19T00:39:44.368530+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:44.368530+0000","last_undegraded":"2024-08-19T00:39:44.368530+0000","last_fullsized":"2024-08-19T00:39:44.368530+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368467+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:44.368467+0000","last_peered":"2024-08-19T00:39:44.368467+0000","last_clean":"2024-08-19T00:39:44.368467+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:44.368467+0000","last_undegraded":"2024-08-19T00:39:44.368467+0000","last_fullsized":"2024-08-19T00:39:44.368467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":24,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368365+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:44.368365+0000","last_peered":"2024-08-19T00:39:44.368365+0000","last_clean":"2024-08-19T00:39:44.368365+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:44.368365+0000","last_undegraded":"2024-08-19T00:39:44.368365+0000","last_fullsized":"2024-08-19T00:39:44.368365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162769+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:37.162769+0000","last_peered":"2024-08-19T00:39:37.162769+0000","last_clean":"2024-08-19T00:39:37.162769+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.162769+0000","last_undegraded":"2024-08-19T00:39:37.162769+0000","last_fullsized":"2024-08-19T00:39:37.162769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162717+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:37.162717+0000","last_peered":"2024-08-19T00:39:37.162717+0000","last_clean":"2024-08-19T00:39:37.162717+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:37.162717+0000","last_undegraded":"2024-08-19T00:39:37.162717+0000","last_fullsized":"2024-08-19T00:39:37.162717+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134321+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:37.134321+0000","last_peered":"2024-08-19T00:39:37.134321+0000","last_clean":"2024-08-19T00:39:37.134321+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:37.134321+0000","last_undegraded":"2024-08-19T00:39:37.134321+0000","last_fullsized":"2024-08-19T00:39:37.134321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370669+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:44.370669+0000","last_peered":"2024-08-19T00:39:44.370669+0000","last_clean":"2024-08-19T00:39:44.370669+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:44.370669+0000","last_undegraded":"2024-08-19T00:39:44.370669+0000","last_fullsized":"2024-08-19T00:39:44.370669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162693+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:37.162693+0000","last_peered":"2024-08-19T00:39:37.162693+0000","last_clean":"2024-08-19T00:39:37.162693+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:37.162693+0000","last_undegraded":"2024-08-19T00:39:37.162693+0000","last_fullsized":"2024-08-19T00:39:37.162693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368842+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:44.368842+0000","last_peered":"2024-08-19T00:39:44.368842+0000","last_clean":"2024-08-19T00:39:44.368842+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:44.368842+0000","last_undegraded":"2024-08-19T00:39:44.368842+0000","last_fullsized":"2024-08-19T00:39:44.368842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134432+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:37.134432+0000","last_peered":"2024-08-19T00:39:37.134432+0000","last_clean":"2024-08-19T00:39:37.134432+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:37.134432+0000","last_undegraded":"2024-08-19T00:39:37.134432+0000","last_fullsized":"2024-08-19T00:39:37.134432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373783+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:44.373783+0000","last_peered":"2024-08-19T00:39:44.373783+0000","last_clean":"2024-08-19T00:39:44.373783+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:44.373783+0000","last_undegraded":"2024-08-19T00:39:44.373783+0000","last_fullsized":"2024-08-19T00:39:44.373783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375635+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:44.375635+0000","last_peered":"2024-08-19T00:39:44.375635+0000","last_clean":"2024-08-19T00:39:44.375635+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:44.375635+0000","last_undegraded":"2024-08-19T00:39:44.375635+0000","last_fullsized":"2024-08-19T00:39:44.375635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134154+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:37.134154+0000","last_peered":"2024-08-19T00:39:37.134154+0000","last_clean":"2024-08-19T00:39:37.134154+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:37.134154+0000","last_undegraded":"2024-08-19T00:39:37.134154+0000","last_fullsized":"2024-08-19T00:39:37.134154+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133819+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:37.133819+0000","last_peered":"2024-08-19T00:39:37.133819+0000","last_clean":"2024-08-19T00:39:37.133819+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:37.133819+0000","last_undegraded":"2024-08-19T00:39:37.133819+0000","last_fullsized":"2024-08-19T00:39:37.133819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133681+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:37.133681+0000","last_peered":"2024-08-19T00:39:37.133681+0000","last_clean":"2024-08-19T00:39:37.133681+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:37.133681+0000","last_undegraded":"2024-08-19T00:39:37.133681+0000","last_fullsized":"2024-08-19T00:39:37.133681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372791+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:44.372791+0000","last_peered":"2024-08-19T00:39:44.372791+0000","last_clean":"2024-08-19T00:39:44.372791+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:44.372791+0000","last_undegraded":"2024-08-19T00:39:44.372791+0000","last_fullsized":"2024-08-19T00:39:44.372791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162876+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:37.162876+0000","last_peered":"2024-08-19T00:39:37.162876+0000","last_clean":"2024-08-19T00:39:37.162876+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:37.162876+0000","last_undegraded":"2024-08-19T00:39:37.162876+0000","last_fullsized":"2024-08-19T00:39:37.162876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371223+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:44.371223+0000","last_peered":"2024-08-19T00:39:44.371223+0000","last_clean":"2024-08-19T00:39:44.371223+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:44.371223+0000","last_undegraded":"2024-08-19T00:39:44.371223+0000","last_fullsized":"2024-08-19T00:39:44.371223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162863+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:37.162863+0000","last_peered":"2024-08-19T00:39:37.162863+0000","last_clean":"2024-08-19T00:39:37.162863+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:37.162863+0000","last_undegraded":"2024-08-19T00:39:37.162863+0000","last_fullsized":"2024-08-19T00:39:37.162863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371495+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:44.371495+0000","last_peered":"2024-08-19T00:39:44.371495+0000","last_clean":"2024-08-19T00:39:44.371495+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:44.371495+0000","last_undegraded":"2024-08-19T00:39:44.371495+0000","last_fullsized":"2024-08-19T00:39:44.371495+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371427+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:44.371427+0000","last_peered":"2024-08-19T00:39:44.371427+0000","last_clean":"2024-08-19T00:39:44.371427+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:44.371427+0000","last_undegraded":"2024-08-19T00:39:44.371427+0000","last_fullsized":"2024-08-19T00:39:44.371427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374080+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:44.374080+0000","last_peered":"2024-08-19T00:39:44.374080+0000","last_clean":"2024-08-19T00:39:44.374080+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:44.374080+0000","last_undegraded":"2024-08-19T00:39:44.374080+0000","last_fullsized":"2024-08-19T00:39:44.374080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134080+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:37.134080+0000","last_peered":"2024-08-19T00:39:37.134080+0000","last_clean":"2024-08-19T00:39:37.134080+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:37.134080+0000","last_undegraded":"2024-08-19T00:39:37.134080+0000","last_fullsized":"2024-08-19T00:39:37.134080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162526+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:37.162526+0000","last_peered":"2024-08-19T00:39:37.162526+0000","last_clean":"2024-08-19T00:39:37.162526+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:37.162526+0000","last_undegraded":"2024-08-19T00:39:37.162526+0000","last_fullsized":"2024-08-19T00:39:37.162526+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370907+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:44.370907+0000","last_peered":"2024-08-19T00:39:44.370907+0000","last_clean":"2024-08-19T00:39:44.370907+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:44.370907+0000","last_undegraded":"2024-08-19T00:39:44.370907+0000","last_fullsized":"2024-08-19T00:39:44.370907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370826+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:44.370826+0000","last_peered":"2024-08-19T00:39:44.370826+0000","last_clean":"2024-08-19T00:39:44.370826+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:44.370826+0000","last_undegraded":"2024-08-19T00:39:44.370826+0000","last_fullsized":"2024-08-19T00:39:44.370826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694933+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:37.694933+0000","last_peered":"2024-08-19T00:39:37.694933+0000","last_clean":"2024-08-19T00:39:37.694933+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:37.694933+0000","last_undegraded":"2024-08-19T00:39:37.694933+0000","last_fullsized":"2024-08-19T00:39:37.694933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162321+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:37.162321+0000","last_peered":"2024-08-19T00:39:37.162321+0000","last_clean":"2024-08-19T00:39:37.162321+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:37.162321+0000","last_undegraded":"2024-08-19T00:39:37.162321+0000","last_fullsized":"2024-08-19T00:39:37.162321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133674+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:37.133674+0000","last_peered":"2024-08-19T00:39:37.133674+0000","last_clean":"2024-08-19T00:39:37.133674+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:37.133674+0000","last_undegraded":"2024-08-19T00:39:37.133674+0000","last_fullsized":"2024-08-19T00:39:37.133674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370521+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:44.370521+0000","last_peered":"2024-08-19T00:39:44.370521+0000","last_clean":"2024-08-19T00:39:44.370521+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:44.370521+0000","last_undegraded":"2024-08-19T00:39:44.370521+0000","last_fullsized":"2024-08-19T00:39:44.370521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370949+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:44.370949+0000","last_peered":"2024-08-19T00:39:44.370949+0000","last_clean":"2024-08-19T00:39:44.370949+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:44.370949+0000","last_undegraded":"2024-08-19T00:39:44.370949+0000","last_fullsized":"2024-08-19T00:39:44.370949+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133877+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:37.133877+0000","last_peered":"2024-08-19T00:39:37.133877+0000","last_clean":"2024-08-19T00:39:37.133877+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:37.133877+0000","last_undegraded":"2024-08-19T00:39:37.133877+0000","last_fullsized":"2024-08-19T00:39:37.133877+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133936+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:37.133936+0000","last_peered":"2024-08-19T00:39:37.133936+0000","last_clean":"2024-08-19T00:39:37.133936+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:37.133936+0000","last_undegraded":"2024-08-19T00:39:37.133936+0000","last_fullsized":"2024-08-19T00:39:37.133936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694635+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:37.694635+0000","last_peered":"2024-08-19T00:39:37.694635+0000","last_clean":"2024-08-19T00:39:37.694635+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:37.694635+0000","last_undegraded":"2024-08-19T00:39:37.694635+0000","last_fullsized":"2024-08-19T00:39:37.694635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373042+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:44.373042+0000","last_peered":"2024-08-19T00:39:44.373042+0000","last_clean":"2024-08-19T00:39:44.373042+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:44.373042+0000","last_undegraded":"2024-08-19T00:39:44.373042+0000","last_fullsized":"2024-08-19T00:39:44.373042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":290825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":290755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":875110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":291349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":290823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":286480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":881683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":286320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:50.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:50.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.369+0000 7f2ef6e00640 1 Processor -- start 2024-08-19T00:39:50.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.369+0000 7f2ef6e00640 1 -- start start 2024-08-19T00:39:50.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef6e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ef006cf70 0x7f2ef00ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef6e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ef00ae390 0x7f2ef0160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef6e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef00aebc0 con 0x7f2ef0155110 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef6e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef01554f0 con 0x7f2ef006cf70 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef6e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef015f880 con 0x7f2ef00ae390 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef5000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ef006cf70 0x7f2ef00ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef5000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ef006cf70 0x7f2ef00ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39578/0 (socket says 172.21.15.7:39578) 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.370+0000 7f2ef5000640 1 -- 172.21.15.7:0/2248296911 learned_addr learned my addr 172.21.15.7:0/2248296911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.371+0000 7f2ef6400640 1 --2- 172.21.15.7:0/2248296911 >> v2:172.21.15.162:3300/0 conn(0x7f2ef00ae390 0x7f2ef0160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.371+0000 7f2ef5000640 1 -- 172.21.15.7:0/2248296911 >> v2:172.21.15.162:3300/0 conn(0x7f2ef00ae390 msgr2=0x7f2ef0160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.371+0000 7f2ef5000640 1 --2- 172.21.15.7:0/2248296911 >> v2:172.21.15.162:3300/0 conn(0x7f2ef00ae390 0x7f2ef0160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.371+0000 7f2ef5000640 1 -- 172.21.15.7:0/2248296911 >> v1:172.21.15.162:6789/0 conn(0x7f2ef0155110 legacy=0x7f2ef006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:50.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.371+0000 7f2ef5000640 1 -- 172.21.15.7:0/2248296911 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef015fb60 con 0x7f2ef006cf70 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.372+0000 7f2ef5000640 1 --2- 172.21.15.7:0/2248296911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef006cf70 0x7f2ef00ade50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00b3410 tx=0x7f2edc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a5614d2a9b4276 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.372+0000 7f2eefe00640 1 -- 172.21.15.7:0/2248296911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc037070 con 0x7f2ef006cf70 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.372+0000 7f2eefe00640 1 -- 172.21.15.7:0/2248296911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2edc02ae50 con 0x7f2ef006cf70 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.372+0000 7f2eefe00640 1 -- 172.21.15.7:0/2248296911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc032860 con 0x7f2ef006cf70 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2248296911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef006cf70 msgr2=0x7f2ef00ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2248296911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef006cf70 0x7f2ef00ade50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00b3410 tx=0x7f2edc02a300 comp rx=0 tx=0).stop 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2248296911 shutdown_connections 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2248296911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef006cf70 0x7f2ef00ade50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2248296911 >> v2:172.21.15.162:3300/0 conn(0x7f2ef00ae390 0x7f2ef0160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2248296911 >> 172.21.15.7:0/2248296911 conn(0x7f2ef0072020 msgr2=0x7f2ef0072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2248296911 shutdown_connections 2024-08-19T00:39:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.373+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2248296911 wait complete. 2024-08-19T00:39:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.375+0000 7f2ef6e00640 1 Processor -- start 2024-08-19T00:39:50.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.375+0000 7f2ef6e00640 1 -- start start 2024-08-19T00:39:50.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef006cf70 0x7f2ef0147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef00ae390 0x7f2ef0155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef0155110 0x7f2ef01e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef00ae800 con 0x7f2ef0155110 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef00aeea0 con 0x7f2ef00ae390 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef00ae980 con 0x7f2ef006cf70 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef0155110 0x7f2ef01e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef0155110 0x7f2ef01e9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39594/0 (socket says 172.21.15.7:39594) 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 -- 172.21.15.7:0/2727733143 learned_addr learned my addr 172.21.15.7:0/2727733143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef5000640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef00ae390 0x7f2ef0155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef5a00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef006cf70 0x7f2ef0147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 -- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef006cf70 msgr2=0x7f2ef0147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef006cf70 0x7f2ef0147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 -- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef00ae390 msgr2=0x7f2ef0155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef00ae390 0x7f2ef0155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef6400640 1 -- 172.21.15.7:0/2727733143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef0147540 con 0x7f2ef0155110 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef5000640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef00ae390 0x7f2ef0155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.376+0000 7f2ef5a00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef006cf70 0x7f2ef0147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.377+0000 7f2ef6400640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef0155110 0x7f2ef01e9170 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8007e70 tx=0x7f2ee800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.377+0000 7f2eed600640 1 -- 172.21.15.7:0/2727733143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8014620 con 0x7f2ef0155110 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.377+0000 7f2eed600640 1 -- 172.21.15.7:0/2727733143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee8019070 con 0x7f2ef0155110 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.377+0000 7f2eed600640 1 -- 172.21.15.7:0/2727733143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8014a20 con 0x7f2ef0155110 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.377+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef0156050 con 0x7f2ef0155110 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.377+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef0156b30 con 0x7f2ef0155110 2024-08-19T00:39:50.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.378+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef00ade50 con 0x7f2ef0155110 2024-08-19T00:39:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.379+0000 7f2eed600640 1 -- 172.21.15.7:0/2727733143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ee8014bc0 con 0x7f2ef0155110 2024-08-19T00:39:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.380+0000 7f2eed600640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ed006be60 0x7f2ed006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.380+0000 7f2eed600640 1 -- 172.21.15.7:0/2727733143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f2ee808b8c0 con 0x7f2ef0155110 2024-08-19T00:39:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.380+0000 7f2ef5a00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ed006be60 0x7f2ed006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.381+0000 7f2ef5a00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ed006be60 0x7f2ed006e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40015e0 tx=0x7f2ee4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.384+0000 7f2eed600640 1 -- 172.21.15.7:0/2727733143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2ee805a100 con 0x7f2ef0155110 2024-08-19T00:39:50.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.565+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ef01611a0 con 0x7f2ed006be60 2024-08-19T00:39:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.571+0000 7f2eed600640 1 -- 172.21.15.7:0/2727733143 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251708 (secure 0 0 0) 0x7f2ef01611a0 con 0x7f2ed006be60 2024-08-19T00:39:50.576 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:50.577 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ed006be60 msgr2=0x7f2ed006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ed006be60 0x7f2ed006e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40015e0 tx=0x7f2ee4009040 comp rx=0 tx=0).stop 2024-08-19T00:39:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef0155110 msgr2=0x7f2ef01e9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef0155110 0x7f2ef01e9170 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8007e70 tx=0x7f2ee800e4b0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 shutdown_connections 2024-08-19T00:39:50.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ed006be60 0x7f2ed006e320 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ef0155110 0x7f2ef01e9170 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef00ae390 0x7f2ef0155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 --2- 172.21.15.7:0/2727733143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef006cf70 0x7f2ef0147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 >> 172.21.15.7:0/2727733143 conn(0x7f2ef0072020 msgr2=0x7f2ef0160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 shutdown_connections 2024-08-19T00:39:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.575+0000 7f2ef6e00640 1 -- 172.21.15.7:0/2727733143 wait complete. 2024-08-19T00:39:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-19T00:39:49.292613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243600,"kb_used_data":6628,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731120,"statfs":{"total":773094113280,"available":772844666880,"internally_reserved":0,"allocated":6787072,"data_stored":3493345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001780"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371678+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:44.371678+0000","last_peered":"2024-08-19T00:39:44.371678+0000","last_clean":"2024-08-19T00:39:44.371678+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:44.371678+0000","last_undegraded":"2024-08-19T00:39:44.371678+0000","last_fullsized":"2024-08-19T00:39:44.371678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370966+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:44.370966+0000","last_peered":"2024-08-19T00:39:44.370966+0000","last_clean":"2024-08-19T00:39:44.370966+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:44.370966+0000","last_undegraded":"2024-08-19T00:39:44.370966+0000","last_fullsized":"2024-08-19T00:39:44.370966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162625+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:37.162625+0000","last_peered":"2024-08-19T00:39:37.162625+0000","last_clean":"2024-08-19T00:39:37.162625+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:37.162625+0000","last_undegraded":"2024-08-19T00:39:37.162625+0000","last_fullsized":"2024-08-19T00:39:37.162625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368733+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:44.368733+0000","last_peered":"2024-08-19T00:39:44.368733+0000","last_clean":"2024-08-19T00:39:44.368733+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:44.368733+0000","last_undegraded":"2024-08-19T00:39:44.368733+0000","last_fullsized":"2024-08-19T00:39:44.368733+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.135051+0000","last_change":"2024-08-19T00:39:45.312229+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.135051+0000","last_undegraded":"2024-08-19T00:39:36.135051+0000","last_fullsized":"2024-08-19T00:39:36.135051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370452+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:44.370452+0000","last_peered":"2024-08-19T00:39:44.370452+0000","last_clean":"2024-08-19T00:39:44.370452+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:44.370452+0000","last_undegraded":"2024-08-19T00:39:44.370452+0000","last_fullsized":"2024-08-19T00:39:44.370452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368316+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:44.368316+0000","last_peered":"2024-08-19T00:39:44.368316+0000","last_clean":"2024-08-19T00:39:44.368316+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:44.368316+0000","last_undegraded":"2024-08-19T00:39:44.368316+0000","last_fullsized":"2024-08-19T00:39:44.368316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133661+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:37.133661+0000","last_peered":"2024-08-19T00:39:37.133661+0000","last_clean":"2024-08-19T00:39:37.133661+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:37.133661+0000","last_undegraded":"2024-08-19T00:39:37.133661+0000","last_fullsized":"2024-08-19T00:39:37.133661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373880+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:44.373880+0000","last_peered":"2024-08-19T00:39:44.373880+0000","last_clean":"2024-08-19T00:39:44.373880+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:44.373880+0000","last_undegraded":"2024-08-19T00:39:44.373880+0000","last_fullsized":"2024-08-19T00:39:44.373880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371386+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:44.371386+0000","last_peered":"2024-08-19T00:39:44.371386+0000","last_clean":"2024-08-19T00:39:44.371386+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:44.371386+0000","last_undegraded":"2024-08-19T00:39:44.371386+0000","last_fullsized":"2024-08-19T00:39:44.371386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375631+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:44.375631+0000","last_peered":"2024-08-19T00:39:44.375631+0000","last_clean":"2024-08-19T00:39:44.375631+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:44.375631+0000","last_undegraded":"2024-08-19T00:39:44.375631+0000","last_fullsized":"2024-08-19T00:39:44.375631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373889+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:44.373889+0000","last_peered":"2024-08-19T00:39:44.373889+0000","last_clean":"2024-08-19T00:39:44.373889+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:44.373889+0000","last_undegraded":"2024-08-19T00:39:44.373889+0000","last_fullsized":"2024-08-19T00:39:44.373889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694729+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:37.694729+0000","last_peered":"2024-08-19T00:39:37.694729+0000","last_clean":"2024-08-19T00:39:37.694729+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:37.694729+0000","last_undegraded":"2024-08-19T00:39:37.694729+0000","last_fullsized":"2024-08-19T00:39:37.694729+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162300+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:37.162300+0000","last_peered":"2024-08-19T00:39:37.162300+0000","last_clean":"2024-08-19T00:39:37.162300+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:37.162300+0000","last_undegraded":"2024-08-19T00:39:37.162300+0000","last_fullsized":"2024-08-19T00:39:37.162300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694701+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:37.694701+0000","last_peered":"2024-08-19T00:39:37.694701+0000","last_clean":"2024-08-19T00:39:37.694701+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:37.694701+0000","last_undegraded":"2024-08-19T00:39:37.694701+0000","last_fullsized":"2024-08-19T00:39:37.694701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370368+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:44.370368+0000","last_peered":"2024-08-19T00:39:44.370368+0000","last_clean":"2024-08-19T00:39:44.370368+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:44.370368+0000","last_undegraded":"2024-08-19T00:39:44.370368+0000","last_fullsized":"2024-08-19T00:39:44.370368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371676+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:44.371676+0000","last_peered":"2024-08-19T00:39:44.371676+0000","last_clean":"2024-08-19T00:39:44.371676+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:44.371676+0000","last_undegraded":"2024-08-19T00:39:44.371676+0000","last_fullsized":"2024-08-19T00:39:44.371676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162713+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:37.162713+0000","last_peered":"2024-08-19T00:39:37.162713+0000","last_clean":"2024-08-19T00:39:37.162713+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:37.162713+0000","last_undegraded":"2024-08-19T00:39:37.162713+0000","last_fullsized":"2024-08-19T00:39:37.162713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370911+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:44.370911+0000","last_peered":"2024-08-19T00:39:44.370911+0000","last_clean":"2024-08-19T00:39:44.370911+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:44.370911+0000","last_undegraded":"2024-08-19T00:39:44.370911+0000","last_fullsized":"2024-08-19T00:39:44.370911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375576+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:44.375576+0000","last_peered":"2024-08-19T00:39:44.375576+0000","last_clean":"2024-08-19T00:39:44.375576+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:44.375576+0000","last_undegraded":"2024-08-19T00:39:44.375576+0000","last_fullsized":"2024-08-19T00:39:44.375576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694706+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:37.694706+0000","last_peered":"2024-08-19T00:39:37.694706+0000","last_clean":"2024-08-19T00:39:37.694706+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:37.694706+0000","last_undegraded":"2024-08-19T00:39:37.694706+0000","last_fullsized":"2024-08-19T00:39:37.694706+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375622+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:44.375622+0000","last_peered":"2024-08-19T00:39:44.375622+0000","last_clean":"2024-08-19T00:39:44.375622+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:44.375622+0000","last_undegraded":"2024-08-19T00:39:44.375622+0000","last_fullsized":"2024-08-19T00:39:44.375622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368371+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:44.368371+0000","last_peered":"2024-08-19T00:39:44.368371+0000","last_clean":"2024-08-19T00:39:44.368371+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:44.368371+0000","last_undegraded":"2024-08-19T00:39:44.368371+0000","last_fullsized":"2024-08-19T00:39:44.368371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372557+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:44.372557+0000","last_peered":"2024-08-19T00:39:44.372557+0000","last_clean":"2024-08-19T00:39:44.372557+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:44.372557+0000","last_undegraded":"2024-08-19T00:39:44.372557+0000","last_fullsized":"2024-08-19T00:39:44.372557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370827+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:44.370827+0000","last_peered":"2024-08-19T00:39:44.370827+0000","last_clean":"2024-08-19T00:39:44.370827+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:44.370827+0000","last_undegraded":"2024-08-19T00:39:44.370827+0000","last_fullsized":"2024-08-19T00:39:44.370827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694991+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:37.694991+0000","last_peered":"2024-08-19T00:39:37.694991+0000","last_clean":"2024-08-19T00:39:37.694991+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:37.694991+0000","last_undegraded":"2024-08-19T00:39:37.694991+0000","last_fullsized":"2024-08-19T00:39:37.694991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371103+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:44.371103+0000","last_peered":"2024-08-19T00:39:44.371103+0000","last_clean":"2024-08-19T00:39:44.371103+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:44.371103+0000","last_undegraded":"2024-08-19T00:39:44.371103+0000","last_fullsized":"2024-08-19T00:39:44.371103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134136+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:37.134136+0000","last_peered":"2024-08-19T00:39:37.134136+0000","last_clean":"2024-08-19T00:39:37.134136+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:37.134136+0000","last_undegraded":"2024-08-19T00:39:37.134136+0000","last_fullsized":"2024-08-19T00:39:37.134136+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133991+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:37.133991+0000","last_peered":"2024-08-19T00:39:37.133991+0000","last_clean":"2024-08-19T00:39:37.133991+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.133991+0000","last_undegraded":"2024-08-19T00:39:37.133991+0000","last_fullsized":"2024-08-19T00:39:37.133991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368366+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:44.368366+0000","last_peered":"2024-08-19T00:39:44.368366+0000","last_clean":"2024-08-19T00:39:44.368366+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:44.368366+0000","last_undegraded":"2024-08-19T00:39:44.368366+0000","last_fullsized":"2024-08-19T00:39:44.368366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370803+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:44.370803+0000","last_peered":"2024-08-19T00:39:44.370803+0000","last_clean":"2024-08-19T00:39:44.370803+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:44.370803+0000","last_undegraded":"2024-08-19T00:39:44.370803+0000","last_fullsized":"2024-08-19T00:39:44.370803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375350+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:44.375350+0000","last_peered":"2024-08-19T00:39:44.375350+0000","last_clean":"2024-08-19T00:39:44.375350+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:44.375350+0000","last_undegraded":"2024-08-19T00:39:44.375350+0000","last_fullsized":"2024-08-19T00:39:44.375350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371472+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:44.371472+0000","last_peered":"2024-08-19T00:39:44.371472+0000","last_clean":"2024-08-19T00:39:44.371472+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:44.371472+0000","last_undegraded":"2024-08-19T00:39:44.371472+0000","last_fullsized":"2024-08-19T00:39:44.371472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375974+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:44.375974+0000","last_peered":"2024-08-19T00:39:44.375974+0000","last_clean":"2024-08-19T00:39:44.375974+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:44.375974+0000","last_undegraded":"2024-08-19T00:39:44.375974+0000","last_fullsized":"2024-08-19T00:39:44.375974+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":2,"reported_epoch":58,"state":"peering","last_fresh":"2024-08-19T00:39:36.138503+0000","last_change":"2024-08-19T00:39:45.312271+0000","last_active":"2024-08-19T00:39:35.119314+0000","last_peered":"2024-08-19T00:39:35.119314+0000","last_clean":"2024-08-19T00:39:35.119314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:39:36.138503+0000","last_undegraded":"2024-08-19T00:39:36.138503+0000","last_fullsized":"2024-08-19T00:39:36.138503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371086+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:44.371086+0000","last_peered":"2024-08-19T00:39:44.371086+0000","last_clean":"2024-08-19T00:39:44.371086+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:44.371086+0000","last_undegraded":"2024-08-19T00:39:44.371086+0000","last_fullsized":"2024-08-19T00:39:44.371086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134299+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:37.134299+0000","last_peered":"2024-08-19T00:39:37.134299+0000","last_clean":"2024-08-19T00:39:37.134299+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:37.134299+0000","last_undegraded":"2024-08-19T00:39:37.134299+0000","last_fullsized":"2024-08-19T00:39:37.134299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371153+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:44.371153+0000","last_peered":"2024-08-19T00:39:44.371153+0000","last_clean":"2024-08-19T00:39:44.371153+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:44.371153+0000","last_undegraded":"2024-08-19T00:39:44.371153+0000","last_fullsized":"2024-08-19T00:39:44.371153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370964+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:44.370964+0000","last_peered":"2024-08-19T00:39:44.370964+0000","last_clean":"2024-08-19T00:39:44.370964+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:44.370964+0000","last_undegraded":"2024-08-19T00:39:44.370964+0000","last_fullsized":"2024-08-19T00:39:44.370964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368766+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:44.368766+0000","last_peered":"2024-08-19T00:39:44.368766+0000","last_clean":"2024-08-19T00:39:44.368766+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:44.368766+0000","last_undegraded":"2024-08-19T00:39:44.368766+0000","last_fullsized":"2024-08-19T00:39:44.368766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133710+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:37.133710+0000","last_peered":"2024-08-19T00:39:37.133710+0000","last_clean":"2024-08-19T00:39:37.133710+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:37.133710+0000","last_undegraded":"2024-08-19T00:39:37.133710+0000","last_fullsized":"2024-08-19T00:39:37.133710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162424+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:37.162424+0000","last_peered":"2024-08-19T00:39:37.162424+0000","last_clean":"2024-08-19T00:39:37.162424+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:37.162424+0000","last_undegraded":"2024-08-19T00:39:37.162424+0000","last_fullsized":"2024-08-19T00:39:37.162424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375562+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:44.375562+0000","last_peered":"2024-08-19T00:39:44.375562+0000","last_clean":"2024-08-19T00:39:44.375562+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:44.375562+0000","last_undegraded":"2024-08-19T00:39:44.375562+0000","last_fullsized":"2024-08-19T00:39:44.375562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162288+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:37.162288+0000","last_peered":"2024-08-19T00:39:37.162288+0000","last_clean":"2024-08-19T00:39:37.162288+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:37.162288+0000","last_undegraded":"2024-08-19T00:39:37.162288+0000","last_fullsized":"2024-08-19T00:39:37.162288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373644+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:44.373644+0000","last_peered":"2024-08-19T00:39:44.373644+0000","last_clean":"2024-08-19T00:39:44.373644+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:44.373644+0000","last_undegraded":"2024-08-19T00:39:44.373644+0000","last_fullsized":"2024-08-19T00:39:44.373644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370400+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:44.370400+0000","last_peered":"2024-08-19T00:39:44.370400+0000","last_clean":"2024-08-19T00:39:44.370400+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:44.370400+0000","last_undegraded":"2024-08-19T00:39:44.370400+0000","last_fullsized":"2024-08-19T00:39:44.370400+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694609+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:37.694609+0000","last_peered":"2024-08-19T00:39:37.694609+0000","last_clean":"2024-08-19T00:39:37.694609+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:37.694609+0000","last_undegraded":"2024-08-19T00:39:37.694609+0000","last_fullsized":"2024-08-19T00:39:37.694609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694988+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:37.694988+0000","last_peered":"2024-08-19T00:39:37.694988+0000","last_clean":"2024-08-19T00:39:37.694988+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:37.694988+0000","last_undegraded":"2024-08-19T00:39:37.694988+0000","last_fullsized":"2024-08-19T00:39:37.694988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374150+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:44.374150+0000","last_peered":"2024-08-19T00:39:44.374150+0000","last_clean":"2024-08-19T00:39:44.374150+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:44.374150+0000","last_undegraded":"2024-08-19T00:39:44.374150+0000","last_fullsized":"2024-08-19T00:39:44.374150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162623+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:37.162623+0000","last_peered":"2024-08-19T00:39:37.162623+0000","last_clean":"2024-08-19T00:39:37.162623+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:37.162623+0000","last_undegraded":"2024-08-19T00:39:37.162623+0000","last_fullsized":"2024-08-19T00:39:37.162623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133915+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:37.133915+0000","last_peered":"2024-08-19T00:39:37.133915+0000","last_clean":"2024-08-19T00:39:37.133915+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:37.133915+0000","last_undegraded":"2024-08-19T00:39:37.133915+0000","last_fullsized":"2024-08-19T00:39:37.133915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134374+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:37.134374+0000","last_peered":"2024-08-19T00:39:37.134374+0000","last_clean":"2024-08-19T00:39:37.134374+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:37.134374+0000","last_undegraded":"2024-08-19T00:39:37.134374+0000","last_fullsized":"2024-08-19T00:39:37.134374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368946+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:44.368946+0000","last_peered":"2024-08-19T00:39:44.368946+0000","last_clean":"2024-08-19T00:39:44.368946+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:44.368946+0000","last_undegraded":"2024-08-19T00:39:44.368946+0000","last_fullsized":"2024-08-19T00:39:44.368946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368847+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:44.368847+0000","last_peered":"2024-08-19T00:39:44.368847+0000","last_clean":"2024-08-19T00:39:44.368847+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:44.368847+0000","last_undegraded":"2024-08-19T00:39:44.368847+0000","last_fullsized":"2024-08-19T00:39:44.368847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694922+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:37.694922+0000","last_peered":"2024-08-19T00:39:37.694922+0000","last_clean":"2024-08-19T00:39:37.694922+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:37.694922+0000","last_undegraded":"2024-08-19T00:39:37.694922+0000","last_fullsized":"2024-08-19T00:39:37.694922+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373707+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:44.373707+0000","last_peered":"2024-08-19T00:39:44.373707+0000","last_clean":"2024-08-19T00:39:44.373707+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:44.373707+0000","last_undegraded":"2024-08-19T00:39:44.373707+0000","last_fullsized":"2024-08-19T00:39:44.373707+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134099+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:37.134099+0000","last_peered":"2024-08-19T00:39:37.134099+0000","last_clean":"2024-08-19T00:39:37.134099+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:37.134099+0000","last_undegraded":"2024-08-19T00:39:37.134099+0000","last_fullsized":"2024-08-19T00:39:37.134099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162429+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:37.162429+0000","last_peered":"2024-08-19T00:39:37.162429+0000","last_clean":"2024-08-19T00:39:37.162429+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:37.162429+0000","last_undegraded":"2024-08-19T00:39:37.162429+0000","last_fullsized":"2024-08-19T00:39:37.162429+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368410+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:44.368410+0000","last_peered":"2024-08-19T00:39:44.368410+0000","last_clean":"2024-08-19T00:39:44.368410+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:44.368410+0000","last_undegraded":"2024-08-19T00:39:44.368410+0000","last_fullsized":"2024-08-19T00:39:44.368410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372689+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:44.372689+0000","last_peered":"2024-08-19T00:39:44.372689+0000","last_clean":"2024-08-19T00:39:44.372689+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:44.372689+0000","last_undegraded":"2024-08-19T00:39:44.372689+0000","last_fullsized":"2024-08-19T00:39:44.372689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368530+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:44.368530+0000","last_peered":"2024-08-19T00:39:44.368530+0000","last_clean":"2024-08-19T00:39:44.368530+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:44.368530+0000","last_undegraded":"2024-08-19T00:39:44.368530+0000","last_fullsized":"2024-08-19T00:39:44.368530+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368467+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:44.368467+0000","last_peered":"2024-08-19T00:39:44.368467+0000","last_clean":"2024-08-19T00:39:44.368467+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:44.368467+0000","last_undegraded":"2024-08-19T00:39:44.368467+0000","last_fullsized":"2024-08-19T00:39:44.368467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":24,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368365+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:44.368365+0000","last_peered":"2024-08-19T00:39:44.368365+0000","last_clean":"2024-08-19T00:39:44.368365+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:44.368365+0000","last_undegraded":"2024-08-19T00:39:44.368365+0000","last_fullsized":"2024-08-19T00:39:44.368365+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162769+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:37.162769+0000","last_peered":"2024-08-19T00:39:37.162769+0000","last_clean":"2024-08-19T00:39:37.162769+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:37.162769+0000","last_undegraded":"2024-08-19T00:39:37.162769+0000","last_fullsized":"2024-08-19T00:39:37.162769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371051+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:44.371051+0000","last_peered":"2024-08-19T00:39:44.371051+0000","last_clean":"2024-08-19T00:39:44.371051+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:44.371051+0000","last_undegraded":"2024-08-19T00:39:44.371051+0000","last_fullsized":"2024-08-19T00:39:44.371051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162717+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:37.162717+0000","last_peered":"2024-08-19T00:39:37.162717+0000","last_clean":"2024-08-19T00:39:37.162717+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:37.162717+0000","last_undegraded":"2024-08-19T00:39:37.162717+0000","last_fullsized":"2024-08-19T00:39:37.162717+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134321+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:37.134321+0000","last_peered":"2024-08-19T00:39:37.134321+0000","last_clean":"2024-08-19T00:39:37.134321+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:37.134321+0000","last_undegraded":"2024-08-19T00:39:37.134321+0000","last_fullsized":"2024-08-19T00:39:37.134321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370669+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:44.370669+0000","last_peered":"2024-08-19T00:39:44.370669+0000","last_clean":"2024-08-19T00:39:44.370669+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:44.370669+0000","last_undegraded":"2024-08-19T00:39:44.370669+0000","last_fullsized":"2024-08-19T00:39:44.370669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162693+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:37.162693+0000","last_peered":"2024-08-19T00:39:37.162693+0000","last_clean":"2024-08-19T00:39:37.162693+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:37.162693+0000","last_undegraded":"2024-08-19T00:39:37.162693+0000","last_fullsized":"2024-08-19T00:39:37.162693+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.368842+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:44.368842+0000","last_peered":"2024-08-19T00:39:44.368842+0000","last_clean":"2024-08-19T00:39:44.368842+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:44.368842+0000","last_undegraded":"2024-08-19T00:39:44.368842+0000","last_fullsized":"2024-08-19T00:39:44.368842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134432+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:37.134432+0000","last_peered":"2024-08-19T00:39:37.134432+0000","last_clean":"2024-08-19T00:39:37.134432+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:37.134432+0000","last_undegraded":"2024-08-19T00:39:37.134432+0000","last_fullsized":"2024-08-19T00:39:37.134432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373783+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:44.373783+0000","last_peered":"2024-08-19T00:39:44.373783+0000","last_clean":"2024-08-19T00:39:44.373783+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:44.373783+0000","last_undegraded":"2024-08-19T00:39:44.373783+0000","last_fullsized":"2024-08-19T00:39:44.373783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.375635+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:44.375635+0000","last_peered":"2024-08-19T00:39:44.375635+0000","last_clean":"2024-08-19T00:39:44.375635+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:44.375635+0000","last_undegraded":"2024-08-19T00:39:44.375635+0000","last_fullsized":"2024-08-19T00:39:44.375635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134154+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:37.134154+0000","last_peered":"2024-08-19T00:39:37.134154+0000","last_clean":"2024-08-19T00:39:37.134154+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:37.134154+0000","last_undegraded":"2024-08-19T00:39:37.134154+0000","last_fullsized":"2024-08-19T00:39:37.134154+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133819+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:37.133819+0000","last_peered":"2024-08-19T00:39:37.133819+0000","last_clean":"2024-08-19T00:39:37.133819+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:37.133819+0000","last_undegraded":"2024-08-19T00:39:37.133819+0000","last_fullsized":"2024-08-19T00:39:37.133819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133681+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:37.133681+0000","last_peered":"2024-08-19T00:39:37.133681+0000","last_clean":"2024-08-19T00:39:37.133681+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:37.133681+0000","last_undegraded":"2024-08-19T00:39:37.133681+0000","last_fullsized":"2024-08-19T00:39:37.133681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.372791+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:44.372791+0000","last_peered":"2024-08-19T00:39:44.372791+0000","last_clean":"2024-08-19T00:39:44.372791+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:44.372791+0000","last_undegraded":"2024-08-19T00:39:44.372791+0000","last_fullsized":"2024-08-19T00:39:44.372791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162876+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:37.162876+0000","last_peered":"2024-08-19T00:39:37.162876+0000","last_clean":"2024-08-19T00:39:37.162876+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:37.162876+0000","last_undegraded":"2024-08-19T00:39:37.162876+0000","last_fullsized":"2024-08-19T00:39:37.162876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371223+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:44.371223+0000","last_peered":"2024-08-19T00:39:44.371223+0000","last_clean":"2024-08-19T00:39:44.371223+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:44.371223+0000","last_undegraded":"2024-08-19T00:39:44.371223+0000","last_fullsized":"2024-08-19T00:39:44.371223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162863+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:37.162863+0000","last_peered":"2024-08-19T00:39:37.162863+0000","last_clean":"2024-08-19T00:39:37.162863+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:37.162863+0000","last_undegraded":"2024-08-19T00:39:37.162863+0000","last_fullsized":"2024-08-19T00:39:37.162863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371495+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:44.371495+0000","last_peered":"2024-08-19T00:39:44.371495+0000","last_clean":"2024-08-19T00:39:44.371495+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:44.371495+0000","last_undegraded":"2024-08-19T00:39:44.371495+0000","last_fullsized":"2024-08-19T00:39:44.371495+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.371427+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:44.371427+0000","last_peered":"2024-08-19T00:39:44.371427+0000","last_clean":"2024-08-19T00:39:44.371427+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:44.371427+0000","last_undegraded":"2024-08-19T00:39:44.371427+0000","last_fullsized":"2024-08-19T00:39:44.371427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.374080+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:44.374080+0000","last_peered":"2024-08-19T00:39:44.374080+0000","last_clean":"2024-08-19T00:39:44.374080+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:44.374080+0000","last_undegraded":"2024-08-19T00:39:44.374080+0000","last_fullsized":"2024-08-19T00:39:44.374080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.134080+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:37.134080+0000","last_peered":"2024-08-19T00:39:37.134080+0000","last_clean":"2024-08-19T00:39:37.134080+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:37.134080+0000","last_undegraded":"2024-08-19T00:39:37.134080+0000","last_fullsized":"2024-08-19T00:39:37.134080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162526+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:37.162526+0000","last_peered":"2024-08-19T00:39:37.162526+0000","last_clean":"2024-08-19T00:39:37.162526+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:37.162526+0000","last_undegraded":"2024-08-19T00:39:37.162526+0000","last_fullsized":"2024-08-19T00:39:37.162526+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370907+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:44.370907+0000","last_peered":"2024-08-19T00:39:44.370907+0000","last_clean":"2024-08-19T00:39:44.370907+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:44.370907+0000","last_undegraded":"2024-08-19T00:39:44.370907+0000","last_fullsized":"2024-08-19T00:39:44.370907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370826+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:44.370826+0000","last_peered":"2024-08-19T00:39:44.370826+0000","last_clean":"2024-08-19T00:39:44.370826+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:44.370826+0000","last_undegraded":"2024-08-19T00:39:44.370826+0000","last_fullsized":"2024-08-19T00:39:44.370826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694933+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:37.694933+0000","last_peered":"2024-08-19T00:39:37.694933+0000","last_clean":"2024-08-19T00:39:37.694933+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:37.694933+0000","last_undegraded":"2024-08-19T00:39:37.694933+0000","last_fullsized":"2024-08-19T00:39:37.694933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.162321+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:37.162321+0000","last_peered":"2024-08-19T00:39:37.162321+0000","last_clean":"2024-08-19T00:39:37.162321+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:37.162321+0000","last_undegraded":"2024-08-19T00:39:37.162321+0000","last_fullsized":"2024-08-19T00:39:37.162321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133674+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:37.133674+0000","last_peered":"2024-08-19T00:39:37.133674+0000","last_clean":"2024-08-19T00:39:37.133674+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:37.133674+0000","last_undegraded":"2024-08-19T00:39:37.133674+0000","last_fullsized":"2024-08-19T00:39:37.133674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370521+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:44.370521+0000","last_peered":"2024-08-19T00:39:44.370521+0000","last_clean":"2024-08-19T00:39:44.370521+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:44.370521+0000","last_undegraded":"2024-08-19T00:39:44.370521+0000","last_fullsized":"2024-08-19T00:39:44.370521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.370949+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:44.370949+0000","last_peered":"2024-08-19T00:39:44.370949+0000","last_clean":"2024-08-19T00:39:44.370949+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:44.370949+0000","last_undegraded":"2024-08-19T00:39:44.370949+0000","last_fullsized":"2024-08-19T00:39:44.370949+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133877+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:37.133877+0000","last_peered":"2024-08-19T00:39:37.133877+0000","last_clean":"2024-08-19T00:39:37.133877+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:37.133877+0000","last_undegraded":"2024-08-19T00:39:37.133877+0000","last_fullsized":"2024-08-19T00:39:37.133877+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.133936+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:37.133936+0000","last_peered":"2024-08-19T00:39:37.133936+0000","last_clean":"2024-08-19T00:39:37.133936+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:37.133936+0000","last_undegraded":"2024-08-19T00:39:37.133936+0000","last_fullsized":"2024-08-19T00:39:37.133936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-08-19T00:39:37.694635+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:37.694635+0000","last_peered":"2024-08-19T00:39:37.694635+0000","last_clean":"2024-08-19T00:39:37.694635+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:37.694635+0000","last_undegraded":"2024-08-19T00:39:37.694635+0000","last_fullsized":"2024-08-19T00:39:37.694635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-08-19T00:39:44.373042+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:44.373042+0000","last_peered":"2024-08-19T00:39:44.373042+0000","last_clean":"2024-08-19T00:39:44.373042+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:44.373042+0000","last_undegraded":"2024-08-19T00:39:44.373042+0000","last_fullsized":"2024-08-19T00:39:44.373042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":290825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":290755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":875110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":291349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":290823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":286480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":881683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":286320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:50.596 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-08-19T00:39:50.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 58, 'state': 'peering', 'last_fresh': '2024-08-19T00:39:36.135051+0000', 'last_change': '2024-08-19T00:39:45.312229+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:36.135051+0000', 'last_undegraded': '2024-08-19T00:39:36.135051+0000', 'last_fullsized': '2024-08-19T00:39:36.135051+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 56, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:50.597 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-08-19T00:39:50.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 58, 'state': 'peering', 'last_fresh': '2024-08-19T00:39:36.138503+0000', 'last_change': '2024-08-19T00:39:45.312271+0000', 'last_active': '2024-08-19T00:39:35.119314+0000', 'last_peered': '2024-08-19T00:39:35.119314+0000', 'last_clean': '2024-08-19T00:39:35.119314+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:39:36.138503+0000', 'last_undegraded': '2024-08-19T00:39:36.138503+0000', 'last_fullsized': '2024-08-19T00:39:36.138503+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 56, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'last_clean_scrub_stamp': '2024-08-19T00:39:35.119314+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-19T00:39:50.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-19T00:39:50.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.786+0000 7f556de00640 1 Processor -- start 2024-08-19T00:39:50.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.786+0000 7f556de00640 1 -- start start 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.787+0000 7f556de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5568071980 0x7f55680cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.787+0000 7f556de00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55680cdfb0 con 0x7f556806e710 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f556de00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55680ce290 con 0x7f55680d03c0 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f556de00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f55680cebc0 con 0x7f5568071980 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f555fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f556806e710 0x7f55680b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55590/0 (socket says 172.21.15.7:55590) 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f555fe00640 1 -- 172.21.15.7:0/2329510611 learned_addr learned my addr 172.21.15.7:0/2329510611 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f5567400640 1 --2- 172.21.15.7:0/2329510611 >> v2:172.21.15.7:3300/0 conn(0x7f5568071980 0x7f55680cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f5566000640 1 -- 172.21.15.7:0/2329510611 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133723579 0 0) 0x7f55680cdfb0 con 0x7f556806e710 2024-08-19T00:39:50.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f5566000640 1 -- 172.21.15.7:0/2329510611 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554c003520 con 0x7f556806e710 2024-08-19T00:39:50.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f5567400640 1 -- 172.21.15.7:0/2329510611 >> v1:172.21.15.162:6789/0 conn(0x7f55680d03c0 legacy=0x7f55680d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f5567400640 1 -- 172.21.15.7:0/2329510611 >> v1:172.21.15.7:6789/0 conn(0x7f556806e710 legacy=0x7f55680b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.788+0000 7f5567400640 1 -- 172.21.15.7:0/2329510611 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55680ce570 con 0x7f5568071980 2024-08-19T00:39:50.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.789+0000 7f5567400640 1 --2- 172.21.15.7:0/2329510611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5568071980 0x7f55680cf050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5560009dc0 tx=0x7f556002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858224d1b0782d8c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:50.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.789+0000 7f5566000640 1 -- 172.21.15.7:0/2329510611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560007740 con 0x7f5568071980 2024-08-19T00:39:50.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f5566000640 1 -- 172.21.15.7:0/2329510611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55600078e0 con 0x7f5568071980 2024-08-19T00:39:50.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f5566000640 1 -- 172.21.15.7:0/2329510611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560007c90 con 0x7f5568071980 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f556de00640 1 -- 172.21.15.7:0/2329510611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5568071980 msgr2=0x7f55680cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f556de00640 1 --2- 172.21.15.7:0/2329510611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5568071980 0x7f55680cf050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5560009dc0 tx=0x7f556002a730 comp rx=0 tx=0).stop 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f556de00640 1 -- 172.21.15.7:0/2329510611 shutdown_connections 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f556de00640 1 --2- 172.21.15.7:0/2329510611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5568071980 0x7f55680cf050 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f556de00640 1 -- 172.21.15.7:0/2329510611 >> 172.21.15.7:0/2329510611 conn(0x7f556806bc70 msgr2=0x7f556806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f556de00640 1 -- 172.21.15.7:0/2329510611 shutdown_connections 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.790+0000 7f556de00640 1 -- 172.21.15.7:0/2329510611 wait complete. 2024-08-19T00:39:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.792+0000 7f556de00640 1 Processor -- start 2024-08-19T00:39:50.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.792+0000 7f556de00640 1 -- start start 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f556de00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556806e710 0x7f5568159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f556de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5568071980 0x7f556809b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f556de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55680d03c0 0x7f556815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f556de00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5568073c60 con 0x7f55680d03c0 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f556de00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5568073ae0 con 0x7f5568071980 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f556de00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55680cf590 con 0x7f556806e710 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f5567400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55680d03c0 0x7f556815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f5567400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55680d03c0 0x7f556815c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39608/0 (socket says 172.21.15.7:39608) 2024-08-19T00:39:50.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f5567400640 1 -- 172.21.15.7:0/895784166 learned_addr learned my addr 172.21.15.7:0/895784166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f555fe00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5568071980 0x7f556809b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.793+0000 7f5566a00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556806e710 0x7f5568159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f5567400640 1 -- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556806e710 msgr2=0x7f5568159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f5567400640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556806e710 0x7f5568159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f5567400640 1 -- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5568071980 msgr2=0x7f556809b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f5567400640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5568071980 0x7f556809b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f5567400640 1 -- 172.21.15.7:0/895784166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556815c620 con 0x7f55680d03c0 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f5566a00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556806e710 0x7f5568159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f5567400640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55680d03c0 0x7f556815c0e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5560009dc0 tx=0x7f5560004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:50.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f555f400640 1 -- 172.21.15.7:0/895784166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560040070 con 0x7f55680d03c0 2024-08-19T00:39:50.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f555f400640 1 -- 172.21.15.7:0/895784166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560031c40 con 0x7f55680d03c0 2024-08-19T00:39:50.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f555f400640 1 -- 172.21.15.7:0/895784166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560009450 con 0x7f55680d03c0 2024-08-19T00:39:50.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.794+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556815c8c0 con 0x7f55680d03c0 2024-08-19T00:39:50.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.795+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556815d620 con 0x7f55680d03c0 2024-08-19T00:39:50.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.796+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55680cf050 con 0x7f55680d03c0 2024-08-19T00:39:50.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.797+0000 7f555f400640 1 -- 172.21.15.7:0/895784166 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5560039040 con 0x7f55680d03c0 2024-08-19T00:39:50.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.798+0000 7f555f400640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:50.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.798+0000 7f555f400640 1 -- 172.21.15.7:0/895784166 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f55600abfd0 con 0x7f55680d03c0 2024-08-19T00:39:50.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.798+0000 7f5566a00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:50.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.799+0000 7f5566a00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5558007fd0 tx=0x7f5558009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:50.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:50.802+0000 7f555f400640 1 -- 172.21.15.7:0/895784166 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f556007a2f0 con 0x7f55680d03c0 2024-08-19T00:39:51.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.055+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5568073140 con 0x7f55680d03c0 2024-08-19T00:39:51.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.055+0000 7f555f400640 1 -- 172.21.15.7:0/895784166 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7f556007e5f0 con 0x7f55680d03c0 2024-08-19T00:39:51.057 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:51.057 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":192,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1724027810,"num_in_osds":8,"osd_in_since":1724027801,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":249446400,"bytes_avail":772844666880,"bytes_total":773094113280,"inactive_pgs_ratio":0.020618556067347527},"fsmap":{"epoch":46,"btime":"2024-08-19T00:39:39:157035+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5757}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-08-19T00:39:23.288192+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-19T00:39:51.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 msgr2=0x7f554406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5558007fd0 tx=0x7f5558009040 comp rx=0 tx=0).stop 2024-08-19T00:39:51.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55680d03c0 msgr2=0x7f556815c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55680d03c0 0x7f556815c0e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5560009dc0 tx=0x7f5560004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 shutdown_connections 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55680d03c0 0x7f556815c0e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5568071980 0x7f556809b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 --2- 172.21.15.7:0/895784166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556806e710 0x7f5568159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 >> 172.21.15.7:0/895784166 conn(0x7f556806bc70 msgr2=0x7f5568074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 shutdown_connections 2024-08-19T00:39:51.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.057+0000 7f556de00640 1 -- 172.21.15.7:0/895784166 wait complete. 2024-08-19T00:39:51.075 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-19T00:39:51.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.233+0000 7f22dbc00640 1 Processor -- start 2024-08-19T00:39:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.233+0000 7f22dbc00640 1 -- start start 2024-08-19T00:39:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.234+0000 7f22dbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d406c480 0x7f22d40b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.234+0000 7f22dbc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22d406b850 0x7f22d406bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.234+0000 7f22dbc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d40d0320 con 0x7f22d4161a30 2024-08-19T00:39:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22dbc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f22d40b0cf0 con 0x7f22d406b850 2024-08-19T00:39:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22dbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40b3cf0 con 0x7f22d406c480 2024-08-19T00:39:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d9c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22d406b850 0x7f22d406bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d9200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f22d4161a30 0x7f22d40b4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:57354/0 (socket says 172.21.15.7:57354) 2024-08-19T00:39:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d9200640 1 -- 172.21.15.7:0/33613807 learned_addr learned my addr 172.21.15.7:0/33613807 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d3e00640 1 --2- 172.21.15.7:0/33613807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d406c480 0x7f22d40b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:51.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d9c00640 1 -- 172.21.15.7:0/33613807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d406c480 msgr2=0x7f22d40b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:51.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d9c00640 1 --2- 172.21.15.7:0/33613807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d406c480 0x7f22d40b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d9c00640 1 -- 172.21.15.7:0/33613807 >> v1:172.21.15.162:6789/0 conn(0x7f22d4161a30 legacy=0x7f22d40b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.235+0000 7f22d9c00640 1 -- 172.21.15.7:0/33613807 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40d05c0 con 0x7f22d406b850 2024-08-19T00:39:51.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.236+0000 7f22d9c00640 1 --2- 172.21.15.7:0/33613807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d406bd00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009dc0 tx=0x7f22cc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9af7d2239c64341 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22d3400640 1 -- 172.21.15.7:0/33613807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc007740 con 0x7f22d406b850 2024-08-19T00:39:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22d3400640 1 -- 172.21.15.7:0/33613807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22cc0078e0 con 0x7f22d406b850 2024-08-19T00:39:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22d3400640 1 -- 172.21.15.7:0/33613807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc007cb0 con 0x7f22d406b850 2024-08-19T00:39:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 -- 172.21.15.7:0/33613807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 msgr2=0x7f22d406bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 --2- 172.21.15.7:0/33613807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d406bd00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009dc0 tx=0x7f22cc02a710 comp rx=0 tx=0).stop 2024-08-19T00:39:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 -- 172.21.15.7:0/33613807 shutdown_connections 2024-08-19T00:39:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 --2- 172.21.15.7:0/33613807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d406bd00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 --2- 172.21.15.7:0/33613807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d406c480 0x7f22d40b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 -- 172.21.15.7:0/33613807 >> 172.21.15.7:0/33613807 conn(0x7f22d40b6840 msgr2=0x7f22d40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 -- 172.21.15.7:0/33613807 shutdown_connections 2024-08-19T00:39:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.237+0000 7f22dbc00640 1 -- 172.21.15.7:0/33613807 wait complete. 2024-08-19T00:39:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.239+0000 7f22dbc00640 1 Processor -- start 2024-08-19T00:39:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.239+0000 7f22dbc00640 1 -- start start 2024-08-19T00:39:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22dbc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22dbc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22d406c480 0x7f22d414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22dbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d4161a30 0x7f22d40cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22dbc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40d0b80 con 0x7f22d406b850 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22dbc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40b0f90 con 0x7f22d406c480 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22dbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22d4161e10 con 0x7f22d4161a30 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22d9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22d9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d40cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39640/0 (socket says 172.21.15.7:39640) 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22d9200640 1 -- 172.21.15.7:0/3678277301 learned_addr learned my addr 172.21.15.7:0/3678277301 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.240+0000 7f22d3e00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22d406c480 0x7f22d414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9c00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d4161a30 0x7f22d40cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9200640 1 -- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d4161a30 msgr2=0x7f22d40cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9200640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d4161a30 0x7f22d40cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9200640 1 -- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22d406c480 msgr2=0x7f22d414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9200640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22d406c480 0x7f22d414aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9200640 1 -- 172.21.15.7:0/3678277301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40cb8e0 con 0x7f22d406b850 2024-08-19T00:39:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9c00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d4161a30 0x7f22d40cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d9200640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d40cc980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c4b0 tx=0x7f22c800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d0c00640 1 -- 172.21.15.7:0/3678277301 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8017070 con 0x7f22d406b850 2024-08-19T00:39:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d0c00640 1 -- 172.21.15.7:0/3678277301 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8005ce0 con 0x7f22d406b850 2024-08-19T00:39:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22d0c00640 1 -- 172.21.15.7:0/3678277301 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8007270 con 0x7f22d406b850 2024-08-19T00:39:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.241+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d40cbbc0 con 0x7f22d406b850 2024-08-19T00:39:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.242+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d40cc180 con 0x7f22d406b850 2024-08-19T00:39:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.242+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d40b37b0 con 0x7f22d406b850 2024-08-19T00:39:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.243+0000 7f22d0c00640 1 -- 172.21.15.7:0/3678277301 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22c801a070 con 0x7f22d406b850 2024-08-19T00:39:51.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.245+0000 7f22d0c00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22b406be30 0x7f22b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:51.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.245+0000 7f22d0c00640 1 -- 172.21.15.7:0/3678277301 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f22c808a140 con 0x7f22d406b850 2024-08-19T00:39:51.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.245+0000 7f22d3e00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22b406be30 0x7f22b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.246+0000 7f22d3e00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22b406be30 0x7f22b406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f22d4156fc0 tx=0x7f22c0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.249+0000 7f22d0c00640 1 -- 172.21.15.7:0/3678277301 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f22c8058450 con 0x7f22d406b850 2024-08-19T00:39:51.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.431+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22d4075540 con 0x7f22b406be30 2024-08-19T00:39:51.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.437+0000 7f22d0c00640 1 -- 172.21.15.7:0/3678277301 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7f22d4075540 con 0x7f22b406be30 2024-08-19T00:39:51.442 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:51.444 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22b406be30 msgr2=0x7f22b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22b406be30 0x7f22b406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f22d4156fc0 tx=0x7f22c0009190 comp rx=0 tx=0).stop 2024-08-19T00:39:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 msgr2=0x7f22d40cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d40cc980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c4b0 tx=0x7f22c800c970 comp rx=0 tx=0).stop 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 shutdown_connections 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f22b406be30 0x7f22b406e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22d4161a30 0x7f22d40cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22d406c480 0x7f22d414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 --2- 172.21.15.7:0/3678277301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22d406b850 0x7f22d40cc980 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.441+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 >> 172.21.15.7:0/3678277301 conn(0x7f22d40b6840 msgr2=0x7f22d40b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.442+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 shutdown_connections 2024-08-19T00:39:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:51.442+0000 7f22dbc00640 1 -- 172.21.15.7:0/3678277301 wait complete. 2024-08-19T00:39:51.459 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-19T00:39:51.293178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243736,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730984,"statfs":{"total":773094113280,"available":772844527616,"internally_reserved":0,"allocated":6922240,"data_stored":3559220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001811"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783167+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:45.783167+0000","last_peered":"2024-08-19T00:39:45.783167+0000","last_clean":"2024-08-19T00:39:45.783167+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:45.783167+0000","last_undegraded":"2024-08-19T00:39:45.783167+0000","last_fullsized":"2024-08-19T00:39:45.783167+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382471+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:45.382471+0000","last_peered":"2024-08-19T00:39:45.382471+0000","last_clean":"2024-08-19T00:39:45.382471+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:45.382471+0000","last_undegraded":"2024-08-19T00:39:45.382471+0000","last_fullsized":"2024-08-19T00:39:45.382471+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382536+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:45.382536+0000","last_peered":"2024-08-19T00:39:45.382536+0000","last_clean":"2024-08-19T00:39:45.382536+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:45.382536+0000","last_undegraded":"2024-08-19T00:39:45.382536+0000","last_fullsized":"2024-08-19T00:39:45.382536+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501997+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:45.501997+0000","last_peered":"2024-08-19T00:39:45.501997+0000","last_clean":"2024-08-19T00:39:45.501997+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:45.501997+0000","last_undegraded":"2024-08-19T00:39:45.501997+0000","last_fullsized":"2024-08-19T00:39:45.501997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.503011+0000","last_change":"2024-08-19T00:39:45.503011+0000","last_active":"2024-08-19T00:39:45.503011+0000","last_peered":"2024-08-19T00:39:45.503011+0000","last_clean":"2024-08-19T00:39:45.503011+0000","last_became_active":"2024-08-19T00:39:45.502721+0000","last_became_peered":"2024-08-19T00:39:45.502721+0000","last_unstale":"2024-08-19T00:39:45.503011+0000","last_undegraded":"2024-08-19T00:39:45.503011+0000","last_fullsized":"2024-08-19T00:39:45.503011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:29.614257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782954+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:45.782954+0000","last_peered":"2024-08-19T00:39:45.782954+0000","last_clean":"2024-08-19T00:39:45.782954+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:45.782954+0000","last_undegraded":"2024-08-19T00:39:45.782954+0000","last_fullsized":"2024-08-19T00:39:45.782954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501734+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:45.501734+0000","last_peered":"2024-08-19T00:39:45.501734+0000","last_clean":"2024-08-19T00:39:45.501734+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:45.501734+0000","last_undegraded":"2024-08-19T00:39:45.501734+0000","last_fullsized":"2024-08-19T00:39:45.501734+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888699+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:45.888699+0000","last_peered":"2024-08-19T00:39:45.888699+0000","last_clean":"2024-08-19T00:39:45.888699+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:45.888699+0000","last_undegraded":"2024-08-19T00:39:45.888699+0000","last_fullsized":"2024-08-19T00:39:45.888699+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383679+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:45.383679+0000","last_peered":"2024-08-19T00:39:45.383679+0000","last_clean":"2024-08-19T00:39:45.383679+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:45.383679+0000","last_undegraded":"2024-08-19T00:39:45.383679+0000","last_fullsized":"2024-08-19T00:39:45.383679+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783173+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:45.783173+0000","last_peered":"2024-08-19T00:39:45.783173+0000","last_clean":"2024-08-19T00:39:45.783173+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:45.783173+0000","last_undegraded":"2024-08-19T00:39:45.783173+0000","last_fullsized":"2024-08-19T00:39:45.783173+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380687+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:45.380687+0000","last_peered":"2024-08-19T00:39:45.380687+0000","last_clean":"2024-08-19T00:39:45.380687+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:45.380687+0000","last_undegraded":"2024-08-19T00:39:45.380687+0000","last_fullsized":"2024-08-19T00:39:45.380687+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383867+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:45.383867+0000","last_peered":"2024-08-19T00:39:45.383867+0000","last_clean":"2024-08-19T00:39:45.383867+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:45.383867+0000","last_undegraded":"2024-08-19T00:39:45.383867+0000","last_fullsized":"2024-08-19T00:39:45.383867+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550180+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:45.550180+0000","last_peered":"2024-08-19T00:39:45.550180+0000","last_clean":"2024-08-19T00:39:45.550180+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:45.550180+0000","last_undegraded":"2024-08-19T00:39:45.550180+0000","last_fullsized":"2024-08-19T00:39:45.550180+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382185+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:45.382185+0000","last_peered":"2024-08-19T00:39:45.382185+0000","last_clean":"2024-08-19T00:39:45.382185+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:45.382185+0000","last_undegraded":"2024-08-19T00:39:45.382185+0000","last_fullsized":"2024-08-19T00:39:45.382185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550108+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:45.550108+0000","last_peered":"2024-08-19T00:39:45.550108+0000","last_clean":"2024-08-19T00:39:45.550108+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:45.550108+0000","last_undegraded":"2024-08-19T00:39:45.550108+0000","last_fullsized":"2024-08-19T00:39:45.550108+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782786+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:45.782786+0000","last_peered":"2024-08-19T00:39:45.782786+0000","last_clean":"2024-08-19T00:39:45.782786+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:45.782786+0000","last_undegraded":"2024-08-19T00:39:45.782786+0000","last_fullsized":"2024-08-19T00:39:45.782786+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783289+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:45.783289+0000","last_peered":"2024-08-19T00:39:45.783289+0000","last_clean":"2024-08-19T00:39:45.783289+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:45.783289+0000","last_undegraded":"2024-08-19T00:39:45.783289+0000","last_fullsized":"2024-08-19T00:39:45.783289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382446+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:45.382446+0000","last_peered":"2024-08-19T00:39:45.382446+0000","last_clean":"2024-08-19T00:39:45.382446+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:45.382446+0000","last_undegraded":"2024-08-19T00:39:45.382446+0000","last_fullsized":"2024-08-19T00:39:45.382446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382341+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:45.382341+0000","last_peered":"2024-08-19T00:39:45.382341+0000","last_clean":"2024-08-19T00:39:45.382341+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:45.382341+0000","last_undegraded":"2024-08-19T00:39:45.382341+0000","last_fullsized":"2024-08-19T00:39:45.382341+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380550+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:45.380550+0000","last_peered":"2024-08-19T00:39:45.380550+0000","last_clean":"2024-08-19T00:39:45.380550+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:45.380550+0000","last_undegraded":"2024-08-19T00:39:45.380550+0000","last_fullsized":"2024-08-19T00:39:45.380550+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550360+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:45.550360+0000","last_peered":"2024-08-19T00:39:45.550360+0000","last_clean":"2024-08-19T00:39:45.550360+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:45.550360+0000","last_undegraded":"2024-08-19T00:39:45.550360+0000","last_fullsized":"2024-08-19T00:39:45.550360+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380696+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:45.380696+0000","last_peered":"2024-08-19T00:39:45.380696+0000","last_clean":"2024-08-19T00:39:45.380696+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:45.380696+0000","last_undegraded":"2024-08-19T00:39:45.380696+0000","last_fullsized":"2024-08-19T00:39:45.380696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501920+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:45.501920+0000","last_peered":"2024-08-19T00:39:45.501920+0000","last_clean":"2024-08-19T00:39:45.501920+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:45.501920+0000","last_undegraded":"2024-08-19T00:39:45.501920+0000","last_fullsized":"2024-08-19T00:39:45.501920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383308+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:45.383308+0000","last_peered":"2024-08-19T00:39:45.383308+0000","last_clean":"2024-08-19T00:39:45.383308+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:45.383308+0000","last_undegraded":"2024-08-19T00:39:45.383308+0000","last_fullsized":"2024-08-19T00:39:45.383308+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382480+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:45.382480+0000","last_peered":"2024-08-19T00:39:45.382480+0000","last_clean":"2024-08-19T00:39:45.382480+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:45.382480+0000","last_undegraded":"2024-08-19T00:39:45.382480+0000","last_fullsized":"2024-08-19T00:39:45.382480+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550415+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:45.550415+0000","last_peered":"2024-08-19T00:39:45.550415+0000","last_clean":"2024-08-19T00:39:45.550415+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:45.550415+0000","last_undegraded":"2024-08-19T00:39:45.550415+0000","last_fullsized":"2024-08-19T00:39:45.550415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382570+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:45.382570+0000","last_peered":"2024-08-19T00:39:45.382570+0000","last_clean":"2024-08-19T00:39:45.382570+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:45.382570+0000","last_undegraded":"2024-08-19T00:39:45.382570+0000","last_fullsized":"2024-08-19T00:39:45.382570+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888902+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:45.888902+0000","last_peered":"2024-08-19T00:39:45.888902+0000","last_clean":"2024-08-19T00:39:45.888902+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:45.888902+0000","last_undegraded":"2024-08-19T00:39:45.888902+0000","last_fullsized":"2024-08-19T00:39:45.888902+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888885+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:45.888885+0000","last_peered":"2024-08-19T00:39:45.888885+0000","last_clean":"2024-08-19T00:39:45.888885+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:45.888885+0000","last_undegraded":"2024-08-19T00:39:45.888885+0000","last_fullsized":"2024-08-19T00:39:45.888885+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501722+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:45.501722+0000","last_peered":"2024-08-19T00:39:45.501722+0000","last_clean":"2024-08-19T00:39:45.501722+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:45.501722+0000","last_undegraded":"2024-08-19T00:39:45.501722+0000","last_fullsized":"2024-08-19T00:39:45.501722+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382044+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:45.382044+0000","last_peered":"2024-08-19T00:39:45.382044+0000","last_clean":"2024-08-19T00:39:45.382044+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:45.382044+0000","last_undegraded":"2024-08-19T00:39:45.382044+0000","last_fullsized":"2024-08-19T00:39:45.382044+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380406+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:45.380406+0000","last_peered":"2024-08-19T00:39:45.380406+0000","last_clean":"2024-08-19T00:39:45.380406+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:45.380406+0000","last_undegraded":"2024-08-19T00:39:45.380406+0000","last_fullsized":"2024-08-19T00:39:45.380406+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783272+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:45.783272+0000","last_peered":"2024-08-19T00:39:45.783272+0000","last_clean":"2024-08-19T00:39:45.783272+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:45.783272+0000","last_undegraded":"2024-08-19T00:39:45.783272+0000","last_fullsized":"2024-08-19T00:39:45.783272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.381054+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:45.381054+0000","last_peered":"2024-08-19T00:39:45.381054+0000","last_clean":"2024-08-19T00:39:45.381054+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:45.381054+0000","last_undegraded":"2024-08-19T00:39:45.381054+0000","last_fullsized":"2024-08-19T00:39:45.381054+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.385625+0000","last_change":"2024-08-19T00:39:45.385625+0000","last_active":"2024-08-19T00:39:45.385625+0000","last_peered":"2024-08-19T00:39:45.385625+0000","last_clean":"2024-08-19T00:39:45.385625+0000","last_became_active":"2024-08-19T00:39:45.385278+0000","last_became_peered":"2024-08-19T00:39:45.385278+0000","last_unstale":"2024-08-19T00:39:45.385625+0000","last_undegraded":"2024-08-19T00:39:45.385625+0000","last_fullsized":"2024-08-19T00:39:45.385625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382578+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:45.382578+0000","last_peered":"2024-08-19T00:39:45.382578+0000","last_clean":"2024-08-19T00:39:45.382578+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:45.382578+0000","last_undegraded":"2024-08-19T00:39:45.382578+0000","last_fullsized":"2024-08-19T00:39:45.382578+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888935+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:45.888935+0000","last_peered":"2024-08-19T00:39:45.888935+0000","last_clean":"2024-08-19T00:39:45.888935+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:45.888935+0000","last_undegraded":"2024-08-19T00:39:45.888935+0000","last_fullsized":"2024-08-19T00:39:45.888935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783138+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:45.783138+0000","last_peered":"2024-08-19T00:39:45.783138+0000","last_clean":"2024-08-19T00:39:45.783138+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:45.783138+0000","last_undegraded":"2024-08-19T00:39:45.783138+0000","last_fullsized":"2024-08-19T00:39:45.783138+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783074+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:45.783074+0000","last_peered":"2024-08-19T00:39:45.783074+0000","last_clean":"2024-08-19T00:39:45.783074+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:45.783074+0000","last_undegraded":"2024-08-19T00:39:45.783074+0000","last_fullsized":"2024-08-19T00:39:45.783074+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.502079+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:45.502079+0000","last_peered":"2024-08-19T00:39:45.502079+0000","last_clean":"2024-08-19T00:39:45.502079+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:45.502079+0000","last_undegraded":"2024-08-19T00:39:45.502079+0000","last_fullsized":"2024-08-19T00:39:45.502079+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888777+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:45.888777+0000","last_peered":"2024-08-19T00:39:45.888777+0000","last_clean":"2024-08-19T00:39:45.888777+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:45.888777+0000","last_undegraded":"2024-08-19T00:39:45.888777+0000","last_fullsized":"2024-08-19T00:39:45.888777+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382305+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:45.382305+0000","last_peered":"2024-08-19T00:39:45.382305+0000","last_clean":"2024-08-19T00:39:45.382305+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:45.382305+0000","last_undegraded":"2024-08-19T00:39:45.382305+0000","last_fullsized":"2024-08-19T00:39:45.382305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380779+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:45.380779+0000","last_peered":"2024-08-19T00:39:45.380779+0000","last_clean":"2024-08-19T00:39:45.380779+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:45.380779+0000","last_undegraded":"2024-08-19T00:39:45.380779+0000","last_fullsized":"2024-08-19T00:39:45.380779+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783407+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:45.783407+0000","last_peered":"2024-08-19T00:39:45.783407+0000","last_clean":"2024-08-19T00:39:45.783407+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:45.783407+0000","last_undegraded":"2024-08-19T00:39:45.783407+0000","last_fullsized":"2024-08-19T00:39:45.783407+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.381997+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:45.381997+0000","last_peered":"2024-08-19T00:39:45.381997+0000","last_clean":"2024-08-19T00:39:45.381997+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:45.381997+0000","last_undegraded":"2024-08-19T00:39:45.381997+0000","last_fullsized":"2024-08-19T00:39:45.381997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383546+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:45.383546+0000","last_peered":"2024-08-19T00:39:45.383546+0000","last_clean":"2024-08-19T00:39:45.383546+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:45.383546+0000","last_undegraded":"2024-08-19T00:39:45.383546+0000","last_fullsized":"2024-08-19T00:39:45.383546+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782797+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:45.782797+0000","last_peered":"2024-08-19T00:39:45.782797+0000","last_clean":"2024-08-19T00:39:45.782797+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:45.782797+0000","last_undegraded":"2024-08-19T00:39:45.782797+0000","last_fullsized":"2024-08-19T00:39:45.782797+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550073+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:45.550073+0000","last_peered":"2024-08-19T00:39:45.550073+0000","last_clean":"2024-08-19T00:39:45.550073+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:45.550073+0000","last_undegraded":"2024-08-19T00:39:45.550073+0000","last_fullsized":"2024-08-19T00:39:45.550073+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550448+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:45.550448+0000","last_peered":"2024-08-19T00:39:45.550448+0000","last_clean":"2024-08-19T00:39:45.550448+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:45.550448+0000","last_undegraded":"2024-08-19T00:39:45.550448+0000","last_fullsized":"2024-08-19T00:39:45.550448+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383796+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:45.383796+0000","last_peered":"2024-08-19T00:39:45.383796+0000","last_clean":"2024-08-19T00:39:45.383796+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:45.383796+0000","last_undegraded":"2024-08-19T00:39:45.383796+0000","last_fullsized":"2024-08-19T00:39:45.383796+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382774+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:45.382774+0000","last_peered":"2024-08-19T00:39:45.382774+0000","last_clean":"2024-08-19T00:39:45.382774+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:45.382774+0000","last_undegraded":"2024-08-19T00:39:45.382774+0000","last_fullsized":"2024-08-19T00:39:45.382774+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889245+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:45.889245+0000","last_peered":"2024-08-19T00:39:45.889245+0000","last_clean":"2024-08-19T00:39:45.889245+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:45.889245+0000","last_undegraded":"2024-08-19T00:39:45.889245+0000","last_fullsized":"2024-08-19T00:39:45.889245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889263+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:45.889263+0000","last_peered":"2024-08-19T00:39:45.889263+0000","last_clean":"2024-08-19T00:39:45.889263+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:45.889263+0000","last_undegraded":"2024-08-19T00:39:45.889263+0000","last_fullsized":"2024-08-19T00:39:45.889263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":21,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501994+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:45.501994+0000","last_peered":"2024-08-19T00:39:45.501994+0000","last_clean":"2024-08-19T00:39:45.501994+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:45.501994+0000","last_undegraded":"2024-08-19T00:39:45.501994+0000","last_fullsized":"2024-08-19T00:39:45.501994+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501881+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:45.501881+0000","last_peered":"2024-08-19T00:39:45.501881+0000","last_clean":"2024-08-19T00:39:45.501881+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:45.501881+0000","last_undegraded":"2024-08-19T00:39:45.501881+0000","last_fullsized":"2024-08-19T00:39:45.501881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":23,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550362+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:45.550362+0000","last_peered":"2024-08-19T00:39:45.550362+0000","last_clean":"2024-08-19T00:39:45.550362+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:45.550362+0000","last_undegraded":"2024-08-19T00:39:45.550362+0000","last_fullsized":"2024-08-19T00:39:45.550362+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383592+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:45.383592+0000","last_peered":"2024-08-19T00:39:45.383592+0000","last_clean":"2024-08-19T00:39:45.383592+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:45.383592+0000","last_undegraded":"2024-08-19T00:39:45.383592+0000","last_fullsized":"2024-08-19T00:39:45.383592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889432+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:45.889432+0000","last_peered":"2024-08-19T00:39:45.889432+0000","last_clean":"2024-08-19T00:39:45.889432+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:45.889432+0000","last_undegraded":"2024-08-19T00:39:45.889432+0000","last_fullsized":"2024-08-19T00:39:45.889432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382196+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:45.382196+0000","last_peered":"2024-08-19T00:39:45.382196+0000","last_clean":"2024-08-19T00:39:45.382196+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:45.382196+0000","last_undegraded":"2024-08-19T00:39:45.382196+0000","last_fullsized":"2024-08-19T00:39:45.382196+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501990+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:45.501990+0000","last_peered":"2024-08-19T00:39:45.501990+0000","last_clean":"2024-08-19T00:39:45.501990+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:45.501990+0000","last_undegraded":"2024-08-19T00:39:45.501990+0000","last_fullsized":"2024-08-19T00:39:45.501990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383344+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:45.383344+0000","last_peered":"2024-08-19T00:39:45.383344+0000","last_clean":"2024-08-19T00:39:45.383344+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:45.383344+0000","last_undegraded":"2024-08-19T00:39:45.383344+0000","last_fullsized":"2024-08-19T00:39:45.383344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501946+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:45.501946+0000","last_peered":"2024-08-19T00:39:45.501946+0000","last_clean":"2024-08-19T00:39:45.501946+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:45.501946+0000","last_undegraded":"2024-08-19T00:39:45.501946+0000","last_fullsized":"2024-08-19T00:39:45.501946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501852+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:45.501852+0000","last_peered":"2024-08-19T00:39:45.501852+0000","last_clean":"2024-08-19T00:39:45.501852+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:45.501852+0000","last_undegraded":"2024-08-19T00:39:45.501852+0000","last_fullsized":"2024-08-19T00:39:45.501852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":26,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501747+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:45.501747+0000","last_peered":"2024-08-19T00:39:45.501747+0000","last_clean":"2024-08-19T00:39:45.501747+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:45.501747+0000","last_undegraded":"2024-08-19T00:39:45.501747+0000","last_fullsized":"2024-08-19T00:39:45.501747+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382603+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:45.382603+0000","last_peered":"2024-08-19T00:39:45.382603+0000","last_clean":"2024-08-19T00:39:45.382603+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:45.382603+0000","last_undegraded":"2024-08-19T00:39:45.382603+0000","last_fullsized":"2024-08-19T00:39:45.382603+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382568+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:45.382568+0000","last_peered":"2024-08-19T00:39:45.382568+0000","last_clean":"2024-08-19T00:39:45.382568+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:45.382568+0000","last_undegraded":"2024-08-19T00:39:45.382568+0000","last_fullsized":"2024-08-19T00:39:45.382568+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382838+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:45.382838+0000","last_peered":"2024-08-19T00:39:45.382838+0000","last_clean":"2024-08-19T00:39:45.382838+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:45.382838+0000","last_undegraded":"2024-08-19T00:39:45.382838+0000","last_fullsized":"2024-08-19T00:39:45.382838+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889272+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:45.889272+0000","last_peered":"2024-08-19T00:39:45.889272+0000","last_clean":"2024-08-19T00:39:45.889272+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:45.889272+0000","last_undegraded":"2024-08-19T00:39:45.889272+0000","last_fullsized":"2024-08-19T00:39:45.889272+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382086+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:45.382086+0000","last_peered":"2024-08-19T00:39:45.382086+0000","last_clean":"2024-08-19T00:39:45.382086+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:45.382086+0000","last_undegraded":"2024-08-19T00:39:45.382086+0000","last_fullsized":"2024-08-19T00:39:45.382086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382682+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:45.382682+0000","last_peered":"2024-08-19T00:39:45.382682+0000","last_clean":"2024-08-19T00:39:45.382682+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:45.382682+0000","last_undegraded":"2024-08-19T00:39:45.382682+0000","last_fullsized":"2024-08-19T00:39:45.382682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501906+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:45.501906+0000","last_peered":"2024-08-19T00:39:45.501906+0000","last_clean":"2024-08-19T00:39:45.501906+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:45.501906+0000","last_undegraded":"2024-08-19T00:39:45.501906+0000","last_fullsized":"2024-08-19T00:39:45.501906+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889387+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:45.889387+0000","last_peered":"2024-08-19T00:39:45.889387+0000","last_clean":"2024-08-19T00:39:45.889387+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:45.889387+0000","last_undegraded":"2024-08-19T00:39:45.889387+0000","last_fullsized":"2024-08-19T00:39:45.889387+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383709+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:45.383709+0000","last_peered":"2024-08-19T00:39:45.383709+0000","last_clean":"2024-08-19T00:39:45.383709+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:45.383709+0000","last_undegraded":"2024-08-19T00:39:45.383709+0000","last_fullsized":"2024-08-19T00:39:45.383709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380839+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:45.380839+0000","last_peered":"2024-08-19T00:39:45.380839+0000","last_clean":"2024-08-19T00:39:45.380839+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:45.380839+0000","last_undegraded":"2024-08-19T00:39:45.380839+0000","last_fullsized":"2024-08-19T00:39:45.380839+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889417+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:45.889417+0000","last_peered":"2024-08-19T00:39:45.889417+0000","last_clean":"2024-08-19T00:39:45.889417+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:45.889417+0000","last_undegraded":"2024-08-19T00:39:45.889417+0000","last_fullsized":"2024-08-19T00:39:45.889417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888925+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:45.888925+0000","last_peered":"2024-08-19T00:39:45.888925+0000","last_clean":"2024-08-19T00:39:45.888925+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:45.888925+0000","last_undegraded":"2024-08-19T00:39:45.888925+0000","last_fullsized":"2024-08-19T00:39:45.888925+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888761+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:45.888761+0000","last_peered":"2024-08-19T00:39:45.888761+0000","last_clean":"2024-08-19T00:39:45.888761+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:45.888761+0000","last_undegraded":"2024-08-19T00:39:45.888761+0000","last_fullsized":"2024-08-19T00:39:45.888761+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383461+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:45.383461+0000","last_peered":"2024-08-19T00:39:45.383461+0000","last_clean":"2024-08-19T00:39:45.383461+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:45.383461+0000","last_undegraded":"2024-08-19T00:39:45.383461+0000","last_fullsized":"2024-08-19T00:39:45.383461+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382670+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:45.382670+0000","last_peered":"2024-08-19T00:39:45.382670+0000","last_clean":"2024-08-19T00:39:45.382670+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:45.382670+0000","last_undegraded":"2024-08-19T00:39:45.382670+0000","last_fullsized":"2024-08-19T00:39:45.382670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382604+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:45.382604+0000","last_peered":"2024-08-19T00:39:45.382604+0000","last_clean":"2024-08-19T00:39:45.382604+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:45.382604+0000","last_undegraded":"2024-08-19T00:39:45.382604+0000","last_fullsized":"2024-08-19T00:39:45.382604+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382900+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:45.382900+0000","last_peered":"2024-08-19T00:39:45.382900+0000","last_clean":"2024-08-19T00:39:45.382900+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:45.382900+0000","last_undegraded":"2024-08-19T00:39:45.382900+0000","last_fullsized":"2024-08-19T00:39:45.382900+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783299+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:45.783299+0000","last_peered":"2024-08-19T00:39:45.783299+0000","last_clean":"2024-08-19T00:39:45.783299+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:45.783299+0000","last_undegraded":"2024-08-19T00:39:45.783299+0000","last_fullsized":"2024-08-19T00:39:45.783299+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382247+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:45.382247+0000","last_peered":"2024-08-19T00:39:45.382247+0000","last_clean":"2024-08-19T00:39:45.382247+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:45.382247+0000","last_undegraded":"2024-08-19T00:39:45.382247+0000","last_fullsized":"2024-08-19T00:39:45.382247+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383622+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:45.383622+0000","last_peered":"2024-08-19T00:39:45.383622+0000","last_clean":"2024-08-19T00:39:45.383622+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:45.383622+0000","last_undegraded":"2024-08-19T00:39:45.383622+0000","last_fullsized":"2024-08-19T00:39:45.383622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889148+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:45.889148+0000","last_peered":"2024-08-19T00:39:45.889148+0000","last_clean":"2024-08-19T00:39:45.889148+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:45.889148+0000","last_undegraded":"2024-08-19T00:39:45.889148+0000","last_fullsized":"2024-08-19T00:39:45.889148+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382452+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:45.382452+0000","last_peered":"2024-08-19T00:39:45.382452+0000","last_clean":"2024-08-19T00:39:45.382452+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:45.382452+0000","last_undegraded":"2024-08-19T00:39:45.382452+0000","last_fullsized":"2024-08-19T00:39:45.382452+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783004+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:45.783004+0000","last_peered":"2024-08-19T00:39:45.783004+0000","last_clean":"2024-08-19T00:39:45.783004+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:45.783004+0000","last_undegraded":"2024-08-19T00:39:45.783004+0000","last_fullsized":"2024-08-19T00:39:45.783004+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382207+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:45.382207+0000","last_peered":"2024-08-19T00:39:45.382207+0000","last_clean":"2024-08-19T00:39:45.382207+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:45.382207+0000","last_undegraded":"2024-08-19T00:39:45.382207+0000","last_fullsized":"2024-08-19T00:39:45.382207+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550332+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:45.550332+0000","last_peered":"2024-08-19T00:39:45.550332+0000","last_clean":"2024-08-19T00:39:45.550332+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:45.550332+0000","last_undegraded":"2024-08-19T00:39:45.550332+0000","last_fullsized":"2024-08-19T00:39:45.550332+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382238+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:45.382238+0000","last_peered":"2024-08-19T00:39:45.382238+0000","last_clean":"2024-08-19T00:39:45.382238+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:45.382238+0000","last_undegraded":"2024-08-19T00:39:45.382238+0000","last_fullsized":"2024-08-19T00:39:45.382238+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888731+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:45.888731+0000","last_peered":"2024-08-19T00:39:45.888731+0000","last_clean":"2024-08-19T00:39:45.888731+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:45.888731+0000","last_undegraded":"2024-08-19T00:39:45.888731+0000","last_fullsized":"2024-08-19T00:39:45.888731+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782907+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:45.782907+0000","last_peered":"2024-08-19T00:39:45.782907+0000","last_clean":"2024-08-19T00:39:45.782907+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:45.782907+0000","last_undegraded":"2024-08-19T00:39:45.782907+0000","last_fullsized":"2024-08-19T00:39:45.782907+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382086+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:45.382086+0000","last_peered":"2024-08-19T00:39:45.382086+0000","last_clean":"2024-08-19T00:39:45.382086+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:45.382086+0000","last_undegraded":"2024-08-19T00:39:45.382086+0000","last_fullsized":"2024-08-19T00:39:45.382086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889088+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:45.889088+0000","last_peered":"2024-08-19T00:39:45.889088+0000","last_clean":"2024-08-19T00:39:45.889088+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:45.889088+0000","last_undegraded":"2024-08-19T00:39:45.889088+0000","last_fullsized":"2024-08-19T00:39:45.889088+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889124+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:45.889124+0000","last_peered":"2024-08-19T00:39:45.889124+0000","last_clean":"2024-08-19T00:39:45.889124+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:45.889124+0000","last_undegraded":"2024-08-19T00:39:45.889124+0000","last_fullsized":"2024-08-19T00:39:45.889124+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550127+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:45.550127+0000","last_peered":"2024-08-19T00:39:45.550127+0000","last_clean":"2024-08-19T00:39:45.550127+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:45.550127+0000","last_undegraded":"2024-08-19T00:39:45.550127+0000","last_fullsized":"2024-08-19T00:39:45.550127+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":241,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383446+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:45.383446+0000","last_peered":"2024-08-19T00:39:45.383446+0000","last_clean":"2024-08-19T00:39:45.383446+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:45.383446+0000","last_undegraded":"2024-08-19T00:39:45.383446+0000","last_fullsized":"2024-08-19T00:39:45.383446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":296800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":712704,"data_stored":296730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1306624,"data_stored":887110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":297324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":712704,"data_stored":296798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":298480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1306624,"data_stored":887658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":720896,"data_stored":298320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:54.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:39:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.630+0000 7fd50e000640 1 Processor -- start 2024-08-19T00:39:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.630+0000 7fd50e000640 1 -- start start 2024-08-19T00:39:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.631+0000 7fd50e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd508159bf0 0x7fd508073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.631+0000 7fd50e000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5080739a0 0x7fd5080ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.631+0000 7fd50e000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50806f7f0 con 0x7fd5080cea40 2024-08-19T00:39:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.631+0000 7fd50e000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd50806f510 con 0x7fd5080739a0 2024-08-19T00:39:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.631+0000 7fd50e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd508072980 con 0x7fd508159bf0 2024-08-19T00:39:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd506a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5080739a0 0x7fd5080ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd506a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5080739a0 0x7fd5080ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:35160/0 (socket says 172.21.15.7:35160) 2024-08-19T00:39:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd506a00640 1 -- 172.21.15.7:0/2387434813 learned_addr learned my addr 172.21.15.7:0/2387434813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd507400640 1 --2- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd508159bf0 0x7fd508073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd506a00640 1 -- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd508159bf0 msgr2=0x7fd508073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd506a00640 1 --2- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd508159bf0 0x7fd508073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd506a00640 1 -- 172.21.15.7:0/2387434813 >> v1:172.21.15.162:6789/0 conn(0x7fd5080cea40 legacy=0x7fd5080d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.632+0000 7fd506a00640 1 -- 172.21.15.7:0/2387434813 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd508072c60 con 0x7fd5080739a0 2024-08-19T00:39:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.633+0000 7fd506a00640 1 --2- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd5080ce500 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009870 tx=0x7fd4f402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea40a222c9aa47f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd506000640 1 -- 172.21.15.7:0/2387434813 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4037070 con 0x7fd5080739a0 2024-08-19T00:39:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd506000640 1 -- 172.21.15.7:0/2387434813 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f4032440 con 0x7fd5080739a0 2024-08-19T00:39:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd506000640 1 -- 172.21.15.7:0/2387434813 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4032810 con 0x7fd5080739a0 2024-08-19T00:39:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd50e000640 1 -- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 msgr2=0x7fd5080ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd50e000640 1 --2- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd5080ce500 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009870 tx=0x7fd4f402a180 comp rx=0 tx=0).stop 2024-08-19T00:39:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd50e000640 1 -- 172.21.15.7:0/2387434813 shutdown_connections 2024-08-19T00:39:54.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd50e000640 1 --2- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd5080ce500 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd50e000640 1 --2- 172.21.15.7:0/2387434813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd508159bf0 0x7fd508073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.634+0000 7fd50e000640 1 -- 172.21.15.7:0/2387434813 >> 172.21.15.7:0/2387434813 conn(0x7fd50806bc70 msgr2=0x7fd50806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:54.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.635+0000 7fd50e000640 1 -- 172.21.15.7:0/2387434813 shutdown_connections 2024-08-19T00:39:54.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.635+0000 7fd50e000640 1 -- 172.21.15.7:0/2387434813 wait complete. 2024-08-19T00:39:54.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.636+0000 7fd50e000640 1 Processor -- start 2024-08-19T00:39:54.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.636+0000 7fd50e000640 1 -- start start 2024-08-19T00:39:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.637+0000 7fd50e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd508148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.637+0000 7fd50e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5080cea40 0x7fd50809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.637+0000 7fd50e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd508159bf0 0x7fd508148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.637+0000 7fd50e000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd50815a150 con 0x7fd508159bf0 2024-08-19T00:39:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.637+0000 7fd50e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd508159fd0 con 0x7fd5080739a0 2024-08-19T00:39:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.637+0000 7fd50e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5080d0ad0 con 0x7fd5080cea40 2024-08-19T00:39:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.637+0000 7fd507e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd508159bf0 0x7fd508148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd508159bf0 0x7fd508148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32940/0 (socket says 172.21.15.7:32940) 2024-08-19T00:39:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 -- 172.21.15.7:0/2631412906 learned_addr learned my addr 172.21.15.7:0/2631412906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507400640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd508148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 -- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5080cea40 msgr2=0x7fd50809af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd506a00640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5080cea40 0x7fd50809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5080cea40 0x7fd50809af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 -- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 msgr2=0x7fd508148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd508148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 -- 172.21.15.7:0/2631412906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd508157e60 con 0x7fd508159bf0 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507400640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd508148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd506a00640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5080cea40 0x7fd50809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd507e00640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd508159bf0 0x7fd508148e10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c7b0 tx=0x7fd50000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.638+0000 7fd4ff400640 1 -- 172.21.15.7:0/2631412906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500004b60 con 0x7fd508159bf0 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.639+0000 7fd4ff400640 1 -- 172.21.15.7:0/2631412906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd500004d00 con 0x7fd508159bf0 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.639+0000 7fd4ff400640 1 -- 172.21.15.7:0/2631412906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50000aa90 con 0x7fd508159bf0 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.639+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50809a430 con 0x7fd508159bf0 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.639+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50809a9f0 con 0x7fd508159bf0 2024-08-19T00:39:54.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.640+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50809abf0 con 0x7fd508159bf0 2024-08-19T00:39:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.641+0000 7fd4ff400640 1 -- 172.21.15.7:0/2631412906 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd50000ac30 con 0x7fd508159bf0 2024-08-19T00:39:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.642+0000 7fd4ff400640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4e806be30 0x7fd4e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.642+0000 7fd4ff400640 1 -- 172.21.15.7:0/2631412906 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7fd50008b170 con 0x7fd508159bf0 2024-08-19T00:39:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.642+0000 7fd507400640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4e806be30 0x7fd4e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.643+0000 7fd507400640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4e806be30 0x7fd4e806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8006fd0 tx=0x7fd4f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:54.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.647+0000 7fd4ff400640 1 -- 172.21.15.7:0/2631412906 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd50809abf0 con 0x7fd508159bf0 2024-08-19T00:39:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.829+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5080ce500 con 0x7fd4e806be30 2024-08-19T00:39:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.835+0000 7fd4ff400640 1 -- 172.21.15.7:0/2631412906 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7fd5080ce500 con 0x7fd4e806be30 2024-08-19T00:39:54.840 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:54.841 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:39:54.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4e806be30 msgr2=0x7fd4e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:54.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4e806be30 0x7fd4e806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8006fd0 tx=0x7fd4f8008040 comp rx=0 tx=0).stop 2024-08-19T00:39:54.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd508159bf0 msgr2=0x7fd508148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:54.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd508159bf0 0x7fd508148e10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c7b0 tx=0x7fd50000cc70 comp rx=0 tx=0).stop 2024-08-19T00:39:54.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 shutdown_connections 2024-08-19T00:39:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4e806be30 0x7fd4e806e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd508159bf0 0x7fd508148e10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5080cea40 0x7fd50809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 --2- 172.21.15.7:0/2631412906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5080739a0 0x7fd508148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 >> 172.21.15.7:0/2631412906 conn(0x7fd50806bc70 msgr2=0x7fd5080b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.839+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 shutdown_connections 2024-08-19T00:39:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:54.840+0000 7fd50e000640 1 -- 172.21.15.7:0/2631412906 wait complete. 2024-08-19T00:39:54.857 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-19T00:39:53.293795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243736,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730984,"statfs":{"total":773094113280,"available":772844527616,"internally_reserved":0,"allocated":6922240,"data_stored":3559220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.927645"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783167+0000","last_change":"2024-08-19T00:39:36.168601+0000","last_active":"2024-08-19T00:39:45.783167+0000","last_peered":"2024-08-19T00:39:45.783167+0000","last_clean":"2024-08-19T00:39:45.783167+0000","last_became_active":"2024-08-19T00:39:36.166116+0000","last_became_peered":"2024-08-19T00:39:36.166116+0000","last_unstale":"2024-08-19T00:39:45.783167+0000","last_undegraded":"2024-08-19T00:39:45.783167+0000","last_fullsized":"2024-08-19T00:39:45.783167+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382471+0000","last_change":"2024-08-19T00:39:36.171539+0000","last_active":"2024-08-19T00:39:45.382471+0000","last_peered":"2024-08-19T00:39:45.382471+0000","last_clean":"2024-08-19T00:39:45.382471+0000","last_became_active":"2024-08-19T00:39:36.171341+0000","last_became_peered":"2024-08-19T00:39:36.171341+0000","last_unstale":"2024-08-19T00:39:45.382471+0000","last_undegraded":"2024-08-19T00:39:45.382471+0000","last_fullsized":"2024-08-19T00:39:45.382471+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:59.846386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382536+0000","last_change":"2024-08-19T00:39:36.144382+0000","last_active":"2024-08-19T00:39:45.382536+0000","last_peered":"2024-08-19T00:39:45.382536+0000","last_clean":"2024-08-19T00:39:45.382536+0000","last_became_active":"2024-08-19T00:39:36.142706+0000","last_became_peered":"2024-08-19T00:39:36.142706+0000","last_unstale":"2024-08-19T00:39:45.382536+0000","last_undegraded":"2024-08-19T00:39:45.382536+0000","last_fullsized":"2024-08-19T00:39:45.382536+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501997+0000","last_change":"2024-08-19T00:39:36.157189+0000","last_active":"2024-08-19T00:39:45.501997+0000","last_peered":"2024-08-19T00:39:45.501997+0000","last_clean":"2024-08-19T00:39:45.501997+0000","last_became_active":"2024-08-19T00:39:36.156935+0000","last_became_peered":"2024-08-19T00:39:36.156935+0000","last_unstale":"2024-08-19T00:39:45.501997+0000","last_undegraded":"2024-08-19T00:39:45.501997+0000","last_fullsized":"2024-08-19T00:39:45.501997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.503011+0000","last_change":"2024-08-19T00:39:45.503011+0000","last_active":"2024-08-19T00:39:45.503011+0000","last_peered":"2024-08-19T00:39:45.503011+0000","last_clean":"2024-08-19T00:39:45.503011+0000","last_became_active":"2024-08-19T00:39:45.502721+0000","last_became_peered":"2024-08-19T00:39:45.502721+0000","last_unstale":"2024-08-19T00:39:45.503011+0000","last_undegraded":"2024-08-19T00:39:45.503011+0000","last_fullsized":"2024-08-19T00:39:45.503011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:29.614257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782954+0000","last_change":"2024-08-19T00:39:36.161798+0000","last_active":"2024-08-19T00:39:45.782954+0000","last_peered":"2024-08-19T00:39:45.782954+0000","last_clean":"2024-08-19T00:39:45.782954+0000","last_became_active":"2024-08-19T00:39:36.156155+0000","last_became_peered":"2024-08-19T00:39:36.156155+0000","last_unstale":"2024-08-19T00:39:45.782954+0000","last_undegraded":"2024-08-19T00:39:45.782954+0000","last_fullsized":"2024-08-19T00:39:45.782954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501734+0000","last_change":"2024-08-19T00:39:36.147466+0000","last_active":"2024-08-19T00:39:45.501734+0000","last_peered":"2024-08-19T00:39:45.501734+0000","last_clean":"2024-08-19T00:39:45.501734+0000","last_became_active":"2024-08-19T00:39:36.145829+0000","last_became_peered":"2024-08-19T00:39:36.145829+0000","last_unstale":"2024-08-19T00:39:45.501734+0000","last_undegraded":"2024-08-19T00:39:45.501734+0000","last_fullsized":"2024-08-19T00:39:45.501734+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:05:06.934318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888699+0000","last_change":"2024-08-19T00:39:36.154105+0000","last_active":"2024-08-19T00:39:45.888699+0000","last_peered":"2024-08-19T00:39:45.888699+0000","last_clean":"2024-08-19T00:39:45.888699+0000","last_became_active":"2024-08-19T00:39:36.153706+0000","last_became_peered":"2024-08-19T00:39:36.153706+0000","last_unstale":"2024-08-19T00:39:45.888699+0000","last_undegraded":"2024-08-19T00:39:45.888699+0000","last_fullsized":"2024-08-19T00:39:45.888699+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383679+0000","last_change":"2024-08-19T00:39:36.167511+0000","last_active":"2024-08-19T00:39:45.383679+0000","last_peered":"2024-08-19T00:39:45.383679+0000","last_clean":"2024-08-19T00:39:45.383679+0000","last_became_active":"2024-08-19T00:39:36.166852+0000","last_became_peered":"2024-08-19T00:39:36.166852+0000","last_unstale":"2024-08-19T00:39:45.383679+0000","last_undegraded":"2024-08-19T00:39:45.383679+0000","last_fullsized":"2024-08-19T00:39:45.383679+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783173+0000","last_change":"2024-08-19T00:39:36.154668+0000","last_active":"2024-08-19T00:39:45.783173+0000","last_peered":"2024-08-19T00:39:45.783173+0000","last_clean":"2024-08-19T00:39:45.783173+0000","last_became_active":"2024-08-19T00:39:36.153702+0000","last_became_peered":"2024-08-19T00:39:36.153702+0000","last_unstale":"2024-08-19T00:39:45.783173+0000","last_undegraded":"2024-08-19T00:39:45.783173+0000","last_fullsized":"2024-08-19T00:39:45.783173+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380687+0000","last_change":"2024-08-19T00:39:36.160516+0000","last_active":"2024-08-19T00:39:45.380687+0000","last_peered":"2024-08-19T00:39:45.380687+0000","last_clean":"2024-08-19T00:39:45.380687+0000","last_became_active":"2024-08-19T00:39:36.160127+0000","last_became_peered":"2024-08-19T00:39:36.160127+0000","last_unstale":"2024-08-19T00:39:45.380687+0000","last_undegraded":"2024-08-19T00:39:45.380687+0000","last_fullsized":"2024-08-19T00:39:45.380687+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383867+0000","last_change":"2024-08-19T00:39:36.140526+0000","last_active":"2024-08-19T00:39:45.383867+0000","last_peered":"2024-08-19T00:39:45.383867+0000","last_clean":"2024-08-19T00:39:45.383867+0000","last_became_active":"2024-08-19T00:39:36.140209+0000","last_became_peered":"2024-08-19T00:39:36.140209+0000","last_unstale":"2024-08-19T00:39:45.383867+0000","last_undegraded":"2024-08-19T00:39:45.383867+0000","last_fullsized":"2024-08-19T00:39:45.383867+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550180+0000","last_change":"2024-08-19T00:39:36.151408+0000","last_active":"2024-08-19T00:39:45.550180+0000","last_peered":"2024-08-19T00:39:45.550180+0000","last_clean":"2024-08-19T00:39:45.550180+0000","last_became_active":"2024-08-19T00:39:36.150813+0000","last_became_peered":"2024-08-19T00:39:36.150813+0000","last_unstale":"2024-08-19T00:39:45.550180+0000","last_undegraded":"2024-08-19T00:39:45.550180+0000","last_fullsized":"2024-08-19T00:39:45.550180+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:28.144701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382185+0000","last_change":"2024-08-19T00:39:36.151327+0000","last_active":"2024-08-19T00:39:45.382185+0000","last_peered":"2024-08-19T00:39:45.382185+0000","last_clean":"2024-08-19T00:39:45.382185+0000","last_became_active":"2024-08-19T00:39:36.151031+0000","last_became_peered":"2024-08-19T00:39:36.151031+0000","last_unstale":"2024-08-19T00:39:45.382185+0000","last_undegraded":"2024-08-19T00:39:45.382185+0000","last_fullsized":"2024-08-19T00:39:45.382185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550108+0000","last_change":"2024-08-19T00:39:36.145553+0000","last_active":"2024-08-19T00:39:45.550108+0000","last_peered":"2024-08-19T00:39:45.550108+0000","last_clean":"2024-08-19T00:39:45.550108+0000","last_became_active":"2024-08-19T00:39:36.145234+0000","last_became_peered":"2024-08-19T00:39:36.145234+0000","last_unstale":"2024-08-19T00:39:45.550108+0000","last_undegraded":"2024-08-19T00:39:45.550108+0000","last_fullsized":"2024-08-19T00:39:45.550108+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782786+0000","last_change":"2024-08-19T00:39:36.154170+0000","last_active":"2024-08-19T00:39:45.782786+0000","last_peered":"2024-08-19T00:39:45.782786+0000","last_clean":"2024-08-19T00:39:45.782786+0000","last_became_active":"2024-08-19T00:39:36.153207+0000","last_became_peered":"2024-08-19T00:39:36.153207+0000","last_unstale":"2024-08-19T00:39:45.782786+0000","last_undegraded":"2024-08-19T00:39:45.782786+0000","last_fullsized":"2024-08-19T00:39:45.782786+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:14.334714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783289+0000","last_change":"2024-08-19T00:39:36.162856+0000","last_active":"2024-08-19T00:39:45.783289+0000","last_peered":"2024-08-19T00:39:45.783289+0000","last_clean":"2024-08-19T00:39:45.783289+0000","last_became_active":"2024-08-19T00:39:36.162299+0000","last_became_peered":"2024-08-19T00:39:36.162299+0000","last_unstale":"2024-08-19T00:39:45.783289+0000","last_undegraded":"2024-08-19T00:39:45.783289+0000","last_fullsized":"2024-08-19T00:39:45.783289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382446+0000","last_change":"2024-08-19T00:39:36.155635+0000","last_active":"2024-08-19T00:39:45.382446+0000","last_peered":"2024-08-19T00:39:45.382446+0000","last_clean":"2024-08-19T00:39:45.382446+0000","last_became_active":"2024-08-19T00:39:36.155359+0000","last_became_peered":"2024-08-19T00:39:36.155359+0000","last_unstale":"2024-08-19T00:39:45.382446+0000","last_undegraded":"2024-08-19T00:39:45.382446+0000","last_fullsized":"2024-08-19T00:39:45.382446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382341+0000","last_change":"2024-08-19T00:39:36.172045+0000","last_active":"2024-08-19T00:39:45.382341+0000","last_peered":"2024-08-19T00:39:45.382341+0000","last_clean":"2024-08-19T00:39:45.382341+0000","last_became_active":"2024-08-19T00:39:36.171741+0000","last_became_peered":"2024-08-19T00:39:36.171741+0000","last_unstale":"2024-08-19T00:39:45.382341+0000","last_undegraded":"2024-08-19T00:39:45.382341+0000","last_fullsized":"2024-08-19T00:39:45.382341+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:49.151218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380550+0000","last_change":"2024-08-19T00:39:36.155220+0000","last_active":"2024-08-19T00:39:45.380550+0000","last_peered":"2024-08-19T00:39:45.380550+0000","last_clean":"2024-08-19T00:39:45.380550+0000","last_became_active":"2024-08-19T00:39:36.154911+0000","last_became_peered":"2024-08-19T00:39:36.154911+0000","last_unstale":"2024-08-19T00:39:45.380550+0000","last_undegraded":"2024-08-19T00:39:45.380550+0000","last_fullsized":"2024-08-19T00:39:45.380550+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550360+0000","last_change":"2024-08-19T00:39:36.147509+0000","last_active":"2024-08-19T00:39:45.550360+0000","last_peered":"2024-08-19T00:39:45.550360+0000","last_clean":"2024-08-19T00:39:45.550360+0000","last_became_active":"2024-08-19T00:39:36.147219+0000","last_became_peered":"2024-08-19T00:39:36.147219+0000","last_unstale":"2024-08-19T00:39:45.550360+0000","last_undegraded":"2024-08-19T00:39:45.550360+0000","last_fullsized":"2024-08-19T00:39:45.550360+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380696+0000","last_change":"2024-08-19T00:39:36.150969+0000","last_active":"2024-08-19T00:39:45.380696+0000","last_peered":"2024-08-19T00:39:45.380696+0000","last_clean":"2024-08-19T00:39:45.380696+0000","last_became_active":"2024-08-19T00:39:36.149987+0000","last_became_peered":"2024-08-19T00:39:36.149987+0000","last_unstale":"2024-08-19T00:39:45.380696+0000","last_undegraded":"2024-08-19T00:39:45.380696+0000","last_fullsized":"2024-08-19T00:39:45.380696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:59.724593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501920+0000","last_change":"2024-08-19T00:39:36.158300+0000","last_active":"2024-08-19T00:39:45.501920+0000","last_peered":"2024-08-19T00:39:45.501920+0000","last_clean":"2024-08-19T00:39:45.501920+0000","last_became_active":"2024-08-19T00:39:36.156417+0000","last_became_peered":"2024-08-19T00:39:36.156417+0000","last_unstale":"2024-08-19T00:39:45.501920+0000","last_undegraded":"2024-08-19T00:39:45.501920+0000","last_fullsized":"2024-08-19T00:39:45.501920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:09.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383308+0000","last_change":"2024-08-19T00:39:36.160165+0000","last_active":"2024-08-19T00:39:45.383308+0000","last_peered":"2024-08-19T00:39:45.383308+0000","last_clean":"2024-08-19T00:39:45.383308+0000","last_became_active":"2024-08-19T00:39:36.159883+0000","last_became_peered":"2024-08-19T00:39:36.159883+0000","last_unstale":"2024-08-19T00:39:45.383308+0000","last_undegraded":"2024-08-19T00:39:45.383308+0000","last_fullsized":"2024-08-19T00:39:45.383308+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:05.559350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382480+0000","last_change":"2024-08-19T00:39:36.174739+0000","last_active":"2024-08-19T00:39:45.382480+0000","last_peered":"2024-08-19T00:39:45.382480+0000","last_clean":"2024-08-19T00:39:45.382480+0000","last_became_active":"2024-08-19T00:39:36.174426+0000","last_became_peered":"2024-08-19T00:39:36.174426+0000","last_unstale":"2024-08-19T00:39:45.382480+0000","last_undegraded":"2024-08-19T00:39:45.382480+0000","last_fullsized":"2024-08-19T00:39:45.382480+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550415+0000","last_change":"2024-08-19T00:39:36.144917+0000","last_active":"2024-08-19T00:39:45.550415+0000","last_peered":"2024-08-19T00:39:45.550415+0000","last_clean":"2024-08-19T00:39:45.550415+0000","last_became_active":"2024-08-19T00:39:36.144247+0000","last_became_peered":"2024-08-19T00:39:36.144247+0000","last_unstale":"2024-08-19T00:39:45.550415+0000","last_undegraded":"2024-08-19T00:39:45.550415+0000","last_fullsized":"2024-08-19T00:39:45.550415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382570+0000","last_change":"2024-08-19T00:39:36.168971+0000","last_active":"2024-08-19T00:39:45.382570+0000","last_peered":"2024-08-19T00:39:45.382570+0000","last_clean":"2024-08-19T00:39:45.382570+0000","last_became_active":"2024-08-19T00:39:36.163875+0000","last_became_peered":"2024-08-19T00:39:36.163875+0000","last_unstale":"2024-08-19T00:39:45.382570+0000","last_undegraded":"2024-08-19T00:39:45.382570+0000","last_fullsized":"2024-08-19T00:39:45.382570+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:59.028301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888902+0000","last_change":"2024-08-19T00:39:36.161889+0000","last_active":"2024-08-19T00:39:45.888902+0000","last_peered":"2024-08-19T00:39:45.888902+0000","last_clean":"2024-08-19T00:39:45.888902+0000","last_became_active":"2024-08-19T00:39:36.161614+0000","last_became_peered":"2024-08-19T00:39:36.161614+0000","last_unstale":"2024-08-19T00:39:45.888902+0000","last_undegraded":"2024-08-19T00:39:45.888902+0000","last_fullsized":"2024-08-19T00:39:45.888902+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:19.084822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888885+0000","last_change":"2024-08-19T00:39:36.150361+0000","last_active":"2024-08-19T00:39:45.888885+0000","last_peered":"2024-08-19T00:39:45.888885+0000","last_clean":"2024-08-19T00:39:45.888885+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:45.888885+0000","last_undegraded":"2024-08-19T00:39:45.888885+0000","last_fullsized":"2024-08-19T00:39:45.888885+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:11.781249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501722+0000","last_change":"2024-08-19T00:39:36.138762+0000","last_active":"2024-08-19T00:39:45.501722+0000","last_peered":"2024-08-19T00:39:45.501722+0000","last_clean":"2024-08-19T00:39:45.501722+0000","last_became_active":"2024-08-19T00:39:36.138427+0000","last_became_peered":"2024-08-19T00:39:36.138427+0000","last_unstale":"2024-08-19T00:39:45.501722+0000","last_undegraded":"2024-08-19T00:39:45.501722+0000","last_fullsized":"2024-08-19T00:39:45.501722+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382044+0000","last_change":"2024-08-19T00:39:36.161080+0000","last_active":"2024-08-19T00:39:45.382044+0000","last_peered":"2024-08-19T00:39:45.382044+0000","last_clean":"2024-08-19T00:39:45.382044+0000","last_became_active":"2024-08-19T00:39:36.160294+0000","last_became_peered":"2024-08-19T00:39:36.160294+0000","last_unstale":"2024-08-19T00:39:45.382044+0000","last_undegraded":"2024-08-19T00:39:45.382044+0000","last_fullsized":"2024-08-19T00:39:45.382044+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:33:52.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380406+0000","last_change":"2024-08-19T00:39:36.147943+0000","last_active":"2024-08-19T00:39:45.380406+0000","last_peered":"2024-08-19T00:39:45.380406+0000","last_clean":"2024-08-19T00:39:45.380406+0000","last_became_active":"2024-08-19T00:39:36.147626+0000","last_became_peered":"2024-08-19T00:39:36.147626+0000","last_unstale":"2024-08-19T00:39:45.380406+0000","last_undegraded":"2024-08-19T00:39:45.380406+0000","last_fullsized":"2024-08-19T00:39:45.380406+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:23.398459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783272+0000","last_change":"2024-08-19T00:39:36.142894+0000","last_active":"2024-08-19T00:39:45.783272+0000","last_peered":"2024-08-19T00:39:45.783272+0000","last_clean":"2024-08-19T00:39:45.783272+0000","last_became_active":"2024-08-19T00:39:36.142568+0000","last_became_peered":"2024-08-19T00:39:36.142568+0000","last_unstale":"2024-08-19T00:39:45.783272+0000","last_undegraded":"2024-08-19T00:39:45.783272+0000","last_fullsized":"2024-08-19T00:39:45.783272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.381054+0000","last_change":"2024-08-19T00:39:35.146849+0000","last_active":"2024-08-19T00:39:45.381054+0000","last_peered":"2024-08-19T00:39:45.381054+0000","last_clean":"2024-08-19T00:39:45.381054+0000","last_became_active":"2024-08-19T00:39:35.146511+0000","last_became_peered":"2024-08-19T00:39:35.146511+0000","last_unstale":"2024-08-19T00:39:45.381054+0000","last_undegraded":"2024-08-19T00:39:45.381054+0000","last_fullsized":"2024-08-19T00:39:45.381054+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:33.342547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.385625+0000","last_change":"2024-08-19T00:39:45.385625+0000","last_active":"2024-08-19T00:39:45.385625+0000","last_peered":"2024-08-19T00:39:45.385625+0000","last_clean":"2024-08-19T00:39:45.385625+0000","last_became_active":"2024-08-19T00:39:45.385278+0000","last_became_peered":"2024-08-19T00:39:45.385278+0000","last_unstale":"2024-08-19T00:39:45.385625+0000","last_undegraded":"2024-08-19T00:39:45.385625+0000","last_fullsized":"2024-08-19T00:39:45.385625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:58.755171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382578+0000","last_change":"2024-08-19T00:39:35.143854+0000","last_active":"2024-08-19T00:39:45.382578+0000","last_peered":"2024-08-19T00:39:45.382578+0000","last_clean":"2024-08-19T00:39:45.382578+0000","last_became_active":"2024-08-19T00:39:35.143560+0000","last_became_peered":"2024-08-19T00:39:35.143560+0000","last_unstale":"2024-08-19T00:39:45.382578+0000","last_undegraded":"2024-08-19T00:39:45.382578+0000","last_fullsized":"2024-08-19T00:39:45.382578+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:38.223879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888935+0000","last_change":"2024-08-19T00:39:36.168301+0000","last_active":"2024-08-19T00:39:45.888935+0000","last_peered":"2024-08-19T00:39:45.888935+0000","last_clean":"2024-08-19T00:39:45.888935+0000","last_became_active":"2024-08-19T00:39:36.167953+0000","last_became_peered":"2024-08-19T00:39:36.167953+0000","last_unstale":"2024-08-19T00:39:45.888935+0000","last_undegraded":"2024-08-19T00:39:45.888935+0000","last_fullsized":"2024-08-19T00:39:45.888935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:52.827204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783138+0000","last_change":"2024-08-19T00:39:35.153344+0000","last_active":"2024-08-19T00:39:45.783138+0000","last_peered":"2024-08-19T00:39:45.783138+0000","last_clean":"2024-08-19T00:39:45.783138+0000","last_became_active":"2024-08-19T00:39:35.153002+0000","last_became_peered":"2024-08-19T00:39:35.153002+0000","last_unstale":"2024-08-19T00:39:45.783138+0000","last_undegraded":"2024-08-19T00:39:45.783138+0000","last_fullsized":"2024-08-19T00:39:45.783138+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:10:59.988257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783074+0000","last_change":"2024-08-19T00:39:36.158765+0000","last_active":"2024-08-19T00:39:45.783074+0000","last_peered":"2024-08-19T00:39:45.783074+0000","last_clean":"2024-08-19T00:39:45.783074+0000","last_became_active":"2024-08-19T00:39:36.158520+0000","last_became_peered":"2024-08-19T00:39:36.158520+0000","last_unstale":"2024-08-19T00:39:45.783074+0000","last_undegraded":"2024-08-19T00:39:45.783074+0000","last_fullsized":"2024-08-19T00:39:45.783074+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.502079+0000","last_change":"2024-08-19T00:39:35.150805+0000","last_active":"2024-08-19T00:39:45.502079+0000","last_peered":"2024-08-19T00:39:45.502079+0000","last_clean":"2024-08-19T00:39:45.502079+0000","last_became_active":"2024-08-19T00:39:35.149965+0000","last_became_peered":"2024-08-19T00:39:35.149965+0000","last_unstale":"2024-08-19T00:39:45.502079+0000","last_undegraded":"2024-08-19T00:39:45.502079+0000","last_fullsized":"2024-08-19T00:39:45.502079+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:32.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888777+0000","last_change":"2024-08-19T00:39:36.148831+0000","last_active":"2024-08-19T00:39:45.888777+0000","last_peered":"2024-08-19T00:39:45.888777+0000","last_clean":"2024-08-19T00:39:45.888777+0000","last_became_active":"2024-08-19T00:39:36.148570+0000","last_became_peered":"2024-08-19T00:39:36.148570+0000","last_unstale":"2024-08-19T00:39:45.888777+0000","last_undegraded":"2024-08-19T00:39:45.888777+0000","last_fullsized":"2024-08-19T00:39:45.888777+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382305+0000","last_change":"2024-08-19T00:39:35.144998+0000","last_active":"2024-08-19T00:39:45.382305+0000","last_peered":"2024-08-19T00:39:45.382305+0000","last_clean":"2024-08-19T00:39:45.382305+0000","last_became_active":"2024-08-19T00:39:35.144587+0000","last_became_peered":"2024-08-19T00:39:35.144587+0000","last_unstale":"2024-08-19T00:39:45.382305+0000","last_undegraded":"2024-08-19T00:39:45.382305+0000","last_fullsized":"2024-08-19T00:39:45.382305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380779+0000","last_change":"2024-08-19T00:39:36.155265+0000","last_active":"2024-08-19T00:39:45.380779+0000","last_peered":"2024-08-19T00:39:45.380779+0000","last_clean":"2024-08-19T00:39:45.380779+0000","last_became_active":"2024-08-19T00:39:36.155014+0000","last_became_peered":"2024-08-19T00:39:36.155014+0000","last_unstale":"2024-08-19T00:39:45.380779+0000","last_undegraded":"2024-08-19T00:39:45.380779+0000","last_fullsized":"2024-08-19T00:39:45.380779+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:44.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783407+0000","last_change":"2024-08-19T00:39:35.155692+0000","last_active":"2024-08-19T00:39:45.783407+0000","last_peered":"2024-08-19T00:39:45.783407+0000","last_clean":"2024-08-19T00:39:45.783407+0000","last_became_active":"2024-08-19T00:39:35.155356+0000","last_became_peered":"2024-08-19T00:39:35.155356+0000","last_unstale":"2024-08-19T00:39:45.783407+0000","last_undegraded":"2024-08-19T00:39:45.783407+0000","last_fullsized":"2024-08-19T00:39:45.783407+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:57.748202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.381997+0000","last_change":"2024-08-19T00:39:36.154707+0000","last_active":"2024-08-19T00:39:45.381997+0000","last_peered":"2024-08-19T00:39:45.381997+0000","last_clean":"2024-08-19T00:39:45.381997+0000","last_became_active":"2024-08-19T00:39:36.154434+0000","last_became_peered":"2024-08-19T00:39:36.154434+0000","last_unstale":"2024-08-19T00:39:45.381997+0000","last_undegraded":"2024-08-19T00:39:45.381997+0000","last_fullsized":"2024-08-19T00:39:45.381997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:49:07.350479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383546+0000","last_change":"2024-08-19T00:39:35.151307+0000","last_active":"2024-08-19T00:39:45.383546+0000","last_peered":"2024-08-19T00:39:45.383546+0000","last_clean":"2024-08-19T00:39:45.383546+0000","last_became_active":"2024-08-19T00:39:35.150944+0000","last_became_peered":"2024-08-19T00:39:35.150944+0000","last_unstale":"2024-08-19T00:39:45.383546+0000","last_undegraded":"2024-08-19T00:39:45.383546+0000","last_fullsized":"2024-08-19T00:39:45.383546+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:25.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782797+0000","last_change":"2024-08-19T00:39:36.144384+0000","last_active":"2024-08-19T00:39:45.782797+0000","last_peered":"2024-08-19T00:39:45.782797+0000","last_clean":"2024-08-19T00:39:45.782797+0000","last_became_active":"2024-08-19T00:39:36.144073+0000","last_became_peered":"2024-08-19T00:39:36.144073+0000","last_unstale":"2024-08-19T00:39:45.782797+0000","last_undegraded":"2024-08-19T00:39:45.782797+0000","last_fullsized":"2024-08-19T00:39:45.782797+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:58.938630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550073+0000","last_change":"2024-08-19T00:39:35.138439+0000","last_active":"2024-08-19T00:39:45.550073+0000","last_peered":"2024-08-19T00:39:45.550073+0000","last_clean":"2024-08-19T00:39:45.550073+0000","last_became_active":"2024-08-19T00:39:35.137950+0000","last_became_peered":"2024-08-19T00:39:35.137950+0000","last_unstale":"2024-08-19T00:39:45.550073+0000","last_undegraded":"2024-08-19T00:39:45.550073+0000","last_fullsized":"2024-08-19T00:39:45.550073+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550448+0000","last_change":"2024-08-19T00:39:36.139967+0000","last_active":"2024-08-19T00:39:45.550448+0000","last_peered":"2024-08-19T00:39:45.550448+0000","last_clean":"2024-08-19T00:39:45.550448+0000","last_became_active":"2024-08-19T00:39:36.139673+0000","last_became_peered":"2024-08-19T00:39:36.139673+0000","last_unstale":"2024-08-19T00:39:45.550448+0000","last_undegraded":"2024-08-19T00:39:45.550448+0000","last_fullsized":"2024-08-19T00:39:45.550448+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383796+0000","last_change":"2024-08-19T00:39:35.152751+0000","last_active":"2024-08-19T00:39:45.383796+0000","last_peered":"2024-08-19T00:39:45.383796+0000","last_clean":"2024-08-19T00:39:45.383796+0000","last_became_active":"2024-08-19T00:39:35.152460+0000","last_became_peered":"2024-08-19T00:39:35.152460+0000","last_unstale":"2024-08-19T00:39:45.383796+0000","last_undegraded":"2024-08-19T00:39:45.383796+0000","last_fullsized":"2024-08-19T00:39:45.383796+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:07:11.044162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382774+0000","last_change":"2024-08-19T00:39:36.163630+0000","last_active":"2024-08-19T00:39:45.382774+0000","last_peered":"2024-08-19T00:39:45.382774+0000","last_clean":"2024-08-19T00:39:45.382774+0000","last_became_active":"2024-08-19T00:39:36.163435+0000","last_became_peered":"2024-08-19T00:39:36.163435+0000","last_unstale":"2024-08-19T00:39:45.382774+0000","last_undegraded":"2024-08-19T00:39:45.382774+0000","last_fullsized":"2024-08-19T00:39:45.382774+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:08.644960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889245+0000","last_change":"2024-08-19T00:39:35.150600+0000","last_active":"2024-08-19T00:39:45.889245+0000","last_peered":"2024-08-19T00:39:45.889245+0000","last_clean":"2024-08-19T00:39:45.889245+0000","last_became_active":"2024-08-19T00:39:35.150288+0000","last_became_peered":"2024-08-19T00:39:35.150288+0000","last_unstale":"2024-08-19T00:39:45.889245+0000","last_undegraded":"2024-08-19T00:39:45.889245+0000","last_fullsized":"2024-08-19T00:39:45.889245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.391490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889263+0000","last_change":"2024-08-19T00:39:36.166062+0000","last_active":"2024-08-19T00:39:45.889263+0000","last_peered":"2024-08-19T00:39:45.889263+0000","last_clean":"2024-08-19T00:39:45.889263+0000","last_became_active":"2024-08-19T00:39:36.165733+0000","last_became_peered":"2024-08-19T00:39:36.165733+0000","last_unstale":"2024-08-19T00:39:45.889263+0000","last_undegraded":"2024-08-19T00:39:45.889263+0000","last_fullsized":"2024-08-19T00:39:45.889263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:34.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":21,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501994+0000","last_change":"2024-08-19T00:39:35.150215+0000","last_active":"2024-08-19T00:39:45.501994+0000","last_peered":"2024-08-19T00:39:45.501994+0000","last_clean":"2024-08-19T00:39:45.501994+0000","last_became_active":"2024-08-19T00:39:35.149900+0000","last_became_peered":"2024-08-19T00:39:35.149900+0000","last_unstale":"2024-08-19T00:39:45.501994+0000","last_undegraded":"2024-08-19T00:39:45.501994+0000","last_fullsized":"2024-08-19T00:39:45.501994+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501881+0000","last_change":"2024-08-19T00:39:36.164715+0000","last_active":"2024-08-19T00:39:45.501881+0000","last_peered":"2024-08-19T00:39:45.501881+0000","last_clean":"2024-08-19T00:39:45.501881+0000","last_became_active":"2024-08-19T00:39:36.164429+0000","last_became_peered":"2024-08-19T00:39:36.164429+0000","last_unstale":"2024-08-19T00:39:45.501881+0000","last_undegraded":"2024-08-19T00:39:45.501881+0000","last_fullsized":"2024-08-19T00:39:45.501881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:16.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":23,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550362+0000","last_change":"2024-08-19T00:39:35.139200+0000","last_active":"2024-08-19T00:39:45.550362+0000","last_peered":"2024-08-19T00:39:45.550362+0000","last_clean":"2024-08-19T00:39:45.550362+0000","last_became_active":"2024-08-19T00:39:35.138943+0000","last_became_peered":"2024-08-19T00:39:35.138943+0000","last_unstale":"2024-08-19T00:39:45.550362+0000","last_undegraded":"2024-08-19T00:39:45.550362+0000","last_fullsized":"2024-08-19T00:39:45.550362+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383592+0000","last_change":"2024-08-19T00:39:36.152526+0000","last_active":"2024-08-19T00:39:45.383592+0000","last_peered":"2024-08-19T00:39:45.383592+0000","last_clean":"2024-08-19T00:39:45.383592+0000","last_became_active":"2024-08-19T00:39:36.152185+0000","last_became_peered":"2024-08-19T00:39:36.152185+0000","last_unstale":"2024-08-19T00:39:45.383592+0000","last_undegraded":"2024-08-19T00:39:45.383592+0000","last_fullsized":"2024-08-19T00:39:45.383592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889432+0000","last_change":"2024-08-19T00:39:35.147473+0000","last_active":"2024-08-19T00:39:45.889432+0000","last_peered":"2024-08-19T00:39:45.889432+0000","last_clean":"2024-08-19T00:39:45.889432+0000","last_became_active":"2024-08-19T00:39:35.146042+0000","last_became_peered":"2024-08-19T00:39:35.146042+0000","last_unstale":"2024-08-19T00:39:45.889432+0000","last_undegraded":"2024-08-19T00:39:45.889432+0000","last_fullsized":"2024-08-19T00:39:45.889432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:13.655919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382196+0000","last_change":"2024-08-19T00:39:36.151090+0000","last_active":"2024-08-19T00:39:45.382196+0000","last_peered":"2024-08-19T00:39:45.382196+0000","last_clean":"2024-08-19T00:39:45.382196+0000","last_became_active":"2024-08-19T00:39:36.150827+0000","last_became_peered":"2024-08-19T00:39:36.150827+0000","last_unstale":"2024-08-19T00:39:45.382196+0000","last_undegraded":"2024-08-19T00:39:45.382196+0000","last_fullsized":"2024-08-19T00:39:45.382196+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:14.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501990+0000","last_change":"2024-08-19T00:39:35.150699+0000","last_active":"2024-08-19T00:39:45.501990+0000","last_peered":"2024-08-19T00:39:45.501990+0000","last_clean":"2024-08-19T00:39:45.501990+0000","last_became_active":"2024-08-19T00:39:35.150431+0000","last_became_peered":"2024-08-19T00:39:35.150431+0000","last_unstale":"2024-08-19T00:39:45.501990+0000","last_undegraded":"2024-08-19T00:39:45.501990+0000","last_fullsized":"2024-08-19T00:39:45.501990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:24.778664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383344+0000","last_change":"2024-08-19T00:39:36.142631+0000","last_active":"2024-08-19T00:39:45.383344+0000","last_peered":"2024-08-19T00:39:45.383344+0000","last_clean":"2024-08-19T00:39:45.383344+0000","last_became_active":"2024-08-19T00:39:36.141360+0000","last_became_peered":"2024-08-19T00:39:36.141360+0000","last_unstale":"2024-08-19T00:39:45.383344+0000","last_undegraded":"2024-08-19T00:39:45.383344+0000","last_fullsized":"2024-08-19T00:39:45.383344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:12.062304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501946+0000","last_change":"2024-08-19T00:39:35.146190+0000","last_active":"2024-08-19T00:39:45.501946+0000","last_peered":"2024-08-19T00:39:45.501946+0000","last_clean":"2024-08-19T00:39:45.501946+0000","last_became_active":"2024-08-19T00:39:35.145917+0000","last_became_peered":"2024-08-19T00:39:35.145917+0000","last_unstale":"2024-08-19T00:39:45.501946+0000","last_undegraded":"2024-08-19T00:39:45.501946+0000","last_fullsized":"2024-08-19T00:39:45.501946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:07.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501852+0000","last_change":"2024-08-19T00:39:36.159164+0000","last_active":"2024-08-19T00:39:45.501852+0000","last_peered":"2024-08-19T00:39:45.501852+0000","last_clean":"2024-08-19T00:39:45.501852+0000","last_became_active":"2024-08-19T00:39:36.157432+0000","last_became_peered":"2024-08-19T00:39:36.157432+0000","last_unstale":"2024-08-19T00:39:45.501852+0000","last_undegraded":"2024-08-19T00:39:45.501852+0000","last_fullsized":"2024-08-19T00:39:45.501852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":26,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501747+0000","last_change":"2024-08-19T00:39:35.140744+0000","last_active":"2024-08-19T00:39:45.501747+0000","last_peered":"2024-08-19T00:39:45.501747+0000","last_clean":"2024-08-19T00:39:45.501747+0000","last_became_active":"2024-08-19T00:39:35.139571+0000","last_became_peered":"2024-08-19T00:39:35.139571+0000","last_unstale":"2024-08-19T00:39:45.501747+0000","last_undegraded":"2024-08-19T00:39:45.501747+0000","last_fullsized":"2024-08-19T00:39:45.501747+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:12.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382603+0000","last_change":"2024-08-19T00:39:36.155077+0000","last_active":"2024-08-19T00:39:45.382603+0000","last_peered":"2024-08-19T00:39:45.382603+0000","last_clean":"2024-08-19T00:39:45.382603+0000","last_became_active":"2024-08-19T00:39:36.149898+0000","last_became_peered":"2024-08-19T00:39:36.149898+0000","last_unstale":"2024-08-19T00:39:45.382603+0000","last_undegraded":"2024-08-19T00:39:45.382603+0000","last_fullsized":"2024-08-19T00:39:45.382603+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:01.876626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382568+0000","last_change":"2024-08-19T00:39:35.149420+0000","last_active":"2024-08-19T00:39:45.382568+0000","last_peered":"2024-08-19T00:39:45.382568+0000","last_clean":"2024-08-19T00:39:45.382568+0000","last_became_active":"2024-08-19T00:39:35.147380+0000","last_became_peered":"2024-08-19T00:39:35.147380+0000","last_unstale":"2024-08-19T00:39:45.382568+0000","last_undegraded":"2024-08-19T00:39:45.382568+0000","last_fullsized":"2024-08-19T00:39:45.382568+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382838+0000","last_change":"2024-08-19T00:39:36.168125+0000","last_active":"2024-08-19T00:39:45.382838+0000","last_peered":"2024-08-19T00:39:45.382838+0000","last_clean":"2024-08-19T00:39:45.382838+0000","last_became_active":"2024-08-19T00:39:36.167852+0000","last_became_peered":"2024-08-19T00:39:36.167852+0000","last_unstale":"2024-08-19T00:39:45.382838+0000","last_undegraded":"2024-08-19T00:39:45.382838+0000","last_fullsized":"2024-08-19T00:39:45.382838+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:33.655802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889272+0000","last_change":"2024-08-19T00:39:35.150107+0000","last_active":"2024-08-19T00:39:45.889272+0000","last_peered":"2024-08-19T00:39:45.889272+0000","last_clean":"2024-08-19T00:39:45.889272+0000","last_became_active":"2024-08-19T00:39:35.149254+0000","last_became_peered":"2024-08-19T00:39:35.149254+0000","last_unstale":"2024-08-19T00:39:45.889272+0000","last_undegraded":"2024-08-19T00:39:45.889272+0000","last_fullsized":"2024-08-19T00:39:45.889272+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:32.648833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382086+0000","last_change":"2024-08-19T00:39:36.158501+0000","last_active":"2024-08-19T00:39:45.382086+0000","last_peered":"2024-08-19T00:39:45.382086+0000","last_clean":"2024-08-19T00:39:45.382086+0000","last_became_active":"2024-08-19T00:39:36.158211+0000","last_became_peered":"2024-08-19T00:39:36.158211+0000","last_unstale":"2024-08-19T00:39:45.382086+0000","last_undegraded":"2024-08-19T00:39:45.382086+0000","last_fullsized":"2024-08-19T00:39:45.382086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:45.376678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382682+0000","last_change":"2024-08-19T00:39:35.154045+0000","last_active":"2024-08-19T00:39:45.382682+0000","last_peered":"2024-08-19T00:39:45.382682+0000","last_clean":"2024-08-19T00:39:45.382682+0000","last_became_active":"2024-08-19T00:39:35.153595+0000","last_became_peered":"2024-08-19T00:39:35.153595+0000","last_unstale":"2024-08-19T00:39:45.382682+0000","last_undegraded":"2024-08-19T00:39:45.382682+0000","last_fullsized":"2024-08-19T00:39:45.382682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:17.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.501906+0000","last_change":"2024-08-19T00:39:36.151091+0000","last_active":"2024-08-19T00:39:45.501906+0000","last_peered":"2024-08-19T00:39:45.501906+0000","last_clean":"2024-08-19T00:39:45.501906+0000","last_became_active":"2024-08-19T00:39:36.150846+0000","last_became_peered":"2024-08-19T00:39:36.150846+0000","last_unstale":"2024-08-19T00:39:45.501906+0000","last_undegraded":"2024-08-19T00:39:45.501906+0000","last_fullsized":"2024-08-19T00:39:45.501906+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889387+0000","last_change":"2024-08-19T00:39:35.151466+0000","last_active":"2024-08-19T00:39:45.889387+0000","last_peered":"2024-08-19T00:39:45.889387+0000","last_clean":"2024-08-19T00:39:45.889387+0000","last_became_active":"2024-08-19T00:39:35.151128+0000","last_became_peered":"2024-08-19T00:39:35.151128+0000","last_unstale":"2024-08-19T00:39:45.889387+0000","last_undegraded":"2024-08-19T00:39:45.889387+0000","last_fullsized":"2024-08-19T00:39:45.889387+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:00.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383709+0000","last_change":"2024-08-19T00:39:36.160735+0000","last_active":"2024-08-19T00:39:45.383709+0000","last_peered":"2024-08-19T00:39:45.383709+0000","last_clean":"2024-08-19T00:39:45.383709+0000","last_became_active":"2024-08-19T00:39:36.160476+0000","last_became_peered":"2024-08-19T00:39:36.160476+0000","last_unstale":"2024-08-19T00:39:45.383709+0000","last_undegraded":"2024-08-19T00:39:45.383709+0000","last_fullsized":"2024-08-19T00:39:45.383709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.380839+0000","last_change":"2024-08-19T00:39:35.139216+0000","last_active":"2024-08-19T00:39:45.380839+0000","last_peered":"2024-08-19T00:39:45.380839+0000","last_clean":"2024-08-19T00:39:45.380839+0000","last_became_active":"2024-08-19T00:39:35.138942+0000","last_became_peered":"2024-08-19T00:39:35.138942+0000","last_unstale":"2024-08-19T00:39:45.380839+0000","last_undegraded":"2024-08-19T00:39:45.380839+0000","last_fullsized":"2024-08-19T00:39:45.380839+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:17.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889417+0000","last_change":"2024-08-19T00:39:36.153881+0000","last_active":"2024-08-19T00:39:45.889417+0000","last_peered":"2024-08-19T00:39:45.889417+0000","last_clean":"2024-08-19T00:39:45.889417+0000","last_became_active":"2024-08-19T00:39:36.153593+0000","last_became_peered":"2024-08-19T00:39:36.153593+0000","last_unstale":"2024-08-19T00:39:45.889417+0000","last_undegraded":"2024-08-19T00:39:45.889417+0000","last_fullsized":"2024-08-19T00:39:45.889417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:22:50.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888925+0000","last_change":"2024-08-19T00:39:35.146938+0000","last_active":"2024-08-19T00:39:45.888925+0000","last_peered":"2024-08-19T00:39:45.888925+0000","last_clean":"2024-08-19T00:39:45.888925+0000","last_became_active":"2024-08-19T00:39:35.146108+0000","last_became_peered":"2024-08-19T00:39:35.146108+0000","last_unstale":"2024-08-19T00:39:45.888925+0000","last_undegraded":"2024-08-19T00:39:45.888925+0000","last_fullsized":"2024-08-19T00:39:45.888925+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:58.717624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888761+0000","last_change":"2024-08-19T00:39:36.162545+0000","last_active":"2024-08-19T00:39:45.888761+0000","last_peered":"2024-08-19T00:39:45.888761+0000","last_clean":"2024-08-19T00:39:45.888761+0000","last_became_active":"2024-08-19T00:39:36.162239+0000","last_became_peered":"2024-08-19T00:39:36.162239+0000","last_unstale":"2024-08-19T00:39:45.888761+0000","last_undegraded":"2024-08-19T00:39:45.888761+0000","last_fullsized":"2024-08-19T00:39:45.888761+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:45:12.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383461+0000","last_change":"2024-08-19T00:39:35.151536+0000","last_active":"2024-08-19T00:39:45.383461+0000","last_peered":"2024-08-19T00:39:45.383461+0000","last_clean":"2024-08-19T00:39:45.383461+0000","last_became_active":"2024-08-19T00:39:35.151229+0000","last_became_peered":"2024-08-19T00:39:35.151229+0000","last_unstale":"2024-08-19T00:39:45.383461+0000","last_undegraded":"2024-08-19T00:39:45.383461+0000","last_fullsized":"2024-08-19T00:39:45.383461+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382670+0000","last_change":"2024-08-19T00:39:36.162947+0000","last_active":"2024-08-19T00:39:45.382670+0000","last_peered":"2024-08-19T00:39:45.382670+0000","last_clean":"2024-08-19T00:39:45.382670+0000","last_became_active":"2024-08-19T00:39:36.158113+0000","last_became_peered":"2024-08-19T00:39:36.158113+0000","last_unstale":"2024-08-19T00:39:45.382670+0000","last_undegraded":"2024-08-19T00:39:45.382670+0000","last_fullsized":"2024-08-19T00:39:45.382670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:25.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382604+0000","last_change":"2024-08-19T00:39:35.147639+0000","last_active":"2024-08-19T00:39:45.382604+0000","last_peered":"2024-08-19T00:39:45.382604+0000","last_clean":"2024-08-19T00:39:45.382604+0000","last_became_active":"2024-08-19T00:39:35.147028+0000","last_became_peered":"2024-08-19T00:39:35.147028+0000","last_unstale":"2024-08-19T00:39:45.382604+0000","last_undegraded":"2024-08-19T00:39:45.382604+0000","last_fullsized":"2024-08-19T00:39:45.382604+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:27.725818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382900+0000","last_change":"2024-08-19T00:39:36.153396+0000","last_active":"2024-08-19T00:39:45.382900+0000","last_peered":"2024-08-19T00:39:45.382900+0000","last_clean":"2024-08-19T00:39:45.382900+0000","last_became_active":"2024-08-19T00:39:36.153084+0000","last_became_peered":"2024-08-19T00:39:36.153084+0000","last_unstale":"2024-08-19T00:39:45.382900+0000","last_undegraded":"2024-08-19T00:39:45.382900+0000","last_fullsized":"2024-08-19T00:39:45.382900+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:13.756497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783299+0000","last_change":"2024-08-19T00:39:35.155170+0000","last_active":"2024-08-19T00:39:45.783299+0000","last_peered":"2024-08-19T00:39:45.783299+0000","last_clean":"2024-08-19T00:39:45.783299+0000","last_became_active":"2024-08-19T00:39:35.154785+0000","last_became_peered":"2024-08-19T00:39:35.154785+0000","last_unstale":"2024-08-19T00:39:45.783299+0000","last_undegraded":"2024-08-19T00:39:45.783299+0000","last_fullsized":"2024-08-19T00:39:45.783299+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:28.607288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382247+0000","last_change":"2024-08-19T00:39:36.169884+0000","last_active":"2024-08-19T00:39:45.382247+0000","last_peered":"2024-08-19T00:39:45.382247+0000","last_clean":"2024-08-19T00:39:45.382247+0000","last_became_active":"2024-08-19T00:39:36.169545+0000","last_became_peered":"2024-08-19T00:39:36.169545+0000","last_unstale":"2024-08-19T00:39:45.382247+0000","last_undegraded":"2024-08-19T00:39:45.382247+0000","last_fullsized":"2024-08-19T00:39:45.382247+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:20.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383622+0000","last_change":"2024-08-19T00:39:35.152563+0000","last_active":"2024-08-19T00:39:45.383622+0000","last_peered":"2024-08-19T00:39:45.383622+0000","last_clean":"2024-08-19T00:39:45.383622+0000","last_became_active":"2024-08-19T00:39:35.152288+0000","last_became_peered":"2024-08-19T00:39:35.152288+0000","last_unstale":"2024-08-19T00:39:45.383622+0000","last_undegraded":"2024-08-19T00:39:45.383622+0000","last_fullsized":"2024-08-19T00:39:45.383622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:57.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889148+0000","last_change":"2024-08-19T00:39:36.162616+0000","last_active":"2024-08-19T00:39:45.889148+0000","last_peered":"2024-08-19T00:39:45.889148+0000","last_clean":"2024-08-19T00:39:45.889148+0000","last_became_active":"2024-08-19T00:39:36.160729+0000","last_became_peered":"2024-08-19T00:39:36.160729+0000","last_unstale":"2024-08-19T00:39:45.889148+0000","last_undegraded":"2024-08-19T00:39:45.889148+0000","last_fullsized":"2024-08-19T00:39:45.889148+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:59.801817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382452+0000","last_change":"2024-08-19T00:39:35.145457+0000","last_active":"2024-08-19T00:39:45.382452+0000","last_peered":"2024-08-19T00:39:45.382452+0000","last_clean":"2024-08-19T00:39:45.382452+0000","last_became_active":"2024-08-19T00:39:35.144528+0000","last_became_peered":"2024-08-19T00:39:35.144528+0000","last_unstale":"2024-08-19T00:39:45.382452+0000","last_undegraded":"2024-08-19T00:39:45.382452+0000","last_fullsized":"2024-08-19T00:39:45.382452+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:36.455037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.783004+0000","last_change":"2024-08-19T00:39:36.145137+0000","last_active":"2024-08-19T00:39:45.783004+0000","last_peered":"2024-08-19T00:39:45.783004+0000","last_clean":"2024-08-19T00:39:45.783004+0000","last_became_active":"2024-08-19T00:39:36.144039+0000","last_became_peered":"2024-08-19T00:39:36.144039+0000","last_unstale":"2024-08-19T00:39:45.783004+0000","last_undegraded":"2024-08-19T00:39:45.783004+0000","last_fullsized":"2024-08-19T00:39:45.783004+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:44.222852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382207+0000","last_change":"2024-08-19T00:39:35.150003+0000","last_active":"2024-08-19T00:39:45.382207+0000","last_peered":"2024-08-19T00:39:45.382207+0000","last_clean":"2024-08-19T00:39:45.382207+0000","last_became_active":"2024-08-19T00:39:35.149450+0000","last_became_peered":"2024-08-19T00:39:35.149450+0000","last_unstale":"2024-08-19T00:39:45.382207+0000","last_undegraded":"2024-08-19T00:39:45.382207+0000","last_fullsized":"2024-08-19T00:39:45.382207+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:56.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550332+0000","last_change":"2024-08-19T00:39:36.151114+0000","last_active":"2024-08-19T00:39:45.550332+0000","last_peered":"2024-08-19T00:39:45.550332+0000","last_clean":"2024-08-19T00:39:45.550332+0000","last_became_active":"2024-08-19T00:39:36.150378+0000","last_became_peered":"2024-08-19T00:39:36.150378+0000","last_unstale":"2024-08-19T00:39:45.550332+0000","last_undegraded":"2024-08-19T00:39:45.550332+0000","last_fullsized":"2024-08-19T00:39:45.550332+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:50.571158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382238+0000","last_change":"2024-08-19T00:39:35.151922+0000","last_active":"2024-08-19T00:39:45.382238+0000","last_peered":"2024-08-19T00:39:45.382238+0000","last_clean":"2024-08-19T00:39:45.382238+0000","last_became_active":"2024-08-19T00:39:35.151592+0000","last_became_peered":"2024-08-19T00:39:35.151592+0000","last_unstale":"2024-08-19T00:39:45.382238+0000","last_undegraded":"2024-08-19T00:39:45.382238+0000","last_fullsized":"2024-08-19T00:39:45.382238+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:30.230816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.888731+0000","last_change":"2024-08-19T00:39:36.160871+0000","last_active":"2024-08-19T00:39:45.888731+0000","last_peered":"2024-08-19T00:39:45.888731+0000","last_clean":"2024-08-19T00:39:45.888731+0000","last_became_active":"2024-08-19T00:39:36.160532+0000","last_became_peered":"2024-08-19T00:39:36.160532+0000","last_unstale":"2024-08-19T00:39:45.888731+0000","last_undegraded":"2024-08-19T00:39:45.888731+0000","last_fullsized":"2024-08-19T00:39:45.888731+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:22.704270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.782907+0000","last_change":"2024-08-19T00:39:35.152049+0000","last_active":"2024-08-19T00:39:45.782907+0000","last_peered":"2024-08-19T00:39:45.782907+0000","last_clean":"2024-08-19T00:39:45.782907+0000","last_became_active":"2024-08-19T00:39:35.151701+0000","last_became_peered":"2024-08-19T00:39:35.151701+0000","last_unstale":"2024-08-19T00:39:45.782907+0000","last_undegraded":"2024-08-19T00:39:45.782907+0000","last_fullsized":"2024-08-19T00:39:45.782907+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:12.240722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.382086+0000","last_change":"2024-08-19T00:39:36.161288+0000","last_active":"2024-08-19T00:39:45.382086+0000","last_peered":"2024-08-19T00:39:45.382086+0000","last_clean":"2024-08-19T00:39:45.382086+0000","last_became_active":"2024-08-19T00:39:36.160753+0000","last_became_peered":"2024-08-19T00:39:36.160753+0000","last_unstale":"2024-08-19T00:39:45.382086+0000","last_undegraded":"2024-08-19T00:39:45.382086+0000","last_fullsized":"2024-08-19T00:39:45.382086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:10.108472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889088+0000","last_change":"2024-08-19T00:39:35.145272+0000","last_active":"2024-08-19T00:39:45.889088+0000","last_peered":"2024-08-19T00:39:45.889088+0000","last_clean":"2024-08-19T00:39:45.889088+0000","last_became_active":"2024-08-19T00:39:35.144927+0000","last_became_peered":"2024-08-19T00:39:35.144927+0000","last_unstale":"2024-08-19T00:39:45.889088+0000","last_undegraded":"2024-08-19T00:39:45.889088+0000","last_fullsized":"2024-08-19T00:39:45.889088+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:18:43.286500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.889124+0000","last_change":"2024-08-19T00:39:36.149844+0000","last_active":"2024-08-19T00:39:45.889124+0000","last_peered":"2024-08-19T00:39:45.889124+0000","last_clean":"2024-08-19T00:39:45.889124+0000","last_became_active":"2024-08-19T00:39:36.149309+0000","last_became_peered":"2024-08-19T00:39:36.149309+0000","last_unstale":"2024-08-19T00:39:45.889124+0000","last_undegraded":"2024-08-19T00:39:45.889124+0000","last_fullsized":"2024-08-19T00:39:45.889124+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:35.119314+0000","last_clean_scrub_stamp":"2024-08-19T00:39:35.119314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:33:55.265526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.550127+0000","last_change":"2024-08-19T00:39:35.149381+0000","last_active":"2024-08-19T00:39:45.550127+0000","last_peered":"2024-08-19T00:39:45.550127+0000","last_clean":"2024-08-19T00:39:45.550127+0000","last_became_active":"2024-08-19T00:39:35.148356+0000","last_became_peered":"2024-08-19T00:39:35.148356+0000","last_unstale":"2024-08-19T00:39:45.550127+0000","last_undegraded":"2024-08-19T00:39:45.550127+0000","last_fullsized":"2024-08-19T00:39:45.550127+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:39:34.112345+0000","last_clean_scrub_stamp":"2024-08-19T00:39:34.112345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:44.189278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":241,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-08-19T00:39:45.383446+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:39:45.383446+0000","last_peered":"2024-08-19T00:39:45.383446+0000","last_clean":"2024-08-19T00:39:45.383446+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:39:45.383446+0000","last_undegraded":"2024-08-19T00:39:45.383446+0000","last_fullsized":"2024-08-19T00:39:45.383446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":296800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":712704,"data_stored":296730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1306624,"data_stored":887110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":297324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":712704,"data_stored":296798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":298480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1306624,"data_stored":887658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":720896,"data_stored":298320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:39:54.861 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:39:54.862 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.060+0000 7f750e800640 1 Processor -- start 2024-08-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.060+0000 7f750e800640 1 -- start start 2024-08-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f750e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7508161c90 0x7f75080cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f750e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f750806e330 0x7f75080d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f750e800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750806e750 con 0x7f75080d2a40 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f750e800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f75080d0110 con 0x7f750806e330 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f750e800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f75080d2e70 con 0x7f7508161c90 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f7506a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f750806e330 0x7f75080d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f7506a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f750806e330 0x7f75080d2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32954/0 (socket says 172.21.15.7:32954) 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.061+0000 7f7506a00640 1 -- 172.21.15.7:0/541898370 learned_addr learned my addr 172.21.15.7:0/541898370 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.062+0000 7f7507400640 1 --2- 172.21.15.7:0/541898370 >> v2:172.21.15.162:3300/0 conn(0x7f7508161c90 0x7f75080cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.062+0000 7f7506a00640 1 -- 172.21.15.7:0/541898370 >> v2:172.21.15.162:3300/0 conn(0x7f7508161c90 msgr2=0x7f75080cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.062+0000 7f7506a00640 1 --2- 172.21.15.7:0/541898370 >> v2:172.21.15.162:3300/0 conn(0x7f7508161c90 0x7f75080cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.062+0000 7f7506a00640 1 -- 172.21.15.7:0/541898370 >> v1:172.21.15.162:6789/0 conn(0x7f75080d2a40 legacy=0x7f75080d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.062+0000 7f7506a00640 1 -- 172.21.15.7:0/541898370 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75080cf500 con 0x7f750806e330 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.063+0000 7f7506a00640 1 --2- 172.21.15.7:0/541898370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f750806e330 0x7f75080d2500 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7508069350 tx=0x7f74f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72acfc7e2b37344b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.063+0000 7f7506000640 1 -- 172.21.15.7:0/541898370 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4037070 con 0x7f750806e330 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.063+0000 7f7506000640 1 -- 172.21.15.7:0/541898370 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4032440 con 0x7f750806e330 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.063+0000 7f7506000640 1 -- 172.21.15.7:0/541898370 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4032810 con 0x7f750806e330 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.063+0000 7f750e800640 1 -- 172.21.15.7:0/541898370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f750806e330 msgr2=0x7f75080d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.063+0000 7f750e800640 1 --2- 172.21.15.7:0/541898370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f750806e330 0x7f75080d2500 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7508069350 tx=0x7f74f402a230 comp rx=0 tx=0).stop 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.064+0000 7f750e800640 1 -- 172.21.15.7:0/541898370 shutdown_connections 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.064+0000 7f750e800640 1 --2- 172.21.15.7:0/541898370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f750806e330 0x7f75080d2500 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.064+0000 7f750e800640 1 --2- 172.21.15.7:0/541898370 >> v2:172.21.15.162:3300/0 conn(0x7f7508161c90 0x7f75080cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.064+0000 7f750e800640 1 -- 172.21.15.7:0/541898370 >> 172.21.15.7:0/541898370 conn(0x7f750808c000 msgr2=0x7f75080d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.064+0000 7f750e800640 1 -- 172.21.15.7:0/541898370 shutdown_connections 2024-08-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.064+0000 7f750e800640 1 -- 172.21.15.7:0/541898370 wait complete. 2024-08-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.065+0000 7f750e800640 1 Processor -- start 2024-08-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.065+0000 7f750e800640 1 -- start start 2024-08-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.066+0000 7f750e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f750806e330 0x7f750815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.066+0000 7f750e800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75080d2a40 0x7f75080b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.066+0000 7f750e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7508161c90 0x7f7508151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.066+0000 7f750e800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f75080cfda0 con 0x7f7508161c90 2024-08-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.066+0000 7f750e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75080cfac0 con 0x7f750806e330 2024-08-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.066+0000 7f750e800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7508162070 con 0x7f75080d2a40 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.066+0000 7f7507e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7508161c90 0x7f7508151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7508161c90 0x7f7508151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32968/0 (socket says 172.21.15.7:32968) 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 -- 172.21.15.7:0/1894808191 learned_addr learned my addr 172.21.15.7:0/1894808191 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507400640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f750806e330 0x7f750815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7506a00640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75080d2a40 0x7f75080b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 -- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75080d2a40 msgr2=0x7f75080b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75080d2a40 0x7f75080b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 -- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f750806e330 msgr2=0x7f750815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f750806e330 0x7f750815adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 -- 172.21.15.7:0/1894808191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75080ce7b0 con 0x7f7508161c90 2024-08-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.067+0000 7f7507e00640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7508161c90 0x7f7508151280 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f750000c780 tx=0x7f750000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.068+0000 7f74ff400640 1 -- 172.21.15.7:0/1894808191 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500004b60 con 0x7f7508161c90 2024-08-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.068+0000 7f74ff400640 1 -- 172.21.15.7:0/1894808191 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500004d00 con 0x7f7508161c90 2024-08-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.068+0000 7f74ff400640 1 -- 172.21.15.7:0/1894808191 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750000aa30 con 0x7f7508161c90 2024-08-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.068+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75080b9410 con 0x7f7508161c90 2024-08-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.068+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75080b99d0 con 0x7f7508161c90 2024-08-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.069+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75080d3270 con 0x7f7508161c90 2024-08-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.070+0000 7f74ff400640 1 -- 172.21.15.7:0/1894808191 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f750000abd0 con 0x7f7508161c90 2024-08-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.071+0000 7f74ff400640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74e806be30 0x7f74e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.071+0000 7f74ff400640 1 -- 172.21.15.7:0/1894808191 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f750008b0e0 con 0x7f7508161c90 2024-08-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.071+0000 7f7507400640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74e806be30 0x7f74e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.071+0000 7f7507400640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74e806be30 0x7f74e806e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f74f8006fd0 tx=0x7f74f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.075+0000 7f74ff400640 1 -- 172.21.15.7:0/1894808191 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7500020070 con 0x7f7508161c90 2024-08-19T00:39:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.328+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f75080b6dd0 con 0x7f7508161c90 2024-08-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.330+0000 7f74ff400640 1 -- 172.21.15.7:0/1894808191 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f7500059a50 con 0x7f7508161c90 2024-08-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-08-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-08-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-08-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-19T00:39:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-08-19T00:39:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.332+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74e806be30 msgr2=0x7f74e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.332+0000 7f750e800640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74e806be30 0x7f74e806e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f74f8006fd0 tx=0x7f74f8008040 comp rx=0 tx=0).stop 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7508161c90 msgr2=0x7f7508151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7508161c90 0x7f7508151280 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f750000c780 tx=0x7f750000cc40 comp rx=0 tx=0).stop 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 shutdown_connections 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74e806be30 0x7f74e806e2f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7508161c90 0x7f7508151280 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75080d2a40 0x7f75080b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 --2- 172.21.15.7:0/1894808191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f750806e330 0x7f750815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 >> 172.21.15.7:0/1894808191 conn(0x7f750808c000 msgr2=0x7f75080b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 shutdown_connections 2024-08-19T00:39:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.333+0000 7f750e800640 1 -- 172.21.15.7:0/1894808191 wait complete. 2024-08-19T00:39:55.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:39:55.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.505+0000 7f4bd4e00640 1 Processor -- start 2024-08-19T00:39:55.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.506+0000 7f4bd4e00640 1 -- start start 2024-08-19T00:39:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bd4e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd0159bf0 0x7f4bd0073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bd4e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bd00739a0 0x7f4bd00ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bd4e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd006f7f0 con 0x7f4bd00cea40 2024-08-19T00:39:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bd4e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd006f510 con 0x7f4bd00739a0 2024-08-19T00:39:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bd4e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd0072980 con 0x7f4bd0159bf0 2024-08-19T00:39:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bc7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bd00739a0 0x7f4bd00ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bc7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bd00739a0 0x7f4bd00ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32980/0 (socket says 172.21.15.7:32980) 2024-08-19T00:39:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bc7e00640 1 -- 172.21.15.7:0/3442550865 learned_addr learned my addr 172.21.15.7:0/3442550865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bcde00640 1 --2- 172.21.15.7:0/3442550865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd0159bf0 0x7f4bd0073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bc7e00640 1 -- 172.21.15.7:0/3442550865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd0159bf0 msgr2=0x7f4bd0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:55.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bc7e00640 1 --2- 172.21.15.7:0/3442550865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd0159bf0 0x7f4bd0073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bc7e00640 1 -- 172.21.15.7:0/3442550865 >> v1:172.21.15.162:6789/0 conn(0x7f4bd00cea40 legacy=0x7f4bd00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.507+0000 7f4bc7e00640 1 -- 172.21.15.7:0/3442550865 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd0072c60 con 0x7f4bd00739a0 2024-08-19T00:39:55.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.508+0000 7f4bc7e00640 1 --2- 172.21.15.7:0/3442550865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00739a0 0x7f4bd00ce500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009870 tx=0x7f4bb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508e7103ad02cebd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bcd400640 1 -- 172.21.15.7:0/3442550865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8037070 con 0x7f4bd00739a0 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bcd400640 1 -- 172.21.15.7:0/3442550865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb8032440 con 0x7f4bd00739a0 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bcd400640 1 -- 172.21.15.7:0/3442550865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8032810 con 0x7f4bd00739a0 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3442550865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00739a0 msgr2=0x7f4bd00ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3442550865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00739a0 0x7f4bd00ce500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009870 tx=0x7f4bb802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3442550865 shutdown_connections 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3442550865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00739a0 0x7f4bd00ce500 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3442550865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd0159bf0 0x7f4bd0073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3442550865 >> 172.21.15.7:0/3442550865 conn(0x7f4bd006bc70 msgr2=0x7f4bd006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3442550865 shutdown_connections 2024-08-19T00:39:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.509+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3442550865 wait complete. 2024-08-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.511+0000 7f4bd4e00640 1 Processor -- start 2024-08-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.511+0000 7f4bd4e00640 1 -- start start 2024-08-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bd4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bd00739a0 0x7f4bd009da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bd4e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd00cea40 0x7f4bd01480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bd4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd0159bf0 0x7f4bd015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bd4e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd015a150 con 0x7f4bd0159bf0 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bd4e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0159fd0 con 0x7f4bd00739a0 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bd4e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd00d0ad0 con 0x7f4bd00cea40 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd0159bf0 0x7f4bd015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bcde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bd00739a0 0x7f4bd009da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd0159bf0 0x7f4bd015b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32988/0 (socket says 172.21.15.7:32988) 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.512+0000 7f4bce800640 1 -- 172.21.15.7:0/3170271613 learned_addr learned my addr 172.21.15.7:0/3170271613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bc7e00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd00cea40 0x7f4bd01480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bce800640 1 -- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd00cea40 msgr2=0x7f4bd01480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bce800640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd00cea40 0x7f4bd01480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bce800640 1 -- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bd00739a0 msgr2=0x7f4bd009da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bce800640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bd00739a0 0x7f4bd009da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bce800640 1 -- 172.21.15.7:0/3170271613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd0148aa0 con 0x7f4bd0159bf0 2024-08-19T00:39:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bcde00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bd00739a0 0x7f4bd009da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bce800640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd0159bf0 0x7f4bd015b000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c7d0 tx=0x7f4bc800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bc6000640 1 -- 172.21.15.7:0/3170271613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8003b70 con 0x7f4bd0159bf0 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bc6000640 1 -- 172.21.15.7:0/3170271613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc8003d30 con 0x7f4bd0159bf0 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.513+0000 7f4bc6000640 1 -- 172.21.15.7:0/3170271613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800aa90 con 0x7f4bd0159bf0 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.514+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd0148d80 con 0x7f4bd0159bf0 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.514+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd0149340 con 0x7f4bd0159bf0 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.515+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd015a400 con 0x7f4bd0159bf0 2024-08-19T00:39:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.516+0000 7f4bc6000640 1 -- 172.21.15.7:0/3170271613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bc800ac30 con 0x7f4bd0159bf0 2024-08-19T00:39:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.516+0000 7f4bc6000640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bac06be30 0x7f4bac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.517+0000 7f4bc6000640 1 -- 172.21.15.7:0/3170271613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f4bc808adc0 con 0x7f4bd0159bf0 2024-08-19T00:39:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.517+0000 7f4bcde00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bac06be30 0x7f4bac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.517+0000 7f4bcde00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bac06be30 0x7f4bac06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0006fd0 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.521+0000 7f4bc6000640 1 -- 172.21.15.7:0/3170271613 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4bc8058fb0 con 0x7f4bd0159bf0 2024-08-19T00:39:55.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.740+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bd006c980 con 0x7f4bd0159bf0 2024-08-19T00:39:55.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.741+0000 7f4bc6000640 1 -- 172.21.15.7:0/3170271613 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5220 (secure 0 0 0) 0x7f4bc805d2b0 con 0x7f4bd0159bf0 2024-08-19T00:39:55.743 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:39:55.743 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"btime":"2024-08-19T00:39:39:157035+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:39:38.575704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3306229985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3306229985},{"type":"v1","addr":"172.21.15.7:6836","nonce":3306229985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-08-19T00:39:55.743 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-08-19T00:39:55.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bac06be30 msgr2=0x7f4bac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bac06be30 0x7f4bac06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0006fd0 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-08-19T00:39:55.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd0159bf0 msgr2=0x7f4bd015b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd0159bf0 0x7f4bd015b000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c7d0 tx=0x7f4bc800cc90 comp rx=0 tx=0).stop 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 shutdown_connections 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bac06be30 0x7f4bac06e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd0159bf0 0x7f4bd015b000 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bd00cea40 0x7f4bd01480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 --2- 172.21.15.7:0/3170271613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bd00739a0 0x7f4bd009da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 >> 172.21.15.7:0/3170271613 conn(0x7f4bd006bc70 msgr2=0x7f4bd0075180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 shutdown_connections 2024-08-19T00:39:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:55.743+0000 7f4bd4e00640 1 -- 172.21.15.7:0/3170271613 wait complete. 2024-08-19T00:39:56.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:39:35.566683+0000', 'modified': '2024-08-19T00:39:38.575704+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5757}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5757': {'gid': 5757, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6836/3306229985', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3306229985}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3306229985}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5757, 'qdb_cluster': [5757]} 2024-08-19T00:39:56.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:39:56.164 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:39:56.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.321+0000 7f3b81800640 1 Processor -- start 2024-08-19T00:39:56.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.321+0000 7f3b81800640 1 -- start start 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.322+0000 7f3b81800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0d28c0 0x7f3b7c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.322+0000 7f3b81800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b7c0b4610 0x7f3b7c1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.322+0000 7f3b81800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c161f80 con 0x7f3b7c1439c0 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.322+0000 7f3b81800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c161d30 con 0x7f3b7c0b4610 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.322+0000 7f3b81800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c162b90 con 0x7f3b7c0d28c0 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b80e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b7c0b4610 0x7f3b7c1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b73e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3b7c1439c0 0x7f3b7c0b3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58148/0 (socket says 172.21.15.7:58148) 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b73e00640 1 -- 172.21.15.7:0/4105553377 learned_addr learned my addr 172.21.15.7:0/4105553377 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b7be00640 1 --2- 172.21.15.7:0/4105553377 >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0d28c0 0x7f3b7c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b80e00640 1 -- 172.21.15.7:0/4105553377 >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0d28c0 msgr2=0x7f3b7c1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b80e00640 1 --2- 172.21.15.7:0/4105553377 >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0d28c0 0x7f3b7c1441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b80e00640 1 -- 172.21.15.7:0/4105553377 >> v1:172.21.15.7:6789/0 conn(0x7f3b7c1439c0 legacy=0x7f3b7c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b80e00640 1 -- 172.21.15.7:0/4105553377 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c162260 con 0x7f3b7c0b4610 2024-08-19T00:39:56.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.323+0000 7f3b7be00640 1 --2- 172.21.15.7:0/4105553377 >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0d28c0 0x7f3b7c1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.324+0000 7f3b80e00640 1 --2- 172.21.15.7:0/4105553377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0b4610 0x7f3b7c1419e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c063300 tx=0x7f3b7402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecf8572b948eb19 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.324+0000 7f3b7b400640 1 -- 172.21.15.7:0/4105553377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74007740 con 0x7f3b7c0b4610 2024-08-19T00:39:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b7b400640 1 -- 172.21.15.7:0/4105553377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b740078e0 con 0x7f3b7c0b4610 2024-08-19T00:39:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b7b400640 1 -- 172.21.15.7:0/4105553377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74007cb0 con 0x7f3b7c0b4610 2024-08-19T00:39:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 -- 172.21.15.7:0/4105553377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0b4610 msgr2=0x7f3b7c1419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 --2- 172.21.15.7:0/4105553377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0b4610 0x7f3b7c1419e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c063300 tx=0x7f3b7402a680 comp rx=0 tx=0).stop 2024-08-19T00:39:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 -- 172.21.15.7:0/4105553377 shutdown_connections 2024-08-19T00:39:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 --2- 172.21.15.7:0/4105553377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c0b4610 0x7f3b7c1419e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 --2- 172.21.15.7:0/4105553377 >> v2:172.21.15.162:3300/0 conn(0x7f3b7c0d28c0 0x7f3b7c1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 -- 172.21.15.7:0/4105553377 >> 172.21.15.7:0/4105553377 conn(0x7f3b7c062540 msgr2=0x7f3b7c062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 -- 172.21.15.7:0/4105553377 shutdown_connections 2024-08-19T00:39:56.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.325+0000 7f3b81800640 1 -- 172.21.15.7:0/4105553377 wait complete. 2024-08-19T00:39:56.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.327+0000 7f3b81800640 1 Processor -- start 2024-08-19T00:39:56.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.327+0000 7f3b81800640 1 -- start start 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b81800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b4610 0x7f3b7c155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b81800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0d28c0 0x7f3b7c161650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b81800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c1439c0 0x7f3b7c1f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b81800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c144720 con 0x7f3b7c1439c0 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b81800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c162820 con 0x7f3b7c0d28c0 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b81800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c0d2ca0 con 0x7f3b7c0b4610 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c1439c0 0x7f3b7c1f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c1439c0 0x7f3b7c1f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33014/0 (socket says 172.21.15.7:33014) 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b80e00640 1 -- 172.21.15.7:0/1944188198 learned_addr learned my addr 172.21.15.7:0/1944188198 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b73e00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0d28c0 0x7f3b7c161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.328+0000 7f3b7be00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b4610 0x7f3b7c155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b80e00640 1 -- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b4610 msgr2=0x7f3b7c155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b80e00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b4610 0x7f3b7c155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b80e00640 1 -- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0d28c0 msgr2=0x7f3b7c161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b80e00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0d28c0 0x7f3b7c161650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b80e00640 1 -- 172.21.15.7:0/1944188198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1f8910 con 0x7f3b7c1439c0 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b7be00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b4610 0x7f3b7c155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b73e00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0d28c0 0x7f3b7c161650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b80e00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c1439c0 0x7f3b7c1f83d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3b7402ac70 tx=0x7f3b74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b78c00640 1 -- 172.21.15.7:0/1944188198 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7403f070 con 0x7f3b7c1439c0 2024-08-19T00:39:56.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b78c00640 1 -- 172.21.15.7:0/1944188198 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b74031bc0 con 0x7f3b7c1439c0 2024-08-19T00:39:56.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b78c00640 1 -- 172.21.15.7:0/1944188198 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74044460 con 0x7f3b7c1439c0 2024-08-19T00:39:56.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c160890 con 0x7f3b7c1439c0 2024-08-19T00:39:56.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.329+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c160e50 con 0x7f3b7c1439c0 2024-08-19T00:39:56.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.331+0000 7f3b78c00640 1 -- 172.21.15.7:0/1944188198 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b74007790 con 0x7f3b7c1439c0 2024-08-19T00:39:56.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.332+0000 7f3b78c00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be30 0x7f3b5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.332+0000 7f3b78c00640 1 -- 172.21.15.7:0/1944188198 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f3b740ac700 con 0x7f3b7c1439c0 2024-08-19T00:39:56.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.332+0000 7f3b7be00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be30 0x7f3b5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.333+0000 7f3b85e27740 1 Processor -- start 2024-08-19T00:39:56.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.333+0000 7f3b85e27740 1 -- start start 2024-08-19T00:39:56.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.333+0000 7f3b7be00640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be30 0x7f3b5806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006fd0 tx=0x7f3b6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e4e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b85e27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bc3e3faba0 con 0x55bc3e4e5630 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc3e393230 con 0x55bc3e4e5f90 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55bc3e3f6b60 con 0x55bc3e4c2110 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e4e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e4e5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33016/0 (socket says 172.21.15.7:33016) 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b73e00640 1 -- 172.21.15.7:0/840353009 learned_addr learned my addr 172.21.15.7:0/840353009 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b80e00640 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.334+0000 7f3b7be00640 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b73e00640 1 -- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 msgr2=0x55bc3e4c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b73e00640 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b73e00640 1 -- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 msgr2=0x55bc3e4dafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b73e00640 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4dafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b73e00640 1 -- 172.21.15.7:0/840353009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc3e3c4bb0 con 0x55bc3e4e5630 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b80e00640 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b7be00640 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b73e00640 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e4e5a50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3b640017b0 tx=0x7f3b64001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ef88a4342d1a03 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b70c00640 1 -- 172.21.15.7:0/840353009 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64018070 con 0x55bc3e4e5630 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b70c00640 1 -- 172.21.15.7:0/840353009 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b64005ce0 con 0x55bc3e4e5630 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.335+0000 7f3b70c00640 1 -- 172.21.15.7:0/840353009 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b640072f0 con 0x55bc3e4e5630 2024-08-19T00:39:56.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 -- 172.21.15.7:0/840353009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 msgr2=0x55bc3e4e5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e4e5a50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3b640017b0 tx=0x7f3b64001c70 comp rx=0 tx=0).stop 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 -- 172.21.15.7:0/840353009 shutdown_connections 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e4e5a50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 --2- 172.21.15.7:0/840353009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 -- 172.21.15.7:0/840353009 >> 172.21.15.7:0/840353009 conn(0x55bc3e45f110 msgr2=0x55bc3e4dcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 -- 172.21.15.7:0/840353009 shutdown_connections 2024-08-19T00:39:56.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.336+0000 7f3b85e27740 1 -- 172.21.15.7:0/840353009 wait complete. 2024-08-19T00:39:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.337+0000 7f3b85e27740 1 -- start start 2024-08-19T00:39:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.337+0000 7f3b85e27740 1 Processor -- start 2024-08-19T00:39:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5630 0x55bc3e4f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b85e27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bc3e4df060 con 0x55bc3e4e5f90 2024-08-19T00:39:56.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc3e3b6250 con 0x55bc3e4e5630 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55bc3e4de770 con 0x55bc3e4c2110 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b85e27740 10 client.0 _ll_register_callbacks cb 0x55bc3e3ba740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33030/0 (socket says 172.21.15.7:33030) 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 -- 172.21.15.7:0/3365015484 learned_addr learned my addr 172.21.15.7:0/3365015484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 -- 172.21.15.7:0/3365015484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 msgr2=0x55bc3e4bd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 -- 172.21.15.7:0/3365015484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5630 msgr2=0x55bc3e4f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5630 0x55bc3e4f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.338+0000 7f3b80e00640 1 -- 172.21.15.7:0/3365015484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc3e10e2d0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b80e00640 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bba80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3b7407a8f0 tx=0x7f3b7407a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0bbbae5a70ea37 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b69600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b69600640 1 -- 172.21.15.7:0/3365015484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74083540 con 0x55bc3e4e5f90 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b69600640 1 -- 172.21.15.7:0/3365015484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f3b7407abc0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b64005ce0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b69600640 1 -- 172.21.15.7:0/3365015484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f3b7407ade0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b85e27740 10 client.5943 fetch_fsmap learned FSMap version 46 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55bc3e1d86b0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b69600640 1 -- 172.21.15.7:0/3365015484 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b64005ce0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b69600640 1 -- 172.21.15.7:0/3365015484 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f3b740830b0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b85e27740 10 client.5943 fetch_fsmap finished waiting for FSMap version 46 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b85e27740 10 client.5943 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.339+0000 7f3b85e27740 20 client.5943 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.340+0000 7f3b85e27740 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4d7550 0x55bc3e4d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.340+0000 7f3b85e27740 4 client.5943 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.340+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 --> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc3e4082d0 con 0x55bc3e4d7550 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.340+0000 7f3b7be00640 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4d7550 0x55bc3e4d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.340+0000 7f3b7be00640 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4d7550 0x55bc3e4d7930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450f5df3d3861052 server_cookie=f6ac25b7e513de59 in_seq=0 out_seq=0 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.340+0000 7f3b69600640 10 client.5943 ms_handle_connect on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.341+0000 7f3b69600640 1 -- 172.21.15.7:0/3365015484 <== mds.0 v2:172.21.15.7:6834/3306229985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc3e4082d0 con 0x55bc3e4d7550 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.341+0000 7f3b69600640 10 client.5943 handle_command_reply: tid=0 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.341+0000 7f3b85e27740 1 client.5943 shutdown 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 msgr2=0x55bc3e4bba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bba80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3b7407a8f0 tx=0x7f3b7407a960 comp rx=0 tx=0).stop 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 shutdown_connections 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4d7550 0x55bc3e4d7930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bba80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5630 0x55bc3e4f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b69600640 0 client.5943 ms_handle_reset on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 --2- 172.21.15.7:0/3365015484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e4bd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 >> 172.21.15.7:0/3365015484 conn(0x55bc3e45f110 msgr2=0x55bc3e4dc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 shutdown_connections 2024-08-19T00:39:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 1 -- 172.21.15.7:0/3365015484 wait complete. 2024-08-19T00:39:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.342+0000 7f3b85e27740 20 client.5943 trim_cache size 0 max 16384 2024-08-19T00:39:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.361+0000 7f3b85e27740 1 Processor -- start 2024-08-19T00:39:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.362+0000 7f3b85e27740 1 -- start start 2024-08-19T00:39:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.362+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e500780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.362+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e500cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.362+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.362+0000 7f3b85e27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1323d0 con 0x55bc3e4e5630 2024-08-19T00:39:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.362+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c131730 con 0x55bc3e4e5f90 2024-08-19T00:39:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.362+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c131d80 con 0x55bc3e4c2110 2024-08-19T00:39:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e500cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e500cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33040/0 (socket says 172.21.15.7:33040) 2024-08-19T00:39:56.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 -- 172.21.15.7:0/1579641124 learned_addr learned my addr 172.21.15.7:0/1579641124 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b7be00640 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e500780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b80e00640 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 -- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 msgr2=0x55bc3e500780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e500780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 -- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 msgr2=0x55bc3e4eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4eeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 -- 172.21.15.7:0/1579641124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc3e491e40 con 0x55bc3e4e5630 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.363+0000 7f3b73e00640 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e500cc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3b640013e0 tx=0x7f3b64010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128c03eb027ab79b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b6be00640 1 -- 172.21.15.7:0/1579641124 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64023070 con 0x55bc3e4e5630 2024-08-19T00:39:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b6be00640 1 -- 172.21.15.7:0/1579641124 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b64005d00 con 0x55bc3e4e5630 2024-08-19T00:39:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b6be00640 1 -- 172.21.15.7:0/1579641124 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64018040 con 0x55bc3e4e5630 2024-08-19T00:39:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 -- 172.21.15.7:0/1579641124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 msgr2=0x55bc3e500cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e500cc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3b640013e0 tx=0x7f3b64010000 comp rx=0 tx=0).stop 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 -- 172.21.15.7:0/1579641124 shutdown_connections 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5630 0x55bc3e500cc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 --2- 172.21.15.7:0/1579641124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4c2110 0x55bc3e500780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 -- 172.21.15.7:0/1579641124 >> 172.21.15.7:0/1579641124 conn(0x55bc3e45f110 msgr2=0x55bc3e48e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.364+0000 7f3b85e27740 1 -- 172.21.15.7:0/1579641124 shutdown_connections 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.365+0000 7f3b85e27740 1 -- 172.21.15.7:0/1579641124 wait complete. 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.365+0000 7f3b85e27740 1 -- start start 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.365+0000 7f3b85e27740 1 Processor -- start 2024-08-19T00:39:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.366+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4c2110 0x55bc3e55ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.366+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4e5630 0x55bc3e4bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.366+0000 7f3b85e27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.366+0000 7f3b85e27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bc3e4926f0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.366+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc3e4bbfc0 con 0x55bc3e4c2110 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.366+0000 7f3b85e27740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55bc3e4d8d20 con 0x55bc3e4e5630 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.366+0000 7f3b85e27740 10 client.0 _ll_register_callbacks cb 0x7f3b74076c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33056/0 (socket says 172.21.15.7:33056) 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 -- 172.21.15.7:0/2021498927 learned_addr learned my addr 172.21.15.7:0/2021498927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b7be00640 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4c2110 0x55bc3e55ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b73e00640 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4e5630 0x55bc3e4bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 -- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4e5630 msgr2=0x55bc3e4bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4e5630 0x55bc3e4bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 -- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4c2110 msgr2=0x55bc3e55ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4c2110 0x55bc3e55ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 -- 172.21.15.7:0/2021498927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc3e55b170 con 0x55bc3e4e5f90 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b80e00640 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bcb10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3b740772e0 tx=0x7f3b740aaab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea974c2b3bf0eaa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b69600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b69600640 1 -- 172.21.15.7:0/2021498927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7407a730 con 0x55bc3e4e5f90 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b64005d00 con 0x55bc3e4e5f90 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.367+0000 7f3b69600640 1 -- 172.21.15.7:0/2021498927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f3b74079db0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b69600640 1 -- 172.21.15.7:0/2021498927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f3b74079fb0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 10 client.5949 fetch_fsmap learned FSMap version 46 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55bc3e4e03d0 con 0x55bc3e4e5f90 2024-08-19T00:39:56.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b69600640 1 -- 172.21.15.7:0/2021498927 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b64005d00 con 0x55bc3e4e5f90 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b69600640 1 -- 172.21.15.7:0/2021498927 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f3b74079820 con 0x55bc3e4e5f90 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 10 client.5949 fetch_fsmap finished waiting for FSMap version 46 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 10 client.5949 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 20 client.5949 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4dccc0 0x55bc3e5001b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 4 client.5949 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 --> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] -- command(tid 0: {"prefix": "status"}) -- 0x55bc3e402620 con 0x55bc3e4dccc0 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.368+0000 7f3b7be00640 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4dccc0 0x55bc3e5001b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b7be00640 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4dccc0 0x55bc3e5001b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d37b18c31f4fa35 server_cookie=65166450adcfe0b4 in_seq=0 out_seq=0 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b69600640 10 client.5949 ms_handle_connect on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b69600640 1 -- 172.21.15.7:0/2021498927 <== mds.0 v2:172.21.15.7:6834/3306229985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55bc3e402620 con 0x55bc3e4dccc0 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b69600640 10 client.5949 handle_command_reply: tid=0 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 client.5949 shutdown 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 msgr2=0x55bc3e4bcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bcb10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3b740772e0 tx=0x7f3b740aaab0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 shutdown_connections 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55bc3e4dccc0 0x55bc3e5001b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc3e4e5f90 0x55bc3e4bcb10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bc3e4e5630 0x55bc3e4bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b69600640 0 client.5949 ms_handle_reset on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 --2- 172.21.15.7:0/2021498927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc3e4c2110 0x55bc3e55ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.369+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 >> 172.21.15.7:0/2021498927 conn(0x55bc3e45f110 msgr2=0x55bc3e4c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 shutdown_connections 2024-08-19T00:39:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b85e27740 1 -- 172.21.15.7:0/2021498927 wait complete. 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b85e27740 20 client.5949 trim_cache size 0 max 16384 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5757, 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:39:56.380 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:39:56.381 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 20.226985314, 2024-08-19T00:39:56.381 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 46, 2024-08-19T00:39:56.381 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 59, 2024-08-19T00:39:56.381 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 57, 2024-08-19T00:39:56.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 24.879986370000001 2024-08-19T00:39:56.381 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be30 msgr2=0x7f3b5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be30 0x7f3b5806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006fd0 tx=0x7f3b6c008040 comp rx=0 tx=0).stop 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c1439c0 msgr2=0x7f3b7c1f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c1439c0 0x7f3b7c1f83d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3b7402ac70 tx=0x7f3b74004a40 comp rx=0 tx=0).stop 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 shutdown_connections 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5806be30 0x7f3b5806e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b7c1439c0 0x7f3b7c1f83d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7c0d28c0 0x7f3b7c161650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 --2- 172.21.15.7:0/1944188198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b7c0b4610 0x7f3b7c155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.370+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 >> 172.21.15.7:0/1944188198 conn(0x7f3b7c062540 msgr2=0x7f3b7c1468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.371+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 shutdown_connections 2024-08-19T00:39:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.371+0000 7f3b81800640 1 -- 172.21.15.7:0/1944188198 wait complete. 2024-08-19T00:39:56.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:39:56.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.542+0000 7fe792200640 1 Processor -- start 2024-08-19T00:39:56.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.543+0000 7fe792200640 1 -- start start 2024-08-19T00:39:56.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe792200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe78c0d0ad0 0x7fe78c16d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe792200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c06e660 con 0x7fe78c0ce460 2024-08-19T00:39:56.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe792200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c06e940 con 0x7fe78c0aeb10 2024-08-19T00:39:56.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe792200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c0ae000 con 0x7fe78c0d0ad0 2024-08-19T00:39:56.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe783e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe78c0ce460 0x7fe78c0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58152/0 (socket says 172.21.15.7:58152) 2024-08-19T00:39:56.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe783e00640 1 -- 172.21.15.7:0/2225010970 learned_addr learned my addr 172.21.15.7:0/2225010970 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:56.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe78be00640 1 --2- 172.21.15.7:0/2225010970 >> v2:172.21.15.7:3300/0 conn(0x7fe78c0d0ad0 0x7fe78c16d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe78be00640 1 -- 172.21.15.7:0/2225010970 >> v1:172.21.15.162:6789/0 conn(0x7fe78c0aeb10 legacy=0x7fe78c0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.544+0000 7fe78be00640 1 -- 172.21.15.7:0/2225010970 >> v1:172.21.15.7:6789/0 conn(0x7fe78c0ce460 legacy=0x7fe78c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.545+0000 7fe78aa00640 1 -- 172.21.15.7:0/2225010970 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987009031 0 0) 0x7fe78c06e660 con 0x7fe78c0ce460 2024-08-19T00:39:56.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.545+0000 7fe78be00640 1 -- 172.21.15.7:0/2225010970 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c06ec20 con 0x7fe78c0d0ad0 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.545+0000 7fe78be00640 1 --2- 172.21.15.7:0/2225010970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0d0ad0 0x7fe78c16d4f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0ae180 tx=0x7fe78402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8831161a7cb9ae8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe78aa00640 1 -- 172.21.15.7:0/2225010970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784007740 con 0x7fe78c0d0ad0 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe78aa00640 1 -- 172.21.15.7:0/2225010970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7840078e0 con 0x7fe78c0d0ad0 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe78aa00640 1 -- 172.21.15.7:0/2225010970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784007cb0 con 0x7fe78c0d0ad0 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe792200640 1 -- 172.21.15.7:0/2225010970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0d0ad0 msgr2=0x7fe78c16d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe792200640 1 --2- 172.21.15.7:0/2225010970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0d0ad0 0x7fe78c16d4f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0ae180 tx=0x7fe78402a6f0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe792200640 1 -- 172.21.15.7:0/2225010970 shutdown_connections 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe792200640 1 --2- 172.21.15.7:0/2225010970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0d0ad0 0x7fe78c16d4f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe792200640 1 -- 172.21.15.7:0/2225010970 >> 172.21.15.7:0/2225010970 conn(0x7fe78c06bc70 msgr2=0x7fe78c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe792200640 1 -- 172.21.15.7:0/2225010970 shutdown_connections 2024-08-19T00:39:56.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.546+0000 7fe792200640 1 -- 172.21.15.7:0/2225010970 wait complete. 2024-08-19T00:39:56.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.548+0000 7fe792200640 1 Processor -- start 2024-08-19T00:39:56.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.548+0000 7fe792200640 1 -- start start 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe792200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0aeb10 0x7fe78c150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe792200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0ce460 0x7fe78c15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe792200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c0d0ad0 0x7fe78c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe792200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c06f700 con 0x7fe78c0ce460 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe792200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c06f1e0 con 0x7fe78c0d0ad0 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe792200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c1ece10 con 0x7fe78c0aeb10 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe783e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0ce460 0x7fe78c15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe783e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0ce460 0x7fe78c15fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33066/0 (socket says 172.21.15.7:33066) 2024-08-19T00:39:56.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe783e00640 1 -- 172.21.15.7:0/3507133837 learned_addr learned my addr 172.21.15.7:0/3507133837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:56.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.549+0000 7fe78b400640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0aeb10 0x7fe78c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe78be00640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c0d0ad0 0x7fe78c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783e00640 1 -- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0aeb10 msgr2=0x7fe78c150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783e00640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0aeb10 0x7fe78c150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783e00640 1 -- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c0d0ad0 msgr2=0x7fe78c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783e00640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c0d0ad0 0x7fe78c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783e00640 1 -- 172.21.15.7:0/3507133837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c150980 con 0x7fe78c0ce460 2024-08-19T00:39:56.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783e00640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0ce460 0x7fe78c15fca0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe77400c4a0 tx=0x7fe77400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783400640 1 -- 172.21.15.7:0/3507133837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774018070 con 0x7fe78c0ce460 2024-08-19T00:39:56.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783400640 1 -- 172.21.15.7:0/3507133837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7740074e0 con 0x7fe78c0ce460 2024-08-19T00:39:56.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c1601e0 con 0x7fe78c0ce460 2024-08-19T00:39:56.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe783400640 1 -- 172.21.15.7:0/3507133837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774004a20 con 0x7fe78c0ce460 2024-08-19T00:39:56.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.550+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c160780 con 0x7fe78c0ce460 2024-08-19T00:39:56.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.551+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78c0cd910 con 0x7fe78c0ce460 2024-08-19T00:39:56.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.552+0000 7fe783400640 1 -- 172.21.15.7:0/3507133837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe77401b070 con 0x7fe78c0ce460 2024-08-19T00:39:56.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.553+0000 7fe783400640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76806be60 0x7fe76806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:56.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.553+0000 7fe783400640 1 -- 172.21.15.7:0/3507133837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7fe77408a160 con 0x7fe78c0ce460 2024-08-19T00:39:56.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.553+0000 7fe78b400640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76806be60 0x7fe76806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:56.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.554+0000 7fe78b400640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76806be60 0x7fe76806e320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe78c1ed7d0 tx=0x7fe77c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:56.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.557+0000 7fe783400640 1 -- 172.21.15.7:0/3507133837 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe78c0cd910 con 0x7fe78c0ce460 2024-08-19T00:39:56.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.779+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe78c0cf3c0 con 0x7fe78c0ce460 2024-08-19T00:39:56.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.780+0000 7fe783400640 1 -- 172.21.15.7:0/3507133837 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7fe78c150980 con 0x7fe78c0ce460 2024-08-19T00:39:56.782 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:39:56.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76806be60 msgr2=0x7fe76806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76806be60 0x7fe76806e320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe78c1ed7d0 tx=0x7fe77c009040 comp rx=0 tx=0).stop 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0ce460 msgr2=0x7fe78c15fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0ce460 0x7fe78c15fca0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe77400c4a0 tx=0x7fe77400c960 comp rx=0 tx=0).stop 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 shutdown_connections 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe76806be60 0x7fe76806e320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c0d0ad0 0x7fe78c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe78c0ce460 0x7fe78c15fca0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 --2- 172.21.15.7:0/3507133837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0aeb10 0x7fe78c150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 >> 172.21.15.7:0/3507133837 conn(0x7fe78c06bc70 msgr2=0x7fe78c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 shutdown_connections 2024-08-19T00:39:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:56.782+0000 7fe792200640 1 -- 172.21.15.7:0/3507133837 wait complete. 2024-08-19T00:39:56.799 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:39:56.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:56.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:56.800 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:39:56.836 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:39:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:39:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:39:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42665sec preferred_lft 42665sec 2024-08-19T00:39:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:39:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:39:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:39:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:56.839 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:39:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:39:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:39:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:56.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:56.839 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:39:56.930 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:39:56.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:56.933 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:39:56.969 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:39:56.969 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:39:56.969 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:39:56.969 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:39:56.969 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:39:56.970 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:39:56.970 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:39:56.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:39:56.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:39:56.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:39:56.970 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:39:57.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:39:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:57.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:57.168 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:39:57.203 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:39:57.203 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:39:57.204 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:57.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:57.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:39:57.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:39:57.301 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:57.336 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:57.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:39:57.336 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:57.412 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:39:57.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:57.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:57.541 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:57.541 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:57.541 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:57.556 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:57.556 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:57.556 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:57.556 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:39:57.556 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:39:57.578 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:57.578 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:57.578 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:57.578 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:39:57.578 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:39:57.579 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:39:57.579 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:39:57.579 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:39:57.580 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:39:57.580 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:39:57.580 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:39:57.580 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:39:57.580 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:39:57.583 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:39:57.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:57.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:57.640 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi007.stdout:client5818 2024-08-19T00:39:57.737 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:57.737 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:57.773 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p a/{b,c}/d; sync .') 2024-08-19T00:39:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:39:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:57.918 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:39:57.918 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:39:57.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:39:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.150+0000 7f9cdd000640 1 Processor -- start 2024-08-19T00:39:58.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.150+0000 7f9cdd000640 1 -- start start 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.151+0000 7f9cdd000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9cd815e3e0 0x7f9cd80b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.151+0000 7f9cdd000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd80d27b0 0x7f9cd80d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.151+0000 7f9cdd000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd80d3110 con 0x7f9cd80b4150 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.151+0000 7f9cdd000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd80b4df0 con 0x7f9cd815e3e0 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.151+0000 7f9cdd000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd80b50d0 con 0x7f9cd80d27b0 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.151+0000 7f9cd7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9cd80b4150 0x7f9cd80b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58154/0 (socket says 172.21.15.7:58154) 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd7e00640 1 -- 172.21.15.7:0/2225580969 learned_addr learned my addr 172.21.15.7:0/2225580969 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd6a00640 1 --2- 172.21.15.7:0/2225580969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd80d27b0 0x7f9cd80d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd7400640 1 --2- 172.21.15.7:0/2225580969 >> v2:172.21.15.162:3300/0 conn(0x7f9cd815e3e0 0x7f9cd80b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd6000640 1 -- 172.21.15.7:0/2225580969 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667319050 0 0) 0x7f9cd80d3110 con 0x7f9cd80b4150 2024-08-19T00:39:58.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd6000640 1 -- 172.21.15.7:0/2225580969 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cbc003520 con 0x7f9cd80b4150 2024-08-19T00:39:58.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd6a00640 1 -- 172.21.15.7:0/2225580969 >> v2:172.21.15.162:3300/0 conn(0x7f9cd815e3e0 msgr2=0x7f9cd80b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd6a00640 1 --2- 172.21.15.7:0/2225580969 >> v2:172.21.15.162:3300/0 conn(0x7f9cd815e3e0 0x7f9cd80b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd6a00640 1 -- 172.21.15.7:0/2225580969 >> v1:172.21.15.7:6789/0 conn(0x7f9cd80b4150 legacy=0x7f9cd80b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.152+0000 7f9cd6a00640 1 -- 172.21.15.7:0/2225580969 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd80cf1e0 con 0x7f9cd80d27b0 2024-08-19T00:39:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.153+0000 7f9cd6a00640 1 --2- 172.21.15.7:0/2225580969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd80d27b0 0x7f9cd80d2bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40097a0 tx=0x7f9cc402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f29f377a1b6d4245 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cd6000640 1 -- 172.21.15.7:0/2225580969 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4037070 con 0x7f9cd80d27b0 2024-08-19T00:39:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cd6000640 1 -- 172.21.15.7:0/2225580969 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc4032440 con 0x7f9cd80d27b0 2024-08-19T00:39:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cd6000640 1 -- 172.21.15.7:0/2225580969 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4032810 con 0x7f9cd80d27b0 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 -- 172.21.15.7:0/2225580969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd80d27b0 msgr2=0x7f9cd80d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 --2- 172.21.15.7:0/2225580969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd80d27b0 0x7f9cd80d2bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40097a0 tx=0x7f9cc402a180 comp rx=0 tx=0).stop 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 -- 172.21.15.7:0/2225580969 shutdown_connections 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 --2- 172.21.15.7:0/2225580969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd80d27b0 0x7f9cd80d2bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 --2- 172.21.15.7:0/2225580969 >> v2:172.21.15.162:3300/0 conn(0x7f9cd815e3e0 0x7f9cd80b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 -- 172.21.15.7:0/2225580969 >> 172.21.15.7:0/2225580969 conn(0x7f9cd808dbe0 msgr2=0x7f9cd809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 -- 172.21.15.7:0/2225580969 shutdown_connections 2024-08-19T00:39:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.154+0000 7f9cdd000640 1 -- 172.21.15.7:0/2225580969 wait complete. 2024-08-19T00:39:58.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.156+0000 7f9cdd000640 1 Processor -- start 2024-08-19T00:39:58.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.156+0000 7f9cdd000640 1 -- start start 2024-08-19T00:39:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cdd000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cd80b4150 0x7f9cd81f7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cdd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cd80d27b0 0x7f9cd81f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cdd000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd815e3e0 0x7f9cd80b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cdd000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80b13a0 con 0x7f9cd80d27b0 2024-08-19T00:39:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cdd000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80cee90 con 0x7f9cd80b4150 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cdd000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd80cf9e0 con 0x7f9cd815e3e0 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cd6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cd80d27b0 0x7f9cd81f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cd6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cd80d27b0 0x7f9cd81f3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33068/0 (socket says 172.21.15.7:33068) 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cd6a00640 1 -- 172.21.15.7:0/1280600411 learned_addr learned my addr 172.21.15.7:0/1280600411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.157+0000 7f9cd7400640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cd80b4150 0x7f9cd81f7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.158+0000 7f9cd7e00640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd815e3e0 0x7f9cd80b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.158+0000 7f9cd6a00640 1 -- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd815e3e0 msgr2=0x7f9cd80b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.158+0000 7f9cd6a00640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd815e3e0 0x7f9cd80b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.158+0000 7f9cd6a00640 1 -- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cd80b4150 msgr2=0x7f9cd81f7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.158+0000 7f9cd6a00640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cd80b4150 0x7f9cd81f7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.158+0000 7f9cd6a00640 1 -- 172.21.15.7:0/1280600411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd815e940 con 0x7f9cd80d27b0 2024-08-19T00:39:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.158+0000 7f9cd6a00640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cd80d27b0 0x7f9cd81f3280 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40098c0 tx=0x7f9cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.159+0000 7f9ccf400640 1 -- 172.21.15.7:0/1280600411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4041070 con 0x7f9cd80d27b0 2024-08-19T00:39:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.159+0000 7f9ccf400640 1 -- 172.21.15.7:0/1280600411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc403c870 con 0x7f9cd80d27b0 2024-08-19T00:39:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.159+0000 7f9ccf400640 1 -- 172.21.15.7:0/1280600411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4037040 con 0x7f9cd80d27b0 2024-08-19T00:39:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.159+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd81f77d0 con 0x7f9cd80d27b0 2024-08-19T00:39:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.159+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd81f7d90 con 0x7f9cd80d27b0 2024-08-19T00:39:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.160+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd80b0e60 con 0x7f9cd80d27b0 2024-08-19T00:39:58.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.161+0000 7f9ccf400640 1 -- 172.21.15.7:0/1280600411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cc4044070 con 0x7f9cd80d27b0 2024-08-19T00:39:58.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.162+0000 7f9ccf400640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9cb806be30 0x7f9cb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.162+0000 7f9ccf400640 1 -- 172.21.15.7:0/1280600411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f9cc40ab800 con 0x7f9cd80d27b0 2024-08-19T00:39:58.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.162+0000 7f9cd7400640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9cb806be30 0x7f9cb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.162+0000 7f9cd7400640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9cb806be30 0x7f9cb806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009aa0 tx=0x7f9cc8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.166+0000 7f9ccf400640 1 -- 172.21.15.7:0/1280600411 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9cc4079b10 con 0x7f9cd80d27b0 2024-08-19T00:39:58.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.363+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9cd80d4240 con 0x7f9cd80d27b0 2024-08-19T00:39:58.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.363+0000 7f9ccf400640 1 -- 172.21.15.7:0/1280600411 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7f9cc407de10 con 0x7f9cd80d27b0 2024-08-19T00:39:58.365 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:39:58.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.365+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9cb806be30 msgr2=0x7f9cb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.365+0000 7f9cdd000640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9cb806be30 0x7f9cb806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009aa0 tx=0x7f9cc8009190 comp rx=0 tx=0).stop 2024-08-19T00:39:58.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.365+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cd80d27b0 msgr2=0x7f9cd81f3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.365+0000 7f9cdd000640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cd80d27b0 0x7f9cd81f3280 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40098c0 tx=0x7f9cc40046c0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 shutdown_connections 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9cb806be30 0x7f9cb806e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9cd815e3e0 0x7f9cd80b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cd80d27b0 0x7f9cd81f3280 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 --2- 172.21.15.7:0/1280600411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cd80b4150 0x7f9cd81f7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 >> 172.21.15.7:0/1280600411 conn(0x7f9cd808dbe0 msgr2=0x7f9cd80d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 shutdown_connections 2024-08-19T00:39:58.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.366+0000 7f9cdd000640 1 -- 172.21.15.7:0/1280600411 wait complete. 2024-08-19T00:39:58.383 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:39:58.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:58.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:58.448 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:39:58.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:58.449 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:39:58.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-08-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.683+0000 7f790f200640 1 Processor -- start 2024-08-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.683+0000 7f790f200640 1 -- start start 2024-08-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.684+0000 7f790f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79080ceff0 0x7f79080b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.684+0000 7f790f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f79080cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.684+0000 7f790f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790815e7a0 con 0x7f790815e3c0 2024-08-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.684+0000 7f790f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f79081623e0 con 0x7f79080ceff0 2024-08-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.684+0000 7f790f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79080ce830 con 0x7f79080cf960 2024-08-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.684+0000 7f7907e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f790815e3c0 0x7f7908162870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58166/0 (socket says 172.21.15.7:58166) 2024-08-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.684+0000 7f7907e00640 1 -- 172.21.15.7:0/54662189 learned_addr learned my addr 172.21.15.7:0/54662189 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f7907400640 1 --2- 172.21.15.7:0/54662189 >> v2:172.21.15.7:3300/0 conn(0x7f79080ceff0 0x7f79080b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f790d200640 1 --2- 172.21.15.7:0/54662189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f79080cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f7906a00640 1 -- 172.21.15.7:0/54662189 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064002011 0 0) 0x7f790815e7a0 con 0x7f790815e3c0 2024-08-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f7906a00640 1 -- 172.21.15.7:0/54662189 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78ec003520 con 0x7f790815e3c0 2024-08-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f7907400640 1 -- 172.21.15.7:0/54662189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 msgr2=0x7f79080cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f7907400640 1 --2- 172.21.15.7:0/54662189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f79080cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f7907400640 1 -- 172.21.15.7:0/54662189 >> v1:172.21.15.7:6789/0 conn(0x7f790815e3c0 legacy=0x7f7908162870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.685+0000 7f7907400640 1 -- 172.21.15.7:0/54662189 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080ceb10 con 0x7f79080ceff0 2024-08-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.686+0000 7f7907400640 1 --2- 172.21.15.7:0/54662189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79080ceff0 0x7f79080b0700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f78f40097a0 tx=0x7f78f402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bdff85daafcfc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.686+0000 7f7906a00640 1 -- 172.21.15.7:0/54662189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4037070 con 0x7f79080ceff0 2024-08-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.686+0000 7f7906a00640 1 -- 172.21.15.7:0/54662189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f402ae50 con 0x7f79080ceff0 2024-08-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.686+0000 7f7906a00640 1 -- 172.21.15.7:0/54662189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4032660 con 0x7f79080ceff0 2024-08-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 -- 172.21.15.7:0/54662189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79080ceff0 msgr2=0x7f79080b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 --2- 172.21.15.7:0/54662189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79080ceff0 0x7f79080b0700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f78f40097a0 tx=0x7f78f402a100 comp rx=0 tx=0).stop 2024-08-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 -- 172.21.15.7:0/54662189 shutdown_connections 2024-08-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 --2- 172.21.15.7:0/54662189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f79080cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 --2- 172.21.15.7:0/54662189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79080ceff0 0x7f79080b0700 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 -- 172.21.15.7:0/54662189 >> 172.21.15.7:0/54662189 conn(0x7f79080b2ee0 msgr2=0x7f79080b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 -- 172.21.15.7:0/54662189 shutdown_connections 2024-08-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.687+0000 7f790f200640 1 -- 172.21.15.7:0/54662189 wait complete. 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.689+0000 7f790f200640 1 Processor -- start 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.689+0000 7f790f200640 1 -- start start 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79080ceff0 0x7f7908152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f790815bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f790815e3c0 0x7f79080b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f790806f480 con 0x7f790815e3c0 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f790806f300 con 0x7f79080ceff0 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f790806f600 con 0x7f79080cf960 2024-08-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f790815e3c0 0x7f79080b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f790815e3c0 0x7f79080b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33090/0 (socket says 172.21.15.7:33090) 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 -- 172.21.15.7:0/489257857 learned_addr learned my addr 172.21.15.7:0/489257857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f7907e00640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79080ceff0 0x7f7908152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 -- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 msgr2=0x7f790815bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f7907400640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f790815bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f790815bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 -- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79080ceff0 msgr2=0x7f7908152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79080ceff0 0x7f7908152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f790d200640 1 -- 172.21.15.7:0/489257857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79081533e0 con 0x7f790815e3c0 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f7907e00640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79080ceff0 0x7f7908152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.690+0000 7f7907400640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f790815bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.691+0000 7f790d200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f790815e3c0 0x7f79080b5050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7900007e40 tx=0x7f790000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.691+0000 7f78ffe00640 1 -- 172.21.15.7:0/489257857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900014620 con 0x7f790815e3c0 2024-08-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.691+0000 7f78ffe00640 1 -- 172.21.15.7:0/489257857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7900019070 con 0x7f790815e3c0 2024-08-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.691+0000 7f78ffe00640 1 -- 172.21.15.7:0/489257857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900014a20 con 0x7f790815e3c0 2024-08-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.691+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7908160bb0 con 0x7f790815e3c0 2024-08-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.691+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79080b5ea0 con 0x7f790815e3c0 2024-08-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.693+0000 7f78ffe00640 1 -- 172.21.15.7:0/489257857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7900014bc0 con 0x7f790815e3c0 2024-08-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.694+0000 7f78ffe00640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e806be30 0x7f78e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.694+0000 7f78ffe00640 1 -- 172.21.15.7:0/489257857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f790008b7c0 con 0x7f790815e3c0 2024-08-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.694+0000 7f7907e00640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e806be30 0x7f78e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.695+0000 7f7911fcc740 1 Processor -- start 2024-08-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.695+0000 7f7907e00640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e806be30 0x7f78e806e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f78f8005880 tx=0x7f78f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.695+0000 7f7911fcc740 1 -- start start 2024-08-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85786cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e8578b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7911fcc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8577d4de0 con 0x55e8578b8bf0 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e85776d0e0 con 0x55e85786fd00 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e8577d0da0 con 0x55e857873d10 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7907e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7907e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33092/0 (socket says 172.21.15.7:33092) 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7907e00640 1 -- 172.21.15.7:0/788141594 learned_addr learned my addr 172.21.15.7:0/788141594 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f790d200640 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e8578b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.696+0000 7f7907400640 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85786cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f7907e00640 1 -- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 msgr2=0x55e8578b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f7907e00640 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e8578b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f7907e00640 1 -- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 msgr2=0x55e85786cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f7907e00640 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85786cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f7907e00640 1 -- 172.21.15.7:0/788141594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8575b27d0 con 0x55e8578b8bf0 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f7907400640 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85786cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f7907e00640 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b8fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f78f8005ca0 tx=0x7f78f8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dff547eb43793a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f78fcc00640 1 -- 172.21.15.7:0/788141594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8007760 con 0x55e8578b8bf0 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f78fcc00640 1 -- 172.21.15.7:0/788141594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f800da70 con 0x55e8578b8bf0 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.697+0000 7f78fcc00640 1 -- 172.21.15.7:0/788141594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f800de20 con 0x55e8578b8bf0 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 -- 172.21.15.7:0/788141594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 msgr2=0x55e8578b8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b8fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f78f8005ca0 tx=0x7f78f8010000 comp rx=0 tx=0).stop 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 -- 172.21.15.7:0/788141594 shutdown_connections 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e8578b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85786cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 --2- 172.21.15.7:0/788141594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b8fd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 -- 172.21.15.7:0/788141594 >> 172.21.15.7:0/788141594 conn(0x55e857838ff0 msgr2=0x55e8578b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 -- 172.21.15.7:0/788141594 shutdown_connections 2024-08-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.698+0000 7f7911fcc740 1 -- 172.21.15.7:0/788141594 wait complete. 2024-08-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.699+0000 7f7911fcc740 1 -- start start 2024-08-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.699+0000 7f7911fcc740 1 Processor -- start 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85788afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e85789ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7911fcc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8578b5040 con 0x55e8578b8bf0 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e857790180 con 0x55e85786fd00 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e85789a050 con 0x55e857873d10 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7911fcc740 10 client.0 _ll_register_callbacks cb 0x55e85777c4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f790d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f790d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33108/0 (socket says 172.21.15.7:33108) 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f790d200640 1 -- 172.21.15.7:0/578165246 learned_addr learned my addr 172.21.15.7:0/578165246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7907e00640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85788afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f7907400640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e85789ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.700+0000 7f790d200640 1 -- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 msgr2=0x55e85789ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f790d200640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e85789ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f790d200640 1 -- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 msgr2=0x55e85788afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f790d200640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85788afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f790d200640 1 -- 172.21.15.7:0/578165246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8574e83f0 con 0x55e8578b8bf0 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f7907e00640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85788afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f790d200640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b1040 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7900089ca0 tx=0x7f7900059480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad45e355d98b77c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f78f1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f78f1600640 1 -- 172.21.15.7:0/578165246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900062600 con 0x55e8578b8bf0 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f800da70 con 0x55e8578b8bf0 2024-08-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f78f1600640 1 -- 172.21.15.7:0/578165246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f7900062170 con 0x55e8578b8bf0 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f78f1600640 1 -- 172.21.15.7:0/578165246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f7900062370 con 0x55e8578b8bf0 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f7911fcc740 10 client.5979 fetch_fsmap learned FSMap version 46 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55e8574a80f0 con 0x55e8578b8bf0 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.701+0000 7f78f1600640 1 -- 172.21.15.7:0/578165246 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f800da70 con 0x55e8578b8bf0 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f78f1600640 1 -- 172.21.15.7:0/578165246 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f7900058e70 con 0x55e8578b8bf0 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7911fcc740 10 client.5979 fetch_fsmap finished waiting for FSMap version 46 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7911fcc740 10 client.5979 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7911fcc740 20 client.5979 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7911fcc740 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578b3230 0x55e8578b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7911fcc740 4 client.5979 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 --> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8577e2510 con 0x55e8578b3230 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7907e00640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578b3230 0x55e8578b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f7907e00640 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578b3230 0x55e8578b3680 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b794499c728b263c server_cookie=5f19a81b9e72543e in_seq=0 out_seq=0 2024-08-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.702+0000 7f78f1600640 10 client.5979 ms_handle_connect on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.703+0000 7f78f1600640 1 -- 172.21.15.7:0/578165246 <== mds.0 v2:172.21.15.7:6834/3306229985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8577e2510 con 0x55e8578b3230 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.703+0000 7f78f1600640 10 client.5979 handle_command_reply: tid=0 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.703+0000 7f7911fcc740 1 client.5979 shutdown 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.703+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 msgr2=0x55e8578b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.703+0000 7f7911fcc740 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b1040 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7900089ca0 tx=0x7f7900059480 comp rx=0 tx=0).stop 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 shutdown_connections 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578b3230 0x55e8578b3680 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e8578b1040 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e85789ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 --2- 172.21.15.7:0/578165246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e85788afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 >> 172.21.15.7:0/578165246 conn(0x55e857838ff0 msgr2=0x55e8578b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f78f1600640 0 client.5979 ms_handle_reset on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 shutdown_connections 2024-08-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 1 -- 172.21.15.7:0/578165246 wait complete. 2024-08-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.704+0000 7f7911fcc740 20 client.5979 trim_cache size 0 max 16384 2024-08-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.719+0000 7f7911fcc740 1 Processor -- start 2024-08-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.719+0000 7f7911fcc740 1 -- start start 2024-08-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.720+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e8578ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.720+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e857897620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.720+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e857897b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.720+0000 7f7911fcc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79082007d0 con 0x55e8578b8bf0 2024-08-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.720+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79081ff850 con 0x55e85786fd00 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.720+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79080b1ff0 con 0x55e857873d10 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.720+0000 7f790d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e857897b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e857897b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33112/0 (socket says 172.21.15.7:33112) 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 -- 172.21.15.7:0/349892654 learned_addr learned my addr 172.21.15.7:0/349892654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f7907e00640 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e8578ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f7907400640 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e857897620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 -- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 msgr2=0x55e857897620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e857897620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 -- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 msgr2=0x55e8578ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e8578ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 -- 172.21.15.7:0/349892654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8578b1c80 con 0x55e8578b8bf0 2024-08-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f7907e00640 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e8578ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f790d200640 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e857897b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f79000599b0 tx=0x7f790005c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3178be9b9671617e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f78f3e00640 1 -- 172.21.15.7:0/349892654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900062600 con 0x55e8578b8bf0 2024-08-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f78f3e00640 1 -- 172.21.15.7:0/349892654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7900059a20 con 0x55e8578b8bf0 2024-08-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.721+0000 7f78f3e00640 1 -- 172.21.15.7:0/349892654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900056090 con 0x55e8578b8bf0 2024-08-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 -- 172.21.15.7:0/349892654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 msgr2=0x55e857897b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e857897b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f79000599b0 tx=0x7f790005c000 comp rx=0 tx=0).stop 2024-08-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 -- 172.21.15.7:0/349892654 shutdown_connections 2024-08-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8578b8bf0 0x55e857897b60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e857873d10 0x55e857897620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 --2- 172.21.15.7:0/349892654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85786fd00 0x55e8578ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 -- 172.21.15.7:0/349892654 >> 172.21.15.7:0/349892654 conn(0x55e857838ff0 msgr2=0x55e85786da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 -- 172.21.15.7:0/349892654 shutdown_connections 2024-08-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.722+0000 7f7911fcc740 1 -- 172.21.15.7:0/349892654 wait complete. 2024-08-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.723+0000 7f7911fcc740 1 -- start start 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.723+0000 7f7911fcc740 1 Processor -- start 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85786fd00 0x55e8578ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e857873d10 0x55e857935200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7911fcc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8578b8bf0 0x55e857897da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7911fcc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8578b2890 con 0x55e85786fd00 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79081ff350 con 0x55e857873d10 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7911fcc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e8578ced30 con 0x55e8578b8bf0 2024-08-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7911fcc740 10 client.0 _ll_register_callbacks cb 0x7f7900007f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85786fd00 0x55e8578ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85786fd00 0x55e8578ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33116/0 (socket says 172.21.15.7:33116) 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 -- 172.21.15.7:0/4253887602 learned_addr learned my addr 172.21.15.7:0/4253887602 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f790d200640 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8578b8bf0 0x55e857897da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907400640 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e857873d10 0x55e857935200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 -- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8578b8bf0 msgr2=0x55e857897da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8578b8bf0 0x55e857897da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 -- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e857873d10 msgr2=0x55e857935200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e857873d10 0x55e857935200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.724+0000 7f7907e00640 1 -- 172.21.15.7:0/4253887602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8578b4390 con 0x55e85786fd00 2024-08-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f7907e00640 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85786fd00 0x55e8578ce470 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f78f8013000 tx=0x7f78f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62817737396f482f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f78f1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f78f1600640 1 -- 172.21.15.7:0/4253887602 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8020450 con 0x55e85786fd00 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7900059a20 con 0x55e85786fd00 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f78f1600640 1 -- 172.21.15.7:0/4253887602 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f78f80205f0 con 0x55e85786fd00 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f78f1600640 1 -- 172.21.15.7:0/4253887602 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f78f803d050 con 0x55e85786fd00 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f7911fcc740 10 client.5985 fetch_fsmap learned FSMap version 46 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.725+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55e8578b10a0 con 0x55e85786fd00 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f78f1600640 1 -- 172.21.15.7:0/4253887602 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7900059a20 con 0x55e85786fd00 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f78f1600640 1 -- 172.21.15.7:0/4253887602 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f78f8040020 con 0x55e85786fd00 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7911fcc740 10 client.5985 fetch_fsmap finished waiting for FSMap version 46 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7911fcc740 10 client.5985 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7911fcc740 20 client.5985 populate_metadata read hostname 'smithi007' 2024-08-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7911fcc740 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578982e0 0x55e8578b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7911fcc740 4 client.5985 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 --> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e85789aa60 con 0x55e8578982e0 2024-08-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7907400640 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578982e0 0x55e8578b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f7907400640 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578982e0 0x55e8578b3610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b281fa661cbb723 server_cookie=4f015e9c89d0c660 in_seq=0 out_seq=0 2024-08-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.726+0000 7f78f1600640 10 client.5985 ms_handle_connect on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.738+0000 7f78f1600640 1 -- 172.21.15.7:0/4253887602 <== mds.0 v2:172.21.15.7:6834/3306229985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e85789aa60 con 0x55e8578982e0 2024-08-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.738+0000 7f78f1600640 10 client.5985 handle_command_reply: tid=0 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.738+0000 7f7911fcc740 1 client.5985 shutdown 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.738+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85786fd00 msgr2=0x55e8578ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.738+0000 7f7911fcc740 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85786fd00 0x55e8578ce470 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f78f8013000 tx=0x7f78f8000bc0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 shutdown_connections 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:6834/3306229985,v1:172.21.15.7:6836/3306229985] conn(0x55e8578982e0 0x55e8578b3610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e8578b8bf0 0x55e857897da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e857873d10 0x55e857935200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f78f1600640 0 client.5985 ms_handle_reset on v2:172.21.15.7:6834/3306229985 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 --2- 172.21.15.7:0/4253887602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85786fd00 0x55e8578ce470 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 >> 172.21.15.7:0/4253887602 conn(0x55e857838ff0 msgr2=0x55e85786da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 shutdown_connections 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 1 -- 172.21.15.7:0/4253887602 wait complete. 2024-08-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.739+0000 7f7911fcc740 20 client.5985 trim_cache size 0 max 16384 2024-08-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-08-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-08-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e806be30 msgr2=0x7f78e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e806be30 0x7f78e806e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f78f8005880 tx=0x7f78f8009040 comp rx=0 tx=0).stop 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f790815e3c0 msgr2=0x7f79080b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f790815e3c0 0x7f79080b5050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7900007e40 tx=0x7f790000e4b0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 shutdown_connections 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e806be30 0x7f78e806e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f790815e3c0 0x7f79080b5050 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79080cf960 0x7f790815bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 --2- 172.21.15.7:0/489257857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79080ceff0 0x7f7908152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 >> 172.21.15.7:0/489257857 conn(0x7f79080b2ee0 msgr2=0x7f79080b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 shutdown_connections 2024-08-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.740+0000 7f790f200640 1 -- 172.21.15.7:0/489257857 wait complete. 2024-08-19T00:39:58.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:39:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.912+0000 7fbdf4800640 1 Processor -- start 2024-08-19T00:39:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.912+0000 7fbdf4800640 1 -- start start 2024-08-19T00:39:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.913+0000 7fbdf4800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbdec159bf0 0x7fbdec073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.913+0000 7fbdf4800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec0cec10 0x7fbdec0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf4800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdec06f7f0 con 0x7fbdec0739a0 2024-08-19T00:39:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf4800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbdec06f510 con 0x7fbdec159bf0 2024-08-19T00:39:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf4800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbdec072980 con 0x7fbdec0cec10 2024-08-19T00:39:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf1400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbdec0739a0 0x7fbdec0ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58176/0 (socket says 172.21.15.7:58176) 2024-08-19T00:39:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf1400640 1 -- 172.21.15.7:0/2251674967 learned_addr learned my addr 172.21.15.7:0/2251674967 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:39:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf2800640 1 --2- 172.21.15.7:0/2251674967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec0cec10 0x7fbdec0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf1e00640 1 --2- 172.21.15.7:0/2251674967 >> v2:172.21.15.162:3300/0 conn(0x7fbdec159bf0 0x7fbdec073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf0a00640 1 -- 172.21.15.7:0/2251674967 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883728893 0 0) 0x7fbdec06f7f0 con 0x7fbdec0739a0 2024-08-19T00:39:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf0a00640 1 -- 172.21.15.7:0/2251674967 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdd4003520 con 0x7fbdec0739a0 2024-08-19T00:39:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf2800640 1 -- 172.21.15.7:0/2251674967 >> v2:172.21.15.162:3300/0 conn(0x7fbdec159bf0 msgr2=0x7fbdec073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:39:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf2800640 1 --2- 172.21.15.7:0/2251674967 >> v2:172.21.15.162:3300/0 conn(0x7fbdec159bf0 0x7fbdec073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf2800640 1 -- 172.21.15.7:0/2251674967 >> v1:172.21.15.7:6789/0 conn(0x7fbdec0739a0 legacy=0x7fbdec0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.914+0000 7fbdf2800640 1 -- 172.21.15.7:0/2251674967 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec072c60 con 0x7fbdec0cec10 2024-08-19T00:39:58.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf2800640 1 --2- 172.21.15.7:0/2251674967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec0cec10 0x7fbdec0d03c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009d90 tx=0x7fbde802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa8fb654d7e0940 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf0a00640 1 -- 172.21.15.7:0/2251674967 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8031600 con 0x7fbdec0cec10 2024-08-19T00:39:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf0a00640 1 -- 172.21.15.7:0/2251674967 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde80317a0 con 0x7fbdec0cec10 2024-08-19T00:39:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf0a00640 1 -- 172.21.15.7:0/2251674967 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8031b70 con 0x7fbdec0cec10 2024-08-19T00:39:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf4800640 1 -- 172.21.15.7:0/2251674967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec0cec10 msgr2=0x7fbdec0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf4800640 1 --2- 172.21.15.7:0/2251674967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec0cec10 0x7fbdec0d03c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009d90 tx=0x7fbde802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf4800640 1 -- 172.21.15.7:0/2251674967 shutdown_connections 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf4800640 1 --2- 172.21.15.7:0/2251674967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec0cec10 0x7fbdec0d03c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf4800640 1 --2- 172.21.15.7:0/2251674967 >> v2:172.21.15.162:3300/0 conn(0x7fbdec159bf0 0x7fbdec073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.916+0000 7fbdf4800640 1 -- 172.21.15.7:0/2251674967 >> 172.21.15.7:0/2251674967 conn(0x7fbdec06bc70 msgr2=0x7fbdec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.917+0000 7fbdf4800640 1 -- 172.21.15.7:0/2251674967 shutdown_connections 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.917+0000 7fbdf4800640 1 -- 172.21.15.7:0/2251674967 wait complete. 2024-08-19T00:39:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.918+0000 7fbdf4800640 1 Processor -- start 2024-08-19T00:39:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.918+0000 7fbdf4800640 1 -- start start 2024-08-19T00:39:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf4800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdec0739a0 0x7fbdec14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf4800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec159bf0 0x7fbdec154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf4800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdec0b3b20 0x7fbdec155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf4800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec15a150 con 0x7fbdec0739a0 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf4800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec159fd0 con 0x7fbdec0b3b20 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf4800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbdec0d0900 con 0x7fbdec159bf0 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdec0739a0 0x7fbdec14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.919+0000 7fbdf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdec0739a0 0x7fbdec14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33126/0 (socket says 172.21.15.7:33126) 2024-08-19T00:39:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1e00640 1 -- 172.21.15.7:0/4272110853 learned_addr learned my addr 172.21.15.7:0/4272110853 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:39:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf2800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdec0b3b20 0x7fbdec155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1400640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec159bf0 0x7fbdec154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1e00640 1 -- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec159bf0 msgr2=0x7fbdec154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1e00640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec159bf0 0x7fbdec154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1e00640 1 -- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdec0b3b20 msgr2=0x7fbdec155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1e00640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdec0b3b20 0x7fbdec155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:58.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1e00640 1 -- 172.21.15.7:0/4272110853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec0b4c60 con 0x7fbdec0739a0 2024-08-19T00:39:58.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf2800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdec0b3b20 0x7fbdec155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:58.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1400640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec159bf0 0x7fbdec154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:39:58.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbdf1e00640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdec0739a0 0x7fbdec14e4b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbde000e9e0 tx=0x7fbde000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbde6000640 1 -- 172.21.15.7:0/4272110853 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0017070 con 0x7fbdec0739a0 2024-08-19T00:39:58.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbde6000640 1 -- 172.21.15.7:0/4272110853 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde000c9d0 con 0x7fbdec0739a0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.920+0000 7fbde6000640 1 -- 172.21.15.7:0/4272110853 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde000cdc0 con 0x7fbdec0739a0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.921+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdec0b40e0 con 0x7fbdec0739a0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.921+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdec0b46a0 con 0x7fbdec0739a0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.922+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdec0d0c80 con 0x7fbdec0739a0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.923+0000 7fbde6000640 1 -- 172.21.15.7:0/4272110853 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbde001a070 con 0x7fbdec0739a0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.923+0000 7fbde6000640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbdd006be30 0x7fbdd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.924+0000 7fbde6000640 1 -- 172.21.15.7:0/4272110853 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7fbde008b350 con 0x7fbdec0739a0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.924+0000 7fbdf1400640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbdd006be30 0x7fbdd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:39:58.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.925+0000 7fbdf1400640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbdd006be30 0x7fbdd006e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbddc007fd0 tx=0x7fbddc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:39:58.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:58.928+0000 7fbde6000640 1 -- 172.21.15.7:0/4272110853 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbde0059b90 con 0x7fbdec0739a0 2024-08-19T00:39:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.148+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbdec154d20 con 0x7fbdec0739a0 2024-08-19T00:39:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.149+0000 7fbde6000640 1 -- 172.21.15.7:0/4272110853 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7fbde0059490 con 0x7fbdec0739a0 2024-08-19T00:39:59.150 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:39:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbdd006be30 msgr2=0x7fbdd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbdd006be30 0x7fbdd006e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbddc007fd0 tx=0x7fbddc009040 comp rx=0 tx=0).stop 2024-08-19T00:39:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdec0739a0 msgr2=0x7fbdec14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:39:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdec0739a0 0x7fbdec14e4b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbde000e9e0 tx=0x7fbde000eea0 comp rx=0 tx=0).stop 2024-08-19T00:39:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 shutdown_connections 2024-08-19T00:39:59.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbdd006be30 0x7fbdd006e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:59.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdec0b3b20 0x7fbdec155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:59.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdec159bf0 0x7fbdec154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:59.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 --2- 172.21.15.7:0/4272110853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdec0739a0 0x7fbdec14e4b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:39:59.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 >> 172.21.15.7:0/4272110853 conn(0x7fbdec06bc70 msgr2=0x7fbdec15a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:39:59.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 shutdown_connections 2024-08-19T00:39:59.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59.151+0000 7fbdf4800640 1 -- 172.21.15.7:0/4272110853 wait complete. 2024-08-19T00:39:59.168 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:39:59.169 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:59.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:59.169 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42662sec preferred_lft 42662sec 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:39:59.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:59.210 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:39:59.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:59.303 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:39:59.339 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:39:59.339 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:39:59.339 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:39:59.339 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:39:59.340 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:39:59.340 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:39:59.340 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:39:59.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:39:59.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:39:59.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:39:59.340 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:39:59.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:39:59.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:39:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:39:59.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:59.539 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:39:59.574 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:39:59.574 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:39:59.575 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:59.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:59.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:39:59.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:39:59.672 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:59.706 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:39:59.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:39:59.707 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:39:59.781 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:39:59.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:59.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:59.911 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:59.911 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:59.911 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:59.926 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:59.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:59.927 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:59.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:39:59.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:39:59.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:39:59.949 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:39:59.950 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:39:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:39:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:39:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:39:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:39:59.952 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:39:59.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:39:59.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:40:00.009 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:40:00.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:40:00.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:40:00.099 INFO:teuthology.orchestra.run.smithi007.stdout:client5842 2024-08-19T00:40:00.099 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:40:00.099 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:40:00.135 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'chmod 711 a/b/d; sync .') 2024-08-19T00:40:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:40:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:40:00.269 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:40:00.270 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:40:00.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:40:00.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.504+0000 7f578e000640 1 Processor -- start 2024-08-19T00:40:00.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.504+0000 7f578e000640 1 -- start start 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578e000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f578806d600 0x7f578806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f578815d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578e000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5788073140 con 0x7f578815bd70 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578e000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f578806df90 con 0x7f578806d600 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f57880733f0 con 0x7f578815cca0 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578d600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f578815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f5787e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f578806d600 0x7f578806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:00.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578d600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f578815d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:33220/0 (socket says 172.21.15.7:33220) 2024-08-19T00:40:00.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f578d600640 1 -- 172.21.15.7:0/2339159630 learned_addr learned my addr 172.21.15.7:0/2339159630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:00.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.505+0000 7f5787e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f578806d600 0x7f578806da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:35352/0 (socket says 172.21.15.7:35352) 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.506+0000 7f578d600640 1 -- 172.21.15.7:0/2339159630 >> v2:172.21.15.162:3300/0 conn(0x7f578806d600 msgr2=0x7f578806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.506+0000 7f578d600640 1 --2- 172.21.15.7:0/2339159630 >> v2:172.21.15.162:3300/0 conn(0x7f578806d600 0x7f578806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.506+0000 7f578d600640 1 -- 172.21.15.7:0/2339159630 >> v1:172.21.15.162:6789/0 conn(0x7f578815bd70 legacy=0x7f5788072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.506+0000 7f578d600640 1 -- 172.21.15.7:0/2339159630 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57880736d0 con 0x7f578815cca0 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.507+0000 7f578d600640 1 --2- 172.21.15.7:0/2339159630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f578815d110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5780009e50 tx=0x7f578002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e14fd8a4fd0803a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.507+0000 7f5787400640 1 -- 172.21.15.7:0/2339159630 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780036070 con 0x7f578815cca0 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.507+0000 7f5787400640 1 -- 172.21.15.7:0/2339159630 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5780031600 con 0x7f578815cca0 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.507+0000 7f5787400640 1 -- 172.21.15.7:0/2339159630 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57800319d0 con 0x7f578815cca0 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 -- 172.21.15.7:0/2339159630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 msgr2=0x7f578815d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 --2- 172.21.15.7:0/2339159630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f578815d110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5780009e50 tx=0x7f578002a710 comp rx=0 tx=0).stop 2024-08-19T00:40:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 -- 172.21.15.7:0/2339159630 shutdown_connections 2024-08-19T00:40:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 --2- 172.21.15.7:0/2339159630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f578815d110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 --2- 172.21.15.7:0/2339159630 >> v2:172.21.15.162:3300/0 conn(0x7f578806d600 0x7f578806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 -- 172.21.15.7:0/2339159630 >> 172.21.15.7:0/2339159630 conn(0x7f578806b850 msgr2=0x7f578806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 -- 172.21.15.7:0/2339159630 shutdown_connections 2024-08-19T00:40:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.508+0000 7f578e000640 1 -- 172.21.15.7:0/2339159630 wait complete. 2024-08-19T00:40:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.510+0000 7f578e000640 1 Processor -- start 2024-08-19T00:40:00.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.510+0000 7f578e000640 1 -- start start 2024-08-19T00:40:00.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f578806d600 0x7f5788155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:00.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f578815bd70 0x7f578814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:00.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f5788153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:00.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578e000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f578815c780 con 0x7f578806d600 2024-08-19T00:40:00.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f578815c4a0 con 0x7f578815bd70 2024-08-19T00:40:00.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f578815c150 con 0x7f578815cca0 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f578806d600 0x7f5788155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f578806d600 0x7f5788155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33128/0 (socket says 172.21.15.7:33128) 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578cc00640 1 -- 172.21.15.7:0/2820269242 learned_addr learned my addr 172.21.15.7:0/2820269242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f5787e00640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f578815bd70 0x7f578814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.511+0000 7f578d600640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f5788153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578cc00640 1 -- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 msgr2=0x7f5788153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578cc00640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f5788153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578cc00640 1 -- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f578815bd70 msgr2=0x7f578814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578cc00640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f578815bd70 0x7f578814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578cc00640 1 -- 172.21.15.7:0/2820269242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5788154360 con 0x7f578806d600 2024-08-19T00:40:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578cc00640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f578806d600 0x7f5788155600 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c480 tx=0x7f577c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f5784c00640 1 -- 172.21.15.7:0/2820269242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c0052d0 con 0x7f578806d600 2024-08-19T00:40:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f5784c00640 1 -- 172.21.15.7:0/2820269242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577c005470 con 0x7f578806d600 2024-08-19T00:40:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5788154640 con 0x7f578806d600 2024-08-19T00:40:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f5784c00640 1 -- 172.21.15.7:0/2820269242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c012870 con 0x7f578806d600 2024-08-19T00:40:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.512+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5788154c00 con 0x7f578806d600 2024-08-19T00:40:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.513+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578806e3a0 con 0x7f578806d600 2024-08-19T00:40:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.514+0000 7f5784c00640 1 -- 172.21.15.7:0/2820269242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f577c012a10 con 0x7f578806d600 2024-08-19T00:40:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.515+0000 7f5784c00640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.515+0000 7f5784c00640 1 -- 172.21.15.7:0/2820269242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f577c08aa00 con 0x7f578806d600 2024-08-19T00:40:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.515+0000 7f5787e00640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.516+0000 7f5787e00640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f576806be30 0x7f576806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5774009b40 tx=0x7f5774009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.519+0000 7f5784c00640 1 -- 172.21.15.7:0/2820269242 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f577c058d10 con 0x7f578806d600 2024-08-19T00:40:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.714+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f578814ff60 con 0x7f578806d600 2024-08-19T00:40:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.714+0000 7f5784c00640 1 -- 172.21.15.7:0/2820269242 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7f577c05d010 con 0x7f578806d600 2024-08-19T00:40:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:40:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.716+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f576806be30 msgr2=0x7f576806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.716+0000 7f578e000640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f576806be30 0x7f576806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5774009b40 tx=0x7f5774009190 comp rx=0 tx=0).stop 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.716+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f578806d600 msgr2=0x7f5788155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.716+0000 7f578e000640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f578806d600 0x7f5788155600 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c480 tx=0x7f577c00c940 comp rx=0 tx=0).stop 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 shutdown_connections 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f578815cca0 0x7f5788153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f578815bd70 0x7f578814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 --2- 172.21.15.7:0/2820269242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f578806d600 0x7f5788155600 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 >> 172.21.15.7:0/2820269242 conn(0x7f578806b850 msgr2=0x7f57880cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 shutdown_connections 2024-08-19T00:40:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:00.717+0000 7f578e000640 1 -- 172.21.15.7:0/2820269242 wait complete. 2024-08-19T00:40:00.733 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:40:00.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:40:00.734 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:40:00.798 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:40:00.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:40:00.798 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:40:00.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:40:01.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.032+0000 7f20dda00640 1 Processor -- start 2024-08-19T00:40:01.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.032+0000 7f20dda00640 1 -- start start 2024-08-19T00:40:01.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.033+0000 7f20dda00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f20d80d03c0 0x7f20d8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.033+0000 7f20dda00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80b3750 0x7f20d80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20dda00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d80cdfb0 con 0x7f20d806e710 2024-08-19T00:40:01.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20dda00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f20d80cebc0 con 0x7f20d80d03c0 2024-08-19T00:40:01.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20dda00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20d80ce290 con 0x7f20d80b3750 2024-08-19T00:40:01.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20d6a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f20d80d03c0 0x7f20d8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20d7400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80b3750 0x7f20d80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20d6a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f20d80d03c0 0x7f20d8071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:35372/0 (socket says 172.21.15.7:35372) 2024-08-19T00:40:01.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20d6a00640 1 -- 172.21.15.7:0/2697343142 learned_addr learned my addr 172.21.15.7:0/2697343142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:01.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.034+0000 7f20ce000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f20d806e710 0x7f20d80d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:40390/0 (socket says 172.21.15.7:40390) 2024-08-19T00:40:01.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.035+0000 7f20d6a00640 1 -- 172.21.15.7:0/2697343142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80b3750 msgr2=0x7f20d80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:01.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.035+0000 7f20d6a00640 1 --2- 172.21.15.7:0/2697343142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80b3750 0x7f20d80cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.035+0000 7f20d6a00640 1 -- 172.21.15.7:0/2697343142 >> v1:172.21.15.162:6789/0 conn(0x7f20d806e710 legacy=0x7f20d80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.035+0000 7f20d6a00640 1 -- 172.21.15.7:0/2697343142 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d80ce570 con 0x7f20d80d03c0 2024-08-19T00:40:01.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.036+0000 7f20d6a00640 1 --2- 172.21.15.7:0/2697343142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d80d03c0 0x7f20d8071980 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20c80098a0 tx=0x7f20c802a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb2096abc48e867 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:01.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.036+0000 7f20d6000640 1 -- 172.21.15.7:0/2697343142 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8037070 con 0x7f20d80d03c0 2024-08-19T00:40:01.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.036+0000 7f20d6000640 1 -- 172.21.15.7:0/2697343142 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c8032440 con 0x7f20d80d03c0 2024-08-19T00:40:01.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.036+0000 7f20d6000640 1 -- 172.21.15.7:0/2697343142 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8032810 con 0x7f20d80d03c0 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 -- 172.21.15.7:0/2697343142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d80d03c0 msgr2=0x7f20d8071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 --2- 172.21.15.7:0/2697343142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d80d03c0 0x7f20d8071980 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20c80098a0 tx=0x7f20c802a290 comp rx=0 tx=0).stop 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 -- 172.21.15.7:0/2697343142 shutdown_connections 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 --2- 172.21.15.7:0/2697343142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80b3750 0x7f20d80cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 --2- 172.21.15.7:0/2697343142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d80d03c0 0x7f20d8071980 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 -- 172.21.15.7:0/2697343142 >> 172.21.15.7:0/2697343142 conn(0x7f20d806bc70 msgr2=0x7f20d806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 -- 172.21.15.7:0/2697343142 shutdown_connections 2024-08-19T00:40:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.037+0000 7f20dda00640 1 -- 172.21.15.7:0/2697343142 wait complete. 2024-08-19T00:40:01.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.038+0000 7f20dda00640 1 Processor -- start 2024-08-19T00:40:01.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.039+0000 7f20dda00640 1 -- start start 2024-08-19T00:40:01.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.039+0000 7f20dda00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d806e710 0x7f20d8099820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.039+0000 7f20dda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d80b3750 0x7f20d81557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.039+0000 7f20dda00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80d03c0 0x7f20d8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.039+0000 7f20dda00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8073c60 con 0x7f20d80b3750 2024-08-19T00:40:01.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.039+0000 7f20dda00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8073ae0 con 0x7f20d806e710 2024-08-19T00:40:01.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.039+0000 7f20dda00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20d80b3be0 con 0x7f20d80d03c0 2024-08-19T00:40:01.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20ce000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d80b3750 0x7f20d81557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20d6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d806e710 0x7f20d8099820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20d6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d806e710 0x7f20d8099820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:35380/0 (socket says 172.21.15.7:35380) 2024-08-19T00:40:01.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20d6a00640 1 -- 172.21.15.7:0/1319966500 learned_addr learned my addr 172.21.15.7:0/1319966500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:01.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20d7400640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80d03c0 0x7f20d8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20ce000640 1 -- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80d03c0 msgr2=0x7f20d8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20ce000640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80d03c0 0x7f20d8155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20ce000640 1 -- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d806e710 msgr2=0x7f20d8099820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20ce000640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d806e710 0x7f20d8099820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20ce000640 1 -- 172.21.15.7:0/1319966500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d815df60 con 0x7f20d80b3750 2024-08-19T00:40:01.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.040+0000 7f20d6a00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d806e710 0x7f20d8099820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:40:01.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.041+0000 7f20ce000640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d80b3750 0x7f20d81557a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f20c0000f60 tx=0x7f20c000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:01.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.041+0000 7f20cf400640 1 -- 172.21.15.7:0/1319966500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c00074e0 con 0x7f20d80b3750 2024-08-19T00:40:01.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.041+0000 7f20cf400640 1 -- 172.21.15.7:0/1319966500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c00047e0 con 0x7f20d80b3750 2024-08-19T00:40:01.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.041+0000 7f20cf400640 1 -- 172.21.15.7:0/1319966500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0004bd0 con 0x7f20d80b3750 2024-08-19T00:40:01.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.041+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d81549e0 con 0x7f20d80b3750 2024-08-19T00:40:01.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.041+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d8154fa0 con 0x7f20d80b3750 2024-08-19T00:40:01.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.042+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d8071980 con 0x7f20d80b3750 2024-08-19T00:40:01.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.043+0000 7f20cf400640 1 -- 172.21.15.7:0/1319966500 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20c001a020 con 0x7f20d80b3750 2024-08-19T00:40:01.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.044+0000 7f20cf400640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f20b406be30 0x7f20b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.044+0000 7f20cf400640 1 -- 172.21.15.7:0/1319966500 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5767+0+0 (secure 0 0 0) 0x7f20c008a440 con 0x7f20d80b3750 2024-08-19T00:40:01.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.044+0000 7f20d6a00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f20b406be30 0x7f20b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.045+0000 7f20d6a00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f20b406be30 0x7f20b406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f20c80090b0 tx=0x7f20c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:01.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.048+0000 7f20cf400640 1 -- 172.21.15.7:0/1319966500 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f20d815df60 con 0x7f20d80b3750 2024-08-19T00:40:01.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.273+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f20d80721e0 con 0x7f20d80b3750 2024-08-19T00:40:01.278 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:40:01.273+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:40:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.275+0000 7f20cf400640 1 -- 172.21.15.7:0/1319966500 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 161+0+0 (secure 0 0 0) 0x7f20c0058760 con 0x7f20d80b3750 2024-08-19T00:40:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f20b406be30 msgr2=0x7f20b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f20b406be30 0x7f20b406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f20c80090b0 tx=0x7f20c802e000 comp rx=0 tx=0).stop 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d80b3750 msgr2=0x7f20d81557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d80b3750 0x7f20d81557a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f20c0000f60 tx=0x7f20c000c760 comp rx=0 tx=0).stop 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 shutdown_connections 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f20b406be30 0x7f20b406e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20d80d03c0 0x7f20d8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d80b3750 0x7f20d81557a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 --2- 172.21.15.7:0/1319966500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d806e710 0x7f20d8099820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 >> 172.21.15.7:0/1319966500 conn(0x7f20d806bc70 msgr2=0x7f20d815a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 shutdown_connections 2024-08-19T00:40:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.280+0000 7f20dda00640 1 -- 172.21.15.7:0/1319966500 wait complete. 2024-08-19T00:40:01.290 INFO:tasks.ceph.mds.a.smithi007.stderr: -5795> 2024-08-19T00:39:38.119+0000 7f33d1a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:40:01.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_journal_corrupt_dentry_first 1.0 2024-08-19T00:40:01.343 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:40:01.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:40:01.471 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:40:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.467+0000 7f9372600640 1 Processor -- start 2024-08-19T00:40:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.467+0000 7f9372600640 1 -- start start 2024-08-19T00:40:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.468+0000 7f9372600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f936c0cef00 0x7f936c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.468+0000 7f9372600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936c0cf500 con 0x7f936c161c90 2024-08-19T00:40:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.468+0000 7f9372600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936c0cf7e0 con 0x7f936c0d2c10 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.468+0000 7f9372600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f936c0d0110 con 0x7f936c0cef00 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.468+0000 7f936b400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f936c161c90 0x7f936c0d2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58188/0 (socket says 172.21.15.7:58188) 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.468+0000 7f936b400640 1 -- 172.21.15.7:0/3156630453 learned_addr learned my addr 172.21.15.7:0/3156630453 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.468+0000 7f936be00640 1 --2- 172.21.15.7:0/3156630453 >> v2:172.21.15.162:3300/0 conn(0x7f936c0cef00 0x7f936c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.469+0000 7f936aa00640 1 -- 172.21.15.7:0/3156630453 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999091518 0 0) 0x7f936c0cf500 con 0x7f936c161c90 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.469+0000 7f936aa00640 1 -- 172.21.15.7:0/3156630453 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9350003520 con 0x7f936c161c90 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.469+0000 7f936be00640 1 -- 172.21.15.7:0/3156630453 >> v1:172.21.15.162:6789/0 conn(0x7f936c0d2c10 legacy=0x7f936c06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.469+0000 7f936aa00640 1 -- 172.21.15.7:0/3156630453 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213527768 0 0) 0x7f936c0cf7e0 con 0x7f936c0d2c10 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.469+0000 7f936be00640 1 -- 172.21.15.7:0/3156630453 >> v1:172.21.15.7:6789/0 conn(0x7f936c161c90 legacy=0x7f936c0d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.469+0000 7f936be00640 1 -- 172.21.15.7:0/3156630453 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c0cfac0 con 0x7f936c0cef00 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.470+0000 7f936be00640 1 --2- 172.21.15.7:0/3156630453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0cef00 0x7f936c06e330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9364009d90 tx=0x7f936402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8933824704c56b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.470+0000 7f936aa00640 1 -- 172.21.15.7:0/3156630453 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364007740 con 0x7f936c0cef00 2024-08-19T00:40:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f936aa00640 1 -- 172.21.15.7:0/3156630453 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93640078e0 con 0x7f936c0cef00 2024-08-19T00:40:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f936aa00640 1 -- 172.21.15.7:0/3156630453 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364007cb0 con 0x7f936c0cef00 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f9372600640 1 -- 172.21.15.7:0/3156630453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0cef00 msgr2=0x7f936c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f9372600640 1 --2- 172.21.15.7:0/3156630453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0cef00 0x7f936c06e330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9364009d90 tx=0x7f936402a6f0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f9372600640 1 -- 172.21.15.7:0/3156630453 shutdown_connections 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f9372600640 1 --2- 172.21.15.7:0/3156630453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0cef00 0x7f936c06e330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f9372600640 1 -- 172.21.15.7:0/3156630453 >> 172.21.15.7:0/3156630453 conn(0x7f936c08c000 msgr2=0x7f936c0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f9372600640 1 -- 172.21.15.7:0/3156630453 shutdown_connections 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.471+0000 7f9372600640 1 -- 172.21.15.7:0/3156630453 wait complete. 2024-08-19T00:40:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.473+0000 7f9372600640 1 Processor -- start 2024-08-19T00:40:01.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.473+0000 7f9372600640 1 -- start start 2024-08-19T00:40:01.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f9372600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f936c0cef00 0x7f936c156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f9372600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0d2c10 0x7f936c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f9372600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c161c90 0x7f936c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f9372600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f936c1621f0 con 0x7f936c161c90 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f9372600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f936c162070 con 0x7f936c0d2c10 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f9372600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f936c0d3270 con 0x7f936c0cef00 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f936b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f936c0cef00 0x7f936c156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f936be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c161c90 0x7f936c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f9362a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0d2c10 0x7f936c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f936b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f936c0cef00 0x7f936c156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:33262/0 (socket says 172.21.15.7:33262) 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.474+0000 7f936b400640 1 -- 172.21.15.7:0/2676974984 learned_addr learned my addr 172.21.15.7:0/2676974984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f936b400640 1 -- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0d2c10 msgr2=0x7f936c158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f936b400640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0d2c10 0x7f936c158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f936b400640 1 -- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c161c90 msgr2=0x7f936c0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f936b400640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c161c90 0x7f936c0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f936b400640 1 -- 172.21.15.7:0/2676974984 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c0cde60 con 0x7f936c0cef00 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f9362a00640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0d2c10 0x7f936c158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f936be00640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c161c90 0x7f936c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.475+0000 7f936b400640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f936c0cef00 0x7f936c156e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c390 tx=0x7f935c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.476+0000 7f9363e00640 1 -- 172.21.15.7:0/2676974984 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c017070 con 0x7f936c0cef00 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.476+0000 7f9363e00640 1 -- 172.21.15.7:0/2676974984 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f935c005ce0 con 0x7f936c0cef00 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.476+0000 7f9363e00640 1 -- 172.21.15.7:0/2676974984 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c0072f0 con 0x7f936c0cef00 2024-08-19T00:40:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.476+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936c0ce140 con 0x7f936c0cef00 2024-08-19T00:40:01.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.476+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f936c0cb4c0 con 0x7f936c0cef00 2024-08-19T00:40:01.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.477+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f936c06e330 con 0x7f936c0cef00 2024-08-19T00:40:01.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.478+0000 7f9363e00640 1 -- 172.21.15.7:0/2676974984 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f935c01a070 con 0x7f936c0cef00 2024-08-19T00:40:01.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.479+0000 7f9363e00640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f934806be30 0x7f934806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:01.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.479+0000 7f9363e00640 1 -- 172.21.15.7:0/2676974984 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f935c08a2e0 con 0x7f936c0cef00 2024-08-19T00:40:01.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.479+0000 7f9362a00640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f934806be30 0x7f934806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:01.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.480+0000 7f9362a00640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f934806be30 0x7f934806e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9354007fd0 tx=0x7f9354009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:01.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.484+0000 7f9363e00640 1 -- 172.21.15.7:0/2676974984 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f935c058510 con 0x7f936c0cef00 2024-08-19T00:40:01.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.675+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=mds_inject_journal_corrupt_dentry_first}] v 0) -- 0x7f936c06dcc0 con 0x7f936c0cef00 2024-08-19T00:40:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.680+0000 7f9363e00640 1 -- 172.21.15.7:0/2676974984 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_journal_corrupt_dentry_first}]=0 v19)=0 v19) ==== 139+0+0 (secure 0 0 0) 0x7f935c05c810 con 0x7f936c0cef00 2024-08-19T00:40:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.682+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f934806be30 msgr2=0x7f934806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.682+0000 7f9372600640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f934806be30 0x7f934806e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9354007fd0 tx=0x7f9354009040 comp rx=0 tx=0).stop 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.682+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f936c0cef00 msgr2=0x7f936c156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.682+0000 7f9372600640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f936c0cef00 0x7f936c156e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c390 tx=0x7f935c00c850 comp rx=0 tx=0).stop 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 shutdown_connections 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f934806be30 0x7f934806e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c161c90 0x7f936c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936c0d2c10 0x7f936c158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 --2- 172.21.15.7:0/2676974984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f936c0cef00 0x7f936c156e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 >> 172.21.15.7:0/2676974984 conn(0x7f936c08c000 msgr2=0x7f936c0b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 shutdown_connections 2024-08-19T00:40:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:01.683+0000 7f9372600640 1 -- 172.21.15.7:0/2676974984 wait complete. 2024-08-19T00:40:06.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.873+0000 7f4fdce00640 1 Processor -- start 2024-08-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.873+0000 7f4fdce00640 1 -- start start 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fdce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4fd815e3d0 0x7f4fd80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fdce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4fd806c860 0x7f4fd806cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fdce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd80b43f0 con 0x7f4fd80b5900 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fdce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd806e570 con 0x7f4fd815e3d0 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fdce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd806d1d0 con 0x7f4fd806c860 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fd5400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4fd80b5900 0x7f4fd80ae9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56638/0 (socket says 172.21.15.7:56638) 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fd5400640 1 -- 172.21.15.7:0/3454007073 learned_addr learned my addr 172.21.15.7:0/3454007073 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.874+0000 7f4fd5e00640 1 --2- 172.21.15.7:0/3454007073 >> v2:172.21.15.7:3300/0 conn(0x7f4fd815e3d0 0x7f4fd80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.875+0000 7f4fd6800640 1 --2- 172.21.15.7:0/3454007073 >> v2:172.21.15.162:3300/0 conn(0x7f4fd806c860 0x7f4fd806cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.875+0000 7f4fd5e00640 1 -- 172.21.15.7:0/3454007073 >> v2:172.21.15.162:3300/0 conn(0x7f4fd806c860 msgr2=0x7f4fd806cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.875+0000 7f4fd5e00640 1 --2- 172.21.15.7:0/3454007073 >> v2:172.21.15.162:3300/0 conn(0x7f4fd806c860 0x7f4fd806cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.875+0000 7f4fd5e00640 1 -- 172.21.15.7:0/3454007073 >> v1:172.21.15.7:6789/0 conn(0x7f4fd80b5900 legacy=0x7f4fd80ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.875+0000 7f4fd5e00640 1 -- 172.21.15.7:0/3454007073 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd80b46d0 con 0x7f4fd815e3d0 2024-08-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.875+0000 7f4fd4a00640 1 -- 172.21.15.7:0/3454007073 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423529666 0 0) 0x7f4fd80b43f0 con 0x7f4fd80b5900 2024-08-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.876+0000 7f4fd5e00640 1 --2- 172.21.15.7:0/3454007073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd815e3d0 0x7f4fd80b3ba0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80735f0 tx=0x7f4fc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc9f15c68e2dbe4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.876+0000 7f4fd4a00640 1 -- 172.21.15.7:0/3454007073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8037070 con 0x7f4fd815e3d0 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.876+0000 7f4fd4a00640 1 -- 172.21.15.7:0/3454007073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8032440 con 0x7f4fd815e3d0 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.876+0000 7f4fd4a00640 1 -- 172.21.15.7:0/3454007073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8032810 con 0x7f4fd815e3d0 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 -- 172.21.15.7:0/3454007073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd815e3d0 msgr2=0x7f4fd80b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 --2- 172.21.15.7:0/3454007073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd815e3d0 0x7f4fd80b3ba0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80735f0 tx=0x7f4fc802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 -- 172.21.15.7:0/3454007073 shutdown_connections 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 --2- 172.21.15.7:0/3454007073 >> v2:172.21.15.162:3300/0 conn(0x7f4fd806c860 0x7f4fd806cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 --2- 172.21.15.7:0/3454007073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd815e3d0 0x7f4fd80b3ba0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 -- 172.21.15.7:0/3454007073 >> 172.21.15.7:0/3454007073 conn(0x7f4fd80723b0 msgr2=0x7f4fd80727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 -- 172.21.15.7:0/3454007073 shutdown_connections 2024-08-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.877+0000 7f4fdce00640 1 -- 172.21.15.7:0/3454007073 wait complete. 2024-08-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.879+0000 7f4fdce00640 1 Processor -- start 2024-08-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.879+0000 7f4fdce00640 1 -- start start 2024-08-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fdce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd806c860 0x7f4fd80ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fdce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fd80b5900 0x7f4fd81f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fdce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fd815e3d0 0x7f4fd814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fdce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd80b40e0 con 0x7f4fd806c860 2024-08-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fdce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd815e7b0 con 0x7f4fd815e3d0 2024-08-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fdce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd80af0c0 con 0x7f4fd80b5900 2024-08-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd806c860 0x7f4fd80ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd806c860 0x7f4fd80ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59646/0 (socket says 172.21.15.7:59646) 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 -- 172.21.15.7:0/1913613779 learned_addr learned my addr 172.21.15.7:0/1913613779 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd6800640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fd815e3d0 0x7f4fd814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5400640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fd80b5900 0x7f4fd81f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 -- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fd80b5900 msgr2=0x7f4fd81f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fd80b5900 0x7f4fd81f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 -- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fd815e3d0 msgr2=0x7f4fd814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fd815e3d0 0x7f4fd814a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd5e00640 1 -- 172.21.15.7:0/1913613779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd80ceac0 con 0x7f4fd806c860 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.880+0000 7f4fd6800640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fd815e3d0 0x7f4fd814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.881+0000 7f4fd5e00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd806c860 0x7f4fd80ce3c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009890 tx=0x7f4fc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.881+0000 7f4fce000640 1 -- 172.21.15.7:0/1913613779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8037040 con 0x7f4fd806c860 2024-08-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.881+0000 7f4fce000640 1 -- 172.21.15.7:0/1913613779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8042070 con 0x7f4fd806c860 2024-08-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.881+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd80ceda0 con 0x7f4fd806c860 2024-08-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.881+0000 7f4fce000640 1 -- 172.21.15.7:0/1913613779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8030bd0 con 0x7f4fd806c860 2024-08-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.881+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd80cf360 con 0x7f4fd806c860 2024-08-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.882+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd806cc90 con 0x7f4fd806c860 2024-08-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.883+0000 7f4fce000640 1 -- 172.21.15.7:0/1913613779 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fc8047460 con 0x7f4fd806c860 2024-08-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.884+0000 7f4fce000640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fb806be60 0x7f4fb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.884+0000 7f4fce000640 1 -- 172.21.15.7:0/1913613779 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f4fc80abb10 con 0x7f4fd806c860 2024-08-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.884+0000 7f4fd5400640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fb806be60 0x7f4fb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.885+0000 7f4fd5400640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fb806be60 0x7f4fb806e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80b2830 tx=0x7f4fc4007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:06.889+0000 7f4fce000640 1 -- 172.21.15.7:0/1913613779 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4fc8032e20 con 0x7f4fd806c860 2024-08-19T00:40:07.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.108+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f4fd8070850 con 0x7f4fd806c860 2024-08-19T00:40:07.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.161+0000 7f4fce000640 1 -- 172.21.15.7:0/1913613779 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v49) ==== 162+0+0 (secure 0 0 0) 0x7f4fc807a390 con 0x7f4fd806c860 2024-08-19T00:40:07.163 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:40:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.163+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fb806be60 msgr2=0x7f4fb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.163+0000 7f4fdce00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fb806be60 0x7f4fb806e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80b2830 tx=0x7f4fc4007b50 comp rx=0 tx=0).stop 2024-08-19T00:40:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.163+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd806c860 msgr2=0x7f4fd80ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.163+0000 7f4fdce00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd806c860 0x7f4fd80ce3c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009890 tx=0x7f4fc80046c0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 shutdown_connections 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4fb806be60 0x7f4fb806e320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fd815e3d0 0x7f4fd814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fd80b5900 0x7f4fd81f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 --2- 172.21.15.7:0/1913613779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd806c860 0x7f4fd80ce3c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 >> 172.21.15.7:0/1913613779 conn(0x7f4fd80723b0 msgr2=0x7f4fd80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 shutdown_connections 2024-08-19T00:40:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.164+0000 7f4fdce00640 1 -- 172.21.15.7:0/1913613779 wait complete. 2024-08-19T00:40:07.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.339+0000 7f7f3ae00640 1 Processor -- start 2024-08-19T00:40:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.339+0000 7f7f3ae00640 1 -- start start 2024-08-19T00:40:07.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f3ae00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f340d27b0 0x7f7f340d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:07.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f3ae00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f340d1fd0 0x7f7f340d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:07.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f3ae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f340d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:07.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f3ae00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7f340d0110 con 0x7f7f340d27b0 2024-08-19T00:40:07.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f3ae00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7f340d30d0 con 0x7f7f340d1fd0 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f3ae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f340d4fe0 con 0x7f7f340d0880 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f39a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f340d27b0 0x7f7f340d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f39a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f340d27b0 0x7f7f340d48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59662/0 (socket says 172.21.15.7:59662) 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f39a00640 1 -- 172.21.15.7:0/2110711511 learned_addr learned my addr 172.21.15.7:0/2110711511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f39000640 1 --2- 172.21.15.7:0/2110711511 >> v2:172.21.15.162:3300/0 conn(0x7f7f340d1fd0 0x7f7f340d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.340+0000 7f7f3a400640 1 --2- 172.21.15.7:0/2110711511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f340d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.341+0000 7f7f39a00640 1 -- 172.21.15.7:0/2110711511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 msgr2=0x7f7f340d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.341+0000 7f7f39a00640 1 --2- 172.21.15.7:0/2110711511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f340d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.341+0000 7f7f39a00640 1 -- 172.21.15.7:0/2110711511 >> v2:172.21.15.162:3300/0 conn(0x7f7f340d1fd0 msgr2=0x7f7f340d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.341+0000 7f7f39a00640 1 --2- 172.21.15.7:0/2110711511 >> v2:172.21.15.162:3300/0 conn(0x7f7f340d1fd0 0x7f7f340d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.341+0000 7f7f39a00640 1 -- 172.21.15.7:0/2110711511 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f340cf870 con 0x7f7f340d27b0 2024-08-19T00:40:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.341+0000 7f7f39000640 1 --2- 172.21.15.7:0/2110711511 >> v2:172.21.15.162:3300/0 conn(0x7f7f340d1fd0 0x7f7f340d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.342+0000 7f7f39a00640 1 --2- 172.21.15.7:0/2110711511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f340d48e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f3409d940 tx=0x7f7f2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cb2cdc42b13f54 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.342+0000 7f7f33e00640 1 -- 172.21.15.7:0/2110711511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28037070 con 0x7f7f340d27b0 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.342+0000 7f7f33e00640 1 -- 172.21.15.7:0/2110711511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f28032440 con 0x7f7f340d27b0 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.342+0000 7f7f33e00640 1 -- 172.21.15.7:0/2110711511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28032810 con 0x7f7f340d27b0 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.342+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2110711511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 msgr2=0x7f7f340d48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.342+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2110711511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f340d48e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f3409d940 tx=0x7f7f2802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.343+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2110711511 shutdown_connections 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.343+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2110711511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f340d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.343+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2110711511 >> v2:172.21.15.162:3300/0 conn(0x7f7f340d1fd0 0x7f7f340d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.343+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2110711511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f340d48e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.343+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2110711511 >> 172.21.15.7:0/2110711511 conn(0x7f7f3409d510 msgr2=0x7f7f340d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.343+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2110711511 shutdown_connections 2024-08-19T00:40:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.343+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2110711511 wait complete. 2024-08-19T00:40:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.344+0000 7f7f3ae00640 1 Processor -- start 2024-08-19T00:40:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.344+0000 7f7f3ae00640 1 -- start start 2024-08-19T00:40:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.345+0000 7f7f3ae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f34156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.345+0000 7f7f3ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f340d1fd0 0x7f7f341f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:07.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.345+0000 7f7f3ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f34157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.345+0000 7f7f3ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f340d2440 con 0x7f7f340d27b0 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.345+0000 7f7f3ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f340cfe30 con 0x7f7f340d1fd0 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.345+0000 7f7f3ae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f3415e550 con 0x7f7f340d0880 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f34157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f39a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f34156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f34157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59670/0 (socket says 172.21.15.7:59670) 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 -- 172.21.15.7:0/2282999442 learned_addr learned my addr 172.21.15.7:0/2282999442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f39000640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f340d1fd0 0x7f7f341f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 -- 172.21.15.7:0/2282999442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 msgr2=0x7f7f34156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f34156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 -- 172.21.15.7:0/2282999442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f340d1fd0 msgr2=0x7f7f341f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f340d1fd0 0x7f7f341f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 -- 172.21.15.7:0/2282999442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f340b8880 con 0x7f7f340d27b0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.346+0000 7f7f3a400640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f34157040 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007e60 tx=0x7f7f2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.347+0000 7f7f31600640 1 -- 172.21.15.7:0/2282999442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c014620 con 0x7f7f340d27b0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.347+0000 7f7f31600640 1 -- 172.21.15.7:0/2282999442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2c019070 con 0x7f7f340d27b0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.347+0000 7f7f31600640 1 -- 172.21.15.7:0/2282999442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c014a20 con 0x7f7f340d27b0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.347+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f341f5160 con 0x7f7f340d27b0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.347+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f340b9440 con 0x7f7f340d27b0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.348+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f340d2b90 con 0x7f7f340d27b0 2024-08-19T00:40:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.349+0000 7f7f31600640 1 -- 172.21.15.7:0/2282999442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f2c014bc0 con 0x7f7f340d27b0 2024-08-19T00:40:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.350+0000 7f7f31600640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f1406be30 0x7f7f1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.350+0000 7f7f31600640 1 -- 172.21.15.7:0/2282999442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f7f2c08b610 con 0x7f7f340d27b0 2024-08-19T00:40:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.350+0000 7f7f39a00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f1406be30 0x7f7f1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.351+0000 7f7f39a00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f1406be30 0x7f7f1406e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f28034000 tx=0x7f7f2802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.354+0000 7f7f31600640 1 -- 172.21.15.7:0/2282999442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7f341f5160 con 0x7f7f340d27b0 2024-08-19T00:40:07.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.578+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f3415b560 con 0x7f7f340d27b0 2024-08-19T00:40:07.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.578+0000 7f7f31600640 1 -- 172.21.15.7:0/2282999442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5214 (secure 0 0 0) 0x7f7f2c0598d0 con 0x7f7f340d27b0 2024-08-19T00:40:07.580 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:07.580 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":50,"btime":"2024-08-19T00:40:07:164311+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:07.164301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-08-19T00:40:07.580 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 50 2024-08-19T00:40:07.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.580+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f1406be30 msgr2=0x7f7f1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:07.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.580+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f1406be30 0x7f7f1406e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f28034000 tx=0x7f7f2802e000 comp rx=0 tx=0).stop 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.580+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 msgr2=0x7f7f34157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.580+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f34157040 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007e60 tx=0x7f7f2c00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 shutdown_connections 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f1406be30 0x7f7f1406e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f340d27b0 0x7f7f34157040 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f340d1fd0 0x7f7f341f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 --2- 172.21.15.7:0/2282999442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f340d0880 0x7f7f34156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 >> 172.21.15.7:0/2282999442 conn(0x7f7f3409d510 msgr2=0x7f7f3406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 shutdown_connections 2024-08-19T00:40:07.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:07.581+0000 7f7f3ae00640 1 -- 172.21.15.7:0/2282999442 wait complete. 2024-08-19T00:40:08.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:39:35.566683+0000', 'modified': '2024-08-19T00:40:07.164301+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6003}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6003': {'gid': 6003, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6836/2987342349', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2987342349}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2987342349}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:40:08.000 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6003:up:replay 2024-08-19T00:40:09.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:09.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.167+0000 7f4930a00640 1 Processor -- start 2024-08-19T00:40:09.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.167+0000 7f4930a00640 1 -- start start 2024-08-19T00:40:09.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.168+0000 7f4930a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:09.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.168+0000 7f4930a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f492c0d03c0 0x7f492c0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:09.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f4930a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c06f7f0 con 0x7f492c159bf0 2024-08-19T00:40:09.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f4930a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f492c0cee80 con 0x7f492c0d03c0 2024-08-19T00:40:09.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f4930a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f492c0d0d70 con 0x7f492c0ce500 2024-08-19T00:40:09.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f4923e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:09.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f492a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f492c0d03c0 0x7f492c0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:09.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f4923e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:48784/0 (socket says 172.21.15.7:48784) 2024-08-19T00:40:09.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f492a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f492c0d03c0 0x7f492c0d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:35736/0 (socket says 172.21.15.7:35736) 2024-08-19T00:40:09.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.169+0000 7f4923e00640 1 -- 172.21.15.7:0/2456811543 learned_addr learned my addr 172.21.15.7:0/2456811543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:09.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.170+0000 7f4923e00640 1 -- 172.21.15.7:0/2456811543 >> v2:172.21.15.162:3300/0 conn(0x7f492c0d03c0 msgr2=0x7f492c0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:09.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.170+0000 7f4923e00640 1 --2- 172.21.15.7:0/2456811543 >> v2:172.21.15.162:3300/0 conn(0x7f492c0d03c0 0x7f492c0d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.170+0000 7f4923e00640 1 -- 172.21.15.7:0/2456811543 >> v1:172.21.15.162:6789/0 conn(0x7f492c159bf0 legacy=0x7f492c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:09.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.170+0000 7f4923e00640 1 -- 172.21.15.7:0/2456811543 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c06f510 con 0x7f492c0ce500 2024-08-19T00:40:09.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.170+0000 7f492a800640 1 --2- 172.21.15.7:0/2456811543 >> v2:172.21.15.162:3300/0 conn(0x7f492c0d03c0 0x7f492c0d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:40:09.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.171+0000 7f4923e00640 1 --2- 172.21.15.7:0/2456811543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c0ce940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4914009870 tx=0x7f491402a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93cd90e66a943948 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:09.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.171+0000 7f4929400640 1 -- 172.21.15.7:0/2456811543 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914037070 con 0x7f492c0ce500 2024-08-19T00:40:09.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.171+0000 7f4929400640 1 -- 172.21.15.7:0/2456811543 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4914032440 con 0x7f492c0ce500 2024-08-19T00:40:09.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.171+0000 7f4929400640 1 -- 172.21.15.7:0/2456811543 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914032810 con 0x7f492c0ce500 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.171+0000 7f4930a00640 1 -- 172.21.15.7:0/2456811543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 msgr2=0x7f492c0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.171+0000 7f4930a00640 1 --2- 172.21.15.7:0/2456811543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c0ce940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4914009870 tx=0x7f491402a1d0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.172+0000 7f4930a00640 1 -- 172.21.15.7:0/2456811543 shutdown_connections 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.172+0000 7f4930a00640 1 --2- 172.21.15.7:0/2456811543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c0ce940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.172+0000 7f4930a00640 1 --2- 172.21.15.7:0/2456811543 >> v2:172.21.15.162:3300/0 conn(0x7f492c0d03c0 0x7f492c0d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.172+0000 7f4930a00640 1 -- 172.21.15.7:0/2456811543 >> 172.21.15.7:0/2456811543 conn(0x7f492c06bc70 msgr2=0x7f492c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.172+0000 7f4930a00640 1 -- 172.21.15.7:0/2456811543 shutdown_connections 2024-08-19T00:40:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.172+0000 7f4930a00640 1 -- 172.21.15.7:0/2456811543 wait complete. 2024-08-19T00:40:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.173+0000 7f4930a00640 1 Processor -- start 2024-08-19T00:40:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.174+0000 7f4930a00640 1 -- start start 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4930a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4930a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492c0d03c0 0x7f492c1f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4930a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f492c159bf0 0x7f492c160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4930a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f492c072f40 con 0x7f492c159bf0 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4930a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f492c072c60 con 0x7f492c0d03c0 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4930a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f492c073b70 con 0x7f492c0ce500 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f492c159bf0 0x7f492c160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f492c159bf0 0x7f492c160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59676/0 (socket says 172.21.15.7:59676) 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 -- 172.21.15.7:0/2168488382 learned_addr learned my addr 172.21.15.7:0/2168488382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4923e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492c0d03c0 0x7f492c1f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f4929e00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 -- 172.21.15.7:0/2168488382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 msgr2=0x7f492c150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 -- 172.21.15.7:0/2168488382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492c0d03c0 msgr2=0x7f492c1f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492c0d03c0 0x7f492c1f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.175+0000 7f492a800640 1 -- 172.21.15.7:0/2168488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c1f52b0 con 0x7f492c159bf0 2024-08-19T00:40:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.176+0000 7f492a800640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f492c159bf0 0x7f492c160070 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4924009f00 tx=0x7f492400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.176+0000 7f4922000640 1 -- 172.21.15.7:0/2168488382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924018030 con 0x7f492c159bf0 2024-08-19T00:40:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.176+0000 7f4922000640 1 -- 172.21.15.7:0/2168488382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492400ce50 con 0x7f492c159bf0 2024-08-19T00:40:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.176+0000 7f4922000640 1 -- 172.21.15.7:0/2168488382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924003bb0 con 0x7f492c159bf0 2024-08-19T00:40:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.176+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c156f60 con 0x7f492c159bf0 2024-08-19T00:40:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.176+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c157520 con 0x7f492c159bf0 2024-08-19T00:40:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.178+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c159fd0 con 0x7f492c159bf0 2024-08-19T00:40:09.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.180+0000 7f4922000640 1 -- 172.21.15.7:0/2168488382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4924005d10 con 0x7f492c159bf0 2024-08-19T00:40:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.181+0000 7f4922000640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f490806be60 0x7f490806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.181+0000 7f4922000640 1 -- 172.21.15.7:0/2168488382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f492408bf30 con 0x7f492c159bf0 2024-08-19T00:40:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.181+0000 7f4929e00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f490806be60 0x7f490806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.182+0000 7f4929e00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f490806be60 0x7f490806e320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f492c06fd20 tx=0x7f491c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:09.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.184+0000 7f4922000640 1 -- 172.21.15.7:0/2168488382 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f49240ba990 con 0x7f492c159bf0 2024-08-19T00:40:09.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.403+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f492c0b4890 con 0x7f492c159bf0 2024-08-19T00:40:09.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.404+0000 7f4922000640 1 -- 172.21.15.7:0/2168488382 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5214 (secure 0 0 0) 0x7f492c1f52b0 con 0x7f492c159bf0 2024-08-19T00:40:09.406 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:09.407 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"btime":"2024-08-19T00:40:09:173314+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:08.175861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-08-19T00:40:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-08-19T00:40:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f490806be60 msgr2=0x7f490806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f490806be60 0x7f490806e320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f492c06fd20 tx=0x7f491c009040 comp rx=0 tx=0).stop 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f492c159bf0 msgr2=0x7f492c160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f492c159bf0 0x7f492c160070 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4924009f00 tx=0x7f492400c490 comp rx=0 tx=0).stop 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 shutdown_connections 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f490806be60 0x7f490806e320 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f492c159bf0 0x7f492c160070 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492c0d03c0 0x7f492c1f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 --2- 172.21.15.7:0/2168488382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492c0ce500 0x7f492c150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 >> 172.21.15.7:0/2168488382 conn(0x7f492c06bc70 msgr2=0x7f492c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 shutdown_connections 2024-08-19T00:40:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:09.406+0000 7f4930a00640 1 -- 172.21.15.7:0/2168488382 wait complete. 2024-08-19T00:40:09.829 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:39:35.566683+0000', 'modified': '2024-08-19T00:40:08.175861+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6003}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6003': {'gid': 6003, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:rejoin', 'state_seq': 4, 'addr': '172.21.15.7:6836/2987342349', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2987342349}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2987342349}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:40:09.829 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6003:up:rejoin 2024-08-19T00:40:10.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:10.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.995+0000 7f4c01e00640 1 Processor -- start 2024-08-19T00:40:10.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.995+0000 7f4c01e00640 1 -- start start 2024-08-19T00:40:10.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4c01e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bfc071980 0x7f4bfc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4c01e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc0cdfb0 con 0x7f4bfc0d03c0 2024-08-19T00:40:11.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4c01e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc0ce290 con 0x7f4bfc06e710 2024-08-19T00:40:11.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4c01e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4bfc0cebc0 con 0x7f4bfc071980 2024-08-19T00:40:11.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfaa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4bfc0d03c0 0x7f4bfc0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56642/0 (socket says 172.21.15.7:56642) 2024-08-19T00:40:11.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfaa00640 1 -- 172.21.15.7:0/2827728145 learned_addr learned my addr 172.21.15.7:0/2827728145 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:11.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfb400640 1 --2- 172.21.15.7:0/2827728145 >> v2:172.21.15.7:3300/0 conn(0x7f4bfc071980 0x7f4bfc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfa000640 1 -- 172.21.15.7:0/2827728145 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737335438 0 0) 0x7f4bfc0cdfb0 con 0x7f4bfc0d03c0 2024-08-19T00:40:11.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfa000640 1 -- 172.21.15.7:0/2827728145 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be0003520 con 0x7f4bfc0d03c0 2024-08-19T00:40:11.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfb400640 1 -- 172.21.15.7:0/2827728145 >> v1:172.21.15.162:6789/0 conn(0x7f4bfc06e710 legacy=0x7f4bfc0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfb400640 1 -- 172.21.15.7:0/2827728145 >> v1:172.21.15.7:6789/0 conn(0x7f4bfc0d03c0 legacy=0x7f4bfc0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.997+0000 7f4bfb400640 1 -- 172.21.15.7:0/2827728145 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc0ce570 con 0x7f4bfc071980 2024-08-19T00:40:11.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.998+0000 7f4bfb400640 1 --2- 172.21.15.7:0/2827728145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc071980 0x7f4bfc0cf050 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009dc0 tx=0x7f4bf402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a5a00a80c7561f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4bfa000640 1 -- 172.21.15.7:0/2827728145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4007740 con 0x7f4bfc071980 2024-08-19T00:40:11.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4bfa000640 1 -- 172.21.15.7:0/2827728145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf40078e0 con 0x7f4bfc071980 2024-08-19T00:40:11.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4bfa000640 1 -- 172.21.15.7:0/2827728145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4007cb0 con 0x7f4bfc071980 2024-08-19T00:40:11.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4c01e00640 1 -- 172.21.15.7:0/2827728145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc071980 msgr2=0x7f4bfc0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4c01e00640 1 --2- 172.21.15.7:0/2827728145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc071980 0x7f4bfc0cf050 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009dc0 tx=0x7f4bf402a730 comp rx=0 tx=0).stop 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4c01e00640 1 -- 172.21.15.7:0/2827728145 shutdown_connections 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4c01e00640 1 --2- 172.21.15.7:0/2827728145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc071980 0x7f4bfc0cf050 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4c01e00640 1 -- 172.21.15.7:0/2827728145 >> 172.21.15.7:0/2827728145 conn(0x7f4bfc06bc70 msgr2=0x7f4bfc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4c01e00640 1 -- 172.21.15.7:0/2827728145 shutdown_connections 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:10.999+0000 7f4c01e00640 1 -- 172.21.15.7:0/2827728145 wait complete. 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.001+0000 7f4c01e00640 1 Processor -- start 2024-08-19T00:40:11.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.001+0000 7f4c01e00640 1 -- start start 2024-08-19T00:40:11.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4c01e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc06e710 0x7f4bfc0c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4c01e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bfc071980 0x7f4bfc153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4c01e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bfc0d03c0 0x7f4bfc153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4c01e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc073c60 con 0x7f4bfc06e710 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4c01e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc073ae0 con 0x7f4bfc071980 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4c01e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0cf590 con 0x7f4bfc0d03c0 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4bfaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc06e710 0x7f4bfc0c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4bfaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc06e710 0x7f4bfc0c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59698/0 (socket says 172.21.15.7:59698) 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.002+0000 7f4bfaa00640 1 -- 172.21.15.7:0/4236511321 learned_addr learned my addr 172.21.15.7:0/4236511321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bf3e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bfc071980 0x7f4bfc153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bfb400640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bfc0d03c0 0x7f4bfc153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bfaa00640 1 -- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bfc0d03c0 msgr2=0x7f4bfc153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bfc0d03c0 0x7f4bfc153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bfaa00640 1 -- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bfc071980 msgr2=0x7f4bfc153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bfc071980 0x7f4bfc153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bfaa00640 1 -- 172.21.15.7:0/4236511321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc156ac0 con 0x7f4bfc06e710 2024-08-19T00:40:11.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc06e710 0x7f4bfc0c9d20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c500 tx=0x7f4bec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bf3400640 1 -- 172.21.15.7:0/4236511321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec017070 con 0x7f4bfc06e710 2024-08-19T00:40:11.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bf3400640 1 -- 172.21.15.7:0/4236511321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec005ce0 con 0x7f4bfc06e710 2024-08-19T00:40:11.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4bf3400640 1 -- 172.21.15.7:0/4236511321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec007330 con 0x7f4bfc06e710 2024-08-19T00:40:11.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc0ca490 con 0x7f4bfc06e710 2024-08-19T00:40:11.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.003+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc154c70 con 0x7f4bfc06e710 2024-08-19T00:40:11.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.004+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc0cf050 con 0x7f4bfc06e710 2024-08-19T00:40:11.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.005+0000 7f4bf3400640 1 -- 172.21.15.7:0/4236511321 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bec01a070 con 0x7f4bfc06e710 2024-08-19T00:40:11.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.006+0000 7f4bf3400640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd806be30 0x7f4bd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.006+0000 7f4bf3400640 1 -- 172.21.15.7:0/4236511321 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f4bec08a2a0 con 0x7f4bfc06e710 2024-08-19T00:40:11.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.006+0000 7f4bf3e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd806be30 0x7f4bd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.007+0000 7f4bf3e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd806be30 0x7f4bd806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4be4007fd0 tx=0x7f4be4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.011+0000 7f4bf3400640 1 -- 172.21.15.7:0/4236511321 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4bec058d10 con 0x7f4bfc06e710 2024-08-19T00:40:11.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.232+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bfc0ae060 con 0x7f4bfc06e710 2024-08-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.232+0000 7f4bf3400640 1 -- 172.21.15.7:0/4236511321 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5221 (secure 0 0 0) 0x7f4bec058610 con 0x7f4bfc06e710 2024-08-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"btime":"2024-08-19T00:40:10:178898+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:10.178891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6003,"qdb_cluster":[6003]},"id":4}]} 2024-08-19T00:40:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-08-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd806be30 msgr2=0x7f4bd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd806be30 0x7f4bd806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4be4007fd0 tx=0x7f4be4009040 comp rx=0 tx=0).stop 2024-08-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc06e710 msgr2=0x7f4bfc0c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc06e710 0x7f4bfc0c9d20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c500 tx=0x7f4bec00c9c0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 shutdown_connections 2024-08-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd806be30 0x7f4bd806e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bfc0d03c0 0x7f4bfc153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bfc071980 0x7f4bfc153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 --2- 172.21.15.7:0/4236511321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc06e710 0x7f4bfc0c9d20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.234+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 >> 172.21.15.7:0/4236511321 conn(0x7f4bfc06bc70 msgr2=0x7f4bfc072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.235+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 shutdown_connections 2024-08-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.235+0000 7f4c01e00640 1 -- 172.21.15.7:0/4236511321 wait complete. 2024-08-19T00:40:11.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:39:35.566683+0000', 'modified': '2024-08-19T00:40:10.178891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6003}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6003': {'gid': 6003, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.7:6836/2987342349', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2987342349}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2987342349}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6003, 'qdb_cluster': [6003]} 2024-08-19T00:40:11.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:40:11.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:40:11.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.814+0000 7f216b400640 1 Processor -- start 2024-08-19T00:40:11.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.814+0000 7f216b400640 1 -- start start 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f216b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640ce500 0x7f21640ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f216b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21640d03c0 0x7f21640d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f216b400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216406f7f0 con 0x7f2164159bf0 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f216b400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f21640cee80 con 0x7f21640d03c0 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f216b400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21640d0d70 con 0x7f21640ce500 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f2168a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2164159bf0 0x7f2164073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56650/0 (socket says 172.21.15.7:56650) 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f2168a00640 1 -- 172.21.15.7:0/633401538 learned_addr learned my addr 172.21.15.7:0/633401538 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f2169400640 1 --2- 172.21.15.7:0/633401538 >> v2:172.21.15.7:3300/0 conn(0x7f21640d03c0 0x7f21640d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f2163e00640 1 --2- 172.21.15.7:0/633401538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640ce500 0x7f21640ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.815+0000 7f2163400640 1 -- 172.21.15.7:0/633401538 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264144308 0 0) 0x7f216406f7f0 con 0x7f2164159bf0 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.816+0000 7f2169400640 1 -- 172.21.15.7:0/633401538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640ce500 msgr2=0x7f21640ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.816+0000 7f2169400640 1 --2- 172.21.15.7:0/633401538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640ce500 0x7f21640ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.816+0000 7f2169400640 1 -- 172.21.15.7:0/633401538 >> v1:172.21.15.7:6789/0 conn(0x7f2164159bf0 legacy=0x7f2164073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.816+0000 7f2169400640 1 -- 172.21.15.7:0/633401538 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216406f510 con 0x7f21640d03c0 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.817+0000 7f2169400640 1 --2- 172.21.15.7:0/633401538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21640d03c0 0x7f21640d0830 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f215c009d90 tx=0x7f215c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9870fff9e563b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.817+0000 7f2163400640 1 -- 172.21.15.7:0/633401538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c031600 con 0x7f21640d03c0 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.817+0000 7f2163400640 1 -- 172.21.15.7:0/633401538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c0317a0 con 0x7f21640d03c0 2024-08-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.817+0000 7f2163400640 1 -- 172.21.15.7:0/633401538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c031b70 con 0x7f21640d03c0 2024-08-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.817+0000 7f216b400640 1 -- 172.21.15.7:0/633401538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21640d03c0 msgr2=0x7f21640d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.817+0000 7f216b400640 1 --2- 172.21.15.7:0/633401538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21640d03c0 0x7f21640d0830 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f215c009d90 tx=0x7f215c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.818+0000 7f216b400640 1 -- 172.21.15.7:0/633401538 shutdown_connections 2024-08-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.818+0000 7f216b400640 1 --2- 172.21.15.7:0/633401538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21640d03c0 0x7f21640d0830 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.818+0000 7f216b400640 1 --2- 172.21.15.7:0/633401538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640ce500 0x7f21640ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.818+0000 7f216b400640 1 -- 172.21.15.7:0/633401538 >> 172.21.15.7:0/633401538 conn(0x7f216406bc70 msgr2=0x7f216406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.818+0000 7f216b400640 1 -- 172.21.15.7:0/633401538 shutdown_connections 2024-08-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.818+0000 7f216b400640 1 -- 172.21.15.7:0/633401538 wait complete. 2024-08-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.819+0000 7f216b400640 1 Processor -- start 2024-08-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.819+0000 7f216b400640 1 -- start start 2024-08-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.820+0000 7f216b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21640ce500 0x7f21641f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.820+0000 7f216b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640d03c0 0x7f216414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.820+0000 7f216b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2164159bf0 0x7f216415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.820+0000 7f216b400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2164072f40 con 0x7f2164159bf0 2024-08-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.820+0000 7f216b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2164072c60 con 0x7f21640ce500 2024-08-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.820+0000 7f216b400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2164073b70 con 0x7f21640d03c0 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2164159bf0 0x7f216415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2164159bf0 0x7f216415fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59710/0 (socket says 172.21.15.7:59710) 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2163e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640d03c0 0x7f216414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 -- 172.21.15.7:0/1477702705 learned_addr learned my addr 172.21.15.7:0/1477702705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2168a00640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21640ce500 0x7f21641f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 -- 172.21.15.7:0/1477702705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640d03c0 msgr2=0x7f216414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640d03c0 0x7f216414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 -- 172.21.15.7:0/1477702705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21640ce500 msgr2=0x7f21641f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21640ce500 0x7f21641f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 -- 172.21.15.7:0/1477702705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2164151330 con 0x7f2164159bf0 2024-08-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.821+0000 7f2169400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2164159bf0 0x7f216415fef0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f215c009eb0 tx=0x7f215c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.822+0000 7f2160c00640 1 -- 172.21.15.7:0/1477702705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c040070 con 0x7f2164159bf0 2024-08-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.822+0000 7f2160c00640 1 -- 172.21.15.7:0/1477702705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c030b60 con 0x7f2164159bf0 2024-08-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.822+0000 7f2160c00640 1 -- 172.21.15.7:0/1477702705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c009450 con 0x7f2164159bf0 2024-08-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.822+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2164151610 con 0x7f2164159bf0 2024-08-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.822+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2164151bd0 con 0x7f2164159bf0 2024-08-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.824+0000 7f2160c00640 1 -- 172.21.15.7:0/1477702705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f215c039040 con 0x7f2164159bf0 2024-08-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.825+0000 7f2160c00640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f214406be60 0x7f214406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.826+0000 7f2160c00640 1 -- 172.21.15.7:0/1477702705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f215c0ac530 con 0x7f2164159bf0 2024-08-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.826+0000 7f2168a00640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f214406be60 0x7f214406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.826+0000 7f216e1fc740 1 Processor -- start 2024-08-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.826+0000 7f216e1fc740 1 -- start start 2024-08-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.826+0000 7f2168a00640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f214406be60 0x7f214406e320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f60 tx=0x7f2158007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e95ff50 0x56309e960330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e97c830 0x56309e960870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e930c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f216e1fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56309e898ba0 con 0x56309e95ff50 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56309e831230 con 0x56309e930780 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56309e894b60 con 0x56309e97c830 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f2168a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e95ff50 0x56309e960330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f2168a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e95ff50 0x56309e960330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59722/0 (socket says 172.21.15.7:59722) 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.827+0000 7f2168a00640 1 -- 172.21.15.7:0/763772197 learned_addr learned my addr 172.21.15.7:0/763772197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2169400640 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e930c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2163e00640 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e97c830 0x56309e960870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2168a00640 1 -- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e97c830 msgr2=0x56309e960870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2168a00640 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e97c830 0x56309e960870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2168a00640 1 -- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 msgr2=0x56309e930c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2168a00640 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e930c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2168a00640 1 -- 172.21.15.7:0/763772197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309e862bb0 con 0x56309e95ff50 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2169400640 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e930c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2163e00640 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e97c830 0x56309e960870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2168a00640 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e95ff50 0x56309e960330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2158004fb0 tx=0x7f2158013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60226b0e66bcc6e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2155200640 1 -- 172.21.15.7:0/763772197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158026070 con 0x56309e95ff50 2024-08-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2155200640 1 -- 172.21.15.7:0/763772197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2158013b80 con 0x56309e95ff50 2024-08-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.828+0000 7f2155200640 1 -- 172.21.15.7:0/763772197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158012350 con 0x56309e95ff50 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 -- 172.21.15.7:0/763772197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e95ff50 msgr2=0x56309e960330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e95ff50 0x56309e960330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2158004fb0 tx=0x7f2158013000 comp rx=0 tx=0).stop 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 -- 172.21.15.7:0/763772197 shutdown_connections 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e930c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e97c830 0x56309e960870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 --2- 172.21.15.7:0/763772197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e95ff50 0x56309e960330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 -- 172.21.15.7:0/763772197 >> 172.21.15.7:0/763772197 conn(0x56309e8fd110 msgr2=0x56309e97ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 -- 172.21.15.7:0/763772197 shutdown_connections 2024-08-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.829+0000 7f216e1fc740 1 -- 172.21.15.7:0/763772197 wait complete. 2024-08-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.830+0000 7f216e1fc740 1 -- start start 2024-08-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.830+0000 7f216e1fc740 1 Processor -- start 2024-08-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e930780 0x56309e9638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e95ff50 0x56309e951430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e95bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f216e1fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56309e931e80 con 0x56309e97c830 2024-08-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56309e854250 con 0x56309e95ff50 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56309e95da10 con 0x56309e930780 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f216e1fc740 10 client.0 _ll_register_callbacks cb 0x56309e858740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f2169400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e95bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f2169400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e95bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59738/0 (socket says 172.21.15.7:59738) 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.831+0000 7f2169400640 1 -- 172.21.15.7:0/471945570 learned_addr learned my addr 172.21.15.7:0/471945570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2168a00640 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e930780 0x56309e9638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2163e00640 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e95ff50 0x56309e951430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2169400640 1 -- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e930780 msgr2=0x56309e9638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2169400640 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e930780 0x56309e9638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2169400640 1 -- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e95ff50 msgr2=0x56309e951430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2169400640 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e95ff50 0x56309e951430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2169400640 1 -- 172.21.15.7:0/471945570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309e5ac2d0 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2169400640 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e95bbb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f215c02a610 tx=0x7f215c07a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5625134f5f9aa271 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2149600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2149600640 1 -- 172.21.15.7:0/471945570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c04a070 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f2149600640 1 -- 172.21.15.7:0/471945570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f215c0ac0b0 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.832+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2158013b80 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f2149600640 1 -- 172.21.15.7:0/471945570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f215c0aa050 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 10 client.6051 fetch_fsmap learned FSMap version 53 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x56309e6766b0 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f2149600640 1 -- 172.21.15.7:0/471945570 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2158013b80 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f2149600640 1 -- 172.21.15.7:0/471945570 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f215c07a9c0 con 0x56309e97c830 2024-08-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 10 client.6051 fetch_fsmap finished waiting for FSMap version 53 2024-08-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 10 client.6051 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 20 client.6051 populate_metadata read hostname 'smithi007' 2024-08-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e935bd0 0x56309e961110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 4 client.6051 mds_command: new command op to 6003 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 --> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56309e8a62d0 con 0x56309e935bd0 2024-08-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.833+0000 7f2168a00640 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e935bd0 0x56309e961110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.834+0000 7f2168a00640 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e935bd0 0x56309e961110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e8b1a4b02ac68d9 server_cookie=96105db140af4f48 in_seq=0 out_seq=0 2024-08-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.834+0000 7f2149600640 10 client.6051 ms_handle_connect on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f2149600640 1 -- 172.21.15.7:0/471945570 <== mds.0 v2:172.21.15.7:6834/2987342349 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56309e8a62d0 con 0x56309e935bd0 2024-08-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f2149600640 10 client.6051 handle_command_reply: tid=0 2024-08-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 client.6051 shutdown 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 msgr2=0x56309e95bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e95bbb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f215c02a610 tx=0x7f215c07a180 comp rx=0 tx=0).stop 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 shutdown_connections 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e935bd0 0x56309e961110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e95bbb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e95ff50 0x56309e951430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 --2- 172.21.15.7:0/471945570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e930780 0x56309e9638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f2149600640 0 client.6051 ms_handle_reset on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 >> 172.21.15.7:0/471945570 conn(0x56309e8fd110 msgr2=0x56309e92f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 shutdown_connections 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 1 -- 172.21.15.7:0/471945570 wait complete. 2024-08-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.835+0000 7f216e1fc740 20 client.6051 trim_cache size 0 max 16384 2024-08-19T00:40:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.854+0000 7f216e1fc740 1 Processor -- start 2024-08-19T00:40:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.854+0000 7f216e1fc740 1 -- start start 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e930780 0x56309e94db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 0x56309e963600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e97c830 0x56309e95b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f216e1fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21640b4970 con 0x56309e930780 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21641f5960 con 0x56309e97c830 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21640b4320 con 0x56309e95ff50 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f2168a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e930780 0x56309e94db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f2168a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e930780 0x56309e94db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59740/0 (socket says 172.21.15.7:59740) 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f2168a00640 1 -- 172.21.15.7:0/1503972996 learned_addr learned my addr 172.21.15.7:0/1503972996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f2169400640 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e97c830 0x56309e95b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f2168a00640 1 -- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 msgr2=0x56309e963600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.855+0000 7f2168a00640 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 0x56309e963600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f2168a00640 1 -- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e97c830 msgr2=0x56309e95b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f2168a00640 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e97c830 0x56309e95b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f2168a00640 1 -- 172.21.15.7:0/1503972996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309e962100 con 0x56309e930780 2024-08-19T00:40:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f2169400640 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e97c830 0x56309e95b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:40:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f2168a00640 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e930780 0x56309e94db40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f215801f000 tx=0x7f2158014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a9d9f5f9a78b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f214be00640 1 -- 172.21.15.7:0/1503972996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158026040 con 0x56309e930780 2024-08-19T00:40:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f214be00640 1 -- 172.21.15.7:0/1503972996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2158027040 con 0x56309e930780 2024-08-19T00:40:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.856+0000 7f214be00640 1 -- 172.21.15.7:0/1503972996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215802f680 con 0x56309e930780 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 -- 172.21.15.7:0/1503972996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e930780 msgr2=0x56309e94db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e930780 0x56309e94db40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f215801f000 tx=0x7f2158014000 comp rx=0 tx=0).stop 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 -- 172.21.15.7:0/1503972996 shutdown_connections 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e97c830 0x56309e95b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 0x56309e963600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 --2- 172.21.15.7:0/1503972996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e930780 0x56309e94db40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 -- 172.21.15.7:0/1503972996 >> 172.21.15.7:0/1503972996 conn(0x56309e8fd110 msgr2=0x56309e92f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 -- 172.21.15.7:0/1503972996 shutdown_connections 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 -- 172.21.15.7:0/1503972996 wait complete. 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.857+0000 7f216e1fc740 1 -- start start 2024-08-19T00:40:11.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.858+0000 7f216e1fc740 1 Processor -- start 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.858+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e979f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.858+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 0x56309e977520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.858+0000 7f216e1fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e977a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.858+0000 7f216e1fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56309e9341a0 con 0x56309e97c830 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.858+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56309e951ac0 con 0x56309e930780 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.858+0000 7f216e1fc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56309e9505d0 con 0x56309e95ff50 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f216e1fc740 10 client.0 _ll_register_callbacks cb 0x7f215c030f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e977a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e977a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59742/0 (socket says 172.21.15.7:59742) 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 -- 172.21.15.7:0/4087844378 learned_addr learned my addr 172.21.15.7:0/4087844378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2163e00640 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 0x56309e977520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2168a00640 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e979f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 -- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 msgr2=0x56309e977520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 0x56309e977520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 -- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 msgr2=0x56309e979f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e979f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 -- 172.21.15.7:0/4087844378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309e9343d0 con 0x56309e97c830 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2169400640 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e977a60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f215c0770e0 tx=0x7f215c0aa800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103037dfda881902 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.859+0000 7f2149600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f2149600640 1 -- 172.21.15.7:0/4087844378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c04a070 con 0x56309e97c830 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f2149600640 1 -- 172.21.15.7:0/4087844378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f215c082e00 con 0x56309e97c830 2024-08-19T00:40:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2158027040 con 0x56309e97c830 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f2149600640 1 -- 172.21.15.7:0/4087844378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f215c0a0050 con 0x56309e97c830 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 10 client.6057 fetch_fsmap learned FSMap version 53 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x56309e950a50 con 0x56309e97c830 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f2149600640 1 -- 172.21.15.7:0/4087844378 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2158027040 con 0x56309e97c830 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f2149600640 1 -- 172.21.15.7:0/4087844378 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f215c0a3020 con 0x56309e97c830 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 10 client.6057 fetch_fsmap finished waiting for FSMap version 53 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 10 client.6057 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 20 client.6057 populate_metadata read hostname 'smithi007' 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e97e1d0 0x56309e97e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 4 client.6057 mds_command: new command op to 6003 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.860+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 --> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] -- command(tid 0: {"prefix": "status"}) -- 0x56309e8a0620 con 0x56309e97e1d0 2024-08-19T00:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.861+0000 7f2168a00640 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e97e1d0 0x56309e97e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.861+0000 7f2168a00640 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e97e1d0 0x56309e97e5b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b92a84a6483128f server_cookie=fae3f412abce19fb in_seq=0 out_seq=0 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.861+0000 7f2149600640 10 client.6057 ms_handle_connect on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.861+0000 7f2149600640 1 -- 172.21.15.7:0/4087844378 <== mds.0 v2:172.21.15.7:6834/2987342349 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56309e8a0620 con 0x56309e97e1d0 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.861+0000 7f2149600640 10 client.6057 handle_command_reply: tid=0 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.861+0000 7f216e1fc740 1 client.6057 shutdown 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 msgr2=0x56309e977a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e977a60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f215c0770e0 tx=0x7f215c0aa800 comp rx=0 tx=0).stop 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 shutdown_connections 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56309e97e1d0 0x56309e97e5b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56309e97c830 0x56309e977a60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56309e95ff50 0x56309e977520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 --2- 172.21.15.7:0/4087844378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56309e930780 0x56309e979f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f2149600640 0 client.6057 ms_handle_reset on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 >> 172.21.15.7:0/4087844378 conn(0x56309e8fd110 msgr2=0x56309e95c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 shutdown_connections 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 1 -- 172.21.15.7:0/4087844378 wait complete. 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216e1fc740 20 client.6057 trim_cache size 0 max 16384 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6003, 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:40:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:40:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:40:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.6952196690000001, 2024-08-19T00:40:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 53, 2024-08-19T00:40:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 60, 2024-08-19T00:40:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 60, 2024-08-19T00:40:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.517291827999999 2024-08-19T00:40:11.870 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f214406be60 msgr2=0x7f214406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.862+0000 7f216b400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f214406be60 0x7f214406e320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f60 tx=0x7f2158007d50 comp rx=0 tx=0).stop 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2164159bf0 msgr2=0x7f216415fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2164159bf0 0x7f216415fef0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f215c009eb0 tx=0x7f215c004a40 comp rx=0 tx=0).stop 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 shutdown_connections 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f214406be60 0x7f214406e320 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2164159bf0 0x7f216415fef0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21640d03c0 0x7f216414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 --2- 172.21.15.7:0/1477702705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21640ce500 0x7f21641f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 >> 172.21.15.7:0/1477702705 conn(0x7f216406bc70 msgr2=0x7f216415e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 shutdown_connections 2024-08-19T00:40:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:11.863+0000 7f216b400640 1 -- 172.21.15.7:0/1477702705 wait complete. 2024-08-19T00:40:11.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.034+0000 7f5874200640 1 Processor -- start 2024-08-19T00:40:12.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.034+0000 7f5874200640 1 -- start start 2024-08-19T00:40:12.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.035+0000 7f5874200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f586c09aa70 0x7f586c09ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.035+0000 7f5874200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f586c09b390 con 0x7f586c09b730 2024-08-19T00:40:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.035+0000 7f5874200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f586c15ec30 con 0x7f586c0d0290 2024-08-19T00:40:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.035+0000 7f5874200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f586c15ef10 con 0x7f586c09aa70 2024-08-19T00:40:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.035+0000 7f5870e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f586c09b730 0x7f586c06fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56652/0 (socket says 172.21.15.7:56652) 2024-08-19T00:40:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f5870e00640 1 -- 172.21.15.7:0/2117666310 learned_addr learned my addr 172.21.15.7:0/2117666310 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f5871800640 1 --2- 172.21.15.7:0/2117666310 >> v2:172.21.15.162:3300/0 conn(0x7f586c09aa70 0x7f586c09ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757027697 0 0) 0x7f586c09b390 con 0x7f586c09b730 2024-08-19T00:40:12.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5854003520 con 0x7f586c09b730 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2813021588 0 0) 0x7f5854003520 con 0x7f586c09b730 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 >> v2:172.21.15.162:3300/0 conn(0x7f586c09aa70 msgr2=0x7f586c09ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 --2- 172.21.15.7:0/2117666310 >> v2:172.21.15.162:3300/0 conn(0x7f586c09aa70 0x7f586c09ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 >> v1:172.21.15.162:6789/0 conn(0x7f586c0d0290 legacy=0x7f586c0d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c15f1f0 con 0x7f586c09b730 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f5858001670 con 0x7f586c09b730 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 >> v1:172.21.15.7:6789/0 conn(0x7f586c09b730 legacy=0x7f586c06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58540039b0 0x7f5854003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.036+0000 7f586be00640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5854004800 0x7f5854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f586be00640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540051c0 0x7f585400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f586c15ef10 con 0x7f58540039b0 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f585400c060 con 0x7f58540051c0 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f585400c260 con 0x7f5854004800 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5871800640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58540039b0 0x7f5854003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5870e00640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5854004800 0x7f5854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5872200640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540051c0 0x7f585400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5871800640 1 -- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5854004800 msgr2=0x7f5854004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5871800640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5854004800 0x7f5854004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5871800640 1 -- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540051c0 msgr2=0x7f585400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5871800640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540051c0 0x7f585400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5871800640 1 -- 172.21.15.7:0/2117666310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5854003520 con 0x7f58540039b0 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5872200640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540051c0 0x7f585400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5870e00640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5854004800 0x7f5854004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.037+0000 7f5872200640 1 -- 172.21.15.7:0/2117666310 reap_dead start 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.038+0000 7f5871800640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58540039b0 0x7f5854003dd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5860009ac0 tx=0x7f5854005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53c007e179c6c1b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.038+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860036070 con 0x7f58540039b0 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.038+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5860031400 con 0x7f58540039b0 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.038+0000 7f586be00640 1 -- 172.21.15.7:0/2117666310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860009690 con 0x7f58540039b0 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.039+0000 7f5874200640 1 -- 172.21.15.7:0/2117666310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58540039b0 msgr2=0x7f5854003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.039+0000 7f5874200640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58540039b0 0x7f5854003dd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5860009ac0 tx=0x7f5854005830 comp rx=0 tx=0).stop 2024-08-19T00:40:12.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.039+0000 7f5874200640 1 -- 172.21.15.7:0/2117666310 shutdown_connections 2024-08-19T00:40:12.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.039+0000 7f5874200640 1 --2- 172.21.15.7:0/2117666310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58540039b0 0x7f5854003dd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.039+0000 7f5874200640 1 -- 172.21.15.7:0/2117666310 >> 172.21.15.7:0/2117666310 conn(0x7f586c0d2190 msgr2=0x7f586c0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:12.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.039+0000 7f5874200640 1 -- 172.21.15.7:0/2117666310 shutdown_connections 2024-08-19T00:40:12.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.039+0000 7f5874200640 1 -- 172.21.15.7:0/2117666310 wait complete. 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.041+0000 7f5874200640 1 Processor -- start 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.041+0000 7f5874200640 1 -- start start 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5874200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58540039b0 0x7f586c0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5874200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f586c0af7a0 0x7f586c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5874200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0afc00 0x7f586c15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5874200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f586c09ae50 con 0x7f586c0af7a0 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5874200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f586c15e8f0 con 0x7f586c0afc00 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5874200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f586c09afd0 con 0x7f58540039b0 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f586c0af7a0 0x7f586c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f586c0af7a0 0x7f586c15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59762/0 (socket says 172.21.15.7:59762) 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 -- 172.21.15.7:0/4156422791 learned_addr learned my addr 172.21.15.7:0/4156422791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:12.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5871800640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58540039b0 0x7f586c0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5872200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0afc00 0x7f586c15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 -- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58540039b0 msgr2=0x7f586c0b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58540039b0 0x7f586c0b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 -- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0afc00 msgr2=0x7f586c15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0afc00 0x7f586c15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5870e00640 1 -- 172.21.15.7:0/4156422791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c0b6a90 con 0x7f586c0af7a0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.042+0000 7f5872200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0afc00 0x7f586c15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.043+0000 7f5870e00640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f586c0af7a0 0x7f586c15c0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f585800e860 tx=0x7f585800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.043+0000 7f5869600640 1 -- 172.21.15.7:0/4156422791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585800c870 con 0x7f586c0af7a0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.043+0000 7f5869600640 1 -- 172.21.15.7:0/4156422791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5858018070 con 0x7f586c0af7a0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.043+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586c0b6d70 con 0x7f586c0af7a0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.043+0000 7f5869600640 1 -- 172.21.15.7:0/4156422791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585800cc50 con 0x7f586c0af7a0 2024-08-19T00:40:12.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.043+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586c0b7330 con 0x7f586c0af7a0 2024-08-19T00:40:12.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.044+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586c06fc30 con 0x7f586c0af7a0 2024-08-19T00:40:12.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.045+0000 7f5869600640 1 -- 172.21.15.7:0/4156422791 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f585801d460 con 0x7f586c0af7a0 2024-08-19T00:40:12.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.046+0000 7f5869600640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f584c06be30 0x7f584c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.046+0000 7f5869600640 1 -- 172.21.15.7:0/4156422791 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f585808b000 con 0x7f586c0af7a0 2024-08-19T00:40:12.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.046+0000 7f5871800640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f584c06be30 0x7f584c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.047+0000 7f5871800640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f584c06be30 0x7f584c06e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5860033000 tx=0x7f5860008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:12.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.050+0000 7f5869600640 1 -- 172.21.15.7:0/4156422791 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5858059880 con 0x7f586c0af7a0 2024-08-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.272+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f586c06d190 con 0x7f586c0af7a0 2024-08-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.273+0000 7f5869600640 1 -- 172.21.15.7:0/4156422791 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5221 (secure 0 0 0) 0x7f5858059180 con 0x7f586c0af7a0 2024-08-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"btime":"2024-08-19T00:40:10:178898+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:10.178891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6003,"qdb_cluster":[6003]},"id":4}]} 2024-08-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-08-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f584c06be30 msgr2=0x7f584c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f584c06be30 0x7f584c06e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5860033000 tx=0x7f5860008030 comp rx=0 tx=0).stop 2024-08-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f586c0af7a0 msgr2=0x7f586c15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f586c0af7a0 0x7f586c15c0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f585800e860 tx=0x7f585800ed20 comp rx=0 tx=0).stop 2024-08-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 shutdown_connections 2024-08-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f584c06be30 0x7f584c06e2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0afc00 0x7f586c15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f586c0af7a0 0x7f586c15c0a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 --2- 172.21.15.7:0/4156422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58540039b0 0x7f586c0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 >> 172.21.15.7:0/4156422791 conn(0x7f586c0d2190 msgr2=0x7f586c0d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 shutdown_connections 2024-08-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.275+0000 7f5874200640 1 -- 172.21.15.7:0/4156422791 wait complete. 2024-08-19T00:40:12.289 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:40:12.286+0000 7fe6c8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:40:12.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 4:0 true 2024-08-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.451+0000 7f5c9e600640 1 Processor -- start 2024-08-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.451+0000 7f5c9e600640 1 -- start start 2024-08-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.452+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.452+0000 7f5c9e600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5c980cfce0 0x7f5c98162a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.452+0000 7f5c9e600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c980d50d0 con 0x7f5c980d0ba0 2024-08-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.452+0000 7f5c9e600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5c980ced30 con 0x7f5c980cfce0 2024-08-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.452+0000 7f5c9e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5c98162f50 con 0x7f5c98161900 2024-08-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c97e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5c980cfce0 0x7f5c98162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c9d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c9dc00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5c980d0ba0 0x7f5c980b6fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:48860/0 (socket says 172.21.15.7:48860) 2024-08-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c97e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5c980cfce0 0x7f5c98162a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:35832/0 (socket says 172.21.15.7:35832) 2024-08-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c9dc00640 1 -- 172.21.15.7:0/3444623348 learned_addr learned my addr 172.21.15.7:0/3444623348 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c97400640 1 -- 172.21.15.7:0/3444623348 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405914206 0 0) 0x7f5c980d50d0 con 0x7f5c980d0ba0 2024-08-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c97400640 1 -- 172.21.15.7:0/3444623348 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c80003520 con 0x7f5c980d0ba0 2024-08-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c9d200640 1 -- 172.21.15.7:0/3444623348 >> v2:172.21.15.162:3300/0 conn(0x7f5c980cfce0 msgr2=0x7f5c98162a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c9d200640 1 --2- 172.21.15.7:0/3444623348 >> v2:172.21.15.162:3300/0 conn(0x7f5c980cfce0 0x7f5c98162a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c9d200640 1 -- 172.21.15.7:0/3444623348 >> v1:172.21.15.162:6789/0 conn(0x7f5c980d0ba0 legacy=0x7f5c980b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c9d200640 1 -- 172.21.15.7:0/3444623348 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c980cef60 con 0x7f5c98161900 2024-08-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.453+0000 7f5c97e00640 1 --2- 172.21.15.7:0/3444623348 >> v2:172.21.15.162:3300/0 conn(0x7f5c980cfce0 0x7f5c98162a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.455+0000 7f5c9d200640 1 --2- 172.21.15.7:0/3444623348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980d4af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0097a0 tx=0x7f5c8c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6651ff92097d4767 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.455+0000 7f5c97400640 1 -- 172.21.15.7:0/3444623348 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c037070 con 0x7f5c98161900 2024-08-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.455+0000 7f5c97400640 1 -- 172.21.15.7:0/3444623348 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8c032440 con 0x7f5c98161900 2024-08-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.455+0000 7f5c97400640 1 -- 172.21.15.7:0/3444623348 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c032810 con 0x7f5c98161900 2024-08-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.455+0000 7f5c9e600640 1 -- 172.21.15.7:0/3444623348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 msgr2=0x7f5c980d4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.455+0000 7f5c9e600640 1 --2- 172.21.15.7:0/3444623348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980d4af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0097a0 tx=0x7f5c8c02a180 comp rx=0 tx=0).stop 2024-08-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.456+0000 7f5c9e600640 1 -- 172.21.15.7:0/3444623348 shutdown_connections 2024-08-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.456+0000 7f5c9e600640 1 --2- 172.21.15.7:0/3444623348 >> v2:172.21.15.162:3300/0 conn(0x7f5c980cfce0 0x7f5c98162a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.456+0000 7f5c9e600640 1 --2- 172.21.15.7:0/3444623348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980d4af0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.456+0000 7f5c9e600640 1 -- 172.21.15.7:0/3444623348 >> 172.21.15.7:0/3444623348 conn(0x7f5c9809d4d0 msgr2=0x7f5c980d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.456+0000 7f5c9e600640 1 -- 172.21.15.7:0/3444623348 shutdown_connections 2024-08-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.456+0000 7f5c9e600640 1 -- 172.21.15.7:0/3444623348 wait complete. 2024-08-19T00:40:12.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.457+0000 7f5c9e600640 1 Processor -- start 2024-08-19T00:40:12.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.457+0000 7f5c9e600640 1 -- start start 2024-08-19T00:40:12.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.458+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c980cfce0 0x7f5c980cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.458+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c980d0ba0 0x7f5c9806d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.458+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.458+0000 7f5c9e600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980d0140 con 0x7f5c980d0ba0 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.458+0000 7f5c9e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980cf850 con 0x7f5c980cfce0 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.458+0000 7f5c9e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5c980cf4e0 con 0x7f5c98161900 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.458+0000 7f5c97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c980d0ba0 0x7f5c9806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c980d0ba0 0x7f5c9806d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59776/0 (socket says 172.21.15.7:59776) 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 -- 172.21.15.7:0/2994484528 learned_addr learned my addr 172.21.15.7:0/2994484528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c9d200640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c980cfce0 0x7f5c980cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c9dc00640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 -- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 msgr2=0x7f5c980cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 -- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c980cfce0 msgr2=0x7f5c980cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:12.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c980cfce0 0x7f5c980cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:12.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 -- 172.21.15.7:0/2994484528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c980cda70 con 0x7f5c980d0ba0 2024-08-19T00:40:12.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c97e00640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c980d0ba0 0x7f5c9806d240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400ebe0 tx=0x7f5c8400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:12.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.459+0000 7f5c94c00640 1 -- 172.21.15.7:0/2994484528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84017070 con 0x7f5c980d0ba0 2024-08-19T00:40:12.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.460+0000 7f5c94c00640 1 -- 172.21.15.7:0/2994484528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8400cc30 con 0x7f5c980d0ba0 2024-08-19T00:40:12.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.460+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c980cb260 con 0x7f5c980d0ba0 2024-08-19T00:40:12.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.460+0000 7f5c94c00640 1 -- 172.21.15.7:0/2994484528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84013470 con 0x7f5c980d0ba0 2024-08-19T00:40:12.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.460+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c980cb820 con 0x7f5c980d0ba0 2024-08-19T00:40:12.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.461+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c98162a10 con 0x7f5c980d0ba0 2024-08-19T00:40:12.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.462+0000 7f5c94c00640 1 -- 172.21.15.7:0/2994484528 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c8401a070 con 0x7f5c980d0ba0 2024-08-19T00:40:12.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.463+0000 7f5c94c00640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5c7806be30 0x7f5c7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:12.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.463+0000 7f5c94c00640 1 -- 172.21.15.7:0/2994484528 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f5c8408b140 con 0x7f5c980d0ba0 2024-08-19T00:40:12.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.463+0000 7f5c9d200640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5c7806be30 0x7f5c7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:12.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.463+0000 7f5c9d200640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5c7806be30 0x7f5c7806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c034000 tx=0x7f5c8c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:12.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.467+0000 7f5c94c00640 1 -- 172.21.15.7:0/2994484528 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5c84059410 con 0x7f5c980d0ba0 2024-08-19T00:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:12.720+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "4:0", "val": "true"} v 0) -- 0x7f5c980d0980 con 0x7f5c980d0ba0 2024-08-19T00:40:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.193+0000 7f5c94c00640 1 -- 172.21.15.7:0/2994484528 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "4:0", "val": "true"}]=0 freezing mds.6003 v54) ==== 112+0+0 (secure 0 0 0) 0x7f5c8405d710 con 0x7f5c980d0ba0 2024-08-19T00:40:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:freezing mds.6003 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5c7806be30 msgr2=0x7f5c7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5c7806be30 0x7f5c7806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c034000 tx=0x7f5c8c02e000 comp rx=0 tx=0).stop 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c980d0ba0 msgr2=0x7f5c9806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c980d0ba0 0x7f5c9806d240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400ebe0 tx=0x7f5c8400c520 comp rx=0 tx=0).stop 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 shutdown_connections 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5c7806be30 0x7f5c7806e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c98161900 0x7f5c980cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c980d0ba0 0x7f5c9806d240 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 --2- 172.21.15.7:0/2994484528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c980cfce0 0x7f5c980cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 >> 172.21.15.7:0/2994484528 conn(0x7f5c9809d4d0 msgr2=0x7f5c980cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 shutdown_connections 2024-08-19T00:40:13.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.195+0000 7f5c9e600640 1 -- 172.21.15.7:0/2994484528 wait complete. 2024-08-19T00:40:13.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo daemon-helper kill ceph --cluster ceph -w 2024-08-19T00:40:13.218 DEBUG:teuthology.orchestra.run.smithi007:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --connect-timeout=60 tell mds.4:0 flush journal 2024-08-19T00:40:13.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-08-19T00:40:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.380+0000 7fd1b1000640 1 Processor -- start 2024-08-19T00:40:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.380+0000 7fd1b1000640 1 -- start start 2024-08-19T00:40:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1b1000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd1ac0aed00 0x7fd1ac06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1b1000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1ac06f720 0x7fd1ac0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1b1000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0b3450 0x7fd1ac06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1b1000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac0b38b0 con 0x7fd1ac06f720 2024-08-19T00:40:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1b1000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac15e720 con 0x7fd1ac0aed00 2024-08-19T00:40:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1b1000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac0b3c00 con 0x7fd1ac0b3450 2024-08-19T00:40:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1a9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1ac06f720 0x7fd1ac0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1a9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1ac06f720 0x7fd1ac0b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59786/0 (socket says 172.21.15.7:59786) 2024-08-19T00:40:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1a9400640 1 -- 172.21.15.7:0/4051925030 learned_addr learned my addr 172.21.15.7:0/4051925030 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/4051925030 >> v2:172.21.15.162:3300/0 conn(0x7fd1ac0aed00 0x7fd1ac06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.381+0000 7fd1aa800640 1 --2- 172.21.15.7:0/4051925030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0b3450 0x7fd1ac06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.382+0000 7fd1a9400640 1 -- 172.21.15.7:0/4051925030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0b3450 msgr2=0x7fd1ac06deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.382+0000 7fd1a9400640 1 --2- 172.21.15.7:0/4051925030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0b3450 0x7fd1ac06deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.382+0000 7fd1a9400640 1 -- 172.21.15.7:0/4051925030 >> v2:172.21.15.162:3300/0 conn(0x7fd1ac0aed00 msgr2=0x7fd1ac06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.382+0000 7fd1a9400640 1 --2- 172.21.15.7:0/4051925030 >> v2:172.21.15.162:3300/0 conn(0x7fd1ac0aed00 0x7fd1ac06f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.382+0000 7fd1a9400640 1 -- 172.21.15.7:0/4051925030 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac072450 con 0x7fd1ac06f720 2024-08-19T00:40:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.383+0000 7fd1a9400640 1 --2- 172.21.15.7:0/4051925030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 0x7fd1ac0b2f10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b2ca0 tx=0x7fd19802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22d488b4d3970d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.383+0000 7fd1a8a00640 1 -- 172.21.15.7:0/4051925030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198037070 con 0x7fd1ac06f720 2024-08-19T00:40:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.383+0000 7fd1a8a00640 1 -- 172.21.15.7:0/4051925030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19802ae00 con 0x7fd1ac06f720 2024-08-19T00:40:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.383+0000 7fd1a8a00640 1 -- 172.21.15.7:0/4051925030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198032660 con 0x7fd1ac06f720 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 -- 172.21.15.7:0/4051925030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 msgr2=0x7fd1ac0b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 --2- 172.21.15.7:0/4051925030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 0x7fd1ac0b2f10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b2ca0 tx=0x7fd19802a0b0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 -- 172.21.15.7:0/4051925030 shutdown_connections 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 --2- 172.21.15.7:0/4051925030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0b3450 0x7fd1ac06deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 --2- 172.21.15.7:0/4051925030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 0x7fd1ac0b2f10 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 --2- 172.21.15.7:0/4051925030 >> v2:172.21.15.162:3300/0 conn(0x7fd1ac0aed00 0x7fd1ac06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 -- 172.21.15.7:0/4051925030 >> 172.21.15.7:0/4051925030 conn(0x7fd1ac0b2300 msgr2=0x7fd1ac06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 -- 172.21.15.7:0/4051925030 shutdown_connections 2024-08-19T00:40:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.384+0000 7fd1b1000640 1 -- 172.21.15.7:0/4051925030 wait complete. 2024-08-19T00:40:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.386+0000 7fd1b1000640 1 Processor -- start 2024-08-19T00:40:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.386+0000 7fd1b1000640 1 -- start start 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1b1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 0x7fd1ac09da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1b1000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0aed00 0x7fd1ac1e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1b1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1ac0b3450 0x7fd1ac09b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1b1000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac072cf0 con 0x7fd1ac06f720 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1b1000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac072a10 con 0x7fd1ac0b3450 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1b1000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac06e3f0 con 0x7fd1ac0aed00 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 0x7fd1ac09da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 0x7fd1ac09da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59802/0 (socket says 172.21.15.7:59802) 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1a9e00640 1 -- 172.21.15.7:0/1580560449 learned_addr learned my addr 172.21.15.7:0/1580560449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1a9400640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0aed00 0x7fd1ac1e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.387+0000 7fd1aa800640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1ac0b3450 0x7fd1ac09b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a9e00640 1 -- 172.21.15.7:0/1580560449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0aed00 msgr2=0x7fd1ac1e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1ac0aed00 0x7fd1ac1e6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a9e00640 1 -- 172.21.15.7:0/1580560449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1ac0b3450 msgr2=0x7fd1ac09b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1ac0b3450 0x7fd1ac09b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a9e00640 1 -- 172.21.15.7:0/1580560449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac09aba0 con 0x7fd1ac06f720 2024-08-19T00:40:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1ac06f720 0x7fd1ac09da00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00e8c0 tx=0x7fd19c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a2000640 1 -- 172.21.15.7:0/1580560449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c017070 con 0x7fd1ac06f720 2024-08-19T00:40:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a2000640 1 -- 172.21.15.7:0/1580560449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c00c940 con 0x7fd1ac06f720 2024-08-19T00:40:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1b1000640 1 -- 172.21.15.7:0/1580560449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac09ae80 con 0x7fd1ac06f720 2024-08-19T00:40:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.388+0000 7fd1a2000640 1 -- 172.21.15.7:0/1580560449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00cd10 con 0x7fd1ac06f720 2024-08-19T00:40:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.389+0000 7fd1b1000640 1 -- 172.21.15.7:0/1580560449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac1e7060 con 0x7fd1ac06f720 2024-08-19T00:40:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.392+0000 7fd1a2000640 1 -- 172.21.15.7:0/1580560449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd19c01a070 con 0x7fd1ac06f720 2024-08-19T00:40:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.392+0000 7fd1b3e63740 1 Processor -- start 2024-08-19T00:40:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.392+0000 7fd1b3e63740 1 -- start start 2024-08-19T00:40:13.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.393+0000 7fd1a2000640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd18c06be60 0x7fd18c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.393+0000 7fd1a2000640 1 -- 172.21.15.7:0/1580560449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7fd19c08b110 con 0x7fd1ac06f720 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.393+0000 7fd1aa800640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd18c06be60 0x7fd18c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.393+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f07e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.393+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f0369d0 0x56133f0395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.393+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f062e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56133ef21900 con 0x56133f039210 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56133ef593e0 con 0x56133f03a9a0 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56133ef9bc70 con 0x56133f0369d0 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f07e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f07e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59816/0 (socket says 172.21.15.7:59816) 2024-08-19T00:40:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3041986640 learned_addr learned my addr 172.21.15.7:0/3041986640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9400640 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f0369d0 0x56133f0395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1aa800640 1 --2- 172.21.15.7:0/1580560449 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd18c06be60 0x7fd18c06e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4011420 tx=0x7fd1a400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1aa800640 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f062e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f0369d0 msgr2=0x56133f0395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f0369d0 0x56133f0395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 msgr2=0x56133f062e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f062e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.394+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3041986640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56133ed7ba30 con 0x56133f039210 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.395+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f07e9b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0895b0 tx=0x7fd19c059470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc0bbdfaddd12b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.395+0000 7fd196a00640 1 -- 172.21.15.7:0/3041986640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c021040 con 0x56133f039210 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.395+0000 7fd196a00640 1 -- 172.21.15.7:0/3041986640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c061fa0 con 0x56133f039210 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.395+0000 7fd196a00640 1 -- 172.21.15.7:0/3041986640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c055ae0 con 0x56133f039210 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3041986640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 msgr2=0x56133f07e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f07e9b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0895b0 tx=0x7fd19c059470 comp rx=0 tx=0).stop 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3041986640 shutdown_connections 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f062e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f0369d0 0x56133f0395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/3041986640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f07e9b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3041986640 >> 172.21.15.7:0/3041986640 conn(0x56133f0359d0 msgr2=0x56133f07de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3041986640 shutdown_connections 2024-08-19T00:40:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.396+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3041986640 wait complete. 2024-08-19T00:40:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.397+0000 7fd1b3e63740 1 -- start start 2024-08-19T00:40:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.397+0000 7fd1b3e63740 1 Processor -- start 2024-08-19T00:40:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f05d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f03a9a0 0x56133f059e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f033200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56133ef97c30 con 0x56133f039210 2024-08-19T00:40:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56133ef340d0 con 0x56133f032dc0 2024-08-19T00:40:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56133ef57160 con 0x56133f03a9a0 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1b3e63740 10 client.0 _ll_register_callbacks cb 0x56133ef47cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.398+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f05d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f05d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59818/0 (socket says 172.21.15.7:59818) 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 -- 172.21.15.7:0/4120007534 learned_addr learned my addr 172.21.15.7:0/4120007534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9400640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f03a9a0 0x56133f059e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1aa800640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f033200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 -- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f03a9a0 msgr2=0x56133f059e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f03a9a0 0x56133f059e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 -- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 msgr2=0x56133f033200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f033200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 -- 172.21.15.7:0/4120007534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56133ecaf620 con 0x56133f039210 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9400640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f03a9a0 0x56133f059e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1aa800640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f033200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f05d1a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0895b0 tx=0x7fd19c00efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45327d2ad6dc58 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.399+0000 7fd18b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd18b400640 1 -- 172.21.15.7:0/4120007534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c021040 con 0x56133f039210 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd18b400640 1 -- 172.21.15.7:0/4120007534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7fd19c072d60 con 0x56133f039210 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd19c061fa0 con 0x56133f039210 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd18b400640 1 -- 172.21.15.7:0/4120007534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd19c057830 con 0x56133f039210 2024-08-19T00:40:13.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 10 client.6078 fetch_fsmap learned FSMap version 54 2024-08-19T00:40:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x56133ec6f320 con 0x56133f039210 2024-08-19T00:40:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd18b400640 1 -- 172.21.15.7:0/4120007534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c061fa0 con 0x56133f039210 2024-08-19T00:40:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd18b400640 1 -- 172.21.15.7:0/4120007534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7fd19c071120 con 0x56133f039210 2024-08-19T00:40:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 10 client.6078 fetch_fsmap finished waiting for FSMap version 54 2024-08-19T00:40:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 10 client.6078 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-08-19T00:40:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 20 client.6078 populate_metadata read hostname 'smithi007' 2024-08-19T00:40:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f0610c0 0x56133f0614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 4 client.6078 mds_command: new command op to 6003 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:40:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.400+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 --> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56133efa93a0 con 0x56133f0610c0 2024-08-19T00:40:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.401+0000 7fd1a9400640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f0610c0 0x56133f0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.401+0000 7fd1a9400640 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f0610c0 0x56133f0614d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a89f78765d47 server_cookie=3e50da8963344b77 in_seq=0 out_seq=0 2024-08-19T00:40:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.401+0000 7fd18b400640 10 client.6078 ms_handle_connect on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.402+0000 7fd18b400640 1 -- 172.21.15.7:0/4120007534 <== mds.0 v2:172.21.15.7:6834/2987342349 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56133efa93a0 con 0x56133f0610c0 2024-08-19T00:40:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.402+0000 7fd18b400640 10 client.6078 handle_command_reply: tid=0 2024-08-19T00:40:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.402+0000 7fd1b3e63740 1 client.6078 shutdown 2024-08-19T00:40:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 msgr2=0x56133f05d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f05d1a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0895b0 tx=0x7fd19c00efd0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 shutdown_connections 2024-08-19T00:40:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f0610c0 0x56133f0614d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f033200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f03a9a0 0x56133f059e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/4120007534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f05d1a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 >> 172.21.15.7:0/4120007534 conn(0x56133f0369d0 msgr2=0x56133f081390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd18b400640 0 client.6078 ms_handle_reset on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:13.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 shutdown_connections 2024-08-19T00:40:13.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 1 -- 172.21.15.7:0/4120007534 wait complete. 2024-08-19T00:40:13.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.403+0000 7fd1b3e63740 20 client.6078 trim_cache size 0 max 16384 2024-08-19T00:40:13.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.410+0000 7ff246400640 1 Processor -- start 2024-08-19T00:40:13.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.410+0000 7ff246400640 1 -- start start 2024-08-19T00:40:13.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.411+0000 7ff246400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff2400739d0 0x7ff24006da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.411+0000 7ff246400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff240072b90 0x7ff2400cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.411+0000 7ff246400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff24006dfe0 con 0x7ff2400cce30 2024-08-19T00:40:13.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.411+0000 7ff246400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff240162e30 con 0x7ff240072b90 2024-08-19T00:40:13.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.411+0000 7ff246400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff2400cd280 con 0x7ff2400739d0 2024-08-19T00:40:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff240072b90 0x7ff2400cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff2400739d0 0x7ff24006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff2400739d0 0x7ff24006da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:35886/0 (socket says 172.21.15.7:35886) 2024-08-19T00:40:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23f400640 1 -- 172.21.15.7:0/85544378 learned_addr learned my addr 172.21.15.7:0/85544378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff240072b90 0x7ff2400cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59828/0 (socket says 172.21.15.7:59828) 2024-08-19T00:40:13.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23f400640 1 -- 172.21.15.7:0/85544378 >> v2:172.21.15.7:3300/0 conn(0x7ff240072b90 msgr2=0x7ff2400cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23f400640 1 --2- 172.21.15.7:0/85544378 >> v2:172.21.15.7:3300/0 conn(0x7ff240072b90 0x7ff2400cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23f400640 1 -- 172.21.15.7:0/85544378 >> v1:172.21.15.162:6789/0 conn(0x7ff2400cce30 legacy=0x7ff2401664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.412+0000 7ff23f400640 1 -- 172.21.15.7:0/85544378 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24006e2c0 con 0x7ff2400739d0 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.413+0000 7ff23f400640 1 --2- 172.21.15.7:0/85544378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400739d0 0x7ff24006da00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff240063290 tx=0x7ff23002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7761552ad0b96221 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff23e000640 1 -- 172.21.15.7:0/85544378 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230037070 con 0x7ff2400739d0 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff23e000640 1 -- 172.21.15.7:0/85544378 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230032440 con 0x7ff2400739d0 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff23e000640 1 -- 172.21.15.7:0/85544378 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230032810 con 0x7ff2400739d0 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 -- 172.21.15.7:0/85544378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400739d0 msgr2=0x7ff24006da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 --2- 172.21.15.7:0/85544378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400739d0 0x7ff24006da00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff240063290 tx=0x7ff23002a270 comp rx=0 tx=0).stop 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 -- 172.21.15.7:0/85544378 shutdown_connections 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 --2- 172.21.15.7:0/85544378 >> v2:172.21.15.7:3300/0 conn(0x7ff240072b90 0x7ff2400cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 --2- 172.21.15.7:0/85544378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400739d0 0x7ff24006da00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 -- 172.21.15.7:0/85544378 >> 172.21.15.7:0/85544378 conn(0x7ff2400b1d10 msgr2=0x7ff2400b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 -- 172.21.15.7:0/85544378 shutdown_connections 2024-08-19T00:40:13.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.414+0000 7ff246400640 1 -- 172.21.15.7:0/85544378 wait complete. 2024-08-19T00:40:13.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.416+0000 7ff246400640 1 Processor -- start 2024-08-19T00:40:13.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.416+0000 7ff246400640 1 -- start start 2024-08-19T00:40:13.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.417+0000 7ff246400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff240072b90 0x7ff240150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.417+0000 7ff246400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2400739d0 0x7ff24015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.417+0000 7ff246400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400cce30 0x7ff2401600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.417+0000 7ff246400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff24006e880 con 0x7ff2400739d0 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.417+0000 7ff246400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff24006e5a0 con 0x7ff2400cce30 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.417+0000 7ff246400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff24006f680 con 0x7ff240072b90 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2400739d0 0x7ff24015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff240072b90 0x7ff240150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff240072b90 0x7ff240150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:48944/0 (socket says 172.21.15.7:48944) 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 -- 172.21.15.7:0/2166629296 learned_addr learned my addr 172.21.15.7:0/2166629296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23fe00640 1 --2- 172.21.15.7:0/2166629296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400cce30 0x7ff2401600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 -- 172.21.15.7:0/2166629296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400cce30 msgr2=0x7ff2401600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 --2- 172.21.15.7:0/2166629296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2400cce30 0x7ff2401600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 -- 172.21.15.7:0/2166629296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2400739d0 msgr2=0x7ff24015fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 --2- 172.21.15.7:0/2166629296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2400739d0 0x7ff24015fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.418+0000 7ff23f400640 1 -- 172.21.15.7:0/2166629296 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff240150dd0 con 0x7ff240072b90 2024-08-19T00:40:13.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.419+0000 7ff23f400640 1 --2- 172.21.15.7:0/2166629296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff240072b90 0x7ff240150890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff230000c00 tx=0x7ff2300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.419+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230037040 con 0x7ff240072b90 2024-08-19T00:40:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.419+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230042070 con 0x7ff240072b90 2024-08-19T00:40:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.419+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230030880 con 0x7ff240072b90 2024-08-19T00:40:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.419+0000 7ff246400640 1 -- 172.21.15.7:0/2166629296 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24015ef10 con 0x7ff240072b90 2024-08-19T00:40:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.420+0000 7ff246400640 1 -- 172.21.15.7:0/2166629296 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24014e440 con 0x7ff240072b90 2024-08-19T00:40:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.420+0000 7ff234c00640 1 -- 172.21.15.7:0/2166629296 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "status"} v 0) -- 0x7ff2400cc8f0 con 0x7ff240072b90 2024-08-19T00:40:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.421+0000 7fd1b3e63740 1 Processor -- start 2024-08-19T00:40:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.421+0000 7fd1b3e63740 1 -- start start 2024-08-19T00:40:13.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff230030a20 con 0x7ff240072b90 2024-08-19T00:40:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f032dc0 0x56133f0a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f08c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f08cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac200b20 con 0x56133f039210 2024-08-19T00:40:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac1ffb40 con 0x56133f03a9a0 2024-08-19T00:40:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac1fef80 con 0x56133f032dc0 2024-08-19T00:40:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.422+0000 7fd1a9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f08c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f032dc0 0x56133f0a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f032dc0 0x56133f0a20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:48960/0 (socket says 172.21.15.7:48960) 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 -- 172.21.15.7:0/2376771444 learned_addr learned my addr 172.21.15.7:0/2376771444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1aa800640 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f08cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 -- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 msgr2=0x56133f08cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f08cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 -- 172.21.15.7:0/2376771444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 msgr2=0x56133f08c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f08c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 -- 172.21.15.7:0/2376771444 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56133f082350 con 0x56133f032dc0 2024-08-19T00:40:13.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7ff237400640 1 --2- 172.21.15.7:0/2166629296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff22006be80 0x7ff22006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7ff2300ac180 con 0x7ff240072b90 2024-08-19T00:40:13.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.423+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f032dc0 0x56133f0a20d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd19c055df0 tx=0x7fd19c06f070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7858aa9b28f0a724 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7ff23ea00640 1 --2- 172.21.15.7:0/2166629296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff22006be80 0x7ff22006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7fd196000640 1 -- 172.21.15.7:0/2376771444 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c021070 con 0x56133f032dc0 2024-08-19T00:40:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+513 (secure 0 0 0) 0x7ff2300ac550 con 0x7ff240072b90 2024-08-19T00:40:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7fd196000640 1 -- 172.21.15.7:0/2376771444 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c071120 con 0x56133f032dc0 2024-08-19T00:40:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7fd196000640 1 -- 172.21.15.7:0/2376771444 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c058ba0 con 0x56133f032dc0 2024-08-19T00:40:13.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7ff234c00640 1 -- 172.21.15.7:0/2166629296 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({log-info=0+}) -- 0x7ff2400af4d0 con 0x7ff240072b90 2024-08-19T00:40:13.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 7 ==== log(1 entries from seq 656 at 2024-08-19T00:40:12.722512+0000) ==== 308+0+0 (secure 0 0 0) 0x7ff230078440 con 0x7ff240072b90 2024-08-19T00:40:13.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.424+0000 7ff23ea00640 1 --2- 172.21.15.7:0/2166629296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff22006be80 0x7ff22006e340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff240151130 tx=0x7ff22c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 -- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f032dc0 msgr2=0x56133f0a20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f032dc0 0x56133f0a20d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd19c055df0 tx=0x7fd19c06f070 comp rx=0 tx=0).stop 2024-08-19T00:40:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 -- 172.21.15.7:0/2376771444 shutdown_connections 2024-08-19T00:40:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f03a9a0 0x56133f08cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f039210 0x56133f08c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/2376771444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f032dc0 0x56133f0a20d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 -- 172.21.15.7:0/2376771444 >> 172.21.15.7:0/2376771444 conn(0x56133f0369d0 msgr2=0x56133f02f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 -- 172.21.15.7:0/2376771444 shutdown_connections 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 -- 172.21.15.7:0/2376771444 wait complete. 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.425+0000 7fd1b3e63740 1 -- start start 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.426+0000 7fd1b3e63740 1 Processor -- start 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f0ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f039210 0x56133f0a1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1b3e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f03a9a0 0x56133f0a1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac1ff4f0 con 0x56133f03a9a0 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56133efa93a0 con 0x56133f032dc0 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1b3e63740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56133f094c90 con 0x56133f039210 2024-08-19T00:40:13.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1b3e63740 10 client.0 _ll_register_callbacks cb 0x7fd19c071070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f03a9a0 0x56133f0a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f03a9a0 0x56133f0a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59858/0 (socket says 172.21.15.7:59858) 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 -- 172.21.15.7:0/3613639029 learned_addr learned my addr 172.21.15.7:0/3613639029 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f0ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1a9400640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f039210 0x56133f0a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f039210 msgr2=0x56133f0a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56133f039210 0x56133f0a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 msgr2=0x56133f0ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133f032dc0 0x56133f0ff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.427+0000 7fd1aa800640 1 -- 172.21.15.7:0/3613639029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56133f0986d0 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd1aa800640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56133f03a9a0 0x56133f0a1750 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4015740 tx=0x7fd1a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7096102555a5972 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd18b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd18b400640 1 -- 172.21.15.7:0/3613639029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4031060 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd18b400640 1 -- 172.21.15.7:0/3613639029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7fd1a40237c0 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3613639029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd19c071120 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd18b400640 1 -- 172.21.15.7:0/3613639029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd1a40239c0 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd1b3e63740 10 client.6090 fetch_fsmap learned FSMap version 54 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.428+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3613639029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x56133f033b90 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd18b400640 1 -- 172.21.15.7:0/3613639029 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c071120 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd18b400640 1 -- 172.21.15.7:0/3613639029 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7fd1a4020040 con 0x56133f03a9a0 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd1b3e63740 10 client.6090 fetch_fsmap finished waiting for FSMap version 54 2024-08-19T00:40:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd1b3e63740 10 client.6090 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-08-19T00:40:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd1b3e63740 20 client.6090 populate_metadata read hostname 'smithi007' 2024-08-19T00:40:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd1b3e63740 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd1b3e63740 4 client.6090 mds_command: new command op to 6003 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:40:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd1b3e63740 1 -- 172.21.15.7:0/3613639029 --> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56133efa36f0 con 0x56133f081540 2024-08-19T00:40:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.429+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.430+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a89dae986def3bbb server_cookie=bd75dd07942fcbd8 in_seq=0 out_seq=0 2024-08-19T00:40:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.430+0000 7fd18b400640 10 client.6090 ms_handle_connect on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:13.438 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:40:13.433+0000 7fe6c3c00640 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x563fdc8a7180] 2024-08-19T00:40:13.438 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:40:13.433+0000 7fe6c3c00640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x563fdc8a7180] 2024-08-19T00:40:13.438 INFO:tasks.ceph.mds.a.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7fe6c3c00640 time 2024-08-19T00:40:13.434926+0000 2024-08-19T00:40:13.438 INFO:tasks.ceph.mds.a.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:40:13.438 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7fe6d2f83417] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.439 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:40:13.434+0000 7fe6c3c00640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7fe6c3c00640 time 2024-08-19T00:40:13.434926+0000 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.440 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7fe6d2f83417] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.441 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.442 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr:*** Caught signal (Aborted) ** 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: in thread 7fe6c3c00640 thread_name:MR_Finisher 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6d263e6f0] 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6d268b94c] 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: raise() 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: abort() 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fe6d2f834d4] 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.443 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.444 INFO:tasks.ceph.mds.a.smithi007.stderr: 21: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 22: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:40:13.435+0000 7fe6c3c00640 -1 *** Caught signal (Aborted) ** 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: in thread 7fe6c3c00640 thread_name:MR_Finisher 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6d263e6f0] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6d268b94c] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: raise() 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: abort() 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fe6d2f834d4] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.445 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 21: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.446 INFO:tasks.ceph.mds.a.smithi007.stderr: 22: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.447 INFO:tasks.ceph.mds.a.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-19T00:40:13.447 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.448 INFO:teuthology.orchestra.run.smithi007.stdout:{"mds_beacon_grace":"15.000000"} 2024-08-19T00:40:13.448 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-08-19T00:40:13.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:13.449 INFO:tasks.ceph.mds.a.smithi007.stderr: -167> 2024-08-19T00:40:12.286+0000 7fe6c8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:40:13.449 INFO:tasks.ceph.mds.a.smithi007.stderr: -11> 2024-08-19T00:40:13.433+0000 7fe6c3c00640 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x563fdc8a7180] 2024-08-19T00:40:13.449 INFO:tasks.ceph.mds.a.smithi007.stderr: -9> 2024-08-19T00:40:13.433+0000 7fe6c3c00640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x563fdc8a7180] 2024-08-19T00:40:13.450 INFO:tasks.ceph.mds.a.smithi007.stderr: -3> 2024-08-19T00:40:13.434+0000 7fe6c3c00640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7fe6c3c00640 time 2024-08-19T00:40:13.434926+0000 2024-08-19T00:40:13.450 INFO:tasks.ceph.mds.a.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:40:13.450 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.450 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.450 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7fe6d2f83417] 2024-08-19T00:40:13.450 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.450 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.454 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.455 INFO:tasks.ceph.mds.a.smithi007.stderr: 0> 2024-08-19T00:40:13.435+0000 7fe6c3c00640 -1 *** Caught signal (Aborted) ** 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: in thread 7fe6c3c00640 thread_name:MR_Finisher 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6d263e6f0] 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6d268b94c] 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: raise() 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: abort() 2024-08-19T00:40:13.456 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fe6d2f834d4] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.457 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 21: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 22: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-19T00:40:13.458 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.459 INFO:tasks.ceph.mds.a.smithi007.stderr: -167> 2024-08-19T00:40:12.286+0000 7fe6c8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:40:13.459 INFO:tasks.ceph.mds.a.smithi007.stderr: -11> 2024-08-19T00:40:13.433+0000 7fe6c3c00640 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x563fdc8a7180] 2024-08-19T00:40:13.459 INFO:tasks.ceph.mds.a.smithi007.stderr: -9> 2024-08-19T00:40:13.433+0000 7fe6c3c00640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x563fdc8a7180] 2024-08-19T00:40:13.459 INFO:tasks.ceph.mds.a.smithi007.stderr: -3> 2024-08-19T00:40:13.434+0000 7fe6c3c00640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7fe6c3c00640 time 2024-08-19T00:40:13.434926+0000 2024-08-19T00:40:13.459 INFO:tasks.ceph.mds.a.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7fe6d2f83417] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.460 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: 0> 2024-08-19T00:40:13.435+0000 7fe6c3c00640 -1 *** Caught signal (Aborted) ** 2024-08-19T00:40:13.461 INFO:tasks.ceph.mds.a.smithi007.stderr: in thread 7fe6c3c00640 thread_name:MR_Finisher 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6d263e6f0] 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6d268b94c] 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 3: raise() 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 4: abort() 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fe6d2f834d4] 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x563fa40002c1] 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x563fa422b3f4] 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 8: ceph-mds(+0x3cd25c) [0x563fa424525c] 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 9: (CDir::_omap_commit(int)+0x93a) [0x563fa4246b8a] 2024-08-19T00:40:13.462 INFO:tasks.ceph.mds.a.smithi007.stderr: 10: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x265) [0x563fa4248165] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 11: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xaf7) [0x563fa404d417] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 12: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563fa42cc432] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 13: (MDLog::trim_all()+0x769) [0x563fa42cf2f9] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 14: ceph-mds(+0x1bfd71) [0x563fa4037d71] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 15: ceph-mds(+0x16032d) [0x563fa3fd832d] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 16: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 17: ceph-mds(+0x1605f2) [0x563fa3fd85f2] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 18: (MDSContext::complete(int)+0x5c) [0x563fa42c484c] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 19: (MDSIOContextBase::complete(int)+0x31c) [0x563fa42c4c9c] 2024-08-19T00:40:13.463 INFO:tasks.ceph.mds.a.smithi007.stderr: 20: (Finisher::finisher_thread_entry()+0x175) [0x7fe6d3041a65] 2024-08-19T00:40:13.465 INFO:tasks.ceph.mds.a.smithi007.stderr: 21: /lib64/libc.so.6(+0x89c02) [0x7fe6d2689c02] 2024-08-19T00:40:13.465 INFO:tasks.ceph.mds.a.smithi007.stderr: 22: /lib64/libc.so.6(+0x10ec40) [0x7fe6d270ec40] 2024-08-19T00:40:13.465 INFO:tasks.ceph.mds.a.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-19T00:40:13.465 INFO:tasks.ceph.mds.a.smithi007.stderr: 2024-08-19T00:40:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.528+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:40:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.528+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:40:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.528+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:40:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.529+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-08-19T00:40:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.529+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.529+0000 7fd18b400640 1 client.6090 ms_handle_refused on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.529+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=15 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:40:13.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.614+0000 7efdd6600640 1 Processor -- start 2024-08-19T00:40:13.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.614+0000 7efdd6600640 1 -- start start 2024-08-19T00:40:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.615+0000 7efdd6600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efdd006e710 0x7efdd0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.615+0000 7efdd6600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd00cdfb0 con 0x7efdd00d03c0 2024-08-19T00:40:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.615+0000 7efdd6600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd00ce290 con 0x7efdd00b3750 2024-08-19T00:40:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.615+0000 7efdd6600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efdd00cebc0 con 0x7efdd006e710 2024-08-19T00:40:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdcf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efdd00d03c0 0x7efdd00d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56664/0 (socket says 172.21.15.7:56664) 2024-08-19T00:40:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdcf400640 1 -- 172.21.15.7:0/3681255385 learned_addr learned my addr 172.21.15.7:0/3681255385 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdc7e00640 1 --2- 172.21.15.7:0/3681255385 >> v2:172.21.15.162:3300/0 conn(0x7efdd006e710 0x7efdd0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdcea00640 1 -- 172.21.15.7:0/3681255385 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967936093 0 0) 0x7efdd00cdfb0 con 0x7efdd00d03c0 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdcea00640 1 -- 172.21.15.7:0/3681255385 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdb4003520 con 0x7efdd00d03c0 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdcea00640 1 -- 172.21.15.7:0/3681255385 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111549033 0 0) 0x7efdd00ce290 con 0x7efdd00b3750 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdcea00640 1 -- 172.21.15.7:0/3681255385 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdd00cdfb0 con 0x7efdd00b3750 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdc7e00640 1 -- 172.21.15.7:0/3681255385 >> v1:172.21.15.162:6789/0 conn(0x7efdd00b3750 legacy=0x7efdd00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdc7e00640 1 -- 172.21.15.7:0/3681255385 >> v1:172.21.15.7:6789/0 conn(0x7efdd00d03c0 legacy=0x7efdd00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.616+0000 7efdc7e00640 1 -- 172.21.15.7:0/3681255385 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd00ce570 con 0x7efdd006e710 2024-08-19T00:40:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.617+0000 7efdc7e00640 1 --2- 172.21.15.7:0/3681255385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 0x7efdd0071980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097d0 tx=0x7efdb802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e47c5b05ae8c6d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdcea00640 1 -- 172.21.15.7:0/3681255385 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8037070 con 0x7efdd006e710 2024-08-19T00:40:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdcea00640 1 -- 172.21.15.7:0/3681255385 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb8032440 con 0x7efdd006e710 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdcea00640 1 -- 172.21.15.7:0/3681255385 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8032810 con 0x7efdd006e710 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdd6600640 1 -- 172.21.15.7:0/3681255385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 msgr2=0x7efdd0071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdd6600640 1 --2- 172.21.15.7:0/3681255385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 0x7efdd0071980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097d0 tx=0x7efdb802a250 comp rx=0 tx=0).stop 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdd6600640 1 -- 172.21.15.7:0/3681255385 shutdown_connections 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdd6600640 1 --2- 172.21.15.7:0/3681255385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 0x7efdd0071980 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdd6600640 1 -- 172.21.15.7:0/3681255385 >> 172.21.15.7:0/3681255385 conn(0x7efdd006bc70 msgr2=0x7efdd006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdd6600640 1 -- 172.21.15.7:0/3681255385 shutdown_connections 2024-08-19T00:40:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.618+0000 7efdd6600640 1 -- 172.21.15.7:0/3681255385 wait complete. 2024-08-19T00:40:13.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.620+0000 7efdd6600640 1 Processor -- start 2024-08-19T00:40:13.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.620+0000 7efdd6600640 1 -- start start 2024-08-19T00:40:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.621+0000 7efdd6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 0x7efdd01f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.621+0000 7efdd6600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdd00b3750 0x7efdd006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.621+0000 7efdd6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd00d03c0 0x7efdd006df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.621+0000 7efdd6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0073c60 con 0x7efdd00d03c0 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.621+0000 7efdd6600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0073ae0 con 0x7efdd006e710 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.621+0000 7efdd6600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efdd00b3be0 con 0x7efdd00b3750 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.621+0000 7efdcfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd00d03c0 0x7efdd006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd00d03c0 0x7efdd006df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59860/0 (socket says 172.21.15.7:59860) 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 -- 172.21.15.7:0/2572389534 learned_addr learned my addr 172.21.15.7:0/2572389534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdc7e00640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdd00b3750 0x7efdd006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcf400640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 0x7efdd01f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 -- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdd00b3750 msgr2=0x7efdd006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdd00b3750 0x7efdd006d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 -- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 msgr2=0x7efdd01f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 0x7efdd01f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 -- 172.21.15.7:0/2572389534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd01f4aa0 con 0x7efdd00d03c0 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdcfe00640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd00d03c0 0x7efdd006df20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c790 tx=0x7efdc800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.622+0000 7efdc7400640 1 -- 172.21.15.7:0/2572389534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8003b70 con 0x7efdd00d03c0 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.623+0000 7efdc7400640 1 -- 172.21.15.7:0/2572389534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8003d10 con 0x7efdd00d03c0 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.623+0000 7efdc7400640 1 -- 172.21.15.7:0/2572389534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc800aa50 con 0x7efdd00d03c0 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.623+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd01f4d80 con 0x7efdd00d03c0 2024-08-19T00:40:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.623+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd01f5060 con 0x7efdd00d03c0 2024-08-19T00:40:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.624+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd00ce290 con 0x7efdd00d03c0 2024-08-19T00:40:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.625+0000 7efdc7400640 1 -- 172.21.15.7:0/2572389534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdc800abf0 con 0x7efdd00d03c0 2024-08-19T00:40:13.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.626+0000 7efdc7400640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efdac06be30 0x7efdac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:13.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.626+0000 7efdc7400640 1 -- 172.21.15.7:0/2572389534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7efdc808ad80 con 0x7efdd00d03c0 2024-08-19T00:40:13.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.626+0000 7efdcf400640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efdac06be30 0x7efdac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:13.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.627+0000 7efdcf400640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efdac06be30 0x7efdac06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efdc00011e0 tx=0x7efdc0007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:13.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.631+0000 7efdc7400640 1 -- 172.21.15.7:0/2572389534 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efdc8059040 con 0x7efdd00d03c0 2024-08-19T00:40:13.707 INFO:tasks.ceph.mds.a.smithi007.stderr:daemon-helper: command crashed with signal 6 2024-08-19T00:40:13.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.730+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:13.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.730+0000 7fd18b400640 1 client.6090 ms_handle_refused on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:13.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.730+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=15 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:40:13.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.855+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdd00b0090 con 0x7efdd00d03c0 2024-08-19T00:40:13.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.856+0000 7efdc7400640 1 -- 172.21.15.7:0/2572389534 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5221 (secure 0 0 0) 0x7efdc805d340 con 0x7efdd00d03c0 2024-08-19T00:40:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:13.859 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":54,"btime":"2024-08-19T00:40:13:187552+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:12.722631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6003,"qdb_cluster":[6003]},"id":4}]} 2024-08-19T00:40:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 54 2024-08-19T00:40:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efdac06be30 msgr2=0x7efdac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efdac06be30 0x7efdac06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efdc00011e0 tx=0x7efdc0007d30 comp rx=0 tx=0).stop 2024-08-19T00:40:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd00d03c0 msgr2=0x7efdd006df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd00d03c0 0x7efdd006df20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c790 tx=0x7efdc800cc50 comp rx=0 tx=0).stop 2024-08-19T00:40:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 shutdown_connections 2024-08-19T00:40:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efdac06be30 0x7efdac06e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdd00d03c0 0x7efdd006df20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdd00b3750 0x7efdd006d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 --2- 172.21.15.7:0/2572389534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdd006e710 0x7efdd01f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.858+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 >> 172.21.15.7:0/2572389534 conn(0x7efdd006bc70 msgr2=0x7efdd00acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.859+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 shutdown_connections 2024-08-19T00:40:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:13.859+0000 7efdd6600640 1 -- 172.21.15.7:0/2572389534 wait complete. 2024-08-19T00:40:13.878 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-19T00:40:14.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:14.131+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:14.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:14.131+0000 7fd18b400640 1 client.6090 ms_handle_refused on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:14.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:14.131+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=15 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T00:40:14.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:14.200+0000 7ff237400640 1 -- 172.21.15.7:0/2166629296 <== mon.2 v2:172.21.15.162:3301/0 8 ==== log(2 entries from seq 657 at 2024-08-19T00:40:13.194501+0000) ==== 634+0+0 (secure 0 0 0) 0x7ff2300786a0 con 0x7ff240072b90 2024-08-19T00:40:14.203 INFO:teuthology.orchestra.run.smithi007.stdout: cluster: 2024-08-19T00:40:14.203 INFO:teuthology.orchestra.run.smithi007.stdout: id: bd35d026-e259-45a6-99d5-e8ea5afa8a60 2024-08-19T00:40:14.203 INFO:teuthology.orchestra.run.smithi007.stdout: health: HEALTH_OK 2024-08-19T00:40:14.203 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: services: 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: mgr: y(active, since 3m), standbys: x 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: mds: 1/1 daemons up, 3 standby 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: data: 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: volumes: 1/1 healthy 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: pools: 3 pools, 97 pgs 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: objects: 29 objects, 602 KiB 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: usage: 238 MiB used, 720 GiB / 720 GiB avail 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: pgs: 97 active+clean 2024-08-19T00:40:14.204 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:14.205 INFO:teuthology.orchestra.run.smithi007.stdout: io: 2024-08-19T00:40:14.205 INFO:teuthology.orchestra.run.smithi007.stdout: client: 9.2 KiB/s rd, 715 B/s wr, 7 op/s rd, 0 op/s wr 2024-08-19T00:40:14.205 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:14.205 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:14.205 INFO:teuthology.orchestra.run.smithi007.stdout:2024-08-19T00:40:13.434881+0000 mds.a [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x563fdc8a7180] 2024-08-19T00:40:14.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:14.932+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:14.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:14.932+0000 7fd18b400640 1 client.6090 ms_handle_refused on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:14.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:14.932+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=15 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T00:40:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:16.533+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:16.533+0000 7fd18b400640 1 client.6090 ms_handle_refused on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:16.533+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=15 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-08-19T00:40:17.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-08-19T00:40:18.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:19.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.044+0000 7f7c3d600640 1 Processor -- start 2024-08-19T00:40:19.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.044+0000 7f7c3d600640 1 -- start start 2024-08-19T00:40:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.045+0000 7f7c3d600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b4ab0 0x7f7c3806c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.045+0000 7f7c3d600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c380b3860 0x7f7c3806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.045+0000 7f7c3d600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c38162bf0 con 0x7f7c38147b80 2024-08-19T00:40:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.045+0000 7f7c3d600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7c380cd740 con 0x7f7c380b3860 2024-08-19T00:40:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.045+0000 7f7c3d600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c38161d00 con 0x7f7c380b4ab0 2024-08-19T00:40:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c3cc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c380b3860 0x7f7c3806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:19.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c3cc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c380b3860 0x7f7c3806ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37002/0 (socket says 172.21.15.7:37002) 2024-08-19T00:40:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c3cc00640 1 -- 172.21.15.7:0/622028812 learned_addr learned my addr 172.21.15.7:0/622028812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c37400640 1 --2- 172.21.15.7:0/622028812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b4ab0 0x7f7c3806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c3cc00640 1 -- 172.21.15.7:0/622028812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b4ab0 msgr2=0x7f7c3806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:19.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c3cc00640 1 --2- 172.21.15.7:0/622028812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b4ab0 0x7f7c3806c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c3cc00640 1 -- 172.21.15.7:0/622028812 >> v1:172.21.15.162:6789/0 conn(0x7f7c38147b80 legacy=0x7f7c380b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.046+0000 7f7c3cc00640 1 -- 172.21.15.7:0/622028812 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c38161fe0 con 0x7f7c380b3860 2024-08-19T00:40:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.047+0000 7f7c3cc00640 1 --2- 172.21.15.7:0/622028812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c380b3860 0x7f7c3806ffe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009e80 tx=0x7f7c3002a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3affa2445deeb51e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.047+0000 7f7c36a00640 1 -- 172.21.15.7:0/622028812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30036070 con 0x7f7c380b3860 2024-08-19T00:40:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.047+0000 7f7c36a00640 1 -- 172.21.15.7:0/622028812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c30031600 con 0x7f7c380b3860 2024-08-19T00:40:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.047+0000 7f7c36a00640 1 -- 172.21.15.7:0/622028812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c300319d0 con 0x7f7c380b3860 2024-08-19T00:40:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 -- 172.21.15.7:0/622028812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c380b3860 msgr2=0x7f7c3806ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 --2- 172.21.15.7:0/622028812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c380b3860 0x7f7c3806ffe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009e80 tx=0x7f7c3002a740 comp rx=0 tx=0).stop 2024-08-19T00:40:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 -- 172.21.15.7:0/622028812 shutdown_connections 2024-08-19T00:40:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 --2- 172.21.15.7:0/622028812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c380b3860 0x7f7c3806ffe0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 --2- 172.21.15.7:0/622028812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b4ab0 0x7f7c3806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 -- 172.21.15.7:0/622028812 >> 172.21.15.7:0/622028812 conn(0x7f7c380b2d70 msgr2=0x7f7c380b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 -- 172.21.15.7:0/622028812 shutdown_connections 2024-08-19T00:40:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.048+0000 7f7c3d600640 1 -- 172.21.15.7:0/622028812 wait complete. 2024-08-19T00:40:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.050+0000 7f7c3d600640 1 Processor -- start 2024-08-19T00:40:19.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.050+0000 7f7c3d600640 1 -- start start 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3d600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b3860 0x7f7c3813ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c380b4ab0 0x7f7c3813e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c38147b80 0x7f7c3815e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38162880 con 0x7f7c38147b80 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3d600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c381625a0 con 0x7f7c380b4ab0 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3d600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c38070520 con 0x7f7c380b3860 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c38147b80 0x7f7c3815e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c38147b80 0x7f7c3815e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37004/0 (socket says 172.21.15.7:37004) 2024-08-19T00:40:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 -- 172.21.15.7:0/847489623 learned_addr learned my addr 172.21.15.7:0/847489623 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c37400640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c380b4ab0 0x7f7c3813e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c37e00640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b3860 0x7f7c3813ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 -- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b3860 msgr2=0x7f7c3813ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b3860 0x7f7c3813ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 -- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c380b4ab0 msgr2=0x7f7c3813e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c380b4ab0 0x7f7c3813e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.051+0000 7f7c3cc00640 1 -- 172.21.15.7:0/847489623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c380aeb10 con 0x7f7c38147b80 2024-08-19T00:40:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.052+0000 7f7c3cc00640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c38147b80 0x7f7c3815e350 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7c30034040 tx=0x7f7c30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.052+0000 7f7c2fe00640 1 -- 172.21.15.7:0/847489623 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30036050 con 0x7f7c38147b80 2024-08-19T00:40:19.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.052+0000 7f7c2fe00640 1 -- 172.21.15.7:0/847489623 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c30042070 con 0x7f7c38147b80 2024-08-19T00:40:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.052+0000 7f7c2fe00640 1 -- 172.21.15.7:0/847489623 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30009510 con 0x7f7c38147b80 2024-08-19T00:40:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.052+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c380aedf0 con 0x7f7c38147b80 2024-08-19T00:40:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.052+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c380af3b0 con 0x7f7c38147b80 2024-08-19T00:40:19.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.053+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3806ffe0 con 0x7f7c38147b80 2024-08-19T00:40:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.054+0000 7f7c2fe00640 1 -- 172.21.15.7:0/847489623 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c30007bd0 con 0x7f7c38147b80 2024-08-19T00:40:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.055+0000 7f7c2fe00640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c1806be30 0x7f7c1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.055+0000 7f7c2fe00640 1 -- 172.21.15.7:0/847489623 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f7c300abc00 con 0x7f7c38147b80 2024-08-19T00:40:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.055+0000 7f7c37e00640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c1806be30 0x7f7c1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:19.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.056+0000 7f7c37e00640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c1806be30 0x7f7c1806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7c280016e0 tx=0x7f7c28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:19.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.060+0000 7f7c2fe00640 1 -- 172.21.15.7:0/847489623 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7c30079f50 con 0x7f7c38147b80 2024-08-19T00:40:19.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.279+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c38073b60 con 0x7f7c38147b80 2024-08-19T00:40:19.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.280+0000 7f7c2fe00640 1 -- 172.21.15.7:0/847489623 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5221 (secure 0 0 0) 0x7f7c3007e250 con 0x7f7c38147b80 2024-08-19T00:40:19.283 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:19.283 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":54,"btime":"2024-08-19T00:40:13:187552+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:12.722631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6003,"qdb_cluster":[6003]},"id":4}]} 2024-08-19T00:40:19.283 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 54 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c1806be30 msgr2=0x7f7c1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c1806be30 0x7f7c1806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7c280016e0 tx=0x7f7c28009040 comp rx=0 tx=0).stop 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c38147b80 msgr2=0x7f7c3815e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c38147b80 0x7f7c3815e350 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7c30034040 tx=0x7f7c30004a40 comp rx=0 tx=0).stop 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 shutdown_connections 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7c1806be30 0x7f7c1806e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c38147b80 0x7f7c3815e350 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c380b4ab0 0x7f7c3813e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 --2- 172.21.15.7:0/847489623 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c380b3860 0x7f7c3813ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:19.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.282+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 >> 172.21.15.7:0/847489623 conn(0x7f7c380b2d70 msgr2=0x7f7c380728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:19.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.283+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 shutdown_connections 2024-08-19T00:40:19.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.283+0000 7f7c3d600640 1 -- 172.21.15.7:0/847489623 wait complete. 2024-08-19T00:40:19.302 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-19T00:40:19.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.737+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:19.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.737+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=15 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-08-19T00:40:19.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:19.737+0000 7fd18b400640 1 client.6090 ms_handle_refused on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:24.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2024-08-19T00:40:24.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.469+0000 7fbce6400640 1 Processor -- start 2024-08-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.469+0000 7fbce6400640 1 -- start start 2024-08-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.470+0000 7fbce6400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbce00d12a0 0x7fbce0169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.470+0000 7fbce6400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce015ec30 con 0x7fbce009aa70 2024-08-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.470+0000 7fbce6400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce015ef10 con 0x7fbce009b730 2024-08-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.470+0000 7fbce6400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbce015f1f0 con 0x7fbce00d12a0 2024-08-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.471+0000 7fbcdf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbce009aa70 0x7fbce009ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60596/0 (socket says 172.21.15.7:60596) 2024-08-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.471+0000 7fbcdf400640 1 -- 172.21.15.7:0/2108371127 learned_addr learned my addr 172.21.15.7:0/2108371127 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.471+0000 7fbcdfe00640 1 --2- 172.21.15.7:0/2108371127 >> v2:172.21.15.7:3300/0 conn(0x7fbce00d12a0 0x7fbce0169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.471+0000 7fbcdfe00640 1 -- 172.21.15.7:0/2108371127 >> v1:172.21.15.162:6789/0 conn(0x7fbce009b730 legacy=0x7fbce006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.471+0000 7fbcdfe00640 1 -- 172.21.15.7:0/2108371127 >> v1:172.21.15.7:6789/0 conn(0x7fbce009aa70 legacy=0x7fbce009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.471+0000 7fbcdfe00640 1 -- 172.21.15.7:0/2108371127 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce015f4d0 con 0x7fbce00d12a0 2024-08-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.472+0000 7fbcdfe00640 1 --2- 172.21.15.7:0/2108371127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce0169290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009d90 tx=0x7fbcd802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecd5126d7e1c1b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.472+0000 7fbcde000640 1 -- 172.21.15.7:0/2108371127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8007740 con 0x7fbce00d12a0 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.472+0000 7fbcde000640 1 -- 172.21.15.7:0/2108371127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd80078e0 con 0x7fbce00d12a0 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.472+0000 7fbcde000640 1 -- 172.21.15.7:0/2108371127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8007cb0 con 0x7fbce00d12a0 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.473+0000 7fbce6400640 1 -- 172.21.15.7:0/2108371127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 msgr2=0x7fbce0169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.473+0000 7fbce6400640 1 --2- 172.21.15.7:0/2108371127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce0169290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009d90 tx=0x7fbcd802a6f0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.473+0000 7fbce6400640 1 -- 172.21.15.7:0/2108371127 shutdown_connections 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.473+0000 7fbce6400640 1 --2- 172.21.15.7:0/2108371127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce0169290 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.473+0000 7fbce6400640 1 -- 172.21.15.7:0/2108371127 >> 172.21.15.7:0/2108371127 conn(0x7fbce00d2190 msgr2=0x7fbce00d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.473+0000 7fbce6400640 1 -- 172.21.15.7:0/2108371127 shutdown_connections 2024-08-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.473+0000 7fbce6400640 1 -- 172.21.15.7:0/2108371127 wait complete. 2024-08-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.475+0000 7fbce6400640 1 Processor -- start 2024-08-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.475+0000 7fbce6400640 1 -- start start 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbce6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce009aa70 0x7fbce0148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbce6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbce009b730 0x7fbce014b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbce6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbce6400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0169950 con 0x7fbce00d12a0 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbce6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbce01697d0 con 0x7fbce009aa70 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbce6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbce0169ad0 con 0x7fbce009b730 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48692/0 (socket says 172.21.15.7:48692) 2024-08-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 -- 172.21.15.7:0/2983843686 learned_addr learned my addr 172.21.15.7:0/2983843686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdf400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce009aa70 0x7fbce0148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdea00640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbce009b730 0x7fbce014b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 -- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbce009b730 msgr2=0x7fbce014b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbce009b730 0x7fbce014b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 -- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce009aa70 msgr2=0x7fbce0148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce009aa70 0x7fbce0148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.476+0000 7fbcdfe00640 1 -- 172.21.15.7:0/2983843686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce014b070 con 0x7fbce00d12a0 2024-08-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.477+0000 7fbcdfe00640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce014bb20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009eb0 tx=0x7fbcd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.477+0000 7fbcd7400640 1 -- 172.21.15.7:0/2983843686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd803f070 con 0x7fbce00d12a0 2024-08-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.477+0000 7fbcd7400640 1 -- 172.21.15.7:0/2983843686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd8031c90 con 0x7fbce00d12a0 2024-08-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.477+0000 7fbcd7400640 1 -- 172.21.15.7:0/2983843686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8044680 con 0x7fbce00d12a0 2024-08-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.477+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce014e440 con 0x7fbce00d12a0 2024-08-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.477+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce0148ab0 con 0x7fbce00d12a0 2024-08-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.478+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce009ae50 con 0x7fbce00d12a0 2024-08-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.479+0000 7fbcd7400640 1 -- 172.21.15.7:0/2983843686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcd803b410 con 0x7fbce00d12a0 2024-08-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.480+0000 7fbcd7400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbcc006be30 0x7fbcc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.480+0000 7fbcd7400640 1 -- 172.21.15.7:0/2983843686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7fbcd80ac6e0 con 0x7fbce00d12a0 2024-08-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.480+0000 7fbcdf400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbcc006be30 0x7fbcc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.481+0000 7fbcdf400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbcc006be30 0x7fbcc006e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005880 tx=0x7fbcd0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.485+0000 7fbcd7400640 1 -- 172.21.15.7:0/2983843686 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbce014b070 con 0x7fbce00d12a0 2024-08-19T00:40:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.705+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbce00d2cb0 con 0x7fbce00d12a0 2024-08-19T00:40:24.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.706+0000 7fbcd7400640 1 -- 172.21.15.7:0/2983843686 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5221 (secure 0 0 0) 0x7fbcd807aa60 con 0x7fbce00d12a0 2024-08-19T00:40:24.708 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:24.708 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":54,"btime":"2024-08-19T00:40:13:187552+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:12.722631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6003,"qdb_cluster":[6003]},"id":4}]} 2024-08-19T00:40:24.709 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 54 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbcc006be30 msgr2=0x7fbcc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbcc006be30 0x7fbcc006e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005880 tx=0x7fbcd0009040 comp rx=0 tx=0).stop 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 msgr2=0x7fbce014bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce014bb20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009eb0 tx=0x7fbcd8004a40 comp rx=0 tx=0).stop 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 shutdown_connections 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbcc006be30 0x7fbcc006e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbce00d12a0 0x7fbce014bb20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbce009b730 0x7fbce014b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 --2- 172.21.15.7:0/2983843686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce009aa70 0x7fbce0148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:24.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 >> 172.21.15.7:0/2983843686 conn(0x7fbce00d2190 msgr2=0x7fbce00b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:24.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 shutdown_connections 2024-08-19T00:40:24.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:24.708+0000 7fbce6400640 1 -- 172.21.15.7:0/2983843686 wait complete. 2024-08-19T00:40:24.728 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-19T00:40:26.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:26.144+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:26.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:26.144+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-08-19T00:40:26.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:26.144+0000 7fd18b400640 1 client.6090 ms_handle_refused on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:29.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.895+0000 7f3fe9400640 1 Processor -- start 2024-08-19T00:40:29.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.895+0000 7f3fe9400640 1 -- start start 2024-08-19T00:40:29.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe9400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3fe4159bf0 0x7f3fe4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:29.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:29.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3fe40cea40 0x7f3fe40d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:29.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe9400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe406f7f0 con 0x7f3fe40cea40 2024-08-19T00:40:29.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe9400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe406f510 con 0x7f3fe4159bf0 2024-08-19T00:40:29.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe4072980 con 0x7f3fe40739a0 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3fe40cea40 0x7f3fe40d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3fe40cea40 0x7f3fe40d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48698/0 (socket says 172.21.15.7:48698) 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.896+0000 7f3fe3200640 1 -- 172.21.15.7:0/1039484487 learned_addr learned my addr 172.21.15.7:0/1039484487 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.897+0000 7f3fdbe00640 1 --2- 172.21.15.7:0/1039484487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.897+0000 7f3fe3200640 1 -- 172.21.15.7:0/1039484487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 msgr2=0x7f3fe40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.897+0000 7f3fe3200640 1 --2- 172.21.15.7:0/1039484487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe40ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.897+0000 7f3fe3200640 1 -- 172.21.15.7:0/1039484487 >> v2:172.21.15.162:3300/0 conn(0x7f3fe4159bf0 msgr2=0x7f3fe4073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.897+0000 7f3fe3200640 1 --2- 172.21.15.7:0/1039484487 >> v2:172.21.15.162:3300/0 conn(0x7f3fe4159bf0 0x7f3fe4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.897+0000 7f3fe3200640 1 -- 172.21.15.7:0/1039484487 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe4072c60 con 0x7f3fe40cea40 2024-08-19T00:40:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.898+0000 7f3fe3200640 1 --2- 172.21.15.7:0/1039484487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe40d03c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3fe406d280 tx=0x7f3fdc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5649313667ebcb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.898+0000 7f3fe1e00640 1 -- 172.21.15.7:0/1039484487 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc036070 con 0x7f3fe40cea40 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.898+0000 7f3fe1e00640 1 -- 172.21.15.7:0/1039484487 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc031600 con 0x7f3fe40cea40 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.898+0000 7f3fe1e00640 1 -- 172.21.15.7:0/1039484487 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0319d0 con 0x7f3fe40cea40 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 -- 172.21.15.7:0/1039484487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 msgr2=0x7f3fe40d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 --2- 172.21.15.7:0/1039484487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe40d03c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3fe406d280 tx=0x7f3fdc02a610 comp rx=0 tx=0).stop 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 -- 172.21.15.7:0/1039484487 shutdown_connections 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 --2- 172.21.15.7:0/1039484487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe40d03c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 --2- 172.21.15.7:0/1039484487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe40ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 --2- 172.21.15.7:0/1039484487 >> v2:172.21.15.162:3300/0 conn(0x7f3fe4159bf0 0x7f3fe4073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 -- 172.21.15.7:0/1039484487 >> 172.21.15.7:0/1039484487 conn(0x7f3fe406bc70 msgr2=0x7f3fe406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 -- 172.21.15.7:0/1039484487 shutdown_connections 2024-08-19T00:40:29.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.899+0000 7f3fe9400640 1 -- 172.21.15.7:0/1039484487 wait complete. 2024-08-19T00:40:29.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.901+0000 7f3fe9400640 1 Processor -- start 2024-08-19T00:40:29.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.901+0000 7f3fe9400640 1 -- start start 2024-08-19T00:40:29.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fe9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe41f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:29.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fe9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:29.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fe9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe4159bf0 0x7f3fe415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fe9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe415a150 con 0x7f3fe40cea40 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fe9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe4159fd0 con 0x7f3fe4159bf0 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fe9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe40d0900 con 0x7f3fe40739a0 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48714/0 (socket says 172.21.15.7:48714) 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 -- 172.21.15.7:0/2443620179 learned_addr learned my addr 172.21.15.7:0/2443620179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fe2800640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe41f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 -- 172.21.15.7:0/2443620179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 msgr2=0x7f3fe41f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe41f7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 -- 172.21.15.7:0/2443620179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe4159bf0 msgr2=0x7f3fe415a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe4159bf0 0x7f3fe415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.902+0000 7f3fdbe00640 1 -- 172.21.15.7:0/2443620179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe41f8480 con 0x7f3fe40cea40 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.903+0000 7f3fdbe00640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe409dac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00d5d0 tx=0x7f3fcc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.903+0000 7f3fdaa00640 1 -- 172.21.15.7:0/2443620179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc004240 con 0x7f3fe40cea40 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.903+0000 7f3fdaa00640 1 -- 172.21.15.7:0/2443620179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc0043e0 con 0x7f3fe40cea40 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.903+0000 7f3fdaa00640 1 -- 172.21.15.7:0/2443620179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc003830 con 0x7f3fe40cea40 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.903+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe409e000 con 0x7f3fe40cea40 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.903+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe41f81a0 con 0x7f3fe40cea40 2024-08-19T00:40:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.904+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe40d03c0 con 0x7f3fe40cea40 2024-08-19T00:40:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.905+0000 7f3fdaa00640 1 -- 172.21.15.7:0/2443620179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fcc0039d0 con 0x7f3fe40cea40 2024-08-19T00:40:29.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.906+0000 7f3fdaa00640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3fc006be30 0x7f3fc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:29.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.907+0000 7f3fdaa00640 1 -- 172.21.15.7:0/2443620179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f3fcc08b1c0 con 0x7f3fe40cea40 2024-08-19T00:40:29.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.907+0000 7f3fe2800640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3fc006be30 0x7f3fc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:29.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.907+0000 7f3fe2800640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3fc006be30 0x7f3fc006e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009890 tx=0x7f3fd4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:29.911+0000 7f3fdaa00640 1 -- 172.21.15.7:0/2443620179 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3fcc059ad0 con 0x7f3fe40cea40 2024-08-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.129+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fe4158880 con 0x7f3fe40cea40 2024-08-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.130+0000 7f3fdaa00640 1 -- 172.21.15.7:0/2443620179 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5221 (secure 0 0 0) 0x7f3fcc0593d0 con 0x7f3fe40cea40 2024-08-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":54,"btime":"2024-08-19T00:40:13:187552+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:12.722631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6003,"qdb_cluster":[6003]},"id":4}]} 2024-08-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 54 2024-08-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3fc006be30 msgr2=0x7f3fc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3fc006be30 0x7f3fc006e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009890 tx=0x7f3fd4008040 comp rx=0 tx=0).stop 2024-08-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 msgr2=0x7f3fe409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe409dac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00d5d0 tx=0x7f3fcc00da90 comp rx=0 tx=0).stop 2024-08-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 shutdown_connections 2024-08-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3fc006be30 0x7f3fc006e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe4159bf0 0x7f3fe415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fe40cea40 0x7f3fe409dac0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 --2- 172.21.15.7:0/2443620179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40739a0 0x7f3fe41f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 >> 172.21.15.7:0/2443620179 conn(0x7f3fe406bc70 msgr2=0x7f3fe40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 shutdown_connections 2024-08-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:30.132+0000 7f3fe9400640 1 -- 172.21.15.7:0/2443620179 wait complete. 2024-08-19T00:40:30.151 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-19T00:40:30.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2024-08-19T00:40:31.570 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:40:31.576 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:40:35.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.320+0000 7f00a5400640 1 Processor -- start 2024-08-19T00:40:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.320+0000 7f00a5400640 1 -- start start 2024-08-19T00:40:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f00a5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00a00d03c0 0x7f00a0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f00a5400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00a00b3750 0x7f00a00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f00a5400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a00cdfb0 con 0x7f00a006e710 2024-08-19T00:40:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f00a5400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f00a00cebc0 con 0x7f00a00d03c0 2024-08-19T00:40:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f00a5400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00a00ce290 con 0x7f00a00b3750 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f009e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00a00d03c0 0x7f00a0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f0097e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00a006e710 0x7f00a00d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47984/0 (socket says 172.21.15.7:47984) 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.321+0000 7f0097e00640 1 -- 172.21.15.7:0/2951030988 learned_addr learned my addr 172.21.15.7:0/2951030988 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.322+0000 7f009f200640 1 --2- 172.21.15.7:0/2951030988 >> v2:172.21.15.162:3300/0 conn(0x7f00a00b3750 0x7f00a00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.322+0000 7f009e800640 1 -- 172.21.15.7:0/2951030988 >> v2:172.21.15.162:3300/0 conn(0x7f00a00b3750 msgr2=0x7f00a00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.322+0000 7f009e800640 1 --2- 172.21.15.7:0/2951030988 >> v2:172.21.15.162:3300/0 conn(0x7f00a00b3750 0x7f00a00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.322+0000 7f009e800640 1 -- 172.21.15.7:0/2951030988 >> v1:172.21.15.7:6789/0 conn(0x7f00a006e710 legacy=0x7f00a00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.322+0000 7f009e800640 1 -- 172.21.15.7:0/2951030988 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a00ce570 con 0x7f00a00d03c0 2024-08-19T00:40:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.322+0000 7f009f200640 1 --2- 172.21.15.7:0/2951030988 >> v2:172.21.15.162:3300/0 conn(0x7f00a00b3750 0x7f00a00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.323+0000 7f009e800640 1 --2- 172.21.15.7:0/2951030988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a00d03c0 0x7f00a0071980 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f00900097a0 tx=0x7f009002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf8eefe6e441e0b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.323+0000 7f009de00640 1 -- 172.21.15.7:0/2951030988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090037070 con 0x7f00a00d03c0 2024-08-19T00:40:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.323+0000 7f009de00640 1 -- 172.21.15.7:0/2951030988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0090032440 con 0x7f00a00d03c0 2024-08-19T00:40:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.323+0000 7f009de00640 1 -- 172.21.15.7:0/2951030988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090032810 con 0x7f00a00d03c0 2024-08-19T00:40:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 -- 172.21.15.7:0/2951030988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a00d03c0 msgr2=0x7f00a0071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 --2- 172.21.15.7:0/2951030988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a00d03c0 0x7f00a0071980 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f00900097a0 tx=0x7f009002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 -- 172.21.15.7:0/2951030988 shutdown_connections 2024-08-19T00:40:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 --2- 172.21.15.7:0/2951030988 >> v2:172.21.15.162:3300/0 conn(0x7f00a00b3750 0x7f00a00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 --2- 172.21.15.7:0/2951030988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a00d03c0 0x7f00a0071980 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 -- 172.21.15.7:0/2951030988 >> 172.21.15.7:0/2951030988 conn(0x7f00a006bc70 msgr2=0x7f00a006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 -- 172.21.15.7:0/2951030988 shutdown_connections 2024-08-19T00:40:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.324+0000 7f00a5400640 1 -- 172.21.15.7:0/2951030988 wait complete. 2024-08-19T00:40:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.326+0000 7f00a5400640 1 Processor -- start 2024-08-19T00:40:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.326+0000 7f00a5400640 1 -- start start 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f00a5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a006e710 0x7f00a0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f00a5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a00b3750 0x7f00a015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f00a5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a00d03c0 0x7f00a015de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f00a5400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0073c60 con 0x7f00a006e710 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f00a5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0073ae0 con 0x7f00a00d03c0 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f00a5400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00a00b3b60 con 0x7f00a00b3750 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a006e710 0x7f00a0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a006e710 0x7f00a0156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60414/0 (socket says 172.21.15.7:60414) 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 -- 172.21.15.7:0/919130238 learned_addr learned my addr 172.21.15.7:0/919130238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 -- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a00b3750 msgr2=0x7f00a015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f0097e00640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a00b3750 0x7f00a015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a00b3750 0x7f00a015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 -- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a00d03c0 msgr2=0x7f00a015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a00d03c0 0x7f00a015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f009e800640 1 -- 172.21.15.7:0/919130238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a015d730 con 0x7f00a006e710 2024-08-19T00:40:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.327+0000 7f0097e00640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a00b3750 0x7f00a015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:40:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.328+0000 7f009e800640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a006e710 0x7f00a0156a30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f00900098c0 tx=0x7f00900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.328+0000 7f0096a00640 1 -- 172.21.15.7:0/919130238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090037040 con 0x7f00a006e710 2024-08-19T00:40:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.328+0000 7f0096a00640 1 -- 172.21.15.7:0/919130238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0090042070 con 0x7f00a006e710 2024-08-19T00:40:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.328+0000 7f0096a00640 1 -- 172.21.15.7:0/919130238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090030bb0 con 0x7f00a006e710 2024-08-19T00:40:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.328+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a0156f70 con 0x7f00a006e710 2024-08-19T00:40:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.328+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a015c970 con 0x7f00a006e710 2024-08-19T00:40:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.329+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a01656a0 con 0x7f00a006e710 2024-08-19T00:40:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.330+0000 7f0096a00640 1 -- 172.21.15.7:0/919130238 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0090047460 con 0x7f00a006e710 2024-08-19T00:40:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.331+0000 7f0096a00640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007c06be30 0x7f007c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.331+0000 7f0096a00640 1 -- 172.21.15.7:0/919130238 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f00900aba80 con 0x7f00a006e710 2024-08-19T00:40:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.331+0000 7f0097e00640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007c06be30 0x7f007c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.332+0000 7f0097e00640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007c06be30 0x7f007c06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f00a00cc4f0 tx=0x7f0088009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.336+0000 7f0096a00640 1 -- 172.21.15.7:0/919130238 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f00900ade20 con 0x7f00a006e710 2024-08-19T00:40:35.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.560+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00a006c980 con 0x7f00a006e710 2024-08-19T00:40:35.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.561+0000 7f0096a00640 1 -- 172.21.15.7:0/919130238 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5269 (secure 0 0 0) 0x7f00a015d730 con 0x7f00a006e710 2024-08-19T00:40:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:35.563 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":55,"btime":"2024-08-19T00:40:33:060738+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:33.060715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6003":{"gid":6003,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6836/2987342349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2987342349},{"type":"v1","addr":"172.21.15.7:6836","nonce":2987342349}]},"join_fscid":-1,"laggy_since":"2024-08-19T00:40:33.060714+0000","export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6003,"qdb_cluster":[6003]},"id":4}]} 2024-08-19T00:40:35.563 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 55 2024-08-19T00:40:35.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.563+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007c06be30 msgr2=0x7f007c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.563+0000 7f00a5400640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007c06be30 0x7f007c06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f00a00cc4f0 tx=0x7f0088009040 comp rx=0 tx=0).stop 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a006e710 msgr2=0x7f00a0156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a006e710 0x7f00a0156a30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f00900098c0 tx=0x7f00900046c0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 shutdown_connections 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007c06be30 0x7f007c06e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a00d03c0 0x7f00a015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a00b3750 0x7f00a015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 --2- 172.21.15.7:0/919130238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a006e710 0x7f00a0156a30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 >> 172.21.15.7:0/919130238 conn(0x7f00a006bc70 msgr2=0x7f00a00aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 shutdown_connections 2024-08-19T00:40:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.564+0000 7f00a5400640 1 -- 172.21.15.7:0/919130238 wait complete. 2024-08-19T00:40:35.581 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-08-19T00:40:35.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_journal_corrupt_dentry_first 2024-08-19T00:40:35.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.840+0000 7f5d23200640 1 Processor -- start 2024-08-19T00:40:35.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.840+0000 7f5d23200640 1 -- start start 2024-08-19T00:40:35.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.841+0000 7f5d23200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c15c390 0x7f5d1c166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.841+0000 7f5d23200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d1c0acef0 con 0x7f5d1c0b5130 2024-08-19T00:40:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.841+0000 7f5d23200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d1c0ad1d0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.841+0000 7f5d23200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c0ad790 con 0x7f5d1c15c390 2024-08-19T00:40:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.841+0000 7f5d13e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5d1c0b5130 0x7f5d1c0aebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47998/0 (socket says 172.21.15.7:47998) 2024-08-19T00:40:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.841+0000 7f5d13e00640 1 -- 172.21.15.7:0/1564352118 learned_addr learned my addr 172.21.15.7:0/1564352118 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d21200640 1 --2- 172.21.15.7:0/1564352118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c15c390 0x7f5d1c166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180363245 0 0) 0x7f5d1c0acef0 con 0x7f5d1c0b5130 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d00003520 con 0x7f5d1c0b5130 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904963473 0 0) 0x7f5d1c0ad1d0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d1c0acef0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d21200640 1 -- 172.21.15.7:0/1564352118 >> v1:172.21.15.162:6789/0 conn(0x7f5d1c15bfb0 legacy=0x7f5d1c0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2467773906 0 0) 0x7f5d00003520 con 0x7f5d1c0b5130 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d21200640 1 -- 172.21.15.7:0/1564352118 >> v1:172.21.15.7:6789/0 conn(0x7f5d1c0b5130 legacy=0x7f5d1c0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.842+0000 7f5d21200640 1 -- 172.21.15.7:0/1564352118 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c0ad4b0 con 0x7f5d1c15c390 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.843+0000 7f5d21200640 1 --2- 172.21.15.7:0/1564352118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c15c390 0x7f5d1c166dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009dc0 tx=0x7f5d1402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5013a0a7311f3fc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.843+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14007740 con 0x7f5d1c15c390 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.843+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d140078e0 con 0x7f5d1c15c390 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.843+0000 7f5d1b400640 1 -- 172.21.15.7:0/1564352118 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14007cb0 con 0x7f5d1c15c390 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.844+0000 7f5d23200640 1 -- 172.21.15.7:0/1564352118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c15c390 msgr2=0x7f5d1c166dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.844+0000 7f5d23200640 1 --2- 172.21.15.7:0/1564352118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c15c390 0x7f5d1c166dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009dc0 tx=0x7f5d1402a6d0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.844+0000 7f5d23200640 1 -- 172.21.15.7:0/1564352118 shutdown_connections 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.844+0000 7f5d23200640 1 --2- 172.21.15.7:0/1564352118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c15c390 0x7f5d1c166dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.844+0000 7f5d23200640 1 -- 172.21.15.7:0/1564352118 >> 172.21.15.7:0/1564352118 conn(0x7f5d1c0b2300 msgr2=0x7f5d1c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.844+0000 7f5d23200640 1 -- 172.21.15.7:0/1564352118 shutdown_connections 2024-08-19T00:40:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.844+0000 7f5d23200640 1 -- 172.21.15.7:0/1564352118 wait complete. 2024-08-19T00:40:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.846+0000 7f5d23200640 1 Processor -- start 2024-08-19T00:40:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.846+0000 7f5d23200640 1 -- start start 2024-08-19T00:40:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d23200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0b5130 0x7f5d1c15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d23200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c15bfb0 0x7f5d1c1f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d23200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c15c390 0x7f5d1c1f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d23200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c0731d0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d23200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c073050 con 0x7f5d1c15c390 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d23200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c0af2e0 con 0x7f5d1c0b5130 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c15bfb0 0x7f5d1c1f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c15bfb0 0x7f5d1c1f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60428/0 (socket says 172.21.15.7:60428) 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d13e00640 1 -- 172.21.15.7:0/2536610450 learned_addr learned my addr 172.21.15.7:0/2536610450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d1be00640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0b5130 0x7f5d1c15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.847+0000 7f5d21200640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c15c390 0x7f5d1c1f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d13e00640 1 -- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0b5130 msgr2=0x7f5d1c15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d13e00640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0b5130 0x7f5d1c15dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d13e00640 1 -- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c15c390 msgr2=0x7f5d1c1f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d13e00640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c15c390 0x7f5d1c1f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d13e00640 1 -- 172.21.15.7:0/2536610450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c15f3a0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d13e00640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c15bfb0 0x7f5d1c1f3e50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5d04001eb0 tx=0x7f5d0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d18c00640 1 -- 172.21.15.7:0/2536610450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04017070 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d18c00640 1 -- 172.21.15.7:0/2536610450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d04005ce0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d18c00640 1 -- 172.21.15.7:0/2536610450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04007310 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1c1f1890 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.848+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1c15e8c0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.849+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d1c0aebd0 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.850+0000 7f5d18c00640 1 -- 172.21.15.7:0/2536610450 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d0401a070 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.851+0000 7f5d18c00640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cf806be30 0x7f5cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.851+0000 7f5d18c00640 1 -- 172.21.15.7:0/2536610450 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f5d0408a310 con 0x7f5d1c15bfb0 2024-08-19T00:40:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.851+0000 7f5d1be00640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cf806be30 0x7f5cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.852+0000 7f5d1be00640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cf806be30 0x7f5cf806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0011e0 tx=0x7f5d0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:35.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:35.855+0000 7f5d18c00640 1 -- 172.21.15.7:0/2536610450 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5d04058540 con 0x7f5d1c15bfb0 2024-08-19T00:40:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.039+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"} v 0) -- 0x7f5d1c160410 con 0x7f5d1c15bfb0 2024-08-19T00:40:36.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.042+0000 7f5d18c00640 1 -- 172.21.15.7:0/2536610450 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f5d0405c840 con 0x7f5d1c15bfb0 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cf806be30 msgr2=0x7f5cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cf806be30 0x7f5cf806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0011e0 tx=0x7f5d0c009040 comp rx=0 tx=0).stop 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c15bfb0 msgr2=0x7f5d1c1f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c15bfb0 0x7f5d1c1f3e50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5d04001eb0 tx=0x7f5d0400c8e0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 shutdown_connections 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cf806be30 0x7f5cf806e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c15c390 0x7f5d1c1f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c15bfb0 0x7f5d1c1f3e50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 --2- 172.21.15.7:0/2536610450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0b5130 0x7f5d1c15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 >> 172.21.15.7:0/2536610450 conn(0x7f5d1c0b2300 msgr2=0x7f5d1c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:36.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 shutdown_connections 2024-08-19T00:40:36.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.045+0000 7f5d23200640 1 -- 172.21.15.7:0/2536610450 wait complete. 2024-08-19T00:40:36.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 4:0 false 2024-08-19T00:40:36.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.218+0000 7f3179800640 1 Processor -- start 2024-08-19T00:40:36.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.218+0000 7f3179800640 1 -- start start 2024-08-19T00:40:36.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.219+0000 7f3179800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f317415e380 0x7f31740d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:36.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3179800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f31740d2ef0 0x7f31740b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:36.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3179800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31740d4ef0 con 0x7f31740d1ef0 2024-08-19T00:40:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3179800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f31740cf800 con 0x7f317415e380 2024-08-19T00:40:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3179800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f31740cfa50 con 0x7f31740d2ef0 2024-08-19T00:40:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3173e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f317415e380 0x7f31740d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3173e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f317415e380 0x7f31740d4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60432/0 (socket says 172.21.15.7:60432) 2024-08-19T00:40:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3173e00640 1 -- 172.21.15.7:0/444364699 learned_addr learned my addr 172.21.15.7:0/444364699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3173e00640 1 -- 172.21.15.7:0/444364699 >> v2:172.21.15.162:3300/0 conn(0x7f31740d2ef0 msgr2=0x7f31740b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3173e00640 1 --2- 172.21.15.7:0/444364699 >> v2:172.21.15.162:3300/0 conn(0x7f31740d2ef0 0x7f31740b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3173e00640 1 -- 172.21.15.7:0/444364699 >> v1:172.21.15.7:6789/0 conn(0x7f31740d1ef0 legacy=0x7f31740d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.220+0000 7f3173e00640 1 -- 172.21.15.7:0/444364699 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31740cfd30 con 0x7f317415e380 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.221+0000 7f3173e00640 1 --2- 172.21.15.7:0/444364699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f317415e380 0x7f31740d4910 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f31740ceae0 tx=0x7f316402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be97a504b154d86 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.221+0000 7f3173400640 1 -- 172.21.15.7:0/444364699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164037070 con 0x7f317415e380 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3173400640 1 -- 172.21.15.7:0/444364699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3164032440 con 0x7f317415e380 2024-08-19T00:40:36.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3173400640 1 -- 172.21.15.7:0/444364699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164032810 con 0x7f317415e380 2024-08-19T00:40:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 -- 172.21.15.7:0/444364699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f317415e380 msgr2=0x7f31740d4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 --2- 172.21.15.7:0/444364699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f317415e380 0x7f31740d4910 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f31740ceae0 tx=0x7f316402a200 comp rx=0 tx=0).stop 2024-08-19T00:40:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 -- 172.21.15.7:0/444364699 shutdown_connections 2024-08-19T00:40:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 --2- 172.21.15.7:0/444364699 >> v2:172.21.15.162:3300/0 conn(0x7f31740d2ef0 0x7f31740b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 --2- 172.21.15.7:0/444364699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f317415e380 0x7f31740d4910 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 -- 172.21.15.7:0/444364699 >> 172.21.15.7:0/444364699 conn(0x7f317409d4d0 msgr2=0x7f31740d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 -- 172.21.15.7:0/444364699 shutdown_connections 2024-08-19T00:40:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.222+0000 7f3179800640 1 -- 172.21.15.7:0/444364699 wait complete. 2024-08-19T00:40:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.224+0000 7f3179800640 1 Processor -- start 2024-08-19T00:40:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.224+0000 7f3179800640 1 -- start start 2024-08-19T00:40:36.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3179800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31740d1ef0 0x7f31741e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:36.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3179800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31740d2ef0 0x7f31740b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:36.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3179800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f317415e380 0x7f31740b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:36.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3179800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31740d24e0 con 0x7f31740d1ef0 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3179800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31740d2360 con 0x7f317415e380 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3179800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f31740b4380 con 0x7f31740d2ef0 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3173e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31740d1ef0 0x7f31741e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3173e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31740d1ef0 0x7f31741e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60436/0 (socket says 172.21.15.7:60436) 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3173e00640 1 -- 172.21.15.7:0/8462683 learned_addr learned my addr 172.21.15.7:0/8462683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f316be00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31740d2ef0 0x7f31740b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.225+0000 7f3178e00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f317415e380 0x7f31740b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3173e00640 1 -- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31740d2ef0 msgr2=0x7f31740b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3173e00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31740d2ef0 0x7f31740b93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3173e00640 1 -- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f317415e380 msgr2=0x7f31740b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3173e00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f317415e380 0x7f31740b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3173e00640 1 -- 172.21.15.7:0/8462683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31740c8500 con 0x7f31740d1ef0 2024-08-19T00:40:36.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3173e00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31740d1ef0 0x7f31741e6060 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3164000c00 tx=0x7f31640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:36.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3170c00640 1 -- 172.21.15.7:0/8462683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164041070 con 0x7f31740d1ef0 2024-08-19T00:40:36.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3170c00640 1 -- 172.21.15.7:0/8462683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316403c870 con 0x7f31740d1ef0 2024-08-19T00:40:36.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3170c00640 1 -- 172.21.15.7:0/8462683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164037040 con 0x7f31740d1ef0 2024-08-19T00:40:36.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741e3470 con 0x7f31740d1ef0 2024-08-19T00:40:36.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.226+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741e3a30 con 0x7f31740d1ef0 2024-08-19T00:40:36.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.228+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31740b3e40 con 0x7f31740d1ef0 2024-08-19T00:40:36.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.228+0000 7f3170c00640 1 -- 172.21.15.7:0/8462683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3164044070 con 0x7f31740d1ef0 2024-08-19T00:40:36.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.229+0000 7f3170c00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f315006be60 0x7f315006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:36.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.229+0000 7f3170c00640 1 -- 172.21.15.7:0/8462683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5853+0+0 (secure 0 0 0) 0x7f31640abc20 con 0x7f31740d1ef0 2024-08-19T00:40:36.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.230+0000 7f316be00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f315006be60 0x7f315006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:36.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.230+0000 7f316be00640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f315006be60 0x7f315006e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f31740a22f0 tx=0x7f315c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.234+0000 7f3170c00640 1 -- 172.21.15.7:0/8462683 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f316407a5c0 con 0x7f31740d1ef0 2024-08-19T00:40:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:36.491+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "4:0", "val": "false"} v 0) -- 0x7f31741eaaa0 con 0x7f31740d1ef0 2024-08-19T00:40:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.367+0000 7f3170c00640 1 -- 172.21.15.7:0/8462683 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "4:0", "val": "false"}]=0 unfreezing mds.6003 v56) ==== 115+0+0 (secure 0 0 0) 0x7f3164079ec0 con 0x7f31740d1ef0 2024-08-19T00:40:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:unfreezing mds.6003 2024-08-19T00:40:37.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f315006be60 msgr2=0x7f315006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f315006be60 0x7f315006e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f31740a22f0 tx=0x7f315c009040 comp rx=0 tx=0).stop 2024-08-19T00:40:37.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31740d1ef0 msgr2=0x7f31741e6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31740d1ef0 0x7f31741e6060 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3164000c00 tx=0x7f31640046c0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 shutdown_connections 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f315006be60 0x7f315006e320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f317415e380 0x7f31740b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31740d2ef0 0x7f31740b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 --2- 172.21.15.7:0/8462683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31740d1ef0 0x7f31741e6060 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 >> 172.21.15.7:0/8462683 conn(0x7f317409d4d0 msgr2=0x7f31740d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 shutdown_connections 2024-08-19T00:40:37.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.371+0000 7f3179800640 1 -- 172.21.15.7:0/8462683 wait complete. 2024-08-19T00:40:37.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -n kernel.core_pattern 2024-08-19T00:40:37.454 INFO:teuthology.orchestra.run.smithi007.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:40:37.456 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:40:37.457 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2024-08-19T00:40:37.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2024-08-19T00:40:37.521 INFO:teuthology.orchestra.run.smithi007.stdout:1724028013.38218.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/proc/self/exe', platform: 'x86_64' 2024-08-19T00:40:37.525 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1724028013.38218.core'] 2024-08-19T00:40:37.525 INFO:tasks.cephfs.cephfs_test_case:Found core file 1724028013.38218.core, deleting it 2024-08-19T00:40:37.525 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1724028013.38218.core 2024-08-19T00:40:37.590 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:40:37.590 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-19T00:40:37.590 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:40:37.590 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:40:37.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:40:37.591 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-08-19T00:40:37.592 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:40:37.592 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:40:37.596 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:40:37.596 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:37.726 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:40:37.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.751+0000 7f0fffa00640 1 Processor -- start 2024-08-19T00:40:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.751+0000 7f0fffa00640 1 -- start start 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.752+0000 7f0fffa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ff8159bf0 0x7f0ff8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.752+0000 7f0fffa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ff80cec10 0x7f0ff80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.752+0000 7f0fffa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff806f7f0 con 0x7f0ff80739a0 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.752+0000 7f0fffa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff806f510 con 0x7f0ff80cec10 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.752+0000 7f0fffa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff8072980 con 0x7f0ff8159bf0 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.752+0000 7f0ffda00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ff80cec10 0x7f0ff80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ffda00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ff80cec10 0x7f0ff80d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60482/0 (socket says 172.21.15.7:60482) 2024-08-19T00:40:37.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ffda00640 1 -- 172.21.15.7:0/2251021486 learned_addr learned my addr 172.21.15.7:0/2251021486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:37.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ffd000640 1 --2- 172.21.15.7:0/2251021486 >> v2:172.21.15.162:3300/0 conn(0x7f0ff8159bf0 0x7f0ff8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:37.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ffda00640 1 -- 172.21.15.7:0/2251021486 >> v2:172.21.15.162:3300/0 conn(0x7f0ff8159bf0 msgr2=0x7f0ff8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:37.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ffda00640 1 --2- 172.21.15.7:0/2251021486 >> v2:172.21.15.162:3300/0 conn(0x7f0ff8159bf0 0x7f0ff8073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ffda00640 1 -- 172.21.15.7:0/2251021486 >> v1:172.21.15.7:6789/0 conn(0x7f0ff80739a0 legacy=0x7f0ff80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ffda00640 1 -- 172.21.15.7:0/2251021486 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff8072c60 con 0x7f0ff80cec10 2024-08-19T00:40:37.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.753+0000 7f0ff7400640 1 -- 172.21.15.7:0/2251021486 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618672971 0 0) 0x7f0ff806f7f0 con 0x7f0ff80739a0 2024-08-19T00:40:37.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.754+0000 7f0ffda00640 1 --2- 172.21.15.7:0/2251021486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff80cec10 0x7f0ff80d03c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806d280 tx=0x7f0ff002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa77491c50e73223 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.754+0000 7f0ff7400640 1 -- 172.21.15.7:0/2251021486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0036070 con 0x7f0ff80cec10 2024-08-19T00:40:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.754+0000 7f0ff7400640 1 -- 172.21.15.7:0/2251021486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff0031600 con 0x7f0ff80cec10 2024-08-19T00:40:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.754+0000 7f0ff7400640 1 -- 172.21.15.7:0/2251021486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00319d0 con 0x7f0ff80cec10 2024-08-19T00:40:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 -- 172.21.15.7:0/2251021486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff80cec10 msgr2=0x7f0ff80d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 --2- 172.21.15.7:0/2251021486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff80cec10 0x7f0ff80d03c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806d280 tx=0x7f0ff002a6a0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 -- 172.21.15.7:0/2251021486 shutdown_connections 2024-08-19T00:40:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 --2- 172.21.15.7:0/2251021486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff80cec10 0x7f0ff80d03c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 --2- 172.21.15.7:0/2251021486 >> v2:172.21.15.162:3300/0 conn(0x7f0ff8159bf0 0x7f0ff8073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 -- 172.21.15.7:0/2251021486 >> 172.21.15.7:0/2251021486 conn(0x7f0ff806bc70 msgr2=0x7f0ff806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:37.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 -- 172.21.15.7:0/2251021486 shutdown_connections 2024-08-19T00:40:37.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.755+0000 7f0fffa00640 1 -- 172.21.15.7:0/2251021486 wait complete. 2024-08-19T00:40:37.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.757+0000 7f0fffa00640 1 Processor -- start 2024-08-19T00:40:37.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.757+0000 7f0fffa00640 1 -- start start 2024-08-19T00:40:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0fffa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff80739a0 0x7f0ff814e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0fffa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff8159bf0 0x7f0ff8150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0fffa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff8150770 0x7f0ff8150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0fffa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff815a150 con 0x7f0ff8159bf0 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0fffa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8159fd0 con 0x7f0ff80739a0 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0fffa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff80d0900 con 0x7f0ff8150770 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0ff7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff8159bf0 0x7f0ff8150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0ff7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff8159bf0 0x7f0ff8150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60492/0 (socket says 172.21.15.7:60492) 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0ff7e00640 1 -- 172.21.15.7:0/1328214281 learned_addr learned my addr 172.21.15.7:0/1328214281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0ffd000640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff80739a0 0x7f0ff814e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.758+0000 7f0ffda00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff8150770 0x7f0ff8150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff7e00640 1 -- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff8150770 msgr2=0x7f0ff8150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff7e00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff8150770 0x7f0ff8150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff7e00640 1 -- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff80739a0 msgr2=0x7f0ff814e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff7e00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff80739a0 0x7f0ff814e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff7e00640 1 -- 172.21.15.7:0/1328214281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff814ea60 con 0x7f0ff8159bf0 2024-08-19T00:40:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff7e00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff8159bf0 0x7f0ff8150230 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c410 tx=0x7f0fe400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff4c00640 1 -- 172.21.15.7:0/1328214281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4017070 con 0x7f0ff8159bf0 2024-08-19T00:40:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff4c00640 1 -- 172.21.15.7:0/1328214281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe40035f0 con 0x7f0ff8159bf0 2024-08-19T00:40:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0ff4c00640 1 -- 172.21.15.7:0/1328214281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40039e0 con 0x7f0ff8159bf0 2024-08-19T00:40:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.759+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff80b4000 con 0x7f0ff8159bf0 2024-08-19T00:40:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.760+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff814f750 con 0x7f0ff8159bf0 2024-08-19T00:40:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.760+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff80d0c90 con 0x7f0ff8159bf0 2024-08-19T00:40:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.761+0000 7f0ff4c00640 1 -- 172.21.15.7:0/1328214281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fe401a070 con 0x7f0ff8159bf0 2024-08-19T00:40:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.762+0000 7f0ff4c00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0fd806be30 0x7f0fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.762+0000 7f0ff4c00640 1 -- 172.21.15.7:0/1328214281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f0fe408a2f0 con 0x7f0ff8159bf0 2024-08-19T00:40:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.763+0000 7f0ffd000640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0fd806be30 0x7f0fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.763+0000 7f0ffd000640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0fd806be30 0x7f0fd806e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.766+0000 7f0ff4c00640 1 -- 172.21.15.7:0/1328214281 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0ff814ea60 con 0x7f0ff8159bf0 2024-08-19T00:40:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.988+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ff81517f0 con 0x7f0ff8159bf0 2024-08-19T00:40:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.988+0000 7f0ff4c00640 1 -- 172.21.15.7:0/1328214281 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+4392 (secure 0 0 0) 0x7f0fe4058550 con 0x7f0ff8159bf0 2024-08-19T00:40:37.990 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:37.991 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"btime":"2024-08-19T00:40:37:371164+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:37.371160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"c","rank":0,"incarnation":57,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-08-19T00:40:37.991 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 57 2024-08-19T00:40:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0fd806be30 msgr2=0x7f0fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0fd806be30 0x7f0fd806e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec008040 comp rx=0 tx=0).stop 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff8159bf0 msgr2=0x7f0ff8150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff8159bf0 0x7f0ff8150230 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c410 tx=0x7f0fe400c8d0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 shutdown_connections 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0fd806be30 0x7f0fd806e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff8150770 0x7f0ff8150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ff8159bf0 0x7f0ff8150230 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 --2- 172.21.15.7:0/1328214281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff80739a0 0x7f0ff814e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 >> 172.21.15.7:0/1328214281 conn(0x7f0ff806bc70 msgr2=0x7f0ff815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 shutdown_connections 2024-08-19T00:40:37.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:37.991+0000 7f0fffa00640 1 -- 172.21.15.7:0/1328214281 wait complete. 2024-08-19T00:40:38.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:39:35.566683+0000', 'modified': '2024-08-19T00:40:37.371160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5641': {'gid': 5641, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/992020227', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 992020227}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 992020227}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:40:38.412 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5641:up:replay 2024-08-19T00:40:38.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.947+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:38.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.948+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_RECONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-08-19T00:40:38.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.948+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_RECONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-08-19T00:40:38.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.948+0000 7fd18b400640 0 client.6090 ms_handle_remote_reset on v2:172.21.15.7:6834/2987342349 2024-08-19T00:40:38.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.948+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:40:38.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.948+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:40:38.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.948+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:40:38.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:38.948+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-08-19T00:40:39.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:39.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.578+0000 7fb472200640 1 Processor -- start 2024-08-19T00:40:39.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.578+0000 7fb472200640 1 -- start start 2024-08-19T00:40:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb472200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e360 0x7fb46c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb472200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb46c0d2af0 0x7fb46c0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb472200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb46c15e740 0x7fb46c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb472200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb46c0d3490 con 0x7fb46c0d2af0 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb472200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb46c0b3ab0 con 0x7fb46c15e740 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb472200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb46c15f460 con 0x7fb46c15e360 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb46be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb46c0d2af0 0x7fb46c0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb46be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb46c0d2af0 0x7fb46c0d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60504/0 (socket says 172.21.15.7:60504) 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.579+0000 7fb46be00640 1 -- 172.21.15.7:0/1179557371 learned_addr learned my addr 172.21.15.7:0/1179557371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.580+0000 7fb46be00640 1 -- 172.21.15.7:0/1179557371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e360 msgr2=0x7fb46c15fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.580+0000 7fb46be00640 1 --2- 172.21.15.7:0/1179557371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e360 0x7fb46c15fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.580+0000 7fb46be00640 1 -- 172.21.15.7:0/1179557371 >> v2:172.21.15.162:3300/0 conn(0x7fb46c15e740 msgr2=0x7fb46c15ebd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.580+0000 7fb46be00640 1 --2- 172.21.15.7:0/1179557371 >> v2:172.21.15.162:3300/0 conn(0x7fb46c15e740 0x7fb46c15ebd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.580+0000 7fb46be00640 1 -- 172.21.15.7:0/1179557371 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c15f740 con 0x7fb46c0d2af0 2024-08-19T00:40:39.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.581+0000 7fb46be00640 1 --2- 172.21.15.7:0/1179557371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d2f50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb46c08d500 tx=0x7fb45802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec69b06d6bd8ccca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:39.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.581+0000 7fb46b400640 1 -- 172.21.15.7:0/1179557371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458037070 con 0x7fb46c0d2af0 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.581+0000 7fb46b400640 1 -- 172.21.15.7:0/1179557371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb458032440 con 0x7fb46c0d2af0 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.581+0000 7fb46b400640 1 -- 172.21.15.7:0/1179557371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458032810 con 0x7fb46c0d2af0 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 -- 172.21.15.7:0/1179557371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c0d2af0 msgr2=0x7fb46c0d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 --2- 172.21.15.7:0/1179557371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d2f50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb46c08d500 tx=0x7fb45802a210 comp rx=0 tx=0).stop 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 -- 172.21.15.7:0/1179557371 shutdown_connections 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 --2- 172.21.15.7:0/1179557371 >> v2:172.21.15.162:3300/0 conn(0x7fb46c15e740 0x7fb46c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 --2- 172.21.15.7:0/1179557371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d2f50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 --2- 172.21.15.7:0/1179557371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e360 0x7fb46c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 -- 172.21.15.7:0/1179557371 >> 172.21.15.7:0/1179557371 conn(0x7fb46c08dbf0 msgr2=0x7fb46c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 -- 172.21.15.7:0/1179557371 shutdown_connections 2024-08-19T00:40:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.582+0000 7fb472200640 1 -- 172.21.15.7:0/1179557371 wait complete. 2024-08-19T00:40:39.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.584+0000 7fb472200640 1 Processor -- start 2024-08-19T00:40:39.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.584+0000 7fb472200640 1 -- start start 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb472200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb472200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c15e360 0x7fb46c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb472200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e740 0x7fb46c0cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb472200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c15f110 con 0x7fb46c15e360 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb472200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c0b4040 con 0x7fb46c0d2af0 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb472200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb46c0d2300 con 0x7fb46c15e740 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c15e360 0x7fb46c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c15e360 0x7fb46c153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60506/0 (socket says 172.21.15.7:60506) 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 -- 172.21.15.7:0/3975629380 learned_addr learned my addr 172.21.15.7:0/3975629380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb470e00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb471800640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e740 0x7fb46c0cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 -- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e740 msgr2=0x7fb46c0cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e740 0x7fb46c0cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 -- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb46c0d2af0 msgr2=0x7fb46c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb46be00640 1 -- 172.21.15.7:0/3975629380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c0cb7f0 con 0x7fb46c15e360 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.585+0000 7fb470e00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.586+0000 7fb46be00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c15e360 0x7fb46c153700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb45802a250 tx=0x7fb4580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.586+0000 7fb468c00640 1 -- 172.21.15.7:0/3975629380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458041070 con 0x7fb46c15e360 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.586+0000 7fb468c00640 1 -- 172.21.15.7:0/3975629380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45803c870 con 0x7fb46c15e360 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.586+0000 7fb468c00640 1 -- 172.21.15.7:0/3975629380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458037040 con 0x7fb46c15e360 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.586+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c0cba70 con 0x7fb46c15e360 2024-08-19T00:40:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.586+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c0cc030 con 0x7fb46c15e360 2024-08-19T00:40:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.587+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46c0d2f50 con 0x7fb46c15e360 2024-08-19T00:40:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.588+0000 7fb468c00640 1 -- 172.21.15.7:0/3975629380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb458044070 con 0x7fb46c15e360 2024-08-19T00:40:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.589+0000 7fb468c00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb44c06be30 0x7fb44c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.589+0000 7fb468c00640 1 -- 172.21.15.7:0/3975629380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fb4580abae0 con 0x7fb46c15e360 2024-08-19T00:40:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.589+0000 7fb470e00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb44c06be30 0x7fb44c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.590+0000 7fb470e00640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb44c06be30 0x7fb44c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb460006fd0 tx=0x7fb460008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:39.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.594+0000 7fb468c00640 1 -- 172.21.15.7:0/3975629380 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb46c0cb7f0 con 0x7fb46c15e360 2024-08-19T00:40:39.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.815+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb46c161fe0 con 0x7fb46c15e360 2024-08-19T00:40:39.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.816+0000 7fb468c00640 1 -- 172.21.15.7:0/3975629380 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5212 (secure 0 0 0) 0x7fb45807a300 con 0x7fb46c15e360 2024-08-19T00:40:39.817 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:39.817 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":59,"btime":"2024-08-19T00:40:39:375384+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/156180871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":156180871},{"type":"v1","addr":"172.21.15.7:6836","nonce":156180871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:38.377795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"c","rank":0,"incarnation":57,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-08-19T00:40:39.818 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 59 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb44c06be30 msgr2=0x7fb44c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb44c06be30 0x7fb44c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb460006fd0 tx=0x7fb460008040 comp rx=0 tx=0).stop 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c15e360 msgr2=0x7fb46c153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c15e360 0x7fb46c153700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb45802a250 tx=0x7fb4580046c0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 shutdown_connections 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb44c06be30 0x7fb44c06e2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb46c15e740 0x7fb46c0cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb46c15e360 0x7fb46c153700 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 --2- 172.21.15.7:0/3975629380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb46c0d2af0 0x7fb46c0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 >> 172.21.15.7:0/3975629380 conn(0x7fb46c08dbf0 msgr2=0x7fb46c0b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 shutdown_connections 2024-08-19T00:40:39.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:39.818+0000 7fb472200640 1 -- 172.21.15.7:0/3975629380 wait complete. 2024-08-19T00:40:40.238 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:39:35.566683+0000', 'modified': '2024-08-19T00:40:38.377795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5641': {'gid': 5641, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:rejoin', 'state_seq': 19, 'addr': '172.21.15.7:6837/992020227', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 992020227}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 992020227}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:40:40.238 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5641:up:rejoin 2024-08-19T00:40:41.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:40:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.407+0000 7fd9a6200640 1 Processor -- start 2024-08-19T00:40:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.407+0000 7fd9a6200640 1 -- start start 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd9a6200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9a009aa70 0x7fd9a009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd9a6200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd9a009b730 0x7fd9a006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd9a6200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a009b390 con 0x7fd9a0161f20 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd9a6200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a015ec30 con 0x7fd9a009aa70 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd9a6200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a015ef10 con 0x7fd9a009b730 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd99f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9a009aa70 0x7fd9a009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd99fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd9a0161f20 0x7fd9a01623b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48040/0 (socket says 172.21.15.7:48040) 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.408+0000 7fd99fe00640 1 -- 172.21.15.7:0/2114986484 learned_addr learned my addr 172.21.15.7:0/2114986484 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.409+0000 7fd99f400640 1 -- 172.21.15.7:0/2114986484 >> v2:172.21.15.162:3300/0 conn(0x7fd9a009b730 msgr2=0x7fd9a006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.409+0000 7fd99ea00640 1 --2- 172.21.15.7:0/2114986484 >> v2:172.21.15.162:3300/0 conn(0x7fd9a009b730 0x7fd9a006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.409+0000 7fd99f400640 1 --2- 172.21.15.7:0/2114986484 >> v2:172.21.15.162:3300/0 conn(0x7fd9a009b730 0x7fd9a006fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.409+0000 7fd99e000640 1 -- 172.21.15.7:0/2114986484 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88281931 0 0) 0x7fd9a009b390 con 0x7fd9a0161f20 2024-08-19T00:40:41.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.409+0000 7fd99f400640 1 -- 172.21.15.7:0/2114986484 >> v1:172.21.15.7:6789/0 conn(0x7fd9a0161f20 legacy=0x7fd9a01623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:41.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.409+0000 7fd99f400640 1 -- 172.21.15.7:0/2114986484 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a015f1f0 con 0x7fd9a009aa70 2024-08-19T00:40:41.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.409+0000 7fd99ea00640 1 --2- 172.21.15.7:0/2114986484 >> v2:172.21.15.162:3300/0 conn(0x7fd9a009b730 0x7fd9a006fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:40:41.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.410+0000 7fd99f400640 1 --2- 172.21.15.7:0/2114986484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a009aa70 0x7fd9a009ae50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0071bd0 tx=0x7fd99002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe64c050978ce17f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:41.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.410+0000 7fd99e000640 1 -- 172.21.15.7:0/2114986484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990037070 con 0x7fd9a009aa70 2024-08-19T00:40:41.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.410+0000 7fd99e000640 1 -- 172.21.15.7:0/2114986484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd990032440 con 0x7fd9a009aa70 2024-08-19T00:40:41.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.410+0000 7fd99e000640 1 -- 172.21.15.7:0/2114986484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990032810 con 0x7fd9a009aa70 2024-08-19T00:40:41.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 -- 172.21.15.7:0/2114986484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a009aa70 msgr2=0x7fd9a009ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:41.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 --2- 172.21.15.7:0/2114986484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a009aa70 0x7fd9a009ae50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0071bd0 tx=0x7fd99002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 -- 172.21.15.7:0/2114986484 shutdown_connections 2024-08-19T00:40:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 --2- 172.21.15.7:0/2114986484 >> v2:172.21.15.162:3300/0 conn(0x7fd9a009b730 0x7fd9a006fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 --2- 172.21.15.7:0/2114986484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a009aa70 0x7fd9a009ae50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 -- 172.21.15.7:0/2114986484 >> 172.21.15.7:0/2114986484 conn(0x7fd9a00d2190 msgr2=0x7fd9a00d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 -- 172.21.15.7:0/2114986484 shutdown_connections 2024-08-19T00:40:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.411+0000 7fd9a6200640 1 -- 172.21.15.7:0/2114986484 wait complete. 2024-08-19T00:40:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.413+0000 7fd9a6200640 1 Processor -- start 2024-08-19T00:40:41.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.413+0000 7fd9a6200640 1 -- start start 2024-08-19T00:40:41.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd9a6200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a009aa70 0x7fd9a015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd9a6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a009b730 0x7fd9a015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd9a6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a0161f20 0x7fd9a00b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd9a6200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a015e8f0 con 0x7fd9a0161f20 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd9a6200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0070170 con 0x7fd9a009b730 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd9a6200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a0162ac0 con 0x7fd9a009aa70 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd99fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a0161f20 0x7fd9a00b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd99fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a0161f20 0x7fd9a00b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60516/0 (socket says 172.21.15.7:60516) 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd99fe00640 1 -- 172.21.15.7:0/1388252247 learned_addr learned my addr 172.21.15.7:0/1388252247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd99ea00640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a009b730 0x7fd9a015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.414+0000 7fd99f400640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a009aa70 0x7fd9a015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd99fe00640 1 -- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a009aa70 msgr2=0x7fd9a015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd99fe00640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a009aa70 0x7fd9a015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd99fe00640 1 -- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a009b730 msgr2=0x7fd9a015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd99fe00640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a009b730 0x7fd9a015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd99fe00640 1 -- 172.21.15.7:0/1388252247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a01e98e0 con 0x7fd9a0161f20 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd99f400640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a009aa70 0x7fd9a015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd99fe00640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a0161f20 0x7fd9a00b0a00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd99800c700 tx=0x7fd99800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd997400640 1 -- 172.21.15.7:0/1388252247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd998018070 con 0x7fd9a0161f20 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd997400640 1 -- 172.21.15.7:0/1388252247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99800ce10 con 0x7fd9a0161f20 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd997400640 1 -- 172.21.15.7:0/1388252247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99800a880 con 0x7fd9a0161f20 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a00b0f40 con 0x7fd9a0161f20 2024-08-19T00:40:41.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.415+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a01e8e00 con 0x7fd9a0161f20 2024-08-19T00:40:41.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.416+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a006fc30 con 0x7fd9a0161f20 2024-08-19T00:40:41.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.417+0000 7fd997400640 1 -- 172.21.15.7:0/1388252247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd99801b070 con 0x7fd9a0161f20 2024-08-19T00:40:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.418+0000 7fd997400640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd98006be30 0x7fd98006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.418+0000 7fd997400640 1 -- 172.21.15.7:0/1388252247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fd99808a450 con 0x7fd9a0161f20 2024-08-19T00:40:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.418+0000 7fd99f400640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd98006be30 0x7fd98006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.419+0000 7fd99f400640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd98006be30 0x7fd98006e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd990034000 tx=0x7fd99002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.423+0000 7fd997400640 1 -- 172.21.15.7:0/1388252247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd9980586b0 con 0x7fd9a0161f20 2024-08-19T00:40:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.642+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9a00d2cb0 con 0x7fd9a0161f20 2024-08-19T00:40:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.642+0000 7fd997400640 1 -- 172.21.15.7:0/1388252247 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5219 (secure 0 0 0) 0x7fd99805c9b0 con 0x7fd9a0161f20 2024-08-19T00:40:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:40:41.644 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"btime":"2024-08-19T00:40:40:377588+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/156180871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":156180871},{"type":"v1","addr":"172.21.15.7:6836","nonce":156180871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:40.377583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":20,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5641,"qdb_cluster":[5641]},"id":4}]} 2024-08-19T00:40:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-08-19T00:40:41.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.644+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd98006be30 msgr2=0x7fd98006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:41.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.644+0000 7fd9a6200640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd98006be30 0x7fd98006e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd990034000 tx=0x7fd99002e000 comp rx=0 tx=0).stop 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.644+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a0161f20 msgr2=0x7fd9a00b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.644+0000 7fd9a6200640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a0161f20 0x7fd9a00b0a00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd99800c700 tx=0x7fd99800cbc0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.644+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 shutdown_connections 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.645+0000 7fd9a6200640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd98006be30 0x7fd98006e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.645+0000 7fd9a6200640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a0161f20 0x7fd9a00b0a00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.645+0000 7fd9a6200640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a009b730 0x7fd9a015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.645+0000 7fd9a6200640 1 --2- 172.21.15.7:0/1388252247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a009aa70 0x7fd9a015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.645+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 >> 172.21.15.7:0/1388252247 conn(0x7fd9a00d2190 msgr2=0x7fd9a00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.645+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 shutdown_connections 2024-08-19T00:40:41.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:41.645+0000 7fd9a6200640 1 -- 172.21.15.7:0/1388252247 wait complete. 2024-08-19T00:40:42.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:39:35.566683+0000', 'modified': '2024-08-19T00:40:40.377583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5641': {'gid': 5641, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.7:6837/992020227', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 992020227}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 992020227}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5641, 'qdb_cluster': [5641]} 2024-08-19T00:40:42.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:40:42.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:40:42.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.223+0000 7fc4eac00640 1 Processor -- start 2024-08-19T00:40:42.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.223+0000 7fc4eac00640 1 -- start start 2024-08-19T00:40:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.224+0000 7fc4eac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e4159bf0 0x7fc4e4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.224+0000 7fc4eac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4e40739a0 0x7fc4e40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.224+0000 7fc4eac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e406f7f0 con 0x7fc4e40cea40 2024-08-19T00:40:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.224+0000 7fc4eac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e406f510 con 0x7fc4e40739a0 2024-08-19T00:40:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.224+0000 7fc4eac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e4072980 con 0x7fc4e4159bf0 2024-08-19T00:40:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e8c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc4e40cea40 0x7fc4e40d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48044/0 (socket says 172.21.15.7:48044) 2024-08-19T00:40:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e8c00640 1 -- 172.21.15.7:0/65270556 learned_addr learned my addr 172.21.15.7:0/65270556 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:40:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e3400640 1 --2- 172.21.15.7:0/65270556 >> v2:172.21.15.162:3300/0 conn(0x7fc4e40739a0 0x7fc4e40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e4159bf0 0x7fc4e4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e2a00640 1 -- 172.21.15.7:0/65270556 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913146603 0 0) 0x7fc4e406f7f0 con 0x7fc4e40cea40 2024-08-19T00:40:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e2a00640 1 -- 172.21.15.7:0/65270556 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c8003520 con 0x7fc4e40cea40 2024-08-19T00:40:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e3400640 1 -- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e4159bf0 msgr2=0x7fc4e4073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e3400640 1 --2- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e4159bf0 0x7fc4e4073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e3400640 1 -- 172.21.15.7:0/65270556 >> v1:172.21.15.7:6789/0 conn(0x7fc4e40cea40 legacy=0x7fc4e40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.225+0000 7fc4e3400640 1 -- 172.21.15.7:0/65270556 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e4072c60 con 0x7fc4e40739a0 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.226+0000 7fc4e3400640 1 --2- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e40739a0 0x7fc4e40ce500 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097a0 tx=0x7fc4d002a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d977c58f26bcc52 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4e2a00640 1 -- 172.21.15.7:0/65270556 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0037070 con 0x7fc4e40739a0 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4e2a00640 1 -- 172.21.15.7:0/65270556 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d002ae40 con 0x7fc4e40739a0 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4e2a00640 1 -- 172.21.15.7:0/65270556 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0032660 con 0x7fc4e40739a0 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4eac00640 1 -- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e40739a0 msgr2=0x7fc4e40ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4eac00640 1 --2- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e40739a0 0x7fc4e40ce500 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00097a0 tx=0x7fc4d002a0f0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4eac00640 1 -- 172.21.15.7:0/65270556 shutdown_connections 2024-08-19T00:40:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4eac00640 1 --2- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e40739a0 0x7fc4e40ce500 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4eac00640 1 --2- 172.21.15.7:0/65270556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e4159bf0 0x7fc4e4073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.227+0000 7fc4eac00640 1 -- 172.21.15.7:0/65270556 >> 172.21.15.7:0/65270556 conn(0x7fc4e406bc70 msgr2=0x7fc4e406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.228+0000 7fc4eac00640 1 -- 172.21.15.7:0/65270556 shutdown_connections 2024-08-19T00:40:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.228+0000 7fc4eac00640 1 -- 172.21.15.7:0/65270556 wait complete. 2024-08-19T00:40:42.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.229+0000 7fc4eac00640 1 Processor -- start 2024-08-19T00:40:42.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.229+0000 7fc4eac00640 1 -- start start 2024-08-19T00:40:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.230+0000 7fc4eac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40739a0 0x7fc4e40cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.230+0000 7fc4eac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e40cea40 0x7fc4e40c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.230+0000 7fc4eac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e4159bf0 0x7fc4e40c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.230+0000 7fc4eac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e415a150 con 0x7fc4e40739a0 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.230+0000 7fc4eac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4159fd0 con 0x7fc4e4159bf0 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.230+0000 7fc4eac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e40d0ad0 con 0x7fc4e40cea40 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40739a0 0x7fc4e40cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40739a0 0x7fc4e40cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60528/0 (socket says 172.21.15.7:60528) 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2093492542 learned_addr learned my addr 172.21.15.7:0/2093492542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e4159bf0 0x7fc4e40c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e40cea40 0x7fc4e40c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e40cea40 msgr2=0x7fc4e40c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e40cea40 0x7fc4e40c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e4159bf0 msgr2=0x7fc4e40c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e4159bf0 0x7fc4e40c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2093492542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e41f4ed0 con 0x7fc4e40739a0 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e4159bf0 0x7fc4e40c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.231+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e40cea40 0x7fc4e40c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.232+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40739a0 0x7fc4e40cca60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400e9b0 tx=0x7fc4d400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.232+0000 7fc4dbe00640 1 -- 172.21.15.7:0/2093492542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4017070 con 0x7fc4e40739a0 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.232+0000 7fc4dbe00640 1 -- 172.21.15.7:0/2093492542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d400c9a0 con 0x7fc4e40739a0 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.232+0000 7fc4dbe00640 1 -- 172.21.15.7:0/2093492542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400cd90 con 0x7fc4e40739a0 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.232+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e414be10 con 0x7fc4e40739a0 2024-08-19T00:40:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.232+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e41494d0 con 0x7fc4e40739a0 2024-08-19T00:40:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.235+0000 7fc4dbe00640 1 -- 172.21.15.7:0/2093492542 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4d401a070 con 0x7fc4e40739a0 2024-08-19T00:40:42.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.236+0000 7fc4dbe00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c406be30 0x7fc4c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.236+0000 7fc4dbe00640 1 -- 172.21.15.7:0/2093492542 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fc4d408b3f0 con 0x7fc4e40739a0 2024-08-19T00:40:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.236+0000 7fc4edbe2740 1 Processor -- start 2024-08-19T00:40:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.236+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c406be30 0x7fc4c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.236+0000 7fc4edbe2740 1 -- start start 2024-08-19T00:40:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c406be30 0x7fc4c406e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0034000 tx=0x7fc4d002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40cc0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3470 0x562c40ce3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cd8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c40bf8ba0 con 0x562c40cbff50 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c40b91230 con 0x562c40ce3dd0 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c40bf4b60 con 0x562c40ce3470 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40cc0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40cc0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60532/0 (socket says 172.21.15.7:60532) 2024-08-19T00:40:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.237+0000 7fc4e3e00640 1 -- 172.21.15.7:0/3998953894 learned_addr learned my addr 172.21.15.7:0/3998953894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cd8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4e3e00640 1 -- 172.21.15.7:0/3998953894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3470 msgr2=0x562c40ce3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3470 0x562c40ce3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4e3e00640 1 -- 172.21.15.7:0/3998953894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 msgr2=0x562c40cd8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cd8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4e3e00640 1 -- 172.21.15.7:0/3998953894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c40bc2bb0 con 0x562c40cbff50 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40cc0330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4061bc0 tx=0x7fc4d4059d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2226046d5341b4d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4cfe00640 1 -- 172.21.15.7:0/3998953894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4021040 con 0x562c40cbff50 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4cfe00640 1 -- 172.21.15.7:0/3998953894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d4057810 con 0x562c40cbff50 2024-08-19T00:40:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.238+0000 7fc4cfe00640 1 -- 172.21.15.7:0/3998953894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4055b80 con 0x562c40cbff50 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 -- 172.21.15.7:0/3998953894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 msgr2=0x562c40cc0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40cc0330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4061bc0 tx=0x7fc4d4059d50 comp rx=0 tx=0).stop 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 -- 172.21.15.7:0/3998953894 shutdown_connections 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cd8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3470 0x562c40ce3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/3998953894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40cc0330 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 -- 172.21.15.7:0/3998953894 >> 172.21.15.7:0/3998953894 conn(0x562c40c5d110 msgr2=0x562c40cdad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 -- 172.21.15.7:0/3998953894 shutdown_connections 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.239+0000 7fc4edbe2740 1 -- 172.21.15.7:0/3998953894 wait complete. 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.240+0000 7fc4edbe2740 1 -- start start 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.240+0000 7fc4edbe2740 1 Processor -- start 2024-08-19T00:40:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c90630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cb8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40c96390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c40cdcea0 con 0x562c40cbff50 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c40bb4250 con 0x562c40ce3470 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c40cdc5b0 con 0x562c40ce3dd0 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4edbe2740 10 client.0 _ll_register_callbacks cb 0x562c40bb8740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c90630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c90630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60544/0 (socket says 172.21.15.7:60544) 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2969709385 learned_addr learned my addr 172.21.15.7:0/2969709385 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cb8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40c96390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 msgr2=0x562c40c96390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.241+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40c96390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 msgr2=0x562c40cb8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cb8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4e3e00640 1 -- 172.21.15.7:0/2969709385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c4090c2d0 con 0x562c40cbff50 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40c96390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c90630 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40594a0 tx=0x7fc4d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7874706c676ed10 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2969709385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4076060 con 0x562c40cbff50 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2969709385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fc4d4055b80 con 0x562c40cbff50 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d4057810 con 0x562c40cbff50 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2969709385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fc4d407d050 con 0x562c40cbff50 2024-08-19T00:40:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4edbe2740 10 client.6183 fetch_fsmap learned FSMap version 60 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x562c409d66b0 con 0x562c40cbff50 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.242+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2969709385 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d4057810 con 0x562c40cbff50 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2969709385 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7fc4d4058960 con 0x562c40cbff50 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4edbe2740 10 client.6183 fetch_fsmap finished waiting for FSMap version 60 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4edbe2740 10 client.6183 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4edbe2740 20 client.6183 populate_metadata read hostname 'smithi007' 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf6350 0x562c40cf8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4edbe2740 4 client.6183 mds_command: new command op to 5641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 --> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c40c062d0 con 0x562c40cf6350 2024-08-19T00:40:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.243+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf6350 0x562c40cf8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.244+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf6350 0x562c40cf8740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb3428086d934ce2 server_cookie=d582a5a9128cc959 in_seq=0 out_seq=0 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.244+0000 7fc4ccc00640 10 client.6183 ms_handle_connect on v2:172.21.15.7:6835/992020227 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.244+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2969709385 <== mds.0 v2:172.21.15.7:6835/992020227 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c40c062d0 con 0x562c40cf6350 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.244+0000 7fc4ccc00640 10 client.6183 handle_command_reply: tid=0 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.244+0000 7fc4edbe2740 1 client.6183 shutdown 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 msgr2=0x562c40c90630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c90630 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40594a0 tx=0x7fc4d4000bc0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 shutdown_connections 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf6350 0x562c40cf8740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40c96390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cb8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2969709385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c90630 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4ccc00640 0 client.6183 ms_handle_reset on v2:172.21.15.7:6835/992020227 2024-08-19T00:40:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 >> 172.21.15.7:0/2969709385 conn(0x562c40c5d110 msgr2=0x562c40cdea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 shutdown_connections 2024-08-19T00:40:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2969709385 wait complete. 2024-08-19T00:40:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.245+0000 7fc4edbe2740 20 client.6183 trim_cache size 0 max 16384 2024-08-19T00:40:42.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.264+0000 7fc4edbe2740 1 Processor -- start 2024-08-19T00:40:42.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.264+0000 7fc4edbe2740 1 -- start start 2024-08-19T00:40:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c92050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40ce2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41ff990 con 0x562c40cbff50 2024-08-19T00:40:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e414a5e0 con 0x562c40ce3470 2024-08-19T00:40:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e414ac30 con 0x562c40ce3dd0 2024-08-19T00:40:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c92050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c92050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60558/0 (socket says 172.21.15.7:60558) 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4e3e00640 1 -- 172.21.15.7:0/1264553960 learned_addr learned my addr 172.21.15.7:0/1264553960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40ce2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.265+0000 7fc4e3400640 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4e3e00640 1 -- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 msgr2=0x562c40ce2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40ce2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4e3e00640 1 -- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 msgr2=0x562c40cddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cddb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4e3e00640 1 -- 172.21.15.7:0/1264553960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c40cdbf20 con 0x562c40cbff50 2024-08-19T00:40:42.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4e3400640 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:42.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c92050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400e980 tx=0x7fc4d406f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbab826fa3562422 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4cf400640 1 -- 172.21.15.7:0/1264553960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4021070 con 0x562c40cbff50 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4cf400640 1 -- 172.21.15.7:0/1264553960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d40893e0 con 0x562c40cbff50 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.266+0000 7fc4cf400640 1 -- 172.21.15.7:0/1264553960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4055b80 con 0x562c40cbff50 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 -- 172.21.15.7:0/1264553960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 msgr2=0x562c40c92050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c92050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400e980 tx=0x7fc4d406f040 comp rx=0 tx=0).stop 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 -- 172.21.15.7:0/1264553960 shutdown_connections 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40ce3dd0 0x562c40ce2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3470 0x562c40cddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/1264553960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40cbff50 0x562c40c92050 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 -- 172.21.15.7:0/1264553960 >> 172.21.15.7:0/1264553960 conn(0x562c40c5d110 msgr2=0x562c40cd0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 -- 172.21.15.7:0/1264553960 shutdown_connections 2024-08-19T00:40:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 -- 172.21.15.7:0/1264553960 wait complete. 2024-08-19T00:40:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.267+0000 7fc4edbe2740 1 -- start start 2024-08-19T00:40:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.268+0000 7fc4edbe2740 1 Processor -- start 2024-08-19T00:40:42.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40cbff50 0x562c40d58550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40ce3470 0x562c40cb8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4edbe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cb85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c40cdcea0 con 0x562c40ce3470 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c40bb4250 con 0x562c40ce3dd0 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4edbe2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c40c945a0 con 0x562c40cbff50 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4edbe2740 10 client.0 _ll_register_callbacks cb 0x7fc4d4071070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40ce3470 0x562c40cb8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40ce3470 0x562c40cb8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60560/0 (socket says 172.21.15.7:60560) 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 -- 172.21.15.7:0/2077430862 learned_addr learned my addr 172.21.15.7:0/2077430862 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cb85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40cbff50 0x562c40d58550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 -- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40cbff50 msgr2=0x562c40d58550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40cbff50 0x562c40d58550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 -- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 msgr2=0x562c40cb85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cb85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3400640 1 -- 172.21.15.7:0/2077430862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c40cf2f90 con 0x562c40ce3470 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.269+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40cbff50 0x562c40d58550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4e3400640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40ce3470 0x562c40cb8070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00098c0 tx=0x7fc4d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81aa140f036fc9e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2077430862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d004e070 con 0x562c40ce3470 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2077430862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fc4d0053ba0 con 0x562c40ce3470 2024-08-19T00:40:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d40893e0 con 0x562c40ce3470 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2077430862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fc4d0037040 con 0x562c40ce3470 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4edbe2740 10 client.6189 fetch_fsmap learned FSMap version 60 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x562c40cf3b10 con 0x562c40ce3470 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.270+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2077430862 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d40893e0 con 0x562c40ce3470 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2077430862 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7fc4d408b070 con 0x562c40ce3470 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4edbe2740 10 client.6189 fetch_fsmap finished waiting for FSMap version 60 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4edbe2740 10 client.6189 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:40:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4edbe2740 20 client.6189 populate_metadata read hostname 'smithi007' 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf04b0 0x562c40cdab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4edbe2740 4 client.6189 mds_command: new command op to 5641 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 --> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] -- command(tid 0: {"prefix": "status"}) -- 0x562c40c00620 con 0x562c40cf04b0 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf04b0 0x562c40cdab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf04b0 0x562c40cdab60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b343ed4394154e5 server_cookie=53c5b5d9633639e6 in_seq=0 out_seq=0 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.271+0000 7fc4ccc00640 10 client.6189 ms_handle_connect on v2:172.21.15.7:6835/992020227 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4ccc00640 1 -- 172.21.15.7:0/2077430862 <== mds.0 v2:172.21.15.7:6835/992020227 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562c40c00620 con 0x562c40cf04b0 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4ccc00640 10 client.6189 handle_command_reply: tid=0 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 client.6189 shutdown 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40ce3470 msgr2=0x562c40cb8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40ce3470 0x562c40cb8070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00098c0 tx=0x7fc4d0004730 comp rx=0 tx=0).stop 2024-08-19T00:40:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 shutdown_connections 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x562c40cf04b0 0x562c40cdab60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c40ce3dd0 0x562c40cb85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c40ce3470 0x562c40cb8070 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4ccc00640 0 client.6189 ms_handle_reset on v2:172.21.15.7:6835/992020227 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 --2- 172.21.15.7:0/2077430862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c40cbff50 0x562c40d58550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 >> 172.21.15.7:0/2077430862 conn(0x562c40c5d110 msgr2=0x562c40cbf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 shutdown_connections 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 1 -- 172.21.15.7:0/2077430862 wait complete. 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.272+0000 7fc4edbe2740 20 client.6189 trim_cache size 0 max 16384 2024-08-19T00:40:42.279 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5641, 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.8972069080000002, 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 60, 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 61, 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 61, 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 70.782095690999995 2024-08-19T00:40:42.280 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:40:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c406be30 msgr2=0x7fc4c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c406be30 0x7fc4c406e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0034000 tx=0x7fc4d002e000 comp rx=0 tx=0).stop 2024-08-19T00:40:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40739a0 msgr2=0x7fc4e40cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:40:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40739a0 0x7fc4e40cca60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400e9b0 tx=0x7fc4d400ee70 comp rx=0 tx=0).stop 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 shutdown_connections 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c406be30 0x7fc4c406e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4e4159bf0 0x7fc4e40c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4e40cea40 0x7fc4e40c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 --2- 172.21.15.7:0/2093492542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e40739a0 0x7fc4e40cca60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 >> 172.21.15.7:0/2093492542 conn(0x7fc4e406bc70 msgr2=0x7fc4e4074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 shutdown_connections 2024-08-19T00:40:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:42.273+0000 7fc4eac00640 1 -- 172.21.15.7:0/2093492542 wait complete. 2024-08-19T00:40:43.125 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:40:43.121+0000 7fcf17e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:40:44.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-08-19T00:40:53.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:53.953+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:40:53.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:53.954+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:40:53.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:53.954+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:40:53.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:53.954+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:40:53.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:40:53.954+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-08-19T00:41:01.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:41:01.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:41:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:08.957+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:41:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:08.957+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:41:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:08.957+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:41:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:08.957+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:41:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:08.957+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-08-19T00:41:23.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:23.965+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:41:23.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:23.965+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:41:23.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:23.965+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:41:23.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:23.965+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:41:23.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:23.965+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-08-19T00:41:31.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:41:31.766 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:41:38.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:38.969+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:41:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:38.969+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:41:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:38.969+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:41:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:38.969+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:41:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:38.969+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-08-19T00:41:53.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:53.977+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:41:53.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:53.977+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:41:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:53.977+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:41:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:53.977+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:41:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:41:53.978+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-08-19T00:42:01.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:42:01.859 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:42:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:08.982+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:08.982+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-19T00:42:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:08.982+0000 7fd1a9e00640 1 -- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 msgr2=0x56133f093d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T00:42:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:08.982+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:42:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:08.982+0000 7fd1a9e00640 1 --2- 172.21.15.7:0/3613639029 >> [v2:172.21.15.7:6834/2987342349,v1:172.21.15.7:6836/2987342349] conn(0x56133f081540 0x56133f093d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-08-19T00:42:13.290 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-19T00:42:13.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:42:13.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.457+0000 7f7f6ec00640 1 Processor -- start 2024-08-19T00:42:13.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.457+0000 7f7f6ec00640 1 -- start start 2024-08-19T00:42:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.458+0000 7f7f6ec00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f6809b730 0x7f7f6806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.458+0000 7f7f6ec00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f680d0290 0x7f7f680d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f6ec00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f6815ec30 con 0x7f7f6809aa70 2024-08-19T00:42:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f6ec00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6815ef10 con 0x7f7f6809b730 2024-08-19T00:42:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f6ec00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6815f1f0 con 0x7f7f680d0290 2024-08-19T00:42:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f5fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f6809b730 0x7f7f6806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f5fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f6809b730 0x7f7f6806fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49818/0 (socket says 172.21.15.7:49818) 2024-08-19T00:42:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f5fe00640 1 -- 172.21.15.7:0/4147893320 learned_addr learned my addr 172.21.15.7:0/4147893320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f6cc00640 1 --2- 172.21.15.7:0/4147893320 >> v2:172.21.15.162:3300/0 conn(0x7f7f680d0290 0x7f7f680d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f5fe00640 1 -- 172.21.15.7:0/4147893320 >> v2:172.21.15.162:3300/0 conn(0x7f7f680d0290 msgr2=0x7f7f680d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f5fe00640 1 --2- 172.21.15.7:0/4147893320 >> v2:172.21.15.162:3300/0 conn(0x7f7f680d0290 0x7f7f680d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f5fe00640 1 -- 172.21.15.7:0/4147893320 >> v1:172.21.15.162:6789/0 conn(0x7f7f6809aa70 legacy=0x7f7f6809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.459+0000 7f7f5fe00640 1 -- 172.21.15.7:0/4147893320 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6815f4d0 con 0x7f7f6809b730 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.460+0000 7f7f5fe00640 1 --2- 172.21.15.7:0/4147893320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809b730 0x7f7f6806fc30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7f680732b0 tx=0x7f7f5002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2002764e836425 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f67400640 1 -- 172.21.15.7:0/4147893320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50037070 con 0x7f7f6809b730 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f67400640 1 -- 172.21.15.7:0/4147893320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f50032440 con 0x7f7f6809b730 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f67400640 1 -- 172.21.15.7:0/4147893320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50032810 con 0x7f7f6809b730 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 -- 172.21.15.7:0/4147893320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809b730 msgr2=0x7f7f6806fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/4147893320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809b730 0x7f7f6806fc30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7f680732b0 tx=0x7f7f5002a230 comp rx=0 tx=0).stop 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 -- 172.21.15.7:0/4147893320 shutdown_connections 2024-08-19T00:42:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/4147893320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809b730 0x7f7f6806fc30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/4147893320 >> v2:172.21.15.162:3300/0 conn(0x7f7f680d0290 0x7f7f680d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 -- 172.21.15.7:0/4147893320 >> 172.21.15.7:0/4147893320 conn(0x7f7f680d2190 msgr2=0x7f7f680d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 -- 172.21.15.7:0/4147893320 shutdown_connections 2024-08-19T00:42:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.461+0000 7f7f6ec00640 1 -- 172.21.15.7:0/4147893320 wait complete. 2024-08-19T00:42:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.463+0000 7f7f6ec00640 1 Processor -- start 2024-08-19T00:42:13.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.463+0000 7f7f6ec00640 1 -- start start 2024-08-19T00:42:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f6ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809aa70 0x7f7f680b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f6ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f6809b730 0x7f7f680b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f6ec00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f680d0290 0x7f7f680b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f6ec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680d0c60 con 0x7f7f6809aa70 2024-08-19T00:42:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f6ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6815e8f0 con 0x7f7f6809b730 2024-08-19T00:42:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f6ec00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680d0de0 con 0x7f7f680d0290 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809aa70 0x7f7f680b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809aa70 0x7f7f680b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49824/0 (socket says 172.21.15.7:49824) 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f67e00640 1 -- 172.21.15.7:0/906156921 learned_addr learned my addr 172.21.15.7:0/906156921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f5fe00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f6809b730 0x7f7f680b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.464+0000 7f7f6cc00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f680d0290 0x7f7f680b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f67e00640 1 -- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f680d0290 msgr2=0x7f7f680b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f67e00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f680d0290 0x7f7f680b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f67e00640 1 -- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f6809b730 msgr2=0x7f7f680b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f67e00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f6809b730 0x7f7f680b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f67e00640 1 -- 172.21.15.7:0/906156921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f681588d0 con 0x7f7f6809aa70 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f6cc00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f680d0290 0x7f7f680b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f67e00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809aa70 0x7f7f680b5250 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800c460 tx=0x7f7f5800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f64c00640 1 -- 172.21.15.7:0/906156921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58016020 con 0x7f7f6809aa70 2024-08-19T00:42:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f64c00640 1 -- 172.21.15.7:0/906156921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58012870 con 0x7f7f6809aa70 2024-08-19T00:42:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f680ce160 con 0x7f7f6809aa70 2024-08-19T00:42:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f64c00640 1 -- 172.21.15.7:0/906156921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58012c60 con 0x7f7f6809aa70 2024-08-19T00:42:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.465+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f680b7d20 con 0x7f7f6809aa70 2024-08-19T00:42:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.466+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f68158aa0 con 0x7f7f6809aa70 2024-08-19T00:42:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.467+0000 7f7f64c00640 1 -- 172.21.15.7:0/906156921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f58019020 con 0x7f7f6809aa70 2024-08-19T00:42:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.468+0000 7f7f64c00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f4406be30 0x7f7f4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.468+0000 7f7f64c00640 1 -- 172.21.15.7:0/906156921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f7f5808ac20 con 0x7f7f6809aa70 2024-08-19T00:42:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.468+0000 7f7f5fe00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f4406be30 0x7f7f4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.469+0000 7f7f5fe00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f4406be30 0x7f7f4406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f50034000 tx=0x7f7f5002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.473+0000 7f7f64c00640 1 -- 172.21.15.7:0/906156921 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7f58020030 con 0x7f7f6809aa70 2024-08-19T00:42:13.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.691+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7f680d2cb0 con 0x7f7f6809aa70 2024-08-19T00:42:13.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.692+0000 7f7f64c00640 1 -- 172.21.15.7:0/906156921 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) ==== 53+0+73 (secure 0 0 0) 0x7f7f580594d0 con 0x7f7f6809aa70 2024-08-19T00:42:13.694 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f4406be30 msgr2=0x7f7f4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f4406be30 0x7f7f4406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f50034000 tx=0x7f7f5002e000 comp rx=0 tx=0).stop 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809aa70 msgr2=0x7f7f680b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809aa70 0x7f7f680b5250 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800c460 tx=0x7f7f5800c920 comp rx=0 tx=0).stop 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 shutdown_connections 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f4406be30 0x7f7f4406e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f680d0290 0x7f7f680b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f6809b730 0x7f7f680b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 --2- 172.21.15.7:0/906156921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f6809aa70 0x7f7f680b5250 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 >> 172.21.15.7:0/906156921 conn(0x7f7f680d2190 msgr2=0x7f7f680d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:13.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 shutdown_connections 2024-08-19T00:42:13.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:13.694+0000 7f7f6ec00640 1 -- 172.21.15.7:0/906156921 wait complete. 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:42:13.712 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:42:13.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:13.713 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:42:13.748 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:42:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:42:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:42:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:42:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:13.748 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42528sec preferred_lft 42528sec 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:42:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:42:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:42:13.751 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:42:13.751 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:13.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:13.752 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:42:13.846 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:42:13.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:13.849 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:42:13.885 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:42:13.885 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:42:13.885 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:42:13.885 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:42:13.886 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:42:13.886 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:42:13.886 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:42:13.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:42:13.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:42:13.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:42:13.886 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:42:14.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:42:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:42:14.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:14.083 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:42:14.119 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:42:14.119 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:42:14.120 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:42:14.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:14.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:42:14.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:42:14.215 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:14.250 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:42:14.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:42:14.250 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:14.325 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:42:14.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:14.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:14.454 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:14.454 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:42:14.454 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:42:14.470 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:14.470 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:42:14.470 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:42:14.470 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:42:14.470 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:42:14.494 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:14.494 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:42:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:42:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:42:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:42:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:42:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:42:14.495 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:42:14.496 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:42:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:42:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:42:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:42:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:42:14.499 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:42:14.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:14.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:14.556 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:42:14.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:42:14.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:42:14.646 INFO:teuthology.orchestra.run.smithi007.stdout:client6022 2024-08-19T00:42:14.646 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:42:14.646 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:14.682 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat a/ && find a/') 2024-08-19T00:42:14.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: File: a/ 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 2ah/42d Inode: 1099511627776 Links: 4 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1333/ ubuntu) 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-19 00:39:57.899158110 +0000 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-19 00:39:57.904158036 +0000 2024-08-19T00:42:14.806 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-19 00:39:57.904158036 +0000 2024-08-19T00:42:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-19 00:39:57.899158110 +0000 2024-08-19T00:42:14.813 INFO:teuthology.orchestra.run.smithi007.stdout:a/ 2024-08-19T00:42:14.813 INFO:teuthology.orchestra.run.smithi007.stdout:a/c 2024-08-19T00:42:14.813 INFO:teuthology.orchestra.run.smithi007.stdout:a/c/d 2024-08-19T00:42:14.813 INFO:teuthology.orchestra.run.smithi007.stdout:a/b 2024-08-19T00:42:14.813 INFO:teuthology.orchestra.run.smithi007.stdout:a/b/d 2024-08-19T00:42:14.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:42:14.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-08-19T00:42:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.979+0000 7f4bf9200640 1 Processor -- start 2024-08-19T00:42:14.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.979+0000 7f4bf9200640 1 -- start start 2024-08-19T00:42:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.980+0000 7f4bf9200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bf40b5130 0x7f4bf40aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.980+0000 7f4bf9200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bf40acef0 con 0x7f4bf415bfb0 2024-08-19T00:42:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.980+0000 7f4bf9200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bf40ad1d0 con 0x7f4bf415c390 2024-08-19T00:42:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.980+0000 7f4bf9200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4bf40ad790 con 0x7f4bf40b5130 2024-08-19T00:42:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.980+0000 7f4bf1e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4bf415bfb0 0x7f4bf40b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53456/0 (socket says 172.21.15.7:53456) 2024-08-19T00:42:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.980+0000 7f4bf1e00640 1 -- 172.21.15.7:0/1180841507 learned_addr learned my addr 172.21.15.7:0/1180841507 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:14.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.980+0000 7f4bebe00640 1 --2- 172.21.15.7:0/1180841507 >> v2:172.21.15.7:3300/0 conn(0x7f4bf40b5130 0x7f4bf40aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.981+0000 7f4bf1400640 1 -- 172.21.15.7:0/1180841507 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53729405 0 0) 0x7f4bf40acef0 con 0x7f4bf415bfb0 2024-08-19T00:42:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.981+0000 7f4bf1400640 1 -- 172.21.15.7:0/1180841507 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bd8003520 con 0x7f4bf415bfb0 2024-08-19T00:42:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.981+0000 7f4bebe00640 1 -- 172.21.15.7:0/1180841507 >> v1:172.21.15.162:6789/0 conn(0x7f4bf415c390 legacy=0x7f4bf4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:14.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.981+0000 7f4bebe00640 1 -- 172.21.15.7:0/1180841507 >> v1:172.21.15.7:6789/0 conn(0x7f4bf415bfb0 legacy=0x7f4bf40b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.981+0000 7f4bebe00640 1 -- 172.21.15.7:0/1180841507 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf40ad4b0 con 0x7f4bf40b5130 2024-08-19T00:42:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.982+0000 7f4bebe00640 1 --2- 172.21.15.7:0/1180841507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf40b5130 0x7f4bf40aebd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0097a0 tx=0x7f4bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5b7aae783c95e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.982+0000 7f4bf1400640 1 -- 172.21.15.7:0/1180841507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc037070 con 0x7f4bf40b5130 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.982+0000 7f4bf1400640 1 -- 172.21.15.7:0/1180841507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bdc032440 con 0x7f4bf40b5130 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.982+0000 7f4bf1400640 1 -- 172.21.15.7:0/1180841507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc032810 con 0x7f4bf40b5130 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.983+0000 7f4bf9200640 1 -- 172.21.15.7:0/1180841507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf40b5130 msgr2=0x7f4bf40aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.983+0000 7f4bf9200640 1 --2- 172.21.15.7:0/1180841507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf40b5130 0x7f4bf40aebd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0097a0 tx=0x7f4bdc02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.983+0000 7f4bf9200640 1 -- 172.21.15.7:0/1180841507 shutdown_connections 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.983+0000 7f4bf9200640 1 --2- 172.21.15.7:0/1180841507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf40b5130 0x7f4bf40aebd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.983+0000 7f4bf9200640 1 -- 172.21.15.7:0/1180841507 >> 172.21.15.7:0/1180841507 conn(0x7f4bf40b2300 msgr2=0x7f4bf406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.983+0000 7f4bf9200640 1 -- 172.21.15.7:0/1180841507 shutdown_connections 2024-08-19T00:42:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.983+0000 7f4bf9200640 1 -- 172.21.15.7:0/1180841507 wait complete. 2024-08-19T00:42:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.984+0000 7f4bf9200640 1 Processor -- start 2024-08-19T00:42:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.985+0000 7f4bf9200640 1 -- start start 2024-08-19T00:42:14.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.985+0000 7f4bf9200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bf40b5130 0x7f4bf41528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.985+0000 7f4bf9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bf415bfb0 0x7f4bf415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf415c390 0x7f4bf40c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf9200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf40af290 con 0x7f4bf415c390 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf9200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf40af110 con 0x7f4bf415bfb0 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf9200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf40af410 con 0x7f4bf40b5130 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf415c390 0x7f4bf40c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf415c390 0x7f4bf40c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34032/0 (socket says 172.21.15.7:34032) 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 -- 172.21.15.7:0/3441124075 learned_addr learned my addr 172.21.15.7:0/3441124075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bf40b5130 0x7f4bf41528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bebe00640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bf415bfb0 0x7f4bf415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 -- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bf40b5130 msgr2=0x7f4bf41528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:14.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bf40b5130 0x7f4bf41528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 -- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bf415bfb0 msgr2=0x7f4bf415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bf415bfb0 0x7f4bf415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bf2800640 1 -- 172.21.15.7:0/3441124075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf415f5a0 con 0x7f4bf415c390 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.986+0000 7f4bebe00640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bf415bfb0 0x7f4bf415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.987+0000 7f4bf2800640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf415c390 0x7f4bf40c9290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00b970 tx=0x7f4bec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.987+0000 7f4bea000640 1 -- 172.21.15.7:0/3441124075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec019070 con 0x7f4bf415c390 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.987+0000 7f4bea000640 1 -- 172.21.15.7:0/3441124075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec00cb40 con 0x7f4bf415c390 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.987+0000 7f4bea000640 1 -- 172.21.15.7:0/3441124075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec014440 con 0x7f4bf415c390 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.987+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf415efe0 con 0x7f4bf415c390 2024-08-19T00:42:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.987+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf415d270 con 0x7f4bf415c390 2024-08-19T00:42:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.990+0000 7f4bea000640 1 -- 172.21.15.7:0/3441124075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bec01c070 con 0x7f4bf415c390 2024-08-19T00:42:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.991+0000 7f4bea000640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd006be30 0x7f4bd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.991+0000 7f4bea000640 1 -- 172.21.15.7:0/3441124075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f4bec08abb0 con 0x7f4bf415c390 2024-08-19T00:42:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.991+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd006be30 0x7f4bd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.991+0000 7f4bfc21d740 1 Processor -- start 2024-08-19T00:42:14.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bfc21d740 1 -- start start 2024-08-19T00:42:14.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd006be30 0x7f4bd006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4be4007fd0 tx=0x7f4be4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 0x561334e2ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561334d4bde0 con 0x561334de6d00 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561334ce40e0 con 0x561334dead10 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.992+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561334d47da0 con 0x561334e2fbf0 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34042/0 (socket says 172.21.15.7:34042) 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 -- 172.21.15.7:0/689628323 learned_addr learned my addr 172.21.15.7:0/689628323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 -- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 msgr2=0x561334e2ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 0x561334e2ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bf2800640 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 -- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 msgr2=0x561334e2cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 -- 172.21.15.7:0/689628323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561334b297d0 con 0x561334de6d00 2024-08-19T00:42:14.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bf2800640 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:14.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.993+0000 7f4bebe00640 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de3b30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc035040 tx=0x7f4bdc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d369d5dc452b1eb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:14.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4be2a00640 1 -- 172.21.15.7:0/689628323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc041070 con 0x561334de6d00 2024-08-19T00:42:14.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4be2a00640 1 -- 172.21.15.7:0/689628323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bdc032780 con 0x561334de6d00 2024-08-19T00:42:14.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4be2a00640 1 -- 172.21.15.7:0/689628323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc037040 con 0x561334de6d00 2024-08-19T00:42:14.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4bfc21d740 1 -- 172.21.15.7:0/689628323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 msgr2=0x561334de3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de3b30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc035040 tx=0x7f4bdc02c000 comp rx=0 tx=0).stop 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4bfc21d740 1 -- 172.21.15.7:0/689628323 shutdown_connections 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de3b30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/689628323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 0x561334e2ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.994+0000 7f4bfc21d740 1 -- 172.21.15.7:0/689628323 >> 172.21.15.7:0/689628323 conn(0x561334dafff0 msgr2=0x561334e2e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.995+0000 7f4bfc21d740 1 -- 172.21.15.7:0/689628323 shutdown_connections 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.995+0000 7f4bfc21d740 1 -- 172.21.15.7:0/689628323 wait complete. 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.995+0000 7f4bfc21d740 1 -- start start 2024-08-19T00:42:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.995+0000 7f4bfc21d740 1 Processor -- start 2024-08-19T00:42:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.996+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e297f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.996+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 0x561334e2b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.996+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 0x561334e12ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.996+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561334e2c040 con 0x561334de6d00 2024-08-19T00:42:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.996+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561334d07180 con 0x561334e2fbf0 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.996+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561334e11050 con 0x561334dead10 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.996+0000 7f4bfc21d740 10 client.0 _ll_register_callbacks cb 0x561334cf34b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e297f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34056/0 (socket says 172.21.15.7:34056) 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 -- 172.21.15.7:0/1468932081 learned_addr learned my addr 172.21.15.7:0/1468932081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 -- 172.21.15.7:0/1468932081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 msgr2=0x561334e2b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 0x561334e2b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 -- 172.21.15.7:0/1468932081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 msgr2=0x561334e12ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 0x561334e12ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 -- 172.21.15.7:0/1468932081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561334a5f3f0 con 0x561334de6d00 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e297f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4be4005e60 tx=0x7f4be4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a26652254db56f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bd7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:42:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bd7400640 1 -- 172.21.15.7:0/1468932081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be400ecb0 con 0x561334de6d00 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.997+0000 7f4bd7400640 1 -- 172.21.15.7:0/1468932081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f4be4023bc0 con 0x561334de6d00 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bdc032780 con 0x561334de6d00 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bd7400640 1 -- 172.21.15.7:0/1468932081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f4be400ee50 con 0x561334de6d00 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 10 client.6210 fetch_fsmap learned FSMap version 60 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x561334a1f0f0 con 0x561334de6d00 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bd7400640 1 -- 172.21.15.7:0/1468932081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bdc032780 con 0x561334de6d00 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bd7400640 1 -- 172.21.15.7:0/1468932081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f4be4023020 con 0x561334de6d00 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 10 client.6210 fetch_fsmap finished waiting for FSMap version 60 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 10 client.6210 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 20 client.6210 populate_metadata read hostname 'smithi007' 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e25060 0x561334e25510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 4 client.6210 mds_command: new command op to 5641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:42:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.998+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 --> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561334d59510 con 0x561334e25060 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.999+0000 7f4bebe00640 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e25060 0x561334e25510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.999+0000 7f4bebe00640 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e25060 0x561334e25510 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30132c07351303a2 server_cookie=32596c9d506eb4f9 in_seq=0 out_seq=0 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:14.999+0000 7f4bd7400640 10 client.6210 ms_handle_connect on v2:172.21.15.7:6835/992020227 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bd7400640 1 -- 172.21.15.7:0/1468932081 <== mds.0 v2:172.21.15.7:6835/992020227 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561334d59510 con 0x561334e25060 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bd7400640 10 client.6210 handle_command_reply: tid=0 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 client.6210 shutdown 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 msgr2=0x561334e297f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e297f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4be4005e60 tx=0x7f4be4000bc0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 shutdown_connections 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e25060 0x561334e25510 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 0x561334e12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 0x561334e2b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/1468932081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e297f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 >> 172.21.15.7:0/1468932081 conn(0x561334dafff0 msgr2=0x561334e31730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:15.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bd7400640 0 client.6210 ms_handle_reset on v2:172.21.15.7:6835/992020227 2024-08-19T00:42:15.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 shutdown_connections 2024-08-19T00:42:15.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 1 -- 172.21.15.7:0/1468932081 wait complete. 2024-08-19T00:42:15.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.000+0000 7f4bfc21d740 20 client.6210 trim_cache size 0 max 16384 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.016+0000 7f4bfc21d740 1 Processor -- start 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.016+0000 7f4bfc21d740 1 -- start start 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e2e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 0x561334e2c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf4200ad0 con 0x561334de6d00 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf41ffb30 con 0x561334dead10 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf40cb1d0 con 0x561334e2fbf0 2024-08-19T00:42:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e2e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e2e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34060/0 (socket says 172.21.15.7:34060) 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 -- 172.21.15.7:0/75091294 learned_addr learned my addr 172.21.15.7:0/75091294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bebe00640 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf2800640 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 0x561334e2c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 -- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 msgr2=0x561334e2c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 0x561334e2c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 -- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 msgr2=0x561334e2e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.017+0000 7f4bf1e00640 1 -- 172.21.15.7:0/75091294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561334e30340 con 0x561334de6d00 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e2e3f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4be40077a0 tx=0x7f4be401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94392edb9b844188 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4be2000640 1 -- 172.21.15.7:0/75091294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be40235c0 con 0x561334de6d00 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4be2000640 1 -- 172.21.15.7:0/75091294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be4023760 con 0x561334de6d00 2024-08-19T00:42:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4be2000640 1 -- 172.21.15.7:0/75091294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4023b10 con 0x561334de6d00 2024-08-19T00:42:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bfc21d740 1 -- 172.21.15.7:0/75091294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 msgr2=0x561334e2e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e2e3f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4be40077a0 tx=0x7f4be401d000 comp rx=0 tx=0).stop 2024-08-19T00:42:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bfc21d740 1 -- 172.21.15.7:0/75091294 shutdown_connections 2024-08-19T00:42:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334e2fbf0 0x561334e2c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334dead10 0x561334e2e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/75091294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334e2e3f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.018+0000 7f4bfc21d740 1 -- 172.21.15.7:0/75091294 >> 172.21.15.7:0/75091294 conn(0x561334dafff0 msgr2=0x561334e2f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.019+0000 7f4bfc21d740 1 -- 172.21.15.7:0/75091294 shutdown_connections 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.019+0000 7f4bfc21d740 1 -- 172.21.15.7:0/75091294 wait complete. 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.019+0000 7f4bfc21d740 1 -- start start 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.019+0000 7f4bfc21d740 1 Processor -- start 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.020+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.020+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 0x561334e2c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.020+0000 7f4bfc21d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 0x561334e2cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.020+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf40cb820 con 0x561334de6d00 2024-08-19T00:42:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.020+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561334dff500 con 0x561334e2fbf0 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.020+0000 7f4bfc21d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561334e91c00 con 0x561334dead10 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.020+0000 7f4bfc21d740 10 client.0 _ll_register_callbacks cb 0x7f4be4001d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34070/0 (socket says 172.21.15.7:34070) 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 -- 172.21.15.7:0/3905064707 learned_addr learned my addr 172.21.15.7:0/3905064707 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 -- 172.21.15.7:0/3905064707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 msgr2=0x561334e2c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 0x561334e2c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 -- 172.21.15.7:0/3905064707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 msgr2=0x561334e2cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 0x561334e2cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 -- 172.21.15.7:0/3905064707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561334e2e640 con 0x561334de6d00 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bf1e00640 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de9230 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4be4005b80 tx=0x7f4be4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc44f6797612de0d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.021+0000 7f4bd7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bd7400640 1 -- 172.21.15.7:0/3905064707 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4038070 con 0x561334de6d00 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bd7400640 1 -- 172.21.15.7:0/3905064707 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f4be4021860 con 0x561334de6d00 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4be4023760 con 0x561334de6d00 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bd7400640 1 -- 172.21.15.7:0/3905064707 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f4be4044050 con 0x561334de6d00 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 10 client.6216 fetch_fsmap learned FSMap version 60 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x561334e919a0 con 0x561334de6d00 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bd7400640 1 -- 172.21.15.7:0/3905064707 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be4023760 con 0x561334de6d00 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bd7400640 1 -- 172.21.15.7:0/3905064707 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f4be4047020 con 0x561334de6d00 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 10 client.6216 fetch_fsmap finished waiting for FSMap version 60 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 10 client.6216 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 20 client.6216 populate_metadata read hostname 'smithi007' 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e8fb10 0x561334de71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 4 client.6216 mds_command: new command op to 5641 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:42:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.022+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 --> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561334e2ad10 con 0x561334e8fb10 2024-08-19T00:42:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.023+0000 7f4bebe00640 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e8fb10 0x561334de71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.023+0000 7f4bebe00640 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e8fb10 0x561334de71a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=152ffaf2ad493aa1 server_cookie=be2061a307557254 in_seq=0 out_seq=0 2024-08-19T00:42:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.023+0000 7f4bd7400640 10 client.6216 ms_handle_connect on v2:172.21.15.7:6835/992020227 2024-08-19T00:42:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bd7400640 1 -- 172.21.15.7:0/3905064707 <== mds.0 v2:172.21.15.7:6835/992020227 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561334e2ad10 con 0x561334e8fb10 2024-08-19T00:42:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bd7400640 10 client.6216 handle_command_reply: tid=0 2024-08-19T00:42:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 client.6216 shutdown 2024-08-19T00:42:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 msgr2=0x561334de9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de9230 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4be4005b80 tx=0x7f4be4012000 comp rx=0 tx=0).stop 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 shutdown_connections 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:6835/992020227,v1:172.21.15.7:6837/992020227] conn(0x561334e8fb10 0x561334de71a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561334e2fbf0 0x561334e2cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561334dead10 0x561334e2c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bd7400640 0 client.6216 ms_handle_reset on v2:172.21.15.7:6835/992020227 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 --2- 172.21.15.7:0/3905064707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561334de6d00 0x561334de9230 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 >> 172.21.15.7:0/3905064707 conn(0x561334dafff0 msgr2=0x561334e52900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 shutdown_connections 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.033+0000 7f4bfc21d740 1 -- 172.21.15.7:0/3905064707 wait complete. 2024-08-19T00:42:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bfc21d740 20 client.6216 trim_cache size 0 max 16384 2024-08-19T00:42:15.037 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:42:15.037 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-08-19T00:42:15.037 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-08-19T00:42:15.037 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd006be30 msgr2=0x7f4bd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd006be30 0x7f4bd006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4be4007fd0 tx=0x7f4be4009040 comp rx=0 tx=0).stop 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf415c390 msgr2=0x7f4bf40c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf415c390 0x7f4bf40c9290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00b970 tx=0x7f4bec00be30 comp rx=0 tx=0).stop 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 shutdown_connections 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4bd006be30 0x7f4bd006e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf415c390 0x7f4bf40c9290 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bf415bfb0 0x7f4bf415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 --2- 172.21.15.7:0/3441124075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bf40b5130 0x7f4bf41528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 >> 172.21.15.7:0/3441124075 conn(0x7f4bf40b2300 msgr2=0x7f4bf4074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.034+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 shutdown_connections 2024-08-19T00:42:15.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.035+0000 7f4bf9200640 1 -- 172.21.15.7:0/3441124075 wait complete. 2024-08-19T00:42:15.051 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:42:15.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:42:15.138 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:42:15.231 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:42:15.232 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:42:15.232 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:42:15.232 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:15.267 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:42:15.268 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:15.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:42:15.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.542+0000 7fea6b800640 1 Processor -- start 2024-08-19T00:42:15.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.542+0000 7fea6b800640 1 -- start start 2024-08-19T00:42:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.543+0000 7fea6b800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea64159bf0 0x7fea64073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.543+0000 7fea6b800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea640cec10 0x7fea640d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.543+0000 7fea6b800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6406f7f0 con 0x7fea640739a0 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.543+0000 7fea6b800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fea6406f510 con 0x7fea64159bf0 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.543+0000 7fea6b800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fea64072980 con 0x7fea640cec10 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea68e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea64159bf0 0x7fea64073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea68e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea64159bf0 0x7fea64073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34078/0 (socket says 172.21.15.7:34078) 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea68e00640 1 -- 172.21.15.7:0/3316267845 learned_addr learned my addr 172.21.15.7:0/3316267845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea69800640 1 --2- 172.21.15.7:0/3316267845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea640cec10 0x7fea640d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea68e00640 1 -- 172.21.15.7:0/3316267845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea640cec10 msgr2=0x7fea640d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea68e00640 1 --2- 172.21.15.7:0/3316267845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea640cec10 0x7fea640d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea68e00640 1 -- 172.21.15.7:0/3316267845 >> v1:172.21.15.162:6789/0 conn(0x7fea640739a0 legacy=0x7fea640ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:15.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.544+0000 7fea68e00640 1 -- 172.21.15.7:0/3316267845 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea64072c60 con 0x7fea64159bf0 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.545+0000 7fea68e00640 1 --2- 172.21.15.7:0/3316267845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea64159bf0 0x7fea64073460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fea58009870 tx=0x7fea5802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395a15262cdd8ec2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.545+0000 7fea63400640 1 -- 172.21.15.7:0/3316267845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58037070 con 0x7fea64159bf0 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.545+0000 7fea63400640 1 -- 172.21.15.7:0/3316267845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea58032440 con 0x7fea64159bf0 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.545+0000 7fea63400640 1 -- 172.21.15.7:0/3316267845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58032810 con 0x7fea64159bf0 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 -- 172.21.15.7:0/3316267845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea64159bf0 msgr2=0x7fea64073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 --2- 172.21.15.7:0/3316267845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea64159bf0 0x7fea64073460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fea58009870 tx=0x7fea5802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 -- 172.21.15.7:0/3316267845 shutdown_connections 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 --2- 172.21.15.7:0/3316267845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea640cec10 0x7fea640d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 --2- 172.21.15.7:0/3316267845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea64159bf0 0x7fea64073460 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 -- 172.21.15.7:0/3316267845 >> 172.21.15.7:0/3316267845 conn(0x7fea6406bc70 msgr2=0x7fea6406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 -- 172.21.15.7:0/3316267845 shutdown_connections 2024-08-19T00:42:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.546+0000 7fea6b800640 1 -- 172.21.15.7:0/3316267845 wait complete. 2024-08-19T00:42:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.548+0000 7fea6b800640 1 Processor -- start 2024-08-19T00:42:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.548+0000 7fea6b800640 1 -- start start 2024-08-19T00:42:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea6b800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea640739a0 0x7fea64099950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea6b800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea64159bf0 0x7fea6415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea6b800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea641604e0 0x7fea6414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea6b800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fea6415a150 con 0x7fea640739a0 2024-08-19T00:42:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea6b800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fea64159fd0 con 0x7fea641604e0 2024-08-19T00:42:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea6b800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fea640d0900 con 0x7fea64159bf0 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea68e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea640739a0 0x7fea64099950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea68e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea640739a0 0x7fea64099950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34094/0 (socket says 172.21.15.7:34094) 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea68e00640 1 -- 172.21.15.7:0/2088688944 learned_addr learned my addr 172.21.15.7:0/2088688944 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea69800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea641604e0 0x7fea6414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea63e00640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea64159bf0 0x7fea6415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea68e00640 1 -- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea64159bf0 msgr2=0x7fea6415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea68e00640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea64159bf0 0x7fea6415ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea68e00640 1 -- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea641604e0 msgr2=0x7fea6414f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.549+0000 7fea68e00640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea641604e0 0x7fea6414f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea68e00640 1 -- 172.21.15.7:0/2088688944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea641f22c0 con 0x7fea640739a0 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea69800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea641604e0 0x7fea6414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea68e00640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea640739a0 0x7fea64099950 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fea58000c00 tx=0x7fea580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea60c00640 1 -- 172.21.15.7:0/2088688944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58041020 con 0x7fea640739a0 2024-08-19T00:42:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea60c00640 1 -- 172.21.15.7:0/2088688944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea580306c0 con 0x7fea640739a0 2024-08-19T00:42:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea60c00640 1 -- 172.21.15.7:0/2088688944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58037040 con 0x7fea640739a0 2024-08-19T00:42:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea641f2580 con 0x7fea640739a0 2024-08-19T00:42:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.550+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641f2b40 con 0x7fea640739a0 2024-08-19T00:42:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.551+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea641f3200 con 0x7fea640739a0 2024-08-19T00:42:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.552+0000 7fea60c00640 1 -- 172.21.15.7:0/2088688944 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea58044020 con 0x7fea640739a0 2024-08-19T00:42:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.553+0000 7fea60c00640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea4406be30 0x7fea4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.553+0000 7fea60c00640 1 -- 172.21.15.7:0/2088688944 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fea580ab400 con 0x7fea640739a0 2024-08-19T00:42:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.553+0000 7fea63e00640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea4406be30 0x7fea4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.554+0000 7fea63e00640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea4406be30 0x7fea4406e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fea50007fd0 tx=0x7fea50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.557+0000 7fea60c00640 1 -- 172.21.15.7:0/2088688944 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fea641f3200 con 0x7fea640739a0 2024-08-19T00:42:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.755+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea64068c00 con 0x7fea640739a0 2024-08-19T00:42:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.755+0000 7fea60c00640 1 -- 172.21.15.7:0/2088688944 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v61) ==== 80+0+240 (secure 0 0 0) 0x7fea5804b070 con 0x7fea640739a0 2024-08-19T00:42:15.757 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/2987342349 2024-08-20T00:40:37.370877+0000 2024-08-19T00:42:15.757 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/2987342349 2024-08-20T00:40:37.370877+0000 2024-08-19T00:42:15.757 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3306229985 2024-08-20T00:40:01.274319+0000 2024-08-19T00:42:15.757 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3306229985 2024-08-20T00:40:01.274319+0000 2024-08-19T00:42:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:listed 4 entries 2024-08-19T00:42:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea4406be30 msgr2=0x7fea4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea4406be30 0x7fea4406e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fea50007fd0 tx=0x7fea50009040 comp rx=0 tx=0).stop 2024-08-19T00:42:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea640739a0 msgr2=0x7fea64099950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea640739a0 0x7fea64099950 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fea58000c00 tx=0x7fea580046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 shutdown_connections 2024-08-19T00:42:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fea4406be30 0x7fea4406e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea641604e0 0x7fea6414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea64159bf0 0x7fea6415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 --2- 172.21.15.7:0/2088688944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea640739a0 0x7fea64099950 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 >> 172.21.15.7:0/2088688944 conn(0x7fea6406bc70 msgr2=0x7fea641588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 shutdown_connections 2024-08-19T00:42:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:15.757+0000 7fea6b800640 1 -- 172.21.15.7:0/2088688944 wait complete. 2024-08-19T00:42:15.775 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:42:15.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:15.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:15.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:42:15.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:15.836 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:42:15.872 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:42:15.872 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:42:15.872 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:15.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:42:15.913 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:42:15.913 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:42:15.913 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:15.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:42:15.948 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:42:15.948 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:42:15.949 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:15.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:42:15.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:16.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.147+0000 7f00f5800640 1 Processor -- start 2024-08-19T00:42:16.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.147+0000 7f00f5800640 1 -- start start 2024-08-19T00:42:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.148+0000 7f00f5800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00f009aa70 0x7f00f009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.148+0000 7f00f5800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.148+0000 7f00f5800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00f0161f20 0x7f00f01623d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.148+0000 7f00f5800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f00f009b390 con 0x7f00f0161f20 2024-08-19T00:42:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.148+0000 7f00f5800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00f015ec30 con 0x7f00f009aa70 2024-08-19T00:42:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.148+0000 7f00f5800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00f015ef10 con 0x7f00f009b730 2024-08-19T00:42:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00f0161f20 0x7f00f01623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00f0161f20 0x7f00f01623d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34110/0 (socket says 172.21.15.7:34110) 2024-08-19T00:42:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 -- 172.21.15.7:0/2461011691 learned_addr learned my addr 172.21.15.7:0/2461011691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ee000640 1 --2- 172.21.15.7:0/2461011691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00eea00640 1 --2- 172.21.15.7:0/2461011691 >> v2:172.21.15.162:3300/0 conn(0x7f00f009aa70 0x7f00f009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 -- 172.21.15.7:0/2461011691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 msgr2=0x7f00f006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 --2- 172.21.15.7:0/2461011691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f006fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 -- 172.21.15.7:0/2461011691 >> v2:172.21.15.162:3300/0 conn(0x7f00f009aa70 msgr2=0x7f00f009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 --2- 172.21.15.7:0/2461011691 >> v2:172.21.15.162:3300/0 conn(0x7f00f009aa70 0x7f00f009ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.149+0000 7f00ef400640 1 -- 172.21.15.7:0/2461011691 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f015f1f0 con 0x7f00f0161f20 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.150+0000 7f00ef400640 1 --2- 172.21.15.7:0/2461011691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f0161f20 0x7f00f01623d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009e50 tx=0x7f00e802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805f84e07c9d57f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.150+0000 7f00ed600640 1 -- 172.21.15.7:0/2461011691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e8036070 con 0x7f00f0161f20 2024-08-19T00:42:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.150+0000 7f00ed600640 1 -- 172.21.15.7:0/2461011691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e8031600 con 0x7f00f0161f20 2024-08-19T00:42:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00ed600640 1 -- 172.21.15.7:0/2461011691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e80319d0 con 0x7f00f0161f20 2024-08-19T00:42:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 -- 172.21.15.7:0/2461011691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f0161f20 msgr2=0x7f00f01623d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 --2- 172.21.15.7:0/2461011691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f0161f20 0x7f00f01623d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009e50 tx=0x7f00e802a6d0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 -- 172.21.15.7:0/2461011691 shutdown_connections 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 --2- 172.21.15.7:0/2461011691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f0161f20 0x7f00f01623d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 --2- 172.21.15.7:0/2461011691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f006fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 --2- 172.21.15.7:0/2461011691 >> v2:172.21.15.162:3300/0 conn(0x7f00f009aa70 0x7f00f009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 -- 172.21.15.7:0/2461011691 >> 172.21.15.7:0/2461011691 conn(0x7f00f00d2190 msgr2=0x7f00f00d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 -- 172.21.15.7:0/2461011691 shutdown_connections 2024-08-19T00:42:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.151+0000 7f00f5800640 1 -- 172.21.15.7:0/2461011691 wait complete. 2024-08-19T00:42:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.153+0000 7f00f5800640 1 Processor -- start 2024-08-19T00:42:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.153+0000 7f00f5800640 1 -- start start 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.154+0000 7f00f5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f009aa70 0x7f00f0158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.154+0000 7f00f5800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f00b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.154+0000 7f00f5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f0161f20 0x7f00f00b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.154+0000 7f00f5800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00f015e8f0 con 0x7f00f009aa70 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.154+0000 7f00f5800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00f0070170 con 0x7f00f0161f20 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.154+0000 7f00f5800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00f0162910 con 0x7f00f009b730 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.154+0000 7f00eea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f009aa70 0x7f00f0158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00eea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f009aa70 0x7f00f0158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34118/0 (socket says 172.21.15.7:34118) 2024-08-19T00:42:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00eea00640 1 -- 172.21.15.7:0/413579401 learned_addr learned my addr 172.21.15.7:0/413579401 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ef400640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f0161f20 0x7f00f00b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ee000640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f00b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ef400640 1 -- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 msgr2=0x7f00f00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ef400640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f00b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ef400640 1 -- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f009aa70 msgr2=0x7f00f0158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ef400640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f009aa70 0x7f00f0158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ef400640 1 -- 172.21.15.7:0/413579401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f00cab80 con 0x7f00f0161f20 2024-08-19T00:42:16.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.155+0000 7f00ef400640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f0161f20 0x7f00f00b5580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f00f0072ea0 tx=0x7f00e8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.156+0000 7f00e6a00640 1 -- 172.21.15.7:0/413579401 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e8041020 con 0x7f00f0161f20 2024-08-19T00:42:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.156+0000 7f00e6a00640 1 -- 172.21.15.7:0/413579401 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e80077a0 con 0x7f00f0161f20 2024-08-19T00:42:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.156+0000 7f00e6a00640 1 -- 172.21.15.7:0/413579401 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e8036040 con 0x7f00f0161f20 2024-08-19T00:42:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.156+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f00cae20 con 0x7f00f0161f20 2024-08-19T00:42:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.156+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f00cb3e0 con 0x7f00f0161f20 2024-08-19T00:42:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.157+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f0162b80 con 0x7f00f0161f20 2024-08-19T00:42:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.159+0000 7f00e6a00640 1 -- 172.21.15.7:0/413579401 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00e8044020 con 0x7f00f0161f20 2024-08-19T00:42:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.159+0000 7f00e6a00640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f00d006be30 0x7f00d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.159+0000 7f00e6a00640 1 -- 172.21.15.7:0/413579401 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f00e80abb80 con 0x7f00f0161f20 2024-08-19T00:42:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.160+0000 7f00eea00640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f00d006be30 0x7f00d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.160+0000 7f00eea00640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f00d006be30 0x7f00d006e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009c00 tx=0x7f00e0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.164+0000 7f00e6a00640 1 -- 172.21.15.7:0/413579401 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f00e804b030 con 0x7f00f0161f20 2024-08-19T00:42:16.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.384+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00f00d2cb0 con 0x7f00f0161f20 2024-08-19T00:42:16.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.385+0000 7f00e6a00640 1 -- 172.21.15.7:0/413579401 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5219 (secure 0 0 0) 0x7f00e8079d40 con 0x7f00f0161f20 2024-08-19T00:42:16.387 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:16.387 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"btime":"2024-08-19T00:40:40:377588+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/156180871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":156180871},{"type":"v1","addr":"172.21.15.7:6836","nonce":156180871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:40.377583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":20,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5641,"qdb_cluster":[5641]},"id":4}]} 2024-08-19T00:42:16.388 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f00d006be30 msgr2=0x7f00d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f00d006be30 0x7f00d006e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009c00 tx=0x7f00e0009190 comp rx=0 tx=0).stop 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f0161f20 msgr2=0x7f00f00b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f0161f20 0x7f00f00b5580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f00f0072ea0 tx=0x7f00e8004a40 comp rx=0 tx=0).stop 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 shutdown_connections 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f00d006be30 0x7f00d006e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f0161f20 0x7f00f00b5580 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f009b730 0x7f00f00b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 --2- 172.21.15.7:0/413579401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f009aa70 0x7f00f0158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 >> 172.21.15.7:0/413579401 conn(0x7f00f00d2190 msgr2=0x7f00f0159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:16.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 shutdown_connections 2024-08-19T00:42:16.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.388+0000 7f00f5800640 1 -- 172.21.15.7:0/413579401 wait complete. 2024-08-19T00:42:16.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.560+0000 7fa3eae00640 1 Processor -- start 2024-08-19T00:42:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.561+0000 7fa3eae00640 1 -- start start 2024-08-19T00:42:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.562+0000 7fa3eae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e406da50 0x7fa3e415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.562+0000 7fa3eae00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e4073140 con 0x7fa3e406d600 2024-08-19T00:42:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.562+0000 7fa3eae00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e40733f0 con 0x7fa3e415bd70 2024-08-19T00:42:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.562+0000 7fa3eae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e40736d0 con 0x7fa3e406da50 2024-08-19T00:42:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.562+0000 7fa3e9000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa3e406d600 0x7fa3e415cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53460/0 (socket says 172.21.15.7:53460) 2024-08-19T00:42:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.562+0000 7fa3e9000640 1 -- 172.21.15.7:0/808232248 learned_addr learned my addr 172.21.15.7:0/808232248 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3ea400640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e406da50 0x7fa3e415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062305774 0 0) 0x7fa3e4073140 con 0x7fa3e406d600 2024-08-19T00:42:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3cc003520 con 0x7fa3e406d600 2024-08-19T00:42:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2580039069 0 0) 0x7fa3cc003520 con 0x7fa3e406d600 2024-08-19T00:42:16.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e406da50 msgr2=0x7fa3e415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e406da50 0x7fa3e415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 >> v1:172.21.15.162:6789/0 conn(0x7fa3e415bd70 legacy=0x7fa3e4072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e40739b0 con 0x7fa3e406d600 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fa3d0001670 con 0x7fa3e406d600 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 >> v1:172.21.15.7:6789/0 conn(0x7fa3e406d600 legacy=0x7fa3e415cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3cc0039e0 0x7fa3cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3cc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3cc005060 0x7fa3cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40736d0 con 0x7fa3cc004390 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc00bf30 con 0x7fa3cc0039e0 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3cc00c130 con 0x7fa3cc005060 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.563+0000 7fa3ea400640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e406da50 0x7fa3e415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:16.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9000640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3cc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9a00640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3cc0039e0 0x7fa3cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3ea400640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3cc005060 0x7fa3cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9000640 1 -- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3cc005060 msgr2=0x7fa3cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9000640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3cc005060 0x7fa3cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9000640 1 -- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3cc0039e0 msgr2=0x7fa3cc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9000640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3cc0039e0 0x7fa3cc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9000640 1 -- 172.21.15.7:0/808232248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc003520 con 0x7fa3cc004390 2024-08-19T00:42:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.564+0000 7fa3e9a00640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3cc0039e0 0x7fa3cc003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.565+0000 7fa3e9000640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3cc004860 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0007fd0 tx=0x7fa3cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0a21866016d7f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.565+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0007ca0 con 0x7fa3cc004390 2024-08-19T00:42:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.565+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d0005af0 con 0x7fa3cc004390 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.565+0000 7fa3e3e00640 1 -- 172.21.15.7:0/808232248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0007070 con 0x7fa3cc004390 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.566+0000 7fa3eae00640 1 -- 172.21.15.7:0/808232248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 msgr2=0x7fa3cc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.566+0000 7fa3eae00640 1 --2- 172.21.15.7:0/808232248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3cc004860 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0007fd0 tx=0x7fa3cc005830 comp rx=0 tx=0).stop 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.566+0000 7fa3ea400640 1 -- 172.21.15.7:0/808232248 reap_dead start 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.566+0000 7fa3eae00640 1 -- 172.21.15.7:0/808232248 shutdown_connections 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.566+0000 7fa3eae00640 1 -- 172.21.15.7:0/808232248 >> 172.21.15.7:0/808232248 conn(0x7fa3e406b850 msgr2=0x7fa3e406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.566+0000 7fa3eae00640 1 -- 172.21.15.7:0/808232248 shutdown_connections 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.566+0000 7fa3eae00640 1 -- 172.21.15.7:0/808232248 wait complete. 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.568+0000 7fa3eae00640 1 Processor -- start 2024-08-19T00:42:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.568+0000 7fa3eae00640 1 -- start start 2024-08-19T00:42:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.568+0000 7fa3eae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3e41e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3eae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e414afc0 0x7fa3e41e1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3eae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41e8c60 0x7fa3e41e9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3eae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e406dec0 con 0x7fa3cc004390 2024-08-19T00:42:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3eae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e415c780 con 0x7fa3e41e8c60 2024-08-19T00:42:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3eae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e415c150 con 0x7fa3e414afc0 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3e41e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3e41e5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34142/0 (socket says 172.21.15.7:34142) 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 -- 172.21.15.7:0/3012598896 learned_addr learned my addr 172.21.15.7:0/3012598896 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 -- 172.21.15.7:0/3012598896 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e414afc0 msgr2=0x7fa3e41e1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e414afc0 0x7fa3e41e1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 -- 172.21.15.7:0/3012598896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41e8c60 msgr2=0x7fa3e41e9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41e8c60 0x7fa3e41e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 -- 172.21.15.7:0/3012598896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e41e2250 con 0x7fa3cc004390 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.569+0000 7fa3e9a00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3e41e5c20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800f8e0 tx=0x7fa3d800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.570+0000 7fa3e1600640 1 -- 172.21.15.7:0/3012598896 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80053a0 con 0x7fa3cc004390 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.570+0000 7fa3e1600640 1 -- 172.21.15.7:0/3012598896 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d8018070 con 0x7fa3cc004390 2024-08-19T00:42:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.570+0000 7fa3e1600640 1 -- 172.21.15.7:0/3012598896 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800d870 con 0x7fa3cc004390 2024-08-19T00:42:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.570+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e41e2530 con 0x7fa3cc004390 2024-08-19T00:42:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.570+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e41e2d20 con 0x7fa3cc004390 2024-08-19T00:42:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.571+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e406e3a0 con 0x7fa3cc004390 2024-08-19T00:42:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.572+0000 7fa3e1600640 1 -- 172.21.15.7:0/3012598896 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3d800da10 con 0x7fa3cc004390 2024-08-19T00:42:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.573+0000 7fa3e1600640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3c406be30 0x7fa3c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.573+0000 7fa3e1600640 1 -- 172.21.15.7:0/3012598896 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fa3d808b0d0 con 0x7fa3cc004390 2024-08-19T00:42:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.573+0000 7fa3e9000640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3c406be30 0x7fa3c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.574+0000 7fa3e9000640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3c406be30 0x7fa3c406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0032000 tx=0x7fa3d002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.577+0000 7fa3e1600640 1 -- 172.21.15.7:0/3012598896 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa3d801a310 con 0x7fa3cc004390 2024-08-19T00:42:16.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.799+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3e40cdc00 con 0x7fa3cc004390 2024-08-19T00:42:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.800+0000 7fa3e1600640 1 -- 172.21.15.7:0/3012598896 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5219 (secure 0 0 0) 0x7fa3d80598f0 con 0x7fa3cc004390 2024-08-19T00:42:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:16.802 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"btime":"2024-08-19T00:40:40:377588+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/156180871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":156180871},{"type":"v1","addr":"172.21.15.7:6836","nonce":156180871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:40.377583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":20,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5641,"qdb_cluster":[5641]},"id":4}]} 2024-08-19T00:42:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-08-19T00:42:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3c406be30 msgr2=0x7fa3c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3c406be30 0x7fa3c406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0032000 tx=0x7fa3d002c000 comp rx=0 tx=0).stop 2024-08-19T00:42:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 msgr2=0x7fa3e41e5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3e41e5c20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800f8e0 tx=0x7fa3d800fda0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 shutdown_connections 2024-08-19T00:42:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3c406be30 0x7fa3c406e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41e8c60 0x7fa3e41e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e414afc0 0x7fa3e41e1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 --2- 172.21.15.7:0/3012598896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3cc004390 0x7fa3e41e5c20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 >> 172.21.15.7:0/3012598896 conn(0x7fa3e406b850 msgr2=0x7fa3e4159770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 shutdown_connections 2024-08-19T00:42:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.802+0000 7fa3eae00640 1 -- 172.21.15.7:0/3012598896 wait complete. 2024-08-19T00:42:16.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:42:16.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.975+0000 7f3e99000640 1 Processor -- start 2024-08-19T00:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.975+0000 7f3e99000640 1 -- start start 2024-08-19T00:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.976+0000 7f3e99000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e940b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.976+0000 7f3e99000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3e9406c480 0x7f3e940b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.976+0000 7f3e99000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e940b4640 con 0x7f3e9406b850 2024-08-19T00:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.976+0000 7f3e99000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940d0320 con 0x7f3e9406c480 2024-08-19T00:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.976+0000 7f3e99000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3e940b0cf0 con 0x7f3e94161a30 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e940b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e940b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:47678/0 (socket says 172.21.15.7:47678) 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91e00640 1 -- 172.21.15.7:0/950693769 learned_addr learned my addr 172.21.15.7:0/950693769 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e92800640 1 --1- 172.21.15.7:0/950693769 >> v1:172.21.15.162:6789/0 conn(0x7f3e9406b850 0x7f3e940b14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:40810/0 (socket says 172.21.15.7:40810) 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91400640 1 --2- 172.21.15.7:0/950693769 >> v2:172.21.15.162:3300/0 conn(0x7f3e9406c480 0x7f3e940b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91e00640 1 -- 172.21.15.7:0/950693769 >> v2:172.21.15.162:3300/0 conn(0x7f3e9406c480 msgr2=0x7f3e940b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91e00640 1 --2- 172.21.15.7:0/950693769 >> v2:172.21.15.162:3300/0 conn(0x7f3e9406c480 0x7f3e940b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91e00640 1 -- 172.21.15.7:0/950693769 >> v1:172.21.15.162:6789/0 conn(0x7f3e9406b850 legacy=0x7f3e940b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.977+0000 7f3e91e00640 1 -- 172.21.15.7:0/950693769 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940b3cf0 con 0x7f3e94161a30 2024-08-19T00:42:16.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.978+0000 7f3e91e00640 1 --2- 172.21.15.7:0/950693769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e940b4100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098a0 tx=0x7f3e8402a320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=352b657093749ddb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e90a00640 1 -- 172.21.15.7:0/950693769 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84037070 con 0x7f3e94161a30 2024-08-19T00:42:16.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e90a00640 1 -- 172.21.15.7:0/950693769 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e84032640 con 0x7f3e94161a30 2024-08-19T00:42:16.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e90a00640 1 -- 172.21.15.7:0/950693769 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84032a10 con 0x7f3e94161a30 2024-08-19T00:42:16.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 -- 172.21.15.7:0/950693769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 msgr2=0x7f3e940b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 --2- 172.21.15.7:0/950693769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e940b4100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098a0 tx=0x7f3e8402a320 comp rx=0 tx=0).stop 2024-08-19T00:42:16.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 -- 172.21.15.7:0/950693769 shutdown_connections 2024-08-19T00:42:16.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 --2- 172.21.15.7:0/950693769 >> v2:172.21.15.162:3300/0 conn(0x7f3e9406c480 0x7f3e940b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 --2- 172.21.15.7:0/950693769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e940b4100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 -- 172.21.15.7:0/950693769 >> 172.21.15.7:0/950693769 conn(0x7f3e940b6840 msgr2=0x7f3e940b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:16.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 -- 172.21.15.7:0/950693769 shutdown_connections 2024-08-19T00:42:16.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.979+0000 7f3e99000640 1 -- 172.21.15.7:0/950693769 wait complete. 2024-08-19T00:42:16.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.981+0000 7f3e99000640 1 Processor -- start 2024-08-19T00:42:16.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.981+0000 7f3e99000640 1 -- start start 2024-08-19T00:42:16.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e99000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e9406b850 0x7f3e940af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e99000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9406c480 0x7f3e941565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e99000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e941f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e99000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940b0f90 con 0x7f3e9406c480 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e99000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940d08a0 con 0x7f3e9406b850 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e99000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3e940d0b80 con 0x7f3e94161a30 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e91400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9406c480 0x7f3e941565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e91400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9406c480 0x7f3e941565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34152/0 (socket says 172.21.15.7:34152) 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e91400640 1 -- 172.21.15.7:0/3889492980 learned_addr learned my addr 172.21.15.7:0/3889492980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e91e00640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e9406b850 0x7f3e940af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.982+0000 7f3e92800640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e941f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e91400640 1 -- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 msgr2=0x7f3e941f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e91400640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e941f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e91400640 1 -- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e9406b850 msgr2=0x7f3e940af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:16.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e91400640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e9406b850 0x7f3e940af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:16.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e91400640 1 -- 172.21.15.7:0/3889492980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e941581c0 con 0x7f3e9406c480 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e91400640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9406c480 0x7f3e941565f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d7d0 tx=0x7f3e8000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e8a000640 1 -- 172.21.15.7:0/3889492980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80004030 con 0x7f3e9406c480 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e8a000640 1 -- 172.21.15.7:0/3889492980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e800041d0 con 0x7f3e9406c480 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e8a000640 1 -- 172.21.15.7:0/3889492980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000b6c0 con 0x7f3e9406c480 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.983+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e94158460 con 0x7f3e9406c480 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.984+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e94158a20 con 0x7f3e9406c480 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.985+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e94161ea0 con 0x7f3e9406c480 2024-08-19T00:42:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.985+0000 7f3e8a000640 1 -- 172.21.15.7:0/3889492980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e8000b860 con 0x7f3e9406c480 2024-08-19T00:42:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.987+0000 7f3e8a000640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e7406be30 0x7f3e7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.987+0000 7f3e8a000640 1 -- 172.21.15.7:0/3889492980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f3e8008b1e0 con 0x7f3e9406c480 2024-08-19T00:42:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.987+0000 7f3e91e00640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e7406be30 0x7f3e7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:16.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.988+0000 7f3e91e00640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e7406be30 0x7f3e7406e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e84034000 tx=0x7f3e8402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:16.991+0000 7f3e8a000640 1 -- 172.21.15.7:0/3889492980 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3e80059a90 con 0x7f3e9406c480 2024-08-19T00:42:17.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.175+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e940ce730 con 0x7f3e9406c480 2024-08-19T00:42:17.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.177+0000 7f3e8a000640 1 -- 172.21.15.7:0/3889492980 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16980 (secure 0 0 0) 0x7f3e80059390 con 0x7f3e9406c480 2024-08-19T00:42:17.179 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:17.179 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":61,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:40:37.370941+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:39:33.403543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-08-19T00:39:34.553083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1f","mappings":[{"from":6,"to":1}]},{"pgid":"9.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/2987342349":"2024-08-20T00:40:37.370877+0000","172.21.15.7:6834/2987342349":"2024-08-20T00:40:37.370877+0000","172.21.15.7:6836/3306229985":"2024-08-20T00:40:01.274319+0000","172.21.15.7:6834/3306229985":"2024-08-20T00:40:01.274319+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e7406be30 msgr2=0x7f3e7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e7406be30 0x7f3e7406e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e84034000 tx=0x7f3e8402e000 comp rx=0 tx=0).stop 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9406c480 msgr2=0x7f3e941565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9406c480 0x7f3e941565f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d7d0 tx=0x7f3e8000dc90 comp rx=0 tx=0).stop 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 shutdown_connections 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e7406be30 0x7f3e7406e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e94161a30 0x7f3e941f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9406c480 0x7f3e941565f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 --2- 172.21.15.7:0/3889492980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e9406b850 0x7f3e940af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 >> 172.21.15.7:0/3889492980 conn(0x7f3e940b6840 msgr2=0x7f3e940b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 shutdown_connections 2024-08-19T00:42:17.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.179+0000 7f3e99000640 1 -- 172.21.15.7:0/3889492980 wait complete. 2024-08-19T00:42:17.197 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:42:17.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.352+0000 7efe09a00640 1 Processor -- start 2024-08-19T00:42:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.352+0000 7efe09a00640 1 -- start start 2024-08-19T00:42:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe09a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe0415e360 0x7efe0415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe09a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efe040d2af0 0x7efe040d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe09a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe040b3ab0 con 0x7efe0415e740 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe09a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7efe0415f460 con 0x7efe0415e360 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe09a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efe0415f740 con 0x7efe040d2af0 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe03e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe0415e360 0x7efe0415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe03e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe0415e360 0x7efe0415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34166/0 (socket says 172.21.15.7:34166) 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.353+0000 7efe03e00640 1 -- 172.21.15.7:0/1676782545 learned_addr learned my addr 172.21.15.7:0/1676782545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.354+0000 7efdfbe00640 1 --2- 172.21.15.7:0/1676782545 >> v2:172.21.15.162:3300/0 conn(0x7efe040d2af0 0x7efe040d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.354+0000 7efe03e00640 1 -- 172.21.15.7:0/1676782545 >> v2:172.21.15.162:3300/0 conn(0x7efe040d2af0 msgr2=0x7efe040d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.354+0000 7efe03e00640 1 --2- 172.21.15.7:0/1676782545 >> v2:172.21.15.162:3300/0 conn(0x7efe040d2af0 0x7efe040d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.354+0000 7efe03e00640 1 -- 172.21.15.7:0/1676782545 >> v1:172.21.15.162:6789/0 conn(0x7efe0415e740 legacy=0x7efe0415eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.354+0000 7efe03e00640 1 -- 172.21.15.7:0/1676782545 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe040b3d60 con 0x7efe0415e360 2024-08-19T00:42:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.354+0000 7efdfbe00640 1 --2- 172.21.15.7:0/1676782545 >> v2:172.21.15.162:3300/0 conn(0x7efe040d2af0 0x7efe040d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.355+0000 7efe03e00640 1 --2- 172.21.15.7:0/1676782545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe0415fab0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efe0408db80 tx=0x7efdf402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a1429731b11c15 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.355+0000 7efe03400640 1 -- 172.21.15.7:0/1676782545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4037070 con 0x7efe0415e360 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.355+0000 7efe03400640 1 -- 172.21.15.7:0/1676782545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf4032440 con 0x7efe0415e360 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.355+0000 7efe03400640 1 -- 172.21.15.7:0/1676782545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4032810 con 0x7efe0415e360 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 -- 172.21.15.7:0/1676782545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 msgr2=0x7efe0415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 --2- 172.21.15.7:0/1676782545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe0415fab0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efe0408db80 tx=0x7efdf402a230 comp rx=0 tx=0).stop 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 -- 172.21.15.7:0/1676782545 shutdown_connections 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 --2- 172.21.15.7:0/1676782545 >> v2:172.21.15.162:3300/0 conn(0x7efe040d2af0 0x7efe040d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 --2- 172.21.15.7:0/1676782545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe0415fab0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 -- 172.21.15.7:0/1676782545 >> 172.21.15.7:0/1676782545 conn(0x7efe0408dbf0 msgr2=0x7efe0409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 -- 172.21.15.7:0/1676782545 shutdown_connections 2024-08-19T00:42:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.356+0000 7efe09a00640 1 -- 172.21.15.7:0/1676782545 wait complete. 2024-08-19T00:42:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.358+0000 7efe09a00640 1 Processor -- start 2024-08-19T00:42:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.358+0000 7efe09a00640 1 -- start start 2024-08-19T00:42:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe09a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe040d2af0 0x7efe0415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe09a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe040c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe09a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe0415e740 0x7efe0406d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe09a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe040b4560 con 0x7efe0415e360 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe09a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe040d2300 con 0x7efe040d2af0 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe09a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe040b46e0 con 0x7efe0415e740 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe040c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe040c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34176/0 (socket says 172.21.15.7:34176) 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 -- 172.21.15.7:0/4029743506 learned_addr learned my addr 172.21.15.7:0/4029743506 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe03e00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe040d2af0 0x7efe0415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efe09000640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe0415e740 0x7efe0406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 -- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe0415e740 msgr2=0x7efe0406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe0415e740 0x7efe0406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 -- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe040d2af0 msgr2=0x7efe0415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe040d2af0 0x7efe0415c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.359+0000 7efdfbe00640 1 -- 172.21.15.7:0/4029743506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0415cdd0 con 0x7efe0415e360 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.360+0000 7efdfbe00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe040c7dc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efdec00e7e0 tx=0x7efdec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.360+0000 7efe00c00640 1 -- 172.21.15.7:0/4029743506 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec00f040 con 0x7efe0415e360 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.360+0000 7efe00c00640 1 -- 172.21.15.7:0/4029743506 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec004030 con 0x7efe0415e360 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.360+0000 7efe00c00640 1 -- 172.21.15.7:0/4029743506 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec004400 con 0x7efe0415e360 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.360+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe040b7580 con 0x7efe0415e360 2024-08-19T00:42:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.360+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe040b7b40 con 0x7efe0415e360 2024-08-19T00:42:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.361+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe040c7b20 con 0x7efe0415e360 2024-08-19T00:42:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.362+0000 7efe00c00640 1 -- 172.21.15.7:0/4029743506 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdec00c6d0 con 0x7efe0415e360 2024-08-19T00:42:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.363+0000 7efe00c00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efde006be30 0x7efde006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.363+0000 7efe00c00640 1 -- 172.21.15.7:0/4029743506 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7efdec08add0 con 0x7efe0415e360 2024-08-19T00:42:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.363+0000 7efe03e00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efde006be30 0x7efde006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.364+0000 7efe03e00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efde006be30 0x7efde006e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efdf4034000 tx=0x7efdf402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.367+0000 7efe00c00640 1 -- 172.21.15.7:0/4029743506 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efdec017020 con 0x7efe0415e360 2024-08-19T00:42:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.587+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe040cb370 con 0x7efe0415e360 2024-08-19T00:42:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.588+0000 7efe00c00640 1 -- 172.21.15.7:0/4029743506 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5219 (secure 0 0 0) 0x7efdec059560 con 0x7efe0415e360 2024-08-19T00:42:17.590 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:17.590 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"btime":"2024-08-19T00:40:40:377588+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/156180871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":156180871},{"type":"v1","addr":"172.21.15.7:6836","nonce":156180871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:40.377583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":20,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5641,"qdb_cluster":[5641]},"id":4}]} 2024-08-19T00:42:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-08-19T00:42:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efde006be30 msgr2=0x7efde006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efde006be30 0x7efde006e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efdf4034000 tx=0x7efdf402e000 comp rx=0 tx=0).stop 2024-08-19T00:42:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 msgr2=0x7efe040c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe040c7dc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efdec00e7e0 tx=0x7efdec00eca0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 shutdown_connections 2024-08-19T00:42:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efde006be30 0x7efde006e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe0415e740 0x7efe0406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0415e360 0x7efe040c7dc0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 --2- 172.21.15.7:0/4029743506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe040d2af0 0x7efe0415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 >> 172.21.15.7:0/4029743506 conn(0x7efe0408dbf0 msgr2=0x7efe0406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 shutdown_connections 2024-08-19T00:42:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.590+0000 7efe09a00640 1 -- 172.21.15.7:0/4029743506 wait complete. 2024-08-19T00:42:17.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.762+0000 7ffa6d200640 1 Processor -- start 2024-08-19T00:42:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.763+0000 7ffa6d200640 1 -- start start 2024-08-19T00:42:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa6d200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffa6806e710 0x7ffa68071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa6d200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa680b3750 0x7ffa680cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa6d200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680cdfb0 con 0x7ffa680d03c0 2024-08-19T00:42:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa6d200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680cebc0 con 0x7ffa680b3750 2024-08-19T00:42:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa6d200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680ce290 con 0x7ffa6806e710 2024-08-19T00:42:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa66800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa680b3750 0x7ffa680cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa65e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffa680d03c0 0x7ffa680d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53466/0 (socket says 172.21.15.7:53466) 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa65e00640 1 -- 172.21.15.7:0/1634385143 learned_addr learned my addr 172.21.15.7:0/1634385143 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.764+0000 7ffa5fe00640 1 --2- 172.21.15.7:0/1634385143 >> v2:172.21.15.162:3300/0 conn(0x7ffa6806e710 0x7ffa68071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.765+0000 7ffa66800640 1 -- 172.21.15.7:0/1634385143 >> v2:172.21.15.162:3300/0 conn(0x7ffa6806e710 msgr2=0x7ffa68071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.765+0000 7ffa66800640 1 --2- 172.21.15.7:0/1634385143 >> v2:172.21.15.162:3300/0 conn(0x7ffa6806e710 0x7ffa68071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.765+0000 7ffa66800640 1 -- 172.21.15.7:0/1634385143 >> v1:172.21.15.7:6789/0 conn(0x7ffa680d03c0 legacy=0x7ffa680d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.765+0000 7ffa66800640 1 -- 172.21.15.7:0/1634385143 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680ce570 con 0x7ffa680b3750 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.765+0000 7ffa65400640 1 -- 172.21.15.7:0/1634385143 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3106742893 0 0) 0x7ffa680cdfb0 con 0x7ffa680d03c0 2024-08-19T00:42:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.765+0000 7ffa5fe00640 1 --2- 172.21.15.7:0/1634385143 >> v2:172.21.15.162:3300/0 conn(0x7ffa6806e710 0x7ffa68071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa66800640 1 --2- 172.21.15.7:0/1634385143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680b3750 0x7ffa680cf050 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009d90 tx=0x7ffa6002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de56a74e9cad3e64 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa65400640 1 -- 172.21.15.7:0/1634385143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007740 con 0x7ffa680b3750 2024-08-19T00:42:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa65400640 1 -- 172.21.15.7:0/1634385143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa600078e0 con 0x7ffa680b3750 2024-08-19T00:42:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa65400640 1 -- 172.21.15.7:0/1634385143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007cb0 con 0x7ffa680b3750 2024-08-19T00:42:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa6d200640 1 -- 172.21.15.7:0/1634385143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680b3750 msgr2=0x7ffa680cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa6d200640 1 --2- 172.21.15.7:0/1634385143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680b3750 0x7ffa680cf050 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009d90 tx=0x7ffa6002a6a0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa6d200640 1 -- 172.21.15.7:0/1634385143 shutdown_connections 2024-08-19T00:42:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa6d200640 1 --2- 172.21.15.7:0/1634385143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680b3750 0x7ffa680cf050 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa6d200640 1 --2- 172.21.15.7:0/1634385143 >> v2:172.21.15.162:3300/0 conn(0x7ffa6806e710 0x7ffa68071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.766+0000 7ffa6d200640 1 -- 172.21.15.7:0/1634385143 >> 172.21.15.7:0/1634385143 conn(0x7ffa6806bc70 msgr2=0x7ffa6806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.767+0000 7ffa6d200640 1 -- 172.21.15.7:0/1634385143 shutdown_connections 2024-08-19T00:42:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.767+0000 7ffa6d200640 1 -- 172.21.15.7:0/1634385143 wait complete. 2024-08-19T00:42:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.768+0000 7ffa6d200640 1 Processor -- start 2024-08-19T00:42:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.768+0000 7ffa6d200640 1 -- start start 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.769+0000 7ffa6d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa6806e710 0x7ffa6815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.769+0000 7ffa6d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa680b3750 0x7ffa680acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.769+0000 7ffa6d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680d03c0 0x7ffa680c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.769+0000 7ffa6d200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68073c60 con 0x7ffa680d03c0 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.769+0000 7ffa6d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68073ae0 con 0x7ffa6806e710 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.769+0000 7ffa6d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffa680b3be0 con 0x7ffa680b3750 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680d03c0 0x7ffa680c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa5fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa680b3750 0x7ffa680acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680d03c0 0x7ffa680c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34188/0 (socket says 172.21.15.7:34188) 2024-08-19T00:42:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 -- 172.21.15.7:0/2792747712 learned_addr learned my addr 172.21.15.7:0/2792747712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 -- 172.21.15.7:0/2792747712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa680b3750 msgr2=0x7ffa680acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa680b3750 0x7ffa680acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 -- 172.21.15.7:0/2792747712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa6806e710 msgr2=0x7ffa6815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa6806e710 0x7ffa6815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 -- 172.21.15.7:0/2792747712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680c5530 con 0x7ffa680d03c0 2024-08-19T00:42:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.770+0000 7ffa66800640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680d03c0 0x7ffa680c4ff0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009eb0 tx=0x7ffa60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.771+0000 7ffa5e000640 1 -- 172.21.15.7:0/2792747712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60040070 con 0x7ffa680d03c0 2024-08-19T00:42:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.771+0000 7ffa5e000640 1 -- 172.21.15.7:0/2792747712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60031c90 con 0x7ffa680d03c0 2024-08-19T00:42:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.771+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa680ad6f0 con 0x7ffa680d03c0 2024-08-19T00:42:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.771+0000 7ffa5e000640 1 -- 172.21.15.7:0/2792747712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60045680 con 0x7ffa680d03c0 2024-08-19T00:42:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.771+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa680adcb0 con 0x7ffa680d03c0 2024-08-19T00:42:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.772+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa680cdfb0 con 0x7ffa680d03c0 2024-08-19T00:42:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.773+0000 7ffa5e000640 1 -- 172.21.15.7:0/2792747712 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa60039040 con 0x7ffa680d03c0 2024-08-19T00:42:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.774+0000 7ffa5e000640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa4406be30 0x7ffa4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.774+0000 7ffa5e000640 1 -- 172.21.15.7:0/2792747712 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7ffa600aca30 con 0x7ffa680d03c0 2024-08-19T00:42:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.774+0000 7ffa65e00640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa4406be30 0x7ffa4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:17.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.774+0000 7ffa65e00640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa4406be30 0x7ffa4406e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffa58007fd0 tx=0x7ffa58007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:17.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:17.778+0000 7ffa5e000640 1 -- 172.21.15.7:0/2792747712 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ffa680c5530 con 0x7ffa680d03c0 2024-08-19T00:42:18.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.000+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa680cd5a0 con 0x7ffa680d03c0 2024-08-19T00:42:18.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.000+0000 7ffa5e000640 1 -- 172.21.15.7:0/2792747712 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5219 (secure 0 0 0) 0x7ffa6007b290 con 0x7ffa680d03c0 2024-08-19T00:42:18.002 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:18.002 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"btime":"2024-08-19T00:40:40:377588+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/156180871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":156180871},{"type":"v1","addr":"172.21.15.7:6836","nonce":156180871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:39:35.566683+0000","modified":"2024-08-19T00:40:40.377583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":20,"addr":"172.21.15.7:6837/992020227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":992020227},{"type":"v1","addr":"172.21.15.7:6837","nonce":992020227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5641,"qdb_cluster":[5641]},"id":4}]} 2024-08-19T00:42:18.003 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-08-19T00:42:18.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.002+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa4406be30 msgr2=0x7ffa4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.002+0000 7ffa6d200640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa4406be30 0x7ffa4406e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffa58007fd0 tx=0x7ffa58007920 comp rx=0 tx=0).stop 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.002+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680d03c0 msgr2=0x7ffa680c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.002+0000 7ffa6d200640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680d03c0 0x7ffa680c4ff0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009eb0 tx=0x7ffa60004a40 comp rx=0 tx=0).stop 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 shutdown_connections 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa4406be30 0x7ffa4406e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa680d03c0 0x7ffa680c4ff0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa680b3750 0x7ffa680acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 --2- 172.21.15.7:0/2792747712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa6806e710 0x7ffa6815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 >> 172.21.15.7:0/2792747712 conn(0x7ffa6806bc70 msgr2=0x7ffa680b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 shutdown_connections 2024-08-19T00:42:18.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.003+0000 7ffa6d200640 1 -- 172.21.15.7:0/2792747712 wait complete. 2024-08-19T00:42:18.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:42:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.176+0000 7f3573400640 1 Processor -- start 2024-08-19T00:42:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.176+0000 7f3573400640 1 -- start start 2024-08-19T00:42:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.177+0000 7f3573400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c15f5b0 0x7f356c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.177+0000 7f3573400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f356c0d03c0 0x7f356c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.177+0000 7f3573400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356c0cfaf0 con 0x7f356c0b4380 2024-08-19T00:42:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.177+0000 7f3573400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f356c0d0d60 con 0x7f356c0d03c0 2024-08-19T00:42:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.177+0000 7f3573400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f356c15f990 con 0x7f356c15f5b0 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3563e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f356c0d03c0 0x7f356c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3563e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f356c0d03c0 0x7f356c0d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34192/0 (socket says 172.21.15.7:34192) 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3563e00640 1 -- 172.21.15.7:0/2657169806 learned_addr learned my addr 172.21.15.7:0/2657169806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3570a00640 1 --2- 172.21.15.7:0/2657169806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c15f5b0 0x7f356c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3563e00640 1 -- 172.21.15.7:0/2657169806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c15f5b0 msgr2=0x7f356c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3563e00640 1 --2- 172.21.15.7:0/2657169806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c15f5b0 0x7f356c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3563e00640 1 -- 172.21.15.7:0/2657169806 >> v1:172.21.15.162:6789/0 conn(0x7f356c0b4380 legacy=0x7f356c0b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f356be00640 1 -- 172.21.15.7:0/2657169806 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691676395 0 0) 0x7f356c0cfaf0 con 0x7f356c0b4380 2024-08-19T00:42:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.178+0000 7f3563e00640 1 -- 172.21.15.7:0/2657169806 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c0b50b0 con 0x7f356c0d03c0 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.179+0000 7f3563e00640 1 --2- 172.21.15.7:0/2657169806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c0d0820 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3554009870 tx=0x7f355402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a059d4b0547957 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.179+0000 7f356be00640 1 -- 172.21.15.7:0/2657169806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554037070 con 0x7f356c0d03c0 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.179+0000 7f356be00640 1 -- 172.21.15.7:0/2657169806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3554032440 con 0x7f356c0d03c0 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.179+0000 7f356be00640 1 -- 172.21.15.7:0/2657169806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554032810 con 0x7f356c0d03c0 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 -- 172.21.15.7:0/2657169806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 msgr2=0x7f356c0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 --2- 172.21.15.7:0/2657169806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c0d0820 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3554009870 tx=0x7f355402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 -- 172.21.15.7:0/2657169806 shutdown_connections 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 --2- 172.21.15.7:0/2657169806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c0d0820 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 --2- 172.21.15.7:0/2657169806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c15f5b0 0x7f356c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 -- 172.21.15.7:0/2657169806 >> 172.21.15.7:0/2657169806 conn(0x7f356c06bc70 msgr2=0x7f356c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 -- 172.21.15.7:0/2657169806 shutdown_connections 2024-08-19T00:42:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.180+0000 7f3573400640 1 -- 172.21.15.7:0/2657169806 wait complete. 2024-08-19T00:42:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.182+0000 7f3573400640 1 Processor -- start 2024-08-19T00:42:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.182+0000 7f3573400640 1 -- start start 2024-08-19T00:42:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3573400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c0b4380 0x7f356c1f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3573400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3573400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c15f5b0 0x7f356c161fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3573400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f356c0cedb0 con 0x7f356c0d03c0 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3573400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f356c0cf120 con 0x7f356c15f5b0 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3573400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f356c06e660 con 0x7f356c0b4380 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34198/0 (socket says 172.21.15.7:34198) 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 -- 172.21.15.7:0/119108257 learned_addr learned my addr 172.21.15.7:0/119108257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3570a00640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c0b4380 0x7f356c1f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3571400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c15f5b0 0x7f356c161fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 -- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c0b4380 msgr2=0x7f356c1f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c0b4380 0x7f356c1f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 -- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c15f5b0 msgr2=0x7f356c161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c15f5b0 0x7f356c161fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3563e00640 1 -- 172.21.15.7:0/119108257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c151540 con 0x7f356c0d03c0 2024-08-19T00:42:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.183+0000 7f3571400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c15f5b0 0x7f356c161fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.184+0000 7f3563e00640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c151000 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f35540090b0 tx=0x7f35540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.184+0000 7f3569600640 1 -- 172.21.15.7:0/119108257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554037040 con 0x7f356c0d03c0 2024-08-19T00:42:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.184+0000 7f3569600640 1 -- 172.21.15.7:0/119108257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3554004230 con 0x7f356c0d03c0 2024-08-19T00:42:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.184+0000 7f3569600640 1 -- 172.21.15.7:0/119108257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554003610 con 0x7f356c0d03c0 2024-08-19T00:42:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.184+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c1555d0 con 0x7f356c0d03c0 2024-08-19T00:42:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.184+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c155b90 con 0x7f356c0d03c0 2024-08-19T00:42:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.185+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c0d0820 con 0x7f356c0d03c0 2024-08-19T00:42:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.186+0000 7f3569600640 1 -- 172.21.15.7:0/119108257 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f355402ad10 con 0x7f356c0d03c0 2024-08-19T00:42:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.187+0000 7f3569600640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f354806be30 0x7f354806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.187+0000 7f3569600640 1 -- 172.21.15.7:0/119108257 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7f35540abaf0 con 0x7f356c0d03c0 2024-08-19T00:42:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.187+0000 7f3570a00640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f354806be30 0x7f354806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.188+0000 7f3570a00640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f354806be30 0x7f354806e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f355c006fd0 tx=0x7f355c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.192+0000 7f3569600640 1 -- 172.21.15.7:0/119108257 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f355407a560 con 0x7f356c0d03c0 2024-08-19T00:42:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.379+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f356c158470 con 0x7f356c0d03c0 2024-08-19T00:42:18.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.380+0000 7f3569600640 1 -- 172.21.15.7:0/119108257 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16980 (secure 0 0 0) 0x7f3554079e60 con 0x7f356c0d03c0 2024-08-19T00:42:18.382 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:18.382 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":61,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:40:37.370941+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:39:33.403543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-08-19T00:39:34.553083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1f","mappings":[{"from":6,"to":1}]},{"pgid":"9.3b","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/2987342349":"2024-08-20T00:40:37.370877+0000","172.21.15.7:6834/2987342349":"2024-08-20T00:40:37.370877+0000","172.21.15.7:6836/3306229985":"2024-08-20T00:40:01.274319+0000","172.21.15.7:6834/3306229985":"2024-08-20T00:40:01.274319+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:42:18.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f354806be30 msgr2=0x7f354806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f354806be30 0x7f354806e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f355c006fd0 tx=0x7f355c008040 comp rx=0 tx=0).stop 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 msgr2=0x7f356c151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c151000 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f35540090b0 tx=0x7f35540046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 shutdown_connections 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f354806be30 0x7f354806e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f356c15f5b0 0x7f356c161fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f356c0d03c0 0x7f356c151000 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 --2- 172.21.15.7:0/119108257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f356c0b4380 0x7f356c1f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 >> 172.21.15.7:0/119108257 conn(0x7f356c06bc70 msgr2=0x7f356c15d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 shutdown_connections 2024-08-19T00:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.383+0000 7f3573400640 1 -- 172.21.15.7:0/119108257 wait complete. 2024-08-19T00:42:18.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:42:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.556+0000 7fd939e00640 1 Processor -- start 2024-08-19T00:42:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.556+0000 7fd939e00640 1 -- start start 2024-08-19T00:42:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd939e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd93415e3e0 0x7fd9340b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd939e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd9340d27b0 0x7fd9340d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd939e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9340b4df0 con 0x7fd9340b4150 2024-08-19T00:42:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd939e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd9340d3140 con 0x7fd93415e3e0 2024-08-19T00:42:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd939e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd9340b50d0 con 0x7fd9340d27b0 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd938a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd93415e3e0 0x7fd9340b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd939400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd9340b4150 0x7fd9340b45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53478/0 (socket says 172.21.15.7:53478) 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.557+0000 7fd939400640 1 -- 172.21.15.7:0/1897809208 learned_addr learned my addr 172.21.15.7:0/1897809208 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.558+0000 7fd938a00640 1 -- 172.21.15.7:0/1897809208 >> v2:172.21.15.162:3300/0 conn(0x7fd9340d27b0 msgr2=0x7fd9340d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.558+0000 7fd938a00640 1 --2- 172.21.15.7:0/1897809208 >> v2:172.21.15.162:3300/0 conn(0x7fd9340d27b0 0x7fd9340d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.558+0000 7fd938a00640 1 -- 172.21.15.7:0/1897809208 >> v1:172.21.15.7:6789/0 conn(0x7fd9340b4150 legacy=0x7fd9340b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.558+0000 7fd938a00640 1 -- 172.21.15.7:0/1897809208 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9340cf1e0 con 0x7fd93415e3e0 2024-08-19T00:42:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.558+0000 7fd933400640 1 -- 172.21.15.7:0/1897809208 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214967072 0 0) 0x7fd9340b4df0 con 0x7fd9340b4150 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.559+0000 7fd938a00640 1 --2- 172.21.15.7:0/1897809208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd93415e3e0 0x7fd9340b0e60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd9280097a0 tx=0x7fd92802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a752b0c02e5c1052 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.559+0000 7fd933400640 1 -- 172.21.15.7:0/1897809208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928037070 con 0x7fd93415e3e0 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.559+0000 7fd933400640 1 -- 172.21.15.7:0/1897809208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd928032440 con 0x7fd93415e3e0 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.559+0000 7fd933400640 1 -- 172.21.15.7:0/1897809208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928032810 con 0x7fd93415e3e0 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 -- 172.21.15.7:0/1897809208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd93415e3e0 msgr2=0x7fd9340b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 --2- 172.21.15.7:0/1897809208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd93415e3e0 0x7fd9340b0e60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd9280097a0 tx=0x7fd92802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 -- 172.21.15.7:0/1897809208 shutdown_connections 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 --2- 172.21.15.7:0/1897809208 >> v2:172.21.15.162:3300/0 conn(0x7fd9340d27b0 0x7fd9340d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 --2- 172.21.15.7:0/1897809208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd93415e3e0 0x7fd9340b0e60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 -- 172.21.15.7:0/1897809208 >> 172.21.15.7:0/1897809208 conn(0x7fd93408dbe0 msgr2=0x7fd93409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 -- 172.21.15.7:0/1897809208 shutdown_connections 2024-08-19T00:42:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.560+0000 7fd939e00640 1 -- 172.21.15.7:0/1897809208 wait complete. 2024-08-19T00:42:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.561+0000 7fd939e00640 1 Processor -- start 2024-08-19T00:42:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.561+0000 7fd939e00640 1 -- start start 2024-08-19T00:42:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.562+0000 7fd939e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9340b4150 0x7fd9341588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.562+0000 7fd939e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9340d27b0 0x7fd9340b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.562+0000 7fd939e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd93415e3e0 0x7fd9340b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.562+0000 7fd939e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9340b13a0 con 0x7fd9340d27b0 2024-08-19T00:42:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.562+0000 7fd939e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9340cee90 con 0x7fd9340b4150 2024-08-19T00:42:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.562+0000 7fd939e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd9340cf9e0 con 0x7fd93415e3e0 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9340d27b0 0x7fd9340b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9340d27b0 0x7fd9340b8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34214/0 (socket says 172.21.15.7:34214) 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 -- 172.21.15.7:0/1067441803 learned_addr learned my addr 172.21.15.7:0/1067441803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd939400640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd93415e3e0 0x7fd9340b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd938a00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9340b4150 0x7fd9341588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 -- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd93415e3e0 msgr2=0x7fd9340b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd93415e3e0 0x7fd9340b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 -- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9340b4150 msgr2=0x7fd9341588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9340b4150 0x7fd9341588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 -- 172.21.15.7:0/1067441803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9340ba010 con 0x7fd9340d27b0 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd939400640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd93415e3e0 0x7fd9340b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd938a00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9340b4150 0x7fd9341588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.563+0000 7fd933e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9340d27b0 0x7fd9340b8e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b4d0 tx=0x7fd92000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.564+0000 7fd930c00640 1 -- 172.21.15.7:0/1067441803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920014070 con 0x7fd9340d27b0 2024-08-19T00:42:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.564+0000 7fd930c00640 1 -- 172.21.15.7:0/1067441803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920010870 con 0x7fd9340d27b0 2024-08-19T00:42:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.564+0000 7fd930c00640 1 -- 172.21.15.7:0/1067441803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920010c60 con 0x7fd9340d27b0 2024-08-19T00:42:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.564+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9341f7520 con 0x7fd9340d27b0 2024-08-19T00:42:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.564+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9341f7ae0 con 0x7fd9340d27b0 2024-08-19T00:42:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.565+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9340d2c00 con 0x7fd9340d27b0 2024-08-19T00:42:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.566+0000 7fd930c00640 1 -- 172.21.15.7:0/1067441803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd920017070 con 0x7fd9340d27b0 2024-08-19T00:42:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.567+0000 7fd930c00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd91406be30 0x7fd91406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.567+0000 7fd930c00640 1 -- 172.21.15.7:0/1067441803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5939+0+0 (secure 0 0 0) 0x7fd92008ad40 con 0x7fd9340d27b0 2024-08-19T00:42:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.567+0000 7fd938a00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd91406be30 0x7fd91406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.568+0000 7fd938a00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd91406be30 0x7fd91406e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd928034000 tx=0x7fd92802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.571+0000 7fd930c00640 1 -- 172.21.15.7:0/1067441803 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd920059600 con 0x7fd9340d27b0 2024-08-19T00:42:18.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.790+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd93409d5a0 con 0x7fd9340d27b0 2024-08-19T00:42:18.792 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:42:18.791+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:42:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.793+0000 7fd930c00640 1 -- 172.21.15.7:0/1067441803 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) ==== 161+0+0 (secure 0 0 0) 0x7fd920058f00 con 0x7fd9340d27b0 2024-08-19T00:42:18.795 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd91406be30 msgr2=0x7fd91406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd91406be30 0x7fd91406e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd928034000 tx=0x7fd92802e000 comp rx=0 tx=0).stop 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9340d27b0 msgr2=0x7fd9340b8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9340d27b0 0x7fd9340b8e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b4d0 tx=0x7fd92000b990 comp rx=0 tx=0).stop 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 shutdown_connections 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd91406be30 0x7fd91406e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd93415e3e0 0x7fd9340b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9340d27b0 0x7fd9340b8e30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 --2- 172.21.15.7:0/1067441803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9340b4150 0x7fd9341588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 >> 172.21.15.7:0/1067441803 conn(0x7fd93408dbe0 msgr2=0x7fd9340d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 shutdown_connections 2024-08-19T00:42:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.796+0000 7fd939e00640 1 -- 172.21.15.7:0/1067441803 wait complete. 2024-08-19T00:42:18.808 INFO:tasks.ceph.mds.c.smithi007.stderr: -4075> 2024-08-19T00:40:43.121+0000 7fcf17e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:42:18.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:42:18.856 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:42:18.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.975+0000 7f0021800640 1 Processor -- start 2024-08-19T00:42:18.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.975+0000 7f0021800640 1 -- start start 2024-08-19T00:42:18.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f0021800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c158cd0 0x7f001c072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f0021800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f001c0ae480 0x7f001c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f0021800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c0aeae0 con 0x7f001c072ff0 2024-08-19T00:42:18.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f0021800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f001c073430 con 0x7f001c0ae480 2024-08-19T00:42:18.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f0021800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f001c0aedc0 con 0x7f001c158cd0 2024-08-19T00:42:18.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f001b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f001c0ae480 0x7f001c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f001b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f001c0ae480 0x7f001c0b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34238/0 (socket says 172.21.15.7:34238) 2024-08-19T00:42:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f001b400640 1 -- 172.21.15.7:0/585314449 learned_addr learned my addr 172.21.15.7:0/585314449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.976+0000 7f001aa00640 1 --2- 172.21.15.7:0/585314449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c158cd0 0x7f001c072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.977+0000 7f001b400640 1 -- 172.21.15.7:0/585314449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c158cd0 msgr2=0x7f001c072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.977+0000 7f001b400640 1 --2- 172.21.15.7:0/585314449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c158cd0 0x7f001c072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.977+0000 7f001b400640 1 -- 172.21.15.7:0/585314449 >> v1:172.21.15.162:6789/0 conn(0x7f001c072ff0 legacy=0x7f001c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:18.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.977+0000 7f001b400640 1 -- 172.21.15.7:0/585314449 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c0af0a0 con 0x7f001c0ae480 2024-08-19T00:42:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.978+0000 7f001b400640 1 --2- 172.21.15.7:0/585314449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c0ae480 0x7f001c0b3150 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f001c0735b0 tx=0x7f001402a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65f4adc9addd535 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.978+0000 7f0019600640 1 -- 172.21.15.7:0/585314449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014036070 con 0x7f001c0ae480 2024-08-19T00:42:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.978+0000 7f0019600640 1 -- 172.21.15.7:0/585314449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0014031600 con 0x7f001c0ae480 2024-08-19T00:42:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.978+0000 7f0019600640 1 -- 172.21.15.7:0/585314449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00140319d0 con 0x7f001c0ae480 2024-08-19T00:42:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.978+0000 7f0021800640 1 -- 172.21.15.7:0/585314449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c0ae480 msgr2=0x7f001c0b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.978+0000 7f0021800640 1 --2- 172.21.15.7:0/585314449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c0ae480 0x7f001c0b3150 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f001c0735b0 tx=0x7f001402a590 comp rx=0 tx=0).stop 2024-08-19T00:42:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.979+0000 7f0021800640 1 -- 172.21.15.7:0/585314449 shutdown_connections 2024-08-19T00:42:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.979+0000 7f0021800640 1 --2- 172.21.15.7:0/585314449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c0ae480 0x7f001c0b3150 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.979+0000 7f0021800640 1 --2- 172.21.15.7:0/585314449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c158cd0 0x7f001c072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.979+0000 7f0021800640 1 -- 172.21.15.7:0/585314449 >> 172.21.15.7:0/585314449 conn(0x7f001c0b2300 msgr2=0x7f001c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.979+0000 7f0021800640 1 -- 172.21.15.7:0/585314449 shutdown_connections 2024-08-19T00:42:18.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.979+0000 7f0021800640 1 -- 172.21.15.7:0/585314449 wait complete. 2024-08-19T00:42:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.980+0000 7f0021800640 1 Processor -- start 2024-08-19T00:42:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.980+0000 7f0021800640 1 -- start start 2024-08-19T00:42:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.981+0000 7f0021800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c072ff0 0x7f001c1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.981+0000 7f0021800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f001c0ae480 0x7f001c09ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.981+0000 7f0021800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c09bf50 0x7f001c13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.981+0000 7f0021800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f001c0b3690 con 0x7f001c072ff0 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.981+0000 7f0021800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f001c0af660 con 0x7f001c0ae480 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.981+0000 7f0021800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f001c0b3810 con 0x7f001c09bf50 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c072ff0 0x7f001c1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c072ff0 0x7f001c1f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34240/0 (socket says 172.21.15.7:34240) 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 -- 172.21.15.7:0/619380272 learned_addr learned my addr 172.21.15.7:0/619380272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001b400640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c09bf50 0x7f001c13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 -- 172.21.15.7:0/619380272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c09bf50 msgr2=0x7f001c13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c09bf50 0x7f001c13f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 -- 172.21.15.7:0/619380272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f001c0ae480 msgr2=0x7f001c09ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:18.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f001c0ae480 0x7f001c09ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:18.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 -- 172.21.15.7:0/619380272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c1564a0 con 0x7f001c072ff0 2024-08-19T00:42:18.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.982+0000 7f001aa00640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c072ff0 0x7f001c1f1fd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f000c00d5f0 tx=0x7f000c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.983+0000 7f0012a00640 1 -- 172.21.15.7:0/619380272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0125f0 con 0x7f001c072ff0 2024-08-19T00:42:18.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.983+0000 7f0012a00640 1 -- 172.21.15.7:0/619380272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c019070 con 0x7f001c072ff0 2024-08-19T00:42:18.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.983+0000 7f0012a00640 1 -- 172.21.15.7:0/619380272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0129d0 con 0x7f001c072ff0 2024-08-19T00:42:18.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.983+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c156780 con 0x7f001c072ff0 2024-08-19T00:42:18.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.983+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c09c3e0 con 0x7f001c072ff0 2024-08-19T00:42:18.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.984+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c0b3150 con 0x7f001c072ff0 2024-08-19T00:42:18.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.985+0000 7f0012a00640 1 -- 172.21.15.7:0/619380272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f000c012b70 con 0x7f001c072ff0 2024-08-19T00:42:18.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.986+0000 7f0012a00640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efffc06be30 0x7efffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:18.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.986+0000 7f0012a00640 1 -- 172.21.15.7:0/619380272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6025+0+0 (secure 0 0 0) 0x7f000c08b370 con 0x7f001c072ff0 2024-08-19T00:42:18.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.986+0000 7f001a000640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efffc06be30 0x7efffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:18.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.987+0000 7f001a000640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efffc06be30 0x7efffc06e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f001c09d270 tx=0x7f00080079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:18.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:18.990+0000 7f0012a00640 1 -- 172.21.15.7:0/619380272 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f000c059bd0 con 0x7f001c072ff0 2024-08-19T00:42:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.214+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f001c0cfd30 con 0x7f001c072ff0 2024-08-19T00:42:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.800+0000 7f0012a00640 1 -- 172.21.15.7:0/619380272 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) ==== 104+0+0 (secure 0 0 0) 0x7f000c0594d0 con 0x7f001c072ff0 2024-08-19T00:42:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efffc06be30 msgr2=0x7efffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efffc06be30 0x7efffc06e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f001c09d270 tx=0x7f00080079b0 comp rx=0 tx=0).stop 2024-08-19T00:42:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c072ff0 msgr2=0x7f001c1f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c072ff0 0x7f001c1f1fd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f000c00d5f0 tx=0x7f000c00dab0 comp rx=0 tx=0).stop 2024-08-19T00:42:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 shutdown_connections 2024-08-19T00:42:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efffc06be30 0x7efffc06e2f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f001c09bf50 0x7f001c13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f001c0ae480 0x7f001c09ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 --2- 172.21.15.7:0/619380272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f001c072ff0 0x7f001c1f1fd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 >> 172.21.15.7:0/619380272 conn(0x7f001c0b2300 msgr2=0x7f001c0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 shutdown_connections 2024-08-19T00:42:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:19.803+0000 7f0021800640 1 -- 172.21.15.7:0/619380272 wait complete. 2024-08-19T00:42:19.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:42:20.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.022+0000 7fd5b7200640 1 Processor -- start 2024-08-19T00:42:20.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.022+0000 7fd5b7200640 1 -- start start 2024-08-19T00:42:20.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.023+0000 7fd5b7200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5b0073540 0x7fd5b00cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.023+0000 7fd5b7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0160940 0x7fd5b00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5b7200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b015d390 con 0x7fd5b015c740 2024-08-19T00:42:20.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5b7200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b0072f10 con 0x7fd5b0073540 2024-08-19T00:42:20.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5b7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b015d670 con 0x7fd5b0160940 2024-08-19T00:42:20.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5afe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5b0073540 0x7fd5b00cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:20.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5afe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd5b0073540 0x7fd5b00cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34244/0 (socket says 172.21.15.7:34244) 2024-08-19T00:42:20.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5afe00640 1 -- 172.21.15.7:0/439164960 learned_addr learned my addr 172.21.15.7:0/439164960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:20.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5afe00640 1 -- 172.21.15.7:0/439164960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0160940 msgr2=0x7fd5b00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:20.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5afe00640 1 --2- 172.21.15.7:0/439164960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0160940 0x7fd5b00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5afe00640 1 -- 172.21.15.7:0/439164960 >> v1:172.21.15.7:6789/0 conn(0x7fd5b015c740 legacy=0x7fd5b015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.024+0000 7fd5afe00640 1 -- 172.21.15.7:0/439164960 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b015fe60 con 0x7fd5b0073540 2024-08-19T00:42:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.025+0000 7fd5afe00640 1 --2- 172.21.15.7:0/439164960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0073540 0x7fd5b00cc970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009870 tx=0x7fd5a002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e97c58501f2887a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5af400640 1 -- 172.21.15.7:0/439164960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0037070 con 0x7fd5b0073540 2024-08-19T00:42:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5af400640 1 -- 172.21.15.7:0/439164960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a0032440 con 0x7fd5b0073540 2024-08-19T00:42:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5af400640 1 -- 172.21.15.7:0/439164960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0032810 con 0x7fd5b0073540 2024-08-19T00:42:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 -- 172.21.15.7:0/439164960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0073540 msgr2=0x7fd5b00cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 --2- 172.21.15.7:0/439164960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0073540 0x7fd5b00cc970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009870 tx=0x7fd5a002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 -- 172.21.15.7:0/439164960 shutdown_connections 2024-08-19T00:42:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 --2- 172.21.15.7:0/439164960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0160940 0x7fd5b00cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 --2- 172.21.15.7:0/439164960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0073540 0x7fd5b00cc970 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 -- 172.21.15.7:0/439164960 >> 172.21.15.7:0/439164960 conn(0x7fd5b006be80 msgr2=0x7fd5b00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 -- 172.21.15.7:0/439164960 shutdown_connections 2024-08-19T00:42:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.026+0000 7fd5b7200640 1 -- 172.21.15.7:0/439164960 wait complete. 2024-08-19T00:42:20.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.028+0000 7fd5b7200640 1 Processor -- start 2024-08-19T00:42:20.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.028+0000 7fd5b7200640 1 -- start start 2024-08-19T00:42:20.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0073540 0x7fd5b006da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5b015c740 0x7fd5b014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0160940 0x7fd5b0148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0073920 con 0x7fd5b0160940 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0160420 con 0x7fd5b015c740 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b00b4130 con 0x7fd5b0073540 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0160940 0x7fd5b0148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0160940 0x7fd5b0148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34258/0 (socket says 172.21.15.7:34258) 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 -- 172.21.15.7:0/686211809 learned_addr learned my addr 172.21.15.7:0/686211809 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 -- 172.21.15.7:0/686211809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0073540 msgr2=0x7fd5b006da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0073540 0x7fd5b006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 -- 172.21.15.7:0/686211809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5b015c740 msgr2=0x7fd5b014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5b015c740 0x7fd5b014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.029+0000 7fd5b5200640 1 -- 172.21.15.7:0/686211809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b0143f60 con 0x7fd5b0160940 2024-08-19T00:42:20.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.030+0000 7fd5b5200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0160940 0x7fd5b0148770 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c7a0 tx=0x7fd5a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:20.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.030+0000 7fd5acc00640 1 -- 172.21.15.7:0/686211809 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8003b70 con 0x7fd5b0160940 2024-08-19T00:42:20.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.030+0000 7fd5acc00640 1 -- 172.21.15.7:0/686211809 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a8003d30 con 0x7fd5b0160940 2024-08-19T00:42:20.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.030+0000 7fd5acc00640 1 -- 172.21.15.7:0/686211809 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800aa90 con 0x7fd5b0160940 2024-08-19T00:42:20.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.030+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b01439a0 con 0x7fd5b0160940 2024-08-19T00:42:20.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.030+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b00cf180 con 0x7fd5b0160940 2024-08-19T00:42:20.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.031+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b015cbd0 con 0x7fd5b0160940 2024-08-19T00:42:20.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.032+0000 7fd5acc00640 1 -- 172.21.15.7:0/686211809 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5a800ac30 con 0x7fd5b0160940 2024-08-19T00:42:20.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.033+0000 7fd5acc00640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd58c06be30 0x7fd58c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.034+0000 7fd5acc00640 1 -- 172.21.15.7:0/686211809 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6025+0+0 (secure 0 0 0) 0x7fd5a808af60 con 0x7fd5b0160940 2024-08-19T00:42:20.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.034+0000 7fd5afe00640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd58c06be30 0x7fd58c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:20.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.034+0000 7fd5afe00640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd58c06be30 0x7fd58c06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0034000 tx=0x7fd5a002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:20.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.038+0000 7fd5acc00640 1 -- 172.21.15.7:0/686211809 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd5a80597c0 con 0x7fd5b0160940 2024-08-19T00:42:20.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.221+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd5b00b29c0 con 0x7fd5b0160940 2024-08-19T00:42:20.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.802+0000 7fd5acc00640 1 -- 172.21.15.7:0/686211809 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) ==== 181+0+0 (secure 0 0 0) 0x7fd5a80590c0 con 0x7fd5b0160940 2024-08-19T00:42:20.804 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.806+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd58c06be30 msgr2=0x7fd58c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.806+0000 7fd5b7200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd58c06be30 0x7fd58c06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0034000 tx=0x7fd5a002c000 comp rx=0 tx=0).stop 2024-08-19T00:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.806+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0160940 msgr2=0x7fd5b0148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.806+0000 7fd5b7200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0160940 0x7fd5b0148770 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c7a0 tx=0x7fd5a800cc60 comp rx=0 tx=0).stop 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 shutdown_connections 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd58c06be30 0x7fd58c06e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b0160940 0x7fd5b0148770 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5b015c740 0x7fd5b014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 --2- 172.21.15.7:0/686211809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5b0073540 0x7fd5b006da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 >> 172.21.15.7:0/686211809 conn(0x7fd5b006be80 msgr2=0x7fd5b0074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 shutdown_connections 2024-08-19T00:42:20.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.807+0000 7fd5b7200640 1 -- 172.21.15.7:0/686211809 wait complete. 2024-08-19T00:42:20.827 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.989+0000 7f62f3800640 1 Processor -- start 2024-08-19T00:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.989+0000 7f62f3800640 1 -- start start 2024-08-19T00:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.990+0000 7f62f3800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f62ec15bd00 0x7f62ec15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.990+0000 7f62f3800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec0cdea0 0x7f62ec0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62f3800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ec06fa10 con 0x7f62ec071ee0 2024-08-19T00:42:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62f3800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f62ec072350 con 0x7f62ec15bd00 2024-08-19T00:42:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62f3800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec0ce6f0 con 0x7f62ec0cdea0 2024-08-19T00:42:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62f1800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f62ec071ee0 0x7f62ec15ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53494/0 (socket says 172.21.15.7:53494) 2024-08-19T00:42:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62f1800640 1 -- 172.21.15.7:0/3656286535 learned_addr learned my addr 172.21.15.7:0/3656286535 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62f0e00640 1 --2- 172.21.15.7:0/3656286535 >> v2:172.21.15.162:3300/0 conn(0x7f62ec15bd00 0x7f62ec15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62ebe00640 1 --2- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec0cdea0 0x7f62ec0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62eb400640 1 -- 172.21.15.7:0/3656286535 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008374408 0 0) 0x7f62ec06fa10 con 0x7f62ec071ee0 2024-08-19T00:42:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.991+0000 7f62eb400640 1 -- 172.21.15.7:0/3656286535 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d4003520 con 0x7f62ec071ee0 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.992+0000 7f62f0e00640 1 -- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec0cdea0 msgr2=0x7f62ec0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.992+0000 7f62f0e00640 1 --2- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec0cdea0 0x7f62ec0719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.992+0000 7f62f0e00640 1 -- 172.21.15.7:0/3656286535 >> v1:172.21.15.7:6789/0 conn(0x7f62ec071ee0 legacy=0x7f62ec15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.992+0000 7f62f0e00640 1 -- 172.21.15.7:0/3656286535 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec0ce9d0 con 0x7f62ec15bd00 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.992+0000 7f62ebe00640 1 --2- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec0cdea0 0x7f62ec0719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.993+0000 7f62f0e00640 1 --2- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 0x7f62ec15c0e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f62e00097a0 tx=0x7f62e002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c7e5b18e5268c4b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.993+0000 7f62eb400640 1 -- 172.21.15.7:0/3656286535 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0037070 con 0x7f62ec15bd00 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.993+0000 7f62eb400640 1 -- 172.21.15.7:0/3656286535 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e0032440 con 0x7f62ec15bd00 2024-08-19T00:42:20.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.993+0000 7f62eb400640 1 -- 172.21.15.7:0/3656286535 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00327f0 con 0x7f62ec15bd00 2024-08-19T00:42:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.993+0000 7f62f3800640 1 -- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 msgr2=0x7f62ec15c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.993+0000 7f62f3800640 1 --2- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 0x7f62ec15c0e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f62e00097a0 tx=0x7f62e002a180 comp rx=0 tx=0).stop 2024-08-19T00:42:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.994+0000 7f62f3800640 1 -- 172.21.15.7:0/3656286535 shutdown_connections 2024-08-19T00:42:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.994+0000 7f62f3800640 1 --2- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec0cdea0 0x7f62ec0719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.994+0000 7f62f3800640 1 --2- 172.21.15.7:0/3656286535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 0x7f62ec15c0e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:20.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.994+0000 7f62f3800640 1 -- 172.21.15.7:0/3656286535 >> 172.21.15.7:0/3656286535 conn(0x7f62ec06be80 msgr2=0x7f62ec0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.994+0000 7f62f3800640 1 -- 172.21.15.7:0/3656286535 shutdown_connections 2024-08-19T00:42:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.994+0000 7f62f3800640 1 -- 172.21.15.7:0/3656286535 wait complete. 2024-08-19T00:42:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.995+0000 7f62f3800640 1 Processor -- start 2024-08-19T00:42:20.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.995+0000 7f62f3800640 1 -- start start 2024-08-19T00:42:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.996+0000 7f62f3800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec071ee0 0x7f62ec152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.996+0000 7f62f3800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62ec0cdea0 0x7f62ec1f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.996+0000 7f62f3800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 0x7f62ec09c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.996+0000 7f62f3800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec0cf270 con 0x7f62ec0cdea0 2024-08-19T00:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.996+0000 7f62f3800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec0cef90 con 0x7f62ec15bd00 2024-08-19T00:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.996+0000 7f62f3800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec0cf790 con 0x7f62ec071ee0 2024-08-19T00:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62ec0cdea0 0x7f62ec1f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62ec0cdea0 0x7f62ec1f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34272/0 (socket says 172.21.15.7:34272) 2024-08-19T00:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 -- 172.21.15.7:0/2156885522 learned_addr learned my addr 172.21.15.7:0/2156885522 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62f0e00640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec071ee0 0x7f62ec152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62f1800640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 0x7f62ec09c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 -- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec071ee0 msgr2=0x7f62ec152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec071ee0 0x7f62ec152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 -- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 msgr2=0x7f62ec09c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 0x7f62ec09c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 -- 172.21.15.7:0/2156885522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec1f49e0 con 0x7f62ec0cdea0 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.997+0000 7f62ebe00640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62ec0cdea0 0x7f62ec1f41b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f62d800e960 tx=0x7f62d800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.998+0000 7f62e8c00640 1 -- 172.21.15.7:0/2156885522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8017070 con 0x7f62ec0cdea0 2024-08-19T00:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.998+0000 7f62e8c00640 1 -- 172.21.15.7:0/2156885522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d800ca00 con 0x7f62ec0cdea0 2024-08-19T00:42:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.998+0000 7f62e8c00640 1 -- 172.21.15.7:0/2156885522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d800cdd0 con 0x7f62ec0cdea0 2024-08-19T00:42:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.998+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ec1f4cc0 con 0x7f62ec0cdea0 2024-08-19T00:42:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.998+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ec152c80 con 0x7f62ec0cdea0 2024-08-19T00:42:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:20.999+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ec15faa0 con 0x7f62ec0cdea0 2024-08-19T00:42:21.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.000+0000 7f62e8c00640 1 -- 172.21.15.7:0/2156885522 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62d801a070 con 0x7f62ec0cdea0 2024-08-19T00:42:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.001+0000 7f62e8c00640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62cc06be30 0x7f62cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.001+0000 7f62e8c00640 1 -- 172.21.15.7:0/2156885522 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5587+0+0 (secure 0 0 0) 0x7f62d808afc0 con 0x7f62ec0cdea0 2024-08-19T00:42:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.002+0000 7f62f0e00640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62cc06be30 0x7f62cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.002+0000 7f62f0e00640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62cc06be30 0x7f62cc06e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f62e0034000 tx=0x7f62e002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:21.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.006+0000 7f62e8c00640 1 -- 172.21.15.7:0/2156885522 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f62ec15faa0 con 0x7f62ec0cdea0 2024-08-19T00:42:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.189+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f62ec0ce300 con 0x7f62ec0cdea0 2024-08-19T00:42:21.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.809+0000 7f62e8c00640 1 -- 172.21.15.7:0/2156885522 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) ==== 169+0+0 (secure 0 0 0) 0x7f62d8059380 con 0x7f62ec0cdea0 2024-08-19T00:42:21.811 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-08-19T00:42:21.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62cc06be30 msgr2=0x7f62cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62cc06be30 0x7f62cc06e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f62e0034000 tx=0x7f62e002e000 comp rx=0 tx=0).stop 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62ec0cdea0 msgr2=0x7f62ec1f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62ec0cdea0 0x7f62ec1f41b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f62d800e960 tx=0x7f62d800ee20 comp rx=0 tx=0).stop 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 shutdown_connections 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62cc06be30 0x7f62cc06e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62ec15bd00 0x7f62ec09c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62ec0cdea0 0x7f62ec1f41b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 --2- 172.21.15.7:0/2156885522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62ec071ee0 0x7f62ec152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.813+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 >> 172.21.15.7:0/2156885522 conn(0x7f62ec06be80 msgr2=0x7f62ec06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.817+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 shutdown_connections 2024-08-19T00:42:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:21.817+0000 7f62f3800640 1 -- 172.21.15.7:0/2156885522 wait complete. 2024-08-19T00:42:21.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_journal_corrupt_dentry_first 2024-08-19T00:42:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.002+0000 7fcbbac00640 1 Processor -- start 2024-08-19T00:42:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.002+0000 7fcbbac00640 1 -- start start 2024-08-19T00:42:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.003+0000 7fcbbac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb4158cd0 0x7fcbb4072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.003+0000 7fcbbac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb40aeae0 con 0x7fcbb40ae480 2024-08-19T00:42:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.003+0000 7fcbbac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb40aedc0 con 0x7fcbb4072ff0 2024-08-19T00:42:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.003+0000 7fcbbac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb4073430 con 0x7fcbb4158cd0 2024-08-19T00:42:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb8c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcbb40ae480 0x7fcbb40b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53504/0 (socket says 172.21.15.7:53504) 2024-08-19T00:42:22.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb8c00640 1 -- 172.21.15.7:0/3238929699 learned_addr learned my addr 172.21.15.7:0/3238929699 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797349490 0 0) 0x7fcbb40aeae0 con 0x7fcbb40ae480 2024-08-19T00:42:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb98003520 con 0x7fcbb40ae480 2024-08-19T00:42:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3593276731 0 0) 0x7fcb98003520 con 0x7fcbb40ae480 2024-08-19T00:42:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb4158cd0 msgr2=0x7fcbb4072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb4158cd0 0x7fcbb4072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 >> v1:172.21.15.162:6789/0 conn(0x7fcbb4072ff0 legacy=0x7fcbb40add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb40af0a0 con 0x7fcbb40ae480 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fcbac0019f0 con 0x7fcbb40ae480 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 >> v1:172.21.15.7:6789/0 conn(0x7fcbb40ae480 legacy=0x7fcbb40b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb980039e0 0x7fcb98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb98004800 0x7fcb98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.004+0000 7fcbb3400640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb98005230 0x7fcb9800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb4073430 con 0x7fcb98004800 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9800e350 con 0x7fcb98005230 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9800e550 con 0x7fcb980039e0 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbabe00640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb98004800 0x7fcb98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbb8c00640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb98005230 0x7fcb9800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbabe00640 1 -- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb980039e0 msgr2=0x7fcb98003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:22.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbabe00640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb980039e0 0x7fcb98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbabe00640 1 -- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb98005230 msgr2=0x7fcb9800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbabe00640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb98005230 0x7fcb9800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.005+0000 7fcbabe00640 1 -- 172.21.15.7:0/3238929699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb98003520 con 0x7fcb98004800 2024-08-19T00:42:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.006+0000 7fcbabe00640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb98004800 0x7fcb98004c80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c001650 tx=0x7fcb98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbb40a4f638e2a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.006+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c001220 con 0x7fcb98004800 2024-08-19T00:42:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.006+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c02e070 con 0x7fcb98004800 2024-08-19T00:42:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.006+0000 7fcbb3400640 1 -- 172.21.15.7:0/3238929699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c02a7f0 con 0x7fcb98004800 2024-08-19T00:42:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.007+0000 7fcbbac00640 1 -- 172.21.15.7:0/3238929699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb98004800 msgr2=0x7fcb98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.007+0000 7fcbbac00640 1 --2- 172.21.15.7:0/3238929699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb98004800 0x7fcb98004c80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c001650 tx=0x7fcb98005830 comp rx=0 tx=0).stop 2024-08-19T00:42:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.007+0000 7fcbb8c00640 1 -- 172.21.15.7:0/3238929699 reap_dead start 2024-08-19T00:42:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.007+0000 7fcbbac00640 1 -- 172.21.15.7:0/3238929699 shutdown_connections 2024-08-19T00:42:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.007+0000 7fcbbac00640 1 -- 172.21.15.7:0/3238929699 >> 172.21.15.7:0/3238929699 conn(0x7fcbb40b2300 msgr2=0x7fcbb406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.007+0000 7fcbbac00640 1 -- 172.21.15.7:0/3238929699 shutdown_connections 2024-08-19T00:42:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.007+0000 7fcbbac00640 1 -- 172.21.15.7:0/3238929699 wait complete. 2024-08-19T00:42:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.009+0000 7fcbbac00640 1 Processor -- start 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.009+0000 7fcbbac00640 1 -- start start 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbbac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb98004800 0x7fcbb41f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbbac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb41ef380 0x7fcbb41ef800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbbac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbb406e920 0x7fcbb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbbac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb40b3860 con 0x7fcbb406e920 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbbac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb40af660 con 0x7fcbb41ef380 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbbac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb40b39e0 con 0x7fcb98004800 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbb406e920 0x7fcbb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbb406e920 0x7fcbb406edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34294/0 (socket says 172.21.15.7:34294) 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 -- 172.21.15.7:0/957513918 learned_addr learned my addr 172.21.15.7:0/957513918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 -- 172.21.15.7:0/957513918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb98004800 msgr2=0x7fcbb41f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb98004800 0x7fcbb41f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 -- 172.21.15.7:0/957513918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb41ef380 msgr2=0x7fcbb41ef800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb41ef380 0x7fcbb41ef800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.010+0000 7fcbb8c00640 1 -- 172.21.15.7:0/957513918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb41efe50 con 0x7fcbb406e920 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.011+0000 7fcbb8c00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbb406e920 0x7fcbb406edb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcbac000f80 tx=0x7fcbac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.011+0000 7fcbb0c00640 1 -- 172.21.15.7:0/957513918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac007aa0 con 0x7fcbb406e920 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.011+0000 7fcbb0c00640 1 -- 172.21.15.7:0/957513918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac00edc0 con 0x7fcbb406e920 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.011+0000 7fcbb0c00640 1 -- 172.21.15.7:0/957513918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac014670 con 0x7fcbb406e920 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.011+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb41f0130 con 0x7fcbb406e920 2024-08-19T00:42:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.011+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb41f06f0 con 0x7fcbb406e920 2024-08-19T00:42:22.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.012+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb4158cd0 con 0x7fcbb406e920 2024-08-19T00:42:22.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.013+0000 7fcbb0c00640 1 -- 172.21.15.7:0/957513918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbac014810 con 0x7fcbb406e920 2024-08-19T00:42:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.014+0000 7fcbb0c00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb9006be60 0x7fcb9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.014+0000 7fcbb0c00640 1 -- 172.21.15.7:0/957513918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7fcbac08aa80 con 0x7fcbb406e920 2024-08-19T00:42:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.014+0000 7fcbb3e00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb9006be60 0x7fcb9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.015+0000 7fcbb3e00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb9006be60 0x7fcb9006e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406f660 tx=0x7fcba4006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.018+0000 7fcbb0c00640 1 -- 172.21.15.7:0/957513918 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcbac08ce20 con 0x7fcbb406e920 2024-08-19T00:42:22.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.205+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"} v 0) -- 0x7fcbb41581a0 con 0x7fcbb406e920 2024-08-19T00:42:22.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.206+0000 7fcbb0c00640 1 -- 172.21.15.7:0/957513918 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7fcbac0595e0 con 0x7fcbb406e920 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb9006be60 msgr2=0x7fcb9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb9006be60 0x7fcb9006e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406f660 tx=0x7fcba4006ca0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbb406e920 msgr2=0x7fcbb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbb406e920 0x7fcbb406edb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcbac000f80 tx=0x7fcbac00e530 comp rx=0 tx=0).stop 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 shutdown_connections 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb9006be60 0x7fcb9006e320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbb406e920 0x7fcbb406edb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb41ef380 0x7fcbb41ef800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 --2- 172.21.15.7:0/957513918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb98004800 0x7fcbb41f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 >> 172.21.15.7:0/957513918 conn(0x7fcbb40b2300 msgr2=0x7fcbb40b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 shutdown_connections 2024-08-19T00:42:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.208+0000 7fcbbac00640 1 -- 172.21.15.7:0/957513918 wait complete. 2024-08-19T00:42:22.226 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-19T00:42:22.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.383+0000 7f2a28400640 1 Processor -- start 2024-08-19T00:42:22.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.383+0000 7f2a28400640 1 -- start start 2024-08-19T00:42:22.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.384+0000 7f2a28400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2a200b5130 0x7f2a200aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.384+0000 7f2a28400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200acef0 con 0x7f2a2015c390 2024-08-19T00:42:22.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.384+0000 7f2a28400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200ad1d0 con 0x7f2a2015bfb0 2024-08-19T00:42:22.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.384+0000 7f2a28400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2a200ad790 con 0x7f2a200b5130 2024-08-19T00:42:22.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a26400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2a2015c390 0x7f2a20072040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53506/0 (socket says 172.21.15.7:53506) 2024-08-19T00:42:22.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a26400640 1 -- 172.21.15.7:0/2056546485 learned_addr learned my addr 172.21.15.7:0/2056546485 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:22.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a25000640 1 --2- 172.21.15.7:0/2056546485 >> v2:172.21.15.162:3300/0 conn(0x7f2a200b5130 0x7f2a200aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a1fe00640 1 -- 172.21.15.7:0/2056546485 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130250875 0 0) 0x7f2a200acef0 con 0x7f2a2015c390 2024-08-19T00:42:22.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a1fe00640 1 -- 172.21.15.7:0/2056546485 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a08003520 con 0x7f2a2015c390 2024-08-19T00:42:22.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a1fe00640 1 -- 172.21.15.7:0/2056546485 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421910724 0 0) 0x7f2a200ad1d0 con 0x7f2a2015bfb0 2024-08-19T00:42:22.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a1fe00640 1 -- 172.21.15.7:0/2056546485 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a200acef0 con 0x7f2a2015bfb0 2024-08-19T00:42:22.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a25000640 1 -- 172.21.15.7:0/2056546485 >> v1:172.21.15.162:6789/0 conn(0x7f2a2015bfb0 legacy=0x7f2a200b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a25000640 1 -- 172.21.15.7:0/2056546485 >> v1:172.21.15.7:6789/0 conn(0x7f2a2015c390 legacy=0x7f2a20072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.385+0000 7f2a25000640 1 -- 172.21.15.7:0/2056546485 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a200ad4b0 con 0x7f2a200b5130 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.387+0000 7f2a25000640 1 --2- 172.21.15.7:0/2056546485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 0x7f2a200aebd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097a0 tx=0x7f2a0c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766657e0988f0a16 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a1fe00640 1 -- 172.21.15.7:0/2056546485 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c037070 con 0x7f2a200b5130 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a1fe00640 1 -- 172.21.15.7:0/2056546485 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c032440 con 0x7f2a200b5130 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a1fe00640 1 -- 172.21.15.7:0/2056546485 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0327f0 con 0x7f2a200b5130 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a28400640 1 -- 172.21.15.7:0/2056546485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 msgr2=0x7f2a200aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a28400640 1 --2- 172.21.15.7:0/2056546485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 0x7f2a200aebd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097a0 tx=0x7f2a0c02a230 comp rx=0 tx=0).stop 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a28400640 1 -- 172.21.15.7:0/2056546485 shutdown_connections 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a28400640 1 --2- 172.21.15.7:0/2056546485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 0x7f2a200aebd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.388+0000 7f2a28400640 1 -- 172.21.15.7:0/2056546485 >> 172.21.15.7:0/2056546485 conn(0x7f2a200b2300 msgr2=0x7f2a2006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.389+0000 7f2a28400640 1 -- 172.21.15.7:0/2056546485 shutdown_connections 2024-08-19T00:42:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.389+0000 7f2a28400640 1 -- 172.21.15.7:0/2056546485 wait complete. 2024-08-19T00:42:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.390+0000 7f2a28400640 1 Processor -- start 2024-08-19T00:42:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.390+0000 7f2a28400640 1 -- start start 2024-08-19T00:42:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a28400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 0x7f2a20153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a28400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a2015bfb0 0x7f2a2015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a28400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015c390 0x7f2a2015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a28400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a200af290 con 0x7f2a2015c390 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a28400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a200af110 con 0x7f2a200b5130 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a28400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a200af410 con 0x7f2a2015bfb0 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a26400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015c390 0x7f2a2015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a26400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015c390 0x7f2a2015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34304/0 (socket says 172.21.15.7:34304) 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.391+0000 7f2a26400640 1 -- 172.21.15.7:0/205792340 learned_addr learned my addr 172.21.15.7:0/205792340 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a25000640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a2015bfb0 0x7f2a2015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a25a00640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 0x7f2a20153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a26400640 1 -- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a2015bfb0 msgr2=0x7f2a2015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a26400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a2015bfb0 0x7f2a2015e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a26400640 1 -- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 msgr2=0x7f2a20153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a26400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 0x7f2a20153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a26400640 1 -- 172.21.15.7:0/205792340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2015e570 con 0x7f2a2015c390 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a25000640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a2015bfb0 0x7f2a2015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a26400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015c390 0x7f2a2015d040 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800caf0 tx=0x7f2a1800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a1d600640 1 -- 172.21.15.7:0/205792340 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18017070 con 0x7f2a2015c390 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a1d600640 1 -- 172.21.15.7:0/205792340 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1800aca0 con 0x7f2a2015c390 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a1d600640 1 -- 172.21.15.7:0/205792340 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18012620 con 0x7f2a2015c390 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.392+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2015e810 con 0x7f2a2015c390 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.393+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2015c840 con 0x7f2a2015c390 2024-08-19T00:42:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.394+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a200aebd0 con 0x7f2a2015c390 2024-08-19T00:42:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.395+0000 7f2a1d600640 1 -- 172.21.15.7:0/205792340 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a1801a070 con 0x7f2a2015c390 2024-08-19T00:42:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.396+0000 7f2a1d600640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a0006be30 0x7f2a0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.396+0000 7f2a1d600640 1 -- 172.21.15.7:0/205792340 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7f2a1808a9c0 con 0x7f2a2015c390 2024-08-19T00:42:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.396+0000 7f2a25a00640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a0006be30 0x7f2a0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.397+0000 7f2a25a00640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a0006be30 0x7f2a0006e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a2015b200 tx=0x7f2a14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.400+0000 7f2a1d600640 1 -- 172.21.15.7:0/205792340 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2a180595b0 con 0x7f2a2015c390 2024-08-19T00:42:22.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.586+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2a200b12c0 con 0x7f2a2015c390 2024-08-19T00:42:22.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.590+0000 7f2a1d600640 1 -- 172.21.15.7:0/205792340 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f2a18058eb0 con 0x7f2a2015c390 2024-08-19T00:42:22.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a0006be30 msgr2=0x7f2a0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a0006be30 0x7f2a0006e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a2015b200 tx=0x7f2a14009040 comp rx=0 tx=0).stop 2024-08-19T00:42:22.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015c390 msgr2=0x7f2a2015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015c390 0x7f2a2015d040 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800caf0 tx=0x7f2a1800a060 comp rx=0 tx=0).stop 2024-08-19T00:42:22.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 shutdown_connections 2024-08-19T00:42:22.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a0006be30 0x7f2a0006e2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a2015c390 0x7f2a2015d040 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a2015bfb0 0x7f2a2015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 --2- 172.21.15.7:0/205792340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a200b5130 0x7f2a20153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 >> 172.21.15.7:0/205792340 conn(0x7f2a200b2300 msgr2=0x7f2a200b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:22.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 shutdown_connections 2024-08-19T00:42:22.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.592+0000 7f2a28400640 1 -- 172.21.15.7:0/205792340 wait complete. 2024-08-19T00:42:22.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit' 2024-08-19T00:42:22.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.765+0000 7efcdac00640 1 Processor -- start 2024-08-19T00:42:22.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.765+0000 7efcdac00640 1 -- start start 2024-08-19T00:42:22.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcdac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd40d03c0 0x7efcd4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcdac00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efcd40b3750 0x7efcd40cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcdac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd40cdfb0 con 0x7efcd406e710 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcdac00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7efcd40cebc0 con 0x7efcd40b3750 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcdac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efcd40ce290 con 0x7efcd40d03c0 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcd8c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efcd40b3750 0x7efcd40cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcd8c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efcd40b3750 0x7efcd40cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34316/0 (socket says 172.21.15.7:34316) 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.766+0000 7efcd8c00640 1 -- 172.21.15.7:0/3459434488 learned_addr learned my addr 172.21.15.7:0/3459434488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.767+0000 7efcd3e00640 1 --2- 172.21.15.7:0/3459434488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd40d03c0 0x7efcd4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.767+0000 7efcd8c00640 1 -- 172.21.15.7:0/3459434488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd40d03c0 msgr2=0x7efcd4071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.767+0000 7efcd8c00640 1 --2- 172.21.15.7:0/3459434488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd40d03c0 0x7efcd4071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.767+0000 7efcd8c00640 1 -- 172.21.15.7:0/3459434488 >> v1:172.21.15.162:6789/0 conn(0x7efcd406e710 legacy=0x7efcd40d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:22.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.767+0000 7efcd8c00640 1 -- 172.21.15.7:0/3459434488 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd40ce570 con 0x7efcd40b3750 2024-08-19T00:42:22.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.767+0000 7efcd3e00640 1 --2- 172.21.15.7:0/3459434488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd40d03c0 0x7efcd4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.768+0000 7efcd8c00640 1 --2- 172.21.15.7:0/3459434488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd40cf050 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7efccc009870 tx=0x7efccc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d830adfce71e3061 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.768+0000 7efcd3400640 1 -- 172.21.15.7:0/3459434488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc037070 con 0x7efcd40b3750 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.768+0000 7efcd3400640 1 -- 172.21.15.7:0/3459434488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efccc032440 con 0x7efcd40b3750 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.768+0000 7efcd3400640 1 -- 172.21.15.7:0/3459434488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc032810 con 0x7efcd40b3750 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 -- 172.21.15.7:0/3459434488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 msgr2=0x7efcd40cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 --2- 172.21.15.7:0/3459434488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd40cf050 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7efccc009870 tx=0x7efccc02a210 comp rx=0 tx=0).stop 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 -- 172.21.15.7:0/3459434488 shutdown_connections 2024-08-19T00:42:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 --2- 172.21.15.7:0/3459434488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd40cf050 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 --2- 172.21.15.7:0/3459434488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd40d03c0 0x7efcd4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 -- 172.21.15.7:0/3459434488 >> 172.21.15.7:0/3459434488 conn(0x7efcd406bc70 msgr2=0x7efcd406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 -- 172.21.15.7:0/3459434488 shutdown_connections 2024-08-19T00:42:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.769+0000 7efcdac00640 1 -- 172.21.15.7:0/3459434488 wait complete. 2024-08-19T00:42:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.770+0000 7efcdac00640 1 Processor -- start 2024-08-19T00:42:22.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.771+0000 7efcdac00640 1 -- start start 2024-08-19T00:42:22.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.771+0000 7efcdac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd406e710 0x7efcd414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.771+0000 7efcdac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd4099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.771+0000 7efcdac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd40d03c0 0x7efcd4152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.771+0000 7efcdac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4073c60 con 0x7efcd40b3750 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.771+0000 7efcdac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4073ae0 con 0x7efcd40d03c0 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.771+0000 7efcdac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efcd40b3be0 con 0x7efcd406e710 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd4099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd4099a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34320/0 (socket says 172.21.15.7:34320) 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 -- 172.21.15.7:0/2876286563 learned_addr learned my addr 172.21.15.7:0/2876286563 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efcd8c00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd40d03c0 0x7efcd4152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efcd3e00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd406e710 0x7efcd414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 -- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd406e710 msgr2=0x7efcd414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd406e710 0x7efcd414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 -- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd40d03c0 msgr2=0x7efcd4152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd40d03c0 0x7efcd4152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 -- 172.21.15.7:0/2876286563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd406dd70 con 0x7efcd40b3750 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.772+0000 7efccb400640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd4099a30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b420 tx=0x7efcbc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.773+0000 7efcd0c00640 1 -- 172.21.15.7:0/2876286563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc011830 con 0x7efcd40b3750 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.773+0000 7efcd0c00640 1 -- 172.21.15.7:0/2876286563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc016070 con 0x7efcd40b3750 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.773+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd415c110 con 0x7efcd40b3750 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.773+0000 7efcd0c00640 1 -- 172.21.15.7:0/2876286563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc011c10 con 0x7efcd40b3750 2024-08-19T00:42:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.773+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd414cc50 con 0x7efcd40b3750 2024-08-19T00:42:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.774+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd4071980 con 0x7efcd40b3750 2024-08-19T00:42:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.775+0000 7efcd0c00640 1 -- 172.21.15.7:0/2876286563 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcbc01b460 con 0x7efcd40b3750 2024-08-19T00:42:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.776+0000 7efcd0c00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcb006be30 0x7efcb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.776+0000 7efcd0c00640 1 -- 172.21.15.7:0/2876286563 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7efcbc08a630 con 0x7efcd40b3750 2024-08-19T00:42:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.776+0000 7efcd3e00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcb006be30 0x7efcb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:22.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.776+0000 7efcd3e00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcb006be30 0x7efcb006e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efcc400d620 tx=0x7efcc4007810 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:22.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:22.780+0000 7efcd0c00640 1 -- 172.21.15.7:0/2876286563 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efcbc020020 con 0x7efcd40b3750 2024-08-19T00:42:23.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.034+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]} v 0) -- 0x7efcd40b1970 con 0x7efcd40b3750 2024-08-19T00:42:23.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.818+0000 7efcd0c00640 1 -- 172.21.15.7:0/2876286563 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]}]=0 v265) ==== 142+0+0 (secure 0 0 0) 0x7efcbc058b50 con 0x7efcd40b3750 2024-08-19T00:42:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcb006be30 msgr2=0x7efcb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcb006be30 0x7efcb006e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efcc400d620 tx=0x7efcc4007810 comp rx=0 tx=0).stop 2024-08-19T00:42:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 msgr2=0x7efcd4099a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd4099a30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b420 tx=0x7efcbc00b8e0 comp rx=0 tx=0).stop 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 shutdown_connections 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcb006be30 0x7efcb006e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd40d03c0 0x7efcd4152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efcd40b3750 0x7efcd4099a30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 --2- 172.21.15.7:0/2876286563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd406e710 0x7efcd414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.821+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 >> 172.21.15.7:0/2876286563 conn(0x7efcd406bc70 msgr2=0x7efcd40ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.822+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 shutdown_connections 2024-08-19T00:42:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:23.822+0000 7efcdac00640 1 -- 172.21.15.7:0/2876286563 wait complete. 2024-08-19T00:42:23.843 INFO:tasks.cephfs_test_runner:That the MDS won't write a dentry with new damage to CDentry::first ... ok 2024-08-19T00:42:23.843 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_preflush (tasks.cephfs.test_damage.TestDamage) That the MDS won't write a dentry with new damage to CDentry::first 2024-08-19T00:42:23.843 INFO:tasks.cephfs_test_runner:test_dentry_first_preflush (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:42:23.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:42:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.002+0000 7ffb59c00640 1 Processor -- start 2024-08-19T00:42:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.002+0000 7ffb59c00640 1 -- start start 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.003+0000 7ffb59c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb5406e710 0x7ffb54071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.003+0000 7ffb59c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.003+0000 7ffb59c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb540cdfb0 con 0x7ffb540d03c0 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.003+0000 7ffb59c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ffb540cebc0 con 0x7ffb5406e710 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.003+0000 7ffb59c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffb540ce290 con 0x7ffb540b3750 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.003+0000 7ffb4be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb5406e710 0x7ffb54071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.004+0000 7ffb4be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb5406e710 0x7ffb54071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56326/0 (socket says 172.21.15.7:56326) 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.004+0000 7ffb4be00640 1 -- 172.21.15.7:0/2594651238 learned_addr learned my addr 172.21.15.7:0/2594651238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.004+0000 7ffb53400640 1 --2- 172.21.15.7:0/2594651238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.004+0000 7ffb4be00640 1 -- 172.21.15.7:0/2594651238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 msgr2=0x7ffb540cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:24.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.004+0000 7ffb4be00640 1 --2- 172.21.15.7:0/2594651238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.004+0000 7ffb4be00640 1 -- 172.21.15.7:0/2594651238 >> v1:172.21.15.162:6789/0 conn(0x7ffb540d03c0 legacy=0x7ffb540d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:24.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.004+0000 7ffb4be00640 1 -- 172.21.15.7:0/2594651238 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb540ce570 con 0x7ffb5406e710 2024-08-19T00:42:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.005+0000 7ffb4be00640 1 --2- 172.21.15.7:0/2594651238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb5406e710 0x7ffb54071980 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0098a0 tx=0x7ffb3c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a436a6bdef21e0e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.005+0000 7ffb52000640 1 -- 172.21.15.7:0/2594651238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c037070 con 0x7ffb5406e710 2024-08-19T00:42:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.005+0000 7ffb52000640 1 -- 172.21.15.7:0/2594651238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3c032440 con 0x7ffb5406e710 2024-08-19T00:42:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.005+0000 7ffb52000640 1 -- 172.21.15.7:0/2594651238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c032810 con 0x7ffb5406e710 2024-08-19T00:42:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 -- 172.21.15.7:0/2594651238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb5406e710 msgr2=0x7ffb54071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2594651238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb5406e710 0x7ffb54071980 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0098a0 tx=0x7ffb3c02a290 comp rx=0 tx=0).stop 2024-08-19T00:42:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 -- 172.21.15.7:0/2594651238 shutdown_connections 2024-08-19T00:42:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2594651238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2594651238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb5406e710 0x7ffb54071980 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 -- 172.21.15.7:0/2594651238 >> 172.21.15.7:0/2594651238 conn(0x7ffb5406bc70 msgr2=0x7ffb5406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 -- 172.21.15.7:0/2594651238 shutdown_connections 2024-08-19T00:42:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.006+0000 7ffb59c00640 1 -- 172.21.15.7:0/2594651238 wait complete. 2024-08-19T00:42:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.008+0000 7ffb59c00640 1 Processor -- start 2024-08-19T00:42:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.008+0000 7ffb59c00640 1 -- start start 2024-08-19T00:42:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb59c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5406e710 0x7ffb541f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb59c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb59c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb540d03c0 0x7ffb540b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb59c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54073c60 con 0x7ffb540d03c0 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb59c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54073ae0 con 0x7ffb5406e710 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb59c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffb540b3be0 con 0x7ffb540b3750 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb53400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb540d03c0 0x7ffb540b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb53400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb540d03c0 0x7ffb540b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56330/0 (socket says 172.21.15.7:56330) 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb53400640 1 -- 172.21.15.7:0/2349899735 learned_addr learned my addr 172.21.15.7:0/2349899735 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb52a00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5406e710 0x7ffb541f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.009+0000 7ffb4be00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb53400640 1 -- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 msgr2=0x7ffb540b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb53400640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb53400640 1 -- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5406e710 msgr2=0x7ffb541f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb53400640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5406e710 0x7ffb541f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb53400640 1 -- 172.21.15.7:0/2349899735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb541f57d0 con 0x7ffb540d03c0 2024-08-19T00:42:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb53400640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb540d03c0 0x7ffb540b2390 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c007e40 tx=0x7ffb4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb4aa00640 1 -- 172.21.15.7:0/2349899735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c014620 con 0x7ffb540d03c0 2024-08-19T00:42:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb4aa00640 1 -- 172.21.15.7:0/2349899735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c019070 con 0x7ffb540d03c0 2024-08-19T00:42:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb541f5ab0 con 0x7ffb540d03c0 2024-08-19T00:42:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb4aa00640 1 -- 172.21.15.7:0/2349899735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c014a20 con 0x7ffb540d03c0 2024-08-19T00:42:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.010+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb541f6350 con 0x7ffb540d03c0 2024-08-19T00:42:24.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.011+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb54071980 con 0x7ffb540d03c0 2024-08-19T00:42:24.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.012+0000 7ffb4aa00640 1 -- 172.21.15.7:0/2349899735 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb4c014bc0 con 0x7ffb540d03c0 2024-08-19T00:42:24.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.013+0000 7ffb4aa00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffb3006be30 0x7ffb3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.013+0000 7ffb4aa00640 1 -- 172.21.15.7:0/2349899735 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7ffb4c08b3e0 con 0x7ffb540d03c0 2024-08-19T00:42:24.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.014+0000 7ffb52a00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffb3006be30 0x7ffb3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.014+0000 7ffb52a00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffb3006be30 0x7ffb3006e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffb44001780 tx=0x7ffb44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.018+0000 7ffb4aa00640 1 -- 172.21.15.7:0/2349899735 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ffb4c059980 con 0x7ffb540d03c0 2024-08-19T00:42:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.205+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb540cd5a0 con 0x7ffb540d03c0 2024-08-19T00:42:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.206+0000 7ffb4aa00640 1 -- 172.21.15.7:0/2349899735 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+13236 (secure 0 0 0) 0x7ffb4c05dc80 con 0x7ffb540d03c0 2024-08-19T00:42:24.208 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:24.209 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:42:21.803870+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/992020227":"2024-08-20T00:42:18.791796+0000","172.21.15.7:6835/992020227":"2024-08-20T00:42:18.791796+0000","172.21.15.7:6836/2987342349":"2024-08-20T00:40:37.370877+0000","172.21.15.7:6834/2987342349":"2024-08-20T00:40:37.370877+0000","172.21.15.7:6836/3306229985":"2024-08-20T00:40:01.274319+0000","172.21.15.7:6834/3306229985":"2024-08-20T00:40:01.274319+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:42:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffb3006be30 msgr2=0x7ffb3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffb3006be30 0x7ffb3006e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffb44001780 tx=0x7ffb44009040 comp rx=0 tx=0).stop 2024-08-19T00:42:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb540d03c0 msgr2=0x7ffb540b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb540d03c0 0x7ffb540b2390 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c007e40 tx=0x7ffb4c00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 shutdown_connections 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffb3006be30 0x7ffb3006e2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb540d03c0 0x7ffb540b2390 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb540b3750 0x7ffb540b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 --2- 172.21.15.7:0/2349899735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5406e710 0x7ffb541f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 >> 172.21.15.7:0/2349899735 conn(0x7ffb5406bc70 msgr2=0x7ffb5415e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.208+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 shutdown_connections 2024-08-19T00:42:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.209+0000 7ffb59c00640 1 -- 172.21.15.7:0/2349899735 wait complete. 2024-08-19T00:42:24.227 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:36:51.315746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:42:24.228 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T00:42:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.385+0000 7febf9600640 1 Processor -- start 2024-08-19T00:42:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.385+0000 7febf9600640 1 -- start start 2024-08-19T00:42:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf9600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febf4161c90 0x7febf40cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf9600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf406e330 0x7febf40d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf9600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7febf40d2a40 0x7febf40d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf9600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7febf40d0110 con 0x7febf4161c90 2024-08-19T00:42:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf9600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7febf406e750 con 0x7febf40d2a40 2024-08-19T00:42:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf9600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febf40cf500 con 0x7febf406e330 2024-08-19T00:42:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febf4161c90 0x7febf40cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febf4161c90 0x7febf40cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56334/0 (socket says 172.21.15.7:56334) 2024-08-19T00:42:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.386+0000 7febf2a00640 1 -- 172.21.15.7:0/861857868 learned_addr learned my addr 172.21.15.7:0/861857868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.387+0000 7febf2a00640 1 -- 172.21.15.7:0/861857868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf406e330 msgr2=0x7febf40d2500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.387+0000 7febf2a00640 1 --2- 172.21.15.7:0/861857868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf406e330 0x7febf40d2500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.387+0000 7febf2a00640 1 -- 172.21.15.7:0/861857868 >> v2:172.21.15.162:3300/0 conn(0x7febf40d2a40 msgr2=0x7febf40d0b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.387+0000 7febf2a00640 1 --2- 172.21.15.7:0/861857868 >> v2:172.21.15.162:3300/0 conn(0x7febf40d2a40 0x7febf40d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.387+0000 7febf2a00640 1 -- 172.21.15.7:0/861857868 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf40cf7e0 con 0x7febf4161c90 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.388+0000 7febf2a00640 1 --2- 172.21.15.7:0/861857868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf4161c90 0x7febf40cef00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7febf40cb450 tx=0x7febe402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53be020e7022192 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.388+0000 7febf1600640 1 -- 172.21.15.7:0/861857868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4037070 con 0x7febf4161c90 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.388+0000 7febf1600640 1 -- 172.21.15.7:0/861857868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe4032440 con 0x7febf4161c90 2024-08-19T00:42:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.388+0000 7febf1600640 1 -- 172.21.15.7:0/861857868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4032810 con 0x7febf4161c90 2024-08-19T00:42:24.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 -- 172.21.15.7:0/861857868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf4161c90 msgr2=0x7febf40cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 --2- 172.21.15.7:0/861857868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf4161c90 0x7febf40cef00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7febf40cb450 tx=0x7febe402a200 comp rx=0 tx=0).stop 2024-08-19T00:42:24.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 -- 172.21.15.7:0/861857868 shutdown_connections 2024-08-19T00:42:24.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 --2- 172.21.15.7:0/861857868 >> v2:172.21.15.162:3300/0 conn(0x7febf40d2a40 0x7febf40d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 --2- 172.21.15.7:0/861857868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf406e330 0x7febf40d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 --2- 172.21.15.7:0/861857868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf4161c90 0x7febf40cef00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 -- 172.21.15.7:0/861857868 >> 172.21.15.7:0/861857868 conn(0x7febf408c000 msgr2=0x7febf40d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 -- 172.21.15.7:0/861857868 shutdown_connections 2024-08-19T00:42:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.389+0000 7febf9600640 1 -- 172.21.15.7:0/861857868 wait complete. 2024-08-19T00:42:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.391+0000 7febf9600640 1 Processor -- start 2024-08-19T00:42:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.391+0000 7febf9600640 1 -- start start 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf406e330 0x7febf4152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febf40d2a40 0x7febf409ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf9600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf4161c90 0x7febf409ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf9600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7febf4162070 con 0x7febf406e330 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf9600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febf40cfda0 con 0x7febf40d2a40 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf9600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febf41621f0 con 0x7febf4161c90 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf406e330 0x7febf4152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf406e330 0x7febf4152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56346/0 (socket says 172.21.15.7:56346) 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 -- 172.21.15.7:0/1556508770 learned_addr learned my addr 172.21.15.7:0/1556508770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 -- 172.21.15.7:0/1556508770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf4161c90 msgr2=0x7febf409ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf4161c90 0x7febf409ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 -- 172.21.15.7:0/1556508770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febf40d2a40 msgr2=0x7febf409ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febf40d2a40 0x7febf409ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.392+0000 7febf2a00640 1 -- 172.21.15.7:0/1556508770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf40a1760 con 0x7febf406e330 2024-08-19T00:42:24.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.393+0000 7febf2a00640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf406e330 0x7febf4152af0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7febe402a240 tx=0x7febe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.393+0000 7febeaa00640 1 -- 172.21.15.7:0/1556508770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4041070 con 0x7febf406e330 2024-08-19T00:42:24.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.393+0000 7febeaa00640 1 -- 172.21.15.7:0/1556508770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe403c890 con 0x7febf406e330 2024-08-19T00:42:24.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.393+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf40a1a40 con 0x7febf406e330 2024-08-19T00:42:24.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.393+0000 7febeaa00640 1 -- 172.21.15.7:0/1556508770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4037040 con 0x7febf406e330 2024-08-19T00:42:24.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.393+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf40a0970 con 0x7febf406e330 2024-08-19T00:42:24.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.394+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf40b8370 con 0x7febf406e330 2024-08-19T00:42:24.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.395+0000 7febeaa00640 1 -- 172.21.15.7:0/1556508770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febe4044070 con 0x7febf406e330 2024-08-19T00:42:24.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.396+0000 7febeaa00640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febd406be30 0x7febd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.396+0000 7febeaa00640 1 -- 172.21.15.7:0/1556508770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7febe40abab0 con 0x7febf406e330 2024-08-19T00:42:24.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.396+0000 7febf2000640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febd406be30 0x7febd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.397+0000 7febf2000640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febd406be30 0x7febd406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febf40b5ba0 tx=0x7febe0006ba0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.400+0000 7febeaa00640 1 -- 172.21.15.7:0/1556508770 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7febe407a7c0 con 0x7febf406e330 2024-08-19T00:42:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.584+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7febf40d3270 con 0x7febf406e330 2024-08-19T00:42:24.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.585+0000 7febeaa00640 1 -- 172.21.15.7:0/1556508770 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7febe407a0c0 con 0x7febf406e330 2024-08-19T00:42:24.588 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febd406be30 msgr2=0x7febd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febd406be30 0x7febd406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febf40b5ba0 tx=0x7febe0006ba0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf406e330 msgr2=0x7febf4152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf406e330 0x7febf4152af0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7febe402a240 tx=0x7febe40046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 shutdown_connections 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7febd406be30 0x7febd406e2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febf4161c90 0x7febf409ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febf40d2a40 0x7febf409ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 --2- 172.21.15.7:0/1556508770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febf406e330 0x7febf4152af0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 >> 172.21.15.7:0/1556508770 conn(0x7febf408c000 msgr2=0x7febf40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 shutdown_connections 2024-08-19T00:42:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.587+0000 7febf9600640 1 -- 172.21.15.7:0/1556508770 wait complete. 2024-08-19T00:42:24.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush' 2024-08-19T00:42:24.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.760+0000 7fc18f200640 1 Processor -- start 2024-08-19T00:42:24.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.760+0000 7fc18f200640 1 -- start start 2024-08-19T00:42:24.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc18f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1880d03c0 0x7fc188071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc18f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc18806e710 0x7fc1880d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc18f200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1880d0ce0 con 0x7fc1880b3750 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc18f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc1880cebc0 con 0x7fc18806e710 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc18f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1880cdfb0 con 0x7fc1880d03c0 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc17fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc18806e710 0x7fc1880d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc17fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc18806e710 0x7fc1880d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56360/0 (socket says 172.21.15.7:56360) 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc17fe00640 1 -- 172.21.15.7:0/2623081557 learned_addr learned my addr 172.21.15.7:0/2623081557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc187e00640 1 --2- 172.21.15.7:0/2623081557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1880d03c0 0x7fc188071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc17fe00640 1 -- 172.21.15.7:0/2623081557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1880d03c0 msgr2=0x7fc188071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc17fe00640 1 --2- 172.21.15.7:0/2623081557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1880d03c0 0x7fc188071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc17fe00640 1 -- 172.21.15.7:0/2623081557 >> v1:172.21.15.162:6789/0 conn(0x7fc1880b3750 legacy=0x7fc1880cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.762+0000 7fc17fe00640 1 -- 172.21.15.7:0/2623081557 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1880ce290 con 0x7fc18806e710 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.763+0000 7fc17fe00640 1 --2- 172.21.15.7:0/2623081557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc18806e710 0x7fc1880d07a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc17000bb10 tx=0x7fc17002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c437460100d0190c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc187400640 1 -- 172.21.15.7:0/2623081557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc170036020 con 0x7fc18806e710 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc187400640 1 -- 172.21.15.7:0/2623081557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc170032820 con 0x7fc18806e710 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc187400640 1 -- 172.21.15.7:0/2623081557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc170032bf0 con 0x7fc18806e710 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 -- 172.21.15.7:0/2623081557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc18806e710 msgr2=0x7fc1880d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 --2- 172.21.15.7:0/2623081557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc18806e710 0x7fc1880d07a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc17000bb10 tx=0x7fc17002c920 comp rx=0 tx=0).stop 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 -- 172.21.15.7:0/2623081557 shutdown_connections 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 --2- 172.21.15.7:0/2623081557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc18806e710 0x7fc1880d07a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 --2- 172.21.15.7:0/2623081557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1880d03c0 0x7fc188071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 -- 172.21.15.7:0/2623081557 >> 172.21.15.7:0/2623081557 conn(0x7fc18806bc70 msgr2=0x7fc18806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 -- 172.21.15.7:0/2623081557 shutdown_connections 2024-08-19T00:42:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.764+0000 7fc18f200640 1 -- 172.21.15.7:0/2623081557 wait complete. 2024-08-19T00:42:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.766+0000 7fc18f200640 1 Processor -- start 2024-08-19T00:42:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.766+0000 7fc18f200640 1 -- start start 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.767+0000 7fc18f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc18806e710 0x7fc1881f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.767+0000 7fc18f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1880b3750 0x7fc1881545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.767+0000 7fc18f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d03c0 0x7fc188159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.767+0000 7fc18f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc188073ae0 con 0x7fc1880d03c0 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.767+0000 7fc18f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1880ce850 con 0x7fc1880b3750 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.767+0000 7fc18f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc188073c60 con 0x7fc18806e710 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1880b3750 0x7fc1881545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1880b3750 0x7fc1881545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:57354/0 (socket says 172.21.15.7:57354) 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 -- 172.21.15.7:0/1571092951 learned_addr learned my addr 172.21.15.7:0/1571092951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc18d200640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d03c0 0x7fc188159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc187e00640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc18806e710 0x7fc1881f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 -- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc18806e710 msgr2=0x7fc1881f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc18806e710 0x7fc1881f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 -- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d03c0 msgr2=0x7fc188159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d03c0 0x7fc188159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.768+0000 7fc17fe00640 1 -- 172.21.15.7:0/1571092951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18815c280 con 0x7fc1880b3750 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.769+0000 7fc17fe00640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1880b3750 0x7fc1881545b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc17000b2c0 tx=0x7fc170004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.769+0000 7fc184c00640 1 -- 172.21.15.7:0/1571092951 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc170031cb0 con 0x7fc1880b3750 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.769+0000 7fc184c00640 1 -- 172.21.15.7:0/1571092951 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17003b420 con 0x7fc1880b3750 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.769+0000 7fc184c00640 1 -- 172.21.15.7:0/1571092951 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17003b810 con 0x7fc1880b3750 2024-08-19T00:42:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.769+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1881570f0 con 0x7fc1880b3750 2024-08-19T00:42:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.769+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18815c520 con 0x7fc1880b3750 2024-08-19T00:42:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.770+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1880b3be0 con 0x7fc1880b3750 2024-08-19T00:42:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.771+0000 7fc184c00640 1 -- 172.21.15.7:0/1571092951 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc170039020 con 0x7fc1880b3750 2024-08-19T00:42:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.772+0000 7fc184c00640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc16406be30 0x7fc16406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.772+0000 7fc184c00640 1 -- 172.21.15.7:0/1571092951 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7fc1700ac4c0 con 0x7fc1880b3750 2024-08-19T00:42:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.772+0000 7fc187e00640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc16406be30 0x7fc16406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.773+0000 7fc187e00640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc16406be30 0x7fc16406e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc178006fd0 tx=0x7fc178008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:24.777+0000 7fc184c00640 1 -- 172.21.15.7:0/1571092951 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc17002f070 con 0x7fc1880b3750 2024-08-19T00:42:25.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.030+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]} v 0) -- 0x7fc18815c6f0 con 0x7fc1880b3750 2024-08-19T00:42:25.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.833+0000 7fc184c00640 1 -- 172.21.15.7:0/1571092951 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]}]=0 v267) ==== 144+0+0 (secure 0 0 0) 0x7fc17007ac00 con 0x7fc1880b3750 2024-08-19T00:42:25.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc16406be30 msgr2=0x7fc16406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc16406be30 0x7fc16406e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc178006fd0 tx=0x7fc178008040 comp rx=0 tx=0).stop 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1880b3750 msgr2=0x7fc1881545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1880b3750 0x7fc1881545b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc17000b2c0 tx=0x7fc170004730 comp rx=0 tx=0).stop 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 shutdown_connections 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc16406be30 0x7fc16406e2f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d03c0 0x7fc188159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1880b3750 0x7fc1881545b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 --2- 172.21.15.7:0/1571092951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc18806e710 0x7fc1881f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.836+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 >> 172.21.15.7:0/1571092951 conn(0x7fc18806bc70 msgr2=0x7fc1880acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.837+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 shutdown_connections 2024-08-19T00:42:25.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:25.837+0000 7fc18f200640 1 -- 172.21.15.7:0/1571092951 wait complete. 2024-08-19T00:42:25.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-19T00:42:26.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.019+0000 7f6fa5200640 1 Processor -- start 2024-08-19T00:42:26.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.019+0000 7f6fa5200640 1 -- start start 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6fa5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 0x7f6fa0140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6fa5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6fa0140640 0x7f6fa006d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6fa5200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa015e930 con 0x7f6fa006db40 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6fa5200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa015ec10 con 0x7f6fa0140640 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6fa5200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa015eef0 con 0x7f6fa013dc30 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6f9fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6fa006db40 0x7f6fa0072920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40068/0 (socket says 172.21.15.7:40068) 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6f9fe00640 1 -- 172.21.15.7:0/2606295396 learned_addr learned my addr 172.21.15.7:0/2606295396 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6f96a00640 1 --2- 172.21.15.7:0/2606295396 >> v2:172.21.15.162:3300/0 conn(0x7f6fa0140640 0x7f6fa006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6f9f400640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 0x7f6fa0140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.021+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612585399 0 0) 0x7f6fa015e930 con 0x7f6fa006db40 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f84003520 con 0x7f6fa006db40 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4188129377 0 0) 0x7f6f84003520 con 0x7f6fa006db40 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 msgr2=0x7f6fa0140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 0x7f6fa0140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 >> v2:172.21.15.162:3300/0 conn(0x7f6fa0140640 msgr2=0x7f6fa006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 --2- 172.21.15.7:0/2606295396 >> v2:172.21.15.162:3300/0 conn(0x7f6fa0140640 0x7f6fa006d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa015f1d0 con 0x7f6fa006db40 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f6f980019f0 con 0x7f6fa006db40 2024-08-19T00:42:26.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 >> v1:172.21.15.7:6789/0 conn(0x7f6fa006db40 legacy=0x7f6fa0072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 0x7f6f840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f84003f30 0x7f6f84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84004d40 0x7f6f840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa015ec10 con 0x7f6f84004d40 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa015eef0 con 0x7f6f84003f30 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8400dbd0 con 0x7f6fa013dc30 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f9fe00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84004d40 0x7f6f840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.022+0000 7f6f96a00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f84003f30 0x7f6f84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.023+0000 7f6f9f400640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 0x7f6f840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.023+0000 7f6f9fe00640 1 -- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 msgr2=0x7f6f840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.023+0000 7f6f9fe00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 0x7f6f840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.023+0000 7f6f9fe00640 1 -- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f84003f30 msgr2=0x7f6f84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.023+0000 7f6f9fe00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f84003f30 0x7f6f84004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.023+0000 7f6f9fe00640 1 -- 172.21.15.7:0/2606295396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84003520 con 0x7f6f84004d40 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.023+0000 7f6f9f400640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa013dc30 0x7f6f840039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.024+0000 7f6f9fe00640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84004d40 0x7f6f840051c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800a920 tx=0x7f6f84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8393f68fbff3067d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.024+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800a4c0 con 0x7f6f84004d40 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.024+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9802f070 con 0x7f6f84004d40 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.024+0000 7f6f9ea00640 1 -- 172.21.15.7:0/2606295396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9802bd60 con 0x7f6f84004d40 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.024+0000 7f6fa5200640 1 -- 172.21.15.7:0/2606295396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84004d40 msgr2=0x7f6f840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.024+0000 7f6fa5200640 1 --2- 172.21.15.7:0/2606295396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f84004d40 0x7f6f840051c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800a920 tx=0x7f6f84005830 comp rx=0 tx=0).stop 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.025+0000 7f6f9fe00640 1 -- 172.21.15.7:0/2606295396 reap_dead start 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.025+0000 7f6fa5200640 1 -- 172.21.15.7:0/2606295396 shutdown_connections 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.025+0000 7f6fa5200640 1 -- 172.21.15.7:0/2606295396 >> 172.21.15.7:0/2606295396 conn(0x7f6fa006b850 msgr2=0x7f6fa006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.025+0000 7f6fa5200640 1 -- 172.21.15.7:0/2606295396 shutdown_connections 2024-08-19T00:42:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.025+0000 7f6fa5200640 1 -- 172.21.15.7:0/2606295396 wait complete. 2024-08-19T00:42:26.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.026+0000 7f6fa5200640 1 Processor -- start 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.027+0000 7f6fa5200640 1 -- start start 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.027+0000 7f6fa5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f84004d40 0x7f6fa00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.027+0000 7f6fa5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa015b540 0x7f6fa015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.027+0000 7f6fa5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00ae960 0x7f6fa00aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.027+0000 7f6fa5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa013e190 con 0x7f6fa015b540 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.027+0000 7f6fa5200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa013e010 con 0x7f6fa00ae960 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.027+0000 7f6fa5200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa00cf830 con 0x7f6f84004d40 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa015b540 0x7f6fa015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa015b540 0x7f6fa015b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56386/0 (socket says 172.21.15.7:56386) 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 -- 172.21.15.7:0/350460205 learned_addr learned my addr 172.21.15.7:0/350460205 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f9f400640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f84004d40 0x7f6fa00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f9fe00640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00ae960 0x7f6fa00aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 -- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f84004d40 msgr2=0x7f6fa00b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f84004d40 0x7f6fa00b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 -- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00ae960 msgr2=0x7f6fa00aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00ae960 0x7f6fa00aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 -- 172.21.15.7:0/350460205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa00b54b0 con 0x7f6fa015b540 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f9fe00640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00ae960 0x7f6fa00aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.028+0000 7f6f96a00640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa015b540 0x7f6fa015b9c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6f88011960 tx=0x7f6f88011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.029+0000 7f6f97e00640 1 -- 172.21.15.7:0/350460205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800faf0 con 0x7f6fa015b540 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.029+0000 7f6f97e00640 1 -- 172.21.15.7:0/350460205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8800fc90 con 0x7f6fa015b540 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.029+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa00af690 con 0x7f6fa015b540 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.029+0000 7f6f97e00640 1 -- 172.21.15.7:0/350460205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88014440 con 0x7f6fa015b540 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.029+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa012f990 con 0x7f6fa015b540 2024-08-19T00:42:26.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.030+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa015bf00 con 0x7f6fa015b540 2024-08-19T00:42:26.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.031+0000 7f6f97e00640 1 -- 172.21.15.7:0/350460205 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f88012040 con 0x7f6fa015b540 2024-08-19T00:42:26.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.032+0000 7f6f97e00640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f7c06be60 0x7f6f7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.032+0000 7f6f97e00640 1 -- 172.21.15.7:0/350460205 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7f6f8808b200 con 0x7f6fa015b540 2024-08-19T00:42:26.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.032+0000 7f6f9f400640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f7c06be60 0x7f6f7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.032+0000 7f6f9f400640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f7c06be60 0x7f6f7c06e320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009b50 tx=0x7f6f90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:26.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.036+0000 7f6f97e00640 1 -- 172.21.15.7:0/350460205 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6f88019030 con 0x7f6fa015b540 2024-08-19T00:42:26.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.219+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6fa006d600 con 0x7f6fa015b540 2024-08-19T00:42:26.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.223+0000 7f6f97e00640 1 -- 172.21.15.7:0/350460205 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f6f88059df0 con 0x7f6fa015b540 2024-08-19T00:42:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.225+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f7c06be60 msgr2=0x7f6f7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.225+0000 7f6fa5200640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f7c06be60 0x7f6f7c06e320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009b50 tx=0x7f6f90008040 comp rx=0 tx=0).stop 2024-08-19T00:42:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.225+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa015b540 msgr2=0x7f6fa015b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.225+0000 7f6fa5200640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa015b540 0x7f6fa015b9c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6f88011960 tx=0x7f6f88011e20 comp rx=0 tx=0).stop 2024-08-19T00:42:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 shutdown_connections 2024-08-19T00:42:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f7c06be60 0x7f6f7c06e320 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00ae960 0x7f6fa00aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa015b540 0x7f6fa015b9c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 --2- 172.21.15.7:0/350460205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f84004d40 0x7f6fa00b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 >> 172.21.15.7:0/350460205 conn(0x7f6fa006b850 msgr2=0x7f6fa0159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:26.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 shutdown_connections 2024-08-19T00:42:26.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.226+0000 7f6fa5200640 1 -- 172.21.15.7:0/350460205 wait complete. 2024-08-19T00:42:26.245 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:42:26.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:42:26.335 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:42:26.426 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:42:26.427 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:42:26.427 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:26.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:42:26.463 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:42:26.463 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:26.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:42:26.500 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:42:26.500 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:26.537 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:42:26.537 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:42:26.537 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:26.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:42:26.577 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-19T00:42:26.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.730+0000 7fc37b000640 1 Processor -- start 2024-08-19T00:42:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.730+0000 7fc37b000640 1 -- start start 2024-08-19T00:42:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.731+0000 7fc37b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3740d03c0 0x7fc374071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.731+0000 7fc37b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc3740cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.731+0000 7fc37b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3740cdfb0 con 0x7fc37406e710 2024-08-19T00:42:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc37b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc3740cebc0 con 0x7fc3740d03c0 2024-08-19T00:42:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc37b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3740ce290 con 0x7fc3740b3750 2024-08-19T00:42:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc379000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc3740cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc379000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc3740cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:37380/0 (socket says 172.21.15.7:37380) 2024-08-19T00:42:26.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc379000640 1 -- 172.21.15.7:0/4155172379 learned_addr learned my addr 172.21.15.7:0/4155172379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:26.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc373e00640 1 --2- 172.21.15.7:0/4155172379 >> v2:172.21.15.162:3300/0 conn(0x7fc3740d03c0 0x7fc374071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc379000640 1 -- 172.21.15.7:0/4155172379 >> v2:172.21.15.162:3300/0 conn(0x7fc3740d03c0 msgr2=0x7fc374071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:26.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc379000640 1 --2- 172.21.15.7:0/4155172379 >> v2:172.21.15.162:3300/0 conn(0x7fc3740d03c0 0x7fc374071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc379000640 1 -- 172.21.15.7:0/4155172379 >> v1:172.21.15.162:6789/0 conn(0x7fc37406e710 legacy=0x7fc3740d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.732+0000 7fc379000640 1 -- 172.21.15.7:0/4155172379 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3740ce570 con 0x7fc3740b3750 2024-08-19T00:42:26.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.733+0000 7fc379000640 1 --2- 172.21.15.7:0/4155172379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc3740cf050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009e80 tx=0x7fc36c02a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f627317b35b5141 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.734+0000 7fc373400640 1 -- 172.21.15.7:0/4155172379 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c036070 con 0x7fc3740b3750 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.734+0000 7fc373400640 1 -- 172.21.15.7:0/4155172379 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c031600 con 0x7fc3740b3750 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.734+0000 7fc373400640 1 -- 172.21.15.7:0/4155172379 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0319d0 con 0x7fc3740b3750 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 -- 172.21.15.7:0/4155172379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 msgr2=0x7fc3740cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 --2- 172.21.15.7:0/4155172379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc3740cf050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009e80 tx=0x7fc36c02a750 comp rx=0 tx=0).stop 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 -- 172.21.15.7:0/4155172379 shutdown_connections 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 --2- 172.21.15.7:0/4155172379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc3740cf050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 --2- 172.21.15.7:0/4155172379 >> v2:172.21.15.162:3300/0 conn(0x7fc3740d03c0 0x7fc374071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 -- 172.21.15.7:0/4155172379 >> 172.21.15.7:0/4155172379 conn(0x7fc37406bc70 msgr2=0x7fc37406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 -- 172.21.15.7:0/4155172379 shutdown_connections 2024-08-19T00:42:26.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.735+0000 7fc37b000640 1 -- 172.21.15.7:0/4155172379 wait complete. 2024-08-19T00:42:26.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.736+0000 7fc37b000640 1 Processor -- start 2024-08-19T00:42:26.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.737+0000 7fc37b000640 1 -- start start 2024-08-19T00:42:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.737+0000 7fc37b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37406e710 0x7fc374153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.737+0000 7fc37b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc374158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.737+0000 7fc37b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3740d03c0 0x7fc3741546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.737+0000 7fc37b000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc374073c60 con 0x7fc37406e710 2024-08-19T00:42:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.737+0000 7fc37b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc374073ae0 con 0x7fc3740d03c0 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.737+0000 7fc37b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3740b3be0 con 0x7fc3740b3750 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37406e710 0x7fc374153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37406e710 0x7fc374153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56402/0 (socket says 172.21.15.7:56402) 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 -- 172.21.15.7:0/729440974 learned_addr learned my addr 172.21.15.7:0/729440974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc379000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3740d03c0 0x7fc3741546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc36b400640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc374158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 -- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 msgr2=0x7fc374158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc374158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 -- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3740d03c0 msgr2=0x7fc3741546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3740d03c0 0x7fc3741546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 -- 172.21.15.7:0/729440974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc374153f60 con 0x7fc37406e710 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc379000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3740d03c0 0x7fc3741546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.738+0000 7fc373e00640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37406e710 0x7fc374153a20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc3640089b0 tx=0x7fc364008aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.739+0000 7fc370c00640 1 -- 172.21.15.7:0/729440974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36401b070 con 0x7fc37406e710 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.739+0000 7fc370c00640 1 -- 172.21.15.7:0/729440974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc364009d20 con 0x7fc37406e710 2024-08-19T00:42:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.739+0000 7fc370c00640 1 -- 172.21.15.7:0/729440974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364016630 con 0x7fc37406e710 2024-08-19T00:42:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.739+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc374158d00 con 0x7fc37406e710 2024-08-19T00:42:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.739+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3741592c0 con 0x7fc37406e710 2024-08-19T00:42:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.740+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc374071980 con 0x7fc37406e710 2024-08-19T00:42:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.741+0000 7fc370c00640 1 -- 172.21.15.7:0/729440974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc36401e070 con 0x7fc37406e710 2024-08-19T00:42:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.742+0000 7fc370c00640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc35006be30 0x7fc35006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.742+0000 7fc370c00640 1 -- 172.21.15.7:0/729440974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7fc36408a930 con 0x7fc37406e710 2024-08-19T00:42:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.742+0000 7fc36b400640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc35006be30 0x7fc35006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.743+0000 7fc36b400640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc35006be30 0x7fc35006e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc3740b0460 tx=0x7fc35c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:26.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.746+0000 7fc370c00640 1 -- 172.21.15.7:0/729440974 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc374153f60 con 0x7fc37406e710 2024-08-19T00:42:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.968+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc374072f70 con 0x7fc37406e710 2024-08-19T00:42:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.968+0000 7fc370c00640 1 -- 172.21.15.7:0/729440974 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+3905 (secure 0 0 0) 0x7fc364058e40 con 0x7fc37406e710 2024-08-19T00:42:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:26.971 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":62,"btime":"2024-08-19T00:42:19:794237+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/4090245752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":4090245752},{"type":"v1","addr":"172.21.15.162:6834","nonce":4090245752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4290054875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4290054875},{"type":"v1","addr":"172.21.15.162:6835","nonce":4290054875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/156180871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":156180871},{"type":"v1","addr":"172.21.15.7:6836","nonce":156180871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/643697204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":643697204},{"type":"v1","addr":"172.21.15.7:6837","nonce":643697204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[]} 2024-08-19T00:42:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 62 2024-08-19T00:42:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc35006be30 msgr2=0x7fc35006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc35006be30 0x7fc35006e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc3740b0460 tx=0x7fc35c009040 comp rx=0 tx=0).stop 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37406e710 msgr2=0x7fc374153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37406e710 0x7fc374153a20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc3640089b0 tx=0x7fc364008aa0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 shutdown_connections 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc35006be30 0x7fc35006e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3740d03c0 0x7fc3741546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3740b3750 0x7fc374158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 --2- 172.21.15.7:0/729440974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37406e710 0x7fc374153a20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 >> 172.21.15.7:0/729440974 conn(0x7fc37406bc70 msgr2=0x7fc3740ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 shutdown_connections 2024-08-19T00:42:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:26.970+0000 7fc37b000640 1 -- 172.21.15.7:0/729440974 wait complete. 2024-08-19T00:42:26.989 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:42:26.989 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-19T00:42:26.990 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:42:26.990 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:42:26.990 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:42:26.990 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-19T00:42:26.990 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:42:26.990 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:42:26.990 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-19T00:42:26.991 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-19T00:42:26.991 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-19T00:42:26.991 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:42:26.991 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-19T00:42:26.991 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-19T00:42:26.991 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-19T00:42:26.991 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:42:27.008 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:42:27.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:42:27.009 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:42:27.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:42:27.016 INFO:tasks.ceph.mds.d:Stopped 2024-08-19T00:42:27.016 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-19T00:42:27.017 INFO:tasks.ceph.mds.b:Stopped 2024-08-19T00:42:27.017 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-19T00:42:27.054 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:42:27.054 DEBUG:teuthology.parallel:result is None 2024-08-19T00:42:27.056 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:42:27.057 DEBUG:teuthology.parallel:result is None 2024-08-19T00:42:27.062 INFO:tasks.ceph.mds.d:Started 2024-08-19T00:42:27.062 DEBUG:teuthology.parallel:result is None 2024-08-19T00:42:27.064 INFO:tasks.ceph.mds.b:Started 2024-08-19T00:42:27.064 DEBUG:teuthology.parallel:result is None 2024-08-19T00:42:27.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-19T00:42:27.186 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:42:27.186 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:42:27.195 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:42:27.195 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:42:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.230+0000 7feb40e00640 1 Processor -- start 2024-08-19T00:42:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.230+0000 7feb40e00640 1 -- start start 2024-08-19T00:42:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.231+0000 7feb40e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb3c15e3e0 0x7feb3c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.231+0000 7feb40e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3c0b4df0 con 0x7feb3c0d27b0 2024-08-19T00:42:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.231+0000 7feb40e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3c0b50d0 con 0x7feb3c0b4860 2024-08-19T00:42:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.231+0000 7feb40e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7feb3c0cf1e0 con 0x7feb3c15e3e0 2024-08-19T00:42:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.231+0000 7feb3b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb3c15e3e0 0x7feb3c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.232+0000 7feb33e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feb3c0d27b0 0x7feb3c0b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40074/0 (socket says 172.21.15.7:40074) 2024-08-19T00:42:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.232+0000 7feb3b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb3c15e3e0 0x7feb3c0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56420/0 (socket says 172.21.15.7:56420) 2024-08-19T00:42:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.232+0000 7feb33e00640 1 -- 172.21.15.7:0/863688731 learned_addr learned my addr 172.21.15.7:0/863688731 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.232+0000 7feb3b400640 1 -- 172.21.15.7:0/863688731 >> v1:172.21.15.162:6789/0 conn(0x7feb3c0b4860 legacy=0x7feb3c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.232+0000 7feb3b400640 1 -- 172.21.15.7:0/863688731 >> v1:172.21.15.7:6789/0 conn(0x7feb3c0d27b0 legacy=0x7feb3c0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.232+0000 7feb3b400640 1 -- 172.21.15.7:0/863688731 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c0cf4c0 con 0x7feb3c15e3e0 2024-08-19T00:42:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.233+0000 7feb3b400640 1 --2- 172.21.15.7:0/863688731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c15e3e0 0x7feb3c0b0e60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0097d0 tx=0x7feb2c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d643b43e964f59 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.233+0000 7feb3aa00640 1 -- 172.21.15.7:0/863688731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c037070 con 0x7feb3c15e3e0 2024-08-19T00:42:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.233+0000 7feb3aa00640 1 -- 172.21.15.7:0/863688731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c032440 con 0x7feb3c15e3e0 2024-08-19T00:42:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.233+0000 7feb3aa00640 1 -- 172.21.15.7:0/863688731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c032810 con 0x7feb3c15e3e0 2024-08-19T00:42:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.234+0000 7feb40e00640 1 -- 172.21.15.7:0/863688731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c15e3e0 msgr2=0x7feb3c0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.234+0000 7feb40e00640 1 --2- 172.21.15.7:0/863688731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c15e3e0 0x7feb3c0b0e60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0097d0 tx=0x7feb2c02a250 comp rx=0 tx=0).stop 2024-08-19T00:42:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.234+0000 7feb40e00640 1 -- 172.21.15.7:0/863688731 shutdown_connections 2024-08-19T00:42:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.234+0000 7feb40e00640 1 --2- 172.21.15.7:0/863688731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c15e3e0 0x7feb3c0b0e60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.234+0000 7feb40e00640 1 -- 172.21.15.7:0/863688731 >> 172.21.15.7:0/863688731 conn(0x7feb3c08dbe0 msgr2=0x7feb3c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.234+0000 7feb40e00640 1 -- 172.21.15.7:0/863688731 shutdown_connections 2024-08-19T00:42:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.234+0000 7feb40e00640 1 -- 172.21.15.7:0/863688731 wait complete. 2024-08-19T00:42:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.236+0000 7feb40e00640 1 Processor -- start 2024-08-19T00:42:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.236+0000 7feb40e00640 1 -- start start 2024-08-19T00:42:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb40e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c0b4860 0x7feb3c0b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb40e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3c0d27b0 0x7feb3c15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb40e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3c15e3e0 0x7feb3c1e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb40e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c0d00f0 con 0x7feb3c0b4860 2024-08-19T00:42:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb40e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c0b13a0 con 0x7feb3c0d27b0 2024-08-19T00:42:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb40e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb3c0d0270 con 0x7feb3c15e3e0 2024-08-19T00:42:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c0b4860 0x7feb3c0b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c0b4860 0x7feb3c0b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56422/0 (socket says 172.21.15.7:56422) 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 -- 172.21.15.7:0/135348347 learned_addr learned my addr 172.21.15.7:0/135348347 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 -- 172.21.15.7:0/135348347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3c15e3e0 msgr2=0x7feb3c1e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3c15e3e0 0x7feb3c1e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 -- 172.21.15.7:0/135348347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3c0d27b0 msgr2=0x7feb3c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3c0d27b0 0x7feb3c15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.237+0000 7feb3b400640 1 -- 172.21.15.7:0/135348347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c1e90c0 con 0x7feb3c0b4860 2024-08-19T00:42:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.238+0000 7feb3b400640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c0b4860 0x7feb3c0b9bc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7feb2c035040 tx=0x7feb2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.238+0000 7feb33400640 1 -- 172.21.15.7:0/135348347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c037040 con 0x7feb3c0b4860 2024-08-19T00:42:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.238+0000 7feb33400640 1 -- 172.21.15.7:0/135348347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c030770 con 0x7feb3c0b4860 2024-08-19T00:42:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.238+0000 7feb33400640 1 -- 172.21.15.7:0/135348347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c030b80 con 0x7feb3c0b4860 2024-08-19T00:42:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.238+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c1e7ae0 con 0x7feb3c0b4860 2024-08-19T00:42:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.238+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c1e80a0 con 0x7feb3c0b4860 2024-08-19T00:42:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.239+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3c06e430 con 0x7feb3c0b4860 2024-08-19T00:42:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.240+0000 7feb33400640 1 -- 172.21.15.7:0/135348347 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb2c044020 con 0x7feb3c0b4860 2024-08-19T00:42:27.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.241+0000 7feb33400640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1806be30 0x7feb1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:27.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.241+0000 7feb33400640 1 -- 172.21.15.7:0/135348347 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5115+0+0 (secure 0 0 0) 0x7feb2c0ab290 con 0x7feb3c0b4860 2024-08-19T00:42:27.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.241+0000 7feb33e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1806be30 0x7feb1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:27.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.242+0000 7feb33e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1806be30 0x7feb1806e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb3c161d30 tx=0x7feb24007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:27.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.246+0000 7feb33400640 1 -- 172.21.15.7:0/135348347 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feb3c06e430 con 0x7feb3c0b4860 2024-08-19T00:42:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.442+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7feb3c0b2920 con 0x7feb3c0b4860 2024-08-19T00:42:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.838+0000 7feb33400640 1 -- 172.21.15.7:0/135348347 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) ==== 97+0+0 (secure 0 0 0) 0x7feb3c1e90c0 con 0x7feb3c0b4860 2024-08-19T00:42:27.841 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-08-19T00:42:27.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1806be30 msgr2=0x7feb1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:27.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1806be30 0x7feb1806e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb3c161d30 tx=0x7feb24007a40 comp rx=0 tx=0).stop 2024-08-19T00:42:27.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c0b4860 msgr2=0x7feb3c0b9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c0b4860 0x7feb3c0b9bc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7feb2c035040 tx=0x7feb2c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 shutdown_connections 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb1806be30 0x7feb1806e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3c15e3e0 0x7feb3c1e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3c0d27b0 0x7feb3c15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 --2- 172.21.15.7:0/135348347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb3c0b4860 0x7feb3c0b9bc0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.841+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 >> 172.21.15.7:0/135348347 conn(0x7feb3c08dbe0 msgr2=0x7feb3c0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.842+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 shutdown_connections 2024-08-19T00:42:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:27.842+0000 7feb40e00640 1 -- 172.21.15.7:0/135348347 wait complete. 2024-08-19T00:42:27.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-19T00:42:28.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.017+0000 7fee47400640 1 Processor -- start 2024-08-19T00:42:28.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.018+0000 7fee47400640 1 -- start start 2024-08-19T00:42:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.019+0000 7fee47400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fee400d03c0 0x7fee40071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.019+0000 7fee47400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee400cdfb0 con 0x7fee4006e710 2024-08-19T00:42:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.019+0000 7fee47400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee400ce290 con 0x7fee400b3750 2024-08-19T00:42:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.019+0000 7fee47400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fee400cebc0 con 0x7fee400d03c0 2024-08-19T00:42:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.019+0000 7fee3fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fee4006e710 0x7fee400d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40080/0 (socket says 172.21.15.7:40080) 2024-08-19T00:42:28.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.019+0000 7fee3fe00640 1 -- 172.21.15.7:0/2844063920 learned_addr learned my addr 172.21.15.7:0/2844063920 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.019+0000 7fee44a00640 1 --2- 172.21.15.7:0/2844063920 >> v2:172.21.15.162:3300/0 conn(0x7fee400d03c0 0x7fee40071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.020+0000 7fee3f400640 1 -- 172.21.15.7:0/2844063920 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334696357 0 0) 0x7fee400cdfb0 con 0x7fee4006e710 2024-08-19T00:42:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.020+0000 7fee3f400640 1 -- 172.21.15.7:0/2844063920 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee28003520 con 0x7fee4006e710 2024-08-19T00:42:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.020+0000 7fee44a00640 1 -- 172.21.15.7:0/2844063920 >> v1:172.21.15.162:6789/0 conn(0x7fee400b3750 legacy=0x7fee400cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.020+0000 7fee3f400640 1 -- 172.21.15.7:0/2844063920 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3830548235 0 0) 0x7fee28003520 con 0x7fee4006e710 2024-08-19T00:42:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.020+0000 7fee44a00640 1 -- 172.21.15.7:0/2844063920 >> v1:172.21.15.7:6789/0 conn(0x7fee4006e710 legacy=0x7fee400d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.020+0000 7fee44a00640 1 -- 172.21.15.7:0/2844063920 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee400ce570 con 0x7fee400d03c0 2024-08-19T00:42:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.021+0000 7fee44a00640 1 --2- 172.21.15.7:0/2844063920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 0x7fee40071980 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fee340097d0 tx=0x7fee3402a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cad701a6a8020e2e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.021+0000 7fee3f400640 1 -- 172.21.15.7:0/2844063920 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34037070 con 0x7fee400d03c0 2024-08-19T00:42:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee3f400640 1 -- 172.21.15.7:0/2844063920 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3402ac90 con 0x7fee400d03c0 2024-08-19T00:42:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee3f400640 1 -- 172.21.15.7:0/2844063920 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c001670 con 0x7fee400d03c0 2024-08-19T00:42:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee47400640 1 -- 172.21.15.7:0/2844063920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 msgr2=0x7fee40071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee47400640 1 --2- 172.21.15.7:0/2844063920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 0x7fee40071980 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fee340097d0 tx=0x7fee3402a200 comp rx=0 tx=0).stop 2024-08-19T00:42:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee47400640 1 -- 172.21.15.7:0/2844063920 shutdown_connections 2024-08-19T00:42:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee47400640 1 --2- 172.21.15.7:0/2844063920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 0x7fee40071980 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee47400640 1 -- 172.21.15.7:0/2844063920 >> 172.21.15.7:0/2844063920 conn(0x7fee4006bc70 msgr2=0x7fee4006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee47400640 1 -- 172.21.15.7:0/2844063920 shutdown_connections 2024-08-19T00:42:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.022+0000 7fee47400640 1 -- 172.21.15.7:0/2844063920 wait complete. 2024-08-19T00:42:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.024+0000 7fee47400640 1 Processor -- start 2024-08-19T00:42:28.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.024+0000 7fee47400640 1 -- start start 2024-08-19T00:42:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee47400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee4006e710 0x7fee4015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee47400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee400b3750 0x7fee401f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee47400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 0x7fee401f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee47400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee40073c60 con 0x7fee4006e710 2024-08-19T00:42:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee47400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee40073ae0 con 0x7fee400d03c0 2024-08-19T00:42:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee47400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee400b3be0 con 0x7fee400b3750 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee44a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee4006e710 0x7fee4015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee44a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee4006e710 0x7fee4015d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56436/0 (socket says 172.21.15.7:56436) 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee44a00640 1 -- 172.21.15.7:0/2846772939 learned_addr learned my addr 172.21.15.7:0/2846772939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee3fe00640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee400b3750 0x7fee401f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee45400640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 0x7fee401f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.025+0000 7fee44a00640 1 -- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee400b3750 msgr2=0x7fee401f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee44a00640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee400b3750 0x7fee401f7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee44a00640 1 -- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 msgr2=0x7fee401f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee44a00640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 0x7fee401f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee44a00640 1 -- 172.21.15.7:0/2846772939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee400ca760 con 0x7fee4006e710 2024-08-19T00:42:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee44a00640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee4006e710 0x7fee4015d1f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fee3402a240 tx=0x7fee340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee3cc00640 1 -- 172.21.15.7:0/2846772939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34037040 con 0x7fee4006e710 2024-08-19T00:42:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee3cc00640 1 -- 172.21.15.7:0/2846772939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee34042070 con 0x7fee4006e710 2024-08-19T00:42:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee3cc00640 1 -- 172.21.15.7:0/2846772939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3403d440 con 0x7fee4006e710 2024-08-19T00:42:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee400caa40 con 0x7fee4006e710 2024-08-19T00:42:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.026+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4015d730 con 0x7fee4006e710 2024-08-19T00:42:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.027+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee400b1f30 con 0x7fee4006e710 2024-08-19T00:42:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.028+0000 7fee3cc00640 1 -- 172.21.15.7:0/2846772939 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee3403d5e0 con 0x7fee4006e710 2024-08-19T00:42:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.029+0000 7fee3cc00640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee2006be30 0x7fee2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.029+0000 7fee3cc00640 1 -- 172.21.15.7:0/2846772939 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7fee340ab2f0 con 0x7fee4006e710 2024-08-19T00:42:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.029+0000 7fee3fe00640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee2006be30 0x7fee2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.030+0000 7fee3fe00640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee2006be30 0x7fee2006e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee400afb30 tx=0x7fee2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.033+0000 7fee3cc00640 1 -- 172.21.15.7:0/2846772939 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fee34079f50 con 0x7fee4006e710 2024-08-19T00:42:28.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.285+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fee40071980 con 0x7fee4006e710 2024-08-19T00:42:28.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.286+0000 7fee3cc00640 1 -- 172.21.15.7:0/2846772939 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fee34079850 con 0x7fee4006e710 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g==", 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:42:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA==", 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ==", 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA==", 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA==", 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ==", 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-08-19T00:42:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ==", 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w==", 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg==", 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-08-19T00:42:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ==", 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA==", 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA==", 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA==", 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA==", 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.298 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ==", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg==", 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-08-19T00:42:28.300 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8Jmuq0sEBAA7n5q8IKlS3tRogqIwCSCeQ==", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ==", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:42:28.301 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg==", 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-08-19T00:42:28.302 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:42:28.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee2006be30 msgr2=0x7fee2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee2006be30 0x7fee2006e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee400afb30 tx=0x7fee2c009040 comp rx=0 tx=0).stop 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee4006e710 msgr2=0x7fee4015d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee4006e710 0x7fee4015d1f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fee3402a240 tx=0x7fee340046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 shutdown_connections 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee2006be30 0x7fee2006e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee400d03c0 0x7fee401f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee400b3750 0x7fee401f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 --2- 172.21.15.7:0/2846772939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee4006e710 0x7fee4015d1f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 >> 172.21.15.7:0/2846772939 conn(0x7fee4006bc70 msgr2=0x7fee400ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 shutdown_connections 2024-08-19T00:42:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.288+0000 7fee47400640 1 -- 172.21.15.7:0/2846772939 wait complete. 2024-08-19T00:42:28.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-19T00:42:28.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.460+0000 7f0335200640 1 Processor -- start 2024-08-19T00:42:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.460+0000 7f0335200640 1 -- start start 2024-08-19T00:42:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.461+0000 7f0335200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f033015ee50 0x7f033015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.461+0000 7f0335200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03300b3ab0 con 0x7f03300d3200 2024-08-19T00:42:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.461+0000 7f0335200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033015f460 con 0x7f033015e360 2024-08-19T00:42:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.461+0000 7f0335200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f033015f740 con 0x7f033015ee50 2024-08-19T00:42:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.461+0000 7f032ea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f03300d3200 0x7f033015e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40090/0 (socket says 172.21.15.7:40090) 2024-08-19T00:42:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.461+0000 7f032ea00640 1 -- 172.21.15.7:0/2310866466 learned_addr learned my addr 172.21.15.7:0/2310866466 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.461+0000 7f032fe00640 1 --2- 172.21.15.7:0/2310866466 >> v2:172.21.15.7:3300/0 conn(0x7f033015ee50 0x7f033015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.462+0000 7f032e000640 1 -- 172.21.15.7:0/2310866466 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211322104 0 0) 0x7f03300b3ab0 con 0x7f03300d3200 2024-08-19T00:42:28.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.462+0000 7f032e000640 1 -- 172.21.15.7:0/2310866466 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0314003520 con 0x7f03300d3200 2024-08-19T00:42:28.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.462+0000 7f032fe00640 1 -- 172.21.15.7:0/2310866466 >> v1:172.21.15.162:6789/0 conn(0x7f033015e360 legacy=0x7f03300d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.462+0000 7f032fe00640 1 -- 172.21.15.7:0/2310866466 >> v1:172.21.15.7:6789/0 conn(0x7f03300d3200 legacy=0x7f033015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.462+0000 7f032fe00640 1 -- 172.21.15.7:0/2310866466 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03300b3d60 con 0x7f033015ee50 2024-08-19T00:42:28.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.463+0000 7f032fe00640 1 --2- 172.21.15.7:0/2310866466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015ee50 0x7f033015fab0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94c35580f57454a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.463+0000 7f032e000640 1 -- 172.21.15.7:0/2310866466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328007740 con 0x7f033015ee50 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.463+0000 7f032e000640 1 -- 172.21.15.7:0/2310866466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03280078e0 con 0x7f033015ee50 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.463+0000 7f032e000640 1 -- 172.21.15.7:0/2310866466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328007c90 con 0x7f033015ee50 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.464+0000 7f0335200640 1 -- 172.21.15.7:0/2310866466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015ee50 msgr2=0x7f033015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.464+0000 7f0335200640 1 --2- 172.21.15.7:0/2310866466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015ee50 0x7f033015fab0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802a6f0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.464+0000 7f0335200640 1 -- 172.21.15.7:0/2310866466 shutdown_connections 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.464+0000 7f0335200640 1 --2- 172.21.15.7:0/2310866466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015ee50 0x7f033015fab0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.464+0000 7f0335200640 1 -- 172.21.15.7:0/2310866466 >> 172.21.15.7:0/2310866466 conn(0x7f033008dbf0 msgr2=0x7f033009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.464+0000 7f0335200640 1 -- 172.21.15.7:0/2310866466 shutdown_connections 2024-08-19T00:42:28.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.464+0000 7f0335200640 1 -- 172.21.15.7:0/2310866466 wait complete. 2024-08-19T00:42:28.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.466+0000 7f0335200640 1 Processor -- start 2024-08-19T00:42:28.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.466+0000 7f0335200640 1 -- start start 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.466+0000 7f0335200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03300d3200 0x7f0330150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f0335200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015e360 0x7f03300d4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f0335200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f033015ee50 0x7f03300d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f0335200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03300b4560 con 0x7f033015e360 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f0335200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03300d2300 con 0x7f03300d3200 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f0335200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03300b46e0 con 0x7f033015ee50 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015e360 0x7f03300d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015e360 0x7f03300d4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56454/0 (socket says 172.21.15.7:56454) 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 -- 172.21.15.7:0/2320178173 learned_addr learned my addr 172.21.15.7:0/2320178173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 -- 172.21.15.7:0/2320178173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f033015ee50 msgr2=0x7f03300d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f033015ee50 0x7f03300d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 -- 172.21.15.7:0/2320178173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03300d3200 msgr2=0x7f0330150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03300d3200 0x7f0330150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.467+0000 7f032ea00640 1 -- 172.21.15.7:0/2320178173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03300cb3e0 con 0x7f033015e360 2024-08-19T00:42:28.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.468+0000 7f032ea00640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015e360 0x7f03300d4290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f031c00c530 tx=0x7f031c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.468+0000 7f0327400640 1 -- 172.21.15.7:0/2320178173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c017070 con 0x7f033015e360 2024-08-19T00:42:28.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.468+0000 7f0327400640 1 -- 172.21.15.7:0/2320178173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c005ce0 con 0x7f033015e360 2024-08-19T00:42:28.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.468+0000 7f0327400640 1 -- 172.21.15.7:0/2320178173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c0072b0 con 0x7f033015e360 2024-08-19T00:42:28.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.468+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03300cb6c0 con 0x7f033015e360 2024-08-19T00:42:28.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.468+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03300cbc80 con 0x7f033015e360 2024-08-19T00:42:28.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.469+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033015fab0 con 0x7f033015e360 2024-08-19T00:42:28.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.470+0000 7f0327400640 1 -- 172.21.15.7:0/2320178173 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f031c01a070 con 0x7f033015e360 2024-08-19T00:42:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.471+0000 7f0327400640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f031006be30 0x7f031006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.471+0000 7f0327400640 1 -- 172.21.15.7:0/2320178173 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7f031c089f40 con 0x7f033015e360 2024-08-19T00:42:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.471+0000 7f032f400640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f031006be30 0x7f031006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.472+0000 7f032f400640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f031006be30 0x7f031006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0320000f60 tx=0x7f03200079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.475+0000 7f0327400640 1 -- 172.21.15.7:0/2320178173 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f031c058cf0 con 0x7f033015e360 2024-08-19T00:42:28.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.661+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f03300d50d0 con 0x7f033015e360 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.661+0000 7f0327400640 1 -- 172.21.15.7:0/2320178173 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7f031c0585f0 con 0x7f033015e360 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:42:28.664 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:42:28.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f031006be30 msgr2=0x7f031006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f031006be30 0x7f031006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0320000f60 tx=0x7f03200079b0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015e360 msgr2=0x7f03300d4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015e360 0x7f03300d4290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f031c00c530 tx=0x7f031c00c9f0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 shutdown_connections 2024-08-19T00:42:28.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f031006be30 0x7f031006e2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f033015ee50 0x7f03300d47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033015e360 0x7f03300d4290 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 --2- 172.21.15.7:0/2320178173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03300d3200 0x7f0330150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 >> 172.21.15.7:0/2320178173 conn(0x7f033008dbf0 msgr2=0x7f033015fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:28.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 shutdown_connections 2024-08-19T00:42:28.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.663+0000 7f0335200640 1 -- 172.21.15.7:0/2320178173 wait complete. 2024-08-19T00:42:28.681 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:42:28.681 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:42:28.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.841+0000 7f009ac00640 1 Processor -- start 2024-08-19T00:42:28.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.841+0000 7f009ac00640 1 -- start start 2024-08-19T00:42:28.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.842+0000 7f009ac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f009415de20 0x7f00940d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.842+0000 7f009ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f009415f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.842+0000 7f009ac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0094162b80 con 0x7f0094161cb0 2024-08-19T00:42:28.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.842+0000 7f009ac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00940b4360 con 0x7f009415de20 2024-08-19T00:42:28.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.842+0000 7f009ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00940b4010 con 0x7f00940b4f00 2024-08-19T00:42:28.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.842+0000 7f0098e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0094161cb0 0x7f00940b47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40094/0 (socket says 172.21.15.7:40094) 2024-08-19T00:42:28.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.842+0000 7f0098e00640 1 -- 172.21.15.7:0/2607043591 learned_addr learned my addr 172.21.15.7:0/2607043591 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:28.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.843+0000 7f009a200640 1 --2- 172.21.15.7:0/2607043591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f009415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.843+0000 7f009a200640 1 -- 172.21.15.7:0/2607043591 >> v2:172.21.15.162:3300/0 conn(0x7f009415de20 msgr2=0x7f00940d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:28.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.843+0000 7f009a200640 1 --2- 172.21.15.7:0/2607043591 >> v2:172.21.15.162:3300/0 conn(0x7f009415de20 0x7f00940d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.843+0000 7f009a200640 1 -- 172.21.15.7:0/2607043591 >> v1:172.21.15.7:6789/0 conn(0x7f0094161cb0 legacy=0x7f00940b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.843+0000 7f009a200640 1 -- 172.21.15.7:0/2607043591 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00940d13a0 con 0x7f00940b4f00 2024-08-19T00:42:28.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.845+0000 7f009a200640 1 --2- 172.21.15.7:0/2607043591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f009415f210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f008c009d90 tx=0x7f008c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6217cfd68a3e845e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.845+0000 7f0093e00640 1 -- 172.21.15.7:0/2607043591 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c007740 con 0x7f00940b4f00 2024-08-19T00:42:28.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.845+0000 7f0093e00640 1 -- 172.21.15.7:0/2607043591 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c0078e0 con 0x7f00940b4f00 2024-08-19T00:42:28.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.845+0000 7f0093e00640 1 -- 172.21.15.7:0/2607043591 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c007cb0 con 0x7f00940b4f00 2024-08-19T00:42:28.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 -- 172.21.15.7:0/2607043591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 msgr2=0x7f009415f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 --2- 172.21.15.7:0/2607043591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f009415f210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f008c009d90 tx=0x7f008c02a660 comp rx=0 tx=0).stop 2024-08-19T00:42:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 -- 172.21.15.7:0/2607043591 shutdown_connections 2024-08-19T00:42:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 --2- 172.21.15.7:0/2607043591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f009415f210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 --2- 172.21.15.7:0/2607043591 >> v2:172.21.15.162:3300/0 conn(0x7f009415de20 0x7f00940d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 -- 172.21.15.7:0/2607043591 >> 172.21.15.7:0/2607043591 conn(0x7f009408dbe0 msgr2=0x7f009409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 -- 172.21.15.7:0/2607043591 shutdown_connections 2024-08-19T00:42:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.846+0000 7f009ac00640 1 -- 172.21.15.7:0/2607043591 wait complete. 2024-08-19T00:42:28.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.848+0000 7f009ac00640 1 Processor -- start 2024-08-19T00:42:28.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.848+0000 7f009ac00640 1 -- start start 2024-08-19T00:42:28.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.849+0000 7f009ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f00940b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.849+0000 7f009ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f009415de20 0x7f0094156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.849+0000 7f009ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0094161cb0 0x7f009415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.849+0000 7f009ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00940d1090 con 0x7f0094161cb0 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.849+0000 7f009ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00940d1960 con 0x7f009415de20 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.849+0000 7f009ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00940d3e80 con 0x7f00940b4f00 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.849+0000 7f009a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0094161cb0 0x7f009415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0094161cb0 0x7f009415b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56466/0 (socket says 172.21.15.7:56466) 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 -- 172.21.15.7:0/1996583371 learned_addr learned my addr 172.21.15.7:0/1996583371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 -- 172.21.15.7:0/1996583371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 msgr2=0x7f00940b2740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f00940b2740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 -- 172.21.15.7:0/1996583371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f009415de20 msgr2=0x7f0094156ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:42:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f009415de20 0x7f0094156ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:28.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 -- 172.21.15.7:0/1996583371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00940cb910 con 0x7f0094161cb0 2024-08-19T00:42:28.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.850+0000 7f009a200640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0094161cb0 0x7f009415b740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f008c009eb0 tx=0x7f008c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.851+0000 7f0091600640 1 -- 172.21.15.7:0/1996583371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c040070 con 0x7f0094161cb0 2024-08-19T00:42:28.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.851+0000 7f0091600640 1 -- 172.21.15.7:0/1996583371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c031c90 con 0x7f0094161cb0 2024-08-19T00:42:28.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00940b1360 con 0x7f0094161cb0 2024-08-19T00:42:28.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.851+0000 7f0091600640 1 -- 172.21.15.7:0/1996583371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c03c640 con 0x7f0094161cb0 2024-08-19T00:42:28.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00940b1920 con 0x7f0094161cb0 2024-08-19T00:42:28.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.852+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00940d0b50 con 0x7f0094161cb0 2024-08-19T00:42:28.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.853+0000 7f0091600640 1 -- 172.21.15.7:0/1996583371 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f008c039040 con 0x7f0094161cb0 2024-08-19T00:42:28.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.854+0000 7f0091600640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007406be30 0x7f007406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:28.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.854+0000 7f0091600640 1 -- 172.21.15.7:0/1996583371 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7f008c0ac190 con 0x7f0094161cb0 2024-08-19T00:42:28.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.854+0000 7f0099800640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007406be30 0x7f007406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:28.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.855+0000 7f0099800640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007406be30 0x7f007406e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00880096b0 tx=0x7f0088006c20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:28.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:28.858+0000 7f0091600640 1 -- 172.21.15.7:0/1996583371 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f008c07af40 con 0x7f0094161cb0 2024-08-19T00:42:29.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.043+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f00940cbae0 con 0x7f0094161cb0 2024-08-19T00:42:29.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.847+0000 7f0091600640 1 -- 172.21.15.7:0/1996583371 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f008c07a840 con 0x7f0094161cb0 2024-08-19T00:42:29.851 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-08-19T00:42:29.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007406be30 msgr2=0x7f007406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007406be30 0x7f007406e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00880096b0 tx=0x7f0088006c20 comp rx=0 tx=0).stop 2024-08-19T00:42:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0094161cb0 msgr2=0x7f009415b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0094161cb0 0x7f009415b740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f008c009eb0 tx=0x7f008c004a40 comp rx=0 tx=0).stop 2024-08-19T00:42:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 shutdown_connections 2024-08-19T00:42:29.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f007406be30 0x7f007406e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:29.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0094161cb0 0x7f009415b740 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:29.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f009415de20 0x7f0094156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:29.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 --2- 172.21.15.7:0/1996583371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00940b4f00 0x7f00940b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:29.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 >> 172.21.15.7:0/1996583371 conn(0x7f009408dbe0 msgr2=0x7f009406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:29.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 shutdown_connections 2024-08-19T00:42:29.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:29.851+0000 7f009ac00640 1 -- 172.21.15.7:0/1996583371 wait complete. 2024-08-19T00:42:29.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:42:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.043+0000 7f90e5200640 1 Processor -- start 2024-08-19T00:42:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.043+0000 7f90e5200640 1 -- start start 2024-08-19T00:42:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90e5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f90e0158cd0 0x7f90e0072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90e5200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90e00ae480 0x7f90e00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90e5200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e00aeae0 con 0x7f90e0072ff0 2024-08-19T00:42:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90e5200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f90e0073460 con 0x7f90e00ae480 2024-08-19T00:42:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90e5200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f90e00aedc0 con 0x7f90e0158cd0 2024-08-19T00:42:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90de800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90e00ae480 0x7f90e00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90de800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90e00ae480 0x7f90e00b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56482/0 (socket says 172.21.15.7:56482) 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90de800640 1 -- 172.21.15.7:0/3462056963 learned_addr learned my addr 172.21.15.7:0/3462056963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90de800640 1 -- 172.21.15.7:0/3462056963 >> v2:172.21.15.162:3300/0 conn(0x7f90e0158cd0 msgr2=0x7f90e0072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90dde00640 1 --2- 172.21.15.7:0/3462056963 >> v2:172.21.15.162:3300/0 conn(0x7f90e0158cd0 0x7f90e0072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90de800640 1 --2- 172.21.15.7:0/3462056963 >> v2:172.21.15.162:3300/0 conn(0x7f90e0158cd0 0x7f90e0072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.045+0000 7f90de800640 1 -- 172.21.15.7:0/3462056963 >> v1:172.21.15.162:6789/0 conn(0x7f90e0072ff0 legacy=0x7f90e00add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.046+0000 7f90de800640 1 -- 172.21.15.7:0/3462056963 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e00af0a0 con 0x7f90e00ae480 2024-08-19T00:42:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.046+0000 7f90dde00640 1 --2- 172.21.15.7:0/3462056963 >> v2:172.21.15.162:3300/0 conn(0x7f90e0158cd0 0x7f90e0072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.046+0000 7f90de800640 1 --2- 172.21.15.7:0/3462056963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e00ae480 0x7f90e00b3150 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f90e00b2ca0 tx=0x7f90d802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcbf0604cf8b5ea server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90dd400640 1 -- 172.21.15.7:0/3462056963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8038070 con 0x7f90e00ae480 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90dd400640 1 -- 172.21.15.7:0/3462056963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d8009600 con 0x7f90e00ae480 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90dd400640 1 -- 172.21.15.7:0/3462056963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d80099d0 con 0x7f90e00ae480 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90e5200640 1 -- 172.21.15.7:0/3462056963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e00ae480 msgr2=0x7f90e00b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90e5200640 1 --2- 172.21.15.7:0/3462056963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e00ae480 0x7f90e00b3150 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f90e00b2ca0 tx=0x7f90d802c7e0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90e5200640 1 -- 172.21.15.7:0/3462056963 shutdown_connections 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90e5200640 1 --2- 172.21.15.7:0/3462056963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e00ae480 0x7f90e00b3150 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90e5200640 1 --2- 172.21.15.7:0/3462056963 >> v2:172.21.15.162:3300/0 conn(0x7f90e0158cd0 0x7f90e0072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90e5200640 1 -- 172.21.15.7:0/3462056963 >> 172.21.15.7:0/3462056963 conn(0x7f90e00b2300 msgr2=0x7f90e006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.047+0000 7f90e5200640 1 -- 172.21.15.7:0/3462056963 shutdown_connections 2024-08-19T00:42:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.048+0000 7f90e5200640 1 -- 172.21.15.7:0/3462056963 wait complete. 2024-08-19T00:42:30.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.049+0000 7f90e5200640 1 Processor -- start 2024-08-19T00:42:30.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.049+0000 7f90e5200640 1 -- start start 2024-08-19T00:42:30.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90e5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e0072ff0 0x7f90e01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:30.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90e5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90e00ae480 0x7f90e006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:30.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90e5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e006ea30 0x7f90e0157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:30.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90e5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90e00b3690 con 0x7f90e0072ff0 2024-08-19T00:42:30.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90e5200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90e00af660 con 0x7f90e006ea30 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90e5200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90e00b3810 con 0x7f90e00ae480 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e0072ff0 0x7f90e01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e0072ff0 0x7f90e01552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56488/0 (socket says 172.21.15.7:56488) 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90dde00640 1 -- 172.21.15.7:0/1398212422 learned_addr learned my addr 172.21.15.7:0/1398212422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.050+0000 7f90d7e00640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90e00ae480 0x7f90e006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90de800640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e006ea30 0x7f90e0157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90dde00640 1 -- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90e00ae480 msgr2=0x7f90e006e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90dde00640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90e00ae480 0x7f90e006e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90dde00640 1 -- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e006ea30 msgr2=0x7f90e0157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90dde00640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e006ea30 0x7f90e0157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90dde00640 1 -- 172.21.15.7:0/1398212422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e01537a0 con 0x7f90e0072ff0 2024-08-19T00:42:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90dde00640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e0072ff0 0x7f90e01552f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f90d000c820 tx=0x7f90d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90d6000640 1 -- 172.21.15.7:0/1398212422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0015070 con 0x7f90e0072ff0 2024-08-19T00:42:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90d6000640 1 -- 172.21.15.7:0/1398212422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d0007a30 con 0x7f90e0072ff0 2024-08-19T00:42:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e0153a80 con 0x7f90e0072ff0 2024-08-19T00:42:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.051+0000 7f90d6000640 1 -- 172.21.15.7:0/1398212422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0007de0 con 0x7f90e0072ff0 2024-08-19T00:42:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.052+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e0154320 con 0x7f90e0072ff0 2024-08-19T00:42:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.053+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e00b3150 con 0x7f90e0072ff0 2024-08-19T00:42:30.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.054+0000 7f90d6000640 1 -- 172.21.15.7:0/1398212422 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90d0018070 con 0x7f90e0072ff0 2024-08-19T00:42:30.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.055+0000 7f90d6000640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f90bc06be30 0x7f90bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:30.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.055+0000 7f90d6000640 1 -- 172.21.15.7:0/1398212422 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5227+0+0 (secure 0 0 0) 0x7f90d008ab00 con 0x7f90e0072ff0 2024-08-19T00:42:30.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.055+0000 7f90d7e00640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f90bc06be30 0x7f90bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:30.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.056+0000 7f90d7e00640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f90bc06be30 0x7f90bc06e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004f60 tx=0x7f90c8007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:30.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.060+0000 7f90d6000640 1 -- 172.21.15.7:0/1398212422 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f90d0059030 con 0x7f90e0072ff0 2024-08-19T00:42:30.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.243+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f90e00cfd30 con 0x7f90e0072ff0 2024-08-19T00:42:30.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.851+0000 7f90d6000640 1 -- 172.21.15.7:0/1398212422 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) ==== 170+0+0 (secure 0 0 0) 0x7f90d005d330 con 0x7f90e0072ff0 2024-08-19T00:42:30.854 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-08-19T00:42:30.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.856+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f90bc06be30 msgr2=0x7f90bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:30.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.856+0000 7f90e5200640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f90bc06be30 0x7f90bc06e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004f60 tx=0x7f90c8007e30 comp rx=0 tx=0).stop 2024-08-19T00:42:30.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.856+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e0072ff0 msgr2=0x7f90e01552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:30.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.856+0000 7f90e5200640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e0072ff0 0x7f90e01552f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f90d000c820 tx=0x7f90d000cce0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.857+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 shutdown_connections 2024-08-19T00:42:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.857+0000 7f90e5200640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f90bc06be30 0x7f90bc06e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.857+0000 7f90e5200640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e006ea30 0x7f90e0157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.857+0000 7f90e5200640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90e00ae480 0x7f90e006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.857+0000 7f90e5200640 1 --2- 172.21.15.7:0/1398212422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e0072ff0 0x7f90e01552f0 secure :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f90d000c820 tx=0x7f90d000cce0 comp rx=0 tx=0).stop 2024-08-19T00:42:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.857+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 >> 172.21.15.7:0/1398212422 conn(0x7f90e00b2300 msgr2=0x7f90e0072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.860+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 shutdown_connections 2024-08-19T00:42:30.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:30.860+0000 7f90e5200640 1 -- 172.21.15.7:0/1398212422 wait complete. 2024-08-19T00:42:30.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:42:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.055+0000 7f0606c00640 1 Processor -- start 2024-08-19T00:42:31.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.055+0000 7f0606c00640 1 -- start start 2024-08-19T00:42:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.056+0000 7f0606c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f06000cbc30 0x7f06000cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.056+0000 7f0606c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06000b6f70 con 0x7f060006d770 2024-08-19T00:42:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.056+0000 7f0606c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06000b7250 con 0x7f06000cc570 2024-08-19T00:42:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.056+0000 7f0606c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f06000cb430 con 0x7f06000cbc30 2024-08-19T00:42:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.056+0000 7f05ffe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f060006d770 0x7f060006db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40096/0 (socket says 172.21.15.7:40096) 2024-08-19T00:42:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.056+0000 7f05ffe00640 1 -- 172.21.15.7:0/692469803 learned_addr learned my addr 172.21.15.7:0/692469803 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05ff400640 1 --2- 172.21.15.7:0/692469803 >> v2:172.21.15.162:3300/0 conn(0x7f06000cbc30 0x7f06000cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543885096 0 0) 0x7f06000b6f70 con 0x7f060006d770 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05e4003520 con 0x7f060006d770 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899390016 0 0) 0x7f06000b7250 con 0x7f06000cc570 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06000b6f70 con 0x7f06000cc570 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1140488294 0 0) 0x7f05e4003520 con 0x7f060006d770 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 >> v2:172.21.15.162:3300/0 conn(0x7f06000cbc30 msgr2=0x7f06000cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 --2- 172.21.15.7:0/692469803 >> v2:172.21.15.162:3300/0 conn(0x7f06000cbc30 0x7f06000cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 >> v1:172.21.15.162:6789/0 conn(0x7f06000cc570 legacy=0x7f0600168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06000cb710 con 0x7f060006d770 2024-08-19T00:42:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f05f0001670 con 0x7f060006d770 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 >> v1:172.21.15.7:6789/0 conn(0x7f060006d770 legacy=0x7f060006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e4003b40 0x7f05e4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e4004800 0x7f05e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e40051c0 0x7f05e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06000cb430 con 0x7f05e4003b40 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05e400c040 con 0x7f05e4004800 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05e400c240 con 0x7f05e40051c0 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.057+0000 7f05ff400640 1 --2- 172.21.15.7:0/692469803 >> v2:172.21.15.162:3300/0 conn(0x7f06000cbc30 0x7f06000cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ffe00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e4003b40 0x7f05e4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f0604c00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e40051c0 0x7f05e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ff400640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e4004800 0x7f05e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ffe00640 1 -- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e40051c0 msgr2=0x7f05e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ffe00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e40051c0 0x7f05e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ffe00640 1 -- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e4004800 msgr2=0x7f05e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ffe00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e4004800 0x7f05e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ffe00640 1 -- 172.21.15.7:0/692469803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4003520 con 0x7f05e4003b40 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f0604c00640 1 -- 172.21.15.7:0/692469803 reap_dead start 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.058+0000 7f05ff400640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e4004800 0x7f05e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.059+0000 7f05ffe00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e4003b40 0x7f05e4003f40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c190 tx=0x7f05e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dac1cd6e6bfa2c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.059+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0007ce0 con 0x7f05e4003b40 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.059+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f0005ad0 con 0x7f05e4003b40 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.059+0000 7f05fea00640 1 -- 172.21.15.7:0/692469803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0007070 con 0x7f05e4003b40 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.060+0000 7f0606c00640 1 -- 172.21.15.7:0/692469803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e4003b40 msgr2=0x7f05e4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.060+0000 7f0606c00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e4003b40 0x7f05e4003f40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c190 tx=0x7f05e4005830 comp rx=0 tx=0).stop 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.060+0000 7f0606c00640 1 -- 172.21.15.7:0/692469803 shutdown_connections 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.060+0000 7f0606c00640 1 --2- 172.21.15.7:0/692469803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e4003b40 0x7f05e4003f40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.060+0000 7f0606c00640 1 -- 172.21.15.7:0/692469803 >> 172.21.15.7:0/692469803 conn(0x7f06000d2180 msgr2=0x7f06000d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:31.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.060+0000 7f0606c00640 1 -- 172.21.15.7:0/692469803 shutdown_connections 2024-08-19T00:42:31.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.060+0000 7f0606c00640 1 -- 172.21.15.7:0/692469803 wait complete. 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.062+0000 7f0606c00640 1 Processor -- start 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.062+0000 7f0606c00640 1 -- start start 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f0606c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e4003b40 0x7f060015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f0606c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001f4210 0x7f06001f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f0606c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06001e5710 0x7f06001e5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f0606c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f060006d370 con 0x7f06001f4210 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f0606c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f060015ea10 con 0x7f06001e5710 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f0606c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06000d2ca0 con 0x7f05e4003b40 2024-08-19T00:42:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001f4210 0x7f06001f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001f4210 0x7f06001f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56506/0 (socket says 172.21.15.7:56506) 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 -- 172.21.15.7:0/2303206835 learned_addr learned my addr 172.21.15.7:0/2303206835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ffe00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e4003b40 0x7f060015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f0604c00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06001e5710 0x7f06001e5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 -- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e4003b40 msgr2=0x7f060015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e4003b40 0x7f060015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 -- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06001e5710 msgr2=0x7f06001e5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06001e5710 0x7f06001e5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.063+0000 7f05ff400640 1 -- 172.21.15.7:0/2303206835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06001e3af0 con 0x7f06001f4210 2024-08-19T00:42:31.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.064+0000 7f05ff400640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001f4210 0x7f06001f4690 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f05ec011830 tx=0x7f05ec011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:31.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.064+0000 7f05f7e00640 1 -- 172.21.15.7:0/2303206835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00f9c0 con 0x7f06001f4210 2024-08-19T00:42:31.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.064+0000 7f05f7e00640 1 -- 172.21.15.7:0/2303206835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ec00fb60 con 0x7f06001f4210 2024-08-19T00:42:31.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.064+0000 7f05f7e00640 1 -- 172.21.15.7:0/2303206835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec015460 con 0x7f06001f4210 2024-08-19T00:42:31.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.064+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06001e3dd0 con 0x7f06001f4210 2024-08-19T00:42:31.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.064+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001e4390 con 0x7f06001f4210 2024-08-19T00:42:31.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.065+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f060009ba80 con 0x7f06001f4210 2024-08-19T00:42:31.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.066+0000 7f05f7e00640 1 -- 172.21.15.7:0/2303206835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05ec015810 con 0x7f06001f4210 2024-08-19T00:42:31.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.067+0000 7f05f7e00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05e006be30 0x7f05e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:31.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.067+0000 7f05f7e00640 1 -- 172.21.15.7:0/2303206835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5609+0+0 (secure 0 0 0) 0x7f05ec08bb30 con 0x7f06001f4210 2024-08-19T00:42:31.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.068+0000 7f05ffe00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05e006be30 0x7f05e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:31.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.068+0000 7f05ffe00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05e006be30 0x7f05e006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05f0032000 tx=0x7f05f0009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:31.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.072+0000 7f05f7e00640 1 -- 172.21.15.7:0/2303206835 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f05ec019030 con 0x7f06001f4210 2024-08-19T00:42:31.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.295+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f06000b3b70 con 0x7f06001f4210 2024-08-19T00:42:31.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.873+0000 7f05f7e00640 1 -- 172.21.15.7:0/2303206835 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v65) ==== 174+0+0 (secure 0 0 0) 0x7f05ec05a4a0 con 0x7f06001f4210 2024-08-19T00:42:31.877 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 10 and data pool 11 2024-08-19T00:42:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.882+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05e006be30 msgr2=0x7f05e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.882+0000 7f0606c00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05e006be30 0x7f05e006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05f0032000 tx=0x7f05f0009030 comp rx=0 tx=0).stop 2024-08-19T00:42:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.882+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001f4210 msgr2=0x7f06001f4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.882+0000 7f0606c00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001f4210 0x7f06001f4690 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f05ec011830 tx=0x7f05ec011cf0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.884+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 shutdown_connections 2024-08-19T00:42:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.884+0000 7f0606c00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05e006be30 0x7f05e006e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.884+0000 7f0606c00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06001e5710 0x7f06001e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.884+0000 7f0606c00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001f4210 0x7f06001f4690 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.884+0000 7f0606c00640 1 --2- 172.21.15.7:0/2303206835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05e4003b40 0x7f060015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.884+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 >> 172.21.15.7:0/2303206835 conn(0x7f06000d2180 msgr2=0x7f06000b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.885+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 shutdown_connections 2024-08-19T00:42:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:31.885+0000 7f0606c00640 1 -- 172.21.15.7:0/2303206835 wait complete. 2024-08-19T00:42:31.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:42:31.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:42:31.970 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:42:32.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.072+0000 7f7a9f200640 1 Processor -- start 2024-08-19T00:42:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.072+0000 7f7a9f200640 1 -- start start 2024-08-19T00:42:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7aa006dd10 0x7f7aa015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9f200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa00733f0 con 0x7f7aa0072f70 2024-08-19T00:42:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa00736d0 con 0x7f7aa006dd10 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa00739b0 con 0x7f7aa015bd70 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7aa006dd10 0x7f7aa015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7aa006dd10 0x7f7aa015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56512/0 (socket says 172.21.15.7:56512) 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9e800640 1 -- 172.21.15.7:0/3771869752 learned_addr learned my addr 172.21.15.7:0/3771869752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.073+0000 7f7a9de00640 1 --2- 172.21.15.7:0/3771869752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.074+0000 7f7a9e800640 1 -- 172.21.15.7:0/3771869752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 msgr2=0x7f7aa0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.074+0000 7f7a9e800640 1 --2- 172.21.15.7:0/3771869752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.074+0000 7f7a9e800640 1 -- 172.21.15.7:0/3771869752 >> v1:172.21.15.162:6789/0 conn(0x7f7aa0072f70 legacy=0x7f7aa006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.074+0000 7f7a9e800640 1 -- 172.21.15.7:0/3771869752 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa015c4a0 con 0x7f7aa006dd10 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.075+0000 7f7a9e800640 1 --2- 172.21.15.7:0/3771869752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa015cca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009e50 tx=0x7f7a9802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8554daf6f74c59 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.075+0000 7f7a9d400640 1 -- 172.21.15.7:0/3771869752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98036070 con 0x7f7aa006dd10 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.075+0000 7f7a9d400640 1 -- 172.21.15.7:0/3771869752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a98031600 con 0x7f7aa006dd10 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.075+0000 7f7a9d400640 1 -- 172.21.15.7:0/3771869752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a980319d0 con 0x7f7aa006dd10 2024-08-19T00:42:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.075+0000 7f7a9f200640 1 -- 172.21.15.7:0/3771869752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 msgr2=0x7f7aa015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.075+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3771869752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa015cca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009e50 tx=0x7f7a9802a710 comp rx=0 tx=0).stop 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.076+0000 7f7a9f200640 1 -- 172.21.15.7:0/3771869752 shutdown_connections 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.076+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3771869752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa015cca0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.076+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3771869752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.076+0000 7f7a9f200640 1 -- 172.21.15.7:0/3771869752 >> 172.21.15.7:0/3771869752 conn(0x7f7aa006b850 msgr2=0x7f7aa006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.076+0000 7f7a9f200640 1 -- 172.21.15.7:0/3771869752 shutdown_connections 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.076+0000 7f7a9f200640 1 -- 172.21.15.7:0/3771869752 wait complete. 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.077+0000 7f7a9f200640 1 Processor -- start 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.077+0000 7f7a9f200640 1 -- start start 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.078+0000 7f7a9f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa0141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.078+0000 7f7a9f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa0072f70 0x7f7aa01516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.078+0000 7f7a9f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.078+0000 7f7a9f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa006e3a0 con 0x7f7aa006dd10 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.078+0000 7f7a9f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa015c150 con 0x7f7aa0072f70 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.078+0000 7f7a9f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa006e520 con 0x7f7aa015bd70 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa0141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa0141e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56516/0 (socket says 172.21.15.7:56516) 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 -- 172.21.15.7:0/3265237918 learned_addr learned my addr 172.21.15.7:0/3265237918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a97e00640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa0072f70 0x7f7aa01516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9e800640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 -- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 msgr2=0x7f7aa0151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 -- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa0072f70 msgr2=0x7f7aa01516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa0072f70 0x7f7aa01516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 -- 172.21.15.7:0/3265237918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa013f650 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a97e00640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa0072f70 0x7f7aa01516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9e800640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.079+0000 7f7a9de00640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa0141e80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000e9e0 tx=0x7f7a9000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.080+0000 7f7a96000640 1 -- 172.21.15.7:0/3265237918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90017070 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.080+0000 7f7a96000640 1 -- 172.21.15.7:0/3265237918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9000c9d0 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.080+0000 7f7a96000640 1 -- 172.21.15.7:0/3265237918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9000cdc0 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.080+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa013f930 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.080+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa013fef0 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.081+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa015cca0 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.082+0000 7f7a96000640 1 -- 172.21.15.7:0/3265237918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a9001a070 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.083+0000 7f7a96000640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a7c06be30 0x7f7a7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.083+0000 7f7a96000640 1 -- 172.21.15.7:0/3265237918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f7a9008b280 con 0x7f7aa006dd10 2024-08-19T00:42:32.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.083+0000 7f7a97e00640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a7c06be30 0x7f7a7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.084+0000 7f7a97e00640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a7c06be30 0x7f7a7c06e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7aa01e6260 tx=0x7f7a88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.087+0000 7f7a96000640 1 -- 172.21.15.7:0/3265237918 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7a90059b90 con 0x7f7aa006dd10 2024-08-19T00:42:32.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.274+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7aa015b3f0 con 0x7f7aa006dd10 2024-08-19T00:42:32.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.275+0000 7f7a96000640 1 -- 172.21.15.7:0/3265237918 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16585 (secure 0 0 0) 0x7f7a90059490 con 0x7f7aa006dd10 2024-08-19T00:42:32.278 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:32.279 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":71,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:42:31.297614+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:42:29.087286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-08-19T00:42:30.287566+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a7c06be30 msgr2=0x7f7a7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a7c06be30 0x7f7a7c06e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7aa01e6260 tx=0x7f7a88009040 comp rx=0 tx=0).stop 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 msgr2=0x7f7aa0141e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa0141e80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000e9e0 tx=0x7f7a9000eea0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 shutdown_connections 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a7c06be30 0x7f7a7c06e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa015bd70 0x7f7aa0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa0072f70 0x7f7aa01516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 --2- 172.21.15.7:0/3265237918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7aa006dd10 0x7f7aa0141e80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 >> 172.21.15.7:0/3265237918 conn(0x7f7aa006b850 msgr2=0x7f7aa00ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:32.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 shutdown_connections 2024-08-19T00:42:32.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.278+0000 7f7a9f200640 1 -- 172.21.15.7:0/3265237918 wait complete. 2024-08-19T00:42:32.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:42:32.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.491+0000 7fc5ff200640 1 Processor -- start 2024-08-19T00:42:32.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.491+0000 7fc5ff200640 1 -- start start 2024-08-19T00:42:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.492+0000 7fc5ff200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5f8159bf0 0x7fc5f8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.492+0000 7fc5ff200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f80739a0 0x7fc5f80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.492+0000 7fc5ff200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f806f7f0 con 0x7fc5f80cea40 2024-08-19T00:42:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.492+0000 7fc5ff200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f806f510 con 0x7fc5f8159bf0 2024-08-19T00:42:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.492+0000 7fc5ff200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f8072980 con 0x7fc5f80739a0 2024-08-19T00:42:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f80739a0 0x7fc5f80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5f8159bf0 0x7fc5f8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5f8159bf0 0x7fc5f8073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:57552/0 (socket says 172.21.15.7:57552) 2024-08-19T00:42:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7e00640 1 -- 172.21.15.7:0/4156109326 learned_addr learned my addr 172.21.15.7:0/4156109326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7e00640 1 -- 172.21.15.7:0/4156109326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f80739a0 msgr2=0x7fc5f80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:32.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7e00640 1 --2- 172.21.15.7:0/4156109326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f80739a0 0x7fc5f80ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7e00640 1 -- 172.21.15.7:0/4156109326 >> v1:172.21.15.162:6789/0 conn(0x7fc5f80cea40 legacy=0x7fc5f80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f7e00640 1 -- 172.21.15.7:0/4156109326 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f8072c60 con 0x7fc5f8159bf0 2024-08-19T00:42:32.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.493+0000 7fc5f6a00640 1 -- 172.21.15.7:0/4156109326 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221805834 0 0) 0x7fc5f806f7f0 con 0x7fc5f80cea40 2024-08-19T00:42:32.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.494+0000 7fc5f7e00640 1 --2- 172.21.15.7:0/4156109326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8159bf0 0x7fc5f8073460 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ab6c0bfbd7861be server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5f6a00640 1 -- 172.21.15.7:0/4156109326 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8037070 con 0x7fc5f8159bf0 2024-08-19T00:42:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5f6a00640 1 -- 172.21.15.7:0/4156109326 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8032440 con 0x7fc5f8159bf0 2024-08-19T00:42:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5f6a00640 1 -- 172.21.15.7:0/4156109326 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8032810 con 0x7fc5f8159bf0 2024-08-19T00:42:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 -- 172.21.15.7:0/4156109326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8159bf0 msgr2=0x7fc5f8073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 --2- 172.21.15.7:0/4156109326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8159bf0 0x7fc5f8073460 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 -- 172.21.15.7:0/4156109326 shutdown_connections 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 --2- 172.21.15.7:0/4156109326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f80739a0 0x7fc5f80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 --2- 172.21.15.7:0/4156109326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8159bf0 0x7fc5f8073460 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 -- 172.21.15.7:0/4156109326 >> 172.21.15.7:0/4156109326 conn(0x7fc5f806bc70 msgr2=0x7fc5f806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 -- 172.21.15.7:0/4156109326 shutdown_connections 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.495+0000 7fc5ff200640 1 -- 172.21.15.7:0/4156109326 wait complete. 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.497+0000 7fc5ff200640 1 Processor -- start 2024-08-19T00:42:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.497+0000 7fc5ff200640 1 -- start start 2024-08-19T00:42:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5ff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f80739a0 0x7fc5f81f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5ff200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f80cea40 0x7fc5f81467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5ff200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f8159bf0 0x7fc5f8146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5ff200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f815a150 con 0x7fc5f80739a0 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5ff200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f8159fd0 con 0x7fc5f80cea40 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5ff200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f80d0ad0 con 0x7fc5f8159bf0 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f80739a0 0x7fc5f81f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f80739a0 0x7fc5f81f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56532/0 (socket says 172.21.15.7:56532) 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5f7e00640 1 -- 172.21.15.7:0/178662960 learned_addr learned my addr 172.21.15.7:0/178662960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5f7400640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f80cea40 0x7fc5f81467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.498+0000 7fc5fd200640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f8159bf0 0x7fc5f8146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5f7e00640 1 -- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f8159bf0 msgr2=0x7fc5f8146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5f7e00640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f8159bf0 0x7fc5f8146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5f7e00640 1 -- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f80cea40 msgr2=0x7fc5f81467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5f7e00640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f80cea40 0x7fc5f81467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5f7e00640 1 -- 172.21.15.7:0/178662960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f8148e20 con 0x7fc5f80739a0 2024-08-19T00:42:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5f7e00640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f80739a0 0x7fc5f81f36f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802a200 tx=0x7fc5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5efe00640 1 -- 172.21.15.7:0/178662960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8037040 con 0x7fc5f80739a0 2024-08-19T00:42:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5efe00640 1 -- 172.21.15.7:0/178662960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8042070 con 0x7fc5f80739a0 2024-08-19T00:42:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5efe00640 1 -- 172.21.15.7:0/178662960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8030880 con 0x7fc5f80739a0 2024-08-19T00:42:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.499+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f8147320 con 0x7fc5f80739a0 2024-08-19T00:42:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.500+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f8145b50 con 0x7fc5f80739a0 2024-08-19T00:42:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.501+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f80ce500 con 0x7fc5f80739a0 2024-08-19T00:42:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.502+0000 7fc5efe00640 1 -- 172.21.15.7:0/178662960 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5e802ad10 con 0x7fc5f80739a0 2024-08-19T00:42:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.503+0000 7fc5efe00640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d806be30 0x7fc5d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.503+0000 7fc5efe00640 1 -- 172.21.15.7:0/178662960 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fc5e80ab370 con 0x7fc5f80739a0 2024-08-19T00:42:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.503+0000 7fc5f7400640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d806be30 0x7fc5d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.504+0000 7fc5f7400640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d806be30 0x7fc5d806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80b4a30 tx=0x7fc5e4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.507+0000 7fc5efe00640 1 -- 172.21.15.7:0/178662960 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc5e8079c80 con 0x7fc5f80739a0 2024-08-19T00:42:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.693+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5f8073730 con 0x7fc5f80739a0 2024-08-19T00:42:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.694+0000 7fc5efe00640 1 -- 172.21.15.7:0/178662960 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16585 (secure 0 0 0) 0x7fc5e8079580 con 0x7fc5f80739a0 2024-08-19T00:42:32.697 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:32.697 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":71,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:42:31.297614+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:42:29.087286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-08-19T00:42:30.287566+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:42:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d806be30 msgr2=0x7fc5d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d806be30 0x7fc5d806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80b4a30 tx=0x7fc5e4009190 comp rx=0 tx=0).stop 2024-08-19T00:42:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f80739a0 msgr2=0x7fc5f81f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f80739a0 0x7fc5f81f36f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802a200 tx=0x7fc5e80046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 shutdown_connections 2024-08-19T00:42:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5d806be30 0x7fc5d806e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f8159bf0 0x7fc5f8146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f80cea40 0x7fc5f81467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 --2- 172.21.15.7:0/178662960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5f80739a0 0x7fc5f81f36f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 >> 172.21.15.7:0/178662960 conn(0x7fc5f806bc70 msgr2=0x7fc5f815f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 shutdown_connections 2024-08-19T00:42:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.696+0000 7fc5ff200640 1 -- 172.21.15.7:0/178662960 wait complete. 2024-08-19T00:42:32.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:42:32.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.876+0000 7fe887800640 1 Processor -- start 2024-08-19T00:42:32.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.876+0000 7fe887800640 1 -- start start 2024-08-19T00:42:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe887800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe88006d770 0x7fe88006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe887800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8800b5da0 0x7fe8800b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe887800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe8800b66e0 0x7fe8800cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe887800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe88006e090 con 0x7fe8800b5da0 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe887800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe8800b6f70 con 0x7fe8800b66e0 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe887800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8800b7250 con 0x7fe88006d770 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe87fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8800b5da0 0x7fe8800b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe87fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8800b5da0 0x7fe8800b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56536/0 (socket says 172.21.15.7:56536) 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe87fe00640 1 -- 172.21.15.7:0/2965149313 learned_addr learned my addr 172.21.15.7:0/2965149313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.878+0000 7fe885800640 1 --2- 172.21.15.7:0/2965149313 >> v2:172.21.15.162:3300/0 conn(0x7fe8800b66e0 0x7fe8800cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.879+0000 7fe884e00640 1 --2- 172.21.15.7:0/2965149313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe88006d770 0x7fe88006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.879+0000 7fe87fe00640 1 -- 172.21.15.7:0/2965149313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe88006d770 msgr2=0x7fe88006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.879+0000 7fe87fe00640 1 --2- 172.21.15.7:0/2965149313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe88006d770 0x7fe88006db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.879+0000 7fe87fe00640 1 -- 172.21.15.7:0/2965149313 >> v2:172.21.15.162:3300/0 conn(0x7fe8800b66e0 msgr2=0x7fe8800cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:32.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.879+0000 7fe87fe00640 1 --2- 172.21.15.7:0/2965149313 >> v2:172.21.15.162:3300/0 conn(0x7fe8800b66e0 0x7fe8800cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.879+0000 7fe87fe00640 1 -- 172.21.15.7:0/2965149313 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8800cb430 con 0x7fe8800b5da0 2024-08-19T00:42:32.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.879+0000 7fe884e00640 1 --2- 172.21.15.7:0/2965149313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe88006d770 0x7fe88006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:32.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.880+0000 7fe87fe00640 1 --2- 172.21.15.7:0/2965149313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8800b5da0 0x7fe8800b61a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe88006f630 tx=0x7fe86c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d8090eab15bf17 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.882+0000 7fe87f400640 1 -- 172.21.15.7:0/2965149313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c037070 con 0x7fe8800b5da0 2024-08-19T00:42:32.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.882+0000 7fe87f400640 1 -- 172.21.15.7:0/2965149313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86c032440 con 0x7fe8800b5da0 2024-08-19T00:42:32.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.882+0000 7fe87f400640 1 -- 172.21.15.7:0/2965149313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c032810 con 0x7fe8800b5da0 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 -- 172.21.15.7:0/2965149313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8800b5da0 msgr2=0x7fe8800b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 --2- 172.21.15.7:0/2965149313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8800b5da0 0x7fe8800b61a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe88006f630 tx=0x7fe86c02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 -- 172.21.15.7:0/2965149313 shutdown_connections 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 --2- 172.21.15.7:0/2965149313 >> v2:172.21.15.162:3300/0 conn(0x7fe8800b66e0 0x7fe8800cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 --2- 172.21.15.7:0/2965149313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8800b5da0 0x7fe8800b61a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 --2- 172.21.15.7:0/2965149313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe88006d770 0x7fe88006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 -- 172.21.15.7:0/2965149313 >> 172.21.15.7:0/2965149313 conn(0x7fe8800d2180 msgr2=0x7fe8800d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 -- 172.21.15.7:0/2965149313 shutdown_connections 2024-08-19T00:42:32.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.883+0000 7fe887800640 1 -- 172.21.15.7:0/2965149313 wait complete. 2024-08-19T00:42:32.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.885+0000 7fe887800640 1 Processor -- start 2024-08-19T00:42:32.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.885+0000 7fe887800640 1 -- start start 2024-08-19T00:42:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe887800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe88006d770 0x7fe88014c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe887800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8800b5da0 0x7fe88014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe887800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8800b66e0 0x7fe88014f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe887800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe88015ea10 con 0x7fe88006d770 2024-08-19T00:42:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe887800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe88006f9a0 con 0x7fe8800b66e0 2024-08-19T00:42:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe887800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe88006d370 con 0x7fe8800b5da0 2024-08-19T00:42:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe88006d770 0x7fe88014c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe88006d770 0x7fe88014c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56552/0 (socket says 172.21.15.7:56552) 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 -- 172.21.15.7:0/965708811 learned_addr learned my addr 172.21.15.7:0/965708811 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe87fe00640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8800b5da0 0x7fe88014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe885800640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8800b66e0 0x7fe88014f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 -- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8800b5da0 msgr2=0x7fe88014ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8800b5da0 0x7fe88014ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 -- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8800b66e0 msgr2=0x7fe88014f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8800b66e0 0x7fe88014f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.886+0000 7fe884e00640 1 -- 172.21.15.7:0/965708811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88014faa0 con 0x7fe88006d770 2024-08-19T00:42:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.887+0000 7fe884e00640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe88006d770 0x7fe88014c5c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe87400d800 tx=0x7fe87400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.887+0000 7fe87cc00640 1 -- 172.21.15.7:0/965708811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874018070 con 0x7fe88006d770 2024-08-19T00:42:32.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.887+0000 7fe87cc00640 1 -- 172.21.15.7:0/965708811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe874004030 con 0x7fe88006d770 2024-08-19T00:42:32.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.887+0000 7fe87cc00640 1 -- 172.21.15.7:0/965708811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874004400 con 0x7fe88006d770 2024-08-19T00:42:32.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.887+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88014fd80 con 0x7fe88006d770 2024-08-19T00:42:32.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.887+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88014d180 con 0x7fe88006d770 2024-08-19T00:42:32.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.888+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8800d2ca0 con 0x7fe88006d770 2024-08-19T00:42:32.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.889+0000 7fe87cc00640 1 -- 172.21.15.7:0/965708811 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8740096a0 con 0x7fe88006d770 2024-08-19T00:42:32.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.890+0000 7fe87cc00640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe86006be60 0x7fe86006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:32.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.890+0000 7fe87cc00640 1 -- 172.21.15.7:0/965708811 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fe87408b150 con 0x7fe88006d770 2024-08-19T00:42:32.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.890+0000 7fe87fe00640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe86006be60 0x7fe86006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:32.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.891+0000 7fe87fe00640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe86006be60 0x7fe86006e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe86c034000 tx=0x7fe86c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:32.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:32.895+0000 7fe87cc00640 1 -- 172.21.15.7:0/965708811 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe874059af0 con 0x7fe88006d770 2024-08-19T00:42:33.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.118+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe8800b3b90 con 0x7fe88006d770 2024-08-19T00:42:33.851 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:42:33.848+0000 7f1057200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:42:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.887+0000 7fe87cc00640 1 -- 172.21.15.7:0/965708811 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) ==== 118+0+0 (secure 0 0 0) 0x7fe8740593f0 con 0x7fe88006d770 2024-08-19T00:42:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe86006be60 msgr2=0x7fe86006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe86006be60 0x7fe86006e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe86c034000 tx=0x7fe86c02e000 comp rx=0 tx=0).stop 2024-08-19T00:42:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe88006d770 msgr2=0x7fe88014c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe88006d770 0x7fe88014c5c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe87400d800 tx=0x7fe87400dcc0 comp rx=0 tx=0).stop 2024-08-19T00:42:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 shutdown_connections 2024-08-19T00:42:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe86006be60 0x7fe86006e320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8800b66e0 0x7fe88014f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8800b5da0 0x7fe88014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 --2- 172.21.15.7:0/965708811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe88006d770 0x7fe88014c5c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.890+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 >> 172.21.15.7:0/965708811 conn(0x7fe8800d2180 msgr2=0x7fe88015b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.891+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 shutdown_connections 2024-08-19T00:42:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:33.891+0000 7fe887800640 1 -- 172.21.15.7:0/965708811 wait complete. 2024-08-19T00:42:33.911 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-19T00:42:33.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-19T00:42:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.073+0000 7fcc9f200640 1 Processor -- start 2024-08-19T00:42:34.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.073+0000 7fcc9f200640 1 -- start start 2024-08-19T00:42:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.074+0000 7fcc9f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 0x7fcca00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.074+0000 7fcc9f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca00b4df0 con 0x7fcca015e3e0 2024-08-19T00:42:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.074+0000 7fcc9f200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca00b50d0 con 0x7fcca00d27b0 2024-08-19T00:42:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.074+0000 7fcc9f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcca00d3140 con 0x7fcca00b4860 2024-08-19T00:42:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.074+0000 7fcc9de00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcca015e3e0 0x7fcca00b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44786/0 (socket says 172.21.15.7:44786) 2024-08-19T00:42:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.074+0000 7fcc9de00640 1 -- 172.21.15.7:0/385162647 learned_addr learned my addr 172.21.15.7:0/385162647 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:34.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9e800640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 0x7fcca00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000403348 0 0) 0x7fcca00b4df0 con 0x7fcca015e3e0 2024-08-19T00:42:34.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc84003520 con 0x7fcca015e3e0 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1671861010 0 0) 0x7fcc84003520 con 0x7fcca015e3e0 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 msgr2=0x7fcca00d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 0x7fcca00d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 >> v1:172.21.15.162:6789/0 conn(0x7fcca00d27b0 legacy=0x7fcca00b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca00cf1e0 con 0x7fcca015e3e0 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fcc90001670 con 0x7fcca015e3e0 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 >> v1:172.21.15.7:6789/0 conn(0x7fcca015e3e0 legacy=0x7fcca00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc840039e0 0x7fcc84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc84004800 0x7fcc84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 0x7fcc840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcca00d3140 con 0x7fcc84004800 2024-08-19T00:42:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.075+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8400ba70 con 0x7fcc840039e0 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8400bc20 con 0x7fcca00b4860 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9de00640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc840039e0 0x7fcc84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9d400640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc84004800 0x7fcc84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9e800640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 0x7fcc840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9d400640 1 -- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 msgr2=0x7fcc840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9d400640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca00b4860 0x7fcc840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9d400640 1 -- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc840039e0 msgr2=0x7fcc84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9d400640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc840039e0 0x7fcc84003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9d400640 1 -- 172.21.15.7:0/385162647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc84003520 con 0x7fcc84004800 2024-08-19T00:42:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.076+0000 7fcc9de00640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc840039e0 0x7fcc84003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.077+0000 7fcc9d400640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc84004800 0x7fcc84004c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c001830 tx=0x7fcc84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b7dfb632a3d7e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c037070 con 0x7fcc84004800 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8c02ab90 con 0x7fcc84004800 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9ca00640 1 -- 172.21.15.7:0/385162647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c001430 con 0x7fcc84004800 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9f200640 1 -- 172.21.15.7:0/385162647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc84004800 msgr2=0x7fcc84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9f200640 1 --2- 172.21.15.7:0/385162647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc84004800 0x7fcc84004c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c001830 tx=0x7fcc84005830 comp rx=0 tx=0).stop 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9e800640 1 -- 172.21.15.7:0/385162647 reap_dead start 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9f200640 1 -- 172.21.15.7:0/385162647 shutdown_connections 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9f200640 1 -- 172.21.15.7:0/385162647 >> 172.21.15.7:0/385162647 conn(0x7fcca008dbe0 msgr2=0x7fcca009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9f200640 1 -- 172.21.15.7:0/385162647 shutdown_connections 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.078+0000 7fcc9f200640 1 -- 172.21.15.7:0/385162647 wait complete. 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.080+0000 7fcc9f200640 1 Processor -- start 2024-08-19T00:42:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.080+0000 7fcc9f200640 1 -- start start 2024-08-19T00:42:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc84004800 0x7fcca00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca015f810 0x7fcca00cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca0159e60 0x7fcca015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcca00d2c00 con 0x7fcca015f810 2024-08-19T00:42:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcca00cee90 con 0x7fcca0159e60 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcca00d2d80 con 0x7fcc84004800 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca015f810 0x7fcca00cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca015f810 0x7fcca00cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34472/0 (socket says 172.21.15.7:34472) 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.081+0000 7fcc9d400640 1 -- 172.21.15.7:0/2683594297 learned_addr learned my addr 172.21.15.7:0/2683594297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9de00640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc84004800 0x7fcca00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9e800640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca0159e60 0x7fcca015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9d400640 1 -- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc84004800 msgr2=0x7fcca00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9d400640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc84004800 0x7fcca00ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9d400640 1 -- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca0159e60 msgr2=0x7fcca015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9d400640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca0159e60 0x7fcca015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9d400640 1 -- 172.21.15.7:0/2683594297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca0160060 con 0x7fcca015f810 2024-08-19T00:42:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9d400640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca015f810 0x7fcca00cb510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c001920 tx=0x7fcc8c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc96000640 1 -- 172.21.15.7:0/2683594297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c037040 con 0x7fcca015f810 2024-08-19T00:42:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc96000640 1 -- 172.21.15.7:0/2683594297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8c005070 con 0x7fcca015f810 2024-08-19T00:42:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc96000640 1 -- 172.21.15.7:0/2683594297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c001430 con 0x7fcca015f810 2024-08-19T00:42:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca0160340 con 0x7fcca015f810 2024-08-19T00:42:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.082+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca0160900 con 0x7fcca015f810 2024-08-19T00:42:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.083+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca00b4d50 con 0x7fcca015f810 2024-08-19T00:42:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.084+0000 7fcc96000640 1 -- 172.21.15.7:0/2683594297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc8c0035f0 con 0x7fcca015f810 2024-08-19T00:42:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.085+0000 7fcc96000640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc8006be60 0x7fcc8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.085+0000 7fcc96000640 1 -- 172.21.15.7:0/2683594297 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fcc8c0ab660 con 0x7fcca015f810 2024-08-19T00:42:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.085+0000 7fcc9de00640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc8006be60 0x7fcc8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.086+0000 7fcc9de00640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc8006be60 0x7fcc8006e320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc90001010 tx=0x7fcc90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:34.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.090+0000 7fcc96000640 1 -- 172.21.15.7:0/2683594297 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcc8c079ee0 con 0x7fcca015f810 2024-08-19T00:42:34.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.312+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcca00d0d60 con 0x7fcca015f810 2024-08-19T00:42:34.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.889+0000 7fcc96000640 1 -- 172.21.15.7:0/2683594297 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) ==== 122+0+0 (secure 0 0 0) 0x7fcc8c0797e0 con 0x7fcca015f810 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.891+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc8006be60 msgr2=0x7fcc8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.891+0000 7fcc9f200640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc8006be60 0x7fcc8006e320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc90001010 tx=0x7fcc90009040 comp rx=0 tx=0).stop 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.891+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca015f810 msgr2=0x7fcca00cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.891+0000 7fcc9f200640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca015f810 0x7fcca00cb510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c001920 tx=0x7fcc8c001230 comp rx=0 tx=0).stop 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 shutdown_connections 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc8006be60 0x7fcc8006e320 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca0159e60 0x7fcca015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca015f810 0x7fcca00cb510 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 --2- 172.21.15.7:0/2683594297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc84004800 0x7fcca00ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 >> 172.21.15.7:0/2683594297 conn(0x7fcca008dbe0 msgr2=0x7fcca00b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 shutdown_connections 2024-08-19T00:42:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:34.892+0000 7fcc9f200640 1 -- 172.21.15.7:0/2683594297 wait complete. 2024-08-19T00:42:34.912 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-19T00:42:34.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.068+0000 7fb3b7600640 1 Processor -- start 2024-08-19T00:42:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.068+0000 7fb3b7600640 1 -- start start 2024-08-19T00:42:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.069+0000 7fb3b7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b00ce500 0x7fb3b00ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.069+0000 7fb3b7600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b006f7f0 con 0x7fb3b00d03c0 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.069+0000 7fb3b7600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b006f510 con 0x7fb3b0159bf0 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.069+0000 7fb3b7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b00cee80 con 0x7fb3b00ce500 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.069+0000 7fb3b5600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb3b00d03c0 0x7fb3b006e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44788/0 (socket says 172.21.15.7:44788) 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.069+0000 7fb3b5600640 1 -- 172.21.15.7:0/4093398964 learned_addr learned my addr 172.21.15.7:0/4093398964 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.070+0000 7fb3afe00640 1 --2- 172.21.15.7:0/4093398964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b00ce500 0x7fb3b00ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.070+0000 7fb3af400640 1 -- 172.21.15.7:0/4093398964 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091560234 0 0) 0x7fb3b006f7f0 con 0x7fb3b00d03c0 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.070+0000 7fb3af400640 1 -- 172.21.15.7:0/4093398964 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb398003520 con 0x7fb3b00d03c0 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.070+0000 7fb3afe00640 1 -- 172.21.15.7:0/4093398964 >> v1:172.21.15.162:6789/0 conn(0x7fb3b0159bf0 legacy=0x7fb3b0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.070+0000 7fb3afe00640 1 -- 172.21.15.7:0/4093398964 >> v1:172.21.15.7:6789/0 conn(0x7fb3b00d03c0 legacy=0x7fb3b006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.070+0000 7fb3afe00640 1 -- 172.21.15.7:0/4093398964 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b0072980 con 0x7fb3b00ce500 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.071+0000 7fb3afe00640 1 --2- 172.21.15.7:0/4093398964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b00ce500 0x7fb3b00ce940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097d0 tx=0x7fb39c02a120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701d96790c8f2539 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.071+0000 7fb3af400640 1 -- 172.21.15.7:0/4093398964 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c037070 con 0x7fb3b00ce500 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.071+0000 7fb3af400640 1 -- 172.21.15.7:0/4093398964 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c02ae30 con 0x7fb3b00ce500 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.071+0000 7fb3af400640 1 -- 172.21.15.7:0/4093398964 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c032640 con 0x7fb3b00ce500 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.072+0000 7fb3b7600640 1 -- 172.21.15.7:0/4093398964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b00ce500 msgr2=0x7fb3b00ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.072+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4093398964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b00ce500 0x7fb3b00ce940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097d0 tx=0x7fb39c02a120 comp rx=0 tx=0).stop 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.072+0000 7fb3b7600640 1 -- 172.21.15.7:0/4093398964 shutdown_connections 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.072+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4093398964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b00ce500 0x7fb3b00ce940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.072+0000 7fb3b7600640 1 -- 172.21.15.7:0/4093398964 >> 172.21.15.7:0/4093398964 conn(0x7fb3b006bc70 msgr2=0x7fb3b006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.072+0000 7fb3b7600640 1 -- 172.21.15.7:0/4093398964 shutdown_connections 2024-08-19T00:42:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.072+0000 7fb3b7600640 1 -- 172.21.15.7:0/4093398964 wait complete. 2024-08-19T00:42:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.074+0000 7fb3b7600640 1 Processor -- start 2024-08-19T00:42:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.074+0000 7fb3b7600640 1 -- start start 2024-08-19T00:42:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3b7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b00ce500 0x7fb3b009d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3b7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b00d03c0 0x7fb3b00b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3b7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b0159bf0 0x7fb3b014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3b7600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0073b70 con 0x7fb3b00d03c0 2024-08-19T00:42:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3b7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0072f40 con 0x7fb3b00ce500 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3b7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b0159fd0 con 0x7fb3b0159bf0 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b00d03c0 0x7fb3b00b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b00d03c0 0x7fb3b00b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34478/0 (socket says 172.21.15.7:34478) 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.075+0000 7fb3afe00640 1 -- 172.21.15.7:0/4292328807 learned_addr learned my addr 172.21.15.7:0/4292328807 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3b4c00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b00ce500 0x7fb3b009d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3b5600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b0159bf0 0x7fb3b014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3afe00640 1 -- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b0159bf0 msgr2=0x7fb3b014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3afe00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b0159bf0 0x7fb3b014d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3afe00640 1 -- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b00ce500 msgr2=0x7fb3b009d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3afe00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b00ce500 0x7fb3b009d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3afe00640 1 -- 172.21.15.7:0/4292328807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b014d8c0 con 0x7fb3b00d03c0 2024-08-19T00:42:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3b4c00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b00ce500 0x7fb3b009d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3b5600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b0159bf0 0x7fb3b014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3afe00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b00d03c0 0x7fb3b00b3110 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097d0 tx=0x7fb39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3acc00640 1 -- 172.21.15.7:0/4292328807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c041070 con 0x7fb3b00d03c0 2024-08-19T00:42:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3acc00640 1 -- 172.21.15.7:0/4292328807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c03c460 con 0x7fb3b00d03c0 2024-08-19T00:42:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3acc00640 1 -- 172.21.15.7:0/4292328807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c037040 con 0x7fb3b00d03c0 2024-08-19T00:42:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.076+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b00b3880 con 0x7fb3b00d03c0 2024-08-19T00:42:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.077+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b00b3e40 con 0x7fb3b00d03c0 2024-08-19T00:42:35.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.078+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b00ce940 con 0x7fb3b00d03c0 2024-08-19T00:42:35.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.078+0000 7fb3acc00640 1 -- 172.21.15.7:0/4292328807 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb39c044070 con 0x7fb3b00d03c0 2024-08-19T00:42:35.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.079+0000 7fb3acc00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39006be30 0x7fb39006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.079+0000 7fb3acc00640 1 -- 172.21.15.7:0/4292328807 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fb39c0ab830 con 0x7fb3b00d03c0 2024-08-19T00:42:35.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.080+0000 7fb3b4c00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39006be30 0x7fb39006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.080+0000 7fb3b4c00640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39006be30 0x7fb39006e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4003eb0 tx=0x7fb3a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.084+0000 7fb3acc00640 1 -- 172.21.15.7:0/4292328807 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb39c07a300 con 0x7fb3b00d03c0 2024-08-19T00:42:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.304+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3b0158f90 con 0x7fb3b00d03c0 2024-08-19T00:42:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.304+0000 7fb3acc00640 1 -- 172.21.15.7:0/4292328807 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5219 (secure 0 0 0) 0x7fb39c079c00 con 0x7fb3b00d03c0 2024-08-19T00:42:35.307 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:35.307 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":69,"btime":"2024-08-19T00:42:34:888871+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:42:34.314121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6354":{"gid":6354,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2626740684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2626740684},{"type":"v1","addr":"172.21.15.7:6837","nonce":2626740684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6354,"qdb_cluster":[6354]},"id":5}]} 2024-08-19T00:42:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 69 2024-08-19T00:42:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39006be30 msgr2=0x7fb39006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39006be30 0x7fb39006e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4003eb0 tx=0x7fb3a4009040 comp rx=0 tx=0).stop 2024-08-19T00:42:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b00d03c0 msgr2=0x7fb3b00b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b00d03c0 0x7fb3b00b3110 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097d0 tx=0x7fb39c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 shutdown_connections 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb39006be30 0x7fb39006e2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b0159bf0 0x7fb3b014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3b00d03c0 0x7fb3b00b3110 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 --2- 172.21.15.7:0/4292328807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b00ce500 0x7fb3b009d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.306+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 >> 172.21.15.7:0/4292328807 conn(0x7fb3b006bc70 msgr2=0x7fb3b015bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.307+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 shutdown_connections 2024-08-19T00:42:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.307+0000 7fb3b7600640 1 -- 172.21.15.7:0/4292328807 wait complete. 2024-08-19T00:42:35.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:42:35.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.479+0000 7f1688600640 1 Processor -- start 2024-08-19T00:42:35.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.479+0000 7f1688600640 1 -- start start 2024-08-19T00:42:35.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.480+0000 7f1688600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f168015f5b0 0x7f16800cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.480+0000 7f1688600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800b4a90 0x7f16800d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.480+0000 7f1688600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16800cfaf0 con 0x7f16800d03c0 2024-08-19T00:42:35.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.480+0000 7f1688600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f16800d0d60 con 0x7f168015f5b0 2024-08-19T00:42:35.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.480+0000 7f1688600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f168015f990 con 0x7f16800b4a90 2024-08-19T00:42:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1686600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800b4a90 0x7f16800d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1685c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f168015f5b0 0x7f16800cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1686600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800b4a90 0x7f16800d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:47224/0 (socket says 172.21.15.7:47224) 2024-08-19T00:42:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1686600640 1 -- 172.21.15.7:0/482282487 learned_addr learned my addr 172.21.15.7:0/482282487 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1686600640 1 -- 172.21.15.7:0/482282487 >> v2:172.21.15.162:3300/0 conn(0x7f168015f5b0 msgr2=0x7f16800cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1686600640 1 --2- 172.21.15.7:0/482282487 >> v2:172.21.15.162:3300/0 conn(0x7f168015f5b0 0x7f16800cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1686600640 1 -- 172.21.15.7:0/482282487 >> v1:172.21.15.162:6789/0 conn(0x7f16800d03c0 legacy=0x7f16800b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1686600640 1 -- 172.21.15.7:0/482282487 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16800b50b0 con 0x7f16800b4a90 2024-08-19T00:42:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.481+0000 7f1685c00640 1 --2- 172.21.15.7:0/482282487 >> v2:172.21.15.162:3300/0 conn(0x7f168015f5b0 0x7f16800cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.482+0000 7f1686600640 1 --2- 172.21.15.7:0/482282487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800b4a90 0x7f16800d0820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1678009e50 tx=0x7f167802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ab1e8f721e1530 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.482+0000 7f167fe00640 1 -- 172.21.15.7:0/482282487 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678036070 con 0x7f16800b4a90 2024-08-19T00:42:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f167fe00640 1 -- 172.21.15.7:0/482282487 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1678031600 con 0x7f16800b4a90 2024-08-19T00:42:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f167fe00640 1 -- 172.21.15.7:0/482282487 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16780319d0 con 0x7f16800b4a90 2024-08-19T00:42:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 -- 172.21.15.7:0/482282487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800b4a90 msgr2=0x7f16800d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 --2- 172.21.15.7:0/482282487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800b4a90 0x7f16800d0820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1678009e50 tx=0x7f167802a680 comp rx=0 tx=0).stop 2024-08-19T00:42:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 -- 172.21.15.7:0/482282487 shutdown_connections 2024-08-19T00:42:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 --2- 172.21.15.7:0/482282487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800b4a90 0x7f16800d0820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 --2- 172.21.15.7:0/482282487 >> v2:172.21.15.162:3300/0 conn(0x7f168015f5b0 0x7f16800cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 -- 172.21.15.7:0/482282487 >> 172.21.15.7:0/482282487 conn(0x7f168006bc70 msgr2=0x7f168006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 -- 172.21.15.7:0/482282487 shutdown_connections 2024-08-19T00:42:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.483+0000 7f1688600640 1 -- 172.21.15.7:0/482282487 wait complete. 2024-08-19T00:42:35.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.485+0000 7f1688600640 1 Processor -- start 2024-08-19T00:42:35.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.485+0000 7f1688600640 1 -- start start 2024-08-19T00:42:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1688600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16800b4a90 0x7f16801512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1688600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800d03c0 0x7f16800ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1688600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168015f5b0 0x7f16800b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1688600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16800cedb0 con 0x7f16800b4a90 2024-08-19T00:42:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1688600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16800cf120 con 0x7f168015f5b0 2024-08-19T00:42:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1688600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f168006e660 con 0x7f16800d03c0 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1685c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16800b4a90 0x7f16801512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1685c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16800b4a90 0x7f16801512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34484/0 (socket says 172.21.15.7:34484) 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1685c00640 1 -- 172.21.15.7:0/334551627 learned_addr learned my addr 172.21.15.7:0/334551627 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1685200640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800d03c0 0x7f16800ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.486+0000 7f1686600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168015f5b0 0x7f16800b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f1685c00640 1 -- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800d03c0 msgr2=0x7f16800ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f1685c00640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800d03c0 0x7f16800ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f1685c00640 1 -- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168015f5b0 msgr2=0x7f16800b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f1685c00640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168015f5b0 0x7f16800b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f1685c00640 1 -- 172.21.15.7:0/334551627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16800af3d0 con 0x7f16800b4a90 2024-08-19T00:42:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f1685c00640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16800b4a90 0x7f16801512f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f167400e9c0 tx=0x7f167400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f167d600640 1 -- 172.21.15.7:0/334551627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674017070 con 0x7f16800b4a90 2024-08-19T00:42:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f167d600640 1 -- 172.21.15.7:0/334551627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167400ca60 con 0x7f16800b4a90 2024-08-19T00:42:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f167d600640 1 -- 172.21.15.7:0/334551627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167400ce30 con 0x7f16800b4a90 2024-08-19T00:42:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.487+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16800adaa0 con 0x7f16800b4a90 2024-08-19T00:42:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.488+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16800ae060 con 0x7f16800b4a90 2024-08-19T00:42:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.489+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16800d0820 con 0x7f16800b4a90 2024-08-19T00:42:35.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.489+0000 7f167d600640 1 -- 172.21.15.7:0/334551627 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f167401a070 con 0x7f16800b4a90 2024-08-19T00:42:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.490+0000 7f167d600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.490+0000 7f167d600640 1 -- 172.21.15.7:0/334551627 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f167408ace0 con 0x7f16800b4a90 2024-08-19T00:42:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.491+0000 7f1685200640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.491+0000 7f1685200640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1680151c40 tx=0x7f166c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.495+0000 7f167d600640 1 -- 172.21.15.7:0/334551627 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1674058f20 con 0x7f16800b4a90 2024-08-19T00:42:35.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.682+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1680162240 con 0x7f16800b4a90 2024-08-19T00:42:35.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.683+0000 7f167d600640 1 -- 172.21.15.7:0/334551627 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16572 (secure 0 0 0) 0x7f167405d220 con 0x7f16800b4a90 2024-08-19T00:42:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:35.686 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":72,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:42:32.864674+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:42:29.087286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-08-19T00:42:30.287566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:42:35.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.685+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 msgr2=0x7f166006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.685+0000 7f1688600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1680151c40 tx=0x7f166c009040 comp rx=0 tx=0).stop 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.685+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16800b4a90 msgr2=0x7f16801512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.685+0000 7f1688600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16800b4a90 0x7f16801512f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f167400e9c0 tx=0x7f167400ee80 comp rx=0 tx=0).stop 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 shutdown_connections 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168015f5b0 0x7f16800b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16800d03c0 0x7f16800ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 --2- 172.21.15.7:0/334551627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16800b4a90 0x7f16801512f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 >> 172.21.15.7:0/334551627 conn(0x7f168006bc70 msgr2=0x7f1680157660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 shutdown_connections 2024-08-19T00:42:35.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.686+0000 7f1688600640 1 -- 172.21.15.7:0/334551627 wait complete. 2024-08-19T00:42:35.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:42:35.705 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:42:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.859+0000 7f21fa600640 1 Processor -- start 2024-08-19T00:42:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.859+0000 7f21fa600640 1 -- start start 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.860+0000 7f21fa600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f21f40d1fd0 0x7f21f40b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.860+0000 7f21fa600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f40d4d50 con 0x7f21f40d27b0 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.860+0000 7f21fa600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f40d2460 con 0x7f21f40d48e0 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.860+0000 7f21fa600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f21f40d0110 con 0x7f21f40d1fd0 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.860+0000 7f21f9200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f21f40d27b0 0x7f21f40d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44802/0 (socket says 172.21.15.7:44802) 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.860+0000 7f21f9200640 1 -- 172.21.15.7:0/1230683933 learned_addr learned my addr 172.21.15.7:0/1230683933 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.860+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507737153 0 0) 0x7f21f40d4d50 con 0x7f21f40d27b0 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21dc003520 con 0x7f21f40d27b0 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3464159152 0 0) 0x7f21dc003520 con 0x7f21f40d27b0 2024-08-19T00:42:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 >> v2:172.21.15.162:3300/0 conn(0x7f21f40d1fd0 msgr2=0x7f21f40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 --2- 172.21.15.7:0/1230683933 >> v2:172.21.15.162:3300/0 conn(0x7f21f40d1fd0 0x7f21f40b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 >> v1:172.21.15.162:6789/0 conn(0x7f21f40d48e0 legacy=0x7f21f40b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f40d4fe0 con 0x7f21f40d27b0 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f21e8001670 con 0x7f21f40d27b0 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 >> v1:172.21.15.7:6789/0 conn(0x7f21f40d27b0 legacy=0x7f21f40d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0039b0 0x7f21dc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0052e0 0x7f21dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21f40d0110 con 0x7f21dc004800 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc00c1e0 con 0x7f21dc0052e0 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21dc00c3e0 con 0x7f21dc0039b0 2024-08-19T00:42:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.861+0000 7f21f3e00640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.862+0000 7f21f3e00640 1 -- 172.21.15.7:0/1230683933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0039b0 msgr2=0x7f21dc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.862+0000 7f21f3e00640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0039b0 0x7f21dc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.862+0000 7f21f3e00640 1 -- 172.21.15.7:0/1230683933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0052e0 msgr2=0x7f21dc00b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.862+0000 7f21f3e00640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0052e0 0x7f21dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.862+0000 7f21f3e00640 1 -- 172.21.15.7:0/1230683933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21dc003520 con 0x7f21dc004800 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.862+0000 7f21f9c00640 1 -- 172.21.15.7:0/1230683933 reap_dead start 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.863+0000 7f21f3e00640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21dc004c80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f21e0001620 tx=0x7f21dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6bbf2319f83fd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.863+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0001220 con 0x7f21dc004800 2024-08-19T00:42:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.863+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e002e070 con 0x7f21dc004800 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.863+0000 7f21f3400640 1 -- 172.21.15.7:0/1230683933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e002a7c0 con 0x7f21dc004800 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.864+0000 7f21fa600640 1 -- 172.21.15.7:0/1230683933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 msgr2=0x7f21dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.864+0000 7f21fa600640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21dc004c80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f21e0001620 tx=0x7f21dc005830 comp rx=0 tx=0).stop 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.864+0000 7f21fa600640 1 -- 172.21.15.7:0/1230683933 shutdown_connections 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.864+0000 7f21fa600640 1 --2- 172.21.15.7:0/1230683933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21dc004c80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.864+0000 7f21fa600640 1 -- 172.21.15.7:0/1230683933 >> 172.21.15.7:0/1230683933 conn(0x7f21f409d510 msgr2=0x7f21f40d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.864+0000 7f21fa600640 1 -- 172.21.15.7:0/1230683933 shutdown_connections 2024-08-19T00:42:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.864+0000 7f21fa600640 1 -- 172.21.15.7:0/1230683933 wait complete. 2024-08-19T00:42:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.865+0000 7f21fa600640 1 Processor -- start 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.866+0000 7f21fa600640 1 -- start start 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.866+0000 7f21fa600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21f40cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.866+0000 7f21fa600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21f41f74e0 0x7f21f41f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.866+0000 7f21fa600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21f40ca0d0 0x7f21f40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21fa600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21f40cfe30 con 0x7f21dc004800 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21fa600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21f40cfb50 con 0x7f21f41f74e0 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21fa600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21f415e550 con 0x7f21f40ca0d0 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21f40cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21f40cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34504/0 (socket says 172.21.15.7:34504) 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 -- 172.21.15.7:0/4062709418 learned_addr learned my addr 172.21.15.7:0/4062709418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f3e00640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21f41f74e0 0x7f21f41f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 -- 172.21.15.7:0/4062709418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21f40ca0d0 msgr2=0x7f21f40ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21f40ca0d0 0x7f21f40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 -- 172.21.15.7:0/4062709418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21f41f74e0 msgr2=0x7f21f41f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21f41f74e0 0x7f21f41f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.867+0000 7f21f9200640 1 -- 172.21.15.7:0/4062709418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f40b9290 con 0x7f21dc004800 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.868+0000 7f21f9200640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21f40cb720 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f21e800c760 tx=0x7f21e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.868+0000 7f21f0c00640 1 -- 172.21.15.7:0/4062709418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8018070 con 0x7f21dc004800 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.868+0000 7f21f0c00640 1 -- 172.21.15.7:0/4062709418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e80074e0 con 0x7f21dc004800 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.868+0000 7f21f0c00640 1 -- 172.21.15.7:0/4062709418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8004a20 con 0x7f21dc004800 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.868+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f40b9570 con 0x7f21dc004800 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.868+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f41f5250 con 0x7f21dc004800 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.869+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f40b9a30 con 0x7f21dc004800 2024-08-19T00:42:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.870+0000 7f21f0c00640 1 -- 172.21.15.7:0/4062709418 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21e8004bc0 con 0x7f21dc004800 2024-08-19T00:42:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.871+0000 7f21f0c00640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21d406be60 0x7f21d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.871+0000 7f21f0c00640 1 -- 172.21.15.7:0/4062709418 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f21e808a480 con 0x7f21dc004800 2024-08-19T00:42:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.871+0000 7f21f3e00640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21d406be60 0x7f21d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.872+0000 7f21f3e00640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21d406be60 0x7f21d406e320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f21e0032000 tx=0x7f21e0005000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:35.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:35.875+0000 7f21f0c00640 1 -- 172.21.15.7:0/4062709418 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f21e8058da0 con 0x7f21dc004800 2024-08-19T00:42:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.056+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21f4075fb0 con 0x7f21d406be60 2024-08-19T00:42:36.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.064+0000 7f21f0c00640 1 -- 172.21.15.7:0/4062709418 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244673 (secure 0 0 0) 0x7f21f4075fb0 con 0x7f21d406be60 2024-08-19T00:42:36.070 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:42:36.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21d406be60 msgr2=0x7f21d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21d406be60 0x7f21d406e320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f21e0032000 tx=0x7f21e0005000 comp rx=0 tx=0).stop 2024-08-19T00:42:36.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 msgr2=0x7f21f40cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21f40cb720 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f21e800c760 tx=0x7f21e800cc20 comp rx=0 tx=0).stop 2024-08-19T00:42:36.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 shutdown_connections 2024-08-19T00:42:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21d406be60 0x7f21d406e320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21f40ca0d0 0x7f21f40ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21f41f74e0 0x7f21f41f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 --2- 172.21.15.7:0/4062709418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc004800 0x7f21f40cb720 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 >> 172.21.15.7:0/4062709418 conn(0x7f21f409d510 msgr2=0x7f21f40b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 shutdown_connections 2024-08-19T00:42:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.068+0000 7f21fa600640 1 -- 172.21.15.7:0/4062709418 wait complete. 2024-08-19T00:42:36.086 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-08-19T00:42:35.335421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":248964,"kb_used_data":7812,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725756,"statfs":{"total":773094113280,"available":772839174144,"internally_reserved":0,"allocated":7999488,"data_stored":4058980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.485334"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869267+0000","last_change":"2024-08-19T00:42:31.884968+0000","last_active":"2024-08-19T00:42:32.869267+0000","last_peered":"2024-08-19T00:42:32.869267+0000","last_clean":"2024-08-19T00:42:32.869267+0000","last_became_active":"2024-08-19T00:42:31.884622+0000","last_became_peered":"2024-08-19T00:42:31.884622+0000","last_unstale":"2024-08-19T00:42:32.869267+0000","last_undegraded":"2024-08-19T00:42:32.869267+0000","last_fullsized":"2024-08-19T00:42:32.869267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:50.077709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871538+0000","last_change":"2024-08-19T00:42:31.895581+0000","last_active":"2024-08-19T00:42:32.871538+0000","last_peered":"2024-08-19T00:42:32.871538+0000","last_clean":"2024-08-19T00:42:32.871538+0000","last_became_active":"2024-08-19T00:42:31.893034+0000","last_became_peered":"2024-08-19T00:42:31.893034+0000","last_unstale":"2024-08-19T00:42:32.871538+0000","last_undegraded":"2024-08-19T00:42:32.871538+0000","last_fullsized":"2024-08-19T00:42:32.871538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872132+0000","last_change":"2024-08-19T00:42:31.889975+0000","last_active":"2024-08-19T00:42:32.872132+0000","last_peered":"2024-08-19T00:42:32.872132+0000","last_clean":"2024-08-19T00:42:32.872132+0000","last_became_active":"2024-08-19T00:42:31.889637+0000","last_became_peered":"2024-08-19T00:42:31.889637+0000","last_unstale":"2024-08-19T00:42:32.872132+0000","last_undegraded":"2024-08-19T00:42:32.872132+0000","last_fullsized":"2024-08-19T00:42:32.872132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:52.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872934+0000","last_change":"2024-08-19T00:42:31.886621+0000","last_active":"2024-08-19T00:42:32.872934+0000","last_peered":"2024-08-19T00:42:32.872934+0000","last_clean":"2024-08-19T00:42:32.872934+0000","last_became_active":"2024-08-19T00:42:31.886367+0000","last_became_peered":"2024-08-19T00:42:31.886367+0000","last_unstale":"2024-08-19T00:42:32.872934+0000","last_undegraded":"2024-08-19T00:42:32.872934+0000","last_fullsized":"2024-08-19T00:42:32.872934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:07.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869305+0000","last_change":"2024-08-19T00:42:31.892500+0000","last_active":"2024-08-19T00:42:32.869305+0000","last_peered":"2024-08-19T00:42:32.869305+0000","last_clean":"2024-08-19T00:42:32.869305+0000","last_became_active":"2024-08-19T00:42:31.892123+0000","last_became_peered":"2024-08-19T00:42:31.892123+0000","last_unstale":"2024-08-19T00:42:32.869305+0000","last_undegraded":"2024-08-19T00:42:32.869305+0000","last_fullsized":"2024-08-19T00:42:32.869305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:29.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871904+0000","last_change":"2024-08-19T00:42:31.889746+0000","last_active":"2024-08-19T00:42:32.871904+0000","last_peered":"2024-08-19T00:42:32.871904+0000","last_clean":"2024-08-19T00:42:32.871904+0000","last_became_active":"2024-08-19T00:42:31.889449+0000","last_became_peered":"2024-08-19T00:42:31.889449+0000","last_unstale":"2024-08-19T00:42:32.871904+0000","last_undegraded":"2024-08-19T00:42:32.871904+0000","last_fullsized":"2024-08-19T00:42:32.871904+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:37.985664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872176+0000","last_change":"2024-08-19T00:42:31.879729+0000","last_active":"2024-08-19T00:42:32.872176+0000","last_peered":"2024-08-19T00:42:32.872176+0000","last_clean":"2024-08-19T00:42:32.872176+0000","last_became_active":"2024-08-19T00:42:31.878400+0000","last_became_peered":"2024-08-19T00:42:31.878400+0000","last_unstale":"2024-08-19T00:42:32.872176+0000","last_undegraded":"2024-08-19T00:42:32.872176+0000","last_fullsized":"2024-08-19T00:42:32.872176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:32.583705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872917+0000","last_change":"2024-08-19T00:42:31.880675+0000","last_active":"2024-08-19T00:42:32.872917+0000","last_peered":"2024-08-19T00:42:32.872917+0000","last_clean":"2024-08-19T00:42:32.872917+0000","last_became_active":"2024-08-19T00:42:31.880274+0000","last_became_peered":"2024-08-19T00:42:31.880274+0000","last_unstale":"2024-08-19T00:42:32.872917+0000","last_undegraded":"2024-08-19T00:42:32.872917+0000","last_fullsized":"2024-08-19T00:42:32.872917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:54.995370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869520+0000","last_change":"2024-08-19T00:42:31.897877+0000","last_active":"2024-08-19T00:42:32.869520+0000","last_peered":"2024-08-19T00:42:32.869520+0000","last_clean":"2024-08-19T00:42:32.869520+0000","last_became_active":"2024-08-19T00:42:31.895922+0000","last_became_peered":"2024-08-19T00:42:31.895922+0000","last_unstale":"2024-08-19T00:42:32.869520+0000","last_undegraded":"2024-08-19T00:42:32.869520+0000","last_fullsized":"2024-08-19T00:42:32.869520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868929+0000","last_change":"2024-08-19T00:42:31.896289+0000","last_active":"2024-08-19T00:42:32.868929+0000","last_peered":"2024-08-19T00:42:32.868929+0000","last_clean":"2024-08-19T00:42:32.868929+0000","last_became_active":"2024-08-19T00:42:31.896025+0000","last_became_peered":"2024-08-19T00:42:31.896025+0000","last_unstale":"2024-08-19T00:42:32.868929+0000","last_undegraded":"2024-08-19T00:42:32.868929+0000","last_fullsized":"2024-08-19T00:42:32.868929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:29.342491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868945+0000","last_change":"2024-08-19T00:42:31.896076+0000","last_active":"2024-08-19T00:42:32.868945+0000","last_peered":"2024-08-19T00:42:32.868945+0000","last_clean":"2024-08-19T00:42:32.868945+0000","last_became_active":"2024-08-19T00:42:31.895763+0000","last_became_peered":"2024-08-19T00:42:31.895763+0000","last_unstale":"2024-08-19T00:42:32.868945+0000","last_undegraded":"2024-08-19T00:42:32.868945+0000","last_fullsized":"2024-08-19T00:42:32.868945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:27.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872076+0000","last_change":"2024-08-19T00:42:30.876351+0000","last_active":"2024-08-19T00:42:32.872076+0000","last_peered":"2024-08-19T00:42:32.872076+0000","last_clean":"2024-08-19T00:42:32.872076+0000","last_became_active":"2024-08-19T00:42:30.875237+0000","last_became_peered":"2024-08-19T00:42:30.875237+0000","last_unstale":"2024-08-19T00:42:32.872076+0000","last_undegraded":"2024-08-19T00:42:32.872076+0000","last_fullsized":"2024-08-19T00:42:32.872076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:28.336385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852730+0000","last_change":"2024-08-19T00:42:29.852730+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852730+0000","last_undegraded":"2024-08-19T00:42:29.852730+0000","last_fullsized":"2024-08-19T00:42:29.852730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871886+0000","last_change":"2024-08-19T00:42:31.894145+0000","last_active":"2024-08-19T00:42:32.871886+0000","last_peered":"2024-08-19T00:42:32.871886+0000","last_clean":"2024-08-19T00:42:32.871886+0000","last_became_active":"2024-08-19T00:42:31.893868+0000","last_became_peered":"2024-08-19T00:42:31.893868+0000","last_unstale":"2024-08-19T00:42:32.871886+0000","last_undegraded":"2024-08-19T00:42:32.871886+0000","last_fullsized":"2024-08-19T00:42:32.871886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:13.096377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.859991+0000","last_change":"2024-08-19T00:42:29.859991+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.859991+0000","last_undegraded":"2024-08-19T00:42:29.859991+0000","last_fullsized":"2024-08-19T00:42:29.859991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872671+0000","last_change":"2024-08-19T00:42:31.888776+0000","last_active":"2024-08-19T00:42:32.872671+0000","last_peered":"2024-08-19T00:42:32.872671+0000","last_clean":"2024-08-19T00:42:32.872671+0000","last_became_active":"2024-08-19T00:42:31.888495+0000","last_became_peered":"2024-08-19T00:42:31.888495+0000","last_unstale":"2024-08-19T00:42:32.872671+0000","last_undegraded":"2024-08-19T00:42:32.872671+0000","last_fullsized":"2024-08-19T00:42:32.872671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:30.401352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871890+0000","last_change":"2024-08-19T00:42:30.878407+0000","last_active":"2024-08-19T00:42:32.871890+0000","last_peered":"2024-08-19T00:42:32.871890+0000","last_clean":"2024-08-19T00:42:32.871890+0000","last_became_active":"2024-08-19T00:42:30.876759+0000","last_became_peered":"2024-08-19T00:42:30.876759+0000","last_unstale":"2024-08-19T00:42:32.871890+0000","last_undegraded":"2024-08-19T00:42:32.871890+0000","last_fullsized":"2024-08-19T00:42:32.871890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:10.187178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857870+0000","last_change":"2024-08-19T00:42:29.857870+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857870+0000","last_undegraded":"2024-08-19T00:42:29.857870+0000","last_fullsized":"2024-08-19T00:42:29.857870+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871643+0000","last_change":"2024-08-19T00:42:31.892760+0000","last_active":"2024-08-19T00:42:32.871643+0000","last_peered":"2024-08-19T00:42:32.871643+0000","last_clean":"2024-08-19T00:42:32.871643+0000","last_became_active":"2024-08-19T00:42:31.892474+0000","last_became_peered":"2024-08-19T00:42:31.892474+0000","last_unstale":"2024-08-19T00:42:32.871643+0000","last_undegraded":"2024-08-19T00:42:32.871643+0000","last_fullsized":"2024-08-19T00:42:32.871643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:33.985970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872250+0000","last_change":"2024-08-19T00:42:30.875439+0000","last_active":"2024-08-19T00:42:32.872250+0000","last_peered":"2024-08-19T00:42:32.872250+0000","last_clean":"2024-08-19T00:42:32.872250+0000","last_became_active":"2024-08-19T00:42:30.875169+0000","last_became_peered":"2024-08-19T00:42:30.875169+0000","last_unstale":"2024-08-19T00:42:32.872250+0000","last_undegraded":"2024-08-19T00:42:32.872250+0000","last_fullsized":"2024-08-19T00:42:32.872250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:16:55.713900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860331+0000","last_change":"2024-08-19T00:42:29.860331+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860331+0000","last_undegraded":"2024-08-19T00:42:29.860331+0000","last_fullsized":"2024-08-19T00:42:29.860331+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857222+0000","last_change":"2024-08-19T00:42:29.857222+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857222+0000","last_undegraded":"2024-08-19T00:42:29.857222+0000","last_fullsized":"2024-08-19T00:42:29.857222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872985+0000","last_change":"2024-08-19T00:42:31.878514+0000","last_active":"2024-08-19T00:42:32.872985+0000","last_peered":"2024-08-19T00:42:32.872985+0000","last_clean":"2024-08-19T00:42:32.872985+0000","last_became_active":"2024-08-19T00:42:31.878252+0000","last_became_peered":"2024-08-19T00:42:31.878252+0000","last_unstale":"2024-08-19T00:42:32.872985+0000","last_undegraded":"2024-08-19T00:42:32.872985+0000","last_fullsized":"2024-08-19T00:42:32.872985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:38.562669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.861460+0000","last_change":"2024-08-19T00:42:29.861460+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.861460+0000","last_undegraded":"2024-08-19T00:42:29.861460+0000","last_fullsized":"2024-08-19T00:42:29.861460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869300+0000","last_change":"2024-08-19T00:42:31.883957+0000","last_active":"2024-08-19T00:42:32.869300+0000","last_peered":"2024-08-19T00:42:32.869300+0000","last_clean":"2024-08-19T00:42:32.869300+0000","last_became_active":"2024-08-19T00:42:31.883574+0000","last_became_peered":"2024-08-19T00:42:31.883574+0000","last_unstale":"2024-08-19T00:42:32.869300+0000","last_undegraded":"2024-08-19T00:42:32.869300+0000","last_fullsized":"2024-08-19T00:42:32.869300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:39.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869319+0000","last_change":"2024-08-19T00:42:30.880554+0000","last_active":"2024-08-19T00:42:32.869319+0000","last_peered":"2024-08-19T00:42:32.869319+0000","last_clean":"2024-08-19T00:42:32.869319+0000","last_became_active":"2024-08-19T00:42:30.880233+0000","last_became_peered":"2024-08-19T00:42:30.880233+0000","last_unstale":"2024-08-19T00:42:32.869319+0000","last_undegraded":"2024-08-19T00:42:32.869319+0000","last_fullsized":"2024-08-19T00:42:32.869319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:06.057201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857972+0000","last_change":"2024-08-19T00:42:29.857972+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857972+0000","last_undegraded":"2024-08-19T00:42:29.857972+0000","last_fullsized":"2024-08-19T00:42:29.857972+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860343+0000","last_change":"2024-08-19T00:42:29.860343+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860343+0000","last_undegraded":"2024-08-19T00:42:29.860343+0000","last_fullsized":"2024-08-19T00:42:29.860343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871719+0000","last_change":"2024-08-19T00:42:31.893631+0000","last_active":"2024-08-19T00:42:32.871719+0000","last_peered":"2024-08-19T00:42:32.871719+0000","last_clean":"2024-08-19T00:42:32.871719+0000","last_became_active":"2024-08-19T00:42:31.892641+0000","last_became_peered":"2024-08-19T00:42:31.892641+0000","last_unstale":"2024-08-19T00:42:32.871719+0000","last_undegraded":"2024-08-19T00:42:32.871719+0000","last_fullsized":"2024-08-19T00:42:32.871719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:41.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860507+0000","last_change":"2024-08-19T00:42:29.860507+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860507+0000","last_undegraded":"2024-08-19T00:42:29.860507+0000","last_fullsized":"2024-08-19T00:42:29.860507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872374+0000","last_change":"2024-08-19T00:42:31.889060+0000","last_active":"2024-08-19T00:42:32.872374+0000","last_peered":"2024-08-19T00:42:32.872374+0000","last_clean":"2024-08-19T00:42:32.872374+0000","last_became_active":"2024-08-19T00:42:31.888413+0000","last_became_peered":"2024-08-19T00:42:31.888413+0000","last_unstale":"2024-08-19T00:42:32.872374+0000","last_undegraded":"2024-08-19T00:42:32.872374+0000","last_fullsized":"2024-08-19T00:42:32.872374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:31:34.849158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872299+0000","last_change":"2024-08-19T00:42:30.875349+0000","last_active":"2024-08-19T00:42:32.872299+0000","last_peered":"2024-08-19T00:42:32.872299+0000","last_clean":"2024-08-19T00:42:32.872299+0000","last_became_active":"2024-08-19T00:42:30.875068+0000","last_became_peered":"2024-08-19T00:42:30.875068+0000","last_unstale":"2024-08-19T00:42:32.872299+0000","last_undegraded":"2024-08-19T00:42:32.872299+0000","last_fullsized":"2024-08-19T00:42:32.872299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:49.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872178+0000","last_change":"2024-08-19T00:42:30.878500+0000","last_active":"2024-08-19T00:42:32.872178+0000","last_peered":"2024-08-19T00:42:32.872178+0000","last_clean":"2024-08-19T00:42:32.872178+0000","last_became_active":"2024-08-19T00:42:30.877428+0000","last_became_peered":"2024-08-19T00:42:30.877428+0000","last_unstale":"2024-08-19T00:42:32.872178+0000","last_undegraded":"2024-08-19T00:42:32.872178+0000","last_fullsized":"2024-08-19T00:42:32.872178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:28:58.973103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871831+0000","last_change":"2024-08-19T00:42:30.881547+0000","last_active":"2024-08-19T00:42:32.871831+0000","last_peered":"2024-08-19T00:42:32.871831+0000","last_clean":"2024-08-19T00:42:32.871831+0000","last_became_active":"2024-08-19T00:42:30.881265+0000","last_became_peered":"2024-08-19T00:42:30.881265+0000","last_unstale":"2024-08-19T00:42:32.871831+0000","last_undegraded":"2024-08-19T00:42:32.871831+0000","last_fullsized":"2024-08-19T00:42:32.871831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:57:16.076383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869329+0000","last_change":"2024-08-19T00:42:31.887426+0000","last_active":"2024-08-19T00:42:32.869329+0000","last_peered":"2024-08-19T00:42:32.869329+0000","last_clean":"2024-08-19T00:42:32.869329+0000","last_became_active":"2024-08-19T00:42:31.887148+0000","last_became_peered":"2024-08-19T00:42:31.887148+0000","last_unstale":"2024-08-19T00:42:32.869329+0000","last_undegraded":"2024-08-19T00:42:32.869329+0000","last_fullsized":"2024-08-19T00:42:32.869329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:44.470150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.861066+0000","last_change":"2024-08-19T00:42:29.861066+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.861066+0000","last_undegraded":"2024-08-19T00:42:29.861066+0000","last_fullsized":"2024-08-19T00:42:29.861066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869395+0000","last_change":"2024-08-19T00:42:31.876897+0000","last_active":"2024-08-19T00:42:32.869395+0000","last_peered":"2024-08-19T00:42:32.869395+0000","last_clean":"2024-08-19T00:42:32.869395+0000","last_became_active":"2024-08-19T00:42:31.876636+0000","last_became_peered":"2024-08-19T00:42:31.876636+0000","last_unstale":"2024-08-19T00:42:32.869395+0000","last_undegraded":"2024-08-19T00:42:32.869395+0000","last_fullsized":"2024-08-19T00:42:32.869395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:17.571252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869378+0000","last_change":"2024-08-19T00:42:30.878637+0000","last_active":"2024-08-19T00:42:32.869378+0000","last_peered":"2024-08-19T00:42:32.869378+0000","last_clean":"2024-08-19T00:42:32.869378+0000","last_became_active":"2024-08-19T00:42:30.878243+0000","last_became_peered":"2024-08-19T00:42:30.878243+0000","last_unstale":"2024-08-19T00:42:32.869378+0000","last_undegraded":"2024-08-19T00:42:32.869378+0000","last_fullsized":"2024-08-19T00:42:32.869378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:37.556563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869046+0000","last_change":"2024-08-19T00:42:30.881753+0000","last_active":"2024-08-19T00:42:32.869046+0000","last_peered":"2024-08-19T00:42:32.869046+0000","last_clean":"2024-08-19T00:42:32.869046+0000","last_became_active":"2024-08-19T00:42:30.881466+0000","last_became_peered":"2024-08-19T00:42:30.881466+0000","last_unstale":"2024-08-19T00:42:32.869046+0000","last_undegraded":"2024-08-19T00:42:32.869046+0000","last_fullsized":"2024-08-19T00:42:32.869046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:37.954772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871934+0000","last_change":"2024-08-19T00:42:30.866089+0000","last_active":"2024-08-19T00:42:32.871934+0000","last_peered":"2024-08-19T00:42:32.871934+0000","last_clean":"2024-08-19T00:42:32.871934+0000","last_became_active":"2024-08-19T00:42:30.865832+0000","last_became_peered":"2024-08-19T00:42:30.865832+0000","last_unstale":"2024-08-19T00:42:32.871934+0000","last_undegraded":"2024-08-19T00:42:32.871934+0000","last_fullsized":"2024-08-19T00:42:32.871934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:31.060235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871783+0000","last_change":"2024-08-19T00:42:30.873159+0000","last_active":"2024-08-19T00:42:32.871783+0000","last_peered":"2024-08-19T00:42:32.871783+0000","last_clean":"2024-08-19T00:42:32.871783+0000","last_became_active":"2024-08-19T00:42:30.872850+0000","last_became_peered":"2024-08-19T00:42:30.872850+0000","last_unstale":"2024-08-19T00:42:32.871783+0000","last_undegraded":"2024-08-19T00:42:32.871783+0000","last_fullsized":"2024-08-19T00:42:32.871783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:26.723998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869000+0000","last_change":"2024-08-19T00:42:30.878991+0000","last_active":"2024-08-19T00:42:32.869000+0000","last_peered":"2024-08-19T00:42:32.869000+0000","last_clean":"2024-08-19T00:42:32.869000+0000","last_became_active":"2024-08-19T00:42:30.878693+0000","last_became_peered":"2024-08-19T00:42:30.878693+0000","last_unstale":"2024-08-19T00:42:32.869000+0000","last_undegraded":"2024-08-19T00:42:32.869000+0000","last_fullsized":"2024-08-19T00:42:32.869000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:12.874080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852736+0000","last_change":"2024-08-19T00:42:29.852736+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852736+0000","last_undegraded":"2024-08-19T00:42:29.852736+0000","last_fullsized":"2024-08-19T00:42:29.852736+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860616+0000","last_change":"2024-08-19T00:42:29.860616+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860616+0000","last_undegraded":"2024-08-19T00:42:29.860616+0000","last_fullsized":"2024-08-19T00:42:29.860616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872982+0000","last_change":"2024-08-19T00:42:31.891953+0000","last_active":"2024-08-19T00:42:32.872982+0000","last_peered":"2024-08-19T00:42:32.872982+0000","last_clean":"2024-08-19T00:42:32.872982+0000","last_became_active":"2024-08-19T00:42:31.891707+0000","last_became_peered":"2024-08-19T00:42:31.891707+0000","last_unstale":"2024-08-19T00:42:32.872982+0000","last_undegraded":"2024-08-19T00:42:32.872982+0000","last_fullsized":"2024-08-19T00:42:32.872982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:38.960878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860191+0000","last_change":"2024-08-19T00:42:29.860191+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860191+0000","last_undegraded":"2024-08-19T00:42:29.860191+0000","last_fullsized":"2024-08-19T00:42:29.860191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869524+0000","last_change":"2024-08-19T00:42:31.887602+0000","last_active":"2024-08-19T00:42:32.869524+0000","last_peered":"2024-08-19T00:42:32.869524+0000","last_clean":"2024-08-19T00:42:32.869524+0000","last_became_active":"2024-08-19T00:42:31.887337+0000","last_became_peered":"2024-08-19T00:42:31.887337+0000","last_unstale":"2024-08-19T00:42:32.869524+0000","last_undegraded":"2024-08-19T00:42:32.869524+0000","last_fullsized":"2024-08-19T00:42:32.869524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:19.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857489+0000","last_change":"2024-08-19T00:42:29.857489+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857489+0000","last_undegraded":"2024-08-19T00:42:29.857489+0000","last_fullsized":"2024-08-19T00:42:29.857489+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872699+0000","last_change":"2024-08-19T00:42:31.883349+0000","last_active":"2024-08-19T00:42:32.872699+0000","last_peered":"2024-08-19T00:42:32.872699+0000","last_clean":"2024-08-19T00:42:32.872699+0000","last_became_active":"2024-08-19T00:42:31.883056+0000","last_became_peered":"2024-08-19T00:42:31.883056+0000","last_unstale":"2024-08-19T00:42:32.872699+0000","last_undegraded":"2024-08-19T00:42:32.872699+0000","last_fullsized":"2024-08-19T00:42:32.872699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:13.880186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857460+0000","last_change":"2024-08-19T00:42:29.857460+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857460+0000","last_undegraded":"2024-08-19T00:42:29.857460+0000","last_fullsized":"2024-08-19T00:42:29.857460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857377+0000","last_change":"2024-08-19T00:42:29.857377+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857377+0000","last_undegraded":"2024-08-19T00:42:29.857377+0000","last_fullsized":"2024-08-19T00:42:29.857377+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852738+0000","last_change":"2024-08-19T00:42:29.852738+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852738+0000","last_undegraded":"2024-08-19T00:42:29.852738+0000","last_fullsized":"2024-08-19T00:42:29.852738+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869225+0000","last_change":"2024-08-19T00:42:30.884148+0000","last_active":"2024-08-19T00:42:32.869225+0000","last_peered":"2024-08-19T00:42:32.869225+0000","last_clean":"2024-08-19T00:42:32.869225+0000","last_became_active":"2024-08-19T00:42:30.883741+0000","last_became_peered":"2024-08-19T00:42:30.883741+0000","last_unstale":"2024-08-19T00:42:32.869225+0000","last_undegraded":"2024-08-19T00:42:32.869225+0000","last_fullsized":"2024-08-19T00:42:32.869225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:53.989264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868881+0000","last_change":"2024-08-19T00:42:31.885879+0000","last_active":"2024-08-19T00:42:32.868881+0000","last_peered":"2024-08-19T00:42:32.868881+0000","last_clean":"2024-08-19T00:42:32.868881+0000","last_became_active":"2024-08-19T00:42:31.884773+0000","last_became_peered":"2024-08-19T00:42:31.884773+0000","last_unstale":"2024-08-19T00:42:32.868881+0000","last_undegraded":"2024-08-19T00:42:32.868881+0000","last_fullsized":"2024-08-19T00:42:32.868881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:32.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871394+0000","last_change":"2024-08-19T00:42:30.875606+0000","last_active":"2024-08-19T00:42:32.871394+0000","last_peered":"2024-08-19T00:42:32.871394+0000","last_clean":"2024-08-19T00:42:32.871394+0000","last_became_active":"2024-08-19T00:42:30.875023+0000","last_became_peered":"2024-08-19T00:42:30.875023+0000","last_unstale":"2024-08-19T00:42:32.871394+0000","last_undegraded":"2024-08-19T00:42:32.871394+0000","last_fullsized":"2024-08-19T00:42:32.871394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:20.569518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872371+0000","last_change":"2024-08-19T00:42:30.877958+0000","last_active":"2024-08-19T00:42:32.872371+0000","last_peered":"2024-08-19T00:42:32.872371+0000","last_clean":"2024-08-19T00:42:32.872371+0000","last_became_active":"2024-08-19T00:42:30.877702+0000","last_became_peered":"2024-08-19T00:42:30.877702+0000","last_unstale":"2024-08-19T00:42:32.872371+0000","last_undegraded":"2024-08-19T00:42:32.872371+0000","last_fullsized":"2024-08-19T00:42:32.872371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:37.610265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871881+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:42:32.871881+0000","last_peered":"2024-08-19T00:42:32.871881+0000","last_clean":"2024-08-19T00:42:32.871881+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:42:32.871881+0000","last_undegraded":"2024-08-19T00:42:32.871881+0000","last_fullsized":"2024-08-19T00:42:32.871881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":938451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":963610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":373312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:42:36.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:42:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.280+0000 7f3926800640 1 Processor -- start 2024-08-19T00:42:36.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.280+0000 7f3926800640 1 -- start start 2024-08-19T00:42:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.281+0000 7f3926800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e2c0 0x7f39200d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.281+0000 7f3926800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39200b4340 con 0x7f39200d3f90 2024-08-19T00:42:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.281+0000 7f3926800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39200b4620 con 0x7f392015e6a0 2024-08-19T00:42:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.281+0000 7f3926800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39200d3320 con 0x7f392015e2c0 2024-08-19T00:42:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.281+0000 7f3925e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f39200d3f90 0x7f39200d4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44806/0 (socket says 172.21.15.7:44806) 2024-08-19T00:42:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.281+0000 7f3925e00640 1 -- 172.21.15.7:0/2536602071 learned_addr learned my addr 172.21.15.7:0/2536602071 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f3925400640 1 --2- 172.21.15.7:0/2536602071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e2c0 0x7f39200d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f391fe00640 1 -- 172.21.15.7:0/2536602071 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932683911 0 0) 0x7f39200b4340 con 0x7f39200d3f90 2024-08-19T00:42:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f391fe00640 1 -- 172.21.15.7:0/2536602071 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3908003520 con 0x7f39200d3f90 2024-08-19T00:42:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f391fe00640 1 -- 172.21.15.7:0/2536602071 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477884197 0 0) 0x7f39200b4620 con 0x7f392015e6a0 2024-08-19T00:42:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f391fe00640 1 -- 172.21.15.7:0/2536602071 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39200b4340 con 0x7f392015e6a0 2024-08-19T00:42:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f3925400640 1 -- 172.21.15.7:0/2536602071 >> v1:172.21.15.162:6789/0 conn(0x7f392015e6a0 legacy=0x7f39200b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f3925400640 1 -- 172.21.15.7:0/2536602071 >> v1:172.21.15.7:6789/0 conn(0x7f39200d3f90 legacy=0x7f39200d4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.282+0000 7f3925400640 1 -- 172.21.15.7:0/2536602071 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200b4900 con 0x7f392015e2c0 2024-08-19T00:42:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.283+0000 7f3925400640 1 --2- 172.21.15.7:0/2536602071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e2c0 0x7f39200d2de0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39140097d0 tx=0x7f391402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fac8b35931e58c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f391fe00640 1 -- 172.21.15.7:0/2536602071 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914037070 con 0x7f392015e2c0 2024-08-19T00:42:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f391fe00640 1 -- 172.21.15.7:0/2536602071 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3914032440 con 0x7f392015e2c0 2024-08-19T00:42:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f391fe00640 1 -- 172.21.15.7:0/2536602071 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914032810 con 0x7f392015e2c0 2024-08-19T00:42:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f3926800640 1 -- 172.21.15.7:0/2536602071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e2c0 msgr2=0x7f39200d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f3926800640 1 --2- 172.21.15.7:0/2536602071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e2c0 0x7f39200d2de0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39140097d0 tx=0x7f391402a200 comp rx=0 tx=0).stop 2024-08-19T00:42:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f3926800640 1 -- 172.21.15.7:0/2536602071 shutdown_connections 2024-08-19T00:42:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f3926800640 1 --2- 172.21.15.7:0/2536602071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e2c0 0x7f39200d2de0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f3926800640 1 -- 172.21.15.7:0/2536602071 >> 172.21.15.7:0/2536602071 conn(0x7f392008dbe0 msgr2=0x7f392009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f3926800640 1 -- 172.21.15.7:0/2536602071 shutdown_connections 2024-08-19T00:42:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.284+0000 7f3926800640 1 -- 172.21.15.7:0/2536602071 wait complete. 2024-08-19T00:42:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.286+0000 7f3926800640 1 Processor -- start 2024-08-19T00:42:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.286+0000 7f3926800640 1 -- start start 2024-08-19T00:42:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3926800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39200d3f90 0x7f39200b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3926800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392015e2c0 0x7f392014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3926800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e6a0 0x7f392014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3926800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39200cff70 con 0x7f392015e2c0 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3926800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39200cfdf0 con 0x7f39200d3f90 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3926800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39200d00f0 con 0x7f392015e6a0 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3924a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392015e2c0 0x7f392014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3924a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392015e2c0 0x7f392014c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34508/0 (socket says 172.21.15.7:34508) 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.287+0000 7f3924a00640 1 -- 172.21.15.7:0/1872020740 learned_addr learned my addr 172.21.15.7:0/1872020740 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3925400640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39200d3f90 0x7f39200b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3925e00640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e6a0 0x7f392014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3924a00640 1 -- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e6a0 msgr2=0x7f392014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3924a00640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e6a0 0x7f392014c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3924a00640 1 -- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39200d3f90 msgr2=0x7f39200b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3924a00640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39200d3f90 0x7f39200b83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3924a00640 1 -- 172.21.15.7:0/1872020740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392014cf00 con 0x7f392015e2c0 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3925400640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39200d3f90 0x7f39200b83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3924a00640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392015e2c0 0x7f392014c480 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f390c00c3c0 tx=0x7f390c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f391d600640 1 -- 172.21.15.7:0/1872020740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c017070 con 0x7f392015e2c0 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f391d600640 1 -- 172.21.15.7:0/1872020740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c0052f0 con 0x7f392015e2c0 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39200b95f0 con 0x7f392015e2c0 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f391d600640 1 -- 172.21.15.7:0/1872020740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c003830 con 0x7f392015e2c0 2024-08-19T00:42:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.288+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39200b7bb0 con 0x7f392015e2c0 2024-08-19T00:42:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.289+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39200d2de0 con 0x7f392015e2c0 2024-08-19T00:42:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.290+0000 7f391d600640 1 -- 172.21.15.7:0/1872020740 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f390c01a070 con 0x7f392015e2c0 2024-08-19T00:42:36.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.292+0000 7f391d600640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.292+0000 7f391d600640 1 -- 172.21.15.7:0/1872020740 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f390c08a1d0 con 0x7f392015e2c0 2024-08-19T00:42:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.292+0000 7f3925400640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.293+0000 7f3925400640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390006be30 0x7f390006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3914034000 tx=0x7f391402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:36.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.296+0000 7f391d600640 1 -- 172.21.15.7:0/1872020740 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f390c058b70 con 0x7f392015e2c0 2024-08-19T00:42:36.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.478+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39201572d0 con 0x7f390006be30 2024-08-19T00:42:36.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.484+0000 7f391d600640 1 -- 172.21.15.7:0/1872020740 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244673 (secure 0 0 0) 0x7f39201572d0 con 0x7f390006be30 2024-08-19T00:42:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:42:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390006be30 msgr2=0x7f390006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390006be30 0x7f390006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3914034000 tx=0x7f391402e000 comp rx=0 tx=0).stop 2024-08-19T00:42:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392015e2c0 msgr2=0x7f392014c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392015e2c0 0x7f392014c480 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f390c00c3c0 tx=0x7f390c00c880 comp rx=0 tx=0).stop 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 shutdown_connections 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392015e6a0 0x7f392014c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392015e2c0 0x7f392014c480 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 --2- 172.21.15.7:0/1872020740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39200d3f90 0x7f39200b83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 >> 172.21.15.7:0/1872020740 conn(0x7f392008dbe0 msgr2=0x7f392006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 shutdown_connections 2024-08-19T00:42:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.488+0000 7f3926800640 1 -- 172.21.15.7:0/1872020740 wait complete. 2024-08-19T00:42:36.506 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-08-19T00:42:35.335421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":248964,"kb_used_data":7812,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725756,"statfs":{"total":773094113280,"available":772839174144,"internally_reserved":0,"allocated":7999488,"data_stored":4058980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.485334"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869267+0000","last_change":"2024-08-19T00:42:31.884968+0000","last_active":"2024-08-19T00:42:32.869267+0000","last_peered":"2024-08-19T00:42:32.869267+0000","last_clean":"2024-08-19T00:42:32.869267+0000","last_became_active":"2024-08-19T00:42:31.884622+0000","last_became_peered":"2024-08-19T00:42:31.884622+0000","last_unstale":"2024-08-19T00:42:32.869267+0000","last_undegraded":"2024-08-19T00:42:32.869267+0000","last_fullsized":"2024-08-19T00:42:32.869267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:50.077709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871538+0000","last_change":"2024-08-19T00:42:31.895581+0000","last_active":"2024-08-19T00:42:32.871538+0000","last_peered":"2024-08-19T00:42:32.871538+0000","last_clean":"2024-08-19T00:42:32.871538+0000","last_became_active":"2024-08-19T00:42:31.893034+0000","last_became_peered":"2024-08-19T00:42:31.893034+0000","last_unstale":"2024-08-19T00:42:32.871538+0000","last_undegraded":"2024-08-19T00:42:32.871538+0000","last_fullsized":"2024-08-19T00:42:32.871538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872132+0000","last_change":"2024-08-19T00:42:31.889975+0000","last_active":"2024-08-19T00:42:32.872132+0000","last_peered":"2024-08-19T00:42:32.872132+0000","last_clean":"2024-08-19T00:42:32.872132+0000","last_became_active":"2024-08-19T00:42:31.889637+0000","last_became_peered":"2024-08-19T00:42:31.889637+0000","last_unstale":"2024-08-19T00:42:32.872132+0000","last_undegraded":"2024-08-19T00:42:32.872132+0000","last_fullsized":"2024-08-19T00:42:32.872132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:52.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872934+0000","last_change":"2024-08-19T00:42:31.886621+0000","last_active":"2024-08-19T00:42:32.872934+0000","last_peered":"2024-08-19T00:42:32.872934+0000","last_clean":"2024-08-19T00:42:32.872934+0000","last_became_active":"2024-08-19T00:42:31.886367+0000","last_became_peered":"2024-08-19T00:42:31.886367+0000","last_unstale":"2024-08-19T00:42:32.872934+0000","last_undegraded":"2024-08-19T00:42:32.872934+0000","last_fullsized":"2024-08-19T00:42:32.872934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:07.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869305+0000","last_change":"2024-08-19T00:42:31.892500+0000","last_active":"2024-08-19T00:42:32.869305+0000","last_peered":"2024-08-19T00:42:32.869305+0000","last_clean":"2024-08-19T00:42:32.869305+0000","last_became_active":"2024-08-19T00:42:31.892123+0000","last_became_peered":"2024-08-19T00:42:31.892123+0000","last_unstale":"2024-08-19T00:42:32.869305+0000","last_undegraded":"2024-08-19T00:42:32.869305+0000","last_fullsized":"2024-08-19T00:42:32.869305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:29.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871904+0000","last_change":"2024-08-19T00:42:31.889746+0000","last_active":"2024-08-19T00:42:32.871904+0000","last_peered":"2024-08-19T00:42:32.871904+0000","last_clean":"2024-08-19T00:42:32.871904+0000","last_became_active":"2024-08-19T00:42:31.889449+0000","last_became_peered":"2024-08-19T00:42:31.889449+0000","last_unstale":"2024-08-19T00:42:32.871904+0000","last_undegraded":"2024-08-19T00:42:32.871904+0000","last_fullsized":"2024-08-19T00:42:32.871904+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:37.985664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872176+0000","last_change":"2024-08-19T00:42:31.879729+0000","last_active":"2024-08-19T00:42:32.872176+0000","last_peered":"2024-08-19T00:42:32.872176+0000","last_clean":"2024-08-19T00:42:32.872176+0000","last_became_active":"2024-08-19T00:42:31.878400+0000","last_became_peered":"2024-08-19T00:42:31.878400+0000","last_unstale":"2024-08-19T00:42:32.872176+0000","last_undegraded":"2024-08-19T00:42:32.872176+0000","last_fullsized":"2024-08-19T00:42:32.872176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:32.583705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872917+0000","last_change":"2024-08-19T00:42:31.880675+0000","last_active":"2024-08-19T00:42:32.872917+0000","last_peered":"2024-08-19T00:42:32.872917+0000","last_clean":"2024-08-19T00:42:32.872917+0000","last_became_active":"2024-08-19T00:42:31.880274+0000","last_became_peered":"2024-08-19T00:42:31.880274+0000","last_unstale":"2024-08-19T00:42:32.872917+0000","last_undegraded":"2024-08-19T00:42:32.872917+0000","last_fullsized":"2024-08-19T00:42:32.872917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:54.995370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869520+0000","last_change":"2024-08-19T00:42:31.897877+0000","last_active":"2024-08-19T00:42:32.869520+0000","last_peered":"2024-08-19T00:42:32.869520+0000","last_clean":"2024-08-19T00:42:32.869520+0000","last_became_active":"2024-08-19T00:42:31.895922+0000","last_became_peered":"2024-08-19T00:42:31.895922+0000","last_unstale":"2024-08-19T00:42:32.869520+0000","last_undegraded":"2024-08-19T00:42:32.869520+0000","last_fullsized":"2024-08-19T00:42:32.869520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868929+0000","last_change":"2024-08-19T00:42:31.896289+0000","last_active":"2024-08-19T00:42:32.868929+0000","last_peered":"2024-08-19T00:42:32.868929+0000","last_clean":"2024-08-19T00:42:32.868929+0000","last_became_active":"2024-08-19T00:42:31.896025+0000","last_became_peered":"2024-08-19T00:42:31.896025+0000","last_unstale":"2024-08-19T00:42:32.868929+0000","last_undegraded":"2024-08-19T00:42:32.868929+0000","last_fullsized":"2024-08-19T00:42:32.868929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:29.342491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868945+0000","last_change":"2024-08-19T00:42:31.896076+0000","last_active":"2024-08-19T00:42:32.868945+0000","last_peered":"2024-08-19T00:42:32.868945+0000","last_clean":"2024-08-19T00:42:32.868945+0000","last_became_active":"2024-08-19T00:42:31.895763+0000","last_became_peered":"2024-08-19T00:42:31.895763+0000","last_unstale":"2024-08-19T00:42:32.868945+0000","last_undegraded":"2024-08-19T00:42:32.868945+0000","last_fullsized":"2024-08-19T00:42:32.868945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:27.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872076+0000","last_change":"2024-08-19T00:42:30.876351+0000","last_active":"2024-08-19T00:42:32.872076+0000","last_peered":"2024-08-19T00:42:32.872076+0000","last_clean":"2024-08-19T00:42:32.872076+0000","last_became_active":"2024-08-19T00:42:30.875237+0000","last_became_peered":"2024-08-19T00:42:30.875237+0000","last_unstale":"2024-08-19T00:42:32.872076+0000","last_undegraded":"2024-08-19T00:42:32.872076+0000","last_fullsized":"2024-08-19T00:42:32.872076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:28.336385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852730+0000","last_change":"2024-08-19T00:42:29.852730+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852730+0000","last_undegraded":"2024-08-19T00:42:29.852730+0000","last_fullsized":"2024-08-19T00:42:29.852730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871886+0000","last_change":"2024-08-19T00:42:31.894145+0000","last_active":"2024-08-19T00:42:32.871886+0000","last_peered":"2024-08-19T00:42:32.871886+0000","last_clean":"2024-08-19T00:42:32.871886+0000","last_became_active":"2024-08-19T00:42:31.893868+0000","last_became_peered":"2024-08-19T00:42:31.893868+0000","last_unstale":"2024-08-19T00:42:32.871886+0000","last_undegraded":"2024-08-19T00:42:32.871886+0000","last_fullsized":"2024-08-19T00:42:32.871886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:13.096377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.859991+0000","last_change":"2024-08-19T00:42:29.859991+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.859991+0000","last_undegraded":"2024-08-19T00:42:29.859991+0000","last_fullsized":"2024-08-19T00:42:29.859991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872671+0000","last_change":"2024-08-19T00:42:31.888776+0000","last_active":"2024-08-19T00:42:32.872671+0000","last_peered":"2024-08-19T00:42:32.872671+0000","last_clean":"2024-08-19T00:42:32.872671+0000","last_became_active":"2024-08-19T00:42:31.888495+0000","last_became_peered":"2024-08-19T00:42:31.888495+0000","last_unstale":"2024-08-19T00:42:32.872671+0000","last_undegraded":"2024-08-19T00:42:32.872671+0000","last_fullsized":"2024-08-19T00:42:32.872671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:30.401352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871890+0000","last_change":"2024-08-19T00:42:30.878407+0000","last_active":"2024-08-19T00:42:32.871890+0000","last_peered":"2024-08-19T00:42:32.871890+0000","last_clean":"2024-08-19T00:42:32.871890+0000","last_became_active":"2024-08-19T00:42:30.876759+0000","last_became_peered":"2024-08-19T00:42:30.876759+0000","last_unstale":"2024-08-19T00:42:32.871890+0000","last_undegraded":"2024-08-19T00:42:32.871890+0000","last_fullsized":"2024-08-19T00:42:32.871890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:10.187178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857870+0000","last_change":"2024-08-19T00:42:29.857870+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857870+0000","last_undegraded":"2024-08-19T00:42:29.857870+0000","last_fullsized":"2024-08-19T00:42:29.857870+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871643+0000","last_change":"2024-08-19T00:42:31.892760+0000","last_active":"2024-08-19T00:42:32.871643+0000","last_peered":"2024-08-19T00:42:32.871643+0000","last_clean":"2024-08-19T00:42:32.871643+0000","last_became_active":"2024-08-19T00:42:31.892474+0000","last_became_peered":"2024-08-19T00:42:31.892474+0000","last_unstale":"2024-08-19T00:42:32.871643+0000","last_undegraded":"2024-08-19T00:42:32.871643+0000","last_fullsized":"2024-08-19T00:42:32.871643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:33.985970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872250+0000","last_change":"2024-08-19T00:42:30.875439+0000","last_active":"2024-08-19T00:42:32.872250+0000","last_peered":"2024-08-19T00:42:32.872250+0000","last_clean":"2024-08-19T00:42:32.872250+0000","last_became_active":"2024-08-19T00:42:30.875169+0000","last_became_peered":"2024-08-19T00:42:30.875169+0000","last_unstale":"2024-08-19T00:42:32.872250+0000","last_undegraded":"2024-08-19T00:42:32.872250+0000","last_fullsized":"2024-08-19T00:42:32.872250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:16:55.713900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860331+0000","last_change":"2024-08-19T00:42:29.860331+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860331+0000","last_undegraded":"2024-08-19T00:42:29.860331+0000","last_fullsized":"2024-08-19T00:42:29.860331+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857222+0000","last_change":"2024-08-19T00:42:29.857222+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857222+0000","last_undegraded":"2024-08-19T00:42:29.857222+0000","last_fullsized":"2024-08-19T00:42:29.857222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872985+0000","last_change":"2024-08-19T00:42:31.878514+0000","last_active":"2024-08-19T00:42:32.872985+0000","last_peered":"2024-08-19T00:42:32.872985+0000","last_clean":"2024-08-19T00:42:32.872985+0000","last_became_active":"2024-08-19T00:42:31.878252+0000","last_became_peered":"2024-08-19T00:42:31.878252+0000","last_unstale":"2024-08-19T00:42:32.872985+0000","last_undegraded":"2024-08-19T00:42:32.872985+0000","last_fullsized":"2024-08-19T00:42:32.872985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:38.562669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.861460+0000","last_change":"2024-08-19T00:42:29.861460+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.861460+0000","last_undegraded":"2024-08-19T00:42:29.861460+0000","last_fullsized":"2024-08-19T00:42:29.861460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869300+0000","last_change":"2024-08-19T00:42:31.883957+0000","last_active":"2024-08-19T00:42:32.869300+0000","last_peered":"2024-08-19T00:42:32.869300+0000","last_clean":"2024-08-19T00:42:32.869300+0000","last_became_active":"2024-08-19T00:42:31.883574+0000","last_became_peered":"2024-08-19T00:42:31.883574+0000","last_unstale":"2024-08-19T00:42:32.869300+0000","last_undegraded":"2024-08-19T00:42:32.869300+0000","last_fullsized":"2024-08-19T00:42:32.869300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:39.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869319+0000","last_change":"2024-08-19T00:42:30.880554+0000","last_active":"2024-08-19T00:42:32.869319+0000","last_peered":"2024-08-19T00:42:32.869319+0000","last_clean":"2024-08-19T00:42:32.869319+0000","last_became_active":"2024-08-19T00:42:30.880233+0000","last_became_peered":"2024-08-19T00:42:30.880233+0000","last_unstale":"2024-08-19T00:42:32.869319+0000","last_undegraded":"2024-08-19T00:42:32.869319+0000","last_fullsized":"2024-08-19T00:42:32.869319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:06.057201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857972+0000","last_change":"2024-08-19T00:42:29.857972+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857972+0000","last_undegraded":"2024-08-19T00:42:29.857972+0000","last_fullsized":"2024-08-19T00:42:29.857972+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860343+0000","last_change":"2024-08-19T00:42:29.860343+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860343+0000","last_undegraded":"2024-08-19T00:42:29.860343+0000","last_fullsized":"2024-08-19T00:42:29.860343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871719+0000","last_change":"2024-08-19T00:42:31.893631+0000","last_active":"2024-08-19T00:42:32.871719+0000","last_peered":"2024-08-19T00:42:32.871719+0000","last_clean":"2024-08-19T00:42:32.871719+0000","last_became_active":"2024-08-19T00:42:31.892641+0000","last_became_peered":"2024-08-19T00:42:31.892641+0000","last_unstale":"2024-08-19T00:42:32.871719+0000","last_undegraded":"2024-08-19T00:42:32.871719+0000","last_fullsized":"2024-08-19T00:42:32.871719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:41.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860507+0000","last_change":"2024-08-19T00:42:29.860507+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860507+0000","last_undegraded":"2024-08-19T00:42:29.860507+0000","last_fullsized":"2024-08-19T00:42:29.860507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872374+0000","last_change":"2024-08-19T00:42:31.889060+0000","last_active":"2024-08-19T00:42:32.872374+0000","last_peered":"2024-08-19T00:42:32.872374+0000","last_clean":"2024-08-19T00:42:32.872374+0000","last_became_active":"2024-08-19T00:42:31.888413+0000","last_became_peered":"2024-08-19T00:42:31.888413+0000","last_unstale":"2024-08-19T00:42:32.872374+0000","last_undegraded":"2024-08-19T00:42:32.872374+0000","last_fullsized":"2024-08-19T00:42:32.872374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:31:34.849158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872299+0000","last_change":"2024-08-19T00:42:30.875349+0000","last_active":"2024-08-19T00:42:32.872299+0000","last_peered":"2024-08-19T00:42:32.872299+0000","last_clean":"2024-08-19T00:42:32.872299+0000","last_became_active":"2024-08-19T00:42:30.875068+0000","last_became_peered":"2024-08-19T00:42:30.875068+0000","last_unstale":"2024-08-19T00:42:32.872299+0000","last_undegraded":"2024-08-19T00:42:32.872299+0000","last_fullsized":"2024-08-19T00:42:32.872299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:49.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872178+0000","last_change":"2024-08-19T00:42:30.878500+0000","last_active":"2024-08-19T00:42:32.872178+0000","last_peered":"2024-08-19T00:42:32.872178+0000","last_clean":"2024-08-19T00:42:32.872178+0000","last_became_active":"2024-08-19T00:42:30.877428+0000","last_became_peered":"2024-08-19T00:42:30.877428+0000","last_unstale":"2024-08-19T00:42:32.872178+0000","last_undegraded":"2024-08-19T00:42:32.872178+0000","last_fullsized":"2024-08-19T00:42:32.872178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:28:58.973103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871831+0000","last_change":"2024-08-19T00:42:30.881547+0000","last_active":"2024-08-19T00:42:32.871831+0000","last_peered":"2024-08-19T00:42:32.871831+0000","last_clean":"2024-08-19T00:42:32.871831+0000","last_became_active":"2024-08-19T00:42:30.881265+0000","last_became_peered":"2024-08-19T00:42:30.881265+0000","last_unstale":"2024-08-19T00:42:32.871831+0000","last_undegraded":"2024-08-19T00:42:32.871831+0000","last_fullsized":"2024-08-19T00:42:32.871831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:57:16.076383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869329+0000","last_change":"2024-08-19T00:42:31.887426+0000","last_active":"2024-08-19T00:42:32.869329+0000","last_peered":"2024-08-19T00:42:32.869329+0000","last_clean":"2024-08-19T00:42:32.869329+0000","last_became_active":"2024-08-19T00:42:31.887148+0000","last_became_peered":"2024-08-19T00:42:31.887148+0000","last_unstale":"2024-08-19T00:42:32.869329+0000","last_undegraded":"2024-08-19T00:42:32.869329+0000","last_fullsized":"2024-08-19T00:42:32.869329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:44.470150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.861066+0000","last_change":"2024-08-19T00:42:29.861066+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.861066+0000","last_undegraded":"2024-08-19T00:42:29.861066+0000","last_fullsized":"2024-08-19T00:42:29.861066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869395+0000","last_change":"2024-08-19T00:42:31.876897+0000","last_active":"2024-08-19T00:42:32.869395+0000","last_peered":"2024-08-19T00:42:32.869395+0000","last_clean":"2024-08-19T00:42:32.869395+0000","last_became_active":"2024-08-19T00:42:31.876636+0000","last_became_peered":"2024-08-19T00:42:31.876636+0000","last_unstale":"2024-08-19T00:42:32.869395+0000","last_undegraded":"2024-08-19T00:42:32.869395+0000","last_fullsized":"2024-08-19T00:42:32.869395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:17.571252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869378+0000","last_change":"2024-08-19T00:42:30.878637+0000","last_active":"2024-08-19T00:42:32.869378+0000","last_peered":"2024-08-19T00:42:32.869378+0000","last_clean":"2024-08-19T00:42:32.869378+0000","last_became_active":"2024-08-19T00:42:30.878243+0000","last_became_peered":"2024-08-19T00:42:30.878243+0000","last_unstale":"2024-08-19T00:42:32.869378+0000","last_undegraded":"2024-08-19T00:42:32.869378+0000","last_fullsized":"2024-08-19T00:42:32.869378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:37.556563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869046+0000","last_change":"2024-08-19T00:42:30.881753+0000","last_active":"2024-08-19T00:42:32.869046+0000","last_peered":"2024-08-19T00:42:32.869046+0000","last_clean":"2024-08-19T00:42:32.869046+0000","last_became_active":"2024-08-19T00:42:30.881466+0000","last_became_peered":"2024-08-19T00:42:30.881466+0000","last_unstale":"2024-08-19T00:42:32.869046+0000","last_undegraded":"2024-08-19T00:42:32.869046+0000","last_fullsized":"2024-08-19T00:42:32.869046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:37.954772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871934+0000","last_change":"2024-08-19T00:42:30.866089+0000","last_active":"2024-08-19T00:42:32.871934+0000","last_peered":"2024-08-19T00:42:32.871934+0000","last_clean":"2024-08-19T00:42:32.871934+0000","last_became_active":"2024-08-19T00:42:30.865832+0000","last_became_peered":"2024-08-19T00:42:30.865832+0000","last_unstale":"2024-08-19T00:42:32.871934+0000","last_undegraded":"2024-08-19T00:42:32.871934+0000","last_fullsized":"2024-08-19T00:42:32.871934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:31.060235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871783+0000","last_change":"2024-08-19T00:42:30.873159+0000","last_active":"2024-08-19T00:42:32.871783+0000","last_peered":"2024-08-19T00:42:32.871783+0000","last_clean":"2024-08-19T00:42:32.871783+0000","last_became_active":"2024-08-19T00:42:30.872850+0000","last_became_peered":"2024-08-19T00:42:30.872850+0000","last_unstale":"2024-08-19T00:42:32.871783+0000","last_undegraded":"2024-08-19T00:42:32.871783+0000","last_fullsized":"2024-08-19T00:42:32.871783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:26.723998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869000+0000","last_change":"2024-08-19T00:42:30.878991+0000","last_active":"2024-08-19T00:42:32.869000+0000","last_peered":"2024-08-19T00:42:32.869000+0000","last_clean":"2024-08-19T00:42:32.869000+0000","last_became_active":"2024-08-19T00:42:30.878693+0000","last_became_peered":"2024-08-19T00:42:30.878693+0000","last_unstale":"2024-08-19T00:42:32.869000+0000","last_undegraded":"2024-08-19T00:42:32.869000+0000","last_fullsized":"2024-08-19T00:42:32.869000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:12.874080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852736+0000","last_change":"2024-08-19T00:42:29.852736+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852736+0000","last_undegraded":"2024-08-19T00:42:29.852736+0000","last_fullsized":"2024-08-19T00:42:29.852736+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860616+0000","last_change":"2024-08-19T00:42:29.860616+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860616+0000","last_undegraded":"2024-08-19T00:42:29.860616+0000","last_fullsized":"2024-08-19T00:42:29.860616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872982+0000","last_change":"2024-08-19T00:42:31.891953+0000","last_active":"2024-08-19T00:42:32.872982+0000","last_peered":"2024-08-19T00:42:32.872982+0000","last_clean":"2024-08-19T00:42:32.872982+0000","last_became_active":"2024-08-19T00:42:31.891707+0000","last_became_peered":"2024-08-19T00:42:31.891707+0000","last_unstale":"2024-08-19T00:42:32.872982+0000","last_undegraded":"2024-08-19T00:42:32.872982+0000","last_fullsized":"2024-08-19T00:42:32.872982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:38.960878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860191+0000","last_change":"2024-08-19T00:42:29.860191+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860191+0000","last_undegraded":"2024-08-19T00:42:29.860191+0000","last_fullsized":"2024-08-19T00:42:29.860191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869524+0000","last_change":"2024-08-19T00:42:31.887602+0000","last_active":"2024-08-19T00:42:32.869524+0000","last_peered":"2024-08-19T00:42:32.869524+0000","last_clean":"2024-08-19T00:42:32.869524+0000","last_became_active":"2024-08-19T00:42:31.887337+0000","last_became_peered":"2024-08-19T00:42:31.887337+0000","last_unstale":"2024-08-19T00:42:32.869524+0000","last_undegraded":"2024-08-19T00:42:32.869524+0000","last_fullsized":"2024-08-19T00:42:32.869524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:19.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857489+0000","last_change":"2024-08-19T00:42:29.857489+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857489+0000","last_undegraded":"2024-08-19T00:42:29.857489+0000","last_fullsized":"2024-08-19T00:42:29.857489+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872699+0000","last_change":"2024-08-19T00:42:31.883349+0000","last_active":"2024-08-19T00:42:32.872699+0000","last_peered":"2024-08-19T00:42:32.872699+0000","last_clean":"2024-08-19T00:42:32.872699+0000","last_became_active":"2024-08-19T00:42:31.883056+0000","last_became_peered":"2024-08-19T00:42:31.883056+0000","last_unstale":"2024-08-19T00:42:32.872699+0000","last_undegraded":"2024-08-19T00:42:32.872699+0000","last_fullsized":"2024-08-19T00:42:32.872699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:13.880186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857460+0000","last_change":"2024-08-19T00:42:29.857460+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857460+0000","last_undegraded":"2024-08-19T00:42:29.857460+0000","last_fullsized":"2024-08-19T00:42:29.857460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857377+0000","last_change":"2024-08-19T00:42:29.857377+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857377+0000","last_undegraded":"2024-08-19T00:42:29.857377+0000","last_fullsized":"2024-08-19T00:42:29.857377+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852738+0000","last_change":"2024-08-19T00:42:29.852738+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852738+0000","last_undegraded":"2024-08-19T00:42:29.852738+0000","last_fullsized":"2024-08-19T00:42:29.852738+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869225+0000","last_change":"2024-08-19T00:42:30.884148+0000","last_active":"2024-08-19T00:42:32.869225+0000","last_peered":"2024-08-19T00:42:32.869225+0000","last_clean":"2024-08-19T00:42:32.869225+0000","last_became_active":"2024-08-19T00:42:30.883741+0000","last_became_peered":"2024-08-19T00:42:30.883741+0000","last_unstale":"2024-08-19T00:42:32.869225+0000","last_undegraded":"2024-08-19T00:42:32.869225+0000","last_fullsized":"2024-08-19T00:42:32.869225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:53.989264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868881+0000","last_change":"2024-08-19T00:42:31.885879+0000","last_active":"2024-08-19T00:42:32.868881+0000","last_peered":"2024-08-19T00:42:32.868881+0000","last_clean":"2024-08-19T00:42:32.868881+0000","last_became_active":"2024-08-19T00:42:31.884773+0000","last_became_peered":"2024-08-19T00:42:31.884773+0000","last_unstale":"2024-08-19T00:42:32.868881+0000","last_undegraded":"2024-08-19T00:42:32.868881+0000","last_fullsized":"2024-08-19T00:42:32.868881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:32.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871394+0000","last_change":"2024-08-19T00:42:30.875606+0000","last_active":"2024-08-19T00:42:32.871394+0000","last_peered":"2024-08-19T00:42:32.871394+0000","last_clean":"2024-08-19T00:42:32.871394+0000","last_became_active":"2024-08-19T00:42:30.875023+0000","last_became_peered":"2024-08-19T00:42:30.875023+0000","last_unstale":"2024-08-19T00:42:32.871394+0000","last_undegraded":"2024-08-19T00:42:32.871394+0000","last_fullsized":"2024-08-19T00:42:32.871394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:20.569518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872371+0000","last_change":"2024-08-19T00:42:30.877958+0000","last_active":"2024-08-19T00:42:32.872371+0000","last_peered":"2024-08-19T00:42:32.872371+0000","last_clean":"2024-08-19T00:42:32.872371+0000","last_became_active":"2024-08-19T00:42:30.877702+0000","last_became_peered":"2024-08-19T00:42:30.877702+0000","last_unstale":"2024-08-19T00:42:32.872371+0000","last_undegraded":"2024-08-19T00:42:32.872371+0000","last_fullsized":"2024-08-19T00:42:32.872371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:37.610265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871881+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:42:32.871881+0000","last_peered":"2024-08-19T00:42:32.871881+0000","last_clean":"2024-08-19T00:42:32.871881+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:42:32.871881+0000","last_undegraded":"2024-08-19T00:42:32.871881+0000","last_fullsized":"2024-08-19T00:42:32.871881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":938451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":963610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":373312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:42:36.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:42:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.702+0000 7f79d0a00640 1 Processor -- start 2024-08-19T00:42:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.702+0000 7f79d0a00640 1 -- start start 2024-08-19T00:42:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.703+0000 7f79d0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e360 0x7f79cc15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.703+0000 7f79d0a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79cc0d2af0 0x7f79cc0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.703+0000 7f79d0a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f79cc15e740 0x7f79cc15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.703+0000 7f79d0a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f79cc0d3490 con 0x7f79cc0d2af0 2024-08-19T00:42:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.703+0000 7f79d0a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f79cc0b3ab0 con 0x7f79cc15e740 2024-08-19T00:42:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.703+0000 7f79d0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc15f460 con 0x7f79cc15e360 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79cc0d2af0 0x7f79cc0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79cc0d2af0 0x7f79cc0d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34516/0 (socket says 172.21.15.7:34516) 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 -- 172.21.15.7:0/547976902 learned_addr learned my addr 172.21.15.7:0/547976902 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79ca800640 1 --2- 172.21.15.7:0/547976902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e360 0x7f79cc15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79cb200640 1 --2- 172.21.15.7:0/547976902 >> v2:172.21.15.162:3300/0 conn(0x7f79cc15e740 0x7f79cc15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 -- 172.21.15.7:0/547976902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e360 msgr2=0x7f79cc15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 --2- 172.21.15.7:0/547976902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e360 0x7f79cc15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 -- 172.21.15.7:0/547976902 >> v2:172.21.15.162:3300/0 conn(0x7f79cc15e740 msgr2=0x7f79cc15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 --2- 172.21.15.7:0/547976902 >> v2:172.21.15.162:3300/0 conn(0x7f79cc15e740 0x7f79cc15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79c9e00640 1 -- 172.21.15.7:0/547976902 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc15f740 con 0x7f79cc0d2af0 2024-08-19T00:42:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.704+0000 7f79ca800640 1 --2- 172.21.15.7:0/547976902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e360 0x7f79cc15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.705+0000 7f79c9e00640 1 --2- 172.21.15.7:0/547976902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc0d2af0 0x7f79cc0d2f50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f79cc08d500 tx=0x7f79b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbf26f2be3373b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79c9400640 1 -- 172.21.15.7:0/547976902 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8037070 con 0x7f79cc0d2af0 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79c9400640 1 -- 172.21.15.7:0/547976902 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b8032440 con 0x7f79cc0d2af0 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79c9400640 1 -- 172.21.15.7:0/547976902 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8032810 con 0x7f79cc0d2af0 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 -- 172.21.15.7:0/547976902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc0d2af0 msgr2=0x7f79cc0d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 --2- 172.21.15.7:0/547976902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc0d2af0 0x7f79cc0d2f50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f79cc08d500 tx=0x7f79b802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 -- 172.21.15.7:0/547976902 shutdown_connections 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 --2- 172.21.15.7:0/547976902 >> v2:172.21.15.162:3300/0 conn(0x7f79cc15e740 0x7f79cc15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 --2- 172.21.15.7:0/547976902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc0d2af0 0x7f79cc0d2f50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 --2- 172.21.15.7:0/547976902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e360 0x7f79cc15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 -- 172.21.15.7:0/547976902 >> 172.21.15.7:0/547976902 conn(0x7f79cc08dbf0 msgr2=0x7f79cc09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 -- 172.21.15.7:0/547976902 shutdown_connections 2024-08-19T00:42:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.706+0000 7f79d0a00640 1 -- 172.21.15.7:0/547976902 wait complete. 2024-08-19T00:42:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.708+0000 7f79d0a00640 1 Processor -- start 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.708+0000 7f79d0a00640 1 -- start start 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79d0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc0d2af0 0x7f79cc1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79d0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc15e360 0x7f79cc0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79d0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e740 0x7f79cc0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79d0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc15f110 con 0x7f79cc15e360 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79d0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc0b4040 con 0x7f79cc0d2af0 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79d0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc0d2300 con 0x7f79cc15e740 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc15e360 0x7f79cc0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc15e360 0x7f79cc0c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34522/0 (socket says 172.21.15.7:34522) 2024-08-19T00:42:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 -- 172.21.15.7:0/1698011570 learned_addr learned my addr 172.21.15.7:0/1698011570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79ca800640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc0d2af0 0x7f79cc1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 -- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e740 msgr2=0x7f79cc0cf000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:42:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e740 0x7f79cc0cf000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 -- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc0d2af0 msgr2=0x7f79cc1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc0d2af0 0x7f79cc1562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79c9e00640 1 -- 172.21.15.7:0/1698011570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc0c8d30 con 0x7f79cc15e360 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.709+0000 7f79ca800640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc0d2af0 0x7f79cc1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.710+0000 7f79c9e00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc15e360 0x7f79cc0c87f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000c00 tx=0x7f79b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.710+0000 7f79c2a00640 1 -- 172.21.15.7:0/1698011570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8041020 con 0x7f79cc15e360 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.710+0000 7f79c2a00640 1 -- 172.21.15.7:0/1698011570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b80306c0 con 0x7f79cc15e360 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.710+0000 7f79c2a00640 1 -- 172.21.15.7:0/1698011570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8037040 con 0x7f79cc15e360 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.710+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc156b20 con 0x7f79cc15e360 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.710+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc0cfe50 con 0x7f79cc15e360 2024-08-19T00:42:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.711+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79cc0d2f50 con 0x7f79cc15e360 2024-08-19T00:42:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.712+0000 7f79c2a00640 1 -- 172.21.15.7:0/1698011570 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79b8044020 con 0x7f79cc15e360 2024-08-19T00:42:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.713+0000 7f79c2a00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f79ac06be30 0x7f79ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.713+0000 7f79c2a00640 1 -- 172.21.15.7:0/1698011570 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f79b80ab740 con 0x7f79cc15e360 2024-08-19T00:42:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.713+0000 7f79ca800640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f79ac06be30 0x7f79ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:36.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.714+0000 7f79ca800640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f79ac06be30 0x7f79ac06e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f79bc006fd0 tx=0x7f79bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.717+0000 7f79c2a00640 1 -- 172.21.15.7:0/1698011570 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f79b804b030 con 0x7f79cc15e360 2024-08-19T00:42:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.900+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79cc160830 con 0x7f79ac06be30 2024-08-19T00:42:36.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.906+0000 7f79c2a00640 1 -- 172.21.15.7:0/1698011570 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244673 (secure 0 0 0) 0x7f79cc160830 con 0x7f79ac06be30 2024-08-19T00:42:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:42:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f79ac06be30 msgr2=0x7f79ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f79ac06be30 0x7f79ac06e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f79bc006fd0 tx=0x7f79bc008040 comp rx=0 tx=0).stop 2024-08-19T00:42:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc15e360 msgr2=0x7f79cc0c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc15e360 0x7f79cc0c87f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000c00 tx=0x7f79b80046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 shutdown_connections 2024-08-19T00:42:36.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f79ac06be30 0x7f79ac06e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79cc15e740 0x7f79cc0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79cc15e360 0x7f79cc0c87f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 --2- 172.21.15.7:0/1698011570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc0d2af0 0x7f79cc1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.909+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 >> 172.21.15.7:0/1698011570 conn(0x7f79cc08dbf0 msgr2=0x7f79cc15d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.910+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 shutdown_connections 2024-08-19T00:42:36.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:36.910+0000 7f79d0a00640 1 -- 172.21.15.7:0/1698011570 wait complete. 2024-08-19T00:42:36.928 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-08-19T00:42:35.335421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":248964,"kb_used_data":7812,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725756,"statfs":{"total":773094113280,"available":772839174144,"internally_reserved":0,"allocated":7999488,"data_stored":4058980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.485334"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869267+0000","last_change":"2024-08-19T00:42:31.884968+0000","last_active":"2024-08-19T00:42:32.869267+0000","last_peered":"2024-08-19T00:42:32.869267+0000","last_clean":"2024-08-19T00:42:32.869267+0000","last_became_active":"2024-08-19T00:42:31.884622+0000","last_became_peered":"2024-08-19T00:42:31.884622+0000","last_unstale":"2024-08-19T00:42:32.869267+0000","last_undegraded":"2024-08-19T00:42:32.869267+0000","last_fullsized":"2024-08-19T00:42:32.869267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:50.077709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871538+0000","last_change":"2024-08-19T00:42:31.895581+0000","last_active":"2024-08-19T00:42:32.871538+0000","last_peered":"2024-08-19T00:42:32.871538+0000","last_clean":"2024-08-19T00:42:32.871538+0000","last_became_active":"2024-08-19T00:42:31.893034+0000","last_became_peered":"2024-08-19T00:42:31.893034+0000","last_unstale":"2024-08-19T00:42:32.871538+0000","last_undegraded":"2024-08-19T00:42:32.871538+0000","last_fullsized":"2024-08-19T00:42:32.871538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872132+0000","last_change":"2024-08-19T00:42:31.889975+0000","last_active":"2024-08-19T00:42:32.872132+0000","last_peered":"2024-08-19T00:42:32.872132+0000","last_clean":"2024-08-19T00:42:32.872132+0000","last_became_active":"2024-08-19T00:42:31.889637+0000","last_became_peered":"2024-08-19T00:42:31.889637+0000","last_unstale":"2024-08-19T00:42:32.872132+0000","last_undegraded":"2024-08-19T00:42:32.872132+0000","last_fullsized":"2024-08-19T00:42:32.872132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:52.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872934+0000","last_change":"2024-08-19T00:42:31.886621+0000","last_active":"2024-08-19T00:42:32.872934+0000","last_peered":"2024-08-19T00:42:32.872934+0000","last_clean":"2024-08-19T00:42:32.872934+0000","last_became_active":"2024-08-19T00:42:31.886367+0000","last_became_peered":"2024-08-19T00:42:31.886367+0000","last_unstale":"2024-08-19T00:42:32.872934+0000","last_undegraded":"2024-08-19T00:42:32.872934+0000","last_fullsized":"2024-08-19T00:42:32.872934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:07.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869305+0000","last_change":"2024-08-19T00:42:31.892500+0000","last_active":"2024-08-19T00:42:32.869305+0000","last_peered":"2024-08-19T00:42:32.869305+0000","last_clean":"2024-08-19T00:42:32.869305+0000","last_became_active":"2024-08-19T00:42:31.892123+0000","last_became_peered":"2024-08-19T00:42:31.892123+0000","last_unstale":"2024-08-19T00:42:32.869305+0000","last_undegraded":"2024-08-19T00:42:32.869305+0000","last_fullsized":"2024-08-19T00:42:32.869305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:29.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871904+0000","last_change":"2024-08-19T00:42:31.889746+0000","last_active":"2024-08-19T00:42:32.871904+0000","last_peered":"2024-08-19T00:42:32.871904+0000","last_clean":"2024-08-19T00:42:32.871904+0000","last_became_active":"2024-08-19T00:42:31.889449+0000","last_became_peered":"2024-08-19T00:42:31.889449+0000","last_unstale":"2024-08-19T00:42:32.871904+0000","last_undegraded":"2024-08-19T00:42:32.871904+0000","last_fullsized":"2024-08-19T00:42:32.871904+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:37.985664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872176+0000","last_change":"2024-08-19T00:42:31.879729+0000","last_active":"2024-08-19T00:42:32.872176+0000","last_peered":"2024-08-19T00:42:32.872176+0000","last_clean":"2024-08-19T00:42:32.872176+0000","last_became_active":"2024-08-19T00:42:31.878400+0000","last_became_peered":"2024-08-19T00:42:31.878400+0000","last_unstale":"2024-08-19T00:42:32.872176+0000","last_undegraded":"2024-08-19T00:42:32.872176+0000","last_fullsized":"2024-08-19T00:42:32.872176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:32.583705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872917+0000","last_change":"2024-08-19T00:42:31.880675+0000","last_active":"2024-08-19T00:42:32.872917+0000","last_peered":"2024-08-19T00:42:32.872917+0000","last_clean":"2024-08-19T00:42:32.872917+0000","last_became_active":"2024-08-19T00:42:31.880274+0000","last_became_peered":"2024-08-19T00:42:31.880274+0000","last_unstale":"2024-08-19T00:42:32.872917+0000","last_undegraded":"2024-08-19T00:42:32.872917+0000","last_fullsized":"2024-08-19T00:42:32.872917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:54.995370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869520+0000","last_change":"2024-08-19T00:42:31.897877+0000","last_active":"2024-08-19T00:42:32.869520+0000","last_peered":"2024-08-19T00:42:32.869520+0000","last_clean":"2024-08-19T00:42:32.869520+0000","last_became_active":"2024-08-19T00:42:31.895922+0000","last_became_peered":"2024-08-19T00:42:31.895922+0000","last_unstale":"2024-08-19T00:42:32.869520+0000","last_undegraded":"2024-08-19T00:42:32.869520+0000","last_fullsized":"2024-08-19T00:42:32.869520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868929+0000","last_change":"2024-08-19T00:42:31.896289+0000","last_active":"2024-08-19T00:42:32.868929+0000","last_peered":"2024-08-19T00:42:32.868929+0000","last_clean":"2024-08-19T00:42:32.868929+0000","last_became_active":"2024-08-19T00:42:31.896025+0000","last_became_peered":"2024-08-19T00:42:31.896025+0000","last_unstale":"2024-08-19T00:42:32.868929+0000","last_undegraded":"2024-08-19T00:42:32.868929+0000","last_fullsized":"2024-08-19T00:42:32.868929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:29.342491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868945+0000","last_change":"2024-08-19T00:42:31.896076+0000","last_active":"2024-08-19T00:42:32.868945+0000","last_peered":"2024-08-19T00:42:32.868945+0000","last_clean":"2024-08-19T00:42:32.868945+0000","last_became_active":"2024-08-19T00:42:31.895763+0000","last_became_peered":"2024-08-19T00:42:31.895763+0000","last_unstale":"2024-08-19T00:42:32.868945+0000","last_undegraded":"2024-08-19T00:42:32.868945+0000","last_fullsized":"2024-08-19T00:42:32.868945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:27.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872076+0000","last_change":"2024-08-19T00:42:30.876351+0000","last_active":"2024-08-19T00:42:32.872076+0000","last_peered":"2024-08-19T00:42:32.872076+0000","last_clean":"2024-08-19T00:42:32.872076+0000","last_became_active":"2024-08-19T00:42:30.875237+0000","last_became_peered":"2024-08-19T00:42:30.875237+0000","last_unstale":"2024-08-19T00:42:32.872076+0000","last_undegraded":"2024-08-19T00:42:32.872076+0000","last_fullsized":"2024-08-19T00:42:32.872076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:28.336385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852730+0000","last_change":"2024-08-19T00:42:29.852730+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852730+0000","last_undegraded":"2024-08-19T00:42:29.852730+0000","last_fullsized":"2024-08-19T00:42:29.852730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871886+0000","last_change":"2024-08-19T00:42:31.894145+0000","last_active":"2024-08-19T00:42:32.871886+0000","last_peered":"2024-08-19T00:42:32.871886+0000","last_clean":"2024-08-19T00:42:32.871886+0000","last_became_active":"2024-08-19T00:42:31.893868+0000","last_became_peered":"2024-08-19T00:42:31.893868+0000","last_unstale":"2024-08-19T00:42:32.871886+0000","last_undegraded":"2024-08-19T00:42:32.871886+0000","last_fullsized":"2024-08-19T00:42:32.871886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:13.096377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.859991+0000","last_change":"2024-08-19T00:42:29.859991+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.859991+0000","last_undegraded":"2024-08-19T00:42:29.859991+0000","last_fullsized":"2024-08-19T00:42:29.859991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872671+0000","last_change":"2024-08-19T00:42:31.888776+0000","last_active":"2024-08-19T00:42:32.872671+0000","last_peered":"2024-08-19T00:42:32.872671+0000","last_clean":"2024-08-19T00:42:32.872671+0000","last_became_active":"2024-08-19T00:42:31.888495+0000","last_became_peered":"2024-08-19T00:42:31.888495+0000","last_unstale":"2024-08-19T00:42:32.872671+0000","last_undegraded":"2024-08-19T00:42:32.872671+0000","last_fullsized":"2024-08-19T00:42:32.872671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:30.401352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871890+0000","last_change":"2024-08-19T00:42:30.878407+0000","last_active":"2024-08-19T00:42:32.871890+0000","last_peered":"2024-08-19T00:42:32.871890+0000","last_clean":"2024-08-19T00:42:32.871890+0000","last_became_active":"2024-08-19T00:42:30.876759+0000","last_became_peered":"2024-08-19T00:42:30.876759+0000","last_unstale":"2024-08-19T00:42:32.871890+0000","last_undegraded":"2024-08-19T00:42:32.871890+0000","last_fullsized":"2024-08-19T00:42:32.871890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:10.187178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857870+0000","last_change":"2024-08-19T00:42:29.857870+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857870+0000","last_undegraded":"2024-08-19T00:42:29.857870+0000","last_fullsized":"2024-08-19T00:42:29.857870+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871643+0000","last_change":"2024-08-19T00:42:31.892760+0000","last_active":"2024-08-19T00:42:32.871643+0000","last_peered":"2024-08-19T00:42:32.871643+0000","last_clean":"2024-08-19T00:42:32.871643+0000","last_became_active":"2024-08-19T00:42:31.892474+0000","last_became_peered":"2024-08-19T00:42:31.892474+0000","last_unstale":"2024-08-19T00:42:32.871643+0000","last_undegraded":"2024-08-19T00:42:32.871643+0000","last_fullsized":"2024-08-19T00:42:32.871643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:33.985970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872250+0000","last_change":"2024-08-19T00:42:30.875439+0000","last_active":"2024-08-19T00:42:32.872250+0000","last_peered":"2024-08-19T00:42:32.872250+0000","last_clean":"2024-08-19T00:42:32.872250+0000","last_became_active":"2024-08-19T00:42:30.875169+0000","last_became_peered":"2024-08-19T00:42:30.875169+0000","last_unstale":"2024-08-19T00:42:32.872250+0000","last_undegraded":"2024-08-19T00:42:32.872250+0000","last_fullsized":"2024-08-19T00:42:32.872250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:16:55.713900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860331+0000","last_change":"2024-08-19T00:42:29.860331+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860331+0000","last_undegraded":"2024-08-19T00:42:29.860331+0000","last_fullsized":"2024-08-19T00:42:29.860331+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857222+0000","last_change":"2024-08-19T00:42:29.857222+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857222+0000","last_undegraded":"2024-08-19T00:42:29.857222+0000","last_fullsized":"2024-08-19T00:42:29.857222+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872985+0000","last_change":"2024-08-19T00:42:31.878514+0000","last_active":"2024-08-19T00:42:32.872985+0000","last_peered":"2024-08-19T00:42:32.872985+0000","last_clean":"2024-08-19T00:42:32.872985+0000","last_became_active":"2024-08-19T00:42:31.878252+0000","last_became_peered":"2024-08-19T00:42:31.878252+0000","last_unstale":"2024-08-19T00:42:32.872985+0000","last_undegraded":"2024-08-19T00:42:32.872985+0000","last_fullsized":"2024-08-19T00:42:32.872985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:38.562669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.861460+0000","last_change":"2024-08-19T00:42:29.861460+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.861460+0000","last_undegraded":"2024-08-19T00:42:29.861460+0000","last_fullsized":"2024-08-19T00:42:29.861460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869300+0000","last_change":"2024-08-19T00:42:31.883957+0000","last_active":"2024-08-19T00:42:32.869300+0000","last_peered":"2024-08-19T00:42:32.869300+0000","last_clean":"2024-08-19T00:42:32.869300+0000","last_became_active":"2024-08-19T00:42:31.883574+0000","last_became_peered":"2024-08-19T00:42:31.883574+0000","last_unstale":"2024-08-19T00:42:32.869300+0000","last_undegraded":"2024-08-19T00:42:32.869300+0000","last_fullsized":"2024-08-19T00:42:32.869300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:39.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869319+0000","last_change":"2024-08-19T00:42:30.880554+0000","last_active":"2024-08-19T00:42:32.869319+0000","last_peered":"2024-08-19T00:42:32.869319+0000","last_clean":"2024-08-19T00:42:32.869319+0000","last_became_active":"2024-08-19T00:42:30.880233+0000","last_became_peered":"2024-08-19T00:42:30.880233+0000","last_unstale":"2024-08-19T00:42:32.869319+0000","last_undegraded":"2024-08-19T00:42:32.869319+0000","last_fullsized":"2024-08-19T00:42:32.869319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:06.057201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857972+0000","last_change":"2024-08-19T00:42:29.857972+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857972+0000","last_undegraded":"2024-08-19T00:42:29.857972+0000","last_fullsized":"2024-08-19T00:42:29.857972+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860343+0000","last_change":"2024-08-19T00:42:29.860343+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860343+0000","last_undegraded":"2024-08-19T00:42:29.860343+0000","last_fullsized":"2024-08-19T00:42:29.860343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871719+0000","last_change":"2024-08-19T00:42:31.893631+0000","last_active":"2024-08-19T00:42:32.871719+0000","last_peered":"2024-08-19T00:42:32.871719+0000","last_clean":"2024-08-19T00:42:32.871719+0000","last_became_active":"2024-08-19T00:42:31.892641+0000","last_became_peered":"2024-08-19T00:42:31.892641+0000","last_unstale":"2024-08-19T00:42:32.871719+0000","last_undegraded":"2024-08-19T00:42:32.871719+0000","last_fullsized":"2024-08-19T00:42:32.871719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:41.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860507+0000","last_change":"2024-08-19T00:42:29.860507+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860507+0000","last_undegraded":"2024-08-19T00:42:29.860507+0000","last_fullsized":"2024-08-19T00:42:29.860507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872374+0000","last_change":"2024-08-19T00:42:31.889060+0000","last_active":"2024-08-19T00:42:32.872374+0000","last_peered":"2024-08-19T00:42:32.872374+0000","last_clean":"2024-08-19T00:42:32.872374+0000","last_became_active":"2024-08-19T00:42:31.888413+0000","last_became_peered":"2024-08-19T00:42:31.888413+0000","last_unstale":"2024-08-19T00:42:32.872374+0000","last_undegraded":"2024-08-19T00:42:32.872374+0000","last_fullsized":"2024-08-19T00:42:32.872374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:31:34.849158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872299+0000","last_change":"2024-08-19T00:42:30.875349+0000","last_active":"2024-08-19T00:42:32.872299+0000","last_peered":"2024-08-19T00:42:32.872299+0000","last_clean":"2024-08-19T00:42:32.872299+0000","last_became_active":"2024-08-19T00:42:30.875068+0000","last_became_peered":"2024-08-19T00:42:30.875068+0000","last_unstale":"2024-08-19T00:42:32.872299+0000","last_undegraded":"2024-08-19T00:42:32.872299+0000","last_fullsized":"2024-08-19T00:42:32.872299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:49.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872178+0000","last_change":"2024-08-19T00:42:30.878500+0000","last_active":"2024-08-19T00:42:32.872178+0000","last_peered":"2024-08-19T00:42:32.872178+0000","last_clean":"2024-08-19T00:42:32.872178+0000","last_became_active":"2024-08-19T00:42:30.877428+0000","last_became_peered":"2024-08-19T00:42:30.877428+0000","last_unstale":"2024-08-19T00:42:32.872178+0000","last_undegraded":"2024-08-19T00:42:32.872178+0000","last_fullsized":"2024-08-19T00:42:32.872178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:28:58.973103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871831+0000","last_change":"2024-08-19T00:42:30.881547+0000","last_active":"2024-08-19T00:42:32.871831+0000","last_peered":"2024-08-19T00:42:32.871831+0000","last_clean":"2024-08-19T00:42:32.871831+0000","last_became_active":"2024-08-19T00:42:30.881265+0000","last_became_peered":"2024-08-19T00:42:30.881265+0000","last_unstale":"2024-08-19T00:42:32.871831+0000","last_undegraded":"2024-08-19T00:42:32.871831+0000","last_fullsized":"2024-08-19T00:42:32.871831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:57:16.076383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869329+0000","last_change":"2024-08-19T00:42:31.887426+0000","last_active":"2024-08-19T00:42:32.869329+0000","last_peered":"2024-08-19T00:42:32.869329+0000","last_clean":"2024-08-19T00:42:32.869329+0000","last_became_active":"2024-08-19T00:42:31.887148+0000","last_became_peered":"2024-08-19T00:42:31.887148+0000","last_unstale":"2024-08-19T00:42:32.869329+0000","last_undegraded":"2024-08-19T00:42:32.869329+0000","last_fullsized":"2024-08-19T00:42:32.869329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:44.470150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.861066+0000","last_change":"2024-08-19T00:42:29.861066+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.861066+0000","last_undegraded":"2024-08-19T00:42:29.861066+0000","last_fullsized":"2024-08-19T00:42:29.861066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869395+0000","last_change":"2024-08-19T00:42:31.876897+0000","last_active":"2024-08-19T00:42:32.869395+0000","last_peered":"2024-08-19T00:42:32.869395+0000","last_clean":"2024-08-19T00:42:32.869395+0000","last_became_active":"2024-08-19T00:42:31.876636+0000","last_became_peered":"2024-08-19T00:42:31.876636+0000","last_unstale":"2024-08-19T00:42:32.869395+0000","last_undegraded":"2024-08-19T00:42:32.869395+0000","last_fullsized":"2024-08-19T00:42:32.869395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:17.571252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869378+0000","last_change":"2024-08-19T00:42:30.878637+0000","last_active":"2024-08-19T00:42:32.869378+0000","last_peered":"2024-08-19T00:42:32.869378+0000","last_clean":"2024-08-19T00:42:32.869378+0000","last_became_active":"2024-08-19T00:42:30.878243+0000","last_became_peered":"2024-08-19T00:42:30.878243+0000","last_unstale":"2024-08-19T00:42:32.869378+0000","last_undegraded":"2024-08-19T00:42:32.869378+0000","last_fullsized":"2024-08-19T00:42:32.869378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:37.556563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869046+0000","last_change":"2024-08-19T00:42:30.881753+0000","last_active":"2024-08-19T00:42:32.869046+0000","last_peered":"2024-08-19T00:42:32.869046+0000","last_clean":"2024-08-19T00:42:32.869046+0000","last_became_active":"2024-08-19T00:42:30.881466+0000","last_became_peered":"2024-08-19T00:42:30.881466+0000","last_unstale":"2024-08-19T00:42:32.869046+0000","last_undegraded":"2024-08-19T00:42:32.869046+0000","last_fullsized":"2024-08-19T00:42:32.869046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:37.954772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871934+0000","last_change":"2024-08-19T00:42:30.866089+0000","last_active":"2024-08-19T00:42:32.871934+0000","last_peered":"2024-08-19T00:42:32.871934+0000","last_clean":"2024-08-19T00:42:32.871934+0000","last_became_active":"2024-08-19T00:42:30.865832+0000","last_became_peered":"2024-08-19T00:42:30.865832+0000","last_unstale":"2024-08-19T00:42:32.871934+0000","last_undegraded":"2024-08-19T00:42:32.871934+0000","last_fullsized":"2024-08-19T00:42:32.871934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:31.060235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871783+0000","last_change":"2024-08-19T00:42:30.873159+0000","last_active":"2024-08-19T00:42:32.871783+0000","last_peered":"2024-08-19T00:42:32.871783+0000","last_clean":"2024-08-19T00:42:32.871783+0000","last_became_active":"2024-08-19T00:42:30.872850+0000","last_became_peered":"2024-08-19T00:42:30.872850+0000","last_unstale":"2024-08-19T00:42:32.871783+0000","last_undegraded":"2024-08-19T00:42:32.871783+0000","last_fullsized":"2024-08-19T00:42:32.871783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:26.723998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869000+0000","last_change":"2024-08-19T00:42:30.878991+0000","last_active":"2024-08-19T00:42:32.869000+0000","last_peered":"2024-08-19T00:42:32.869000+0000","last_clean":"2024-08-19T00:42:32.869000+0000","last_became_active":"2024-08-19T00:42:30.878693+0000","last_became_peered":"2024-08-19T00:42:30.878693+0000","last_unstale":"2024-08-19T00:42:32.869000+0000","last_undegraded":"2024-08-19T00:42:32.869000+0000","last_fullsized":"2024-08-19T00:42:32.869000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:12.874080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852736+0000","last_change":"2024-08-19T00:42:29.852736+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852736+0000","last_undegraded":"2024-08-19T00:42:29.852736+0000","last_fullsized":"2024-08-19T00:42:29.852736+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860616+0000","last_change":"2024-08-19T00:42:29.860616+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860616+0000","last_undegraded":"2024-08-19T00:42:29.860616+0000","last_fullsized":"2024-08-19T00:42:29.860616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872982+0000","last_change":"2024-08-19T00:42:31.891953+0000","last_active":"2024-08-19T00:42:32.872982+0000","last_peered":"2024-08-19T00:42:32.872982+0000","last_clean":"2024-08-19T00:42:32.872982+0000","last_became_active":"2024-08-19T00:42:31.891707+0000","last_became_peered":"2024-08-19T00:42:31.891707+0000","last_unstale":"2024-08-19T00:42:32.872982+0000","last_undegraded":"2024-08-19T00:42:32.872982+0000","last_fullsized":"2024-08-19T00:42:32.872982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:38.960878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.860191+0000","last_change":"2024-08-19T00:42:29.860191+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.860191+0000","last_undegraded":"2024-08-19T00:42:29.860191+0000","last_fullsized":"2024-08-19T00:42:29.860191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869524+0000","last_change":"2024-08-19T00:42:31.887602+0000","last_active":"2024-08-19T00:42:32.869524+0000","last_peered":"2024-08-19T00:42:32.869524+0000","last_clean":"2024-08-19T00:42:32.869524+0000","last_became_active":"2024-08-19T00:42:31.887337+0000","last_became_peered":"2024-08-19T00:42:31.887337+0000","last_unstale":"2024-08-19T00:42:32.869524+0000","last_undegraded":"2024-08-19T00:42:32.869524+0000","last_fullsized":"2024-08-19T00:42:32.869524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:19.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857489+0000","last_change":"2024-08-19T00:42:29.857489+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857489+0000","last_undegraded":"2024-08-19T00:42:29.857489+0000","last_fullsized":"2024-08-19T00:42:29.857489+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872699+0000","last_change":"2024-08-19T00:42:31.883349+0000","last_active":"2024-08-19T00:42:32.872699+0000","last_peered":"2024-08-19T00:42:32.872699+0000","last_clean":"2024-08-19T00:42:32.872699+0000","last_became_active":"2024-08-19T00:42:31.883056+0000","last_became_peered":"2024-08-19T00:42:31.883056+0000","last_unstale":"2024-08-19T00:42:32.872699+0000","last_undegraded":"2024-08-19T00:42:32.872699+0000","last_fullsized":"2024-08-19T00:42:32.872699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:13.880186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857460+0000","last_change":"2024-08-19T00:42:29.857460+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857460+0000","last_undegraded":"2024-08-19T00:42:29.857460+0000","last_fullsized":"2024-08-19T00:42:29.857460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.857377+0000","last_change":"2024-08-19T00:42:29.857377+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.857377+0000","last_undegraded":"2024-08-19T00:42:29.857377+0000","last_fullsized":"2024-08-19T00:42:29.857377+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-08-19T00:42:29.852738+0000","last_change":"2024-08-19T00:42:29.852738+0000","last_active":"2024-08-19T00:42:29.843378+0000","last_peered":"2024-08-19T00:42:29.843378+0000","last_clean":"2024-08-19T00:42:29.843378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:29.852738+0000","last_undegraded":"2024-08-19T00:42:29.852738+0000","last_fullsized":"2024-08-19T00:42:29.852738+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869225+0000","last_change":"2024-08-19T00:42:30.884148+0000","last_active":"2024-08-19T00:42:32.869225+0000","last_peered":"2024-08-19T00:42:32.869225+0000","last_clean":"2024-08-19T00:42:32.869225+0000","last_became_active":"2024-08-19T00:42:30.883741+0000","last_became_peered":"2024-08-19T00:42:30.883741+0000","last_unstale":"2024-08-19T00:42:32.869225+0000","last_undegraded":"2024-08-19T00:42:32.869225+0000","last_fullsized":"2024-08-19T00:42:32.869225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:53.989264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868881+0000","last_change":"2024-08-19T00:42:31.885879+0000","last_active":"2024-08-19T00:42:32.868881+0000","last_peered":"2024-08-19T00:42:32.868881+0000","last_clean":"2024-08-19T00:42:32.868881+0000","last_became_active":"2024-08-19T00:42:31.884773+0000","last_became_peered":"2024-08-19T00:42:31.884773+0000","last_unstale":"2024-08-19T00:42:32.868881+0000","last_undegraded":"2024-08-19T00:42:32.868881+0000","last_fullsized":"2024-08-19T00:42:32.868881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:32.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871394+0000","last_change":"2024-08-19T00:42:30.875606+0000","last_active":"2024-08-19T00:42:32.871394+0000","last_peered":"2024-08-19T00:42:32.871394+0000","last_clean":"2024-08-19T00:42:32.871394+0000","last_became_active":"2024-08-19T00:42:30.875023+0000","last_became_peered":"2024-08-19T00:42:30.875023+0000","last_unstale":"2024-08-19T00:42:32.871394+0000","last_undegraded":"2024-08-19T00:42:32.871394+0000","last_fullsized":"2024-08-19T00:42:32.871394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:20.569518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-19T00:42:30.849484+0000","last_change":"2024-08-19T00:42:30.849484+0000","last_active":"2024-08-19T00:42:30.849484+0000","last_peered":"2024-08-19T00:42:30.849484+0000","last_clean":"2024-08-19T00:42:30.849484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-19T00:42:30.849484+0000","last_undegraded":"2024-08-19T00:42:30.849484+0000","last_fullsized":"2024-08-19T00:42:30.849484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872371+0000","last_change":"2024-08-19T00:42:30.877958+0000","last_active":"2024-08-19T00:42:32.872371+0000","last_peered":"2024-08-19T00:42:32.872371+0000","last_clean":"2024-08-19T00:42:32.872371+0000","last_became_active":"2024-08-19T00:42:30.877702+0000","last_became_peered":"2024-08-19T00:42:30.877702+0000","last_unstale":"2024-08-19T00:42:32.872371+0000","last_undegraded":"2024-08-19T00:42:32.872371+0000","last_fullsized":"2024-08-19T00:42:32.872371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:37.610265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871881+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:42:32.871881+0000","last_peered":"2024-08-19T00:42:32.871881+0000","last_clean":"2024-08-19T00:42:32.871881+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:42:32.871881+0000","last_undegraded":"2024-08-19T00:42:32.871881+0000","last_fullsized":"2024-08-19T00:42:32.871881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":938451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":839680,"data_stored":353900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":963610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":373312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:42:36.931 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3d is not active+clean 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.932 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:PG 11.34 is not active+clean 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:PG 11.33 is not active+clean 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-08-19T00:42:36.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:PG 11.31 is not active+clean 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-08-19T00:42:36.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2c is not active+clean 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:PG 11.25 is not active+clean 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:PG 11.23 is not active+clean 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-08-19T00:42:36.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.852730+0000', 'last_change': '2024-08-19T00:42:29.852730+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.852730+0000', 'last_undegraded': '2024-08-19T00:42:29.852730+0000', 'last_fullsized': '2024-08-19T00:42:29.852730+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.859991+0000', 'last_change': '2024-08-19T00:42:29.859991+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.859991+0000', 'last_undegraded': '2024-08-19T00:42:29.859991+0000', 'last_fullsized': '2024-08-19T00:42:29.859991+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-08-19T00:42:36.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.857870+0000', 'last_change': '2024-08-19T00:42:29.857870+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.857870+0000', 'last_undegraded': '2024-08-19T00:42:29.857870+0000', 'last_fullsized': '2024-08-19T00:42:29.857870+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.860331+0000', 'last_change': '2024-08-19T00:42:29.860331+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.860331+0000', 'last_undegraded': '2024-08-19T00:42:29.860331+0000', 'last_fullsized': '2024-08-19T00:42:29.860331+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:PG 11.19 is not active+clean 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-08-19T00:42:36.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.857222+0000', 'last_change': '2024-08-19T00:42:29.857222+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.857222+0000', 'last_undegraded': '2024-08-19T00:42:29.857222+0000', 'last_fullsized': '2024-08-19T00:42:29.857222+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.861460+0000', 'last_change': '2024-08-19T00:42:29.861460+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.861460+0000', 'last_undegraded': '2024-08-19T00:42:29.861460+0000', 'last_fullsized': '2024-08-19T00:42:29.861460+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.857972+0000', 'last_change': '2024-08-19T00:42:29.857972+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.857972+0000', 'last_undegraded': '2024-08-19T00:42:29.857972+0000', 'last_fullsized': '2024-08-19T00:42:29.857972+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-08-19T00:42:36.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.860343+0000', 'last_change': '2024-08-19T00:42:29.860343+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.860343+0000', 'last_undegraded': '2024-08-19T00:42:29.860343+0000', 'last_fullsized': '2024-08-19T00:42:29.860343+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.860507+0000', 'last_change': '2024-08-19T00:42:29.860507+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.860507+0000', 'last_undegraded': '2024-08-19T00:42:29.860507+0000', 'last_fullsized': '2024-08-19T00:42:29.860507+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:PG 11.10 is not active+clean 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.861066+0000', 'last_change': '2024-08-19T00:42:29.861066+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.861066+0000', 'last_undegraded': '2024-08-19T00:42:29.861066+0000', 'last_fullsized': '2024-08-19T00:42:29.861066+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.939 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:PG 11.9 is not active+clean 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.852736+0000', 'last_change': '2024-08-19T00:42:29.852736+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.852736+0000', 'last_undegraded': '2024-08-19T00:42:29.852736+0000', 'last_fullsized': '2024-08-19T00:42:29.852736+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:42:36.940 INFO:tasks.ceph.ceph_manager.ceph:PG 11.6 is not active+clean 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.860616+0000', 'last_change': '2024-08-19T00:42:29.860616+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.860616+0000', 'last_undegraded': '2024-08-19T00:42:29.860616+0000', 'last_fullsized': '2024-08-19T00:42:29.860616+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.860191+0000', 'last_change': '2024-08-19T00:42:29.860191+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.860191+0000', 'last_undegraded': '2024-08-19T00:42:29.860191+0000', 'last_fullsized': '2024-08-19T00:42:29.860191+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.857489+0000', 'last_change': '2024-08-19T00:42:29.857489+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.857489+0000', 'last_undegraded': '2024-08-19T00:42:29.857489+0000', 'last_fullsized': '2024-08-19T00:42:29.857489+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.857460+0000', 'last_change': '2024-08-19T00:42:29.857460+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.857460+0000', 'last_undegraded': '2024-08-19T00:42:29.857460+0000', 'last_fullsized': '2024-08-19T00:42:29.857460+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-08-19T00:42:36.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.857377+0000', 'last_change': '2024-08-19T00:42:29.857377+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.857377+0000', 'last_undegraded': '2024-08-19T00:42:29.857377+0000', 'last_fullsized': '2024-08-19T00:42:29.857377+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 69, 'state': 'creating+peering', 'last_fresh': '2024-08-19T00:42:29.852738+0000', 'last_change': '2024-08-19T00:42:29.852738+0000', 'last_active': '2024-08-19T00:42:29.843378+0000', 'last_peered': '2024-08-19T00:42:29.843378+0000', 'last_clean': '2024-08-19T00:42:29.843378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:29.852738+0000', 'last_undegraded': '2024-08-19T00:42:29.852738+0000', 'last_fullsized': '2024-08-19T00:42:29.852738+0000', 'mapping_epoch': 69, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 69, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:29.843378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-08-19T00:42:36.942 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.943 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-08-19T00:42:36.943 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-19T00:42:30.849484+0000', 'last_change': '2024-08-19T00:42:30.849484+0000', 'last_active': '2024-08-19T00:42:30.849484+0000', 'last_peered': '2024-08-19T00:42:30.849484+0000', 'last_clean': '2024-08-19T00:42:30.849484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-19T00:42:30.849484+0000', 'last_undegraded': '2024-08-19T00:42:30.849484+0000', 'last_fullsized': '2024-08-19T00:42:30.849484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'last_clean_scrub_stamp': '2024-08-19T00:42:30.849484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-19T00:42:36.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-19T00:42:37.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.121+0000 7f339aa00640 1 Processor -- start 2024-08-19T00:42:37.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.121+0000 7f339aa00640 1 -- start start 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.122+0000 7f339aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f339415f5b0 0x7f33940cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.122+0000 7f339aa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33940d03c0 0x7f33940d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.122+0000 7f339aa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33940cfaf0 con 0x7f33940b4380 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.122+0000 7f339aa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f33940d0d60 con 0x7f339415f5b0 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.122+0000 7f339aa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f339415f990 con 0x7f33940d03c0 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.123+0000 7f3393e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f339415f5b0 0x7f33940cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.123+0000 7f3393e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f339415f5b0 0x7f33940cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34536/0 (socket says 172.21.15.7:34536) 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.123+0000 7f3393e00640 1 -- 172.21.15.7:0/3488784999 learned_addr learned my addr 172.21.15.7:0/3488784999 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.123+0000 7f3393e00640 1 -- 172.21.15.7:0/3488784999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33940d03c0 msgr2=0x7f33940d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.123+0000 7f3393e00640 1 --2- 172.21.15.7:0/3488784999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33940d03c0 0x7f33940d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.123+0000 7f3393e00640 1 -- 172.21.15.7:0/3488784999 >> v1:172.21.15.162:6789/0 conn(0x7f33940b4380 legacy=0x7f33940b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.123+0000 7f3393e00640 1 -- 172.21.15.7:0/3488784999 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33940b50b0 con 0x7f339415f5b0 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.124+0000 7f3393e00640 1 --2- 172.21.15.7:0/3488784999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339415f5b0 0x7f33940cf5b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3384009870 tx=0x7f338402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc97f60046d3f7e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.124+0000 7f3393400640 1 -- 172.21.15.7:0/3488784999 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384037070 con 0x7f339415f5b0 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f3393400640 1 -- 172.21.15.7:0/3488784999 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3384032440 con 0x7f339415f5b0 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f3393400640 1 -- 172.21.15.7:0/3488784999 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384032810 con 0x7f339415f5b0 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 -- 172.21.15.7:0/3488784999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339415f5b0 msgr2=0x7f33940cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 --2- 172.21.15.7:0/3488784999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339415f5b0 0x7f33940cf5b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3384009870 tx=0x7f338402a180 comp rx=0 tx=0).stop 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 -- 172.21.15.7:0/3488784999 shutdown_connections 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 --2- 172.21.15.7:0/3488784999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33940d03c0 0x7f33940d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 --2- 172.21.15.7:0/3488784999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339415f5b0 0x7f33940cf5b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 -- 172.21.15.7:0/3488784999 >> 172.21.15.7:0/3488784999 conn(0x7f339406bc70 msgr2=0x7f339406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 -- 172.21.15.7:0/3488784999 shutdown_connections 2024-08-19T00:42:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.125+0000 7f339aa00640 1 -- 172.21.15.7:0/3488784999 wait complete. 2024-08-19T00:42:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.127+0000 7f339aa00640 1 Processor -- start 2024-08-19T00:42:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.127+0000 7f339aa00640 1 -- start start 2024-08-19T00:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f339aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33940b4380 0x7f33940ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f339aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33940d03c0 0x7f3394151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f339aa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339415f5b0 0x7f33941e8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f339aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33940cedb0 con 0x7f33940b4380 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f339aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33940cf120 con 0x7f33940d03c0 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f339aa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f339406e660 con 0x7f339415f5b0 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f3393e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33940b4380 0x7f33940ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f3393e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33940b4380 0x7f33940ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34550/0 (socket says 172.21.15.7:34550) 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f3393e00640 1 -- 172.21.15.7:0/3565078768 learned_addr learned my addr 172.21.15.7:0/3565078768 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f338be00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33940d03c0 0x7f3394151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.128+0000 7f3398a00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339415f5b0 0x7f33941e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3393e00640 1 -- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339415f5b0 msgr2=0x7f33941e8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3393e00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339415f5b0 0x7f33941e8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3393e00640 1 -- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33940d03c0 msgr2=0x7f3394151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3393e00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33940d03c0 0x7f3394151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3393e00640 1 -- 172.21.15.7:0/3565078768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33941e8b40 con 0x7f33940b4380 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f338be00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33940d03c0 0x7f3394151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3393e00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33940b4380 0x7f33940ae2d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3384009870 tx=0x7f33840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3390c00640 1 -- 172.21.15.7:0/3565078768 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384041070 con 0x7f33940b4380 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3390c00640 1 -- 172.21.15.7:0/3565078768 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338403c870 con 0x7f33940b4380 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f3390c00640 1 -- 172.21.15.7:0/3565078768 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384037040 con 0x7f33940b4380 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.129+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33941e8e20 con 0x7f33940b4380 2024-08-19T00:42:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.130+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33941e93e0 con 0x7f33940b4380 2024-08-19T00:42:37.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.131+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3394073c50 con 0x7f33940b4380 2024-08-19T00:42:37.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.132+0000 7f3390c00640 1 -- 172.21.15.7:0/3565078768 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3384044070 con 0x7f33940b4380 2024-08-19T00:42:37.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.133+0000 7f3390c00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337006be30 0x7f337006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.133+0000 7f3390c00640 1 -- 172.21.15.7:0/3565078768 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f33840ab930 con 0x7f33940b4380 2024-08-19T00:42:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.133+0000 7f338be00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337006be30 0x7f337006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.133+0000 7f338be00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337006be30 0x7f337006e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33940b1390 tx=0x7f337c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:37.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.137+0000 7f3390c00640 1 -- 172.21.15.7:0/3565078768 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f338407a2e0 con 0x7f33940b4380 2024-08-19T00:42:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.392+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f33940d0800 con 0x7f33940b4380 2024-08-19T00:42:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.392+0000 7f3390c00640 1 -- 172.21.15.7:0/3565078768 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1217 (secure 0 0 0) 0x7f3384079be0 con 0x7f33940b4380 2024-08-19T00:42:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:37.395 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":359,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1724027810,"num_in_osds":8,"osd_in_since":1724027801,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":40},{"state_name":"active+clean","count":40},{"state_name":"creating+peering","count":17}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":591020,"bytes_used":254939136,"bytes_avail":772839174144,"bytes_total":773094113280,"unknown_pgs_ratio":0.41237112879753113,"inactive_pgs_ratio":0.17525772750377655,"write_bytes_sec":373,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":69,"btime":"2024-08-19T00:42:34:888871+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6354}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-08-19T00:41:43.322249+0000","services":{}},"progress_events":{}} 2024-08-19T00:42:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337006be30 msgr2=0x7f337006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337006be30 0x7f337006e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33940b1390 tx=0x7f337c008040 comp rx=0 tx=0).stop 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33940b4380 msgr2=0x7f33940ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33940b4380 0x7f33940ae2d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3384009870 tx=0x7f33840046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 shutdown_connections 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337006be30 0x7f337006e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339415f5b0 0x7f33941e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33940d03c0 0x7f3394151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 --2- 172.21.15.7:0/3565078768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33940b4380 0x7f33940ae2d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.394+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 >> 172.21.15.7:0/3565078768 conn(0x7f339406bc70 msgr2=0x7f3394074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.395+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 shutdown_connections 2024-08-19T00:42:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.395+0000 7f339aa00640 1 -- 172.21.15.7:0/3565078768 wait complete. 2024-08-19T00:42:37.412 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-19T00:42:37.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:42:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.566+0000 7fdb66c00640 1 Processor -- start 2024-08-19T00:42:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.566+0000 7fdb66c00640 1 -- start start 2024-08-19T00:42:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.567+0000 7fdb66c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdb6009aa70 0x7fdb6009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.567+0000 7fdb66c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdb6009b730 0x7fdb6006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.567+0000 7fdb66c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb6009b390 con 0x7fdb60161f20 2024-08-19T00:42:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.567+0000 7fdb66c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fdb6015ec30 con 0x7fdb6009b730 2024-08-19T00:42:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.567+0000 7fdb66c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdb6015ef10 con 0x7fdb6009aa70 2024-08-19T00:42:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.567+0000 7fdb57400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdb6009b730 0x7fdb6006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb57400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdb6009b730 0x7fdb6006fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34552/0 (socket says 172.21.15.7:34552) 2024-08-19T00:42:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb57400640 1 -- 172.21.15.7:0/3341253934 learned_addr learned my addr 172.21.15.7:0/3341253934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb64c00640 1 --1- 172.21.15.7:0/3341253934 >> v1:172.21.15.7:6789/0 conn(0x7fdb60161f20 0x7fdb601623b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44810/0 (socket says 172.21.15.7:44810) 2024-08-19T00:42:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb5fe00640 1 --2- 172.21.15.7:0/3341253934 >> v2:172.21.15.162:3300/0 conn(0x7fdb6009aa70 0x7fdb6009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb57400640 1 -- 172.21.15.7:0/3341253934 >> v2:172.21.15.162:3300/0 conn(0x7fdb6009aa70 msgr2=0x7fdb6009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb57400640 1 --2- 172.21.15.7:0/3341253934 >> v2:172.21.15.162:3300/0 conn(0x7fdb6009aa70 0x7fdb6009ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb57400640 1 -- 172.21.15.7:0/3341253934 >> v1:172.21.15.7:6789/0 conn(0x7fdb60161f20 legacy=0x7fdb601623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.568+0000 7fdb57400640 1 -- 172.21.15.7:0/3341253934 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6015f1f0 con 0x7fdb6009b730 2024-08-19T00:42:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.569+0000 7fdb57400640 1 --2- 172.21.15.7:0/3341253934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009b730 0x7fdb6006fc30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdb60072ff0 tx=0x7fdb4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b580711f35725 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.569+0000 7fdb5f400640 1 -- 172.21.15.7:0/3341253934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48037070 con 0x7fdb6009b730 2024-08-19T00:42:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.569+0000 7fdb5f400640 1 -- 172.21.15.7:0/3341253934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48032440 con 0x7fdb6009b730 2024-08-19T00:42:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.569+0000 7fdb5f400640 1 -- 172.21.15.7:0/3341253934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48032810 con 0x7fdb6009b730 2024-08-19T00:42:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 -- 172.21.15.7:0/3341253934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009b730 msgr2=0x7fdb6006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 --2- 172.21.15.7:0/3341253934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009b730 0x7fdb6006fc30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdb60072ff0 tx=0x7fdb4802a270 comp rx=0 tx=0).stop 2024-08-19T00:42:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 -- 172.21.15.7:0/3341253934 shutdown_connections 2024-08-19T00:42:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 --2- 172.21.15.7:0/3341253934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009b730 0x7fdb6006fc30 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 --2- 172.21.15.7:0/3341253934 >> v2:172.21.15.162:3300/0 conn(0x7fdb6009aa70 0x7fdb6009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 -- 172.21.15.7:0/3341253934 >> 172.21.15.7:0/3341253934 conn(0x7fdb600d2190 msgr2=0x7fdb600d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 -- 172.21.15.7:0/3341253934 shutdown_connections 2024-08-19T00:42:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.570+0000 7fdb66c00640 1 -- 172.21.15.7:0/3341253934 wait complete. 2024-08-19T00:42:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.572+0000 7fdb66c00640 1 Processor -- start 2024-08-19T00:42:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.572+0000 7fdb66c00640 1 -- start start 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb66c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009aa70 0x7fdb601f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb66c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb6009b730 0x7fdb600b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb66c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb60161f20 0x7fdb6015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb66c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6015e8f0 con 0x7fdb6009aa70 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb66c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60070170 con 0x7fdb6009b730 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb66c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb60162ac0 con 0x7fdb60161f20 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009aa70 0x7fdb601f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009aa70 0x7fdb601f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34564/0 (socket says 172.21.15.7:34564) 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb5fe00640 1 -- 172.21.15.7:0/51182583 learned_addr learned my addr 172.21.15.7:0/51182583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb57400640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb6009b730 0x7fdb600b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.573+0000 7fdb64c00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb60161f20 0x7fdb6015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5fe00640 1 -- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb60161f20 msgr2=0x7fdb6015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5fe00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb60161f20 0x7fdb6015bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5fe00640 1 -- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb6009b730 msgr2=0x7fdb600b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5fe00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb6009b730 0x7fdb600b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5fe00640 1 -- 172.21.15.7:0/51182583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb600b6f50 con 0x7fdb6009aa70 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5fe00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009aa70 0x7fdb601f5300 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000e9b0 tx=0x7fdb5000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5cc00640 1 -- 172.21.15.7:0/51182583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50017070 con 0x7fdb6009aa70 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5cc00640 1 -- 172.21.15.7:0/51182583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5000c9a0 con 0x7fdb6009aa70 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb5cc00640 1 -- 172.21.15.7:0/51182583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000cd90 con 0x7fdb6009aa70 2024-08-19T00:42:37.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb600b7230 con 0x7fdb6009aa70 2024-08-19T00:42:37.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.574+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb600b77f0 con 0x7fdb6009aa70 2024-08-19T00:42:37.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.576+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6009ae50 con 0x7fdb6009aa70 2024-08-19T00:42:37.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.576+0000 7fdb5cc00640 1 -- 172.21.15.7:0/51182583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb5001a070 con 0x7fdb6009aa70 2024-08-19T00:42:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.577+0000 7fdb5cc00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.577+0000 7fdb5cc00640 1 -- 172.21.15.7:0/51182583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fdb5008b250 con 0x7fdb6009aa70 2024-08-19T00:42:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.578+0000 7fdb57400640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.578+0000 7fdb57400640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdb48034000 tx=0x7fdb4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.582+0000 7fdb5cc00640 1 -- 172.21.15.7:0/51182583 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdb50059510 con 0x7fdb6009aa70 2024-08-19T00:42:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.763+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb600d1ea0 con 0x7fdb3c06be30 2024-08-19T00:42:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.770+0000 7fdb5cc00640 1 -- 172.21.15.7:0/51182583 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252071 (secure 0 0 0) 0x7fdb600d1ea0 con 0x7fdb3c06be30 2024-08-19T00:42:37.775 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:37.777 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:42:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb3c06be30 msgr2=0x7fdb3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdb48034000 tx=0x7fdb4802e000 comp rx=0 tx=0).stop 2024-08-19T00:42:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009aa70 msgr2=0x7fdb601f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009aa70 0x7fdb601f5300 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000e9b0 tx=0x7fdb5000ee70 comp rx=0 tx=0).stop 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 shutdown_connections 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb60161f20 0x7fdb6015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb6009b730 0x7fdb600b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 --2- 172.21.15.7:0/51182583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6009aa70 0x7fdb601f5300 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.773+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 >> 172.21.15.7:0/51182583 conn(0x7fdb600d2190 msgr2=0x7fdb6006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.774+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 shutdown_connections 2024-08-19T00:42:37.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:37.774+0000 7fdb66c00640 1 -- 172.21.15.7:0/51182583 wait complete. 2024-08-19T00:42:37.792 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-08-19T00:42:37.335806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253348,"kb_used_data":8036,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721372,"statfs":{"total":773094113280,"available":772834684928,"internally_reserved":0,"allocated":8228864,"data_stored":4152592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.482338"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893775+0000","last_change":"2024-08-19T00:42:31.890520+0000","last_active":"2024-08-19T00:42:32.893775+0000","last_peered":"2024-08-19T00:42:32.893775+0000","last_clean":"2024-08-19T00:42:32.893775+0000","last_became_active":"2024-08-19T00:42:31.890272+0000","last_became_peered":"2024-08-19T00:42:31.890272+0000","last_unstale":"2024-08-19T00:42:32.893775+0000","last_undegraded":"2024-08-19T00:42:32.893775+0000","last_fullsized":"2024-08-19T00:42:32.893775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:19:23.781575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869267+0000","last_change":"2024-08-19T00:42:31.884968+0000","last_active":"2024-08-19T00:42:32.869267+0000","last_peered":"2024-08-19T00:42:32.869267+0000","last_clean":"2024-08-19T00:42:32.869267+0000","last_became_active":"2024-08-19T00:42:31.884622+0000","last_became_peered":"2024-08-19T00:42:31.884622+0000","last_unstale":"2024-08-19T00:42:32.869267+0000","last_undegraded":"2024-08-19T00:42:32.869267+0000","last_fullsized":"2024-08-19T00:42:32.869267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:50.077709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568750+0000","last_change":"2024-08-19T00:42:31.897141+0000","last_active":"2024-08-19T00:42:34.568750+0000","last_peered":"2024-08-19T00:42:34.568750+0000","last_clean":"2024-08-19T00:42:34.568750+0000","last_became_active":"2024-08-19T00:42:31.896305+0000","last_became_peered":"2024-08-19T00:42:31.896305+0000","last_unstale":"2024-08-19T00:42:34.568750+0000","last_undegraded":"2024-08-19T00:42:34.568750+0000","last_fullsized":"2024-08-19T00:42:34.568750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:40.889390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568607+0000","last_change":"2024-08-19T00:42:31.885638+0000","last_active":"2024-08-19T00:42:34.568607+0000","last_peered":"2024-08-19T00:42:34.568607+0000","last_clean":"2024-08-19T00:42:34.568607+0000","last_became_active":"2024-08-19T00:42:31.885104+0000","last_became_peered":"2024-08-19T00:42:31.885104+0000","last_unstale":"2024-08-19T00:42:34.568607+0000","last_undegraded":"2024-08-19T00:42:34.568607+0000","last_fullsized":"2024-08-19T00:42:34.568607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:56:48.860832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568983+0000","last_change":"2024-08-19T00:42:31.891961+0000","last_active":"2024-08-19T00:42:34.568983+0000","last_peered":"2024-08-19T00:42:34.568983+0000","last_clean":"2024-08-19T00:42:34.568983+0000","last_became_active":"2024-08-19T00:42:31.891483+0000","last_became_peered":"2024-08-19T00:42:31.891483+0000","last_unstale":"2024-08-19T00:42:34.568983+0000","last_undegraded":"2024-08-19T00:42:34.568983+0000","last_fullsized":"2024-08-19T00:42:34.568983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:39:48.378680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871538+0000","last_change":"2024-08-19T00:42:31.895581+0000","last_active":"2024-08-19T00:42:32.871538+0000","last_peered":"2024-08-19T00:42:32.871538+0000","last_clean":"2024-08-19T00:42:32.871538+0000","last_became_active":"2024-08-19T00:42:31.893034+0000","last_became_peered":"2024-08-19T00:42:31.893034+0000","last_unstale":"2024-08-19T00:42:32.871538+0000","last_undegraded":"2024-08-19T00:42:32.871538+0000","last_fullsized":"2024-08-19T00:42:32.871538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872132+0000","last_change":"2024-08-19T00:42:31.889975+0000","last_active":"2024-08-19T00:42:32.872132+0000","last_peered":"2024-08-19T00:42:32.872132+0000","last_clean":"2024-08-19T00:42:32.872132+0000","last_became_active":"2024-08-19T00:42:31.889637+0000","last_became_peered":"2024-08-19T00:42:31.889637+0000","last_unstale":"2024-08-19T00:42:32.872132+0000","last_undegraded":"2024-08-19T00:42:32.872132+0000","last_fullsized":"2024-08-19T00:42:32.872132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:52.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893196+0000","last_change":"2024-08-19T00:42:31.887021+0000","last_active":"2024-08-19T00:42:32.893196+0000","last_peered":"2024-08-19T00:42:32.893196+0000","last_clean":"2024-08-19T00:42:32.893196+0000","last_became_active":"2024-08-19T00:42:31.886689+0000","last_became_peered":"2024-08-19T00:42:31.886689+0000","last_unstale":"2024-08-19T00:42:32.893196+0000","last_undegraded":"2024-08-19T00:42:32.893196+0000","last_fullsized":"2024-08-19T00:42:32.893196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:39.104819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569574+0000","last_change":"2024-08-19T00:42:31.888701+0000","last_active":"2024-08-19T00:42:34.569574+0000","last_peered":"2024-08-19T00:42:34.569574+0000","last_clean":"2024-08-19T00:42:34.569574+0000","last_became_active":"2024-08-19T00:42:31.887705+0000","last_became_peered":"2024-08-19T00:42:31.887705+0000","last_unstale":"2024-08-19T00:42:34.569574+0000","last_undegraded":"2024-08-19T00:42:34.569574+0000","last_fullsized":"2024-08-19T00:42:34.569574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:02:47.264222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872934+0000","last_change":"2024-08-19T00:42:31.886621+0000","last_active":"2024-08-19T00:42:32.872934+0000","last_peered":"2024-08-19T00:42:32.872934+0000","last_clean":"2024-08-19T00:42:32.872934+0000","last_became_active":"2024-08-19T00:42:31.886367+0000","last_became_peered":"2024-08-19T00:42:31.886367+0000","last_unstale":"2024-08-19T00:42:32.872934+0000","last_undegraded":"2024-08-19T00:42:32.872934+0000","last_fullsized":"2024-08-19T00:42:32.872934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:07.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893711+0000","last_change":"2024-08-19T00:42:31.886557+0000","last_active":"2024-08-19T00:42:32.893711+0000","last_peered":"2024-08-19T00:42:32.893711+0000","last_clean":"2024-08-19T00:42:32.893711+0000","last_became_active":"2024-08-19T00:42:31.885206+0000","last_became_peered":"2024-08-19T00:42:31.885206+0000","last_unstale":"2024-08-19T00:42:32.893711+0000","last_undegraded":"2024-08-19T00:42:32.893711+0000","last_fullsized":"2024-08-19T00:42:32.893711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:32.852505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568365+0000","last_change":"2024-08-19T00:42:31.894185+0000","last_active":"2024-08-19T00:42:34.568365+0000","last_peered":"2024-08-19T00:42:34.568365+0000","last_clean":"2024-08-19T00:42:34.568365+0000","last_became_active":"2024-08-19T00:42:31.893898+0000","last_became_peered":"2024-08-19T00:42:31.893898+0000","last_unstale":"2024-08-19T00:42:34.568365+0000","last_undegraded":"2024-08-19T00:42:34.568365+0000","last_fullsized":"2024-08-19T00:42:34.568365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:17.571252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569398+0000","last_change":"2024-08-19T00:42:31.885950+0000","last_active":"2024-08-19T00:42:34.569398+0000","last_peered":"2024-08-19T00:42:34.569398+0000","last_clean":"2024-08-19T00:42:34.569398+0000","last_became_active":"2024-08-19T00:42:31.885694+0000","last_became_peered":"2024-08-19T00:42:31.885694+0000","last_unstale":"2024-08-19T00:42:34.569398+0000","last_undegraded":"2024-08-19T00:42:34.569398+0000","last_fullsized":"2024-08-19T00:42:34.569398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:21.154615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567913+0000","last_change":"2024-08-19T00:42:31.878908+0000","last_active":"2024-08-19T00:42:34.567913+0000","last_peered":"2024-08-19T00:42:34.567913+0000","last_clean":"2024-08-19T00:42:34.567913+0000","last_became_active":"2024-08-19T00:42:31.878488+0000","last_became_peered":"2024-08-19T00:42:31.878488+0000","last_unstale":"2024-08-19T00:42:34.567913+0000","last_undegraded":"2024-08-19T00:42:34.567913+0000","last_fullsized":"2024-08-19T00:42:34.567913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:44.470150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567690+0000","last_change":"2024-08-19T00:42:31.887088+0000","last_active":"2024-08-19T00:42:34.567690+0000","last_peered":"2024-08-19T00:42:34.567690+0000","last_clean":"2024-08-19T00:42:34.567690+0000","last_became_active":"2024-08-19T00:42:31.885743+0000","last_became_peered":"2024-08-19T00:42:31.885743+0000","last_unstale":"2024-08-19T00:42:34.567690+0000","last_undegraded":"2024-08-19T00:42:34.567690+0000","last_fullsized":"2024-08-19T00:42:34.567690+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:50.077709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893181+0000","last_change":"2024-08-19T00:42:31.875221+0000","last_active":"2024-08-19T00:42:32.893181+0000","last_peered":"2024-08-19T00:42:32.893181+0000","last_clean":"2024-08-19T00:42:32.893181+0000","last_became_active":"2024-08-19T00:42:31.874839+0000","last_became_peered":"2024-08-19T00:42:31.874839+0000","last_unstale":"2024-08-19T00:42:32.893181+0000","last_undegraded":"2024-08-19T00:42:32.893181+0000","last_fullsized":"2024-08-19T00:42:32.893181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:54.455117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569350+0000","last_change":"2024-08-19T00:42:31.886224+0000","last_active":"2024-08-19T00:42:34.569350+0000","last_peered":"2024-08-19T00:42:34.569350+0000","last_clean":"2024-08-19T00:42:34.569350+0000","last_became_active":"2024-08-19T00:42:31.885903+0000","last_became_peered":"2024-08-19T00:42:31.885903+0000","last_unstale":"2024-08-19T00:42:34.569350+0000","last_undegraded":"2024-08-19T00:42:34.569350+0000","last_fullsized":"2024-08-19T00:42:34.569350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:55.671954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569303+0000","last_change":"2024-08-19T00:42:31.898362+0000","last_active":"2024-08-19T00:42:34.569303+0000","last_peered":"2024-08-19T00:42:34.569303+0000","last_clean":"2024-08-19T00:42:34.569303+0000","last_became_active":"2024-08-19T00:42:31.897908+0000","last_became_peered":"2024-08-19T00:42:31.897908+0000","last_unstale":"2024-08-19T00:42:34.569303+0000","last_undegraded":"2024-08-19T00:42:34.569303+0000","last_fullsized":"2024-08-19T00:42:34.569303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:39.438484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893591+0000","last_change":"2024-08-19T00:42:31.896689+0000","last_active":"2024-08-19T00:42:32.893591+0000","last_peered":"2024-08-19T00:42:32.893591+0000","last_clean":"2024-08-19T00:42:32.893591+0000","last_became_active":"2024-08-19T00:42:31.896361+0000","last_became_peered":"2024-08-19T00:42:31.896361+0000","last_unstale":"2024-08-19T00:42:32.893591+0000","last_undegraded":"2024-08-19T00:42:32.893591+0000","last_fullsized":"2024-08-19T00:42:32.893591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:34.897764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569011+0000","last_change":"2024-08-19T00:42:31.889606+0000","last_active":"2024-08-19T00:42:34.569011+0000","last_peered":"2024-08-19T00:42:34.569011+0000","last_clean":"2024-08-19T00:42:34.569011+0000","last_became_active":"2024-08-19T00:42:31.889295+0000","last_became_peered":"2024-08-19T00:42:31.889295+0000","last_unstale":"2024-08-19T00:42:34.569011+0000","last_undegraded":"2024-08-19T00:42:34.569011+0000","last_fullsized":"2024-08-19T00:42:34.569011+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:59.094705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869305+0000","last_change":"2024-08-19T00:42:31.892500+0000","last_active":"2024-08-19T00:42:32.869305+0000","last_peered":"2024-08-19T00:42:32.869305+0000","last_clean":"2024-08-19T00:42:32.869305+0000","last_became_active":"2024-08-19T00:42:31.892123+0000","last_became_peered":"2024-08-19T00:42:31.892123+0000","last_unstale":"2024-08-19T00:42:32.869305+0000","last_undegraded":"2024-08-19T00:42:32.869305+0000","last_fullsized":"2024-08-19T00:42:32.869305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:29.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871904+0000","last_change":"2024-08-19T00:42:31.889746+0000","last_active":"2024-08-19T00:42:32.871904+0000","last_peered":"2024-08-19T00:42:32.871904+0000","last_clean":"2024-08-19T00:42:32.871904+0000","last_became_active":"2024-08-19T00:42:31.889449+0000","last_became_peered":"2024-08-19T00:42:31.889449+0000","last_unstale":"2024-08-19T00:42:32.871904+0000","last_undegraded":"2024-08-19T00:42:32.871904+0000","last_fullsized":"2024-08-19T00:42:32.871904+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:37.985664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872176+0000","last_change":"2024-08-19T00:42:31.879729+0000","last_active":"2024-08-19T00:42:32.872176+0000","last_peered":"2024-08-19T00:42:32.872176+0000","last_clean":"2024-08-19T00:42:32.872176+0000","last_became_active":"2024-08-19T00:42:31.878400+0000","last_became_peered":"2024-08-19T00:42:31.878400+0000","last_unstale":"2024-08-19T00:42:32.872176+0000","last_undegraded":"2024-08-19T00:42:32.872176+0000","last_fullsized":"2024-08-19T00:42:32.872176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:32.583705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893373+0000","last_change":"2024-08-19T00:42:31.883770+0000","last_active":"2024-08-19T00:42:32.893373+0000","last_peered":"2024-08-19T00:42:32.893373+0000","last_clean":"2024-08-19T00:42:32.893373+0000","last_became_active":"2024-08-19T00:42:31.883322+0000","last_became_peered":"2024-08-19T00:42:31.883322+0000","last_unstale":"2024-08-19T00:42:32.893373+0000","last_undegraded":"2024-08-19T00:42:32.893373+0000","last_fullsized":"2024-08-19T00:42:32.893373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:55.671954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872917+0000","last_change":"2024-08-19T00:42:31.880675+0000","last_active":"2024-08-19T00:42:32.872917+0000","last_peered":"2024-08-19T00:42:32.872917+0000","last_clean":"2024-08-19T00:42:32.872917+0000","last_became_active":"2024-08-19T00:42:31.880274+0000","last_became_peered":"2024-08-19T00:42:31.880274+0000","last_unstale":"2024-08-19T00:42:32.872917+0000","last_undegraded":"2024-08-19T00:42:32.872917+0000","last_fullsized":"2024-08-19T00:42:32.872917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:54.995370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893541+0000","last_change":"2024-08-19T00:42:31.885252+0000","last_active":"2024-08-19T00:42:32.893541+0000","last_peered":"2024-08-19T00:42:32.893541+0000","last_clean":"2024-08-19T00:42:32.893541+0000","last_became_active":"2024-08-19T00:42:31.882040+0000","last_became_peered":"2024-08-19T00:42:31.882040+0000","last_unstale":"2024-08-19T00:42:32.893541+0000","last_undegraded":"2024-08-19T00:42:32.893541+0000","last_fullsized":"2024-08-19T00:42:32.893541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:57:14.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569191+0000","last_change":"2024-08-19T00:42:31.892814+0000","last_active":"2024-08-19T00:42:34.569191+0000","last_peered":"2024-08-19T00:42:34.569191+0000","last_clean":"2024-08-19T00:42:34.569191+0000","last_became_active":"2024-08-19T00:42:31.892282+0000","last_became_peered":"2024-08-19T00:42:31.892282+0000","last_unstale":"2024-08-19T00:42:34.569191+0000","last_undegraded":"2024-08-19T00:42:34.569191+0000","last_fullsized":"2024-08-19T00:42:34.569191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:39.104819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869520+0000","last_change":"2024-08-19T00:42:31.897877+0000","last_active":"2024-08-19T00:42:32.869520+0000","last_peered":"2024-08-19T00:42:32.869520+0000","last_clean":"2024-08-19T00:42:32.869520+0000","last_became_active":"2024-08-19T00:42:31.895922+0000","last_became_peered":"2024-08-19T00:42:31.895922+0000","last_unstale":"2024-08-19T00:42:32.869520+0000","last_undegraded":"2024-08-19T00:42:32.869520+0000","last_fullsized":"2024-08-19T00:42:32.869520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569247+0000","last_change":"2024-08-19T00:42:31.893374+0000","last_active":"2024-08-19T00:42:34.569247+0000","last_peered":"2024-08-19T00:42:34.569247+0000","last_clean":"2024-08-19T00:42:34.569247+0000","last_became_active":"2024-08-19T00:42:31.893015+0000","last_became_peered":"2024-08-19T00:42:31.893015+0000","last_unstale":"2024-08-19T00:42:34.569247+0000","last_undegraded":"2024-08-19T00:42:34.569247+0000","last_fullsized":"2024-08-19T00:42:34.569247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:09.038340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893334+0000","last_change":"2024-08-19T00:42:31.895140+0000","last_active":"2024-08-19T00:42:32.893334+0000","last_peered":"2024-08-19T00:42:32.893334+0000","last_clean":"2024-08-19T00:42:32.893334+0000","last_became_active":"2024-08-19T00:42:31.894866+0000","last_became_peered":"2024-08-19T00:42:31.894866+0000","last_unstale":"2024-08-19T00:42:32.893334+0000","last_undegraded":"2024-08-19T00:42:32.893334+0000","last_fullsized":"2024-08-19T00:42:32.893334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:39.438484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868929+0000","last_change":"2024-08-19T00:42:31.896289+0000","last_active":"2024-08-19T00:42:32.868929+0000","last_peered":"2024-08-19T00:42:32.868929+0000","last_clean":"2024-08-19T00:42:32.868929+0000","last_became_active":"2024-08-19T00:42:31.896025+0000","last_became_peered":"2024-08-19T00:42:31.896025+0000","last_unstale":"2024-08-19T00:42:32.868929+0000","last_undegraded":"2024-08-19T00:42:32.868929+0000","last_fullsized":"2024-08-19T00:42:32.868929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:29.342491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868945+0000","last_change":"2024-08-19T00:42:31.896076+0000","last_active":"2024-08-19T00:42:32.868945+0000","last_peered":"2024-08-19T00:42:32.868945+0000","last_clean":"2024-08-19T00:42:32.868945+0000","last_became_active":"2024-08-19T00:42:31.895763+0000","last_became_peered":"2024-08-19T00:42:31.895763+0000","last_unstale":"2024-08-19T00:42:32.868945+0000","last_undegraded":"2024-08-19T00:42:32.868945+0000","last_fullsized":"2024-08-19T00:42:32.868945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:27.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893563+0000","last_change":"2024-08-19T00:42:31.882293+0000","last_active":"2024-08-19T00:42:32.893563+0000","last_peered":"2024-08-19T00:42:32.893563+0000","last_clean":"2024-08-19T00:42:32.893563+0000","last_became_active":"2024-08-19T00:42:31.881686+0000","last_became_peered":"2024-08-19T00:42:31.881686+0000","last_unstale":"2024-08-19T00:42:32.893563+0000","last_undegraded":"2024-08-19T00:42:32.893563+0000","last_fullsized":"2024-08-19T00:42:32.893563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:46.130758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872076+0000","last_change":"2024-08-19T00:42:30.876351+0000","last_active":"2024-08-19T00:42:32.872076+0000","last_peered":"2024-08-19T00:42:32.872076+0000","last_clean":"2024-08-19T00:42:32.872076+0000","last_became_active":"2024-08-19T00:42:30.875237+0000","last_became_peered":"2024-08-19T00:42:30.875237+0000","last_unstale":"2024-08-19T00:42:32.872076+0000","last_undegraded":"2024-08-19T00:42:32.872076+0000","last_fullsized":"2024-08-19T00:42:32.872076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:28.336385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569513+0000","last_change":"2024-08-19T00:42:31.893435+0000","last_active":"2024-08-19T00:42:34.569513+0000","last_peered":"2024-08-19T00:42:34.569513+0000","last_clean":"2024-08-19T00:42:34.569513+0000","last_became_active":"2024-08-19T00:42:31.891803+0000","last_became_peered":"2024-08-19T00:42:31.891803+0000","last_unstale":"2024-08-19T00:42:34.569513+0000","last_undegraded":"2024-08-19T00:42:34.569513+0000","last_fullsized":"2024-08-19T00:42:34.569513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:32:57.741470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569403+0000","last_change":"2024-08-19T00:42:30.874989+0000","last_active":"2024-08-19T00:42:34.569403+0000","last_peered":"2024-08-19T00:42:34.569403+0000","last_clean":"2024-08-19T00:42:34.569403+0000","last_became_active":"2024-08-19T00:42:30.873531+0000","last_became_peered":"2024-08-19T00:42:30.873531+0000","last_unstale":"2024-08-19T00:42:34.569403+0000","last_undegraded":"2024-08-19T00:42:34.569403+0000","last_fullsized":"2024-08-19T00:42:34.569403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:36.979558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871886+0000","last_change":"2024-08-19T00:42:31.894145+0000","last_active":"2024-08-19T00:42:32.871886+0000","last_peered":"2024-08-19T00:42:32.871886+0000","last_clean":"2024-08-19T00:42:32.871886+0000","last_became_active":"2024-08-19T00:42:31.893868+0000","last_became_peered":"2024-08-19T00:42:31.893868+0000","last_unstale":"2024-08-19T00:42:32.871886+0000","last_undegraded":"2024-08-19T00:42:32.871886+0000","last_fullsized":"2024-08-19T00:42:32.871886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:13.096377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893662+0000","last_change":"2024-08-19T00:42:30.864301+0000","last_active":"2024-08-19T00:42:32.893662+0000","last_peered":"2024-08-19T00:42:32.893662+0000","last_clean":"2024-08-19T00:42:32.893662+0000","last_became_active":"2024-08-19T00:42:30.862890+0000","last_became_peered":"2024-08-19T00:42:30.862890+0000","last_unstale":"2024-08-19T00:42:32.893662+0000","last_undegraded":"2024-08-19T00:42:32.893662+0000","last_fullsized":"2024-08-19T00:42:32.893662+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:40:55.120952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872671+0000","last_change":"2024-08-19T00:42:31.888776+0000","last_active":"2024-08-19T00:42:32.872671+0000","last_peered":"2024-08-19T00:42:32.872671+0000","last_clean":"2024-08-19T00:42:32.872671+0000","last_became_active":"2024-08-19T00:42:31.888495+0000","last_became_peered":"2024-08-19T00:42:31.888495+0000","last_unstale":"2024-08-19T00:42:32.872671+0000","last_undegraded":"2024-08-19T00:42:32.872671+0000","last_fullsized":"2024-08-19T00:42:32.872671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:30.401352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871890+0000","last_change":"2024-08-19T00:42:30.878407+0000","last_active":"2024-08-19T00:42:32.871890+0000","last_peered":"2024-08-19T00:42:32.871890+0000","last_clean":"2024-08-19T00:42:32.871890+0000","last_became_active":"2024-08-19T00:42:30.876759+0000","last_became_peered":"2024-08-19T00:42:30.876759+0000","last_unstale":"2024-08-19T00:42:32.871890+0000","last_undegraded":"2024-08-19T00:42:32.871890+0000","last_fullsized":"2024-08-19T00:42:32.871890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:10.187178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893419+0000","last_change":"2024-08-19T00:42:31.888942+0000","last_active":"2024-08-19T00:42:32.893419+0000","last_peered":"2024-08-19T00:42:32.893419+0000","last_clean":"2024-08-19T00:42:32.893419+0000","last_became_active":"2024-08-19T00:42:31.885920+0000","last_became_peered":"2024-08-19T00:42:31.885920+0000","last_unstale":"2024-08-19T00:42:32.893419+0000","last_undegraded":"2024-08-19T00:42:32.893419+0000","last_fullsized":"2024-08-19T00:42:32.893419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:37.597826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568070+0000","last_change":"2024-08-19T00:42:30.874056+0000","last_active":"2024-08-19T00:42:34.568070+0000","last_peered":"2024-08-19T00:42:34.568070+0000","last_clean":"2024-08-19T00:42:34.568070+0000","last_became_active":"2024-08-19T00:42:30.873658+0000","last_became_peered":"2024-08-19T00:42:30.873658+0000","last_unstale":"2024-08-19T00:42:34.568070+0000","last_undegraded":"2024-08-19T00:42:34.568070+0000","last_fullsized":"2024-08-19T00:42:34.568070+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:41:46.915388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871643+0000","last_change":"2024-08-19T00:42:31.892760+0000","last_active":"2024-08-19T00:42:32.871643+0000","last_peered":"2024-08-19T00:42:32.871643+0000","last_clean":"2024-08-19T00:42:32.871643+0000","last_became_active":"2024-08-19T00:42:31.892474+0000","last_became_peered":"2024-08-19T00:42:31.892474+0000","last_unstale":"2024-08-19T00:42:32.871643+0000","last_undegraded":"2024-08-19T00:42:32.871643+0000","last_fullsized":"2024-08-19T00:42:32.871643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:33.985970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872250+0000","last_change":"2024-08-19T00:42:30.875439+0000","last_active":"2024-08-19T00:42:32.872250+0000","last_peered":"2024-08-19T00:42:32.872250+0000","last_clean":"2024-08-19T00:42:32.872250+0000","last_became_active":"2024-08-19T00:42:30.875169+0000","last_became_peered":"2024-08-19T00:42:30.875169+0000","last_unstale":"2024-08-19T00:42:32.872250+0000","last_undegraded":"2024-08-19T00:42:32.872250+0000","last_fullsized":"2024-08-19T00:42:32.872250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:16:55.713900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421449+0000","last_change":"2024-08-19T00:42:31.898698+0000","last_active":"2024-08-19T00:42:34.421449+0000","last_peered":"2024-08-19T00:42:34.421449+0000","last_clean":"2024-08-19T00:42:34.421449+0000","last_became_active":"2024-08-19T00:42:31.898372+0000","last_became_peered":"2024-08-19T00:42:31.898372+0000","last_unstale":"2024-08-19T00:42:34.421449+0000","last_undegraded":"2024-08-19T00:42:34.421449+0000","last_fullsized":"2024-08-19T00:42:34.421449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:11.193284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421422+0000","last_change":"2024-08-19T00:42:30.877280+0000","last_active":"2024-08-19T00:42:34.421422+0000","last_peered":"2024-08-19T00:42:34.421422+0000","last_clean":"2024-08-19T00:42:34.421422+0000","last_became_active":"2024-08-19T00:42:30.876858+0000","last_became_peered":"2024-08-19T00:42:30.876858+0000","last_unstale":"2024-08-19T00:42:34.421422+0000","last_undegraded":"2024-08-19T00:42:34.421422+0000","last_fullsized":"2024-08-19T00:42:34.421422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:37.372124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567781+0000","last_change":"2024-08-19T00:42:31.883278+0000","last_active":"2024-08-19T00:42:34.567781+0000","last_peered":"2024-08-19T00:42:34.567781+0000","last_clean":"2024-08-19T00:42:34.567781+0000","last_became_active":"2024-08-19T00:42:31.882116+0000","last_became_peered":"2024-08-19T00:42:31.882116+0000","last_unstale":"2024-08-19T00:42:34.567781+0000","last_undegraded":"2024-08-19T00:42:34.567781+0000","last_fullsized":"2024-08-19T00:42:34.567781+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:39.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567571+0000","last_change":"2024-08-19T00:42:30.871250+0000","last_active":"2024-08-19T00:42:34.567571+0000","last_peered":"2024-08-19T00:42:34.567571+0000","last_clean":"2024-08-19T00:42:34.567571+0000","last_became_active":"2024-08-19T00:42:30.870892+0000","last_became_peered":"2024-08-19T00:42:30.870892+0000","last_unstale":"2024-08-19T00:42:34.567571+0000","last_undegraded":"2024-08-19T00:42:34.567571+0000","last_fullsized":"2024-08-19T00:42:34.567571+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:49:11.301605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872985+0000","last_change":"2024-08-19T00:42:31.878514+0000","last_active":"2024-08-19T00:42:32.872985+0000","last_peered":"2024-08-19T00:42:32.872985+0000","last_clean":"2024-08-19T00:42:32.872985+0000","last_became_active":"2024-08-19T00:42:31.878252+0000","last_became_peered":"2024-08-19T00:42:31.878252+0000","last_unstale":"2024-08-19T00:42:32.872985+0000","last_undegraded":"2024-08-19T00:42:32.872985+0000","last_fullsized":"2024-08-19T00:42:32.872985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:38.562669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893420+0000","last_change":"2024-08-19T00:42:30.865323+0000","last_active":"2024-08-19T00:42:32.893420+0000","last_peered":"2024-08-19T00:42:32.893420+0000","last_clean":"2024-08-19T00:42:32.893420+0000","last_became_active":"2024-08-19T00:42:30.865027+0000","last_became_peered":"2024-08-19T00:42:30.865027+0000","last_unstale":"2024-08-19T00:42:32.893420+0000","last_undegraded":"2024-08-19T00:42:32.893420+0000","last_fullsized":"2024-08-19T00:42:32.893420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:36.979558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869300+0000","last_change":"2024-08-19T00:42:31.883957+0000","last_active":"2024-08-19T00:42:32.869300+0000","last_peered":"2024-08-19T00:42:32.869300+0000","last_clean":"2024-08-19T00:42:32.869300+0000","last_became_active":"2024-08-19T00:42:31.883574+0000","last_became_peered":"2024-08-19T00:42:31.883574+0000","last_unstale":"2024-08-19T00:42:32.869300+0000","last_undegraded":"2024-08-19T00:42:32.869300+0000","last_fullsized":"2024-08-19T00:42:32.869300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:39.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869319+0000","last_change":"2024-08-19T00:42:30.880554+0000","last_active":"2024-08-19T00:42:32.869319+0000","last_peered":"2024-08-19T00:42:32.869319+0000","last_clean":"2024-08-19T00:42:32.869319+0000","last_became_active":"2024-08-19T00:42:30.880233+0000","last_became_peered":"2024-08-19T00:42:30.880233+0000","last_unstale":"2024-08-19T00:42:32.869319+0000","last_undegraded":"2024-08-19T00:42:32.869319+0000","last_fullsized":"2024-08-19T00:42:32.869319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:06.057201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893444+0000","last_change":"2024-08-19T00:42:31.875514+0000","last_active":"2024-08-19T00:42:32.893444+0000","last_peered":"2024-08-19T00:42:32.893444+0000","last_clean":"2024-08-19T00:42:32.893444+0000","last_became_active":"2024-08-19T00:42:31.875203+0000","last_became_peered":"2024-08-19T00:42:31.875203+0000","last_unstale":"2024-08-19T00:42:32.893444+0000","last_undegraded":"2024-08-19T00:42:32.893444+0000","last_fullsized":"2024-08-19T00:42:32.893444+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:36.319084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568114+0000","last_change":"2024-08-19T00:42:30.876755+0000","last_active":"2024-08-19T00:42:34.568114+0000","last_peered":"2024-08-19T00:42:34.568114+0000","last_clean":"2024-08-19T00:42:34.568114+0000","last_became_active":"2024-08-19T00:42:30.876439+0000","last_became_peered":"2024-08-19T00:42:30.876439+0000","last_unstale":"2024-08-19T00:42:34.568114+0000","last_undegraded":"2024-08-19T00:42:34.568114+0000","last_fullsized":"2024-08-19T00:42:34.568114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:51:45.203488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569177+0000","last_change":"2024-08-19T00:42:31.892636+0000","last_active":"2024-08-19T00:42:34.569177+0000","last_peered":"2024-08-19T00:42:34.569177+0000","last_clean":"2024-08-19T00:42:34.569177+0000","last_became_active":"2024-08-19T00:42:31.891939+0000","last_became_peered":"2024-08-19T00:42:31.891939+0000","last_unstale":"2024-08-19T00:42:34.569177+0000","last_undegraded":"2024-08-19T00:42:34.569177+0000","last_fullsized":"2024-08-19T00:42:34.569177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:54.455117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421544+0000","last_change":"2024-08-19T00:42:30.880160+0000","last_active":"2024-08-19T00:42:34.421544+0000","last_peered":"2024-08-19T00:42:34.421544+0000","last_clean":"2024-08-19T00:42:34.421544+0000","last_became_active":"2024-08-19T00:42:30.879495+0000","last_became_peered":"2024-08-19T00:42:30.879495+0000","last_unstale":"2024-08-19T00:42:34.421544+0000","last_undegraded":"2024-08-19T00:42:34.421544+0000","last_fullsized":"2024-08-19T00:42:34.421544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:51:45.203488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871719+0000","last_change":"2024-08-19T00:42:31.893631+0000","last_active":"2024-08-19T00:42:32.871719+0000","last_peered":"2024-08-19T00:42:32.871719+0000","last_clean":"2024-08-19T00:42:32.871719+0000","last_became_active":"2024-08-19T00:42:31.892641+0000","last_became_peered":"2024-08-19T00:42:31.892641+0000","last_unstale":"2024-08-19T00:42:32.871719+0000","last_undegraded":"2024-08-19T00:42:32.871719+0000","last_fullsized":"2024-08-19T00:42:32.871719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:41.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421245+0000","last_change":"2024-08-19T00:42:30.881772+0000","last_active":"2024-08-19T00:42:34.421245+0000","last_peered":"2024-08-19T00:42:34.421245+0000","last_clean":"2024-08-19T00:42:34.421245+0000","last_became_active":"2024-08-19T00:42:30.881489+0000","last_became_peered":"2024-08-19T00:42:30.881489+0000","last_unstale":"2024-08-19T00:42:34.421245+0000","last_undegraded":"2024-08-19T00:42:34.421245+0000","last_fullsized":"2024-08-19T00:42:34.421245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:41:46.915388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872374+0000","last_change":"2024-08-19T00:42:31.889060+0000","last_active":"2024-08-19T00:42:32.872374+0000","last_peered":"2024-08-19T00:42:32.872374+0000","last_clean":"2024-08-19T00:42:32.872374+0000","last_became_active":"2024-08-19T00:42:31.888413+0000","last_became_peered":"2024-08-19T00:42:31.888413+0000","last_unstale":"2024-08-19T00:42:32.872374+0000","last_undegraded":"2024-08-19T00:42:32.872374+0000","last_fullsized":"2024-08-19T00:42:32.872374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:31:34.849158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872299+0000","last_change":"2024-08-19T00:42:30.875349+0000","last_active":"2024-08-19T00:42:32.872299+0000","last_peered":"2024-08-19T00:42:32.872299+0000","last_clean":"2024-08-19T00:42:32.872299+0000","last_became_active":"2024-08-19T00:42:30.875068+0000","last_became_peered":"2024-08-19T00:42:30.875068+0000","last_unstale":"2024-08-19T00:42:32.872299+0000","last_undegraded":"2024-08-19T00:42:32.872299+0000","last_fullsized":"2024-08-19T00:42:32.872299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:49.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568649+0000","last_change":"2024-08-19T00:42:31.884205+0000","last_active":"2024-08-19T00:42:34.568649+0000","last_peered":"2024-08-19T00:42:34.568649+0000","last_clean":"2024-08-19T00:42:34.568649+0000","last_became_active":"2024-08-19T00:42:31.883930+0000","last_became_peered":"2024-08-19T00:42:31.883930+0000","last_unstale":"2024-08-19T00:42:34.568649+0000","last_undegraded":"2024-08-19T00:42:34.568649+0000","last_fullsized":"2024-08-19T00:42:34.568649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:12.996891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872178+0000","last_change":"2024-08-19T00:42:30.878500+0000","last_active":"2024-08-19T00:42:32.872178+0000","last_peered":"2024-08-19T00:42:32.872178+0000","last_clean":"2024-08-19T00:42:32.872178+0000","last_became_active":"2024-08-19T00:42:30.877428+0000","last_became_peered":"2024-08-19T00:42:30.877428+0000","last_unstale":"2024-08-19T00:42:32.872178+0000","last_undegraded":"2024-08-19T00:42:32.872178+0000","last_fullsized":"2024-08-19T00:42:32.872178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:28:58.973103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568356+0000","last_change":"2024-08-19T00:42:31.894072+0000","last_active":"2024-08-19T00:42:34.568356+0000","last_peered":"2024-08-19T00:42:34.568356+0000","last_clean":"2024-08-19T00:42:34.568356+0000","last_became_active":"2024-08-19T00:42:31.893794+0000","last_became_peered":"2024-08-19T00:42:31.893794+0000","last_unstale":"2024-08-19T00:42:34.568356+0000","last_undegraded":"2024-08-19T00:42:34.568356+0000","last_fullsized":"2024-08-19T00:42:34.568356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:57:47.386304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871831+0000","last_change":"2024-08-19T00:42:30.881547+0000","last_active":"2024-08-19T00:42:32.871831+0000","last_peered":"2024-08-19T00:42:32.871831+0000","last_clean":"2024-08-19T00:42:32.871831+0000","last_became_active":"2024-08-19T00:42:30.881265+0000","last_became_peered":"2024-08-19T00:42:30.881265+0000","last_unstale":"2024-08-19T00:42:32.871831+0000","last_undegraded":"2024-08-19T00:42:32.871831+0000","last_fullsized":"2024-08-19T00:42:32.871831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:57:16.076383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869329+0000","last_change":"2024-08-19T00:42:31.887426+0000","last_active":"2024-08-19T00:42:32.869329+0000","last_peered":"2024-08-19T00:42:32.869329+0000","last_clean":"2024-08-19T00:42:32.869329+0000","last_became_active":"2024-08-19T00:42:31.887148+0000","last_became_peered":"2024-08-19T00:42:31.887148+0000","last_unstale":"2024-08-19T00:42:32.869329+0000","last_undegraded":"2024-08-19T00:42:32.869329+0000","last_fullsized":"2024-08-19T00:42:32.869329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:44.470150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893557+0000","last_change":"2024-08-19T00:42:30.872013+0000","last_active":"2024-08-19T00:42:32.893557+0000","last_peered":"2024-08-19T00:42:32.893557+0000","last_clean":"2024-08-19T00:42:32.893557+0000","last_became_active":"2024-08-19T00:42:30.871480+0000","last_became_peered":"2024-08-19T00:42:30.871480+0000","last_unstale":"2024-08-19T00:42:32.893557+0000","last_undegraded":"2024-08-19T00:42:32.893557+0000","last_fullsized":"2024-08-19T00:42:32.893557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:12.090271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869395+0000","last_change":"2024-08-19T00:42:31.876897+0000","last_active":"2024-08-19T00:42:32.869395+0000","last_peered":"2024-08-19T00:42:32.869395+0000","last_clean":"2024-08-19T00:42:32.869395+0000","last_became_active":"2024-08-19T00:42:31.876636+0000","last_became_peered":"2024-08-19T00:42:31.876636+0000","last_unstale":"2024-08-19T00:42:32.869395+0000","last_undegraded":"2024-08-19T00:42:32.869395+0000","last_fullsized":"2024-08-19T00:42:32.869395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:17.571252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869378+0000","last_change":"2024-08-19T00:42:30.878637+0000","last_active":"2024-08-19T00:42:32.869378+0000","last_peered":"2024-08-19T00:42:32.869378+0000","last_clean":"2024-08-19T00:42:32.869378+0000","last_became_active":"2024-08-19T00:42:30.878243+0000","last_became_peered":"2024-08-19T00:42:30.878243+0000","last_unstale":"2024-08-19T00:42:32.869378+0000","last_undegraded":"2024-08-19T00:42:32.869378+0000","last_fullsized":"2024-08-19T00:42:32.869378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:37.556563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568776+0000","last_change":"2024-08-19T00:42:31.887946+0000","last_active":"2024-08-19T00:42:34.568776+0000","last_peered":"2024-08-19T00:42:34.568776+0000","last_clean":"2024-08-19T00:42:34.568776+0000","last_became_active":"2024-08-19T00:42:31.887661+0000","last_became_peered":"2024-08-19T00:42:31.887661+0000","last_unstale":"2024-08-19T00:42:34.568776+0000","last_undegraded":"2024-08-19T00:42:34.568776+0000","last_fullsized":"2024-08-19T00:42:34.568776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:44:32.547545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869046+0000","last_change":"2024-08-19T00:42:30.881753+0000","last_active":"2024-08-19T00:42:32.869046+0000","last_peered":"2024-08-19T00:42:32.869046+0000","last_clean":"2024-08-19T00:42:32.869046+0000","last_became_active":"2024-08-19T00:42:30.881466+0000","last_became_peered":"2024-08-19T00:42:30.881466+0000","last_unstale":"2024-08-19T00:42:32.869046+0000","last_undegraded":"2024-08-19T00:42:32.869046+0000","last_fullsized":"2024-08-19T00:42:32.869046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:37.954772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568878+0000","last_change":"2024-08-19T00:42:31.892617+0000","last_active":"2024-08-19T00:42:34.568878+0000","last_peered":"2024-08-19T00:42:34.568878+0000","last_clean":"2024-08-19T00:42:34.568878+0000","last_became_active":"2024-08-19T00:42:31.892276+0000","last_became_peered":"2024-08-19T00:42:31.892276+0000","last_unstale":"2024-08-19T00:42:34.568878+0000","last_undegraded":"2024-08-19T00:42:34.568878+0000","last_fullsized":"2024-08-19T00:42:34.568878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:33:25.241946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871934+0000","last_change":"2024-08-19T00:42:30.866089+0000","last_active":"2024-08-19T00:42:32.871934+0000","last_peered":"2024-08-19T00:42:32.871934+0000","last_clean":"2024-08-19T00:42:32.871934+0000","last_became_active":"2024-08-19T00:42:30.865832+0000","last_became_peered":"2024-08-19T00:42:30.865832+0000","last_unstale":"2024-08-19T00:42:32.871934+0000","last_undegraded":"2024-08-19T00:42:32.871934+0000","last_fullsized":"2024-08-19T00:42:32.871934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:31.060235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421696+0000","last_change":"2024-08-19T00:42:31.892028+0000","last_active":"2024-08-19T00:42:34.421696+0000","last_peered":"2024-08-19T00:42:34.421696+0000","last_clean":"2024-08-19T00:42:34.421696+0000","last_became_active":"2024-08-19T00:42:31.890732+0000","last_became_peered":"2024-08-19T00:42:31.890732+0000","last_unstale":"2024-08-19T00:42:34.421696+0000","last_undegraded":"2024-08-19T00:42:34.421696+0000","last_fullsized":"2024-08-19T00:42:34.421696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:32.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871783+0000","last_change":"2024-08-19T00:42:30.873159+0000","last_active":"2024-08-19T00:42:32.871783+0000","last_peered":"2024-08-19T00:42:32.871783+0000","last_clean":"2024-08-19T00:42:32.871783+0000","last_became_active":"2024-08-19T00:42:30.872850+0000","last_became_peered":"2024-08-19T00:42:30.872850+0000","last_unstale":"2024-08-19T00:42:32.871783+0000","last_undegraded":"2024-08-19T00:42:32.871783+0000","last_fullsized":"2024-08-19T00:42:32.871783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:26.723998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421657+0000","last_change":"2024-08-19T00:42:31.890778+0000","last_active":"2024-08-19T00:42:34.421657+0000","last_peered":"2024-08-19T00:42:34.421657+0000","last_clean":"2024-08-19T00:42:34.421657+0000","last_became_active":"2024-08-19T00:42:31.890405+0000","last_became_peered":"2024-08-19T00:42:31.890405+0000","last_unstale":"2024-08-19T00:42:34.421657+0000","last_undegraded":"2024-08-19T00:42:34.421657+0000","last_fullsized":"2024-08-19T00:42:34.421657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:29.342491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869000+0000","last_change":"2024-08-19T00:42:30.878991+0000","last_active":"2024-08-19T00:42:32.869000+0000","last_peered":"2024-08-19T00:42:32.869000+0000","last_clean":"2024-08-19T00:42:32.869000+0000","last_became_active":"2024-08-19T00:42:30.878693+0000","last_became_peered":"2024-08-19T00:42:30.878693+0000","last_unstale":"2024-08-19T00:42:32.869000+0000","last_undegraded":"2024-08-19T00:42:32.869000+0000","last_fullsized":"2024-08-19T00:42:32.869000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:12.874080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567844+0000","last_change":"2024-08-19T00:42:31.882782+0000","last_active":"2024-08-19T00:42:34.567844+0000","last_peered":"2024-08-19T00:42:34.567844+0000","last_clean":"2024-08-19T00:42:34.567844+0000","last_became_active":"2024-08-19T00:42:31.882156+0000","last_became_peered":"2024-08-19T00:42:31.882156+0000","last_unstale":"2024-08-19T00:42:34.567844+0000","last_undegraded":"2024-08-19T00:42:34.567844+0000","last_fullsized":"2024-08-19T00:42:34.567844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:29.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568485+0000","last_change":"2024-08-19T00:42:30.879982+0000","last_active":"2024-08-19T00:42:34.568485+0000","last_peered":"2024-08-19T00:42:34.568485+0000","last_clean":"2024-08-19T00:42:34.568485+0000","last_became_active":"2024-08-19T00:42:30.879231+0000","last_became_peered":"2024-08-19T00:42:30.879231+0000","last_unstale":"2024-08-19T00:42:34.568485+0000","last_undegraded":"2024-08-19T00:42:34.568485+0000","last_fullsized":"2024-08-19T00:42:34.568485+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:04:40.399211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569527+0000","last_change":"2024-08-19T00:42:31.893067+0000","last_active":"2024-08-19T00:42:34.569527+0000","last_peered":"2024-08-19T00:42:34.569527+0000","last_clean":"2024-08-19T00:42:34.569527+0000","last_became_active":"2024-08-19T00:42:31.892794+0000","last_became_peered":"2024-08-19T00:42:31.892794+0000","last_unstale":"2024-08-19T00:42:34.569527+0000","last_undegraded":"2024-08-19T00:42:34.569527+0000","last_fullsized":"2024-08-19T00:42:34.569527+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:36.319084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893771+0000","last_change":"2024-08-19T00:42:30.871757+0000","last_active":"2024-08-19T00:42:32.893771+0000","last_peered":"2024-08-19T00:42:32.893771+0000","last_clean":"2024-08-19T00:42:32.893771+0000","last_became_active":"2024-08-19T00:42:30.871122+0000","last_became_peered":"2024-08-19T00:42:30.871122+0000","last_unstale":"2024-08-19T00:42:32.893771+0000","last_undegraded":"2024-08-19T00:42:32.893771+0000","last_fullsized":"2024-08-19T00:42:32.893771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:04:40.399211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872982+0000","last_change":"2024-08-19T00:42:31.891953+0000","last_active":"2024-08-19T00:42:32.872982+0000","last_peered":"2024-08-19T00:42:32.872982+0000","last_clean":"2024-08-19T00:42:32.872982+0000","last_became_active":"2024-08-19T00:42:31.891707+0000","last_became_peered":"2024-08-19T00:42:31.891707+0000","last_unstale":"2024-08-19T00:42:32.872982+0000","last_undegraded":"2024-08-19T00:42:32.872982+0000","last_fullsized":"2024-08-19T00:42:32.872982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:38.960878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893665+0000","last_change":"2024-08-19T00:42:30.874040+0000","last_active":"2024-08-19T00:42:32.893665+0000","last_peered":"2024-08-19T00:42:32.893665+0000","last_clean":"2024-08-19T00:42:32.893665+0000","last_became_active":"2024-08-19T00:42:30.873726+0000","last_became_peered":"2024-08-19T00:42:30.873726+0000","last_unstale":"2024-08-19T00:42:32.893665+0000","last_undegraded":"2024-08-19T00:42:32.893665+0000","last_fullsized":"2024-08-19T00:42:32.893665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:40.847324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869524+0000","last_change":"2024-08-19T00:42:31.887602+0000","last_active":"2024-08-19T00:42:32.869524+0000","last_peered":"2024-08-19T00:42:32.869524+0000","last_clean":"2024-08-19T00:42:32.869524+0000","last_became_active":"2024-08-19T00:42:31.887337+0000","last_became_peered":"2024-08-19T00:42:31.887337+0000","last_unstale":"2024-08-19T00:42:32.869524+0000","last_undegraded":"2024-08-19T00:42:32.869524+0000","last_fullsized":"2024-08-19T00:42:32.869524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:19.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568151+0000","last_change":"2024-08-19T00:42:30.871473+0000","last_active":"2024-08-19T00:42:34.568151+0000","last_peered":"2024-08-19T00:42:34.568151+0000","last_clean":"2024-08-19T00:42:34.568151+0000","last_became_active":"2024-08-19T00:42:30.871055+0000","last_became_peered":"2024-08-19T00:42:30.871055+0000","last_unstale":"2024-08-19T00:42:34.568151+0000","last_undegraded":"2024-08-19T00:42:34.568151+0000","last_fullsized":"2024-08-19T00:42:34.568151+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:52:44.316677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872699+0000","last_change":"2024-08-19T00:42:31.883349+0000","last_active":"2024-08-19T00:42:32.872699+0000","last_peered":"2024-08-19T00:42:32.872699+0000","last_clean":"2024-08-19T00:42:32.872699+0000","last_became_active":"2024-08-19T00:42:31.883056+0000","last_became_peered":"2024-08-19T00:42:31.883056+0000","last_unstale":"2024-08-19T00:42:32.872699+0000","last_undegraded":"2024-08-19T00:42:32.872699+0000","last_fullsized":"2024-08-19T00:42:32.872699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:13.880186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568255+0000","last_change":"2024-08-19T00:42:30.875857+0000","last_active":"2024-08-19T00:42:34.568255+0000","last_peered":"2024-08-19T00:42:34.568255+0000","last_clean":"2024-08-19T00:42:34.568255+0000","last_became_active":"2024-08-19T00:42:30.875373+0000","last_became_peered":"2024-08-19T00:42:30.875373+0000","last_unstale":"2024-08-19T00:42:34.568255+0000","last_undegraded":"2024-08-19T00:42:34.568255+0000","last_fullsized":"2024-08-19T00:42:34.568255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:51.439813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569580+0000","last_change":"2024-08-19T00:42:31.886379+0000","last_active":"2024-08-19T00:42:34.569580+0000","last_peered":"2024-08-19T00:42:34.569580+0000","last_clean":"2024-08-19T00:42:34.569580+0000","last_became_active":"2024-08-19T00:42:31.886079+0000","last_became_peered":"2024-08-19T00:42:31.886079+0000","last_unstale":"2024-08-19T00:42:34.569580+0000","last_undegraded":"2024-08-19T00:42:34.569580+0000","last_fullsized":"2024-08-19T00:42:34.569580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:57:14.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568149+0000","last_change":"2024-08-19T00:42:30.874268+0000","last_active":"2024-08-19T00:42:34.568149+0000","last_peered":"2024-08-19T00:42:34.568149+0000","last_clean":"2024-08-19T00:42:34.568149+0000","last_became_active":"2024-08-19T00:42:30.873932+0000","last_became_peered":"2024-08-19T00:42:30.873932+0000","last_unstale":"2024-08-19T00:42:34.568149+0000","last_undegraded":"2024-08-19T00:42:34.568149+0000","last_fullsized":"2024-08-19T00:42:34.568149+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:25.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893643+0000","last_change":"2024-08-19T00:42:31.874543+0000","last_active":"2024-08-19T00:42:32.893643+0000","last_peered":"2024-08-19T00:42:32.893643+0000","last_clean":"2024-08-19T00:42:32.893643+0000","last_became_active":"2024-08-19T00:42:31.874203+0000","last_became_peered":"2024-08-19T00:42:31.874203+0000","last_unstale":"2024-08-19T00:42:32.893643+0000","last_undegraded":"2024-08-19T00:42:32.893643+0000","last_fullsized":"2024-08-19T00:42:32.893643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:28.520824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569528+0000","last_change":"2024-08-19T00:42:30.876424+0000","last_active":"2024-08-19T00:42:34.569528+0000","last_peered":"2024-08-19T00:42:34.569528+0000","last_clean":"2024-08-19T00:42:34.569528+0000","last_became_active":"2024-08-19T00:42:30.875552+0000","last_became_peered":"2024-08-19T00:42:30.875552+0000","last_unstale":"2024-08-19T00:42:34.569528+0000","last_undegraded":"2024-08-19T00:42:34.569528+0000","last_fullsized":"2024-08-19T00:42:34.569528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:12.090271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421678+0000","last_change":"2024-08-19T00:42:31.892453+0000","last_active":"2024-08-19T00:42:34.421678+0000","last_peered":"2024-08-19T00:42:34.421678+0000","last_clean":"2024-08-19T00:42:34.421678+0000","last_became_active":"2024-08-19T00:42:31.891426+0000","last_became_peered":"2024-08-19T00:42:31.891426+0000","last_unstale":"2024-08-19T00:42:34.421678+0000","last_undegraded":"2024-08-19T00:42:34.421678+0000","last_fullsized":"2024-08-19T00:42:34.421678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:27.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869225+0000","last_change":"2024-08-19T00:42:30.884148+0000","last_active":"2024-08-19T00:42:32.869225+0000","last_peered":"2024-08-19T00:42:32.869225+0000","last_clean":"2024-08-19T00:42:32.869225+0000","last_became_active":"2024-08-19T00:42:30.883741+0000","last_became_peered":"2024-08-19T00:42:30.883741+0000","last_unstale":"2024-08-19T00:42:32.869225+0000","last_undegraded":"2024-08-19T00:42:32.869225+0000","last_fullsized":"2024-08-19T00:42:32.869225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:53.989264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868881+0000","last_change":"2024-08-19T00:42:31.885879+0000","last_active":"2024-08-19T00:42:32.868881+0000","last_peered":"2024-08-19T00:42:32.868881+0000","last_clean":"2024-08-19T00:42:32.868881+0000","last_became_active":"2024-08-19T00:42:31.884773+0000","last_became_peered":"2024-08-19T00:42:31.884773+0000","last_unstale":"2024-08-19T00:42:32.868881+0000","last_undegraded":"2024-08-19T00:42:32.868881+0000","last_fullsized":"2024-08-19T00:42:32.868881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:32.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871394+0000","last_change":"2024-08-19T00:42:30.875606+0000","last_active":"2024-08-19T00:42:32.871394+0000","last_peered":"2024-08-19T00:42:32.871394+0000","last_clean":"2024-08-19T00:42:32.871394+0000","last_became_active":"2024-08-19T00:42:30.875023+0000","last_became_peered":"2024-08-19T00:42:30.875023+0000","last_unstale":"2024-08-19T00:42:32.871394+0000","last_undegraded":"2024-08-19T00:42:32.871394+0000","last_fullsized":"2024-08-19T00:42:32.871394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:20.569518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569466+0000","last_change":"2024-08-19T00:42:31.892816+0000","last_active":"2024-08-19T00:42:34.569466+0000","last_peered":"2024-08-19T00:42:34.569466+0000","last_clean":"2024-08-19T00:42:34.569466+0000","last_became_active":"2024-08-19T00:42:31.892543+0000","last_became_peered":"2024-08-19T00:42:31.892543+0000","last_unstale":"2024-08-19T00:42:34.569466+0000","last_undegraded":"2024-08-19T00:42:34.569466+0000","last_fullsized":"2024-08-19T00:42:34.569466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:37.597826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872371+0000","last_change":"2024-08-19T00:42:30.877958+0000","last_active":"2024-08-19T00:42:32.872371+0000","last_peered":"2024-08-19T00:42:32.872371+0000","last_clean":"2024-08-19T00:42:32.872371+0000","last_became_active":"2024-08-19T00:42:30.877702+0000","last_became_peered":"2024-08-19T00:42:30.877702+0000","last_unstale":"2024-08-19T00:42:32.872371+0000","last_undegraded":"2024-08-19T00:42:32.872371+0000","last_fullsized":"2024-08-19T00:42:32.872371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:37.610265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871881+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:42:32.871881+0000","last_peered":"2024-08-19T00:42:32.871881+0000","last_clean":"2024-08-19T00:42:32.871881+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:42:32.871881+0000","last_undegraded":"2024-08-19T00:42:32.871881+0000","last_fullsized":"2024-08-19T00:42:32.871881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":368554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":892928,"data_stored":374888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1462272,"data_stored":957400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":367636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":888832,"data_stored":373368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":963610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":373312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:42:40.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:42:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.963+0000 7f16d2400640 1 Processor -- start 2024-08-19T00:42:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.963+0000 7f16d2400640 1 -- start start 2024-08-19T00:42:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16d2400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16cc159bf0 0x7f16cc073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16d2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc0cec10 0x7f16cc0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16d2400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16cc06f7f0 con 0x7f16cc0739a0 2024-08-19T00:42:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16d2400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f16cc06f510 con 0x7f16cc159bf0 2024-08-19T00:42:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16d2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16cc072980 con 0x7f16cc0cec10 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16c2a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f16cc0739a0 0x7f16cc0ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44818/0 (socket says 172.21.15.7:44818) 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16c2a00640 1 -- 172.21.15.7:0/1085445586 learned_addr learned my addr 172.21.15.7:0/1085445586 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16cbe00640 1 --2- 172.21.15.7:0/1085445586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc0cec10 0x7f16cc0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.964+0000 7f16cb400640 1 --2- 172.21.15.7:0/1085445586 >> v2:172.21.15.162:3300/0 conn(0x7f16cc159bf0 0x7f16cc073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.965+0000 7f16caa00640 1 -- 172.21.15.7:0/1085445586 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936221221 0 0) 0x7f16cc06f7f0 con 0x7f16cc0739a0 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.965+0000 7f16caa00640 1 -- 172.21.15.7:0/1085445586 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16b0003520 con 0x7f16cc0739a0 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.965+0000 7f16cbe00640 1 -- 172.21.15.7:0/1085445586 >> v2:172.21.15.162:3300/0 conn(0x7f16cc159bf0 msgr2=0x7f16cc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.965+0000 7f16cbe00640 1 --2- 172.21.15.7:0/1085445586 >> v2:172.21.15.162:3300/0 conn(0x7f16cc159bf0 0x7f16cc073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.965+0000 7f16cbe00640 1 -- 172.21.15.7:0/1085445586 >> v1:172.21.15.7:6789/0 conn(0x7f16cc0739a0 legacy=0x7f16cc0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.965+0000 7f16cbe00640 1 -- 172.21.15.7:0/1085445586 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc072c60 con 0x7f16cc0cec10 2024-08-19T00:42:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.965+0000 7f16cb400640 1 --2- 172.21.15.7:0/1085445586 >> v2:172.21.15.162:3300/0 conn(0x7f16cc159bf0 0x7f16cc073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.966+0000 7f16cbe00640 1 --2- 172.21.15.7:0/1085445586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc0cec10 0x7f16cc0d03c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009d90 tx=0x7f16c402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c48c15307f7124f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.966+0000 7f16caa00640 1 -- 172.21.15.7:0/1085445586 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4031600 con 0x7f16cc0cec10 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.966+0000 7f16caa00640 1 -- 172.21.15.7:0/1085445586 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c40317a0 con 0x7f16cc0cec10 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.966+0000 7f16caa00640 1 -- 172.21.15.7:0/1085445586 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4031b70 con 0x7f16cc0cec10 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 -- 172.21.15.7:0/1085445586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc0cec10 msgr2=0x7f16cc0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 --2- 172.21.15.7:0/1085445586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc0cec10 0x7f16cc0d03c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009d90 tx=0x7f16c402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 -- 172.21.15.7:0/1085445586 shutdown_connections 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 --2- 172.21.15.7:0/1085445586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc0cec10 0x7f16cc0d03c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 --2- 172.21.15.7:0/1085445586 >> v2:172.21.15.162:3300/0 conn(0x7f16cc159bf0 0x7f16cc073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 -- 172.21.15.7:0/1085445586 >> 172.21.15.7:0/1085445586 conn(0x7f16cc06bc70 msgr2=0x7f16cc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 -- 172.21.15.7:0/1085445586 shutdown_connections 2024-08-19T00:42:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.967+0000 7f16d2400640 1 -- 172.21.15.7:0/1085445586 wait complete. 2024-08-19T00:42:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.969+0000 7f16d2400640 1 Processor -- start 2024-08-19T00:42:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.969+0000 7f16d2400640 1 -- start start 2024-08-19T00:42:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16d2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16cc0739a0 0x7f16cc160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16d2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc159bf0 0x7f16cc154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16d2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16cc1577e0 0x7f16cc1f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16d2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc15a150 con 0x7f16cc1577e0 2024-08-19T00:42:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16d2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc159fd0 con 0x7f16cc0739a0 2024-08-19T00:42:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16d2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16cc0d0900 con 0x7f16cc159bf0 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16cc1577e0 0x7f16cc1f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16cc1577e0 0x7f16cc1f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34570/0 (socket says 172.21.15.7:34570) 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 -- 172.21.15.7:0/4105639689 learned_addr learned my addr 172.21.15.7:0/4105639689 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cb400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16cc0739a0 0x7f16cc160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16c2a00640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc159bf0 0x7f16cc154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 -- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc159bf0 msgr2=0x7f16cc154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc159bf0 0x7f16cc154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 -- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16cc0739a0 msgr2=0x7f16cc160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16cc0739a0 0x7f16cc160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16cbe00640 1 -- 172.21.15.7:0/4105639689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc156740 con 0x7f16cc1577e0 2024-08-19T00:42:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.970+0000 7f16c2a00640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc159bf0 0x7f16cc154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.971+0000 7f16cbe00640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16cc1577e0 0x7f16cc1f41b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009eb0 tx=0x7f16c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.971+0000 7f16c3e00640 1 -- 172.21.15.7:0/4105639689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4040070 con 0x7f16cc1577e0 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.971+0000 7f16c3e00640 1 -- 172.21.15.7:0/4105639689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c403c830 con 0x7f16cc1577e0 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.971+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc156a20 con 0x7f16cc1577e0 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.971+0000 7f16c3e00640 1 -- 172.21.15.7:0/4105639689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c403cbe0 con 0x7f16cc1577e0 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.971+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc156fe0 con 0x7f16cc1577e0 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.972+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16cc06e070 con 0x7f16cc1577e0 2024-08-19T00:42:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.973+0000 7f16c3e00640 1 -- 172.21.15.7:0/4105639689 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16c4039040 con 0x7f16cc1577e0 2024-08-19T00:42:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.974+0000 7f16c3e00640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a806be30 0x7f16a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.974+0000 7f16c3e00640 1 -- 172.21.15.7:0/4105639689 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f16c40ac580 con 0x7f16cc1577e0 2024-08-19T00:42:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.974+0000 7f16cb400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a806be30 0x7f16a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.975+0000 7f16cb400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a806be30 0x7f16a806e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009560 tx=0x7f16bc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:40.979+0000 7f16c3e00640 1 -- 172.21.15.7:0/4105639689 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f16cc06e070 con 0x7f16cc1577e0 2024-08-19T00:42:41.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.160+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16cc0d0c80 con 0x7f16a806be30 2024-08-19T00:42:41.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.166+0000 7f16c3e00640 1 -- 172.21.15.7:0/4105639689 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252071 (secure 0 0 0) 0x7f16cc0d0c80 con 0x7f16a806be30 2024-08-19T00:42:41.172 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:41.173 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:42:41.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a806be30 msgr2=0x7f16a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a806be30 0x7f16a806e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009560 tx=0x7f16bc009190 comp rx=0 tx=0).stop 2024-08-19T00:42:41.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16cc1577e0 msgr2=0x7f16cc1f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16cc1577e0 0x7f16cc1f41b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009eb0 tx=0x7f16c4004a40 comp rx=0 tx=0).stop 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 shutdown_connections 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16a806be30 0x7f16a806e2f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16cc1577e0 0x7f16cc1f41b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16cc159bf0 0x7f16cc154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 --2- 172.21.15.7:0/4105639689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16cc0739a0 0x7f16cc160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 >> 172.21.15.7:0/4105639689 conn(0x7f16cc06bc70 msgr2=0x7f16cc15a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 shutdown_connections 2024-08-19T00:42:41.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.171+0000 7f16d2400640 1 -- 172.21.15.7:0/4105639689 wait complete. 2024-08-19T00:42:41.190 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-08-19T00:42:39.336305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253348,"kb_used_data":8036,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721372,"statfs":{"total":773094113280,"available":772834684928,"internally_reserved":0,"allocated":8228864,"data_stored":4152592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001813"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893775+0000","last_change":"2024-08-19T00:42:31.890520+0000","last_active":"2024-08-19T00:42:32.893775+0000","last_peered":"2024-08-19T00:42:32.893775+0000","last_clean":"2024-08-19T00:42:32.893775+0000","last_became_active":"2024-08-19T00:42:31.890272+0000","last_became_peered":"2024-08-19T00:42:31.890272+0000","last_unstale":"2024-08-19T00:42:32.893775+0000","last_undegraded":"2024-08-19T00:42:32.893775+0000","last_fullsized":"2024-08-19T00:42:32.893775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:19:23.781575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869267+0000","last_change":"2024-08-19T00:42:31.884968+0000","last_active":"2024-08-19T00:42:32.869267+0000","last_peered":"2024-08-19T00:42:32.869267+0000","last_clean":"2024-08-19T00:42:32.869267+0000","last_became_active":"2024-08-19T00:42:31.884622+0000","last_became_peered":"2024-08-19T00:42:31.884622+0000","last_unstale":"2024-08-19T00:42:32.869267+0000","last_undegraded":"2024-08-19T00:42:32.869267+0000","last_fullsized":"2024-08-19T00:42:32.869267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:50.077709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568750+0000","last_change":"2024-08-19T00:42:31.897141+0000","last_active":"2024-08-19T00:42:34.568750+0000","last_peered":"2024-08-19T00:42:34.568750+0000","last_clean":"2024-08-19T00:42:34.568750+0000","last_became_active":"2024-08-19T00:42:31.896305+0000","last_became_peered":"2024-08-19T00:42:31.896305+0000","last_unstale":"2024-08-19T00:42:34.568750+0000","last_undegraded":"2024-08-19T00:42:34.568750+0000","last_fullsized":"2024-08-19T00:42:34.568750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:40.889390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568607+0000","last_change":"2024-08-19T00:42:31.885638+0000","last_active":"2024-08-19T00:42:34.568607+0000","last_peered":"2024-08-19T00:42:34.568607+0000","last_clean":"2024-08-19T00:42:34.568607+0000","last_became_active":"2024-08-19T00:42:31.885104+0000","last_became_peered":"2024-08-19T00:42:31.885104+0000","last_unstale":"2024-08-19T00:42:34.568607+0000","last_undegraded":"2024-08-19T00:42:34.568607+0000","last_fullsized":"2024-08-19T00:42:34.568607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:56:48.860832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568983+0000","last_change":"2024-08-19T00:42:31.891961+0000","last_active":"2024-08-19T00:42:34.568983+0000","last_peered":"2024-08-19T00:42:34.568983+0000","last_clean":"2024-08-19T00:42:34.568983+0000","last_became_active":"2024-08-19T00:42:31.891483+0000","last_became_peered":"2024-08-19T00:42:31.891483+0000","last_unstale":"2024-08-19T00:42:34.568983+0000","last_undegraded":"2024-08-19T00:42:34.568983+0000","last_fullsized":"2024-08-19T00:42:34.568983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:39:48.378680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871538+0000","last_change":"2024-08-19T00:42:31.895581+0000","last_active":"2024-08-19T00:42:32.871538+0000","last_peered":"2024-08-19T00:42:32.871538+0000","last_clean":"2024-08-19T00:42:32.871538+0000","last_became_active":"2024-08-19T00:42:31.893034+0000","last_became_peered":"2024-08-19T00:42:31.893034+0000","last_unstale":"2024-08-19T00:42:32.871538+0000","last_undegraded":"2024-08-19T00:42:32.871538+0000","last_fullsized":"2024-08-19T00:42:32.871538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872132+0000","last_change":"2024-08-19T00:42:31.889975+0000","last_active":"2024-08-19T00:42:32.872132+0000","last_peered":"2024-08-19T00:42:32.872132+0000","last_clean":"2024-08-19T00:42:32.872132+0000","last_became_active":"2024-08-19T00:42:31.889637+0000","last_became_peered":"2024-08-19T00:42:31.889637+0000","last_unstale":"2024-08-19T00:42:32.872132+0000","last_undegraded":"2024-08-19T00:42:32.872132+0000","last_fullsized":"2024-08-19T00:42:32.872132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:52.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893196+0000","last_change":"2024-08-19T00:42:31.887021+0000","last_active":"2024-08-19T00:42:32.893196+0000","last_peered":"2024-08-19T00:42:32.893196+0000","last_clean":"2024-08-19T00:42:32.893196+0000","last_became_active":"2024-08-19T00:42:31.886689+0000","last_became_peered":"2024-08-19T00:42:31.886689+0000","last_unstale":"2024-08-19T00:42:32.893196+0000","last_undegraded":"2024-08-19T00:42:32.893196+0000","last_fullsized":"2024-08-19T00:42:32.893196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:39.104819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569574+0000","last_change":"2024-08-19T00:42:31.888701+0000","last_active":"2024-08-19T00:42:34.569574+0000","last_peered":"2024-08-19T00:42:34.569574+0000","last_clean":"2024-08-19T00:42:34.569574+0000","last_became_active":"2024-08-19T00:42:31.887705+0000","last_became_peered":"2024-08-19T00:42:31.887705+0000","last_unstale":"2024-08-19T00:42:34.569574+0000","last_undegraded":"2024-08-19T00:42:34.569574+0000","last_fullsized":"2024-08-19T00:42:34.569574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:02:47.264222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872934+0000","last_change":"2024-08-19T00:42:31.886621+0000","last_active":"2024-08-19T00:42:32.872934+0000","last_peered":"2024-08-19T00:42:32.872934+0000","last_clean":"2024-08-19T00:42:32.872934+0000","last_became_active":"2024-08-19T00:42:31.886367+0000","last_became_peered":"2024-08-19T00:42:31.886367+0000","last_unstale":"2024-08-19T00:42:32.872934+0000","last_undegraded":"2024-08-19T00:42:32.872934+0000","last_fullsized":"2024-08-19T00:42:32.872934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:07.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893711+0000","last_change":"2024-08-19T00:42:31.886557+0000","last_active":"2024-08-19T00:42:32.893711+0000","last_peered":"2024-08-19T00:42:32.893711+0000","last_clean":"2024-08-19T00:42:32.893711+0000","last_became_active":"2024-08-19T00:42:31.885206+0000","last_became_peered":"2024-08-19T00:42:31.885206+0000","last_unstale":"2024-08-19T00:42:32.893711+0000","last_undegraded":"2024-08-19T00:42:32.893711+0000","last_fullsized":"2024-08-19T00:42:32.893711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:32.852505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568365+0000","last_change":"2024-08-19T00:42:31.894185+0000","last_active":"2024-08-19T00:42:34.568365+0000","last_peered":"2024-08-19T00:42:34.568365+0000","last_clean":"2024-08-19T00:42:34.568365+0000","last_became_active":"2024-08-19T00:42:31.893898+0000","last_became_peered":"2024-08-19T00:42:31.893898+0000","last_unstale":"2024-08-19T00:42:34.568365+0000","last_undegraded":"2024-08-19T00:42:34.568365+0000","last_fullsized":"2024-08-19T00:42:34.568365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:17.571252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569398+0000","last_change":"2024-08-19T00:42:31.885950+0000","last_active":"2024-08-19T00:42:34.569398+0000","last_peered":"2024-08-19T00:42:34.569398+0000","last_clean":"2024-08-19T00:42:34.569398+0000","last_became_active":"2024-08-19T00:42:31.885694+0000","last_became_peered":"2024-08-19T00:42:31.885694+0000","last_unstale":"2024-08-19T00:42:34.569398+0000","last_undegraded":"2024-08-19T00:42:34.569398+0000","last_fullsized":"2024-08-19T00:42:34.569398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:21.154615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567913+0000","last_change":"2024-08-19T00:42:31.878908+0000","last_active":"2024-08-19T00:42:34.567913+0000","last_peered":"2024-08-19T00:42:34.567913+0000","last_clean":"2024-08-19T00:42:34.567913+0000","last_became_active":"2024-08-19T00:42:31.878488+0000","last_became_peered":"2024-08-19T00:42:31.878488+0000","last_unstale":"2024-08-19T00:42:34.567913+0000","last_undegraded":"2024-08-19T00:42:34.567913+0000","last_fullsized":"2024-08-19T00:42:34.567913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:44.470150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567690+0000","last_change":"2024-08-19T00:42:31.887088+0000","last_active":"2024-08-19T00:42:34.567690+0000","last_peered":"2024-08-19T00:42:34.567690+0000","last_clean":"2024-08-19T00:42:34.567690+0000","last_became_active":"2024-08-19T00:42:31.885743+0000","last_became_peered":"2024-08-19T00:42:31.885743+0000","last_unstale":"2024-08-19T00:42:34.567690+0000","last_undegraded":"2024-08-19T00:42:34.567690+0000","last_fullsized":"2024-08-19T00:42:34.567690+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:50.077709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893181+0000","last_change":"2024-08-19T00:42:31.875221+0000","last_active":"2024-08-19T00:42:32.893181+0000","last_peered":"2024-08-19T00:42:32.893181+0000","last_clean":"2024-08-19T00:42:32.893181+0000","last_became_active":"2024-08-19T00:42:31.874839+0000","last_became_peered":"2024-08-19T00:42:31.874839+0000","last_unstale":"2024-08-19T00:42:32.893181+0000","last_undegraded":"2024-08-19T00:42:32.893181+0000","last_fullsized":"2024-08-19T00:42:32.893181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:54.455117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569350+0000","last_change":"2024-08-19T00:42:31.886224+0000","last_active":"2024-08-19T00:42:34.569350+0000","last_peered":"2024-08-19T00:42:34.569350+0000","last_clean":"2024-08-19T00:42:34.569350+0000","last_became_active":"2024-08-19T00:42:31.885903+0000","last_became_peered":"2024-08-19T00:42:31.885903+0000","last_unstale":"2024-08-19T00:42:34.569350+0000","last_undegraded":"2024-08-19T00:42:34.569350+0000","last_fullsized":"2024-08-19T00:42:34.569350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:55.671954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569303+0000","last_change":"2024-08-19T00:42:31.898362+0000","last_active":"2024-08-19T00:42:34.569303+0000","last_peered":"2024-08-19T00:42:34.569303+0000","last_clean":"2024-08-19T00:42:34.569303+0000","last_became_active":"2024-08-19T00:42:31.897908+0000","last_became_peered":"2024-08-19T00:42:31.897908+0000","last_unstale":"2024-08-19T00:42:34.569303+0000","last_undegraded":"2024-08-19T00:42:34.569303+0000","last_fullsized":"2024-08-19T00:42:34.569303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:39.438484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893591+0000","last_change":"2024-08-19T00:42:31.896689+0000","last_active":"2024-08-19T00:42:32.893591+0000","last_peered":"2024-08-19T00:42:32.893591+0000","last_clean":"2024-08-19T00:42:32.893591+0000","last_became_active":"2024-08-19T00:42:31.896361+0000","last_became_peered":"2024-08-19T00:42:31.896361+0000","last_unstale":"2024-08-19T00:42:32.893591+0000","last_undegraded":"2024-08-19T00:42:32.893591+0000","last_fullsized":"2024-08-19T00:42:32.893591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:34.897764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569011+0000","last_change":"2024-08-19T00:42:31.889606+0000","last_active":"2024-08-19T00:42:34.569011+0000","last_peered":"2024-08-19T00:42:34.569011+0000","last_clean":"2024-08-19T00:42:34.569011+0000","last_became_active":"2024-08-19T00:42:31.889295+0000","last_became_peered":"2024-08-19T00:42:31.889295+0000","last_unstale":"2024-08-19T00:42:34.569011+0000","last_undegraded":"2024-08-19T00:42:34.569011+0000","last_fullsized":"2024-08-19T00:42:34.569011+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:22:59.094705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869305+0000","last_change":"2024-08-19T00:42:31.892500+0000","last_active":"2024-08-19T00:42:32.869305+0000","last_peered":"2024-08-19T00:42:32.869305+0000","last_clean":"2024-08-19T00:42:32.869305+0000","last_became_active":"2024-08-19T00:42:31.892123+0000","last_became_peered":"2024-08-19T00:42:31.892123+0000","last_unstale":"2024-08-19T00:42:32.869305+0000","last_undegraded":"2024-08-19T00:42:32.869305+0000","last_fullsized":"2024-08-19T00:42:32.869305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:29.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871904+0000","last_change":"2024-08-19T00:42:31.889746+0000","last_active":"2024-08-19T00:42:32.871904+0000","last_peered":"2024-08-19T00:42:32.871904+0000","last_clean":"2024-08-19T00:42:32.871904+0000","last_became_active":"2024-08-19T00:42:31.889449+0000","last_became_peered":"2024-08-19T00:42:31.889449+0000","last_unstale":"2024-08-19T00:42:32.871904+0000","last_undegraded":"2024-08-19T00:42:32.871904+0000","last_fullsized":"2024-08-19T00:42:32.871904+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:37.985664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872176+0000","last_change":"2024-08-19T00:42:31.879729+0000","last_active":"2024-08-19T00:42:32.872176+0000","last_peered":"2024-08-19T00:42:32.872176+0000","last_clean":"2024-08-19T00:42:32.872176+0000","last_became_active":"2024-08-19T00:42:31.878400+0000","last_became_peered":"2024-08-19T00:42:31.878400+0000","last_unstale":"2024-08-19T00:42:32.872176+0000","last_undegraded":"2024-08-19T00:42:32.872176+0000","last_fullsized":"2024-08-19T00:42:32.872176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:50:32.583705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893373+0000","last_change":"2024-08-19T00:42:31.883770+0000","last_active":"2024-08-19T00:42:32.893373+0000","last_peered":"2024-08-19T00:42:32.893373+0000","last_clean":"2024-08-19T00:42:32.893373+0000","last_became_active":"2024-08-19T00:42:31.883322+0000","last_became_peered":"2024-08-19T00:42:31.883322+0000","last_unstale":"2024-08-19T00:42:32.893373+0000","last_undegraded":"2024-08-19T00:42:32.893373+0000","last_fullsized":"2024-08-19T00:42:32.893373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:55.671954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872917+0000","last_change":"2024-08-19T00:42:31.880675+0000","last_active":"2024-08-19T00:42:32.872917+0000","last_peered":"2024-08-19T00:42:32.872917+0000","last_clean":"2024-08-19T00:42:32.872917+0000","last_became_active":"2024-08-19T00:42:31.880274+0000","last_became_peered":"2024-08-19T00:42:31.880274+0000","last_unstale":"2024-08-19T00:42:32.872917+0000","last_undegraded":"2024-08-19T00:42:32.872917+0000","last_fullsized":"2024-08-19T00:42:32.872917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:54.995370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893541+0000","last_change":"2024-08-19T00:42:31.885252+0000","last_active":"2024-08-19T00:42:32.893541+0000","last_peered":"2024-08-19T00:42:32.893541+0000","last_clean":"2024-08-19T00:42:32.893541+0000","last_became_active":"2024-08-19T00:42:31.882040+0000","last_became_peered":"2024-08-19T00:42:31.882040+0000","last_unstale":"2024-08-19T00:42:32.893541+0000","last_undegraded":"2024-08-19T00:42:32.893541+0000","last_fullsized":"2024-08-19T00:42:32.893541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:57:14.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569191+0000","last_change":"2024-08-19T00:42:31.892814+0000","last_active":"2024-08-19T00:42:34.569191+0000","last_peered":"2024-08-19T00:42:34.569191+0000","last_clean":"2024-08-19T00:42:34.569191+0000","last_became_active":"2024-08-19T00:42:31.892282+0000","last_became_peered":"2024-08-19T00:42:31.892282+0000","last_unstale":"2024-08-19T00:42:34.569191+0000","last_undegraded":"2024-08-19T00:42:34.569191+0000","last_fullsized":"2024-08-19T00:42:34.569191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:39.104819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869520+0000","last_change":"2024-08-19T00:42:31.897877+0000","last_active":"2024-08-19T00:42:32.869520+0000","last_peered":"2024-08-19T00:42:32.869520+0000","last_clean":"2024-08-19T00:42:32.869520+0000","last_became_active":"2024-08-19T00:42:31.895922+0000","last_became_peered":"2024-08-19T00:42:31.895922+0000","last_unstale":"2024-08-19T00:42:32.869520+0000","last_undegraded":"2024-08-19T00:42:32.869520+0000","last_fullsized":"2024-08-19T00:42:32.869520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:19:11.362135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569247+0000","last_change":"2024-08-19T00:42:31.893374+0000","last_active":"2024-08-19T00:42:34.569247+0000","last_peered":"2024-08-19T00:42:34.569247+0000","last_clean":"2024-08-19T00:42:34.569247+0000","last_became_active":"2024-08-19T00:42:31.893015+0000","last_became_peered":"2024-08-19T00:42:31.893015+0000","last_unstale":"2024-08-19T00:42:34.569247+0000","last_undegraded":"2024-08-19T00:42:34.569247+0000","last_fullsized":"2024-08-19T00:42:34.569247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:09.038340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893334+0000","last_change":"2024-08-19T00:42:31.895140+0000","last_active":"2024-08-19T00:42:32.893334+0000","last_peered":"2024-08-19T00:42:32.893334+0000","last_clean":"2024-08-19T00:42:32.893334+0000","last_became_active":"2024-08-19T00:42:31.894866+0000","last_became_peered":"2024-08-19T00:42:31.894866+0000","last_unstale":"2024-08-19T00:42:32.893334+0000","last_undegraded":"2024-08-19T00:42:32.893334+0000","last_fullsized":"2024-08-19T00:42:32.893334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:39.438484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868929+0000","last_change":"2024-08-19T00:42:31.896289+0000","last_active":"2024-08-19T00:42:32.868929+0000","last_peered":"2024-08-19T00:42:32.868929+0000","last_clean":"2024-08-19T00:42:32.868929+0000","last_became_active":"2024-08-19T00:42:31.896025+0000","last_became_peered":"2024-08-19T00:42:31.896025+0000","last_unstale":"2024-08-19T00:42:32.868929+0000","last_undegraded":"2024-08-19T00:42:32.868929+0000","last_fullsized":"2024-08-19T00:42:32.868929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:29.342491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868945+0000","last_change":"2024-08-19T00:42:31.896076+0000","last_active":"2024-08-19T00:42:32.868945+0000","last_peered":"2024-08-19T00:42:32.868945+0000","last_clean":"2024-08-19T00:42:32.868945+0000","last_became_active":"2024-08-19T00:42:31.895763+0000","last_became_peered":"2024-08-19T00:42:31.895763+0000","last_unstale":"2024-08-19T00:42:32.868945+0000","last_undegraded":"2024-08-19T00:42:32.868945+0000","last_fullsized":"2024-08-19T00:42:32.868945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:27.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893563+0000","last_change":"2024-08-19T00:42:31.882293+0000","last_active":"2024-08-19T00:42:32.893563+0000","last_peered":"2024-08-19T00:42:32.893563+0000","last_clean":"2024-08-19T00:42:32.893563+0000","last_became_active":"2024-08-19T00:42:31.881686+0000","last_became_peered":"2024-08-19T00:42:31.881686+0000","last_unstale":"2024-08-19T00:42:32.893563+0000","last_undegraded":"2024-08-19T00:42:32.893563+0000","last_fullsized":"2024-08-19T00:42:32.893563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:46.130758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872076+0000","last_change":"2024-08-19T00:42:30.876351+0000","last_active":"2024-08-19T00:42:32.872076+0000","last_peered":"2024-08-19T00:42:32.872076+0000","last_clean":"2024-08-19T00:42:32.872076+0000","last_became_active":"2024-08-19T00:42:30.875237+0000","last_became_peered":"2024-08-19T00:42:30.875237+0000","last_unstale":"2024-08-19T00:42:32.872076+0000","last_undegraded":"2024-08-19T00:42:32.872076+0000","last_fullsized":"2024-08-19T00:42:32.872076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:28.336385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569513+0000","last_change":"2024-08-19T00:42:31.893435+0000","last_active":"2024-08-19T00:42:34.569513+0000","last_peered":"2024-08-19T00:42:34.569513+0000","last_clean":"2024-08-19T00:42:34.569513+0000","last_became_active":"2024-08-19T00:42:31.891803+0000","last_became_peered":"2024-08-19T00:42:31.891803+0000","last_unstale":"2024-08-19T00:42:34.569513+0000","last_undegraded":"2024-08-19T00:42:34.569513+0000","last_fullsized":"2024-08-19T00:42:34.569513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:32:57.741470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569403+0000","last_change":"2024-08-19T00:42:30.874989+0000","last_active":"2024-08-19T00:42:34.569403+0000","last_peered":"2024-08-19T00:42:34.569403+0000","last_clean":"2024-08-19T00:42:34.569403+0000","last_became_active":"2024-08-19T00:42:30.873531+0000","last_became_peered":"2024-08-19T00:42:30.873531+0000","last_unstale":"2024-08-19T00:42:34.569403+0000","last_undegraded":"2024-08-19T00:42:34.569403+0000","last_fullsized":"2024-08-19T00:42:34.569403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:36.979558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871886+0000","last_change":"2024-08-19T00:42:31.894145+0000","last_active":"2024-08-19T00:42:32.871886+0000","last_peered":"2024-08-19T00:42:32.871886+0000","last_clean":"2024-08-19T00:42:32.871886+0000","last_became_active":"2024-08-19T00:42:31.893868+0000","last_became_peered":"2024-08-19T00:42:31.893868+0000","last_unstale":"2024-08-19T00:42:32.871886+0000","last_undegraded":"2024-08-19T00:42:32.871886+0000","last_fullsized":"2024-08-19T00:42:32.871886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:13.096377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893662+0000","last_change":"2024-08-19T00:42:30.864301+0000","last_active":"2024-08-19T00:42:32.893662+0000","last_peered":"2024-08-19T00:42:32.893662+0000","last_clean":"2024-08-19T00:42:32.893662+0000","last_became_active":"2024-08-19T00:42:30.862890+0000","last_became_peered":"2024-08-19T00:42:30.862890+0000","last_unstale":"2024-08-19T00:42:32.893662+0000","last_undegraded":"2024-08-19T00:42:32.893662+0000","last_fullsized":"2024-08-19T00:42:32.893662+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:40:55.120952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872671+0000","last_change":"2024-08-19T00:42:31.888776+0000","last_active":"2024-08-19T00:42:32.872671+0000","last_peered":"2024-08-19T00:42:32.872671+0000","last_clean":"2024-08-19T00:42:32.872671+0000","last_became_active":"2024-08-19T00:42:31.888495+0000","last_became_peered":"2024-08-19T00:42:31.888495+0000","last_unstale":"2024-08-19T00:42:32.872671+0000","last_undegraded":"2024-08-19T00:42:32.872671+0000","last_fullsized":"2024-08-19T00:42:32.872671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:30.401352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871890+0000","last_change":"2024-08-19T00:42:30.878407+0000","last_active":"2024-08-19T00:42:32.871890+0000","last_peered":"2024-08-19T00:42:32.871890+0000","last_clean":"2024-08-19T00:42:32.871890+0000","last_became_active":"2024-08-19T00:42:30.876759+0000","last_became_peered":"2024-08-19T00:42:30.876759+0000","last_unstale":"2024-08-19T00:42:32.871890+0000","last_undegraded":"2024-08-19T00:42:32.871890+0000","last_fullsized":"2024-08-19T00:42:32.871890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:10.187178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893419+0000","last_change":"2024-08-19T00:42:31.888942+0000","last_active":"2024-08-19T00:42:32.893419+0000","last_peered":"2024-08-19T00:42:32.893419+0000","last_clean":"2024-08-19T00:42:32.893419+0000","last_became_active":"2024-08-19T00:42:31.885920+0000","last_became_peered":"2024-08-19T00:42:31.885920+0000","last_unstale":"2024-08-19T00:42:32.893419+0000","last_undegraded":"2024-08-19T00:42:32.893419+0000","last_fullsized":"2024-08-19T00:42:32.893419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:37.597826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568070+0000","last_change":"2024-08-19T00:42:30.874056+0000","last_active":"2024-08-19T00:42:34.568070+0000","last_peered":"2024-08-19T00:42:34.568070+0000","last_clean":"2024-08-19T00:42:34.568070+0000","last_became_active":"2024-08-19T00:42:30.873658+0000","last_became_peered":"2024-08-19T00:42:30.873658+0000","last_unstale":"2024-08-19T00:42:34.568070+0000","last_undegraded":"2024-08-19T00:42:34.568070+0000","last_fullsized":"2024-08-19T00:42:34.568070+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:41:46.915388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871643+0000","last_change":"2024-08-19T00:42:31.892760+0000","last_active":"2024-08-19T00:42:32.871643+0000","last_peered":"2024-08-19T00:42:32.871643+0000","last_clean":"2024-08-19T00:42:32.871643+0000","last_became_active":"2024-08-19T00:42:31.892474+0000","last_became_peered":"2024-08-19T00:42:31.892474+0000","last_unstale":"2024-08-19T00:42:32.871643+0000","last_undegraded":"2024-08-19T00:42:32.871643+0000","last_fullsized":"2024-08-19T00:42:32.871643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:33.985970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872250+0000","last_change":"2024-08-19T00:42:30.875439+0000","last_active":"2024-08-19T00:42:32.872250+0000","last_peered":"2024-08-19T00:42:32.872250+0000","last_clean":"2024-08-19T00:42:32.872250+0000","last_became_active":"2024-08-19T00:42:30.875169+0000","last_became_peered":"2024-08-19T00:42:30.875169+0000","last_unstale":"2024-08-19T00:42:32.872250+0000","last_undegraded":"2024-08-19T00:42:32.872250+0000","last_fullsized":"2024-08-19T00:42:32.872250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:16:55.713900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421449+0000","last_change":"2024-08-19T00:42:31.898698+0000","last_active":"2024-08-19T00:42:34.421449+0000","last_peered":"2024-08-19T00:42:34.421449+0000","last_clean":"2024-08-19T00:42:34.421449+0000","last_became_active":"2024-08-19T00:42:31.898372+0000","last_became_peered":"2024-08-19T00:42:31.898372+0000","last_unstale":"2024-08-19T00:42:34.421449+0000","last_undegraded":"2024-08-19T00:42:34.421449+0000","last_fullsized":"2024-08-19T00:42:34.421449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:11.193284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421422+0000","last_change":"2024-08-19T00:42:30.877280+0000","last_active":"2024-08-19T00:42:34.421422+0000","last_peered":"2024-08-19T00:42:34.421422+0000","last_clean":"2024-08-19T00:42:34.421422+0000","last_became_active":"2024-08-19T00:42:30.876858+0000","last_became_peered":"2024-08-19T00:42:30.876858+0000","last_unstale":"2024-08-19T00:42:34.421422+0000","last_undegraded":"2024-08-19T00:42:34.421422+0000","last_fullsized":"2024-08-19T00:42:34.421422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:37.372124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567781+0000","last_change":"2024-08-19T00:42:31.883278+0000","last_active":"2024-08-19T00:42:34.567781+0000","last_peered":"2024-08-19T00:42:34.567781+0000","last_clean":"2024-08-19T00:42:34.567781+0000","last_became_active":"2024-08-19T00:42:31.882116+0000","last_became_peered":"2024-08-19T00:42:31.882116+0000","last_unstale":"2024-08-19T00:42:34.567781+0000","last_undegraded":"2024-08-19T00:42:34.567781+0000","last_fullsized":"2024-08-19T00:42:34.567781+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:39.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567571+0000","last_change":"2024-08-19T00:42:30.871250+0000","last_active":"2024-08-19T00:42:34.567571+0000","last_peered":"2024-08-19T00:42:34.567571+0000","last_clean":"2024-08-19T00:42:34.567571+0000","last_became_active":"2024-08-19T00:42:30.870892+0000","last_became_peered":"2024-08-19T00:42:30.870892+0000","last_unstale":"2024-08-19T00:42:34.567571+0000","last_undegraded":"2024-08-19T00:42:34.567571+0000","last_fullsized":"2024-08-19T00:42:34.567571+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:49:11.301605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872985+0000","last_change":"2024-08-19T00:42:31.878514+0000","last_active":"2024-08-19T00:42:32.872985+0000","last_peered":"2024-08-19T00:42:32.872985+0000","last_clean":"2024-08-19T00:42:32.872985+0000","last_became_active":"2024-08-19T00:42:31.878252+0000","last_became_peered":"2024-08-19T00:42:31.878252+0000","last_unstale":"2024-08-19T00:42:32.872985+0000","last_undegraded":"2024-08-19T00:42:32.872985+0000","last_fullsized":"2024-08-19T00:42:32.872985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:38.562669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893420+0000","last_change":"2024-08-19T00:42:30.865323+0000","last_active":"2024-08-19T00:42:32.893420+0000","last_peered":"2024-08-19T00:42:32.893420+0000","last_clean":"2024-08-19T00:42:32.893420+0000","last_became_active":"2024-08-19T00:42:30.865027+0000","last_became_peered":"2024-08-19T00:42:30.865027+0000","last_unstale":"2024-08-19T00:42:32.893420+0000","last_undegraded":"2024-08-19T00:42:32.893420+0000","last_fullsized":"2024-08-19T00:42:32.893420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:36.979558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869300+0000","last_change":"2024-08-19T00:42:31.883957+0000","last_active":"2024-08-19T00:42:32.869300+0000","last_peered":"2024-08-19T00:42:32.869300+0000","last_clean":"2024-08-19T00:42:32.869300+0000","last_became_active":"2024-08-19T00:42:31.883574+0000","last_became_peered":"2024-08-19T00:42:31.883574+0000","last_unstale":"2024-08-19T00:42:32.869300+0000","last_undegraded":"2024-08-19T00:42:32.869300+0000","last_fullsized":"2024-08-19T00:42:32.869300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:39.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869319+0000","last_change":"2024-08-19T00:42:30.880554+0000","last_active":"2024-08-19T00:42:32.869319+0000","last_peered":"2024-08-19T00:42:32.869319+0000","last_clean":"2024-08-19T00:42:32.869319+0000","last_became_active":"2024-08-19T00:42:30.880233+0000","last_became_peered":"2024-08-19T00:42:30.880233+0000","last_unstale":"2024-08-19T00:42:32.869319+0000","last_undegraded":"2024-08-19T00:42:32.869319+0000","last_fullsized":"2024-08-19T00:42:32.869319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:06.057201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893444+0000","last_change":"2024-08-19T00:42:31.875514+0000","last_active":"2024-08-19T00:42:32.893444+0000","last_peered":"2024-08-19T00:42:32.893444+0000","last_clean":"2024-08-19T00:42:32.893444+0000","last_became_active":"2024-08-19T00:42:31.875203+0000","last_became_peered":"2024-08-19T00:42:31.875203+0000","last_unstale":"2024-08-19T00:42:32.893444+0000","last_undegraded":"2024-08-19T00:42:32.893444+0000","last_fullsized":"2024-08-19T00:42:32.893444+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:36.319084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568114+0000","last_change":"2024-08-19T00:42:30.876755+0000","last_active":"2024-08-19T00:42:34.568114+0000","last_peered":"2024-08-19T00:42:34.568114+0000","last_clean":"2024-08-19T00:42:34.568114+0000","last_became_active":"2024-08-19T00:42:30.876439+0000","last_became_peered":"2024-08-19T00:42:30.876439+0000","last_unstale":"2024-08-19T00:42:34.568114+0000","last_undegraded":"2024-08-19T00:42:34.568114+0000","last_fullsized":"2024-08-19T00:42:34.568114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:51:45.203488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569177+0000","last_change":"2024-08-19T00:42:31.892636+0000","last_active":"2024-08-19T00:42:34.569177+0000","last_peered":"2024-08-19T00:42:34.569177+0000","last_clean":"2024-08-19T00:42:34.569177+0000","last_became_active":"2024-08-19T00:42:31.891939+0000","last_became_peered":"2024-08-19T00:42:31.891939+0000","last_unstale":"2024-08-19T00:42:34.569177+0000","last_undegraded":"2024-08-19T00:42:34.569177+0000","last_fullsized":"2024-08-19T00:42:34.569177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:54.455117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421544+0000","last_change":"2024-08-19T00:42:30.880160+0000","last_active":"2024-08-19T00:42:34.421544+0000","last_peered":"2024-08-19T00:42:34.421544+0000","last_clean":"2024-08-19T00:42:34.421544+0000","last_became_active":"2024-08-19T00:42:30.879495+0000","last_became_peered":"2024-08-19T00:42:30.879495+0000","last_unstale":"2024-08-19T00:42:34.421544+0000","last_undegraded":"2024-08-19T00:42:34.421544+0000","last_fullsized":"2024-08-19T00:42:34.421544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:51:45.203488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871719+0000","last_change":"2024-08-19T00:42:31.893631+0000","last_active":"2024-08-19T00:42:32.871719+0000","last_peered":"2024-08-19T00:42:32.871719+0000","last_clean":"2024-08-19T00:42:32.871719+0000","last_became_active":"2024-08-19T00:42:31.892641+0000","last_became_peered":"2024-08-19T00:42:31.892641+0000","last_unstale":"2024-08-19T00:42:32.871719+0000","last_undegraded":"2024-08-19T00:42:32.871719+0000","last_fullsized":"2024-08-19T00:42:32.871719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:41.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421245+0000","last_change":"2024-08-19T00:42:30.881772+0000","last_active":"2024-08-19T00:42:34.421245+0000","last_peered":"2024-08-19T00:42:34.421245+0000","last_clean":"2024-08-19T00:42:34.421245+0000","last_became_active":"2024-08-19T00:42:30.881489+0000","last_became_peered":"2024-08-19T00:42:30.881489+0000","last_unstale":"2024-08-19T00:42:34.421245+0000","last_undegraded":"2024-08-19T00:42:34.421245+0000","last_fullsized":"2024-08-19T00:42:34.421245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:41:46.915388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872374+0000","last_change":"2024-08-19T00:42:31.889060+0000","last_active":"2024-08-19T00:42:32.872374+0000","last_peered":"2024-08-19T00:42:32.872374+0000","last_clean":"2024-08-19T00:42:32.872374+0000","last_became_active":"2024-08-19T00:42:31.888413+0000","last_became_peered":"2024-08-19T00:42:31.888413+0000","last_unstale":"2024-08-19T00:42:32.872374+0000","last_undegraded":"2024-08-19T00:42:32.872374+0000","last_fullsized":"2024-08-19T00:42:32.872374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:31:34.849158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872299+0000","last_change":"2024-08-19T00:42:30.875349+0000","last_active":"2024-08-19T00:42:32.872299+0000","last_peered":"2024-08-19T00:42:32.872299+0000","last_clean":"2024-08-19T00:42:32.872299+0000","last_became_active":"2024-08-19T00:42:30.875068+0000","last_became_peered":"2024-08-19T00:42:30.875068+0000","last_unstale":"2024-08-19T00:42:32.872299+0000","last_undegraded":"2024-08-19T00:42:32.872299+0000","last_fullsized":"2024-08-19T00:42:32.872299+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:49.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568649+0000","last_change":"2024-08-19T00:42:31.884205+0000","last_active":"2024-08-19T00:42:34.568649+0000","last_peered":"2024-08-19T00:42:34.568649+0000","last_clean":"2024-08-19T00:42:34.568649+0000","last_became_active":"2024-08-19T00:42:31.883930+0000","last_became_peered":"2024-08-19T00:42:31.883930+0000","last_unstale":"2024-08-19T00:42:34.568649+0000","last_undegraded":"2024-08-19T00:42:34.568649+0000","last_fullsized":"2024-08-19T00:42:34.568649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:12.996891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872178+0000","last_change":"2024-08-19T00:42:30.878500+0000","last_active":"2024-08-19T00:42:32.872178+0000","last_peered":"2024-08-19T00:42:32.872178+0000","last_clean":"2024-08-19T00:42:32.872178+0000","last_became_active":"2024-08-19T00:42:30.877428+0000","last_became_peered":"2024-08-19T00:42:30.877428+0000","last_unstale":"2024-08-19T00:42:32.872178+0000","last_undegraded":"2024-08-19T00:42:32.872178+0000","last_fullsized":"2024-08-19T00:42:32.872178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:28:58.973103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568356+0000","last_change":"2024-08-19T00:42:31.894072+0000","last_active":"2024-08-19T00:42:34.568356+0000","last_peered":"2024-08-19T00:42:34.568356+0000","last_clean":"2024-08-19T00:42:34.568356+0000","last_became_active":"2024-08-19T00:42:31.893794+0000","last_became_peered":"2024-08-19T00:42:31.893794+0000","last_unstale":"2024-08-19T00:42:34.568356+0000","last_undegraded":"2024-08-19T00:42:34.568356+0000","last_fullsized":"2024-08-19T00:42:34.568356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:57:47.386304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871831+0000","last_change":"2024-08-19T00:42:30.881547+0000","last_active":"2024-08-19T00:42:32.871831+0000","last_peered":"2024-08-19T00:42:32.871831+0000","last_clean":"2024-08-19T00:42:32.871831+0000","last_became_active":"2024-08-19T00:42:30.881265+0000","last_became_peered":"2024-08-19T00:42:30.881265+0000","last_unstale":"2024-08-19T00:42:32.871831+0000","last_undegraded":"2024-08-19T00:42:32.871831+0000","last_fullsized":"2024-08-19T00:42:32.871831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:57:16.076383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869329+0000","last_change":"2024-08-19T00:42:31.887426+0000","last_active":"2024-08-19T00:42:32.869329+0000","last_peered":"2024-08-19T00:42:32.869329+0000","last_clean":"2024-08-19T00:42:32.869329+0000","last_became_active":"2024-08-19T00:42:31.887148+0000","last_became_peered":"2024-08-19T00:42:31.887148+0000","last_unstale":"2024-08-19T00:42:32.869329+0000","last_undegraded":"2024-08-19T00:42:32.869329+0000","last_fullsized":"2024-08-19T00:42:32.869329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:44.470150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893557+0000","last_change":"2024-08-19T00:42:30.872013+0000","last_active":"2024-08-19T00:42:32.893557+0000","last_peered":"2024-08-19T00:42:32.893557+0000","last_clean":"2024-08-19T00:42:32.893557+0000","last_became_active":"2024-08-19T00:42:30.871480+0000","last_became_peered":"2024-08-19T00:42:30.871480+0000","last_unstale":"2024-08-19T00:42:32.893557+0000","last_undegraded":"2024-08-19T00:42:32.893557+0000","last_fullsized":"2024-08-19T00:42:32.893557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:12.090271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869395+0000","last_change":"2024-08-19T00:42:31.876897+0000","last_active":"2024-08-19T00:42:32.869395+0000","last_peered":"2024-08-19T00:42:32.869395+0000","last_clean":"2024-08-19T00:42:32.869395+0000","last_became_active":"2024-08-19T00:42:31.876636+0000","last_became_peered":"2024-08-19T00:42:31.876636+0000","last_unstale":"2024-08-19T00:42:32.869395+0000","last_undegraded":"2024-08-19T00:42:32.869395+0000","last_fullsized":"2024-08-19T00:42:32.869395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:17.571252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869378+0000","last_change":"2024-08-19T00:42:30.878637+0000","last_active":"2024-08-19T00:42:32.869378+0000","last_peered":"2024-08-19T00:42:32.869378+0000","last_clean":"2024-08-19T00:42:32.869378+0000","last_became_active":"2024-08-19T00:42:30.878243+0000","last_became_peered":"2024-08-19T00:42:30.878243+0000","last_unstale":"2024-08-19T00:42:32.869378+0000","last_undegraded":"2024-08-19T00:42:32.869378+0000","last_fullsized":"2024-08-19T00:42:32.869378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:37.556563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568776+0000","last_change":"2024-08-19T00:42:31.887946+0000","last_active":"2024-08-19T00:42:34.568776+0000","last_peered":"2024-08-19T00:42:34.568776+0000","last_clean":"2024-08-19T00:42:34.568776+0000","last_became_active":"2024-08-19T00:42:31.887661+0000","last_became_peered":"2024-08-19T00:42:31.887661+0000","last_unstale":"2024-08-19T00:42:34.568776+0000","last_undegraded":"2024-08-19T00:42:34.568776+0000","last_fullsized":"2024-08-19T00:42:34.568776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:44:32.547545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869046+0000","last_change":"2024-08-19T00:42:30.881753+0000","last_active":"2024-08-19T00:42:32.869046+0000","last_peered":"2024-08-19T00:42:32.869046+0000","last_clean":"2024-08-19T00:42:32.869046+0000","last_became_active":"2024-08-19T00:42:30.881466+0000","last_became_peered":"2024-08-19T00:42:30.881466+0000","last_unstale":"2024-08-19T00:42:32.869046+0000","last_undegraded":"2024-08-19T00:42:32.869046+0000","last_fullsized":"2024-08-19T00:42:32.869046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:37.954772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568878+0000","last_change":"2024-08-19T00:42:31.892617+0000","last_active":"2024-08-19T00:42:34.568878+0000","last_peered":"2024-08-19T00:42:34.568878+0000","last_clean":"2024-08-19T00:42:34.568878+0000","last_became_active":"2024-08-19T00:42:31.892276+0000","last_became_peered":"2024-08-19T00:42:31.892276+0000","last_unstale":"2024-08-19T00:42:34.568878+0000","last_undegraded":"2024-08-19T00:42:34.568878+0000","last_fullsized":"2024-08-19T00:42:34.568878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:33:25.241946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871934+0000","last_change":"2024-08-19T00:42:30.866089+0000","last_active":"2024-08-19T00:42:32.871934+0000","last_peered":"2024-08-19T00:42:32.871934+0000","last_clean":"2024-08-19T00:42:32.871934+0000","last_became_active":"2024-08-19T00:42:30.865832+0000","last_became_peered":"2024-08-19T00:42:30.865832+0000","last_unstale":"2024-08-19T00:42:32.871934+0000","last_undegraded":"2024-08-19T00:42:32.871934+0000","last_fullsized":"2024-08-19T00:42:32.871934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:31.060235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421696+0000","last_change":"2024-08-19T00:42:31.892028+0000","last_active":"2024-08-19T00:42:34.421696+0000","last_peered":"2024-08-19T00:42:34.421696+0000","last_clean":"2024-08-19T00:42:34.421696+0000","last_became_active":"2024-08-19T00:42:31.890732+0000","last_became_peered":"2024-08-19T00:42:31.890732+0000","last_unstale":"2024-08-19T00:42:34.421696+0000","last_undegraded":"2024-08-19T00:42:34.421696+0000","last_fullsized":"2024-08-19T00:42:34.421696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:32.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871783+0000","last_change":"2024-08-19T00:42:30.873159+0000","last_active":"2024-08-19T00:42:32.871783+0000","last_peered":"2024-08-19T00:42:32.871783+0000","last_clean":"2024-08-19T00:42:32.871783+0000","last_became_active":"2024-08-19T00:42:30.872850+0000","last_became_peered":"2024-08-19T00:42:30.872850+0000","last_unstale":"2024-08-19T00:42:32.871783+0000","last_undegraded":"2024-08-19T00:42:32.871783+0000","last_fullsized":"2024-08-19T00:42:32.871783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:26.723998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421657+0000","last_change":"2024-08-19T00:42:31.890778+0000","last_active":"2024-08-19T00:42:34.421657+0000","last_peered":"2024-08-19T00:42:34.421657+0000","last_clean":"2024-08-19T00:42:34.421657+0000","last_became_active":"2024-08-19T00:42:31.890405+0000","last_became_peered":"2024-08-19T00:42:31.890405+0000","last_unstale":"2024-08-19T00:42:34.421657+0000","last_undegraded":"2024-08-19T00:42:34.421657+0000","last_fullsized":"2024-08-19T00:42:34.421657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:29.342491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869000+0000","last_change":"2024-08-19T00:42:30.878991+0000","last_active":"2024-08-19T00:42:32.869000+0000","last_peered":"2024-08-19T00:42:32.869000+0000","last_clean":"2024-08-19T00:42:32.869000+0000","last_became_active":"2024-08-19T00:42:30.878693+0000","last_became_peered":"2024-08-19T00:42:30.878693+0000","last_unstale":"2024-08-19T00:42:32.869000+0000","last_undegraded":"2024-08-19T00:42:32.869000+0000","last_fullsized":"2024-08-19T00:42:32.869000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:12.874080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.567844+0000","last_change":"2024-08-19T00:42:31.882782+0000","last_active":"2024-08-19T00:42:34.567844+0000","last_peered":"2024-08-19T00:42:34.567844+0000","last_clean":"2024-08-19T00:42:34.567844+0000","last_became_active":"2024-08-19T00:42:31.882156+0000","last_became_peered":"2024-08-19T00:42:31.882156+0000","last_unstale":"2024-08-19T00:42:34.567844+0000","last_undegraded":"2024-08-19T00:42:34.567844+0000","last_fullsized":"2024-08-19T00:42:34.567844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:44:29.428165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568485+0000","last_change":"2024-08-19T00:42:30.879982+0000","last_active":"2024-08-19T00:42:34.568485+0000","last_peered":"2024-08-19T00:42:34.568485+0000","last_clean":"2024-08-19T00:42:34.568485+0000","last_became_active":"2024-08-19T00:42:30.879231+0000","last_became_peered":"2024-08-19T00:42:30.879231+0000","last_unstale":"2024-08-19T00:42:34.568485+0000","last_undegraded":"2024-08-19T00:42:34.568485+0000","last_fullsized":"2024-08-19T00:42:34.568485+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:04:40.399211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569527+0000","last_change":"2024-08-19T00:42:31.893067+0000","last_active":"2024-08-19T00:42:34.569527+0000","last_peered":"2024-08-19T00:42:34.569527+0000","last_clean":"2024-08-19T00:42:34.569527+0000","last_became_active":"2024-08-19T00:42:31.892794+0000","last_became_peered":"2024-08-19T00:42:31.892794+0000","last_unstale":"2024-08-19T00:42:34.569527+0000","last_undegraded":"2024-08-19T00:42:34.569527+0000","last_fullsized":"2024-08-19T00:42:34.569527+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:36.319084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893771+0000","last_change":"2024-08-19T00:42:30.871757+0000","last_active":"2024-08-19T00:42:32.893771+0000","last_peered":"2024-08-19T00:42:32.893771+0000","last_clean":"2024-08-19T00:42:32.893771+0000","last_became_active":"2024-08-19T00:42:30.871122+0000","last_became_peered":"2024-08-19T00:42:30.871122+0000","last_unstale":"2024-08-19T00:42:32.893771+0000","last_undegraded":"2024-08-19T00:42:32.893771+0000","last_fullsized":"2024-08-19T00:42:32.893771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:04:40.399211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872982+0000","last_change":"2024-08-19T00:42:31.891953+0000","last_active":"2024-08-19T00:42:32.872982+0000","last_peered":"2024-08-19T00:42:32.872982+0000","last_clean":"2024-08-19T00:42:32.872982+0000","last_became_active":"2024-08-19T00:42:31.891707+0000","last_became_peered":"2024-08-19T00:42:31.891707+0000","last_unstale":"2024-08-19T00:42:32.872982+0000","last_undegraded":"2024-08-19T00:42:32.872982+0000","last_fullsized":"2024-08-19T00:42:32.872982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:43:38.960878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893665+0000","last_change":"2024-08-19T00:42:30.874040+0000","last_active":"2024-08-19T00:42:32.893665+0000","last_peered":"2024-08-19T00:42:32.893665+0000","last_clean":"2024-08-19T00:42:32.893665+0000","last_became_active":"2024-08-19T00:42:30.873726+0000","last_became_peered":"2024-08-19T00:42:30.873726+0000","last_unstale":"2024-08-19T00:42:32.893665+0000","last_undegraded":"2024-08-19T00:42:32.893665+0000","last_fullsized":"2024-08-19T00:42:32.893665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:40.847324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869524+0000","last_change":"2024-08-19T00:42:31.887602+0000","last_active":"2024-08-19T00:42:32.869524+0000","last_peered":"2024-08-19T00:42:32.869524+0000","last_clean":"2024-08-19T00:42:32.869524+0000","last_became_active":"2024-08-19T00:42:31.887337+0000","last_became_peered":"2024-08-19T00:42:31.887337+0000","last_unstale":"2024-08-19T00:42:32.869524+0000","last_undegraded":"2024-08-19T00:42:32.869524+0000","last_fullsized":"2024-08-19T00:42:32.869524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:19.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568151+0000","last_change":"2024-08-19T00:42:30.871473+0000","last_active":"2024-08-19T00:42:34.568151+0000","last_peered":"2024-08-19T00:42:34.568151+0000","last_clean":"2024-08-19T00:42:34.568151+0000","last_became_active":"2024-08-19T00:42:30.871055+0000","last_became_peered":"2024-08-19T00:42:30.871055+0000","last_unstale":"2024-08-19T00:42:34.568151+0000","last_undegraded":"2024-08-19T00:42:34.568151+0000","last_fullsized":"2024-08-19T00:42:34.568151+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:52:44.316677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872699+0000","last_change":"2024-08-19T00:42:31.883349+0000","last_active":"2024-08-19T00:42:32.872699+0000","last_peered":"2024-08-19T00:42:32.872699+0000","last_clean":"2024-08-19T00:42:32.872699+0000","last_became_active":"2024-08-19T00:42:31.883056+0000","last_became_peered":"2024-08-19T00:42:31.883056+0000","last_unstale":"2024-08-19T00:42:32.872699+0000","last_undegraded":"2024-08-19T00:42:32.872699+0000","last_fullsized":"2024-08-19T00:42:32.872699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:13.880186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568255+0000","last_change":"2024-08-19T00:42:30.875857+0000","last_active":"2024-08-19T00:42:34.568255+0000","last_peered":"2024-08-19T00:42:34.568255+0000","last_clean":"2024-08-19T00:42:34.568255+0000","last_became_active":"2024-08-19T00:42:30.875373+0000","last_became_peered":"2024-08-19T00:42:30.875373+0000","last_unstale":"2024-08-19T00:42:34.568255+0000","last_undegraded":"2024-08-19T00:42:34.568255+0000","last_fullsized":"2024-08-19T00:42:34.568255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:51.439813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569580+0000","last_change":"2024-08-19T00:42:31.886379+0000","last_active":"2024-08-19T00:42:34.569580+0000","last_peered":"2024-08-19T00:42:34.569580+0000","last_clean":"2024-08-19T00:42:34.569580+0000","last_became_active":"2024-08-19T00:42:31.886079+0000","last_became_peered":"2024-08-19T00:42:31.886079+0000","last_unstale":"2024-08-19T00:42:34.569580+0000","last_undegraded":"2024-08-19T00:42:34.569580+0000","last_fullsized":"2024-08-19T00:42:34.569580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:57:14.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.568149+0000","last_change":"2024-08-19T00:42:30.874268+0000","last_active":"2024-08-19T00:42:34.568149+0000","last_peered":"2024-08-19T00:42:34.568149+0000","last_clean":"2024-08-19T00:42:34.568149+0000","last_became_active":"2024-08-19T00:42:30.873932+0000","last_became_peered":"2024-08-19T00:42:30.873932+0000","last_unstale":"2024-08-19T00:42:34.568149+0000","last_undegraded":"2024-08-19T00:42:34.568149+0000","last_fullsized":"2024-08-19T00:42:34.568149+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:25.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.893643+0000","last_change":"2024-08-19T00:42:31.874543+0000","last_active":"2024-08-19T00:42:32.893643+0000","last_peered":"2024-08-19T00:42:32.893643+0000","last_clean":"2024-08-19T00:42:32.893643+0000","last_became_active":"2024-08-19T00:42:31.874203+0000","last_became_peered":"2024-08-19T00:42:31.874203+0000","last_unstale":"2024-08-19T00:42:32.893643+0000","last_undegraded":"2024-08-19T00:42:32.893643+0000","last_fullsized":"2024-08-19T00:42:32.893643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:28.520824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569528+0000","last_change":"2024-08-19T00:42:30.876424+0000","last_active":"2024-08-19T00:42:34.569528+0000","last_peered":"2024-08-19T00:42:34.569528+0000","last_clean":"2024-08-19T00:42:34.569528+0000","last_became_active":"2024-08-19T00:42:30.875552+0000","last_became_peered":"2024-08-19T00:42:30.875552+0000","last_unstale":"2024-08-19T00:42:34.569528+0000","last_undegraded":"2024-08-19T00:42:34.569528+0000","last_fullsized":"2024-08-19T00:42:34.569528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:12.090271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.421678+0000","last_change":"2024-08-19T00:42:31.892453+0000","last_active":"2024-08-19T00:42:34.421678+0000","last_peered":"2024-08-19T00:42:34.421678+0000","last_clean":"2024-08-19T00:42:34.421678+0000","last_became_active":"2024-08-19T00:42:31.891426+0000","last_became_peered":"2024-08-19T00:42:31.891426+0000","last_unstale":"2024-08-19T00:42:34.421678+0000","last_undegraded":"2024-08-19T00:42:34.421678+0000","last_fullsized":"2024-08-19T00:42:34.421678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:27.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.869225+0000","last_change":"2024-08-19T00:42:30.884148+0000","last_active":"2024-08-19T00:42:32.869225+0000","last_peered":"2024-08-19T00:42:32.869225+0000","last_clean":"2024-08-19T00:42:32.869225+0000","last_became_active":"2024-08-19T00:42:30.883741+0000","last_became_peered":"2024-08-19T00:42:30.883741+0000","last_unstale":"2024-08-19T00:42:32.869225+0000","last_undegraded":"2024-08-19T00:42:32.869225+0000","last_fullsized":"2024-08-19T00:42:32.869225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:53.989264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.868881+0000","last_change":"2024-08-19T00:42:31.885879+0000","last_active":"2024-08-19T00:42:32.868881+0000","last_peered":"2024-08-19T00:42:32.868881+0000","last_clean":"2024-08-19T00:42:32.868881+0000","last_became_active":"2024-08-19T00:42:31.884773+0000","last_became_peered":"2024-08-19T00:42:31.884773+0000","last_unstale":"2024-08-19T00:42:32.868881+0000","last_undegraded":"2024-08-19T00:42:32.868881+0000","last_fullsized":"2024-08-19T00:42:32.868881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:32.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871394+0000","last_change":"2024-08-19T00:42:30.875606+0000","last_active":"2024-08-19T00:42:32.871394+0000","last_peered":"2024-08-19T00:42:32.871394+0000","last_clean":"2024-08-19T00:42:32.871394+0000","last_became_active":"2024-08-19T00:42:30.875023+0000","last_became_peered":"2024-08-19T00:42:30.875023+0000","last_unstale":"2024-08-19T00:42:32.871394+0000","last_undegraded":"2024-08-19T00:42:32.871394+0000","last_fullsized":"2024-08-19T00:42:32.871394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:20.569518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:34.569466+0000","last_change":"2024-08-19T00:42:31.892816+0000","last_active":"2024-08-19T00:42:34.569466+0000","last_peered":"2024-08-19T00:42:34.569466+0000","last_clean":"2024-08-19T00:42:34.569466+0000","last_became_active":"2024-08-19T00:42:31.892543+0000","last_became_peered":"2024-08-19T00:42:31.892543+0000","last_unstale":"2024-08-19T00:42:34.569466+0000","last_undegraded":"2024-08-19T00:42:34.569466+0000","last_fullsized":"2024-08-19T00:42:34.569466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:30.849484+0000","last_clean_scrub_stamp":"2024-08-19T00:42:30.849484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:37.597826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.872371+0000","last_change":"2024-08-19T00:42:30.877958+0000","last_active":"2024-08-19T00:42:32.872371+0000","last_peered":"2024-08-19T00:42:32.872371+0000","last_clean":"2024-08-19T00:42:32.872371+0000","last_became_active":"2024-08-19T00:42:30.877702+0000","last_became_peered":"2024-08-19T00:42:30.877702+0000","last_unstale":"2024-08-19T00:42:32.872371+0000","last_undegraded":"2024-08-19T00:42:32.872371+0000","last_fullsized":"2024-08-19T00:42:32.872371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:42:29.843378+0000","last_clean_scrub_stamp":"2024-08-19T00:42:29.843378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:37.610265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-19T00:42:32.871881+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:42:32.871881+0000","last_peered":"2024-08-19T00:42:32.871881+0000","last_clean":"2024-08-19T00:42:32.871881+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:42:32.871881+0000","last_undegraded":"2024-08-19T00:42:32.871881+0000","last_fullsized":"2024-08-19T00:42:32.871881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":368554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":892928,"data_stored":374888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1462272,"data_stored":957400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":367636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":888832,"data_stored":373368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":963610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":373312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:42:41.194 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:42:41.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-19T00:42:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.393+0000 7f5996000640 1 Processor -- start 2024-08-19T00:42:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.393+0000 7f5996000640 1 -- start start 2024-08-19T00:42:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.394+0000 7f5996000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015c390 0x7f5990166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.394+0000 7f5996000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59900acef0 con 0x7f599015bfb0 2024-08-19T00:42:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.394+0000 7f5996000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59900ad1d0 con 0x7f59900b5130 2024-08-19T00:42:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.394+0000 7f5996000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f59900ad790 con 0x7f599015c390 2024-08-19T00:42:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.394+0000 7f598f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f599015bfb0 0x7f59900b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44828/0 (socket says 172.21.15.7:44828) 2024-08-19T00:42:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.394+0000 7f598f400640 1 -- 172.21.15.7:0/2580143244 learned_addr learned my addr 172.21.15.7:0/2580143244 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.394+0000 7f598fe00640 1 --2- 172.21.15.7:0/2580143244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015c390 0x7f5990166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883544065 0 0) 0x7f59900acef0 con 0x7f599015bfb0 2024-08-19T00:42:41.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5974003520 con 0x7f599015bfb0 2024-08-19T00:42:41.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358764607 0 0) 0x7f59900ad1d0 con 0x7f59900b5130 2024-08-19T00:42:41.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59900acef0 con 0x7f59900b5130 2024-08-19T00:42:41.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1422793858 0 0) 0x7f5974003520 con 0x7f599015bfb0 2024-08-19T00:42:41.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598fe00640 1 -- 172.21.15.7:0/2580143244 >> v1:172.21.15.162:6789/0 conn(0x7f59900b5130 legacy=0x7f59900aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598fe00640 1 -- 172.21.15.7:0/2580143244 >> v1:172.21.15.7:6789/0 conn(0x7f599015bfb0 legacy=0x7f59900b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.395+0000 7f598fe00640 1 -- 172.21.15.7:0/2580143244 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59900ad4b0 con 0x7f599015c390 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.396+0000 7f598fe00640 1 --2- 172.21.15.7:0/2580143244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015c390 0x7f5990166dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5988009dc0 tx=0x7f598802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bbca0916ab33970 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980001670 con 0x7f599015c390 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5988007540 con 0x7f599015c390 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f598ea00640 1 -- 172.21.15.7:0/2580143244 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880078f0 con 0x7f599015c390 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f5996000640 1 -- 172.21.15.7:0/2580143244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015c390 msgr2=0x7f5990166dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f5996000640 1 --2- 172.21.15.7:0/2580143244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015c390 0x7f5990166dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5988009dc0 tx=0x7f598802a660 comp rx=0 tx=0).stop 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f5996000640 1 -- 172.21.15.7:0/2580143244 shutdown_connections 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f5996000640 1 --2- 172.21.15.7:0/2580143244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015c390 0x7f5990166dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f5996000640 1 -- 172.21.15.7:0/2580143244 >> 172.21.15.7:0/2580143244 conn(0x7f59900b2300 msgr2=0x7f599006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:41.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f5996000640 1 -- 172.21.15.7:0/2580143244 shutdown_connections 2024-08-19T00:42:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.397+0000 7f5996000640 1 -- 172.21.15.7:0/2580143244 wait complete. 2024-08-19T00:42:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.399+0000 7f5996000640 1 Processor -- start 2024-08-19T00:42:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.399+0000 7f5996000640 1 -- start start 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f5996000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59900b5130 0x7f59900cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f5996000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015bfb0 0x7f599015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f5996000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599015c390 0x7f5990149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f5996000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59900731d0 con 0x7f59900b5130 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f5996000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5990073050 con 0x7f599015c390 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f5996000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f59900af2e0 con 0x7f599015bfb0 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f598f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59900b5130 0x7f59900cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f598f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59900b5130 0x7f59900cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34576/0 (socket says 172.21.15.7:34576) 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f598f400640 1 -- 172.21.15.7:0/2415262763 learned_addr learned my addr 172.21.15.7:0/2415262763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f598fe00640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599015c390 0x7f5990149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f5987e00640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015bfb0 0x7f599015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f598f400640 1 -- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015bfb0 msgr2=0x7f599015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.400+0000 7f598f400640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015bfb0 0x7f599015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f598f400640 1 -- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599015c390 msgr2=0x7f5990149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f598f400640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599015c390 0x7f5990149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f598f400640 1 -- 172.21.15.7:0/2415262763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59900ce360 con 0x7f59900b5130 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f598f400640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59900b5130 0x7f59900cdd80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f598000c5a0 tx=0x7f598000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f5987400640 1 -- 172.21.15.7:0/2415262763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980017070 con 0x7f59900b5130 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f5987400640 1 -- 172.21.15.7:0/2415262763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5980005ce0 con 0x7f59900b5130 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59900ce640 con 0x7f59900b5130 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f5987400640 1 -- 172.21.15.7:0/2415262763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59800072b0 con 0x7f59900b5130 2024-08-19T00:42:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.401+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59900cec00 con 0x7f59900b5130 2024-08-19T00:42:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.402+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599006c450 con 0x7f59900b5130 2024-08-19T00:42:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.403+0000 7f5987400640 1 -- 172.21.15.7:0/2415262763 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f598001a070 con 0x7f59900b5130 2024-08-19T00:42:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.404+0000 7f5987400640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f596c06be30 0x7f596c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.405+0000 7f5987400640 1 -- 172.21.15.7:0/2415262763 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f598008a390 con 0x7f59900b5130 2024-08-19T00:42:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.405+0000 7f5987e00640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f596c06be30 0x7f596c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.405+0000 7f5987e00640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f596c06be30 0x7f596c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f59901f5510 tx=0x7f5978009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.409+0000 7f5987400640 1 -- 172.21.15.7:0/2415262763 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f599006c450 con 0x7f59900b5130 2024-08-19T00:42:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.664+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f59900aebd0 con 0x7f59900b5130 2024-08-19T00:42:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.668+0000 7f5987400640 1 -- 172.21.15.7:0/2415262763 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f5980058d40 con 0x7f59900b5130 2024-08-19T00:42:41.670 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-08-19T00:42:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:42:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-08-19T00:42:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-08-19T00:42:41.670 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-19T00:42:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f596c06be30 msgr2=0x7f596c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f596c06be30 0x7f596c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f59901f5510 tx=0x7f5978009040 comp rx=0 tx=0).stop 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59900b5130 msgr2=0x7f59900cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59900b5130 0x7f59900cdd80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f598000c5a0 tx=0x7f598000ca60 comp rx=0 tx=0).stop 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 shutdown_connections 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f596c06be30 0x7f596c06e2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599015c390 0x7f5990149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599015bfb0 0x7f599015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 --2- 172.21.15.7:0/2415262763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59900b5130 0x7f59900cdd80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 >> 172.21.15.7:0/2415262763 conn(0x7f59900b2300 msgr2=0x7f5990160580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 shutdown_connections 2024-08-19T00:42:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.670+0000 7f5996000640 1 -- 172.21.15.7:0/2415262763 wait complete. 2024-08-19T00:42:41.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.841+0000 7f55fb000640 1 Processor -- start 2024-08-19T00:42:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.842+0000 7f55fb000640 1 -- start start 2024-08-19T00:42:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.843+0000 7f55fb000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.843+0000 7f55fb000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f55f406e710 0x7f55f40d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.843+0000 7f55fb000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f40d0ce0 con 0x7f55f40b3750 2024-08-19T00:42:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.843+0000 7f55fb000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f55f40cebc0 con 0x7f55f406e710 2024-08-19T00:42:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.843+0000 7f55fb000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55f40cdfb0 con 0x7f55f40d03c0 2024-08-19T00:42:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.843+0000 7f55f3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.843+0000 7f55eb400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f55f406e710 0x7f55f40d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.844+0000 7f55f3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f4071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:47354/0 (socket says 172.21.15.7:47354) 2024-08-19T00:42:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.844+0000 7f55f3e00640 1 -- 172.21.15.7:0/95534341 learned_addr learned my addr 172.21.15.7:0/95534341 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.844+0000 7f55eb400640 1 -- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 msgr2=0x7f55f4071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.844+0000 7f55eb400640 1 --2- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f4071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.844+0000 7f55eb400640 1 -- 172.21.15.7:0/95534341 >> v1:172.21.15.162:6789/0 conn(0x7f55f40b3750 legacy=0x7f55f40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.844+0000 7f55eb400640 1 -- 172.21.15.7:0/95534341 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f40ce290 con 0x7f55f406e710 2024-08-19T00:42:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.844+0000 7f55f3e00640 1 --2- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:41.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.845+0000 7f55eb400640 1 --2- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 0x7f55f40d07a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097a0 tx=0x7f55dc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=219bee8a022437aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.845+0000 7f55f3400640 1 -- 172.21.15.7:0/95534341 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc037070 con 0x7f55f406e710 2024-08-19T00:42:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55f3400640 1 -- 172.21.15.7:0/95534341 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55dc032440 con 0x7f55f406e710 2024-08-19T00:42:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55f3400640 1 -- 172.21.15.7:0/95534341 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc032810 con 0x7f55f406e710 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 -- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 msgr2=0x7f55f40d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 --2- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 0x7f55f40d07a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097a0 tx=0x7f55dc02a180 comp rx=0 tx=0).stop 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 -- 172.21.15.7:0/95534341 shutdown_connections 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 --2- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 0x7f55f40d07a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 --2- 172.21.15.7:0/95534341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 -- 172.21.15.7:0/95534341 >> 172.21.15.7:0/95534341 conn(0x7f55f406bc70 msgr2=0x7f55f406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 -- 172.21.15.7:0/95534341 shutdown_connections 2024-08-19T00:42:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.846+0000 7f55fb000640 1 -- 172.21.15.7:0/95534341 wait complete. 2024-08-19T00:42:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.848+0000 7f55fb000640 1 Processor -- start 2024-08-19T00:42:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.848+0000 7f55fb000640 1 -- start start 2024-08-19T00:42:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55fb000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 0x7f55f409a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55fb000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f40b3750 0x7f55f406df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55fb000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f41f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55fb000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55f4073ae0 con 0x7f55f40b3750 2024-08-19T00:42:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55fb000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55f40ce850 con 0x7f55f406e710 2024-08-19T00:42:41.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55fb000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55f4073c60 con 0x7f55f40d03c0 2024-08-19T00:42:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f40b3750 0x7f55f406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f40b3750 0x7f55f406df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34580/0 (socket says 172.21.15.7:34580) 2024-08-19T00:42:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55eb400640 1 -- 172.21.15.7:0/2101019060 learned_addr learned my addr 172.21.15.7:0/2101019060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55f9000640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f41f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.849+0000 7f55f3e00640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 0x7f55f409a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55eb400640 1 -- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 msgr2=0x7f55f41f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55eb400640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f41f1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55eb400640 1 -- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 msgr2=0x7f55f409a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55eb400640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 0x7f55f409a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55eb400640 1 -- 172.21.15.7:0/2101019060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f4153d80 con 0x7f55f40b3750 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55eb400640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f40b3750 0x7f55f406df80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55dc000c00 tx=0x7f55dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55f0c00640 1 -- 172.21.15.7:0/2101019060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc041070 con 0x7f55f40b3750 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55f0c00640 1 -- 172.21.15.7:0/2101019060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55dc03c870 con 0x7f55f40b3750 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55f0c00640 1 -- 172.21.15.7:0/2101019060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc037040 con 0x7f55f40b3750 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.850+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f409a7c0 con 0x7f55f40b3750 2024-08-19T00:42:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.851+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f41f26b0 con 0x7f55f40b3750 2024-08-19T00:42:41.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.852+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f40b3be0 con 0x7f55f40b3750 2024-08-19T00:42:41.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.852+0000 7f55f0c00640 1 -- 172.21.15.7:0/2101019060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55dc044070 con 0x7f55f40b3750 2024-08-19T00:42:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.853+0000 7f55f0c00640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f55d006be30 0x7f55d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.853+0000 7f55f0c00640 1 -- 172.21.15.7:0/2101019060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f55dc0abb40 con 0x7f55f40b3750 2024-08-19T00:42:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.854+0000 7f55f3e00640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f55d006be30 0x7f55d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.854+0000 7f55f3e00640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f55d006be30 0x7f55d006e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f55e4006ca0 tx=0x7f55e4009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:41.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:41.857+0000 7f55f0c00640 1 -- 172.21.15.7:0/2101019060 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f55dc079e90 con 0x7f55f40b3750 2024-08-19T00:42:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.079+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55f40cc580 con 0x7f55f40b3750 2024-08-19T00:42:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.079+0000 7f55f0c00640 1 -- 172.21.15.7:0/2101019060 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5219 (secure 0 0 0) 0x7f55dc07e190 con 0x7f55f40b3750 2024-08-19T00:42:42.083 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:42.083 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":69,"btime":"2024-08-19T00:42:34:888871+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:42:34.314121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6354":{"gid":6354,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2626740684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2626740684},{"type":"v1","addr":"172.21.15.7:6837","nonce":2626740684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6354,"qdb_cluster":[6354]},"id":5}]} 2024-08-19T00:42:42.083 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 69 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f55d006be30 msgr2=0x7f55d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f55d006be30 0x7f55d006e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f55e4006ca0 tx=0x7f55e4009240 comp rx=0 tx=0).stop 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f40b3750 msgr2=0x7f55f406df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f40b3750 0x7f55f406df80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55dc000c00 tx=0x7f55dc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 shutdown_connections 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f55d006be30 0x7f55d006e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55f40d03c0 0x7f55f41f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f40b3750 0x7f55f406df80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 --2- 172.21.15.7:0/2101019060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f406e710 0x7f55f409a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 >> 172.21.15.7:0/2101019060 conn(0x7f55f406bc70 msgr2=0x7f55f40af410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 shutdown_connections 2024-08-19T00:42:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.082+0000 7f55fb000640 1 -- 172.21.15.7:0/2101019060 wait complete. 2024-08-19T00:42:42.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:42:31.298074+0000', 'modified': '2024-08-19T00:42:34.314121+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6354}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6354': {'gid': 6354, 'name': 'c', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6837/2626740684', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 2626740684}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 2626740684}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6354, 'qdb_cluster': [6354]} 2024-08-19T00:42:42.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:42:42.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:42:42.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.661+0000 7f196ee00640 1 Processor -- start 2024-08-19T00:42:42.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.661+0000 7f196ee00640 1 -- start start 2024-08-19T00:42:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.662+0000 7f196ee00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f196815e3e0 0x7f19680b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.662+0000 7f196ee00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19680b4df0 con 0x7f19680d27b0 2024-08-19T00:42:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.662+0000 7f196ee00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19680b50d0 con 0x7f19680b4860 2024-08-19T00:42:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.662+0000 7f196ee00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f19680cf1e0 con 0x7f196815e3e0 2024-08-19T00:42:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.662+0000 7f196da00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f196815e3e0 0x7f19680b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.662+0000 7f196d000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f19680d27b0 0x7f19680b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44840/0 (socket says 172.21.15.7:44840) 2024-08-19T00:42:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.662+0000 7f196d000640 1 -- 172.21.15.7:0/2769563635 learned_addr learned my addr 172.21.15.7:0/2769563635 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:42.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.663+0000 7f196da00640 1 -- 172.21.15.7:0/2769563635 >> v1:172.21.15.162:6789/0 conn(0x7f19680b4860 legacy=0x7f19680cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.663+0000 7f196da00640 1 -- 172.21.15.7:0/2769563635 >> v1:172.21.15.7:6789/0 conn(0x7f19680d27b0 legacy=0x7f19680b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.663+0000 7f196da00640 1 -- 172.21.15.7:0/2769563635 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19680cf4c0 con 0x7f196815e3e0 2024-08-19T00:42:42.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.663+0000 7f1967e00640 1 -- 172.21.15.7:0/2769563635 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 202553116 0 0) 0x7f19680b4df0 con 0x7f19680d27b0 2024-08-19T00:42:42.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.664+0000 7f196da00640 1 --2- 172.21.15.7:0/2769563635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f196815e3e0 0x7f19680b0e60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f195c0097d0 tx=0x7f195c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e058d0194c2caa7c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.664+0000 7f1967e00640 1 -- 172.21.15.7:0/2769563635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c037070 con 0x7f196815e3e0 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.664+0000 7f1967e00640 1 -- 172.21.15.7:0/2769563635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c032440 con 0x7f196815e3e0 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.664+0000 7f1967e00640 1 -- 172.21.15.7:0/2769563635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c032810 con 0x7f196815e3e0 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.665+0000 7f196ee00640 1 -- 172.21.15.7:0/2769563635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f196815e3e0 msgr2=0x7f19680b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.665+0000 7f196ee00640 1 --2- 172.21.15.7:0/2769563635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f196815e3e0 0x7f19680b0e60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f195c0097d0 tx=0x7f195c02a270 comp rx=0 tx=0).stop 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.665+0000 7f196ee00640 1 -- 172.21.15.7:0/2769563635 shutdown_connections 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.665+0000 7f196ee00640 1 --2- 172.21.15.7:0/2769563635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f196815e3e0 0x7f19680b0e60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.665+0000 7f196ee00640 1 -- 172.21.15.7:0/2769563635 >> 172.21.15.7:0/2769563635 conn(0x7f196808dbe0 msgr2=0x7f196809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.665+0000 7f196ee00640 1 -- 172.21.15.7:0/2769563635 shutdown_connections 2024-08-19T00:42:42.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.665+0000 7f196ee00640 1 -- 172.21.15.7:0/2769563635 wait complete. 2024-08-19T00:42:42.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.666+0000 7f196ee00640 1 Processor -- start 2024-08-19T00:42:42.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.667+0000 7f196ee00640 1 -- start start 2024-08-19T00:42:42.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.667+0000 7f196ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19680b4860 0x7f19681f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.667+0000 7f196ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19680d27b0 0x7f19680cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.667+0000 7f196ee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f196815e3e0 0x7f19680cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.667+0000 7f196ee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19680d00f0 con 0x7f19680b4860 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.667+0000 7f196ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19680b13a0 con 0x7f19680d27b0 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.667+0000 7f196ee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19680d0270 con 0x7f196815e3e0 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19680b4860 0x7f19681f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19680b4860 0x7f19681f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34608/0 (socket says 172.21.15.7:34608) 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 -- 172.21.15.7:0/1019163848 learned_addr learned my addr 172.21.15.7:0/1019163848 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196e400640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f196815e3e0 0x7f19680cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196d000640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19680d27b0 0x7f19680cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 -- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f196815e3e0 msgr2=0x7f19680cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f196815e3e0 0x7f19680cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 -- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19680d27b0 msgr2=0x7f19680cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19680d27b0 0x7f19680cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.668+0000 7f196da00640 1 -- 172.21.15.7:0/1019163848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19680cc6a0 con 0x7f19680b4860 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.669+0000 7f196da00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19680b4860 0x7f19681f4cc0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.669+0000 7f1965600640 1 -- 172.21.15.7:0/1019163848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c037040 con 0x7f19680b4860 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.669+0000 7f1965600640 1 -- 172.21.15.7:0/1019163848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c042070 con 0x7f19680b4860 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.669+0000 7f1965600640 1 -- 172.21.15.7:0/1019163848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c030a70 con 0x7f19680b4860 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.669+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19680cc980 con 0x7f19680b4860 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.669+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19680ccf40 con 0x7f19680b4860 2024-08-19T00:42:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.671+0000 7f1965600640 1 -- 172.21.15.7:0/1019163848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f195c030c10 con 0x7f19680b4860 2024-08-19T00:42:42.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.672+0000 7f1965600640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f194806be30 0x7f194806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.672+0000 7f1965600640 1 -- 172.21.15.7:0/1019163848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f195c0ab9d0 con 0x7f19680b4860 2024-08-19T00:42:42.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.672+0000 7f196d000640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f194806be30 0x7f194806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.673+0000 7f196d000640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f194806be30 0x7f194806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f196815d760 tx=0x7f1954007b90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.673+0000 7f197326c740 1 Processor -- start 2024-08-19T00:42:42.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.673+0000 7f197326c740 1 -- start start 2024-08-19T00:42:42.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c41b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f197326c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c43ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c433fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f197326c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c51c353ba0 con 0x55c51c43e630 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c51c2ec230 con 0x55c51c41b110 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c51c34fb60 con 0x55c51c43ef90 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f196d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c43ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f196d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c43ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34616/0 (socket says 172.21.15.7:34616) 2024-08-19T00:42:42.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f196d000640 1 -- 172.21.15.7:0/3353358357 learned_addr learned my addr 172.21.15.7:0/3353358357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f196d000640 1 -- 172.21.15.7:0/3353358357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 msgr2=0x55c51c433fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.674+0000 7f196d000640 1 --2- 172.21.15.7:0/3353358357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c433fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.675+0000 7f196d000640 1 -- 172.21.15.7:0/3353358357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 msgr2=0x55c51c41b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.675+0000 7f196d000640 1 --2- 172.21.15.7:0/3353358357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c41b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.675+0000 7f196d000640 1 -- 172.21.15.7:0/3353358357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51c31dbb0 con 0x55c51c43e630 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.675+0000 7f196d000640 1 --2- 172.21.15.7:0/3353358357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c43ea50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1954005cb0 tx=0x7f1954012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b645890e4951d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.675+0000 7f195a000640 1 -- 172.21.15.7:0/3353358357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954015110 con 0x55c51c43e630 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.675+0000 7f195a000640 1 -- 172.21.15.7:0/3353358357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19540159c0 con 0x55c51c43e630 2024-08-19T00:42:42.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.675+0000 7f195a000640 1 -- 172.21.15.7:0/3353358357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954015d70 con 0x55c51c43e630 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 -- 172.21.15.7:0/3353358357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 msgr2=0x55c51c43ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 --2- 172.21.15.7:0/3353358357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c43ea50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1954005cb0 tx=0x7f1954012000 comp rx=0 tx=0).stop 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 -- 172.21.15.7:0/3353358357 shutdown_connections 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 --2- 172.21.15.7:0/3353358357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c433fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 --2- 172.21.15.7:0/3353358357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c43ea50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 --2- 172.21.15.7:0/3353358357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c41b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 -- 172.21.15.7:0/3353358357 >> 172.21.15.7:0/3353358357 conn(0x55c51c3b8110 msgr2=0x55c51c435f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 -- 172.21.15.7:0/3353358357 shutdown_connections 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 -- 172.21.15.7:0/3353358357 wait complete. 2024-08-19T00:42:42.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.676+0000 7f197326c740 1 -- start start 2024-08-19T00:42:42.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.677+0000 7f197326c740 1 Processor -- start 2024-08-19T00:42:42.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f197326c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c41b110 0x55c51c414b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c43e630 0x55c51c3ea920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f197326c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c51c438060 con 0x55c51c41b110 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c51c30f250 con 0x55c51c43e630 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c51c437770 con 0x55c51c43ef90 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f197326c740 10 client.0 _ll_register_callbacks cb 0x55c51c313740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c41b110 0x55c51c414b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c41b110 0x55c51c414b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34626/0 (socket says 172.21.15.7:34626) 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 -- 172.21.15.7:0/3193641056 learned_addr learned my addr 172.21.15.7:0/3193641056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196d000640 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c43e630 0x55c51c3ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196e400640 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 -- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 msgr2=0x55c51c4176a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4176a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 -- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c43e630 msgr2=0x55c51c3ea920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c43e630 0x55c51c3ea920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.678+0000 7f196da00640 1 -- 172.21.15.7:0/3193641056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51c0672d0 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f196da00640 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c41b110 0x55c51c414b10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f195c076040 tx=0x7f195c079600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7648785f4a7482 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f194ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f194ea00640 1 -- 172.21.15.7:0/3193641056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c091020 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f194ea00640 1 -- 172.21.15.7:0/3193641056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f195c0a4e70 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19540159c0 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f194ea00640 1 -- 172.21.15.7:0/3193641056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f195c079be0 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f197326c740 10 client.6492 fetch_fsmap learned FSMap version 69 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55c51c1316b0 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f194ea00640 1 -- 172.21.15.7:0/3193641056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19540159c0 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f194ea00640 1 -- 172.21.15.7:0/3193641056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f195c03a030 con 0x55c51c41b110 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f197326c740 10 client.6492 fetch_fsmap finished waiting for FSMap version 69 2024-08-19T00:42:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f197326c740 10 client.6492 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:42:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.679+0000 7f197326c740 20 client.6492 populate_metadata read hostname 'smithi007' 2024-08-19T00:42:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.680+0000 7f197326c740 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c430720 0x55c51c3f0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.680+0000 7f197326c740 4 client.6492 mds_command: new command op to 6354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:42:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.680+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 --> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c51c3612d0 con 0x55c51c430720 2024-08-19T00:42:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.680+0000 7f196d000640 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c430720 0x55c51c3f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.680+0000 7f196d000640 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c430720 0x55c51c3f0590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10bd76fdcaa8b23f server_cookie=f6d088988e3154e3 in_seq=0 out_seq=0 2024-08-19T00:42:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.680+0000 7f194ea00640 10 client.6492 ms_handle_connect on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.681+0000 7f194ea00640 1 -- 172.21.15.7:0/3193641056 <== mds.0 v2:172.21.15.7:6835/2626740684 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c51c3612d0 con 0x55c51c430720 2024-08-19T00:42:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.681+0000 7f194ea00640 10 client.6492 handle_command_reply: tid=0 2024-08-19T00:42:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.681+0000 7f197326c740 1 client.6492 shutdown 2024-08-19T00:42:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.681+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c41b110 msgr2=0x55c51c414b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.681+0000 7f197326c740 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c41b110 0x55c51c414b10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f195c076040 tx=0x7f195c079600 comp rx=0 tx=0).stop 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.681+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 shutdown_connections 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.681+0000 7f197326c740 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c430720 0x55c51c3f0590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f197326c740 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4176a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f197326c740 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c43e630 0x55c51c3ea920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f197326c740 1 --2- 172.21.15.7:0/3193641056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c41b110 0x55c51c414b10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f194ea00640 0 client.6492 ms_handle_reset on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 >> 172.21.15.7:0/3193641056 conn(0x55c51c3b8110 msgr2=0x55c51c4393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 shutdown_connections 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f197326c740 1 -- 172.21.15.7:0/3193641056 wait complete. 2024-08-19T00:42:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.682+0000 7f197326c740 20 client.6492 trim_cache size 0 max 16384 2024-08-19T00:42:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 Processor -- start 2024-08-19T00:42:42.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 -- start start 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c438a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43e630 0x55c51c434d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43ef90 0x55c51c4352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19681ff500 con 0x55c51c43ef90 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19681f47a0 con 0x55c51c41b110 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.701+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19681feeb0 con 0x55c51c43e630 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43ef90 0x55c51c4352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43ef90 0x55c51c4352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34642/0 (socket says 172.21.15.7:34642) 2024-08-19T00:42:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 -- 172.21.15.7:0/1680422297 learned_addr learned my addr 172.21.15.7:0/1680422297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 -- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43e630 msgr2=0x55c51c434d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196da00640 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c438a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196d000640 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43e630 0x55c51c434d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43e630 0x55c51c434d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 -- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 msgr2=0x55c51c438a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c438a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 -- 172.21.15.7:0/1680422297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51c3eac90 con 0x55c51c43ef90 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196da00640 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c438a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196d000640 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43e630 0x55c51c434d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.702+0000 7f196e400640 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43ef90 0x55c51c4352c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1960001ab0 tx=0x7f1960001f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceba42af11fa3820 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f1959600640 1 -- 172.21.15.7:0/1680422297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960003b80 con 0x55c51c43ef90 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f1959600640 1 -- 172.21.15.7:0/1680422297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196001a070 con 0x55c51c43ef90 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f1959600640 1 -- 172.21.15.7:0/1680422297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960011830 con 0x55c51c43ef90 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 -- 172.21.15.7:0/1680422297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43ef90 msgr2=0x55c51c4352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43ef90 0x55c51c4352c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1960001ab0 tx=0x7f1960001f70 comp rx=0 tx=0).stop 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 -- 172.21.15.7:0/1680422297 shutdown_connections 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43ef90 0x55c51c4352c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43e630 0x55c51c434d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 --2- 172.21.15.7:0/1680422297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c438a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 -- 172.21.15.7:0/1680422297 >> 172.21.15.7:0/1680422297 conn(0x55c51c3b8110 msgr2=0x55c51c437fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 -- 172.21.15.7:0/1680422297 shutdown_connections 2024-08-19T00:42:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.703+0000 7f197326c740 1 -- 172.21.15.7:0/1680422297 wait complete. 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.704+0000 7f197326c740 1 -- start start 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.704+0000 7f197326c740 1 Processor -- start 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c45a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f197326c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c4b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f197326c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4136f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f197326c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c51c4305a0 con 0x55c51c43e630 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c51c3eb6d0 con 0x55c51c41b110 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f197326c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c51c430bf0 con 0x55c51c43ef90 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f197326c740 10 client.0 _ll_register_callbacks cb 0x7f195c02a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f196d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c4b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f196d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c4b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34652/0 (socket says 172.21.15.7:34652) 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f196d000640 1 -- 172.21.15.7:0/3515843426 learned_addr learned my addr 172.21.15.7:0/3515843426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f196da00640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c45a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.705+0000 7f196e400640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f196d000640 1 -- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 msgr2=0x55c51c4136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f196d000640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f196d000640 1 -- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 msgr2=0x55c51c45a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f196d000640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c45a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f196d000640 1 -- 172.21.15.7:0/3515843426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51c44fd40 con 0x55c51c43e630 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f196da00640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c45a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f196d000640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c4b34d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1954005cb0 tx=0x7f1954007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efb075549533d6c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f194ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f194ea00640 1 -- 172.21.15.7:0/3515843426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954035060 con 0x55c51c43e630 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f194ea00640 1 -- 172.21.15.7:0/3515843426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f1954015dd0 con 0x55c51c43e630 2024-08-19T00:42:42.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.706+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f196001a070 con 0x55c51c43e630 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f194ea00640 1 -- 172.21.15.7:0/3515843426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f195403b050 con 0x55c51c43e630 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 10 client.6498 fetch_fsmap learned FSMap version 69 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55c51c450050 con 0x55c51c43e630 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f194ea00640 1 -- 172.21.15.7:0/3515843426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196001a070 con 0x55c51c43e630 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f194ea00640 1 -- 172.21.15.7:0/3515843426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f195403e020 con 0x55c51c43e630 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 10 client.6498 fetch_fsmap finished waiting for FSMap version 69 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 10 client.6498 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 20 client.6498 populate_metadata read hostname 'smithi007' 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c416750 0x55c51c42ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 4 client.6498 mds_command: new command op to 6354 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 --> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] -- command(tid 0: {"prefix": "status"}) -- 0x55c51c35b620 con 0x55c51c416750 2024-08-19T00:42:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.707+0000 7f196da00640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c416750 0x55c51c42ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f196da00640 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c416750 0x55c51c42ec60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9711653d11d7e122 server_cookie=75fe87d05b14b50c in_seq=0 out_seq=0 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f194ea00640 10 client.6498 ms_handle_connect on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f194ea00640 1 -- 172.21.15.7:0/3515843426 <== mds.0 v2:172.21.15.7:6835/2626740684 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c51c35b620 con 0x55c51c416750 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f194ea00640 10 client.6498 handle_command_reply: tid=0 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 client.6498 shutdown 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 msgr2=0x55c51c4b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c4b34d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1954005cb0 tx=0x7f1954007a10 comp rx=0 tx=0).stop 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 shutdown_connections 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x55c51c416750 0x55c51c42ec60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c51c43ef90 0x55c51c4136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c51c43e630 0x55c51c4b34d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 --2- 172.21.15.7:0/3515843426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c51c41b110 0x55c51c45a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f194ea00640 0 client.6498 ms_handle_reset on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 >> 172.21.15.7:0/3515843426 conn(0x55c51c3b8110 msgr2=0x55c51c3ec0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 shutdown_connections 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.708+0000 7f197326c740 1 -- 172.21.15.7:0/3515843426 wait complete. 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f197326c740 20 client.6498 trim_cache size 0 max 16384 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:42:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6354, 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 10.828908558, 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 69, 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 72, 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 72, 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 15.518629047999999 2024-08-19T00:42:42.717 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:42:42.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f194806be30 msgr2=0x7f194806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f194806be30 0x7f194806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f196815d760 tx=0x7f1954007b90 comp rx=0 tx=0).stop 2024-08-19T00:42:42.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19680b4860 msgr2=0x7f19681f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19680b4860 0x7f19681f4cc0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 shutdown_connections 2024-08-19T00:42:42.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f194806be30 0x7f194806e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f196815e3e0 0x7f19680cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19680d27b0 0x7f19680cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 --2- 172.21.15.7:0/1019163848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19680b4860 0x7f19681f4cc0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 >> 172.21.15.7:0/1019163848 conn(0x7f196808dbe0 msgr2=0x7f19680b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 shutdown_connections 2024-08-19T00:42:42.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.709+0000 7f196ee00640 1 -- 172.21.15.7:0/1019163848 wait complete. 2024-08-19T00:42:42.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:42:42.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.882+0000 7f47c5600640 1 Processor -- start 2024-08-19T00:42:42.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.882+0000 7f47c5600640 1 -- start start 2024-08-19T00:42:42.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.883+0000 7f47c5600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 0x7f47c0073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.883+0000 7f47c5600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f47c00cec10 0x7f47c00d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.883+0000 7f47c5600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c006f7f0 con 0x7f47c00739a0 2024-08-19T00:42:42.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.883+0000 7f47c5600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f47c006f510 con 0x7f47c00cec10 2024-08-19T00:42:42.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.883+0000 7f47c5600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47c0072980 con 0x7f47c0159bf0 2024-08-19T00:42:42.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47b7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f47c00739a0 0x7f47c00ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44848/0 (socket says 172.21.15.7:44848) 2024-08-19T00:42:42.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47b7e00640 1 -- 172.21.15.7:0/1348738192 learned_addr learned my addr 172.21.15.7:0/1348738192 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47bf400640 1 --2- 172.21.15.7:0/1348738192 >> v2:172.21.15.162:3300/0 conn(0x7f47c00cec10 0x7f47c00d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47bea00640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 0x7f47c0073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090584823 0 0) 0x7f47c006f7f0 con 0x7f47c00739a0 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a4003520 con 0x7f47c00739a0 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3096133044 0 0) 0x7f47a4003520 con 0x7f47c00739a0 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 msgr2=0x7f47c0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 0x7f47c0073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 >> v2:172.21.15.162:3300/0 conn(0x7f47c00cec10 msgr2=0x7f47c00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 --2- 172.21.15.7:0/1348738192 >> v2:172.21.15.162:3300/0 conn(0x7f47c00cec10 0x7f47c00d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c0072c60 con 0x7f47c00739a0 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.884+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f47a8001670 con 0x7f47c00739a0 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 >> v1:172.21.15.7:6789/0 conn(0x7f47c00739a0 legacy=0x7f47c00ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47be000640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47be000640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 0x7f47a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47be000640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a4004d40 0x7f47a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47c006f510 con 0x7f47a40039b0 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0072980 con 0x7f47a4004d40 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47a400fe00 con 0x7f47c0159bf0 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bea00640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bf400640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a4004d40 0x7f47a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47b7e00640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 0x7f47a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bea00640 1 -- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 msgr2=0x7f47a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bea00640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c0159bf0 0x7f47a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bea00640 1 -- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a4004d40 msgr2=0x7f47a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bea00640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a4004d40 0x7f47a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bea00640 1 -- 172.21.15.7:0/1348738192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a4003520 con 0x7f47a40039b0 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.885+0000 7f47bf400640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a4004d40 0x7f47a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.886+0000 7f47bea00640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47a4003dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009ac0 tx=0x7f47a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c96ad431e5620b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.886+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0036070 con 0x7f47a40039b0 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.886+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0031400 con 0x7f47a40039b0 2024-08-19T00:42:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.886+0000 7f47be000640 1 -- 172.21.15.7:0/1348738192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0009690 con 0x7f47a40039b0 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.887+0000 7f47c5600640 1 -- 172.21.15.7:0/1348738192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 msgr2=0x7f47a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.887+0000 7f47c5600640 1 --2- 172.21.15.7:0/1348738192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47a4003dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009ac0 tx=0x7f47a4005830 comp rx=0 tx=0).stop 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.887+0000 7f47bf400640 1 -- 172.21.15.7:0/1348738192 reap_dead start 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.887+0000 7f47c5600640 1 -- 172.21.15.7:0/1348738192 shutdown_connections 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.887+0000 7f47c5600640 1 -- 172.21.15.7:0/1348738192 >> 172.21.15.7:0/1348738192 conn(0x7f47c006bc70 msgr2=0x7f47c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.887+0000 7f47c5600640 1 -- 172.21.15.7:0/1348738192 shutdown_connections 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.887+0000 7f47c5600640 1 -- 172.21.15.7:0/1348738192 wait complete. 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.889+0000 7f47c5600640 1 Processor -- start 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.889+0000 7f47c5600640 1 -- start start 2024-08-19T00:42:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47c5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47c0153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47c5600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c014c490 0x7f47c015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47c5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c015e200 0x7f47c01f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47c5600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47c015a150 con 0x7f47a40039b0 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47c5600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0159fd0 con 0x7f47c015e200 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47c5600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47c0073460 con 0x7f47c014c490 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47c0153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47c0153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34662/0 (socket says 172.21.15.7:34662) 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 -- 172.21.15.7:0/3461090694 learned_addr learned my addr 172.21.15.7:0/3461090694 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bf400640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c015e200 0x7f47c01f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 -- 172.21.15.7:0/3461090694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c014c490 msgr2=0x7f47c015dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c014c490 0x7f47c015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 -- 172.21.15.7:0/3461090694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c015e200 msgr2=0x7f47c01f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c015e200 0x7f47c01f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.890+0000 7f47bea00640 1 -- 172.21.15.7:0/3461090694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c01537c0 con 0x7f47a40039b0 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.891+0000 7f47bea00640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47c0153280 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f47b0034040 tx=0x7f47b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.891+0000 7f47b6a00640 1 -- 172.21.15.7:0/3461090694 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0040020 con 0x7f47a40039b0 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.891+0000 7f47b6a00640 1 -- 172.21.15.7:0/3461090694 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0003bc0 con 0x7f47a40039b0 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.891+0000 7f47b6a00640 1 -- 172.21.15.7:0/3461090694 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0036040 con 0x7f47a40039b0 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.891+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c01521e0 con 0x7f47a40039b0 2024-08-19T00:42:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.891+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01527a0 con 0x7f47a40039b0 2024-08-19T00:42:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.892+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c015e5e0 con 0x7f47a40039b0 2024-08-19T00:42:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.893+0000 7f47b6a00640 1 -- 172.21.15.7:0/3461090694 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47b0043020 con 0x7f47a40039b0 2024-08-19T00:42:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.894+0000 7f47b6a00640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f479c06be30 0x7f479c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.894+0000 7f47b6a00640 1 -- 172.21.15.7:0/3461090694 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f47b00aafe0 con 0x7f47a40039b0 2024-08-19T00:42:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.894+0000 7f47b7e00640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f479c06be30 0x7f479c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.895+0000 7f47b7e00640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f479c06be30 0x7f479c06e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f47c0160e10 tx=0x7f47a8000f70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:42.898+0000 7f47b6a00640 1 -- 172.21.15.7:0/3461090694 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f47b004a070 con 0x7f47a40039b0 2024-08-19T00:42:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.125+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f47c015ba70 con 0x7f47a40039b0 2024-08-19T00:42:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.126+0000 7f47b6a00640 1 -- 172.21.15.7:0/3461090694 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) ==== 53+0+73 (secure 0 0 0) 0x7f47b00044e0 con 0x7f47a40039b0 2024-08-19T00:42:43.128 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:42:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f479c06be30 msgr2=0x7f479c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f479c06be30 0x7f479c06e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f47c0160e10 tx=0x7f47a8000f70 comp rx=0 tx=0).stop 2024-08-19T00:42:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 msgr2=0x7f47c0153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47c0153280 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f47b0034040 tx=0x7f47b0004730 comp rx=0 tx=0).stop 2024-08-19T00:42:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 shutdown_connections 2024-08-19T00:42:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f479c06be30 0x7f479c06e2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c015e200 0x7f47c01f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c014c490 0x7f47c015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 --2- 172.21.15.7:0/3461090694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47a40039b0 0x7f47c0153280 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 >> 172.21.15.7:0/3461090694 conn(0x7f47c006bc70 msgr2=0x7f47c0074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 shutdown_connections 2024-08-19T00:42:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43.128+0000 7f47c5600640 1 -- 172.21.15.7:0/3461090694 wait complete. 2024-08-19T00:42:43.146 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:42:43.146 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:42:43.146 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:42:43.147 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:42:43.147 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:43.147 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:42:43.147 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:42:43.147 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:42:43.147 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:42:43.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:43.147 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:42:43.183 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:42:43.183 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:42:43.183 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:42:43.183 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:43.183 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42498sec preferred_lft 42498sec 2024-08-19T00:42:43.184 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:42:43.185 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:42:43.186 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:43.186 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:42:43.186 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:42:43.186 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:42:43.186 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:42:43.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:43.186 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:42:43.277 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:42:43.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:43.280 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:42:43.317 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:42:43.317 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:42:43.317 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:42:43.317 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:42:43.317 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:42:43.317 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:42:43.317 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:42:43.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:42:43.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:42:43.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:42:43.318 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:42:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:42:43.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:42:43.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:43.515 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:42:43.551 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:42:43.551 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:42:43.551 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:42:43.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:43.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:42:43.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:42:43.647 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:43.682 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:42:43.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:42:43.683 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:43.757 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:42:43.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:43.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:43.886 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:43.887 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:42:43.887 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:42:43.902 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:43.903 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:42:43.903 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:42:43.903 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:42:43.903 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:42:43.926 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:42:43.926 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:42:43.927 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:42:43.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:42:43.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:42:43.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:42:43.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:42:43.927 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:42:43.929 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:42:43.929 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:42:43.929 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:42:43.929 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:42:43.930 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:42:43.932 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:42:43.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:42:43.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:42:43.989 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:42:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:42:44.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:42:44.088 INFO:teuthology.orchestra.run.smithi007.stdout:client5723 2024-08-19T00:42:44.088 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:42:44.088 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:42:44.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.318+0000 7f0c2b200640 1 Processor -- start 2024-08-19T00:42:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.318+0000 7f0c2b200640 1 -- start start 2024-08-19T00:42:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.319+0000 7f0c2b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0c240ce500 0x7f0c240ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.319+0000 7f0c2b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c240d03c0 0x7f0c240d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.319+0000 7f0c2b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2406f7f0 con 0x7f0c24159bf0 2024-08-19T00:42:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.319+0000 7f0c2b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0c240d0d50 con 0x7f0c240ce500 2024-08-19T00:42:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.319+0000 7f0c2b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2406f510 con 0x7f0c240d03c0 2024-08-19T00:42:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c23e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0c24159bf0 0x7f0c24073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58818/0 (socket says 172.21.15.7:58818) 2024-08-19T00:42:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c23e00640 1 -- 172.21.15.7:0/3325023998 learned_addr learned my addr 172.21.15.7:0/3325023998 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c1be00640 1 --2- 172.21.15.7:0/3325023998 >> v2:172.21.15.7:3300/0 conn(0x7f0c240ce500 0x7f0c240ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c29200640 1 --2- 172.21.15.7:0/3325023998 >> v2:172.21.15.162:3300/0 conn(0x7f0c240d03c0 0x7f0c240d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c1be00640 1 -- 172.21.15.7:0/3325023998 >> v2:172.21.15.162:3300/0 conn(0x7f0c240d03c0 msgr2=0x7f0c240d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c1be00640 1 --2- 172.21.15.7:0/3325023998 >> v2:172.21.15.162:3300/0 conn(0x7f0c240d03c0 0x7f0c240d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c1be00640 1 -- 172.21.15.7:0/3325023998 >> v1:172.21.15.7:6789/0 conn(0x7f0c24159bf0 legacy=0x7f0c24073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c1be00640 1 -- 172.21.15.7:0/3325023998 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c24072980 con 0x7f0c240ce500 2024-08-19T00:42:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.320+0000 7f0c23400640 1 -- 172.21.15.7:0/3325023998 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739036403 0 0) 0x7f0c2406f7f0 con 0x7f0c24159bf0 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.321+0000 7f0c1be00640 1 --2- 172.21.15.7:0/3325023998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c240ce500 0x7f0c240ce970 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0c240d0fb0 tx=0x7f0c0c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28890699d631307 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c23400640 1 -- 172.21.15.7:0/3325023998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c037070 con 0x7f0c240ce500 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c23400640 1 -- 172.21.15.7:0/3325023998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0c032440 con 0x7f0c240ce500 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c23400640 1 -- 172.21.15.7:0/3325023998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c02ae60 con 0x7f0c240ce500 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 -- 172.21.15.7:0/3325023998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c240ce500 msgr2=0x7f0c240ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 --2- 172.21.15.7:0/3325023998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c240ce500 0x7f0c240ce970 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0c240d0fb0 tx=0x7f0c0c02a110 comp rx=0 tx=0).stop 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 -- 172.21.15.7:0/3325023998 shutdown_connections 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 --2- 172.21.15.7:0/3325023998 >> v2:172.21.15.162:3300/0 conn(0x7f0c240d03c0 0x7f0c240d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 --2- 172.21.15.7:0/3325023998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c240ce500 0x7f0c240ce970 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 -- 172.21.15.7:0/3325023998 >> 172.21.15.7:0/3325023998 conn(0x7f0c2406bc70 msgr2=0x7f0c2406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 -- 172.21.15.7:0/3325023998 shutdown_connections 2024-08-19T00:42:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.322+0000 7f0c2b200640 1 -- 172.21.15.7:0/3325023998 wait complete. 2024-08-19T00:42:44.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.324+0000 7f0c2b200640 1 Processor -- start 2024-08-19T00:42:44.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.324+0000 7f0c2b200640 1 -- start start 2024-08-19T00:42:44.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c2b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c240ce500 0x7f0c2409ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c2b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240d03c0 0x7f0c2414afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c2b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c24159bf0 0x7f0c2414b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c2b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24073b70 con 0x7f0c24159bf0 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c2b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24072f40 con 0x7f0c240d03c0 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c2b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c24159fd0 con 0x7f0c240ce500 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c29200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c24159bf0 0x7f0c2414b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c29200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c24159bf0 0x7f0c2414b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34640/0 (socket says 172.21.15.7:34640) 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c29200640 1 -- 172.21.15.7:0/1581692601 learned_addr learned my addr 172.21.15.7:0/1581692601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.325+0000 7f0c23e00640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c240ce500 0x7f0c2409ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c1be00640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240d03c0 0x7f0c2414afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c29200640 1 -- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c240ce500 msgr2=0x7f0c2409ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c29200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c240ce500 0x7f0c2409ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c29200640 1 -- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240d03c0 msgr2=0x7f0c2414afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c29200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240d03c0 0x7f0c2414afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c29200640 1 -- 172.21.15.7:0/1581692601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2409d510 con 0x7f0c24159bf0 2024-08-19T00:42:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c1be00640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240d03c0 0x7f0c2414afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c23e00640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c240ce500 0x7f0c2409ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c29200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c24159bf0 0x7f0c2414b500 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c007e40 tx=0x7f0c1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c20c00640 1 -- 172.21.15.7:0/1581692601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c014620 con 0x7f0c24159bf0 2024-08-19T00:42:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c20c00640 1 -- 172.21.15.7:0/1581692601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c019070 con 0x7f0c24159bf0 2024-08-19T00:42:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c20c00640 1 -- 172.21.15.7:0/1581692601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c014a20 con 0x7f0c24159bf0 2024-08-19T00:42:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2409d7f0 con 0x7f0c24159bf0 2024-08-19T00:42:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.326+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2409ddb0 con 0x7f0c24159bf0 2024-08-19T00:42:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.327+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c24155370 con 0x7f0c24159bf0 2024-08-19T00:42:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.328+0000 7f0c20c00640 1 -- 172.21.15.7:0/1581692601 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c1c014bc0 con 0x7f0c24159bf0 2024-08-19T00:42:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.329+0000 7f0c20c00640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c0006be30 0x7f0c0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.329+0000 7f0c20c00640 1 -- 172.21.15.7:0/1581692601 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f0c1c08b810 con 0x7f0c24159bf0 2024-08-19T00:42:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.329+0000 7f0c23e00640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c0006be30 0x7f0c0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.330+0000 7f0c23e00640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c0006be30 0x7f0c0006e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000f60 tx=0x7f0c14007c30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.334+0000 7f0c20c00640 1 -- 172.21.15.7:0/1581692601 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0c24155370 con 0x7f0c24159bf0 2024-08-19T00:42:44.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.553+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c240d0810 con 0x7f0c24159bf0 2024-08-19T00:42:44.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.554+0000 7f0c20c00640 1 -- 172.21.15.7:0/1581692601 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5219 (secure 0 0 0) 0x7f0c1c05a120 con 0x7f0c24159bf0 2024-08-19T00:42:44.556 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:44.557 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":69,"btime":"2024-08-19T00:42:34:888871+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:42:34.314121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6354":{"gid":6354,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2626740684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2626740684},{"type":"v1","addr":"172.21.15.7:6837","nonce":2626740684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6354,"qdb_cluster":[6354]},"id":5}]} 2024-08-19T00:42:44.557 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 69 2024-08-19T00:42:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c0006be30 msgr2=0x7f0c0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c0006be30 0x7f0c0006e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000f60 tx=0x7f0c14007c30 comp rx=0 tx=0).stop 2024-08-19T00:42:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c24159bf0 msgr2=0x7f0c2414b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c24159bf0 0x7f0c2414b500 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c007e40 tx=0x7f0c1c00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 shutdown_connections 2024-08-19T00:42:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c0006be30 0x7f0c0006e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c24159bf0 0x7f0c2414b500 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240d03c0 0x7f0c2414afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 --2- 172.21.15.7:0/1581692601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c240ce500 0x7f0c2409ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 >> 172.21.15.7:0/1581692601 conn(0x7f0c2406bc70 msgr2=0x7f0c240cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 shutdown_connections 2024-08-19T00:42:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.556+0000 7f0c2b200640 1 -- 172.21.15.7:0/1581692601 wait complete. 2024-08-19T00:42:44.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 5:0 true 2024-08-19T00:42:44.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.730+0000 7f1fb9a00640 1 Processor -- start 2024-08-19T00:42:44.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.730+0000 7f1fb9a00640 1 -- start start 2024-08-19T00:42:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.731+0000 7f1fb9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 0x7f1fb406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.731+0000 7f1fb9a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb406e0a0 con 0x7f1fb40ccc40 2024-08-19T00:42:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.731+0000 7f1fb9a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb40b6f70 con 0x7f1fb409ba80 2024-08-19T00:42:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.731+0000 7f1fb9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb40b7250 con 0x7f1fb406d780 2024-08-19T00:42:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb3400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1fb40ccc40 0x7f1fb40b64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58824/0 (socket says 172.21.15.7:58824) 2024-08-19T00:42:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb3400640 1 -- 172.21.15.7:0/1748630400 learned_addr learned my addr 172.21.15.7:0/1748630400 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 0x7f1fb406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313174583 0 0) 0x7f1fb406e0a0 con 0x7f1fb40ccc40 2024-08-19T00:42:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f98003520 con 0x7f1fb40ccc40 2024-08-19T00:42:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545077007 0 0) 0x7f1fb40b6f70 con 0x7f1fb409ba80 2024-08-19T00:42:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fb406e0a0 con 0x7f1fb409ba80 2024-08-19T00:42:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1870748785 0 0) 0x7f1f98003520 con 0x7f1fb40ccc40 2024-08-19T00:42:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 msgr2=0x7f1fb406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 0x7f1fb406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 >> v1:172.21.15.162:6789/0 conn(0x7f1fb409ba80 legacy=0x7f1fb40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb40cb430 con 0x7f1fb40ccc40 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f1fac0019f0 con 0x7f1fb40ccc40 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.732+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 >> v1:172.21.15.7:6789/0 conn(0x7f1fb40ccc40 legacy=0x7f1fb40b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb1600640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f98003b70 0x7f1f98003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb1600640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 0x7f1f98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb1600640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98004d40 0x7f1f980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb40b7250 con 0x7f1f98003b70 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9800ba70 con 0x7f1f98004d40 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9800bc20 con 0x7f1fb406d780 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f98003b70 0x7f1f98003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2000640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 0x7f1f98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2a00640 1 -- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 msgr2=0x7f1f98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 0x7f1f98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2a00640 1 -- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98004d40 msgr2=0x7f1f980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98004d40 0x7f1f980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2a00640 1 -- 172.21.15.7:0/1748630400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f98003520 con 0x7f1f98003b70 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.733+0000 7f1fb2000640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb406d780 0x7f1f98004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.734+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f98003b70 0x7f1f98003f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009ac0 tx=0x7f1f98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ebaf7018e7a443 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.734+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4036070 con 0x7f1f98003b70 2024-08-19T00:42:44.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.734+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa4031400 con 0x7f1f98003b70 2024-08-19T00:42:44.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb1600640 1 -- 172.21.15.7:0/1748630400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4009690 con 0x7f1f98003b70 2024-08-19T00:42:44.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb9a00640 1 -- 172.21.15.7:0/1748630400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f98003b70 msgr2=0x7f1f98003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb9a00640 1 --2- 172.21.15.7:0/1748630400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f98003b70 0x7f1f98003f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009ac0 tx=0x7f1f98005830 comp rx=0 tx=0).stop 2024-08-19T00:42:44.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb3400640 1 -- 172.21.15.7:0/1748630400 reap_dead start 2024-08-19T00:42:44.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb9a00640 1 -- 172.21.15.7:0/1748630400 shutdown_connections 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb9a00640 1 -- 172.21.15.7:0/1748630400 >> 172.21.15.7:0/1748630400 conn(0x7f1fb40d2180 msgr2=0x7f1fb40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb9a00640 1 -- 172.21.15.7:0/1748630400 shutdown_connections 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.735+0000 7f1fb9a00640 1 -- 172.21.15.7:0/1748630400 wait complete. 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.737+0000 7f1fb9a00640 1 Processor -- start 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.737+0000 7f1fb9a00640 1 -- start start 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98003b70 0x7f1fb4145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb409d620 0x7f1fb409e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb409e670 0x7f1fb406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb9a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb415ea10 con 0x7f1fb409d620 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb9a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb406f9a0 con 0x7f1f98003b70 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb406d380 con 0x7f1fb409e670 2024-08-19T00:42:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb409d620 0x7f1fb409e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb409d620 0x7f1fb409e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34664/0 (socket says 172.21.15.7:34664) 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb2000640 1 -- 172.21.15.7:0/2750538260 learned_addr learned my addr 172.21.15.7:0/2750538260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb3400640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb409e670 0x7f1fb406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.738+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98003b70 0x7f1fb4145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb2000640 1 -- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb409e670 msgr2=0x7f1fb406fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb2000640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb409e670 0x7f1fb406fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb2000640 1 -- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98003b70 msgr2=0x7f1fb4145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb2000640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98003b70 0x7f1fb4145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb2000640 1 -- 172.21.15.7:0/2750538260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb41460f0 con 0x7f1fb409d620 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb2000640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb409d620 0x7f1fb409e130 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000e7b0 tx=0x7f1fa000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1faaa00640 1 -- 172.21.15.7:0/2750538260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00050d0 con 0x7f1fb409d620 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1faaa00640 1 -- 172.21.15.7:0/2750538260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa0005270 con 0x7f1fb409d620 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1faaa00640 1 -- 172.21.15.7:0/2750538260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005420 con 0x7f1fb409d620 2024-08-19T00:42:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb409c580 con 0x7f1fb409d620 2024-08-19T00:42:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.739+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb409cb40 con 0x7f1fb409d620 2024-08-19T00:42:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.740+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb40b6f70 con 0x7f1fb409d620 2024-08-19T00:42:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.741+0000 7f1faaa00640 1 -- 172.21.15.7:0/2750538260 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fa001a020 con 0x7f1fb409d620 2024-08-19T00:42:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.742+0000 7f1faaa00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f9406be30 0x7f1f9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.742+0000 7f1faaa00640 1 -- 172.21.15.7:0/2750538260 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f1fa008a520 con 0x7f1fb409d620 2024-08-19T00:42:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.742+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f9406be30 0x7f1f9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.743+0000 7f1fb2a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f9406be30 0x7f1f9406e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4033000 tx=0x7f1fa4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:44.746+0000 7f1faaa00640 1 -- 172.21.15.7:0/2750538260 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1fa0058870 con 0x7f1fb409d620 2024-08-19T00:42:45.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.003+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "5:0", "val": "true"} v 0) -- 0x7f1fb4159fa0 con 0x7f1fb409d620 2024-08-19T00:42:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.936+0000 7f1faaa00640 1 -- 172.21.15.7:0/2750538260 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "5:0", "val": "true"}]=0 freezing mds.6354 v70) ==== 112+0+0 (secure 0 0 0) 0x7f1fa005cb70 con 0x7f1fb409d620 2024-08-19T00:42:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:freezing mds.6354 2024-08-19T00:42:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f9406be30 msgr2=0x7f1f9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f9406be30 0x7f1f9406e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4033000 tx=0x7f1fa4008030 comp rx=0 tx=0).stop 2024-08-19T00:42:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb409d620 msgr2=0x7f1fb409e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb409d620 0x7f1fb409e130 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000e7b0 tx=0x7f1fa000ec70 comp rx=0 tx=0).stop 2024-08-19T00:42:45.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 shutdown_connections 2024-08-19T00:42:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f9406be30 0x7f1f9406e2f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb409e670 0x7f1fb406fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb409d620 0x7f1fb409e130 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 --2- 172.21.15.7:0/2750538260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f98003b70 0x7f1fb4145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.939+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 >> 172.21.15.7:0/2750538260 conn(0x7f1fb40d2180 msgr2=0x7f1fb4071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.940+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 shutdown_connections 2024-08-19T00:42:45.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:45.940+0000 7f1fb9a00640 1 -- 172.21.15.7:0/2750538260 wait complete. 2024-08-19T00:42:45.961 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p a/{b,c}/d') 2024-08-19T00:42:46.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:42:46.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:42:46.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2024-08-19T00:42:46.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.231+0000 7f5b1b000640 1 Processor -- start 2024-08-19T00:42:46.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.231+0000 7f5b1b000640 1 -- start start 2024-08-19T00:42:46.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.231+0000 7f5b1b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1406d770 0x7f5b1406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.231+0000 7f5b1b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b140b5da0 0x7f5b140b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.231+0000 7f5b1b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1406e090 con 0x7f5b140b66e0 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.231+0000 7f5b1b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5b140b6f70 con 0x7f5b140b5da0 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.231+0000 7f5b1b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b140b7250 con 0x7f5b1406d770 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1406d770 0x7f5b1406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b140b5da0 0x7f5b140b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b140b5da0 0x7f5b140b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:49796/0 (socket says 172.21.15.7:49796) 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1406d770 0x7f5b1406db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53000/0 (socket says 172.21.15.7:53000) 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b19000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5b140b66e0 0x7f5b140cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:58232/0 (socket says 172.21.15.7:58232) 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13400640 1 -- 172.21.15.7:0/4203074547 learned_addr learned my addr 172.21.15.7:0/4203074547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13400640 1 -- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1406d770 msgr2=0x7f5b1406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13400640 1 --2- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1406d770 0x7f5b1406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13400640 1 -- 172.21.15.7:0/4203074547 >> v1:172.21.15.162:6789/0 conn(0x7f5b140b66e0 legacy=0x7f5b140cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13400640 1 -- 172.21.15.7:0/4203074547 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b140cb430 con 0x7f5b140b5da0 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b12a00640 1 -- 172.21.15.7:0/4203074547 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606766307 0 0) 0x7f5b1406e090 con 0x7f5b140b66e0 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.232+0000 7f5b13e00640 1 --2- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1406d770 0x7f5b1406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.234+0000 7f5b13400640 1 --2- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 0x7f5b140b61a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009870 tx=0x7f5b0002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=910a75bec7492688 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.234+0000 7f5b12a00640 1 -- 172.21.15.7:0/4203074547 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00037070 con 0x7f5b140b5da0 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.234+0000 7f5b12a00640 1 -- 172.21.15.7:0/4203074547 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00032440 con 0x7f5b140b5da0 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.234+0000 7f5b12a00640 1 -- 172.21.15.7:0/4203074547 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00032810 con 0x7f5b140b5da0 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 -- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 msgr2=0x7f5b140b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 --2- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 0x7f5b140b61a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009870 tx=0x7f5b0002a250 comp rx=0 tx=0).stop 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 -- 172.21.15.7:0/4203074547 shutdown_connections 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 --2- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 0x7f5b140b61a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 --2- 172.21.15.7:0/4203074547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1406d770 0x7f5b1406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 -- 172.21.15.7:0/4203074547 >> 172.21.15.7:0/4203074547 conn(0x7f5b140d2180 msgr2=0x7f5b140d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 -- 172.21.15.7:0/4203074547 shutdown_connections 2024-08-19T00:42:46.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.235+0000 7f5b1b000640 1 -- 172.21.15.7:0/4203074547 wait complete. 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.236+0000 7f5b1b000640 1 Processor -- start 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.237+0000 7f5b1b000640 1 -- start start 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.237+0000 7f5b1b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1406d770 0x7f5b141f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.237+0000 7f5b1b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 0x7f5b1409f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b1b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b140b66e0 0x7f5b140ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b1b000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1415ea10 con 0x7f5b1406d770 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b1b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1406f9a0 con 0x7f5b140b5da0 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b1b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1406d370 con 0x7f5b140b66e0 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1406d770 0x7f5b141f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1406d770 0x7f5b141f49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34674/0 (socket says 172.21.15.7:34674) 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 -- 172.21.15.7:0/586815031 learned_addr learned my addr 172.21.15.7:0/586815031 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13400640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 0x7f5b1409f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b19000640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b140b66e0 0x7f5b140ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 -- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b140b66e0 msgr2=0x7f5b140ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b140b66e0 0x7f5b140ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 -- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 msgr2=0x7f5b1409f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 0x7f5b1409f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.238+0000 7f5b13e00640 1 -- 172.21.15.7:0/586815031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b14156c60 con 0x7f5b1406d770 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.239+0000 7f5b13e00640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1406d770 0x7f5b141f49a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e960 tx=0x7f5b0400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.239+0000 7f5b0be00640 1 -- 172.21.15.7:0/586815031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04017070 con 0x7f5b1406d770 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.239+0000 7f5b0be00640 1 -- 172.21.15.7:0/586815031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0400ca00 con 0x7f5b1406d770 2024-08-19T00:42:46.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.239+0000 7f5b0be00640 1 -- 172.21.15.7:0/586815031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400cdd0 con 0x7f5b1406d770 2024-08-19T00:42:46.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.239+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b14156f00 con 0x7f5b1406d770 2024-08-19T00:42:46.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.239+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b141574c0 con 0x7f5b1406d770 2024-08-19T00:42:46.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.241+0000 7f5b0be00640 1 -- 172.21.15.7:0/586815031 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b0401a070 con 0x7f5b1406d770 2024-08-19T00:42:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.242+0000 7f5b0be00640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5af406be30 0x7f5af406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.242+0000 7f5b0be00640 1 -- 172.21.15.7:0/586815031 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f5b0408acd0 con 0x7f5b1406d770 2024-08-19T00:42:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.242+0000 7f5b13400640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5af406be30 0x7f5af406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.243+0000 7f5b1e086740 1 Processor -- start 2024-08-19T00:42:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.243+0000 7f5b1e086740 1 -- start start 2024-08-19T00:42:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.243+0000 7f5b13400640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5af406be30 0x7f5af406e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b00034000 tx=0x7f5b0002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e56bdbf0 0x5606e56bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5674d00 0x5606e5671b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5678d10 0x5606e56baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b1e086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5606e55d9de0 con 0x5606e5678d10 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5606e55720e0 con 0x5606e56bdbf0 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5606e55d5da0 con 0x5606e5674d00 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b19000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5678d10 0x5606e56baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b19000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5678d10 0x5606e56baab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34676/0 (socket says 172.21.15.7:34676) 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b19000640 1 -- 172.21.15.7:0/777611375 learned_addr learned my addr 172.21.15.7:0/777611375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b19000640 1 -- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5674d00 msgr2=0x5606e5671b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b13400640 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5674d00 0x5606e5671b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b13e00640 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e56bdbf0 0x5606e56bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.244+0000 7f5b19000640 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5674d00 0x5606e5671b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b19000640 1 -- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e56bdbf0 msgr2=0x5606e56bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b19000640 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e56bdbf0 0x5606e56bdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b19000640 1 -- 172.21.15.7:0/777611375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e53b77d0 con 0x5606e5678d10 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b13400640 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5674d00 0x5606e5671b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b13e00640 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e56bdbf0 0x5606e56bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b19000640 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5678d10 0x5606e56baab0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c007290 tx=0x7f5b0c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351b735365f3ca69 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b08c00640 1 -- 172.21.15.7:0/777611375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c019070 con 0x5606e5678d10 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b08c00640 1 -- 172.21.15.7:0/777611375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0079a0 con 0x5606e5678d10 2024-08-19T00:42:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.245+0000 7f5b08c00640 1 -- 172.21.15.7:0/777611375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c001c10 con 0x5606e5678d10 2024-08-19T00:42:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 -- 172.21.15.7:0/777611375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5678d10 msgr2=0x5606e56baab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5678d10 0x5606e56baab0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c007290 tx=0x7f5b0c007750 comp rx=0 tx=0).stop 2024-08-19T00:42:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 -- 172.21.15.7:0/777611375 shutdown_connections 2024-08-19T00:42:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5678d10 0x5606e56baab0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5674d00 0x5606e5671b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 --2- 172.21.15.7:0/777611375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e56bdbf0 0x5606e56bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 -- 172.21.15.7:0/777611375 >> 172.21.15.7:0/777611375 conn(0x5606e563dff0 msgr2=0x5606e56bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 -- 172.21.15.7:0/777611375 shutdown_connections 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 -- 172.21.15.7:0/777611375 wait complete. 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.246+0000 7f5b1e086740 1 -- start start 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.247+0000 7f5b1e086740 1 Processor -- start 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5674d00 0x5606e56b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5678d10 0x5606e56b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e56bdbf0 0x5606e56a1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b1e086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5606e56ba040 con 0x5606e5674d00 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5606e5595180 con 0x5606e5678d10 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5606e569f050 con 0x5606e56bdbf0 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b1e086740 10 client.0 _ll_register_callbacks cb 0x5606e55814b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:42:46.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5674d00 0x5606e56b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5674d00 0x5606e56b8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34678/0 (socket says 172.21.15.7:34678) 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 -- 172.21.15.7:0/1246156912 learned_addr learned my addr 172.21.15.7:0/1246156912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 -- 172.21.15.7:0/1246156912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e56bdbf0 msgr2=0x5606e56a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e56bdbf0 0x5606e56a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 -- 172.21.15.7:0/1246156912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5678d10 msgr2=0x5606e56b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5678d10 0x5606e56b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 -- 172.21.15.7:0/1246156912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606e52ed3f0 con 0x5606e5674d00 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5b13e00640 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5674d00 0x5606e56b8b30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5b040615f0 tx=0x7f5b04059130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9ab1f937cb853c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.248+0000 7f5afd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5afd600640 1 -- 172.21.15.7:0/1246156912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04021040 con 0x5606e5674d00 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5afd600640 1 -- 172.21.15.7:0/1246156912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f5b04058640 con 0x5606e5674d00 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b0c0079a0 con 0x5606e5674d00 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5afd600640 1 -- 172.21.15.7:0/1246156912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f5b04082b20 con 0x5606e5674d00 2024-08-19T00:42:46.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 10 client.6528 fetch_fsmap learned FSMap version 70 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x5606e52ad0f0 con 0x5606e5674d00 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5afd600640 1 -- 172.21.15.7:0/1246156912 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0079a0 con 0x5606e5674d00 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5afd600640 1 -- 172.21.15.7:0/1246156912 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f5b04024060 con 0x5606e5674d00 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 10 client.6528 fetch_fsmap finished waiting for FSMap version 70 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 10 client.6528 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 20 client.6528 populate_metadata read hostname 'smithi007' 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56cfa90 0x5606e56cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 4 client.6528 mds_command: new command op to 6354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.249+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 --> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606e55e7510 con 0x5606e56cfa90 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.250+0000 7f5b13400640 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56cfa90 0x5606e56cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.250+0000 7f5b13400640 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56cfa90 0x5606e56cff10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0c4af179e765564 server_cookie=d3d3c6b899eb449a in_seq=0 out_seq=0 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.250+0000 7f5afd600640 10 client.6528 ms_handle_connect on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5afd600640 1 -- 172.21.15.7:0/1246156912 <== mds.0 v2:172.21.15.7:6835/2626740684 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606e55e7510 con 0x5606e56cfa90 2024-08-19T00:42:46.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5afd600640 10 client.6528 handle_command_reply: tid=0 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 client.6528 shutdown 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5674d00 msgr2=0x5606e56b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5674d00 0x5606e56b8b30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5b040615f0 tx=0x7f5b04059130 comp rx=0 tx=0).stop 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 shutdown_connections 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56cfa90 0x5606e56cff10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e56bdbf0 0x5606e56a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5678d10 0x5606e56b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5afd600640 0 client.6528 ms_handle_reset on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 --2- 172.21.15.7:0/1246156912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e5674d00 0x5606e56b8b30 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 >> 172.21.15.7:0/1246156912 conn(0x5606e563dff0 msgr2=0x5606e56bf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 shutdown_connections 2024-08-19T00:42:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.251+0000 7f5b1e086740 1 -- 172.21.15.7:0/1246156912 wait complete. 2024-08-19T00:42:46.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.252+0000 7f5b1e086740 20 client.6528 trim_cache size 0 max 16384 2024-08-19T00:42:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.267+0000 7f5b1e086740 1 Processor -- start 2024-08-19T00:42:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.267+0000 7f5b1e086740 1 -- start start 2024-08-19T00:42:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e56ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b1e086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b14200850 con 0x5606e56bdbf0 2024-08-19T00:42:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b141ff920 con 0x5606e5674d00 2024-08-19T00:42:46.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b141f7920 con 0x5606e5678d10 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34682/0 (socket says 172.21.15.7:34682) 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 -- 172.21.15.7:0/3046963968 learned_addr learned my addr 172.21.15.7:0/3046963968 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b13400640 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e56ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b13e00640 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 -- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 msgr2=0x5606e56ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e56ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 -- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 msgr2=0x5606e56b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.268+0000 7f5b19000640 1 -- 172.21.15.7:0/3046963968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e56791e0 con 0x5606e56bdbf0 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b19000640 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56cea80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c012000 tx=0x7f5b0c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ee5f14f98f9752 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5affe00640 1 -- 172.21.15.7:0/3046963968 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c019070 con 0x5606e56bdbf0 2024-08-19T00:42:46.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5affe00640 1 -- 172.21.15.7:0/3046963968 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c01a040 con 0x5606e56bdbf0 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5affe00640 1 -- 172.21.15.7:0/3046963968 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c002070 con 0x5606e56bdbf0 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b1e086740 1 -- 172.21.15.7:0/3046963968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 msgr2=0x5606e56cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56cea80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c012000 tx=0x7f5b0c011000 comp rx=0 tx=0).stop 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b1e086740 1 -- 172.21.15.7:0/3046963968 shutdown_connections 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56cea80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e56ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3046963968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.269+0000 7f5b1e086740 1 -- 172.21.15.7:0/3046963968 >> 172.21.15.7:0/3046963968 conn(0x5606e563dff0 msgr2=0x5606e5691560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.270+0000 7f5b1e086740 1 -- 172.21.15.7:0/3046963968 shutdown_connections 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.270+0000 7f5b1e086740 1 -- 172.21.15.7:0/3046963968 wait complete. 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.270+0000 7f5b1e086740 1 -- start start 2024-08-19T00:42:46.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.270+0000 7f5b1e086740 1 Processor -- start 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.271+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.271+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e57207f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.271+0000 7f5b1e086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56bf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.271+0000 7f5b1e086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b141f7f70 con 0x5606e56bdbf0 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.271+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5606e56b6540 con 0x5606e5674d00 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.271+0000 7f5b1e086740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5606e56b27e0 con 0x5606e5678d10 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.271+0000 7f5b1e086740 10 client.0 _ll_register_callbacks cb 0x7f5b04055290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34694/0 (socket says 172.21.15.7:34694) 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 -- 172.21.15.7:0/3056335418 learned_addr learned my addr 172.21.15.7:0/3056335418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b13e00640 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b13400640 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e57207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 -- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 msgr2=0x5606e57207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e57207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 -- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 msgr2=0x5606e56b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 -- 172.21.15.7:0/3056335418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606e56b5700 con 0x5606e56bdbf0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5b19000640 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56bf730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c001e40 tx=0x7f5b0c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19612017097f6755 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.272+0000 7f5afd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5afd600640 1 -- 172.21.15.7:0/3056335418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c019070 con 0x5606e56bdbf0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5afd600640 1 -- 172.21.15.7:0/3056335418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f5b0c005cd0 con 0x5606e56bdbf0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b0c01a040 con 0x5606e56bdbf0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5afd600640 1 -- 172.21.15.7:0/3056335418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f5b0c0079a0 con 0x5606e56bdbf0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 10 client.6534 fetch_fsmap learned FSMap version 70 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x5606e5720df0 con 0x5606e56bdbf0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5afd600640 1 -- 172.21.15.7:0/3056335418 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c01a040 con 0x5606e56bdbf0 2024-08-19T00:42:46.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5afd600640 1 -- 172.21.15.7:0/3056335418 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f5b0c020680 con 0x5606e56bdbf0 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 10 client.6534 fetch_fsmap finished waiting for FSMap version 70 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 10 client.6534 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 20 client.6534 populate_metadata read hostname 'smithi007' 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56bfc70 0x5606e56ba210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 4 client.6534 mds_command: new command op to 6354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.273+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 --> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606e55e1860 con 0x5606e56bfc70 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.274+0000 7f5b13e00640 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56bfc70 0x5606e56ba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.274+0000 7f5b13e00640 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56bfc70 0x5606e56ba210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ecb342c0271529c server_cookie=5bcab123413f0bd in_seq=0 out_seq=0 2024-08-19T00:42:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.274+0000 7f5afd600640 10 client.6534 ms_handle_connect on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:46.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5afd600640 1 -- 172.21.15.7:0/3056335418 <== mds.0 v2:172.21.15.7:6835/2626740684 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606e55e1860 con 0x5606e56bfc70 2024-08-19T00:42:46.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5afd600640 10 client.6534 handle_command_reply: tid=0 2024-08-19T00:42:46.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 client.6534 shutdown 2024-08-19T00:42:46.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 msgr2=0x5606e56bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56bf730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c001e40 tx=0x7f5b0c007d90 comp rx=0 tx=0).stop 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 shutdown_connections 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:6835/2626740684,v1:172.21.15.7:6837/2626740684] conn(0x5606e56bfc70 0x5606e56ba210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606e56bdbf0 0x5606e56bf730 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5606e5678d10 0x5606e57207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 --2- 172.21.15.7:0/3056335418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e5674d00 0x5606e56b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5afd600640 0 client.6534 ms_handle_reset on v2:172.21.15.7:6835/2626740684 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 >> 172.21.15.7:0/3056335418 conn(0x5606e563dff0 msgr2=0x5606e5692a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.294+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 shutdown_connections 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.295+0000 7f5b1e086740 1 -- 172.21.15.7:0/3056335418 wait complete. 2024-08-19T00:42:46.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.295+0000 7f5b1e086740 20 client.6534 trim_cache size 0 max 16384 2024-08-19T00:42:46.299 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:42:46.299 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-08-19T00:42:46.299 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-08-19T00:42:46.299 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:42:46.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.295+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5af406be30 msgr2=0x7f5af406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.295+0000 7f5b1b000640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5af406be30 0x7f5af406e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b00034000 tx=0x7f5b0002e000 comp rx=0 tx=0).stop 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.295+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1406d770 msgr2=0x7f5b141f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.295+0000 7f5b1b000640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1406d770 0x7f5b141f49a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e960 tx=0x7f5b0400ee20 comp rx=0 tx=0).stop 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 shutdown_connections 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5af406be30 0x7f5af406e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b140b66e0 0x7f5b140ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b140b5da0 0x7f5b1409f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 --2- 172.21.15.7:0/586815031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1406d770 0x7f5b141f49a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 >> 172.21.15.7:0/586815031 conn(0x7f5b140d2180 msgr2=0x7f5b1406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 shutdown_connections 2024-08-19T00:42:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.296+0000 7f5b1b000640 1 -- 172.21.15.7:0/586815031 wait complete. 2024-08-19T00:42:46.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_rename_corrupt_dentry_first 1.0 2024-08-19T00:42:46.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613f200640 1 Processor -- start 2024-08-19T00:42:46.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613f200640 1 -- start start 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6140143ea0 0x7f614015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f61400b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614015f700 con 0x7f61400b44e0 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6140161d30 con 0x7f6140143ea0 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6140161fd0 con 0x7f6140144280 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.475+0000 7f613de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6140143ea0 0x7f614015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613e800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f61400b44e0 0x7f61400d23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58840/0 (socket says 172.21.15.7:58840) 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6140143ea0 0x7f614015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34706/0 (socket says 172.21.15.7:34706) 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613e800640 1 -- 172.21.15.7:0/2677918788 learned_addr learned my addr 172.21.15.7:0/2677918788 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:46.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613d400640 1 --2- 172.21.15.7:0/2677918788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f61400b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613de00640 1 -- 172.21.15.7:0/2677918788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 msgr2=0x7f61400b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:46.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613de00640 1 --2- 172.21.15.7:0/2677918788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f61400b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613de00640 1 -- 172.21.15.7:0/2677918788 >> v1:172.21.15.7:6789/0 conn(0x7f61400b44e0 legacy=0x7f61400d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613de00640 1 -- 172.21.15.7:0/2677918788 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61401622b0 con 0x7f6140143ea0 2024-08-19T00:42:46.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.476+0000 7f613ca00640 1 -- 172.21.15.7:0/2677918788 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051965203 0 0) 0x7f6138001490 con 0x7f61400b44e0 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.477+0000 7f613de00640 1 --2- 172.21.15.7:0/2677918788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6140143ea0 0x7f614015f1c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f61300097a0 tx=0x7f613002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8235df08b4b62310 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.477+0000 7f613ca00640 1 -- 172.21.15.7:0/2677918788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130037070 con 0x7f6140143ea0 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.477+0000 7f613ca00640 1 -- 172.21.15.7:0/2677918788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6130032440 con 0x7f6140143ea0 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.477+0000 7f613ca00640 1 -- 172.21.15.7:0/2677918788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130032810 con 0x7f6140143ea0 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 -- 172.21.15.7:0/2677918788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6140143ea0 msgr2=0x7f614015f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 --2- 172.21.15.7:0/2677918788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6140143ea0 0x7f614015f1c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f61300097a0 tx=0x7f613002a180 comp rx=0 tx=0).stop 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 -- 172.21.15.7:0/2677918788 shutdown_connections 2024-08-19T00:42:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 --2- 172.21.15.7:0/2677918788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f61400b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 --2- 172.21.15.7:0/2677918788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6140143ea0 0x7f614015f1c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 -- 172.21.15.7:0/2677918788 >> 172.21.15.7:0/2677918788 conn(0x7f6140062540 msgr2=0x7f6140062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 -- 172.21.15.7:0/2677918788 shutdown_connections 2024-08-19T00:42:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.478+0000 7f613f200640 1 -- 172.21.15.7:0/2677918788 wait complete. 2024-08-19T00:42:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.480+0000 7f613f200640 1 Processor -- start 2024-08-19T00:42:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.480+0000 7f613f200640 1 -- start start 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61400b44e0 0x7f614013f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6140143ea0 0x7f61400cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f614015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6140162b50 con 0x7f61400b44e0 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6140162870 con 0x7f6140143ea0 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61401446e0 con 0x7f6140144280 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61400b44e0 0x7f614013f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61400b44e0 0x7f614013f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34716/0 (socket says 172.21.15.7:34716) 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613de00640 1 -- 172.21.15.7:0/659737771 learned_addr learned my addr 172.21.15.7:0/659737771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613d400640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6140143ea0 0x7f61400cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.481+0000 7f613e800640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f614015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613de00640 1 -- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 msgr2=0x7f614015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613de00640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f614015a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613de00640 1 -- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6140143ea0 msgr2=0x7f61400cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613de00640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6140143ea0 0x7f61400cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613de00640 1 -- 172.21.15.7:0/659737771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614012fcb0 con 0x7f61400b44e0 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613d400640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6140143ea0 0x7f61400cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613de00640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61400b44e0 0x7f614013f8c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f61300097a0 tx=0x7f61300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f6136000640 1 -- 172.21.15.7:0/659737771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130037050 con 0x7f61400b44e0 2024-08-19T00:42:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f6136000640 1 -- 172.21.15.7:0/659737771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6130038040 con 0x7f61400b44e0 2024-08-19T00:42:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f6136000640 1 -- 172.21.15.7:0/659737771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130004490 con 0x7f61400b44e0 2024-08-19T00:42:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614012ff90 con 0x7f61400b44e0 2024-08-19T00:42:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.482+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6140130550 con 0x7f61400b44e0 2024-08-19T00:42:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.483+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6140072230 con 0x7f61400b44e0 2024-08-19T00:42:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.484+0000 7f6136000640 1 -- 172.21.15.7:0/659737771 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f613003c6d0 con 0x7f61400b44e0 2024-08-19T00:42:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.485+0000 7f6136000640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f612006be30 0x7f612006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.485+0000 7f6136000640 1 -- 172.21.15.7:0/659737771 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f61300ab990 con 0x7f61400b44e0 2024-08-19T00:42:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.486+0000 7f613d400640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f612006be30 0x7f612006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.486+0000 7f613d400640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f612006be30 0x7f612006e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f614012f810 tx=0x7f612c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:46.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.490+0000 7f6136000640 1 -- 172.21.15.7:0/659737771 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f613007a260 con 0x7f61400b44e0 2024-08-19T00:42:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.674+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}] v 0) -- 0x7f614015d3f0 con 0x7f61400b44e0 2024-08-19T00:42:46.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.678+0000 7f6136000640 1 -- 172.21.15.7:0/659737771 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}]=0 v23)=0 v23) ==== 138+0+0 (secure 0 0 0) 0x7f6130079b60 con 0x7f61400b44e0 2024-08-19T00:42:46.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f612006be30 msgr2=0x7f612006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f612006be30 0x7f612006e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f614012f810 tx=0x7f612c008040 comp rx=0 tx=0).stop 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61400b44e0 msgr2=0x7f614013f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61400b44e0 0x7f614013f8c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f61300097a0 tx=0x7f61300046c0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 shutdown_connections 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f612006be30 0x7f612006e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6140144280 0x7f614015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6140143ea0 0x7f61400cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 --2- 172.21.15.7:0/659737771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61400b44e0 0x7f614013f8c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 >> 172.21.15.7:0/659737771 conn(0x7f6140062540 msgr2=0x7f6140140520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 shutdown_connections 2024-08-19T00:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:46.681+0000 7f613f200640 1 -- 172.21.15.7:0/659737771 wait complete. 2024-08-19T00:42:51.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo daemon-helper kill ceph --cluster ceph -w 2024-08-19T00:42:51.706 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'timeout 60 mv a/b a/z') 2024-08-19T00:42:51.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-08-19T00:42:51.803 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:42:51.802+0000 7f105a400640 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5723:47 nref=7 cr=0x558cb7917500)) (dversion lock w=1 last_client=5723) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x558cb782b680] 2024-08-19T00:42:51.804 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:42:51.802+0000 7f105a400640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5723:47 nref=7 cr=0x558cb7917500)) (dversion lock w=1 last_client=5723) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x558cb782b680] 2024-08-19T00:42:51.804 INFO:tasks.ceph.mds.c.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f105a400640 time 2024-08-19T00:42:51.802915+0000 2024-08-19T00:42:51.804 INFO:tasks.ceph.mds.c.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:42:51.804 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1061583417] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.805 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:42:51.803+0000 7f105a400640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f105a400640 time 2024-08-19T00:42:51.802915+0000 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1061583417] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.806 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.807 INFO:tasks.ceph.mds.c.smithi007.stderr:*** Caught signal (Aborted) ** 2024-08-19T00:42:51.808 INFO:tasks.ceph.mds.c.smithi007.stderr: in thread 7f105a400640 thread_name:ms_dispatch 2024-08-19T00:42:51.808 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.808 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1060c3e6f0] 2024-08-19T00:42:51.808 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f1060c8b94c] 2024-08-19T00:42:51.808 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: raise() 2024-08-19T00:42:51.808 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: abort() 2024-08-19T00:42:51.808 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f10615834d4] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.809 INFO:tasks.ceph.mds.c.smithi007.stderr: 18: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 19: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:42:51.804+0000 7f105a400640 -1 *** Caught signal (Aborted) ** 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: in thread 7f105a400640 thread_name:ms_dispatch 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1060c3e6f0] 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f1060c8b94c] 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: raise() 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: abort() 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f10615834d4] 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.810 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 18: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 19: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-19T00:42:51.811 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.816 INFO:tasks.ceph.mds.c.smithi007.stderr: -5095> 2024-08-19T00:42:33.848+0000 7f1057200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:42:51.825 INFO:tasks.ceph.mds.c.smithi007.stderr: -8> 2024-08-19T00:42:51.802+0000 7f105a400640 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5723:47 nref=7 cr=0x558cb7917500)) (dversion lock w=1 last_client=5723) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x558cb782b680] 2024-08-19T00:42:51.825 INFO:tasks.ceph.mds.c.smithi007.stderr: -6> 2024-08-19T00:42:51.802+0000 7f105a400640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5723:47 nref=7 cr=0x558cb7917500)) (dversion lock w=1 last_client=5723) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x558cb782b680] 2024-08-19T00:42:51.825 INFO:tasks.ceph.mds.c.smithi007.stderr: -1> 2024-08-19T00:42:51.803+0000 7f105a400640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f105a400640 time 2024-08-19T00:42:51.802915+0000 2024-08-19T00:42:51.825 INFO:tasks.ceph.mds.c.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:42:51.825 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.825 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1061583417] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.826 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 0> 2024-08-19T00:42:51.804+0000 7f105a400640 -1 *** Caught signal (Aborted) ** 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: in thread 7f105a400640 thread_name:ms_dispatch 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1060c3e6f0] 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f1060c8b94c] 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: raise() 2024-08-19T00:42:51.827 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: abort() 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f10615834d4] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.828 INFO:tasks.ceph.mds.c.smithi007.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.829 INFO:tasks.ceph.mds.c.smithi007.stderr: 18: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.829 INFO:tasks.ceph.mds.c.smithi007.stderr: 19: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.829 INFO:tasks.ceph.mds.c.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-19T00:42:51.829 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.829 INFO:tasks.ceph.mds.c.smithi007.stderr: -5095> 2024-08-19T00:42:33.848+0000 7f1057200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr: -8> 2024-08-19T00:42:51.802+0000 7f105a400640 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5723:47 nref=7 cr=0x558cb7917500)) (dversion lock w=1 last_client=5723) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x558cb782b680] 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr: -6> 2024-08-19T00:42:51.802+0000 7f105a400640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5723:47 nref=7 cr=0x558cb7917500)) (dversion lock w=1 last_client=5723) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x558cb782b680] 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr: -1> 2024-08-19T00:42:51.803+0000 7f105a400640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f105a400640 time 2024-08-19T00:42:51.802915+0000 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.1.0-1382-gde09dd01/rpm/el9/BUILD/ceph-19.1.0-1382-gde09dd01/src/mds/MDSRank.cc: 952: ceph_abort_msg("abort() called") 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1061583417] 2024-08-19T00:42:51.833 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.834 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 0> 2024-08-19T00:42:51.804+0000 7f105a400640 -1 *** Caught signal (Aborted) ** 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: in thread 7f105a400640 thread_name:ms_dispatch 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1060c3e6f0] 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f1060c8b94c] 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 3: raise() 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 4: abort() 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7f10615834d4] 2024-08-19T00:42:51.835 INFO:tasks.ceph.mds.c.smithi007.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x558ca1ed72c1] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 7: (CDentry::check_corruption(bool)+0x4d4) [0x558ca21023f4] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 8: ceph-mds(+0x1cb3e9) [0x558ca1f1a3e9] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 9: (Server::_rename_prepare(boost::intrusive_ptr const&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x207f) [0x558ca1fa55ff] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 10: (Server::handle_client_rename(boost::intrusive_ptr const&)+0x25e2) [0x558ca1fa88d2] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 11: (Server::handle_client_request(boost::intrusive_ptr const&)+0x3e3) [0x558ca1f6f0e3] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x558ca1f5ccec] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x558ca1ede88b] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558ca1eded5c] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1a6) [0x558ca1ec3276] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 16: (DispatchQueue::entry()+0x4c2) [0x7f106178fe62] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 17: /usr/lib64/ceph/libceph-common.so.2(+0x429901) [0x7f1061829901] 2024-08-19T00:42:51.836 INFO:tasks.ceph.mds.c.smithi007.stderr: 18: /lib64/libc.so.6(+0x89c02) [0x7f1060c89c02] 2024-08-19T00:42:51.837 INFO:tasks.ceph.mds.c.smithi007.stderr: 19: /lib64/libc.so.6(+0x10ec40) [0x7f1060d0ec40] 2024-08-19T00:42:51.837 INFO:tasks.ceph.mds.c.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-19T00:42:51.837 INFO:tasks.ceph.mds.c.smithi007.stderr: 2024-08-19T00:42:51.894 INFO:teuthology.orchestra.run.smithi007.stdout:{"mds_beacon_grace":"15.000000"} 2024-08-19T00:42:51.895 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-08-19T00:42:51.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:51.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.906+0000 7fbfb9600640 1 Processor -- start 2024-08-19T00:42:51.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.906+0000 7fbfb9600640 1 -- start start 2024-08-19T00:42:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.908+0000 7fbfb9600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfb40cd100 0x7fbfb4167070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.908+0000 7fbfb9600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb40b4c70 con 0x7fbfb415c280 2024-08-19T00:42:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.908+0000 7fbfb9600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb40b4f50 con 0x7fbfb40b47c0 2024-08-19T00:42:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.908+0000 7fbfb9600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb40b5510 con 0x7fbfb40cd100 2024-08-19T00:42:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb2a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbfb415c280 0x7fbfb40b40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58854/0 (socket says 172.21.15.7:58854) 2024-08-19T00:42:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb2a00640 1 -- 172.21.15.7:0/3071356995 learned_addr learned my addr 172.21.15.7:0/3071356995 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb3400640 1 --2- 172.21.15.7:0/3071356995 >> v2:172.21.15.7:3300/0 conn(0x7fbfb40cd100 0x7fbfb4167070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb2000640 1 -- 172.21.15.7:0/3071356995 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3303746528 0 0) 0x7fbfb40b4c70 con 0x7fbfb415c280 2024-08-19T00:42:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb2000640 1 -- 172.21.15.7:0/3071356995 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf98003520 con 0x7fbfb415c280 2024-08-19T00:42:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb3400640 1 -- 172.21.15.7:0/3071356995 >> v1:172.21.15.162:6789/0 conn(0x7fbfb40b47c0 legacy=0x7fbfb40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb2000640 1 -- 172.21.15.7:0/3071356995 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242623341 0 0) 0x7fbfb40b4f50 con 0x7fbfb40b47c0 2024-08-19T00:42:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb3400640 1 -- 172.21.15.7:0/3071356995 >> v1:172.21.15.7:6789/0 conn(0x7fbfb415c280 legacy=0x7fbfb40b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.909+0000 7fbfb3400640 1 -- 172.21.15.7:0/3071356995 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb40b5230 con 0x7fbfb40cd100 2024-08-19T00:42:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.911+0000 7fbfb3400640 1 --2- 172.21.15.7:0/3071356995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 0x7fbfb4167070 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009d90 tx=0x7fbfac02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9744d4fd72e5b07c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.911+0000 7fbfb2000640 1 -- 172.21.15.7:0/3071356995 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac007740 con 0x7fbfb40cd100 2024-08-19T00:42:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.911+0000 7fbfb2000640 1 -- 172.21.15.7:0/3071356995 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfac0078e0 con 0x7fbfb40cd100 2024-08-19T00:42:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.911+0000 7fbfb2000640 1 -- 172.21.15.7:0/3071356995 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac007cd0 con 0x7fbfb40cd100 2024-08-19T00:42:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.912+0000 7fbfb9600640 1 -- 172.21.15.7:0/3071356995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 msgr2=0x7fbfb4167070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.912+0000 7fbfb9600640 1 --2- 172.21.15.7:0/3071356995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 0x7fbfb4167070 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009d90 tx=0x7fbfac02a680 comp rx=0 tx=0).stop 2024-08-19T00:42:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.912+0000 7fbfb9600640 1 -- 172.21.15.7:0/3071356995 shutdown_connections 2024-08-19T00:42:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.912+0000 7fbfb9600640 1 --2- 172.21.15.7:0/3071356995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 0x7fbfb4167070 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.912+0000 7fbfb9600640 1 -- 172.21.15.7:0/3071356995 >> 172.21.15.7:0/3071356995 conn(0x7fbfb40b1d10 msgr2=0x7fbfb40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.912+0000 7fbfb9600640 1 -- 172.21.15.7:0/3071356995 shutdown_connections 2024-08-19T00:42:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.912+0000 7fbfb9600640 1 -- 172.21.15.7:0/3071356995 wait complete. 2024-08-19T00:42:51.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.914+0000 7fbfb9600640 1 Processor -- start 2024-08-19T00:42:51.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.915+0000 7fbfb9600640 1 -- start start 2024-08-19T00:42:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.915+0000 7fbfb9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb40b47c0 0x7fbfb4152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.915+0000 7fbfb9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 0x7fbfb4156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.915+0000 7fbfb9600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb415c280 0x7fbfb40cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.915+0000 7fbfb9600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb40ce9f0 con 0x7fbfb40cd100 2024-08-19T00:42:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.915+0000 7fbfb9600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb406db30 con 0x7fbfb40b47c0 2024-08-19T00:42:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.915+0000 7fbfb9600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb40ceb70 con 0x7fbfb415c280 2024-08-19T00:42:51.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 0x7fbfb4156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 0x7fbfb4156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34730/0 (socket says 172.21.15.7:34730) 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 -- 172.21.15.7:0/1060227293 learned_addr learned my addr 172.21.15.7:0/1060227293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfb2a00640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb40b47c0 0x7fbfb4152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfb3400640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb415c280 0x7fbfb40cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 -- 172.21.15.7:0/1060227293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb415c280 msgr2=0x7fbfb40cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb415c280 0x7fbfb40cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 -- 172.21.15.7:0/1060227293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb40b47c0 msgr2=0x7fbfb4152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb40b47c0 0x7fbfb4152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.916+0000 7fbfaa000640 1 -- 172.21.15.7:0/1060227293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb40c9530 con 0x7fbfb40cd100 2024-08-19T00:42:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.917+0000 7fbfaa000640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb40cd100 0x7fbfb4156f80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c490 tx=0x7fbf9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:51.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.917+0000 7fbfab400640 1 -- 172.21.15.7:0/1060227293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c005480 con 0x7fbfb40cd100 2024-08-19T00:42:51.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.917+0000 7fbfab400640 1 -- 172.21.15.7:0/1060227293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0035f0 con 0x7fbfb40cd100 2024-08-19T00:42:51.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.917+0000 7fbfab400640 1 -- 172.21.15.7:0/1060227293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0039c0 con 0x7fbfb40cd100 2024-08-19T00:42:51.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.917+0000 7fbfb9600640 1 -- 172.21.15.7:0/1060227293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb40c9810 con 0x7fbfb40cd100 2024-08-19T00:42:51.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.917+0000 7fbfb9600640 1 -- 172.21.15.7:0/1060227293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb41529a0 con 0x7fbfb40cd100 2024-08-19T00:42:51.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.918+0000 7fbfb9600640 1 -- 172.21.15.7:0/1060227293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fbfb415c780 con 0x7fbfb40cd100 2024-08-19T00:42:51.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.920+0000 7fbfab400640 1 -- 172.21.15.7:0/1060227293 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf9c025430 con 0x7fbfb40cd100 2024-08-19T00:42:51.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.921+0000 7fbfab400640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf9006bfd0 0x7fbf9006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:51.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.921+0000 7fbfab400640 1 -- 172.21.15.7:0/1060227293 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7fbf9c08b580 con 0x7fbfb40cd100 2024-08-19T00:42:51.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.921+0000 7fbfb2a00640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf9006bfd0 0x7fbf9006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:51.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.921+0000 7fbfab400640 1 -- 172.21.15.7:0/1060227293 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+558 (secure 0 0 0) 0x7fbf9c08b950 con 0x7fbfb40cd100 2024-08-19T00:42:51.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.921+0000 7fbfb9600640 1 -- 172.21.15.7:0/1060227293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7fbfb40b1870 con 0x7fbfb40cd100 2024-08-19T00:42:51.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.922+0000 7fbfb2a00640 1 --2- 172.21.15.7:0/1060227293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf9006bfd0 0x7fbf9006e490 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4005880 tx=0x7fbfa4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:51.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:51.952+0000 7fbfab400640 1 -- 172.21.15.7:0/1060227293 <== mon.0 v2:172.21.15.7:3300/0 7 ==== log(1 entries from seq 1 at 2024-08-19T00:42:51.802872+0000) ==== 468+0+0 (secure 0 0 0) 0x7fbf9c057880 con 0x7fbfb40cd100 2024-08-19T00:42:51.954 INFO:teuthology.orchestra.run.smithi007.stdout: cluster: 2024-08-19T00:42:51.954 INFO:teuthology.orchestra.run.smithi007.stdout: id: bd35d026-e259-45a6-99d5-e8ea5afa8a60 2024-08-19T00:42:51.954 INFO:teuthology.orchestra.run.smithi007.stdout: health: HEALTH_OK 2024-08-19T00:42:51.954 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:51.954 INFO:teuthology.orchestra.run.smithi007.stdout: services: 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 6m) 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: mgr: y(active, since 6m), standbys: x 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: mds: 1/1 daemons up, 3 standby 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: osd: 8 osds: 8 up (since 6m), 8 in (since 6m) 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: data: 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: volumes: 1/1 healthy 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: pools: 3 pools, 97 pgs 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: objects: 24 objects, 579 KiB 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: usage: 247 MiB used, 720 GiB / 720 GiB avail 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: pgs: 2.062% pgs not active 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: 95 active+clean 2024-08-19T00:42:51.955 INFO:teuthology.orchestra.run.smithi007.stdout: 2 peering 2024-08-19T00:42:51.956 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:51.956 INFO:teuthology.orchestra.run.smithi007.stdout: io: 2024-08-19T00:42:51.956 INFO:teuthology.orchestra.run.smithi007.stdout: client: 127 B/s wr, 0 op/s rd, 0 op/s wr 2024-08-19T00:42:51.956 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:51.956 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:51.956 INFO:teuthology.orchestra.run.smithi007.stdout:2024-08-19T00:42:51.802872+0000 mds.c [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by request(client.5723:47 nref=7 cr=0x558cb7917500)) (dversion lock w=1 last_client=5723) pv=11 v=10 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x558cb782b680] 2024-08-19T00:42:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.059+0000 7f877b200640 1 Processor -- start 2024-08-19T00:42:52.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.059+0000 7f877b200640 1 -- start start 2024-08-19T00:42:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.061+0000 7f877b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c0d3200 0x7f877c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.061+0000 7f877b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f877c15e740 0x7f877c15ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.061+0000 7f877b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877c0b3ab0 con 0x7f877c15e360 2024-08-19T00:42:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.061+0000 7f877b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f877c15f460 con 0x7f877c15e740 2024-08-19T00:42:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.061+0000 7f877b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f877c15f740 con 0x7f877c0d3200 2024-08-19T00:42:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.061+0000 7f8779e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f877c15e360 0x7f877c0d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58866/0 (socket says 172.21.15.7:58866) 2024-08-19T00:42:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.061+0000 7f8779e00640 1 -- 172.21.15.7:0/3740683845 learned_addr learned my addr 172.21.15.7:0/3740683845 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f8779400640 1 --2- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c0d3200 0x7f877c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f877a800640 1 --2- 172.21.15.7:0/3740683845 >> v2:172.21.15.162:3300/0 conn(0x7f877c15e740 0x7f877c15ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f8778a00640 1 -- 172.21.15.7:0/3740683845 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303527271 0 0) 0x7f877c0b3ab0 con 0x7f877c15e360 2024-08-19T00:42:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f8778a00640 1 -- 172.21.15.7:0/3740683845 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8760003520 con 0x7f877c15e360 2024-08-19T00:42:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f877a800640 1 -- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c0d3200 msgr2=0x7f877c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:42:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f877a800640 1 --2- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c0d3200 0x7f877c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f877a800640 1 -- 172.21.15.7:0/3740683845 >> v1:172.21.15.7:6789/0 conn(0x7f877c15e360 legacy=0x7f877c0d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f8778a00640 1 -- 172.21.15.7:0/3740683845 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1610047236 0 0) 0x7f8760003520 con 0x7f877c15e360 2024-08-19T00:42:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f877a800640 1 -- 172.21.15.7:0/3740683845 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c0b3d60 con 0x7f877c15e740 2024-08-19T00:42:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.062+0000 7f8779400640 1 --2- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c0d3200 0x7f877c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:42:52.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.063+0000 7f877a800640 1 --2- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c15e740 0x7f877c15ebb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8774009d90 tx=0x7f877402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4a41e2b92ea1a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f8778a00640 1 -- 172.21.15.7:0/3740683845 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c001670 con 0x7f877c15e740 2024-08-19T00:42:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f8778a00640 1 -- 172.21.15.7:0/3740683845 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8774007540 con 0x7f877c15e740 2024-08-19T00:42:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f8778a00640 1 -- 172.21.15.7:0/3740683845 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774007910 con 0x7f877c15e740 2024-08-19T00:42:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 -- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c15e740 msgr2=0x7f877c15ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 --2- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c15e740 0x7f877c15ebb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8774009d90 tx=0x7f877402a5f0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 -- 172.21.15.7:0/3740683845 shutdown_connections 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 --2- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c15e740 0x7f877c15ebb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 --2- 172.21.15.7:0/3740683845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c0d3200 0x7f877c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 -- 172.21.15.7:0/3740683845 >> 172.21.15.7:0/3740683845 conn(0x7f877c08dbf0 msgr2=0x7f877c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 -- 172.21.15.7:0/3740683845 shutdown_connections 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.064+0000 7f877b200640 1 -- 172.21.15.7:0/3740683845 wait complete. 2024-08-19T00:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.066+0000 7f877b200640 1 Processor -- start 2024-08-19T00:42:52.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.066+0000 7f877b200640 1 -- start start 2024-08-19T00:42:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c0d3200 0x7f877c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c15e360 0x7f877c1e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c15e740 0x7f877c1e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f877c15f0f0 con 0x7f877c15e740 2024-08-19T00:42:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f877c0d2300 con 0x7f877c0d3200 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f877c0b4560 con 0x7f877c15e360 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c15e740 0x7f877c1e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c15e740 0x7f877c1e9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34738/0 (socket says 172.21.15.7:34738) 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f877a800640 1 -- 172.21.15.7:0/1281834934 learned_addr learned my addr 172.21.15.7:0/1281834934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f8779e00640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c0d3200 0x7f877c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.067+0000 7f8779400640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c15e360 0x7f877c1e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f877a800640 1 -- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c15e360 msgr2=0x7f877c1e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f877a800640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c15e360 0x7f877c1e91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f877a800640 1 -- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c0d3200 msgr2=0x7f877c154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f877a800640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c0d3200 0x7f877c154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f877a800640 1 -- 172.21.15.7:0/1281834934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c1e9d40 con 0x7f877c15e740 2024-08-19T00:42:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f877a800640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c15e740 0x7f877c1e9730 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8774009eb0 tx=0x7f8774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f8772000640 1 -- 172.21.15.7:0/1281834934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774040070 con 0x7f877c15e740 2024-08-19T00:42:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f8772000640 1 -- 172.21.15.7:0/1281834934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8774031b40 con 0x7f877c15e740 2024-08-19T00:42:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877c1ea020 con 0x7f877c15e740 2024-08-19T00:42:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.068+0000 7f8772000640 1 -- 172.21.15.7:0/1281834934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774007e90 con 0x7f877c15e740 2024-08-19T00:42:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.069+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c1ea5e0 con 0x7f877c15e740 2024-08-19T00:42:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.070+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f877c15ebb0 con 0x7f877c15e740 2024-08-19T00:42:52.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.071+0000 7f8772000640 1 -- 172.21.15.7:0/1281834934 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8774039040 con 0x7f877c15e740 2024-08-19T00:42:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.071+0000 7f8772000640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.072+0000 7f8772000640 1 -- 172.21.15.7:0/1281834934 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f87740ac130 con 0x7f877c15e740 2024-08-19T00:42:52.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.072+0000 7f8779e00640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:52.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.072+0000 7f8779e00640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f875c06be30 0x7f875c06e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f876c005880 tx=0x7f876c0057f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:52.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.076+0000 7f8772000640 1 -- 172.21.15.7:0/1281834934 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f877407a3b0 con 0x7f877c15e740 2024-08-19T00:42:52.187 INFO:tasks.ceph.mds.c.smithi007.stderr:daemon-helper: command crashed with signal 6 2024-08-19T00:42:52.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.297+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f877c0d3770 con 0x7f877c15e740 2024-08-19T00:42:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.297+0000 7f8772000640 1 -- 172.21.15.7:0/1281834934 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5219 (secure 0 0 0) 0x7f877407e6b0 con 0x7f877c15e740 2024-08-19T00:42:52.299 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:52.299 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":70,"btime":"2024-08-19T00:42:45:932470+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:42:45.005795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6354":{"gid":6354,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2626740684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2626740684},{"type":"v1","addr":"172.21.15.7:6837","nonce":2626740684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6354,"qdb_cluster":[6354]},"id":5}]} 2024-08-19T00:42:52.299 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 70 2024-08-19T00:42:52.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.299+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f875c06be30 msgr2=0x7f875c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.299+0000 7f877b200640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f875c06be30 0x7f875c06e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f876c005880 tx=0x7f876c0057f0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.299+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c15e740 msgr2=0x7f877c1e9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.299+0000 7f877b200640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c15e740 0x7f877c1e9730 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8774009eb0 tx=0x7f8774004a40 comp rx=0 tx=0).stop 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 shutdown_connections 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f875c06be30 0x7f875c06e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c15e740 0x7f877c1e9730 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f877c15e360 0x7f877c1e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 --2- 172.21.15.7:0/1281834934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f877c0d3200 0x7f877c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 >> 172.21.15.7:0/1281834934 conn(0x7f877c08dbf0 msgr2=0x7f877c1621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 shutdown_connections 2024-08-19T00:42:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:52.300+0000 7f877b200640 1 -- 172.21.15.7:0/1281834934 wait complete. 2024-08-19T00:42:52.317 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-19T00:42:57.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:42:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.485+0000 7f0fa7a00640 1 Processor -- start 2024-08-19T00:42:57.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.485+0000 7f0fa7a00640 1 -- start start 2024-08-19T00:42:57.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa7a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0fa00b4a90 0x7f0fa00d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:57.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa7a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa00b50b0 con 0x7f0fa00d03c0 2024-08-19T00:42:57.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa7a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa00cead0 con 0x7f0fa015f5b0 2024-08-19T00:42:57.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa7a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa015f990 con 0x7f0fa00b4a90 2024-08-19T00:42:57.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0f9fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0fa00d03c0 0x7f0fa00b4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44144/0 (socket says 172.21.15.7:44144) 2024-08-19T00:42:57.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0f9fe00640 1 -- 172.21.15.7:0/3796332592 learned_addr learned my addr 172.21.15.7:0/3796332592 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:42:57.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa5a00640 1 --2- 172.21.15.7:0/3796332592 >> v2:172.21.15.7:3300/0 conn(0x7f0fa00b4a90 0x7f0fa00d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:57.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa5a00640 1 -- 172.21.15.7:0/3796332592 >> v1:172.21.15.162:6789/0 conn(0x7f0fa015f5b0 legacy=0x7f0fa00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:57.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa5a00640 1 -- 172.21.15.7:0/3796332592 >> v1:172.21.15.7:6789/0 conn(0x7f0fa00d03c0 legacy=0x7f0fa00b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:57.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0fa5a00640 1 -- 172.21.15.7:0/3796332592 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa00cedb0 con 0x7f0fa00b4a90 2024-08-19T00:42:57.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.487+0000 7f0f9f400640 1 -- 172.21.15.7:0/3796332592 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393872580 0 0) 0x7f0fa00b50b0 con 0x7f0fa00d03c0 2024-08-19T00:42:57.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.488+0000 7f0fa5a00640 1 --2- 172.21.15.7:0/3796332592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00d0800 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009d90 tx=0x7f0f9802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac19f67488a198e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:57.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0f9f400640 1 -- 172.21.15.7:0/3796332592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98007740 con 0x7f0fa00b4a90 2024-08-19T00:42:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0f9f400640 1 -- 172.21.15.7:0/3796332592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f980078e0 con 0x7f0fa00b4a90 2024-08-19T00:42:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0f9f400640 1 -- 172.21.15.7:0/3796332592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98007cb0 con 0x7f0fa00b4a90 2024-08-19T00:42:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0fa7a00640 1 -- 172.21.15.7:0/3796332592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 msgr2=0x7f0fa00d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/3796332592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00d0800 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009d90 tx=0x7f0f9802a660 comp rx=0 tx=0).stop 2024-08-19T00:42:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0fa7a00640 1 -- 172.21.15.7:0/3796332592 shutdown_connections 2024-08-19T00:42:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/3796332592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00d0800 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0fa7a00640 1 -- 172.21.15.7:0/3796332592 >> 172.21.15.7:0/3796332592 conn(0x7f0fa006bc70 msgr2=0x7f0fa006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:57.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.489+0000 7f0fa7a00640 1 -- 172.21.15.7:0/3796332592 shutdown_connections 2024-08-19T00:42:57.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.490+0000 7f0fa7a00640 1 -- 172.21.15.7:0/3796332592 wait complete. 2024-08-19T00:42:57.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.491+0000 7f0fa7a00640 1 Processor -- start 2024-08-19T00:42:57.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.491+0000 7f0fa7a00640 1 -- start start 2024-08-19T00:42:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa7a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa7a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00d03c0 0x7f0fa0155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa7a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fa015f5b0 0x7f0fa01f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa7a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa006ea30 con 0x7f0fa00b4a90 2024-08-19T00:42:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa7a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa006e8b0 con 0x7f0fa00d03c0 2024-08-19T00:42:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa7a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa006ebb0 con 0x7f0fa015f5b0 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35868/0 (socket says 172.21.15.7:35868) 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.492+0000 7f0fa5000640 1 -- 172.21.15.7:0/2728167004 learned_addr learned my addr 172.21.15.7:0/2728167004 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0f9fe00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00d03c0 0x7f0fa0155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0fa5a00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fa015f5b0 0x7f0fa01f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0fa5000640 1 -- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fa015f5b0 msgr2=0x7f0fa01f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0fa5000640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fa015f5b0 0x7f0fa01f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0fa5000640 1 -- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00d03c0 msgr2=0x7f0fa0155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0fa5000640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00d03c0 0x7f0fa0155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0fa5000640 1 -- 172.21.15.7:0/2728167004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa00adba0 con 0x7f0fa00b4a90 2024-08-19T00:42:57.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0fa5000640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00aee50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c430 tx=0x7f0f9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:57.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0f9cc00640 1 -- 172.21.15.7:0/2728167004 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94017070 con 0x7f0fa00b4a90 2024-08-19T00:42:57.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0f9cc00640 1 -- 172.21.15.7:0/2728167004 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f940052d0 con 0x7f0fa00b4a90 2024-08-19T00:42:57.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.493+0000 7f0f9cc00640 1 -- 172.21.15.7:0/2728167004 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94003830 con 0x7f0fa00b4a90 2024-08-19T00:42:57.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.494+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa00ade80 con 0x7f0fa00b4a90 2024-08-19T00:42:57.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.494+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa00af390 con 0x7f0fa00b4a90 2024-08-19T00:42:57.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.495+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa006efa0 con 0x7f0fa00b4a90 2024-08-19T00:42:57.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.496+0000 7f0f9cc00640 1 -- 172.21.15.7:0/2728167004 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f9401a070 con 0x7f0fa00b4a90 2024-08-19T00:42:57.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.496+0000 7f0f9cc00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f8006be30 0x7f0f8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:42:57.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.497+0000 7f0f9cc00640 1 -- 172.21.15.7:0/2728167004 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f0f9408a170 con 0x7f0fa00b4a90 2024-08-19T00:42:57.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.497+0000 7f0f9fe00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f8006be30 0x7f0f8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:42:57.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.497+0000 7f0f9fe00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f8006be30 0x7f0f8006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0fa015e320 tx=0x7f0f8c007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:42:57.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.501+0000 7f0f9cc00640 1 -- 172.21.15.7:0/2728167004 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0f94058480 con 0x7f0fa00b4a90 2024-08-19T00:42:57.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.719+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fa006f5b0 con 0x7f0fa00b4a90 2024-08-19T00:42:57.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.719+0000 7f0f9cc00640 1 -- 172.21.15.7:0/2728167004 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5219 (secure 0 0 0) 0x7f0f9405c780 con 0x7f0fa00b4a90 2024-08-19T00:42:57.721 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:42:57.721 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":70,"btime":"2024-08-19T00:42:45:932470+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:42:45.005795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6354":{"gid":6354,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2626740684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2626740684},{"type":"v1","addr":"172.21.15.7:6837","nonce":2626740684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6354,"qdb_cluster":[6354]},"id":5}]} 2024-08-19T00:42:57.722 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 70 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f8006be30 msgr2=0x7f0f8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f8006be30 0x7f0f8006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0fa015e320 tx=0x7f0f8c007f00 comp rx=0 tx=0).stop 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 msgr2=0x7f0fa00aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00aee50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c430 tx=0x7f0f9400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 shutdown_connections 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f8006be30 0x7f0f8006e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fa015f5b0 0x7f0fa01f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fa00d03c0 0x7f0fa0155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 --2- 172.21.15.7:0/2728167004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0fa00b4a90 0x7f0fa00aee50 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 >> 172.21.15.7:0/2728167004 conn(0x7f0fa006bc70 msgr2=0x7f0fa00aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:42:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 shutdown_connections 2024-08-19T00:42:57.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:42:57.722+0000 7f0fa7a00640 1 -- 172.21.15.7:0/2728167004 wait complete. 2024-08-19T00:42:57.740 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-19T00:42:58.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-08-19T00:43:02.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:43:02.066 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:43:02.740 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:02.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.908+0000 7fa3c6400640 1 Processor -- start 2024-08-19T00:43:02.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.909+0000 7fa3c6400640 1 -- start start 2024-08-19T00:43:02.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3c6400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa3c00d0ad0 0x7fa3c00ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3c6400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c006f7f0 con 0x7fa3c0159bf0 2024-08-19T00:43:02.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3c6400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c006f510 con 0x7fa3c00ce500 2024-08-19T00:43:02.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3c6400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c0072980 con 0x7fa3c00d0ad0 2024-08-19T00:43:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3bf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa3c0159bf0 0x7fa3c0073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44160/0 (socket says 172.21.15.7:44160) 2024-08-19T00:43:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3bf400640 1 -- 172.21.15.7:0/4281281285 learned_addr learned my addr 172.21.15.7:0/4281281285 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3bfe00640 1 --2- 172.21.15.7:0/4281281285 >> v2:172.21.15.162:3300/0 conn(0x7fa3c00d0ad0 0x7fa3c00ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235086059 0 0) 0x7fa3c006f7f0 con 0x7fa3c0159bf0 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.910+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a4003520 con 0x7fa3c0159bf0 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1492204682 0 0) 0x7fa3a4003520 con 0x7fa3c0159bf0 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 >> v2:172.21.15.162:3300/0 conn(0x7fa3c00d0ad0 msgr2=0x7fa3c00ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 --2- 172.21.15.7:0/4281281285 >> v2:172.21.15.162:3300/0 conn(0x7fa3c00d0ad0 0x7fa3c00ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 >> v1:172.21.15.162:6789/0 conn(0x7fa3c00ce500 legacy=0x7fa3c00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c0072c60 con 0x7fa3c0159bf0 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fa3b0001670 con 0x7fa3c0159bf0 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 >> v1:172.21.15.7:6789/0 conn(0x7fa3c0159bf0 legacy=0x7fa3c0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3a4003a00 0x7fa3a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3a4005210 0x7fa3a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0072980 con 0x7fa3a4003a00 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a400c160 con 0x7fa3a4004800 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a400c360 con 0x7fa3a4005210 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bf400640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3a4003a00 0x7fa3a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3b6a00640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bfe00640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3a4005210 0x7fa3a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bf400640 1 -- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3a4005210 msgr2=0x7fa3a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.911+0000 7fa3bf400640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3a4005210 0x7fa3a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.912+0000 7fa3bf400640 1 -- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4004800 msgr2=0x7fa3a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.912+0000 7fa3bf400640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4004800 0x7fa3a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.912+0000 7fa3bf400640 1 -- 172.21.15.7:0/4281281285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4003520 con 0x7fa3a4003a00 2024-08-19T00:43:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.912+0000 7fa3bfe00640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3a4005210 0x7fa3a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.912+0000 7fa3bfe00640 1 -- 172.21.15.7:0/4281281285 reap_dead start 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.912+0000 7fa3bf400640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3a4003a00 0x7fa3a4003e20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c0e0 tx=0x7fa3a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8138a68fd79de412 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0007c40 con 0x7fa3a4003a00 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b0005af0 con 0x7fa3a4003a00 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3bea00640 1 -- 172.21.15.7:0/4281281285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0007070 con 0x7fa3a4003a00 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3c6400640 1 -- 172.21.15.7:0/4281281285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3a4003a00 msgr2=0x7fa3a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3c6400640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3a4003a00 0x7fa3a4003e20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c0e0 tx=0x7fa3a4005830 comp rx=0 tx=0).stop 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3c6400640 1 -- 172.21.15.7:0/4281281285 shutdown_connections 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3c6400640 1 --2- 172.21.15.7:0/4281281285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3a4003a00 0x7fa3a4003e20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3c6400640 1 -- 172.21.15.7:0/4281281285 >> 172.21.15.7:0/4281281285 conn(0x7fa3c006bc70 msgr2=0x7fa3c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3c6400640 1 -- 172.21.15.7:0/4281281285 shutdown_connections 2024-08-19T00:43:02.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.913+0000 7fa3c6400640 1 -- 172.21.15.7:0/4281281285 wait complete. 2024-08-19T00:43:02.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.915+0000 7fa3c6400640 1 Processor -- start 2024-08-19T00:43:02.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.915+0000 7fa3c6400640 1 -- start start 2024-08-19T00:43:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.916+0000 7fa3c6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4003a00 0x7fa3c01541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.916+0000 7fa3c6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c00c9390 0x7fa3c009a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.916+0000 7fa3c6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c0157fa0 0x7fa3c0158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.916+0000 7fa3c6400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c015a150 con 0x7fa3c00c9390 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.916+0000 7fa3c6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0159fd0 con 0x7fa3a4003a00 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.916+0000 7fa3c6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c00ce970 con 0x7fa3c0157fa0 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c00c9390 0x7fa3c009a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c00c9390 0x7fa3c009a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35890/0 (socket says 172.21.15.7:35890) 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 -- 172.21.15.7:0/1723062189 learned_addr learned my addr 172.21.15.7:0/1723062189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3bf400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4003a00 0x7fa3c01541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3bfe00640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c0157fa0 0x7fa3c0158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 -- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c0157fa0 msgr2=0x7fa3c0158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c0157fa0 0x7fa3c0158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 -- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4003a00 msgr2=0x7fa3c01541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4003a00 0x7fa3c01541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 -- 172.21.15.7:0/1723062189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c00c9890 con 0x7fa3c00c9390 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b6a00640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c00c9390 0x7fa3c009a1e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800f5d0 tx=0x7fa3a800fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.917+0000 7fa3b7e00640 1 -- 172.21.15.7:0/1723062189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80052e0 con 0x7fa3c00c9390 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.918+0000 7fa3b7e00640 1 -- 172.21.15.7:0/1723062189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a8018070 con 0x7fa3c00c9390 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.918+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c00c9b70 con 0x7fa3c00c9390 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.918+0000 7fa3b7e00640 1 -- 172.21.15.7:0/1723062189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8003810 con 0x7fa3c00c9390 2024-08-19T00:43:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.918+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c00ca130 con 0x7fa3c00c9390 2024-08-19T00:43:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.919+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c009cb30 con 0x7fa3c00c9390 2024-08-19T00:43:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.920+0000 7fa3b7e00640 1 -- 172.21.15.7:0/1723062189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3a80039b0 con 0x7fa3c00c9390 2024-08-19T00:43:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.920+0000 7fa3b7e00640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa39c06be60 0x7fa39c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.920+0000 7fa3b7e00640 1 -- 172.21.15.7:0/1723062189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7fa3a808acb0 con 0x7fa3c00c9390 2024-08-19T00:43:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.921+0000 7fa3bf400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa39c06be60 0x7fa39c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.921+0000 7fa3bf400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa39c06be60 0x7fa39c06e320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0032000 tx=0x7fa3b002d000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:02.925+0000 7fa3b7e00640 1 -- 172.21.15.7:0/1723062189 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa3a8059580 con 0x7fa3c00c9390 2024-08-19T00:43:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.150+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3c00ceca0 con 0x7fa3c00c9390 2024-08-19T00:43:03.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.150+0000 7fa3b7e00640 1 -- 172.21.15.7:0/1723062189 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5267 (secure 0 0 0) 0x7fa3a8058e80 con 0x7fa3c00c9390 2024-08-19T00:43:03.152 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:03.152 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":71,"btime":"2024-08-19T00:43:03:085966+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:03.085940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6354":{"gid":6354,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2626740684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2626740684},{"type":"v1","addr":"172.21.15.7:6837","nonce":2626740684}]},"join_fscid":-1,"laggy_since":"2024-08-19T00:43:03.085940+0000","export_targets":[],"features":4540701547738038271,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6354,"qdb_cluster":[6354]},"id":5}]} 2024-08-19T00:43:03.152 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 71 2024-08-19T00:43:03.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa39c06be60 msgr2=0x7fa39c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa39c06be60 0x7fa39c06e320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0032000 tx=0x7fa3b002d000 comp rx=0 tx=0).stop 2024-08-19T00:43:03.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c00c9390 msgr2=0x7fa3c009a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c00c9390 0x7fa3c009a1e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800f5d0 tx=0x7fa3a800fa90 comp rx=0 tx=0).stop 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 shutdown_connections 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa39c06be60 0x7fa39c06e320 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c0157fa0 0x7fa3c0158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3c00c9390 0x7fa3c009a1e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 --2- 172.21.15.7:0/1723062189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a4003a00 0x7fa3c01541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.152+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 >> 172.21.15.7:0/1723062189 conn(0x7fa3c006bc70 msgr2=0x7fa3c00b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.153+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 shutdown_connections 2024-08-19T00:43:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.153+0000 7fa3c6400640 1 -- 172.21.15.7:0/1723062189 wait complete. 2024-08-19T00:43:03.170 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-08-19T00:43:03.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-08-19T00:43:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.430+0000 7f5894a00640 1 Processor -- start 2024-08-19T00:43:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.430+0000 7f5894a00640 1 -- start start 2024-08-19T00:43:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f5894a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f58900cc740 0x7f5890169d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f5894a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58900b6f70 con 0x7f589006d770 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f5894a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58900b7250 con 0x7f58900cbc30 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f5894a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f58900cb430 con 0x7f58900cc740 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588de00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f589006d770 0x7f589006db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44174/0 (socket says 172.21.15.7:44174) 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588de00640 1 -- 172.21.15.7:0/819379310 learned_addr learned my addr 172.21.15.7:0/819379310 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588e800640 1 --2- 172.21.15.7:0/819379310 >> v2:172.21.15.162:3300/0 conn(0x7f58900cc740 0x7f5890169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2697578734 0 0) 0x7f58900b6f70 con 0x7f589006d770 2024-08-19T00:43:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5874003520 con 0x7f589006d770 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155305052 0 0) 0x7f58900b7250 con 0x7f58900cbc30 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58900b6f70 con 0x7f58900cbc30 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.432+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2176309024 0 0) 0x7f5874003520 con 0x7f589006d770 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 >> v2:172.21.15.162:3300/0 conn(0x7f58900cc740 msgr2=0x7f5890169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 --2- 172.21.15.7:0/819379310 >> v2:172.21.15.162:3300/0 conn(0x7f58900cc740 0x7f5890169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 >> v1:172.21.15.162:6789/0 conn(0x7f58900cbc30 legacy=0x7f58900cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58900cb710 con 0x7f589006d770 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f5880001670 con 0x7f589006d770 2024-08-19T00:43:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 >> v1:172.21.15.7:6789/0 conn(0x7f589006d770 legacy=0x7f589006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874003bc0 0x7f5874003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874004800 0x7f5874004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58740051c0 0x7f587400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58900cb430 con 0x7f5874004800 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f587400c0c0 con 0x7f5874003bc0 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f587400c2c0 con 0x7f58740051c0 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588d400640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874004800 0x7f5874004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588de00640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874003bc0 0x7f5874003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588e800640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58740051c0 0x7f587400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588d400640 1 -- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58740051c0 msgr2=0x7f587400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588d400640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58740051c0 0x7f587400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588d400640 1 -- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874003bc0 msgr2=0x7f5874003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588d400640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874003bc0 0x7f5874003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588d400640 1 -- 172.21.15.7:0/819379310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5874003520 con 0x7f5874004800 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.433+0000 7f588e800640 1 -- 172.21.15.7:0/819379310 reap_dead start 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.434+0000 7f588d400640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874004800 0x7f5874004c80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f587c0018d0 tx=0x7f5874005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d006cc379c9d730 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c0014f0 con 0x7f5874004800 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c0052d0 con 0x7f5874004800 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f588ca00640 1 -- 172.21.15.7:0/819379310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c02ac40 con 0x7f5874004800 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f5894a00640 1 -- 172.21.15.7:0/819379310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874004800 msgr2=0x7f5874004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f5894a00640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874004800 0x7f5874004c80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f587c0018d0 tx=0x7f5874005830 comp rx=0 tx=0).stop 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f5894a00640 1 -- 172.21.15.7:0/819379310 shutdown_connections 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f5894a00640 1 --2- 172.21.15.7:0/819379310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874004800 0x7f5874004c80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f5894a00640 1 -- 172.21.15.7:0/819379310 >> 172.21.15.7:0/819379310 conn(0x7f58900d2180 msgr2=0x7f58900d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f5894a00640 1 -- 172.21.15.7:0/819379310 shutdown_connections 2024-08-19T00:43:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.435+0000 7f5894a00640 1 -- 172.21.15.7:0/819379310 wait complete. 2024-08-19T00:43:03.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.437+0000 7f5894a00640 1 Processor -- start 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.437+0000 7f5894a00640 1 -- start start 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f5894a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874004800 0x7f5890151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f5894a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5890152e50 0x7f589006fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f5894a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5890153330 0x7f5890070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f5894a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f589006d370 con 0x7f5890152e50 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f5894a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f589015ea10 con 0x7f5874004800 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f5894a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f58900d2ca0 con 0x7f5890153330 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f588d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5890152e50 0x7f589006fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f588d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5890152e50 0x7f589006fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35922/0 (socket says 172.21.15.7:35922) 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f588d400640 1 -- 172.21.15.7:0/4196224931 learned_addr learned my addr 172.21.15.7:0/4196224931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f588de00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874004800 0x7f5890151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.438+0000 7f588e800640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5890153330 0x7f5890070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588d400640 1 -- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5890153330 msgr2=0x7f5890070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588d400640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5890153330 0x7f5890070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588d400640 1 -- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874004800 msgr2=0x7f5890151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588d400640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874004800 0x7f5890151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588d400640 1 -- 172.21.15.7:0/4196224931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58900b0b90 con 0x7f5890152e50 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588de00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874004800 0x7f5890151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588e800640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5890153330 0x7f5890070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f588d400640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5890152e50 0x7f589006fc50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f587c0018d0 tx=0x7f587c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f5886000640 1 -- 172.21.15.7:0/4196224931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c03f020 con 0x7f5890152e50 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f5886000640 1 -- 172.21.15.7:0/4196224931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c005480 con 0x7f5890152e50 2024-08-19T00:43:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f5886000640 1 -- 172.21.15.7:0/4196224931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c037040 con 0x7f5890152e50 2024-08-19T00:43:03.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58900b0e30 con 0x7f5890152e50 2024-08-19T00:43:03.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.439+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58900b13f0 con 0x7f5890152e50 2024-08-19T00:43:03.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.440+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589009ba80 con 0x7f5890152e50 2024-08-19T00:43:03.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.441+0000 7f5886000640 1 -- 172.21.15.7:0/4196224931 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f587c042020 con 0x7f5890152e50 2024-08-19T00:43:03.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.443+0000 7f5886000640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f587006be30 0x7f587006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.443+0000 7f5886000640 1 -- 172.21.15.7:0/4196224931 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f587c0aabf0 con 0x7f5890152e50 2024-08-19T00:43:03.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.443+0000 7f588de00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f587006be30 0x7f587006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.443+0000 7f588de00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f587006be30 0x7f587006e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5880000c00 tx=0x7f5880009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:03.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.447+0000 7f5886000640 1 -- 172.21.15.7:0/4196224931 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f587c049030 con 0x7f5890152e50 2024-08-19T00:43:03.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.634+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7f58900b3b90 con 0x7f5890152e50 2024-08-19T00:43:03.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.638+0000 7f5886000640 1 -- 172.21.15.7:0/4196224931 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f587c0794c0 con 0x7f5890152e50 2024-08-19T00:43:03.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.640+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f587006be30 msgr2=0x7f587006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.640+0000 7f5894a00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f587006be30 0x7f587006e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5880000c00 tx=0x7f5880009040 comp rx=0 tx=0).stop 2024-08-19T00:43:03.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.640+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5890152e50 msgr2=0x7f589006fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.640+0000 7f5894a00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5890152e50 0x7f589006fc50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f587c0018d0 tx=0x7f587c0012d0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 shutdown_connections 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f587006be30 0x7f587006e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5890153330 0x7f5890070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5890152e50 0x7f589006fc50 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 --2- 172.21.15.7:0/4196224931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5874004800 0x7f5890151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 >> 172.21.15.7:0/4196224931 conn(0x7f58900d2180 msgr2=0x7f58900ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 shutdown_connections 2024-08-19T00:43:03.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.641+0000 7f5894a00640 1 -- 172.21.15.7:0/4196224931 wait complete. 2024-08-19T00:43:03.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 5:0 false 2024-08-19T00:43:03.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.815+0000 7f7d24200640 1 Processor -- start 2024-08-19T00:43:03.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.815+0000 7f7d24200640 1 -- start start 2024-08-19T00:43:03.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d24200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d1c0b3620 0x7f7d1c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d24200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1c15e720 con 0x7f7d1c06f720 2024-08-19T00:43:03.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d24200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1c0b3c00 con 0x7f7d1c0aed00 2024-08-19T00:43:03.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d24200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7d1c072450 con 0x7f7d1c0b3620 2024-08-19T00:43:03.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d22200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7d1c06f720 0x7f7d1c0acef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53992/0 (socket says 172.21.15.7:53992) 2024-08-19T00:43:03.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d20e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d1c0b3620 0x7f7d1c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d22200640 1 -- 172.21.15.7:0/3267920137 learned_addr learned my addr 172.21.15.7:0/3267920137 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:03.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d20e00640 1 -- 172.21.15.7:0/3267920137 >> v1:172.21.15.162:6789/0 conn(0x7f7d1c0aed00 legacy=0x7f7d1c0b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:03.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d20e00640 1 -- 172.21.15.7:0/3267920137 >> v1:172.21.15.7:6789/0 conn(0x7f7d1c06f720 legacy=0x7f7d1c0acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d20e00640 1 -- 172.21.15.7:0/3267920137 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c072730 con 0x7f7d1c0b3620 2024-08-19T00:43:03.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.817+0000 7f7d1be00640 1 -- 172.21.15.7:0/3267920137 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239468568 0 0) 0x7f7d14001490 con 0x7f7d1c06f720 2024-08-19T00:43:03.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.818+0000 7f7d20e00640 1 --2- 172.21.15.7:0/3267920137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c06f0d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7d080097a0 tx=0x7f7d0802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21884d88716013 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:03.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d1be00640 1 -- 172.21.15.7:0/3267920137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08037070 con 0x7f7d1c0b3620 2024-08-19T00:43:03.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d1be00640 1 -- 172.21.15.7:0/3267920137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0802adc0 con 0x7f7d1c0b3620 2024-08-19T00:43:03.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d1be00640 1 -- 172.21.15.7:0/3267920137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08032660 con 0x7f7d1c0b3620 2024-08-19T00:43:03.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d24200640 1 -- 172.21.15.7:0/3267920137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c0b3620 msgr2=0x7f7d1c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d24200640 1 --2- 172.21.15.7:0/3267920137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c06f0d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7d080097a0 tx=0x7f7d0802a0b0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d24200640 1 -- 172.21.15.7:0/3267920137 shutdown_connections 2024-08-19T00:43:03.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d24200640 1 --2- 172.21.15.7:0/3267920137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c06f0d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d24200640 1 -- 172.21.15.7:0/3267920137 >> 172.21.15.7:0/3267920137 conn(0x7f7d1c0b2300 msgr2=0x7f7d1c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:03.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.819+0000 7f7d24200640 1 -- 172.21.15.7:0/3267920137 shutdown_connections 2024-08-19T00:43:03.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.820+0000 7f7d24200640 1 -- 172.21.15.7:0/3267920137 wait complete. 2024-08-19T00:43:03.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.821+0000 7f7d24200640 1 Processor -- start 2024-08-19T00:43:03.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.821+0000 7f7d24200640 1 -- start start 2024-08-19T00:43:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d24200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c06f720 0x7f7d1c161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d24200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d1c0aed00 0x7f7d1c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d24200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d24200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c0ad600 con 0x7f7d1c06f720 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d24200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c072cf0 con 0x7f7d1c0b3620 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d24200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c0ad780 con 0x7f7d1c0aed00 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d21800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c06f720 0x7f7d1c161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d21800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c06f720 0x7f7d1c161140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36462/0 (socket says 172.21.15.7:36462) 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.822+0000 7f7d21800640 1 -- 172.21.15.7:0/3632344675 learned_addr learned my addr 172.21.15.7:0/3632344675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d20e00640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d1c0aed00 0x7f7d1c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d22200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d21800640 1 -- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d1c0aed00 msgr2=0x7f7d1c146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d21800640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d1c0aed00 0x7f7d1c146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d21800640 1 -- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c0b3620 msgr2=0x7f7d1c146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d21800640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d21800640 1 -- 172.21.15.7:0/3632344675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c1f82f0 con 0x7f7d1c06f720 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d22200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d21800640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c06f720 0x7f7d1c161140 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000c430 tx=0x7f7d1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d19600640 1 -- 172.21.15.7:0/3632344675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011790 con 0x7f7d1c06f720 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d19600640 1 -- 172.21.15.7:0/3632344675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d10017070 con 0x7f7d1c06f720 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d19600640 1 -- 172.21.15.7:0/3632344675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011b70 con 0x7f7d1c06f720 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1c09af20 con 0x7f7d1c06f720 2024-08-19T00:43:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.823+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1c09b4e0 con 0x7f7d1c06f720 2024-08-19T00:43:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.825+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1c06f0d0 con 0x7f7d1c06f720 2024-08-19T00:43:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.825+0000 7f7d19600640 1 -- 172.21.15.7:0/3632344675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d10011d10 con 0x7f7d1c06f720 2024-08-19T00:43:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.827+0000 7f7d19600640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cfc06be30 0x7f7cfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.827+0000 7f7d19600640 1 -- 172.21.15.7:0/3632344675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5767+0+0 (secure 0 0 0) 0x7f7d1008adf0 con 0x7f7d1c06f720 2024-08-19T00:43:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.827+0000 7f7d20e00640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cfc06be30 0x7f7cfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.828+0000 7f7d20e00640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cfc06be30 0x7f7cfc06e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7d08034000 tx=0x7f7d0802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:03.831+0000 7f7d19600640 1 -- 172.21.15.7:0/3632344675 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7d100596c0 con 0x7f7d1c06f720 2024-08-19T00:43:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:04.094+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "5:0", "val": "false"} v 0) -- 0x7f7d1c0b0f70 con 0x7f7d1c06f720 2024-08-19T00:43:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2024-08-19T00:43:05.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.098+0000 7f7d19600640 1 -- 172.21.15.7:0/3632344675 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "5:0", "val": "false"}]=0 unfreezing mds.6354 v72) ==== 115+0+0 (secure 0 0 0) 0x7f7d10058fc0 con 0x7f7d1c06f720 2024-08-19T00:43:05.100 INFO:teuthology.orchestra.run.smithi007.stderr:unfreezing mds.6354 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cfc06be30 msgr2=0x7f7cfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cfc06be30 0x7f7cfc06e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7d08034000 tx=0x7f7d0802e000 comp rx=0 tx=0).stop 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c06f720 msgr2=0x7f7d1c161140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c06f720 0x7f7d1c161140 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000c430 tx=0x7f7d1000c8f0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 shutdown_connections 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cfc06be30 0x7f7cfc06e2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c0b3620 0x7f7d1c146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d1c0aed00 0x7f7d1c146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 --2- 172.21.15.7:0/3632344675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d1c06f720 0x7f7d1c161140 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 >> 172.21.15.7:0/3632344675 conn(0x7f7d1c0b2300 msgr2=0x7f7d1c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:05.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 shutdown_connections 2024-08-19T00:43:05.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.102+0000 7f7d24200640 1 -- 172.21.15.7:0/3632344675 wait complete. 2024-08-19T00:43:05.129 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -n kernel.core_pattern 2024-08-19T00:43:05.185 INFO:teuthology.orchestra.run.smithi007.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:43:05.187 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:43:05.188 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2024-08-19T00:43:05.252 INFO:teuthology.orchestra.run.smithi007.stdout:1724028171.42982.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-08-19T00:43:05.256 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1724028171.42982.core'] 2024-08-19T00:43:05.256 INFO:tasks.cephfs.cephfs_test_case:Found core file 1724028171.42982.core, deleting it 2024-08-19T00:43:05.257 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1724028171.42982.core 2024-08-19T00:43:05.325 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:43:05.325 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-19T00:43:05.325 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:43:05.325 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:43:05.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:43:05.325 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-08-19T00:43:05.326 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:43:05.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:43:05.330 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:43:05.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:05.462 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:43:05.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.488+0000 7fbc90400640 1 Processor -- start 2024-08-19T00:43:05.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.489+0000 7fbc90400640 1 -- start start 2024-08-19T00:43:05.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc90400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815d490 0x7fbc881671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:05.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc90400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc880ccd40 con 0x7fbc8815c510 2024-08-19T00:43:05.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc90400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc8809b370 con 0x7fbc8815c8f0 2024-08-19T00:43:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc90400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8809b650 con 0x7fbc8815d490 2024-08-19T00:43:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc8d000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbc8815c510 0x7fbc8809aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54012/0 (socket says 172.21.15.7:54012) 2024-08-19T00:43:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc8d000640 1 -- 172.21.15.7:0/1035620758 learned_addr learned my addr 172.21.15.7:0/1035620758 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc8e400640 1 --2- 172.21.15.7:0/1035620758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815d490 0x7fbc881671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc87e00640 1 -- 172.21.15.7:0/1035620758 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1704327535 0 0) 0x7fbc880ccd40 con 0x7fbc8815c510 2024-08-19T00:43:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.490+0000 7fbc87e00640 1 -- 172.21.15.7:0/1035620758 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc70003520 con 0x7fbc8815c510 2024-08-19T00:43:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.491+0000 7fbc8e400640 1 -- 172.21.15.7:0/1035620758 >> v1:172.21.15.162:6789/0 conn(0x7fbc8815c8f0 legacy=0x7fbc8815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.491+0000 7fbc87e00640 1 -- 172.21.15.7:0/1035620758 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549721565 0 0) 0x7fbc8809b370 con 0x7fbc8815c8f0 2024-08-19T00:43:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.491+0000 7fbc8e400640 1 -- 172.21.15.7:0/1035620758 >> v1:172.21.15.7:6789/0 conn(0x7fbc8815c510 legacy=0x7fbc8809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.491+0000 7fbc8e400640 1 -- 172.21.15.7:0/1035620758 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8809b930 con 0x7fbc8815d490 2024-08-19T00:43:05.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.492+0000 7fbc8e400640 1 --2- 172.21.15.7:0/1035620758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815d490 0x7fbc881671e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009dc0 tx=0x7fbc8002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd0774edf504c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.492+0000 7fbc87e00640 1 -- 172.21.15.7:0/1035620758 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80007740 con 0x7fbc8815d490 2024-08-19T00:43:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.492+0000 7fbc87e00640 1 -- 172.21.15.7:0/1035620758 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc800078e0 con 0x7fbc8815d490 2024-08-19T00:43:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.492+0000 7fbc87e00640 1 -- 172.21.15.7:0/1035620758 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80007cb0 con 0x7fbc8815d490 2024-08-19T00:43:05.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.493+0000 7fbc90400640 1 -- 172.21.15.7:0/1035620758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815d490 msgr2=0x7fbc881671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.493+0000 7fbc90400640 1 --2- 172.21.15.7:0/1035620758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815d490 0x7fbc881671e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009dc0 tx=0x7fbc8002a6d0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.493+0000 7fbc90400640 1 -- 172.21.15.7:0/1035620758 shutdown_connections 2024-08-19T00:43:05.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.493+0000 7fbc90400640 1 --2- 172.21.15.7:0/1035620758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815d490 0x7fbc881671e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.493+0000 7fbc90400640 1 -- 172.21.15.7:0/1035620758 >> 172.21.15.7:0/1035620758 conn(0x7fbc880d2190 msgr2=0x7fbc880d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:05.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.493+0000 7fbc90400640 1 -- 172.21.15.7:0/1035620758 shutdown_connections 2024-08-19T00:43:05.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.493+0000 7fbc90400640 1 -- 172.21.15.7:0/1035620758 wait complete. 2024-08-19T00:43:05.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.494+0000 7fbc90400640 1 Processor -- start 2024-08-19T00:43:05.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.495+0000 7fbc90400640 1 -- start start 2024-08-19T00:43:05.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.495+0000 7fbc90400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8815c510 0x7fbc88156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:05.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.495+0000 7fbc90400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815c8f0 0x7fbc880b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:05.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.495+0000 7fbc90400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8815d490 0x7fbc880b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.495+0000 7fbc90400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880ce3b0 con 0x7fbc8815c510 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.495+0000 7fbc90400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880ce230 con 0x7fbc8815d490 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.495+0000 7fbc90400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc880ce530 con 0x7fbc8815c8f0 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8815c510 0x7fbc88156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8815c510 0x7fbc88156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36492/0 (socket says 172.21.15.7:36492) 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 -- 172.21.15.7:0/2167334756 learned_addr learned my addr 172.21.15.7:0/2167334756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8e400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8815d490 0x7fbc880b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8d000640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815c8f0 0x7fbc880b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 -- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815c8f0 msgr2=0x7fbc880b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815c8f0 0x7fbc880b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 -- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8815d490 msgr2=0x7fbc880b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8815d490 0x7fbc880b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 -- 172.21.15.7:0/2167334756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc880c5df0 con 0x7fbc8815c510 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8e400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8815d490 0x7fbc880b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.496+0000 7fbc8da00640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8815c510 0x7fbc88156600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c460 tx=0x7fbc7c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.497+0000 7fbc85600640 1 -- 172.21.15.7:0/2167334756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c005480 con 0x7fbc8815c510 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.497+0000 7fbc85600640 1 -- 172.21.15.7:0/2167334756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0035f0 con 0x7fbc8815c510 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.497+0000 7fbc85600640 1 -- 172.21.15.7:0/2167334756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c003a00 con 0x7fbc8815c510 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.497+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc880c60d0 con 0x7fbc8815c510 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.497+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc880c6690 con 0x7fbc8815c510 2024-08-19T00:43:05.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.498+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc880d2cb0 con 0x7fbc8815c510 2024-08-19T00:43:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.499+0000 7fbc85600640 1 -- 172.21.15.7:0/2167334756 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc7c003ba0 con 0x7fbc8815c510 2024-08-19T00:43:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.500+0000 7fbc85600640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc6806bfd0 0x7fbc6806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.500+0000 7fbc85600640 1 -- 172.21.15.7:0/2167334756 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7fbc7c08abe0 con 0x7fbc8815c510 2024-08-19T00:43:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.500+0000 7fbc8d000640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc6806bfd0 0x7fbc6806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:05.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.500+0000 7fbc8d000640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc6806bfd0 0x7fbc6806e490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbc880b2e00 tx=0x7fbc74009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:05.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.504+0000 7fbc85600640 1 -- 172.21.15.7:0/2167334756 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbc7c0594f0 con 0x7fbc8815c510 2024-08-19T00:43:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.724+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc88156b40 con 0x7fbc8815c510 2024-08-19T00:43:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.725+0000 7fbc85600640 1 -- 172.21.15.7:0/2167334756 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+4391 (secure 0 0 0) 0x7fbc7c058df0 con 0x7fbc8815c510 2024-08-19T00:43:05.727 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:05.727 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"btime":"2024-08-19T00:43:05:101626+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:05.101620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":73,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-08-19T00:43:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc6806bfd0 msgr2=0x7fbc6806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc6806bfd0 0x7fbc6806e490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbc880b2e00 tx=0x7fbc74009040 comp rx=0 tx=0).stop 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8815c510 msgr2=0x7fbc88156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8815c510 0x7fbc88156600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c460 tx=0x7fbc7c00c920 comp rx=0 tx=0).stop 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 shutdown_connections 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc6806bfd0 0x7fbc6806e490 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8815d490 0x7fbc880b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc8815c8f0 0x7fbc880b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 --2- 172.21.15.7:0/2167334756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8815c510 0x7fbc88156600 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 >> 172.21.15.7:0/2167334756 conn(0x7fbc880d2190 msgr2=0x7fbc880d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 shutdown_connections 2024-08-19T00:43:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:05.727+0000 7fbc90400640 1 -- 172.21.15.7:0/2167334756 wait complete. 2024-08-19T00:43:06.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:42:31.298074+0000', 'modified': '2024-08-19T00:43:05.101620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 75, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6351}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6351': {'gid': 6351, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6836/3281733316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3281733316}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3281733316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:43:06.148 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6351:up:replay 2024-08-19T00:43:07.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.316+0000 7f600ce00640 1 Processor -- start 2024-08-19T00:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.316+0000 7f600ce00640 1 -- start start 2024-08-19T00:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.317+0000 7f600ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f600806d960 0x7f60080b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.317+0000 7f600ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60080d2ba0 0x7f60080b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.317+0000 7f600ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60080d5240 con 0x7f6008161ba0 2024-08-19T00:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.317+0000 7f600ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f60080b39c0 con 0x7f60080d2ba0 2024-08-19T00:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.317+0000 7f600ce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f60080b36e0 con 0x7f600806d960 2024-08-19T00:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6006800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60080d2ba0 0x7f60080b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6006800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60080d2ba0 0x7f60080b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36494/0 (socket says 172.21.15.7:36494) 2024-08-19T00:43:07.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6006800640 1 -- 172.21.15.7:0/1667353021 learned_addr learned my addr 172.21.15.7:0/1667353021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:07.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6005400640 1 --2- 172.21.15.7:0/1667353021 >> v2:172.21.15.162:3300/0 conn(0x7f600806d960 0x7f60080b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:07.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6006800640 1 -- 172.21.15.7:0/1667353021 >> v2:172.21.15.162:3300/0 conn(0x7f600806d960 msgr2=0x7f60080b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6006800640 1 --2- 172.21.15.7:0/1667353021 >> v2:172.21.15.162:3300/0 conn(0x7f600806d960 0x7f60080b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6006800640 1 -- 172.21.15.7:0/1667353021 >> v1:172.21.15.162:6789/0 conn(0x7f6008161ba0 legacy=0x7f60080d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6006800640 1 -- 172.21.15.7:0/1667353021 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600806e3a0 con 0x7f60080d2ba0 2024-08-19T00:43:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.318+0000 7f6005400640 1 --2- 172.21.15.7:0/1667353021 >> v2:172.21.15.162:3300/0 conn(0x7f600806d960 0x7f60080b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.319+0000 7f6006800640 1 --2- 172.21.15.7:0/1667353021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f60080b2640 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f60080b3e30 tx=0x7f600002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad763ce3a558c361 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.319+0000 7f6004a00640 1 -- 172.21.15.7:0/1667353021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000036070 con 0x7f60080d2ba0 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.319+0000 7f6004a00640 1 -- 172.21.15.7:0/1667353021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6000031600 con 0x7f60080d2ba0 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.319+0000 7f6004a00640 1 -- 172.21.15.7:0/1667353021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60000319d0 con 0x7f60080d2ba0 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 -- 172.21.15.7:0/1667353021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 msgr2=0x7f60080b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 --2- 172.21.15.7:0/1667353021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f60080b2640 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f60080b3e30 tx=0x7f600002a6c0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 -- 172.21.15.7:0/1667353021 shutdown_connections 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 --2- 172.21.15.7:0/1667353021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f60080b2640 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 --2- 172.21.15.7:0/1667353021 >> v2:172.21.15.162:3300/0 conn(0x7f600806d960 0x7f60080b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 -- 172.21.15.7:0/1667353021 >> 172.21.15.7:0/1667353021 conn(0x7f600808c000 msgr2=0x7f60080d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 -- 172.21.15.7:0/1667353021 shutdown_connections 2024-08-19T00:43:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.320+0000 7f600ce00640 1 -- 172.21.15.7:0/1667353021 wait complete. 2024-08-19T00:43:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.322+0000 7f600ce00640 1 Processor -- start 2024-08-19T00:43:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.322+0000 7f600ce00640 1 -- start start 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f600ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f600806d960 0x7f60080cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f600ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f6008154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f600ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6008161ba0 0x7f60081f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f600ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6008161f80 con 0x7f60080d2ba0 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f600ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60080b1be0 con 0x7f600806d960 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f600ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6008162100 con 0x7f6008161ba0 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f6008154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f6008154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36502/0 (socket says 172.21.15.7:36502) 2024-08-19T00:43:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005400640 1 -- 172.21.15.7:0/2339713042 learned_addr learned my addr 172.21.15.7:0/2339713042 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6006800640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6008161ba0 0x7f60081f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005400640 1 -- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6008161ba0 msgr2=0x7f60081f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005e00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f600806d960 0x7f60080cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005400640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6008161ba0 0x7f60081f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005400640 1 -- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f600806d960 msgr2=0x7f60080cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.323+0000 7f6005400640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f600806d960 0x7f60080cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f6005400640 1 -- 172.21.15.7:0/2339713042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60081f5190 con 0x7f60080d2ba0 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f6006800640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6008161ba0 0x7f60081f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f6005e00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f600806d960 0x7f60080cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f6005400640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f6008154c60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c820 tx=0x7f5ff400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f5ffe000640 1 -- 172.21.15.7:0/2339713042 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4015070 con 0x7f60080d2ba0 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f5ffe000640 1 -- 172.21.15.7:0/2339713042 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff4007a30 con 0x7f60080d2ba0 2024-08-19T00:43:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60080b8f10 con 0x7f60080d2ba0 2024-08-19T00:43:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f5ffe000640 1 -- 172.21.15.7:0/2339713042 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4007e00 con 0x7f60080d2ba0 2024-08-19T00:43:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.324+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60080b9490 con 0x7f60080d2ba0 2024-08-19T00:43:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.325+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600806ded0 con 0x7f60080d2ba0 2024-08-19T00:43:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.326+0000 7f5ffe000640 1 -- 172.21.15.7:0/2339713042 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ff4018070 con 0x7f60080d2ba0 2024-08-19T00:43:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.328+0000 7f5ffe000640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.328+0000 7f5ffe000640 1 -- 172.21.15.7:0/2339713042 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f5ff408add0 con 0x7f60080d2ba0 2024-08-19T00:43:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.328+0000 7f6005e00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.328+0000 7f6005e00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fe806be30 0x7f5fe806e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f60080c7ef0 tx=0x7f5ff8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:07.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.332+0000 7f5ffe000640 1 -- 172.21.15.7:0/2339713042 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f600806ded0 con 0x7f60080d2ba0 2024-08-19T00:43:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.553+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60080d4b30 con 0x7f60080d2ba0 2024-08-19T00:43:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.554+0000 7f5ffe000640 1 -- 172.21.15.7:0/2339713042 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5214 (secure 0 0 0) 0x7f60081f5190 con 0x7f60080d2ba0 2024-08-19T00:43:07.555 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:07.556 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"btime":"2024-08-19T00:43:07:109103+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":5774,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1074731607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1074731607},{"type":"v1","addr":"172.21.15.7:6837","nonce":1074731607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:06.118905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":73,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-08-19T00:43:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 75 2024-08-19T00:43:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fe806be30 msgr2=0x7f5fe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fe806be30 0x7f5fe806e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f60080c7ef0 tx=0x7f5ff8008040 comp rx=0 tx=0).stop 2024-08-19T00:43:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 msgr2=0x7f6008154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f6008154c60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c820 tx=0x7f5ff400cc20 comp rx=0 tx=0).stop 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 shutdown_connections 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6008161ba0 0x7f60081f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60080d2ba0 0x7f6008154c60 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 --2- 172.21.15.7:0/2339713042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f600806d960 0x7f60080cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 >> 172.21.15.7:0/2339713042 conn(0x7f600808c000 msgr2=0x7f60080d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 shutdown_connections 2024-08-19T00:43:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:07.556+0000 7f600ce00640 1 -- 172.21.15.7:0/2339713042 wait complete. 2024-08-19T00:43:07.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:42:31.298074+0000', 'modified': '2024-08-19T00:43:06.118905+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 75, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6351}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6351': {'gid': 6351, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:rejoin', 'state_seq': 12, 'addr': '172.21.15.7:6836/3281733316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3281733316}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3281733316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:43:07.977 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6351:up:rejoin 2024-08-19T00:43:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:43:08.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:09.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.146+0000 7f329da00640 1 Processor -- start 2024-08-19T00:43:09.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.146+0000 7f329da00640 1 -- start start 2024-08-19T00:43:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.147+0000 7f329da00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32980d03c0 0x7f3298071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.147+0000 7f329da00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f329806e710 0x7f32980d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.147+0000 7f329da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32980d0ce0 con 0x7f32980b3750 2024-08-19T00:43:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.147+0000 7f329da00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f32980cebc0 con 0x7f32980d03c0 2024-08-19T00:43:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.147+0000 7f329da00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f32980cdfb0 con 0x7f329806e710 2024-08-19T00:43:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3296a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32980d03c0 0x7f3298071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3297400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f32980b3750 0x7f32980cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54020/0 (socket says 172.21.15.7:54020) 2024-08-19T00:43:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3297400640 1 -- 172.21.15.7:0/3684286143 learned_addr learned my addr 172.21.15.7:0/3684286143 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f328e000640 1 --2- 172.21.15.7:0/3684286143 >> v2:172.21.15.162:3300/0 conn(0x7f329806e710 0x7f32980d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3296a00640 1 -- 172.21.15.7:0/3684286143 >> v2:172.21.15.162:3300/0 conn(0x7f329806e710 msgr2=0x7f32980d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3296a00640 1 --2- 172.21.15.7:0/3684286143 >> v2:172.21.15.162:3300/0 conn(0x7f329806e710 0x7f32980d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3296a00640 1 -- 172.21.15.7:0/3684286143 >> v1:172.21.15.7:6789/0 conn(0x7f32980b3750 legacy=0x7f32980cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3296a00640 1 -- 172.21.15.7:0/3684286143 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32980ce290 con 0x7f32980d03c0 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f3296000640 1 -- 172.21.15.7:0/3684286143 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140710761 0 0) 0x7f32980d0ce0 con 0x7f32980b3750 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.148+0000 7f328e000640 1 --2- 172.21.15.7:0/3684286143 >> v2:172.21.15.162:3300/0 conn(0x7f329806e710 0x7f32980d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.149+0000 7f3296a00640 1 --2- 172.21.15.7:0/3684286143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32980d03c0 0x7f3298071980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f328800ba40 tx=0x7f328802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb68d8bcd36ae45 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.149+0000 7f3296000640 1 -- 172.21.15.7:0/3684286143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288032770 con 0x7f32980d03c0 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.149+0000 7f3296000640 1 -- 172.21.15.7:0/3684286143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288038070 con 0x7f32980d03c0 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.149+0000 7f3296000640 1 -- 172.21.15.7:0/3684286143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288032b30 con 0x7f32980d03c0 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 -- 172.21.15.7:0/3684286143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32980d03c0 msgr2=0x7f3298071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 --2- 172.21.15.7:0/3684286143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32980d03c0 0x7f3298071980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f328800ba40 tx=0x7f328802c8b0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 -- 172.21.15.7:0/3684286143 shutdown_connections 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 --2- 172.21.15.7:0/3684286143 >> v2:172.21.15.162:3300/0 conn(0x7f329806e710 0x7f32980d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 --2- 172.21.15.7:0/3684286143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32980d03c0 0x7f3298071980 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 -- 172.21.15.7:0/3684286143 >> 172.21.15.7:0/3684286143 conn(0x7f329806bc70 msgr2=0x7f329806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 -- 172.21.15.7:0/3684286143 shutdown_connections 2024-08-19T00:43:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.150+0000 7f329da00640 1 -- 172.21.15.7:0/3684286143 wait complete. 2024-08-19T00:43:09.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.152+0000 7f329da00640 1 Processor -- start 2024-08-19T00:43:09.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.152+0000 7f329da00640 1 -- start start 2024-08-19T00:43:09.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f329da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f329806e710 0x7f32981f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f329da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32980b3750 0x7f32981f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f329da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32980d03c0 0x7f32981ea470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f329da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3298073ae0 con 0x7f329806e710 2024-08-19T00:43:09.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f329da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32980ce850 con 0x7f32980d03c0 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f329da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3298073c60 con 0x7f32980b3750 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f329806e710 0x7f32981f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f329806e710 0x7f32981f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36518/0 (socket says 172.21.15.7:36518) 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 -- 172.21.15.7:0/1827452774 learned_addr learned my addr 172.21.15.7:0/1827452774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f328e000640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32980b3750 0x7f32981f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3297400640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32980d03c0 0x7f32981ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 -- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32980b3750 msgr2=0x7f32981f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32980b3750 0x7f32981f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 -- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32980d03c0 msgr2=0x7f32981ea470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32980d03c0 0x7f32981ea470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3296a00640 1 -- 172.21.15.7:0/1827452774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329815d630 con 0x7f329806e710 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.153+0000 7f3297400640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32980d03c0 0x7f32981ea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.154+0000 7f3296a00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f329806e710 0x7f32981f3c60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f328800ba40 tx=0x7f3288004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.154+0000 7f328f400640 1 -- 172.21.15.7:0/1827452774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288033c40 con 0x7f329806e710 2024-08-19T00:43:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.154+0000 7f328f400640 1 -- 172.21.15.7:0/1827452774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288032e50 con 0x7f329806e710 2024-08-19T00:43:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.154+0000 7f328f400640 1 -- 172.21.15.7:0/1827452774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288046410 con 0x7f329806e710 2024-08-19T00:43:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.154+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32981f81a0 con 0x7f329806e710 2024-08-19T00:43:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.154+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32981f4870 con 0x7f329806e710 2024-08-19T00:43:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.155+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32980b3bc0 con 0x7f329806e710 2024-08-19T00:43:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.156+0000 7f328f400640 1 -- 172.21.15.7:0/1827452774 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3288044020 con 0x7f329806e710 2024-08-19T00:43:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.157+0000 7f328f400640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f327406be60 0x7f327406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.157+0000 7f328f400640 1 -- 172.21.15.7:0/1827452774 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f32880abcb0 con 0x7f329806e710 2024-08-19T00:43:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.157+0000 7f328e000640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f327406be60 0x7f327406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.158+0000 7f328e000640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f327406be60 0x7f327406e320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3280007510 tx=0x7f32800074a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.162+0000 7f328f400640 1 -- 172.21.15.7:0/1827452774 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f32981f81a0 con 0x7f329806e710 2024-08-19T00:43:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.387+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32980d0cd0 con 0x7f329806e710 2024-08-19T00:43:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.388+0000 7f328f400640 1 -- 172.21.15.7:0/1827452774 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5221 (secure 0 0 0) 0x7f328807a530 con 0x7f329806e710 2024-08-19T00:43:09.390 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:09.390 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"btime":"2024-08-19T00:43:08:115906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":5774,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1074731607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1074731607},{"type":"v1","addr":"172.21.15.7:6837","nonce":1074731607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:08.115898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":13,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":5}]} 2024-08-19T00:43:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 76 2024-08-19T00:43:09.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f327406be60 msgr2=0x7f327406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f327406be60 0x7f327406e320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3280007510 tx=0x7f32800074a0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f329806e710 msgr2=0x7f32981f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f329806e710 0x7f32981f3c60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f328800ba40 tx=0x7f3288004730 comp rx=0 tx=0).stop 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 shutdown_connections 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f327406be60 0x7f327406e320 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32980d03c0 0x7f32981ea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32980b3750 0x7f32981f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 --2- 172.21.15.7:0/1827452774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f329806e710 0x7f32981f3c60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 >> 172.21.15.7:0/1827452774 conn(0x7f329806bc70 msgr2=0x7f329806c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 shutdown_connections 2024-08-19T00:43:09.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.390+0000 7f329da00640 1 -- 172.21.15.7:0/1827452774 wait complete. 2024-08-19T00:43:09.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:42:31.298074+0000', 'modified': '2024-08-19T00:43:08.115898+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 75, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6351}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6351': {'gid': 6351, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.7:6836/3281733316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3281733316}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3281733316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6351, 'qdb_cluster': [6351]} 2024-08-19T00:43:09.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:43:09.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:43:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.971+0000 7fefbe200640 1 Processor -- start 2024-08-19T00:43:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.971+0000 7fefbe200640 1 -- start start 2024-08-19T00:43:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefbe200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fefb815f5b0 0x7fefb80cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefbe200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefb80b4a90 0x7fefb80d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefbe200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb80cfaf0 con 0x7fefb80d03c0 2024-08-19T00:43:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefbe200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fefb80d0d60 con 0x7fefb80b4a90 2024-08-19T00:43:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefbe200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fefb815f990 con 0x7fefb815f5b0 2024-08-19T00:43:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefb7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefb80b4a90 0x7fefb80d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefb7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefb80b4a90 0x7fefb80d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36530/0 (socket says 172.21.15.7:36530) 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefb7e00640 1 -- 172.21.15.7:0/4013755596 learned_addr learned my addr 172.21.15.7:0/4013755596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefb7400640 1 --2- 172.21.15.7:0/4013755596 >> v2:172.21.15.162:3300/0 conn(0x7fefb815f5b0 0x7fefb80cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.972+0000 7fefb7e00640 1 -- 172.21.15.7:0/4013755596 >> v2:172.21.15.162:3300/0 conn(0x7fefb815f5b0 msgr2=0x7fefb80cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.973+0000 7fefb7e00640 1 --2- 172.21.15.7:0/4013755596 >> v2:172.21.15.162:3300/0 conn(0x7fefb815f5b0 0x7fefb80cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.973+0000 7fefb7e00640 1 -- 172.21.15.7:0/4013755596 >> v1:172.21.15.162:6789/0 conn(0x7fefb80d03c0 legacy=0x7fefb80b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.973+0000 7fefb7e00640 1 -- 172.21.15.7:0/4013755596 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb80b50b0 con 0x7fefb80b4a90 2024-08-19T00:43:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.973+0000 7fefb7400640 1 --2- 172.21.15.7:0/4013755596 >> v2:172.21.15.162:3300/0 conn(0x7fefb815f5b0 0x7fefb80cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefb7e00640 1 --2- 172.21.15.7:0/4013755596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80d0820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fefb806d280 tx=0x7fefb002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ac750361bbff11 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefb6a00640 1 -- 172.21.15.7:0/4013755596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0036070 con 0x7fefb80b4a90 2024-08-19T00:43:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefb6a00640 1 -- 172.21.15.7:0/4013755596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0031600 con 0x7fefb80b4a90 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefb6a00640 1 -- 172.21.15.7:0/4013755596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb00319d0 con 0x7fefb80b4a90 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefbe200640 1 -- 172.21.15.7:0/4013755596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 msgr2=0x7fefb80d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefbe200640 1 --2- 172.21.15.7:0/4013755596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80d0820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fefb806d280 tx=0x7fefb002a6d0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefbe200640 1 -- 172.21.15.7:0/4013755596 shutdown_connections 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefbe200640 1 --2- 172.21.15.7:0/4013755596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80d0820 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefbe200640 1 --2- 172.21.15.7:0/4013755596 >> v2:172.21.15.162:3300/0 conn(0x7fefb815f5b0 0x7fefb80cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefbe200640 1 -- 172.21.15.7:0/4013755596 >> 172.21.15.7:0/4013755596 conn(0x7fefb806bc70 msgr2=0x7fefb806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.974+0000 7fefbe200640 1 -- 172.21.15.7:0/4013755596 shutdown_connections 2024-08-19T00:43:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.975+0000 7fefbe200640 1 -- 172.21.15.7:0/4013755596 wait complete. 2024-08-19T00:43:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.976+0000 7fefbe200640 1 Processor -- start 2024-08-19T00:43:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.976+0000 7fefbe200640 1 -- start start 2024-08-19T00:43:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefbe200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefbe200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefb80d03c0 0x7fefb81515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefbe200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fefb815f5b0 0x7fefb80ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefbe200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefb80cedb0 con 0x7fefb80b4a90 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefbe200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefb80cf120 con 0x7fefb80d03c0 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefbe200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fefb806e660 con 0x7fefb815f5b0 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefb7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefb7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36536/0 (socket says 172.21.15.7:36536) 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefb7400640 1 -- 172.21.15.7:0/559277235 learned_addr learned my addr 172.21.15.7:0/559277235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefb7e00640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fefb815f5b0 0x7fefb80ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.977+0000 7fefafe00640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefb80d03c0 0x7fefb81515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefb7400640 1 -- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fefb815f5b0 msgr2=0x7fefb80ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefb7400640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fefb815f5b0 0x7fefb80ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefb7400640 1 -- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefb80d03c0 msgr2=0x7fefb81515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefb7400640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefb80d03c0 0x7fefb81515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefb7400640 1 -- 172.21.15.7:0/559277235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb80ad660 con 0x7fefb80b4a90 2024-08-19T00:43:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefafe00640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefb80d03c0 0x7fefb81515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefb7400640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80acff0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fefa800d7d0 tx=0x7fefa800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefaf400640 1 -- 172.21.15.7:0/559277235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8004030 con 0x7fefb80b4a90 2024-08-19T00:43:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefaf400640 1 -- 172.21.15.7:0/559277235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa80041d0 con 0x7fefb80b4a90 2024-08-19T00:43:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefaf400640 1 -- 172.21.15.7:0/559277235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa800b6c0 con 0x7fefb80b4a90 2024-08-19T00:43:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.978+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb80ad940 con 0x7fefb80b4a90 2024-08-19T00:43:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.979+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb80b09f0 con 0x7fefb80b4a90 2024-08-19T00:43:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.981+0000 7fefaf400640 1 -- 172.21.15.7:0/559277235 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefa800b860 con 0x7fefb80b4a90 2024-08-19T00:43:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.981+0000 7fefaf400640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef9406be60 0x7fef9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.982+0000 7fefaf400640 1 -- 172.21.15.7:0/559277235 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7fefa808b100 con 0x7fefb80b4a90 2024-08-19T00:43:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.982+0000 7fefafe00640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef9406be60 0x7fef9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.982+0000 7fefc11ef740 1 Processor -- start 2024-08-19T00:43:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.982+0000 7fefc11ef740 1 -- start start 2024-08-19T00:43:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.982+0000 7fefafe00640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef9406be60 0x7fef9406e320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fefb81f7e40 tx=0x7fefa0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f61141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164470 0x560f61164890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefc11ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560f61079ba0 con 0x560f61164dd0 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560f61012230 con 0x560f61164470 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560f61075b60 con 0x560f61140f50 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36546/0 (socket says 172.21.15.7:36546) 2024-08-19T00:43:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.983+0000 7fefb7e00640 1 -- 172.21.15.7:0/2900311034 learned_addr learned my addr 172.21.15.7:0/2900311034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefafe00640 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164470 0x560f61164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefb7400640 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f61141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefb7e00640 1 -- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 msgr2=0x560f61141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefb7e00640 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f61141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefb7e00640 1 -- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164470 msgr2=0x560f61164890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefb7e00640 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164470 0x560f61164890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefb7e00640 1 -- 172.21.15.7:0/2900311034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f61043bb0 con 0x560f61164dd0 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefafe00640 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164470 0x560f61164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefb7e00640 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61159df0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009f70 tx=0x7fefb002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481379b24ce893fb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefa7400640 1 -- 172.21.15.7:0/2900311034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0036040 con 0x560f61164dd0 2024-08-19T00:43:09.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefa7400640 1 -- 172.21.15.7:0/2900311034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0037040 con 0x560f61164dd0 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.984+0000 7fefa7400640 1 -- 172.21.15.7:0/2900311034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0031800 con 0x560f61164dd0 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 -- 172.21.15.7:0/2900311034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 msgr2=0x560f61159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61159df0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009f70 tx=0x7fefb002e000 comp rx=0 tx=0).stop 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 -- 172.21.15.7:0/2900311034 shutdown_connections 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61159df0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164470 0x560f61164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2900311034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f61141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 -- 172.21.15.7:0/2900311034 >> 172.21.15.7:0/2900311034 conn(0x560f610de110 msgr2=0x560f6115bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 -- 172.21.15.7:0/2900311034 shutdown_connections 2024-08-19T00:43:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.985+0000 7fefc11ef740 1 -- 172.21.15.7:0/2900311034 wait complete. 2024-08-19T00:43:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.986+0000 7fefc11ef740 1 -- start start 2024-08-19T00:43:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.986+0000 7fefc11ef740 1 Processor -- start 2024-08-19T00:43:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f611121f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164470 0x560f61157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164dd0 0x560f61110cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefc11ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560f6115dea0 con 0x560f61164470 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560f61035250 con 0x560f61164dd0 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560f6115d5b0 con 0x560f61140f50 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefc11ef740 10 client.0 _ll_register_callbacks cb 0x560f61039740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefafe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164470 0x560f61157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefafe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164470 0x560f61157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36548/0 (socket says 172.21.15.7:36548) 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefafe00640 1 -- 172.21.15.7:0/2479651102 learned_addr learned my addr 172.21.15.7:0/2479651102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefb7400640 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f611121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.987+0000 7fefb7e00640 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164dd0 0x560f61110cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fefafe00640 1 -- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 msgr2=0x560f611121f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fefafe00640 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f611121f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fefafe00640 1 -- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164dd0 msgr2=0x560f61110cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fefafe00640 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164dd0 0x560f61110cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fefafe00640 1 -- 172.21.15.7:0/2479651102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f60d8d2d0 con 0x560f61164470 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fefafe00640 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164470 0x560f61157ea0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e860 tx=0x7fefa0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dc427955b11fa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fef9be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fef9be00640 1 -- 172.21.15.7:0/2479651102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0027060 con 0x560f61164470 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fef9be00640 1 -- 172.21.15.7:0/2479651102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7fefa0010040 con 0x560f61164470 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.988+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb0037040 con 0x560f61164470 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fef9be00640 1 -- 172.21.15.7:0/2479651102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fefa0003b70 con 0x560f61164470 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 10 client.6630 fetch_fsmap learned FSMap version 76 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x560f60e576b0 con 0x560f61164470 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fef9be00640 1 -- 172.21.15.7:0/2479651102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0037040 con 0x560f61164470 2024-08-19T00:43:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fef9be00640 1 -- 172.21.15.7:0/2479651102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7fefa0022430 con 0x560f61164470 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 10 client.6630 fetch_fsmap finished waiting for FSMap version 76 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 10 client.6630 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 20 client.6630 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f61111210 0x560f61156390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 4 client.6630 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.989+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 --> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f610872d0 con 0x560f61111210 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.990+0000 7fefb7400640 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f61111210 0x560f61156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.990+0000 7fefb7400640 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f61111210 0x560f61156390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cbb9d254fa809a7 server_cookie=e7aa79d833a48034 in_seq=0 out_seq=0 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.990+0000 7fef9be00640 10 client.6630 ms_handle_connect on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fef9be00640 1 -- 172.21.15.7:0/2479651102 <== mds.0 v2:172.21.15.7:6834/3281733316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f610872d0 con 0x560f61111210 2024-08-19T00:43:09.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fef9be00640 10 client.6630 handle_command_reply: tid=0 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 client.6630 shutdown 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164470 msgr2=0x560f61157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164470 0x560f61157ea0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e860 tx=0x7fefa0000bc0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 shutdown_connections 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61164dd0 0x560f61110cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f61111210 0x560f61156390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164470 0x560f61157ea0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2479651102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61140f50 0x560f611121f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fef9be00640 0 client.6630 ms_handle_reset on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.991+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 >> 172.21.15.7:0/2479651102 conn(0x560f610de110 msgr2=0x560f6115bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.992+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 shutdown_connections 2024-08-19T00:43:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.992+0000 7fefc11ef740 1 -- 172.21.15.7:0/2479651102 wait complete. 2024-08-19T00:43:09.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:09.992+0000 7fefc11ef740 20 client.6630 trim_cache size 0 max 16384 2024-08-19T00:43:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 Processor -- start 2024-08-19T00:43:10.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 -- start start 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61111b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f611131e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f6115c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefb81ffa10 con 0x560f61164dd0 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefb8156100 con 0x560f61140f50 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.011+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fefb81ff3c0 con 0x560f61164470 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f6115c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f6115c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36550/0 (socket says 172.21.15.7:36550) 2024-08-19T00:43:10.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 -- 172.21.15.7:0/1221364037 learned_addr learned my addr 172.21.15.7:0/1221364037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefafe00640 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f611131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7400640 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61111b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 -- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 msgr2=0x560f611131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f611131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 -- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 msgr2=0x560f61111b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61111b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 -- 172.21.15.7:0/1221364037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f61164850 con 0x560f61164dd0 2024-08-19T00:43:10.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.012+0000 7fefb7e00640 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f6115c3e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009c90 tx=0x7fefb002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ef50b7fb7dedcf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefa6a00640 1 -- 172.21.15.7:0/1221364037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb004b070 con 0x560f61164dd0 2024-08-19T00:43:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefa6a00640 1 -- 172.21.15.7:0/1221364037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0031700 con 0x560f61164dd0 2024-08-19T00:43:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefa6a00640 1 -- 172.21.15.7:0/1221364037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0036040 con 0x560f61164dd0 2024-08-19T00:43:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 -- 172.21.15.7:0/1221364037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 msgr2=0x560f6115c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f6115c3e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009c90 tx=0x7fefb002f000 comp rx=0 tx=0).stop 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 -- 172.21.15.7:0/1221364037 shutdown_connections 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f6115c3e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f611131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 --2- 172.21.15.7:0/1221364037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61111b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 -- 172.21.15.7:0/1221364037 >> 172.21.15.7:0/1221364037 conn(0x560f610de110 msgr2=0x560f6117fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 -- 172.21.15.7:0/1221364037 shutdown_connections 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.013+0000 7fefc11ef740 1 -- 172.21.15.7:0/1221364037 wait complete. 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.014+0000 7fefc11ef740 1 -- start start 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.014+0000 7fefc11ef740 1 Processor -- start 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61141990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f61174340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefc11ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61174880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefc11ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560f611585c0 con 0x560f61164dd0 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560f61135750 con 0x560f61140f50 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefc11ef740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560f61111610 con 0x560f61164470 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefc11ef740 10 client.0 _ll_register_callbacks cb 0x7fefa0001440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61174880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61174880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36564/0 (socket says 172.21.15.7:36564) 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefb7e00640 1 -- 172.21.15.7:0/2445464751 learned_addr learned my addr 172.21.15.7:0/2445464751 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefafe00640 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f61174340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.015+0000 7fefb7400640 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fefb7e00640 1 -- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 msgr2=0x560f61174340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fefb7e00640 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f61174340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fefb7e00640 1 -- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 msgr2=0x560f61141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fefb7e00640 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fefb7e00640 1 -- 172.21.15.7:0/2445464751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f611176f0 con 0x560f61164dd0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fefb7e00640 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61174880 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fefb0049040 tx=0x7fefb0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f58b56b547cd228 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fef9be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.016+0000 7fef9be00640 1 -- 172.21.15.7:0/2445464751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0055020 con 0x560f61164dd0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb0031700 con 0x560f61164dd0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fef9be00640 1 -- 172.21.15.7:0/2445464751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7fefb0031bf0 con 0x560f61164dd0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fef9be00640 1 -- 172.21.15.7:0/2445464751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fefb005f050 con 0x560f61164dd0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 10 client.6636 fetch_fsmap learned FSMap version 76 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x560f6115ff30 con 0x560f61164dd0 2024-08-19T00:43:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fef9be00640 1 -- 172.21.15.7:0/2445464751 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0031700 con 0x560f61164dd0 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fef9be00640 1 -- 172.21.15.7:0/2445464751 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7fefb0062020 con 0x560f61164dd0 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 10 client.6636 fetch_fsmap finished waiting for FSMap version 76 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 10 client.6636 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 20 client.6636 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f6115cd60 0x560f6115d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 4 client.6636 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.017+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 --> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] -- command(tid 0: {"prefix": "status"}) -- 0x560f61081620 con 0x560f6115cd60 2024-08-19T00:43:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefb7400640 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f6115cd60 0x560f6115d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefb7400640 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f6115cd60 0x560f6115d140 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af2118ae8f6003 server_cookie=5c4e8b86e01f667 in_seq=0 out_seq=0 2024-08-19T00:43:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fef9be00640 10 client.6636 ms_handle_connect on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fef9be00640 1 -- 172.21.15.7:0/2445464751 <== mds.0 v2:172.21.15.7:6834/3281733316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560f61081620 con 0x560f6115cd60 2024-08-19T00:43:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fef9be00640 10 client.6636 handle_command_reply: tid=0 2024-08-19T00:43:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 client.6636 shutdown 2024-08-19T00:43:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 msgr2=0x560f61174880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61174880 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fefb0049040 tx=0x7fefb0004ab0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 shutdown_connections 2024-08-19T00:43:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x560f6115cd60 0x560f6115d140 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f61164dd0 0x560f61174880 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f61164470 0x560f61174340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 --2- 172.21.15.7:0/2445464751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f61140f50 0x560f61141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fef9be00640 0 client.6636 ms_handle_reset on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.018+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 >> 172.21.15.7:0/2445464751 conn(0x560f610de110 msgr2=0x560f61111a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 shutdown_connections 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefc11ef740 1 -- 172.21.15.7:0/2445464751 wait complete. 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefc11ef740 20 client.6636 trim_cache size 0 max 16384 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:43:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6351, 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.9145290389999996, 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 76, 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 42.829611968000002 2024-08-19T00:43:10.029 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:43:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef9406be60 msgr2=0x7fef9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef9406be60 0x7fef9406e320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fefb81f7e40 tx=0x7fefa0009040 comp rx=0 tx=0).stop 2024-08-19T00:43:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 msgr2=0x7fefb80acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80acff0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fefa800d7d0 tx=0x7fefa800dc90 comp rx=0 tx=0).stop 2024-08-19T00:43:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 shutdown_connections 2024-08-19T00:43:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef9406be60 0x7fef9406e320 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fefb815f5b0 0x7fefb80ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefb80d03c0 0x7fefb81515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 --2- 172.21.15.7:0/559277235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb80b4a90 0x7fefb80acff0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.019+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 >> 172.21.15.7:0/559277235 conn(0x7fefb806bc70 msgr2=0x7fefb8158090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.020+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 shutdown_connections 2024-08-19T00:43:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.020+0000 7fefbe200640 1 -- 172.21.15.7:0/559277235 wait complete. 2024-08-19T00:43:10.037 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat a/ && find a/') 2024-08-19T00:43:10.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: File: a/ 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 2ah/42d Inode: 1099511627776 Links: 4 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1333/ ubuntu) 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-19 00:42:46.052673113 +0000 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-19 00:42:51.801588221 +0000 2024-08-19T00:43:10.121 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-19 00:42:51.801588221 +0000 2024-08-19T00:43:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-19 00:42:46.052673113 +0000 2024-08-19T00:43:10.132 INFO:teuthology.orchestra.run.smithi007.stdout:a/ 2024-08-19T00:43:10.132 INFO:teuthology.orchestra.run.smithi007.stdout:a/z 2024-08-19T00:43:10.132 INFO:teuthology.orchestra.run.smithi007.stdout:a/z/d 2024-08-19T00:43:10.132 INFO:teuthology.orchestra.run.smithi007.stdout:a/c 2024-08-19T00:43:10.132 INFO:teuthology.orchestra.run.smithi007.stdout:a/c/d 2024-08-19T00:43:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:43:10.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2024-08-19T00:43:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.298+0000 7f2792c00640 1 Processor -- start 2024-08-19T00:43:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.298+0000 7f2792c00640 1 -- start start 2024-08-19T00:43:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.299+0000 7f2792c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d4af0 0x7f278c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.299+0000 7f2792c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278c0d50d0 con 0x7f278c0d12b0 2024-08-19T00:43:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.299+0000 7f2792c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278c0cef60 con 0x7f278c161900 2024-08-19T00:43:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.299+0000 7f2792c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f278c0ced30 con 0x7f278c0d4af0 2024-08-19T00:43:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.299+0000 7f2790e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f278c0d12b0 0x7f278c0b6fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54028/0 (socket says 172.21.15.7:54028) 2024-08-19T00:43:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.299+0000 7f2790e00640 1 -- 172.21.15.7:0/1846141118 learned_addr learned my addr 172.21.15.7:0/1846141118 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:10.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f2792200640 1 --2- 172.21.15.7:0/1846141118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d4af0 0x7f278c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082486263 0 0) 0x7f278c0d50d0 con 0x7f278c0d12b0 2024-08-19T00:43:10.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2774003520 con 0x7f278c0d12b0 2024-08-19T00:43:10.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438834239 0 0) 0x7f278c0cef60 con 0x7f278c161900 2024-08-19T00:43:10.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f278c0d50d0 con 0x7f278c161900 2024-08-19T00:43:10.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f2792200640 1 -- 172.21.15.7:0/1846141118 >> v1:172.21.15.162:6789/0 conn(0x7f278c161900 legacy=0x7f278c0d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f2792200640 1 -- 172.21.15.7:0/1846141118 >> v1:172.21.15.7:6789/0 conn(0x7f278c0d12b0 legacy=0x7f278c0b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 492588371 0 0) 0x7f2774003520 con 0x7f278c0d12b0 2024-08-19T00:43:10.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.300+0000 7f2792200640 1 -- 172.21.15.7:0/1846141118 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c0cf200 con 0x7f278c0d4af0 2024-08-19T00:43:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.301+0000 7f2792200640 1 --2- 172.21.15.7:0/1846141118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d4af0 0x7f278c0cfce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2784009dc0 tx=0x7f278402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80da5e67fd70d1c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778001670 con 0x7f278c0d4af0 2024-08-19T00:43:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2784007540 con 0x7f278c0d4af0 2024-08-19T00:43:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f278be00640 1 -- 172.21.15.7:0/1846141118 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27840078f0 con 0x7f278c0d4af0 2024-08-19T00:43:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f2792c00640 1 -- 172.21.15.7:0/1846141118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d4af0 msgr2=0x7f278c0cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f2792c00640 1 --2- 172.21.15.7:0/1846141118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d4af0 0x7f278c0cfce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2784009dc0 tx=0x7f278402a660 comp rx=0 tx=0).stop 2024-08-19T00:43:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f2792c00640 1 -- 172.21.15.7:0/1846141118 shutdown_connections 2024-08-19T00:43:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f2792c00640 1 --2- 172.21.15.7:0/1846141118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d4af0 0x7f278c0cfce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f2792c00640 1 -- 172.21.15.7:0/1846141118 >> 172.21.15.7:0/1846141118 conn(0x7f278c09d4d0 msgr2=0x7f278c0d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f2792c00640 1 -- 172.21.15.7:0/1846141118 shutdown_connections 2024-08-19T00:43:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.302+0000 7f2792c00640 1 -- 172.21.15.7:0/1846141118 wait complete. 2024-08-19T00:43:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.304+0000 7f2792c00640 1 Processor -- start 2024-08-19T00:43:10.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.304+0000 7f2792c00640 1 -- start start 2024-08-19T00:43:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d12b0 0x7f278c09f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f278c0d4af0 0x7f278c158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f278c161900 0x7f278c0b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f278c161ce0 con 0x7f278c161900 2024-08-19T00:43:10.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0cf850 con 0x7f278c0d4af0 2024-08-19T00:43:10.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f278c162a10 con 0x7f278c0d12b0 2024-08-19T00:43:10.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f278c161900 0x7f278c0b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f278c161900 0x7f278c0b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36568/0 (socket says 172.21.15.7:36568) 2024-08-19T00:43:10.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2792200640 1 -- 172.21.15.7:0/3758648131 learned_addr learned my addr 172.21.15.7:0/3758648131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2790e00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f278c0d4af0 0x7f278c158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.305+0000 7f2791800640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d12b0 0x7f278c09f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792200640 1 -- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d12b0 msgr2=0x7f278c09f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792200640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d12b0 0x7f278c09f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792200640 1 -- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f278c0d4af0 msgr2=0x7f278c158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792200640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f278c0d4af0 0x7f278c158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792200640 1 -- 172.21.15.7:0/3758648131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c0b1400 con 0x7f278c161900 2024-08-19T00:43:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2790e00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f278c0d4af0 0x7f278c158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2791800640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d12b0 0x7f278c09f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792200640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f278c161900 0x7f278c0b1970 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f278402ac50 tx=0x7f2784004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2789600640 1 -- 172.21.15.7:0/3758648131 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784040070 con 0x7f278c161900 2024-08-19T00:43:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2789600640 1 -- 172.21.15.7:0/3758648131 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2784031bc0 con 0x7f278c161900 2024-08-19T00:43:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2789600640 1 -- 172.21.15.7:0/3758648131 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784009450 con 0x7f278c161900 2024-08-19T00:43:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c0b16e0 con 0x7f278c161900 2024-08-19T00:43:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.306+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c09ecd0 con 0x7f278c161900 2024-08-19T00:43:10.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.308+0000 7f2789600640 1 -- 172.21.15.7:0/3758648131 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2784039040 con 0x7f278c161900 2024-08-19T00:43:10.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.310+0000 7f2789600640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f276c06be60 0x7f276c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.310+0000 7f2789600640 1 -- 172.21.15.7:0/3758648131 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f27840ac230 con 0x7f278c161900 2024-08-19T00:43:10.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.310+0000 7f2791800640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f276c06be60 0x7f276c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.310+0000 7f2797209740 1 Processor -- start 2024-08-19T00:43:10.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2797209740 1 -- start start 2024-08-19T00:43:10.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2791800640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f276c06be60 0x7f276c06e320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f27800011e0 tx=0x7f2780009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2797209740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e931b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8e46d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e4def0 0x5595a8e8fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2797209740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5595a8daede0 con 0x5595a8e92dd0 2024-08-19T00:43:10.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5595a8d470e0 con 0x5595a8e4def0 2024-08-19T00:43:10.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.311+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5595a8daada0 con 0x5595a8e49ee0 2024-08-19T00:43:10.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e931b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36582/0 (socket says 172.21.15.7:36582) 2024-08-19T00:43:10.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 -- 172.21.15.7:0/2204286843 learned_addr learned my addr 172.21.15.7:0/2204286843 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2792200640 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e4def0 0x5595a8e8fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2790e00640 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8e46d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 -- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 msgr2=0x5595a8e46d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8e46d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 -- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e4def0 msgr2=0x5595a8e8fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e4def0 0x5595a8e8fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 -- 172.21.15.7:0/2204286843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595a8b8c7d0 con 0x5595a8e92dd0 2024-08-19T00:43:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.312+0000 7f2791800640 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e931b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f278000d900 tx=0x7f2780010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a170ef6b7793a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f277e000640 1 -- 172.21.15.7:0/2204286843 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780024070 con 0x5595a8e92dd0 2024-08-19T00:43:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f277e000640 1 -- 172.21.15.7:0/2204286843 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2780014db0 con 0x5595a8e92dd0 2024-08-19T00:43:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f277e000640 1 -- 172.21.15.7:0/2204286843 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278001f600 con 0x5595a8e92dd0 2024-08-19T00:43:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f2797209740 1 -- 172.21.15.7:0/2204286843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 msgr2=0x5595a8e931b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f2797209740 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e931b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f278000d900 tx=0x7f2780010000 comp rx=0 tx=0).stop 2024-08-19T00:43:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f2797209740 1 -- 172.21.15.7:0/2204286843 shutdown_connections 2024-08-19T00:43:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f2797209740 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e4def0 0x5595a8e8fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f2797209740 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8e46d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f2797209740 1 --2- 172.21.15.7:0/2204286843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e931b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.313+0000 7f2797209740 1 -- 172.21.15.7:0/2204286843 >> 172.21.15.7:0/2204286843 conn(0x5595a8e12ff0 msgr2=0x5595a8e91430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.314+0000 7f2797209740 1 -- 172.21.15.7:0/2204286843 shutdown_connections 2024-08-19T00:43:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.314+0000 7f2797209740 1 -- 172.21.15.7:0/2204286843 wait complete. 2024-08-19T00:43:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.314+0000 7f2797209740 1 -- start start 2024-08-19T00:43:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.314+0000 7f2797209740 1 Processor -- start 2024-08-19T00:43:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.315+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e49ee0 0x5595a8e68340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.315+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e8af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.315+0000 7f2797209740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e8b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.315+0000 7f2797209740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5595a8e8f220 con 0x5595a8e92dd0 2024-08-19T00:43:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.315+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5595a8d6a180 con 0x5595a8e49ee0 2024-08-19T00:43:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.315+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5595a8e74230 con 0x5595a8e4def0 2024-08-19T00:43:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.315+0000 7f2797209740 10 client.0 _ll_register_callbacks cb 0x5595a8d564b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e8b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2790e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e8af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2791800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e49ee0 0x5595a8e68340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e8b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36596/0 (socket says 172.21.15.7:36596) 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 -- 172.21.15.7:0/3563178745 learned_addr learned my addr 172.21.15.7:0/3563178745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 -- 172.21.15.7:0/3563178745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 msgr2=0x5595a8e8af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e8af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 -- 172.21.15.7:0/3563178745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e49ee0 msgr2=0x5595a8e68340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e49ee0 0x5595a8e68340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 -- 172.21.15.7:0/3563178745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595a8ac23f0 con 0x5595a8e92dd0 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2792200640 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e8b450 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f27840aa6c0 tx=0x7f2784007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470d0c7db72b2441 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2772a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.316+0000 7f2772a00640 1 -- 172.21.15.7:0/3563178745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784092070 con 0x5595a8e92dd0 2024-08-19T00:43:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2772a00640 1 -- 172.21.15.7:0/3563178745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f2784092410 con 0x5595a8e92dd0 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2780014db0 con 0x5595a8e92dd0 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2772a00640 1 -- 172.21.15.7:0/3563178745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f278407a440 con 0x5595a8e92dd0 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 10 client.6648 fetch_fsmap learned FSMap version 76 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5595a8a820f0 con 0x5595a8e92dd0 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2772a00640 1 -- 172.21.15.7:0/3563178745 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2780014db0 con 0x5595a8e92dd0 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2772a00640 1 -- 172.21.15.7:0/3563178745 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f27840aa200 con 0x5595a8e92dd0 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 10 client.6648 fetch_fsmap finished waiting for FSMap version 76 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 10 client.6648 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 20 client.6648 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8e94ea0 0x5595a8ea4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 4 client.6648 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 --> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595a8dbc510 con 0x5595a8e94ea0 2024-08-19T00:43:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.317+0000 7f2791800640 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8e94ea0 0x5595a8ea4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.318+0000 7f2791800640 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8e94ea0 0x5595a8ea4870 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51ac3b50be24f2ca server_cookie=f0e086a385d05efa in_seq=0 out_seq=0 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.318+0000 7f2772a00640 10 client.6648 ms_handle_connect on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2772a00640 1 -- 172.21.15.7:0/3563178745 <== mds.0 v2:172.21.15.7:6834/3281733316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595a8dbc510 con 0x5595a8e94ea0 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2772a00640 10 client.6648 handle_command_reply: tid=0 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 client.6648 shutdown 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 msgr2=0x5595a8e8b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e8b450 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f27840aa6c0 tx=0x7f2784007f30 comp rx=0 tx=0).stop 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 shutdown_connections 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8e94ea0 0x5595a8ea4870 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e92dd0 0x5595a8e8b450 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e8af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 --2- 172.21.15.7:0/3563178745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e49ee0 0x5595a8e68340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2772a00640 0 client.6648 ms_handle_reset on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 >> 172.21.15.7:0/3563178745 conn(0x5595a8e12ff0 msgr2=0x5595a8e91c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 shutdown_connections 2024-08-19T00:43:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 1 -- 172.21.15.7:0/3563178745 wait complete. 2024-08-19T00:43:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.319+0000 7f2797209740 20 client.6648 trim_cache size 0 max 16384 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.335+0000 7f2797209740 1 Processor -- start 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.335+0000 7f2797209740 1 -- start start 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8eb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2797209740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e4def0 0x5595a8ea3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8ea3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2797209740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f278c2007f0 con 0x5595a8e4def0 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0b4b50 con 0x5595a8e92dd0 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f278c0a0d00 con 0x5595a8e49ee0 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2790e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e4def0 0x5595a8ea3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2790e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e4def0 0x5595a8ea3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36600/0 (socket says 172.21.15.7:36600) 2024-08-19T00:43:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2790e00640 1 -- 172.21.15.7:0/2979425637 learned_addr learned my addr 172.21.15.7:0/2979425637 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2791800640 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8eb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.336+0000 7f2792200640 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8ea3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f2790e00640 1 -- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 msgr2=0x5595a8eb4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f2790e00640 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8eb4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f2790e00640 1 -- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 msgr2=0x5595a8ea3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f2790e00640 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8ea3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f2790e00640 1 -- 172.21.15.7:0/2979425637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595a8e414a0 con 0x5595a8e4def0 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f2790e00640 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e4def0 0x5595a8ea3a80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f27780011e0 tx=0x7f2778007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb95c127db2521c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f277d600640 1 -- 172.21.15.7:0/2979425637 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778019020 con 0x5595a8e4def0 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f277d600640 1 -- 172.21.15.7:0/2979425637 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778012b40 con 0x5595a8e4def0 2024-08-19T00:43:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.337+0000 7f277d600640 1 -- 172.21.15.7:0/2979425637 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27780058d0 con 0x5595a8e4def0 2024-08-19T00:43:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 -- 172.21.15.7:0/2979425637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e4def0 msgr2=0x5595a8ea3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e4def0 0x5595a8ea3a80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f27780011e0 tx=0x7f2778007dd0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 -- 172.21.15.7:0/2979425637 shutdown_connections 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8ea3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e4def0 0x5595a8ea3a80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 --2- 172.21.15.7:0/2979425637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e49ee0 0x5595a8eb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 -- 172.21.15.7:0/2979425637 >> 172.21.15.7:0/2979425637 conn(0x5595a8e12ff0 msgr2=0x5595a8e8af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 -- 172.21.15.7:0/2979425637 shutdown_connections 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.338+0000 7f2797209740 1 -- 172.21.15.7:0/2979425637 wait complete. 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.339+0000 7f2797209740 1 -- start start 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.339+0000 7f2797209740 1 Processor -- start 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2797209740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e49ee0 0x5595a8f0e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e91980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2797209740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8e91ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2797209740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0b4500 con 0x5595a8e49ee0 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5595a8e42ad0 con 0x5595a8e92dd0 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2797209740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5595a8eb5320 con 0x5595a8e4def0 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2797209740 10 client.0 _ll_register_callbacks cb 0x7f2784079da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e49ee0 0x5595a8f0e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e49ee0 0x5595a8f0e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36606/0 (socket says 172.21.15.7:36606) 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 -- 172.21.15.7:0/192991279 learned_addr learned my addr 172.21.15.7:0/192991279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2792200640 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8e91ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2790e00640 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e91980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 -- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 msgr2=0x5595a8e91980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e91980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 -- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 msgr2=0x5595a8e91ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8e91ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.340+0000 7f2791800640 1 -- 172.21.15.7:0/192991279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595a8e906c0 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2791800640 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e49ee0 0x5595a8f0e6d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2780009010 tx=0x7f2780000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a9a3b649d0be8f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2772a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2772a00640 1 -- 172.21.15.7:0/192991279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780024040 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2772a00640 1 -- 172.21.15.7:0/192991279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f27800052b0 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2778012b40 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2772a00640 1 -- 172.21.15.7:0/192991279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f278003b050 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2797209740 10 client.6654 fetch_fsmap learned FSMap version 76 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.341+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5595a8e8aba0 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2772a00640 1 -- 172.21.15.7:0/192991279 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778012b40 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2772a00640 1 -- 172.21.15.7:0/192991279 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f278003e020 con 0x5595a8e49ee0 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2797209740 10 client.6654 fetch_fsmap finished waiting for FSMap version 76 2024-08-19T00:43:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2797209740 10 client.6654 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-08-19T00:43:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2797209740 20 client.6654 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2797209740 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8ea4800 0x5595a8eb3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2797209740 4 client.6654 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:43:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 --> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595a8db6860 con 0x5595a8ea4800 2024-08-19T00:43:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2790e00640 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8ea4800 0x5595a8eb3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2790e00640 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8ea4800 0x5595a8eb3fe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5dd6a969f8f3edd server_cookie=a19cbc82ebc7f82f in_seq=0 out_seq=0 2024-08-19T00:43:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.342+0000 7f2772a00640 10 client.6654 ms_handle_connect on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:10.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2772a00640 1 -- 172.21.15.7:0/192991279 <== mds.0 v2:172.21.15.7:6834/3281733316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595a8db6860 con 0x5595a8ea4800 2024-08-19T00:43:10.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2772a00640 10 client.6654 handle_command_reply: tid=0 2024-08-19T00:43:10.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 client.6654 shutdown 2024-08-19T00:43:10.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e49ee0 msgr2=0x5595a8f0e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e49ee0 0x5595a8f0e6d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2780009010 tx=0x7f2780000ed0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 shutdown_connections 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595a8e92dd0 0x5595a8e91ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5595a8e4def0 0x5595a8e91980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:6834/3281733316,v1:172.21.15.7:6836/3281733316] conn(0x5595a8ea4800 0x5595a8eb3fe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 --2- 172.21.15.7:0/192991279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5595a8e49ee0 0x5595a8f0e6d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2772a00640 0 client.6654 ms_handle_reset on v2:172.21.15.7:6834/3281733316 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.354+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 >> 172.21.15.7:0/192991279 conn(0x5595a8e12ff0 msgr2=0x5595a8ea3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.355+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 shutdown_connections 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.355+0000 7f2797209740 1 -- 172.21.15.7:0/192991279 wait complete. 2024-08-19T00:43:10.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.355+0000 7f2797209740 20 client.6654 trim_cache size 0 max 16384 2024-08-19T00:43:10.358 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:43:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-08-19T00:43:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-08-19T00:43:10.358 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.355+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f276c06be60 msgr2=0x7f276c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.355+0000 7f2792c00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f276c06be60 0x7f276c06e320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f27800011e0 tx=0x7f2780009040 comp rx=0 tx=0).stop 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.355+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f278c161900 msgr2=0x7f278c0b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.355+0000 7f2792c00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f278c161900 0x7f278c0b1970 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f278402ac50 tx=0x7f2784004a40 comp rx=0 tx=0).stop 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 shutdown_connections 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f276c06be60 0x7f276c06e320 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f278c161900 0x7f278c0b1970 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f278c0d4af0 0x7f278c158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 --2- 172.21.15.7:0/3758648131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f278c0d12b0 0x7f278c09f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 >> 172.21.15.7:0/3758648131 conn(0x7f278c09d4d0 msgr2=0x7f278c0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 shutdown_connections 2024-08-19T00:43:10.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.356+0000 7f2792c00640 1 -- 172.21.15.7:0/3758648131 wait complete. 2024-08-19T00:43:10.373 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:43:10.373 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:43:10.453 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:43:10.540 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:43:10.541 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:43:10.541 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:10.541 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:10.577 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:10.577 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:10.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:43:10.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.849+0000 7f4a57200640 1 Processor -- start 2024-08-19T00:43:10.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.849+0000 7f4a57200640 1 -- start start 2024-08-19T00:43:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.850+0000 7f4a57200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a5815e050 0x7f4a580b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.850+0000 7f4a57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.850+0000 7f4a57200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a580cf830 con 0x7f4a580cf220 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.850+0000 7f4a57200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5815e8a0 con 0x7f4a5815e050 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.850+0000 7f4a57200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a580d00d0 con 0x7f4a5815e430 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a5815e050 0x7f4a580b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a5815e050 0x7f4a580b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36614/0 (socket says 172.21.15.7:36614) 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55e00640 1 -- 172.21.15.7:0/197667117 learned_addr learned my addr 172.21.15.7:0/197667117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55400640 1 --2- 172.21.15.7:0/197667117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55e00640 1 -- 172.21.15.7:0/197667117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 msgr2=0x7f4a580cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55e00640 1 --2- 172.21.15.7:0/197667117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55e00640 1 -- 172.21.15.7:0/197667117 >> v1:172.21.15.162:6789/0 conn(0x7f4a580cf220 legacy=0x7f4a580d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.851+0000 7f4a55e00640 1 -- 172.21.15.7:0/197667117 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a580cfb10 con 0x7f4a5815e050 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.852+0000 7f4a55e00640 1 --2- 172.21.15.7:0/197667117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a5815e050 0x7f4a580b0e00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009870 tx=0x7f4a4802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738b4073283d3901 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.852+0000 7f4a54a00640 1 -- 172.21.15.7:0/197667117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48037070 con 0x7f4a5815e050 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.852+0000 7f4a54a00640 1 -- 172.21.15.7:0/197667117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a48032440 con 0x7f4a5815e050 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.852+0000 7f4a54a00640 1 -- 172.21.15.7:0/197667117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48032810 con 0x7f4a5815e050 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 -- 172.21.15.7:0/197667117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a5815e050 msgr2=0x7f4a580b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 --2- 172.21.15.7:0/197667117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a5815e050 0x7f4a580b0e00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009870 tx=0x7f4a4802a130 comp rx=0 tx=0).stop 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 -- 172.21.15.7:0/197667117 shutdown_connections 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 --2- 172.21.15.7:0/197667117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 --2- 172.21.15.7:0/197667117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a5815e050 0x7f4a580b0e00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 -- 172.21.15.7:0/197667117 >> 172.21.15.7:0/197667117 conn(0x7f4a5809d510 msgr2=0x7f4a580d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 -- 172.21.15.7:0/197667117 shutdown_connections 2024-08-19T00:43:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.853+0000 7f4a57200640 1 -- 172.21.15.7:0/197667117 wait complete. 2024-08-19T00:43:10.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.855+0000 7f4a57200640 1 Processor -- start 2024-08-19T00:43:10.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.855+0000 7f4a57200640 1 -- start start 2024-08-19T00:43:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a57200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a580cf220 0x7f4a58154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a57200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5815e050 0x7f4a580b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a57200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580d4bf0 con 0x7f4a580cf220 2024-08-19T00:43:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a57200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580d4a70 con 0x7f4a5815e050 2024-08-19T00:43:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a57200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a580d1120 con 0x7f4a5815e430 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a580cf220 0x7f4a58154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a580cf220 0x7f4a58154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36626/0 (socket says 172.21.15.7:36626) 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 -- 172.21.15.7:0/2302306719 learned_addr learned my addr 172.21.15.7:0/2302306719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55400640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5815e050 0x7f4a580b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a56800640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 -- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 msgr2=0x7f4a580b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 -- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5815e050 msgr2=0x7f4a580b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5815e050 0x7f4a580b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55e00640 1 -- 172.21.15.7:0/2302306719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a581617b0 con 0x7f4a580cf220 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a55400640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5815e050 0x7f4a580b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.856+0000 7f4a56800640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.857+0000 7f4a55e00640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a580cf220 0x7f4a58154cc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4a48000c00 tx=0x7f4a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.857+0000 7f4a4e000640 1 -- 172.21.15.7:0/2302306719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48037040 con 0x7f4a580cf220 2024-08-19T00:43:10.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.857+0000 7f4a4e000640 1 -- 172.21.15.7:0/2302306719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a48042070 con 0x7f4a580cf220 2024-08-19T00:43:10.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.857+0000 7f4a4e000640 1 -- 172.21.15.7:0/2302306719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48030880 con 0x7f4a580cf220 2024-08-19T00:43:10.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.857+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a580b8f10 con 0x7f4a580cf220 2024-08-19T00:43:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.857+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a581614d0 con 0x7f4a580cf220 2024-08-19T00:43:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.858+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a580cece0 con 0x7f4a580cf220 2024-08-19T00:43:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.859+0000 7f4a4e000640 1 -- 172.21.15.7:0/2302306719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a48030a20 con 0x7f4a580cf220 2024-08-19T00:43:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.860+0000 7f4a4e000640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a3806be30 0x7f4a3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.860+0000 7f4a4e000640 1 -- 172.21.15.7:0/2302306719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f4a480ab7c0 con 0x7f4a580cf220 2024-08-19T00:43:10.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.860+0000 7f4a55400640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a3806be30 0x7f4a3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:10.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.861+0000 7f4a55400640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a3806be30 0x7f4a3806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4a580b5170 tx=0x7f4a44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:10.864+0000 7f4a4e000640 1 -- 172.21.15.7:0/2302306719 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4a4807a0d0 con 0x7f4a580cf220 2024-08-19T00:43:11.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.062+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a580b4b00 con 0x7f4a580cf220 2024-08-19T00:43:11.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.062+0000 7f4a4e000640 1 -- 172.21.15.7:0/2302306719 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v75) ==== 80+0+120 (secure 0 0 0) 0x7f4a480799d0 con 0x7f4a580cf220 2024-08-19T00:43:11.064 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2626740684 2024-08-20T00:43:05.101401+0000 2024-08-19T00:43:11.064 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2626740684 2024-08-20T00:43:05.101401+0000 2024-08-19T00:43:11.064 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-08-19T00:43:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a3806be30 msgr2=0x7f4a3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a3806be30 0x7f4a3806e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4a580b5170 tx=0x7f4a44008040 comp rx=0 tx=0).stop 2024-08-19T00:43:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a580cf220 msgr2=0x7f4a58154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a580cf220 0x7f4a58154cc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4a48000c00 tx=0x7f4a480046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 shutdown_connections 2024-08-19T00:43:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a3806be30 0x7f4a3806e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5815e430 0x7f4a580b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5815e050 0x7f4a580b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 --2- 172.21.15.7:0/2302306719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a580cf220 0x7f4a58154cc0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 >> 172.21.15.7:0/2302306719 conn(0x7f4a5809d510 msgr2=0x7f4a580b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 shutdown_connections 2024-08-19T00:43:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.064+0000 7f4a57200640 1 -- 172.21.15.7:0/2302306719 wait complete. 2024-08-19T00:43:11.081 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:43:11.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:11.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:11.144 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:43:11.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:11.145 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:43:11.181 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:43:11.181 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:43:11.181 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:11.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:43:11.221 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:43:11.221 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:11.222 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:11.257 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:43:11.257 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:43:11.257 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:43:11.257 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:11.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:43:11.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.453+0000 7f282a800640 1 Processor -- start 2024-08-19T00:43:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.454+0000 7f282a800640 1 -- start start 2024-08-19T00:43:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f282a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f282415f5b0 0x7f28240cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f282a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240b4a90 0x7f28240d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f282a800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28240cfaf0 con 0x7f28240d03c0 2024-08-19T00:43:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f282a800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f28240d0d60 con 0x7f282415f5b0 2024-08-19T00:43:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f282a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f282415f990 con 0x7f28240b4a90 2024-08-19T00:43:11.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f281be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f28240d03c0 0x7f28240b4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54032/0 (socket says 172.21.15.7:54032) 2024-08-19T00:43:11.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f2823400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f282415f5b0 0x7f28240cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f281be00640 1 -- 172.21.15.7:0/1330648682 learned_addr learned my addr 172.21.15.7:0/1330648682 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:11.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f2823e00640 1 --2- 172.21.15.7:0/1330648682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240b4a90 0x7f28240d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f2823400640 1 -- 172.21.15.7:0/1330648682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240b4a90 msgr2=0x7f28240d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f2823400640 1 --2- 172.21.15.7:0/1330648682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240b4a90 0x7f28240d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f2823400640 1 -- 172.21.15.7:0/1330648682 >> v1:172.21.15.7:6789/0 conn(0x7f28240d03c0 legacy=0x7f28240b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.455+0000 7f2823400640 1 -- 172.21.15.7:0/1330648682 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28240b50b0 con 0x7f282415f5b0 2024-08-19T00:43:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.456+0000 7f2823400640 1 --2- 172.21.15.7:0/1330648682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282415f5b0 0x7f28240cf5b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f28140097a0 tx=0x7f281402a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a2e926b269c7f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f2822a00640 1 -- 172.21.15.7:0/1330648682 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814037070 con 0x7f282415f5b0 2024-08-19T00:43:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f2822a00640 1 -- 172.21.15.7:0/1330648682 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281402ae40 con 0x7f282415f5b0 2024-08-19T00:43:11.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f2822a00640 1 -- 172.21.15.7:0/1330648682 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814032660 con 0x7f282415f5b0 2024-08-19T00:43:11.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f282a800640 1 -- 172.21.15.7:0/1330648682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282415f5b0 msgr2=0x7f28240cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f282a800640 1 --2- 172.21.15.7:0/1330648682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282415f5b0 0x7f28240cf5b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f28140097a0 tx=0x7f281402a0f0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f282a800640 1 -- 172.21.15.7:0/1330648682 shutdown_connections 2024-08-19T00:43:11.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f282a800640 1 --2- 172.21.15.7:0/1330648682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240b4a90 0x7f28240d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f282a800640 1 --2- 172.21.15.7:0/1330648682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282415f5b0 0x7f28240cf5b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f282a800640 1 -- 172.21.15.7:0/1330648682 >> 172.21.15.7:0/1330648682 conn(0x7f282406bc70 msgr2=0x7f282406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:11.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.457+0000 7f282a800640 1 -- 172.21.15.7:0/1330648682 shutdown_connections 2024-08-19T00:43:11.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.458+0000 7f282a800640 1 -- 172.21.15.7:0/1330648682 wait complete. 2024-08-19T00:43:11.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.459+0000 7f282a800640 1 Processor -- start 2024-08-19T00:43:11.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.459+0000 7f282a800640 1 -- start start 2024-08-19T00:43:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f282a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28240b4a90 0x7f2824150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f282a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240d03c0 0x7f282409d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f282a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282415f5b0 0x7f282409dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f282a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f28240cedb0 con 0x7f28240b4a90 2024-08-19T00:43:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f282a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28240cf120 con 0x7f282415f5b0 2024-08-19T00:43:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f282a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f282406e660 con 0x7f28240d03c0 2024-08-19T00:43:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f2823400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28240b4a90 0x7f2824150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f2823400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28240b4a90 0x7f2824150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36640/0 (socket says 172.21.15.7:36640) 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.460+0000 7f2823400640 1 -- 172.21.15.7:0/3869269589 learned_addr learned my addr 172.21.15.7:0/3869269589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f2823e00640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282415f5b0 0x7f282409dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f281be00640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240d03c0 0x7f282409d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f2823400640 1 -- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240d03c0 msgr2=0x7f282409d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f2823400640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240d03c0 0x7f282409d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f2823400640 1 -- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282415f5b0 msgr2=0x7f282409dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f2823400640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282415f5b0 0x7f282409dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f2823400640 1 -- 172.21.15.7:0/3869269589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2824072510 con 0x7f28240b4a90 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f2823400640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28240b4a90 0x7f2824150310 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2814035040 tx=0x7f28140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f281b400640 1 -- 172.21.15.7:0/3869269589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814041070 con 0x7f28240b4a90 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f281b400640 1 -- 172.21.15.7:0/3869269589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281403c460 con 0x7f28240b4a90 2024-08-19T00:43:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f281b400640 1 -- 172.21.15.7:0/3869269589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814037040 con 0x7f28240b4a90 2024-08-19T00:43:11.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.461+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28240727f0 con 0x7f28240b4a90 2024-08-19T00:43:11.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.462+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2824072db0 con 0x7f28240b4a90 2024-08-19T00:43:11.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.463+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28240d0820 con 0x7f28240b4a90 2024-08-19T00:43:11.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.463+0000 7f281b400640 1 -- 172.21.15.7:0/3869269589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f281403a070 con 0x7f28240b4a90 2024-08-19T00:43:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.464+0000 7f281b400640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f280006be60 0x7f280006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.464+0000 7f281b400640 1 -- 172.21.15.7:0/3869269589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f28140ab170 con 0x7f28240b4a90 2024-08-19T00:43:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.465+0000 7f281be00640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f280006be60 0x7f280006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.465+0000 7f281be00640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f280006be60 0x7f280006e320 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f28241618f0 tx=0x7f280c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:11.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.469+0000 7f281b400640 1 -- 172.21.15.7:0/3869269589 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f28140793a0 con 0x7f28240b4a90 2024-08-19T00:43:11.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-08-19T00:43:11.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.687+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28240b1a80 con 0x7f28240b4a90 2024-08-19T00:43:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.687+0000 7f281b400640 1 -- 172.21.15.7:0/3869269589 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5221 (secure 0 0 0) 0x7f281407d6a0 con 0x7f28240b4a90 2024-08-19T00:43:11.689 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"btime":"2024-08-19T00:43:08:115906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":5774,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1074731607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1074731607},{"type":"v1","addr":"172.21.15.7:6837","nonce":1074731607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:08.115898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":13,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":5}]} 2024-08-19T00:43:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 76 2024-08-19T00:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f280006be60 msgr2=0x7f280006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f280006be60 0x7f280006e320 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f28241618f0 tx=0x7f280c007e80 comp rx=0 tx=0).stop 2024-08-19T00:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28240b4a90 msgr2=0x7f2824150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28240b4a90 0x7f2824150310 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2814035040 tx=0x7f28140046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 shutdown_connections 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f280006be60 0x7f280006e320 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282415f5b0 0x7f282409dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240d03c0 0x7f282409d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 --2- 172.21.15.7:0/3869269589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28240b4a90 0x7f2824150310 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 >> 172.21.15.7:0/3869269589 conn(0x7f282406bc70 msgr2=0x7f28241511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.689+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 shutdown_connections 2024-08-19T00:43:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.690+0000 7f282a800640 1 -- 172.21.15.7:0/3869269589 wait complete. 2024-08-19T00:43:11.707 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.864+0000 7fc2e7c00640 1 Processor -- start 2024-08-19T00:43:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.864+0000 7fc2e7c00640 1 -- start start 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.865+0000 7fc2e7c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc2e009aa70 0x7fc2e009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.865+0000 7fc2e7c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2e00d0290 0x7fc2e00d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.865+0000 7fc2e7c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e009b390 con 0x7fc2e009b730 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.865+0000 7fc2e7c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e015ec30 con 0x7fc2e00d0290 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.865+0000 7fc2e7c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e015ef10 con 0x7fc2e009aa70 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.865+0000 7fc2e5c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2e00d0290 0x7fc2e00d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2e00d0290 0x7fc2e00d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36652/0 (socket says 172.21.15.7:36652) 2024-08-19T00:43:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5c00640 1 -- 172.21.15.7:0/4211806287 learned_addr learned my addr 172.21.15.7:0/4211806287 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5200640 1 --2- 172.21.15.7:0/4211806287 >> v2:172.21.15.162:3300/0 conn(0x7fc2e009aa70 0x7fc2e009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5c00640 1 -- 172.21.15.7:0/4211806287 >> v2:172.21.15.162:3300/0 conn(0x7fc2e009aa70 msgr2=0x7fc2e009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5c00640 1 --2- 172.21.15.7:0/4211806287 >> v2:172.21.15.162:3300/0 conn(0x7fc2e009aa70 0x7fc2e009ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5c00640 1 -- 172.21.15.7:0/4211806287 >> v1:172.21.15.162:6789/0 conn(0x7fc2e009b730 legacy=0x7fc2e006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5c00640 1 -- 172.21.15.7:0/4211806287 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e015f1f0 con 0x7fc2e00d0290 2024-08-19T00:43:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.866+0000 7fc2e5200640 1 --2- 172.21.15.7:0/4211806287 >> v2:172.21.15.162:3300/0 conn(0x7fc2e009aa70 0x7fc2e009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.867+0000 7fc2e5c00640 1 --2- 172.21.15.7:0/4211806287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e00d0290 0x7fc2e00d0720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0072ff0 tx=0x7fc2d802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbcda03d2286678 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.867+0000 7fc2df400640 1 -- 172.21.15.7:0/4211806287 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8036070 con 0x7fc2e00d0290 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.867+0000 7fc2df400640 1 -- 172.21.15.7:0/4211806287 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d8031600 con 0x7fc2e00d0290 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.867+0000 7fc2df400640 1 -- 172.21.15.7:0/4211806287 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80319d0 con 0x7fc2e00d0290 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 -- 172.21.15.7:0/4211806287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e00d0290 msgr2=0x7fc2e00d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/4211806287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e00d0290 0x7fc2e00d0720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0072ff0 tx=0x7fc2d802a6f0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 -- 172.21.15.7:0/4211806287 shutdown_connections 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/4211806287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e00d0290 0x7fc2e00d0720 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/4211806287 >> v2:172.21.15.162:3300/0 conn(0x7fc2e009aa70 0x7fc2e009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 -- 172.21.15.7:0/4211806287 >> 172.21.15.7:0/4211806287 conn(0x7fc2e00d2190 msgr2=0x7fc2e00d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 -- 172.21.15.7:0/4211806287 shutdown_connections 2024-08-19T00:43:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.868+0000 7fc2e7c00640 1 -- 172.21.15.7:0/4211806287 wait complete. 2024-08-19T00:43:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.870+0000 7fc2e7c00640 1 Processor -- start 2024-08-19T00:43:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.870+0000 7fc2e7c00640 1 -- start start 2024-08-19T00:43:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e7c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e009aa70 0x7fc2e00cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e7c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e009b730 0x7fc2e0152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e7c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e00d0290 0x7fc2e015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e7c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00d0c60 con 0x7fc2e009aa70 2024-08-19T00:43:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e7c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e015e8f0 con 0x7fc2e009b730 2024-08-19T00:43:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e7c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e00d0de0 con 0x7fc2e00d0290 2024-08-19T00:43:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e009aa70 0x7fc2e00cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e009aa70 0x7fc2e00cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36666/0 (socket says 172.21.15.7:36666) 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 -- 172.21.15.7:0/477738519 learned_addr learned my addr 172.21.15.7:0/477738519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5c00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e00d0290 0x7fc2e015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2dfe00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e009b730 0x7fc2e0152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 -- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e00d0290 msgr2=0x7fc2e015fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e00d0290 0x7fc2e015fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 -- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e009b730 msgr2=0x7fc2e0152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e009b730 0x7fc2e0152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2e5200640 1 -- 172.21.15.7:0/477738519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e00cc160 con 0x7fc2e009aa70 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.871+0000 7fc2dfe00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e009b730 0x7fc2e0152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.872+0000 7fc2e5200640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e009aa70 0x7fc2e00cbc20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400c7f0 tx=0x7fc2d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.872+0000 7fc2dcc00640 1 -- 172.21.15.7:0/477738519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4015070 con 0x7fc2e009aa70 2024-08-19T00:43:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.872+0000 7fc2dcc00640 1 -- 172.21.15.7:0/477738519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d4007a30 con 0x7fc2e009aa70 2024-08-19T00:43:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.872+0000 7fc2dcc00640 1 -- 172.21.15.7:0/477738519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4007e00 con 0x7fc2e009aa70 2024-08-19T00:43:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.872+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e00caa20 con 0x7fc2e009aa70 2024-08-19T00:43:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.872+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e00cafe0 con 0x7fc2e009aa70 2024-08-19T00:43:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.873+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e009ae50 con 0x7fc2e009aa70 2024-08-19T00:43:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.874+0000 7fc2dcc00640 1 -- 172.21.15.7:0/477738519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2d4018070 con 0x7fc2e009aa70 2024-08-19T00:43:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.875+0000 7fc2dcc00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2c006be30 0x7fc2c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.875+0000 7fc2dcc00640 1 -- 172.21.15.7:0/477738519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7fc2d408ae10 con 0x7fc2e009aa70 2024-08-19T00:43:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.875+0000 7fc2dfe00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2c006be30 0x7fc2c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.876+0000 7fc2dfe00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2c006be30 0x7fc2c006e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00c99e0 tx=0x7fc2cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:11.879+0000 7fc2dcc00640 1 -- 172.21.15.7:0/477738519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc2d408e030 con 0x7fc2e009aa70 2024-08-19T00:43:12.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.105+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2e00d0a20 con 0x7fc2e009aa70 2024-08-19T00:43:12.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.106+0000 7fc2dcc00640 1 -- 172.21.15.7:0/477738519 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5221 (secure 0 0 0) 0x7fc2d40590d0 con 0x7fc2e009aa70 2024-08-19T00:43:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:12.108 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"btime":"2024-08-19T00:43:08:115906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":5774,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1074731607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1074731607},{"type":"v1","addr":"172.21.15.7:6837","nonce":1074731607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:08.115898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":13,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":5}]} 2024-08-19T00:43:12.108 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 76 2024-08-19T00:43:12.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2c006be30 msgr2=0x7fc2c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2c006be30 0x7fc2c006e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00c99e0 tx=0x7fc2cc009040 comp rx=0 tx=0).stop 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e009aa70 msgr2=0x7fc2e00cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e009aa70 0x7fc2e00cbc20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400c7f0 tx=0x7fc2d400cbf0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 shutdown_connections 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2c006be30 0x7fc2c006e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e00d0290 0x7fc2e015fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e009b730 0x7fc2e0152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 --2- 172.21.15.7:0/477738519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e009aa70 0x7fc2e00cbc20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 >> 172.21.15.7:0/477738519 conn(0x7fc2e00d2190 msgr2=0x7fc2e006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 shutdown_connections 2024-08-19T00:43:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.109+0000 7fc2e7c00640 1 -- 172.21.15.7:0/477738519 wait complete. 2024-08-19T00:43:12.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:43:12.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.282+0000 7fa46f000640 1 Processor -- start 2024-08-19T00:43:12.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.282+0000 7fa46f000640 1 -- start start 2024-08-19T00:43:12.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.283+0000 7fa46f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 0x7fa46815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.283+0000 7fa46f000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4680b3ab0 con 0x7fa46815e740 2024-08-19T00:43:12.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.283+0000 7fa46f000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46815f460 con 0x7fa46815e360 2024-08-19T00:43:12.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.283+0000 7fa46f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa46815f740 con 0x7fa4680d3200 2024-08-19T00:43:12.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.283+0000 7fa46e600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa46815e740 0x7fa46815ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54040/0 (socket says 172.21.15.7:54040) 2024-08-19T00:43:12.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.283+0000 7fa46e600640 1 -- 172.21.15.7:0/781034577 learned_addr learned my addr 172.21.15.7:0/781034577 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:12.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa46d200640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 0x7fa46815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170715277 0 0) 0x7fa4680b3ab0 con 0x7fa46815e740 2024-08-19T00:43:12.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa450003520 con 0x7fa46815e740 2024-08-19T00:43:12.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884661045 0 0) 0x7fa46815f460 con 0x7fa46815e360 2024-08-19T00:43:12.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4680b3ab0 con 0x7fa46815e360 2024-08-19T00:43:12.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2099469991 0 0) 0x7fa450003520 con 0x7fa46815e740 2024-08-19T00:43:12.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 msgr2=0x7fa46815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 0x7fa46815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 >> v1:172.21.15.162:6789/0 conn(0x7fa46815e360 legacy=0x7fa4680d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4680b3d60 con 0x7fa46815e740 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fa4600019f0 con 0x7fa46815e740 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 >> v1:172.21.15.7:6789/0 conn(0x7fa46815e740 legacy=0x7fa46815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 0x7fa450003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa450004120 0x7fa450004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa450004d40 0x7fa4500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa46815f740 con 0x7fa450004120 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa45000bb00 con 0x7fa450004d40 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.284+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa45000bd00 con 0x7fa4680d3200 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46d200640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa450004120 0x7fa450004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46dc00640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 0x7fa450003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46e600640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa450004d40 0x7fa4500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46d200640 1 -- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 msgr2=0x7fa450003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46d200640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4680d3200 0x7fa450003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46d200640 1 -- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa450004d40 msgr2=0x7fa4500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46d200640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa450004d40 0x7fa4500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.285+0000 7fa46d200640 1 -- 172.21.15.7:0/781034577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa450003520 con 0x7fa450004120 2024-08-19T00:43:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.286+0000 7fa46d200640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa450004120 0x7fa450004800 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa454009a90 tx=0x7fa450005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e291f93230cb043 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.286+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454036070 con 0x7fa450004120 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.286+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa454031400 con 0x7fa450004120 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.286+0000 7fa467e00640 1 -- 172.21.15.7:0/781034577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454009690 con 0x7fa450004120 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.287+0000 7fa46f000640 1 -- 172.21.15.7:0/781034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa450004120 msgr2=0x7fa450004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.287+0000 7fa46f000640 1 --2- 172.21.15.7:0/781034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa450004120 0x7fa450004800 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa454009a90 tx=0x7fa450005830 comp rx=0 tx=0).stop 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.287+0000 7fa46e600640 1 -- 172.21.15.7:0/781034577 reap_dead start 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.287+0000 7fa46f000640 1 -- 172.21.15.7:0/781034577 shutdown_connections 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.287+0000 7fa46f000640 1 -- 172.21.15.7:0/781034577 >> 172.21.15.7:0/781034577 conn(0x7fa46808dbf0 msgr2=0x7fa46809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.287+0000 7fa46f000640 1 -- 172.21.15.7:0/781034577 shutdown_connections 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.287+0000 7fa46f000640 1 -- 172.21.15.7:0/781034577 wait complete. 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.289+0000 7fa46f000640 1 Processor -- start 2024-08-19T00:43:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.289+0000 7fa46f000640 1 -- start start 2024-08-19T00:43:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa450004120 0x7fa468156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46815c590 0x7fa4680c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4680c7d10 0x7fa46806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa46815fab0 con 0x7fa4680c7d10 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680d2300 con 0x7fa46815c590 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa46815fc30 con 0x7fa450004120 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4680c7d10 0x7fa46806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4680c7d10 0x7fa46806d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36678/0 (socket says 172.21.15.7:36678) 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46e600640 1 -- 172.21.15.7:0/2003023557 learned_addr learned my addr 172.21.15.7:0/2003023557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46dc00640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa450004120 0x7fa468156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.290+0000 7fa46d200640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46815c590 0x7fa4680c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46e600640 1 -- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa450004120 msgr2=0x7fa468156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46e600640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa450004120 0x7fa468156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46e600640 1 -- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46815c590 msgr2=0x7fa4680c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46e600640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46815c590 0x7fa4680c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46e600640 1 -- 172.21.15.7:0/2003023557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa468156a90 con 0x7fa4680c7d10 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46e600640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4680c7d10 0x7fa46806d660 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa4680cb260 tx=0x7fa460007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa465600640 1 -- 172.21.15.7:0/2003023557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46000aa90 con 0x7fa4680c7d10 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa465600640 1 -- 172.21.15.7:0/2003023557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa460018070 con 0x7fa4680c7d10 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa465600640 1 -- 172.21.15.7:0/2003023557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600133f0 con 0x7fa4680c7d10 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4680c85f0 con 0x7fa4680c7d10 2024-08-19T00:43:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.291+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4680c8bb0 con 0x7fa4680c7d10 2024-08-19T00:43:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.292+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4680d50d0 con 0x7fa4680c7d10 2024-08-19T00:43:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.293+0000 7fa465600640 1 -- 172.21.15.7:0/2003023557 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa460013590 con 0x7fa4680c7d10 2024-08-19T00:43:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.294+0000 7fa465600640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa44806be30 0x7fa44806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.294+0000 7fa465600640 1 -- 172.21.15.7:0/2003023557 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7fa46008b3e0 con 0x7fa4680c7d10 2024-08-19T00:43:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.294+0000 7fa46dc00640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa44806be30 0x7fa44806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.295+0000 7fa46dc00640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa44806be30 0x7fa44806e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa45c001940 tx=0x7fa45c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.299+0000 7fa465600640 1 -- 172.21.15.7:0/2003023557 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa460059580 con 0x7fa4680c7d10 2024-08-19T00:43:12.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.482+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa468160ac0 con 0x7fa4680c7d10 2024-08-19T00:43:12.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.483+0000 7fa465600640 1 -- 172.21.15.7:0/2003023557 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16796 (secure 0 0 0) 0x7fa46005d880 con 0x7fa4680c7d10 2024-08-19T00:43:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:12.486 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:43:05.101446+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:42:29.087286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-08-19T00:42:30.287566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/2626740684":"2024-08-20T00:43:05.101401+0000","172.21.15.7:6835/2626740684":"2024-08-20T00:43:05.101401+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:43:12.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa44806be30 msgr2=0x7fa44806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa44806be30 0x7fa44806e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa45c001940 tx=0x7fa45c009040 comp rx=0 tx=0).stop 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4680c7d10 msgr2=0x7fa46806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4680c7d10 0x7fa46806d660 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa4680cb260 tx=0x7fa460007bd0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 shutdown_connections 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa44806be30 0x7fa44806e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4680c7d10 0x7fa46806d660 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46815c590 0x7fa4680c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 --2- 172.21.15.7:0/2003023557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa450004120 0x7fa468156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 >> 172.21.15.7:0/2003023557 conn(0x7fa46808dbf0 msgr2=0x7fa46806cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 shutdown_connections 2024-08-19T00:43:12.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.486+0000 7fa46f000640 1 -- 172.21.15.7:0/2003023557 wait complete. 2024-08-19T00:43:12.505 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:43:12.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:12.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.660+0000 7f219a400640 1 Processor -- start 2024-08-19T00:43:12.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.660+0000 7f219a400640 1 -- start start 2024-08-19T00:43:12.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.661+0000 7f219a400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21940d03c0 0x7f2194071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.661+0000 7f219a400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f219406e710 0x7f21940d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f219a400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f21940b3750 0x7f21940cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f219a400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f21940cebc0 con 0x7f21940d03c0 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f219a400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f21940d0ce0 con 0x7f21940b3750 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f219a400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21940cdfb0 con 0x7f219406e710 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21940d03c0 0x7f2194071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21940d03c0 0x7f2194071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36692/0 (socket says 172.21.15.7:36692) 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 -- 172.21.15.7:0/2345140567 learned_addr learned my addr 172.21.15.7:0/2345140567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f218be00640 1 --2- 172.21.15.7:0/2345140567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f219406e710 0x7f21940d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193e00640 1 --2- 172.21.15.7:0/2345140567 >> v2:172.21.15.162:3300/0 conn(0x7f21940b3750 0x7f21940cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 -- 172.21.15.7:0/2345140567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f219406e710 msgr2=0x7f21940d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:12.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 --2- 172.21.15.7:0/2345140567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f219406e710 0x7f21940d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 -- 172.21.15.7:0/2345140567 >> v2:172.21.15.162:3300/0 conn(0x7f21940b3750 msgr2=0x7f21940cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:12.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 --2- 172.21.15.7:0/2345140567 >> v2:172.21.15.162:3300/0 conn(0x7f21940b3750 0x7f21940cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.662+0000 7f2193400640 1 -- 172.21.15.7:0/2345140567 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21940ce290 con 0x7f21940d03c0 2024-08-19T00:43:12.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.663+0000 7f2193400640 1 --2- 172.21.15.7:0/2345140567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21940d03c0 0x7f2194071980 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f219409e320 tx=0x7f218402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b92d4df1b614ba3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:12.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f2192a00640 1 -- 172.21.15.7:0/2345140567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184037070 con 0x7f21940d03c0 2024-08-19T00:43:12.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f2192a00640 1 -- 172.21.15.7:0/2345140567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2184032440 con 0x7f21940d03c0 2024-08-19T00:43:12.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f2192a00640 1 -- 172.21.15.7:0/2345140567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184032810 con 0x7f21940d03c0 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 -- 172.21.15.7:0/2345140567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21940d03c0 msgr2=0x7f2194071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 --2- 172.21.15.7:0/2345140567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21940d03c0 0x7f2194071980 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f219409e320 tx=0x7f218402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 -- 172.21.15.7:0/2345140567 shutdown_connections 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 --2- 172.21.15.7:0/2345140567 >> v2:172.21.15.162:3300/0 conn(0x7f21940b3750 0x7f21940cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 --2- 172.21.15.7:0/2345140567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f219406e710 0x7f21940d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 --2- 172.21.15.7:0/2345140567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21940d03c0 0x7f2194071980 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 -- 172.21.15.7:0/2345140567 >> 172.21.15.7:0/2345140567 conn(0x7f219406bc70 msgr2=0x7f219406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 -- 172.21.15.7:0/2345140567 shutdown_connections 2024-08-19T00:43:12.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.664+0000 7f219a400640 1 -- 172.21.15.7:0/2345140567 wait complete. 2024-08-19T00:43:12.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.666+0000 7f219a400640 1 Processor -- start 2024-08-19T00:43:12.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.666+0000 7f219a400640 1 -- start start 2024-08-19T00:43:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f219a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219406e710 0x7f219409dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f219a400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21940b3750 0x7f21941f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f219a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21940d03c0 0x7f219409b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f219a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2194073ae0 con 0x7f219406e710 2024-08-19T00:43:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f219a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21940ce850 con 0x7f21940d03c0 2024-08-19T00:43:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f219a400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2194073c60 con 0x7f21940b3750 2024-08-19T00:43:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f2193400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219406e710 0x7f219409dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f2193400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219406e710 0x7f219409dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36704/0 (socket says 172.21.15.7:36704) 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f2193400640 1 -- 172.21.15.7:0/830213053 learned_addr learned my addr 172.21.15.7:0/830213053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.667+0000 7f218be00640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21940b3750 0x7f21941f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193e00640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21940d03c0 0x7f219409b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193400640 1 -- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21940b3750 msgr2=0x7f21941f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21940b3750 0x7f21941f3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193400640 1 -- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21940d03c0 msgr2=0x7f219409b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21940d03c0 0x7f219409b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193400640 1 -- 172.21.15.7:0/830213053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219409e3b0 con 0x7f219406e710 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193e00640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21940d03c0 0x7f219409b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f2193400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219406e710 0x7f219409dd30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2184000c00 tx=0x7f21840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f218b400640 1 -- 172.21.15.7:0/830213053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184041020 con 0x7f219406e710 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f218b400640 1 -- 172.21.15.7:0/830213053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218403d620 con 0x7f219406e710 2024-08-19T00:43:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219409a2f0 con 0x7f219406e710 2024-08-19T00:43:12.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.668+0000 7f218b400640 1 -- 172.21.15.7:0/830213053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184037040 con 0x7f219406e710 2024-08-19T00:43:12.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.669+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219409a8b0 con 0x7f219406e710 2024-08-19T00:43:12.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.669+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21940b3be0 con 0x7f219406e710 2024-08-19T00:43:12.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.670+0000 7f218b400640 1 -- 172.21.15.7:0/830213053 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2184044020 con 0x7f219406e710 2024-08-19T00:43:12.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.671+0000 7f218b400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f217006be30 0x7f217006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:12.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.671+0000 7f218b400640 1 -- 172.21.15.7:0/830213053 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f21840ab5a0 con 0x7f219406e710 2024-08-19T00:43:12.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.672+0000 7f218be00640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f217006be30 0x7f217006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:12.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.672+0000 7f218be00640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f217006be30 0x7f217006e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f21940b0ef0 tx=0x7f217c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.675+0000 7f218b400640 1 -- 172.21.15.7:0/830213053 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f218404b030 con 0x7f219406e710 2024-08-19T00:43:12.847 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:43:12.846+0000 7fb831600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:43:12.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.900+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2194072c40 con 0x7f219406e710 2024-08-19T00:43:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.900+0000 7f218b400640 1 -- 172.21.15.7:0/830213053 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5221 (secure 0 0 0) 0x7f2184079ec0 con 0x7f219406e710 2024-08-19T00:43:12.902 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:12.902 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"btime":"2024-08-19T00:43:08:115906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":5774,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1074731607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1074731607},{"type":"v1","addr":"172.21.15.7:6837","nonce":1074731607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:08.115898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":13,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":5}]} 2024-08-19T00:43:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 76 2024-08-19T00:43:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f217006be30 msgr2=0x7f217006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f217006be30 0x7f217006e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f21940b0ef0 tx=0x7f217c009190 comp rx=0 tx=0).stop 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219406e710 msgr2=0x7f219409dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219406e710 0x7f219409dd30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2184000c00 tx=0x7f21840046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 shutdown_connections 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f217006be30 0x7f217006e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21940d03c0 0x7f219409b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21940b3750 0x7f21941f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 --2- 172.21.15.7:0/830213053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219406e710 0x7f219409dd30 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 >> 172.21.15.7:0/830213053 conn(0x7f219406bc70 msgr2=0x7f21940b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 shutdown_connections 2024-08-19T00:43:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:12.903+0000 7f219a400640 1 -- 172.21.15.7:0/830213053 wait complete. 2024-08-19T00:43:12.920 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.074+0000 7f46aba00640 1 Processor -- start 2024-08-19T00:43:13.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.075+0000 7f46aba00640 1 -- start start 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46aba00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f46a4159bf0 0x7f46a4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46aba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46a40cec10 0x7f46a40d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46aba00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a406f7f0 con 0x7f46a40739a0 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46aba00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f46a406f510 con 0x7f46a4159bf0 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46aba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f46a4072980 con 0x7f46a40cec10 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46a9000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f46a4159bf0 0x7f46a4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46a9000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f46a4159bf0 0x7f46a4073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36716/0 (socket says 172.21.15.7:36716) 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46a9000640 1 -- 172.21.15.7:0/4093688862 learned_addr learned my addr 172.21.15.7:0/4093688862 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.076+0000 7f46a9a00640 1 --2- 172.21.15.7:0/4093688862 >> v2:172.21.15.162:3300/0 conn(0x7f46a40cec10 0x7f46a40d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.077+0000 7f46a9000640 1 -- 172.21.15.7:0/4093688862 >> v2:172.21.15.162:3300/0 conn(0x7f46a40cec10 msgr2=0x7f46a40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.077+0000 7f46a9000640 1 --2- 172.21.15.7:0/4093688862 >> v2:172.21.15.162:3300/0 conn(0x7f46a40cec10 0x7f46a40d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.077+0000 7f46a9000640 1 -- 172.21.15.7:0/4093688862 >> v1:172.21.15.162:6789/0 conn(0x7f46a40739a0 legacy=0x7f46a40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.077+0000 7f46a9000640 1 -- 172.21.15.7:0/4093688862 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a4072c60 con 0x7f46a4159bf0 2024-08-19T00:43:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.077+0000 7f46a9a00640 1 --2- 172.21.15.7:0/4093688862 >> v2:172.21.15.162:3300/0 conn(0x7f46a40cec10 0x7f46a40d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.078+0000 7f46a9000640 1 --2- 172.21.15.7:0/4093688862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a4073460 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f46a40d0f80 tx=0x7f469802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cfc28a889dd3d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.078+0000 7f46a3400640 1 -- 172.21.15.7:0/4093688862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698037070 con 0x7f46a4159bf0 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.078+0000 7f46a3400640 1 -- 172.21.15.7:0/4093688862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698032440 con 0x7f46a4159bf0 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.078+0000 7f46a3400640 1 -- 172.21.15.7:0/4093688862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698032810 con 0x7f46a4159bf0 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.078+0000 7f46aba00640 1 -- 172.21.15.7:0/4093688862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 msgr2=0x7f46a4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.078+0000 7f46aba00640 1 --2- 172.21.15.7:0/4093688862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a4073460 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f46a40d0f80 tx=0x7f469802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.079+0000 7f46aba00640 1 -- 172.21.15.7:0/4093688862 shutdown_connections 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.079+0000 7f46aba00640 1 --2- 172.21.15.7:0/4093688862 >> v2:172.21.15.162:3300/0 conn(0x7f46a40cec10 0x7f46a40d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.079+0000 7f46aba00640 1 --2- 172.21.15.7:0/4093688862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a4073460 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.079+0000 7f46aba00640 1 -- 172.21.15.7:0/4093688862 >> 172.21.15.7:0/4093688862 conn(0x7f46a406bc70 msgr2=0x7f46a406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.079+0000 7f46aba00640 1 -- 172.21.15.7:0/4093688862 shutdown_connections 2024-08-19T00:43:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.079+0000 7f46aba00640 1 -- 172.21.15.7:0/4093688862 wait complete. 2024-08-19T00:43:13.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.080+0000 7f46aba00640 1 Processor -- start 2024-08-19T00:43:13.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.080+0000 7f46aba00640 1 -- start start 2024-08-19T00:43:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.081+0000 7f46aba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a40739a0 0x7f46a4152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.081+0000 7f46aba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a409aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.081+0000 7f46aba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46a4158340 0x7f46a41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.081+0000 7f46aba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46a415a150 con 0x7f46a4159bf0 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.081+0000 7f46aba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4159fd0 con 0x7f46a40739a0 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.081+0000 7f46aba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46a40d0900 con 0x7f46a4158340 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a409aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a409aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36728/0 (socket says 172.21.15.7:36728) 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 -- 172.21.15.7:0/2584816728 learned_addr learned my addr 172.21.15.7:0/2584816728 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a9000640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a40739a0 0x7f46a4152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a9a00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46a4158340 0x7f46a41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 -- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46a4158340 msgr2=0x7f46a41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46a4158340 0x7f46a41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 -- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a40739a0 msgr2=0x7f46a4152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a40739a0 0x7f46a4152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 -- 172.21.15.7:0/2584816728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a409d300 con 0x7f46a4159bf0 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a9000640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a40739a0 0x7f46a4152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.082+0000 7f46a3e00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a409aab0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f469000c3f0 tx=0x7f469000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.083+0000 7f46a0c00640 1 -- 172.21.15.7:0/2584816728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46900052d0 con 0x7f46a4159bf0 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.083+0000 7f46a0c00640 1 -- 172.21.15.7:0/2584816728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4690005490 con 0x7f46a4159bf0 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.083+0000 7f46a0c00640 1 -- 172.21.15.7:0/2584816728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690007260 con 0x7f46a4159bf0 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.083+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a409d5e0 con 0x7f46a4159bf0 2024-08-19T00:43:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.083+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a409dba0 con 0x7f46a4159bf0 2024-08-19T00:43:13.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.084+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a40d0c90 con 0x7f46a4159bf0 2024-08-19T00:43:13.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.085+0000 7f46a0c00640 1 -- 172.21.15.7:0/2584816728 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4690007400 con 0x7f46a4159bf0 2024-08-19T00:43:13.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.086+0000 7f46a0c00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f468406be60 0x7f468406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.086+0000 7f46a0c00640 1 -- 172.21.15.7:0/2584816728 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f469008a340 con 0x7f46a4159bf0 2024-08-19T00:43:13.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.086+0000 7f46a9000640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f468406be60 0x7f468406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.087+0000 7f46a9000640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f468406be60 0x7f468406e320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4698034000 tx=0x7f469802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.091+0000 7f46a0c00640 1 -- 172.21.15.7:0/2584816728 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4690058600 con 0x7f46a4159bf0 2024-08-19T00:43:13.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.310+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46a41599a0 con 0x7f46a4159bf0 2024-08-19T00:43:13.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.311+0000 7f46a0c00640 1 -- 172.21.15.7:0/2584816728 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5221 (secure 0 0 0) 0x7f469005c900 con 0x7f46a4159bf0 2024-08-19T00:43:13.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:13.313 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"btime":"2024-08-19T00:43:08:115906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":5774,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1074731607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1074731607},{"type":"v1","addr":"172.21.15.7:6837","nonce":1074731607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:42:31.298074+0000","modified":"2024-08-19T00:43:08.115898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":13,"addr":"172.21.15.7:6836/3281733316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3281733316},{"type":"v1","addr":"172.21.15.7:6836","nonce":3281733316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":5}]} 2024-08-19T00:43:13.313 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 76 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f468406be60 msgr2=0x7f468406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f468406be60 0x7f468406e320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4698034000 tx=0x7f469802e000 comp rx=0 tx=0).stop 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 msgr2=0x7f46a409aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a409aab0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f469000c3f0 tx=0x7f469000c8b0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 shutdown_connections 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f468406be60 0x7f468406e320 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46a4158340 0x7f46a41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46a4159bf0 0x7f46a409aab0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 --2- 172.21.15.7:0/2584816728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a40739a0 0x7f46a4152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 >> 172.21.15.7:0/2584816728 conn(0x7f46a406bc70 msgr2=0x7f46a415a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:13.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 shutdown_connections 2024-08-19T00:43:13.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.313+0000 7f46aba00640 1 -- 172.21.15.7:0/2584816728 wait complete. 2024-08-19T00:43:13.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:43:13.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.487+0000 7faec4800640 1 Processor -- start 2024-08-19T00:43:13.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.487+0000 7faec4800640 1 -- start start 2024-08-19T00:43:13.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.488+0000 7faec4800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faebc159bf0 0x7faebc073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.488+0000 7faec4800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc0739a0 0x7faebc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.488+0000 7faec4800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc06f7f0 con 0x7faebc0cea40 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.488+0000 7faec4800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7faebc06f510 con 0x7faebc159bf0 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.488+0000 7faec4800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faebc072980 con 0x7faebc0739a0 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faebc159bf0 0x7faebc073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faebc159bf0 0x7faebc073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36740/0 (socket says 172.21.15.7:36740) 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1e00640 1 -- 172.21.15.7:0/1077508263 learned_addr learned my addr 172.21.15.7:0/1077508263 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1400640 1 --2- 172.21.15.7:0/1077508263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc0739a0 0x7faebc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1e00640 1 -- 172.21.15.7:0/1077508263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc0739a0 msgr2=0x7faebc0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1e00640 1 --2- 172.21.15.7:0/1077508263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc0739a0 0x7faebc0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1e00640 1 -- 172.21.15.7:0/1077508263 >> v1:172.21.15.162:6789/0 conn(0x7faebc0cea40 legacy=0x7faebc0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.489+0000 7faec1e00640 1 -- 172.21.15.7:0/1077508263 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc072c60 con 0x7faebc159bf0 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.490+0000 7faec1e00640 1 --2- 172.21.15.7:0/1077508263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc159bf0 0x7faebc073460 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009870 tx=0x7faeb002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14b26a19481886a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.490+0000 7faec0a00640 1 -- 172.21.15.7:0/1077508263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0037070 con 0x7faebc159bf0 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.490+0000 7faec0a00640 1 -- 172.21.15.7:0/1077508263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb0032440 con 0x7faebc159bf0 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.490+0000 7faec0a00640 1 -- 172.21.15.7:0/1077508263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0032810 con 0x7faebc159bf0 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 -- 172.21.15.7:0/1077508263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc159bf0 msgr2=0x7faebc073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 --2- 172.21.15.7:0/1077508263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc159bf0 0x7faebc073460 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009870 tx=0x7faeb002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 -- 172.21.15.7:0/1077508263 shutdown_connections 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 --2- 172.21.15.7:0/1077508263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc0739a0 0x7faebc0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 --2- 172.21.15.7:0/1077508263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc159bf0 0x7faebc073460 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 -- 172.21.15.7:0/1077508263 >> 172.21.15.7:0/1077508263 conn(0x7faebc06bc70 msgr2=0x7faebc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 -- 172.21.15.7:0/1077508263 shutdown_connections 2024-08-19T00:43:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.491+0000 7faec4800640 1 -- 172.21.15.7:0/1077508263 wait complete. 2024-08-19T00:43:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.493+0000 7faec4800640 1 Processor -- start 2024-08-19T00:43:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.493+0000 7faec4800640 1 -- start start 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec4800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc0739a0 0x7faebc157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec4800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faebc0cea40 0x7faebc154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec4800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc159bf0 0x7faebc0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec4800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faebc15a150 con 0x7faebc0739a0 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec4800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faebc159fd0 con 0x7faebc0cea40 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec4800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faebc0d0ad0 con 0x7faebc159bf0 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc0739a0 0x7faebc157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc0739a0 0x7faebc157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36750/0 (socket says 172.21.15.7:36750) 2024-08-19T00:43:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec1e00640 1 -- 172.21.15.7:0/3122224317 learned_addr learned my addr 172.21.15.7:0/3122224317 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec1400640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faebc0cea40 0x7faebc154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec2800640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc159bf0 0x7faebc0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec1e00640 1 -- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc159bf0 msgr2=0x7faebc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec1e00640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc159bf0 0x7faebc0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.494+0000 7faec1e00640 1 -- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faebc0cea40 msgr2=0x7faebc154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faec1e00640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faebc0cea40 0x7faebc154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faec1e00640 1 -- 172.21.15.7:0/3122224317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc1551e0 con 0x7faebc0739a0 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faec1400640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faebc0cea40 0x7faebc154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faec1e00640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc0739a0 0x7faebc157c60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faeb0000c00 tx=0x7faeb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faeb6000640 1 -- 172.21.15.7:0/3122224317 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0041020 con 0x7faebc0739a0 2024-08-19T00:43:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faeb6000640 1 -- 172.21.15.7:0/3122224317 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb00306c0 con 0x7faebc0739a0 2024-08-19T00:43:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faeb6000640 1 -- 172.21.15.7:0/3122224317 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0037040 con 0x7faebc0739a0 2024-08-19T00:43:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faebc1510d0 con 0x7faebc0739a0 2024-08-19T00:43:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.495+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faebc151690 con 0x7faebc0739a0 2024-08-19T00:43:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.496+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faebc15c8b0 con 0x7faebc0739a0 2024-08-19T00:43:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.497+0000 7faeb6000640 1 -- 172.21.15.7:0/3122224317 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faeb0044020 con 0x7faebc0739a0 2024-08-19T00:43:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.499+0000 7faeb6000640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faea006be30 0x7faea006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.499+0000 7faeb6000640 1 -- 172.21.15.7:0/3122224317 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7faeb00ab3a0 con 0x7faebc0739a0 2024-08-19T00:43:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.499+0000 7faec1400640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faea006be30 0x7faea006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.500+0000 7faec1400640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faea006be30 0x7faea006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faeac006fd0 tx=0x7faeac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.504+0000 7faeb6000640 1 -- 172.21.15.7:0/3122224317 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faebc15c8b0 con 0x7faebc0739a0 2024-08-19T00:43:13.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.689+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faebc15aaf0 con 0x7faebc0739a0 2024-08-19T00:43:13.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.690+0000 7faeb6000640 1 -- 172.21.15.7:0/3122224317 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16796 (secure 0 0 0) 0x7faebc15aaf0 con 0x7faebc0739a0 2024-08-19T00:43:13.692 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:13.692 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:43:05.101446+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:42:29.087286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-08-19T00:42:30.287566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.a","mappings":[{"from":2,"to":7}]},{"pgid":"11.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/2626740684":"2024-08-20T00:43:05.101401+0000","172.21.15.7:6835/2626740684":"2024-08-20T00:43:05.101401+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faea006be30 msgr2=0x7faea006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faea006be30 0x7faea006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faeac006fd0 tx=0x7faeac008040 comp rx=0 tx=0).stop 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc0739a0 msgr2=0x7faebc157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc0739a0 0x7faebc157c60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faeb0000c00 tx=0x7faeb00046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 shutdown_connections 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faea006be30 0x7faea006e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faebc159bf0 0x7faebc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faebc0cea40 0x7faebc154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 --2- 172.21.15.7:0/3122224317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faebc0739a0 0x7faebc157c60 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 >> 172.21.15.7:0/3122224317 conn(0x7faebc06bc70 msgr2=0x7faebc15ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 shutdown_connections 2024-08-19T00:43:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.692+0000 7faec4800640 1 -- 172.21.15.7:0/3122224317 wait complete. 2024-08-19T00:43:13.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:43:13.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.865+0000 7f3ee1800640 1 Processor -- start 2024-08-19T00:43:13.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.865+0000 7f3ee1800640 1 -- start start 2024-08-19T00:43:13.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.866+0000 7f3ee1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0d27b0 0x7f3edc0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.866+0000 7f3ee1800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc0d3110 con 0x7f3edc0b4150 2024-08-19T00:43:13.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.866+0000 7f3ee1800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc0b4df0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.866+0000 7f3ee1800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0b50d0 con 0x7f3edc0d27b0 2024-08-19T00:43:13.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3ee0e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3edc0b4150 0x7f3edc0b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34558/0 (socket says 172.21.15.7:34558) 2024-08-19T00:43:13.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3ee0e00640 1 -- 172.21.15.7:0/4172973361 learned_addr learned my addr 172.21.15.7:0/4172973361 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:13.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3ed3e00640 1 --2- 172.21.15.7:0/4172973361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0d27b0 0x7f3edc0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757191641 0 0) 0x7f3edc0d3110 con 0x7f3edc0b4150 2024-08-19T00:43:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec0003520 con 0x7f3edc0b4150 2024-08-19T00:43:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571876624 0 0) 0x7f3edc0b4df0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3edc0d3110 con 0x7f3edc15e3e0 2024-08-19T00:43:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734786732 0 0) 0x7f3ec0003520 con 0x7f3edc0b4150 2024-08-19T00:43:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3ed3e00640 1 -- 172.21.15.7:0/4172973361 >> v1:172.21.15.162:6789/0 conn(0x7f3edc15e3e0 legacy=0x7f3edc0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3ed3e00640 1 -- 172.21.15.7:0/4172973361 >> v1:172.21.15.7:6789/0 conn(0x7f3edc0b4150 legacy=0x7f3edc0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.867+0000 7f3ed3e00640 1 -- 172.21.15.7:0/4172973361 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc0cf1e0 con 0x7f3edc0d27b0 2024-08-19T00:43:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3ed3e00640 1 --2- 172.21.15.7:0/4172973361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0d27b0 0x7f3edc0d2bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40097d0 tx=0x7f3ec402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276ced2da2db8364 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4037070 con 0x7f3edc0d27b0 2024-08-19T00:43:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec402ac30 con 0x7f3edc0d27b0 2024-08-19T00:43:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3edb400640 1 -- 172.21.15.7:0/4172973361 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40019f0 con 0x7f3edc0d27b0 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3ee1800640 1 -- 172.21.15.7:0/4172973361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0d27b0 msgr2=0x7f3edc0d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3ee1800640 1 --2- 172.21.15.7:0/4172973361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0d27b0 0x7f3edc0d2bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40097d0 tx=0x7f3ec402a1a0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3ee1800640 1 -- 172.21.15.7:0/4172973361 shutdown_connections 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3ee1800640 1 --2- 172.21.15.7:0/4172973361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0d27b0 0x7f3edc0d2bd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.869+0000 7f3ee1800640 1 -- 172.21.15.7:0/4172973361 >> 172.21.15.7:0/4172973361 conn(0x7f3edc08dbe0 msgr2=0x7f3edc09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.870+0000 7f3ee1800640 1 -- 172.21.15.7:0/4172973361 shutdown_connections 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.870+0000 7f3ee1800640 1 -- 172.21.15.7:0/4172973361 wait complete. 2024-08-19T00:43:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.871+0000 7f3ee1800640 1 Processor -- start 2024-08-19T00:43:13.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.871+0000 7f3ee1800640 1 -- start start 2024-08-19T00:43:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0b4150 0x7f3edc160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0d27b0 0x7f3edc15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc15e3e0 0x7f3edc1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee1800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc0cf9e0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee1800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc0cee90 con 0x7f3edc0d27b0 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee1800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0cfb60 con 0x7f3edc0b4150 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc15e3e0 0x7f3edc1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc15e3e0 0x7f3edc1534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53784/0 (socket says 172.21.15.7:53784) 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.872+0000 7f3ee0e00640 1 -- 172.21.15.7:0/3994342243 learned_addr learned my addr 172.21.15.7:0/3994342243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ed3e00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0d27b0 0x7f3edc15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3edbe00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0b4150 0x7f3edc160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ee0e00640 1 -- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0b4150 msgr2=0x7f3edc160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ee0e00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0b4150 0x7f3edc160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ee0e00640 1 -- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0d27b0 msgr2=0x7f3edc15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ee0e00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0d27b0 0x7f3edc15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ee0e00640 1 -- 172.21.15.7:0/3994342243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc1539e0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3edbe00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0b4150 0x7f3edc160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:13.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ee0e00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc15e3e0 0x7f3edc1534a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4001350 tx=0x7f3ed400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ed8c00640 1 -- 172.21.15.7:0/3994342243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4017070 con 0x7f3edc15e3e0 2024-08-19T00:43:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ed8c00640 1 -- 172.21.15.7:0/3994342243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4012400 con 0x7f3edc15e3e0 2024-08-19T00:43:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3edc15eaf0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.873+0000 7f3ed8c00640 1 -- 172.21.15.7:0/3994342243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4012830 con 0x7f3edc15e3e0 2024-08-19T00:43:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.874+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3edc15f0b0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.874+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3edc0d2bd0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.875+0000 7f3ed8c00640 1 -- 172.21.15.7:0/3994342243 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ed401a070 con 0x7f3edc15e3e0 2024-08-19T00:43:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.876+0000 7f3ed8c00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.876+0000 7f3ed8c00640 1 -- 172.21.15.7:0/3994342243 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5853+0+0 (secure 0 0 0) 0x7f3ed408acf0 con 0x7f3edc15e3e0 2024-08-19T00:43:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.877+0000 7f3edbe00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.877+0000 7f3edbe00640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0011e0 tx=0x7f3ecc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:13.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:13.881+0000 7f3ed8c00640 1 -- 172.21.15.7:0/3994342243 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3ed408f070 con 0x7f3edc15e3e0 2024-08-19T00:43:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.101+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3edc06dcc0 con 0x7f3edc15e3e0 2024-08-19T00:43:14.103 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:43:14.101+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:43:14.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.103+0000 7f3ed8c00640 1 -- 172.21.15.7:0/3994342243 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7f3ed4059050 con 0x7f3edc15e3e0 2024-08-19T00:43:14.105 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:43:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 msgr2=0x7f3eb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0011e0 tx=0x7f3ecc009040 comp rx=0 tx=0).stop 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc15e3e0 msgr2=0x7f3edc1534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc15e3e0 0x7f3edc1534a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4001350 tx=0x7f3ed400cf90 comp rx=0 tx=0).stop 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 shutdown_connections 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3edc15e3e0 0x7f3edc1534a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3edc0d27b0 0x7f3edc15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 --2- 172.21.15.7:0/3994342243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3edc0b4150 0x7f3edc160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 >> 172.21.15.7:0/3994342243 conn(0x7f3edc08dbe0 msgr2=0x7f3edc06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 shutdown_connections 2024-08-19T00:43:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.107+0000 7f3ee1800640 1 -- 172.21.15.7:0/3994342243 wait complete. 2024-08-19T00:43:14.125 INFO:tasks.ceph.mds.a.smithi007.stderr: -40> 2024-08-19T00:43:12.846+0000 7fb831600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:43:14.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:43:14.171 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:43:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.294+0000 7fbbc4c00640 1 Processor -- start 2024-08-19T00:43:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.294+0000 7fbbc4c00640 1 -- start start 2024-08-19T00:43:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.295+0000 7fbbc4c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbbc00d27b0 0x7fbbc00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.295+0000 7fbbc4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.295+0000 7fbbc4c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc00b4b20 con 0x7fbbc015e3e0 2024-08-19T00:43:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.295+0000 7fbbc4c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc00d3140 con 0x7fbbc00d27b0 2024-08-19T00:43:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.295+0000 7fbbc4c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00b4df0 con 0x7fbbc00b4150 2024-08-19T00:43:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbbc00d27b0 0x7fbbc00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbf400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbbc015e3e0 0x7fbbc00b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:45768/0 (socket says 172.21.15.7:45768) 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbf400640 1 -- 172.21.15.7:0/1071476383 learned_addr learned my addr 172.21.15.7:0/1071476383 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbbc00d27b0 0x7fbbc00d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:59138/0 (socket says 172.21.15.7:59138) 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbe000640 1 -- 172.21.15.7:0/1071476383 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952383288 0 0) 0x7fbbc00b4b20 con 0x7fbbc015e3e0 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbe000640 1 -- 172.21.15.7:0/1071476383 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbba4003520 con 0x7fbbc015e3e0 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbea00640 1 -- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 msgr2=0x7fbbc00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbea00640 1 --2- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc00b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbea00640 1 -- 172.21.15.7:0/1071476383 >> v1:172.21.15.162:6789/0 conn(0x7fbbc015e3e0 legacy=0x7fbbc00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbea00640 1 -- 172.21.15.7:0/1071476383 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00b50d0 con 0x7fbbc00d27b0 2024-08-19T00:43:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.296+0000 7fbbbfe00640 1 --2- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc00b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.297+0000 7fbbbea00640 1 --2- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc00d27b0 0x7fbbc00d2c00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0097d0 tx=0x7fbbac02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f4dd4f9407d5983 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbbe000640 1 -- 172.21.15.7:0/1071476383 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac037070 con 0x7fbbc00d27b0 2024-08-19T00:43:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbbe000640 1 -- 172.21.15.7:0/1071476383 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac032440 con 0x7fbbc00d27b0 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbbe000640 1 -- 172.21.15.7:0/1071476383 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac032810 con 0x7fbbc00d27b0 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbc4c00640 1 -- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc00d27b0 msgr2=0x7fbbc00d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc00d27b0 0x7fbbc00d2c00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0097d0 tx=0x7fbbac02a1c0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbc4c00640 1 -- 172.21.15.7:0/1071476383 shutdown_connections 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc00b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/1071476383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc00d27b0 0x7fbbc00d2c00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.298+0000 7fbbc4c00640 1 -- 172.21.15.7:0/1071476383 >> 172.21.15.7:0/1071476383 conn(0x7fbbc008dbe0 msgr2=0x7fbbc009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.299+0000 7fbbc4c00640 1 -- 172.21.15.7:0/1071476383 shutdown_connections 2024-08-19T00:43:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.299+0000 7fbbc4c00640 1 -- 172.21.15.7:0/1071476383 wait complete. 2024-08-19T00:43:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.300+0000 7fbbc4c00640 1 Processor -- start 2024-08-19T00:43:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.300+0000 7fbbc4c00640 1 -- start start 2024-08-19T00:43:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbc4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbc4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc00d27b0 0x7fbbc009f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbc4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc015e3e0 0x7fbbc009fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbc4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc00cee90 con 0x7fbbc00d27b0 2024-08-19T00:43:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbc4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc00cf4c0 con 0x7fbbc015e3e0 2024-08-19T00:43:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbc4c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00cf9e0 con 0x7fbbc00b4150 2024-08-19T00:43:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbbea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc00d27b0 0x7fbbc009f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbbea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc00d27b0 0x7fbbc009f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53806/0 (socket says 172.21.15.7:53806) 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.301+0000 7fbbbea00640 1 -- 172.21.15.7:0/48553130 learned_addr learned my addr 172.21.15.7:0/48553130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbf400640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbfe00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc015e3e0 0x7fbbc009fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbea00640 1 -- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 msgr2=0x7fbbc014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbea00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbea00640 1 -- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc015e3e0 msgr2=0x7fbbc009fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbea00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc015e3e0 0x7fbbc009fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbea00640 1 -- 172.21.15.7:0/48553130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00cc3f0 con 0x7fbbc00d27b0 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbbea00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc00d27b0 0x7fbbc009f710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0098f0 tx=0x7fbbac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbb7400640 1 -- 172.21.15.7:0/48553130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac041020 con 0x7fbbc00d27b0 2024-08-19T00:43:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbb7400640 1 -- 172.21.15.7:0/48553130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac03d620 con 0x7fbbc00d27b0 2024-08-19T00:43:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.302+0000 7fbbb7400640 1 -- 172.21.15.7:0/48553130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac037040 con 0x7fbbc00d27b0 2024-08-19T00:43:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.303+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc00cc6d0 con 0x7fbbc00d27b0 2024-08-19T00:43:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.303+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc00ccc90 con 0x7fbbc00d27b0 2024-08-19T00:43:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.304+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc00d2c00 con 0x7fbbc00d27b0 2024-08-19T00:43:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.305+0000 7fbbb7400640 1 -- 172.21.15.7:0/48553130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbac044020 con 0x7fbbc00d27b0 2024-08-19T00:43:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.306+0000 7fbbb7400640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbba006be30 0x7fbba006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.306+0000 7fbbb7400640 1 -- 172.21.15.7:0/48553130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5939+0+0 (secure 0 0 0) 0x7fbbac0ab5c0 con 0x7fbbc00d27b0 2024-08-19T00:43:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.306+0000 7fbbbf400640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbba006be30 0x7fbba006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.307+0000 7fbbbf400640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbba006be30 0x7fbba006e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00011e0 tx=0x7fbbb0007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.310+0000 7fbbb7400640 1 -- 172.21.15.7:0/48553130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbbac04b030 con 0x7fbbc00d27b0 2024-08-19T00:43:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:14.532+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbbc009d7e0 con 0x7fbbc00d27b0 2024-08-19T00:43:15.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.148+0000 7fbbb7400640 1 -- 172.21.15.7:0/48553130 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7fbbac079df0 con 0x7fbbc00d27b0 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbba006be30 msgr2=0x7fbba006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbba006be30 0x7fbba006e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00011e0 tx=0x7fbbb0007d30 comp rx=0 tx=0).stop 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc00d27b0 msgr2=0x7fbbc009f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc00d27b0 0x7fbbc009f710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0098f0 tx=0x7fbbac0046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 shutdown_connections 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbba006be30 0x7fbba006e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbc015e3e0 0x7fbbc009fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc00d27b0 0x7fbbc009f710 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 --2- 172.21.15.7:0/48553130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbc00b4150 0x7fbbc014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 >> 172.21.15.7:0/48553130 conn(0x7fbbc008dbe0 msgr2=0x7fbbc006dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 shutdown_connections 2024-08-19T00:43:15.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.151+0000 7fbbc4c00640 1 -- 172.21.15.7:0/48553130 wait complete. 2024-08-19T00:43:15.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:43:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.376+0000 7fab4aa00640 1 Processor -- start 2024-08-19T00:43:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.377+0000 7fab4aa00640 1 -- start start 2024-08-19T00:43:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab4aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab4415ce50 0x7fab441670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:15.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab4aa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4415d390 con 0x7fab440cd080 2024-08-19T00:43:15.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab4aa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4415fe60 con 0x7fab44073540 2024-08-19T00:43:15.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab4aa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fab44072f10 con 0x7fab4415ce50 2024-08-19T00:43:15.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab3b400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fab440cd080 0x7fab4415c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34560/0 (socket says 172.21.15.7:34560) 2024-08-19T00:43:15.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab3b400640 1 -- 172.21.15.7:0/4017622899 learned_addr learned my addr 172.21.15.7:0/4017622899 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab48a00640 1 --2- 172.21.15.7:0/4017622899 >> v2:172.21.15.162:3300/0 conn(0x7fab4415ce50 0x7fab441670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.378+0000 7fab43400640 1 -- 172.21.15.7:0/4017622899 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473257529 0 0) 0x7fab4415d390 con 0x7fab440cd080 2024-08-19T00:43:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.379+0000 7fab43400640 1 -- 172.21.15.7:0/4017622899 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab28003520 con 0x7fab440cd080 2024-08-19T00:43:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.379+0000 7fab48a00640 1 -- 172.21.15.7:0/4017622899 >> v1:172.21.15.162:6789/0 conn(0x7fab44073540 legacy=0x7fab440cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.379+0000 7fab43400640 1 -- 172.21.15.7:0/4017622899 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3755470876 0 0) 0x7fab28003520 con 0x7fab440cd080 2024-08-19T00:43:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.379+0000 7fab48a00640 1 -- 172.21.15.7:0/4017622899 >> v1:172.21.15.7:6789/0 conn(0x7fab440cd080 legacy=0x7fab4415c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.379+0000 7fab48a00640 1 -- 172.21.15.7:0/4017622899 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44160140 con 0x7fab4415ce50 2024-08-19T00:43:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.380+0000 7fab48a00640 1 --2- 172.21.15.7:0/4017622899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4415ce50 0x7fab441670c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009d90 tx=0x7fab3c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44ab88cba0cfa6b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.380+0000 7fab43400640 1 -- 172.21.15.7:0/4017622899 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c001670 con 0x7fab4415ce50 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.380+0000 7fab43400640 1 -- 172.21.15.7:0/4017622899 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c007540 con 0x7fab4415ce50 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.380+0000 7fab43400640 1 -- 172.21.15.7:0/4017622899 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c007910 con 0x7fab4415ce50 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.381+0000 7fab4aa00640 1 -- 172.21.15.7:0/4017622899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4415ce50 msgr2=0x7fab441670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.381+0000 7fab4aa00640 1 --2- 172.21.15.7:0/4017622899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4415ce50 0x7fab441670c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009d90 tx=0x7fab3c02a5f0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.381+0000 7fab4aa00640 1 -- 172.21.15.7:0/4017622899 shutdown_connections 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.381+0000 7fab4aa00640 1 --2- 172.21.15.7:0/4017622899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4415ce50 0x7fab441670c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.381+0000 7fab4aa00640 1 -- 172.21.15.7:0/4017622899 >> 172.21.15.7:0/4017622899 conn(0x7fab4406be80 msgr2=0x7fab440b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.381+0000 7fab4aa00640 1 -- 172.21.15.7:0/4017622899 shutdown_connections 2024-08-19T00:43:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.381+0000 7fab4aa00640 1 -- 172.21.15.7:0/4017622899 wait complete. 2024-08-19T00:43:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.383+0000 7fab4aa00640 1 Processor -- start 2024-08-19T00:43:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.383+0000 7fab4aa00640 1 -- start start 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab4aa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab44073540 0x7fab4415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab4aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440cd080 0x7fab4415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab4aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4415ce50 0x7fab4406da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab4aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab44073920 con 0x7fab4415ce50 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab4aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab4415d670 con 0x7fab440cd080 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab4aa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab44160940 con 0x7fab44073540 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4415ce50 0x7fab4406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4415ce50 0x7fab4406da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53822/0 (socket says 172.21.15.7:53822) 2024-08-19T00:43:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 -- 172.21.15.7:0/26190423 learned_addr learned my addr 172.21.15.7:0/26190423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab3b400640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440cd080 0x7fab4415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab43e00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab44073540 0x7fab4415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 -- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab44073540 msgr2=0x7fab4415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab44073540 0x7fab4415af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 -- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440cd080 msgr2=0x7fab4415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440cd080 0x7fab4415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab48a00640 1 -- 172.21.15.7:0/26190423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4406f9e0 con 0x7fab4415ce50 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.384+0000 7fab43e00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab44073540 0x7fab4415af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.385+0000 7fab48a00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4415ce50 0x7fab4406da00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009d90 tx=0x7fab3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.385+0000 7fab40c00640 1 -- 172.21.15.7:0/26190423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c040070 con 0x7fab4415ce50 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.385+0000 7fab40c00640 1 -- 172.21.15.7:0/26190423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c031bc0 con 0x7fab4415ce50 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.385+0000 7fab40c00640 1 -- 172.21.15.7:0/26190423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c009450 con 0x7fab4415ce50 2024-08-19T00:43:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.385+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab441593a0 con 0x7fab4415ce50 2024-08-19T00:43:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.385+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab44159960 con 0x7fab4415ce50 2024-08-19T00:43:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.386+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab440cc970 con 0x7fab4415ce50 2024-08-19T00:43:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.387+0000 7fab40c00640 1 -- 172.21.15.7:0/26190423 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab3c039040 con 0x7fab4415ce50 2024-08-19T00:43:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.388+0000 7fab40c00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab2006be30 0x7fab2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.388+0000 7fab40c00640 1 -- 172.21.15.7:0/26190423 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5939+0+0 (secure 0 0 0) 0x7fab3c0ac580 con 0x7fab4415ce50 2024-08-19T00:43:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.388+0000 7fab43e00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab2006be30 0x7fab2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.389+0000 7fab43e00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab2006be30 0x7fab2006e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fab34000f60 tx=0x7fab34009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.392+0000 7fab40c00640 1 -- 172.21.15.7:0/26190423 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fab3c038350 con 0x7fab4415ce50 2024-08-19T00:43:15.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:15.574+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fab440ada80 con 0x7fab4415ce50 2024-08-19T00:43:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.160+0000 7fab40c00640 1 -- 172.21.15.7:0/26190423 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7fab3c07ac90 con 0x7fab4415ce50 2024-08-19T00:43:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:43:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab2006be30 msgr2=0x7fab2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab2006be30 0x7fab2006e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fab34000f60 tx=0x7fab34009040 comp rx=0 tx=0).stop 2024-08-19T00:43:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4415ce50 msgr2=0x7fab4406da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4415ce50 0x7fab4406da00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009d90 tx=0x7fab3c004a40 comp rx=0 tx=0).stop 2024-08-19T00:43:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 shutdown_connections 2024-08-19T00:43:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab2006be30 0x7fab2006e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4415ce50 0x7fab4406da00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440cd080 0x7fab4415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 --2- 172.21.15.7:0/26190423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab44073540 0x7fab4415af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.164+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 >> 172.21.15.7:0/26190423 conn(0x7fab4406be80 msgr2=0x7fab440acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.165+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 shutdown_connections 2024-08-19T00:43:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.165+0000 7fab4aa00640 1 -- 172.21.15.7:0/26190423 wait complete. 2024-08-19T00:43:16.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:43:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.350+0000 7f8c49400640 1 Processor -- start 2024-08-19T00:43:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.350+0000 7f8c49400640 1 -- start start 2024-08-19T00:43:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.351+0000 7f8c49400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c44161f50 0x7f8c44162330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.351+0000 7f8c49400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c44162870 0x7f8c4406b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.351+0000 7f8c49400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c440b4090 con 0x7f8c4406bd90 2024-08-19T00:43:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.351+0000 7f8c49400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8c440b43c0 con 0x7f8c44162870 2024-08-19T00:43:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.351+0000 7f8c49400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c440b5e50 con 0x7f8c44161f50 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.351+0000 7f8c43200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8c4406bd90 0x7f8c4406f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34576/0 (socket says 172.21.15.7:34576) 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.351+0000 7f8c43200640 1 -- 172.21.15.7:0/1704670007 learned_addr learned my addr 172.21.15.7:0/1704670007 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c39e00640 1 --2- 172.21.15.7:0/1704670007 >> v2:172.21.15.162:3300/0 conn(0x7f8c44162870 0x7f8c4406b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c42800640 1 --2- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c44161f50 0x7f8c44162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c41e00640 1 -- 172.21.15.7:0/1704670007 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179907533 0 0) 0x7f8c440b4090 con 0x7f8c4406bd90 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c41e00640 1 -- 172.21.15.7:0/1704670007 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c28003520 con 0x7f8c4406bd90 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c39e00640 1 -- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c44161f50 msgr2=0x7f8c44162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c39e00640 1 --2- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c44161f50 0x7f8c44162330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c39e00640 1 -- 172.21.15.7:0/1704670007 >> v1:172.21.15.7:6789/0 conn(0x7f8c4406bd90 legacy=0x7f8c4406f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c41e00640 1 -- 172.21.15.7:0/1704670007 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510329058 0 0) 0x7f8c28003520 con 0x7f8c4406bd90 2024-08-19T00:43:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.352+0000 7f8c39e00640 1 -- 172.21.15.7:0/1704670007 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c440b6130 con 0x7f8c44162870 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.353+0000 7f8c39e00640 1 --2- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 0x7f8c4406b850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097a0 tx=0x7f8c2c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ad80d94318ef6c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c41e00640 1 -- 172.21.15.7:0/1704670007 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c037070 con 0x7f8c44162870 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c41e00640 1 -- 172.21.15.7:0/1704670007 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2c02aba0 con 0x7f8c44162870 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c41e00640 1 -- 172.21.15.7:0/1704670007 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0019f0 con 0x7f8c44162870 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 -- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 msgr2=0x7f8c4406b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 --2- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 0x7f8c4406b850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097a0 tx=0x7f8c2c02a110 comp rx=0 tx=0).stop 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 -- 172.21.15.7:0/1704670007 shutdown_connections 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 --2- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 0x7f8c4406b850 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 --2- 172.21.15.7:0/1704670007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c44161f50 0x7f8c44162330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 -- 172.21.15.7:0/1704670007 >> 172.21.15.7:0/1704670007 conn(0x7f8c44072ff0 msgr2=0x7f8c440b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 -- 172.21.15.7:0/1704670007 shutdown_connections 2024-08-19T00:43:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.354+0000 7f8c49400640 1 -- 172.21.15.7:0/1704670007 wait complete. 2024-08-19T00:43:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.356+0000 7f8c49400640 1 Processor -- start 2024-08-19T00:43:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.356+0000 7f8c49400640 1 -- start start 2024-08-19T00:43:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c49400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c4406bd90 0x7f8c44156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44161f50 0x7f8c4414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c49400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 0x7f8c441512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c49400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4415e770 con 0x7f8c44161f50 2024-08-19T00:43:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c49400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c440b4850 con 0x7f8c44162870 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c49400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c440b06b0 con 0x7f8c4406bd90 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c39e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44161f50 0x7f8c4414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c39e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44161f50 0x7f8c4414fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53832/0 (socket says 172.21.15.7:53832) 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c39e00640 1 -- 172.21.15.7:0/3358204875 learned_addr learned my addr 172.21.15.7:0/3358204875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c43200640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 0x7f8c441512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.357+0000 7f8c42800640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c4406bd90 0x7f8c44156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c39e00640 1 -- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c4406bd90 msgr2=0x7f8c44156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c39e00640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c4406bd90 0x7f8c44156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c39e00640 1 -- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 msgr2=0x7f8c441512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c39e00640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 0x7f8c441512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c39e00640 1 -- 172.21.15.7:0/3358204875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c44152070 con 0x7f8c44161f50 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c39e00640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44161f50 0x7f8c4414fb10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c035040 tx=0x7f8c2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c3b400640 1 -- 172.21.15.7:0/3358204875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c041070 con 0x7f8c44161f50 2024-08-19T00:43:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c3b400640 1 -- 172.21.15.7:0/3358204875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2c03c660 con 0x7f8c44161f50 2024-08-19T00:43:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c3b400640 1 -- 172.21.15.7:0/3358204875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c037040 con 0x7f8c44161f50 2024-08-19T00:43:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c44151040 con 0x7f8c44161f50 2024-08-19T00:43:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.358+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c441561a0 con 0x7f8c44161f50 2024-08-19T00:43:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.360+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c44162c90 con 0x7f8c44161f50 2024-08-19T00:43:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.361+0000 7f8c3b400640 1 -- 172.21.15.7:0/3358204875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c2c044070 con 0x7f8c44161f50 2024-08-19T00:43:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.361+0000 7f8c3b400640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8c2006be30 0x7f8c2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.361+0000 7f8c3b400640 1 -- 172.21.15.7:0/3358204875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5472+0+0 (secure 0 0 0) 0x7f8c2c0ab5d0 con 0x7f8c44161f50 2024-08-19T00:43:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.362+0000 7f8c42800640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8c2006be30 0x7f8c2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.362+0000 7f8c42800640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8c2006be30 0x7f8c2006e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009ad0 tx=0x7f8c34008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.366+0000 7f8c3b400640 1 -- 172.21.15.7:0/3358204875 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8c2c07a220 con 0x7f8c44161f50 2024-08-19T00:43:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:16.556+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8c44072d90 con 0x7f8c44161f50 2024-08-19T00:43:17.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.162+0000 7f8c3b400640 1 -- 172.21.15.7:0/3358204875 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7f8c2c079b20 con 0x7f8c44161f50 2024-08-19T00:43:17.164 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-08-19T00:43:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.165+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8c2006be30 msgr2=0x7f8c2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.165+0000 7f8c49400640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8c2006be30 0x7f8c2006e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009ad0 tx=0x7f8c34008040 comp rx=0 tx=0).stop 2024-08-19T00:43:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44161f50 msgr2=0x7f8c4414fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44161f50 0x7f8c4414fb10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c035040 tx=0x7f8c2c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 shutdown_connections 2024-08-19T00:43:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8c2006be30 0x7f8c2006e2f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c44162870 0x7f8c441512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44161f50 0x7f8c4414fb10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 --2- 172.21.15.7:0/3358204875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c4406bd90 0x7f8c44156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.166+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 >> 172.21.15.7:0/3358204875 conn(0x7f8c44072ff0 msgr2=0x7f8c440b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.167+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 shutdown_connections 2024-08-19T00:43:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.167+0000 7f8c49400640 1 -- 172.21.15.7:0/3358204875 wait complete. 2024-08-19T00:43:17.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2024-08-19T00:43:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.356+0000 7fc671800640 1 Processor -- start 2024-08-19T00:43:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.356+0000 7fc671800640 1 -- start start 2024-08-19T00:43:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.357+0000 7fc671800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc66c06dce0 0x7fc66c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc671800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc66c0b58e0 con 0x7fc66c06fc10 2024-08-19T00:43:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc671800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc66c06cf60 con 0x7fc66c0b5450 2024-08-19T00:43:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc671800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc66c162d90 con 0x7fc66c06dce0 2024-08-19T00:43:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc663e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc66c06dce0 0x7fc66c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc66be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc66c06fc10 0x7fc66c06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34590/0 (socket says 172.21.15.7:34590) 2024-08-19T00:43:17.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc66be00640 1 -- 172.21.15.7:0/4141694734 learned_addr learned my addr 172.21.15.7:0/4141694734 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc663e00640 1 -- 172.21.15.7:0/4141694734 >> v1:172.21.15.162:6789/0 conn(0x7fc66c0b5450 legacy=0x7fc66c15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc663e00640 1 -- 172.21.15.7:0/4141694734 >> v1:172.21.15.7:6789/0 conn(0x7fc66c06fc10 legacy=0x7fc66c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.358+0000 7fc663e00640 1 -- 172.21.15.7:0/4141694734 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c06d200 con 0x7fc66c06dce0 2024-08-19T00:43:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.359+0000 7fc663e00640 1 --2- 172.21.15.7:0/4141694734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c06dce0 0x7fc66c0b4f10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc6540097a0 tx=0x7fc65402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c45675b7006ead server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc66b400640 1 -- 172.21.15.7:0/4141694734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654037070 con 0x7fc66c06dce0 2024-08-19T00:43:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc66b400640 1 -- 172.21.15.7:0/4141694734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65402ae50 con 0x7fc66c06dce0 2024-08-19T00:43:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc66b400640 1 -- 172.21.15.7:0/4141694734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654032660 con 0x7fc66c06dce0 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc671800640 1 -- 172.21.15.7:0/4141694734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c06dce0 msgr2=0x7fc66c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc671800640 1 --2- 172.21.15.7:0/4141694734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c06dce0 0x7fc66c0b4f10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc6540097a0 tx=0x7fc65402a140 comp rx=0 tx=0).stop 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc671800640 1 -- 172.21.15.7:0/4141694734 shutdown_connections 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc671800640 1 --2- 172.21.15.7:0/4141694734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c06dce0 0x7fc66c0b4f10 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc671800640 1 -- 172.21.15.7:0/4141694734 >> 172.21.15.7:0/4141694734 conn(0x7fc66c0d1fa0 msgr2=0x7fc66c0d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc671800640 1 -- 172.21.15.7:0/4141694734 shutdown_connections 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.360+0000 7fc671800640 1 -- 172.21.15.7:0/4141694734 wait complete. 2024-08-19T00:43:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.362+0000 7fc671800640 1 Processor -- start 2024-08-19T00:43:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.362+0000 7fc671800640 1 -- start start 2024-08-19T00:43:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc671800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c06dce0 0x7fc66c1622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc671800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c06fc10 0x7fc66c145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc671800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0b5450 0x7fc66c145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc671800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c06e120 con 0x7fc66c0b5450 2024-08-19T00:43:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc671800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c06d850 con 0x7fc66c06fc10 2024-08-19T00:43:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc671800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c0b5b60 con 0x7fc66c06dce0 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc670e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0b5450 0x7fc66c145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc670e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0b5450 0x7fc66c145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53852/0 (socket says 172.21.15.7:53852) 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc670e00640 1 -- 172.21.15.7:0/1387704989 learned_addr learned my addr 172.21.15.7:0/1387704989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc66be00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c06dce0 0x7fc66c1622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.363+0000 7fc663e00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c06fc10 0x7fc66c145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc670e00640 1 -- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c06dce0 msgr2=0x7fc66c1622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc670e00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c06dce0 0x7fc66c1622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc670e00640 1 -- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c06fc10 msgr2=0x7fc66c145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc670e00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c06fc10 0x7fc66c145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc670e00640 1 -- 172.21.15.7:0/1387704989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c130420 con 0x7fc66c0b5450 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc670e00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0b5450 0x7fc66c145b80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc66400c780 tx=0x7fc66400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc668c00640 1 -- 172.21.15.7:0/1387704989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664004b60 con 0x7fc66c0b5450 2024-08-19T00:43:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc668c00640 1 -- 172.21.15.7:0/1387704989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc664004d00 con 0x7fc66c0b5450 2024-08-19T00:43:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c130700 con 0x7fc66c0b5450 2024-08-19T00:43:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.364+0000 7fc668c00640 1 -- 172.21.15.7:0/1387704989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66400aa90 con 0x7fc66c0b5450 2024-08-19T00:43:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.365+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c130cc0 con 0x7fc66c0b5450 2024-08-19T00:43:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.365+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66c147ee0 con 0x7fc66c0b5450 2024-08-19T00:43:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.366+0000 7fc668c00640 1 -- 172.21.15.7:0/1387704989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc66400ac30 con 0x7fc66c0b5450 2024-08-19T00:43:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.367+0000 7fc668c00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc64806be30 0x7fc64806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.367+0000 7fc668c00640 1 -- 172.21.15.7:0/1387704989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7fc66408ae00 con 0x7fc66c0b5450 2024-08-19T00:43:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.368+0000 7fc66be00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc64806be30 0x7fc64806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.368+0000 7fc66be00640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc64806be30 0x7fc64806e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc65c007fd0 tx=0x7fc65c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.372+0000 7fc668c00640 1 -- 172.21.15.7:0/1387704989 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc664020070 con 0x7fc66c0b5450 2024-08-19T00:43:17.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.557+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) -- 0x7fc66c0b1810 con 0x7fc66c0b5450 2024-08-19T00:43:17.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.557+0000 7fc668c00640 1 -- 172.21.15.7:0/1387704989 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fc664059360 con 0x7fc66c0b5450 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc64806be30 msgr2=0x7fc64806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc64806be30 0x7fc64806e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc65c007fd0 tx=0x7fc65c007e80 comp rx=0 tx=0).stop 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0b5450 msgr2=0x7fc66c145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0b5450 0x7fc66c145b80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc66400c780 tx=0x7fc66400cc40 comp rx=0 tx=0).stop 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 shutdown_connections 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc64806be30 0x7fc64806e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc66c0b5450 0x7fc66c145b80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c06fc10 0x7fc66c145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 --2- 172.21.15.7:0/1387704989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c06dce0 0x7fc66c1622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 >> 172.21.15.7:0/1387704989 conn(0x7fc66c0d1fa0 msgr2=0x7fc66c071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 shutdown_connections 2024-08-19T00:43:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.560+0000 7fc671800640 1 -- 172.21.15.7:0/1387704989 wait complete. 2024-08-19T00:43:17.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-19T00:43:17.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.735+0000 7fa748400640 1 Processor -- start 2024-08-19T00:43:17.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.735+0000 7fa748400640 1 -- start start 2024-08-19T00:43:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.736+0000 7fa748400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa740158cd0 0x7fa740072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.736+0000 7fa748400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7400ae480 0x7fa7400b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.736+0000 7fa748400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7400aeae0 con 0x7fa740072ff0 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.736+0000 7fa748400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa740073460 con 0x7fa7400ae480 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.736+0000 7fa748400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa7400aedc0 con 0x7fa740158cd0 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa746400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7400ae480 0x7fa7400b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa746400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7400ae480 0x7fa7400b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53868/0 (socket says 172.21.15.7:53868) 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa746400640 1 -- 172.21.15.7:0/4190277715 learned_addr learned my addr 172.21.15.7:0/4190277715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa745a00640 1 --2- 172.21.15.7:0/4190277715 >> v2:172.21.15.162:3300/0 conn(0x7fa740158cd0 0x7fa740072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa746400640 1 -- 172.21.15.7:0/4190277715 >> v2:172.21.15.162:3300/0 conn(0x7fa740158cd0 msgr2=0x7fa740072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa746400640 1 --2- 172.21.15.7:0/4190277715 >> v2:172.21.15.162:3300/0 conn(0x7fa740158cd0 0x7fa740072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa746400640 1 -- 172.21.15.7:0/4190277715 >> v1:172.21.15.162:6789/0 conn(0x7fa740072ff0 legacy=0x7fa7400add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:17.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.737+0000 7fa746400640 1 -- 172.21.15.7:0/4190277715 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7400af0a0 con 0x7fa7400ae480 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.738+0000 7fa746400640 1 --2- 172.21.15.7:0/4190277715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7400ae480 0x7fa7400b3150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa7400b2ca0 tx=0x7fa73802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b21378bd708168b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.738+0000 7fa73fe00640 1 -- 172.21.15.7:0/4190277715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738036070 con 0x7fa7400ae480 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.738+0000 7fa73fe00640 1 -- 172.21.15.7:0/4190277715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa738031600 con 0x7fa7400ae480 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.738+0000 7fa73fe00640 1 -- 172.21.15.7:0/4190277715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7380319d0 con 0x7fa7400ae480 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 -- 172.21.15.7:0/4190277715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7400ae480 msgr2=0x7fa7400b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 --2- 172.21.15.7:0/4190277715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7400ae480 0x7fa7400b3150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa7400b2ca0 tx=0x7fa73802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 -- 172.21.15.7:0/4190277715 shutdown_connections 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 --2- 172.21.15.7:0/4190277715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7400ae480 0x7fa7400b3150 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 --2- 172.21.15.7:0/4190277715 >> v2:172.21.15.162:3300/0 conn(0x7fa740158cd0 0x7fa740072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 -- 172.21.15.7:0/4190277715 >> 172.21.15.7:0/4190277715 conn(0x7fa7400b2300 msgr2=0x7fa74006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 -- 172.21.15.7:0/4190277715 shutdown_connections 2024-08-19T00:43:17.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.739+0000 7fa748400640 1 -- 172.21.15.7:0/4190277715 wait complete. 2024-08-19T00:43:17.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.741+0000 7fa748400640 1 Processor -- start 2024-08-19T00:43:17.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.741+0000 7fa748400640 1 -- start start 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa748400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa740072ff0 0x7fa74014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa748400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7400ae480 0x7fa7401e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa748400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7401e65a0 0x7fa74006e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa748400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7400b3690 con 0x7fa740072ff0 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa748400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7400af660 con 0x7fa7400ae480 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa748400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7400b3810 con 0x7fa7401e65a0 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa740072ff0 0x7fa74014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa740072ff0 0x7fa74014a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53878/0 (socket says 172.21.15.7:53878) 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 -- 172.21.15.7:0/1422550402 learned_addr learned my addr 172.21.15.7:0/1422550402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745000640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7400ae480 0x7fa7401e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa746400640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7401e65a0 0x7fa74006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 -- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7401e65a0 msgr2=0x7fa74006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7401e65a0 0x7fa74006e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 -- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7400ae480 msgr2=0x7fa7401e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7400ae480 0x7fa7401e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.742+0000 7fa745a00640 1 -- 172.21.15.7:0/1422550402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74006de10 con 0x7fa740072ff0 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.743+0000 7fa745000640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7400ae480 0x7fa7401e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.743+0000 7fa745a00640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa740072ff0 0x7fa74014a400 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d5f0 tx=0x7fa73400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.743+0000 7fa73d600640 1 -- 172.21.15.7:0/1422550402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7340125f0 con 0x7fa740072ff0 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.743+0000 7fa73d600640 1 -- 172.21.15.7:0/1422550402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa734019070 con 0x7fa740072ff0 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.743+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7401e50f0 con 0x7fa740072ff0 2024-08-19T00:43:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.743+0000 7fa73d600640 1 -- 172.21.15.7:0/1422550402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7340129d0 con 0x7fa740072ff0 2024-08-19T00:43:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.743+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7401e53d0 con 0x7fa740072ff0 2024-08-19T00:43:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.744+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7400b3150 con 0x7fa740072ff0 2024-08-19T00:43:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.745+0000 7fa73d600640 1 -- 172.21.15.7:0/1422550402 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa734012b70 con 0x7fa740072ff0 2024-08-19T00:43:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.746+0000 7fa73d600640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa72006be30 0x7fa72006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.746+0000 7fa73d600640 1 -- 172.21.15.7:0/1422550402 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7fa73408afb0 con 0x7fa740072ff0 2024-08-19T00:43:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.746+0000 7fa745000640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa72006be30 0x7fa72006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.747+0000 7fa745000640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa72006be30 0x7fa72006e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa7401527e0 tx=0x7fa72c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.750+0000 7fa73d600640 1 -- 172.21.15.7:0/1422550402 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa734059b60 con 0x7fa740072ff0 2024-08-19T00:43:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.936+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa7400cfd30 con 0x7fa740072ff0 2024-08-19T00:43:17.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.940+0000 7fa73d600640 1 -- 172.21.15.7:0/1422550402 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7fa734059460 con 0x7fa740072ff0 2024-08-19T00:43:17.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa72006be30 msgr2=0x7fa72006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa72006be30 0x7fa72006e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa7401527e0 tx=0x7fa72c009040 comp rx=0 tx=0).stop 2024-08-19T00:43:17.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa740072ff0 msgr2=0x7fa74014a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:17.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa740072ff0 0x7fa74014a400 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d5f0 tx=0x7fa73400dab0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 shutdown_connections 2024-08-19T00:43:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa72006be30 0x7fa72006e2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7401e65a0 0x7fa74006e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7400ae480 0x7fa7401e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 --2- 172.21.15.7:0/1422550402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa740072ff0 0x7fa74014a400 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 >> 172.21.15.7:0/1422550402 conn(0x7fa7400b2300 msgr2=0x7fa740072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 shutdown_connections 2024-08-19T00:43:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:17.942+0000 7fa748400640 1 -- 172.21.15.7:0/1422550402 wait complete. 2024-08-19T00:43:17.960 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush' 2024-08-19T00:43:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.114+0000 7f4570200640 1 Processor -- start 2024-08-19T00:43:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.115+0000 7f4570200640 1 -- start start 2024-08-19T00:43:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f4570200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4568159bf0 0x7f4568073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f4570200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680cec10 0x7f45680d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f4570200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456806f7f0 con 0x7f45680739a0 2024-08-19T00:43:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f4570200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f456806f510 con 0x7f4568159bf0 2024-08-19T00:43:18.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f4570200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4568072980 con 0x7f45680cec10 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f456d800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4568159bf0 0x7f4568073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f456e200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680cec10 0x7f45680d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f456d800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4568159bf0 0x7f4568073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:59236/0 (socket says 172.21.15.7:59236) 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f456d800640 1 -- 172.21.15.7:0/476114112 learned_addr learned my addr 172.21.15.7:0/476114112 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.116+0000 7f456ce00640 1 --1- 172.21.15.7:0/476114112 >> v1:172.21.15.162:6789/0 conn(0x7f45680739a0 0x7f45680ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:45820/0 (socket says 172.21.15.7:45820) 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.117+0000 7f456d800640 1 -- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680cec10 msgr2=0x7f45680d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.117+0000 7f456d800640 1 --2- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680cec10 0x7f45680d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.117+0000 7f456d800640 1 -- 172.21.15.7:0/476114112 >> v1:172.21.15.162:6789/0 conn(0x7f45680739a0 legacy=0x7f45680ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.117+0000 7f456d800640 1 -- 172.21.15.7:0/476114112 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4568072c60 con 0x7f4568159bf0 2024-08-19T00:43:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.117+0000 7f456e200640 1 --2- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680cec10 0x7f45680d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.118+0000 7f456d800640 1 --2- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4568159bf0 0x7f4568073460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f455c009870 tx=0x7f455c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e1cc5d2cdb6c82 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.118+0000 7f4567e00640 1 -- 172.21.15.7:0/476114112 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c037070 con 0x7f4568159bf0 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.118+0000 7f4567e00640 1 -- 172.21.15.7:0/476114112 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c032440 con 0x7f4568159bf0 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.118+0000 7f4567e00640 1 -- 172.21.15.7:0/476114112 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c032810 con 0x7f4568159bf0 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 -- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4568159bf0 msgr2=0x7f4568073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 --2- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4568159bf0 0x7f4568073460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f455c009870 tx=0x7f455c02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 -- 172.21.15.7:0/476114112 shutdown_connections 2024-08-19T00:43:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 --2- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680cec10 0x7f45680d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 --2- 172.21.15.7:0/476114112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4568159bf0 0x7f4568073460 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 -- 172.21.15.7:0/476114112 >> 172.21.15.7:0/476114112 conn(0x7f456806bc70 msgr2=0x7f456806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 -- 172.21.15.7:0/476114112 shutdown_connections 2024-08-19T00:43:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.119+0000 7f4570200640 1 -- 172.21.15.7:0/476114112 wait complete. 2024-08-19T00:43:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.121+0000 7f4570200640 1 Processor -- start 2024-08-19T00:43:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.121+0000 7f4570200640 1 -- start start 2024-08-19T00:43:18.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.121+0000 7f4570200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680739a0 0x7f4568151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.121+0000 7f4570200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4568159bf0 0x7f45681523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f4570200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45681e5b90 0x7f456815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f4570200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f456815a150 con 0x7f4568159bf0 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f4570200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4568159fd0 con 0x7f45681e5b90 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f4570200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45680d0900 con 0x7f45680739a0 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4568159bf0 0x7f45681523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4568159bf0 0x7f45681523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53884/0 (socket says 172.21.15.7:53884) 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 -- 172.21.15.7:0/3898790404 learned_addr learned my addr 172.21.15.7:0/3898790404 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456d800640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680739a0 0x7f4568151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:18.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456e200640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45681e5b90 0x7f456815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 -- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680739a0 msgr2=0x7f4568151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680739a0 0x7f4568151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 -- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45681e5b90 msgr2=0x7f456815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45681e5b90 0x7f456815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.122+0000 7f456ce00640 1 -- 172.21.15.7:0/3898790404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45681e6090 con 0x7f4568159bf0 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.123+0000 7f456ce00640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4568159bf0 0x7f45681523e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f455400c3c0 tx=0x7f455400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.123+0000 7f4565600640 1 -- 172.21.15.7:0/3898790404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45540074e0 con 0x7f4568159bf0 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.123+0000 7f4565600640 1 -- 172.21.15.7:0/3898790404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554007680 con 0x7f4568159bf0 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.123+0000 7f4565600640 1 -- 172.21.15.7:0/3898790404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554004a00 con 0x7f4568159bf0 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.123+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4568156a40 con 0x7f4568159bf0 2024-08-19T00:43:18.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.123+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456815de40 con 0x7f4568159bf0 2024-08-19T00:43:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.124+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4568156f60 con 0x7f4568159bf0 2024-08-19T00:43:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.125+0000 7f4565600640 1 -- 172.21.15.7:0/3898790404 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f455401a020 con 0x7f4568159bf0 2024-08-19T00:43:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.126+0000 7f4565600640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f454806be60 0x7f454806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.126+0000 7f4565600640 1 -- 172.21.15.7:0/3898790404 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f455408a170 con 0x7f4568159bf0 2024-08-19T00:43:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.126+0000 7f456d800640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f454806be60 0x7f454806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.127+0000 7f456d800640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f454806be60 0x7f454806e320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f455c034000 tx=0x7f455c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:18.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.131+0000 7f4565600640 1 -- 172.21.15.7:0/3898790404 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4554058db0 con 0x7f4568159bf0 2024-08-19T00:43:18.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:18.384+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]} v 0) -- 0x7f4568160c20 con 0x7f4568159bf0 2024-08-19T00:43:19.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.180+0000 7f4565600640 1 -- 172.21.15.7:0/3898790404 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]}]=0 v313) ==== 141+0+0 (secure 0 0 0) 0x7f45540586b0 con 0x7f4568159bf0 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f454806be60 msgr2=0x7f454806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f454806be60 0x7f454806e320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f455c034000 tx=0x7f455c02e000 comp rx=0 tx=0).stop 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4568159bf0 msgr2=0x7f45681523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4568159bf0 0x7f45681523e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f455400c3c0 tx=0x7f455400c7c0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 shutdown_connections 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f454806be60 0x7f454806e320 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45681e5b90 0x7f456815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4568159bf0 0x7f45681523e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 --2- 172.21.15.7:0/3898790404 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45680739a0 0x7f4568151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 >> 172.21.15.7:0/3898790404 conn(0x7f456806bc70 msgr2=0x7f456815b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 shutdown_connections 2024-08-19T00:43:19.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.183+0000 7f4570200640 1 -- 172.21.15.7:0/3898790404 wait complete. 2024-08-19T00:43:19.203 INFO:tasks.cephfs_test_runner:That the MDS won't write a dentry with new damage to CDentry::first ... ok 2024-08-19T00:43:19.203 INFO:tasks.cephfs_test_runner:Starting test: test_object_deletion (tasks.cephfs.test_damage.TestDamage) That the MDS has a clean 'damaged' response to loss of any single metadata object 2024-08-19T00:43:19.203 INFO:tasks.cephfs_test_runner:test_object_deletion (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:43:19.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:43:19.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.365+0000 7facb1800640 1 Processor -- start 2024-08-19T00:43:19.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.365+0000 7facb1800640 1 -- start start 2024-08-19T00:43:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.366+0000 7facb1800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7facac15bd70 0x7facac072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.366+0000 7facb1800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facac0733f0 con 0x7facac06dd10 2024-08-19T00:43:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.366+0000 7facb1800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facac0736d0 con 0x7facac072f70 2024-08-19T00:43:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.366+0000 7facb1800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7facac0739b0 con 0x7facac15bd70 2024-08-19T00:43:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.367+0000 7facabe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7facac15bd70 0x7facac072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.367+0000 7facb0e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7facac06dd10 0x7facac15cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34598/0 (socket says 172.21.15.7:34598) 2024-08-19T00:43:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.367+0000 7facb0e00640 1 -- 172.21.15.7:0/3156419020 learned_addr learned my addr 172.21.15.7:0/3156419020 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.367+0000 7facabe00640 1 -- 172.21.15.7:0/3156419020 >> v1:172.21.15.162:6789/0 conn(0x7facac072f70 legacy=0x7facac06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.367+0000 7facabe00640 1 -- 172.21.15.7:0/3156419020 >> v1:172.21.15.7:6789/0 conn(0x7facac06dd10 legacy=0x7facac15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.367+0000 7facabe00640 1 -- 172.21.15.7:0/3156419020 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac15c4a0 con 0x7facac15bd70 2024-08-19T00:43:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.367+0000 7facaaa00640 1 -- 172.21.15.7:0/3156419020 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429426343 0 0) 0x7facac0733f0 con 0x7facac06dd10 2024-08-19T00:43:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.368+0000 7facabe00640 1 --2- 172.21.15.7:0/3156419020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac072a30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0097a0 tx=0x7fac9c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afa2d48b17f8a8e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facaaa00640 1 -- 172.21.15.7:0/3156419020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c037070 con 0x7facac15bd70 2024-08-19T00:43:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facaaa00640 1 -- 172.21.15.7:0/3156419020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9c032440 con 0x7facac15bd70 2024-08-19T00:43:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facaaa00640 1 -- 172.21.15.7:0/3156419020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c032810 con 0x7facac15bd70 2024-08-19T00:43:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facb1800640 1 -- 172.21.15.7:0/3156419020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 msgr2=0x7facac072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facb1800640 1 --2- 172.21.15.7:0/3156419020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac072a30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0097a0 tx=0x7fac9c02a1a0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facb1800640 1 -- 172.21.15.7:0/3156419020 shutdown_connections 2024-08-19T00:43:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facb1800640 1 --2- 172.21.15.7:0/3156419020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac072a30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facb1800640 1 -- 172.21.15.7:0/3156419020 >> 172.21.15.7:0/3156419020 conn(0x7facac06b850 msgr2=0x7facac06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facb1800640 1 -- 172.21.15.7:0/3156419020 shutdown_connections 2024-08-19T00:43:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.369+0000 7facb1800640 1 -- 172.21.15.7:0/3156419020 wait complete. 2024-08-19T00:43:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.371+0000 7facb1800640 1 Processor -- start 2024-08-19T00:43:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.371+0000 7facb1800640 1 -- start start 2024-08-19T00:43:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac06dd10 0x7facac153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac072f70 0x7facac159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb1800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7facac06e3a0 con 0x7facac15bd70 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb1800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7facac15c150 con 0x7facac06dd10 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb1800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7facac06e520 con 0x7facac072f70 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac15a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53902/0 (socket says 172.21.15.7:53902) 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facb0e00640 1 -- 172.21.15.7:0/2840723716 learned_addr learned my addr 172.21.15.7:0/2840723716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facabe00640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac06dd10 0x7facac153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.372+0000 7facab400640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac072f70 0x7facac159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb0e00640 1 -- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac072f70 msgr2=0x7facac159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb0e00640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac072f70 0x7facac159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb0e00640 1 -- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac06dd10 msgr2=0x7facac153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb0e00640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac06dd10 0x7facac153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb0e00640 1 -- 172.21.15.7:0/2840723716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac156330 con 0x7facac15bd70 2024-08-19T00:43:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb0e00640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac15a390 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faca400c6d0 tx=0x7faca400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7faca3e00640 1 -- 172.21.15.7:0/2840723716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4018070 con 0x7facac15bd70 2024-08-19T00:43:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7faca3e00640 1 -- 172.21.15.7:0/2840723716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca4004d60 con 0x7facac15bd70 2024-08-19T00:43:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7faca3e00640 1 -- 172.21.15.7:0/2840723716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca400a880 con 0x7facac15bd70 2024-08-19T00:43:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facac13e3d0 con 0x7facac15bd70 2024-08-19T00:43:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.373+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facac1540b0 con 0x7facac15bd70 2024-08-19T00:43:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.375+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facac13e9e0 con 0x7facac15bd70 2024-08-19T00:43:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.375+0000 7faca3e00640 1 -- 172.21.15.7:0/2840723716 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faca400ac30 con 0x7facac15bd70 2024-08-19T00:43:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.377+0000 7faca3e00640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.377+0000 7faca3e00640 1 -- 172.21.15.7:0/2840723716 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7faca408a280 con 0x7facac15bd70 2024-08-19T00:43:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.377+0000 7facabe00640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.378+0000 7facabe00640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac9c034000 tx=0x7fac9c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.381+0000 7faca3e00640 1 -- 172.21.15.7:0/2840723716 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faca4058910 con 0x7facac15bd70 2024-08-19T00:43:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.568+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facac13e1c0 con 0x7facac15bd70 2024-08-19T00:43:19.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.569+0000 7faca3e00640 1 -- 172.21.15.7:0/2840723716 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13111 (secure 0 0 0) 0x7faca405cc10 con 0x7facac15bd70 2024-08-19T00:43:19.570 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:19.571 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":78,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:43:17.160782+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3281733316":"2024-08-20T00:43:14.102106+0000","172.21.15.7:6834/3281733316":"2024-08-20T00:43:14.102106+0000","172.21.15.7:6837/2626740684":"2024-08-20T00:43:05.101401+0000","172.21.15.7:6835/2626740684":"2024-08-20T00:43:05.101401+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 msgr2=0x7fac8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac9c034000 tx=0x7fac9c02e000 comp rx=0 tx=0).stop 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 msgr2=0x7facac15a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac15a390 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faca400c6d0 tx=0x7faca400cb90 comp rx=0 tx=0).stop 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 shutdown_connections 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac15bd70 0x7facac15a390 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac072f70 0x7facac159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 --2- 172.21.15.7:0/2840723716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac06dd10 0x7facac153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 >> 172.21.15.7:0/2840723716 conn(0x7facac06b850 msgr2=0x7facac15d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 shutdown_connections 2024-08-19T00:43:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.571+0000 7facb1800640 1 -- 172.21.15.7:0/2840723716 wait complete. 2024-08-19T00:43:19.588 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:36:51.315746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:43:19.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T00:43:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.746+0000 7f6b87000640 1 Processor -- start 2024-08-19T00:43:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.746+0000 7f6b87000640 1 -- start start 2024-08-19T00:43:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.747+0000 7f6b87000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6b800b3620 0x7f6b8006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.747+0000 7f6b87000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b8006f720 0x7f6b800acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.747+0000 7f6b87000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b8015e720 con 0x7f6b800aed00 2024-08-19T00:43:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.747+0000 7f6b87000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6b800b3c00 con 0x7f6b8006f720 2024-08-19T00:43:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.747+0000 7f6b87000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6b80072450 con 0x7f6b800b3620 2024-08-19T00:43:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b85000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b8006f720 0x7f6b800acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b85000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b8006f720 0x7f6b800acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53912/0 (socket says 172.21.15.7:53912) 2024-08-19T00:43:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b85000640 1 -- 172.21.15.7:0/3223323735 learned_addr learned my addr 172.21.15.7:0/3223323735 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b77e00640 1 --2- 172.21.15.7:0/3223323735 >> v2:172.21.15.162:3300/0 conn(0x7f6b800b3620 0x7f6b8006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b85000640 1 -- 172.21.15.7:0/3223323735 >> v2:172.21.15.162:3300/0 conn(0x7f6b800b3620 msgr2=0x7f6b8006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b85000640 1 --2- 172.21.15.7:0/3223323735 >> v2:172.21.15.162:3300/0 conn(0x7f6b800b3620 0x7f6b8006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b85000640 1 -- 172.21.15.7:0/3223323735 >> v1:172.21.15.162:6789/0 conn(0x7f6b800aed00 legacy=0x7f6b800b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.748+0000 7f6b85000640 1 -- 172.21.15.7:0/3223323735 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b80072730 con 0x7f6b8006f720 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.749+0000 7f6b85000640 1 --2- 172.21.15.7:0/3223323735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b800acef0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6b80161de0 tx=0x7f6b7802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42fcd8a8c020f8d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b7f400640 1 -- 172.21.15.7:0/3223323735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78036070 con 0x7f6b8006f720 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b7f400640 1 -- 172.21.15.7:0/3223323735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b78031600 con 0x7f6b8006f720 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b7f400640 1 -- 172.21.15.7:0/3223323735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b780319d0 con 0x7f6b8006f720 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 -- 172.21.15.7:0/3223323735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 msgr2=0x7f6b800acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 --2- 172.21.15.7:0/3223323735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b800acef0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6b80161de0 tx=0x7f6b7802a610 comp rx=0 tx=0).stop 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 -- 172.21.15.7:0/3223323735 shutdown_connections 2024-08-19T00:43:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 --2- 172.21.15.7:0/3223323735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b800acef0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 --2- 172.21.15.7:0/3223323735 >> v2:172.21.15.162:3300/0 conn(0x7f6b800b3620 0x7f6b8006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 -- 172.21.15.7:0/3223323735 >> 172.21.15.7:0/3223323735 conn(0x7f6b800b2300 msgr2=0x7f6b8006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 -- 172.21.15.7:0/3223323735 shutdown_connections 2024-08-19T00:43:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.750+0000 7f6b87000640 1 -- 172.21.15.7:0/3223323735 wait complete. 2024-08-19T00:43:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.752+0000 7f6b87000640 1 Processor -- start 2024-08-19T00:43:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.752+0000 7f6b87000640 1 -- start start 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b87000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b80157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b87000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b800aed00 0x7f6b80158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b87000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b800b3620 0x7f6b8015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b87000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b800ad430 con 0x7f6b8006f720 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b87000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80072cf0 con 0x7f6b800b3620 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b87000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b800ad5b0 con 0x7f6b800aed00 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b80157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b80157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53926/0 (socket says 172.21.15.7:53926) 2024-08-19T00:43:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b7fe00640 1 -- 172.21.15.7:0/544070691 learned_addr learned my addr 172.21.15.7:0/544070691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b77e00640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b800aed00 0x7f6b80158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.753+0000 7f6b85000640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b800b3620 0x7f6b8015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7fe00640 1 -- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b800aed00 msgr2=0x7f6b80158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7fe00640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b800aed00 0x7f6b80158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7fe00640 1 -- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b800b3620 msgr2=0x7f6b8015a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7fe00640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b800b3620 0x7f6b8015a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7fe00640 1 -- 172.21.15.7:0/544070691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8015b740 con 0x7f6b8006f720 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7fe00640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b80157bc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c400 tx=0x7f6b7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7cc00640 1 -- 172.21.15.7:0/544070691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b700052d0 con 0x7f6b8006f720 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7cc00640 1 -- 172.21.15.7:0/544070691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b70005490 con 0x7f6b8006f720 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b7cc00640 1 -- 172.21.15.7:0/544070691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70007260 con 0x7f6b8006f720 2024-08-19T00:43:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8015b180 con 0x7f6b8006f720 2024-08-19T00:43:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.754+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8009ab10 con 0x7f6b8006f720 2024-08-19T00:43:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.755+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b800acef0 con 0x7f6b8006f720 2024-08-19T00:43:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.756+0000 7f6b7cc00640 1 -- 172.21.15.7:0/544070691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b70007400 con 0x7f6b8006f720 2024-08-19T00:43:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.757+0000 7f6b7cc00640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b5c06be30 0x7f6b5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.757+0000 7f6b7cc00640 1 -- 172.21.15.7:0/544070691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f6b7008a140 con 0x7f6b8006f720 2024-08-19T00:43:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.758+0000 7f6b77e00640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b5c06be30 0x7f6b5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.758+0000 7f6b77e00640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b5c06be30 0x7f6b5c06e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b8015dd30 tx=0x7f6b68009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.762+0000 7f6b7cc00640 1 -- 172.21.15.7:0/544070691 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6b8015e720 con 0x7f6b8006f720 2024-08-19T00:43:19.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.948+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6b8006f100 con 0x7f6b8006f720 2024-08-19T00:43:19.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.949+0000 7f6b7cc00640 1 -- 172.21.15.7:0/544070691 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f6b700586a0 con 0x7f6b8006f720 2024-08-19T00:43:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b5c06be30 msgr2=0x7f6b5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b5c06be30 0x7f6b5c06e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b8015dd30 tx=0x7f6b68009190 comp rx=0 tx=0).stop 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 msgr2=0x7f6b80157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b80157bc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c400 tx=0x7f6b7000c8c0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 shutdown_connections 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b5c06be30 0x7f6b5c06e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b800b3620 0x7f6b8015a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b800aed00 0x7f6b80158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 --2- 172.21.15.7:0/544070691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b8006f720 0x7f6b80157bc0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 >> 172.21.15.7:0/544070691 conn(0x7f6b800b2300 msgr2=0x7f6b80160c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 shutdown_connections 2024-08-19T00:43:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:19.951+0000 7f6b87000640 1 -- 172.21.15.7:0/544070691 wait complete. 2024-08-19T00:43:19.969 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion' 2024-08-19T00:43:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.124+0000 7fcba0c00640 1 Processor -- start 2024-08-19T00:43:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.125+0000 7fcba0c00640 1 -- start start 2024-08-19T00:43:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcba0c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0d03c0 0x7fcb9c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcba0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb9c06e710 0x7fcb9c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcba0c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9c0d0ce0 con 0x7fcb9c0b3750 2024-08-19T00:43:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcba0c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c0cebc0 con 0x7fcb9c06e710 2024-08-19T00:43:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcba0c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c0cdfb0 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcb91400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb9c06e710 0x7fcb9c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcb9a800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcb9c0b3750 0x7fcb9c0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34608/0 (socket says 172.21.15.7:34608) 2024-08-19T00:43:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcb9a800640 1 -- 172.21.15.7:0/775983519 learned_addr learned my addr 172.21.15.7:0/775983519 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.126+0000 7fcb99e00640 1 --2- 172.21.15.7:0/775983519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0d03c0 0x7fcb9c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.127+0000 7fcb91400640 1 -- 172.21.15.7:0/775983519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0d03c0 msgr2=0x7fcb9c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.127+0000 7fcb91400640 1 --2- 172.21.15.7:0/775983519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0d03c0 0x7fcb9c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.127+0000 7fcb91400640 1 -- 172.21.15.7:0/775983519 >> v1:172.21.15.7:6789/0 conn(0x7fcb9c0b3750 legacy=0x7fcb9c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.127+0000 7fcb91400640 1 -- 172.21.15.7:0/775983519 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c0ce290 con 0x7fcb9c06e710 2024-08-19T00:43:20.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.128+0000 7fcb91400640 1 --2- 172.21.15.7:0/775983519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c06e710 0x7fcb9c0d07a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcb840097a0 tx=0x7fcb8402c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9a9f868455a806 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:20.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.128+0000 7fcb99400640 1 -- 172.21.15.7:0/775983519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84039070 con 0x7fcb9c06e710 2024-08-19T00:43:20.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.128+0000 7fcb99400640 1 -- 172.21.15.7:0/775983519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb84034640 con 0x7fcb9c06e710 2024-08-19T00:43:20.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.128+0000 7fcb99400640 1 -- 172.21.15.7:0/775983519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84034a10 con 0x7fcb9c06e710 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.128+0000 7fcba0c00640 1 -- 172.21.15.7:0/775983519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c06e710 msgr2=0x7fcb9c0d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.128+0000 7fcba0c00640 1 --2- 172.21.15.7:0/775983519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c06e710 0x7fcb9c0d07a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcb840097a0 tx=0x7fcb8402c390 comp rx=0 tx=0).stop 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.129+0000 7fcba0c00640 1 -- 172.21.15.7:0/775983519 shutdown_connections 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.129+0000 7fcba0c00640 1 --2- 172.21.15.7:0/775983519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c06e710 0x7fcb9c0d07a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.129+0000 7fcba0c00640 1 --2- 172.21.15.7:0/775983519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0d03c0 0x7fcb9c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.129+0000 7fcba0c00640 1 -- 172.21.15.7:0/775983519 >> 172.21.15.7:0/775983519 conn(0x7fcb9c06bc70 msgr2=0x7fcb9c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.129+0000 7fcba0c00640 1 -- 172.21.15.7:0/775983519 shutdown_connections 2024-08-19T00:43:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.129+0000 7fcba0c00640 1 -- 172.21.15.7:0/775983519 wait complete. 2024-08-19T00:43:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.130+0000 7fcba0c00640 1 Processor -- start 2024-08-19T00:43:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.130+0000 7fcba0c00640 1 -- start start 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.131+0000 7fcba0c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb9c06e710 0x7fcb9c1f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.131+0000 7fcba0c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0b3750 0x7fcb9c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.131+0000 7fcba0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c0d03c0 0x7fcb9c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.131+0000 7fcba0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c073ae0 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.131+0000 7fcba0c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c0ce850 con 0x7fcb9c06e710 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.131+0000 7fcba0c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c073c60 con 0x7fcb9c0b3750 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c0d03c0 0x7fcb9c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c0d03c0 0x7fcb9c154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53946/0 (socket says 172.21.15.7:53946) 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 -- 172.21.15.7:0/817804831 learned_addr learned my addr 172.21.15.7:0/817804831 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb91400640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0b3750 0x7fcb9c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb99e00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb9c06e710 0x7fcb9c1f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 -- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0b3750 msgr2=0x7fcb9c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0b3750 0x7fcb9c0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 -- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb9c06e710 msgr2=0x7fcb9c1f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb9c06e710 0x7fcb9c1f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 -- 172.21.15.7:0/817804831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c0cb790 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.132+0000 7fcb9a800640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c0d03c0 0x7fcb9c154590 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400cbf0 tx=0x7fcb9400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.133+0000 7fcb92a00640 1 -- 172.21.15.7:0/817804831 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94017070 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.133+0000 7fcb92a00640 1 -- 172.21.15.7:0/817804831 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9400ad40 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.133+0000 7fcb92a00640 1 -- 172.21.15.7:0/817804831 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94012600 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.133+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c0cba70 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.133+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c15bb50 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.134+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9c0b3be0 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.135+0000 7fcb92a00640 1 -- 172.21.15.7:0/817804831 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb9401a070 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.136+0000 7fcb92a00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb7806be30 0x7fcb7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:20.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.136+0000 7fcb92a00640 1 -- 172.21.15.7:0/817804831 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7fcb9408a880 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.136+0000 7fcb99e00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb7806be30 0x7fcb7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:20.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.137+0000 7fcb99e00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb7806be30 0x7fcb7806e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009ad0 tx=0x7fcb8c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:20.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.140+0000 7fcb92a00640 1 -- 172.21.15.7:0/817804831 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcb94058e80 con 0x7fcb9c0d03c0 2024-08-19T00:43:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:20.396+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]} v 0) -- 0x7fcb9c0cbc40 con 0x7fcb9c0d03c0 2024-08-19T00:43:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.188+0000 7fcb92a00640 1 -- 172.21.15.7:0/817804831 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]}]=0 v315) ==== 138+0+0 (secure 0 0 0) 0x7fcb9405d180 con 0x7fcb9c0d03c0 2024-08-19T00:43:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb7806be30 msgr2=0x7fcb7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb7806be30 0x7fcb7806e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009ad0 tx=0x7fcb8c008040 comp rx=0 tx=0).stop 2024-08-19T00:43:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c0d03c0 msgr2=0x7fcb9c154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c0d03c0 0x7fcb9c154590 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400cbf0 tx=0x7fcb9400a430 comp rx=0 tx=0).stop 2024-08-19T00:43:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 shutdown_connections 2024-08-19T00:43:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcb7806be30 0x7fcb7806e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb9c0d03c0 0x7fcb9c154590 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb9c0b3750 0x7fcb9c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 --2- 172.21.15.7:0/817804831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb9c06e710 0x7fcb9c1f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.191+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 >> 172.21.15.7:0/817804831 conn(0x7fcb9c06bc70 msgr2=0x7fcb9c0ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.192+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 shutdown_connections 2024-08-19T00:43:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.192+0000 7fcba0c00640 1 -- 172.21.15.7:0/817804831 wait complete. 2024-08-19T00:43:21.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-19T00:43:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.376+0000 7fd66cc00640 1 Processor -- start 2024-08-19T00:43:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.376+0000 7fd66cc00640 1 -- start start 2024-08-19T00:43:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.377+0000 7fd66cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd66815e3e0 0x7fd6680b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.377+0000 7fd66cc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6680b4df0 con 0x7fd6680d27b0 2024-08-19T00:43:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.377+0000 7fd66cc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6680b50d0 con 0x7fd6680b4150 2024-08-19T00:43:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.377+0000 7fd66cc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6680cf1e0 con 0x7fd66815e3e0 2024-08-19T00:43:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.377+0000 7fd666a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd6680d27b0 0x7fd6680d2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34614/0 (socket says 172.21.15.7:34614) 2024-08-19T00:43:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.377+0000 7fd666a00640 1 -- 172.21.15.7:0/1925423948 learned_addr learned my addr 172.21.15.7:0/1925423948 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd667400640 1 --2- 172.21.15.7:0/1925423948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd66815e3e0 0x7fd6680b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166653441 0 0) 0x7fd6680b4df0 con 0x7fd6680d27b0 2024-08-19T00:43:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd64c003520 con 0x7fd6680d27b0 2024-08-19T00:43:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743198029 0 0) 0x7fd6680b50d0 con 0x7fd6680b4150 2024-08-19T00:43:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6680b4df0 con 0x7fd6680b4150 2024-08-19T00:43:21.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd667400640 1 -- 172.21.15.7:0/1925423948 >> v1:172.21.15.162:6789/0 conn(0x7fd6680b4150 legacy=0x7fd6680b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd667400640 1 -- 172.21.15.7:0/1925423948 >> v1:172.21.15.7:6789/0 conn(0x7fd6680d27b0 legacy=0x7fd6680d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1713373931 0 0) 0x7fd64c003520 con 0x7fd6680d27b0 2024-08-19T00:43:21.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.378+0000 7fd667400640 1 -- 172.21.15.7:0/1925423948 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6680cf4c0 con 0x7fd66815e3e0 2024-08-19T00:43:21.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.379+0000 7fd667400640 1 --2- 172.21.15.7:0/1925423948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd66815e3e0 0x7fd6680b0e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097d0 tx=0x7fd65802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7048cae734e09731 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:21.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658037070 con 0x7fd66815e3e0 2024-08-19T00:43:21.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65802ac30 con 0x7fd66815e3e0 2024-08-19T00:43:21.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd666000640 1 -- 172.21.15.7:0/1925423948 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654001670 con 0x7fd66815e3e0 2024-08-19T00:43:21.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd66cc00640 1 -- 172.21.15.7:0/1925423948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd66815e3e0 msgr2=0x7fd6680b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd66cc00640 1 --2- 172.21.15.7:0/1925423948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd66815e3e0 0x7fd6680b0e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097d0 tx=0x7fd65802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd66cc00640 1 -- 172.21.15.7:0/1925423948 shutdown_connections 2024-08-19T00:43:21.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd66cc00640 1 --2- 172.21.15.7:0/1925423948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd66815e3e0 0x7fd6680b0e60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd66cc00640 1 -- 172.21.15.7:0/1925423948 >> 172.21.15.7:0/1925423948 conn(0x7fd66808dbe0 msgr2=0x7fd66809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:21.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd66cc00640 1 -- 172.21.15.7:0/1925423948 shutdown_connections 2024-08-19T00:43:21.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.380+0000 7fd66cc00640 1 -- 172.21.15.7:0/1925423948 wait complete. 2024-08-19T00:43:21.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.382+0000 7fd66cc00640 1 Processor -- start 2024-08-19T00:43:21.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.382+0000 7fd66cc00640 1 -- start start 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd66cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6680b4150 0x7fd66814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd66cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6680d27b0 0x7fd6681f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd66cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66815e3e0 0x7fd6680d0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd66cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680cf9e0 con 0x7fd6680d27b0 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd66cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680b13a0 con 0x7fd66815e3e0 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd66cc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6680cfb60 con 0x7fd6680b4150 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd666a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6680d27b0 0x7fd6681f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:21.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd666a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6680d27b0 0x7fd6681f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53958/0 (socket says 172.21.15.7:53958) 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd666a00640 1 -- 172.21.15.7:0/2317912808 learned_addr learned my addr 172.21.15.7:0/2317912808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd667400640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6680b4150 0x7fd66814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.383+0000 7fd667e00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66815e3e0 0x7fd6680d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd666a00640 1 -- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6680b4150 msgr2=0x7fd66814f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd666a00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6680b4150 0x7fd66814f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd666a00640 1 -- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66815e3e0 msgr2=0x7fd6680d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd666a00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66815e3e0 0x7fd6680d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd666a00640 1 -- 172.21.15.7:0/2317912808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6680cd160 con 0x7fd6680d27b0 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd666a00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6680d27b0 0x7fd6681f3ef0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c5a0 tx=0x7fd65400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd65f400640 1 -- 172.21.15.7:0/2317912808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654017070 con 0x7fd6680d27b0 2024-08-19T00:43:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd65f400640 1 -- 172.21.15.7:0/2317912808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654005ce0 con 0x7fd6680d27b0 2024-08-19T00:43:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd65f400640 1 -- 172.21.15.7:0/2317912808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6540072b0 con 0x7fd6680d27b0 2024-08-19T00:43:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.384+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6680cd440 con 0x7fd6680d27b0 2024-08-19T00:43:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.385+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66815f3b0 con 0x7fd6680d27b0 2024-08-19T00:43:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.385+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6680cd960 con 0x7fd6680d27b0 2024-08-19T00:43:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.386+0000 7fd65f400640 1 -- 172.21.15.7:0/2317912808 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd65401a070 con 0x7fd6680d27b0 2024-08-19T00:43:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.387+0000 7fd65f400640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd64806be30 0x7fd64806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.387+0000 7fd65f400640 1 -- 172.21.15.7:0/2317912808 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7fd654089fc0 con 0x7fd6680d27b0 2024-08-19T00:43:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.388+0000 7fd667400640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd64806be30 0x7fd64806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.388+0000 7fd667400640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd64806be30 0x7fd64806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd658034000 tx=0x7fd65802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.392+0000 7fd65f400640 1 -- 172.21.15.7:0/2317912808 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd654058650 con 0x7fd6680d27b0 2024-08-19T00:43:21.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.576+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd66815f1a0 con 0x7fd6680d27b0 2024-08-19T00:43:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.580+0000 7fd65f400640 1 -- 172.21.15.7:0/2317912808 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fd65405c950 con 0x7fd6680d27b0 2024-08-19T00:43:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd64806be30 msgr2=0x7fd64806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd64806be30 0x7fd64806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd658034000 tx=0x7fd65802e000 comp rx=0 tx=0).stop 2024-08-19T00:43:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6680d27b0 msgr2=0x7fd6681f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6680d27b0 0x7fd6681f3ef0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c5a0 tx=0x7fd65400ca60 comp rx=0 tx=0).stop 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 shutdown_connections 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd64806be30 0x7fd64806e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66815e3e0 0x7fd6680d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6680d27b0 0x7fd6681f3ef0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 --2- 172.21.15.7:0/2317912808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6680b4150 0x7fd66814f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 >> 172.21.15.7:0/2317912808 conn(0x7fd66808dbe0 msgr2=0x7fd6680d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 shutdown_connections 2024-08-19T00:43:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:21.582+0000 7fd66cc00640 1 -- 172.21.15.7:0/2317912808 wait complete. 2024-08-19T00:43:21.600 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:43:21.600 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:43:21.688 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:43:21.780 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:43:21.780 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:21.781 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:21.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:43:21.816 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:43:21.816 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:21.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:43:21.854 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:21.854 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:21.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:43:21.891 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:43:21.891 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:21.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:43:21.930 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-19T00:43:21.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:22.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.085+0000 7fd838600640 1 Processor -- start 2024-08-19T00:43:22.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.085+0000 7fd838600640 1 -- start start 2024-08-19T00:43:22.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.086+0000 7fd838600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd83015f5b0 0x7fd8300cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd838600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8300b4a90 0x7fd8300d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd838600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300cfaf0 con 0x7fd8300d03c0 2024-08-19T00:43:22.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd838600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd8300d0d60 con 0x7fd83015f5b0 2024-08-19T00:43:22.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd838600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd83015f990 con 0x7fd8300b4a90 2024-08-19T00:43:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd835c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd83015f5b0 0x7fd8300cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd835c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd83015f5b0 0x7fd8300cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53960/0 (socket says 172.21.15.7:53960) 2024-08-19T00:43:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd835c00640 1 -- 172.21.15.7:0/127484074 learned_addr learned my addr 172.21.15.7:0/127484074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd836600640 1 --2- 172.21.15.7:0/127484074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8300b4a90 0x7fd8300d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd835c00640 1 -- 172.21.15.7:0/127484074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8300b4a90 msgr2=0x7fd8300d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd835c00640 1 --2- 172.21.15.7:0/127484074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8300b4a90 0x7fd8300d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd835c00640 1 -- 172.21.15.7:0/127484074 >> v1:172.21.15.162:6789/0 conn(0x7fd8300d03c0 legacy=0x7fd8300b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd835c00640 1 -- 172.21.15.7:0/127484074 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300b50b0 con 0x7fd83015f5b0 2024-08-19T00:43:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.087+0000 7fd836600640 1 --2- 172.21.15.7:0/127484074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8300b4a90 0x7fd8300d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.088+0000 7fd835c00640 1 --2- 172.21.15.7:0/127484074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83015f5b0 0x7fd8300cf5b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd824009870 tx=0x7fd82402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e0d9104e138ce8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:22.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.088+0000 7fd82fe00640 1 -- 172.21.15.7:0/127484074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824037070 con 0x7fd83015f5b0 2024-08-19T00:43:22.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd82fe00640 1 -- 172.21.15.7:0/127484074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd824032440 con 0x7fd83015f5b0 2024-08-19T00:43:22.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd82fe00640 1 -- 172.21.15.7:0/127484074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824032810 con 0x7fd83015f5b0 2024-08-19T00:43:22.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 -- 172.21.15.7:0/127484074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83015f5b0 msgr2=0x7fd8300cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 --2- 172.21.15.7:0/127484074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83015f5b0 0x7fd8300cf5b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd824009870 tx=0x7fd82402a180 comp rx=0 tx=0).stop 2024-08-19T00:43:22.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 -- 172.21.15.7:0/127484074 shutdown_connections 2024-08-19T00:43:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 --2- 172.21.15.7:0/127484074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8300b4a90 0x7fd8300d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 --2- 172.21.15.7:0/127484074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83015f5b0 0x7fd8300cf5b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 -- 172.21.15.7:0/127484074 >> 172.21.15.7:0/127484074 conn(0x7fd83006bc70 msgr2=0x7fd83006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 -- 172.21.15.7:0/127484074 shutdown_connections 2024-08-19T00:43:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.089+0000 7fd838600640 1 -- 172.21.15.7:0/127484074 wait complete. 2024-08-19T00:43:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.091+0000 7fd838600640 1 Processor -- start 2024-08-19T00:43:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.091+0000 7fd838600640 1 -- start start 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd838600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8300b4a90 0x7fd830150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd838600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8300d03c0 0x7fd83015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd838600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd83015f5b0 0x7fd83015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd838600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300cedb0 con 0x7fd8300d03c0 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd838600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300cf120 con 0x7fd8300b4a90 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd838600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd83006e660 con 0x7fd83015f5b0 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd835200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8300d03c0 0x7fd83015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd835200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8300d03c0 0x7fd83015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53966/0 (socket says 172.21.15.7:53966) 2024-08-19T00:43:22.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd835200640 1 -- 172.21.15.7:0/640583236 learned_addr learned my addr 172.21.15.7:0/640583236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:22.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd835c00640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8300b4a90 0x7fd830150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.092+0000 7fd836600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd83015f5b0 0x7fd83015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd835200640 1 -- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd83015f5b0 msgr2=0x7fd83015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd835200640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd83015f5b0 0x7fd83015d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd835200640 1 -- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8300b4a90 msgr2=0x7fd830150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd835200640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8300b4a90 0x7fd830150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd835200640 1 -- 172.21.15.7:0/640583236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83015a3c0 con 0x7fd8300d03c0 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd836600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd83015f5b0 0x7fd83015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd835200640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8300d03c0 0x7fd83015ccb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00c460 tx=0x7fd81c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd82d600640 1 -- 172.21.15.7:0/640583236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c016020 con 0x7fd8300d03c0 2024-08-19T00:43:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd82d600640 1 -- 172.21.15.7:0/640583236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81c012870 con 0x7fd8300d03c0 2024-08-19T00:43:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd82d600640 1 -- 172.21.15.7:0/640583236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c012c60 con 0x7fd8300d03c0 2024-08-19T00:43:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83015a660 con 0x7fd8300d03c0 2024-08-19T00:43:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.093+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83015ac20 con 0x7fd8300d03c0 2024-08-19T00:43:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.094+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8300d0820 con 0x7fd8300d03c0 2024-08-19T00:43:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.095+0000 7fd82d600640 1 -- 172.21.15.7:0/640583236 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd81c019020 con 0x7fd8300d03c0 2024-08-19T00:43:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.097+0000 7fd82d600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd81006be30 0x7fd81006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.097+0000 7fd82d600640 1 -- 172.21.15.7:0/640583236 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7fd81c08a8f0 con 0x7fd8300d03c0 2024-08-19T00:43:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.097+0000 7fd835c00640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd81006be30 0x7fd81006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.098+0000 7fd835c00640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd81006be30 0x7fd81006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd824034000 tx=0x7fd82402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:22.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.101+0000 7fd82d600640 1 -- 172.21.15.7:0/640583236 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd81c020030 con 0x7fd8300d03c0 2024-08-19T00:43:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.320+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd830162e90 con 0x7fd8300d03c0 2024-08-19T00:43:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.321+0000 7fd82d600640 1 -- 172.21.15.7:0/640583236 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3905 (secure 0 0 0) 0x7fd81c0594a0 con 0x7fd8300d03c0 2024-08-19T00:43:22.323 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:22.323 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":78,"btime":"2024-08-19T00:43:15:147002+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/857454916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":857454916},{"type":"v1","addr":"172.21.15.162:6834","nonce":857454916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":5774,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1074731607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1074731607},{"type":"v1","addr":"172.21.15.7:6837","nonce":1074731607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":6133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/822715409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":822715409},{"type":"v1","addr":"172.21.15.162:6835","nonce":822715409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3809889953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3809889953},{"type":"v1","addr":"172.21.15.7:6836","nonce":3809889953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[]} 2024-08-19T00:43:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 78 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd81006be30 msgr2=0x7fd81006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd81006be30 0x7fd81006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd824034000 tx=0x7fd82402e000 comp rx=0 tx=0).stop 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8300d03c0 msgr2=0x7fd83015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8300d03c0 0x7fd83015ccb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00c460 tx=0x7fd81c00c920 comp rx=0 tx=0).stop 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 shutdown_connections 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd81006be30 0x7fd81006e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd83015f5b0 0x7fd83015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8300d03c0 0x7fd83015ccb0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 --2- 172.21.15.7:0/640583236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8300b4a90 0x7fd830150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 >> 172.21.15.7:0/640583236 conn(0x7fd83006bc70 msgr2=0x7fd830162690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 shutdown_connections 2024-08-19T00:43:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.323+0000 7fd838600640 1 -- 172.21.15.7:0/640583236 wait complete. 2024-08-19T00:43:22.341 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:43:22.341 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-19T00:43:22.341 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:43:22.342 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:43:22.342 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:43:22.342 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-19T00:43:22.342 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:43:22.342 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:43:22.342 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-19T00:43:22.342 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-19T00:43:22.343 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-19T00:43:22.343 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:43:22.343 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-19T00:43:22.343 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-19T00:43:22.343 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-19T00:43:22.343 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:43:22.357 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:43:22.357 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:43:22.358 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:43:22.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:43:22.360 INFO:tasks.ceph.mds.b:Stopped 2024-08-19T00:43:22.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-19T00:43:22.361 INFO:tasks.ceph.mds.d:Stopped 2024-08-19T00:43:22.361 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-19T00:43:22.400 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:43:22.401 DEBUG:teuthology.parallel:result is None 2024-08-19T00:43:22.403 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:43:22.403 DEBUG:teuthology.parallel:result is None 2024-08-19T00:43:22.404 INFO:tasks.ceph.mds.b:Started 2024-08-19T00:43:22.404 DEBUG:teuthology.parallel:result is None 2024-08-19T00:43:22.407 INFO:tasks.ceph.mds.d:Started 2024-08-19T00:43:22.407 DEBUG:teuthology.parallel:result is None 2024-08-19T00:43:22.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-19T00:43:22.533 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:43:22.533 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:43:22.539 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:43:22.539 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:43:22.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.572+0000 7f89a6c00640 1 Processor -- start 2024-08-19T00:43:22.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.573+0000 7f89a6c00640 1 -- start start 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f89a6c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89a00d03c0 0x7f89a0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f89a6c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a006e710 0x7f89a00d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f89a6c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a00d0ce0 con 0x7f89a00b3750 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f89a6c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f89a00cebc0 con 0x7f89a00d03c0 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f89a6c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89a00cdfb0 con 0x7f89a006e710 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f8997e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a006e710 0x7f89a00d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f899fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89a00d03c0 0x7f89a0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f8997e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a006e710 0x7f89a00d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52128/0 (socket says 172.21.15.7:52128) 2024-08-19T00:43:22.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f8997e00640 1 -- 172.21.15.7:0/3168620442 learned_addr learned my addr 172.21.15.7:0/3168620442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:22.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f8997e00640 1 -- 172.21.15.7:0/3168620442 >> v2:172.21.15.162:3300/0 conn(0x7f89a00d03c0 msgr2=0x7f89a0071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:22.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f8997e00640 1 --2- 172.21.15.7:0/3168620442 >> v2:172.21.15.162:3300/0 conn(0x7f89a00d03c0 0x7f89a0071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f8997e00640 1 -- 172.21.15.7:0/3168620442 >> v1:172.21.15.162:6789/0 conn(0x7f89a00b3750 legacy=0x7f89a00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.575+0000 7f8997e00640 1 -- 172.21.15.7:0/3168620442 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a00ce290 con 0x7f89a006e710 2024-08-19T00:43:22.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.574+0000 7f899f400640 1 -- 172.21.15.7:0/3168620442 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936928539 0 0) 0x7f89a00d0ce0 con 0x7f89a00b3750 2024-08-19T00:43:22.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f8997e00640 1 --2- 172.21.15.7:0/3168620442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a006e710 0x7f89a00d07a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f898800bb10 tx=0x7f898802c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf73b5138d55c97 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:22.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f899f400640 1 -- 172.21.15.7:0/3168620442 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988036020 con 0x7f89a006e710 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f899f400640 1 -- 172.21.15.7:0/3168620442 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8988032820 con 0x7f89a006e710 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f899f400640 1 -- 172.21.15.7:0/3168620442 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988032bf0 con 0x7f89a006e710 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f89a6c00640 1 -- 172.21.15.7:0/3168620442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a006e710 msgr2=0x7f89a00d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3168620442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a006e710 0x7f89a00d07a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f898800bb10 tx=0x7f898802c920 comp rx=0 tx=0).stop 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f89a6c00640 1 -- 172.21.15.7:0/3168620442 shutdown_connections 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3168620442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a006e710 0x7f89a00d07a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3168620442 >> v2:172.21.15.162:3300/0 conn(0x7f89a00d03c0 0x7f89a0071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.576+0000 7f89a6c00640 1 -- 172.21.15.7:0/3168620442 >> 172.21.15.7:0/3168620442 conn(0x7f89a006bc70 msgr2=0x7f89a006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.577+0000 7f89a6c00640 1 -- 172.21.15.7:0/3168620442 shutdown_connections 2024-08-19T00:43:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.577+0000 7f89a6c00640 1 -- 172.21.15.7:0/3168620442 wait complete. 2024-08-19T00:43:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.578+0000 7f89a6c00640 1 Processor -- start 2024-08-19T00:43:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.578+0000 7f89a6c00640 1 -- start start 2024-08-19T00:43:22.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.579+0000 7f89a6c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a006e710 0x7f89a01f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.579+0000 7f89a6c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a00b3750 0x7f89a015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.579+0000 7f89a6c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00d03c0 0x7f89a00724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.579+0000 7f89a6c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89a0073ae0 con 0x7f89a00b3750 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.579+0000 7f89a6c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89a00ce850 con 0x7f89a006e710 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.579+0000 7f89a6c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89a0073c60 con 0x7f89a00d03c0 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.579+0000 7f8997e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a00b3750 0x7f89a015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a00b3750 0x7f89a015e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54016/0 (socket says 172.21.15.7:54016) 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 -- 172.21.15.7:0/3606741855 learned_addr learned my addr 172.21.15.7:0/3606741855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f899fe00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a006e710 0x7f89a01f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f89a4c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00d03c0 0x7f89a00724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 -- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00d03c0 msgr2=0x7f89a00724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00d03c0 0x7f89a00724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 -- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a006e710 msgr2=0x7f89a01f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a006e710 0x7f89a01f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 -- 172.21.15.7:0/3606741855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a015e7e0 con 0x7f89a00b3750 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f89a4c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00d03c0 0x7f89a00724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.580+0000 7f8997e00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a00b3750 0x7f89a015e2a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8988000c00 tx=0x7f8988004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.581+0000 7f899cc00640 1 -- 172.21.15.7:0/3606741855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988031cb0 con 0x7f89a00b3750 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.581+0000 7f899cc00640 1 -- 172.21.15.7:0/3606741855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898803b420 con 0x7f89a00b3750 2024-08-19T00:43:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.581+0000 7f899cc00640 1 -- 172.21.15.7:0/3606741855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898803b810 con 0x7f89a00b3750 2024-08-19T00:43:22.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.581+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a015cbb0 con 0x7f89a00b3750 2024-08-19T00:43:22.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.581+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a015d170 con 0x7f89a00b3750 2024-08-19T00:43:22.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.582+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a00b3be0 con 0x7f89a00b3750 2024-08-19T00:43:22.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.583+0000 7f899cc00640 1 -- 172.21.15.7:0/3606741855 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8988039020 con 0x7f89a00b3750 2024-08-19T00:43:22.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.584+0000 7f899cc00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f897c06be60 0x7f897c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:22.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.584+0000 7f899cc00640 1 -- 172.21.15.7:0/3606741855 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f89880abb80 con 0x7f89a00b3750 2024-08-19T00:43:22.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.584+0000 7f899fe00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f897c06be60 0x7f897c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:22.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.585+0000 7f899fe00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f897c06be60 0x7f897c06e320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f89a0073250 tx=0x7f8990009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:22.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.589+0000 7f899cc00640 1 -- 172.21.15.7:0/3606741855 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f898802f070 con 0x7f89a00b3750 2024-08-19T00:43:22.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:22.784+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f89a015aa00 con 0x7f89a00b3750 2024-08-19T00:43:23.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.204+0000 7f899cc00640 1 -- 172.21.15.7:0/3606741855 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) ==== 97+0+0 (secure 0 0 0) 0x7f898807a290 con 0x7f89a00b3750 2024-08-19T00:43:23.206 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f897c06be60 msgr2=0x7f897c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f897c06be60 0x7f897c06e320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f89a0073250 tx=0x7f8990009190 comp rx=0 tx=0).stop 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a00b3750 msgr2=0x7f89a015e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a00b3750 0x7f89a015e2a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8988000c00 tx=0x7f8988004730 comp rx=0 tx=0).stop 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 shutdown_connections 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f897c06be60 0x7f897c06e320 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00d03c0 0x7f89a00724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a00b3750 0x7f89a015e2a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 --2- 172.21.15.7:0/3606741855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a006e710 0x7f89a01f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 >> 172.21.15.7:0/3606741855 conn(0x7f89a006bc70 msgr2=0x7f89a015ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:23.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 shutdown_connections 2024-08-19T00:43:23.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.208+0000 7f89a6c00640 1 -- 172.21.15.7:0/3606741855 wait complete. 2024-08-19T00:43:23.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-19T00:43:23.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.384+0000 7f3707800640 1 Processor -- start 2024-08-19T00:43:23.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.384+0000 7f3707800640 1 -- start start 2024-08-19T00:43:23.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.385+0000 7f3707800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009b730 0x7f370006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.385+0000 7f3707800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37000d0290 0x7f37000d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.385+0000 7f3707800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f370015ec30 con 0x7f370009aa70 2024-08-19T00:43:23.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.385+0000 7f3707800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f370015ef10 con 0x7f37000d0290 2024-08-19T00:43:23.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.385+0000 7f3707800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f370015f1f0 con 0x7f370009b730 2024-08-19T00:43:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f3704e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f370009aa70 0x7f370009ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:45878/0 (socket says 172.21.15.7:45878) 2024-08-19T00:43:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f3705800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37000d0290 0x7f37000d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f3704e00640 1 -- 172.21.15.7:0/750749697 learned_addr learned my addr 172.21.15.7:0/750749697 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f36ffe00640 1 --2- 172.21.15.7:0/750749697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009b730 0x7f370006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f36ff400640 1 -- 172.21.15.7:0/750749697 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2613733457 0 0) 0x7f370015ec30 con 0x7f370009aa70 2024-08-19T00:43:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f36ff400640 1 -- 172.21.15.7:0/750749697 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36e8003520 con 0x7f370009aa70 2024-08-19T00:43:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f36ffe00640 1 -- 172.21.15.7:0/750749697 >> v2:172.21.15.162:3300/0 conn(0x7f37000d0290 msgr2=0x7f37000d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f36ffe00640 1 --2- 172.21.15.7:0/750749697 >> v2:172.21.15.162:3300/0 conn(0x7f37000d0290 0x7f37000d0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f36ffe00640 1 -- 172.21.15.7:0/750749697 >> v1:172.21.15.162:6789/0 conn(0x7f370009aa70 legacy=0x7f370009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f36ffe00640 1 -- 172.21.15.7:0/750749697 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370015f4d0 con 0x7f370009b730 2024-08-19T00:43:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.386+0000 7f3705800640 1 --2- 172.21.15.7:0/750749697 >> v2:172.21.15.162:3300/0 conn(0x7f37000d0290 0x7f37000d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.387+0000 7f36ffe00640 1 --2- 172.21.15.7:0/750749697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009b730 0x7f370006fc30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0097d0 tx=0x7f36ec02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da90a39db18c965b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.387+0000 7f36ff400640 1 -- 172.21.15.7:0/750749697 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec037070 con 0x7f370009b730 2024-08-19T00:43:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.387+0000 7f36ff400640 1 -- 172.21.15.7:0/750749697 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec032440 con 0x7f370009b730 2024-08-19T00:43:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.387+0000 7f36ff400640 1 -- 172.21.15.7:0/750749697 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec032810 con 0x7f370009b730 2024-08-19T00:43:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 -- 172.21.15.7:0/750749697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009b730 msgr2=0x7f370006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 --2- 172.21.15.7:0/750749697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009b730 0x7f370006fc30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0097d0 tx=0x7f36ec02a1c0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 -- 172.21.15.7:0/750749697 shutdown_connections 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 --2- 172.21.15.7:0/750749697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009b730 0x7f370006fc30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 --2- 172.21.15.7:0/750749697 >> v2:172.21.15.162:3300/0 conn(0x7f37000d0290 0x7f37000d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 -- 172.21.15.7:0/750749697 >> 172.21.15.7:0/750749697 conn(0x7f37000d2190 msgr2=0x7f37000d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 -- 172.21.15.7:0/750749697 shutdown_connections 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.388+0000 7f3707800640 1 -- 172.21.15.7:0/750749697 wait complete. 2024-08-19T00:43:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.390+0000 7f3707800640 1 Processor -- start 2024-08-19T00:43:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.390+0000 7f3707800640 1 -- start start 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3707800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009aa70 0x7f3700161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3707800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370009b730 0x7f370014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3707800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37000d0290 0x7f37001f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3707800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37000d0c80 con 0x7f37000d0290 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3707800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f370015e8f0 con 0x7f370009b730 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3707800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37000d0e00 con 0x7f370009aa70 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37000d0290 0x7f37001f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37000d0290 0x7f37001f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54022/0 (socket says 172.21.15.7:54022) 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 -- 172.21.15.7:0/4056726914 learned_addr learned my addr 172.21.15.7:0/4056726914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3704e00640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009aa70 0x7f3700161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f36ffe00640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370009b730 0x7f370014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 -- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009aa70 msgr2=0x7f3700161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009aa70 0x7f3700161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 -- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370009b730 msgr2=0x7f370014ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370009b730 0x7f370014ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3705800640 1 -- 172.21.15.7:0/4056726914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37001f52d0 con 0x7f37000d0290 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f36ffe00640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370009b730 0x7f370014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.391+0000 7f3704e00640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009aa70 0x7f3700161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.392+0000 7f3705800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37000d0290 0x7f37001f7970 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f36f800efc0 tx=0x7f36f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.392+0000 7f36fcc00640 1 -- 172.21.15.7:0/4056726914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8018030 con 0x7f37000d0290 2024-08-19T00:43:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.392+0000 7f36fcc00640 1 -- 172.21.15.7:0/4056726914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f800cdf0 con 0x7f37000d0290 2024-08-19T00:43:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.392+0000 7f36fcc00640 1 -- 172.21.15.7:0/4056726914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8003bb0 con 0x7f37000d0290 2024-08-19T00:43:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.392+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37001629a0 con 0x7f37000d0290 2024-08-19T00:43:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.392+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37001626c0 con 0x7f37000d0290 2024-08-19T00:43:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.393+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370006fc30 con 0x7f37000d0290 2024-08-19T00:43:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.394+0000 7f36fcc00640 1 -- 172.21.15.7:0/4056726914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36f8005d10 con 0x7f37000d0290 2024-08-19T00:43:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.395+0000 7f36fcc00640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f36e006be30 0x7f36e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.395+0000 7f36fcc00640 1 -- 172.21.15.7:0/4056726914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7f36f808b520 con 0x7f37000d0290 2024-08-19T00:43:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.396+0000 7f3704e00640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f36e006be30 0x7f36e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.396+0000 7f3704e00640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f36e006be30 0x7f36e006e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f36f4007fd0 tx=0x7f36f4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.400+0000 7f36fcc00640 1 -- 172.21.15.7:0/4056726914 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f36f8022070 con 0x7f37000d0290 2024-08-19T00:43:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.650+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f37000d2cb0 con 0x7f37000d0290 2024-08-19T00:43:23.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.650+0000 7f36fcc00640 1 -- 172.21.15.7:0/4056726914 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f37001f52d0 con 0x7f37000d0290 2024-08-19T00:43:23.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:23.652 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:43:23.652 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-08-19T00:43:23.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.652 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g==", 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA==", 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ==", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:43:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA==", 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA==", 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ==", 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ==", 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w==", 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg==", 2024-08-19T00:43:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ==", 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA==", 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA==", 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA==", 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA==", 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ==", 2024-08-19T00:43:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg==", 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8Jmuq0sEBAA7n5q8IKlS3tRogqIwCSCeQ==", 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ==", 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:43:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg==", 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-08-19T00:43:23.666 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:43:23.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.652+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f36e006be30 msgr2=0x7f36e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.652+0000 7f3707800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f36e006be30 0x7f36e006e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f36f4007fd0 tx=0x7f36f4009040 comp rx=0 tx=0).stop 2024-08-19T00:43:23.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.652+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37000d0290 msgr2=0x7f37001f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.652+0000 7f3707800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37000d0290 0x7f37001f7970 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f36f800efc0 tx=0x7f36f800c490 comp rx=0 tx=0).stop 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 shutdown_connections 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f36e006be30 0x7f36e006e2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37000d0290 0x7f37001f7970 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370009b730 0x7f370014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 --2- 172.21.15.7:0/4056726914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f370009aa70 0x7f3700161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 >> 172.21.15.7:0/4056726914 conn(0x7f37000d2190 msgr2=0x7f37000d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 shutdown_connections 2024-08-19T00:43:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.653+0000 7f3707800640 1 -- 172.21.15.7:0/4056726914 wait complete. 2024-08-19T00:43:23.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-19T00:43:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.824+0000 7fbfaa000640 1 Processor -- start 2024-08-19T00:43:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.824+0000 7fbfaa000640 1 -- start start 2024-08-19T00:43:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.825+0000 7fbfaa000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa4071980 0x7fbfa40cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.825+0000 7fbfaa000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa40cdfb0 con 0x7fbfa40d03c0 2024-08-19T00:43:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.825+0000 7fbfaa000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa40ce290 con 0x7fbfa406e710 2024-08-19T00:43:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.825+0000 7fbfaa000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa40cebc0 con 0x7fbfa4071980 2024-08-19T00:43:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.825+0000 7fbfa3400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbfa40d03c0 0x7fbfa40d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53336/0 (socket says 172.21.15.7:53336) 2024-08-19T00:43:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa3400640 1 -- 172.21.15.7:0/1714216691 learned_addr learned my addr 172.21.15.7:0/1714216691 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa3e00640 1 --2- 172.21.15.7:0/1714216691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa4071980 0x7fbfa40cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa2000640 1 -- 172.21.15.7:0/1714216691 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764070445 0 0) 0x7fbfa40cdfb0 con 0x7fbfa40d03c0 2024-08-19T00:43:23.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa2000640 1 -- 172.21.15.7:0/1714216691 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf88003520 con 0x7fbfa40d03c0 2024-08-19T00:43:23.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa2000640 1 -- 172.21.15.7:0/1714216691 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896714514 0 0) 0x7fbfa40ce290 con 0x7fbfa406e710 2024-08-19T00:43:23.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa2000640 1 -- 172.21.15.7:0/1714216691 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfa40cdfb0 con 0x7fbfa406e710 2024-08-19T00:43:23.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa3e00640 1 -- 172.21.15.7:0/1714216691 >> v1:172.21.15.162:6789/0 conn(0x7fbfa406e710 legacy=0x7fbfa40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa3e00640 1 -- 172.21.15.7:0/1714216691 >> v1:172.21.15.7:6789/0 conn(0x7fbfa40d03c0 legacy=0x7fbfa40d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.826+0000 7fbfa3e00640 1 -- 172.21.15.7:0/1714216691 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa40ce570 con 0x7fbfa4071980 2024-08-19T00:43:23.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.827+0000 7fbfa3e00640 1 --2- 172.21.15.7:0/1714216691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa4071980 0x7fbfa40cf050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009df0 tx=0x7fbf9c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d04227ca0d9658e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:23.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfa2000640 1 -- 172.21.15.7:0/1714216691 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c007740 con 0x7fbfa4071980 2024-08-19T00:43:23.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfa2000640 1 -- 172.21.15.7:0/1714216691 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0078e0 con 0x7fbfa4071980 2024-08-19T00:43:23.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfa2000640 1 -- 172.21.15.7:0/1714216691 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c007cb0 con 0x7fbfa4071980 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfaa000640 1 -- 172.21.15.7:0/1714216691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa4071980 msgr2=0x7fbfa40cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfaa000640 1 --2- 172.21.15.7:0/1714216691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa4071980 0x7fbfa40cf050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009df0 tx=0x7fbf9c02a710 comp rx=0 tx=0).stop 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfaa000640 1 -- 172.21.15.7:0/1714216691 shutdown_connections 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfaa000640 1 --2- 172.21.15.7:0/1714216691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa4071980 0x7fbfa40cf050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfaa000640 1 -- 172.21.15.7:0/1714216691 >> 172.21.15.7:0/1714216691 conn(0x7fbfa406bc70 msgr2=0x7fbfa406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfaa000640 1 -- 172.21.15.7:0/1714216691 shutdown_connections 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.828+0000 7fbfaa000640 1 -- 172.21.15.7:0/1714216691 wait complete. 2024-08-19T00:43:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.830+0000 7fbfaa000640 1 Processor -- start 2024-08-19T00:43:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.830+0000 7fbfaa000640 1 -- start start 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfaa000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa406e710 0x7fbfa4152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfaa000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa4071980 0x7fbfa40cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfaa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa40d03c0 0x7fbfa415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfaa000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4073c60 con 0x7fbfa40d03c0 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfaa000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4073ae0 con 0x7fbfa4071980 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfaa000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa40cf590 con 0x7fbfa406e710 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa40d03c0 0x7fbfa415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfa3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa406e710 0x7fbfa4152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa40d03c0 0x7fbfa415e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47814/0 (socket says 172.21.15.7:47814) 2024-08-19T00:43:23.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfa2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa4071980 0x7fbfa40cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.831+0000 7fbfa3e00640 1 -- 172.21.15.7:0/3872987133 learned_addr learned my addr 172.21.15.7:0/3872987133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.832+0000 7fbfa3e00640 1 -- 172.21.15.7:0/3872987133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa406e710 msgr2=0x7fbfa4152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.832+0000 7fbfa3e00640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa406e710 0x7fbfa4152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.832+0000 7fbfa3e00640 1 -- 172.21.15.7:0/3872987133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa4071980 msgr2=0x7fbfa40cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.832+0000 7fbfa3e00640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa4071980 0x7fbfa40cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.832+0000 7fbfa3e00640 1 -- 172.21.15.7:0/3872987133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa40b2190 con 0x7fbfa40d03c0 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.832+0000 7fbfa2a00640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa4071980 0x7fbfa40cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.832+0000 7fbfa3e00640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa40d03c0 0x7fbfa415e070 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009f10 tx=0x7fbf9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.833+0000 7fbf9b400640 1 -- 172.21.15.7:0/3872987133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c040070 con 0x7fbfa40d03c0 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.833+0000 7fbf9b400640 1 -- 172.21.15.7:0/3872987133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c031bc0 con 0x7fbfa40d03c0 2024-08-19T00:43:23.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.833+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa41f40b0 con 0x7fbfa40d03c0 2024-08-19T00:43:23.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.833+0000 7fbf9b400640 1 -- 172.21.15.7:0/3872987133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c009450 con 0x7fbfa40d03c0 2024-08-19T00:43:23.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.833+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa4152e80 con 0x7fbfa40d03c0 2024-08-19T00:43:23.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.834+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa40cf050 con 0x7fbfa40d03c0 2024-08-19T00:43:23.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.835+0000 7fbf9b400640 1 -- 172.21.15.7:0/3872987133 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf9c039040 con 0x7fbfa40d03c0 2024-08-19T00:43:23.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.836+0000 7fbf9b400640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:23.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.836+0000 7fbf9b400640 1 -- 172.21.15.7:0/3872987133 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7fbf9c0ac120 con 0x7fbfa40d03c0 2024-08-19T00:43:23.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.836+0000 7fbfa3400640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:23.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.837+0000 7fbfa3400640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbf94000f60 tx=0x7fbf94007d70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:23.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:23.840+0000 7fbf9b400640 1 -- 172.21.15.7:0/3872987133 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbf9c07a860 con 0x7fbfa40d03c0 2024-08-19T00:43:24.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.026+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbfa41f4280 con 0x7fbfa40d03c0 2024-08-19T00:43:24.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.026+0000 7fbf9b400640 1 -- 172.21.15.7:0/3872987133 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7fbf9c07eb60 con 0x7fbfa40d03c0 2024-08-19T00:43:24.028 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:24.028 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:43:24.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:43:24.029 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-08-19T00:43:24.029 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-08-19T00:43:24.029 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:43:24.029 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 msgr2=0x7fbf8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbf94000f60 tx=0x7fbf94007d70 comp rx=0 tx=0).stop 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa40d03c0 msgr2=0x7fbfa415e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa40d03c0 0x7fbfa415e070 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009f10 tx=0x7fbf9c004a40 comp rx=0 tx=0).stop 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 shutdown_connections 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa40d03c0 0x7fbfa415e070 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa4071980 0x7fbfa40cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 --2- 172.21.15.7:0/3872987133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa406e710 0x7fbfa4152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 >> 172.21.15.7:0/3872987133 conn(0x7fbfa406bc70 msgr2=0x7fbfa40acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:24.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 shutdown_connections 2024-08-19T00:43:24.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.029+0000 7fbfaa000640 1 -- 172.21.15.7:0/3872987133 wait complete. 2024-08-19T00:43:24.046 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:43:24.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:43:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.206+0000 7f7efee00640 1 Processor -- start 2024-08-19T00:43:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.206+0000 7f7efee00640 1 -- start start 2024-08-19T00:43:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.207+0000 7f7efee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ef815de20 0x7f7ef80d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.207+0000 7f7efee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.207+0000 7f7efee00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ef80b4d30 0x7f7ef80d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.207+0000 7f7efee00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef80b51e0 con 0x7f7ef80b4d30 2024-08-19T00:43:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.207+0000 7f7efee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef80b4360 con 0x7f7ef815de20 2024-08-19T00:43:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.207+0000 7f7efee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef8162b80 con 0x7f7ef8161cb0 2024-08-19T00:43:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ef80b4d30 0x7f7ef80d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ef80b4d30 0x7f7ef80d3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47828/0 (socket says 172.21.15.7:47828) 2024-08-19T00:43:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efda00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ef815de20 0x7f7ef80d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 -- 172.21.15.7:0/3856748081 learned_addr learned my addr 172.21.15.7:0/3856748081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efd000640 1 --2- 172.21.15.7:0/3856748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 -- 172.21.15.7:0/3856748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 msgr2=0x7f7ef80b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 --2- 172.21.15.7:0/3856748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 -- 172.21.15.7:0/3856748081 >> v2:172.21.15.162:3300/0 conn(0x7f7ef815de20 msgr2=0x7f7ef80d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 --2- 172.21.15.7:0/3856748081 >> v2:172.21.15.162:3300/0 conn(0x7f7ef815de20 0x7f7ef80d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.208+0000 7f7efe400640 1 -- 172.21.15.7:0/3856748081 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef80b4010 con 0x7f7ef80b4d30 2024-08-19T00:43:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.209+0000 7f7efe400640 1 --2- 172.21.15.7:0/3856748081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef80b4d30 0x7f7ef80d3e80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009e50 tx=0x7f7ef002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e313a35cb05cc6a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.210+0000 7f7ef7e00640 1 -- 172.21.15.7:0/3856748081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0036070 con 0x7f7ef80b4d30 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.210+0000 7f7ef7e00640 1 -- 172.21.15.7:0/3856748081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef0031600 con 0x7f7ef80b4d30 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.210+0000 7f7ef7e00640 1 -- 172.21.15.7:0/3856748081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00319d0 con 0x7f7ef80b4d30 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 -- 172.21.15.7:0/3856748081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef80b4d30 msgr2=0x7f7ef80d3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 --2- 172.21.15.7:0/3856748081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef80b4d30 0x7f7ef80d3e80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009e50 tx=0x7f7ef002a6d0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 -- 172.21.15.7:0/3856748081 shutdown_connections 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 --2- 172.21.15.7:0/3856748081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef80b4d30 0x7f7ef80d3e80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 --2- 172.21.15.7:0/3856748081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 --2- 172.21.15.7:0/3856748081 >> v2:172.21.15.162:3300/0 conn(0x7f7ef815de20 0x7f7ef80d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 -- 172.21.15.7:0/3856748081 >> 172.21.15.7:0/3856748081 conn(0x7f7ef808dbe0 msgr2=0x7f7ef809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 -- 172.21.15.7:0/3856748081 shutdown_connections 2024-08-19T00:43:24.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.211+0000 7f7efee00640 1 -- 172.21.15.7:0/3856748081 wait complete. 2024-08-19T00:43:24.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.213+0000 7f7efee00640 1 Processor -- start 2024-08-19T00:43:24.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.213+0000 7f7efee00640 1 -- start start 2024-08-19T00:43:24.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80b4d30 0x7f7ef81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:24.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef815de20 0x7f7ef80b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:24.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:24.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef80d1960 con 0x7f7ef815de20 2024-08-19T00:43:24.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef80d1680 con 0x7f7ef80b4d30 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef80d1090 con 0x7f7ef8161cb0 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef815de20 0x7f7ef80b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef815de20 0x7f7ef80b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47832/0 (socket says 172.21.15.7:47832) 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efd000640 1 -- 172.21.15.7:0/3437974458 learned_addr learned my addr 172.21.15.7:0/3437974458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efda00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80b4d30 0x7f7ef81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efe400640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.214+0000 7f7efd000640 1 -- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 msgr2=0x7f7ef80b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.215+0000 7f7efd000640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.215+0000 7f7efd000640 1 -- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80b4d30 msgr2=0x7f7ef81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.215+0000 7f7efd000640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80b4d30 0x7f7ef81565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.215+0000 7f7efd000640 1 -- 172.21.15.7:0/3437974458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef80cc980 con 0x7f7ef815de20 2024-08-19T00:43:24.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.215+0000 7f7efd000640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef815de20 0x7f7ef80b1eb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400e840 tx=0x7f7ee400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:24.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.216+0000 7f7ef5600640 1 -- 172.21.15.7:0/3437974458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4017070 con 0x7f7ef815de20 2024-08-19T00:43:24.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.217+0000 7f7ef5600640 1 -- 172.21.15.7:0/3437974458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee400c940 con 0x7f7ef815de20 2024-08-19T00:43:24.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.217+0000 7f7ef5600640 1 -- 172.21.15.7:0/3437974458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400cd10 con 0x7f7ef815de20 2024-08-19T00:43:24.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.217+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef80ccc60 con 0x7f7ef815de20 2024-08-19T00:43:24.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.217+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef80cd220 con 0x7f7ef815de20 2024-08-19T00:43:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.218+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef80d0b50 con 0x7f7ef815de20 2024-08-19T00:43:24.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.219+0000 7f7ef5600640 1 -- 172.21.15.7:0/3437974458 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ee401a070 con 0x7f7ef815de20 2024-08-19T00:43:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.219+0000 7f7ef5600640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ed806be30 0x7f7ed806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.220+0000 7f7ef5600640 1 -- 172.21.15.7:0/3437974458 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 4857+0+0 (secure 0 0 0) 0x7f7ee408ad30 con 0x7f7ef815de20 2024-08-19T00:43:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.220+0000 7f7efda00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ed806be30 0x7f7ed806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.220+0000 7f7efda00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ed806be30 0x7f7ed806e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009ac0 tx=0x7f7eec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:24.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.224+0000 7f7ef5600640 1 -- 172.21.15.7:0/3437974458 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7ee4059340 con 0x7f7ef815de20 2024-08-19T00:43:24.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:24.408+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7ef8161800 con 0x7f7ef815de20 2024-08-19T00:43:25.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.217+0000 7f7ef5600640 1 -- 172.21.15.7:0/3437974458 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f7ee405d640 con 0x7f7ef815de20 2024-08-19T00:43:25.219 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-08-19T00:43:25.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ed806be30 msgr2=0x7f7ed806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:25.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ed806be30 0x7f7ed806e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009ac0 tx=0x7f7eec009190 comp rx=0 tx=0).stop 2024-08-19T00:43:25.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef815de20 msgr2=0x7f7ef80b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:25.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef815de20 0x7f7ef80b1eb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400e840 tx=0x7f7ee400ed00 comp rx=0 tx=0).stop 2024-08-19T00:43:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 shutdown_connections 2024-08-19T00:43:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ed806be30 0x7f7ed806e2f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef8161cb0 0x7f7ef80b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef815de20 0x7f7ef80b1eb0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 --2- 172.21.15.7:0/3437974458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80b4d30 0x7f7ef81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.221+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 >> 172.21.15.7:0/3437974458 conn(0x7f7ef808dbe0 msgr2=0x7f7ef80d2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.222+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 shutdown_connections 2024-08-19T00:43:25.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.222+0000 7f7efee00640 1 -- 172.21.15.7:0/3437974458 wait complete. 2024-08-19T00:43:25.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:43:25.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.414+0000 7fcda6400640 1 Processor -- start 2024-08-19T00:43:25.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.414+0000 7fcda6400640 1 -- start start 2024-08-19T00:43:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcda6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0158cd0 0x7fcda0072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcda6400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcda0072ff0 0x7fcda00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcda6400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda00aeae0 con 0x7fcda00ae2b0 2024-08-19T00:43:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcda6400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcda0073430 con 0x7fcda0072ff0 2024-08-19T00:43:25.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcda6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcda00aedc0 con 0x7fcda0158cd0 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcd9fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcda00ae2b0 0x7fcda015ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53338/0 (socket says 172.21.15.7:53338) 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcd9fe00640 1 -- 172.21.15.7:0/14590588 learned_addr learned my addr 172.21.15.7:0/14590588 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcd9f400640 1 --2- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0158cd0 0x7fcda0072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.415+0000 7fcd97e00640 1 --2- 172.21.15.7:0/14590588 >> v2:172.21.15.162:3300/0 conn(0x7fcda0072ff0 0x7fcda00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.416+0000 7fcd9ea00640 1 -- 172.21.15.7:0/14590588 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732419055 0 0) 0x7fcda00aeae0 con 0x7fcda00ae2b0 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.416+0000 7fcd9ea00640 1 -- 172.21.15.7:0/14590588 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd84005730 con 0x7fcda00ae2b0 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.416+0000 7fcd97e00640 1 -- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0158cd0 msgr2=0x7fcda0072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.416+0000 7fcd97e00640 1 --2- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0158cd0 0x7fcda0072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.416+0000 7fcd97e00640 1 -- 172.21.15.7:0/14590588 >> v1:172.21.15.7:6789/0 conn(0x7fcda00ae2b0 legacy=0x7fcda015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:25.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.416+0000 7fcd97e00640 1 -- 172.21.15.7:0/14590588 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda00af0a0 con 0x7fcda0072ff0 2024-08-19T00:43:25.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.416+0000 7fcd9f400640 1 --2- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0158cd0 0x7fcda0072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.417+0000 7fcd97e00640 1 --2- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda00add70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcda00735b0 tx=0x7fcd8802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=186cde43453524b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcd9ea00640 1 -- 172.21.15.7:0/14590588 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88037070 con 0x7fcda0072ff0 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcd9ea00640 1 -- 172.21.15.7:0/14590588 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8802adb0 con 0x7fcda0072ff0 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcd9ea00640 1 -- 172.21.15.7:0/14590588 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88032640 con 0x7fcda0072ff0 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 -- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 msgr2=0x7fcda00add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 --2- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda00add70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcda00735b0 tx=0x7fcd8802a060 comp rx=0 tx=0).stop 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 -- 172.21.15.7:0/14590588 shutdown_connections 2024-08-19T00:43:25.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 --2- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda00add70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 --2- 172.21.15.7:0/14590588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0158cd0 0x7fcda0072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 -- 172.21.15.7:0/14590588 >> 172.21.15.7:0/14590588 conn(0x7fcda00b2300 msgr2=0x7fcda006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:25.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 -- 172.21.15.7:0/14590588 shutdown_connections 2024-08-19T00:43:25.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.418+0000 7fcda6400640 1 -- 172.21.15.7:0/14590588 wait complete. 2024-08-19T00:43:25.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.420+0000 7fcda6400640 1 Processor -- start 2024-08-19T00:43:25.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.420+0000 7fcda6400640 1 -- start start 2024-08-19T00:43:25.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcda6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda0147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:25.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcda6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda00ae2b0 0x7fcda006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcda6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcda006de10 0x7fcda006e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcda6400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcda00ae6c0 con 0x7fcda006de10 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcda6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcda00af660 con 0x7fcda0072ff0 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcda6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcda00ae840 con 0x7fcda00ae2b0 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcd9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcda006de10 0x7fcda006e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcd9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcda006de10 0x7fcda006e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47842/0 (socket says 172.21.15.7:47842) 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.421+0000 7fcd9fe00640 1 -- 172.21.15.7:0/2413526377 learned_addr learned my addr 172.21.15.7:0/2413526377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd97e00640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda00ae2b0 0x7fcda006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9f400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda0147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9fe00640 1 -- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda00ae2b0 msgr2=0x7fcda006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9fe00640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda00ae2b0 0x7fcda006d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9fe00640 1 -- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 msgr2=0x7fcda0147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9fe00640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda0147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9fe00640 1 -- 172.21.15.7:0/2413526377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda0153ac0 con 0x7fcda006de10 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd97e00640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda00ae2b0 0x7fcda006d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9f400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda0147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd9fe00640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcda006de10 0x7fcda006e2c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800cb40 tx=0x7fcd9800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd97400640 1 -- 172.21.15.7:0/2413526377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98017070 con 0x7fcda006de10 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd97400640 1 -- 172.21.15.7:0/2413526377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9800aca0 con 0x7fcda006de10 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcd97400640 1 -- 172.21.15.7:0/2413526377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98012620 con 0x7fcda006de10 2024-08-19T00:43:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.422+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda0153da0 con 0x7fcda006de10 2024-08-19T00:43:25.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.423+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda0154360 con 0x7fcda006de10 2024-08-19T00:43:25.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.423+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda00add70 con 0x7fcda006de10 2024-08-19T00:43:25.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.426+0000 7fcd97400640 1 -- 172.21.15.7:0/2413526377 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd9801a070 con 0x7fcda006de10 2024-08-19T00:43:25.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.426+0000 7fcd97400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd7c06be60 0x7fcd7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:25.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.427+0000 7fcd97400640 1 -- 172.21.15.7:0/2413526377 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5227+0+0 (secure 0 0 0) 0x7fcd9808af90 con 0x7fcda006de10 2024-08-19T00:43:25.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.427+0000 7fcd9f400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd7c06be60 0x7fcd7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:25.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.427+0000 7fcd9f400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd7c06be60 0x7fcd7c06e320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009ba0 tx=0x7fcd90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:25.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.430+0000 7fcd97400640 1 -- 172.21.15.7:0/2413526377 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcd98021020 con 0x7fcda006de10 2024-08-19T00:43:25.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:25.614+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcda00cfd30 con 0x7fcda006de10 2024-08-19T00:43:26.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.224+0000 7fcd97400640 1 -- 172.21.15.7:0/2413526377 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7fcd98059b00 con 0x7fcda006de10 2024-08-19T00:43:26.226 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-08-19T00:43:26.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd7c06be60 msgr2=0x7fcd7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd7c06be60 0x7fcd7c06e320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009ba0 tx=0x7fcd90008040 comp rx=0 tx=0).stop 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcda006de10 msgr2=0x7fcda006e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcda006de10 0x7fcda006e2c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800cb40 tx=0x7fcd9800a060 comp rx=0 tx=0).stop 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 shutdown_connections 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd7c06be60 0x7fcd7c06e320 secure :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009ba0 tx=0x7fcd90008040 comp rx=0 tx=0).stop 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcda006de10 0x7fcda006e2c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda00ae2b0 0x7fcda006d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 --2- 172.21.15.7:0/2413526377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0072ff0 0x7fcda0147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.230+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 >> 172.21.15.7:0/2413526377 conn(0x7fcda00b2300 msgr2=0x7fcda00b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.231+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 shutdown_connections 2024-08-19T00:43:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.231+0000 7fcda6400640 1 -- 172.21.15.7:0/2413526377 wait complete. 2024-08-19T00:43:26.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:43:26.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.425+0000 7f0f19600640 1 Processor -- start 2024-08-19T00:43:26.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.425+0000 7f0f19600640 1 -- start start 2024-08-19T00:43:26.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f19600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f1406d770 0x7f0f1406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f19600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0f140b5da0 0x7f0f140b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f19600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f140b66e0 0x7f0f140cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f19600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1406e090 con 0x7f0f140b66e0 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f19600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0f140b6f70 con 0x7f0f140b5da0 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f19600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0f140b7250 con 0x7f0f1406d770 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f140b66e0 0x7f0f140cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f140b66e0 0x7f0f140cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47852/0 (socket says 172.21.15.7:47852) 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f12000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0f140b5da0 0x7f0f140b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f12a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f1406d770 0x7f0f1406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:26.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 -- 172.21.15.7:0/1282178527 learned_addr learned my addr 172.21.15.7:0/1282178527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:26.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 -- 172.21.15.7:0/1282178527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f1406d770 msgr2=0x7f0f1406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:26.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 --2- 172.21.15.7:0/1282178527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f1406d770 0x7f0f1406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 -- 172.21.15.7:0/1282178527 >> v2:172.21.15.162:3300/0 conn(0x7f0f140b5da0 msgr2=0x7f0f140b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:26.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 --2- 172.21.15.7:0/1282178527 >> v2:172.21.15.162:3300/0 conn(0x7f0f140b5da0 0x7f0f140b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.427+0000 7f0f13400640 1 -- 172.21.15.7:0/1282178527 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f140cb430 con 0x7f0f140b66e0 2024-08-19T00:43:26.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f13400640 1 --2- 172.21.15.7:0/1282178527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f140b66e0 0x7f0f140cbc30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0f14072a10 tx=0x7f0f0c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4691575945b719b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:26.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f11600640 1 -- 172.21.15.7:0/1282178527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c036070 con 0x7f0f140b66e0 2024-08-19T00:43:26.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f11600640 1 -- 172.21.15.7:0/1282178527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0c031600 con 0x7f0f140b66e0 2024-08-19T00:43:26.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f11600640 1 -- 172.21.15.7:0/1282178527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0319d0 con 0x7f0f140b66e0 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f19600640 1 -- 172.21.15.7:0/1282178527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f140b66e0 msgr2=0x7f0f140cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f19600640 1 --2- 172.21.15.7:0/1282178527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f140b66e0 0x7f0f140cbc30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0f14072a10 tx=0x7f0f0c02a6a0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f19600640 1 -- 172.21.15.7:0/1282178527 shutdown_connections 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f19600640 1 --2- 172.21.15.7:0/1282178527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f140b66e0 0x7f0f140cbc30 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f19600640 1 --2- 172.21.15.7:0/1282178527 >> v2:172.21.15.162:3300/0 conn(0x7f0f140b5da0 0x7f0f140b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f19600640 1 --2- 172.21.15.7:0/1282178527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f1406d770 0x7f0f1406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.429+0000 7f0f19600640 1 -- 172.21.15.7:0/1282178527 >> 172.21.15.7:0/1282178527 conn(0x7f0f140d2180 msgr2=0x7f0f140d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.430+0000 7f0f19600640 1 -- 172.21.15.7:0/1282178527 shutdown_connections 2024-08-19T00:43:26.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.430+0000 7f0f19600640 1 -- 172.21.15.7:0/1282178527 wait complete. 2024-08-19T00:43:26.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.431+0000 7f0f19600640 1 Processor -- start 2024-08-19T00:43:26.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.431+0000 7f0f19600640 1 -- start start 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.432+0000 7f0f19600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f1406d770 0x7f0f14151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.432+0000 7f0f19600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f140b5da0 0x7f0f140b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.432+0000 7f0f19600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f140b66e0 0x7f0f14155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.432+0000 7f0f19600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1415ea10 con 0x7f0f1406d770 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.432+0000 7f0f19600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1406f9a0 con 0x7f0f140b5da0 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.432+0000 7f0f19600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1406d370 con 0x7f0f140b66e0 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.432+0000 7f0f12a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f1406d770 0x7f0f14151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f1406d770 0x7f0f14151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47856/0 (socket says 172.21.15.7:47856) 2024-08-19T00:43:26.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 -- 172.21.15.7:0/3208721681 learned_addr learned my addr 172.21.15.7:0/3208721681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12000640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f140b5da0 0x7f0f140b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f13400640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f140b66e0 0x7f0f14155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 -- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f140b66e0 msgr2=0x7f0f14155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f140b66e0 0x7f0f14155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 -- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f140b5da0 msgr2=0x7f0f140b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f140b5da0 0x7f0f140b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 -- 172.21.15.7:0/3208721681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f14151680 con 0x7f0f1406d770 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12000640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f140b5da0 0x7f0f140b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f13400640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f140b66e0 0x7f0f14155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f12a00640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f1406d770 0x7f0f14151140 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00e870 tx=0x7f0efc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:26.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f0aa00640 1 -- 172.21.15.7:0/3208721681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc017070 con 0x7f0f1406d770 2024-08-19T00:43:26.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f0aa00640 1 -- 172.21.15.7:0/3208721681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0efc00ee60 con 0x7f0f1406d770 2024-08-19T00:43:26.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f0aa00640 1 -- 172.21.15.7:0/3208721681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00cb80 con 0x7f0f1406d770 2024-08-19T00:43:26.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.433+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1409f2d0 con 0x7f0f1406d770 2024-08-19T00:43:26.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.434+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1409f890 con 0x7f0f1406d770 2024-08-19T00:43:26.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.435+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f140d2ca0 con 0x7f0f1406d770 2024-08-19T00:43:26.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.436+0000 7f0f0aa00640 1 -- 172.21.15.7:0/3208721681 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0efc01a070 con 0x7f0f1406d770 2024-08-19T00:43:26.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.437+0000 7f0f0aa00640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ef006be30 0x7f0ef006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:26.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.437+0000 7f0f0aa00640 1 -- 172.21.15.7:0/3208721681 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5609+0+0 (secure 0 0 0) 0x7f0efc08b440 con 0x7f0f1406d770 2024-08-19T00:43:26.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.437+0000 7f0f12000640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ef006be30 0x7f0ef006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:26.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.438+0000 7f0f12000640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ef006be30 0x7f0ef006e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0f141593e0 tx=0x7f0f04008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:26.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.441+0000 7f0f0aa00640 1 -- 172.21.15.7:0/3208721681 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0f14151680 con 0x7f0f1406d770 2024-08-19T00:43:26.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:26.669+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0f140b3b90 con 0x7f0f1406d770 2024-08-19T00:43:27.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.227+0000 7f0f0aa00640 1 -- 172.21.15.7:0/3208721681 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v81) ==== 174+0+0 (secure 0 0 0) 0x7f0efc059ec0 con 0x7f0f1406d770 2024-08-19T00:43:27.229 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 12 and data pool 13 2024-08-19T00:43:27.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ef006be30 msgr2=0x7f0ef006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ef006be30 0x7f0ef006e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0f141593e0 tx=0x7f0f04008040 comp rx=0 tx=0).stop 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f1406d770 msgr2=0x7f0f14151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f1406d770 0x7f0f14151140 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00e870 tx=0x7f0efc00ed30 comp rx=0 tx=0).stop 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 shutdown_connections 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ef006be30 0x7f0ef006e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f140b66e0 0x7f0f14155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f140b5da0 0x7f0f140b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 --2- 172.21.15.7:0/3208721681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f1406d770 0x7f0f14151140 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.231+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 >> 172.21.15.7:0/3208721681 conn(0x7f0f140d2180 msgr2=0x7f0f140d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.232+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 shutdown_connections 2024-08-19T00:43:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.233+0000 7f0f19600640 1 -- 172.21.15.7:0/3208721681 wait complete. 2024-08-19T00:43:27.277 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:43:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.435+0000 7f7239a00640 1 Processor -- start 2024-08-19T00:43:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.436+0000 7f7239a00640 1 -- start start 2024-08-19T00:43:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f7239a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72340ce500 0x7f72340ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f7239a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f723406f7f0 con 0x7f72340d03c0 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f7239a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f723406f510 con 0x7f7234159bf0 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f7239a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7234072980 con 0x7f72340ce500 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f722be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72340ce500 0x7f72340ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f722be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72340ce500 0x7f72340ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47872/0 (socket says 172.21.15.7:47872) 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f7233400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f72340d03c0 0x7f723406e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53340/0 (socket says 172.21.15.7:53340) 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f722be00640 1 -- 172.21.15.7:0/3922466633 learned_addr learned my addr 172.21.15.7:0/3922466633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f722be00640 1 -- 172.21.15.7:0/3922466633 >> v1:172.21.15.162:6789/0 conn(0x7f7234159bf0 legacy=0x7f7234073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f722be00640 1 -- 172.21.15.7:0/3922466633 >> v1:172.21.15.7:6789/0 conn(0x7f72340d03c0 legacy=0x7f723406e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f722be00640 1 -- 172.21.15.7:0/3922466633 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7234072c60 con 0x7f72340ce500 2024-08-19T00:43:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.437+0000 7f7232000640 1 -- 172.21.15.7:0/3922466633 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369282846 0 0) 0x7f723406f7f0 con 0x7f72340d03c0 2024-08-19T00:43:27.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.438+0000 7f722be00640 1 --2- 172.21.15.7:0/3922466633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72340ce970 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f721c009870 tx=0x7f721c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c51d6e790a135c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7232000640 1 -- 172.21.15.7:0/3922466633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c037070 con 0x7f72340ce500 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7232000640 1 -- 172.21.15.7:0/3922466633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c032440 con 0x7f72340ce500 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7232000640 1 -- 172.21.15.7:0/3922466633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c032810 con 0x7f72340ce500 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7239a00640 1 -- 172.21.15.7:0/3922466633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 msgr2=0x7f72340ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7239a00640 1 --2- 172.21.15.7:0/3922466633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72340ce970 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f721c009870 tx=0x7f721c02a210 comp rx=0 tx=0).stop 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7239a00640 1 -- 172.21.15.7:0/3922466633 shutdown_connections 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7239a00640 1 --2- 172.21.15.7:0/3922466633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72340ce970 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7239a00640 1 -- 172.21.15.7:0/3922466633 >> 172.21.15.7:0/3922466633 conn(0x7f723406bc70 msgr2=0x7f723406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7239a00640 1 -- 172.21.15.7:0/3922466633 shutdown_connections 2024-08-19T00:43:27.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.439+0000 7f7239a00640 1 -- 172.21.15.7:0/3922466633 wait complete. 2024-08-19T00:43:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.441+0000 7f7239a00640 1 Processor -- start 2024-08-19T00:43:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.441+0000 7f7239a00640 1 -- start start 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7239a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72341f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7239a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72340d03c0 0x7f723415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7239a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7234159bf0 0x7f723409cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7239a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7234159fd0 con 0x7f72340ce500 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7239a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7234073b70 con 0x7f7234159bf0 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7239a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f723415a150 con 0x7f72340d03c0 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7232a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72341f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7232a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72341f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47882/0 (socket says 172.21.15.7:47882) 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7232a00640 1 -- 172.21.15.7:0/2013366847 learned_addr learned my addr 172.21.15.7:0/2013366847 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f722be00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72340d03c0 0x7f723415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.442+0000 7f7233400640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7234159bf0 0x7f723409cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7232a00640 1 -- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72340d03c0 msgr2=0x7f723415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7232a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72340d03c0 0x7f723415b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7232a00640 1 -- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7234159bf0 msgr2=0x7f723409cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7232a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7234159bf0 0x7f723409cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7232a00640 1 -- 172.21.15.7:0/2013366847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723409c100 con 0x7f72340ce500 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7232a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72341f1a80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f722400c430 tx=0x7f722400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f722aa00640 1 -- 172.21.15.7:0/2013366847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224011790 con 0x7f72340ce500 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f722aa00640 1 -- 172.21.15.7:0/2013366847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7224017070 con 0x7f72340ce500 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723409b580 con 0x7f72340ce500 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f722aa00640 1 -- 172.21.15.7:0/2013366847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224011bb0 con 0x7f72340ce500 2024-08-19T00:43:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.443+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723409bb40 con 0x7f72340ce500 2024-08-19T00:43:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.445+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72340ce970 con 0x7f72340ce500 2024-08-19T00:43:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.445+0000 7f722aa00640 1 -- 172.21.15.7:0/2013366847 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f722401c460 con 0x7f72340ce500 2024-08-19T00:43:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.447+0000 7f722aa00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f721006be30 0x7f721006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.447+0000 7f722aa00640 1 -- 172.21.15.7:0/2013366847 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5709+0+0 (secure 0 0 0) 0x7f722408ac90 con 0x7f72340ce500 2024-08-19T00:43:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.447+0000 7f722be00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f721006be30 0x7f721006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.448+0000 7f722be00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f721006be30 0x7f721006e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f721c034000 tx=0x7f721c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.451+0000 7f722aa00640 1 -- 172.21.15.7:0/2013366847 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7224059630 con 0x7f72340ce500 2024-08-19T00:43:27.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.636+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72340ce220 con 0x7f72340ce500 2024-08-19T00:43:27.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.637+0000 7f722aa00640 1 -- 172.21.15.7:0/2013366847 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16649 (secure 0 0 0) 0x7f7224058f30 con 0x7f72340ce500 2024-08-19T00:43:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:27.639 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:43:26.670145+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:43:24.450864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-08-19T00:43:25.656952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:43:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.639+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f721006be30 msgr2=0x7f721006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.639+0000 7f7239a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f721006be30 0x7f721006e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f721c034000 tx=0x7f721c02e000 comp rx=0 tx=0).stop 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.639+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 msgr2=0x7f72341f1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.639+0000 7f7239a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72341f1a80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f722400c430 tx=0x7f722400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 shutdown_connections 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f721006be30 0x7f721006e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7234159bf0 0x7f723409cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72340d03c0 0x7f723415b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 --2- 172.21.15.7:0/2013366847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72340ce500 0x7f72341f1a80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 >> 172.21.15.7:0/2013366847 conn(0x7f723406bc70 msgr2=0x7f7234160490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 shutdown_connections 2024-08-19T00:43:27.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.640+0000 7f7239a00640 1 -- 172.21.15.7:0/2013366847 wait complete. 2024-08-19T00:43:27.657 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:43:27.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.812+0000 7f8ff0600640 1 Processor -- start 2024-08-19T00:43:27.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.812+0000 7f8ff0600640 1 -- start start 2024-08-19T00:43:27.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.813+0000 7f8ff0600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8fe80aeb10 0x7f8fe80cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.813+0000 7f8ff0600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe806e660 con 0x7f8fe80ce460 2024-08-19T00:43:27.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.813+0000 7f8ff0600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe806e940 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.813+0000 7f8ff0600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe806ec20 con 0x7f8fe80aeb10 2024-08-19T00:43:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fedc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8fe80aeb10 0x7f8fe80cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fedc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8fe80aeb10 0x7f8fe80cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47886/0 (socket says 172.21.15.7:47886) 2024-08-19T00:43:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fedc00640 1 -- 172.21.15.7:0/2216591568 learned_addr learned my addr 172.21.15.7:0/2216591568 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fed200640 1 --1- 172.21.15.7:0/2216591568 >> v1:172.21.15.7:6789/0 conn(0x7f8fe80ce460 0x7f8fe80d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53352/0 (socket says 172.21.15.7:53352) 2024-08-19T00:43:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fedc00640 1 -- 172.21.15.7:0/2216591568 >> v1:172.21.15.162:6789/0 conn(0x7f8fe80d0ad0 legacy=0x7f8fe80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fedc00640 1 -- 172.21.15.7:0/2216591568 >> v1:172.21.15.7:6789/0 conn(0x7f8fe80ce460 legacy=0x7f8fe80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fedc00640 1 -- 172.21.15.7:0/2216591568 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe806ef00 con 0x7f8fe80aeb10 2024-08-19T00:43:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.814+0000 7f8fe7e00640 1 -- 172.21.15.7:0/2216591568 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997712576 0 0) 0x7f8fe806e660 con 0x7f8fe80ce460 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.815+0000 7f8fedc00640 1 --2- 172.21.15.7:0/2216591568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80aeb10 0x7f8fe80cf3c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009870 tx=0x7f8fdc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427ed77b20ef855c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8fe7e00640 1 -- 172.21.15.7:0/2216591568 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc037070 con 0x7f8fe80aeb10 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8fe7e00640 1 -- 172.21.15.7:0/2216591568 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fdc032440 con 0x7f8fe80aeb10 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8fe7e00640 1 -- 172.21.15.7:0/2216591568 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc032810 con 0x7f8fe80aeb10 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8ff0600640 1 -- 172.21.15.7:0/2216591568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80aeb10 msgr2=0x7f8fe80cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2216591568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80aeb10 0x7f8fe80cf3c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009870 tx=0x7f8fdc02a2a0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8ff0600640 1 -- 172.21.15.7:0/2216591568 shutdown_connections 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2216591568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80aeb10 0x7f8fe80cf3c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8ff0600640 1 -- 172.21.15.7:0/2216591568 >> 172.21.15.7:0/2216591568 conn(0x7f8fe806bc70 msgr2=0x7f8fe806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8ff0600640 1 -- 172.21.15.7:0/2216591568 shutdown_connections 2024-08-19T00:43:27.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.816+0000 7f8ff0600640 1 -- 172.21.15.7:0/2216591568 wait complete. 2024-08-19T00:43:27.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.818+0000 7f8ff0600640 1 Processor -- start 2024-08-19T00:43:27.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.818+0000 7f8ff0600640 1 -- start start 2024-08-19T00:43:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8ff0600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fe80aeb10 0x7f8fe8165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8ff0600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8fe80ce460 0x7f8fe8162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8ff0600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80d0ad0 0x7f8fe815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8ff0600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe806f700 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8ff0600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe80cf900 con 0x7f8fe80aeb10 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8ff0600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe81633e0 con 0x7f8fe80ce460 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8fee600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80d0ad0 0x7f8fe815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8fedc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fe80aeb10 0x7f8fe8165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8fee600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80d0ad0 0x7f8fe815c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47900/0 (socket says 172.21.15.7:47900) 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8fee600640 1 -- 172.21.15.7:0/2914952822 learned_addr learned my addr 172.21.15.7:0/2914952822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.819+0000 7f8fed200640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8fe80ce460 0x7f8fe8162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fee600640 1 -- 172.21.15.7:0/2914952822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8fe80ce460 msgr2=0x7f8fe8162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fee600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8fe80ce460 0x7f8fe8162ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fee600640 1 -- 172.21.15.7:0/2914952822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fe80aeb10 msgr2=0x7f8fe8165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fee600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fe80aeb10 0x7f8fe8165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fee600640 1 -- 172.21.15.7:0/2914952822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe8163660 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fee600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80d0ad0 0x7f8fe815c560 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000b9e0 tx=0x7f8fe000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fe5600640 1 -- 172.21.15.7:0/2914952822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0003b70 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fe5600640 1 -- 172.21.15.7:0/2914952822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe0003d10 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe8163940 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.820+0000 7f8fe5600640 1 -- 172.21.15.7:0/2914952822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000cb00 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.821+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe815d210 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.822+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe80cf3c0 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.823+0000 7f8fe5600640 1 -- 172.21.15.7:0/2914952822 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fe000cca0 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.823+0000 7f8fe5600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8fc806be30 0x7f8fc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:27.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.823+0000 7f8fe5600640 1 -- 172.21.15.7:0/2914952822 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5709+0+0 (secure 0 0 0) 0x7f8fe008ac10 con 0x7f8fe80d0ad0 2024-08-19T00:43:27.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.824+0000 7f8fedc00640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8fc806be30 0x7f8fc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:27.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.824+0000 7f8fedc00640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8fc806be30 0x7f8fc806e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc034000 tx=0x7f8fdc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:27.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:27.828+0000 7f8fe5600640 1 -- 172.21.15.7:0/2914952822 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8fe0058ed0 con 0x7f8fe80d0ad0 2024-08-19T00:43:28.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.013+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fe80aff90 con 0x7f8fe80d0ad0 2024-08-19T00:43:28.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.014+0000 7f8fe5600640 1 -- 172.21.15.7:0/2914952822 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16649 (secure 0 0 0) 0x7f8fe005d1d0 con 0x7f8fe80d0ad0 2024-08-19T00:43:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:28.016 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:43:26.670145+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:43:24.450864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-08-19T00:43:25.656952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:43:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8fc806be30 msgr2=0x7f8fc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:28.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8fc806be30 0x7f8fc806e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc034000 tx=0x7f8fdc02e000 comp rx=0 tx=0).stop 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80d0ad0 msgr2=0x7f8fe815c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80d0ad0 0x7f8fe815c560 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000b9e0 tx=0x7f8fe000bea0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 shutdown_connections 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8fc806be30 0x7f8fc806e2f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fe80d0ad0 0x7f8fe815c560 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.016+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8fe80ce460 0x7f8fe8162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.017+0000 7f8ff0600640 1 --2- 172.21.15.7:0/2914952822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fe80aeb10 0x7f8fe8165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.017+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 >> 172.21.15.7:0/2914952822 conn(0x7f8fe806bc70 msgr2=0x7f8fe8074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.017+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 shutdown_connections 2024-08-19T00:43:28.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.017+0000 7f8ff0600640 1 -- 172.21.15.7:0/2914952822 wait complete. 2024-08-19T00:43:28.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:43:28.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.195+0000 7fc4afe00640 1 Processor -- start 2024-08-19T00:43:28.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.195+0000 7fc4afe00640 1 -- start start 2024-08-19T00:43:28.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.196+0000 7fc4afe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4b015bd70 0x7fc4b0072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.196+0000 7fc4afe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b006d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.196+0000 7fc4afe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b00733f0 con 0x7fc4b006db40 2024-08-19T00:43:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.196+0000 7fc4afe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b006dfb0 con 0x7fc4b015bd70 2024-08-19T00:43:28.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.196+0000 7fc4afe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b00736d0 con 0x7fc4b0072f70 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.196+0000 7fc4af400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc4b006db40 0x7fc4b0071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53354/0 (socket says 172.21.15.7:53354) 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.196+0000 7fc4af400640 1 -- 172.21.15.7:0/1760254395 learned_addr learned my addr 172.21.15.7:0/1760254395 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4ae000640 1 --2- 172.21.15.7:0/1760254395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4aea00640 1 --2- 172.21.15.7:0/1760254395 >> v2:172.21.15.162:3300/0 conn(0x7fc4b015bd70 0x7fc4b0072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4ad600640 1 -- 172.21.15.7:0/1760254395 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045485491 0 0) 0x7fc4b00733f0 con 0x7fc4b006db40 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4ad600640 1 -- 172.21.15.7:0/1760254395 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc494003520 con 0x7fc4b006db40 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4ae000640 1 -- 172.21.15.7:0/1760254395 >> v2:172.21.15.162:3300/0 conn(0x7fc4b015bd70 msgr2=0x7fc4b0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:28.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4ae000640 1 --2- 172.21.15.7:0/1760254395 >> v2:172.21.15.162:3300/0 conn(0x7fc4b015bd70 0x7fc4b0072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4ae000640 1 -- 172.21.15.7:0/1760254395 >> v1:172.21.15.7:6789/0 conn(0x7fc4b006db40 legacy=0x7fc4b0071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4ae000640 1 -- 172.21.15.7:0/1760254395 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b00739b0 con 0x7fc4b0072f70 2024-08-19T00:43:28.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.197+0000 7fc4aea00640 1 --2- 172.21.15.7:0/1760254395 >> v2:172.21.15.162:3300/0 conn(0x7fc4b015bd70 0x7fc4b0072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.198+0000 7fc4ae000640 1 --2- 172.21.15.7:0/1760254395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b006d600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0097a0 tx=0x7fc49c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba59c59e4e1607a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4ad600640 1 -- 172.21.15.7:0/1760254395 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c037070 con 0x7fc4b0072f70 2024-08-19T00:43:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4ad600640 1 -- 172.21.15.7:0/1760254395 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c032440 con 0x7fc4b0072f70 2024-08-19T00:43:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4ad600640 1 -- 172.21.15.7:0/1760254395 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c032810 con 0x7fc4b0072f70 2024-08-19T00:43:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 -- 172.21.15.7:0/1760254395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 msgr2=0x7fc4b006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 --2- 172.21.15.7:0/1760254395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b006d600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0097a0 tx=0x7fc49c02a180 comp rx=0 tx=0).stop 2024-08-19T00:43:28.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 -- 172.21.15.7:0/1760254395 shutdown_connections 2024-08-19T00:43:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 --2- 172.21.15.7:0/1760254395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b006d600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 --2- 172.21.15.7:0/1760254395 >> v2:172.21.15.162:3300/0 conn(0x7fc4b015bd70 0x7fc4b0072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 -- 172.21.15.7:0/1760254395 >> 172.21.15.7:0/1760254395 conn(0x7fc4b006b850 msgr2=0x7fc4b006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 -- 172.21.15.7:0/1760254395 shutdown_connections 2024-08-19T00:43:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.199+0000 7fc4afe00640 1 -- 172.21.15.7:0/1760254395 wait complete. 2024-08-19T00:43:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.201+0000 7fc4afe00640 1 Processor -- start 2024-08-19T00:43:28.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.201+0000 7fc4afe00640 1 -- start start 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4afe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b006db40 0x7fc4b00c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4afe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b0151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b015bd70 0x7fc4b00aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4afe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b015c150 con 0x7fc4b015bd70 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4afe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b015c780 con 0x7fc4b006db40 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4afe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b006e3a0 con 0x7fc4b0072f70 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b015bd70 0x7fc4b00aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b015bd70 0x7fc4b00aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47908/0 (socket says 172.21.15.7:47908) 2024-08-19T00:43:28.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4af400640 1 -- 172.21.15.7:0/979959279 learned_addr learned my addr 172.21.15.7:0/979959279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:28.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4ae000640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b0151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:28.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.202+0000 7fc4aea00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b006db40 0x7fc4b00c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:28.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4af400640 1 -- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 msgr2=0x7fc4b0151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:28.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4af400640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b0151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4af400640 1 -- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b006db40 msgr2=0x7fc4b00c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4af400640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b006db40 0x7fc4b00c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4af400640 1 -- 172.21.15.7:0/979959279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b0151cc0 con 0x7fc4b015bd70 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4af400640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b015bd70 0x7fc4b00aec60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800cb40 tx=0x7fc4a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4a6a00640 1 -- 172.21.15.7:0/979959279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8017070 con 0x7fc4b015bd70 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4a6a00640 1 -- 172.21.15.7:0/979959279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a800aca0 con 0x7fc4b015bd70 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4a6a00640 1 -- 172.21.15.7:0/979959279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8012620 con 0x7fc4b015bd70 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b00ad8e0 con 0x7fc4b015bd70 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.203+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b00adea0 con 0x7fc4b015bd70 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.204+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b006d600 con 0x7fc4b015bd70 2024-08-19T00:43:28.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.205+0000 7fc4a6a00640 1 -- 172.21.15.7:0/979959279 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4a801a070 con 0x7fc4b015bd70 2024-08-19T00:43:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.207+0000 7fc4a6a00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc49006be30 0x7fc49006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.207+0000 7fc4a6a00640 1 -- 172.21.15.7:0/979959279 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5709+0+0 (secure 0 0 0) 0x7fc4a808ad00 con 0x7fc4b015bd70 2024-08-19T00:43:28.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.207+0000 7fc4aea00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc49006be30 0x7fc49006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:28.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.208+0000 7fc4aea00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc49006be30 0x7fc49006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009560 tx=0x7fc4a0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:28.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.212+0000 7fc4a6a00640 1 -- 172.21.15.7:0/979959279 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc4a8058f40 con 0x7fc4b015bd70 2024-08-19T00:43:28.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:28.435+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc4b00b03a0 con 0x7fc4b015bd70 2024-08-19T00:43:29.213 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-08-19T00:43:29.211+0000 7fc3fe600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:43:29.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.254+0000 7fc4a6a00640 1 -- 172.21.15.7:0/979959279 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) ==== 118+0+0 (secure 0 0 0) 0x7fc4a805d240 con 0x7fc4b015bd70 2024-08-19T00:43:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc49006be30 msgr2=0x7fc49006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc49006be30 0x7fc49006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009560 tx=0x7fc4a0009190 comp rx=0 tx=0).stop 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b015bd70 msgr2=0x7fc4b00aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b015bd70 0x7fc4b00aec60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800cb40 tx=0x7fc4a800a060 comp rx=0 tx=0).stop 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 shutdown_connections 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc49006be30 0x7fc49006e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4b015bd70 0x7fc4b00aec60 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b0072f70 0x7fc4b0151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 --2- 172.21.15.7:0/979959279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b006db40 0x7fc4b00c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 >> 172.21.15.7:0/979959279 conn(0x7fc4b006b850 msgr2=0x7fc4b015a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 shutdown_connections 2024-08-19T00:43:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.258+0000 7fc4afe00640 1 -- 172.21.15.7:0/979959279 wait complete. 2024-08-19T00:43:29.279 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-19T00:43:29.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-19T00:43:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.442+0000 7f3811a00640 1 Processor -- start 2024-08-19T00:43:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.442+0000 7f3811a00640 1 -- start start 2024-08-19T00:43:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3811a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f380c0731c0 0x7f380c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3811a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f380c0ae2b0 0x7f380c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3811a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f380c0aeae0 con 0x7f380c158cd0 2024-08-19T00:43:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3811a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f380c0aedc0 con 0x7f380c0731c0 2024-08-19T00:43:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3811a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f380c0af0a0 con 0x7f380c0ae2b0 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3802000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f380c0731c0 0x7f380c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3802000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f380c0731c0 0x7f380c0add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47918/0 (socket says 172.21.15.7:47918) 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3802000640 1 -- 172.21.15.7:0/2473377326 learned_addr learned my addr 172.21.15.7:0/2473377326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f380b400640 1 --2- 172.21.15.7:0/2473377326 >> v2:172.21.15.162:3300/0 conn(0x7f380c0ae2b0 0x7f380c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3802000640 1 -- 172.21.15.7:0/2473377326 >> v2:172.21.15.162:3300/0 conn(0x7f380c0ae2b0 msgr2=0x7f380c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3802000640 1 --2- 172.21.15.7:0/2473377326 >> v2:172.21.15.162:3300/0 conn(0x7f380c0ae2b0 0x7f380c0b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.444+0000 7f3802000640 1 -- 172.21.15.7:0/2473377326 >> v1:172.21.15.7:6789/0 conn(0x7f380c158cd0 legacy=0x7f380c072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.445+0000 7f3802000640 1 -- 172.21.15.7:0/2473377326 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c0af380 con 0x7f380c0731c0 2024-08-19T00:43:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.445+0000 7f380a000640 1 -- 172.21.15.7:0/2473377326 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762617390 0 0) 0x7f380c0aeae0 con 0x7f380c158cd0 2024-08-19T00:43:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f3802000640 1 --2- 172.21.15.7:0/2473377326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0731c0 0x7f380c0add70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f380c0b5220 tx=0x7f37f402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f271f7efe6d54633 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f380a000640 1 -- 172.21.15.7:0/2473377326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4037070 con 0x7f380c0731c0 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f380a000640 1 -- 172.21.15.7:0/2473377326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4032440 con 0x7f380c0731c0 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f380a000640 1 -- 172.21.15.7:0/2473377326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4032810 con 0x7f380c0731c0 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f3811a00640 1 -- 172.21.15.7:0/2473377326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0731c0 msgr2=0x7f380c0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f3811a00640 1 --2- 172.21.15.7:0/2473377326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0731c0 0x7f380c0add70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f380c0b5220 tx=0x7f37f402a150 comp rx=0 tx=0).stop 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f3811a00640 1 -- 172.21.15.7:0/2473377326 shutdown_connections 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f3811a00640 1 --2- 172.21.15.7:0/2473377326 >> v2:172.21.15.162:3300/0 conn(0x7f380c0ae2b0 0x7f380c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f3811a00640 1 --2- 172.21.15.7:0/2473377326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0731c0 0x7f380c0add70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.446+0000 7f3811a00640 1 -- 172.21.15.7:0/2473377326 >> 172.21.15.7:0/2473377326 conn(0x7f380c0b2300 msgr2=0x7f380c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.447+0000 7f3811a00640 1 -- 172.21.15.7:0/2473377326 shutdown_connections 2024-08-19T00:43:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.447+0000 7f3811a00640 1 -- 172.21.15.7:0/2473377326 wait complete. 2024-08-19T00:43:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.448+0000 7f3811a00640 1 Processor -- start 2024-08-19T00:43:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.448+0000 7f3811a00640 1 -- start start 2024-08-19T00:43:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3811a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f380c0731c0 0x7f380c0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3811a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0ae2b0 0x7f380c13f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3811a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380c0cf540 0x7f380c15de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3811a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f380c0b3690 con 0x7f380c0ae2b0 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3811a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f380c0ae760 con 0x7f380c0cf540 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3811a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f380c0b3810 con 0x7f380c0731c0 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3802000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0ae2b0 0x7f380c13f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3802000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0ae2b0 0x7f380c13f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47928/0 (socket says 172.21.15.7:47928) 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.449+0000 7f3802000640 1 -- 172.21.15.7:0/2266247593 learned_addr learned my addr 172.21.15.7:0/2266247593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f380b400640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380c0cf540 0x7f380c15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f380aa00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f380c0731c0 0x7f380c0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3802000640 1 -- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f380c0731c0 msgr2=0x7f380c0cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3802000640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f380c0731c0 0x7f380c0cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3802000640 1 -- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380c0cf540 msgr2=0x7f380c15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3802000640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380c0cf540 0x7f380c15de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3802000640 1 -- 172.21.15.7:0/2266247593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c15e3b0 con 0x7f380c0ae2b0 2024-08-19T00:43:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3802000640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0ae2b0 0x7f380c13f160 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f37f402a190 tx=0x7f37f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3803400640 1 -- 172.21.15.7:0/2266247593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4041020 con 0x7f380c0ae2b0 2024-08-19T00:43:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3803400640 1 -- 172.21.15.7:0/2266247593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4030760 con 0x7f380c0ae2b0 2024-08-19T00:43:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380c0ce780 con 0x7f380c0ae2b0 2024-08-19T00:43:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.450+0000 7f3803400640 1 -- 172.21.15.7:0/2266247593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4037040 con 0x7f380c0ae2b0 2024-08-19T00:43:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.451+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380c0ced40 con 0x7f380c0ae2b0 2024-08-19T00:43:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.452+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f380c06fcb0 con 0x7f380c0ae2b0 2024-08-19T00:43:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.452+0000 7f3803400640 1 -- 172.21.15.7:0/2266247593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37f4044020 con 0x7f380c0ae2b0 2024-08-19T00:43:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.453+0000 7f3803400640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37e806be30 0x7f37e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.453+0000 7f3803400640 1 -- 172.21.15.7:0/2266247593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f37f40ab6e0 con 0x7f380c0ae2b0 2024-08-19T00:43:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.453+0000 7f380aa00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37e806be30 0x7f37e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.454+0000 7f380aa00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37e806be30 0x7f37e806e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f37fc007fd0 tx=0x7f37fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.458+0000 7f3803400640 1 -- 172.21.15.7:0/2266247593 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f380c06fcb0 con 0x7f380c0ae2b0 2024-08-19T00:43:29.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:29.677+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f380c0add70 con 0x7f380c0ae2b0 2024-08-19T00:43:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.260+0000 7f3803400640 1 -- 172.21.15.7:0/2266247593 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) ==== 122+0+0 (secure 0 0 0) 0x7f37f404b030 con 0x7f380c0ae2b0 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.263+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37e806be30 msgr2=0x7f37e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.263+0000 7f3811a00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37e806be30 0x7f37e806e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f37fc007fd0 tx=0x7f37fc009040 comp rx=0 tx=0).stop 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.263+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0ae2b0 msgr2=0x7f380c13f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.263+0000 7f3811a00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0ae2b0 0x7f380c13f160 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f37f402a190 tx=0x7f37f40046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 shutdown_connections 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f37e806be30 0x7f37e806e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380c0cf540 0x7f380c15de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f380c0ae2b0 0x7f380c13f160 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 --2- 172.21.15.7:0/2266247593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f380c0731c0 0x7f380c0cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 >> 172.21.15.7:0/2266247593 conn(0x7f380c0b2300 msgr2=0x7f380c0b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 shutdown_connections 2024-08-19T00:43:30.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.264+0000 7f3811a00640 1 -- 172.21.15.7:0/2266247593 wait complete. 2024-08-19T00:43:30.284 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-19T00:43:30.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.446+0000 7f7bd6400640 1 Processor -- start 2024-08-19T00:43:30.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.446+0000 7f7bd6400640 1 -- start start 2024-08-19T00:43:30.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd006d600 0x7f7bd006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd6400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7bd015cca0 0x7f7bd015d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd6400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd006df60 con 0x7f7bd015bd70 2024-08-19T00:43:30.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd6400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd0073140 con 0x7f7bd015cca0 2024-08-19T00:43:30.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd00733f0 con 0x7f7bd006d600 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd5a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7bd015cca0 0x7f7bd015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd5000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7bd015bd70 0x7f7bd0072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53372/0 (socket says 172.21.15.7:53372) 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bd5000640 1 -- 172.21.15.7:0/3959496068 learned_addr learned my addr 172.21.15.7:0/3959496068 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.447+0000 7f7bc7e00640 1 --2- 172.21.15.7:0/3959496068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd006d600 0x7f7bd006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.448+0000 7f7bd5a00640 1 -- 172.21.15.7:0/3959496068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd006d600 msgr2=0x7f7bd006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.448+0000 7f7bd5a00640 1 --2- 172.21.15.7:0/3959496068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd006d600 0x7f7bd006da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.448+0000 7f7bd5a00640 1 -- 172.21.15.7:0/3959496068 >> v1:172.21.15.7:6789/0 conn(0x7f7bd015bd70 legacy=0x7f7bd0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.448+0000 7f7bd5a00640 1 -- 172.21.15.7:0/3959496068 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00736d0 con 0x7f7bd015cca0 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.448+0000 7f7bc7e00640 1 --2- 172.21.15.7:0/3959496068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd006d600 0x7f7bd006da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:30.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.448+0000 7f7bcfe00640 1 -- 172.21.15.7:0/3959496068 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901887795 0 0) 0x7f7bd006df60 con 0x7f7bd015bd70 2024-08-19T00:43:30.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.449+0000 7f7bd5a00640 1 --2- 172.21.15.7:0/3959496068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd015cca0 0x7f7bd015d130 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009dc0 tx=0x7f7bc802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e36e260d1eb0c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.449+0000 7f7bcfe00640 1 -- 172.21.15.7:0/3959496068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc802ae60 con 0x7f7bd015cca0 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.449+0000 7f7bcfe00640 1 -- 172.21.15.7:0/3959496068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc8007740 con 0x7f7bd015cca0 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.449+0000 7f7bcfe00640 1 -- 172.21.15.7:0/3959496068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8007b10 con 0x7f7bd015cca0 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 -- 172.21.15.7:0/3959496068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd015cca0 msgr2=0x7f7bd015d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 --2- 172.21.15.7:0/3959496068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd015cca0 0x7f7bd015d130 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009dc0 tx=0x7f7bc802a680 comp rx=0 tx=0).stop 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 -- 172.21.15.7:0/3959496068 shutdown_connections 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 --2- 172.21.15.7:0/3959496068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd015cca0 0x7f7bd015d130 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 --2- 172.21.15.7:0/3959496068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd006d600 0x7f7bd006da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 -- 172.21.15.7:0/3959496068 >> 172.21.15.7:0/3959496068 conn(0x7f7bd006b850 msgr2=0x7f7bd006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 -- 172.21.15.7:0/3959496068 shutdown_connections 2024-08-19T00:43:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.450+0000 7f7bd6400640 1 -- 172.21.15.7:0/3959496068 wait complete. 2024-08-19T00:43:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.451+0000 7f7bd6400640 1 Processor -- start 2024-08-19T00:43:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.452+0000 7f7bd6400640 1 -- start start 2024-08-19T00:43:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.452+0000 7f7bd6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd006d600 0x7f7bd00b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.452+0000 7f7bd6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bd015bd70 0x7f7bd00ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.452+0000 7f7bd6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd015cca0 0x7f7bd00aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.452+0000 7f7bd6400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd015c780 con 0x7f7bd006d600 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.452+0000 7f7bd6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd015c4a0 con 0x7f7bd015bd70 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.452+0000 7f7bd6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd015c150 con 0x7f7bd015cca0 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd006d600 0x7f7bd00b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd006d600 0x7f7bd00b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47948/0 (socket says 172.21.15.7:47948) 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 -- 172.21.15.7:0/265951527 learned_addr learned my addr 172.21.15.7:0/265951527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bc7e00640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bd015bd70 0x7f7bd00ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5a00640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd015cca0 0x7f7bd00aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 -- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd015cca0 msgr2=0x7f7bd00aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd015cca0 0x7f7bd00aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 -- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bd015bd70 msgr2=0x7f7bd00ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bd015bd70 0x7f7bd00ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 -- 172.21.15.7:0/265951527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00b3550 con 0x7f7bd006d600 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bc7e00640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bd015bd70 0x7f7bd00ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.453+0000 7f7bd5000640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd006d600 0x7f7bd00b49c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c500 tx=0x7f7bc000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.454+0000 7f7bcd600640 1 -- 172.21.15.7:0/265951527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0018070 con 0x7f7bd006d600 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.454+0000 7f7bcd600640 1 -- 172.21.15.7:0/265951527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc0007580 con 0x7f7bd006d600 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.454+0000 7f7bcd600640 1 -- 172.21.15.7:0/265951527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0004a20 con 0x7f7bd006d600 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.454+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd00b3830 con 0x7f7bd006d600 2024-08-19T00:43:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.454+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd00b3df0 con 0x7f7bd006d600 2024-08-19T00:43:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.455+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd006e3a0 con 0x7f7bd006d600 2024-08-19T00:43:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.456+0000 7f7bcd600640 1 -- 172.21.15.7:0/265951527 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bc0004bc0 con 0x7f7bd006d600 2024-08-19T00:43:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.457+0000 7f7bcd600640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7bac06be30 0x7f7bac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.457+0000 7f7bcd600640 1 -- 172.21.15.7:0/265951527 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f7bc008a180 con 0x7f7bd006d600 2024-08-19T00:43:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.457+0000 7f7bc7e00640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7bac06be30 0x7f7bac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.457+0000 7f7bc7e00640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7bac06be30 0x7f7bac06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0151dd0 tx=0x7f7bb8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.461+0000 7f7bcd600640 1 -- 172.21.15.7:0/265951527 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7bc0058b20 con 0x7f7bd006d600 2024-08-19T00:43:30.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.682+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bd0151e20 con 0x7f7bd006d600 2024-08-19T00:43:30.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.682+0000 7f7bcd600640 1 -- 172.21.15.7:0/265951527 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5225 (secure 0 0 0) 0x7f7bc0058420 con 0x7f7bd006d600 2024-08-19T00:43:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:30.684 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":84,"btime":"2024-08-19T00:43:30:255297+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3482189423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3482189423},{"type":"v1","addr":"172.21.15.162:6834","nonce":3482189423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:29.678316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6835/2295549448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2295549448},{"type":"v1","addr":"172.21.15.162:6835","nonce":2295549448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6505,"qdb_cluster":[6505]},"id":6}]} 2024-08-19T00:43:30.684 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 84 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7bac06be30 msgr2=0x7f7bac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7bac06be30 0x7f7bac06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0151dd0 tx=0x7f7bb8008040 comp rx=0 tx=0).stop 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd006d600 msgr2=0x7f7bd00b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd006d600 0x7f7bd00b49c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c500 tx=0x7f7bc000c9c0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 shutdown_connections 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7bac06be30 0x7f7bac06e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bd015cca0 0x7f7bd00aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bd015bd70 0x7f7bd00ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 --2- 172.21.15.7:0/265951527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd006d600 0x7f7bd00b49c0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 >> 172.21.15.7:0/265951527 conn(0x7f7bd006b850 msgr2=0x7f7bd00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 shutdown_connections 2024-08-19T00:43:30.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.685+0000 7f7bd6400640 1 -- 172.21.15.7:0/265951527 wait complete. 2024-08-19T00:43:30.702 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:43:30.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.858+0000 7f06c5000640 1 Processor -- start 2024-08-19T00:43:30.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.858+0000 7f06c5000640 1 -- start start 2024-08-19T00:43:30.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.859+0000 7f06c5000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f06c00b4ab0 0x7f06c006c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.859+0000 7f06c5000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c0162bf0 con 0x7f06c0147b80 2024-08-19T00:43:30.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.859+0000 7f06c5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c0161d00 con 0x7f06c00b3860 2024-08-19T00:43:30.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.859+0000 7f06c5000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f06c00cd740 con 0x7f06c00b4ab0 2024-08-19T00:43:30.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.859+0000 7f06bf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f06c0147b80 0x7f06c00b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53382/0 (socket says 172.21.15.7:53382) 2024-08-19T00:43:30.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.859+0000 7f06bf400640 1 -- 172.21.15.7:0/2656952958 learned_addr learned my addr 172.21.15.7:0/2656952958 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.859+0000 7f06b6a00640 1 --2- 172.21.15.7:0/2656952958 >> v2:172.21.15.162:3300/0 conn(0x7f06c00b4ab0 0x7f06c006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.860+0000 7f06bea00640 1 -- 172.21.15.7:0/2656952958 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260551594 0 0) 0x7f06c0162bf0 con 0x7f06c0147b80 2024-08-19T00:43:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.860+0000 7f06bea00640 1 -- 172.21.15.7:0/2656952958 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06a4003520 con 0x7f06c0147b80 2024-08-19T00:43:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.860+0000 7f06b6a00640 1 -- 172.21.15.7:0/2656952958 >> v1:172.21.15.162:6789/0 conn(0x7f06c00b3860 legacy=0x7f06c006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.860+0000 7f06b6a00640 1 -- 172.21.15.7:0/2656952958 >> v1:172.21.15.7:6789/0 conn(0x7f06c0147b80 legacy=0x7f06c00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.860+0000 7f06b6a00640 1 -- 172.21.15.7:0/2656952958 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c0161fe0 con 0x7f06c00b4ab0 2024-08-19T00:43:30.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.861+0000 7f06b6a00640 1 --2- 172.21.15.7:0/2656952958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c00b4ab0 0x7f06c006c260 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f06a80097a0 tx=0x7f06a802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4d657af54e05a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:30.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.861+0000 7f06bea00640 1 -- 172.21.15.7:0/2656952958 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8037070 con 0x7f06c00b4ab0 2024-08-19T00:43:30.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.861+0000 7f06bea00640 1 -- 172.21.15.7:0/2656952958 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a8032440 con 0x7f06c00b4ab0 2024-08-19T00:43:30.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.861+0000 7f06bea00640 1 -- 172.21.15.7:0/2656952958 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8032810 con 0x7f06c00b4ab0 2024-08-19T00:43:30.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.862+0000 7f06c5000640 1 -- 172.21.15.7:0/2656952958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c00b4ab0 msgr2=0x7f06c006c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.862+0000 7f06c5000640 1 --2- 172.21.15.7:0/2656952958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c00b4ab0 0x7f06c006c260 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f06a80097a0 tx=0x7f06a802a230 comp rx=0 tx=0).stop 2024-08-19T00:43:30.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.862+0000 7f06c5000640 1 -- 172.21.15.7:0/2656952958 shutdown_connections 2024-08-19T00:43:30.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.862+0000 7f06c5000640 1 --2- 172.21.15.7:0/2656952958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c00b4ab0 0x7f06c006c260 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.862+0000 7f06c5000640 1 -- 172.21.15.7:0/2656952958 >> 172.21.15.7:0/2656952958 conn(0x7f06c00b2d70 msgr2=0x7f06c00b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:30.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.862+0000 7f06c5000640 1 -- 172.21.15.7:0/2656952958 shutdown_connections 2024-08-19T00:43:30.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.862+0000 7f06c5000640 1 -- 172.21.15.7:0/2656952958 wait complete. 2024-08-19T00:43:30.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.864+0000 7f06c5000640 1 Processor -- start 2024-08-19T00:43:30.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.864+0000 7f06c5000640 1 -- start start 2024-08-19T00:43:30.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c00b3860 0x7f06c015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06c5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06c00b4ab0 0x7f06c00cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06c5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c0147b80 0x7f06c00cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06c5000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0162880 con 0x7f06c00b3860 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06c5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01625a0 con 0x7f06c0147b80 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06c5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06c00706f0 con 0x7f06c00b4ab0 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c00b3860 0x7f06c015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c00b3860 0x7f06c015d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47954/0 (socket says 172.21.15.7:47954) 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 -- 172.21.15.7:0/709922374 learned_addr learned my addr 172.21.15.7:0/709922374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bfe00640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c0147b80 0x7f06c00cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 -- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06c00b4ab0 msgr2=0x7f06c00cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06b6a00640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06c00b4ab0 0x7f06c00cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06c00b4ab0 0x7f06c00cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 -- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c0147b80 msgr2=0x7f06c00cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c0147b80 0x7f06c00cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bf400640 1 -- 172.21.15.7:0/709922374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c0144ac0 con 0x7f06c00b3860 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06bfe00640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c0147b80 0x7f06c00cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.865+0000 7f06b6a00640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06c00b4ab0 0x7f06c00cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.866+0000 7f06bf400640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c00b3860 0x7f06c015d990 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c410 tx=0x7f06b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.866+0000 7f06b7e00640 1 -- 172.21.15.7:0/709922374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0017070 con 0x7f06c00b3860 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.866+0000 7f06b7e00640 1 -- 172.21.15.7:0/709922374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b0005ce0 con 0x7f06c00b3860 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.866+0000 7f06b7e00640 1 -- 172.21.15.7:0/709922374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b00072f0 con 0x7f06c00b3860 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.866+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c0144da0 con 0x7f06c00b3860 2024-08-19T00:43:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.866+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c0145360 con 0x7f06c00b3860 2024-08-19T00:43:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.867+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c006c260 con 0x7f06c00b3860 2024-08-19T00:43:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.868+0000 7f06b7e00640 1 -- 172.21.15.7:0/709922374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06b001a070 con 0x7f06c00b3860 2024-08-19T00:43:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.869+0000 7f06b7e00640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f069c06be60 0x7f069c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.869+0000 7f06b7e00640 1 -- 172.21.15.7:0/709922374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f06b008a340 con 0x7f06c00b3860 2024-08-19T00:43:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.869+0000 7f06b6a00640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f069c06be60 0x7f069c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.870+0000 7f06b6a00640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f069c06be60 0x7f069c06e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f06a8034000 tx=0x7f06a802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:30.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:30.874+0000 7f06b7e00640 1 -- 172.21.15.7:0/709922374 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f06b0058d10 con 0x7f06c00b3860 2024-08-19T00:43:31.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.060+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06c0073b60 con 0x7f06c00b3860 2024-08-19T00:43:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.061+0000 7f06b7e00640 1 -- 172.21.15.7:0/709922374 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16636 (secure 0 0 0) 0x7f06b0058610 con 0x7f06c00b3860 2024-08-19T00:43:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:31.063 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:43:28.241102+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:43:24.450864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-08-19T00:43:25.656952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:43:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f069c06be60 msgr2=0x7f069c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f069c06be60 0x7f069c06e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f06a8034000 tx=0x7f06a802e000 comp rx=0 tx=0).stop 2024-08-19T00:43:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c00b3860 msgr2=0x7f06c015d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c00b3860 0x7f06c015d990 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c410 tx=0x7f06b000c8d0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 shutdown_connections 2024-08-19T00:43:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f069c06be60 0x7f069c06e320 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c0147b80 0x7f06c00cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06c00b4ab0 0x7f06c00cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 --2- 172.21.15.7:0/709922374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c00b3860 0x7f06c015d990 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 >> 172.21.15.7:0/709922374 conn(0x7f06c00b2d70 msgr2=0x7f06c0143130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:31.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 shutdown_connections 2024-08-19T00:43:31.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.063+0000 7f06c5000640 1 -- 172.21.15.7:0/709922374 wait complete. 2024-08-19T00:43:31.081 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:43:31.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:43:31.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.236+0000 7f107aa00640 1 Processor -- start 2024-08-19T00:43:31.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.236+0000 7f107aa00640 1 -- start start 2024-08-19T00:43:31.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.237+0000 7f107aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f107415ee50 0x7f107415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.237+0000 7f107aa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10740b3ab0 con 0x7f10740d3200 2024-08-19T00:43:31.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.237+0000 7f107aa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107415f460 con 0x7f107415e360 2024-08-19T00:43:31.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.237+0000 7f107aa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f107415f740 con 0x7f107415ee50 2024-08-19T00:43:31.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.237+0000 7f1078c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f10740d3200 0x7f107415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53390/0 (socket says 172.21.15.7:53390) 2024-08-19T00:43:31.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.237+0000 7f1078c00640 1 -- 172.21.15.7:0/4121613830 learned_addr learned my addr 172.21.15.7:0/4121613830 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.238+0000 7f107a000640 1 --2- 172.21.15.7:0/4121613830 >> v2:172.21.15.162:3300/0 conn(0x7f107415ee50 0x7f107415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.238+0000 7f1073e00640 1 -- 172.21.15.7:0/4121613830 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113163356 0 0) 0x7f10740b3ab0 con 0x7f10740d3200 2024-08-19T00:43:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.238+0000 7f1073e00640 1 -- 172.21.15.7:0/4121613830 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f105c003520 con 0x7f10740d3200 2024-08-19T00:43:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.238+0000 7f107a000640 1 -- 172.21.15.7:0/4121613830 >> v1:172.21.15.162:6789/0 conn(0x7f107415e360 legacy=0x7f10740d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.238+0000 7f107a000640 1 -- 172.21.15.7:0/4121613830 >> v1:172.21.15.7:6789/0 conn(0x7f10740d3200 legacy=0x7f107415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.238+0000 7f1073e00640 1 -- 172.21.15.7:0/4121613830 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1970238223 0 0) 0x7f105c003520 con 0x7f10740d3200 2024-08-19T00:43:31.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.238+0000 7f107a000640 1 -- 172.21.15.7:0/4121613830 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10740b3d60 con 0x7f107415ee50 2024-08-19T00:43:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.239+0000 7f107a000640 1 --2- 172.21.15.7:0/4121613830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415ee50 0x7f107415fab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f106c009d90 tx=0x7f106c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b393ac0a79fb38 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f1073e00640 1 -- 172.21.15.7:0/4121613830 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060001670 con 0x7f107415ee50 2024-08-19T00:43:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f1073e00640 1 -- 172.21.15.7:0/4121613830 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c007540 con 0x7f107415ee50 2024-08-19T00:43:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f1073e00640 1 -- 172.21.15.7:0/4121613830 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c007910 con 0x7f107415ee50 2024-08-19T00:43:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f107aa00640 1 -- 172.21.15.7:0/4121613830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415ee50 msgr2=0x7f107415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f107aa00640 1 --2- 172.21.15.7:0/4121613830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415ee50 0x7f107415fab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f106c009d90 tx=0x7f106c02a680 comp rx=0 tx=0).stop 2024-08-19T00:43:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f107aa00640 1 -- 172.21.15.7:0/4121613830 shutdown_connections 2024-08-19T00:43:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f107aa00640 1 --2- 172.21.15.7:0/4121613830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415ee50 0x7f107415fab0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f107aa00640 1 -- 172.21.15.7:0/4121613830 >> 172.21.15.7:0/4121613830 conn(0x7f107408dbf0 msgr2=0x7f107409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f107aa00640 1 -- 172.21.15.7:0/4121613830 shutdown_connections 2024-08-19T00:43:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.240+0000 7f107aa00640 1 -- 172.21.15.7:0/4121613830 wait complete. 2024-08-19T00:43:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.242+0000 7f107aa00640 1 Processor -- start 2024-08-19T00:43:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.242+0000 7f107aa00640 1 -- start start 2024-08-19T00:43:31.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f107aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740d3200 0x7f1074155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f107aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415e360 0x7f10740c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f107aa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f107415ee50 0x7f10740c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f107aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10740b4560 con 0x7f10740d3200 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f107aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10740d2300 con 0x7f107415e360 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f107aa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10740b46e0 con 0x7f107415ee50 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f1079600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740d3200 0x7f1074155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f1079600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740d3200 0x7f1074155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47970/0 (socket says 172.21.15.7:47970) 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f1079600640 1 -- 172.21.15.7:0/911825177 learned_addr learned my addr 172.21.15.7:0/911825177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f1078c00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415e360 0x7f10740c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1079600640 1 -- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f107415ee50 msgr2=0x7f10740c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.243+0000 7f107a000640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f107415ee50 0x7f10740c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1079600640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f107415ee50 0x7f10740c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1079600640 1 -- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415e360 msgr2=0x7f10740c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1079600640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415e360 0x7f10740c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1079600640 1 -- 172.21.15.7:0/911825177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10740c87d0 con 0x7f10740d3200 2024-08-19T00:43:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1078c00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415e360 0x7f10740c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f107a000640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f107415ee50 0x7f10740c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1079600640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740d3200 0x7f1074155db0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f106800c450 tx=0x7f106800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1071600640 1 -- 172.21.15.7:0/911825177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680052d0 con 0x7f10740d3200 2024-08-19T00:43:31.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1071600640 1 -- 172.21.15.7:0/911825177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1068005470 con 0x7f10740d3200 2024-08-19T00:43:31.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f1071600640 1 -- 172.21.15.7:0/911825177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068012870 con 0x7f10740d3200 2024-08-19T00:43:31.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10740c8ab0 con 0x7f10740d3200 2024-08-19T00:43:31.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.244+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10740c9350 con 0x7f10740d3200 2024-08-19T00:43:31.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.246+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10740d3020 con 0x7f10740d3200 2024-08-19T00:43:31.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.246+0000 7f1071600640 1 -- 172.21.15.7:0/911825177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1068012a10 con 0x7f10740d3200 2024-08-19T00:43:31.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.248+0000 7f1071600640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f105406be30 0x7f105406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.248+0000 7f1071600640 1 -- 172.21.15.7:0/911825177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f106808ab80 con 0x7f10740d3200 2024-08-19T00:43:31.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.248+0000 7f1078c00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f105406be30 0x7f105406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.249+0000 7f1078c00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f105406be30 0x7f105406e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1060001380 tx=0x7f1060009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:31.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.252+0000 7f1071600640 1 -- 172.21.15.7:0/911825177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f10740d3020 con 0x7f10740d3200 2024-08-19T00:43:31.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.433+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f107415fab0 con 0x7f105406be30 2024-08-19T00:43:31.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.440+0000 7f1071600640 1 -- 172.21.15.7:0/911825177 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252083 (secure 0 0 0) 0x7f107415fab0 con 0x7f105406be30 2024-08-19T00:43:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:31.445 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:43:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f105406be30 msgr2=0x7f105406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f105406be30 0x7f105406e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1060001380 tx=0x7f1060009040 comp rx=0 tx=0).stop 2024-08-19T00:43:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740d3200 msgr2=0x7f1074155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740d3200 0x7f1074155db0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f106800c450 tx=0x7f106800c910 comp rx=0 tx=0).stop 2024-08-19T00:43:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 shutdown_connections 2024-08-19T00:43:31.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f105406be30 0x7f105406e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f107415ee50 0x7f10740c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107415e360 0x7f10740c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 --2- 172.21.15.7:0/911825177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740d3200 0x7f1074155db0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.443+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 >> 172.21.15.7:0/911825177 conn(0x7f107408dbf0 msgr2=0x7f1074160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.444+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 shutdown_connections 2024-08-19T00:43:31.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.444+0000 7f107aa00640 1 -- 172.21.15.7:0/911825177 wait complete. 2024-08-19T00:43:31.460 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-08-19T00:43:31.347677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258944,"kb_used_data":9480,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715776,"statfs":{"total":773094113280,"available":772828954624,"internally_reserved":0,"allocated":9707520,"data_stored":4826548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001153"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769011+0000","last_change":"2024-08-19T00:43:27.259640+0000","last_active":"2024-08-19T00:43:28.769011+0000","last_peered":"2024-08-19T00:43:28.769011+0000","last_clean":"2024-08-19T00:43:28.769011+0000","last_became_active":"2024-08-19T00:43:27.259364+0000","last_became_peered":"2024-08-19T00:43:27.259364+0000","last_unstale":"2024-08-19T00:43:28.769011+0000","last_undegraded":"2024-08-19T00:43:28.769011+0000","last_fullsized":"2024-08-19T00:43:28.769011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:08.366242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250788+0000","last_change":"2024-08-19T00:43:27.261846+0000","last_active":"2024-08-19T00:43:28.250788+0000","last_peered":"2024-08-19T00:43:28.250788+0000","last_clean":"2024-08-19T00:43:28.250788+0000","last_became_active":"2024-08-19T00:43:27.261580+0000","last_became_peered":"2024-08-19T00:43:27.261580+0000","last_unstale":"2024-08-19T00:43:28.250788+0000","last_undegraded":"2024-08-19T00:43:28.250788+0000","last_fullsized":"2024-08-19T00:43:28.250788+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:41.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768705+0000","last_change":"2024-08-19T00:43:27.263914+0000","last_active":"2024-08-19T00:43:28.768705+0000","last_peered":"2024-08-19T00:43:28.768705+0000","last_clean":"2024-08-19T00:43:28.768705+0000","last_became_active":"2024-08-19T00:43:27.256100+0000","last_became_peered":"2024-08-19T00:43:27.256100+0000","last_unstale":"2024-08-19T00:43:28.768705+0000","last_undegraded":"2024-08-19T00:43:28.768705+0000","last_fullsized":"2024-08-19T00:43:28.768705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:41.845190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252095+0000","last_change":"2024-08-19T00:43:27.256771+0000","last_active":"2024-08-19T00:43:28.252095+0000","last_peered":"2024-08-19T00:43:28.252095+0000","last_clean":"2024-08-19T00:43:28.252095+0000","last_became_active":"2024-08-19T00:43:27.256376+0000","last_became_peered":"2024-08-19T00:43:27.256376+0000","last_unstale":"2024-08-19T00:43:28.252095+0000","last_undegraded":"2024-08-19T00:43:28.252095+0000","last_fullsized":"2024-08-19T00:43:28.252095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:41.845190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767377+0000","last_change":"2024-08-19T00:43:27.265983+0000","last_active":"2024-08-19T00:43:28.767377+0000","last_peered":"2024-08-19T00:43:28.767377+0000","last_clean":"2024-08-19T00:43:28.767377+0000","last_became_active":"2024-08-19T00:43:27.265688+0000","last_became_peered":"2024-08-19T00:43:27.265688+0000","last_unstale":"2024-08-19T00:43:28.767377+0000","last_undegraded":"2024-08-19T00:43:28.767377+0000","last_fullsized":"2024-08-19T00:43:28.767377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:03:36.385936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767480+0000","last_change":"2024-08-19T00:43:27.267976+0000","last_active":"2024-08-19T00:43:28.767480+0000","last_peered":"2024-08-19T00:43:28.767480+0000","last_clean":"2024-08-19T00:43:28.767480+0000","last_became_active":"2024-08-19T00:43:27.267507+0000","last_became_peered":"2024-08-19T00:43:27.267507+0000","last_unstale":"2024-08-19T00:43:28.767480+0000","last_undegraded":"2024-08-19T00:43:28.767480+0000","last_fullsized":"2024-08-19T00:43:28.767480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:28:57.101787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250478+0000","last_change":"2024-08-19T00:43:27.253620+0000","last_active":"2024-08-19T00:43:28.250478+0000","last_peered":"2024-08-19T00:43:28.250478+0000","last_clean":"2024-08-19T00:43:28.250478+0000","last_became_active":"2024-08-19T00:43:27.252774+0000","last_became_peered":"2024-08-19T00:43:27.252774+0000","last_unstale":"2024-08-19T00:43:28.250478+0000","last_undegraded":"2024-08-19T00:43:28.250478+0000","last_fullsized":"2024-08-19T00:43:28.250478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:31.688435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767924+0000","last_change":"2024-08-19T00:43:27.265003+0000","last_active":"2024-08-19T00:43:28.767924+0000","last_peered":"2024-08-19T00:43:28.767924+0000","last_clean":"2024-08-19T00:43:28.767924+0000","last_became_active":"2024-08-19T00:43:27.264719+0000","last_became_peered":"2024-08-19T00:43:27.264719+0000","last_unstale":"2024-08-19T00:43:28.767924+0000","last_undegraded":"2024-08-19T00:43:28.767924+0000","last_fullsized":"2024-08-19T00:43:28.767924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.649719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769024+0000","last_change":"2024-08-19T00:43:27.248809+0000","last_active":"2024-08-19T00:43:28.769024+0000","last_peered":"2024-08-19T00:43:28.769024+0000","last_clean":"2024-08-19T00:43:28.769024+0000","last_became_active":"2024-08-19T00:43:27.248417+0000","last_became_peered":"2024-08-19T00:43:27.248417+0000","last_unstale":"2024-08-19T00:43:28.769024+0000","last_undegraded":"2024-08-19T00:43:28.769024+0000","last_fullsized":"2024-08-19T00:43:28.769024+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:40:43.748031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768679+0000","last_change":"2024-08-19T00:43:27.265327+0000","last_active":"2024-08-19T00:43:28.768679+0000","last_peered":"2024-08-19T00:43:28.768679+0000","last_clean":"2024-08-19T00:43:28.768679+0000","last_became_active":"2024-08-19T00:43:27.264795+0000","last_became_peered":"2024-08-19T00:43:27.264795+0000","last_unstale":"2024-08-19T00:43:28.768679+0000","last_undegraded":"2024-08-19T00:43:28.768679+0000","last_fullsized":"2024-08-19T00:43:28.768679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:25.346987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767120+0000","last_change":"2024-08-19T00:43:27.263792+0000","last_active":"2024-08-19T00:43:28.767120+0000","last_peered":"2024-08-19T00:43:28.767120+0000","last_clean":"2024-08-19T00:43:28.767120+0000","last_became_active":"2024-08-19T00:43:27.261861+0000","last_became_peered":"2024-08-19T00:43:27.261861+0000","last_unstale":"2024-08-19T00:43:28.767120+0000","last_undegraded":"2024-08-19T00:43:28.767120+0000","last_fullsized":"2024-08-19T00:43:28.767120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.649719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767973+0000","last_change":"2024-08-19T00:43:27.247883+0000","last_active":"2024-08-19T00:43:28.767973+0000","last_peered":"2024-08-19T00:43:28.767973+0000","last_clean":"2024-08-19T00:43:28.767973+0000","last_became_active":"2024-08-19T00:43:27.247555+0000","last_became_peered":"2024-08-19T00:43:27.247555+0000","last_unstale":"2024-08-19T00:43:28.767973+0000","last_undegraded":"2024-08-19T00:43:28.767973+0000","last_fullsized":"2024-08-19T00:43:28.767973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:38.494522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767530+0000","last_change":"2024-08-19T00:43:27.262426+0000","last_active":"2024-08-19T00:43:28.767530+0000","last_peered":"2024-08-19T00:43:28.767530+0000","last_clean":"2024-08-19T00:43:28.767530+0000","last_became_active":"2024-08-19T00:43:27.261751+0000","last_became_peered":"2024-08-19T00:43:27.261751+0000","last_unstale":"2024-08-19T00:43:28.767530+0000","last_undegraded":"2024-08-19T00:43:28.767530+0000","last_fullsized":"2024-08-19T00:43:28.767530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:40.321992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251690+0000","last_change":"2024-08-19T00:43:27.253022+0000","last_active":"2024-08-19T00:43:28.251690+0000","last_peered":"2024-08-19T00:43:28.251690+0000","last_clean":"2024-08-19T00:43:28.251690+0000","last_became_active":"2024-08-19T00:43:27.251819+0000","last_became_peered":"2024-08-19T00:43:27.251819+0000","last_unstale":"2024-08-19T00:43:28.251690+0000","last_undegraded":"2024-08-19T00:43:28.251690+0000","last_fullsized":"2024-08-19T00:43:28.251690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:24.630669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250497+0000","last_change":"2024-08-19T00:43:27.258894+0000","last_active":"2024-08-19T00:43:28.250497+0000","last_peered":"2024-08-19T00:43:28.250497+0000","last_clean":"2024-08-19T00:43:28.250497+0000","last_became_active":"2024-08-19T00:43:27.258266+0000","last_became_peered":"2024-08-19T00:43:27.258266+0000","last_unstale":"2024-08-19T00:43:28.250497+0000","last_undegraded":"2024-08-19T00:43:28.250497+0000","last_fullsized":"2024-08-19T00:43:28.250497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:10.269530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767036+0000","last_change":"2024-08-19T00:43:27.259194+0000","last_active":"2024-08-19T00:43:28.767036+0000","last_peered":"2024-08-19T00:43:28.767036+0000","last_clean":"2024-08-19T00:43:28.767036+0000","last_became_active":"2024-08-19T00:43:27.258041+0000","last_became_peered":"2024-08-19T00:43:27.258041+0000","last_unstale":"2024-08-19T00:43:28.767036+0000","last_undegraded":"2024-08-19T00:43:28.767036+0000","last_fullsized":"2024-08-19T00:43:28.767036+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:36.092151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768099+0000","last_change":"2024-08-19T00:43:27.250078+0000","last_active":"2024-08-19T00:43:28.768099+0000","last_peered":"2024-08-19T00:43:28.768099+0000","last_clean":"2024-08-19T00:43:28.768099+0000","last_became_active":"2024-08-19T00:43:27.248929+0000","last_became_peered":"2024-08-19T00:43:27.248929+0000","last_unstale":"2024-08-19T00:43:28.768099+0000","last_undegraded":"2024-08-19T00:43:28.768099+0000","last_fullsized":"2024-08-19T00:43:28.768099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:40.710684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767007+0000","last_change":"2024-08-19T00:43:27.264845+0000","last_active":"2024-08-19T00:43:28.767007+0000","last_peered":"2024-08-19T00:43:28.767007+0000","last_clean":"2024-08-19T00:43:28.767007+0000","last_became_active":"2024-08-19T00:43:27.262011+0000","last_became_peered":"2024-08-19T00:43:27.262011+0000","last_unstale":"2024-08-19T00:43:28.767007+0000","last_undegraded":"2024-08-19T00:43:28.767007+0000","last_fullsized":"2024-08-19T00:43:28.767007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:31.358363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252377+0000","last_change":"2024-08-19T00:43:27.255190+0000","last_active":"2024-08-19T00:43:28.252377+0000","last_peered":"2024-08-19T00:43:28.252377+0000","last_clean":"2024-08-19T00:43:28.252377+0000","last_became_active":"2024-08-19T00:43:27.254881+0000","last_became_peered":"2024-08-19T00:43:27.254881+0000","last_unstale":"2024-08-19T00:43:28.252377+0000","last_undegraded":"2024-08-19T00:43:28.252377+0000","last_fullsized":"2024-08-19T00:43:28.252377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:08.366242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252028+0000","last_change":"2024-08-19T00:43:27.253877+0000","last_active":"2024-08-19T00:43:28.252028+0000","last_peered":"2024-08-19T00:43:28.252028+0000","last_clean":"2024-08-19T00:43:28.252028+0000","last_became_active":"2024-08-19T00:43:27.251144+0000","last_became_peered":"2024-08-19T00:43:27.251144+0000","last_unstale":"2024-08-19T00:43:28.252028+0000","last_undegraded":"2024-08-19T00:43:28.252028+0000","last_fullsized":"2024-08-19T00:43:28.252028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:39.990758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252490+0000","last_change":"2024-08-19T00:43:27.254154+0000","last_active":"2024-08-19T00:43:28.252490+0000","last_peered":"2024-08-19T00:43:28.252490+0000","last_clean":"2024-08-19T00:43:28.252490+0000","last_became_active":"2024-08-19T00:43:27.252492+0000","last_became_peered":"2024-08-19T00:43:27.252492+0000","last_unstale":"2024-08-19T00:43:28.252490+0000","last_undegraded":"2024-08-19T00:43:28.252490+0000","last_fullsized":"2024-08-19T00:43:28.252490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:33.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251845+0000","last_change":"2024-08-19T00:43:27.252207+0000","last_active":"2024-08-19T00:43:28.251845+0000","last_peered":"2024-08-19T00:43:28.251845+0000","last_clean":"2024-08-19T00:43:28.251845+0000","last_became_active":"2024-08-19T00:43:27.251468+0000","last_became_peered":"2024-08-19T00:43:27.251468+0000","last_unstale":"2024-08-19T00:43:28.251845+0000","last_undegraded":"2024-08-19T00:43:28.251845+0000","last_fullsized":"2024-08-19T00:43:28.251845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:13.141021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766869+0000","last_change":"2024-08-19T00:43:27.244156+0000","last_active":"2024-08-19T00:43:28.766869+0000","last_peered":"2024-08-19T00:43:28.766869+0000","last_clean":"2024-08-19T00:43:28.766869+0000","last_became_active":"2024-08-19T00:43:27.243604+0000","last_became_peered":"2024-08-19T00:43:27.243604+0000","last_unstale":"2024-08-19T00:43:28.766869+0000","last_undegraded":"2024-08-19T00:43:28.766869+0000","last_fullsized":"2024-08-19T00:43:28.766869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:04.402827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766920+0000","last_change":"2024-08-19T00:43:27.266289+0000","last_active":"2024-08-19T00:43:28.766920+0000","last_peered":"2024-08-19T00:43:28.766920+0000","last_clean":"2024-08-19T00:43:28.766920+0000","last_became_active":"2024-08-19T00:43:27.266003+0000","last_became_peered":"2024-08-19T00:43:27.266003+0000","last_unstale":"2024-08-19T00:43:28.766920+0000","last_undegraded":"2024-08-19T00:43:28.766920+0000","last_fullsized":"2024-08-19T00:43:28.766920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:28.221857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766849+0000","last_change":"2024-08-19T00:43:27.261202+0000","last_active":"2024-08-19T00:43:28.766849+0000","last_peered":"2024-08-19T00:43:28.766849+0000","last_clean":"2024-08-19T00:43:28.766849+0000","last_became_active":"2024-08-19T00:43:27.260696+0000","last_became_peered":"2024-08-19T00:43:27.260696+0000","last_unstale":"2024-08-19T00:43:28.766849+0000","last_undegraded":"2024-08-19T00:43:28.766849+0000","last_fullsized":"2024-08-19T00:43:28.766849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:23.890175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767491+0000","last_change":"2024-08-19T00:43:27.256609+0000","last_active":"2024-08-19T00:43:28.767491+0000","last_peered":"2024-08-19T00:43:28.767491+0000","last_clean":"2024-08-19T00:43:28.767491+0000","last_became_active":"2024-08-19T00:43:27.252505+0000","last_became_peered":"2024-08-19T00:43:27.252505+0000","last_unstale":"2024-08-19T00:43:28.767491+0000","last_undegraded":"2024-08-19T00:43:28.767491+0000","last_fullsized":"2024-08-19T00:43:28.767491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:25:57.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767402+0000","last_change":"2024-08-19T00:43:27.261920+0000","last_active":"2024-08-19T00:43:28.767402+0000","last_peered":"2024-08-19T00:43:28.767402+0000","last_clean":"2024-08-19T00:43:28.767402+0000","last_became_active":"2024-08-19T00:43:27.261595+0000","last_became_peered":"2024-08-19T00:43:27.261595+0000","last_unstale":"2024-08-19T00:43:28.767402+0000","last_undegraded":"2024-08-19T00:43:28.767402+0000","last_fullsized":"2024-08-19T00:43:28.767402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:26:26.573704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767230+0000","last_change":"2024-08-19T00:43:27.245322+0000","last_active":"2024-08-19T00:43:28.767230+0000","last_peered":"2024-08-19T00:43:28.767230+0000","last_clean":"2024-08-19T00:43:28.767230+0000","last_became_active":"2024-08-19T00:43:27.245057+0000","last_became_peered":"2024-08-19T00:43:27.245057+0000","last_unstale":"2024-08-19T00:43:28.767230+0000","last_undegraded":"2024-08-19T00:43:28.767230+0000","last_fullsized":"2024-08-19T00:43:28.767230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:59.209595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252649+0000","last_change":"2024-08-19T00:43:27.248660+0000","last_active":"2024-08-19T00:43:28.252649+0000","last_peered":"2024-08-19T00:43:28.252649+0000","last_clean":"2024-08-19T00:43:28.252649+0000","last_became_active":"2024-08-19T00:43:27.248044+0000","last_became_peered":"2024-08-19T00:43:27.248044+0000","last_unstale":"2024-08-19T00:43:28.252649+0000","last_undegraded":"2024-08-19T00:43:28.252649+0000","last_fullsized":"2024-08-19T00:43:28.252649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:33:06.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252020+0000","last_change":"2024-08-19T00:43:27.253266+0000","last_active":"2024-08-19T00:43:28.252020+0000","last_peered":"2024-08-19T00:43:28.252020+0000","last_clean":"2024-08-19T00:43:28.252020+0000","last_became_active":"2024-08-19T00:43:27.252157+0000","last_became_peered":"2024-08-19T00:43:27.252157+0000","last_unstale":"2024-08-19T00:43:28.252020+0000","last_undegraded":"2024-08-19T00:43:28.252020+0000","last_fullsized":"2024-08-19T00:43:28.252020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:22.151596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767792+0000","last_change":"2024-08-19T00:43:27.265561+0000","last_active":"2024-08-19T00:43:28.767792+0000","last_peered":"2024-08-19T00:43:28.767792+0000","last_clean":"2024-08-19T00:43:28.767792+0000","last_became_active":"2024-08-19T00:43:27.265302+0000","last_became_peered":"2024-08-19T00:43:27.265302+0000","last_unstale":"2024-08-19T00:43:28.767792+0000","last_undegraded":"2024-08-19T00:43:28.767792+0000","last_fullsized":"2024-08-19T00:43:28.767792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:18.239557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767180+0000","last_change":"2024-08-19T00:43:27.267978+0000","last_active":"2024-08-19T00:43:28.767180+0000","last_peered":"2024-08-19T00:43:28.767180+0000","last_clean":"2024-08-19T00:43:28.767180+0000","last_became_active":"2024-08-19T00:43:27.267598+0000","last_became_peered":"2024-08-19T00:43:27.267598+0000","last_unstale":"2024-08-19T00:43:28.767180+0000","last_undegraded":"2024-08-19T00:43:28.767180+0000","last_fullsized":"2024-08-19T00:43:28.767180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:02.273830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767033+0000","last_change":"2024-08-19T00:43:27.249270+0000","last_active":"2024-08-19T00:43:28.767033+0000","last_peered":"2024-08-19T00:43:28.767033+0000","last_clean":"2024-08-19T00:43:28.767033+0000","last_became_active":"2024-08-19T00:43:27.248162+0000","last_became_peered":"2024-08-19T00:43:27.248162+0000","last_unstale":"2024-08-19T00:43:28.767033+0000","last_undegraded":"2024-08-19T00:43:28.767033+0000","last_fullsized":"2024-08-19T00:43:28.767033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:30.154871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767704+0000","last_change":"2024-08-19T00:43:26.246125+0000","last_active":"2024-08-19T00:43:28.767704+0000","last_peered":"2024-08-19T00:43:28.767704+0000","last_clean":"2024-08-19T00:43:28.767704+0000","last_became_active":"2024-08-19T00:43:26.245804+0000","last_became_peered":"2024-08-19T00:43:26.245804+0000","last_unstale":"2024-08-19T00:43:28.767704+0000","last_undegraded":"2024-08-19T00:43:28.767704+0000","last_fullsized":"2024-08-19T00:43:28.767704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:17.236477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769097+0000","last_change":"2024-08-19T00:43:27.260846+0000","last_active":"2024-08-19T00:43:28.769097+0000","last_peered":"2024-08-19T00:43:28.769097+0000","last_clean":"2024-08-19T00:43:28.769097+0000","last_became_active":"2024-08-19T00:43:27.260046+0000","last_became_peered":"2024-08-19T00:43:27.260046+0000","last_unstale":"2024-08-19T00:43:28.769097+0000","last_undegraded":"2024-08-19T00:43:28.769097+0000","last_fullsized":"2024-08-19T00:43:28.769097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:23:54.464056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768583+0000","last_change":"2024-08-19T00:43:26.248047+0000","last_active":"2024-08-19T00:43:28.768583+0000","last_peered":"2024-08-19T00:43:28.768583+0000","last_clean":"2024-08-19T00:43:28.768583+0000","last_became_active":"2024-08-19T00:43:26.247782+0000","last_became_peered":"2024-08-19T00:43:26.247782+0000","last_unstale":"2024-08-19T00:43:28.768583+0000","last_undegraded":"2024-08-19T00:43:28.768583+0000","last_fullsized":"2024-08-19T00:43:28.768583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:29.151791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768093+0000","last_change":"2024-08-19T00:43:27.248545+0000","last_active":"2024-08-19T00:43:28.768093+0000","last_peered":"2024-08-19T00:43:28.768093+0000","last_clean":"2024-08-19T00:43:28.768093+0000","last_became_active":"2024-08-19T00:43:27.248239+0000","last_became_peered":"2024-08-19T00:43:27.248239+0000","last_unstale":"2024-08-19T00:43:28.768093+0000","last_undegraded":"2024-08-19T00:43:28.768093+0000","last_fullsized":"2024-08-19T00:43:28.768093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:11.927273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767104+0000","last_change":"2024-08-19T00:43:26.251923+0000","last_active":"2024-08-19T00:43:28.767104+0000","last_peered":"2024-08-19T00:43:28.767104+0000","last_clean":"2024-08-19T00:43:28.767104+0000","last_became_active":"2024-08-19T00:43:26.251439+0000","last_became_peered":"2024-08-19T00:43:26.251439+0000","last_unstale":"2024-08-19T00:43:28.767104+0000","last_undegraded":"2024-08-19T00:43:28.767104+0000","last_fullsized":"2024-08-19T00:43:28.767104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:07.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768496+0000","last_change":"2024-08-19T00:43:27.263705+0000","last_active":"2024-08-19T00:43:28.768496+0000","last_peered":"2024-08-19T00:43:28.768496+0000","last_clean":"2024-08-19T00:43:28.768496+0000","last_became_active":"2024-08-19T00:43:27.263362+0000","last_became_peered":"2024-08-19T00:43:27.263362+0000","last_unstale":"2024-08-19T00:43:28.768496+0000","last_undegraded":"2024-08-19T00:43:28.768496+0000","last_fullsized":"2024-08-19T00:43:28.768496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:39.990758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252153+0000","last_change":"2024-08-19T00:43:26.246804+0000","last_active":"2024-08-19T00:43:28.252153+0000","last_peered":"2024-08-19T00:43:28.252153+0000","last_clean":"2024-08-19T00:43:28.252153+0000","last_became_active":"2024-08-19T00:43:26.246490+0000","last_became_peered":"2024-08-19T00:43:26.246490+0000","last_unstale":"2024-08-19T00:43:28.252153+0000","last_undegraded":"2024-08-19T00:43:28.252153+0000","last_fullsized":"2024-08-19T00:43:28.252153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:58:42.326764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252213+0000","last_change":"2024-08-19T00:43:27.262564+0000","last_active":"2024-08-19T00:43:28.252213+0000","last_peered":"2024-08-19T00:43:28.252213+0000","last_clean":"2024-08-19T00:43:28.252213+0000","last_became_active":"2024-08-19T00:43:27.262296+0000","last_became_peered":"2024-08-19T00:43:27.262296+0000","last_unstale":"2024-08-19T00:43:28.252213+0000","last_undegraded":"2024-08-19T00:43:28.252213+0000","last_fullsized":"2024-08-19T00:43:28.252213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:28.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767752+0000","last_change":"2024-08-19T00:43:26.253685+0000","last_active":"2024-08-19T00:43:28.767752+0000","last_peered":"2024-08-19T00:43:28.767752+0000","last_clean":"2024-08-19T00:43:28.767752+0000","last_became_active":"2024-08-19T00:43:26.252890+0000","last_became_peered":"2024-08-19T00:43:26.252890+0000","last_unstale":"2024-08-19T00:43:28.767752+0000","last_undegraded":"2024-08-19T00:43:28.767752+0000","last_fullsized":"2024-08-19T00:43:28.767752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:48.821388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768509+0000","last_change":"2024-08-19T00:43:27.262317+0000","last_active":"2024-08-19T00:43:28.768509+0000","last_peered":"2024-08-19T00:43:28.768509+0000","last_clean":"2024-08-19T00:43:28.768509+0000","last_became_active":"2024-08-19T00:43:27.261568+0000","last_became_peered":"2024-08-19T00:43:27.261568+0000","last_unstale":"2024-08-19T00:43:28.768509+0000","last_undegraded":"2024-08-19T00:43:28.768509+0000","last_fullsized":"2024-08-19T00:43:28.768509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:19.803006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767536+0000","last_change":"2024-08-19T00:43:26.247209+0000","last_active":"2024-08-19T00:43:28.767536+0000","last_peered":"2024-08-19T00:43:28.767536+0000","last_clean":"2024-08-19T00:43:28.767536+0000","last_became_active":"2024-08-19T00:43:26.246911+0000","last_became_peered":"2024-08-19T00:43:26.246911+0000","last_unstale":"2024-08-19T00:43:28.767536+0000","last_undegraded":"2024-08-19T00:43:28.767536+0000","last_fullsized":"2024-08-19T00:43:28.767536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:18.147846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767879+0000","last_change":"2024-08-19T00:43:27.262904+0000","last_active":"2024-08-19T00:43:28.767879+0000","last_peered":"2024-08-19T00:43:28.767879+0000","last_clean":"2024-08-19T00:43:28.767879+0000","last_became_active":"2024-08-19T00:43:27.261180+0000","last_became_peered":"2024-08-19T00:43:27.261180+0000","last_unstale":"2024-08-19T00:43:28.767879+0000","last_undegraded":"2024-08-19T00:43:28.767879+0000","last_fullsized":"2024-08-19T00:43:28.767879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:05.079587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251607+0000","last_change":"2024-08-19T00:43:26.247049+0000","last_active":"2024-08-19T00:43:28.251607+0000","last_peered":"2024-08-19T00:43:28.251607+0000","last_clean":"2024-08-19T00:43:28.251607+0000","last_became_active":"2024-08-19T00:43:26.246711+0000","last_became_peered":"2024-08-19T00:43:26.246711+0000","last_unstale":"2024-08-19T00:43:28.251607+0000","last_undegraded":"2024-08-19T00:43:28.251607+0000","last_fullsized":"2024-08-19T00:43:28.251607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:44:11.937523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251470+0000","last_change":"2024-08-19T00:43:27.248910+0000","last_active":"2024-08-19T00:43:28.251470+0000","last_peered":"2024-08-19T00:43:28.251470+0000","last_clean":"2024-08-19T00:43:28.251470+0000","last_became_active":"2024-08-19T00:43:27.248587+0000","last_became_peered":"2024-08-19T00:43:27.248587+0000","last_unstale":"2024-08-19T00:43:28.251470+0000","last_undegraded":"2024-08-19T00:43:28.251470+0000","last_fullsized":"2024-08-19T00:43:28.251470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:05.079587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251353+0000","last_change":"2024-08-19T00:43:26.249337+0000","last_active":"2024-08-19T00:43:28.251353+0000","last_peered":"2024-08-19T00:43:28.251353+0000","last_clean":"2024-08-19T00:43:28.251353+0000","last_became_active":"2024-08-19T00:43:26.248960+0000","last_became_peered":"2024-08-19T00:43:26.248960+0000","last_unstale":"2024-08-19T00:43:28.251353+0000","last_undegraded":"2024-08-19T00:43:28.251353+0000","last_fullsized":"2024-08-19T00:43:28.251353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:33.748667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252439+0000","last_change":"2024-08-19T00:43:27.256006+0000","last_active":"2024-08-19T00:43:28.252439+0000","last_peered":"2024-08-19T00:43:28.252439+0000","last_clean":"2024-08-19T00:43:28.252439+0000","last_became_active":"2024-08-19T00:43:27.255714+0000","last_became_peered":"2024-08-19T00:43:27.255714+0000","last_unstale":"2024-08-19T00:43:28.252439+0000","last_undegraded":"2024-08-19T00:43:28.252439+0000","last_fullsized":"2024-08-19T00:43:28.252439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:40:43.748031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769129+0000","last_change":"2024-08-19T00:43:26.242572+0000","last_active":"2024-08-19T00:43:28.769129+0000","last_peered":"2024-08-19T00:43:28.769129+0000","last_clean":"2024-08-19T00:43:28.769129+0000","last_became_active":"2024-08-19T00:43:26.242278+0000","last_became_peered":"2024-08-19T00:43:26.242278+0000","last_unstale":"2024-08-19T00:43:28.769129+0000","last_undegraded":"2024-08-19T00:43:28.769129+0000","last_fullsized":"2024-08-19T00:43:28.769129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:38.836421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769177+0000","last_change":"2024-08-19T00:43:27.263872+0000","last_active":"2024-08-19T00:43:28.769177+0000","last_peered":"2024-08-19T00:43:28.769177+0000","last_clean":"2024-08-19T00:43:28.769177+0000","last_became_active":"2024-08-19T00:43:27.261810+0000","last_became_peered":"2024-08-19T00:43:27.261810+0000","last_unstale":"2024-08-19T00:43:28.769177+0000","last_undegraded":"2024-08-19T00:43:28.769177+0000","last_fullsized":"2024-08-19T00:43:28.769177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:49.824469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768708+0000","last_change":"2024-08-19T00:43:26.253953+0000","last_active":"2024-08-19T00:43:28.768708+0000","last_peered":"2024-08-19T00:43:28.768708+0000","last_clean":"2024-08-19T00:43:28.768708+0000","last_became_active":"2024-08-19T00:43:26.252604+0000","last_became_peered":"2024-08-19T00:43:26.252604+0000","last_unstale":"2024-08-19T00:43:28.768708+0000","last_undegraded":"2024-08-19T00:43:28.768708+0000","last_fullsized":"2024-08-19T00:43:28.768708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:45.646638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767011+0000","last_change":"2024-08-19T00:43:27.271707+0000","last_active":"2024-08-19T00:43:28.767011+0000","last_peered":"2024-08-19T00:43:28.767011+0000","last_clean":"2024-08-19T00:43:28.767011+0000","last_became_active":"2024-08-19T00:43:27.271387+0000","last_became_peered":"2024-08-19T00:43:27.271387+0000","last_unstale":"2024-08-19T00:43:28.767011+0000","last_undegraded":"2024-08-19T00:43:28.767011+0000","last_fullsized":"2024-08-19T00:43:28.767011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:04.402827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768781+0000","last_change":"2024-08-19T00:43:26.251562+0000","last_active":"2024-08-19T00:43:28.768781+0000","last_peered":"2024-08-19T00:43:28.768781+0000","last_clean":"2024-08-19T00:43:28.768781+0000","last_became_active":"2024-08-19T00:43:26.251123+0000","last_became_peered":"2024-08-19T00:43:26.251123+0000","last_unstale":"2024-08-19T00:43:28.768781+0000","last_undegraded":"2024-08-19T00:43:28.768781+0000","last_fullsized":"2024-08-19T00:43:28.768781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:33.748667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767360+0000","last_change":"2024-08-19T00:43:27.270547+0000","last_active":"2024-08-19T00:43:28.767360+0000","last_peered":"2024-08-19T00:43:28.767360+0000","last_clean":"2024-08-19T00:43:28.767360+0000","last_became_active":"2024-08-19T00:43:27.270247+0000","last_became_peered":"2024-08-19T00:43:27.270247+0000","last_unstale":"2024-08-19T00:43:28.767360+0000","last_undegraded":"2024-08-19T00:43:28.767360+0000","last_fullsized":"2024-08-19T00:43:28.767360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:52.090956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768128+0000","last_change":"2024-08-19T00:43:26.250539+0000","last_active":"2024-08-19T00:43:28.768128+0000","last_peered":"2024-08-19T00:43:28.768128+0000","last_clean":"2024-08-19T00:43:28.768128+0000","last_became_active":"2024-08-19T00:43:26.250267+0000","last_became_peered":"2024-08-19T00:43:26.250267+0000","last_unstale":"2024-08-19T00:43:28.768128+0000","last_undegraded":"2024-08-19T00:43:28.768128+0000","last_fullsized":"2024-08-19T00:43:28.768128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:33.804755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766748+0000","last_change":"2024-08-19T00:43:27.268964+0000","last_active":"2024-08-19T00:43:28.766748+0000","last_peered":"2024-08-19T00:43:28.766748+0000","last_clean":"2024-08-19T00:43:28.766748+0000","last_became_active":"2024-08-19T00:43:27.267592+0000","last_became_peered":"2024-08-19T00:43:27.267592+0000","last_unstale":"2024-08-19T00:43:28.766748+0000","last_undegraded":"2024-08-19T00:43:28.766748+0000","last_fullsized":"2024-08-19T00:43:28.766748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:30.267115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252657+0000","last_change":"2024-08-19T00:43:26.243216+0000","last_active":"2024-08-19T00:43:28.252657+0000","last_peered":"2024-08-19T00:43:28.252657+0000","last_clean":"2024-08-19T00:43:28.252657+0000","last_became_active":"2024-08-19T00:43:26.242929+0000","last_became_peered":"2024-08-19T00:43:26.242929+0000","last_unstale":"2024-08-19T00:43:28.252657+0000","last_undegraded":"2024-08-19T00:43:28.252657+0000","last_fullsized":"2024-08-19T00:43:28.252657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:19:05.337990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767635+0000","last_change":"2024-08-19T00:43:27.260738+0000","last_active":"2024-08-19T00:43:28.767635+0000","last_peered":"2024-08-19T00:43:28.767635+0000","last_clean":"2024-08-19T00:43:28.767635+0000","last_became_active":"2024-08-19T00:43:27.260440+0000","last_became_peered":"2024-08-19T00:43:27.260440+0000","last_unstale":"2024-08-19T00:43:28.767635+0000","last_undegraded":"2024-08-19T00:43:28.767635+0000","last_fullsized":"2024-08-19T00:43:28.767635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:05.612255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250308+0000","last_change":"2024-08-19T00:43:26.251595+0000","last_active":"2024-08-19T00:43:28.250308+0000","last_peered":"2024-08-19T00:43:28.250308+0000","last_clean":"2024-08-19T00:43:28.250308+0000","last_became_active":"2024-08-19T00:43:26.251139+0000","last_became_peered":"2024-08-19T00:43:26.251139+0000","last_unstale":"2024-08-19T00:43:28.250308+0000","last_undegraded":"2024-08-19T00:43:28.250308+0000","last_fullsized":"2024-08-19T00:43:28.250308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:07.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251278+0000","last_change":"2024-08-19T00:43:27.261460+0000","last_active":"2024-08-19T00:43:28.251278+0000","last_peered":"2024-08-19T00:43:28.251278+0000","last_clean":"2024-08-19T00:43:28.251278+0000","last_became_active":"2024-08-19T00:43:27.261164+0000","last_became_peered":"2024-08-19T00:43:27.261164+0000","last_unstale":"2024-08-19T00:43:28.251278+0000","last_undegraded":"2024-08-19T00:43:28.251278+0000","last_fullsized":"2024-08-19T00:43:28.251278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:05.612255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767844+0000","last_change":"2024-08-19T00:43:26.235275+0000","last_active":"2024-08-19T00:43:28.767844+0000","last_peered":"2024-08-19T00:43:28.767844+0000","last_clean":"2024-08-19T00:43:28.767844+0000","last_became_active":"2024-08-19T00:43:26.234935+0000","last_became_peered":"2024-08-19T00:43:26.234935+0000","last_unstale":"2024-08-19T00:43:28.767844+0000","last_undegraded":"2024-08-19T00:43:28.767844+0000","last_fullsized":"2024-08-19T00:43:28.767844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:27.218776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766568+0000","last_change":"2024-08-19T00:43:27.266257+0000","last_active":"2024-08-19T00:43:28.766568+0000","last_peered":"2024-08-19T00:43:28.766568+0000","last_clean":"2024-08-19T00:43:28.766568+0000","last_became_active":"2024-08-19T00:43:27.265880+0000","last_became_peered":"2024-08-19T00:43:27.265880+0000","last_unstale":"2024-08-19T00:43:28.766568+0000","last_undegraded":"2024-08-19T00:43:28.766568+0000","last_fullsized":"2024-08-19T00:43:28.766568+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:41.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766631+0000","last_change":"2024-08-19T00:43:26.247753+0000","last_active":"2024-08-19T00:43:28.766631+0000","last_peered":"2024-08-19T00:43:28.766631+0000","last_clean":"2024-08-19T00:43:28.766631+0000","last_became_active":"2024-08-19T00:43:26.246140+0000","last_became_peered":"2024-08-19T00:43:26.246140+0000","last_unstale":"2024-08-19T00:43:28.766631+0000","last_undegraded":"2024-08-19T00:43:28.766631+0000","last_fullsized":"2024-08-19T00:43:28.766631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:21.148516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768196+0000","last_change":"2024-08-19T00:43:27.246597+0000","last_active":"2024-08-19T00:43:28.768196+0000","last_peered":"2024-08-19T00:43:28.768196+0000","last_clean":"2024-08-19T00:43:28.768196+0000","last_became_active":"2024-08-19T00:43:27.246206+0000","last_became_peered":"2024-08-19T00:43:27.246206+0000","last_unstale":"2024-08-19T00:43:28.768196+0000","last_undegraded":"2024-08-19T00:43:28.768196+0000","last_fullsized":"2024-08-19T00:43:28.768196+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:27.480299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767849+0000","last_change":"2024-08-19T00:43:26.254823+0000","last_active":"2024-08-19T00:43:28.767849+0000","last_peered":"2024-08-19T00:43:28.767849+0000","last_clean":"2024-08-19T00:43:28.767849+0000","last_became_active":"2024-08-19T00:43:26.254128+0000","last_became_peered":"2024-08-19T00:43:26.254128+0000","last_unstale":"2024-08-19T00:43:28.767849+0000","last_undegraded":"2024-08-19T00:43:28.767849+0000","last_fullsized":"2024-08-19T00:43:28.767849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:18.799925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768921+0000","last_change":"2024-08-19T00:43:27.264063+0000","last_active":"2024-08-19T00:43:28.768921+0000","last_peered":"2024-08-19T00:43:28.768921+0000","last_clean":"2024-08-19T00:43:28.768921+0000","last_became_active":"2024-08-19T00:43:27.263736+0000","last_became_peered":"2024-08-19T00:43:27.263736+0000","last_unstale":"2024-08-19T00:43:28.768921+0000","last_undegraded":"2024-08-19T00:43:28.768921+0000","last_fullsized":"2024-08-19T00:43:28.768921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:33.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252497+0000","last_change":"2024-08-19T00:43:26.245999+0000","last_active":"2024-08-19T00:43:28.252497+0000","last_peered":"2024-08-19T00:43:28.252497+0000","last_clean":"2024-08-19T00:43:28.252497+0000","last_became_active":"2024-08-19T00:43:26.245343+0000","last_became_peered":"2024-08-19T00:43:26.245343+0000","last_unstale":"2024-08-19T00:43:28.252497+0000","last_undegraded":"2024-08-19T00:43:28.252497+0000","last_fullsized":"2024-08-19T00:43:28.252497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:20:05.728407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768153+0000","last_change":"2024-08-19T00:43:27.247091+0000","last_active":"2024-08-19T00:43:28.768153+0000","last_peered":"2024-08-19T00:43:28.768153+0000","last_clean":"2024-08-19T00:43:28.768153+0000","last_became_active":"2024-08-19T00:43:27.245584+0000","last_became_peered":"2024-08-19T00:43:27.245584+0000","last_unstale":"2024-08-19T00:43:28.768153+0000","last_undegraded":"2024-08-19T00:43:28.768153+0000","last_fullsized":"2024-08-19T00:43:28.768153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:09.776567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252086+0000","last_change":"2024-08-19T00:43:26.245518+0000","last_active":"2024-08-19T00:43:28.252086+0000","last_peered":"2024-08-19T00:43:28.252086+0000","last_clean":"2024-08-19T00:43:28.252086+0000","last_became_active":"2024-08-19T00:43:26.244229+0000","last_became_peered":"2024-08-19T00:43:26.244229+0000","last_unstale":"2024-08-19T00:43:28.252086+0000","last_undegraded":"2024-08-19T00:43:28.252086+0000","last_fullsized":"2024-08-19T00:43:28.252086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:14.099566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250463+0000","last_change":"2024-08-19T00:43:27.263950+0000","last_active":"2024-08-19T00:43:28.250463+0000","last_peered":"2024-08-19T00:43:28.250463+0000","last_clean":"2024-08-19T00:43:28.250463+0000","last_became_active":"2024-08-19T00:43:27.261230+0000","last_became_peered":"2024-08-19T00:43:27.261230+0000","last_unstale":"2024-08-19T00:43:28.250463+0000","last_undegraded":"2024-08-19T00:43:28.250463+0000","last_fullsized":"2024-08-19T00:43:28.250463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:32.967177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252016+0000","last_change":"2024-08-19T00:43:26.246724+0000","last_active":"2024-08-19T00:43:28.252016+0000","last_peered":"2024-08-19T00:43:28.252016+0000","last_clean":"2024-08-19T00:43:28.252016+0000","last_became_active":"2024-08-19T00:43:26.244400+0000","last_became_peered":"2024-08-19T00:43:26.244400+0000","last_unstale":"2024-08-19T00:43:28.252016+0000","last_undegraded":"2024-08-19T00:43:28.252016+0000","last_fullsized":"2024-08-19T00:43:28.252016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:38.836421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767615+0000","last_change":"2024-08-19T00:43:27.259917+0000","last_active":"2024-08-19T00:43:28.767615+0000","last_peered":"2024-08-19T00:43:28.767615+0000","last_clean":"2024-08-19T00:43:28.767615+0000","last_became_active":"2024-08-19T00:43:27.258961+0000","last_became_peered":"2024-08-19T00:43:27.258961+0000","last_unstale":"2024-08-19T00:43:28.767615+0000","last_undegraded":"2024-08-19T00:43:28.767615+0000","last_fullsized":"2024-08-19T00:43:28.767615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:48:47.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250526+0000","last_change":"2024-08-19T00:43:26.246389+0000","last_active":"2024-08-19T00:43:28.250526+0000","last_peered":"2024-08-19T00:43:28.250526+0000","last_clean":"2024-08-19T00:43:28.250526+0000","last_became_active":"2024-08-19T00:43:26.246109+0000","last_became_peered":"2024-08-19T00:43:26.246109+0000","last_unstale":"2024-08-19T00:43:28.250526+0000","last_undegraded":"2024-08-19T00:43:28.250526+0000","last_fullsized":"2024-08-19T00:43:28.250526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:40:42.744951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251242+0000","last_change":"2024-08-19T00:43:27.240290+0000","last_active":"2024-08-19T00:43:28.251242+0000","last_peered":"2024-08-19T00:43:28.251242+0000","last_clean":"2024-08-19T00:43:28.251242+0000","last_became_active":"2024-08-19T00:43:27.240016+0000","last_became_peered":"2024-08-19T00:43:27.240016+0000","last_unstale":"2024-08-19T00:43:28.251242+0000","last_undegraded":"2024-08-19T00:43:28.251242+0000","last_fullsized":"2024-08-19T00:43:28.251242+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:25.346987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766505+0000","last_change":"2024-08-19T00:43:26.251634+0000","last_active":"2024-08-19T00:43:28.766505+0000","last_peered":"2024-08-19T00:43:28.766505+0000","last_clean":"2024-08-19T00:43:28.766505+0000","last_became_active":"2024-08-19T00:43:26.251080+0000","last_became_peered":"2024-08-19T00:43:26.251080+0000","last_unstale":"2024-08-19T00:43:28.766505+0000","last_undegraded":"2024-08-19T00:43:28.766505+0000","last_fullsized":"2024-08-19T00:43:28.766505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:38.987677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767027+0000","last_change":"2024-08-19T00:43:27.246800+0000","last_active":"2024-08-19T00:43:28.767027+0000","last_peered":"2024-08-19T00:43:28.767027+0000","last_clean":"2024-08-19T00:43:28.767027+0000","last_became_active":"2024-08-19T00:43:27.243884+0000","last_became_peered":"2024-08-19T00:43:27.243884+0000","last_unstale":"2024-08-19T00:43:28.767027+0000","last_undegraded":"2024-08-19T00:43:28.767027+0000","last_fullsized":"2024-08-19T00:43:28.767027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:31.358363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251469+0000","last_change":"2024-08-19T00:43:26.245542+0000","last_active":"2024-08-19T00:43:28.251469+0000","last_peered":"2024-08-19T00:43:28.251469+0000","last_clean":"2024-08-19T00:43:28.251469+0000","last_became_active":"2024-08-19T00:43:26.244413+0000","last_became_peered":"2024-08-19T00:43:26.244413+0000","last_unstale":"2024-08-19T00:43:28.251469+0000","last_undegraded":"2024-08-19T00:43:28.251469+0000","last_fullsized":"2024-08-19T00:43:28.251469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:23.794436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767671+0000","last_change":"2024-08-19T00:43:27.252136+0000","last_active":"2024-08-19T00:43:28.767671+0000","last_peered":"2024-08-19T00:43:28.767671+0000","last_clean":"2024-08-19T00:43:28.767671+0000","last_became_active":"2024-08-19T00:43:27.249981+0000","last_became_peered":"2024-08-19T00:43:27.249981+0000","last_unstale":"2024-08-19T00:43:28.767671+0000","last_undegraded":"2024-08-19T00:43:28.767671+0000","last_fullsized":"2024-08-19T00:43:28.767671+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:09.506149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252235+0000","last_change":"2024-08-19T00:43:26.248782+0000","last_active":"2024-08-19T00:43:28.252235+0000","last_peered":"2024-08-19T00:43:28.252235+0000","last_clean":"2024-08-19T00:43:28.252235+0000","last_became_active":"2024-08-19T00:43:26.248488+0000","last_became_peered":"2024-08-19T00:43:26.248488+0000","last_unstale":"2024-08-19T00:43:28.252235+0000","last_undegraded":"2024-08-19T00:43:28.252235+0000","last_fullsized":"2024-08-19T00:43:28.252235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:28.352241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767772+0000","last_change":"2024-08-19T00:43:27.255288+0000","last_active":"2024-08-19T00:43:28.767772+0000","last_peered":"2024-08-19T00:43:28.767772+0000","last_clean":"2024-08-19T00:43:28.767772+0000","last_became_active":"2024-08-19T00:43:27.254996+0000","last_became_peered":"2024-08-19T00:43:27.254996+0000","last_unstale":"2024-08-19T00:43:28.767772+0000","last_undegraded":"2024-08-19T00:43:28.767772+0000","last_fullsized":"2024-08-19T00:43:28.767772+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:54.813820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766799+0000","last_change":"2024-08-19T00:43:26.247355+0000","last_active":"2024-08-19T00:43:28.766799+0000","last_peered":"2024-08-19T00:43:28.766799+0000","last_clean":"2024-08-19T00:43:28.766799+0000","last_became_active":"2024-08-19T00:43:26.246754+0000","last_became_peered":"2024-08-19T00:43:26.246754+0000","last_unstale":"2024-08-19T00:43:28.766799+0000","last_undegraded":"2024-08-19T00:43:28.766799+0000","last_fullsized":"2024-08-19T00:43:28.766799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:12.137940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767130+0000","last_change":"2024-08-19T00:43:27.256077+0000","last_active":"2024-08-19T00:43:28.767130+0000","last_peered":"2024-08-19T00:43:28.767130+0000","last_clean":"2024-08-19T00:43:28.767130+0000","last_became_active":"2024-08-19T00:43:27.255770+0000","last_became_peered":"2024-08-19T00:43:27.255770+0000","last_unstale":"2024-08-19T00:43:28.767130+0000","last_undegraded":"2024-08-19T00:43:28.767130+0000","last_fullsized":"2024-08-19T00:43:28.767130+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:48:48.389713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767976+0000","last_change":"2024-08-19T00:43:26.254345+0000","last_active":"2024-08-19T00:43:28.767976+0000","last_peered":"2024-08-19T00:43:28.767976+0000","last_clean":"2024-08-19T00:43:28.767976+0000","last_became_active":"2024-08-19T00:43:26.253385+0000","last_became_peered":"2024-08-19T00:43:26.253385+0000","last_unstale":"2024-08-19T00:43:28.767976+0000","last_undegraded":"2024-08-19T00:43:28.767976+0000","last_fullsized":"2024-08-19T00:43:28.767976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:33.471090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768855+0000","last_change":"2024-08-19T00:43:27.267381+0000","last_active":"2024-08-19T00:43:28.768855+0000","last_peered":"2024-08-19T00:43:28.768855+0000","last_clean":"2024-08-19T00:43:28.768855+0000","last_became_active":"2024-08-19T00:43:27.264111+0000","last_became_peered":"2024-08-19T00:43:27.264111+0000","last_unstale":"2024-08-19T00:43:28.768855+0000","last_undegraded":"2024-08-19T00:43:28.768855+0000","last_fullsized":"2024-08-19T00:43:28.768855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:28.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768454+0000","last_change":"2024-08-19T00:43:26.241910+0000","last_active":"2024-08-19T00:43:28.768454+0000","last_peered":"2024-08-19T00:43:28.768454+0000","last_clean":"2024-08-19T00:43:28.768454+0000","last_became_active":"2024-08-19T00:43:26.241588+0000","last_became_peered":"2024-08-19T00:43:26.241588+0000","last_unstale":"2024-08-19T00:43:28.768454+0000","last_undegraded":"2024-08-19T00:43:28.768454+0000","last_fullsized":"2024-08-19T00:43:28.768454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:30.355282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768490+0000","last_change":"2024-08-19T00:43:27.254828+0000","last_active":"2024-08-19T00:43:28.768490+0000","last_peered":"2024-08-19T00:43:28.768490+0000","last_clean":"2024-08-19T00:43:28.768490+0000","last_became_active":"2024-08-19T00:43:27.254439+0000","last_became_peered":"2024-08-19T00:43:27.254439+0000","last_unstale":"2024-08-19T00:43:28.768490+0000","last_undegraded":"2024-08-19T00:43:28.768490+0000","last_fullsized":"2024-08-19T00:43:28.768490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:22.151596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251004+0000","last_change":"2024-08-19T00:43:26.249707+0000","last_active":"2024-08-19T00:43:28.251004+0000","last_peered":"2024-08-19T00:43:28.251004+0000","last_clean":"2024-08-19T00:43:28.251004+0000","last_became_active":"2024-08-19T00:43:26.249440+0000","last_became_peered":"2024-08-19T00:43:26.249440+0000","last_unstale":"2024-08-19T00:43:28.251004+0000","last_undegraded":"2024-08-19T00:43:28.251004+0000","last_fullsized":"2024-08-19T00:43:28.251004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:23:53.460976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766963+0000","last_change":"2024-08-19T00:43:27.260600+0000","last_active":"2024-08-19T00:43:28.766963+0000","last_peered":"2024-08-19T00:43:28.766963+0000","last_clean":"2024-08-19T00:43:28.766963+0000","last_became_active":"2024-08-19T00:43:27.259917+0000","last_became_peered":"2024-08-19T00:43:27.259917+0000","last_unstale":"2024-08-19T00:43:28.766963+0000","last_undegraded":"2024-08-19T00:43:28.766963+0000","last_fullsized":"2024-08-19T00:43:28.766963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:19.150926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768244+0000","last_change":"2024-08-19T00:43:26.247215+0000","last_active":"2024-08-19T00:43:28.768244+0000","last_peered":"2024-08-19T00:43:28.768244+0000","last_clean":"2024-08-19T00:43:28.768244+0000","last_became_active":"2024-08-19T00:43:26.246956+0000","last_became_peered":"2024-08-19T00:43:26.246956+0000","last_unstale":"2024-08-19T00:43:28.768244+0000","last_undegraded":"2024-08-19T00:43:28.768244+0000","last_fullsized":"2024-08-19T00:43:28.768244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:03.399746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768220+0000","last_change":"2024-08-19T00:43:27.252339+0000","last_active":"2024-08-19T00:43:28.768220+0000","last_peered":"2024-08-19T00:43:28.768220+0000","last_clean":"2024-08-19T00:43:28.768220+0000","last_became_active":"2024-08-19T00:43:27.251860+0000","last_became_peered":"2024-08-19T00:43:27.251860+0000","last_unstale":"2024-08-19T00:43:28.768220+0000","last_undegraded":"2024-08-19T00:43:28.768220+0000","last_fullsized":"2024-08-19T00:43:28.768220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:24.630669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767352+0000","last_change":"2024-08-19T00:43:26.247628+0000","last_active":"2024-08-19T00:43:28.767352+0000","last_peered":"2024-08-19T00:43:28.767352+0000","last_clean":"2024-08-19T00:43:28.767352+0000","last_became_active":"2024-08-19T00:43:26.247335+0000","last_became_peered":"2024-08-19T00:43:26.247335+0000","last_unstale":"2024-08-19T00:43:28.767352+0000","last_undegraded":"2024-08-19T00:43:28.767352+0000","last_fullsized":"2024-08-19T00:43:28.767352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:23.794436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768475+0000","last_change":"2024-08-19T00:43:27.253156+0000","last_active":"2024-08-19T00:43:28.768475+0000","last_peered":"2024-08-19T00:43:28.768475+0000","last_clean":"2024-08-19T00:43:28.768475+0000","last_became_active":"2024-08-19T00:43:27.252898+0000","last_became_peered":"2024-08-19T00:43:27.252898+0000","last_unstale":"2024-08-19T00:43:28.768475+0000","last_undegraded":"2024-08-19T00:43:28.768475+0000","last_fullsized":"2024-08-19T00:43:28.768475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:13.141021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767975+0000","last_change":"2024-08-19T00:43:26.252641+0000","last_active":"2024-08-19T00:43:28.767975+0000","last_peered":"2024-08-19T00:43:28.767975+0000","last_clean":"2024-08-19T00:43:28.767975+0000","last_became_active":"2024-08-19T00:43:26.252395+0000","last_became_peered":"2024-08-19T00:43:26.252395+0000","last_unstale":"2024-08-19T00:43:28.767975+0000","last_undegraded":"2024-08-19T00:43:28.767975+0000","last_fullsized":"2024-08-19T00:43:28.767975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:23:53.460976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767038+0000","last_change":"2024-08-19T00:43:27.259714+0000","last_active":"2024-08-19T00:43:28.767038+0000","last_peered":"2024-08-19T00:43:28.767038+0000","last_clean":"2024-08-19T00:43:28.767038+0000","last_became_active":"2024-08-19T00:43:27.258524+0000","last_became_peered":"2024-08-19T00:43:27.258524+0000","last_unstale":"2024-08-19T00:43:28.767038+0000","last_undegraded":"2024-08-19T00:43:28.767038+0000","last_fullsized":"2024-08-19T00:43:28.767038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:30.154871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767416+0000","last_change":"2024-08-19T00:43:26.235378+0000","last_active":"2024-08-19T00:43:28.767416+0000","last_peered":"2024-08-19T00:43:28.767416+0000","last_clean":"2024-08-19T00:43:28.767416+0000","last_became_active":"2024-08-19T00:43:26.235107+0000","last_became_peered":"2024-08-19T00:43:26.235107+0000","last_unstale":"2024-08-19T00:43:28.767416+0000","last_undegraded":"2024-08-19T00:43:28.767416+0000","last_fullsized":"2024-08-19T00:43:28.767416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:24.343907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":295,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767938+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:43:28.767938+0000","last_peered":"2024-08-19T00:43:28.767938+0000","last_clean":"2024-08-19T00:43:28.767938+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:43:28.767938+0000","last_undegraded":"2024-08-19T00:43:28.767938+0000","last_fullsized":"2024-08-19T00:43:28.767938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":455194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1064960,"data_stored":455796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32812,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339028,"statfs":{"total":96636764160,"available":96603164672,"internally_reserved":0,"allocated":1667072,"data_stored":1047138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":455158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":455798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":455124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1654784,"data_stored":1045582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":456758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:43:31.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:43:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.654+0000 7fd6f8200640 1 Processor -- start 2024-08-19T00:43:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.654+0000 7fd6f8200640 1 -- start start 2024-08-19T00:43:31.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.655+0000 7fd6f8200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6f006e710 0x7fd6f0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.655+0000 7fd6f8200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f00b3750 0x7fd6f00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.655+0000 7fd6f8200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f00cdfb0 con 0x7fd6f00d03c0 2024-08-19T00:43:31.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.655+0000 7fd6f8200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f00cebc0 con 0x7fd6f006e710 2024-08-19T00:43:31.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.655+0000 7fd6f8200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f00ce290 con 0x7fd6f00b3750 2024-08-19T00:43:31.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6f5800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd6f00d03c0 0x7fd6f00d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53402/0 (socket says 172.21.15.7:53402) 2024-08-19T00:43:31.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6f5800640 1 -- 172.21.15.7:0/11575207 learned_addr learned my addr 172.21.15.7:0/11575207 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:31.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/11575207 >> v2:172.21.15.162:3300/0 conn(0x7fd6f006e710 0x7fd6f0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6f6200640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f00b3750 0x7fd6f00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716249756 0 0) 0x7fd6f00cdfb0 con 0x7fd6f00d03c0 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6d8003520 con 0x7fd6f00d03c0 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2139993279 0 0) 0x7fd6d8003520 con 0x7fd6f00d03c0 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f00b3750 msgr2=0x7fd6f00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6efe00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f00b3750 0x7fd6f00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 >> v2:172.21.15.162:3300/0 conn(0x7fd6f006e710 msgr2=0x7fd6f0071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.656+0000 7fd6efe00640 1 --2- 172.21.15.7:0/11575207 >> v2:172.21.15.162:3300/0 conn(0x7fd6f006e710 0x7fd6f0071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f00ce570 con 0x7fd6f00d03c0 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fd6e4001670 con 0x7fd6f00d03c0 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 >> v1:172.21.15.7:6789/0 conn(0x7fd6f00d03c0 legacy=0x7fd6f00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d80039b0 0x7fd6d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d80051c0 0x7fd6d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f00cebc0 con 0x7fd6d8004800 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f00ce290 con 0x7fd6d80051c0 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d800bf00 con 0x7fd6d80039b0 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f5800640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d80039b0 0x7fd6d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f6200640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d80051c0 0x7fd6d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f4e00640 1 -- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d80039b0 msgr2=0x7fd6d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d80039b0 0x7fd6d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f4e00640 1 -- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d80051c0 msgr2=0x7fd6d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:31.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d80051c0 0x7fd6d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.657+0000 7fd6f4e00640 1 -- 172.21.15.7:0/11575207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d8003520 con 0x7fd6d8004800 2024-08-19T00:43:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.658+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6d8004c80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009af0 tx=0x7fd6d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ca371bb4a95019 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc036070 con 0x7fd6d8004800 2024-08-19T00:43:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc031400 con 0x7fd6d8004800 2024-08-19T00:43:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6efe00640 1 -- 172.21.15.7:0/11575207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc009690 con 0x7fd6d8004800 2024-08-19T00:43:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6f8200640 1 -- 172.21.15.7:0/11575207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 msgr2=0x7fd6d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6f8200640 1 --2- 172.21.15.7:0/11575207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6d8004c80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009af0 tx=0x7fd6d8005830 comp rx=0 tx=0).stop 2024-08-19T00:43:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6f6200640 1 -- 172.21.15.7:0/11575207 reap_dead start 2024-08-19T00:43:31.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6f8200640 1 -- 172.21.15.7:0/11575207 shutdown_connections 2024-08-19T00:43:31.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6f8200640 1 -- 172.21.15.7:0/11575207 >> 172.21.15.7:0/11575207 conn(0x7fd6f006bc70 msgr2=0x7fd6f006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:31.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6f8200640 1 -- 172.21.15.7:0/11575207 shutdown_connections 2024-08-19T00:43:31.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.659+0000 7fd6f8200640 1 -- 172.21.15.7:0/11575207 wait complete. 2024-08-19T00:43:31.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.661+0000 7fd6f8200640 1 Processor -- start 2024-08-19T00:43:31.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.661+0000 7fd6f8200640 1 -- start start 2024-08-19T00:43:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f8200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6f015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f8200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f0154950 0x7fd6f0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f8200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f009b4e0 0x7fd6f009b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f8200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0073c60 con 0x7fd6d8004800 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f8200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0073ae0 con 0x7fd6f0154950 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f8200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f00b3be0 con 0x7fd6f009b4e0 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6f015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6f015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47990/0 (socket says 172.21.15.7:47990) 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f5800640 1 -- 172.21.15.7:0/2607606296 learned_addr learned my addr 172.21.15.7:0/2607606296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.662+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f0154950 0x7fd6f0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f6200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f009b4e0 0x7fd6f009b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f5800640 1 -- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f009b4e0 msgr2=0x7fd6f009b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f5800640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f009b4e0 0x7fd6f009b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f5800640 1 -- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f0154950 msgr2=0x7fd6f0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f5800640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f0154950 0x7fd6f0154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f5800640 1 -- 172.21.15.7:0/2607606296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f0098d00 con 0x7fd6d8004800 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f6200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f009b4e0 0x7fd6f009b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f5800640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6f015a8b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40072c0 tx=0x7fd6e4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:31.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6ed600640 1 -- 172.21.15.7:0/2607606296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400f960 con 0x7fd6d8004800 2024-08-19T00:43:31.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6ed600640 1 -- 172.21.15.7:0/2607606296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e4018070 con 0x7fd6d8004800 2024-08-19T00:43:31.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6ed600640 1 -- 172.21.15.7:0/2607606296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400fd80 con 0x7fd6d8004800 2024-08-19T00:43:31.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.663+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f0098fa0 con 0x7fd6d8004800 2024-08-19T00:43:31.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.664+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f0099560 con 0x7fd6d8004800 2024-08-19T00:43:31.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.665+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f00cd930 con 0x7fd6d8004800 2024-08-19T00:43:31.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.665+0000 7fd6ed600640 1 -- 172.21.15.7:0/2607606296 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6e401d460 con 0x7fd6d8004800 2024-08-19T00:43:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.667+0000 7fd6ed600640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d006be60 0x7fd6d006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.667+0000 7fd6ed600640 1 -- 172.21.15.7:0/2607606296 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7fd6e408ae50 con 0x7fd6d8004800 2024-08-19T00:43:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.667+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d006be60 0x7fd6d006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.668+0000 7fd6f4e00640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d006be60 0x7fd6d006e320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc033000 tx=0x7fd6dc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:31.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.671+0000 7fd6ed600640 1 -- 172.21.15.7:0/2607606296 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd6f00cd930 con 0x7fd6d8004800 2024-08-19T00:43:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.851+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6f0071980 con 0x7fd6d006be60 2024-08-19T00:43:31.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.857+0000 7fd6ed600640 1 -- 172.21.15.7:0/2607606296 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252083 (secure 0 0 0) 0x7fd6f0071980 con 0x7fd6d006be60 2024-08-19T00:43:31.864 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:31.865 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:43:31.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.861+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d006be60 msgr2=0x7fd6d006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.861+0000 7fd6f8200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d006be60 0x7fd6d006e320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc033000 tx=0x7fd6dc008030 comp rx=0 tx=0).stop 2024-08-19T00:43:31.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.861+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 msgr2=0x7fd6f015a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.861+0000 7fd6f8200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6f015a8b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40072c0 tx=0x7fd6e4007780 comp rx=0 tx=0).stop 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 shutdown_connections 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd6d006be60 0x7fd6d006e320 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f009b4e0 0x7fd6f009b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6f0154950 0x7fd6f0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 --2- 172.21.15.7:0/2607606296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d8004800 0x7fd6f015a8b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 >> 172.21.15.7:0/2607606296 conn(0x7fd6f006bc70 msgr2=0x7fd6f00b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 shutdown_connections 2024-08-19T00:43:31.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:31.862+0000 7fd6f8200640 1 -- 172.21.15.7:0/2607606296 wait complete. 2024-08-19T00:43:31.880 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-08-19T00:43:31.347677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258944,"kb_used_data":9480,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715776,"statfs":{"total":773094113280,"available":772828954624,"internally_reserved":0,"allocated":9707520,"data_stored":4826548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001153"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769011+0000","last_change":"2024-08-19T00:43:27.259640+0000","last_active":"2024-08-19T00:43:28.769011+0000","last_peered":"2024-08-19T00:43:28.769011+0000","last_clean":"2024-08-19T00:43:28.769011+0000","last_became_active":"2024-08-19T00:43:27.259364+0000","last_became_peered":"2024-08-19T00:43:27.259364+0000","last_unstale":"2024-08-19T00:43:28.769011+0000","last_undegraded":"2024-08-19T00:43:28.769011+0000","last_fullsized":"2024-08-19T00:43:28.769011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:08.366242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250788+0000","last_change":"2024-08-19T00:43:27.261846+0000","last_active":"2024-08-19T00:43:28.250788+0000","last_peered":"2024-08-19T00:43:28.250788+0000","last_clean":"2024-08-19T00:43:28.250788+0000","last_became_active":"2024-08-19T00:43:27.261580+0000","last_became_peered":"2024-08-19T00:43:27.261580+0000","last_unstale":"2024-08-19T00:43:28.250788+0000","last_undegraded":"2024-08-19T00:43:28.250788+0000","last_fullsized":"2024-08-19T00:43:28.250788+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:41.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768705+0000","last_change":"2024-08-19T00:43:27.263914+0000","last_active":"2024-08-19T00:43:28.768705+0000","last_peered":"2024-08-19T00:43:28.768705+0000","last_clean":"2024-08-19T00:43:28.768705+0000","last_became_active":"2024-08-19T00:43:27.256100+0000","last_became_peered":"2024-08-19T00:43:27.256100+0000","last_unstale":"2024-08-19T00:43:28.768705+0000","last_undegraded":"2024-08-19T00:43:28.768705+0000","last_fullsized":"2024-08-19T00:43:28.768705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:41.845190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252095+0000","last_change":"2024-08-19T00:43:27.256771+0000","last_active":"2024-08-19T00:43:28.252095+0000","last_peered":"2024-08-19T00:43:28.252095+0000","last_clean":"2024-08-19T00:43:28.252095+0000","last_became_active":"2024-08-19T00:43:27.256376+0000","last_became_peered":"2024-08-19T00:43:27.256376+0000","last_unstale":"2024-08-19T00:43:28.252095+0000","last_undegraded":"2024-08-19T00:43:28.252095+0000","last_fullsized":"2024-08-19T00:43:28.252095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:41.845190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767377+0000","last_change":"2024-08-19T00:43:27.265983+0000","last_active":"2024-08-19T00:43:28.767377+0000","last_peered":"2024-08-19T00:43:28.767377+0000","last_clean":"2024-08-19T00:43:28.767377+0000","last_became_active":"2024-08-19T00:43:27.265688+0000","last_became_peered":"2024-08-19T00:43:27.265688+0000","last_unstale":"2024-08-19T00:43:28.767377+0000","last_undegraded":"2024-08-19T00:43:28.767377+0000","last_fullsized":"2024-08-19T00:43:28.767377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:03:36.385936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767480+0000","last_change":"2024-08-19T00:43:27.267976+0000","last_active":"2024-08-19T00:43:28.767480+0000","last_peered":"2024-08-19T00:43:28.767480+0000","last_clean":"2024-08-19T00:43:28.767480+0000","last_became_active":"2024-08-19T00:43:27.267507+0000","last_became_peered":"2024-08-19T00:43:27.267507+0000","last_unstale":"2024-08-19T00:43:28.767480+0000","last_undegraded":"2024-08-19T00:43:28.767480+0000","last_fullsized":"2024-08-19T00:43:28.767480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:28:57.101787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250478+0000","last_change":"2024-08-19T00:43:27.253620+0000","last_active":"2024-08-19T00:43:28.250478+0000","last_peered":"2024-08-19T00:43:28.250478+0000","last_clean":"2024-08-19T00:43:28.250478+0000","last_became_active":"2024-08-19T00:43:27.252774+0000","last_became_peered":"2024-08-19T00:43:27.252774+0000","last_unstale":"2024-08-19T00:43:28.250478+0000","last_undegraded":"2024-08-19T00:43:28.250478+0000","last_fullsized":"2024-08-19T00:43:28.250478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:31.688435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767924+0000","last_change":"2024-08-19T00:43:27.265003+0000","last_active":"2024-08-19T00:43:28.767924+0000","last_peered":"2024-08-19T00:43:28.767924+0000","last_clean":"2024-08-19T00:43:28.767924+0000","last_became_active":"2024-08-19T00:43:27.264719+0000","last_became_peered":"2024-08-19T00:43:27.264719+0000","last_unstale":"2024-08-19T00:43:28.767924+0000","last_undegraded":"2024-08-19T00:43:28.767924+0000","last_fullsized":"2024-08-19T00:43:28.767924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.649719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769024+0000","last_change":"2024-08-19T00:43:27.248809+0000","last_active":"2024-08-19T00:43:28.769024+0000","last_peered":"2024-08-19T00:43:28.769024+0000","last_clean":"2024-08-19T00:43:28.769024+0000","last_became_active":"2024-08-19T00:43:27.248417+0000","last_became_peered":"2024-08-19T00:43:27.248417+0000","last_unstale":"2024-08-19T00:43:28.769024+0000","last_undegraded":"2024-08-19T00:43:28.769024+0000","last_fullsized":"2024-08-19T00:43:28.769024+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:40:43.748031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768679+0000","last_change":"2024-08-19T00:43:27.265327+0000","last_active":"2024-08-19T00:43:28.768679+0000","last_peered":"2024-08-19T00:43:28.768679+0000","last_clean":"2024-08-19T00:43:28.768679+0000","last_became_active":"2024-08-19T00:43:27.264795+0000","last_became_peered":"2024-08-19T00:43:27.264795+0000","last_unstale":"2024-08-19T00:43:28.768679+0000","last_undegraded":"2024-08-19T00:43:28.768679+0000","last_fullsized":"2024-08-19T00:43:28.768679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:25.346987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767120+0000","last_change":"2024-08-19T00:43:27.263792+0000","last_active":"2024-08-19T00:43:28.767120+0000","last_peered":"2024-08-19T00:43:28.767120+0000","last_clean":"2024-08-19T00:43:28.767120+0000","last_became_active":"2024-08-19T00:43:27.261861+0000","last_became_peered":"2024-08-19T00:43:27.261861+0000","last_unstale":"2024-08-19T00:43:28.767120+0000","last_undegraded":"2024-08-19T00:43:28.767120+0000","last_fullsized":"2024-08-19T00:43:28.767120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.649719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767973+0000","last_change":"2024-08-19T00:43:27.247883+0000","last_active":"2024-08-19T00:43:28.767973+0000","last_peered":"2024-08-19T00:43:28.767973+0000","last_clean":"2024-08-19T00:43:28.767973+0000","last_became_active":"2024-08-19T00:43:27.247555+0000","last_became_peered":"2024-08-19T00:43:27.247555+0000","last_unstale":"2024-08-19T00:43:28.767973+0000","last_undegraded":"2024-08-19T00:43:28.767973+0000","last_fullsized":"2024-08-19T00:43:28.767973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:35:38.494522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767530+0000","last_change":"2024-08-19T00:43:27.262426+0000","last_active":"2024-08-19T00:43:28.767530+0000","last_peered":"2024-08-19T00:43:28.767530+0000","last_clean":"2024-08-19T00:43:28.767530+0000","last_became_active":"2024-08-19T00:43:27.261751+0000","last_became_peered":"2024-08-19T00:43:27.261751+0000","last_unstale":"2024-08-19T00:43:28.767530+0000","last_undegraded":"2024-08-19T00:43:28.767530+0000","last_fullsized":"2024-08-19T00:43:28.767530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:40.321992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251690+0000","last_change":"2024-08-19T00:43:27.253022+0000","last_active":"2024-08-19T00:43:28.251690+0000","last_peered":"2024-08-19T00:43:28.251690+0000","last_clean":"2024-08-19T00:43:28.251690+0000","last_became_active":"2024-08-19T00:43:27.251819+0000","last_became_peered":"2024-08-19T00:43:27.251819+0000","last_unstale":"2024-08-19T00:43:28.251690+0000","last_undegraded":"2024-08-19T00:43:28.251690+0000","last_fullsized":"2024-08-19T00:43:28.251690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:24.630669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250497+0000","last_change":"2024-08-19T00:43:27.258894+0000","last_active":"2024-08-19T00:43:28.250497+0000","last_peered":"2024-08-19T00:43:28.250497+0000","last_clean":"2024-08-19T00:43:28.250497+0000","last_became_active":"2024-08-19T00:43:27.258266+0000","last_became_peered":"2024-08-19T00:43:27.258266+0000","last_unstale":"2024-08-19T00:43:28.250497+0000","last_undegraded":"2024-08-19T00:43:28.250497+0000","last_fullsized":"2024-08-19T00:43:28.250497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:10.269530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767036+0000","last_change":"2024-08-19T00:43:27.259194+0000","last_active":"2024-08-19T00:43:28.767036+0000","last_peered":"2024-08-19T00:43:28.767036+0000","last_clean":"2024-08-19T00:43:28.767036+0000","last_became_active":"2024-08-19T00:43:27.258041+0000","last_became_peered":"2024-08-19T00:43:27.258041+0000","last_unstale":"2024-08-19T00:43:28.767036+0000","last_undegraded":"2024-08-19T00:43:28.767036+0000","last_fullsized":"2024-08-19T00:43:28.767036+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:36.092151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768099+0000","last_change":"2024-08-19T00:43:27.250078+0000","last_active":"2024-08-19T00:43:28.768099+0000","last_peered":"2024-08-19T00:43:28.768099+0000","last_clean":"2024-08-19T00:43:28.768099+0000","last_became_active":"2024-08-19T00:43:27.248929+0000","last_became_peered":"2024-08-19T00:43:27.248929+0000","last_unstale":"2024-08-19T00:43:28.768099+0000","last_undegraded":"2024-08-19T00:43:28.768099+0000","last_fullsized":"2024-08-19T00:43:28.768099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:25:40.710684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767007+0000","last_change":"2024-08-19T00:43:27.264845+0000","last_active":"2024-08-19T00:43:28.767007+0000","last_peered":"2024-08-19T00:43:28.767007+0000","last_clean":"2024-08-19T00:43:28.767007+0000","last_became_active":"2024-08-19T00:43:27.262011+0000","last_became_peered":"2024-08-19T00:43:27.262011+0000","last_unstale":"2024-08-19T00:43:28.767007+0000","last_undegraded":"2024-08-19T00:43:28.767007+0000","last_fullsized":"2024-08-19T00:43:28.767007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:31.358363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252377+0000","last_change":"2024-08-19T00:43:27.255190+0000","last_active":"2024-08-19T00:43:28.252377+0000","last_peered":"2024-08-19T00:43:28.252377+0000","last_clean":"2024-08-19T00:43:28.252377+0000","last_became_active":"2024-08-19T00:43:27.254881+0000","last_became_peered":"2024-08-19T00:43:27.254881+0000","last_unstale":"2024-08-19T00:43:28.252377+0000","last_undegraded":"2024-08-19T00:43:28.252377+0000","last_fullsized":"2024-08-19T00:43:28.252377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:08.366242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252028+0000","last_change":"2024-08-19T00:43:27.253877+0000","last_active":"2024-08-19T00:43:28.252028+0000","last_peered":"2024-08-19T00:43:28.252028+0000","last_clean":"2024-08-19T00:43:28.252028+0000","last_became_active":"2024-08-19T00:43:27.251144+0000","last_became_peered":"2024-08-19T00:43:27.251144+0000","last_unstale":"2024-08-19T00:43:28.252028+0000","last_undegraded":"2024-08-19T00:43:28.252028+0000","last_fullsized":"2024-08-19T00:43:28.252028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:39.990758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252490+0000","last_change":"2024-08-19T00:43:27.254154+0000","last_active":"2024-08-19T00:43:28.252490+0000","last_peered":"2024-08-19T00:43:28.252490+0000","last_clean":"2024-08-19T00:43:28.252490+0000","last_became_active":"2024-08-19T00:43:27.252492+0000","last_became_peered":"2024-08-19T00:43:27.252492+0000","last_unstale":"2024-08-19T00:43:28.252490+0000","last_undegraded":"2024-08-19T00:43:28.252490+0000","last_fullsized":"2024-08-19T00:43:28.252490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:33.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251845+0000","last_change":"2024-08-19T00:43:27.252207+0000","last_active":"2024-08-19T00:43:28.251845+0000","last_peered":"2024-08-19T00:43:28.251845+0000","last_clean":"2024-08-19T00:43:28.251845+0000","last_became_active":"2024-08-19T00:43:27.251468+0000","last_became_peered":"2024-08-19T00:43:27.251468+0000","last_unstale":"2024-08-19T00:43:28.251845+0000","last_undegraded":"2024-08-19T00:43:28.251845+0000","last_fullsized":"2024-08-19T00:43:28.251845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:13.141021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766869+0000","last_change":"2024-08-19T00:43:27.244156+0000","last_active":"2024-08-19T00:43:28.766869+0000","last_peered":"2024-08-19T00:43:28.766869+0000","last_clean":"2024-08-19T00:43:28.766869+0000","last_became_active":"2024-08-19T00:43:27.243604+0000","last_became_peered":"2024-08-19T00:43:27.243604+0000","last_unstale":"2024-08-19T00:43:28.766869+0000","last_undegraded":"2024-08-19T00:43:28.766869+0000","last_fullsized":"2024-08-19T00:43:28.766869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:04.402827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766920+0000","last_change":"2024-08-19T00:43:27.266289+0000","last_active":"2024-08-19T00:43:28.766920+0000","last_peered":"2024-08-19T00:43:28.766920+0000","last_clean":"2024-08-19T00:43:28.766920+0000","last_became_active":"2024-08-19T00:43:27.266003+0000","last_became_peered":"2024-08-19T00:43:27.266003+0000","last_unstale":"2024-08-19T00:43:28.766920+0000","last_undegraded":"2024-08-19T00:43:28.766920+0000","last_fullsized":"2024-08-19T00:43:28.766920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:28.221857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766849+0000","last_change":"2024-08-19T00:43:27.261202+0000","last_active":"2024-08-19T00:43:28.766849+0000","last_peered":"2024-08-19T00:43:28.766849+0000","last_clean":"2024-08-19T00:43:28.766849+0000","last_became_active":"2024-08-19T00:43:27.260696+0000","last_became_peered":"2024-08-19T00:43:27.260696+0000","last_unstale":"2024-08-19T00:43:28.766849+0000","last_undegraded":"2024-08-19T00:43:28.766849+0000","last_fullsized":"2024-08-19T00:43:28.766849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:23.890175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767491+0000","last_change":"2024-08-19T00:43:27.256609+0000","last_active":"2024-08-19T00:43:28.767491+0000","last_peered":"2024-08-19T00:43:28.767491+0000","last_clean":"2024-08-19T00:43:28.767491+0000","last_became_active":"2024-08-19T00:43:27.252505+0000","last_became_peered":"2024-08-19T00:43:27.252505+0000","last_unstale":"2024-08-19T00:43:28.767491+0000","last_undegraded":"2024-08-19T00:43:28.767491+0000","last_fullsized":"2024-08-19T00:43:28.767491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:25:57.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767402+0000","last_change":"2024-08-19T00:43:27.261920+0000","last_active":"2024-08-19T00:43:28.767402+0000","last_peered":"2024-08-19T00:43:28.767402+0000","last_clean":"2024-08-19T00:43:28.767402+0000","last_became_active":"2024-08-19T00:43:27.261595+0000","last_became_peered":"2024-08-19T00:43:27.261595+0000","last_unstale":"2024-08-19T00:43:28.767402+0000","last_undegraded":"2024-08-19T00:43:28.767402+0000","last_fullsized":"2024-08-19T00:43:28.767402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:26:26.573704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767230+0000","last_change":"2024-08-19T00:43:27.245322+0000","last_active":"2024-08-19T00:43:28.767230+0000","last_peered":"2024-08-19T00:43:28.767230+0000","last_clean":"2024-08-19T00:43:28.767230+0000","last_became_active":"2024-08-19T00:43:27.245057+0000","last_became_peered":"2024-08-19T00:43:27.245057+0000","last_unstale":"2024-08-19T00:43:28.767230+0000","last_undegraded":"2024-08-19T00:43:28.767230+0000","last_fullsized":"2024-08-19T00:43:28.767230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:59.209595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252649+0000","last_change":"2024-08-19T00:43:27.248660+0000","last_active":"2024-08-19T00:43:28.252649+0000","last_peered":"2024-08-19T00:43:28.252649+0000","last_clean":"2024-08-19T00:43:28.252649+0000","last_became_active":"2024-08-19T00:43:27.248044+0000","last_became_peered":"2024-08-19T00:43:27.248044+0000","last_unstale":"2024-08-19T00:43:28.252649+0000","last_undegraded":"2024-08-19T00:43:28.252649+0000","last_fullsized":"2024-08-19T00:43:28.252649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:33:06.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252020+0000","last_change":"2024-08-19T00:43:27.253266+0000","last_active":"2024-08-19T00:43:28.252020+0000","last_peered":"2024-08-19T00:43:28.252020+0000","last_clean":"2024-08-19T00:43:28.252020+0000","last_became_active":"2024-08-19T00:43:27.252157+0000","last_became_peered":"2024-08-19T00:43:27.252157+0000","last_unstale":"2024-08-19T00:43:28.252020+0000","last_undegraded":"2024-08-19T00:43:28.252020+0000","last_fullsized":"2024-08-19T00:43:28.252020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:22.151596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767792+0000","last_change":"2024-08-19T00:43:27.265561+0000","last_active":"2024-08-19T00:43:28.767792+0000","last_peered":"2024-08-19T00:43:28.767792+0000","last_clean":"2024-08-19T00:43:28.767792+0000","last_became_active":"2024-08-19T00:43:27.265302+0000","last_became_peered":"2024-08-19T00:43:27.265302+0000","last_unstale":"2024-08-19T00:43:28.767792+0000","last_undegraded":"2024-08-19T00:43:28.767792+0000","last_fullsized":"2024-08-19T00:43:28.767792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:18.239557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767180+0000","last_change":"2024-08-19T00:43:27.267978+0000","last_active":"2024-08-19T00:43:28.767180+0000","last_peered":"2024-08-19T00:43:28.767180+0000","last_clean":"2024-08-19T00:43:28.767180+0000","last_became_active":"2024-08-19T00:43:27.267598+0000","last_became_peered":"2024-08-19T00:43:27.267598+0000","last_unstale":"2024-08-19T00:43:28.767180+0000","last_undegraded":"2024-08-19T00:43:28.767180+0000","last_fullsized":"2024-08-19T00:43:28.767180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:02.273830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767033+0000","last_change":"2024-08-19T00:43:27.249270+0000","last_active":"2024-08-19T00:43:28.767033+0000","last_peered":"2024-08-19T00:43:28.767033+0000","last_clean":"2024-08-19T00:43:28.767033+0000","last_became_active":"2024-08-19T00:43:27.248162+0000","last_became_peered":"2024-08-19T00:43:27.248162+0000","last_unstale":"2024-08-19T00:43:28.767033+0000","last_undegraded":"2024-08-19T00:43:28.767033+0000","last_fullsized":"2024-08-19T00:43:28.767033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:30.154871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767704+0000","last_change":"2024-08-19T00:43:26.246125+0000","last_active":"2024-08-19T00:43:28.767704+0000","last_peered":"2024-08-19T00:43:28.767704+0000","last_clean":"2024-08-19T00:43:28.767704+0000","last_became_active":"2024-08-19T00:43:26.245804+0000","last_became_peered":"2024-08-19T00:43:26.245804+0000","last_unstale":"2024-08-19T00:43:28.767704+0000","last_undegraded":"2024-08-19T00:43:28.767704+0000","last_fullsized":"2024-08-19T00:43:28.767704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:17.236477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769097+0000","last_change":"2024-08-19T00:43:27.260846+0000","last_active":"2024-08-19T00:43:28.769097+0000","last_peered":"2024-08-19T00:43:28.769097+0000","last_clean":"2024-08-19T00:43:28.769097+0000","last_became_active":"2024-08-19T00:43:27.260046+0000","last_became_peered":"2024-08-19T00:43:27.260046+0000","last_unstale":"2024-08-19T00:43:28.769097+0000","last_undegraded":"2024-08-19T00:43:28.769097+0000","last_fullsized":"2024-08-19T00:43:28.769097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:23:54.464056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768583+0000","last_change":"2024-08-19T00:43:26.248047+0000","last_active":"2024-08-19T00:43:28.768583+0000","last_peered":"2024-08-19T00:43:28.768583+0000","last_clean":"2024-08-19T00:43:28.768583+0000","last_became_active":"2024-08-19T00:43:26.247782+0000","last_became_peered":"2024-08-19T00:43:26.247782+0000","last_unstale":"2024-08-19T00:43:28.768583+0000","last_undegraded":"2024-08-19T00:43:28.768583+0000","last_fullsized":"2024-08-19T00:43:28.768583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:29.151791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768093+0000","last_change":"2024-08-19T00:43:27.248545+0000","last_active":"2024-08-19T00:43:28.768093+0000","last_peered":"2024-08-19T00:43:28.768093+0000","last_clean":"2024-08-19T00:43:28.768093+0000","last_became_active":"2024-08-19T00:43:27.248239+0000","last_became_peered":"2024-08-19T00:43:27.248239+0000","last_unstale":"2024-08-19T00:43:28.768093+0000","last_undegraded":"2024-08-19T00:43:28.768093+0000","last_fullsized":"2024-08-19T00:43:28.768093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:11.927273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767104+0000","last_change":"2024-08-19T00:43:26.251923+0000","last_active":"2024-08-19T00:43:28.767104+0000","last_peered":"2024-08-19T00:43:28.767104+0000","last_clean":"2024-08-19T00:43:28.767104+0000","last_became_active":"2024-08-19T00:43:26.251439+0000","last_became_peered":"2024-08-19T00:43:26.251439+0000","last_unstale":"2024-08-19T00:43:28.767104+0000","last_undegraded":"2024-08-19T00:43:28.767104+0000","last_fullsized":"2024-08-19T00:43:28.767104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:07.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768496+0000","last_change":"2024-08-19T00:43:27.263705+0000","last_active":"2024-08-19T00:43:28.768496+0000","last_peered":"2024-08-19T00:43:28.768496+0000","last_clean":"2024-08-19T00:43:28.768496+0000","last_became_active":"2024-08-19T00:43:27.263362+0000","last_became_peered":"2024-08-19T00:43:27.263362+0000","last_unstale":"2024-08-19T00:43:28.768496+0000","last_undegraded":"2024-08-19T00:43:28.768496+0000","last_fullsized":"2024-08-19T00:43:28.768496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:39.990758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252153+0000","last_change":"2024-08-19T00:43:26.246804+0000","last_active":"2024-08-19T00:43:28.252153+0000","last_peered":"2024-08-19T00:43:28.252153+0000","last_clean":"2024-08-19T00:43:28.252153+0000","last_became_active":"2024-08-19T00:43:26.246490+0000","last_became_peered":"2024-08-19T00:43:26.246490+0000","last_unstale":"2024-08-19T00:43:28.252153+0000","last_undegraded":"2024-08-19T00:43:28.252153+0000","last_fullsized":"2024-08-19T00:43:28.252153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:58:42.326764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252213+0000","last_change":"2024-08-19T00:43:27.262564+0000","last_active":"2024-08-19T00:43:28.252213+0000","last_peered":"2024-08-19T00:43:28.252213+0000","last_clean":"2024-08-19T00:43:28.252213+0000","last_became_active":"2024-08-19T00:43:27.262296+0000","last_became_peered":"2024-08-19T00:43:27.262296+0000","last_unstale":"2024-08-19T00:43:28.252213+0000","last_undegraded":"2024-08-19T00:43:28.252213+0000","last_fullsized":"2024-08-19T00:43:28.252213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:28.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767752+0000","last_change":"2024-08-19T00:43:26.253685+0000","last_active":"2024-08-19T00:43:28.767752+0000","last_peered":"2024-08-19T00:43:28.767752+0000","last_clean":"2024-08-19T00:43:28.767752+0000","last_became_active":"2024-08-19T00:43:26.252890+0000","last_became_peered":"2024-08-19T00:43:26.252890+0000","last_unstale":"2024-08-19T00:43:28.767752+0000","last_undegraded":"2024-08-19T00:43:28.767752+0000","last_fullsized":"2024-08-19T00:43:28.767752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:48.821388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768509+0000","last_change":"2024-08-19T00:43:27.262317+0000","last_active":"2024-08-19T00:43:28.768509+0000","last_peered":"2024-08-19T00:43:28.768509+0000","last_clean":"2024-08-19T00:43:28.768509+0000","last_became_active":"2024-08-19T00:43:27.261568+0000","last_became_peered":"2024-08-19T00:43:27.261568+0000","last_unstale":"2024-08-19T00:43:28.768509+0000","last_undegraded":"2024-08-19T00:43:28.768509+0000","last_fullsized":"2024-08-19T00:43:28.768509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:19.803006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767536+0000","last_change":"2024-08-19T00:43:26.247209+0000","last_active":"2024-08-19T00:43:28.767536+0000","last_peered":"2024-08-19T00:43:28.767536+0000","last_clean":"2024-08-19T00:43:28.767536+0000","last_became_active":"2024-08-19T00:43:26.246911+0000","last_became_peered":"2024-08-19T00:43:26.246911+0000","last_unstale":"2024-08-19T00:43:28.767536+0000","last_undegraded":"2024-08-19T00:43:28.767536+0000","last_fullsized":"2024-08-19T00:43:28.767536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:18.147846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767879+0000","last_change":"2024-08-19T00:43:27.262904+0000","last_active":"2024-08-19T00:43:28.767879+0000","last_peered":"2024-08-19T00:43:28.767879+0000","last_clean":"2024-08-19T00:43:28.767879+0000","last_became_active":"2024-08-19T00:43:27.261180+0000","last_became_peered":"2024-08-19T00:43:27.261180+0000","last_unstale":"2024-08-19T00:43:28.767879+0000","last_undegraded":"2024-08-19T00:43:28.767879+0000","last_fullsized":"2024-08-19T00:43:28.767879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:05.079587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251607+0000","last_change":"2024-08-19T00:43:26.247049+0000","last_active":"2024-08-19T00:43:28.251607+0000","last_peered":"2024-08-19T00:43:28.251607+0000","last_clean":"2024-08-19T00:43:28.251607+0000","last_became_active":"2024-08-19T00:43:26.246711+0000","last_became_peered":"2024-08-19T00:43:26.246711+0000","last_unstale":"2024-08-19T00:43:28.251607+0000","last_undegraded":"2024-08-19T00:43:28.251607+0000","last_fullsized":"2024-08-19T00:43:28.251607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:44:11.937523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251470+0000","last_change":"2024-08-19T00:43:27.248910+0000","last_active":"2024-08-19T00:43:28.251470+0000","last_peered":"2024-08-19T00:43:28.251470+0000","last_clean":"2024-08-19T00:43:28.251470+0000","last_became_active":"2024-08-19T00:43:27.248587+0000","last_became_peered":"2024-08-19T00:43:27.248587+0000","last_unstale":"2024-08-19T00:43:28.251470+0000","last_undegraded":"2024-08-19T00:43:28.251470+0000","last_fullsized":"2024-08-19T00:43:28.251470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:05.079587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251353+0000","last_change":"2024-08-19T00:43:26.249337+0000","last_active":"2024-08-19T00:43:28.251353+0000","last_peered":"2024-08-19T00:43:28.251353+0000","last_clean":"2024-08-19T00:43:28.251353+0000","last_became_active":"2024-08-19T00:43:26.248960+0000","last_became_peered":"2024-08-19T00:43:26.248960+0000","last_unstale":"2024-08-19T00:43:28.251353+0000","last_undegraded":"2024-08-19T00:43:28.251353+0000","last_fullsized":"2024-08-19T00:43:28.251353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:33.748667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252439+0000","last_change":"2024-08-19T00:43:27.256006+0000","last_active":"2024-08-19T00:43:28.252439+0000","last_peered":"2024-08-19T00:43:28.252439+0000","last_clean":"2024-08-19T00:43:28.252439+0000","last_became_active":"2024-08-19T00:43:27.255714+0000","last_became_peered":"2024-08-19T00:43:27.255714+0000","last_unstale":"2024-08-19T00:43:28.252439+0000","last_undegraded":"2024-08-19T00:43:28.252439+0000","last_fullsized":"2024-08-19T00:43:28.252439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:40:43.748031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769129+0000","last_change":"2024-08-19T00:43:26.242572+0000","last_active":"2024-08-19T00:43:28.769129+0000","last_peered":"2024-08-19T00:43:28.769129+0000","last_clean":"2024-08-19T00:43:28.769129+0000","last_became_active":"2024-08-19T00:43:26.242278+0000","last_became_peered":"2024-08-19T00:43:26.242278+0000","last_unstale":"2024-08-19T00:43:28.769129+0000","last_undegraded":"2024-08-19T00:43:28.769129+0000","last_fullsized":"2024-08-19T00:43:28.769129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:38.836421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.769177+0000","last_change":"2024-08-19T00:43:27.263872+0000","last_active":"2024-08-19T00:43:28.769177+0000","last_peered":"2024-08-19T00:43:28.769177+0000","last_clean":"2024-08-19T00:43:28.769177+0000","last_became_active":"2024-08-19T00:43:27.261810+0000","last_became_peered":"2024-08-19T00:43:27.261810+0000","last_unstale":"2024-08-19T00:43:28.769177+0000","last_undegraded":"2024-08-19T00:43:28.769177+0000","last_fullsized":"2024-08-19T00:43:28.769177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:49.824469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768708+0000","last_change":"2024-08-19T00:43:26.253953+0000","last_active":"2024-08-19T00:43:28.768708+0000","last_peered":"2024-08-19T00:43:28.768708+0000","last_clean":"2024-08-19T00:43:28.768708+0000","last_became_active":"2024-08-19T00:43:26.252604+0000","last_became_peered":"2024-08-19T00:43:26.252604+0000","last_unstale":"2024-08-19T00:43:28.768708+0000","last_undegraded":"2024-08-19T00:43:28.768708+0000","last_fullsized":"2024-08-19T00:43:28.768708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:45.646638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767011+0000","last_change":"2024-08-19T00:43:27.271707+0000","last_active":"2024-08-19T00:43:28.767011+0000","last_peered":"2024-08-19T00:43:28.767011+0000","last_clean":"2024-08-19T00:43:28.767011+0000","last_became_active":"2024-08-19T00:43:27.271387+0000","last_became_peered":"2024-08-19T00:43:27.271387+0000","last_unstale":"2024-08-19T00:43:28.767011+0000","last_undegraded":"2024-08-19T00:43:28.767011+0000","last_fullsized":"2024-08-19T00:43:28.767011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:04.402827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768781+0000","last_change":"2024-08-19T00:43:26.251562+0000","last_active":"2024-08-19T00:43:28.768781+0000","last_peered":"2024-08-19T00:43:28.768781+0000","last_clean":"2024-08-19T00:43:28.768781+0000","last_became_active":"2024-08-19T00:43:26.251123+0000","last_became_peered":"2024-08-19T00:43:26.251123+0000","last_unstale":"2024-08-19T00:43:28.768781+0000","last_undegraded":"2024-08-19T00:43:28.768781+0000","last_fullsized":"2024-08-19T00:43:28.768781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:33.748667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767360+0000","last_change":"2024-08-19T00:43:27.270547+0000","last_active":"2024-08-19T00:43:28.767360+0000","last_peered":"2024-08-19T00:43:28.767360+0000","last_clean":"2024-08-19T00:43:28.767360+0000","last_became_active":"2024-08-19T00:43:27.270247+0000","last_became_peered":"2024-08-19T00:43:27.270247+0000","last_unstale":"2024-08-19T00:43:28.767360+0000","last_undegraded":"2024-08-19T00:43:28.767360+0000","last_fullsized":"2024-08-19T00:43:28.767360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:52.090956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768128+0000","last_change":"2024-08-19T00:43:26.250539+0000","last_active":"2024-08-19T00:43:28.768128+0000","last_peered":"2024-08-19T00:43:28.768128+0000","last_clean":"2024-08-19T00:43:28.768128+0000","last_became_active":"2024-08-19T00:43:26.250267+0000","last_became_peered":"2024-08-19T00:43:26.250267+0000","last_unstale":"2024-08-19T00:43:28.768128+0000","last_undegraded":"2024-08-19T00:43:28.768128+0000","last_fullsized":"2024-08-19T00:43:28.768128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:33.804755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766748+0000","last_change":"2024-08-19T00:43:27.268964+0000","last_active":"2024-08-19T00:43:28.766748+0000","last_peered":"2024-08-19T00:43:28.766748+0000","last_clean":"2024-08-19T00:43:28.766748+0000","last_became_active":"2024-08-19T00:43:27.267592+0000","last_became_peered":"2024-08-19T00:43:27.267592+0000","last_unstale":"2024-08-19T00:43:28.766748+0000","last_undegraded":"2024-08-19T00:43:28.766748+0000","last_fullsized":"2024-08-19T00:43:28.766748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:30.267115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252657+0000","last_change":"2024-08-19T00:43:26.243216+0000","last_active":"2024-08-19T00:43:28.252657+0000","last_peered":"2024-08-19T00:43:28.252657+0000","last_clean":"2024-08-19T00:43:28.252657+0000","last_became_active":"2024-08-19T00:43:26.242929+0000","last_became_peered":"2024-08-19T00:43:26.242929+0000","last_unstale":"2024-08-19T00:43:28.252657+0000","last_undegraded":"2024-08-19T00:43:28.252657+0000","last_fullsized":"2024-08-19T00:43:28.252657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:19:05.337990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767635+0000","last_change":"2024-08-19T00:43:27.260738+0000","last_active":"2024-08-19T00:43:28.767635+0000","last_peered":"2024-08-19T00:43:28.767635+0000","last_clean":"2024-08-19T00:43:28.767635+0000","last_became_active":"2024-08-19T00:43:27.260440+0000","last_became_peered":"2024-08-19T00:43:27.260440+0000","last_unstale":"2024-08-19T00:43:28.767635+0000","last_undegraded":"2024-08-19T00:43:28.767635+0000","last_fullsized":"2024-08-19T00:43:28.767635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:05.612255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250308+0000","last_change":"2024-08-19T00:43:26.251595+0000","last_active":"2024-08-19T00:43:28.250308+0000","last_peered":"2024-08-19T00:43:28.250308+0000","last_clean":"2024-08-19T00:43:28.250308+0000","last_became_active":"2024-08-19T00:43:26.251139+0000","last_became_peered":"2024-08-19T00:43:26.251139+0000","last_unstale":"2024-08-19T00:43:28.250308+0000","last_undegraded":"2024-08-19T00:43:28.250308+0000","last_fullsized":"2024-08-19T00:43:28.250308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:07.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251278+0000","last_change":"2024-08-19T00:43:27.261460+0000","last_active":"2024-08-19T00:43:28.251278+0000","last_peered":"2024-08-19T00:43:28.251278+0000","last_clean":"2024-08-19T00:43:28.251278+0000","last_became_active":"2024-08-19T00:43:27.261164+0000","last_became_peered":"2024-08-19T00:43:27.261164+0000","last_unstale":"2024-08-19T00:43:28.251278+0000","last_undegraded":"2024-08-19T00:43:28.251278+0000","last_fullsized":"2024-08-19T00:43:28.251278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:05.612255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767844+0000","last_change":"2024-08-19T00:43:26.235275+0000","last_active":"2024-08-19T00:43:28.767844+0000","last_peered":"2024-08-19T00:43:28.767844+0000","last_clean":"2024-08-19T00:43:28.767844+0000","last_became_active":"2024-08-19T00:43:26.234935+0000","last_became_peered":"2024-08-19T00:43:26.234935+0000","last_unstale":"2024-08-19T00:43:28.767844+0000","last_undegraded":"2024-08-19T00:43:28.767844+0000","last_fullsized":"2024-08-19T00:43:28.767844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:27.218776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766568+0000","last_change":"2024-08-19T00:43:27.266257+0000","last_active":"2024-08-19T00:43:28.766568+0000","last_peered":"2024-08-19T00:43:28.766568+0000","last_clean":"2024-08-19T00:43:28.766568+0000","last_became_active":"2024-08-19T00:43:27.265880+0000","last_became_peered":"2024-08-19T00:43:27.265880+0000","last_unstale":"2024-08-19T00:43:28.766568+0000","last_undegraded":"2024-08-19T00:43:28.766568+0000","last_fullsized":"2024-08-19T00:43:28.766568+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:41.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766631+0000","last_change":"2024-08-19T00:43:26.247753+0000","last_active":"2024-08-19T00:43:28.766631+0000","last_peered":"2024-08-19T00:43:28.766631+0000","last_clean":"2024-08-19T00:43:28.766631+0000","last_became_active":"2024-08-19T00:43:26.246140+0000","last_became_peered":"2024-08-19T00:43:26.246140+0000","last_unstale":"2024-08-19T00:43:28.766631+0000","last_undegraded":"2024-08-19T00:43:28.766631+0000","last_fullsized":"2024-08-19T00:43:28.766631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:21.148516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768196+0000","last_change":"2024-08-19T00:43:27.246597+0000","last_active":"2024-08-19T00:43:28.768196+0000","last_peered":"2024-08-19T00:43:28.768196+0000","last_clean":"2024-08-19T00:43:28.768196+0000","last_became_active":"2024-08-19T00:43:27.246206+0000","last_became_peered":"2024-08-19T00:43:27.246206+0000","last_unstale":"2024-08-19T00:43:28.768196+0000","last_undegraded":"2024-08-19T00:43:28.768196+0000","last_fullsized":"2024-08-19T00:43:28.768196+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:27.480299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767849+0000","last_change":"2024-08-19T00:43:26.254823+0000","last_active":"2024-08-19T00:43:28.767849+0000","last_peered":"2024-08-19T00:43:28.767849+0000","last_clean":"2024-08-19T00:43:28.767849+0000","last_became_active":"2024-08-19T00:43:26.254128+0000","last_became_peered":"2024-08-19T00:43:26.254128+0000","last_unstale":"2024-08-19T00:43:28.767849+0000","last_undegraded":"2024-08-19T00:43:28.767849+0000","last_fullsized":"2024-08-19T00:43:28.767849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:18.799925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768921+0000","last_change":"2024-08-19T00:43:27.264063+0000","last_active":"2024-08-19T00:43:28.768921+0000","last_peered":"2024-08-19T00:43:28.768921+0000","last_clean":"2024-08-19T00:43:28.768921+0000","last_became_active":"2024-08-19T00:43:27.263736+0000","last_became_peered":"2024-08-19T00:43:27.263736+0000","last_unstale":"2024-08-19T00:43:28.768921+0000","last_undegraded":"2024-08-19T00:43:28.768921+0000","last_fullsized":"2024-08-19T00:43:28.768921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:33.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252497+0000","last_change":"2024-08-19T00:43:26.245999+0000","last_active":"2024-08-19T00:43:28.252497+0000","last_peered":"2024-08-19T00:43:28.252497+0000","last_clean":"2024-08-19T00:43:28.252497+0000","last_became_active":"2024-08-19T00:43:26.245343+0000","last_became_peered":"2024-08-19T00:43:26.245343+0000","last_unstale":"2024-08-19T00:43:28.252497+0000","last_undegraded":"2024-08-19T00:43:28.252497+0000","last_fullsized":"2024-08-19T00:43:28.252497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:20:05.728407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768153+0000","last_change":"2024-08-19T00:43:27.247091+0000","last_active":"2024-08-19T00:43:28.768153+0000","last_peered":"2024-08-19T00:43:28.768153+0000","last_clean":"2024-08-19T00:43:28.768153+0000","last_became_active":"2024-08-19T00:43:27.245584+0000","last_became_peered":"2024-08-19T00:43:27.245584+0000","last_unstale":"2024-08-19T00:43:28.768153+0000","last_undegraded":"2024-08-19T00:43:28.768153+0000","last_fullsized":"2024-08-19T00:43:28.768153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:09.776567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252086+0000","last_change":"2024-08-19T00:43:26.245518+0000","last_active":"2024-08-19T00:43:28.252086+0000","last_peered":"2024-08-19T00:43:28.252086+0000","last_clean":"2024-08-19T00:43:28.252086+0000","last_became_active":"2024-08-19T00:43:26.244229+0000","last_became_peered":"2024-08-19T00:43:26.244229+0000","last_unstale":"2024-08-19T00:43:28.252086+0000","last_undegraded":"2024-08-19T00:43:28.252086+0000","last_fullsized":"2024-08-19T00:43:28.252086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:14.099566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250463+0000","last_change":"2024-08-19T00:43:27.263950+0000","last_active":"2024-08-19T00:43:28.250463+0000","last_peered":"2024-08-19T00:43:28.250463+0000","last_clean":"2024-08-19T00:43:28.250463+0000","last_became_active":"2024-08-19T00:43:27.261230+0000","last_became_peered":"2024-08-19T00:43:27.261230+0000","last_unstale":"2024-08-19T00:43:28.250463+0000","last_undegraded":"2024-08-19T00:43:28.250463+0000","last_fullsized":"2024-08-19T00:43:28.250463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:32.967177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252016+0000","last_change":"2024-08-19T00:43:26.246724+0000","last_active":"2024-08-19T00:43:28.252016+0000","last_peered":"2024-08-19T00:43:28.252016+0000","last_clean":"2024-08-19T00:43:28.252016+0000","last_became_active":"2024-08-19T00:43:26.244400+0000","last_became_peered":"2024-08-19T00:43:26.244400+0000","last_unstale":"2024-08-19T00:43:28.252016+0000","last_undegraded":"2024-08-19T00:43:28.252016+0000","last_fullsized":"2024-08-19T00:43:28.252016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:38.836421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767615+0000","last_change":"2024-08-19T00:43:27.259917+0000","last_active":"2024-08-19T00:43:28.767615+0000","last_peered":"2024-08-19T00:43:28.767615+0000","last_clean":"2024-08-19T00:43:28.767615+0000","last_became_active":"2024-08-19T00:43:27.258961+0000","last_became_peered":"2024-08-19T00:43:27.258961+0000","last_unstale":"2024-08-19T00:43:28.767615+0000","last_undegraded":"2024-08-19T00:43:28.767615+0000","last_fullsized":"2024-08-19T00:43:28.767615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:48:47.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.250526+0000","last_change":"2024-08-19T00:43:26.246389+0000","last_active":"2024-08-19T00:43:28.250526+0000","last_peered":"2024-08-19T00:43:28.250526+0000","last_clean":"2024-08-19T00:43:28.250526+0000","last_became_active":"2024-08-19T00:43:26.246109+0000","last_became_peered":"2024-08-19T00:43:26.246109+0000","last_unstale":"2024-08-19T00:43:28.250526+0000","last_undegraded":"2024-08-19T00:43:28.250526+0000","last_fullsized":"2024-08-19T00:43:28.250526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:40:42.744951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251242+0000","last_change":"2024-08-19T00:43:27.240290+0000","last_active":"2024-08-19T00:43:28.251242+0000","last_peered":"2024-08-19T00:43:28.251242+0000","last_clean":"2024-08-19T00:43:28.251242+0000","last_became_active":"2024-08-19T00:43:27.240016+0000","last_became_peered":"2024-08-19T00:43:27.240016+0000","last_unstale":"2024-08-19T00:43:28.251242+0000","last_undegraded":"2024-08-19T00:43:28.251242+0000","last_fullsized":"2024-08-19T00:43:28.251242+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:25.346987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766505+0000","last_change":"2024-08-19T00:43:26.251634+0000","last_active":"2024-08-19T00:43:28.766505+0000","last_peered":"2024-08-19T00:43:28.766505+0000","last_clean":"2024-08-19T00:43:28.766505+0000","last_became_active":"2024-08-19T00:43:26.251080+0000","last_became_peered":"2024-08-19T00:43:26.251080+0000","last_unstale":"2024-08-19T00:43:28.766505+0000","last_undegraded":"2024-08-19T00:43:28.766505+0000","last_fullsized":"2024-08-19T00:43:28.766505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:38.987677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767027+0000","last_change":"2024-08-19T00:43:27.246800+0000","last_active":"2024-08-19T00:43:28.767027+0000","last_peered":"2024-08-19T00:43:28.767027+0000","last_clean":"2024-08-19T00:43:28.767027+0000","last_became_active":"2024-08-19T00:43:27.243884+0000","last_became_peered":"2024-08-19T00:43:27.243884+0000","last_unstale":"2024-08-19T00:43:28.767027+0000","last_undegraded":"2024-08-19T00:43:28.767027+0000","last_fullsized":"2024-08-19T00:43:28.767027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:31.358363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251469+0000","last_change":"2024-08-19T00:43:26.245542+0000","last_active":"2024-08-19T00:43:28.251469+0000","last_peered":"2024-08-19T00:43:28.251469+0000","last_clean":"2024-08-19T00:43:28.251469+0000","last_became_active":"2024-08-19T00:43:26.244413+0000","last_became_peered":"2024-08-19T00:43:26.244413+0000","last_unstale":"2024-08-19T00:43:28.251469+0000","last_undegraded":"2024-08-19T00:43:28.251469+0000","last_fullsized":"2024-08-19T00:43:28.251469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:23.794436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767671+0000","last_change":"2024-08-19T00:43:27.252136+0000","last_active":"2024-08-19T00:43:28.767671+0000","last_peered":"2024-08-19T00:43:28.767671+0000","last_clean":"2024-08-19T00:43:28.767671+0000","last_became_active":"2024-08-19T00:43:27.249981+0000","last_became_peered":"2024-08-19T00:43:27.249981+0000","last_unstale":"2024-08-19T00:43:28.767671+0000","last_undegraded":"2024-08-19T00:43:28.767671+0000","last_fullsized":"2024-08-19T00:43:28.767671+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:09.506149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.252235+0000","last_change":"2024-08-19T00:43:26.248782+0000","last_active":"2024-08-19T00:43:28.252235+0000","last_peered":"2024-08-19T00:43:28.252235+0000","last_clean":"2024-08-19T00:43:28.252235+0000","last_became_active":"2024-08-19T00:43:26.248488+0000","last_became_peered":"2024-08-19T00:43:26.248488+0000","last_unstale":"2024-08-19T00:43:28.252235+0000","last_undegraded":"2024-08-19T00:43:28.252235+0000","last_fullsized":"2024-08-19T00:43:28.252235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:28.352241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767772+0000","last_change":"2024-08-19T00:43:27.255288+0000","last_active":"2024-08-19T00:43:28.767772+0000","last_peered":"2024-08-19T00:43:28.767772+0000","last_clean":"2024-08-19T00:43:28.767772+0000","last_became_active":"2024-08-19T00:43:27.254996+0000","last_became_peered":"2024-08-19T00:43:27.254996+0000","last_unstale":"2024-08-19T00:43:28.767772+0000","last_undegraded":"2024-08-19T00:43:28.767772+0000","last_fullsized":"2024-08-19T00:43:28.767772+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:54.813820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766799+0000","last_change":"2024-08-19T00:43:26.247355+0000","last_active":"2024-08-19T00:43:28.766799+0000","last_peered":"2024-08-19T00:43:28.766799+0000","last_clean":"2024-08-19T00:43:28.766799+0000","last_became_active":"2024-08-19T00:43:26.246754+0000","last_became_peered":"2024-08-19T00:43:26.246754+0000","last_unstale":"2024-08-19T00:43:28.766799+0000","last_undegraded":"2024-08-19T00:43:28.766799+0000","last_fullsized":"2024-08-19T00:43:28.766799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:12.137940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767130+0000","last_change":"2024-08-19T00:43:27.256077+0000","last_active":"2024-08-19T00:43:28.767130+0000","last_peered":"2024-08-19T00:43:28.767130+0000","last_clean":"2024-08-19T00:43:28.767130+0000","last_became_active":"2024-08-19T00:43:27.255770+0000","last_became_peered":"2024-08-19T00:43:27.255770+0000","last_unstale":"2024-08-19T00:43:28.767130+0000","last_undegraded":"2024-08-19T00:43:28.767130+0000","last_fullsized":"2024-08-19T00:43:28.767130+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:48:48.389713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767976+0000","last_change":"2024-08-19T00:43:26.254345+0000","last_active":"2024-08-19T00:43:28.767976+0000","last_peered":"2024-08-19T00:43:28.767976+0000","last_clean":"2024-08-19T00:43:28.767976+0000","last_became_active":"2024-08-19T00:43:26.253385+0000","last_became_peered":"2024-08-19T00:43:26.253385+0000","last_unstale":"2024-08-19T00:43:28.767976+0000","last_undegraded":"2024-08-19T00:43:28.767976+0000","last_fullsized":"2024-08-19T00:43:28.767976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:33.471090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768855+0000","last_change":"2024-08-19T00:43:27.267381+0000","last_active":"2024-08-19T00:43:28.768855+0000","last_peered":"2024-08-19T00:43:28.768855+0000","last_clean":"2024-08-19T00:43:28.768855+0000","last_became_active":"2024-08-19T00:43:27.264111+0000","last_became_peered":"2024-08-19T00:43:27.264111+0000","last_unstale":"2024-08-19T00:43:28.768855+0000","last_undegraded":"2024-08-19T00:43:28.768855+0000","last_fullsized":"2024-08-19T00:43:28.768855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:28.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768454+0000","last_change":"2024-08-19T00:43:26.241910+0000","last_active":"2024-08-19T00:43:28.768454+0000","last_peered":"2024-08-19T00:43:28.768454+0000","last_clean":"2024-08-19T00:43:28.768454+0000","last_became_active":"2024-08-19T00:43:26.241588+0000","last_became_peered":"2024-08-19T00:43:26.241588+0000","last_unstale":"2024-08-19T00:43:28.768454+0000","last_undegraded":"2024-08-19T00:43:28.768454+0000","last_fullsized":"2024-08-19T00:43:28.768454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:30.355282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768490+0000","last_change":"2024-08-19T00:43:27.254828+0000","last_active":"2024-08-19T00:43:28.768490+0000","last_peered":"2024-08-19T00:43:28.768490+0000","last_clean":"2024-08-19T00:43:28.768490+0000","last_became_active":"2024-08-19T00:43:27.254439+0000","last_became_peered":"2024-08-19T00:43:27.254439+0000","last_unstale":"2024-08-19T00:43:28.768490+0000","last_undegraded":"2024-08-19T00:43:28.768490+0000","last_fullsized":"2024-08-19T00:43:28.768490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:22.151596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.251004+0000","last_change":"2024-08-19T00:43:26.249707+0000","last_active":"2024-08-19T00:43:28.251004+0000","last_peered":"2024-08-19T00:43:28.251004+0000","last_clean":"2024-08-19T00:43:28.251004+0000","last_became_active":"2024-08-19T00:43:26.249440+0000","last_became_peered":"2024-08-19T00:43:26.249440+0000","last_unstale":"2024-08-19T00:43:28.251004+0000","last_undegraded":"2024-08-19T00:43:28.251004+0000","last_fullsized":"2024-08-19T00:43:28.251004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:23:53.460976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.766963+0000","last_change":"2024-08-19T00:43:27.260600+0000","last_active":"2024-08-19T00:43:28.766963+0000","last_peered":"2024-08-19T00:43:28.766963+0000","last_clean":"2024-08-19T00:43:28.766963+0000","last_became_active":"2024-08-19T00:43:27.259917+0000","last_became_peered":"2024-08-19T00:43:27.259917+0000","last_unstale":"2024-08-19T00:43:28.766963+0000","last_undegraded":"2024-08-19T00:43:28.766963+0000","last_fullsized":"2024-08-19T00:43:28.766963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:19.150926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768244+0000","last_change":"2024-08-19T00:43:26.247215+0000","last_active":"2024-08-19T00:43:28.768244+0000","last_peered":"2024-08-19T00:43:28.768244+0000","last_clean":"2024-08-19T00:43:28.768244+0000","last_became_active":"2024-08-19T00:43:26.246956+0000","last_became_peered":"2024-08-19T00:43:26.246956+0000","last_unstale":"2024-08-19T00:43:28.768244+0000","last_undegraded":"2024-08-19T00:43:28.768244+0000","last_fullsized":"2024-08-19T00:43:28.768244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:03.399746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768220+0000","last_change":"2024-08-19T00:43:27.252339+0000","last_active":"2024-08-19T00:43:28.768220+0000","last_peered":"2024-08-19T00:43:28.768220+0000","last_clean":"2024-08-19T00:43:28.768220+0000","last_became_active":"2024-08-19T00:43:27.251860+0000","last_became_peered":"2024-08-19T00:43:27.251860+0000","last_unstale":"2024-08-19T00:43:28.768220+0000","last_undegraded":"2024-08-19T00:43:28.768220+0000","last_fullsized":"2024-08-19T00:43:28.768220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:24.630669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767352+0000","last_change":"2024-08-19T00:43:26.247628+0000","last_active":"2024-08-19T00:43:28.767352+0000","last_peered":"2024-08-19T00:43:28.767352+0000","last_clean":"2024-08-19T00:43:28.767352+0000","last_became_active":"2024-08-19T00:43:26.247335+0000","last_became_peered":"2024-08-19T00:43:26.247335+0000","last_unstale":"2024-08-19T00:43:28.767352+0000","last_undegraded":"2024-08-19T00:43:28.767352+0000","last_fullsized":"2024-08-19T00:43:28.767352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:45:23.794436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.768475+0000","last_change":"2024-08-19T00:43:27.253156+0000","last_active":"2024-08-19T00:43:28.768475+0000","last_peered":"2024-08-19T00:43:28.768475+0000","last_clean":"2024-08-19T00:43:28.768475+0000","last_became_active":"2024-08-19T00:43:27.252898+0000","last_became_peered":"2024-08-19T00:43:27.252898+0000","last_unstale":"2024-08-19T00:43:28.768475+0000","last_undegraded":"2024-08-19T00:43:28.768475+0000","last_fullsized":"2024-08-19T00:43:28.768475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:13.141021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767975+0000","last_change":"2024-08-19T00:43:26.252641+0000","last_active":"2024-08-19T00:43:28.767975+0000","last_peered":"2024-08-19T00:43:28.767975+0000","last_clean":"2024-08-19T00:43:28.767975+0000","last_became_active":"2024-08-19T00:43:26.252395+0000","last_became_peered":"2024-08-19T00:43:26.252395+0000","last_unstale":"2024-08-19T00:43:28.767975+0000","last_undegraded":"2024-08-19T00:43:28.767975+0000","last_fullsized":"2024-08-19T00:43:28.767975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:23:53.460976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767038+0000","last_change":"2024-08-19T00:43:27.259714+0000","last_active":"2024-08-19T00:43:28.767038+0000","last_peered":"2024-08-19T00:43:28.767038+0000","last_clean":"2024-08-19T00:43:28.767038+0000","last_became_active":"2024-08-19T00:43:27.258524+0000","last_became_peered":"2024-08-19T00:43:27.258524+0000","last_unstale":"2024-08-19T00:43:28.767038+0000","last_undegraded":"2024-08-19T00:43:28.767038+0000","last_fullsized":"2024-08-19T00:43:28.767038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:26.218836+0000","last_clean_scrub_stamp":"2024-08-19T00:43:26.218836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:30.154871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767416+0000","last_change":"2024-08-19T00:43:26.235378+0000","last_active":"2024-08-19T00:43:28.767416+0000","last_peered":"2024-08-19T00:43:28.767416+0000","last_clean":"2024-08-19T00:43:28.767416+0000","last_became_active":"2024-08-19T00:43:26.235107+0000","last_became_peered":"2024-08-19T00:43:26.235107+0000","last_unstale":"2024-08-19T00:43:28.767416+0000","last_undegraded":"2024-08-19T00:43:28.767416+0000","last_fullsized":"2024-08-19T00:43:28.767416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:43:25.215755+0000","last_clean_scrub_stamp":"2024-08-19T00:43:25.215755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:24.343907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":295,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-19T00:43:28.767938+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:43:28.767938+0000","last_peered":"2024-08-19T00:43:28.767938+0000","last_clean":"2024-08-19T00:43:28.767938+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:43:28.767938+0000","last_undegraded":"2024-08-19T00:43:28.767938+0000","last_fullsized":"2024-08-19T00:43:28.767938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":455194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1064960,"data_stored":455796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32812,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339028,"statfs":{"total":96636764160,"available":96603164672,"internally_reserved":0,"allocated":1667072,"data_stored":1047138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":455158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":455798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":455124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1654784,"data_stored":1045582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":456758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:43:31.884 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:43:31.885 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-19T00:43:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.082+0000 7f0e24000640 1 Processor -- start 2024-08-19T00:43:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.082+0000 7f0e24000640 1 -- start start 2024-08-19T00:43:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e24000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e1c158cd0 0x7f0e1c072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e24000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c072ff0 0x7f0e1c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e24000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c0aeae0 con 0x7f0e1c0ae2b0 2024-08-19T00:43:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e24000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1c073460 con 0x7f0e1c158cd0 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e24000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c0aedc0 con 0x7f0e1c072ff0 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e21600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e1c158cd0 0x7f0e1c072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e21600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e1c158cd0 0x7f0e1c072ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47994/0 (socket says 172.21.15.7:47994) 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e21600640 1 -- 172.21.15.7:0/1685643592 learned_addr learned my addr 172.21.15.7:0/1685643592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.083+0000 7f0e20c00640 1 --2- 172.21.15.7:0/1685643592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c072ff0 0x7f0e1c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.084+0000 7f0e21600640 1 -- 172.21.15.7:0/1685643592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c072ff0 msgr2=0x7f0e1c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.084+0000 7f0e21600640 1 --2- 172.21.15.7:0/1685643592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c072ff0 0x7f0e1c0add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.084+0000 7f0e21600640 1 -- 172.21.15.7:0/1685643592 >> v1:172.21.15.162:6789/0 conn(0x7f0e1c0ae2b0 legacy=0x7f0e1c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.084+0000 7f0e21600640 1 -- 172.21.15.7:0/1685643592 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c0af0a0 con 0x7f0e1c158cd0 2024-08-19T00:43:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.084+0000 7f0e20c00640 1 --2- 172.21.15.7:0/1685643592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c072ff0 0x7f0e1c0add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.085+0000 7f0e21600640 1 --2- 172.21.15.7:0/1685643592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c158cd0 0x7f0e1c072ab0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009870 tx=0x7f0e1002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73f25e6c8a9f986 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.085+0000 7f0e1be00640 1 -- 172.21.15.7:0/1685643592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10037070 con 0x7f0e1c158cd0 2024-08-19T00:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.085+0000 7f0e1be00640 1 -- 172.21.15.7:0/1685643592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10032440 con 0x7f0e1c158cd0 2024-08-19T00:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.085+0000 7f0e1be00640 1 -- 172.21.15.7:0/1685643592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10032810 con 0x7f0e1c158cd0 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 -- 172.21.15.7:0/1685643592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c158cd0 msgr2=0x7f0e1c072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 --2- 172.21.15.7:0/1685643592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c158cd0 0x7f0e1c072ab0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009870 tx=0x7f0e1002a130 comp rx=0 tx=0).stop 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 -- 172.21.15.7:0/1685643592 shutdown_connections 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 --2- 172.21.15.7:0/1685643592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c072ff0 0x7f0e1c0add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 --2- 172.21.15.7:0/1685643592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c158cd0 0x7f0e1c072ab0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 -- 172.21.15.7:0/1685643592 >> 172.21.15.7:0/1685643592 conn(0x7f0e1c0b2300 msgr2=0x7f0e1c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 -- 172.21.15.7:0/1685643592 shutdown_connections 2024-08-19T00:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.086+0000 7f0e24000640 1 -- 172.21.15.7:0/1685643592 wait complete. 2024-08-19T00:43:32.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.088+0000 7f0e24000640 1 Processor -- start 2024-08-19T00:43:32.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.088+0000 7f0e24000640 1 -- start start 2024-08-19T00:43:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e24000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c072ff0 0x7f0e1c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e24000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c0ae2b0 0x7f0e1c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e24000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c06f590 0x7f0e1c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e24000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c0ae6d0 con 0x7f0e1c072ff0 2024-08-19T00:43:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e24000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c0af660 con 0x7f0e1c0ae2b0 2024-08-19T00:43:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e24000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c0ae850 con 0x7f0e1c06f590 2024-08-19T00:43:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c072ff0 0x7f0e1c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c072ff0 0x7f0e1c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47996/0 (socket says 172.21.15.7:47996) 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 -- 172.21.15.7:0/2421276196 learned_addr learned my addr 172.21.15.7:0/2421276196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e20c00640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c0ae2b0 0x7f0e1c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e22000640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c06f590 0x7f0e1c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 -- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c06f590 msgr2=0x7f0e1c0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c06f590 0x7f0e1c0c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 -- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c0ae2b0 msgr2=0x7f0e1c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c0ae2b0 0x7f0e1c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e21600640 1 -- 172.21.15.7:0/2421276196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c0cb1e0 con 0x7f0e1c072ff0 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.089+0000 7f0e20c00640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c0ae2b0 0x7f0e1c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.090+0000 7f0e21600640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c072ff0 0x7f0e1c0caa90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0e10000c00 tx=0x7f0e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.090+0000 7f0e19600640 1 -- 172.21.15.7:0/2421276196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10037040 con 0x7f0e1c072ff0 2024-08-19T00:43:32.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.090+0000 7f0e19600640 1 -- 172.21.15.7:0/2421276196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10042070 con 0x7f0e1c072ff0 2024-08-19T00:43:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.090+0000 7f0e19600640 1 -- 172.21.15.7:0/2421276196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10030980 con 0x7f0e1c072ff0 2024-08-19T00:43:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.090+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c0cb4c0 con 0x7f0e1c072ff0 2024-08-19T00:43:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.090+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c0c9610 con 0x7f0e1c072ff0 2024-08-19T00:43:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.091+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c15de10 con 0x7f0e1c072ff0 2024-08-19T00:43:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.092+0000 7f0e19600640 1 -- 172.21.15.7:0/2421276196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e10030b20 con 0x7f0e1c072ff0 2024-08-19T00:43:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.093+0000 7f0e19600640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0dfc06be30 0x7f0dfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.093+0000 7f0e19600640 1 -- 172.21.15.7:0/2421276196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f0e100ab950 con 0x7f0e1c072ff0 2024-08-19T00:43:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.093+0000 7f0e20c00640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0dfc06be30 0x7f0dfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.094+0000 7f0e20c00640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0dfc06be30 0x7f0dfc06e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0b1120 tx=0x7f0e08008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.097+0000 7f0e19600640 1 -- 172.21.15.7:0/2421276196 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0e10045360 con 0x7f0e1c072ff0 2024-08-19T00:43:32.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:43:32.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:43:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.352+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0e1c0b4240 con 0x7f0e1c072ff0 2024-08-19T00:43:32.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.354+0000 7f0e19600640 1 -- 172.21.15.7:0/2421276196 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f0e1007a1d0 con 0x7f0e1c072ff0 2024-08-19T00:43:32.357 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-08-19T00:43:32.357 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:43:32.357 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-08-19T00:43:32.357 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-08-19T00:43:32.357 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-19T00:43:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0dfc06be30 msgr2=0x7f0dfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0dfc06be30 0x7f0dfc06e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0b1120 tx=0x7f0e08008040 comp rx=0 tx=0).stop 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c072ff0 msgr2=0x7f0e1c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c072ff0 0x7f0e1c0caa90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0e10000c00 tx=0x7f0e100046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 shutdown_connections 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0dfc06be30 0x7f0dfc06e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e1c06f590 0x7f0e1c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c0ae2b0 0x7f0e1c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 --2- 172.21.15.7:0/2421276196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e1c072ff0 0x7f0e1c0caa90 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 >> 172.21.15.7:0/2421276196 conn(0x7f0e1c0b2300 msgr2=0x7f0e1c14ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 shutdown_connections 2024-08-19T00:43:32.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.357+0000 7f0e24000640 1 -- 172.21.15.7:0/2421276196 wait complete. 2024-08-19T00:43:32.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.527+0000 7f5ef8e00640 1 Processor -- start 2024-08-19T00:43:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.528+0000 7f5ef8e00640 1 -- start start 2024-08-19T00:43:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5ef8e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5ef4071980 0x7f5ef40cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5ef8e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef40cdfb0 con 0x7f5ef406e710 2024-08-19T00:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5ef8e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef40ce290 con 0x7f5ef40d03c0 2024-08-19T00:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5ef8e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef40cebc0 con 0x7f5ef4071980 2024-08-19T00:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5eebe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5ef406e710 0x7f5ef40b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53408/0 (socket says 172.21.15.7:53408) 2024-08-19T00:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5eebe00640 1 -- 172.21.15.7:0/2853025604 learned_addr learned my addr 172.21.15.7:0/2853025604 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5ef2800640 1 --2- 172.21.15.7:0/2853025604 >> v2:172.21.15.162:3300/0 conn(0x7f5ef4071980 0x7f5ef40cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982591026 0 0) 0x7f5ef40cdfb0 con 0x7f5ef406e710 2024-08-19T00:43:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.529+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed8005730 con 0x7f5ef406e710 2024-08-19T00:43:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043765421 0 0) 0x7f5ef40ce290 con 0x7f5ef40d03c0 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ef40cdfb0 con 0x7f5ef40d03c0 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 930671912 0 0) 0x7f5ed8005730 con 0x7f5ef406e710 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 >> v2:172.21.15.162:3300/0 conn(0x7f5ef4071980 msgr2=0x7f5ef40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 --2- 172.21.15.7:0/2853025604 >> v2:172.21.15.162:3300/0 conn(0x7f5ef4071980 0x7f5ef40cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 >> v1:172.21.15.162:6789/0 conn(0x7f5ef40d03c0 legacy=0x7f5ef40d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef40ce570 con 0x7f5ef406e710 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f5edc0015f0 con 0x7f5ef406e710 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 >> v1:172.21.15.7:6789/0 conn(0x7f5ef406e710 legacy=0x7f5ef40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed8005d50 0x7f5ed8006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed8006a10 0x7f5ed8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ed800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef40cebc0 con 0x7f5ed80073d0 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed800e250 con 0x7f5ed8005d50 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed800e450 con 0x7f5ed8006a10 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef2800640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ed800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5ef1e00640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed8005d50 0x7f5ed8006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.530+0000 7f5eebe00640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed8006a10 0x7f5ed8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.531+0000 7f5ef2800640 1 -- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed8006a10 msgr2=0x7f5ed8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.531+0000 7f5ef2800640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed8006a10 0x7f5ed8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.531+0000 7f5ef2800640 1 -- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed8005d50 msgr2=0x7f5ed8006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.531+0000 7f5ef2800640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed8005d50 0x7f5ed8006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.531+0000 7f5ef2800640 1 -- 172.21.15.7:0/2853025604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed8005730 con 0x7f5ed80073d0 2024-08-19T00:43:32.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.531+0000 7f5eebe00640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed8006a10 0x7f5ed8006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.531+0000 7f5ef2800640 1 -- 172.21.15.7:0/2853025604 reap_dead start 2024-08-19T00:43:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef2800640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ed800dbd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009fc0 tx=0x7f5ed8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36ee00f7ab86e68 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec035020 con 0x7f5ed80073d0 2024-08-19T00:43:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec003bd0 con 0x7f5ed80073d0 2024-08-19T00:43:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef1400640 1 -- 172.21.15.7:0/2853025604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec009c10 con 0x7f5ed80073d0 2024-08-19T00:43:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2853025604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 msgr2=0x7f5ed800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ed800dbd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009fc0 tx=0x7f5ed8007a40 comp rx=0 tx=0).stop 2024-08-19T00:43:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2853025604 shutdown_connections 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2853025604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ed800dbd0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.532+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2853025604 >> 172.21.15.7:0/2853025604 conn(0x7f5ef406bc70 msgr2=0x7f5ef406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.533+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2853025604 shutdown_connections 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.533+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2853025604 wait complete. 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.534+0000 7f5ef8e00640 1 Processor -- start 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.534+0000 7f5ef8e00640 1 -- start start 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ef40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef41edf60 0x7f5ef415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef415f130 0x7f5ef41f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef8e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4073c60 con 0x7f5ed80073d0 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4073ae0 con 0x7f5ef41edf60 2024-08-19T00:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef40d07a0 con 0x7f5ef415f130 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ef40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ef40b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48008/0 (socket says 172.21.15.7:48008) 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.535+0000 7f5ef1e00640 1 -- 172.21.15.7:0/2593016383 learned_addr learned my addr 172.21.15.7:0/2593016383 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5eebe00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef41edf60 0x7f5ef415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef2800640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef415f130 0x7f5ef41f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef1e00640 1 -- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef415f130 msgr2=0x7f5ef41f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef1e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef415f130 0x7f5ef41f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef1e00640 1 -- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef41edf60 msgr2=0x7f5ef415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef1e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef41edf60 0x7f5ef415ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef1e00640 1 -- 172.21.15.7:0/2593016383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef40b0ea0 con 0x7f5ed80073d0 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef2800640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef415f130 0x7f5ef41f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef1e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ef40b1c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400f7a0 tx=0x7f5ee400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5eea000640 1 -- 172.21.15.7:0/2593016383 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee401a070 con 0x7f5ed80073d0 2024-08-19T00:43:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5eea000640 1 -- 172.21.15.7:0/2593016383 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee400fe50 con 0x7f5ed80073d0 2024-08-19T00:43:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5eea000640 1 -- 172.21.15.7:0/2593016383 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4007050 con 0x7f5ed80073d0 2024-08-19T00:43:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.536+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef41f4f60 con 0x7f5ed80073d0 2024-08-19T00:43:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.537+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef40b1420 con 0x7f5ed80073d0 2024-08-19T00:43:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.538+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef40ce290 con 0x7f5ed80073d0 2024-08-19T00:43:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.539+0000 7f5eea000640 1 -- 172.21.15.7:0/2593016383 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ee401d070 con 0x7f5ed80073d0 2024-08-19T00:43:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.540+0000 7f5eea000640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5ed006be60 0x7f5ed006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.540+0000 7f5eea000640 1 -- 172.21.15.7:0/2593016383 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f5ee408a690 con 0x7f5ed80073d0 2024-08-19T00:43:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.540+0000 7f5eebe00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5ed006be60 0x7f5ed006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.541+0000 7f5eebe00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5ed006be60 0x7f5ed006e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5ef415fab0 tx=0x7f5edc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:32.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.544+0000 7f5eea000640 1 -- 172.21.15.7:0/2593016383 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5ee4058fa0 con 0x7f5ed80073d0 2024-08-19T00:43:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.765+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ef415a970 con 0x7f5ed80073d0 2024-08-19T00:43:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.765+0000 7f5eea000640 1 -- 172.21.15.7:0/2593016383 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5225 (secure 0 0 0) 0x7f5ee40588a0 con 0x7f5ed80073d0 2024-08-19T00:43:32.768 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:32.768 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":84,"btime":"2024-08-19T00:43:30:255297+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3482189423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3482189423},{"type":"v1","addr":"172.21.15.162:6834","nonce":3482189423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:29.678316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6835/2295549448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2295549448},{"type":"v1","addr":"172.21.15.162:6835","nonce":2295549448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6505,"qdb_cluster":[6505]},"id":6}]} 2024-08-19T00:43:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 84 2024-08-19T00:43:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.767+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5ed006be60 msgr2=0x7f5ed006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.767+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5ed006be60 0x7f5ed006e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5ef415fab0 tx=0x7f5edc009040 comp rx=0 tx=0).stop 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.767+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 msgr2=0x7f5ef40b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.767+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ef40b1c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400f7a0 tx=0x7f5ee400fc60 comp rx=0 tx=0).stop 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 shutdown_connections 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5ed006be60 0x7f5ed006e320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef415f130 0x7f5ef41f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef41edf60 0x7f5ef415ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 --2- 172.21.15.7:0/2593016383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed80073d0 0x7f5ef40b1c20 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 >> 172.21.15.7:0/2593016383 conn(0x7f5ef406bc70 msgr2=0x7f5ef40ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 shutdown_connections 2024-08-19T00:43:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:32.768+0000 7f5ef8e00640 1 -- 172.21.15.7:0/2593016383 wait complete. 2024-08-19T00:43:33.188 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:43:29.678316+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6505}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6505': {'gid': 6505, 'name': 'd', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6835/2295549448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 2295549448}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2295549448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6505, 'qdb_cluster': [6505]} 2024-08-19T00:43:33.188 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:43:33.189 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-19T00:43:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.346+0000 7f0cc3200640 1 Processor -- start 2024-08-19T00:43:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.346+0000 7f0cc3200640 1 -- start start 2024-08-19T00:43:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.347+0000 7f0cc3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0cbc169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.347+0000 7f0cc3200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cbc15ec30 con 0x7f0cbc09b730 2024-08-19T00:43:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.347+0000 7f0cc3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cbc15ef10 con 0x7f0cbc09aa70 2024-08-19T00:43:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.347+0000 7f0cc3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc15f1f0 con 0x7f0cbc0d12a0 2024-08-19T00:43:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbb400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0cbc09b730 0x7f0cbc06fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53412/0 (socket says 172.21.15.7:53412) 2024-08-19T00:43:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbb400640 1 -- 172.21.15.7:0/3692459458 learned_addr learned my addr 172.21.15.7:0/3692459458 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0cbc169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420830362 0 0) 0x7f0cbc15ec30 con 0x7f0cbc09b730 2024-08-19T00:43:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca0003520 con 0x7f0cbc09b730 2024-08-19T00:43:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2490905428 0 0) 0x7f0ca0003520 con 0x7f0cbc09b730 2024-08-19T00:43:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 msgr2=0x7f0cbc169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0cbc169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 >> v1:172.21.15.162:6789/0 conn(0x7f0cbc09aa70 legacy=0x7f0cbc09ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc15f4d0 con 0x7f0cbc09b730 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f0ca8001670 con 0x7f0cbc09b730 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.348+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0cbc169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 >> v1:172.21.15.7:6789/0 conn(0x7f0cbc09b730 legacy=0x7f0cbc06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbaa00640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbaa00640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0ca0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbaa00640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca0004d40 0x7f0ca00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc15f1f0 con 0x7f0ca0004d40 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca000b9c0 con 0x7f0ca00039e0 2024-08-19T00:43:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca000bbc0 con 0x7f0cbc0d12a0 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca0004d40 0x7f0ca00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbb400640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0ca0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cc1200640 1 -- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 msgr2=0x7f0ca0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0ca0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cc1200640 1 -- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca00039e0 msgr2=0x7f0ca0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cc1200640 1 -- 172.21.15.7:0/3692459458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca0003520 con 0x7f0ca0004d40 2024-08-19T00:43:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.349+0000 7f0cbb400640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc0d12a0 0x7f0ca0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.350+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca0004d40 0x7f0ca00051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e350 tx=0x7f0ca0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d9da68c9be4f80 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4033070 con 0x7f0ca0004d40 2024-08-19T00:43:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb402f660 con 0x7f0ca0004d40 2024-08-19T00:43:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cbaa00640 1 -- 172.21.15.7:0/3692459458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4009de0 con 0x7f0ca0004d40 2024-08-19T00:43:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cc3200640 1 -- 172.21.15.7:0/3692459458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca0004d40 msgr2=0x7f0ca00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cc3200640 1 --2- 172.21.15.7:0/3692459458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca0004d40 0x7f0ca00051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e350 tx=0x7f0ca0005830 comp rx=0 tx=0).stop 2024-08-19T00:43:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cc1200640 1 -- 172.21.15.7:0/3692459458 reap_dead start 2024-08-19T00:43:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cc3200640 1 -- 172.21.15.7:0/3692459458 shutdown_connections 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cc3200640 1 -- 172.21.15.7:0/3692459458 >> 172.21.15.7:0/3692459458 conn(0x7f0cbc0d2190 msgr2=0x7f0cbc0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cc3200640 1 -- 172.21.15.7:0/3692459458 shutdown_connections 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.351+0000 7f0cc3200640 1 -- 172.21.15.7:0/3692459458 wait complete. 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.353+0000 7f0cc3200640 1 Processor -- start 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.353+0000 7f0cc3200640 1 -- start start 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cc3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca0004d40 0x7f0cbc150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cc3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cbc0cf4e0 0x7f0cbc15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cc3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc151260 0x7f0cbc15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cc3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc167400 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cc3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc167280 con 0x7f0ca0004d40 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cc3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc167580 con 0x7f0cbc151260 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cbb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cbc0cf4e0 0x7f0cbc15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cbb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cbc0cf4e0 0x7f0cbc15b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48036/0 (socket says 172.21.15.7:48036) 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cbb400640 1 -- 172.21.15.7:0/402377868 learned_addr learned my addr 172.21.15.7:0/402377868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cc1200640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc151260 0x7f0cbc15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.354+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca0004d40 0x7f0cbc150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cbb400640 1 -- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc151260 msgr2=0x7f0cbc15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cbb400640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc151260 0x7f0cbc15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cbb400640 1 -- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca0004d40 msgr2=0x7f0cbc150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cbb400640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca0004d40 0x7f0cbc150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cbb400640 1 -- 172.21.15.7:0/402377868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc0b6ff0 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cbb400640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cbc0cf4e0 0x7f0cbc15b040 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e820 tx=0x7f0ca800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cb3e00640 1 -- 172.21.15.7:0/402377868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800c870 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cb3e00640 1 -- 172.21.15.7:0/402377868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8018070 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cb3e00640 1 -- 172.21.15.7:0/402377868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800cc10 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cbc155550 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.355+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cbc0b7570 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.357+0000 7f0cb3e00640 1 -- 172.21.15.7:0/402377868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ca801d460 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.358+0000 7f0cb3e00640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c9c06be30 0x7f0c9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.358+0000 7f0cb3e00640 1 -- 172.21.15.7:0/402377868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f0ca808ae00 con 0x7f0cbc0cf4e0 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.358+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c9c06be30 0x7f0c9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.359+0000 7f0cc6241740 1 Processor -- start 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.359+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c9c06be30 0x7f0c9c06e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0035f0 tx=0x7f0cac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.359+0000 7f0cc6241740 1 -- start start 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811ebed890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebeddd0 0x55811ebe2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cc6241740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55811eb02ba0 con 0x55811ebc9f50 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55811ea9b230 con 0x55811ebed470 2024-08-19T00:43:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55811eafeb60 con 0x55811ebeddd0 2024-08-19T00:43:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48044/0 (socket says 172.21.15.7:48044) 2024-08-19T00:43:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cbbe00640 1 -- 172.21.15.7:0/1516976583 learned_addr learned my addr 172.21.15.7:0/1516976583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cc1200640 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebeddd0 0x55811ebe2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cbbe00640 1 -- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebeddd0 msgr2=0x55811ebe2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.360+0000 7f0cbb400640 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811ebed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebeddd0 0x55811ebe2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cbbe00640 1 -- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 msgr2=0x55811ebed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811ebed890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cbbe00640 1 -- 172.21.15.7:0/1516976583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811eaccbb0 con 0x55811ebc9f50 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cc1200640 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebeddd0 0x55811ebe2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cbb400640 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811ebed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebca330 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0cac001a50 tx=0x7f0cac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0817a61473849c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cb0c00640 1 -- 172.21.15.7:0/1516976583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac028070 con 0x55811ebc9f50 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cb0c00640 1 -- 172.21.15.7:0/1516976583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac015cc0 con 0x55811ebc9f50 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.361+0000 7f0cb0c00640 1 -- 172.21.15.7:0/1516976583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0145d0 con 0x55811ebc9f50 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 -- 172.21.15.7:0/1516976583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 msgr2=0x55811ebca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebca330 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0cac001a50 tx=0x7f0cac014000 comp rx=0 tx=0).stop 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 -- 172.21.15.7:0/1516976583 shutdown_connections 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebeddd0 0x55811ebe2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811ebed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 --2- 172.21.15.7:0/1516976583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebca330 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 -- 172.21.15.7:0/1516976583 >> 172.21.15.7:0/1516976583 conn(0x55811eb67110 msgr2=0x55811ebe4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 -- 172.21.15.7:0/1516976583 shutdown_connections 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.362+0000 7f0cc6241740 1 -- 172.21.15.7:0/1516976583 wait complete. 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.363+0000 7f0cc6241740 1 -- start start 2024-08-19T00:43:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.363+0000 7f0cc6241740 1 Processor -- start 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811ebc11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ebc67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc6241740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55811ebe6ea0 con 0x55811ebeddd0 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55811eabe250 con 0x55811ebed470 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55811ebe65b0 con 0x55811ebc9f50 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc6241740 10 client.0 _ll_register_callbacks cb 0x55811eac2740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ebc67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ebc67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48056/0 (socket says 172.21.15.7:48056) 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc1200640 1 -- 172.21.15.7:0/4048266324 learned_addr learned my addr 172.21.15.7:0/4048266324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811ebc11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cbb400640 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc1200640 1 -- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 msgr2=0x55811ebc11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.364+0000 7f0cc1200640 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811ebc11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0cc1200640 1 -- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 msgr2=0x55811eb9b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0cc1200640 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0cc1200640 1 -- 172.21.15.7:0/4048266324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811e8162d0 con 0x55811ebeddd0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0cc1200640 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ebc67a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0cb402fa50 tx=0x7f0cb4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a906c5d556b4f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0ca5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0ca5600640 1 -- 172.21.15.7:0/4048266324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4033040 con 0x55811ebeddd0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cac015cc0 con 0x55811ebeddd0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0ca5600640 1 -- 172.21.15.7:0/4048266324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f0cb4003990 con 0x55811ebeddd0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0ca5600640 1 -- 172.21.15.7:0/4048266324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f0cb404d050 con 0x55811ebeddd0 2024-08-19T00:43:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0cc6241740 10 client.6915 fetch_fsmap learned FSMap version 84 2024-08-19T00:43:33.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.365+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55811e8e06b0 con 0x55811ebeddd0 2024-08-19T00:43:33.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0ca5600640 1 -- 172.21.15.7:0/4048266324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac015cc0 con 0x55811ebeddd0 2024-08-19T00:43:33.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0ca5600640 1 -- 172.21.15.7:0/4048266324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f0cb4050020 con 0x55811ebeddd0 2024-08-19T00:43:33.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0cc6241740 10 client.6915 fetch_fsmap finished waiting for FSMap version 84 2024-08-19T00:43:33.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0cc6241740 10 client.6915 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0cc6241740 20 client.6915 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0cc6241740 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebdf540 0x55811ebdf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0cc6241740 4 client.6915 mds_command: new command op to 6505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 --> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55811eb102d0 con 0x55811ebdf540 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.366+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebdf540 0x55811ebdf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.367+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebdf540 0x55811ebdf920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5583c55ea617c721 server_cookie=834d4f82840b1573 in_seq=0 out_seq=0 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.367+0000 7f0ca5600640 10 client.6915 ms_handle_connect on v2:172.21.15.162:6832/2295549448 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0ca5600640 1 -- 172.21.15.7:0/4048266324 <== mds.0 v2:172.21.15.162:6832/2295549448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55811eb102d0 con 0x55811ebdf540 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0ca5600640 10 client.6915 handle_command_reply: tid=0 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 client.6915 shutdown 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 msgr2=0x55811ebc67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ebc67a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0cb402fa50 tx=0x7f0cb4004ab0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 shutdown_connections 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebdf540 0x55811ebdf920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ebc67a0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 --2- 172.21.15.7:0/4048266324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811ebc11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0ca5600640 0 client.6915 ms_handle_reset on v2:172.21.15.162:6832/2295549448 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 >> 172.21.15.7:0/4048266324 conn(0x55811eb67110 msgr2=0x55811ebe2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 shutdown_connections 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.368+0000 7f0cc6241740 1 -- 172.21.15.7:0/4048266324 wait complete. 2024-08-19T00:43:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.369+0000 7f0cc6241740 20 client.6915 trim_cache size 0 max 16384 2024-08-19T00:43:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 Processor -- start 2024-08-19T00:43:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 -- start start 2024-08-19T00:43:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebdafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebed470 0x55811eba03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebeddd0 0x55811eba0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc1ffee0 con 0x55811ebc9f50 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc1f8850 con 0x55811ebeddd0 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.388+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc15a7e0 con 0x55811ebed470 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebdafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebdafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48062/0 (socket says 172.21.15.7:48062) 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 -- 172.21.15.7:0/2169084997 learned_addr learned my addr 172.21.15.7:0/2169084997 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbb400640 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebed470 0x55811eba03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cc1200640 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebeddd0 0x55811eba0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 -- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebed470 msgr2=0x55811eba03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebed470 0x55811eba03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 -- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebeddd0 msgr2=0x55811eba0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebeddd0 0x55811eba0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 -- 172.21.15.7:0/2169084997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811ebf8280 con 0x55811ebc9f50 2024-08-19T00:43:33.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cc1200640 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebeddd0 0x55811eba0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.389+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebdafd0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0cac004010 tx=0x7f0cac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0e4742e89aa31f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0ca7e00640 1 -- 172.21.15.7:0/2169084997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac028040 con 0x55811ebc9f50 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0ca7e00640 1 -- 172.21.15.7:0/2169084997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac007220 con 0x55811ebc9f50 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0ca7e00640 1 -- 172.21.15.7:0/2169084997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac007610 con 0x55811ebc9f50 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 -- 172.21.15.7:0/2169084997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 msgr2=0x55811ebdafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebdafd0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0cac004010 tx=0x7f0cac016000 comp rx=0 tx=0).stop 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 -- 172.21.15.7:0/2169084997 shutdown_connections 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebeddd0 0x55811eba0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebed470 0x55811eba03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 --2- 172.21.15.7:0/2169084997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebc9f50 0x55811ebdafd0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 -- 172.21.15.7:0/2169084997 >> 172.21.15.7:0/2169084997 conn(0x55811eb67110 msgr2=0x55811eb9e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 -- 172.21.15.7:0/2169084997 shutdown_connections 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.390+0000 7f0cc6241740 1 -- 172.21.15.7:0/2169084997 wait complete. 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.391+0000 7f0cc6241740 1 -- start start 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.391+0000 7f0cc6241740 1 Processor -- start 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811eb9e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc6241740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ec62770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc6241740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55811eb9ee20 con 0x55811ebeddd0 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55811ebf8840 con 0x55811ebed470 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc6241740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55811eb999e0 con 0x55811ebc9f50 2024-08-19T00:43:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc6241740 10 client.0 _ll_register_callbacks cb 0x7f0ca00036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ec62770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ec62770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48078/0 (socket says 172.21.15.7:48078) 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cc1200640 1 -- 172.21.15.7:0/3682803755 learned_addr learned my addr 172.21.15.7:0/3682803755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811eb9e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.392+0000 7f0cbb400640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc1200640 1 -- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 msgr2=0x55811eb9e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811eb9e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc1200640 1 -- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 msgr2=0x55811eb9f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc1200640 1 -- 172.21.15.7:0/3682803755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811ec075e0 con 0x55811ebeddd0 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cbb400640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc1200640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ec62770 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x55811ebdb990 tx=0x7f0cb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d0b29c6dba734a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0ca5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0ca5600640 1 -- 172.21.15.7:0/3682803755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4033030 con 0x55811ebeddd0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0ca5600640 1 -- 172.21.15.7:0/3682803755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f0cb40389f0 con 0x55811ebeddd0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cac007220 con 0x55811ebeddd0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0ca5600640 1 -- 172.21.15.7:0/3682803755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f0cb4038bf0 con 0x55811ebeddd0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc6241740 10 client.6921 fetch_fsmap learned FSMap version 84 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.393+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55811ebc0a60 con 0x55811ebeddd0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0ca5600640 1 -- 172.21.15.7:0/3682803755 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac007220 con 0x55811ebeddd0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0ca5600640 1 -- 172.21.15.7:0/3682803755 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f0cb4050040 con 0x55811ebeddd0 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0cc6241740 10 client.6921 fetch_fsmap finished waiting for FSMap version 84 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0cc6241740 10 client.6921 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-19T00:43:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0cc6241740 20 client.6921 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0cc6241740 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebe8820 0x55811ebddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0cc6241740 4 client.6921 mds_command: new command op to 6505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:43:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 --> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] -- command(tid 0: {"prefix": "status"}) -- 0x55811eb0a620 con 0x55811ebe8820 2024-08-19T00:43:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.394+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebe8820 0x55811ebddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cbbe00640 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebe8820 0x55811ebddbf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee8422c610012607 server_cookie=39f6d61010e4cf61 in_seq=0 out_seq=0 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0ca5600640 10 client.6921 ms_handle_connect on v2:172.21.15.162:6832/2295549448 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0ca5600640 1 -- 172.21.15.7:0/3682803755 <== mds.0 v2:172.21.15.162:6832/2295549448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55811eb0a620 con 0x55811ebe8820 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0ca5600640 10 client.6921 handle_command_reply: tid=0 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 client.6921 shutdown 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 msgr2=0x55811ec62770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ec62770 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x55811ebdb990 tx=0x7f0cb400b040 comp rx=0 tx=0).stop 2024-08-19T00:43:33.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 shutdown_connections 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:6832/2295549448,v1:172.21.15.162:6835/2295549448] conn(0x55811ebe8820 0x55811ebddbf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55811ebeddd0 0x55811ec62770 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811ebed470 0x55811eb9f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 --2- 172.21.15.7:0/3682803755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55811ebc9f50 0x55811eb9e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0ca5600640 0 client.6921 ms_handle_reset on v2:172.21.15.162:6832/2295549448 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.395+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 >> 172.21.15.7:0/3682803755 conn(0x55811eb67110 msgr2=0x55811eb9b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 shutdown_connections 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc6241740 1 -- 172.21.15.7:0/3682803755 wait complete. 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc6241740 20 client.6921 trim_cache size 0 max 16384 2024-08-19T00:43:33.403 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6505, 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.1673031460000001, 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 84, 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 86, 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.854773133 2024-08-19T00:43:33.404 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:43:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c9c06be30 msgr2=0x7f0c9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c9c06be30 0x7f0c9c06e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0035f0 tx=0x7f0cac009040 comp rx=0 tx=0).stop 2024-08-19T00:43:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cbc0cf4e0 msgr2=0x7f0cbc15b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cbc0cf4e0 0x7f0cbc15b040 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e820 tx=0x7f0ca800ece0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 shutdown_connections 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c9c06be30 0x7f0c9c06e2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cbc151260 0x7f0cbc15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cbc0cf4e0 0x7f0cbc15b040 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 --2- 172.21.15.7:0/402377868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ca0004d40 0x7f0cbc150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.396+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 >> 172.21.15.7:0/402377868 conn(0x7f0cbc0d2190 msgr2=0x7f0cbc06e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.397+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 shutdown_connections 2024-08-19T00:43:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.397+0000 7f0cc3200640 1 -- 172.21.15.7:0/402377868 wait complete. 2024-08-19T00:43:33.414 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:43:33.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.568+0000 7fd389800640 1 Processor -- start 2024-08-19T00:43:33.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.568+0000 7fd389800640 1 -- start start 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.569+0000 7fd389800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd3840cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.569+0000 7fd389800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd3840cf9c0 0x7fd3840b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.569+0000 7fd389800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3840d28c0 con 0x7fd384161960 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.569+0000 7fd389800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd3840b7150 con 0x7fd3840cf9c0 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.569+0000 7fd389800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd3840d2ba0 con 0x7fd3840d1920 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.569+0000 7fd383e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd384161960 0x7fd3840ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53428/0 (socket says 172.21.15.7:53428) 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.569+0000 7fd383e00640 1 -- 172.21.15.7:0/1282179564 learned_addr learned my addr 172.21.15.7:0/1282179564 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd388e00640 1 --2- 172.21.15.7:0/1282179564 >> v2:172.21.15.162:3300/0 conn(0x7fd3840cf9c0 0x7fd3840b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd383400640 1 --2- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd3840cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd382a00640 1 -- 172.21.15.7:0/1282179564 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081997907 0 0) 0x7fd3840d28c0 con 0x7fd384161960 2024-08-19T00:43:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd382a00640 1 -- 172.21.15.7:0/1282179564 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd368003520 con 0x7fd384161960 2024-08-19T00:43:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd388e00640 1 -- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 msgr2=0x7fd3840cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd388e00640 1 --2- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd3840cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd388e00640 1 -- 172.21.15.7:0/1282179564 >> v1:172.21.15.7:6789/0 conn(0x7fd384161960 legacy=0x7fd3840ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.570+0000 7fd388e00640 1 -- 172.21.15.7:0/1282179564 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3840d2e80 con 0x7fd3840cf9c0 2024-08-19T00:43:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.572+0000 7fd388e00640 1 --2- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 0x7fd3840b75e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009d90 tx=0x7fd37c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7604d7dc981b04e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.572+0000 7fd382a00640 1 -- 172.21.15.7:0/1282179564 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c007740 con 0x7fd3840cf9c0 2024-08-19T00:43:33.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.572+0000 7fd382a00640 1 -- 172.21.15.7:0/1282179564 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c0078e0 con 0x7fd3840cf9c0 2024-08-19T00:43:33.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.572+0000 7fd382a00640 1 -- 172.21.15.7:0/1282179564 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c007cb0 con 0x7fd3840cf9c0 2024-08-19T00:43:33.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 -- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 msgr2=0x7fd3840b75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 --2- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 0x7fd3840b75e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009d90 tx=0x7fd37c02a6f0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 -- 172.21.15.7:0/1282179564 shutdown_connections 2024-08-19T00:43:33.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 --2- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 0x7fd3840b75e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 --2- 172.21.15.7:0/1282179564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd3840cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 -- 172.21.15.7:0/1282179564 >> 172.21.15.7:0/1282179564 conn(0x7fd38409d500 msgr2=0x7fd3840d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 -- 172.21.15.7:0/1282179564 shutdown_connections 2024-08-19T00:43:33.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.573+0000 7fd389800640 1 -- 172.21.15.7:0/1282179564 wait complete. 2024-08-19T00:43:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.574+0000 7fd389800640 1 Processor -- start 2024-08-19T00:43:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.575+0000 7fd389800640 1 -- start start 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.575+0000 7fd389800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 0x7fd38415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.575+0000 7fd389800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd38415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.575+0000 7fd389800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384161960 0x7fd38415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd389800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3840d4e30 con 0x7fd384161960 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd389800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd3840d4cb0 con 0x7fd3840cf9c0 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd389800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd384161d40 con 0x7fd3840d1920 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384161960 0x7fd38415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384161960 0x7fd38415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48086/0 (socket says 172.21.15.7:48086) 2024-08-19T00:43:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 -- 172.21.15.7:0/2269668129 learned_addr learned my addr 172.21.15.7:0/2269668129 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd383400640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd38415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd383e00640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 0x7fd38415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 -- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 msgr2=0x7fd38415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd38415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 -- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 msgr2=0x7fd38415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 0x7fd38415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.576+0000 7fd388e00640 1 -- 172.21.15.7:0/2269668129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38415d960 con 0x7fd384161960 2024-08-19T00:43:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.577+0000 7fd388e00640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384161960 0x7fd38415cba0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009eb0 tx=0x7fd37c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.577+0000 7fd37be00640 1 -- 172.21.15.7:0/2269668129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c040070 con 0x7fd384161960 2024-08-19T00:43:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.577+0000 7fd37be00640 1 -- 172.21.15.7:0/2269668129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c031bc0 con 0x7fd384161960 2024-08-19T00:43:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.577+0000 7fd37be00640 1 -- 172.21.15.7:0/2269668129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c009450 con 0x7fd384161960 2024-08-19T00:43:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.577+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38415dc40 con 0x7fd384161960 2024-08-19T00:43:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.577+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3840cbb30 con 0x7fd384161960 2024-08-19T00:43:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.578+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3840d28c0 con 0x7fd384161960 2024-08-19T00:43:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.579+0000 7fd37be00640 1 -- 172.21.15.7:0/2269668129 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd37c039040 con 0x7fd384161960 2024-08-19T00:43:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.580+0000 7fd37be00640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd36406be30 0x7fd36406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.580+0000 7fd37be00640 1 -- 172.21.15.7:0/2269668129 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7fd37c0ac5c0 con 0x7fd384161960 2024-08-19T00:43:33.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.580+0000 7fd383e00640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd36406be30 0x7fd36406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:33.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.581+0000 7fd383e00640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd36406be30 0x7fd36406e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd374005880 tx=0x7fd374009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:33.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.585+0000 7fd37be00640 1 -- 172.21.15.7:0/2269668129 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd37c07a9a0 con 0x7fd384161960 2024-08-19T00:43:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.804+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd3840b76f0 con 0x7fd384161960 2024-08-19T00:43:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.804+0000 7fd37be00640 1 -- 172.21.15.7:0/2269668129 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7fd37c07eca0 con 0x7fd384161960 2024-08-19T00:43:33.807 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:43:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.806+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd36406be30 msgr2=0x7fd36406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.806+0000 7fd389800640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd36406be30 0x7fd36406e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd374005880 tx=0x7fd374009040 comp rx=0 tx=0).stop 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.806+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384161960 msgr2=0x7fd38415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.806+0000 7fd389800640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384161960 0x7fd38415cba0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009eb0 tx=0x7fd37c004a40 comp rx=0 tx=0).stop 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.806+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 shutdown_connections 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.807+0000 7fd389800640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd36406be30 0x7fd36406e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.807+0000 7fd389800640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384161960 0x7fd38415cba0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.807+0000 7fd389800640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3840d1920 0x7fd38415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.807+0000 7fd389800640 1 --2- 172.21.15.7:0/2269668129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3840cf9c0 0x7fd38415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.807+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 >> 172.21.15.7:0/2269668129 conn(0x7fd38409d500 msgr2=0x7fd3840b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.807+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 shutdown_connections 2024-08-19T00:43:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:33.807+0000 7fd389800640 1 -- 172.21.15.7:0/2269668129 wait complete. 2024-08-19T00:43:33.826 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:43:33.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:43:33.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:43:33.826 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:43:33.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:33.826 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:43:33.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:43:33.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:43:33.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:43:33.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:33.827 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:43:33.863 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:43:33.864 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:43:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:33.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:33.867 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:43:33.957 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:43:33.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:33.960 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:43:33.996 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:43:33.997 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:43:33.997 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:43:33.997 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:43:33.997 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:43:33.997 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:43:33.997 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:43:33.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:43:33.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:43:33.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:43:33.997 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:43:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:43:34.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:43:34.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:34.194 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:43:34.230 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:43:34.230 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:43:34.230 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:43:34.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:34.230 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:43:34.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:43:34.327 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:34.364 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:43:34.365 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:43:34.365 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:34.439 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:43:34.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:34.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:34.568 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:34.568 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:43:34.568 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:43:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:43:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:43:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:43:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:43:34.606 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:34.606 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:43:34.606 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:43:34.607 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:43:34.607 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:43:34.607 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:43:34.607 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:43:34.607 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:43:34.608 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:43:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:43:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:43:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:43:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:43:34.611 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:43:34.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:34.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:34.668 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:43:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:43:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:43:34.768 INFO:teuthology.orchestra.run.smithi007.stdout:client6930 2024-08-19T00:43:34.769 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:34.769 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:34.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:34.805 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-08-19T00:43:34.888 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:34.888 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:34.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:34.964 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-08-19T00:43:35.133 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records in 2024-08-19T00:43:35.133 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records out 2024-08-19T00:43:35.133 INFO:teuthology.orchestra.run.smithi007.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.091602 s, 68.7 MB/s 2024-08-19T00:43:35.134 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> import json 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(e.errno) 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> print(json.dumps( 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-19T00:43:35.135 DEBUG:teuthology.orchestra.run.smithi007:> indent=2)) 2024-08-19T00:43:35.136 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_mode": 33188, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_ino": 1099511627777, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_dev": 42, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_nlink": 1, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_uid": 1000, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_gid": 1333, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_size": 6291456, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_atime": 1724028215.0379493, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_mtime": 1724028215.0739486, 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout: "st_ctime": 1724028215.0739486 2024-08-19T00:43:35.239 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:43:35.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:43:35.251 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:35.251 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:35.327 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:35.328 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:35.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:43:35.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.600+0000 7fa788a00640 1 Processor -- start 2024-08-19T00:43:35.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.600+0000 7fa788a00640 1 -- start start 2024-08-19T00:43:35.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa788a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa784159bf0 0x7fa784073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:35.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa788a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840739a0 0x7fa7840ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:35.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa788a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78406f7f0 con 0x7fa7840cea40 2024-08-19T00:43:35.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa788a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa78406f510 con 0x7fa784159bf0 2024-08-19T00:43:35.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa788a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa784072980 con 0x7fa7840739a0 2024-08-19T00:43:35.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa781e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa784159bf0 0x7fa784073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:35.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa77be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840739a0 0x7fa7840ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:35.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa781e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa784159bf0 0x7fa784073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:36488/0 (socket says 172.21.15.7:36488) 2024-08-19T00:43:35.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa781e00640 1 -- 172.21.15.7:0/570843157 learned_addr learned my addr 172.21.15.7:0/570843157 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:35.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.601+0000 7fa77be00640 1 --2- 172.21.15.7:0/570843157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840739a0 0x7fa7840ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:49996/0 (socket says 172.21.15.7:49996) 2024-08-19T00:43:35.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.602+0000 7fa77be00640 1 -- 172.21.15.7:0/570843157 >> v2:172.21.15.162:3300/0 conn(0x7fa784159bf0 msgr2=0x7fa784073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:35.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.602+0000 7fa77be00640 1 --2- 172.21.15.7:0/570843157 >> v2:172.21.15.162:3300/0 conn(0x7fa784159bf0 0x7fa784073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.602+0000 7fa77be00640 1 -- 172.21.15.7:0/570843157 >> v1:172.21.15.162:6789/0 conn(0x7fa7840cea40 legacy=0x7fa7840d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:35.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.602+0000 7fa77be00640 1 -- 172.21.15.7:0/570843157 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa784072c60 con 0x7fa7840739a0 2024-08-19T00:43:35.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.602+0000 7fa781e00640 1 --2- 172.21.15.7:0/570843157 >> v2:172.21.15.162:3300/0 conn(0x7fa784159bf0 0x7fa784073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:35.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.603+0000 7fa77be00640 1 --2- 172.21.15.7:0/570843157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840739a0 0x7fa7840ce500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097a0 tx=0x7fa76c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f2b5904b132e80 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:35.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.603+0000 7fa781400640 1 -- 172.21.15.7:0/570843157 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c037070 con 0x7fa7840739a0 2024-08-19T00:43:35.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.603+0000 7fa781400640 1 -- 172.21.15.7:0/570843157 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76c02ae40 con 0x7fa7840739a0 2024-08-19T00:43:35.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.603+0000 7fa781400640 1 -- 172.21.15.7:0/570843157 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c032660 con 0x7fa7840739a0 2024-08-19T00:43:35.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 -- 172.21.15.7:0/570843157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840739a0 msgr2=0x7fa7840ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:35.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 --2- 172.21.15.7:0/570843157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840739a0 0x7fa7840ce500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097a0 tx=0x7fa76c02a0f0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 -- 172.21.15.7:0/570843157 shutdown_connections 2024-08-19T00:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 --2- 172.21.15.7:0/570843157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840739a0 0x7fa7840ce500 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 --2- 172.21.15.7:0/570843157 >> v2:172.21.15.162:3300/0 conn(0x7fa784159bf0 0x7fa784073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 -- 172.21.15.7:0/570843157 >> 172.21.15.7:0/570843157 conn(0x7fa78406bc70 msgr2=0x7fa78406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 -- 172.21.15.7:0/570843157 shutdown_connections 2024-08-19T00:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.604+0000 7fa788a00640 1 -- 172.21.15.7:0/570843157 wait complete. 2024-08-19T00:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.606+0000 7fa788a00640 1 Processor -- start 2024-08-19T00:43:35.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.606+0000 7fa788a00640 1 -- start start 2024-08-19T00:43:35.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa788a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7840739a0 0x7fa7841f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:35.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa788a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840cea40 0x7fa7840b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:35.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa788a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa784159bf0 0x7fa7840b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:35.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa788a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa78415a150 con 0x7fa7840739a0 2024-08-19T00:43:35.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa788a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa784159fd0 con 0x7fa784159bf0 2024-08-19T00:43:35.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa788a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7840d0ad0 con 0x7fa7840cea40 2024-08-19T00:43:35.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7840739a0 0x7fa7841f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7840739a0 0x7fa7841f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39796/0 (socket says 172.21.15.7:39796) 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 -- 172.21.15.7:0/1696057518 learned_addr learned my addr 172.21.15.7:0/1696057518 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa77be00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840cea40 0x7fa7840b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa782800640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa784159bf0 0x7fa7840b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 -- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840cea40 msgr2=0x7fa7840b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840cea40 0x7fa7840b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 -- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa784159bf0 msgr2=0x7fa7840b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa784159bf0 0x7fa7840b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.607+0000 7fa781e00640 1 -- 172.21.15.7:0/1696057518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78414bf10 con 0x7fa7840739a0 2024-08-19T00:43:35.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.608+0000 7fa781e00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7840739a0 0x7fa7841f34b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa77400ea00 tx=0x7fa77400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:35.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.608+0000 7fa77a000640 1 -- 172.21.15.7:0/1696057518 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774017070 con 0x7fa7840739a0 2024-08-19T00:43:35.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.608+0000 7fa77a000640 1 -- 172.21.15.7:0/1696057518 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77400ca60 con 0x7fa7840739a0 2024-08-19T00:43:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.608+0000 7fa77a000640 1 -- 172.21.15.7:0/1696057518 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77400ce10 con 0x7fa7840739a0 2024-08-19T00:43:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.608+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7841f3e20 con 0x7fa7840739a0 2024-08-19T00:43:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.609+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7841f43e0 con 0x7fa7840739a0 2024-08-19T00:43:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.610+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7840ce500 con 0x7fa7840739a0 2024-08-19T00:43:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.611+0000 7fa77a000640 1 -- 172.21.15.7:0/1696057518 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa77401a070 con 0x7fa7840739a0 2024-08-19T00:43:35.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.612+0000 7fa77a000640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa76006be30 0x7fa76006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:35.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.612+0000 7fa77a000640 1 -- 172.21.15.7:0/1696057518 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7fa77408b220 con 0x7fa7840739a0 2024-08-19T00:43:35.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.612+0000 7fa77be00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa76006be30 0x7fa76006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:35.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.613+0000 7fa77be00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa76006be30 0x7fa76006e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa76c034000 tx=0x7fa76c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:35.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.616+0000 7fa77a000640 1 -- 172.21.15.7:0/1696057518 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa774059b30 con 0x7fa7840739a0 2024-08-19T00:43:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.814+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa78406c980 con 0x7fa7840739a0 2024-08-19T00:43:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.814+0000 7fa77a000640 1 -- 172.21.15.7:0/1696057518 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7fa774059430 con 0x7fa7840739a0 2024-08-19T00:43:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa76006be30 msgr2=0x7fa76006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa76006be30 0x7fa76006e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa76c034000 tx=0x7fa76c02e000 comp rx=0 tx=0).stop 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7840739a0 msgr2=0x7fa7841f34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7840739a0 0x7fa7841f34b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa77400ea00 tx=0x7fa77400eec0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 shutdown_connections 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa76006be30 0x7fa76006e2f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa784159bf0 0x7fa7840b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7840cea40 0x7fa7840b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 --2- 172.21.15.7:0/1696057518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7840739a0 0x7fa7841f34b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 >> 172.21.15.7:0/1696057518 conn(0x7fa78406bc70 msgr2=0x7fa78415e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 shutdown_connections 2024-08-19T00:43:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:35.817+0000 7fa788a00640 1 -- 172.21.15.7:0/1696057518 wait complete. 2024-08-19T00:43:35.835 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:43:35.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:35.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:35.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:43:35.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:35.942 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:43:35.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.178+0000 7f27e3000640 1 Processor -- start 2024-08-19T00:43:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.178+0000 7f27e3000640 1 -- start start 2024-08-19T00:43:36.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e3000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f27dc15e360 0x7f27dc15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e3000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e3000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27dc0b3ab0 con 0x7f27dc0d2af0 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e3000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f27dc15f460 con 0x7f27dc15e360 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e3000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc15f740 con 0x7f27dc15ee50 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e1c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f27dc15e360 0x7f27dc15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e1200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f27dc0d2af0 0x7f27dc15e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50596/0 (socket says 172.21.15.7:50596) 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e1200640 1 -- 172.21.15.7:0/1028110997 learned_addr learned my addr 172.21.15.7:0/1028110997 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.179+0000 7f27e1c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f27dc15e360 0x7f27dc15fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39812/0 (socket says 172.21.15.7:39812) 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.180+0000 7f27e2600640 1 --2- 172.21.15.7:0/1028110997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.180+0000 7f27e1c00640 1 -- 172.21.15.7:0/1028110997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 msgr2=0x7f27dc0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.180+0000 7f27e1c00640 1 --2- 172.21.15.7:0/1028110997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc0d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.180+0000 7f27e1c00640 1 -- 172.21.15.7:0/1028110997 >> v1:172.21.15.7:6789/0 conn(0x7f27dc0d2af0 legacy=0x7f27dc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.180+0000 7f27e1c00640 1 -- 172.21.15.7:0/1028110997 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc0b3d60 con 0x7f27dc15e360 2024-08-19T00:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.180+0000 7f27e2600640 1 --2- 172.21.15.7:0/1028110997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.181+0000 7f27e1c00640 1 --2- 172.21.15.7:0/1028110997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc15fab0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f27d00097a0 tx=0x7f27d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec149378c5aa9a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.181+0000 7f27dbe00640 1 -- 172.21.15.7:0/1028110997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0037070 con 0x7f27dc15e360 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.181+0000 7f27dbe00640 1 -- 172.21.15.7:0/1028110997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d0032440 con 0x7f27dc15e360 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.181+0000 7f27dbe00640 1 -- 172.21.15.7:0/1028110997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0032810 con 0x7f27dc15e360 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 -- 172.21.15.7:0/1028110997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 msgr2=0x7f27dc15fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 --2- 172.21.15.7:0/1028110997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc15fab0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f27d00097a0 tx=0x7f27d002a180 comp rx=0 tx=0).stop 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 -- 172.21.15.7:0/1028110997 shutdown_connections 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 --2- 172.21.15.7:0/1028110997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 --2- 172.21.15.7:0/1028110997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc15fab0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 -- 172.21.15.7:0/1028110997 >> 172.21.15.7:0/1028110997 conn(0x7f27dc08dbf0 msgr2=0x7f27dc09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:36.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 -- 172.21.15.7:0/1028110997 shutdown_connections 2024-08-19T00:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.182+0000 7f27e3000640 1 -- 172.21.15.7:0/1028110997 wait complete. 2024-08-19T00:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.183+0000 7f27e3000640 1 Processor -- start 2024-08-19T00:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.184+0000 7f27e3000640 1 -- start start 2024-08-19T00:43:36.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.184+0000 7f27e3000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27dc0d2af0 0x7f27dc0cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.184+0000 7f27e3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc0b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.184+0000 7f27e3000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc0b4560 con 0x7f27dc15e360 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e3000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc0d2300 con 0x7f27dc0d2af0 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e3000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc0b46e0 con 0x7f27dc15ee50 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc0b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc0b9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39818/0 (socket says 172.21.15.7:39818) 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 -- 172.21.15.7:0/3450598005 learned_addr learned my addr 172.21.15.7:0/3450598005 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1c00640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27dc0d2af0 0x7f27dc0cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e2600640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 -- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 msgr2=0x7f27dc15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc15d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 -- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27dc0d2af0 msgr2=0x7f27dc0cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27dc0d2af0 0x7f27dc0cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.185+0000 7f27e1200640 1 -- 172.21.15.7:0/3450598005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc15d6e0 con 0x7f27dc15e360 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.186+0000 7f27e1200640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc0b9bf0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f27c800c400 tx=0x7f27c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.186+0000 7f27d9600640 1 -- 172.21.15.7:0/3450598005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8017070 con 0x7f27dc15e360 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.186+0000 7f27d9600640 1 -- 172.21.15.7:0/3450598005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c8005ce0 con 0x7f27dc15e360 2024-08-19T00:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.186+0000 7f27d9600640 1 -- 172.21.15.7:0/3450598005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c80072f0 con 0x7f27dc15e360 2024-08-19T00:43:36.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.186+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27dc0ccab0 con 0x7f27dc15e360 2024-08-19T00:43:36.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.186+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27dc0cd070 con 0x7f27dc15e360 2024-08-19T00:43:36.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.187+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27dc15fab0 con 0x7f27dc15e360 2024-08-19T00:43:36.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.188+0000 7f27d9600640 1 -- 172.21.15.7:0/3450598005 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27c801a070 con 0x7f27dc15e360 2024-08-19T00:43:36.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.189+0000 7f27d9600640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f27bc06be30 0x7f27bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.189+0000 7f27d9600640 1 -- 172.21.15.7:0/3450598005 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f27c808a260 con 0x7f27dc15e360 2024-08-19T00:43:36.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.189+0000 7f27e1c00640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f27bc06be30 0x7f27bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.190+0000 7f27e1c00640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f27bc06be30 0x7f27bc06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f27d0034000 tx=0x7f27d002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:36.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.193+0000 7f27d9600640 1 -- 172.21.15.7:0/3450598005 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f27c8058520 con 0x7f27dc15e360 2024-08-19T00:43:36.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.417+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27dc0d50d0 con 0x7f27dc15e360 2024-08-19T00:43:36.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.417+0000 7f27d9600640 1 -- 172.21.15.7:0/3450598005 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5225 (secure 0 0 0) 0x7f27c805c820 con 0x7f27dc15e360 2024-08-19T00:43:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:36.420 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":84,"btime":"2024-08-19T00:43:30:255297+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3482189423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3482189423},{"type":"v1","addr":"172.21.15.162:6834","nonce":3482189423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:29.678316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6835/2295549448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2295549448},{"type":"v1","addr":"172.21.15.162:6835","nonce":2295549448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6505,"qdb_cluster":[6505]},"id":6}]} 2024-08-19T00:43:36.420 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 84 2024-08-19T00:43:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f27bc06be30 msgr2=0x7f27bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f27bc06be30 0x7f27bc06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f27d0034000 tx=0x7f27d002e000 comp rx=0 tx=0).stop 2024-08-19T00:43:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 msgr2=0x7f27dc0b9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc0b9bf0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f27c800c400 tx=0x7f27c800c8c0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 shutdown_connections 2024-08-19T00:43:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f27bc06be30 0x7f27bc06e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27dc15ee50 0x7f27dc15d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27dc15e360 0x7f27dc0b9bf0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 --2- 172.21.15.7:0/3450598005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27dc0d2af0 0x7f27dc0cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.419+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 >> 172.21.15.7:0/3450598005 conn(0x7f27dc08dbf0 msgr2=0x7f27dc161070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.420+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 shutdown_connections 2024-08-19T00:43:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.420+0000 7f27e3000640 1 -- 172.21.15.7:0/3450598005 wait complete. 2024-08-19T00:43:36.442 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-08-19T00:43:36.635 INFO:teuthology.orchestra.run.smithi162.stdout:{"message":"","return_code":0} 2024-08-19T00:43:36.635 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-19T00:43:36.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:43:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.791+0000 7f1eeac00640 1 Processor -- start 2024-08-19T00:43:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.792+0000 7f1eeac00640 1 -- start start 2024-08-19T00:43:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1eeac00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1ee40ce500 0x7f1ee40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1eeac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee406f7f0 con 0x7f1ee40d03c0 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1eeac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee406f510 con 0x7f1ee4159bf0 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1eeac00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee4072980 con 0x7f1ee40ce500 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1edbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1ee40ce500 0x7f1ee40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1ee8c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1ee40d03c0 0x7f1ee406e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50608/0 (socket says 172.21.15.7:50608) 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1ee8c00640 1 -- 172.21.15.7:0/2362214870 learned_addr learned my addr 172.21.15.7:0/2362214870 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1edbe00640 1 -- 172.21.15.7:0/2362214870 >> v1:172.21.15.162:6789/0 conn(0x7f1ee4159bf0 legacy=0x7f1ee4073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1edbe00640 1 -- 172.21.15.7:0/2362214870 >> v1:172.21.15.7:6789/0 conn(0x7f1ee40d03c0 legacy=0x7f1ee406e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.793+0000 7f1edbe00640 1 -- 172.21.15.7:0/2362214870 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee4072c60 con 0x7f1ee40ce500 2024-08-19T00:43:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.794+0000 7f1edbe00640 1 --2- 172.21.15.7:0/2362214870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee40ce970 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0097a0 tx=0x7f1ecc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dd0f703cd01fc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1ee3400640 1 -- 172.21.15.7:0/2362214870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc037070 con 0x7f1ee40ce500 2024-08-19T00:43:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1ee3400640 1 -- 172.21.15.7:0/2362214870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc032440 con 0x7f1ee40ce500 2024-08-19T00:43:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1ee3400640 1 -- 172.21.15.7:0/2362214870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc032810 con 0x7f1ee40ce500 2024-08-19T00:43:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1eeac00640 1 -- 172.21.15.7:0/2362214870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 msgr2=0x7f1ee40ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1eeac00640 1 --2- 172.21.15.7:0/2362214870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee40ce970 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0097a0 tx=0x7f1ecc02a1a0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1eeac00640 1 -- 172.21.15.7:0/2362214870 shutdown_connections 2024-08-19T00:43:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1eeac00640 1 --2- 172.21.15.7:0/2362214870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee40ce970 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.795+0000 7f1eeac00640 1 -- 172.21.15.7:0/2362214870 >> 172.21.15.7:0/2362214870 conn(0x7f1ee406bc70 msgr2=0x7f1ee406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.796+0000 7f1eeac00640 1 -- 172.21.15.7:0/2362214870 shutdown_connections 2024-08-19T00:43:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.796+0000 7f1eeac00640 1 -- 172.21.15.7:0/2362214870 wait complete. 2024-08-19T00:43:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.797+0000 7f1eeac00640 1 Processor -- start 2024-08-19T00:43:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.797+0000 7f1eeac00640 1 -- start start 2024-08-19T00:43:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.798+0000 7f1eeac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.798+0000 7f1eeac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ee40d03c0 0x7f1ee409a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.798+0000 7f1eeac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ee4159bf0 0x7f1ee4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.798+0000 7f1eeac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4159fd0 con 0x7f1ee40ce500 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.798+0000 7f1eeac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4073b70 con 0x7f1ee40d03c0 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.798+0000 7f1eeac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee415a150 con 0x7f1ee4159bf0 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee414a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39836/0 (socket says 172.21.15.7:39836) 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 -- 172.21.15.7:0/873202496 learned_addr learned my addr 172.21.15.7:0/873202496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1edbe00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ee40d03c0 0x7f1ee409a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee8c00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ee4159bf0 0x7f1ee4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 -- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ee4159bf0 msgr2=0x7f1ee4153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ee4159bf0 0x7f1ee4153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 -- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ee40d03c0 msgr2=0x7f1ee409a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ee40d03c0 0x7f1ee409a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 -- 172.21.15.7:0/873202496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee4154490 con 0x7f1ee40ce500 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1edbe00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ee40d03c0 0x7f1ee409a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee8c00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ee4159bf0 0x7f1ee4153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.799+0000 7f1ee3e00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee414a570 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400c430 tx=0x7f1ed400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.800+0000 7f1ee0c00640 1 -- 172.21.15.7:0/873202496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40052d0 con 0x7f1ee40ce500 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.800+0000 7f1ee0c00640 1 -- 172.21.15.7:0/873202496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed4005490 con 0x7f1ee40ce500 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.800+0000 7f1ee0c00640 1 -- 172.21.15.7:0/873202496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4007260 con 0x7f1ee40ce500 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.800+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee4154770 con 0x7f1ee40ce500 2024-08-19T00:43:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.800+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee4154d30 con 0x7f1ee40ce500 2024-08-19T00:43:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.801+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee40ce970 con 0x7f1ee40ce500 2024-08-19T00:43:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.802+0000 7f1ee0c00640 1 -- 172.21.15.7:0/873202496 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ed4007400 con 0x7f1ee40ce500 2024-08-19T00:43:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.803+0000 7f1ee0c00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ec006be30 0x7f1ec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.803+0000 7f1ee0c00640 1 -- 172.21.15.7:0/873202496 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f1ed408a390 con 0x7f1ee40ce500 2024-08-19T00:43:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.803+0000 7f1edbe00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ec006be30 0x7f1ec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:36.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.804+0000 7f1edbe00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ec006be30 0x7f1ec006e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc034000 tx=0x7f1ecc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:36.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:36.807+0000 7f1ee0c00640 1 -- 172.21.15.7:0/873202496 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1ed4058d30 con 0x7f1ee40ce500 2024-08-19T00:43:37.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.026+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1ee40b1c10 con 0x7f1ee40ce500 2024-08-19T00:43:37.029 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:43:37.027+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:43:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.029+0000 7f1ee0c00640 1 -- 172.21.15.7:0/873202496 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) ==== 161+0+0 (secure 0 0 0) 0x7f1ed4058630 con 0x7f1ee40ce500 2024-08-19T00:43:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.032+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ec006be30 msgr2=0x7f1ec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.032+0000 7f1eeac00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ec006be30 0x7f1ec006e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc034000 tx=0x7f1ecc02e000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.032+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 msgr2=0x7f1ee414a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.032+0000 7f1eeac00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee414a570 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400c430 tx=0x7f1ed400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 shutdown_connections 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ec006be30 0x7f1ec006e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ee4159bf0 0x7f1ee4153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ee40d03c0 0x7f1ee409a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 --2- 172.21.15.7:0/873202496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ee40ce500 0x7f1ee414a570 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 >> 172.21.15.7:0/873202496 conn(0x7f1ee406bc70 msgr2=0x7f1ee406c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 shutdown_connections 2024-08-19T00:43:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.033+0000 7f1eeac00640 1 -- 172.21.15.7:0/873202496 wait complete. 2024-08-19T00:43:37.042 INFO:tasks.ceph.mds.d.smithi162.stderr: -4438> 2024-08-19T00:43:29.211+0000 7fc3fe600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:43:37.052 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata export - 2024-08-19T00:43:37.091 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:43:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.126+0000 7f351d0f2f40 1 Processor -- start 2024-08-19T00:43:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.126+0000 7f351d0f2f40 1 -- start start 2024-08-19T00:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351d0f2f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d35b0 0x55796f26be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351d0f2f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d3990 0x55796f18e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351d0f2f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351d0f2f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55796f2790a0 con 0x55796f1eb8d0 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351d0f2f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55796f278dc0 con 0x55796f1d3990 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351d0f2f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55796f279380 con 0x55796f1d35b0 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39856/0 (socket says 172.21.15.7:39856) 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351ac00640 1 -- 172.21.15.7:0/3155190058 learned_addr learned my addr 172.21.15.7:0/3155190058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f3519800640 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d3990 0x55796f18e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.127+0000 7f351a200640 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d35b0 0x55796f26be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f351ac00640 1 -- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d35b0 msgr2=0x55796f26be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f351ac00640 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d35b0 0x55796f26be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f351ac00640 1 -- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d3990 msgr2=0x55796f18e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f351ac00640 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d3990 0x55796f18e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f351ac00640 1 -- 172.21.15.7:0/3155190058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796f0d6130 con 0x55796f1eb8d0 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f351ac00640 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26abe0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f351400b720 tx=0x7f351400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213737245b2e01c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f3513e00640 1 -- 172.21.15.7:0/3155190058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514016020 con 0x55796f1eb8d0 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f3513e00640 1 -- 172.21.15.7:0/3155190058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351400d7b0 con 0x55796f1eb8d0 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.128+0000 7f3513e00640 1 -- 172.21.15.7:0/3155190058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351400dba0 con 0x55796f1eb8d0 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 -- 172.21.15.7:0/3155190058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 msgr2=0x55796f26abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26abe0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f351400b720 tx=0x7f351400bbe0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 -- 172.21.15.7:0/3155190058 shutdown_connections 2024-08-19T00:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26abe0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d3990 0x55796f18e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/3155190058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d35b0 0x55796f26be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 -- 172.21.15.7:0/3155190058 >> 172.21.15.7:0/3155190058 conn(0x55796f1d04e0 msgr2=0x55796f1a0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 -- 172.21.15.7:0/3155190058 shutdown_connections 2024-08-19T00:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 -- 172.21.15.7:0/3155190058 wait complete. 2024-08-19T00:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.129+0000 7f351d0f2f40 1 Processor -- start 2024-08-19T00:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.130+0000 7f351d0f2f40 1 -- start start 2024-08-19T00:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.130+0000 7f351d0f2f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d35b0 0x55796f2673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.130+0000 7f351d0f2f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d3990 0x55796f26d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.130+0000 7f351d0f2f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351d0f2f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55796f26fe00 con 0x55796f1eb8d0 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351d0f2f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55796f1ce8f0 con 0x55796f1d35b0 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351d0f2f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55796f1ceb40 con 0x55796f1d3990 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d35b0 0x55796f2673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d35b0 0x55796f2673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:36532/0 (socket says 172.21.15.7:36532) 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 learned_addr learned my addr 172.21.15.7:0/2731535687 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d3990 0x55796f26d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d3990 msgr2=0x55796f26d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55796f1d3990 0x55796f26d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 msgr2=0x55796f26d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55796f1eb8d0 0x55796f26d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.131+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796f0ccb30 con 0x55796f1d35b0 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.132+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d35b0 0x55796f2673b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f350c005400 tx=0x7f350c0087d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.132+0000 7f3512a00640 1 -- 172.21.15.7:0/2731535687 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c019020 con 0x55796f1d35b0 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.132+0000 7f3512a00640 1 -- 172.21.15.7:0/2731535687 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c015880 con 0x55796f1d35b0 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.132+0000 7f3512a00640 1 -- 172.21.15.7:0/2731535687 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c015c50 con 0x55796f1d35b0 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.132+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55796f109080 con 0x55796f1d35b0 2024-08-19T00:43:37.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.132+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796f2783a0 con 0x55796f1d35b0 2024-08-19T00:43:37.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.134+0000 7f3512a00640 1 -- 172.21.15.7:0/2731535687 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f350c01c020 con 0x55796f1d35b0 2024-08-19T00:43:37.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.135+0000 7f3512a00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34fc06a810 0x7f34fc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.135+0000 7f3512a00640 1 -- 172.21.15.7:0/2731535687 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f350c08a5c0 con 0x55796f1d35b0 2024-08-19T00:43:37.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.135+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34fc06a810 0x7f34fc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout:���� 2024-08-19T00:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: �� 2024-08-19T00:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.135+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55796f270370 0x55796f30e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.135+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.0 12:00000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x55796f270370 2024-08-19T00:43:37.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.135+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55796f270370 0x55796f30e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.136+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34fc06a810 0x7f34fc06ccd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3508056000 tx=0x7f3508050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.136+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55796f270370 0x55796f30e5e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.138+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.138+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f351401b040 0x7f351401c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.138+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:08000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f351401b040 2024-08-19T00:43:37.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.139+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f351401b040 0x7f351401c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.139+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f351401b040 0x7f351401c430 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.141+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(2 [pgnls start_epoch 87 out=177b] v86'10 uv10 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.141+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f350c01e020 0x7f350c08a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.141+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:3 12.8 12:10000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350c01e020 2024-08-19T00:43:37.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.142+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f350c01e020 0x7f350c08a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.142+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f350c01e020 0x7f350c08a050 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.143+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(3 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.143+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:4 12.18 12:18000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350c01e020 2024-08-19T00:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.143+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(4 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.143+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f350806e040 0x7f3508061950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.143+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:5 12.4 12:20000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e040 2024-08-19T00:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.143+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f350806e040 0x7f3508061950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.144+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f350806e040 0x7f3508061950 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.144+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.2 v2:172.21.15.7:6816/3897722247 1 ==== osd_op_reply(5 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f350806e040 2024-08-19T00:43:37.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.144+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:6 12.14 12:28000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x55796f270370 2024-08-19T00:43:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.145+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(6 [pgnls start_epoch 87 out=149b] v86'19 uv19 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.145+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:7 12.c 12:30000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350c01e020 2024-08-19T00:43:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.145+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(7 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.145+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f350806e930 0x7f3508009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.145+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:8 12.1c 12:38000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e930 2024-08-19T00:43:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.146+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f350806e930 0x7f3508009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.146+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f350806e930 0x7f3508009410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.149+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(8 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.149+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:9 12.2 12:40000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e040 2024-08-19T00:43:37.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.149+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.2 v2:172.21.15.7:6816/3897722247 2 ==== osd_op_reply(9 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f350806e040 2024-08-19T00:43:37.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.149+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f351402b910 0x7f35140113d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.149+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:10 12.12 12:48000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f351402b910 2024-08-19T00:43:37.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.149+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f351402b910 0x7f35140113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.150+0000 7f3519800640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f351402b910 0x7f35140113d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.153+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.4 v2:172.21.15.162:6806/2900813997 1 ==== osd_op_reply(10 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350806b040 con 0x7f351402b910 2024-08-19T00:43:37.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.153+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:11 12.a 12:50000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f351402b910 2024-08-19T00:43:37.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.153+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.4 v2:172.21.15.162:6806/2900813997 2 ==== osd_op_reply(11 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350806b040 con 0x7f351402b910 2024-08-19T00:43:37.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.153+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:12 12.1a 12:58000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e040 2024-08-19T00:43:37.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.154+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.2 v2:172.21.15.7:6816/3897722247 3 ==== osd_op_reply(12 [pgnls start_epoch 87 out=49b] v85'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f350806e040 2024-08-19T00:43:37.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.154+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.6 12:60000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f351401b040 2024-08-19T00:43:37.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.154+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(13 [pgnls start_epoch 87 out=77b] v86'4 uv4 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.154+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:14 12.16 12:68000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e040 2024-08-19T00:43:37.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.154+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.2 v2:172.21.15.7:6816/3897722247 4 ==== osd_op_reply(14 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f350806e040 2024-08-19T00:43:37.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.154+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:15 12.e 12:70000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350c01e020 2024-08-19T00:43:37.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.155+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(15 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.155+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:16 12.1e 12:78000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e040 2024-08-19T00:43:37.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.155+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.2 v2:172.21.15.7:6816/3897722247 5 ==== osd_op_reply(16 [pgnls start_epoch 87 out=49b] v85'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f350806e040 2024-08-19T00:43:37.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.155+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f35140353c0 0x7f3514035840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.155+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:17 12.1 12:80000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f35140353c0 2024-08-19T00:43:37.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.156+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f35140353c0 0x7f3514035840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.156+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f35140353c0 0x7f3514035840 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.159+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(17 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.159+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:18 12.11 12:88000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e040 2024-08-19T00:43:37.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.159+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.2 v2:172.21.15.7:6816/3897722247 6 ==== osd_op_reply(18 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f350806e040 2024-08-19T00:43:37.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.159+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.9 12:90000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f351401b040 2024-08-19T00:43:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.160+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(19 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.160+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:20 12.19 12:98000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350c01e020 2024-08-19T00:43:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.160+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(20 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.160+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:21 12.5 12:a0000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x55796f270370 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.161+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(21 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.161+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:22 12.15 12:a8000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f35140353c0 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.161+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(22 [pgnls start_epoch 87 out=97b] v85'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.161+0000 7f351ac00640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f3514038440 0x7f35140388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.161+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:23 12.d 12:b0000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f3514038440 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.161+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f3514038440 0x7f35140388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.162+0000 7f351a200640 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f3514038440 0x7f35140388c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.162+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(23 [pgnls start_epoch 87 out=74b] v85'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.162+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.1d 12:b8000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f351401b040 2024-08-19T00:43:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.162+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(24 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.163+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:25 12.3 12:c0000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f351402b910 2024-08-19T00:43:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.163+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.4 v2:172.21.15.162:6806/2900813997 3 ==== osd_op_reply(25 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350806b040 con 0x7f351402b910 2024-08-19T00:43:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.163+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:26 12.13 12:c8000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350806e930 2024-08-19T00:43:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.163+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(26 [pgnls start_epoch 87 out=98b] v86'3 uv3 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.163+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:27 12.b 12:d0000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350c01e020 2024-08-19T00:43:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.164+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(27 [pgnls start_epoch 87 out=76b] v86'3 uv3 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.164+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:28 12.1b 12:d8000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x55796f270370 2024-08-19T00:43:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.164+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(28 [pgnls start_epoch 87 out=49b] v85'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.164+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:29 12.7 12:e0000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f350c01e020 2024-08-19T00:43:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.165+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(29 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.165+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:30 12.17 12:e8000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f35140353c0 2024-08-19T00:43:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.165+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(30 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.165+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:31 12.f 12:f0000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f3514038440 2024-08-19T00:43:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.165+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(31 [pgnls start_epoch 87 out=73b] v85'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.165+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:32 12.1f 12:f8000000:%01:::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x55796f30eb20 con 0x7f3514038440 2024-08-19T00:43:37.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.166+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(32 [pgnls start_epoch 87 out=101b] v86'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.166+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:33 12.10 12:09401a81:::601.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f30efd0 con 0x7f351401b040 2024-08-19T00:43:37.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.166+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(33 601.00000000 [read 0~0] v0'0 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.166+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:34 12.10 12:09401a81:::601.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f30f370 con 0x7f351401b040 2024-08-19T00:43:37.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.166+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(34 601.00000000 [getxattrs out=124b] v0'0 uv6 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.166+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:35 12.10 12:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f26abe0 con 0x7f351401b040 2024-08-19T00:43:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.167+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(35 601.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.167+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:36 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f26afd0 con 0x7f351401b040 2024-08-19T00:43:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.167+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(36 601.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.168+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:37 12.10 12:0bd6d154:::602.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f26b3c0 con 0x7f351401b040 2024-08-19T00:43:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.168+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(37 602.00000000 [read 0~0] v0'0 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.168+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:38 12.10 12:0bd6d154:::602.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f26b7b0 con 0x7f351401b040 2024-08-19T00:43:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.168+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(38 602.00000000 [getxattrs out=124b] v0'0 uv7 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.168+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:39 12.10 12:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.168+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(39 602.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.169+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:40 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31bbe0 con 0x7f351401b040 2024-08-19T00:43:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.169+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(40 602.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.169+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:41 12.10 12:0cf6ad0f:::10000000000.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.169+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(41 10000000000.00000000 [read 0~0] v0'0 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.169+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:42 12.10 12:0cf6ad0f:::10000000000.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.169+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(42 10000000000.00000000 [getxattrs out=124b] v0'0 uv10 ondisk = 0) ==== 164+0+124 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.169+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:43 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.170+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(43 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.170+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:44 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31bbe0 con 0x7f351401b040 2024-08-19T00:43:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.170+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals out=594b] v0'0 uv10 ondisk = 0) ==== 164+0+594 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: ��*$- 601.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray1 ���� �� ((88���� �� ��*$- 602.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray2 ���� �� ((88���� �� ��2,510000000000.00000000�������������������!�������������������������� ���~_layout��������_parent>8subdir ���� ��  (7��f%C(7��f%C8`7��f^h8`7��f^h���� ��WQ sixmegs_head9i* �7��f^h���5@@ `��������7��f^h7��f%C(8`7��f^h8`7��f^h 2024-08-19T00:43:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.170+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:45 12.10 12:0d82a743:::600.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.170+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(45 600.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.170+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:46 12.10 12:0d82a743:::600.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.171+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(46 600.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.171+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:47 12.10 12:0d82a743:::600.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.171+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(47 600.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.171+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:48 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31bbe0 con 0x7f351401b040 2024-08-19T00:43:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.171+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(48 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.171+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:49 12.10 12:0d89b25e:::603.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.172+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(49 603.00000000 [read 0~0] v0'0 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.172+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:50 12.10 12:0d89b25e:::603.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.172+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(50 603.00000000 [getxattrs out=124b] v0'0 uv8 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.172+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:51 12.10 12:0d89b25e:::603.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x7f351401b040 2024-08-19T00:43:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.173+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(51 603.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.173+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:52 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31bbe0 con 0x7f351401b040 2024-08-19T00:43:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.173+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(52 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.173+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:53 12.14 12:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31abd0 con 0x55796f270370 2024-08-19T00:43:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.173+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(53 1.00000000.inode [read 0~582 out=582b] v0'0 uv15 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.173+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:54 12.14 12:287034c4:::1.00000000.inode:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31af70 con 0x55796f270370 2024-08-19T00:43:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.174+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(54 1.00000000.inode [getxattrs out=4b] v0'0 uv15 ondisk = 0) ==== 160+0+4 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.184 INFO:teuthology.orchestra.run.smithi007.stdout:��������7��f%C����`security.selinux%unconfined_u:object_r:unlabeled_t:s0������������ �� ��*$- 600.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray0 ���� �� ((88���� �� ��*$- 603.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray3 ���� �� ((88���� �� ��.(11.00000000.inode�������������������!�������������������������� ��`ZFFceph fs volume v011)�6��f�@�4�C@@ ��������6��f�@�4(6��f�@�48`7��f^h8/��f�#� /��f�#� ����NH/��f�#� ������������ �� 2024-08-19T00:43:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.174+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:55 12.14 12:287034c4:::1.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31b310 con 0x55796f270370 2024-08-19T00:43:37.184 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.174+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(55 1.00000000.inode [omap-get-header] v0'0 uv15 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.174+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:56 12.14 12:287034c4:::1.00000000.inode:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c6c0 con 0x55796f270370 2024-08-19T00:43:37.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.174+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(56 1.00000000.inode [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.174+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:57 12.14 12:292cf221:::200.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31b6b0 con 0x55796f270370 2024-08-19T00:43:37.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(57 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:58 12.14 12:292cf221:::200.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31baa0 con 0x55796f270370 2024-08-19T00:43:37.187 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��*$- 200.00000000�������������������!�������������������������� ��tnZZTceph fs volume v011@�>@�>@�F@@@ ���� �� 2024-08-19T00:43:37.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(58 200.00000000 [getxattrs out=4b] v0'0 uv19 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:59 12.14 12:292cf221:::200.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31be40 con 0x55796f270370 2024-08-19T00:43:37.188 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(59 200.00000000 [omap-get-header] v0'0 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:60 12.14 12:292cf221:::200.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(60 200.00000000 [omap-get-vals out=5b] v0'0 uv19 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.175+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:61 12.14 12:2e2fa760:::200.00000001:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.189 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��*$- 200.00000001�������������������!�������������������������� ���F�F�F�F��XS&YA1e@��XS&YA1h^T/��f*L2 ((88 2 ( 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:( 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:8 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:/��f��� 8 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:/��f��� ��������@0@��XS&YA1�� 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:�6��f�n�#��gk��� entity_id0hostname smithi007kernel_version6.11.0-rc3-g7503b862ff5broot/��7 ����@��XS&YA1���6��f��'n���������@��XS&YA16��fz 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:�'setattr� C���������6��f۠t'�C@@ ��������/��f�#� (86��f۠t'8/��f�#� /��f�#� ����NH/��f�#� ����������������[@��XS&YA1��6��f?�4mkdir�p (6��f�@�4(6��f�@�486��f�@�486��f�@�4J 8subdir���������6��f�@�4�A�5����������������6��f�@�46��f�@�4(88��������6��f�@�4����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������2 ((88  C���������6��f�@�4�C@@ ��������6��f�@�4(6��f�@�486��f�@�48/��f�#� /��f�#� ����NH/��f�#� ������������������@��XS&YA1�7��f5fopenc�p (6��f�@�4(6��f�@�487��f%C86��f�@�4J 8subdir���������7��f%C�A�5����������������7��f%C6��f�@�4(7��f%C87��f%C87��f%C��������6��f�@�4����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������� (7��f%C(7��f%C87��f%C87��f%Cm [sixmegs���������7��f%C���5@@ ��������7��f%C7��f%C@(88��������7��f%C����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������!!���������@��XS&YA17��fI7] 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:cap update�p (6��f�@�4(6��f�@�48 7��f�'86��f�@�4J 8subdir���������7��f%C�A�5����������������7��f%C6��f�@�4(7��f%C8 7��f�'8 7��f�'��������6��f�@�4����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������� (7��f%C(7��f%C8 7��f�'8 7��f�'u csixmegs���������7��f�'���5@@ ��������7��f�'7��f%C�(8 7��f�'8 7��f�'��������7��f%C���� security.selinux%unconfined_u:object_r:unlabeled_t:s0�����������������@��XS&YA17��f0M� 2024-08-19T00:43:37.190 INFO:teuthology.orchestra.run.smithi007.stdout:cap update�p  (6��f�@�4(6��f�@�4807��f.}�86��f�@�4J 8subdir���������7��f%C�A�5����������������7��f%C6��f�@�4(7��f%C807��f.}�807��f.}���������6��f�@�4����security.selinux%unconfined_u:object_r:unlabeled_t:s0��������� (7��f%C(7��f%C807��f.}�807��f.}�u csixmegs���������7��f.}����5@@ 0��������7��f.}�7��f%C�(807��f.}�807��f.}���������7��f%C����0security.selinux%unconfined_u:object_r:unlabeled_t:s0����������������� @��XS&YA1e 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:Q 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:7��f� 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:5 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:cap update 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:p  (6��f�@�4(6��f�@�48`7��f^h8`7��f^hJ 8subdir�������� 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:�7��f%C�A�5����������������7��f%C6��f�@�4(7��f%C8`7��f^h8`7��f^h 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:��������6��f�@�4����security.selinux%unconfined_u:object_r:unlabeled_t:s0���������  (7��f%C(7��f%C8`7��f^h8`7��f^hu csixmegs���������7��f^h���5@@ `��������7��f^h7��f%C(8`7��f^h8`7��f^h��������7��f%C����`security.selinux%unconfined_u:object_r:unlabeled_t:s0�������� C���������6��f�@�4�C@@ ��������6��f�@�4(6��f�@�48`7��f^h8/��f�#� /��f�#� ����NH/��f�#� ����������������()@��XS&YA1�� 2024-08-19T00:43:37.191 INFO:teuthology.orchestra.run.smithi007.stdout:�7��f [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:62 12.14 12:2e2fa760:::200.00000001:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.193 INFO:teuthology.orchestra.run.smithi007.stdout:��������7��f%C����`security.selinux%unconfined_u:object_r:unlabeled_t:s0����������������N4@��XS&YA18.$��>@��XS&YA1h^T8��f�$j$2  (6��f�@�4(6��f�@�48`7��f^h8`7��f^h 2 ( 2024-08-19T00:43:37.193 INFO:teuthology.orchestra.run.smithi007.stdout:( 2024-08-19T00:43:37.193 INFO:teuthology.orchestra.run.smithi007.stdout:8 2024-08-19T00:43:37.193 INFO:teuthology.orchestra.run.smithi007.stdout:/��f��� 8 2024-08-19T00:43:37.193 INFO:teuthology.orchestra.run.smithi007.stdout:/��f��� ��������@�>@��XS&YA1^TJ8��fAr�$scatter_writebehind2 (6��f�@�4(6��f�@�48`7��f^h8`7��f^h  C���������6��f�@�4�C@@ ��������6��f�@�4(6��f�@�48`7��f^h8/��f�#� /��f�#� ����NH/��f�#� ����������������TB@���� �� 2024-08-19T00:43:37.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.176+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(62 200.00000001 [getxattrs out=4b] v0'0 uv16 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.176+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:63 12.14 12:2e2fa760:::200.00000001:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.194 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.176+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(63 200.00000001 [omap-get-header] v0'0 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.176+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:64 12.14 12:2e2fa760:::200.00000001:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.177+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(64 200.00000001 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.177+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:65 12.14 12:2f55791f:::606.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.177+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(65 606.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.177+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:66 12.14 12:2f55791f:::606.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.177+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(66 606.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.177+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:67 12.14 12:2f55791f:::606.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.177+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(67 606.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.178+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:68 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x55796f270370 2024-08-19T00:43:37.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.178+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(68 606.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f351400dc00 con 0x55796f270370 2024-08-19T00:43:37.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.178+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:69 12.1c 12:3ed09add:::607.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f350806e930 2024-08-19T00:43:37.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.178+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(69 607.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.178+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:70 12.1c 12:3ed09add:::607.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f350806e930 2024-08-19T00:43:37.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.179+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(70 607.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.179+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:71 12.1c 12:3ed09add:::607.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f350806e930 2024-08-19T00:43:37.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.179+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(71 607.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.179+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:72 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f350806e930 2024-08-19T00:43:37.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.180+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(72 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.180+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:73 12.6 12:654134d2:::mds0_openfiles.0:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f351401b040 2024-08-19T00:43:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.180+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(73 mds0_openfiles.0 [read 0~0] v0'0 uv4 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.180+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:74 12.6 12:654134d2:::mds0_openfiles.0:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f351401b040 2024-08-19T00:43:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.180+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(74 mds0_openfiles.0 [getxattrs out=4b] v0'0 uv4 ondisk = 0) ==== 160+0+4 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.201 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��*$- 606.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray6 ���� �� ((88���� �� ��*$- 607.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray7 ���� �� ((88���� �� ��.(1mds0_openfiles.0�������������������!�������������������������� �� 2024-08-19T00:43:37.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.181+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:75 12.6 12:654134d2:::mds0_openfiles.0:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f351401b040 2024-08-19T00:43:37.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.181+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(75 mds0_openfiles.0 [omap-get-header out=42b] v0'0 uv4 ondisk = 0) ==== 160+0+42 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.181+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:76 12.6 12:654134d2:::mds0_openfiles.0:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f351401b040 2024-08-19T00:43:37.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.181+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(76 mds0_openfiles.0 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.181+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:77 12.e 12:717a0223:::608.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31c1e0 con 0x7f350c01e020 2024-08-19T00:43:37.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.182+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(77 608.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.182+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:78 12.e 12:717a0223:::608.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31ca60 con 0x7f350c01e020 2024-08-19T00:43:37.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.182+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(78 608.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f350806b040 con 0x7f350c01e020 2024-08-19T00:43:37.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.183+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:79 12.e 12:717a0223:::608.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31ce00 con 0x7f350c01e020 2024-08-19T00:43:37.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.183+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(79 608.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.183+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:80 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e1b0 con 0x7f350c01e020 2024-08-19T00:43:37.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.184+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(80 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.184+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:81 12.15 12:a93a17c2:::604.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f35140353c0 2024-08-19T00:43:37.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.184+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(81 604.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.184+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:82 12.15 12:a93a17c2:::604.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f35140353c0 2024-08-19T00:43:37.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.184+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(82 604.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.184+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:83 12.15 12:a93a17c2:::604.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f35140353c0 2024-08-19T00:43:37.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.185+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(83 604.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.185+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:84 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e550 con 0x7f35140353c0 2024-08-19T00:43:37.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.185+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(84 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.185+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:85 12.15 12:aa448500:::500.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f35140353c0 2024-08-19T00:43:37.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.185+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(85 500.00000000 [read 0~90 out=90b] v0'0 uv3 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.185+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:86 12.15 12:aa448500:::500.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f35140353c0 2024-08-19T00:43:37.209 INFO:teuthology.orchestra.run.smithi007.stdout:���� ��4.*ceph fs volume v011 ���� �� ��*$- 608.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray8 ���� �� ((88���� �� ��*$- 604.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray4 ���� �� ((88���� �� ��*$- 500.00000000�������������������!�������������������������� ��tnZZTceph fs volume v011@@@@@@ ���� �� 2024-08-19T00:43:37.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.186+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(86 500.00000000 [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.186+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:87 12.15 12:aa448500:::500.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f35140353c0 2024-08-19T00:43:37.209 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.186+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(87 500.00000000 [omap-get-header] v0'0 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.186+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:88 12.15 12:aa448500:::500.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e550 con 0x7f35140353c0 2024-08-19T00:43:37.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.186+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(88 500.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f351400dc00 con 0x7f35140353c0 2024-08-19T00:43:37.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.186+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:89 12.d 12:b50e409b:::mds_snaptable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.187+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(89 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.187+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:90 12.d 12:b50e409b:::mds_snaptable:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.187+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(90 mds_snaptable [getxattrs out=4b] v0'0 uv1 ondisk = 0) ==== 157+0+4 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.212 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��+%. mds_snaptable�������������������!�������������������������� ��`ZFF4���� �� 2024-08-19T00:43:37.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.187+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:91 12.d 12:b50e409b:::mds_snaptable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.212 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.187+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(91 mds_snaptable [omap-get-header] v0'0 uv1 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.187+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:92 12.d 12:b50e409b:::mds_snaptable:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e550 con 0x7f3514038440 2024-08-19T00:43:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.188+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(92 mds_snaptable [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.188+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:93 12.1d 12:b871830b:::605.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f351401b040 2024-08-19T00:43:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.188+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(93 605.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.188+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:94 12.1d 12:b871830b:::605.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f351401b040 2024-08-19T00:43:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.189+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(94 605.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.189+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:95 12.1d 12:b871830b:::605.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f351401b040 2024-08-19T00:43:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.189+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(95 605.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.189+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:96 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f351401b040 2024-08-19T00:43:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.189+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(96 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f351401b040 2024-08-19T00:43:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.189+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f350806e930 2024-08-19T00:43:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.190+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.190+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:c91d4a1d:::mds0_inotable:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f350806e930 2024-08-19T00:43:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.190+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(98 mds0_inotable [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 157+0+4 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.217 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��*$- 605.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray5 ���� �� ((88���� �� ��+%. mds0_inotable�������������������!�������������������������� ��<6""��������� �� 2024-08-19T00:43:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.190+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:c91d4a1d:::mds0_inotable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f350806e930 2024-08-19T00:43:37.218 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.191+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(99 mds0_inotable [omap-get-header] v0'0 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.191+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:c91d4a1d:::mds0_inotable:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e550 con 0x7f350806e930 2024-08-19T00:43:37.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.191+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(100 mds0_inotable [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.191+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:101 12.13 12:cd5a64a3:::100.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f350806e930 2024-08-19T00:43:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.191+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(101 100.00000000 [read 0~0] v0'0 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.191+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:102 12.13 12:cd5a64a3:::100.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f350806e930 2024-08-19T00:43:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.191+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(102 100.00000000 [getxattrs out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.220 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��*$- 100.00000000�������������������!�������������������������� �� 2024-08-19T00:43:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.192+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:103 12.13 12:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f350806e930 2024-08-19T00:43:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.192+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(103 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.221 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ( 2024-08-19T00:43:37.221 INFO:teuthology.orchestra.run.smithi007.stdout:( 2024-08-19T00:43:37.221 INFO:teuthology.orchestra.run.smithi007.stdout:8 2024-08-19T00:43:37.221 INFO:teuthology.orchestra.run.smithi007.stdout:/��f��� 8 2024-08-19T00:43:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.192+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:104 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e550 con 0x7f350806e930 2024-08-19T00:43:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.193+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(104 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x7f350c025070 con 0x7f350806e930 2024-08-19T00:43:37.222 INFO:teuthology.orchestra.run.smithi007.stdout:/��f��� ���� ��PJ 2024-08-19T00:43:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.193+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.b 12:d0630e4c:::mds0_sessionmap:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d650 con 0x7f350c01e020 2024-08-19T00:43:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.194+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(105 mds0_sessionmap [read 0~0] v0'0 uv3 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.194+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.b 12:d0630e4c:::mds0_sessionmap:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31da40 con 0x7f350c01e020 2024-08-19T00:43:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: stray0_head�i���/��f�$� @A����������������/��f�$� (8/��f�$� 8/��f�$� /��f�$� ������������ stray1_head�i���/��f��� @A����������������/��f��� (8/��f��� 8/��f��� /��f��� ������������ stray2_head�i���/��f�u� @A����������������/��f�u� (8/��f�u� 8/��f�u� /��f�u� ������������ stray3_head�i���/��f1� @A����������������/��f1� (8/��f1� 8/��f1� /��f1� ������������ stray4_head�i���/��f�_� @A����������������/��f�_� (8/��f�_� 8/��f�_� /��f�_� ������������ stray5_head�i���/��f�R� @A����������������/��f�R� (8/��f�R� 8/��f�R� /��f�R� ������������ stray6_head�i���/��f:!� @A����������������/��f:!� (8/��f:!� 8/��f:!� /��f:!� ������������ stray7_head�i���/��fkO� @A����������������/��fkO� (8/��fkO� 8/��fkO� /��fkO� ������������ stray8_head�i���/��fa�� @A����������������/��fa�� (8/��fa�� 8/��fa�� /��fa�� ������������ stray9_head�i��� /��f��� @A����������������/��f��� (8/��f��� 8/��f��� /��f��� ���������������� �� ��-'0mds0_sessionmap�������������������!�������������������������� �� 2024-08-19T00:43:37.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.194+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(106 mds0_sessionmap [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 159+0+4 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.194+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e550 con 0x7f350c01e020 2024-08-19T00:43:37.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.195+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(107 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.195+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31f900 con 0x7f350c01e020 2024-08-19T00:43:37.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.195+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(108 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.195+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e8f0 con 0x7f350c01e020 2024-08-19T00:43:37.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.195+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(109 609.00000000 [read 0~0] v0'0 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.196+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e8f0 con 0x7f350c01e020 2024-08-19T00:43:37.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.196+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 17 ==== osd_op_reply(110 609.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) ==== 156+0+124 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.196+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:111 12.7 12:e0b41d06:::609.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31e8f0 con 0x7f350c01e020 2024-08-19T00:43:37.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.197+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 18 ==== osd_op_reply(111 609.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.197+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:112 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f350c01e020 2024-08-19T00:43:37.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.197+0000 7f3519800640 1 -- 172.21.15.7:0/2731535687 <== osd.7 v2:172.21.15.162:6824/4238399288 19 ==== osd_op_reply(112 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f3508084040 con 0x7f350c01e020 2024-08-19T00:43:37.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.197+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.198+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.198+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f26dad0 con 0x7f3514038440 2024-08-19T00:43:37.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.198+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [getxattrs out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.229 INFO:teuthology.orchestra.run.smithi007.stdout:���� ������ �� ��*$- 609.00000000�������������������!�������������������������� ���~_layout��������_parent>8 stray9 ���� �� ((88���� �� ��*$- 400.00000000�������������������!�������������������������� ��0*���� �� 2024-08-19T00:43:37.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.198+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.229 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.199+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-get-header] v0'0 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.199+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.f 12:f1f69726:::400.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f26dad0 con 0x7f3514038440 2024-08-19T00:43:37.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.199+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 400.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.199+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f26dad0 con 0x7f3514038440 2024-08-19T00:43:37.231 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��0*3100.00000000.inode�������������������!�������������������������� ��`ZFFceph fs volume v011)�/��f 2024-08-19T00:43:37.231 INFO:teuthology.orchestra.run.smithi007.stdout:�� @A����������������/��f 2024-08-19T00:43:37.231 INFO:teuthology.orchestra.run.smithi007.stdout:�� ( 2024-08-19T00:43:37.231 INFO:teuthology.orchestra.run.smithi007.stdout:8 /��f��� 8 /��f��� /��f 2024-08-19T00:43:37.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.199+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [read 0~582 out=582b] v0'0 uv3 ondisk = 0) ==== 162+0+582 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.199+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.232 INFO:teuthology.orchestra.run.smithi007.stdout:�� ����NH������������ �� 2024-08-19T00:43:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [getxattrs out=4b] v0'0 uv3 ondisk = 0) ==== 162+0+4 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [omap-get-header] v0'0 uv3 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.233 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� 2024-08-19T00:43:37.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 162+0+5 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.233 INFO:teuthology.orchestra.run.smithi007.stdout:���� �� ��("+ 2024-08-19T00:43:37.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [read 0~0] v0'0 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.200+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [getxattrs out=92b] v0'0 uv6 ondisk = 0) ==== 154+0+92 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55796f31d1a0 con 0x7f3514038440 2024-08-19T00:43:37.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351a200640 1 -- 172.21.15.7:0/2731535687 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [omap-get-vals out=585b] v0'0 uv6 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x7f350c025070 con 0x7f3514038440 2024-08-19T00:43:37.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55796f270370 msgr2=0x55796f30e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55796f270370 0x55796f30e5e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f35140353c0 msgr2=0x7f3514035840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f35140353c0 0x7f3514035840 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f350806e040 msgr2=0x7f3508061950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f350806e040 0x7f3508061950 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f3514038440 msgr2=0x7f35140388c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7f3514038440 0x7f35140388c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f351402b910 msgr2=0x7f35140113d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f351402b910 0x7f35140113d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f350806e930 msgr2=0x7f3508009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f350806e930 0x7f3508009410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f351401b040 msgr2=0x7f351401c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f351401b040 0x7f351401c430 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f350c01e020 msgr2=0x7f350c08a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.201+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f350c01e020 0x7f350c08a050 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 reap_dead start 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34fc06a810 msgr2=0x7f34fc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34fc06a810 0x7f34fc06ccd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3508056000 tx=0x7f3508050000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d35b0 msgr2=0x55796f2673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351ac00640 1 -- 172.21.15.7:0/2731535687 reap_dead start 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d35b0 0x55796f2673b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f350c005400 tx=0x7f350c0087d0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 shutdown_connections 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 --2- 172.21.15.7:0/2731535687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796f1d35b0 0x55796f2673b0 secure :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f350c005400 tx=0x7f350c0087d0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 >> 172.21.15.7:0/2731535687 conn(0x55796f1d04e0 msgr2=0x55796f1cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 shutdown_connections 2024-08-19T00:43:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.202+0000 7f351d0f2f40 1 -- 172.21.15.7:0/2731535687 wait complete. 2024-08-19T00:43:37.240 INFO:teuthology.orchestra.run.smithi007.stdout:1.00000000�������������������!�������������������������� ��d^_layout@@ _parent ���� ��  (6��f�@�4(6��f�@�48`7��f^h8`7��f^h���� ��NH subdir_head1i"�7��f%C�A�5����������������7��f%C6��f�@�4(7��f%C8`7��f^h8`7��f^h ��������6��f�@�4����security.selinux%unconfined_u:object_r:unlabeled_t:s0������������ �� �� 2024-08-19T00:43:37.240 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-08-19T00:43:37.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.314+0000 7f7f2e434f40 1 Processor -- start 2024-08-19T00:43:37.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.314+0000 7f7f2e434f40 1 -- start start 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2e434f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f10002460 0x563fa34b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2e434f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563fa35915e0 0x563fa3586c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2e434f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 0x563fa3587170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2e434f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563fa345dd00 con 0x7f7f10002460 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2e434f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563fa3461d40 con 0x563fa35915e0 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2e434f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563fa358edd0 con 0x563fa3582f40 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2b600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f10002460 0x563fa34b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2b600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f10002460 0x563fa34b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39894/0 (socket says 172.21.15.7:39894) 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.315+0000 7f7f2b600640 1 -- 172.21.15.7:0/2855053602 learned_addr learned my addr 172.21.15.7:0/2855053602 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f2b600640 1 -- 172.21.15.7:0/2855053602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 msgr2=0x563fa3587170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f2b600640 1 --2- 172.21.15.7:0/2855053602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 0x563fa3587170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f2b600640 1 -- 172.21.15.7:0/2855053602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563fa35915e0 msgr2=0x563fa3586c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f2b600640 1 --2- 172.21.15.7:0/2855053602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563fa35915e0 0x563fa3586c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f2b600640 1 -- 172.21.15.7:0/2855053602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa341f080 con 0x7f7f10002460 2024-08-19T00:43:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f2b600640 1 --2- 172.21.15.7:0/2855053602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f10002460 0x563fa34b69b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c025f70 tx=0x7f7f1c04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2f15fe49e117c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f29800640 1 -- 172.21.15.7:0/2855053602 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c063070 con 0x7f7f10002460 2024-08-19T00:43:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f29800640 1 -- 172.21.15.7:0/2855053602 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1c0557f0 con 0x7f7f10002460 2024-08-19T00:43:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.316+0000 7f7f29800640 1 -- 172.21.15.7:0/2855053602 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c05a040 con 0x7f7f10002460 2024-08-19T00:43:37.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 -- 172.21.15.7:0/2855053602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f10002460 msgr2=0x563fa34b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/2855053602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f10002460 0x563fa34b69b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c025f70 tx=0x7f7f1c04f000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 -- 172.21.15.7:0/2855053602 shutdown_connections 2024-08-19T00:43:37.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/2855053602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 0x563fa3587170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/2855053602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563fa35915e0 0x563fa3586c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/2855053602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f10002460 0x563fa34b69b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 -- 172.21.15.7:0/2855053602 >> 172.21.15.7:0/2855053602 conn(0x563fa34e64f0 msgr2=0x563fa34e4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 -- 172.21.15.7:0/2855053602 shutdown_connections 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 -- 172.21.15.7:0/2855053602 wait complete. 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.317+0000 7f7f2e434f40 1 Processor -- start 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.318+0000 7f7f2e434f40 1 -- start start 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.318+0000 7f7f2e434f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 0x563fa357f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2e434f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f10002460 0x563fa34e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2e434f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa3587110 0x563fa356e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2e434f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563fa34e5fd0 con 0x563fa3587110 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2e434f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563fa3500dc0 con 0x7f7f10002460 2024-08-19T00:43:37.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2e434f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563fa34e5cf0 con 0x563fa3582f40 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa3587110 0x563fa356e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa3587110 0x563fa356e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39902/0 (socket says 172.21.15.7:39902) 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 learned_addr learned my addr 172.21.15.7:0/3342524364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f10002460 0x563fa34e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 0x563fa357f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 msgr2=0x563fa357f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563fa3582f40 0x563fa357f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f10002460 msgr2=0x563fa34e8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f10002460 0x563fa34e8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa35875c0 con 0x563fa3587110 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.319+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f10002460 0x563fa34e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.320+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa3587110 0x563fa356e260 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x563fa34b61c0 tx=0x7f7f2400d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.320+0000 7f7f23e00640 1 -- 172.21.15.7:0/3342524364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24018070 con 0x563fa3587110 2024-08-19T00:43:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.320+0000 7f7f23e00640 1 -- 172.21.15.7:0/3342524364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2400dda0 con 0x563fa3587110 2024-08-19T00:43:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.320+0000 7f7f23e00640 1 -- 172.21.15.7:0/3342524364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24001d20 con 0x563fa3587110 2024-08-19T00:43:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.320+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fa3590d10 con 0x563fa3587110 2024-08-19T00:43:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.320+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa3586910 con 0x563fa3587110 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.322+0000 7f7f23e00640 1 -- 172.21.15.7:0/3342524364 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f2401b070 con 0x563fa3587110 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.323+0000 7f7f23e00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f0c06a840 0x7f7f0c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.323+0000 7f7f23e00640 1 -- 172.21.15.7:0/3342524364 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f7f24088e40 con 0x563fa3587110 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.323+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f0c06a840 0x7f7f0c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.323+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563fa36250e0 0x563fa36254c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.323+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x563fa36250e0 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.323+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563fa36250e0 0x563fa36254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.323+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f0c06a840 0x7f7f0c06cd00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0098f0 tx=0x7f7f1c052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.324+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563fa36250e0 0x563fa36254c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.324+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f18009710 con 0x563fa36250e0 2024-08-19T00:43:37.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.324+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f7f18010970 0x7f7f1800e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.324+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:08000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f18010970 2024-08-19T00:43:37.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.325+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f7f18010970 0x7f7f1800e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.325+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f7f18010970 0x7f7f1800e3e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.326+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(2 [pgnls start_epoch 87 out=177b] v86'10 uv10 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x7f7f1c066040 con 0x7f7f18010970 2024-08-19T00:43:37.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.326+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f7f1c05e940 0x7f7f1c06a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.326+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:3 12.8 12:10000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1c05e940 2024-08-19T00:43:37.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.326+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f7f1c05e940 0x7f7f1c06a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.327+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f7f1c05e940 0x7f7f1c06a400 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.327+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(3 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f1c05e940 2024-08-19T00:43:37.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.327+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:4 12.18 12:18000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1c05e940 2024-08-19T00:43:37.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.327+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(4 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f1c05e940 2024-08-19T00:43:37.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.327+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f7f1800b860 0x7f7f1801e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.327+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:5 12.4 12:20000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1800b860 2024-08-19T00:43:37.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.328+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f7f1800b860 0x7f7f1801e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.328+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f7f1800b860 0x7f7f1801e340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.329+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.2 v2:172.21.15.7:6816/3897722247 1 ==== osd_op_reply(5 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f1800b860 2024-08-19T00:43:37.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.329+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:6 12.14 12:28000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x563fa36250e0 2024-08-19T00:43:37.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.329+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(6 [pgnls start_epoch 87 out=149b] v86'19 uv19 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f7f1801d040 con 0x563fa36250e0 2024-08-19T00:43:37.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.329+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:7 12.c 12:30000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1c05e940 2024-08-19T00:43:37.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.329+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(7 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f1c05e940 2024-08-19T00:43:37.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.329+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7f180200a0 0x7f7f18024450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.330+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:8 12.1c 12:38000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f180200a0 2024-08-19T00:43:37.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.330+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7f180200a0 0x7f7f18024450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.330+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7f180200a0 0x7f7f18024450 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.331+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(8 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f7f1c066040 con 0x7f7f180200a0 2024-08-19T00:43:37.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.331+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:9 12.2 12:40000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1800b860 2024-08-19T00:43:37.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.331+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.2 v2:172.21.15.7:6816/3897722247 2 ==== osd_op_reply(9 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f1800b860 2024-08-19T00:43:37.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.331+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f7f24059040 0x7f7f24055ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.331+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:10 12.12 12:48000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f24059040 2024-08-19T00:43:37.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.331+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f7f24059040 0x7f7f24055ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.332+0000 7f7f2ac00640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f7f24059040 0x7f7f24055ff0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.333+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.4 v2:172.21.15.162:6806/2900813997 1 ==== osd_op_reply(10 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f24059040 2024-08-19T00:43:37.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.333+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:11 12.a 12:50000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f24059040 2024-08-19T00:43:37.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.333+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.4 v2:172.21.15.162:6806/2900813997 2 ==== osd_op_reply(11 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f24059040 2024-08-19T00:43:37.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.333+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:12 12.1a 12:58000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1800b860 2024-08-19T00:43:37.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.333+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.2 v2:172.21.15.7:6816/3897722247 3 ==== osd_op_reply(12 [pgnls start_epoch 87 out=49b] v85'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f1800b860 2024-08-19T00:43:37.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.333+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.6 12:60000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f18010970 2024-08-19T00:43:37.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.334+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(13 [pgnls start_epoch 87 out=77b] v86'4 uv4 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f7f1c066040 con 0x7f7f18010970 2024-08-19T00:43:37.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.334+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:14 12.16 12:68000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1800b860 2024-08-19T00:43:37.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.334+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.2 v2:172.21.15.7:6816/3897722247 4 ==== osd_op_reply(14 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f1800b860 2024-08-19T00:43:37.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.334+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:15 12.e 12:70000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1c05e940 2024-08-19T00:43:37.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.335+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(15 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f1c05e940 2024-08-19T00:43:37.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.335+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:16 12.1e 12:78000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1800b860 2024-08-19T00:43:37.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.335+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.2 v2:172.21.15.7:6816/3897722247 5 ==== osd_op_reply(16 [pgnls start_epoch 87 out=49b] v85'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f1800b860 2024-08-19T00:43:37.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.335+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f7f2401d060 0x7f7f240876d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.335+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:17 12.1 12:80000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f2401d060 2024-08-19T00:43:37.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.335+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f7f2401d060 0x7f7f240876d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.336+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f7f2401d060 0x7f7f240876d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.336+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(17 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f2401d060 2024-08-19T00:43:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.336+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- osd_op(unknown.0.0:18 12.11 12:88000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1800b860 2024-08-19T00:43:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.336+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.2 v2:172.21.15.7:6816/3897722247 6 ==== osd_op_reply(18 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f1800b860 2024-08-19T00:43:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.336+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.9 12:90000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f18010970 2024-08-19T00:43:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.337+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(19 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1c066040 con 0x7f7f18010970 2024-08-19T00:43:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.337+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:20 12.19 12:98000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1c05e940 2024-08-19T00:43:37.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.338+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(20 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f1c05e940 2024-08-19T00:43:37.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.338+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:21 12.5 12:a0000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x563fa36250e0 2024-08-19T00:43:37.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.338+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(21 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x563fa36250e0 2024-08-19T00:43:37.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.338+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:22 12.15 12:a8000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f2401d060 2024-08-19T00:43:37.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.338+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(22 [pgnls start_epoch 87 out=97b] v85'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f2401d060 2024-08-19T00:43:37.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.338+0000 7f7f2c000640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563fa34e7f50 0x7f7f2405c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.338+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:23 12.d 12:b0000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x563fa34e7f50 2024-08-19T00:43:37.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.339+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563fa34e7f50 0x7f7f2405c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.339+0000 7f7f2b600640 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563fa34e7f50 0x7f7f2405c5c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.339+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(23 [pgnls start_epoch 87 out=74b] v85'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7f1c066040 con 0x563fa34e7f50 2024-08-19T00:43:37.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.339+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.1d 12:b8000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f18010970 2024-08-19T00:43:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.340+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(24 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f7f1c066040 con 0x7f7f18010970 2024-08-19T00:43:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.340+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:25 12.3 12:c0000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f24059040 2024-08-19T00:43:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.340+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.4 v2:172.21.15.162:6806/2900813997 3 ==== osd_op_reply(25 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f24059040 2024-08-19T00:43:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.341+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:26 12.13 12:c8000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f180200a0 2024-08-19T00:43:37.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.341+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(26 [pgnls start_epoch 87 out=98b] v86'3 uv3 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x7f7f1c066040 con 0x7f7f180200a0 2024-08-19T00:43:37.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.341+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:27 12.b 12:d0000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1c05e940 2024-08-19T00:43:37.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.342+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(27 [pgnls start_epoch 87 out=76b] v86'3 uv3 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f1c05e940 2024-08-19T00:43:37.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.342+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:28 12.1b 12:d8000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x563fa36250e0 2024-08-19T00:43:37.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.342+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(28 [pgnls start_epoch 87 out=49b] v85'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f1801d040 con 0x563fa36250e0 2024-08-19T00:43:37.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.342+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:29 12.7 12:e0000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f1c05e940 2024-08-19T00:43:37.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.343+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(29 [pgnls start_epoch 87 out=73b] v85'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f7f1801d040 con 0x7f7f1c05e940 2024-08-19T00:43:37.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.343+0000 7f7f2ac00640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:30 12.17 12:e8000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x7f7f2401d060 2024-08-19T00:43:37.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(30 [pgnls start_epoch 87 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f2401a030 con 0x7f7f2401d060 2024-08-19T00:43:37.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:31 12.f 12:f0000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x563fa34e7f50 2024-08-19T00:43:37.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(31 [pgnls start_epoch 87 out=73b] v85'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f7f1c066040 con 0x563fa34e7f50 2024-08-19T00:43:37.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:32 12.1f 12:f8000000::::head [pgnls start_epoch 87 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e87) -- 0x563fa3625a00 con 0x563fa34e7f50 2024-08-19T00:43:37.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2b600640 1 -- 172.21.15.7:0/3342524364 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(32 [pgnls start_epoch 87 out=101b] v86'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f7f1c066040 con 0x563fa34e7f50 2024-08-19T00:43:37.347 INFO:teuthology.orchestra.run.smithi007.stdout:601.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:602.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:10000000000.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:600.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:603.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:1.00000000.inode 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:200.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:200.00000001 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:606.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:607.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:mds0_openfiles.0 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:608.00000000 2024-08-19T00:43:37.348 INFO:teuthology.orchestra.run.smithi007.stdout:604.00000000 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:500.00000000 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:mds_snaptable 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:605.00000000 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:mds0_inotable 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:100.00000000 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:mds0_sessionmap 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:609.00000000 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:400.00000000 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:100.00000000.inode 2024-08-19T00:43:37.349 INFO:teuthology.orchestra.run.smithi007.stdout:1.00000000 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563fa36250e0 msgr2=0x563fa36254c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563fa36250e0 0x563fa36254c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f7f2401d060 msgr2=0x7f7f240876d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f7f2401d060 0x7f7f240876d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f7f1800b860 msgr2=0x7f7f1801e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f7f1800b860 0x7f7f1801e340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563fa34e7f50 msgr2=0x7f7f2405c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563fa34e7f50 0x7f7f2405c5c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.344+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f7f24059040 msgr2=0x7f7f24055ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f7f24059040 0x7f7f24055ff0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7f180200a0 msgr2=0x7f7f18024450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7f180200a0 0x7f7f18024450 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f7f18010970 msgr2=0x7f7f1800e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f7f18010970 0x7f7f1800e3e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f7f1c05e940 msgr2=0x7f7f1c06a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f7f1c05e940 0x7f7f1c06a400 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 reap_dead start 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2c000640 1 -- 172.21.15.7:0/3342524364 reap_dead start 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f0c06a840 msgr2=0x7f7f0c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f0c06a840 0x7f7f0c06cd00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0098f0 tx=0x7f7f1c052000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa3587110 msgr2=0x563fa356e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa3587110 0x563fa356e260 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x563fa34b61c0 tx=0x7f7f2400d530 comp rx=0 tx=0).stop 2024-08-19T00:43:37.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 shutdown_connections 2024-08-19T00:43:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f0c06a840 0x7f7f0c06cd00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 --2- 172.21.15.7:0/3342524364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa3587110 0x563fa356e260 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 >> 172.21.15.7:0/3342524364 conn(0x563fa34e64f0 msgr2=0x563fa34e68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 shutdown_connections 2024-08-19T00:43:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.345+0000 7f7f2e434f40 1 -- 172.21.15.7:0/3342524364 wait complete. 2024-08-19T00:43:37.354 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 10000000000.00000000 2024-08-19T00:43:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.428+0000 7f1e7e10df40 1 Processor -- start 2024-08-19T00:43:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.428+0000 7f1e7e10df40 1 -- start start 2024-08-19T00:43:37.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.429+0000 7f1e7e10df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad98f40 0x55babae3c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.429+0000 7f1e7e10df40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad9a5b0 0x55babae38140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.429+0000 7f1e7e10df40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 0x55babae38680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.429+0000 7f1e7e10df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55babad998f0 con 0x55babad98f40 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.429+0000 7f1e7e10df40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55babad0ed00 con 0x55babad9a990 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.429+0000 7f1e7e10df40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55babae3fdc0 con 0x55babad9a5b0 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.429+0000 7f1e7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad98f40 0x55babae3c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad98f40 0x55babae3c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39918/0 (socket says 172.21.15.7:39918) 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 -- 172.21.15.7:0/3930989714 learned_addr learned my addr 172.21.15.7:0/3930989714 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7be00640 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 0x55babae38680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7aa00640 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad9a5b0 0x55babae38140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 -- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad9a5b0 msgr2=0x55babae38140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad9a5b0 0x55babae38140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 -- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 msgr2=0x55babae38680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 0x55babae38680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 -- 172.21.15.7:0/3930989714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babac93b30 con 0x55babad98f40 2024-08-19T00:43:37.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7aa00640 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad9a5b0 0x55babae38140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e7b400640 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad98f40 0x55babae3c0e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c001e60 tx=0x7f1e6c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e33a677c95a3b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.430+0000 7f1e79600640 1 -- 172.21.15.7:0/3930989714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c012020 con 0x55babad98f40 2024-08-19T00:43:37.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e79600640 1 -- 172.21.15.7:0/3930989714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00e670 con 0x55babad98f40 2024-08-19T00:43:37.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e79600640 1 -- 172.21.15.7:0/3930989714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00eaa0 con 0x55babad98f40 2024-08-19T00:43:37.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 -- 172.21.15.7:0/3930989714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad98f40 msgr2=0x55babae3c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad98f40 0x55babae3c0e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c001e60 tx=0x7f1e6c00b780 comp rx=0 tx=0).stop 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 -- 172.21.15.7:0/3930989714 shutdown_connections 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 0x55babae38680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad9a5b0 0x55babae38140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/3930989714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad98f40 0x55babae3c0e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 -- 172.21.15.7:0/3930989714 >> 172.21.15.7:0/3930989714 conn(0x55babad974e0 msgr2=0x55babad67ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 -- 172.21.15.7:0/3930989714 shutdown_connections 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.431+0000 7f1e7e10df40 1 -- 172.21.15.7:0/3930989714 wait complete. 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.432+0000 7f1e7e10df40 1 Processor -- start 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.432+0000 7f1e7e10df40 1 -- start start 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7e10df40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad98f40 0x55babae34120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7e10df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad9a5b0 0x55babae34660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7e10df40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 0x55babae3e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7e10df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55babad97c10 con 0x55babad9a5b0 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7e10df40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55babae38e70 con 0x55babad9a990 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7e10df40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55babae34e50 con 0x55babad98f40 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad9a5b0 0x55babae34660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad9a5b0 0x55babae34660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39930/0 (socket says 172.21.15.7:39930) 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7aa00640 1 -- 172.21.15.7:0/746226818 learned_addr learned my addr 172.21.15.7:0/746226818 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7b400640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad98f40 0x55babae34120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.433+0000 7f1e7be00640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 0x55babae3e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7aa00640 1 -- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad98f40 msgr2=0x55babae34120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7aa00640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad98f40 0x55babae34120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7aa00640 1 -- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 msgr2=0x55babae3e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7aa00640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55babad9a990 0x55babae3e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7aa00640 1 -- 172.21.15.7:0/746226818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babacd0080 con 0x55babad9a5b0 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7b400640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55babad98f40 0x55babae34120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7aa00640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad9a5b0 0x55babae34660 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1e68025a80 tx=0x7f1e68002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e73e00640 1 -- 172.21.15.7:0/746226818 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68063030 con 0x55babad9a5b0 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e73e00640 1 -- 172.21.15.7:0/746226818 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e680547f0 con 0x55babad9a5b0 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55babaed09b0 con 0x55babad9a5b0 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.434+0000 7f1e73e00640 1 -- 172.21.15.7:0/746226818 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68059040 con 0x55babad9a5b0 2024-08-19T00:43:37.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.435+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babae35110 con 0x55babad9a5b0 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.437+0000 7f1e73e00640 1 -- 172.21.15.7:0/746226818 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e68066030 con 0x55babad9a5b0 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.437+0000 7f1e73e00640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e5c06a810 0x7f1e5c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.438+0000 7f1e73e00640 1 -- 172.21.15.7:0/746226818 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1e680cd190 con 0x55babad9a5b0 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.438+0000 7f1e7b400640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e5c06a810 0x7f1e5c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.438+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55babaecdb60 0x55babae37f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.438+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55babad953d0 con 0x55babaecdb60 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.438+0000 7f1e7be00640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55babaecdb60 0x55babae37f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.438+0000 7f1e7b400640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e5c06a810 0x7f1e5c06ccd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c001e60 tx=0x7f1e6c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7be00640 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55babaecdb60 0x55babae37f10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7be00640 1 -- 172.21.15.7:0/746226818 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x7f1e74002ab0 con 0x55babaecdb60 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:header (274 bytes) : 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000000 04 03 0c 01 00 00 0b 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000020 00 00 00 00 37 95 c2 66 25 0f 43 02 01 00 00 00 |....7..f%.C.....| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000030 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00 |................| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000050 00 00 37 95 c2 66 25 0f 43 02 01 00 00 00 00 00 |..7..f%.C.......| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000060 00 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00 |................| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000080 00 00 60 00 00 00 00 00 01 00 00 00 00 00 00 00 |..`.............| 2024-08-19T00:43:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:000000a0 00 00 00 00 00 00 00 00 37 95 c2 66 11 5e 68 04 |........7..f.^h.| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:000000c0 60 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 |`...............| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:000000e0 00 00 00 00 00 00 37 95 c2 66 11 5e 68 04 00 00 |......7..f.^h...| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:* 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:00000110 00 00 |..| 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout:00000112 2024-08-19T00:43:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55babaecdb60 msgr2=0x55babae37f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55babaecdb60 0x55babae37f10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e5c06a810 msgr2=0x7f1e5c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e5c06a810 0x7f1e5c06ccd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c001e60 tx=0x7f1e6c009000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad9a5b0 msgr2=0x55babae34660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 --2- 172.21.15.7:0/746226818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55babad9a5b0 0x55babae34660 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1e68025a80 tx=0x7f1e68002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7be00640 1 -- 172.21.15.7:0/746226818 reap_dead start 2024-08-19T00:43:37.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 shutdown_connections 2024-08-19T00:43:37.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.439+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 >> 172.21.15.7:0/746226818 conn(0x55babad974e0 msgr2=0x55babae3f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.440+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 shutdown_connections 2024-08-19T00:43:37.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.440+0000 7f1e7e10df40 1 -- 172.21.15.7:0/746226818 wait complete. 2024-08-19T00:43:37.447 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 600.00000000 2024-08-19T00:43:37.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.521+0000 7f9f959b7f40 1 Processor -- start 2024-08-19T00:43:37.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.521+0000 7f9f959b7f40 1 -- start start 2024-08-19T00:43:37.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f959b7f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f3ef40 0x555fc6fd8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f959b7f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f405b0 0x555fc6f3c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f959b7f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f959b7f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fc6eb4d00 con 0x555fc6f405b0 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f959b7f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555fc6eb8d40 con 0x555fc6f40990 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f959b7f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555fc6fe5dc0 con 0x555fc6f3ef40 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f405b0 0x555fc6f3c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f405b0 0x555fc6f3c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39936/0 (socket says 172.21.15.7:39936) 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 -- 172.21.15.7:0/1435549486 learned_addr learned my addr 172.21.15.7:0/1435549486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92c00640 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f3ef40 0x555fc6fd8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f93600640 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 -- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f3ef40 msgr2=0x555fc6fd8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f3ef40 0x555fc6fd8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 -- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 msgr2=0x555fc6fd70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f92200640 1 -- 172.21.15.7:0/1435549486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fc6e76080 con 0x555fc6f405b0 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.522+0000 7f9f93600640 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f92200640 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f405b0 0x555fc6f3c5b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9f80001d70 tx=0x7f9f8000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e93a6a1652f31f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f90e00640 1 -- 172.21.15.7:0/1435549486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000bd60 con 0x555fc6f405b0 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f90e00640 1 -- 172.21.15.7:0/1435549486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f8000f400 con 0x555fc6f405b0 2024-08-19T00:43:37.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f90e00640 1 -- 172.21.15.7:0/1435549486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000f7f0 con 0x555fc6f405b0 2024-08-19T00:43:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 -- 172.21.15.7:0/1435549486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f405b0 msgr2=0x555fc6f3c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f405b0 0x555fc6f3c5b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9f80001d70 tx=0x7f9f8000b5b0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 -- 172.21.15.7:0/1435549486 shutdown_connections 2024-08-19T00:43:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f405b0 0x555fc6f3c5b0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/1435549486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f3ef40 0x555fc6fd8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 -- 172.21.15.7:0/1435549486 >> 172.21.15.7:0/1435549486 conn(0x555fc6f3d4e0 msgr2=0x555fc6f0d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.523+0000 7f9f959b7f40 1 -- 172.21.15.7:0/1435549486 shutdown_connections 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.524+0000 7f9f959b7f40 1 -- 172.21.15.7:0/1435549486 wait complete. 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.524+0000 7f9f959b7f40 1 Processor -- start 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.524+0000 7f9f959b7f40 1 -- start start 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f959b7f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f3ef40 0x555fc6f3cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f959b7f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f405b0 0x555fc6fe2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f959b7f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f959b7f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fc6f0de80 con 0x555fc6f3ef40 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f959b7f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555fc6f0e400 con 0x555fc6f40990 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f959b7f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555fc6fe6920 con 0x555fc6f405b0 2024-08-19T00:43:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f92c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f3ef40 0x555fc6f3cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f92c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f3ef40 0x555fc6f3cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39950/0 (socket says 172.21.15.7:39950) 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.525+0000 7f9f92c00640 1 -- 172.21.15.7:0/3354078500 learned_addr learned my addr 172.21.15.7:0/3354078500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92200640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f405b0 0x555fc6fe2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f93600640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92c00640 1 -- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f405b0 msgr2=0x555fc6fe2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92c00640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f405b0 0x555fc6fe2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92c00640 1 -- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 msgr2=0x555fc6fd8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92c00640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92c00640 1 -- 172.21.15.7:0/3354078500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fc6fd66a0 con 0x555fc6f3ef40 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92200640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555fc6f405b0 0x555fc6fe2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f93600640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555fc6f40990 0x555fc6fd8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f92c00640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f3ef40 0x555fc6f3cbc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9f84045960 tx=0x7f9f84003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f8b400640 1 -- 172.21.15.7:0/3354078500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84064030 con 0x555fc6f3ef40 2024-08-19T00:43:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f8b400640 1 -- 172.21.15.7:0/3354078500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f84054930 con 0x555fc6f3ef40 2024-08-19T00:43:37.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.526+0000 7f9f8b400640 1 -- 172.21.15.7:0/3354078500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84059040 con 0x555fc6f3ef40 2024-08-19T00:43:37.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.527+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fc6fe5790 con 0x555fc6f3ef40 2024-08-19T00:43:37.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.527+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fc6fd70a0 con 0x555fc6f3ef40 2024-08-19T00:43:37.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.528+0000 7f9f8b400640 1 -- 172.21.15.7:0/3354078500 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f84067030 con 0x555fc6f3ef40 2024-08-19T00:43:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.529+0000 7f9f8b400640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9f7406a810 0x7f9f7406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.529+0000 7f9f8b400640 1 -- 172.21.15.7:0/3354078500 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f9f840cd800 con 0x555fc6f3ef40 2024-08-19T00:43:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.529+0000 7f9f92200640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9f7406a810 0x7f9f7406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.530+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x555fc6fd6b50 0x555fc707ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.530+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0d82a743:::600.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x555fc6f0d990 con 0x555fc6fd6b50 2024-08-19T00:43:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.530+0000 7f9f93600640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x555fc6fd6b50 0x555fc707ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.530+0000 7f9f92200640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9f7406a810 0x7f9f7406ccd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x555fc6f0ed10 tx=0x7f9f80009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f93600640 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x555fc6fd6b50 0x555fc707ed20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f93600640 1 -- 172.21.15.7:0/3354078500 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 600.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f9f8c0044c0 con 0x555fc6fd6b50 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:header (274 bytes) : 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:00000000 04 03 0c 01 00 00 01 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:* 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:* 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:00000080 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:* 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:* 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:00000110 00 00 |..| 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout:00000112 2024-08-19T00:43:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x555fc6fd6b50 msgr2=0x555fc707ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x555fc6fd6b50 0x555fc707ed20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9f7406a810 msgr2=0x7f9f7406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9f7406a810 0x7f9f7406ccd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x555fc6f0ed10 tx=0x7f9f80009000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f3ef40 msgr2=0x555fc6f3cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 --2- 172.21.15.7:0/3354078500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fc6f3ef40 0x555fc6f3cbc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9f84045960 tx=0x7f9f84003020 comp rx=0 tx=0).stop 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f93600640 1 -- 172.21.15.7:0/3354078500 reap_dead start 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 shutdown_connections 2024-08-19T00:43:37.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 >> 172.21.15.7:0/3354078500 conn(0x555fc6f3d4e0 msgr2=0x555fc6fe6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 shutdown_connections 2024-08-19T00:43:37.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.531+0000 7f9f959b7f40 1 -- 172.21.15.7:0/3354078500 wait complete. 2024-08-19T00:43:37.540 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 1.00000000.inode 2024-08-19T00:43:37.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.614+0000 7f1fc53c7f40 1 Processor -- start 2024-08-19T00:43:37.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.614+0000 7f1fc53c7f40 1 -- start start 2024-08-19T00:43:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc53c7f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e1f40 0x564e8c589d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc53c7f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e35b0 0x564e8c58a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc53c7f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 0x564e8c57a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc53c7f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564e8c4e28c0 con 0x564e8c4e1f40 2024-08-19T00:43:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc53c7f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564e8c457d00 con 0x564e8c4e3990 2024-08-19T00:43:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc53c7f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564e8c588dc0 con 0x564e8c4e35b0 2024-08-19T00:43:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e1f40 0x564e8c589d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e1f40 0x564e8c589d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39956/0 (socket says 172.21.15.7:39956) 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 -- 172.21.15.7:0/2784020983 learned_addr learned my addr 172.21.15.7:0/2784020983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc3000640 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 0x564e8c57a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc1c00640 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e35b0 0x564e8c58a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 -- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e35b0 msgr2=0x564e8c58a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e35b0 0x564e8c58a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 -- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 msgr2=0x564e8c57a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 0x564e8c57a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc2600640 1 -- 172.21.15.7:0/2784020983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e8c3dcb30 con 0x564e8c4e1f40 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.615+0000 7f1fc1c00640 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e35b0 0x564e8c58a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.616+0000 7f1fc2600640 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e1f40 0x564e8c589d10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400b3f0 tx=0x7f1fb400b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c973593c4204de78 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.616+0000 7f1fbbe00640 1 -- 172.21.15.7:0/2784020983 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4012020 con 0x564e8c4e1f40 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.616+0000 7f1fbbe00640 1 -- 172.21.15.7:0/2784020983 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb400d690 con 0x564e8c4e1f40 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.616+0000 7f1fbbe00640 1 -- 172.21.15.7:0/2784020983 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb400da80 con 0x564e8c4e1f40 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.616+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/2784020983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e1f40 msgr2=0x564e8c589d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.616+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e1f40 0x564e8c589d10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400b3f0 tx=0x7f1fb400b7f0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/2784020983 shutdown_connections 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 0x564e8c57a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e35b0 0x564e8c58a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/2784020983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e1f40 0x564e8c589d10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/2784020983 >> 172.21.15.7:0/2784020983 conn(0x564e8c4e04e0 msgr2=0x564e8c4fb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/2784020983 shutdown_connections 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/2784020983 wait complete. 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.617+0000 7f1fc53c7f40 1 Processor -- start 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.618+0000 7f1fc53c7f40 1 -- start start 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.618+0000 7f1fc53c7f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e1f40 0x564e8c568a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.618+0000 7f1fc53c7f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e35b0 0x564e8c588260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.618+0000 7f1fc53c7f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 0x564e8c61ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.618+0000 7f1fc53c7f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564e8c4e0310 con 0x564e8c4e35b0 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.618+0000 7f1fc53c7f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564e8c58a250 con 0x564e8c4e3990 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.618+0000 7f1fc53c7f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564e8c4dffd0 con 0x564e8c4e1f40 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e35b0 0x564e8c588260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e35b0 0x564e8c588260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39970/0 (socket says 172.21.15.7:39970) 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 -- 172.21.15.7:0/743539334 learned_addr learned my addr 172.21.15.7:0/743539334 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc2600640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e1f40 0x564e8c568a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc3000640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 0x564e8c61ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 -- 172.21.15.7:0/743539334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e1f40 msgr2=0x564e8c568a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564e8c4e1f40 0x564e8c568a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 -- 172.21.15.7:0/743539334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 msgr2=0x564e8c61ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e8c4e3990 0x564e8c61ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.619+0000 7f1fc1c00640 1 -- 172.21.15.7:0/743539334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e8c419080 con 0x564e8c4e35b0 2024-08-19T00:43:37.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.620+0000 7f1fc1c00640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e35b0 0x564e8c588260 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0025960 tx=0x7f1fb0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.620+0000 7f1fbaa00640 1 -- 172.21.15.7:0/743539334 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0064070 con 0x564e8c4e35b0 2024-08-19T00:43:37.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.620+0000 7f1fbaa00640 1 -- 172.21.15.7:0/743539334 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb005a040 con 0x564e8c4e35b0 2024-08-19T00:43:37.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.620+0000 7f1fbaa00640 1 -- 172.21.15.7:0/743539334 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0059040 con 0x564e8c4e35b0 2024-08-19T00:43:37.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.620+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e8c61f4e0 con 0x564e8c4e35b0 2024-08-19T00:43:37.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.620+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e8c6130b0 con 0x564e8c4e35b0 2024-08-19T00:43:37.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.622+0000 7f1fbaa00640 1 -- 172.21.15.7:0/743539334 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fb0067070 con 0x564e8c4e35b0 2024-08-19T00:43:37.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.623+0000 7f1fbaa00640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1fa406a810 0x7f1fa406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.623+0000 7f1fbaa00640 1 -- 172.21.15.7:0/743539334 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1fb00cd810 con 0x564e8c4e35b0 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.623+0000 7f1fc2600640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1fa406a810 0x7f1fa406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.623+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564e8c564fc0 0x564e8c613b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.623+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x564e8c6140d0 con 0x564e8c564fc0 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.623+0000 7f1fc3000640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564e8c564fc0 0x564e8c613b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc2600640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1fa406a810 0x7f1fa406ccd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400b3f0 tx=0x7f1fb4009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc3000640 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564e8c564fc0 0x564e8c613b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc3000640 1 -- 172.21.15.7:0/743539334 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 1.00000000.inode [omap-get-header] v0'0 uv15 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1fbc00ac10 con 0x564e8c564fc0 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564e8c564fc0 msgr2=0x564e8c613b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564e8c564fc0 0x564e8c613b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1fa406a810 msgr2=0x7f1fa406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1fa406a810 0x7f1fa406ccd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400b3f0 tx=0x7f1fb4009000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e35b0 msgr2=0x564e8c588260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc53c7f40 1 --2- 172.21.15.7:0/743539334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e8c4e35b0 0x564e8c588260 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0025960 tx=0x7f1fb0002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.624+0000 7f1fc3000640 1 -- 172.21.15.7:0/743539334 reap_dead start 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.625+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 shutdown_connections 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.625+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 >> 172.21.15.7:0/743539334 conn(0x564e8c4e04e0 msgr2=0x564e8c4ddf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.625+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 shutdown_connections 2024-08-19T00:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.625+0000 7f1fc53c7f40 1 -- 172.21.15.7:0/743539334 wait complete. 2024-08-19T00:43:37.631 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 200.00000000 2024-08-19T00:43:37.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.705+0000 7f1658b1ef40 1 Processor -- start 2024-08-19T00:43:37.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.706+0000 7f1658b1ef40 1 -- start start 2024-08-19T00:43:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.706+0000 7f1658b1ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d844d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.706+0000 7f1658b1ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad5b0 0x556a3d848870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.706+0000 7f1658b1ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad990 0x556a3d853800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.706+0000 7f1658b1ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556a3d721d00 con 0x556a3d7ad990 2024-08-19T00:43:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.706+0000 7f1658b1ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556a3d725d40 con 0x556a3d7ad5b0 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.706+0000 7f1658b1ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556a3d852dc0 con 0x556a3d7abf40 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad990 0x556a3d853800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d844d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad990 0x556a3d853800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39988/0 (socket says 172.21.15.7:39988) 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 -- 172.21.15.7:0/3167214152 learned_addr learned my addr 172.21.15.7:0/3167214152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f164fe00640 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad5b0 0x556a3d848870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 -- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 msgr2=0x556a3d844d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d844d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 -- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad5b0 msgr2=0x556a3d848870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad5b0 0x556a3d848870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 -- 172.21.15.7:0/3167214152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3d6e3080 con 0x556a3d7ad990 2024-08-19T00:43:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f164fe00640 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad5b0 0x556a3d848870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.707+0000 7f1655c00640 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad990 0x556a3d853800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f1650002630 tx=0x7f1650002af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47060c92a02fe94c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f164ea00640 1 -- 172.21.15.7:0/3167214152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650016070 con 0x556a3d7ad990 2024-08-19T00:43:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f164ea00640 1 -- 172.21.15.7:0/3167214152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1650003690 con 0x556a3d7ad990 2024-08-19T00:43:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f164ea00640 1 -- 172.21.15.7:0/3167214152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650003a80 con 0x556a3d7ad990 2024-08-19T00:43:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3167214152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad990 msgr2=0x556a3d853800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad990 0x556a3d853800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f1650002630 tx=0x7f1650002af0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3167214152 shutdown_connections 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad990 0x556a3d853800 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad5b0 0x556a3d848870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3167214152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d844d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3167214152 >> 172.21.15.7:0/3167214152 conn(0x556a3d7aa4e0 msgr2=0x556a3d8548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3167214152 shutdown_connections 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.708+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3167214152 wait complete. 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.709+0000 7f1658b1ef40 1 Processor -- start 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.709+0000 7f1658b1ef40 1 -- start start 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1658b1ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d841540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1658b1ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad5b0 0x556a3d8546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1658b1ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad990 0x556a3d854c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1658b1ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556a3d855440 con 0x556a3d7ad5b0 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1658b1ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556a3d7c7fe0 con 0x556a3d7ad990 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1658b1ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556a3d7c7d00 con 0x556a3d7abf40 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f164fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad5b0 0x556a3d8546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f164fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad5b0 0x556a3d8546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39994/0 (socket says 172.21.15.7:39994) 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f164fe00640 1 -- 172.21.15.7:0/3158884879 learned_addr learned my addr 172.21.15.7:0/3158884879 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1655200640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d841540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.710+0000 7f1655c00640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad990 0x556a3d854c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164fe00640 1 -- 172.21.15.7:0/3158884879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 msgr2=0x556a3d841540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164fe00640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d841540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164fe00640 1 -- 172.21.15.7:0/3158884879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad990 msgr2=0x556a3d854c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164fe00640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a3d7ad990 0x556a3d854c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164fe00640 1 -- 172.21.15.7:0/3158884879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3d84b370 con 0x556a3d7ad5b0 2024-08-19T00:43:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f1655200640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556a3d7abf40 0x556a3d841540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164fe00640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad5b0 0x556a3d8546f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f164000ddf0 tx=0x7f164000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164d600640 1 -- 172.21.15.7:0/3158884879 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640014020 con 0x556a3d7ad5b0 2024-08-19T00:43:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164d600640 1 -- 172.21.15.7:0/3158884879 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1640010630 con 0x556a3d7ad5b0 2024-08-19T00:43:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f164d600640 1 -- 172.21.15.7:0/3158884879 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640010a00 con 0x556a3d7ad5b0 2024-08-19T00:43:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.711+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a3d77b1a0 con 0x556a3d7ad5b0 2024-08-19T00:43:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.712+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3d841a80 con 0x556a3d7ad5b0 2024-08-19T00:43:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.713+0000 7f164d600640 1 -- 172.21.15.7:0/3158884879 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1640017020 con 0x556a3d7ad5b0 2024-08-19T00:43:37.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.714+0000 7f164d600640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f163406a840 0x7f163406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.714+0000 7f164d600640 1 -- 172.21.15.7:0/3158884879 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1640089e80 con 0x556a3d7ad5b0 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.715+0000 7f1655200640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f163406a840 0x7f163406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.715+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556a3d841da0 0x556a3d84a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.715+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:292cf221:::200.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x556a3d8556c0 con 0x556a3d841da0 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.715+0000 7f1655c00640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556a3d841da0 0x556a3d84a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.715+0000 7f1655200640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f163406a840 0x7f163406cd00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1648057000 tx=0x7f1648052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1655c00640 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556a3d841da0 0x556a3d84a240 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1655c00640 1 -- 172.21.15.7:0/3158884879 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000000 [omap-get-header] v0'0 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1650004030 con 0x556a3d841da0 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:37.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556a3d841da0 msgr2=0x556a3d84a240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556a3d841da0 0x556a3d84a240 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f163406a840 msgr2=0x7f163406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f163406a840 0x7f163406cd00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1648057000 tx=0x7f1648052000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad5b0 msgr2=0x556a3d8546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 --2- 172.21.15.7:0/3158884879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556a3d7ad5b0 0x556a3d8546f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f164000ddf0 tx=0x7f164000b600 comp rx=0 tx=0).stop 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1655c00640 1 -- 172.21.15.7:0/3158884879 reap_dead start 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 shutdown_connections 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 >> 172.21.15.7:0/3158884879 conn(0x556a3d7aa4e0 msgr2=0x556a3d8e1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 shutdown_connections 2024-08-19T00:43:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.716+0000 7f1658b1ef40 1 -- 172.21.15.7:0/3158884879 wait complete. 2024-08-19T00:43:37.723 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 200.00000001 2024-08-19T00:43:37.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.797+0000 7fbb8aa0bf40 1 Processor -- start 2024-08-19T00:43:37.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.797+0000 7fbb8aa0bf40 1 -- start start 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb8aa0bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dcbfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb8aa0bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 0x559d3dd5b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb8aa0bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 0x559d3dc91ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb8aa0bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559d3dcc38f0 con 0x559d3dcc2f40 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb8aa0bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d3dc38d00 con 0x559d3dcc4990 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb8aa0bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559d3dd69dc0 con 0x559d3dcc45b0 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb87000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dcbfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb87000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dcbfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40008/0 (socket says 172.21.15.7:40008) 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb87000640 1 -- 172.21.15.7:0/3767070236 learned_addr learned my addr 172.21.15.7:0/3767070236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb86600640 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 0x559d3dd5b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.798+0000 7fbb87a00640 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 0x559d3dc91ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb87000640 1 -- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 msgr2=0x559d3dd5b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb87000640 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 0x559d3dd5b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb87000640 1 -- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 msgr2=0x559d3dc91ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb87000640 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 0x559d3dc91ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb87000640 1 -- 172.21.15.7:0/3767070236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d3dbbdb30 con 0x559d3dcc2f40 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb87000640 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dcbfc40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbb78001e30 tx=0x7fbb7800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6846c95c5ef928 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb85200640 1 -- 172.21.15.7:0/3767070236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78012020 con 0x559d3dcc2f40 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb85200640 1 -- 172.21.15.7:0/3767070236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7800e670 con 0x559d3dcc2f40 2024-08-19T00:43:37.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.799+0000 7fbb85200640 1 -- 172.21.15.7:0/3767070236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800eac0 con 0x559d3dcc2f40 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/3767070236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 msgr2=0x559d3dcbfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dcbfc40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbb78001e30 tx=0x7fbb7800b780 comp rx=0 tx=0).stop 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/3767070236 shutdown_connections 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 0x559d3dc91ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 0x559d3dd5b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/3767070236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dcbfc40 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/3767070236 >> 172.21.15.7:0/3767070236 conn(0x559d3dcc14e0 msgr2=0x559d3dcc18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/3767070236 shutdown_connections 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.800+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/3767070236 wait complete. 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.801+0000 7fbb8aa0bf40 1 Processor -- start 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.801+0000 7fbb8aa0bf40 1 -- start start 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.801+0000 7fbb8aa0bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dd5b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb8aa0bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 0x559d3dd57630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb8aa0bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 0x559d3dd5a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb8aa0bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559d3dcdd030 con 0x559d3dcc2f40 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb8aa0bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d3dd5bab0 con 0x559d3dcc4990 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb8aa0bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559d3dd627e0 con 0x559d3dcc45b0 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dd5b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dd5b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40012/0 (socket says 172.21.15.7:40012) 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 -- 172.21.15.7:0/2122020726 learned_addr learned my addr 172.21.15.7:0/2122020726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb86600640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 0x559d3dd57630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87a00640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 0x559d3dd5a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 -- 172.21.15.7:0/2122020726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 msgr2=0x559d3dd57630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559d3dcc45b0 0x559d3dd57630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 -- 172.21.15.7:0/2122020726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 msgr2=0x559d3dd5a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3dcc4990 0x559d3dd5a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.802+0000 7fbb87000640 1 -- 172.21.15.7:0/2122020726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d3dbfa080 con 0x559d3dcc2f40 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.803+0000 7fbb87000640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dd5b570 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x559d3dbb7280 tx=0x7fbb78000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.803+0000 7fbb7f400640 1 -- 172.21.15.7:0/2122020726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78027070 con 0x559d3dcc2f40 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.803+0000 7fbb7f400640 1 -- 172.21.15.7:0/2122020726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7800e470 con 0x559d3dcc2f40 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.803+0000 7fbb7f400640 1 -- 172.21.15.7:0/2122020726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78017850 con 0x559d3dcc2f40 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.803+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d3dd5bfe0 con 0x559d3dcc2f40 2024-08-19T00:43:37.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.803+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d3dd59ee0 con 0x559d3dcc2f40 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.805+0000 7fbb7f400640 1 -- 172.21.15.7:0/2122020726 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb7802a070 con 0x559d3dcc2f40 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.806+0000 7fbb7f400640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbb6806a810 0x7fbb6806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.806+0000 7fbb7f400640 1 -- 172.21.15.7:0/2122020726 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fbb7808afe0 con 0x559d3dcc2f40 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.806+0000 7fbb86600640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbb6806a810 0x7fbb6806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.806+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559d3dd5af00 0x559d3dd60a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.806+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:2e2fa760:::200.00000001:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x559d3dd6ad90 con 0x559d3dd5af00 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.806+0000 7fbb87a00640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559d3dd5af00 0x559d3dd60a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb86600640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbb6806a810 0x7fbb6806ccd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbb74056000 tx=0x7fbb74050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb87a00640 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559d3dd5af00 0x559d3dd60a00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb87a00640 1 -- 172.21.15.7:0/2122020726 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000001 [omap-get-header] v0'0 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbb8000ac10 con 0x559d3dd5af00 2024-08-19T00:43:37.811 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:37.811 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559d3dd5af00 msgr2=0x559d3dd60a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559d3dd5af00 0x559d3dd60a00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbb6806a810 msgr2=0x7fbb6806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbb6806a810 0x7fbb6806ccd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbb74056000 tx=0x7fbb74050000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 msgr2=0x559d3dd5b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 --2- 172.21.15.7:0/2122020726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d3dcc2f40 0x559d3dd5b570 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x559d3dbb7280 tx=0x7fbb78000bc0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb87a00640 1 -- 172.21.15.7:0/2122020726 reap_dead start 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 shutdown_connections 2024-08-19T00:43:37.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 >> 172.21.15.7:0/2122020726 conn(0x559d3dcc14e0 msgr2=0x559d3dcc18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.807+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 shutdown_connections 2024-08-19T00:43:37.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.808+0000 7fbb8aa0bf40 1 -- 172.21.15.7:0/2122020726 wait complete. 2024-08-19T00:43:37.814 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_openfiles.0 2024-08-19T00:43:37.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.887+0000 7f8a60625f40 1 Processor -- start 2024-08-19T00:43:37.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.888+0000 7f8a60625f40 1 -- start start 2024-08-19T00:43:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.888+0000 7f8a60625f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a55b0 0x55ca1414cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.888+0000 7f8a60625f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140a5990 0x55ca140a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.888+0000 7f8a60625f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140bd8d0 0x55ca1413c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.888+0000 7f8a60625f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ca1414adc0 con 0x55ca140a55b0 2024-08-19T00:43:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.888+0000 7f8a60625f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca14019d00 con 0x55ca140a5990 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.888+0000 7f8a60625f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ca1414b0a0 con 0x55ca140bd8d0 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a55b0 0x55ca1414cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a55b0 0x55ca1414cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40028/0 (socket says 172.21.15.7:40028) 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 -- 172.21.15.7:0/3826470757 learned_addr learned my addr 172.21.15.7:0/3826470757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5e200640 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140bd8d0 0x55ca1413c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5ce00640 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140a5990 0x55ca140a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 -- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140bd8d0 msgr2=0x55ca1413c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140bd8d0 0x55ca1413c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 -- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140a5990 msgr2=0x55ca140a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140a5990 0x55ca140a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 -- 172.21.15.7:0/3826470757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca13f9eb30 con 0x55ca140a55b0 2024-08-19T00:43:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5e200640 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140bd8d0 0x55ca1413c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5ce00640 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140a5990 0x55ca140a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.889+0000 7f8a5d800640 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a55b0 0x55ca1414cd50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098e0 tx=0x7f8a50005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cac1cd15ca4524 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a57400640 1 -- 172.21.15.7:0/3826470757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50008950 con 0x55ca140a55b0 2024-08-19T00:43:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a57400640 1 -- 172.21.15.7:0/3826470757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a50018070 con 0x55ca140a55b0 2024-08-19T00:43:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a57400640 1 -- 172.21.15.7:0/3826470757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50008d30 con 0x55ca140a55b0 2024-08-19T00:43:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 -- 172.21.15.7:0/3826470757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a55b0 msgr2=0x55ca1414cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a55b0 0x55ca1414cd50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098e0 tx=0x7f8a50005a00 comp rx=0 tx=0).stop 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 -- 172.21.15.7:0/3826470757 shutdown_connections 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140bd8d0 0x55ca1413c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140a5990 0x55ca140a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 --2- 172.21.15.7:0/3826470757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a55b0 0x55ca1414cd50 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 -- 172.21.15.7:0/3826470757 >> 172.21.15.7:0/3826470757 conn(0x55ca140a24e0 msgr2=0x55ca14072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 -- 172.21.15.7:0/3826470757 shutdown_connections 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.890+0000 7f8a60625f40 1 -- 172.21.15.7:0/3826470757 wait complete. 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.891+0000 7f8a60625f40 1 Processor -- start 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.891+0000 7f8a60625f40 1 -- start start 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a60625f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140a55b0 0x55ca14139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a60625f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a5990 0x55ca140726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a60625f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140bd8d0 0x55ca14072c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a60625f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ca1414d290 con 0x55ca140a5990 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a60625f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca1414bb40 con 0x55ca140bd8d0 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a60625f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ca14143770 con 0x55ca140a55b0 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a5ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a5990 0x55ca140726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a5ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a5990 0x55ca140726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40038/0 (socket says 172.21.15.7:40038) 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a5ce00640 1 -- 172.21.15.7:0/2556442729 learned_addr learned my addr 172.21.15.7:0/2556442729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.892+0000 7f8a5d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140a55b0 0x55ca14139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a5e200640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140bd8d0 0x55ca14072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a5ce00640 1 -- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140a55b0 msgr2=0x55ca14139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a5ce00640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ca140a55b0 0x55ca14139640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a5ce00640 1 -- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140bd8d0 msgr2=0x55ca14072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a5ce00640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca140bd8d0 0x55ca14072c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a5ce00640 1 -- 172.21.15.7:0/2556442729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca13fdb080 con 0x55ca140a5990 2024-08-19T00:43:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a5ce00640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a5990 0x55ca140726d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c025ca0 tx=0x7f8a4c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.893+0000 7f8a56000640 1 -- 172.21.15.7:0/2556442729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c06b070 con 0x55ca140a5990 2024-08-19T00:43:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.894+0000 7f8a56000640 1 -- 172.21.15.7:0/2556442729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c0527d0 con 0x55ca140a5990 2024-08-19T00:43:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.894+0000 7f8a56000640 1 -- 172.21.15.7:0/2556442729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c056070 con 0x55ca140a5990 2024-08-19T00:43:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.894+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca141d3e50 con 0x55ca140a5990 2024-08-19T00:43:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.894+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca141d4410 con 0x55ca140a5990 2024-08-19T00:43:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.895+0000 7f8a56000640 1 -- 172.21.15.7:0/2556442729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a4c06e070 con 0x55ca140a5990 2024-08-19T00:43:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.896+0000 7f8a56000640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4006a810 0x7f8a4006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.896+0000 7f8a56000640 1 -- 172.21.15.7:0/2556442729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f8a4c0cd670 con 0x55ca140a5990 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.897+0000 7f8a5d800640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4006a810 0x7f8a4006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.897+0000 7f8a60625f40 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ca14147fe0 0x55ca141483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.897+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.6 12:654134d2:::mds0_openfiles.0:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55ca14148900 con 0x55ca14147fe0 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.897+0000 7f8a5e200640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ca14147fe0 0x55ca141483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.897+0000 7f8a5d800640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4006a810 0x7f8a4006ccd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a50015040 tx=0x7f8a50011000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a5e200640 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ca14147fe0 0x55ca141483c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a5e200640 1 -- 172.21.15.7:0/2556442729 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-get-header out=42b] v0'0 uv4 ondisk = 0) ==== 160+0+42 (crc 0 0 0) 0x7f8a58004540 con 0x55ca14147fe0 2024-08-19T00:43:37.901 INFO:teuthology.orchestra.run.smithi007.stdout:header (42 bytes) : 2024-08-19T00:43:37.902 INFO:teuthology.orchestra.run.smithi007.stdout:00000000 13 00 00 00 63 65 70 68 20 66 73 20 76 6f 6c 75 |....ceph fs volu| 2024-08-19T00:43:37.902 INFO:teuthology.orchestra.run.smithi007.stdout:00000010 6d 65 20 76 30 31 31 01 01 0d 00 00 00 04 00 00 |me v011.........| 2024-08-19T00:43:37.902 INFO:teuthology.orchestra.run.smithi007.stdout:00000020 00 00 00 00 00 01 00 00 00 00 |..........| 2024-08-19T00:43:37.902 INFO:teuthology.orchestra.run.smithi007.stdout:0000002a 2024-08-19T00:43:37.902 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ca14147fe0 msgr2=0x55ca141483c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ca14147fe0 0x55ca141483c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4006a810 msgr2=0x7f8a4006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4006a810 0x7f8a4006ccd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a50015040 tx=0x7f8a50011000 comp rx=0 tx=0).stop 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a5990 msgr2=0x55ca140726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 --2- 172.21.15.7:0/2556442729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca140a5990 0x55ca140726d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c025ca0 tx=0x7f8a4c002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a5e200640 1 -- 172.21.15.7:0/2556442729 reap_dead start 2024-08-19T00:43:37.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 shutdown_connections 2024-08-19T00:43:37.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 >> 172.21.15.7:0/2556442729 conn(0x55ca140a24e0 msgr2=0x55ca1414bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 shutdown_connections 2024-08-19T00:43:37.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.898+0000 7f8a60625f40 1 -- 172.21.15.7:0/2556442729 wait complete. 2024-08-19T00:43:37.905 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 500.00000000 2024-08-19T00:43:37.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.979+0000 7f118ce45f40 1 Processor -- start 2024-08-19T00:43:37.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.979+0000 7f118ce45f40 1 -- start start 2024-08-19T00:43:37.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118ce45f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4eff40 0x55c96f588cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118ce45f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4f15b0 0x55c96f4beef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118ce45f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f4bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118ce45f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c96f4f08f0 con 0x55c96f4f1990 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118ce45f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c96f465d00 con 0x55c96f4eff40 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118ce45f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c96f596dc0 con 0x55c96f4f15b0 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f4bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f4bf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40050/0 (socket says 172.21.15.7:40050) 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 -- 172.21.15.7:0/2607033647 learned_addr learned my addr 172.21.15.7:0/2607033647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f1189600640 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4f15b0 0x55c96f4beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118a000640 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4eff40 0x55c96f588cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 -- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4f15b0 msgr2=0x55c96f4beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4f15b0 0x55c96f4beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 -- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4eff40 msgr2=0x55c96f588cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4eff40 0x55c96f588cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.980+0000 7f118aa00640 1 -- 172.21.15.7:0/2607033647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c96f3eab30 con 0x55c96f4f1990 2024-08-19T00:43:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118aa00640 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f4bf430 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1184002850 tx=0x7f1184002d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bed377395f3d8d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f1183e00640 1 -- 172.21.15.7:0/2607033647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1184016020 con 0x55c96f4f1990 2024-08-19T00:43:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f1183e00640 1 -- 172.21.15.7:0/2607033647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118400d9c0 con 0x55c96f4f1990 2024-08-19T00:43:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f1183e00640 1 -- 172.21.15.7:0/2607033647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118400ddb0 con 0x55c96f4f1990 2024-08-19T00:43:37.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118ce45f40 1 -- 172.21.15.7:0/2607033647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 msgr2=0x55c96f4bf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f4bf430 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1184002850 tx=0x7f1184002d10 comp rx=0 tx=0).stop 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118ce45f40 1 -- 172.21.15.7:0/2607033647 shutdown_connections 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f4bf430 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4f15b0 0x55c96f4beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2607033647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4eff40 0x55c96f588cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.981+0000 7f118ce45f40 1 -- 172.21.15.7:0/2607033647 >> 172.21.15.7:0/2607033647 conn(0x55c96f4ee4e0 msgr2=0x55c96f4ee8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.982+0000 7f118ce45f40 1 -- 172.21.15.7:0/2607033647 shutdown_connections 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.982+0000 7f118ce45f40 1 -- 172.21.15.7:0/2607033647 wait complete. 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.982+0000 7f118ce45f40 1 Processor -- start 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.982+0000 7f118ce45f40 1 -- start start 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.983+0000 7f118ce45f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4eff40 0x55c96f5844d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.983+0000 7f118ce45f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4f15b0 0x55c96f5855f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.983+0000 7f118ce45f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f50ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.983+0000 7f118ce45f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c96f595e80 con 0x55c96f4f1990 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.983+0000 7f118ce45f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c96f58cb30 con 0x55c96f4f15b0 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.983+0000 7f118ce45f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c96f58f730 con 0x55c96f4eff40 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.983+0000 7f118aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f50ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f1189600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4f15b0 0x55c96f5855f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f118a000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4eff40 0x55c96f5844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f118aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f50ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40062/0 (socket says 172.21.15.7:40062) 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f118aa00640 1 -- 172.21.15.7:0/2751131824 learned_addr learned my addr 172.21.15.7:0/2751131824 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f1189600640 1 -- 172.21.15.7:0/2751131824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4eff40 msgr2=0x55c96f5844d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f1189600640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4eff40 0x55c96f5844d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f1189600640 1 -- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 msgr2=0x55c96f50ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f1189600640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f50ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f1189600640 1 -- 172.21.15.7:0/2751131824 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c96f427080 con 0x55c96f4f15b0 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f118a000640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c96f4eff40 0x55c96f5844d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f118aa00640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96f4f1990 0x55c96f50ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.984+0000 7f1189600640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4f15b0 0x55c96f5855f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55c96f590a40 tx=0x7f117800b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.985+0000 7f1182a00640 1 -- 172.21.15.7:0/2751131824 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117800f650 con 0x55c96f4f15b0 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.985+0000 7f1182a00640 1 -- 172.21.15.7:0/2751131824 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117800f7f0 con 0x55c96f4f15b0 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.985+0000 7f1182a00640 1 -- 172.21.15.7:0/2751131824 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117800fbe0 con 0x55c96f4f15b0 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.985+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c96f591960 con 0x55c96f4f15b0 2024-08-19T00:43:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.985+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c96f585e20 con 0x55c96f4f15b0 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.987+0000 7f1182a00640 1 -- 172.21.15.7:0/2751131824 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11780203f0 con 0x55c96f4f15b0 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.987+0000 7f1182a00640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f116c06a810 0x7f116c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.988+0000 7f1182a00640 1 -- 172.21.15.7:0/2751131824 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f117808a250 con 0x55c96f4f15b0 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.988+0000 7f118a000640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f116c06a810 0x7f116c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.988+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c96f50b070 0x55c96f589690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.988+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:1 12.15 12:aa448500:::500.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55c96f62fcb0 con 0x55c96f50b070 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.988+0000 7f118aa00640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c96f50b070 0x55c96f589690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.988+0000 7f118a000640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f116c06a810 0x7f116c06ccd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55c96f50d8f0 tx=0x7f117c056040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118aa00640 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c96f50b070 0x55c96f589690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:37.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118aa00640 1 -- 172.21.15.7:0/2751131824 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(1 500.00000000 [omap-get-header] v0'0 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f11840125f0 con 0x55c96f50b070 2024-08-19T00:43:37.993 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:37.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c96f50b070 msgr2=0x55c96f589690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c96f50b070 0x55c96f589690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f116c06a810 msgr2=0x7f116c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f116c06a810 0x7f116c06ccd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55c96f50d8f0 tx=0x7f117c056040 comp rx=0 tx=0).stop 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4f15b0 msgr2=0x55c96f5855f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 --2- 172.21.15.7:0/2751131824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c96f4f15b0 0x55c96f5855f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55c96f590a40 tx=0x7f117800b6c0 comp rx=0 tx=0).stop 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118aa00640 1 -- 172.21.15.7:0/2751131824 reap_dead start 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 shutdown_connections 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 >> 172.21.15.7:0/2751131824 conn(0x55c96f4ee4e0 msgr2=0x55c96f5978b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 shutdown_connections 2024-08-19T00:43:37.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:37.989+0000 7f118ce45f40 1 -- 172.21.15.7:0/2751131824 wait complete. 2024-08-19T00:43:37.996 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds_snaptable 2024-08-19T00:43:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.069+0000 7f7ae7d1df40 1 Processor -- start 2024-08-19T00:43:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.069+0000 7f7ae7d1df40 1 -- start start 2024-08-19T00:43:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.070+0000 7f7ae7d1df40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c06ff40 0x557e5c117e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.070+0000 7f7ae7d1df40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c1088a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.070+0000 7f7ae7d1df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c071990 0x557e5c10a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.070+0000 7f7ae7d1df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e5c0708f0 con 0x557e5c071990 2024-08-19T00:43:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.070+0000 7f7ae7d1df40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e5bfe5d00 con 0x557e5c0715b0 2024-08-19T00:43:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.070+0000 7f7ae7d1df40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e5c116dc0 con 0x557e5c06ff40 2024-08-19T00:43:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.070+0000 7f7ae5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c071990 0x557e5c10a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c071990 0x557e5c10a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40076/0 (socket says 172.21.15.7:40076) 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 -- 172.21.15.7:0/3728566012 learned_addr learned my addr 172.21.15.7:0/3728566012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5000640 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c06ff40 0x557e5c117e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 -- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c06ff40 msgr2=0x557e5c117e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7adfe00640 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c1088a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c06ff40 0x557e5c117e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 -- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 msgr2=0x557e5c1088a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c1088a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 -- 172.21.15.7:0/3728566012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5bf6ab30 con 0x557e5c071990 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5000640 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c06ff40 0x557e5c117e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7adfe00640 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c1088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7ae5a00640 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c071990 0x557e5c10a660 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b610 tx=0x7f7ae000bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a184cefda676692 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7adea00640 1 -- 172.21.15.7:0/3728566012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0014020 con 0x557e5c071990 2024-08-19T00:43:38.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7adea00640 1 -- 172.21.15.7:0/3728566012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae0010820 con 0x557e5c071990 2024-08-19T00:43:38.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.071+0000 7f7adea00640 1 -- 172.21.15.7:0/3728566012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0010c10 con 0x557e5c071990 2024-08-19T00:43:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3728566012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c071990 msgr2=0x557e5c10a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c071990 0x557e5c10a660 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b610 tx=0x7f7ae000bad0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3728566012 shutdown_connections 2024-08-19T00:43:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c071990 0x557e5c10a660 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c1088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3728566012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c06ff40 0x557e5c117e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3728566012 >> 172.21.15.7:0/3728566012 conn(0x557e5c06e4e0 msgr2=0x557e5c08a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3728566012 shutdown_connections 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.072+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3728566012 wait complete. 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.073+0000 7f7ae7d1df40 1 Processor -- start 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.073+0000 7f7ae7d1df40 1 -- start start 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae7d1df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c06ff40 0x557e5c03f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae7d1df40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae7d1df40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c071990 0x557e5c1a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae7d1df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e5c10c640 con 0x557e5c06ff40 2024-08-19T00:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae7d1df40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e5c08b050 con 0x557e5c0715b0 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae7d1df40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e5c08b2a0 con 0x557e5c071990 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c06ff40 0x557e5c03f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c06ff40 0x557e5c03f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40080/0 (socket says 172.21.15.7:40080) 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae5000640 1 -- 172.21.15.7:0/3721642793 learned_addr learned my addr 172.21.15.7:0/3721642793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7ae5a00640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c071990 0x557e5c1a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.074+0000 7f7adfe00640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae5000640 1 -- 172.21.15.7:0/3721642793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c071990 msgr2=0x557e5c1a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae5000640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e5c071990 0x557e5c1a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae5000640 1 -- 172.21.15.7:0/3721642793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 msgr2=0x557e5c100970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae5000640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5c0715b0 0x557e5c100970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae5000640 1 -- 172.21.15.7:0/3721642793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5bfa7080 con 0x557e5c06ff40 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae5000640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c06ff40 0x557e5c03f9b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8000c00 tx=0x7f7ad8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7add600640 1 -- 172.21.15.7:0/3721642793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8056040 con 0x557e5c06ff40 2024-08-19T00:43:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7add600640 1 -- 172.21.15.7:0/3721642793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8052c70 con 0x557e5c06ff40 2024-08-19T00:43:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7add600640 1 -- 172.21.15.7:0/3721642793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8067640 con 0x557e5c06ff40 2024-08-19T00:43:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e5c107850 con 0x557e5c06ff40 2024-08-19T00:43:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.075+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5c107af0 con 0x557e5c06ff40 2024-08-19T00:43:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.077+0000 7f7add600640 1 -- 172.21.15.7:0/3721642793 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ad8059020 con 0x557e5c06ff40 2024-08-19T00:43:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.078+0000 7f7add600640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ac406a840 0x7f7ac406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.078+0000 7f7add600640 1 -- 172.21.15.7:0/3721642793 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f7ad80cdfe0 con 0x557e5c06ff40 2024-08-19T00:43:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.078+0000 7f7adfe00640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ac406a840 0x7f7ac406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.078+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e5c06df90 0x557e5c10ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.078+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.d 12:b50e409b:::mds_snaptable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x557e5c10b160 con 0x557e5c06df90 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.079+0000 7f7ae5a00640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e5c06df90 0x557e5c10ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.079+0000 7f7adfe00640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ac406a840 0x7f7ac406cd00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x557e5c08b760 tx=0x7f7ad0001820 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.079+0000 7f7ae5a00640 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e5c06df90 0x557e5c10ac20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae5a00640 1 -- 172.21.15.7:0/3721642793 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 mds_snaptable [omap-get-header] v0'0 uv1 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ae00109d0 con 0x557e5c06df90 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e5c06df90 msgr2=0x557e5c10ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e5c06df90 0x557e5c10ac20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ac406a840 msgr2=0x7f7ac406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ac406a840 0x7f7ac406cd00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x557e5c08b760 tx=0x7f7ad0001820 comp rx=0 tx=0).stop 2024-08-19T00:43:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c06ff40 msgr2=0x557e5c03f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 --2- 172.21.15.7:0/3721642793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e5c06ff40 0x557e5c03f9b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8000c00 tx=0x7f7ad8002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae5a00640 1 -- 172.21.15.7:0/3721642793 reap_dead start 2024-08-19T00:43:38.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 shutdown_connections 2024-08-19T00:43:38.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 >> 172.21.15.7:0/3721642793 conn(0x557e5c06e4e0 msgr2=0x557e5c108c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 shutdown_connections 2024-08-19T00:43:38.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.080+0000 7f7ae7d1df40 1 -- 172.21.15.7:0/3721642793 wait complete. 2024-08-19T00:43:38.087 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_inotable 2024-08-19T00:43:38.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.160+0000 7fe056e28f40 1 Processor -- start 2024-08-19T00:43:38.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.160+0000 7fe056e28f40 1 -- start start 2024-08-19T00:43:38.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe056e28f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd30f40 0x555e4ddd09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe056e28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd325b0 0x555e4dd2dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe056e28f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dcff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe056e28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555e4dca6d00 con 0x555e4dd325b0 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe056e28f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555e4dcaad40 con 0x555e4dd32990 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe056e28f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555e4ddd7dc0 con 0x555e4dd30f40 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd325b0 0x555e4dd2dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd325b0 0x555e4dd2dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40098/0 (socket says 172.21.15.7:40098) 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 -- 172.21.15.7:0/2933673429 learned_addr learned my addr 172.21.15.7:0/2933673429 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe054000640 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd30f40 0x555e4ddd09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 -- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd30f40 msgr2=0x555e4ddd09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe054a00640 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dcff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd30f40 0x555e4ddd09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 -- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 msgr2=0x555e4dcff6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dcff6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe053600640 1 -- 172.21.15.7:0/2933673429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e4dc68080 con 0x555e4dd325b0 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe054000640 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd30f40 0x555e4ddd09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.161+0000 7fe054a00640 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dcff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe053600640 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd325b0 0x555e4dd2dc40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe04000b260 tx=0x7fe04000b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3fbdabd47f587d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe052200640 1 -- 172.21.15.7:0/2933673429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04000e5c0 con 0x555e4dd325b0 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe052200640 1 -- 172.21.15.7:0/2933673429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe040006070 con 0x555e4dd325b0 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe052200640 1 -- 172.21.15.7:0/2933673429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04000e960 con 0x555e4dd325b0 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe056e28f40 1 -- 172.21.15.7:0/2933673429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd325b0 msgr2=0x555e4dd2dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd325b0 0x555e4dd2dc40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe04000b260 tx=0x7fe04000b720 comp rx=0 tx=0).stop 2024-08-19T00:43:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe056e28f40 1 -- 172.21.15.7:0/2933673429 shutdown_connections 2024-08-19T00:43:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dcff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd325b0 0x555e4dd2dc40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2933673429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd30f40 0x555e4ddd09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.162+0000 7fe056e28f40 1 -- 172.21.15.7:0/2933673429 >> 172.21.15.7:0/2933673429 conn(0x555e4dd2f4e0 msgr2=0x555e4dd4ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.163+0000 7fe056e28f40 1 -- 172.21.15.7:0/2933673429 shutdown_connections 2024-08-19T00:43:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.163+0000 7fe056e28f40 1 -- 172.21.15.7:0/2933673429 wait complete. 2024-08-19T00:43:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.163+0000 7fe056e28f40 1 Processor -- start 2024-08-19T00:43:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.163+0000 7fe056e28f40 1 -- start start 2024-08-19T00:43:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.164+0000 7fe056e28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd30f40 0x555e4ddcd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.164+0000 7fe056e28f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd325b0 0x555e4dd4bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.164+0000 7fe056e28f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dd4c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.164+0000 7fe056e28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555e4ddd1580 con 0x555e4dd30f40 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.164+0000 7fe056e28f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555e4ddd8930 con 0x555e4dd32990 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.164+0000 7fe056e28f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555e4ddd4270 con 0x555e4dd325b0 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.164+0000 7fe054000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd30f40 0x555e4ddcd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd30f40 0x555e4ddcd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40102/0 (socket says 172.21.15.7:40102) 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 -- 172.21.15.7:0/2676423918 learned_addr learned my addr 172.21.15.7:0/2676423918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe053600640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd325b0 0x555e4dd4bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054a00640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dd4c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 -- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd325b0 msgr2=0x555e4dd4bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e4dd325b0 0x555e4dd4bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 -- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 msgr2=0x555e4dd4c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e4dd32990 0x555e4dd4c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 -- 172.21.15.7:0/2676423918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e4ddcfca0 con 0x555e4dd30f40 2024-08-19T00:43:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.165+0000 7fe054000640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd30f40 0x555e4ddcd320 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe044002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.166+0000 7fe050e00640 1 -- 172.21.15.7:0/2676423918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04406a070 con 0x555e4dd30f40 2024-08-19T00:43:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.166+0000 7fe050e00640 1 -- 172.21.15.7:0/2676423918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe044051bf0 con 0x555e4dd30f40 2024-08-19T00:43:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.166+0000 7fe050e00640 1 -- 172.21.15.7:0/2676423918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04405a450 con 0x555e4dd30f40 2024-08-19T00:43:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.166+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e4ddcff80 con 0x555e4dd30f40 2024-08-19T00:43:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.166+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e4dd4ce10 con 0x555e4dd30f40 2024-08-19T00:43:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.168+0000 7fe050e00640 1 -- 172.21.15.7:0/2676423918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe044058070 con 0x555e4dd30f40 2024-08-19T00:43:38.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.168+0000 7fe050e00640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe03406a810 0x7fe03406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.168+0000 7fe050e00640 1 -- 172.21.15.7:0/2676423918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fe0440cd940 con 0x555e4dd30f40 2024-08-19T00:43:38.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.169+0000 7fe053600640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe03406a810 0x7fe03406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.169+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x555e4ddce370 0x555e4ddce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.169+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x555e4ddd8e50 con 0x555e4ddce370 2024-08-19T00:43:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.169+0000 7fe054a00640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x555e4ddce370 0x555e4ddce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.169+0000 7fe053600640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe03406a810 0x7fe03406ccd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe04000b260 tx=0x7fe040009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.170+0000 7fe054a00640 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x555e4ddce370 0x555e4ddce750 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.170+0000 7fe054a00640 1 -- 172.21.15.7:0/2676423918 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 mds0_inotable [omap-get-header] v0'0 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe04c002700 con 0x555e4ddce370 2024-08-19T00:43:38.174 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:38.174 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.170+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x555e4ddce370 msgr2=0x555e4ddce750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.170+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x555e4ddce370 0x555e4ddce750 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe03406a810 msgr2=0x7fe03406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe03406a810 0x7fe03406ccd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe04000b260 tx=0x7fe040009000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd30f40 msgr2=0x555e4ddcd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 --2- 172.21.15.7:0/2676423918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e4dd30f40 0x555e4ddcd320 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe044002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe054a00640 1 -- 172.21.15.7:0/2676423918 reap_dead start 2024-08-19T00:43:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 shutdown_connections 2024-08-19T00:43:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 >> 172.21.15.7:0/2676423918 conn(0x555e4dd2f4e0 msgr2=0x555e4ddd3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 shutdown_connections 2024-08-19T00:43:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.171+0000 7fe056e28f40 1 -- 172.21.15.7:0/2676423918 wait complete. 2024-08-19T00:43:38.178 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 100.00000000 2024-08-19T00:43:38.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.251+0000 7f259e1e6f40 1 Processor -- start 2024-08-19T00:43:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.251+0000 7f259e1e6f40 1 -- start start 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259e1e6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffa9650 0x55bdf0041590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259e1e6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa5b0 0x55bdf0047750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259e1e6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffaa990 0x55bdf0047c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259e1e6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bdeff1ed00 con 0x55bdeffaa5b0 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259e1e6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bdeff22d40 con 0x55bdeffa9650 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259e1e6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55bdf004fdc0 con 0x55bdeffaa990 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa5b0 0x55bdf0047750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffaa990 0x55bdf0047c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa5b0 0x55bdf0047750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40110/0 (socket says 172.21.15.7:40110) 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259aa00640 1 -- 172.21.15.7:0/1005097920 learned_addr learned my addr 172.21.15.7:0/1005097920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffa9650 0x55bdf0041590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259aa00640 1 -- 172.21.15.7:0/1005097920 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffaa990 msgr2=0x55bdf0047c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259aa00640 1 --2- 172.21.15.7:0/1005097920 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffaa990 0x55bdf0047c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259aa00640 1 -- 172.21.15.7:0/1005097920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffa9650 msgr2=0x55bdf0041590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.252+0000 7f259aa00640 1 --2- 172.21.15.7:0/1005097920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffa9650 0x55bdf0041590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.253+0000 7f259aa00640 1 -- 172.21.15.7:0/1005097920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdefee0080 con 0x55bdeffaa5b0 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.253+0000 7f259aa00640 1 --2- 172.21.15.7:0/1005097920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa5b0 0x55bdf0047750 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2588001e00 tx=0x7f258800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53740a6100dbff3d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.253+0000 7f2599600640 1 -- 172.21.15.7:0/1005097920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258800be40 con 0x55bdeffaa5b0 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.253+0000 7f2599600640 1 -- 172.21.15.7:0/1005097920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258800f400 con 0x55bdeffaa5b0 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.253+0000 7f2599600640 1 -- 172.21.15.7:0/1005097920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258800f7b0 con 0x55bdeffaa5b0 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1005097920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa5b0 msgr2=0x55bdf0047750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1005097920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa5b0 0x55bdf0047750 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2588001e00 tx=0x7f258800b670 comp rx=0 tx=0).stop 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1005097920 shutdown_connections 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1005097920 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffaa990 0x55bdf0047c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1005097920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa5b0 0x55bdf0047750 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1005097920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffa9650 0x55bdf0041590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1005097920 >> 172.21.15.7:0/1005097920 conn(0x55bdeffa74e0 msgr2=0x55bdeff776a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1005097920 shutdown_connections 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1005097920 wait complete. 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.254+0000 7f259e1e6f40 1 Processor -- start 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.255+0000 7f259e1e6f40 1 -- start start 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.255+0000 7f259e1e6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffa9650 0x55bdf003e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.255+0000 7f259e1e6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffaa5b0 0x55bdf004a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.255+0000 7f259e1e6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa990 0x55bdf004a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.255+0000 7f259e1e6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bdf0050810 con 0x55bdeffaa990 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.255+0000 7f259e1e6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bdf00505c0 con 0x55bdeffaa5b0 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.255+0000 7f259e1e6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55bdeff78090 con 0x55bdeffa9650 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa990 0x55bdf004a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa990 0x55bdf004a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40118/0 (socket says 172.21.15.7:40118) 2024-08-19T00:43:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 -- 172.21.15.7:0/1838865657 learned_addr learned my addr 172.21.15.7:0/1838865657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259aa00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffaa5b0 0x55bdf004a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259b400640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffa9650 0x55bdf003e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 -- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffa9650 msgr2=0x55bdf003e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffa9650 0x55bdf003e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 -- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffaa5b0 msgr2=0x55bdf004a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffaa5b0 0x55bdf004a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 -- 172.21.15.7:0/1838865657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf0042270 con 0x55bdeffaa990 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259b400640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bdeffa9650 0x55bdf003e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259aa00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdeffaa5b0 0x55bdf004a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.256+0000 7f259be00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa990 0x55bdf004a790 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2594055040 tx=0x7f2594003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.257+0000 7f2593e00640 1 -- 172.21.15.7:0/1838865657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259406b070 con 0x55bdeffaa990 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.257+0000 7f2593e00640 1 -- 172.21.15.7:0/1838865657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594052c40 con 0x55bdeffaa990 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.257+0000 7f2593e00640 1 -- 172.21.15.7:0/1838865657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594056040 con 0x55bdeffaa990 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.257+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdf00472e0 con 0x55bdeffaa990 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.257+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdf00449e0 con 0x55bdeffaa990 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.259+0000 7f2593e00640 1 -- 172.21.15.7:0/1838865657 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f259406e070 con 0x55bdeffaa990 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.259+0000 7f2593e00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f257c06a840 0x7f257c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.260+0000 7f2593e00640 1 -- 172.21.15.7:0/1838865657 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f25940cd330 con 0x55bdeffaa990 2024-08-19T00:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.260+0000 7f259b400640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f257c06a840 0x7f257c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.260+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55bdf0047dc0 0x55bdf00460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.260+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55bdf00e8e90 con 0x55bdf0047dc0 2024-08-19T00:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.260+0000 7f259aa00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55bdf0047dc0 0x55bdf00460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.260+0000 7f259b400640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f257c06a840 0x7f257c06cd00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f258c000fd0 tx=0x7f258c001690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.261+0000 7f259aa00640 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55bdf0047dc0 0x55bdf00460e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.261+0000 7f259aa00640 1 -- 172.21.15.7:0/1838865657 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x7f258800f5b0 con 0x55bdf0047dc0 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:header (274 bytes) : 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000000 04 03 0c 01 00 00 01 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000030 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000060 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000080 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:00000090 0a 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:000000a0 00 00 00 00 00 00 00 00 2f 95 c2 66 cb da fe 0d |......../..f....| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0a 00 |................| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:000000e0 00 00 00 00 00 00 2f 95 c2 66 cb da fe 0d 00 00 |....../..f......| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:* 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:00000110 00 00 |..| 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout:00000112 2024-08-19T00:43:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55bdf0047dc0 msgr2=0x55bdf00460e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55bdf0047dc0 0x55bdf00460e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f257c06a840 msgr2=0x7f257c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f257c06a840 0x7f257c06cd00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f258c000fd0 tx=0x7f258c001690 comp rx=0 tx=0).stop 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa990 msgr2=0x55bdf004a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 --2- 172.21.15.7:0/1838865657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bdeffaa990 0x55bdf004a790 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2594055040 tx=0x7f2594003330 comp rx=0 tx=0).stop 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259be00640 1 -- 172.21.15.7:0/1838865657 reap_dead start 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 shutdown_connections 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 >> 172.21.15.7:0/1838865657 conn(0x55bdeffa74e0 msgr2=0x55bdeffa6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 shutdown_connections 2024-08-19T00:43:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.262+0000 7f259e1e6f40 1 -- 172.21.15.7:0/1838865657 wait complete. 2024-08-19T00:43:38.269 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_sessionmap 2024-08-19T00:43:38.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.343+0000 7f81dcb20f40 1 Processor -- start 2024-08-19T00:43:38.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.343+0000 7f81dcb20f40 1 -- start start 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81dcb20f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 0x557e74d8fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81dcb20f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74d90990 0x557e74e281c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81dcb20f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74da88d0 0x557e74e2ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81dcb20f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e74e35dc0 con 0x557e74da88d0 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81dcb20f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e74d04d00 con 0x557e74d905b0 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81dcb20f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e74e360a0 con 0x557e74d90990 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81d9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74da88d0 0x557e74e2ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81d9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74da88d0 0x557e74e2ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40128/0 (socket says 172.21.15.7:40128) 2024-08-19T00:43:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.344+0000 7f81d9c00640 1 -- 172.21.15.7:0/1911217842 learned_addr learned my addr 172.21.15.7:0/1911217842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d3e00640 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74d90990 0x557e74e281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d9200640 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 0x557e74d8fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d9c00640 1 -- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74d90990 msgr2=0x557e74e281c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d9c00640 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74d90990 0x557e74e281c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d9c00640 1 -- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 msgr2=0x557e74d8fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d9c00640 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 0x557e74d8fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d9c00640 1 -- 172.21.15.7:0/1911217842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e74c89b30 con 0x557e74da88d0 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d9c00640 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74da88d0 0x557e74e2ad40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f81d40015c0 tx=0x7f81d4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59f911f8766cf47 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d2a00640 1 -- 172.21.15.7:0/1911217842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4003650 con 0x557e74da88d0 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d2a00640 1 -- 172.21.15.7:0/1911217842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d40037f0 con 0x557e74da88d0 2024-08-19T00:43:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.345+0000 7f81d2a00640 1 -- 172.21.15.7:0/1911217842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4003c20 con 0x557e74da88d0 2024-08-19T00:43:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1911217842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74da88d0 msgr2=0x557e74e2ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74da88d0 0x557e74e2ad40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f81d40015c0 tx=0x7f81d4001a80 comp rx=0 tx=0).stop 2024-08-19T00:43:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1911217842 shutdown_connections 2024-08-19T00:43:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74da88d0 0x557e74e2ad40 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74d90990 0x557e74e281c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1911217842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 0x557e74d8fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1911217842 >> 172.21.15.7:0/1911217842 conn(0x557e74d8d4e0 msgr2=0x557e74da8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1911217842 shutdown_connections 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.346+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1911217842 wait complete. 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.347+0000 7f81dcb20f40 1 Processor -- start 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.347+0000 7f81dcb20f40 1 -- start start 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81dcb20f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 0x557e74e25ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81dcb20f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74d90990 0x557e74ece460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81dcb20f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74da88d0 0x557e74da9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81dcb20f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e74d8b590 con 0x557e74d90990 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81dcb20f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e74d90160 con 0x557e74d905b0 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81dcb20f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e74d8b830 con 0x557e74da88d0 2024-08-19T00:43:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74d90990 0x557e74ece460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74d90990 0x557e74ece460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40136/0 (socket says 172.21.15.7:40136) 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 -- 172.21.15.7:0/1670947286 learned_addr learned my addr 172.21.15.7:0/1670947286 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d9c00640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74da88d0 0x557e74da9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d9200640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 0x557e74e25ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 -- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74da88d0 msgr2=0x557e74da9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e74da88d0 0x557e74da9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 -- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 msgr2=0x557e74e25ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e74d905b0 0x557e74e25ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.348+0000 7f81d3e00640 1 -- 172.21.15.7:0/1670947286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e74cc6080 con 0x557e74d90990 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.349+0000 7f81d3e00640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74d90990 0x557e74ece460 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009f50 tx=0x7f81c40084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.349+0000 7f81d1600640 1 -- 172.21.15.7:0/1670947286 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4014600 con 0x557e74d90990 2024-08-19T00:43:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.349+0000 7f81d1600640 1 -- 172.21.15.7:0/1670947286 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c4019070 con 0x557e74d90990 2024-08-19T00:43:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.349+0000 7f81d1600640 1 -- 172.21.15.7:0/1670947286 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c40149a0 con 0x557e74d90990 2024-08-19T00:43:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.349+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e74e265d0 con 0x557e74d90990 2024-08-19T00:43:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.349+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e74e26b90 con 0x557e74d90990 2024-08-19T00:43:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.351+0000 7f81d1600640 1 -- 172.21.15.7:0/1670947286 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81c4013070 con 0x557e74d90990 2024-08-19T00:43:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.352+0000 7f81d1600640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81b806a810 0x7f81b806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.352+0000 7f81d1600640 1 -- 172.21.15.7:0/1670947286 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f81c4089890 con 0x557e74d90990 2024-08-19T00:43:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.352+0000 7f81d9200640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81b806a810 0x7f81b806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.352+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e74e279c0 0x557e74e27da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.352+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:1 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x557e74e282e0 con 0x557e74e279c0 2024-08-19T00:43:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.352+0000 7f81d9c00640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e74e279c0 0x557e74e27da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.353+0000 7f81d9200640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81b806a810 0x7f81b806ccd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f81cc057000 tx=0x7f81cc061040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.353+0000 7f81d9c00640 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e74e279c0 0x557e74e27da0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.357 INFO:teuthology.orchestra.run.smithi007.stdout:header (14 bytes) : 2024-08-19T00:43:38.357 INFO:teuthology.orchestra.run.smithi007.stdout:00000000 01 01 08 00 00 00 04 00 00 00 00 00 00 00 |..............| 2024-08-19T00:43:38.357 INFO:teuthology.orchestra.run.smithi007.stdout:0000000e 2024-08-19T00:43:38.357 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.353+0000 7f81d9c00640 1 -- 172.21.15.7:0/1670947286 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x7f81d400f030 con 0x557e74e279c0 2024-08-19T00:43:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e74e279c0 msgr2=0x557e74e27da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e74e279c0 0x557e74e27da0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81b806a810 msgr2=0x7f81b806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81b806a810 0x7f81b806ccd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f81cc057000 tx=0x7f81cc061040 comp rx=0 tx=0).stop 2024-08-19T00:43:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74d90990 msgr2=0x557e74ece460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 --2- 172.21.15.7:0/1670947286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e74d90990 0x557e74ece460 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009f50 tx=0x7f81c40084c0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81d9c00640 1 -- 172.21.15.7:0/1670947286 reap_dead start 2024-08-19T00:43:38.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 shutdown_connections 2024-08-19T00:43:38.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 >> 172.21.15.7:0/1670947286 conn(0x557e74d8d4e0 msgr2=0x557e74e35150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 shutdown_connections 2024-08-19T00:43:38.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.354+0000 7f81dcb20f40 1 -- 172.21.15.7:0/1670947286 wait complete. 2024-08-19T00:43:38.361 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 400.00000000 2024-08-19T00:43:38.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.435+0000 7f52fe126f40 1 Processor -- start 2024-08-19T00:43:38.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.435+0000 7f52fe126f40 1 -- start start 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.435+0000 7f52fe126f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52e0003630 0x55fac508ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.435+0000 7f52fe126f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fac5167460 0x55fac5158260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fe126f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 0x55fac50daae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fe126f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fac50c18f0 con 0x7f52e0003630 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fe126f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fac5036d00 con 0x55fac50da650 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fe126f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55fac5167dc0 con 0x55fac5167460 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52e0003630 0x55fac508ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52e0003630 0x55fac508ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40160/0 (socket says 172.21.15.7:40160) 2024-08-19T00:43:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 -- 172.21.15.7:0/2455617235 learned_addr learned my addr 172.21.15.7:0/2455617235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52f9e00640 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fac5167460 0x55fac5158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fb200640 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 0x55fac50daae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 -- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fac5167460 msgr2=0x55fac5158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fac5167460 0x55fac5158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 -- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 msgr2=0x55fac50daae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 0x55fac50daae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 -- 172.21.15.7:0/2455617235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac4fbbb30 con 0x7f52e0003630 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.436+0000 7f52fa800640 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52e0003630 0x55fac508ffa0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009900 tx=0x7f52ec005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e9ddf6d03357a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52f8a00640 1 -- 172.21.15.7:0/2455617235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec019030 con 0x7f52e0003630 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52f8a00640 1 -- 172.21.15.7:0/2455617235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec008870 con 0x7f52e0003630 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52f8a00640 1 -- 172.21.15.7:0/2455617235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec008c40 con 0x7f52e0003630 2024-08-19T00:43:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 -- 172.21.15.7:0/2455617235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52e0003630 msgr2=0x55fac508ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52e0003630 0x55fac508ffa0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009900 tx=0x7f52ec005a00 comp rx=0 tx=0).stop 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 -- 172.21.15.7:0/2455617235 shutdown_connections 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 0x55fac50daae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fac5167460 0x55fac5158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 --2- 172.21.15.7:0/2455617235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52e0003630 0x55fac508ffa0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 -- 172.21.15.7:0/2455617235 >> 172.21.15.7:0/2455617235 conn(0x55fac50bf4e0 msgr2=0x55fac50bd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 -- 172.21.15.7:0/2455617235 shutdown_connections 2024-08-19T00:43:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.437+0000 7f52fe126f40 1 -- 172.21.15.7:0/2455617235 wait complete. 2024-08-19T00:43:38.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.438+0000 7f52fe126f40 1 Processor -- start 2024-08-19T00:43:38.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.438+0000 7f52fe126f40 1 -- start start 2024-08-19T00:43:38.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fe126f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 0x55fac50bd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fe126f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fac5167460 0x55fac5158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fe126f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e0003630 0x55fac51571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fe126f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fac50bfc10 con 0x55fac5167460 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fe126f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fac50bedc0 con 0x55fac50da650 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fe126f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55fac508fa40 con 0x7f52e0003630 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52f9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fac5167460 0x55fac5158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52f9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fac5167460 0x55fac5158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40162/0 (socket says 172.21.15.7:40162) 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52f9e00640 1 -- 172.21.15.7:0/3234582157 learned_addr learned my addr 172.21.15.7:0/3234582157 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fb200640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e0003630 0x55fac51571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.439+0000 7f52fa800640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 0x55fac50bd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f9e00640 1 -- 172.21.15.7:0/3234582157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e0003630 msgr2=0x55fac51571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f9e00640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e0003630 0x55fac51571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f9e00640 1 -- 172.21.15.7:0/3234582157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 msgr2=0x55fac50bd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f9e00640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fac50da650 0x55fac50bd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f9e00640 1 -- 172.21.15.7:0/3234582157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac4ff8080 con 0x55fac5167460 2024-08-19T00:43:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f9e00640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fac5167460 0x55fac5158450 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f52e8010540 tx=0x7f52e80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f3400640 1 -- 172.21.15.7:0/3234582157 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e800e990 con 0x55fac5167460 2024-08-19T00:43:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f3400640 1 -- 172.21.15.7:0/3234582157 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e800eb30 con 0x55fac5167460 2024-08-19T00:43:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52f3400640 1 -- 172.21.15.7:0/3234582157 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8019440 con 0x55fac5167460 2024-08-19T00:43:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fac515ef10 con 0x55fac5167460 2024-08-19T00:43:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.440+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac515f4d0 con 0x55fac5167460 2024-08-19T00:43:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.442+0000 7f52f3400640 1 -- 172.21.15.7:0/3234582157 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52e8022440 con 0x55fac5167460 2024-08-19T00:43:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.443+0000 7f52f3400640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f52dc06a810 0x7f52dc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.443+0000 7f52f3400640 1 -- 172.21.15.7:0/3234582157 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f52e808ab20 con 0x55fac5167460 2024-08-19T00:43:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.443+0000 7f52fa800640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f52dc06a810 0x7f52dc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.443+0000 7f52fe126f40 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55fac5158990 0x55fac515d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.443+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55fac515da30 con 0x55fac5158990 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.444+0000 7f52fb200640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55fac5158990 0x55fac515d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.444+0000 7f52fa800640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f52dc06a810 0x7f52dc06ccd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f52ec006010 tx=0x7f52ec015000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.444+0000 7f52fb200640 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55fac5158990 0x55fac515d4f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fb200640 1 -- 172.21.15.7:0/3234582157 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 400.00000000 [omap-get-header] v0'0 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f52f4005040 con 0x55fac5158990 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:38.448 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55fac5158990 msgr2=0x55fac515d4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55fac5158990 0x55fac515d4f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f52dc06a810 msgr2=0x7f52dc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f52dc06a810 0x7f52dc06ccd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f52ec006010 tx=0x7f52ec015000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fac5167460 msgr2=0x55fac5158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 --2- 172.21.15.7:0/3234582157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fac5167460 0x55fac5158450 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f52e8010540 tx=0x7f52e80017a0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fb200640 1 -- 172.21.15.7:0/3234582157 reap_dead start 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 shutdown_connections 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 >> 172.21.15.7:0/3234582157 conn(0x55fac50bf4e0 msgr2=0x55fac50be310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 shutdown_connections 2024-08-19T00:43:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.445+0000 7f52fe126f40 1 -- 172.21.15.7:0/3234582157 wait complete. 2024-08-19T00:43:38.452 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 100.00000000.inode 2024-08-19T00:43:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.525+0000 7f69325b1f40 1 Processor -- start 2024-08-19T00:43:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.525+0000 7f69325b1f40 1 -- start start 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f69325b1f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c83f40 0x55d7e7d237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f69325b1f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c855b0 0x55d7e7d0f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f69325b1f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c85990 0x55d7e7c52640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f69325b1f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d7e7c848f0 con 0x55d7e7c85990 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f69325b1f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d7e7bf9d00 con 0x55d7e7c855b0 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f69325b1f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d7e7d2adc0 con 0x55d7e7c83f40 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f6930200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c85990 0x55d7e7c52640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f6930200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c85990 0x55d7e7c52640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40174/0 (socket says 172.21.15.7:40174) 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f6930200640 1 -- 172.21.15.7:0/521303237 learned_addr learned my addr 172.21.15.7:0/521303237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f692f800640 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c83f40 0x55d7e7d237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.526+0000 7f692ee00640 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c855b0 0x55d7e7d0f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f6930200640 1 -- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c83f40 msgr2=0x55d7e7d237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f6930200640 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c83f40 0x55d7e7d237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f6930200640 1 -- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c855b0 msgr2=0x55d7e7d0f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f6930200640 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c855b0 0x55d7e7d0f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f6930200640 1 -- 172.21.15.7:0/521303237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e7b7eb30 con 0x55d7e7c85990 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f692ee00640 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c855b0 0x55d7e7d0f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f6930200640 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c85990 0x55d7e7c52640 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6928005fd0 tx=0x7f6928050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f948337d013baaf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f692da00640 1 -- 172.21.15.7:0/521303237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928067070 con 0x55d7e7c85990 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f692da00640 1 -- 172.21.15.7:0/521303237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692804fb60 con 0x55d7e7c85990 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.527+0000 7f692da00640 1 -- 172.21.15.7:0/521303237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928062400 con 0x55d7e7c85990 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 -- 172.21.15.7:0/521303237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c85990 msgr2=0x55d7e7c52640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c85990 0x55d7e7c52640 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6928005fd0 tx=0x7f6928050000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 -- 172.21.15.7:0/521303237 shutdown_connections 2024-08-19T00:43:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c85990 0x55d7e7c52640 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c855b0 0x55d7e7d0f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 --2- 172.21.15.7:0/521303237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c83f40 0x55d7e7d237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 -- 172.21.15.7:0/521303237 >> 172.21.15.7:0/521303237 conn(0x55d7e7c824e0 msgr2=0x55d7e7c9d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 -- 172.21.15.7:0/521303237 shutdown_connections 2024-08-19T00:43:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.528+0000 7f69325b1f40 1 -- 172.21.15.7:0/521303237 wait complete. 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.529+0000 7f69325b1f40 1 Processor -- start 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.529+0000 7f69325b1f40 1 -- start start 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f69325b1f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c83f40 0x55d7e7d0e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f69325b1f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c855b0 0x55d7e7d21360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f69325b1f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c85990 0x55d7e7d28c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f69325b1f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d7e7d23cf0 con 0x55d7e7c83f40 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f69325b1f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d7e7d2b990 con 0x55d7e7c85990 2024-08-19T00:43:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f69325b1f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d7e7d2c100 con 0x55d7e7c855b0 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c83f40 0x55d7e7d0e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c83f40 0x55d7e7d0e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40176/0 (socket says 172.21.15.7:40176) 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 -- 172.21.15.7:0/1715078262 learned_addr learned my addr 172.21.15.7:0/1715078262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f6930200640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c85990 0x55d7e7d28c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692ee00640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c855b0 0x55d7e7d21360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 -- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c855b0 msgr2=0x55d7e7d21360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c855b0 0x55d7e7d21360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 -- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c85990 msgr2=0x55d7e7d28c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c85990 0x55d7e7d28c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692f800640 1 -- 172.21.15.7:0/1715078262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e7bbb080 con 0x55d7e7c83f40 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f692ee00640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d7e7c855b0 0x55d7e7d21360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.530+0000 7f6930200640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7e7c85990 0x55d7e7d28c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.531+0000 7f692f800640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c83f40 0x55d7e7d0e250 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6920009fa0 tx=0x7f6920006810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.531+0000 7f6927e00640 1 -- 172.21.15.7:0/1715078262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692001a070 con 0x55d7e7c83f40 2024-08-19T00:43:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.531+0000 7f6927e00640 1 -- 172.21.15.7:0/1715078262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6920015680 con 0x55d7e7c83f40 2024-08-19T00:43:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.531+0000 7f6927e00640 1 -- 172.21.15.7:0/1715078262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920015a50 con 0x55d7e7c83f40 2024-08-19T00:43:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.531+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7e7d29370 con 0x55d7e7c83f40 2024-08-19T00:43:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.531+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7e7d26110 con 0x55d7e7c83f40 2024-08-19T00:43:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.533+0000 7f6927e00640 1 -- 172.21.15.7:0/1715078262 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6920015bf0 con 0x55d7e7c83f40 2024-08-19T00:43:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.534+0000 7f6927e00640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f691006a810 0x7f691006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.534+0000 7f6927e00640 1 -- 172.21.15.7:0/1715078262 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f69200895e0 con 0x55d7e7c83f40 2024-08-19T00:43:38.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.534+0000 7f692ee00640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f691006a810 0x7f691006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.534+0000 7f69325b1f40 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d7e7dc3b00 0x55d7e7dc3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.534+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55d7e7dc4420 con 0x55d7e7dc3b00 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.534+0000 7f6930200640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d7e7dc3b00 0x55d7e7dc3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.535+0000 7f692ee00640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f691006a810 0x7f691006ccd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x55d7e7d2d540 tx=0x7f691c0058c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.535+0000 7f6930200640 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d7e7dc3b00 0x55d7e7dc3ee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.535+0000 7f6930200640 1 -- 172.21.15.7:0/1715078262 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 100.00000000.inode [omap-get-header] v0'0 uv3 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6928060070 con 0x55d7e7dc3b00 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stdout:header (0 bytes) : 2024-08-19T00:43:38.539 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.535+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d7e7dc3b00 msgr2=0x55d7e7dc3ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.535+0000 7f69325b1f40 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d7e7dc3b00 0x55d7e7dc3ee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f691006a810 msgr2=0x7f691006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f691006a810 0x7f691006ccd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x55d7e7d2d540 tx=0x7f691c0058c0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c83f40 msgr2=0x55d7e7d0e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 --2- 172.21.15.7:0/1715078262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7e7c83f40 0x55d7e7d0e250 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6920009fa0 tx=0x7f6920006810 comp rx=0 tx=0).stop 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f6930200640 1 -- 172.21.15.7:0/1715078262 reap_dead start 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 shutdown_connections 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 >> 172.21.15.7:0/1715078262 conn(0x55d7e7c824e0 msgr2=0x55d7e7c52e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 shutdown_connections 2024-08-19T00:43:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.536+0000 7f69325b1f40 1 -- 172.21.15.7:0/1715078262 wait complete. 2024-08-19T00:43:38.543 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 1.00000000 2024-08-19T00:43:38.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.617+0000 7f9482425f40 1 Processor -- start 2024-08-19T00:43:38.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.617+0000 7f9482425f40 1 -- start start 2024-08-19T00:43:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.618+0000 7f9482425f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7705b0 0x55689b8083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.618+0000 7f9482425f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b770990 0x55689b76c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.618+0000 7f9482425f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b7888d0 0x55689b73e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.618+0000 7f9482425f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55689b815dc0 con 0x55689b7705b0 2024-08-19T00:43:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.618+0000 7f9482425f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55689b6e4d00 con 0x55689b770990 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.618+0000 7f9482425f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55689b8160a0 con 0x55689b7888d0 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.618+0000 7f947f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7705b0 0x55689b8083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7705b0 0x55689b8083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40182/0 (socket says 172.21.15.7:40182) 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 -- 172.21.15.7:0/3861086458 learned_addr learned my addr 172.21.15.7:0/3861086458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947ec00640 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b770990 0x55689b76c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f9480000640 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b7888d0 0x55689b73e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 -- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b7888d0 msgr2=0x55689b73e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b7888d0 0x55689b73e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 -- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b770990 msgr2=0x55689b76c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b770990 0x55689b76c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 -- 172.21.15.7:0/3861086458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55689b669b30 con 0x55689b7705b0 2024-08-19T00:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947ec00640 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b770990 0x55689b76c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:38.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.619+0000 7f947f600640 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7705b0 0x55689b8083f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f947000a4f0 tx=0x7f947004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8474a4b6fa03954f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f947d800640 1 -- 172.21.15.7:0/3861086458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470059040 con 0x55689b7705b0 2024-08-19T00:43:38.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f947d800640 1 -- 172.21.15.7:0/3861086458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9470063070 con 0x55689b7705b0 2024-08-19T00:43:38.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f947d800640 1 -- 172.21.15.7:0/3861086458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470054c30 con 0x55689b7705b0 2024-08-19T00:43:38.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 -- 172.21.15.7:0/3861086458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7705b0 msgr2=0x55689b8083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7705b0 0x55689b8083f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f947000a4f0 tx=0x7f947004e000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 -- 172.21.15.7:0/3861086458 shutdown_connections 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b7888d0 0x55689b73e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b770990 0x55689b76c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 --2- 172.21.15.7:0/3861086458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7705b0 0x55689b8083f0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 -- 172.21.15.7:0/3861086458 >> 172.21.15.7:0/3861086458 conn(0x55689b76d4e0 msgr2=0x55689b76fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 -- 172.21.15.7:0/3861086458 shutdown_connections 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.620+0000 7f9482425f40 1 -- 172.21.15.7:0/3861086458 wait complete. 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.621+0000 7f9482425f40 1 Processor -- start 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.621+0000 7f9482425f40 1 -- start start 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9482425f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b7705b0 0x55689b7fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9482425f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b770990 0x55689b8169e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9482425f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7888d0 0x55689b8178d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9482425f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55689b76d9a0 con 0x55689b7888d0 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9482425f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55689b80b7b0 con 0x55689b7705b0 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9482425f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55689b807eb0 con 0x55689b770990 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9480000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7888d0 0x55689b8178d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9480000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7888d0 0x55689b8178d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40198/0 (socket says 172.21.15.7:40198) 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f9480000640 1 -- 172.21.15.7:0/3979617187 learned_addr learned my addr 172.21.15.7:0/3979617187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f947f600640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b7705b0 0x55689b7fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.622+0000 7f947ec00640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b770990 0x55689b8169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9480000640 1 -- 172.21.15.7:0/3979617187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b770990 msgr2=0x55689b8169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9480000640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55689b770990 0x55689b8169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9480000640 1 -- 172.21.15.7:0/3979617187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b7705b0 msgr2=0x55689b7fa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9480000640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b7705b0 0x55689b7fa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9480000640 1 -- 172.21.15.7:0/3979617187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55689b6a6080 con 0x55689b7888d0 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f947f600640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55689b7705b0 0x55689b7fa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9480000640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7888d0 0x55689b8178d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f94780013e0 tx=0x7f94780017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9477e00640 1 -- 172.21.15.7:0/3979617187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94780060d0 con 0x55689b7888d0 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9477e00640 1 -- 172.21.15.7:0/3979617187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9478017070 con 0x55689b7888d0 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9477e00640 1 -- 172.21.15.7:0/3979617187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478004520 con 0x55689b7888d0 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55689b7424e0 con 0x55689b7888d0 2024-08-19T00:43:38.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.623+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55689b742aa0 con 0x55689b7888d0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.625+0000 7f9477e00640 1 -- 172.21.15.7:0/3979617187 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94780046c0 con 0x55689b7888d0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.626+0000 7f9477e00640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f946006a810 0x7f946006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.626+0000 7f9477e00640 1 -- 172.21.15.7:0/3979617187 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f9478089710 con 0x55689b7888d0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.626+0000 7f947f600640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f946006a810 0x7f946006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.626+0000 7f9482425f40 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55689b7432a0 0x55689b73f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.626+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55689b73f880 con 0x55689b7432a0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.627+0000 7f947ec00640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55689b7432a0 0x55689b73f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.627+0000 7f947f600640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f946006a810 0x7f946006ccd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f947000a440 tx=0x7f9470051000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.627+0000 7f947ec00640 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55689b7432a0 0x55689b73f340 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f947ec00640 1 -- 172.21.15.7:0/3979617187 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x7f946c009af0 con 0x55689b7432a0 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:header (274 bytes) : 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000000 04 03 0c 01 00 00 0d 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000020 00 00 00 00 36 95 c2 66 f6 40 82 34 00 00 00 00 |....6..f.@.4....| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000030 00 00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 |................| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000050 00 00 36 95 c2 66 f6 40 82 34 00 00 00 00 00 00 |..6..f.@.4......| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000060 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 00 |................| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000080 00 00 60 00 00 00 00 00 01 00 00 00 00 00 00 00 |..`.............| 2024-08-19T00:43:38.633 INFO:teuthology.orchestra.run.smithi007.stdout:00000090 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:000000a0 00 00 00 00 00 00 00 00 37 95 c2 66 11 5e 68 04 |........7..f.^h.| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:000000c0 60 00 00 00 00 00 01 00 00 00 00 00 00 00 01 00 |`...............| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:000000e0 00 00 00 00 00 00 37 95 c2 66 11 5e 68 04 00 00 |......7..f.^h...| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:* 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:00000110 00 00 |..| 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:00000112 2024-08-19T00:43:38.634 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55689b7432a0 msgr2=0x55689b73f340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55689b7432a0 0x55689b73f340 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f946006a810 msgr2=0x7f946006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f946006a810 0x7f946006ccd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f947000a440 tx=0x7f9470051000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7888d0 msgr2=0x55689b8178d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 --2- 172.21.15.7:0/3979617187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55689b7888d0 0x55689b8178d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f94780013e0 tx=0x7f94780017e0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9480000640 1 -- 172.21.15.7:0/3979617187 reap_dead start 2024-08-19T00:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 shutdown_connections 2024-08-19T00:43:38.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 >> 172.21.15.7:0/3979617187 conn(0x55689b76d4e0 msgr2=0x55689b76fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 shutdown_connections 2024-08-19T00:43:38.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.628+0000 7f9482425f40 1 -- 172.21.15.7:0/3979617187 wait complete. 2024-08-19T00:43:38.637 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-08-19T00:43:38.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.711+0000 7fcf7c434f40 1 Processor -- start 2024-08-19T00:43:38.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.711+0000 7fcf7c434f40 1 -- start start 2024-08-19T00:43:38.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf7c434f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f85b0 0x56547558fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf7c434f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654754f8990 0x56547559e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf7c434f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654755108d0 0x56547559ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf7c434f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56547559ddc0 con 0x5654755108d0 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf7c434f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56547546cd00 con 0x5654754f85b0 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf7c434f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56547559e0a0 con 0x5654754f8990 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf7a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654755108d0 0x56547559ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf79600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f85b0 0x56547558fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf79600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f85b0 0x56547558fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:36854/0 (socket says 172.21.15.7:36854) 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf79600640 1 -- 172.21.15.7:0/1499235957 learned_addr learned my addr 172.21.15.7:0/1499235957 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.712+0000 7fcf78c00640 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654754f8990 0x56547559e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf79600640 1 -- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654754f8990 msgr2=0x56547559e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf79600640 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654754f8990 0x56547559e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf79600640 1 -- 172.21.15.7:0/1499235957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654755108d0 msgr2=0x56547559ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf79600640 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654755108d0 0x56547559ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf79600640 1 -- 172.21.15.7:0/1499235957 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654753f1b30 con 0x5654754f85b0 2024-08-19T00:43:38.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf7a000640 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654755108d0 0x56547559ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:38.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf79600640 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f85b0 0x56547558fd80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0098b0 tx=0x7fcf6c005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f8dd89194d56d5a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf73400640 1 -- 172.21.15.7:0/1499235957 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c008930 con 0x5654754f85b0 2024-08-19T00:43:38.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf73400640 1 -- 172.21.15.7:0/1499235957 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c018070 con 0x5654754f85b0 2024-08-19T00:43:38.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.713+0000 7fcf73400640 1 -- 172.21.15.7:0/1499235957 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c008cd0 con 0x5654754f85b0 2024-08-19T00:43:38.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f85b0 msgr2=0x56547558fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f85b0 0x56547558fd80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0098b0 tx=0x7fcf6c005a00 comp rx=0 tx=0).stop 2024-08-19T00:43:38.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1499235957 shutdown_connections 2024-08-19T00:43:38.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654755108d0 0x56547559ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654754f8990 0x56547559e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1499235957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f85b0 0x56547558fd80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1499235957 >> 172.21.15.7:0/1499235957 conn(0x5654754f54e0 msgr2=0x5654754c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1499235957 shutdown_connections 2024-08-19T00:43:38.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.714+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1499235957 wait complete. 2024-08-19T00:43:38.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.715+0000 7fcf7c434f40 1 Processor -- start 2024-08-19T00:43:38.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.715+0000 7fcf7c434f40 1 -- start start 2024-08-19T00:43:38.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf7c434f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654754f85b0 0x56547550f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf7c434f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f8990 0x56547558e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf7c434f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654755108d0 0x56547559cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf7c434f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5654754b32a0 con 0x5654754f85b0 2024-08-19T00:43:38.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf7c434f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5654755a0220 con 0x5654754f8990 2024-08-19T00:43:38.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf7c434f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x565475596460 con 0x5654755108d0 2024-08-19T00:43:38.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf79600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654754f85b0 0x56547550f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf79600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654754f85b0 0x56547550f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40218/0 (socket says 172.21.15.7:40218) 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf79600640 1 -- 172.21.15.7:0/1245022242 learned_addr learned my addr 172.21.15.7:0/1245022242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf78c00640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f8990 0x56547558e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf7a000640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654755108d0 0x56547559cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf79600640 1 -- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654755108d0 msgr2=0x56547559cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.716+0000 7fcf79600640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5654755108d0 0x56547559cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf79600640 1 -- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f8990 msgr2=0x56547558e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf79600640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5654754f8990 0x56547558e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf79600640 1 -- 172.21.15.7:0/1245022242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547542e080 con 0x5654754f85b0 2024-08-19T00:43:38.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf79600640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654754f85b0 0x56547550f120 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000c00 tx=0x7fcf6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf72000640 1 -- 172.21.15.7:0/1245022242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c027430 con 0x5654754f85b0 2024-08-19T00:43:38.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565475634380 con 0x5654754f85b0 2024-08-19T00:43:38.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf72000640 1 -- 172.21.15.7:0/1245022242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c0275d0 con 0x5654754f85b0 2024-08-19T00:43:38.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf72000640 1 -- 172.21.15.7:0/1245022242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0279c0 con 0x5654754f85b0 2024-08-19T00:43:38.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.717+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565475634940 con 0x5654754f85b0 2024-08-19T00:43:38.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.719+0000 7fcf72000640 1 -- 172.21.15.7:0/1245022242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf6c030440 con 0x5654754f85b0 2024-08-19T00:43:38.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.720+0000 7fcf72000640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf5c06a810 0x7fcf5c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.720+0000 7fcf72000640 1 -- 172.21.15.7:0/1245022242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fcf6c08bb80 con 0x5654754f85b0 2024-08-19T00:43:38.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.720+0000 7fcf78c00640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf5c06a810 0x7fcf5c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.720+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56547558d9d0 0x56547558ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.720+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x56547558e310 con 0x56547558d9d0 2024-08-19T00:43:38.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.721+0000 7fcf7a000640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56547558d9d0 0x56547558ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.721+0000 7fcf78c00640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf5c06a810 0x7fcf5c06ccd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcf68057000 tx=0x7fcf68052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.721+0000 7fcf7a000640 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56547558d9d0 0x56547558ddd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.727 INFO:teuthology.orchestra.run.smithi007.stdout:sixmegs_head 2024-08-19T00:43:38.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7a000640 1 -- 172.21.15.7:0/1245022242 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=21b] v0'0 uv10 ondisk = 0) ==== 164+0+21 (crc 0 0 0) 0x7fcf74006020 con 0x56547558d9d0 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56547558d9d0 msgr2=0x56547558ddd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56547558d9d0 0x56547558ddd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf5c06a810 msgr2=0x7fcf5c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf5c06a810 0x7fcf5c06ccd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcf68057000 tx=0x7fcf68052000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654754f85b0 msgr2=0x56547550f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 --2- 172.21.15.7:0/1245022242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654754f85b0 0x56547550f120 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000c00 tx=0x7fcf6c002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7a000640 1 -- 172.21.15.7:0/1245022242 reap_dead start 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 shutdown_connections 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 >> 172.21.15.7:0/1245022242 conn(0x5654754f54e0 msgr2=0x5654754c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 shutdown_connections 2024-08-19T00:43:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.722+0000 7fcf7c434f40 1 -- 172.21.15.7:0/1245022242 wait complete. 2024-08-19T00:43:38.730 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 600.00000000 2024-08-19T00:43:38.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 Processor -- start 2024-08-19T00:43:38.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 -- start start 2024-08-19T00:43:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f7e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5f855f0 0x5600b5ef9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5edcab0 0x5600b5ef9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5600b5e54d00 con 0x7f6adc002460 2024-08-19T00:43:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5600b5e58d40 con 0x5600b5edcab0 2024-08-19T00:43:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.805+0000 7f6afa557f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5600b5f85dc0 con 0x5600b5f855f0 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f7e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f7e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40230/0 (socket says 172.21.15.7:40230) 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 -- 172.21.15.7:0/1784819207 learned_addr learned my addr 172.21.15.7:0/1784819207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af6e00640 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5f855f0 0x5600b5ef9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af8200640 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5edcab0 0x5600b5ef9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 -- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5f855f0 msgr2=0x5600b5ef9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5f855f0 0x5600b5ef9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 -- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5edcab0 msgr2=0x5600b5ef9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5edcab0 0x5600b5ef9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 -- 172.21.15.7:0/1784819207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b5e16080 con 0x7f6adc002460 2024-08-19T00:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.806+0000 7f6af7800640 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f7e910 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8046a20 tx=0x7f6ae8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ed83c17f186f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6af5a00640 1 -- 172.21.15.7:0/1784819207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8001670 con 0x7f6adc002460 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6af5a00640 1 -- 172.21.15.7:0/1784819207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae8066070 con 0x7f6adc002460 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6af5a00640 1 -- 172.21.15.7:0/1784819207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae804dd80 con 0x7f6adc002460 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 -- 172.21.15.7:0/1784819207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 msgr2=0x5600b5f7e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f7e910 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8046a20 tx=0x7f6ae8050000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 -- 172.21.15.7:0/1784819207 shutdown_connections 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5edcab0 0x5600b5ef9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5f855f0 0x5600b5ef9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 --2- 172.21.15.7:0/1784819207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f7e910 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 -- 172.21.15.7:0/1784819207 >> 172.21.15.7:0/1784819207 conn(0x5600b5edd4e0 msgr2=0x5600b5edb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 -- 172.21.15.7:0/1784819207 shutdown_connections 2024-08-19T00:43:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.807+0000 7f6afa557f40 1 -- 172.21.15.7:0/1784819207 wait complete. 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.808+0000 7f6afa557f40 1 Processor -- start 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.808+0000 7f6afa557f40 1 -- start start 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6afa557f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5edcab0 0x5600b5f778d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6afa557f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5f855f0 0x5600b5ef7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6afa557f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f75600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6afa557f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5600b5edc590 con 0x7f6adc002460 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6afa557f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5600b5f7f6f0 con 0x5600b5f855f0 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6afa557f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5600b5f7f200 con 0x5600b5edcab0 2024-08-19T00:43:38.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6af8200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f75600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6af8200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f75600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40238/0 (socket says 172.21.15.7:40238) 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6af8200640 1 -- 172.21.15.7:0/3245855476 learned_addr learned my addr 172.21.15.7:0/3245855476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6af6e00640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5f855f0 0x5600b5ef7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.809+0000 7f6af7800640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5edcab0 0x5600b5f778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6af8200640 1 -- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5edcab0 msgr2=0x5600b5f778d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6af8200640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5edcab0 0x5600b5f778d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6af8200640 1 -- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5f855f0 msgr2=0x5600b5ef7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6af8200640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600b5f855f0 0x5600b5ef7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6af8200640 1 -- 172.21.15.7:0/3245855476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b5efa610 con 0x7f6adc002460 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6af7800640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5600b5edcab0 0x5600b5f778d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6af8200640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f75600 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x5600b5ede540 tx=0x7f6af000d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6aefe00640 1 -- 172.21.15.7:0/3245855476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0018070 con 0x7f6adc002460 2024-08-19T00:43:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6aefe00640 1 -- 172.21.15.7:0/3245855476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af00062e0 con 0x7f6adc002460 2024-08-19T00:43:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6aefe00640 1 -- 172.21.15.7:0/3245855476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af000de30 con 0x7f6adc002460 2024-08-19T00:43:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600b5edbc70 con 0x7f6adc002460 2024-08-19T00:43:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.810+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b5f7b4e0 con 0x7f6adc002460 2024-08-19T00:43:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.812+0000 7f6aefe00640 1 -- 172.21.15.7:0/3245855476 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6af001b070 con 0x7f6adc002460 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.813+0000 7f6aefe00640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ad806a810 0x7f6ad806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.813+0000 7f6aefe00640 1 -- 172.21.15.7:0/3245855476 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f6af0088e60 con 0x7f6adc002460 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.813+0000 7f6af7800640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ad806a810 0x7f6ad806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.813+0000 7f6afa557f40 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5600b5ef84e0 0x5600b5f82e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.813+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0d82a743:::600.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5600b5f7fe00 con 0x5600b5ef84e0 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.814+0000 7f6af6e00640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5600b5ef84e0 0x5600b5f82e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.814+0000 7f6af7800640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ad806a810 0x7f6ad806ccd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8046a20 tx=0x7f6ae8052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.814+0000 7f6af6e00640 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5600b5ef84e0 0x5600b5f82e10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6af6e00640 1 -- 172.21.15.7:0/3245855476 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 600.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f6ae40099f0 con 0x5600b5ef84e0 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5600b5ef84e0 msgr2=0x5600b5f82e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5600b5ef84e0 0x5600b5f82e10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ad806a810 msgr2=0x7f6ad806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6ad806a810 0x7f6ad806ccd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8046a20 tx=0x7f6ae8052000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 msgr2=0x5600b5f75600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 --2- 172.21.15.7:0/3245855476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6adc002460 0x5600b5f75600 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x5600b5ede540 tx=0x7f6af000d530 comp rx=0 tx=0).stop 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6af8200640 1 -- 172.21.15.7:0/3245855476 reap_dead start 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 shutdown_connections 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 >> 172.21.15.7:0/3245855476 conn(0x5600b5edd4e0 msgr2=0x5600b5f848d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.815+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 shutdown_connections 2024-08-19T00:43:38.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.816+0000 7f6afa557f40 1 -- 172.21.15.7:0/3245855476 wait complete. 2024-08-19T00:43:38.822 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000.inode 2024-08-19T00:43:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.895+0000 7f82def54f40 1 Processor -- start 2024-08-19T00:43:38.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.895+0000 7f82def54f40 1 -- start start 2024-08-19T00:43:38.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82def54f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241bf40 0x5589724b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82def54f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241d5b0 0x5589724c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82def54f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d990 0x5589724c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82def54f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55897241c8f0 con 0x55897241d990 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82def54f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558972391d00 con 0x55897241d5b0 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82def54f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5589724c2dc0 con 0x55897241bf40 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82dcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d990 0x5589724c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.896+0000 7f82dcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d990 0x5589724c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40256/0 (socket says 172.21.15.7:40256) 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dcc00640 1 -- 172.21.15.7:0/1537291088 learned_addr learned my addr 172.21.15.7:0/1537291088 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dc200640 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241bf40 0x5589724b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82db800640 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241d5b0 0x5589724c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dcc00640 1 -- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241bf40 msgr2=0x5589724b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dcc00640 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241bf40 0x5589724b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dcc00640 1 -- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241d5b0 msgr2=0x5589724c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dcc00640 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241d5b0 0x5589724c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dcc00640 1 -- 172.21.15.7:0/1537291088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558972316b30 con 0x55897241d990 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82dcc00640 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d990 0x5589724c3dd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c480 tx=0x7f82d400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dc7d8405f92902 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82da400640 1 -- 172.21.15.7:0/1537291088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d40116b0 con 0x55897241d990 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82da400640 1 -- 172.21.15.7:0/1537291088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d4017070 con 0x55897241d990 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.897+0000 7f82da400640 1 -- 172.21.15.7:0/1537291088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011a90 con 0x55897241d990 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 -- 172.21.15.7:0/1537291088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d990 msgr2=0x5589724c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d990 0x5589724c3dd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c480 tx=0x7f82d400c940 comp rx=0 tx=0).stop 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 -- 172.21.15.7:0/1537291088 shutdown_connections 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d990 0x5589724c3dd0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241d5b0 0x5589724c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 --2- 172.21.15.7:0/1537291088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241bf40 0x5589724b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 -- 172.21.15.7:0/1537291088 >> 172.21.15.7:0/1537291088 conn(0x55897241a4e0 msgr2=0x558972436940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 -- 172.21.15.7:0/1537291088 shutdown_connections 2024-08-19T00:43:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.898+0000 7f82def54f40 1 -- 172.21.15.7:0/1537291088 wait complete. 2024-08-19T00:43:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.899+0000 7f82def54f40 1 Processor -- start 2024-08-19T00:43:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.899+0000 7f82def54f40 1 -- start start 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82def54f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241bf40 0x5589724b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82def54f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d5b0 0x55897255be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82def54f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241d990 0x55897255c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82def54f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589724ba940 con 0x55897241d5b0 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82def54f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5589724bac50 con 0x55897241bf40 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82def54f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558972437c30 con 0x55897241d990 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82db800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d5b0 0x55897255be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82db800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d5b0 0x55897255be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40260/0 (socket says 172.21.15.7:40260) 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82db800640 1 -- 172.21.15.7:0/3267854535 learned_addr learned my addr 172.21.15.7:0/3267854535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82dc200640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241bf40 0x5589724b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.900+0000 7f82dcc00640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241d990 0x55897255c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82db800640 1 -- 172.21.15.7:0/3267854535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241d990 msgr2=0x55897255c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82db800640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55897241d990 0x55897255c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82db800640 1 -- 172.21.15.7:0/3267854535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241bf40 msgr2=0x5589724b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82db800640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55897241bf40 0x5589724b9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82db800640 1 -- 172.21.15.7:0/3267854535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558972353080 con 0x55897241d5b0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82db800640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d5b0 0x55897255be20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f82c800ee10 tx=0x7f82c800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82d9000640 1 -- 172.21.15.7:0/3267854535 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c800f860 con 0x55897241d5b0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82d9000640 1 -- 172.21.15.7:0/3267854535 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c8013030 con 0x55897241d5b0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82d9000640 1 -- 172.21.15.7:0/3267854535 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c800fc00 con 0x55897241d5b0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589724bb810 con 0x55897241d5b0 2024-08-19T00:43:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.901+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589724aec10 con 0x55897241d5b0 2024-08-19T00:43:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.903+0000 7f82d9000640 1 -- 172.21.15.7:0/3267854535 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82c80183e0 con 0x55897241d5b0 2024-08-19T00:43:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.904+0000 7f82d9000640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82bc06a840 0x7f82bc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.904+0000 7f82d9000640 1 -- 172.21.15.7:0/3267854535 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f82c808a5f0 con 0x55897241d5b0 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.904+0000 7f82dc200640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82bc06a840 0x7f82bc06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.904+0000 7f82def54f40 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5589724ba420 0x5589724b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.904+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5589724aefc0 con 0x5589724ba420 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.904+0000 7f82dcc00640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5589724ba420 0x5589724b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.905+0000 7f82dc200640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82bc06a840 0x7f82bc06cd00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f82cc056000 tx=0x7f82cc050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.905+0000 7f82dcc00640 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5589724ba420 0x5589724b5e20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.905+0000 7f82dcc00640 1 -- 172.21.15.7:0/3267854535 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 1.00000000.inode [omap-get-keys out=5b] v0'0 uv15 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7f82d40118d0 con 0x5589724ba420 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5589724ba420 msgr2=0x5589724b5e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5589724ba420 0x5589724b5e20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82bc06a840 msgr2=0x7f82bc06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82bc06a840 0x7f82bc06cd00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f82cc056000 tx=0x7f82cc050000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d5b0 msgr2=0x55897255be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 --2- 172.21.15.7:0/3267854535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55897241d5b0 0x55897255be20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f82c800ee10 tx=0x7f82c800c730 comp rx=0 tx=0).stop 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82dcc00640 1 -- 172.21.15.7:0/3267854535 reap_dead start 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 shutdown_connections 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 >> 172.21.15.7:0/3267854535 conn(0x55897241a4e0 msgr2=0x558972436940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 shutdown_connections 2024-08-19T00:43:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.906+0000 7f82def54f40 1 -- 172.21.15.7:0/3267854535 wait complete. 2024-08-19T00:43:38.913 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 200.00000000 2024-08-19T00:43:38.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.987+0000 7fb13f73af40 1 Processor -- start 2024-08-19T00:43:38.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.988+0000 7fb13f73af40 1 -- start start 2024-08-19T00:43:38.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.988+0000 7fb13f73af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560468809f40 0x5604688a2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.988+0000 7fb13f73af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x5604688a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.988+0000 7fb13f73af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56046880b990 0x56046893e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.988+0000 7fb13f73af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56046880a8c0 con 0x56046880b990 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.988+0000 7fb13f73af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56046877fd00 con 0x560468809f40 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.988+0000 7fb13f73af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5604688b0dc0 con 0x56046880b5b0 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56046880b990 0x56046893e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56046880b990 0x56046893e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40280/0 (socket says 172.21.15.7:40280) 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 -- 172.21.15.7:0/1605965063 learned_addr learned my addr 172.21.15.7:0/1605965063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13ca00640 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560468809f40 0x5604688a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb137e00640 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x5604688a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 -- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 msgr2=0x5604688a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x5604688a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 -- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560468809f40 msgr2=0x5604688a2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560468809f40 0x5604688a2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13d400640 1 -- 172.21.15.7:0/1605965063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560468704b30 con 0x56046880b990 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb13ca00640 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560468809f40 0x5604688a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.989+0000 7fb137e00640 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x5604688a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13d400640 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56046880b990 0x56046893e9f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb138005fd0 tx=0x7fb138051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8148c55d9c3aeef server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb136a00640 1 -- 172.21.15.7:0/1605965063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138056040 con 0x56046880b990 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb136a00640 1 -- 172.21.15.7:0/1605965063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb138052be0 con 0x56046880b990 2024-08-19T00:43:38.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb136a00640 1 -- 172.21.15.7:0/1605965063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138066440 con 0x56046880b990 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13f73af40 1 -- 172.21.15.7:0/1605965063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56046880b990 msgr2=0x56046893e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13f73af40 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56046880b990 0x56046893e9f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb138005fd0 tx=0x7fb138051000 comp rx=0 tx=0).stop 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13f73af40 1 -- 172.21.15.7:0/1605965063 shutdown_connections 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13f73af40 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56046880b990 0x56046893e9f0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13f73af40 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x5604688a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13f73af40 1 --2- 172.21.15.7:0/1605965063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560468809f40 0x5604688a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.990+0000 7fb13f73af40 1 -- 172.21.15.7:0/1605965063 >> 172.21.15.7:0/1605965063 conn(0x5604688084e0 msgr2=0x5604688088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.991+0000 7fb13f73af40 1 -- 172.21.15.7:0/1605965063 shutdown_connections 2024-08-19T00:43:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.991+0000 7fb13f73af40 1 -- 172.21.15.7:0/1605965063 wait complete. 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.991+0000 7fb13f73af40 1 Processor -- start 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.991+0000 7fb13f73af40 1 -- start start 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.992+0000 7fb13f73af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560468809f40 0x5604688a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.992+0000 7fb13f73af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x560468824b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.992+0000 7fb13f73af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56046880b990 0x5604689467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.992+0000 7fb13f73af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5604688b1aa0 con 0x560468809f40 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.992+0000 7fb13f73af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5604688a9f60 con 0x56046880b990 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.992+0000 7fb13f73af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5604688b1f30 con 0x56046880b5b0 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.992+0000 7fb13ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560468809f40 0x5604688a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560468809f40 0x5604688a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40292/0 (socket says 172.21.15.7:40292) 2024-08-19T00:43:38.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 -- 172.21.15.7:0/3377658024 learned_addr learned my addr 172.21.15.7:0/3377658024 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb137e00640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x560468824b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13d400640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56046880b990 0x5604689467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 -- 172.21.15.7:0/3377658024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 msgr2=0x560468824b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56046880b5b0 0x560468824b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 -- 172.21.15.7:0/3377658024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56046880b990 msgr2=0x5604689467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56046880b990 0x5604689467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 -- 172.21.15.7:0/3377658024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560468741080 con 0x560468809f40 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb13ca00640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560468809f40 0x5604688a1820 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb130001c80 tx=0x7fb13000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb135600640 1 -- 172.21.15.7:0/3377658024 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130013070 con 0x560468809f40 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb135600640 1 -- 172.21.15.7:0/3377658024 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13000f650 con 0x560468809f40 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.993+0000 7fb135600640 1 -- 172.21.15.7:0/3377658024 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13000fa00 con 0x560468809f40 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.994+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604688b35b0 con 0x560468809f40 2024-08-19T00:43:38.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.994+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604688a1020 con 0x560468809f40 2024-08-19T00:43:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.996+0000 7fb135600640 1 -- 172.21.15.7:0/3377658024 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb130016070 con 0x560468809f40 2024-08-19T00:43:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.996+0000 7fb135600640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb11c06a810 0x7fb11c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.996+0000 7fb135600640 1 -- 172.21.15.7:0/3377658024 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fb130089d30 con 0x560468809f40 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.997+0000 7fb137e00640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb11c06a810 0x7fb11c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.997+0000 7fb13f73af40 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560468825070 0x560468952780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.997+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:292cf221:::200.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5604688a2890 con 0x560468825070 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.997+0000 7fb13d400640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560468825070 0x560468952780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.997+0000 7fb137e00640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb11c06a810 0x7fb11c06ccd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x560468807ac0 tx=0x7fb1280055f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13d400640 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560468825070 0x560468952780 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13d400640 1 -- 172.21.15.7:0/3377658024 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000000 [omap-get-keys out=5b] v0'0 uv19 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fb13805c430 con 0x560468825070 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560468825070 msgr2=0x560468952780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560468825070 0x560468952780 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb11c06a810 msgr2=0x7fb11c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb11c06a810 0x7fb11c06ccd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x560468807ac0 tx=0x7fb1280055f0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560468809f40 msgr2=0x5604688a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 --2- 172.21.15.7:0/3377658024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560468809f40 0x5604688a1820 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb130001c80 tx=0x7fb13000b6c0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13d400640 1 -- 172.21.15.7:0/3377658024 reap_dead start 2024-08-19T00:43:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 shutdown_connections 2024-08-19T00:43:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 >> 172.21.15.7:0/3377658024 conn(0x5604688084e0 msgr2=0x5604688088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 shutdown_connections 2024-08-19T00:43:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:38.998+0000 7fb13f73af40 1 -- 172.21.15.7:0/3377658024 wait complete. 2024-08-19T00:43:39.005 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 200.00000001 2024-08-19T00:43:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.079+0000 7f1eb5502f40 1 Processor -- start 2024-08-19T00:43:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.079+0000 7f1eb5502f40 1 -- start start 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.080+0000 7f1eb5502f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b6f40 0x56246344f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.080+0000 7f1eb5502f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b85b0 0x5624633b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.080+0000 7f1eb5502f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b8990 0x562463455650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.080+0000 7f1eb5502f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56246332cd00 con 0x5624633b85b0 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.080+0000 7f1eb5502f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562463330d40 con 0x5624633b8990 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.080+0000 7f1eb5502f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56246345ddc0 con 0x5624633b6f40 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b85b0 0x5624633b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b85b0 0x5624633b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40296/0 (socket says 172.21.15.7:40296) 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 -- 172.21.15.7:0/2255055751 learned_addr learned my addr 172.21.15.7:0/2255055751 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb2800640 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b6f40 0x56246344f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb3200640 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b8990 0x562463455650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 -- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b6f40 msgr2=0x56246344f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b6f40 0x56246344f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 -- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b8990 msgr2=0x562463455650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b8990 0x562463455650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 -- 172.21.15.7:0/2255055751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624632ee080 con 0x5624633b85b0 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb3200640 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b8990 0x562463455650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.081+0000 7f1eb1e00640 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b85b0 0x5624633b4820 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0057040 tx=0x7f1ea004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1c1ed199e8774b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb0a00640 1 -- 172.21.15.7:0/2255055751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0059040 con 0x5624633b85b0 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb0a00640 1 -- 172.21.15.7:0/2255055751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0064070 con 0x5624633b85b0 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb0a00640 1 -- 172.21.15.7:0/2255055751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0054b30 con 0x5624633b85b0 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 -- 172.21.15.7:0/2255055751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b85b0 msgr2=0x5624633b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b85b0 0x5624633b4820 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0057040 tx=0x7f1ea004e000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 -- 172.21.15.7:0/2255055751 shutdown_connections 2024-08-19T00:43:39.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b8990 0x562463455650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b85b0 0x5624633b4820 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/2255055751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b6f40 0x56246344f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 -- 172.21.15.7:0/2255055751 >> 172.21.15.7:0/2255055751 conn(0x5624633b54e0 msgr2=0x5624633856d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 -- 172.21.15.7:0/2255055751 shutdown_connections 2024-08-19T00:43:39.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.082+0000 7f1eb5502f40 1 -- 172.21.15.7:0/2255055751 wait complete. 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.083+0000 7f1eb5502f40 1 Processor -- start 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.083+0000 7f1eb5502f40 1 -- start start 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb5502f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b6f40 0x56246345c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb5502f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b85b0 0x56246344e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb5502f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b8990 0x5624633b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb5502f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5624633861c0 con 0x5624633b8990 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb5502f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56246345e5c0 con 0x5624633b6f40 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb5502f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56246345e810 con 0x5624633b85b0 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b8990 0x5624633b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b8990 0x5624633b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40310/0 (socket says 172.21.15.7:40310) 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb3200640 1 -- 172.21.15.7:0/75809743 learned_addr learned my addr 172.21.15.7:0/75809743 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb1e00640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b85b0 0x56246344e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.084+0000 7f1eb2800640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b6f40 0x56246345c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb3200640 1 -- 172.21.15.7:0/75809743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b85b0 msgr2=0x56246344e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb3200640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5624633b85b0 0x56246344e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb3200640 1 -- 172.21.15.7:0/75809743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b6f40 msgr2=0x56246345c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb3200640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b6f40 0x56246345c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb3200640 1 -- 172.21.15.7:0/75809743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562463456310 con 0x5624633b8990 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb2800640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624633b6f40 0x56246345c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb3200640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b8990 0x5624633b3ac0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d3e0 tx=0x7f1eac00d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eab400640 1 -- 172.21.15.7:0/75809743 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac018070 con 0x5624633b8990 2024-08-19T00:43:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eab400640 1 -- 172.21.15.7:0/75809743 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eac0062e0 con 0x5624633b8990 2024-08-19T00:43:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eab400640 1 -- 172.21.15.7:0/75809743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac004740 con 0x5624633b8990 2024-08-19T00:43:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624634565f0 con 0x5624633b8990 2024-08-19T00:43:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.085+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562463453430 con 0x5624633b8990 2024-08-19T00:43:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.087+0000 7f1eab400640 1 -- 172.21.15.7:0/75809743 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1eac01b070 con 0x5624633b8990 2024-08-19T00:43:39.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.088+0000 7f1eab400640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e9406a810 0x7f1e9406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.088+0000 7f1eab400640 1 -- 172.21.15.7:0/75809743 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1eac089400 con 0x5624633b8990 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.088+0000 7f1eb2800640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e9406a810 0x7f1e9406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.088+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5624634508b0 0x562463450cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.088+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:2e2fa760:::200.00000001:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x562463451200 con 0x5624634508b0 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.088+0000 7f1eb1e00640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5624634508b0 0x562463450cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.089+0000 7f1eb2800640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e9406a810 0x7f1e9406ccd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4000c00 tx=0x7f1ea4003050 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.089+0000 7f1eb1e00640 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5624634508b0 0x562463450cc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.089+0000 7f1eb1e00640 1 -- 172.21.15.7:0/75809743 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000001 [omap-get-keys out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f1ea005c040 con 0x5624634508b0 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5624634508b0 msgr2=0x562463450cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5624634508b0 0x562463450cc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e9406a810 msgr2=0x7f1e9406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e9406a810 0x7f1e9406ccd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4000c00 tx=0x7f1ea4003050 comp rx=0 tx=0).stop 2024-08-19T00:43:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b8990 msgr2=0x5624633b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 --2- 172.21.15.7:0/75809743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624633b8990 0x5624633b3ac0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d3e0 tx=0x7f1eac00d8a0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb3200640 1 -- 172.21.15.7:0/75809743 reap_dead start 2024-08-19T00:43:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 shutdown_connections 2024-08-19T00:43:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 >> 172.21.15.7:0/75809743 conn(0x5624633b54e0 msgr2=0x5624633856d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 shutdown_connections 2024-08-19T00:43:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.090+0000 7f1eb5502f40 1 -- 172.21.15.7:0/75809743 wait complete. 2024-08-19T00:43:39.097 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_openfiles.0 2024-08-19T00:43:39.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.170+0000 7ff4d9eabf40 1 Processor -- start 2024-08-19T00:43:39.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.170+0000 7ff4d9eabf40 1 -- start start 2024-08-19T00:43:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d9eabf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d865b0 0x559b80d838c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d9eabf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d86990 0x559b80e1db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d9eabf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e2c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d9eabf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559b80e2bdc0 con 0x559b80d9e8d0 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d9eabf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559b80cfad00 con 0x559b80d865b0 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d9eabf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559b80e2c0a0 con 0x559b80d86990 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d7a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e2c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d7a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e2c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40320/0 (socket says 172.21.15.7:40320) 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.171+0000 7ff4d7a00640 1 -- 172.21.15.7:0/3044989281 learned_addr learned my addr 172.21.15.7:0/3044989281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d7000640 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d865b0 0x559b80d838c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d6600640 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d86990 0x559b80e1db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d7a00640 1 -- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d86990 msgr2=0x559b80e1db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d7a00640 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d86990 0x559b80e1db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d7a00640 1 -- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d865b0 msgr2=0x559b80d838c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d7a00640 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d865b0 0x559b80d838c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d7a00640 1 -- 172.21.15.7:0/3044989281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b80c7fb30 con 0x559b80d9e8d0 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d7a00640 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e2c870 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0001530 tx=0x7ff4d00019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15c7c53d85e5386 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d5200640 1 -- 172.21.15.7:0/3044989281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0016070 con 0x559b80d9e8d0 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d5200640 1 -- 172.21.15.7:0/3044989281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d000f730 con 0x559b80d9e8d0 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.172+0000 7ff4d5200640 1 -- 172.21.15.7:0/3044989281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000fb20 con 0x559b80d9e8d0 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/3044989281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 msgr2=0x559b80e2c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e2c870 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0001530 tx=0x7ff4d00019f0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/3044989281 shutdown_connections 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e2c870 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d86990 0x559b80e1db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/3044989281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d865b0 0x559b80d838c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/3044989281 >> 172.21.15.7:0/3044989281 conn(0x559b80d834e0 msgr2=0x559b80d53ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/3044989281 shutdown_connections 2024-08-19T00:43:39.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.173+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/3044989281 wait complete. 2024-08-19T00:43:39.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.174+0000 7ff4d9eabf40 1 Processor -- start 2024-08-19T00:43:39.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.174+0000 7ff4d9eabf40 1 -- start start 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d9eabf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d865b0 0x559b80e1c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d9eabf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d86990 0x559b80e26790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d9eabf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e26cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d9eabf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559b80e1e090 con 0x559b80d9e8d0 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d9eabf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559b80e212e0 con 0x559b80d86990 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d9eabf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559b80e2da90 con 0x559b80d865b0 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d7a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e26cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d7a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e26cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40336/0 (socket says 172.21.15.7:40336) 2024-08-19T00:43:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d7a00640 1 -- 172.21.15.7:0/2661198081 learned_addr learned my addr 172.21.15.7:0/2661198081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d6600640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d86990 0x559b80e26790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.175+0000 7ff4d7000640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d865b0 0x559b80e1c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d7a00640 1 -- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d865b0 msgr2=0x559b80e1c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d7a00640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559b80d865b0 0x559b80e1c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d7a00640 1 -- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d86990 msgr2=0x559b80e26790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d7a00640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b80d86990 0x559b80e26790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d7a00640 1 -- 172.21.15.7:0/2661198081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b80cbc080 con 0x559b80d9e8d0 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d7a00640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e26cd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00067b0 tx=0x7ff4d0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4cf400640 1 -- 172.21.15.7:0/2661198081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0021070 con 0x559b80d9e8d0 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4cf400640 1 -- 172.21.15.7:0/2661198081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d0011440 con 0x559b80d9e8d0 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4cf400640 1 -- 172.21.15.7:0/2661198081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0016040 con 0x559b80d9e8d0 2024-08-19T00:43:39.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b80e1ca80 con 0x559b80d9e8d0 2024-08-19T00:43:39.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.176+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b80e2ae30 con 0x559b80d9e8d0 2024-08-19T00:43:39.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.178+0000 7ff4cf400640 1 -- 172.21.15.7:0/2661198081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4d0024070 con 0x559b80d9e8d0 2024-08-19T00:43:39.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.179+0000 7ff4cf400640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff4b806a810 0x7ff4b806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.179+0000 7ff4cf400640 1 -- 172.21.15.7:0/2661198081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7ff4d008af60 con 0x559b80d9e8d0 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.179+0000 7ff4d7000640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff4b806a810 0x7ff4b806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.179+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559b80e2a6c0 0x559b80e28ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.179+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.6 12:654134d2:::mds0_openfiles.0:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x559b80d853c0 con 0x559b80e2a6c0 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.180+0000 7ff4d6600640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559b80e2a6c0 0x559b80e28ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.180+0000 7ff4d7000640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff4b806a810 0x7ff4b806ccd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8005fd0 tx=0x7ff4c800c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.180+0000 7ff4d6600640 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559b80e2a6c0 0x559b80e28ba0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d6600640 1 -- 172.21.15.7:0/2661198081 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-get-keys out=5b] v0'0 uv4 ondisk = 0) ==== 160+0+5 (crc 0 0 0) 0x7ff4c405f620 con 0x559b80e2a6c0 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559b80e2a6c0 msgr2=0x559b80e28ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559b80e2a6c0 0x559b80e28ba0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff4b806a810 msgr2=0x7ff4b806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff4b806a810 0x7ff4b806ccd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8005fd0 tx=0x7ff4c800c040 comp rx=0 tx=0).stop 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 msgr2=0x559b80e26cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 --2- 172.21.15.7:0/2661198081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b80d9e8d0 0x559b80e26cd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00067b0 tx=0x7ff4d0000f40 comp rx=0 tx=0).stop 2024-08-19T00:43:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d7a00640 1 -- 172.21.15.7:0/2661198081 reap_dead start 2024-08-19T00:43:39.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 shutdown_connections 2024-08-19T00:43:39.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 >> 172.21.15.7:0/2661198081 conn(0x559b80d834e0 msgr2=0x559b80d822b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 shutdown_connections 2024-08-19T00:43:39.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.181+0000 7ff4d9eabf40 1 -- 172.21.15.7:0/2661198081 wait complete. 2024-08-19T00:43:39.188 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 500.00000000 2024-08-19T00:43:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 Processor -- start 2024-08-19T00:43:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 -- start start 2024-08-19T00:43:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fbef7b0 0x56244fc73430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7bb40 0x56244fbee410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fc7efb0 0x56244fbec780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56244fb4dd00 con 0x56244fc7efb0 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56244fb51d40 con 0x56244fc7bb40 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.262+0000 7f2871679f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56244fc7bf20 con 0x56244fbef7b0 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fc7efb0 0x56244fbec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fc7efb0 0x56244fbec780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40348/0 (socket says 172.21.15.7:40348) 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 -- 172.21.15.7:0/2288325098 learned_addr learned my addr 172.21.15.7:0/2288325098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286e800640 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fbef7b0 0x56244fc73430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286de00640 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7bb40 0x56244fbee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 -- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fbef7b0 msgr2=0x56244fc73430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fbef7b0 0x56244fc73430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 -- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7bb40 msgr2=0x56244fbee410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7bb40 0x56244fbee410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.263+0000 7f286f200640 1 -- 172.21.15.7:0/2288325098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56244fb0f080 con 0x56244fc7efb0 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f286f200640 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fc7efb0 0x56244fbec780 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2868001680 tx=0x7f2868001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94325ef19d2769dd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f286ca00640 1 -- 172.21.15.7:0/2288325098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868004520 con 0x56244fc7efb0 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f286ca00640 1 -- 172.21.15.7:0/2288325098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28680046c0 con 0x56244fc7efb0 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f286ca00640 1 -- 172.21.15.7:0/2288325098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868004af0 con 0x56244fc7efb0 2024-08-19T00:43:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 -- 172.21.15.7:0/2288325098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fc7efb0 msgr2=0x56244fbec780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fc7efb0 0x56244fbec780 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2868001680 tx=0x7f2868001b40 comp rx=0 tx=0).stop 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 -- 172.21.15.7:0/2288325098 shutdown_connections 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fc7efb0 0x56244fbec780 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7bb40 0x56244fbee410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 --2- 172.21.15.7:0/2288325098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fbef7b0 0x56244fc73430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 -- 172.21.15.7:0/2288325098 >> 172.21.15.7:0/2288325098 conn(0x56244fbd45d0 msgr2=0x56244fbefe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 -- 172.21.15.7:0/2288325098 shutdown_connections 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.264+0000 7f2871679f40 1 -- 172.21.15.7:0/2288325098 wait complete. 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.265+0000 7f2871679f40 1 Processor -- start 2024-08-19T00:43:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.265+0000 7f2871679f40 1 -- start start 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f2871679f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fbef7b0 0x56244fc69bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f2871679f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fc7bb40 0x56244fc6a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f2871679f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7efb0 0x56244fc72700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f2871679f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56244fbd3e70 con 0x56244fbef7b0 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f2871679f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56244fbee950 con 0x56244fc7efb0 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f2871679f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56244fc73b00 con 0x56244fc7bb40 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f286e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fbef7b0 0x56244fc69bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f286e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fbef7b0 0x56244fc69bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40364/0 (socket says 172.21.15.7:40364) 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.266+0000 7f286e800640 1 -- 172.21.15.7:0/966497224 learned_addr learned my addr 172.21.15.7:0/966497224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286f200640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7efb0 0x56244fc72700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286de00640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fc7bb40 0x56244fc6a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286e800640 1 -- 172.21.15.7:0/966497224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fc7bb40 msgr2=0x56244fc6a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286e800640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56244fc7bb40 0x56244fc6a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286e800640 1 -- 172.21.15.7:0/966497224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7efb0 msgr2=0x56244fc72700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286e800640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56244fc7efb0 0x56244fc72700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286e800640 1 -- 172.21.15.7:0/966497224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56244fbef5d0 con 0x56244fbef7b0 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f286e800640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fbef7b0 0x56244fc69bf0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f286000a550 tx=0x7f2860002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f2867400640 1 -- 172.21.15.7:0/966497224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286006c070 con 0x56244fbef7b0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f2867400640 1 -- 172.21.15.7:0/966497224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f286000a270 con 0x56244fbef7b0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f2867400640 1 -- 172.21.15.7:0/966497224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860053680 con 0x56244fbef7b0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.267+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56244fc6ee60 con 0x56244fbef7b0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.268+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56244fc721e0 con 0x56244fbef7b0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.269+0000 7f2867400640 1 -- 172.21.15.7:0/966497224 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f286006f070 con 0x56244fbef7b0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.270+0000 7f2867400640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f285006a810 0x7f285006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.270+0000 7f2867400640 1 -- 172.21.15.7:0/966497224 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f28600cd900 con 0x56244fbef7b0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.270+0000 7f286de00640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f285006a810 0x7f285006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.271+0000 7f2871679f40 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56244fc7f660 0x56244fc7fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.271+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:1 12.15 12:aa448500:::500.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x56244fc68280 con 0x56244fc7f660 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.271+0000 7f286f200640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56244fc7f660 0x56244fc7fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.271+0000 7f286de00640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f285006a810 0x7f285006ccd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x56244fc77740 tx=0x7f285c001710 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.271+0000 7f286f200640 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56244fc7f660 0x56244fc7fa40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f286f200640 1 -- 172.21.15.7:0/966497224 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(1 500.00000000 [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7f286800f030 con 0x56244fc7f660 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56244fc7f660 msgr2=0x56244fc7fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56244fc7f660 0x56244fc7fa40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f285006a810 msgr2=0x7f285006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f285006a810 0x7f285006ccd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x56244fc77740 tx=0x7f285c001710 comp rx=0 tx=0).stop 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fbef7b0 msgr2=0x56244fc69bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 --2- 172.21.15.7:0/966497224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56244fbef7b0 0x56244fc69bf0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f286000a550 tx=0x7f2860002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f286f200640 1 -- 172.21.15.7:0/966497224 reap_dead start 2024-08-19T00:43:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 shutdown_connections 2024-08-19T00:43:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 >> 172.21.15.7:0/966497224 conn(0x56244fbd45d0 msgr2=0x56244fbd49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 shutdown_connections 2024-08-19T00:43:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.272+0000 7f2871679f40 1 -- 172.21.15.7:0/966497224 wait complete. 2024-08-19T00:43:39.280 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds_snaptable 2024-08-19T00:43:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.354+0000 7f0acd952f40 1 Processor -- start 2024-08-19T00:43:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.354+0000 7f0acd952f40 1 -- start start 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acd952f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab00022a0 0x5613d83108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acd952f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5613d8316670 0x5613d831f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acd952f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acd952f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5613d81edd00 con 0x7f0ab00022a0 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acd952f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5613d81f1d40 con 0x5613d8293cb0 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acd952f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5613d831edc0 con 0x5613d8316670 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab00022a0 0x5613d83108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.355+0000 7f0acac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab00022a0 0x5613d83108a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40382/0 (socket says 172.21.15.7:40382) 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acac00640 1 -- 172.21.15.7:0/2351024991 learned_addr learned my addr 172.21.15.7:0/2351024991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0aca200640 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5613d8316670 0x5613d831f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acb600640 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acac00640 1 -- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5613d8316670 msgr2=0x5613d831f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acac00640 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5613d8316670 0x5613d831f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acac00640 1 -- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 msgr2=0x5613d831fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acac00640 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acac00640 1 -- 172.21.15.7:0/2351024991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613d81af080 con 0x7f0ab00022a0 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acb600640 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0acac00640 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab00022a0 0x5613d83108a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0263c0 tx=0x7f0abc050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8a0791c1c6f9aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0ac8e00640 1 -- 172.21.15.7:0/2351024991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc061450 con 0x7f0ab00022a0 2024-08-19T00:43:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0ac8e00640 1 -- 172.21.15.7:0/2351024991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc066070 con 0x7f0ab00022a0 2024-08-19T00:43:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.356+0000 7f0ac8e00640 1 -- 172.21.15.7:0/2351024991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc061830 con 0x7f0ab00022a0 2024-08-19T00:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 -- 172.21.15.7:0/2351024991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab00022a0 msgr2=0x5613d83108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab00022a0 0x5613d83108a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0263c0 tx=0x7f0abc050000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 -- 172.21.15.7:0/2351024991 shutdown_connections 2024-08-19T00:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5613d8316670 0x5613d831f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 --2- 172.21.15.7:0/2351024991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab00022a0 0x5613d83108a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 -- 172.21.15.7:0/2351024991 >> 172.21.15.7:0/2351024991 conn(0x5613d82764e0 msgr2=0x5613d8247720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 -- 172.21.15.7:0/2351024991 shutdown_connections 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.357+0000 7f0acd952f40 1 -- 172.21.15.7:0/2351024991 wait complete. 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.358+0000 7f0acd952f40 1 Processor -- start 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.358+0000 7f0acd952f40 1 -- start start 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acd952f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acd952f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5613d8316670 0x5613d8247290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acd952f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ab00022a0 0x5613d830cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acd952f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5613d8275fd0 con 0x5613d8316670 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acd952f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5613d8275aa0 con 0x5613d8293cb0 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acd952f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5613d8275cf0 con 0x7f0ab00022a0 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5613d8316670 0x5613d8247290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5613d8316670 0x5613d8247290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40386/0 (socket says 172.21.15.7:40386) 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 -- 172.21.15.7:0/1028752610 learned_addr learned my addr 172.21.15.7:0/1028752610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acb600640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ab00022a0 0x5613d830cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0acac00640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 -- 172.21.15.7:0/1028752610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ab00022a0 msgr2=0x5613d830cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ab00022a0 0x5613d830cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 -- 172.21.15.7:0/1028752610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 msgr2=0x5613d831fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5613d8293cb0 0x5613d831fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.359+0000 7f0aca200640 1 -- 172.21.15.7:0/1028752610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613d82477d0 con 0x5613d8316670 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.360+0000 7f0aca200640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5613d8316670 0x5613d8247290 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8011e70 tx=0x7f0ab800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.360+0000 7f0ac3400640 1 -- 172.21.15.7:0/1028752610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8012640 con 0x5613d8316670 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.360+0000 7f0ac3400640 1 -- 172.21.15.7:0/1028752610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab8016030 con 0x5613d8316670 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.360+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613d830c010 con 0x5613d8316670 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.360+0000 7f0ac3400640 1 -- 172.21.15.7:0/1028752610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80129e0 con 0x5613d8316670 2024-08-19T00:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.360+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613d830c5d0 con 0x5613d8316670 2024-08-19T00:43:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.362+0000 7f0ac3400640 1 -- 172.21.15.7:0/1028752610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ab800e050 con 0x5613d8316670 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.363+0000 7f0ac3400640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0aac06a840 0x7f0aac06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.363+0000 7f0ac3400640 1 -- 172.21.15.7:0/1028752610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f0ab8089f50 con 0x5613d8316670 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.363+0000 7f0acac00640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0aac06a840 0x7f0aac06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.363+0000 7f0acd952f40 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5613d8246be0 0x5613d83b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.363+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.d 12:b50e409b:::mds_snaptable:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5613d83b51c0 con 0x5613d8246be0 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.363+0000 7f0acb600640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5613d8246be0 0x5613d83b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acac00640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0aac06a840 0x7f0aac06cd00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0263c0 tx=0x7f0abc052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acb600640 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5613d8246be0 0x5613d83b4c80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acb600640 1 -- 172.21.15.7:0/1028752610 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 mds_snaptable [omap-get-keys out=5b] v0'0 uv1 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7f0ac40128c0 con 0x5613d8246be0 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5613d8246be0 msgr2=0x5613d83b4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5613d8246be0 0x5613d83b4c80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0aac06a840 msgr2=0x7f0aac06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0aac06a840 0x7f0aac06cd00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0263c0 tx=0x7f0abc052000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5613d8316670 msgr2=0x5613d8247290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 --2- 172.21.15.7:0/1028752610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5613d8316670 0x5613d8247290 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8011e70 tx=0x7f0ab800f710 comp rx=0 tx=0).stop 2024-08-19T00:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acb600640 1 -- 172.21.15.7:0/1028752610 reap_dead start 2024-08-19T00:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 shutdown_connections 2024-08-19T00:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.364+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 >> 172.21.15.7:0/1028752610 conn(0x5613d82764e0 msgr2=0x5613d8321250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.365+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 shutdown_connections 2024-08-19T00:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.365+0000 7f0acd952f40 1 -- 172.21.15.7:0/1028752610 wait complete. 2024-08-19T00:43:39.371 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_inotable 2024-08-19T00:43:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 Processor -- start 2024-08-19T00:43:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 -- start start 2024-08-19T00:43:39.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 0x562482b41d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 0x562482a77ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482a78430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562482b4fdc0 con 0x562482ac28d0 2024-08-19T00:43:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562482a1ed00 con 0x562482aaa990 2024-08-19T00:43:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.445+0000 7f3f01f1bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562482b500a0 con 0x562482aaa5b0 2024-08-19T00:43:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482a78430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482a78430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40402/0 (socket says 172.21.15.7:40402) 2024-08-19T00:43:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 -- 172.21.15.7:0/3875674215 learned_addr learned my addr 172.21.15.7:0/3875674215 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3efdc00640 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 0x562482a77ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3efe600640 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 0x562482b41d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 -- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 msgr2=0x562482b41d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 0x562482b41d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 -- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 msgr2=0x562482a77ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 0x562482a77ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 -- 172.21.15.7:0/3875674215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624829a3b30 con 0x562482ac28d0 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.446+0000 7f3eff000640 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482a78430 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80015b0 tx=0x7f3ef8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3ec06d329f1882 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3ef7e00640 1 -- 172.21.15.7:0/3875674215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8016070 con 0x562482ac28d0 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3ef7e00640 1 -- 172.21.15.7:0/3875674215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef800f710 con 0x562482ac28d0 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3ef7e00640 1 -- 172.21.15.7:0/3875674215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800fb00 con 0x562482ac28d0 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/3875674215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 msgr2=0x562482a78430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482a78430 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80015b0 tx=0x7f3ef8001a70 comp rx=0 tx=0).stop 2024-08-19T00:43:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/3875674215 shutdown_connections 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482a78430 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 0x562482a77ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/3875674215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 0x562482b41d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/3875674215 >> 172.21.15.7:0/3875674215 conn(0x562482aa74e0 msgr2=0x562482b51da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/3875674215 shutdown_connections 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.447+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/3875674215 wait complete. 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.448+0000 7f3f01f1bf40 1 Processor -- start 2024-08-19T00:43:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.448+0000 7f3f01f1bf40 1 -- start start 2024-08-19T00:43:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3f01f1bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 0x562482b4ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3f01f1bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 0x562482b3ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3f01f1bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482b365c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3f01f1bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562482b48c00 con 0x562482ac28d0 2024-08-19T00:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3f01f1bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562482b51080 con 0x562482aaa990 2024-08-19T00:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3f01f1bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562482aa9f10 con 0x562482aaa5b0 2024-08-19T00:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3eff000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482b365c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3eff000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482b365c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40408/0 (socket says 172.21.15.7:40408) 2024-08-19T00:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3eff000640 1 -- 172.21.15.7:0/1318506962 learned_addr learned my addr 172.21.15.7:0/1318506962 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3efe600640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 0x562482b4ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.449+0000 7f3efdc00640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 0x562482b3ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3eff000640 1 -- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 msgr2=0x562482b4ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3eff000640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562482aaa5b0 0x562482b4ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3eff000640 1 -- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 msgr2=0x562482b3ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3eff000640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562482aaa990 0x562482b3ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3eff000640 1 -- 172.21.15.7:0/1318506962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624829e0080 con 0x562482ac28d0 2024-08-19T00:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3eff000640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482b365c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8004290 tx=0x7f3ef8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3ef6a00640 1 -- 172.21.15.7:0/1318506962 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8021070 con 0x562482ac28d0 2024-08-19T00:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3ef6a00640 1 -- 172.21.15.7:0/1318506962 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef8011440 con 0x562482ac28d0 2024-08-19T00:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562482b36b00 con 0x562482ac28d0 2024-08-19T00:43:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.450+0000 7f3ef6a00640 1 -- 172.21.15.7:0/1318506962 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8016040 con 0x562482ac28d0 2024-08-19T00:43:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.451+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562482b52630 con 0x562482ac28d0 2024-08-19T00:43:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.452+0000 7f3ef6a00640 1 -- 172.21.15.7:0/1318506962 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ef8024070 con 0x562482ac28d0 2024-08-19T00:43:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.453+0000 7f3ef6a00640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ee006a810 0x7f3ee006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.453+0000 7f3ef6a00640 1 -- 172.21.15.7:0/1318506962 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f3ef808aef0 con 0x562482ac28d0 2024-08-19T00:43:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.454+0000 7f3efe600640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ee006a810 0x7f3ee006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.454+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562482b3acc0 0x562482b3b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.454+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x562482b3b5e0 con 0x562482b3acc0 2024-08-19T00:43:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.454+0000 7f3efdc00640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562482b3acc0 0x562482b3b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.454+0000 7f3efe600640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ee006a810 0x7f3ee006ccd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0057000 tx=0x7f3ef0062040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3efdc00640 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562482b3acc0 0x562482b3b0a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3efdc00640 1 -- 172.21.15.7:0/1318506962 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 mds0_inotable [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 157+0+5 (crc 0 0 0) 0x7f3eec009a30 con 0x562482b3acc0 2024-08-19T00:43:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562482b3acc0 msgr2=0x562482b3b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562482b3acc0 0x562482b3b0a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ee006a810 msgr2=0x7f3ee006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ee006a810 0x7f3ee006ccd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0057000 tx=0x7f3ef0062040 comp rx=0 tx=0).stop 2024-08-19T00:43:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 msgr2=0x562482b365c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3f01f1bf40 1 --2- 172.21.15.7:0/1318506962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562482ac28d0 0x562482b365c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8004290 tx=0x7f3ef8001250 comp rx=0 tx=0).stop 2024-08-19T00:43:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.455+0000 7f3eff000640 1 -- 172.21.15.7:0/1318506962 reap_dead start 2024-08-19T00:43:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.456+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 shutdown_connections 2024-08-19T00:43:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.456+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 >> 172.21.15.7:0/1318506962 conn(0x562482aa74e0 msgr2=0x562482b3f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.456+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 shutdown_connections 2024-08-19T00:43:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.456+0000 7f3f01f1bf40 1 -- 172.21.15.7:0/1318506962 wait complete. 2024-08-19T00:43:39.466 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100.00000000 2024-08-19T00:43:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.540+0000 7efe9460bf40 1 Processor -- start 2024-08-19T00:43:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.540+0000 7efe9460bf40 1 -- start start 2024-08-19T00:43:39.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe9460bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aabd5b0 0x55639abf1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe9460bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd990 0x55639abf2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe9460bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aad58d0 0x55639aabc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe9460bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55639ab62dc0 con 0x55639aabd990 2024-08-19T00:43:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe9460bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55639aa31d00 con 0x55639aad58d0 2024-08-19T00:43:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe9460bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55639ab630a0 con 0x55639aabd5b0 2024-08-19T00:43:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe8be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd990 0x55639abf2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe8be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd990 0x55639abf2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40422/0 (socket says 172.21.15.7:40422) 2024-08-19T00:43:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.541+0000 7efe8be00640 1 -- 172.21.15.7:0/3299395390 learned_addr learned my addr 172.21.15.7:0/3299395390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe90c00640 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aabd5b0 0x55639abf1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe91600640 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aad58d0 0x55639aabc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe8be00640 1 -- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aabd5b0 msgr2=0x55639abf1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe8be00640 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aabd5b0 0x55639abf1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe8be00640 1 -- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aad58d0 msgr2=0x55639aabc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe8be00640 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aad58d0 0x55639aabc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe8be00640 1 -- 172.21.15.7:0/3299395390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639a9b6b30 con 0x55639aabd990 2024-08-19T00:43:39.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.542+0000 7efe8be00640 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd990 0x55639abf2330 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7efe7c025b20 tx=0x7efe7c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc73b240cdabea59 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe8aa00640 1 -- 172.21.15.7:0/3299395390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c062070 con 0x55639aabd990 2024-08-19T00:43:39.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe8aa00640 1 -- 172.21.15.7:0/3299395390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c0547f0 con 0x55639aabd990 2024-08-19T00:43:39.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe8aa00640 1 -- 172.21.15.7:0/3299395390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c059040 con 0x55639aabd990 2024-08-19T00:43:39.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 -- 172.21.15.7:0/3299395390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd990 msgr2=0x55639abf2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd990 0x55639abf2330 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7efe7c025b20 tx=0x7efe7c04e000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 -- 172.21.15.7:0/3299395390 shutdown_connections 2024-08-19T00:43:39.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aad58d0 0x55639aabc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd990 0x55639abf2330 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3299395390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aabd5b0 0x55639abf1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 -- 172.21.15.7:0/3299395390 >> 172.21.15.7:0/3299395390 conn(0x55639aaba4e0 msgr2=0x55639aab9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 -- 172.21.15.7:0/3299395390 shutdown_connections 2024-08-19T00:43:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.543+0000 7efe9460bf40 1 -- 172.21.15.7:0/3299395390 wait complete. 2024-08-19T00:43:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.544+0000 7efe9460bf40 1 Processor -- start 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.544+0000 7efe9460bf40 1 -- start start 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe9460bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd5b0 0x55639ab5e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe9460bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aabd990 0x55639ab579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe9460bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aad58d0 0x55639ab56670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe9460bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55639ab5ac00 con 0x55639aabd5b0 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe9460bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55639ab5b630 con 0x55639aabd990 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe9460bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55639aad7df0 con 0x55639aad58d0 2024-08-19T00:43:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe90c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd5b0 0x55639ab5e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe90c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd5b0 0x55639ab5e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40434/0 (socket says 172.21.15.7:40434) 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe90c00640 1 -- 172.21.15.7:0/3050543591 learned_addr learned my addr 172.21.15.7:0/3050543591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe91600640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aad58d0 0x55639ab56670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.545+0000 7efe8be00640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aabd990 0x55639ab579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe90c00640 1 -- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aad58d0 msgr2=0x55639ab56670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe90c00640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55639aad58d0 0x55639ab56670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe90c00640 1 -- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aabd990 msgr2=0x55639ab579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe90c00640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aabd990 0x55639ab579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe90c00640 1 -- 172.21.15.7:0/3050543591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639a9f3080 con 0x55639aabd5b0 2024-08-19T00:43:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe8be00640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55639aabd990 0x55639ab579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe90c00640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd5b0 0x55639ab5e940 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7efe84008790 tx=0x7efe84008880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe89600640 1 -- 172.21.15.7:0/3050543591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84019020 con 0x55639aabd5b0 2024-08-19T00:43:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe89600640 1 -- 172.21.15.7:0/3050543591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe84015880 con 0x55639aabd5b0 2024-08-19T00:43:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe89600640 1 -- 172.21.15.7:0/3050543591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84015c30 con 0x55639aabd5b0 2024-08-19T00:43:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55639ab5cfc0 con 0x55639aabd5b0 2024-08-19T00:43:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.546+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639ab56150 con 0x55639aabd5b0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.548+0000 7efe89600640 1 -- 172.21.15.7:0/3050543591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe8401c020 con 0x55639aabd5b0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.549+0000 7efe89600640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe7006a810 0x7efe7006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.549+0000 7efe89600640 1 -- 172.21.15.7:0/3050543591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7efe8408a360 con 0x55639aabd5b0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.549+0000 7efe8be00640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe7006a810 0x7efe7006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.549+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55639ab57ee0 0x55639abfc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.549+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:cd5a64a3:::100.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55639ab43c60 con 0x55639ab57ee0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.550+0000 7efe91600640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55639ab57ee0 0x55639abfc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.550+0000 7efe8be00640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe7006a810 0x7efe7006ccd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00a4f0 tx=0x7efe7c051000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.550+0000 7efe91600640 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55639ab57ee0 0x55639abfc0e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe91600640 1 -- 172.21.15.7:0/3050543591 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 100.00000000 [omap-get-keys out=155b] v0'0 uv1 ondisk = 0) ==== 156+0+155 (crc 0 0 0) 0x7efe8c003530 con 0x55639ab57ee0 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray0_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray1_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray2_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray3_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray4_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray5_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray6_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray7_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray8_head 2024-08-19T00:43:39.562 INFO:teuthology.orchestra.run.smithi007.stdout:stray9_head 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55639ab57ee0 msgr2=0x55639abfc0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55639ab57ee0 0x55639abfc0e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe7006a810 msgr2=0x7efe7006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe7006a810 0x7efe7006ccd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00a4f0 tx=0x7efe7c051000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd5b0 msgr2=0x55639ab5e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 --2- 172.21.15.7:0/3050543591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55639aabd5b0 0x55639ab5e940 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7efe84008790 tx=0x7efe84008880 comp rx=0 tx=0).stop 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe91600640 1 -- 172.21.15.7:0/3050543591 reap_dead start 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 shutdown_connections 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 >> 172.21.15.7:0/3050543591 conn(0x55639aaba4e0 msgr2=0x55639ab63800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 shutdown_connections 2024-08-19T00:43:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.551+0000 7efe9460bf40 1 -- 172.21.15.7:0/3050543591 wait complete. 2024-08-19T00:43:39.565 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_sessionmap 2024-08-19T00:43:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.639+0000 7f9a1071ef40 1 Processor -- start 2024-08-19T00:43:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.639+0000 7f9a1071ef40 1 -- start start 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a1071ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e32148f40 0x556e321e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a1071ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e3214a5b0 0x556e321f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a1071ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a990 0x556e321f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a1071ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556e321498f0 con 0x556e3214a5b0 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a1071ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556e320bed00 con 0x556e32148f40 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a1071ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556e321efdc0 con 0x556e3214a990 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e3214a5b0 0x556e321f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e3214a5b0 0x556e321f0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40446/0 (socket says 172.21.15.7:40446) 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 -- 172.21.15.7:0/3307316229 learned_addr learned my addr 172.21.15.7:0/3307316229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 -- 172.21.15.7:0/3307316229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a990 msgr2=0x556e321f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 --2- 172.21.15.7:0/3307316229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a990 0x556e321f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 -- 172.21.15.7:0/3307316229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e32148f40 msgr2=0x556e321e3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 --2- 172.21.15.7:0/3307316229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e32148f40 0x556e321e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.640+0000 7f9a07e00640 1 -- 172.21.15.7:0/3307316229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e32043b30 con 0x556e3214a5b0 2024-08-19T00:43:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a07e00640 1 --2- 172.21.15.7:0/3307316229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e3214a5b0 0x556e321f0770 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f99f8006ec0 tx=0x7f99f800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971125d1f151cb34 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a06a00640 1 -- 172.21.15.7:0/3307316229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8012070 con 0x556e3214a5b0 2024-08-19T00:43:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a06a00640 1 -- 172.21.15.7:0/3307316229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f800e690 con 0x556e3214a5b0 2024-08-19T00:43:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a06a00640 1 -- 172.21.15.7:0/3307316229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f800eb00 con 0x556e3214a5b0 2024-08-19T00:43:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 -- 172.21.15.7:0/3307316229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e3214a5b0 msgr2=0x556e321f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/3307316229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e3214a5b0 0x556e321f0770 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f99f8006ec0 tx=0x7f99f800b6c0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 -- 172.21.15.7:0/3307316229 shutdown_connections 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/3307316229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a990 0x556e321f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/3307316229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e3214a5b0 0x556e321f0770 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/3307316229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e32148f40 0x556e321e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 -- 172.21.15.7:0/3307316229 >> 172.21.15.7:0/3307316229 conn(0x556e321474e0 msgr2=0x556e32163940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.641+0000 7f9a1071ef40 1 -- 172.21.15.7:0/3307316229 shutdown_connections 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.642+0000 7f9a1071ef40 1 -- 172.21.15.7:0/3307316229 wait complete. 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.642+0000 7f9a1071ef40 1 Processor -- start 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.642+0000 7f9a1071ef40 1 -- start start 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a1071ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e32148f40 0x556e32118690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a1071ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a5b0 0x556e32289330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a1071ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e3214a990 0x556e32289870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a1071ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556e321e46a0 con 0x556e32148f40 2024-08-19T00:43:39.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a1071ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556e321643d0 con 0x556e3214a990 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a1071ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556e321e4490 con 0x556e3214a5b0 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a0ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e32148f40 0x556e32118690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a0ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e32148f40 0x556e32118690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40454/0 (socket says 172.21.15.7:40454) 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.643+0000 7f9a0ce00640 1 -- 172.21.15.7:0/651109859 learned_addr learned my addr 172.21.15.7:0/651109859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a07e00640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a5b0 0x556e32289330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a0d800640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e3214a990 0x556e32289870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a0ce00640 1 -- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a5b0 msgr2=0x556e32289330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a0ce00640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556e3214a5b0 0x556e32289330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a0ce00640 1 -- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e3214a990 msgr2=0x556e32289870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a0ce00640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e3214a990 0x556e32289870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a0ce00640 1 -- 172.21.15.7:0/651109859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e32080080 con 0x556e32148f40 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a0ce00640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e32148f40 0x556e32118690 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9a00045dd0 tx=0x7f9a000458a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.644+0000 7f9a05600640 1 -- 172.21.15.7:0/651109859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00059040 con 0x556e32148f40 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.645+0000 7f9a05600640 1 -- 172.21.15.7:0/651109859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a000547f0 con 0x556e32148f40 2024-08-19T00:43:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.645+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e321eee80 con 0x556e32148f40 2024-08-19T00:43:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.645+0000 7f9a05600640 1 -- 172.21.15.7:0/651109859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00054be0 con 0x556e32148f40 2024-08-19T00:43:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.645+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e321e1310 con 0x556e32148f40 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.647+0000 7f9a05600640 1 -- 172.21.15.7:0/651109859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a0005f470 con 0x556e32148f40 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.647+0000 7f9a05600640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f99ec06a810 0x7f99ec06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.647+0000 7f9a05600640 1 -- 172.21.15.7:0/651109859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f9a000cdc20 con 0x556e32148f40 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.648+0000 7f9a07e00640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f99ec06a810 0x7f99ec06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.648+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x556e32118bd0 0x556e32291600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.648+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:1 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x556e321e9400 con 0x556e32118bd0 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.648+0000 7f9a0d800640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x556e32118bd0 0x556e32291600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.648+0000 7f9a07e00640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f99ec06a810 0x7f99ec06ccd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x556e32163180 tx=0x7f99f800f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a0d800640 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x556e32118bd0 0x556e32291600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a0d800640 1 -- 172.21.15.7:0/651109859 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x7f9a0800d820 con 0x556e32118bd0 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x556e32118bd0 msgr2=0x556e32291600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x556e32118bd0 0x556e32291600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f99ec06a810 msgr2=0x7f99ec06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f99ec06a810 0x7f99ec06ccd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x556e32163180 tx=0x7f99f800f000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e32148f40 msgr2=0x556e32118690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 --2- 172.21.15.7:0/651109859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e32148f40 0x556e32118690 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9a00045dd0 tx=0x7f9a000458a0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a0d800640 1 -- 172.21.15.7:0/651109859 reap_dead start 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 shutdown_connections 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.649+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 >> 172.21.15.7:0/651109859 conn(0x556e321474e0 msgr2=0x556e321649c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.650+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 shutdown_connections 2024-08-19T00:43:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.650+0000 7f9a1071ef40 1 -- 172.21.15.7:0/651109859 wait complete. 2024-08-19T00:43:39.656 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 400.00000000 2024-08-19T00:43:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.729+0000 7fa458434f40 1 Processor -- start 2024-08-19T00:43:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.729+0000 7fa458434f40 1 -- start start 2024-08-19T00:43:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa458434f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee2f40 0x5617aff8ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa458434f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 0x5617aff786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa458434f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee4990 0x5617afedf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa458434f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617afee38f0 con 0x5617afee2f40 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa458434f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5617afe58d00 con 0x5617afee45b0 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa458434f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5617aff89dc0 con 0x5617afee4990 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa455600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee2f40 0x5617aff8ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa455600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee2f40 0x5617aff8ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40470/0 (socket says 172.21.15.7:40470) 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa455600640 1 -- 172.21.15.7:0/2152096691 learned_addr learned my addr 172.21.15.7:0/2152096691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.730+0000 7fa456000640 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee4990 0x5617afedf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa454c00640 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 0x5617aff786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa455600640 1 -- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee4990 msgr2=0x5617afedf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa455600640 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee4990 0x5617afedf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa455600640 1 -- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 msgr2=0x5617aff786d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa455600640 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 0x5617aff786d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa455600640 1 -- 172.21.15.7:0/2152096691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617afdddb30 con 0x5617afee2f40 2024-08-19T00:43:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa455600640 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee2f40 0x5617aff8ac00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa44800b1c0 tx=0x7fa44800b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30594535a870395 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa44f400640 1 -- 172.21.15.7:0/2152096691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448016070 con 0x5617afee2f40 2024-08-19T00:43:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa44f400640 1 -- 172.21.15.7:0/2152096691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44800d6d0 con 0x5617afee2f40 2024-08-19T00:43:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.731+0000 7fa44f400640 1 -- 172.21.15.7:0/2152096691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44800dac0 con 0x5617afee2f40 2024-08-19T00:43:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 -- 172.21.15.7:0/2152096691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee2f40 msgr2=0x5617aff8ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee2f40 0x5617aff8ac00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa44800b1c0 tx=0x7fa44800b680 comp rx=0 tx=0).stop 2024-08-19T00:43:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 -- 172.21.15.7:0/2152096691 shutdown_connections 2024-08-19T00:43:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee4990 0x5617afedf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 0x5617aff786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 --2- 172.21.15.7:0/2152096691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee2f40 0x5617aff8ac00 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 -- 172.21.15.7:0/2152096691 >> 172.21.15.7:0/2152096691 conn(0x5617afee14e0 msgr2=0x5617afeb1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 -- 172.21.15.7:0/2152096691 shutdown_connections 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.732+0000 7fa458434f40 1 -- 172.21.15.7:0/2152096691 wait complete. 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.733+0000 7fa458434f40 1 Processor -- start 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.733+0000 7fa458434f40 1 -- start start 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa458434f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee2f40 0x5617aff7ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa458434f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 0x5617afeb18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa458434f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee4990 0x5617aff7bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa458434f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617aff824b0 con 0x5617afee4990 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa458434f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5617afee0d80 con 0x5617afee45b0 2024-08-19T00:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa458434f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5617aff8b140 con 0x5617afee2f40 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa456000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee4990 0x5617aff7bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa456000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee4990 0x5617aff7bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40476/0 (socket says 172.21.15.7:40476) 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa456000640 1 -- 172.21.15.7:0/186206634 learned_addr learned my addr 172.21.15.7:0/186206634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa455600640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee2f40 0x5617aff7ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.734+0000 7fa454c00640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 0x5617afeb18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa456000640 1 -- 172.21.15.7:0/186206634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee2f40 msgr2=0x5617aff7ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa456000640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617afee2f40 0x5617aff7ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa456000640 1 -- 172.21.15.7:0/186206634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 msgr2=0x5617afeb18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa456000640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617afee45b0 0x5617afeb18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa456000640 1 -- 172.21.15.7:0/186206634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617afe1a080 con 0x5617afee4990 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa456000640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee4990 0x5617aff7bef0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa450046080 tx=0x7fa4500033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa44e000640 1 -- 172.21.15.7:0/186206634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450055040 con 0x5617afee4990 2024-08-19T00:43:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa44e000640 1 -- 172.21.15.7:0/186206634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45005a450 con 0x5617afee4990 2024-08-19T00:43:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa44e000640 1 -- 172.21.15.7:0/186206634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45005a800 con 0x5617afee4990 2024-08-19T00:43:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617aff752c0 con 0x5617afee4990 2024-08-19T00:43:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.735+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617aff74fd0 con 0x5617afee4990 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.737+0000 7fa44e000640 1 -- 172.21.15.7:0/186206634 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa450058020 con 0x5617afee4990 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.738+0000 7fa44e000640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa43806a840 0x7fa43806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.738+0000 7fa44e000640 1 -- 172.21.15.7:0/186206634 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fa4500cdee0 con 0x5617afee4990 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.738+0000 7fa455600640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa43806a840 0x7fa43806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.738+0000 7fa458434f40 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5617afeb1e00 0x5617b00233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.738+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5617afee1950 con 0x5617afeb1e00 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.739+0000 7fa454c00640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5617afeb1e00 0x5617b00233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.739+0000 7fa455600640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa43806a840 0x7fa43806cd00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa44800b6c0 tx=0x7fa448002000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.739+0000 7fa454c00640 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5617afeb1e00 0x5617b00233a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.739+0000 7fa454c00640 1 -- 172.21.15.7:0/186206634 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 400.00000000 [omap-get-keys out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x7fa444009970 con 0x5617afeb1e00 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.739+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5617afeb1e00 msgr2=0x5617b00233a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.739+0000 7fa458434f40 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5617afeb1e00 0x5617b00233a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa43806a840 msgr2=0x7fa43806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa43806a840 0x7fa43806cd00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa44800b6c0 tx=0x7fa448002000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee4990 msgr2=0x5617aff7bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 --2- 172.21.15.7:0/186206634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617afee4990 0x5617aff7bef0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa450046080 tx=0x7fa4500033a0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa456000640 1 -- 172.21.15.7:0/186206634 reap_dead start 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 shutdown_connections 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 >> 172.21.15.7:0/186206634 conn(0x5617afee14e0 msgr2=0x5617aff7b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 shutdown_connections 2024-08-19T00:43:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.740+0000 7fa458434f40 1 -- 172.21.15.7:0/186206634 wait complete. 2024-08-19T00:43:39.747 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100.00000000.inode 2024-08-19T00:43:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.820+0000 7f1f54cf6f40 1 Processor -- start 2024-08-19T00:43:39.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.821+0000 7f1f54cf6f40 1 -- start start 2024-08-19T00:43:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.821+0000 7f1f54cf6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f596551f40 0x55f59654e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.821+0000 7f1f54cf6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5965535b0 0x55f5965ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.821+0000 7f1f54cf6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.821+0000 7f1f54cf6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f5965528f0 con 0x55f596553990 2024-08-19T00:43:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.821+0000 7f1f54cf6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5964c7d00 con 0x55f5965535b0 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.821+0000 7f1f54cf6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f5965f8dc0 con 0x55f596551f40 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965f95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40482/0 (socket says 172.21.15.7:40482) 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 -- 172.21.15.7:0/2747602721 learned_addr learned my addr 172.21.15.7:0/2747602721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f51e00640 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f596551f40 0x55f59654e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f51400640 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5965535b0 0x55f5965ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 -- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f596551f40 msgr2=0x55f59654e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f596551f40 0x55f59654e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 -- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5965535b0 msgr2=0x55f5965ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5965535b0 0x55f5965ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 -- 172.21.15.7:0/2747602721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59644cb30 con 0x55f596553990 2024-08-19T00:43:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.822+0000 7f1f52800640 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965f95c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c002850 tx=0x7f1f4c002d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b023f21b50ec8e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f4be00640 1 -- 172.21.15.7:0/2747602721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c016020 con 0x55f596553990 2024-08-19T00:43:39.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f4be00640 1 -- 172.21.15.7:0/2747602721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00d9c0 con 0x55f596553990 2024-08-19T00:43:39.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f4be00640 1 -- 172.21.15.7:0/2747602721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00ddb0 con 0x55f596553990 2024-08-19T00:43:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/2747602721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 msgr2=0x55f5965f95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965f95c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c002850 tx=0x7f1f4c002d10 comp rx=0 tx=0).stop 2024-08-19T00:43:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/2747602721 shutdown_connections 2024-08-19T00:43:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965f95c0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5965535b0 0x55f5965ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/2747602721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f596551f40 0x55f59654e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/2747602721 >> 172.21.15.7:0/2747602721 conn(0x55f5965504e0 msgr2=0x55f59656d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/2747602721 shutdown_connections 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.823+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/2747602721 wait complete. 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.824+0000 7f1f54cf6f40 1 Processor -- start 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.824+0000 7f1f54cf6f40 1 -- start start 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f54cf6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f596551f40 0x55f5965ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f54cf6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f5965535b0 0x55f5965e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f54cf6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f54cf6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f5965f1a30 con 0x55f596553990 2024-08-19T00:43:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f54cf6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5965edfe0 con 0x55f596551f40 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f54cf6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f5965ee250 con 0x55f5965535b0 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40490/0 (socket says 172.21.15.7:40490) 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f52800640 1 -- 172.21.15.7:0/4291400384 learned_addr learned my addr 172.21.15.7:0/4291400384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f51400640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f5965535b0 0x55f5965e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.825+0000 7f1f51e00640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f596551f40 0x55f5965ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f52800640 1 -- 172.21.15.7:0/4291400384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f5965535b0 msgr2=0x55f5965e7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f52800640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f5965535b0 0x55f5965e7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f52800640 1 -- 172.21.15.7:0/4291400384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f596551f40 msgr2=0x55f5965ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f52800640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f596551f40 0x55f5965ea4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f52800640 1 -- 172.21.15.7:0/4291400384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f596489080 con 0x55f596553990 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f52800640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965e7890 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c002d50 tx=0x7f1f4c0033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f4aa00640 1 -- 172.21.15.7:0/4291400384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c016030 con 0x55f596553990 2024-08-19T00:43:39.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f4aa00640 1 -- 172.21.15.7:0/4291400384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c01b420 con 0x55f596553990 2024-08-19T00:43:39.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f4aa00640 1 -- 172.21.15.7:0/4291400384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c01b810 con 0x55f596553990 2024-08-19T00:43:39.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.826+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5965f2ef0 con 0x55f596553990 2024-08-19T00:43:39.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.827+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5965e9510 con 0x55f596553990 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.828+0000 7f1f4aa00640 1 -- 172.21.15.7:0/4291400384 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f4c019020 con 0x55f596553990 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.829+0000 7f1f4aa00640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f3406a810 0x7f1f3406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.829+0000 7f1f4aa00640 1 -- 172.21.15.7:0/4291400384 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1f4c08b5c0 con 0x55f596553990 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.830+0000 7f1f51e00640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f3406a810 0x7f1f3406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.830+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f5965f33a0 0x55f5965e8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.830+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55f5965eaa10 con 0x55f5965f33a0 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.830+0000 7f1f51400640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f5965f33a0 0x55f5965e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.830+0000 7f1f51e00640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f3406a810 0x7f1f3406ccd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x55f59656f8f0 tx=0x7f1f44056040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.830+0000 7f1f51400640 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f5965f33a0 0x55f5965e8420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f51400640 1 -- 172.21.15.7:0/4291400384 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 100.00000000.inode [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) ==== 162+0+5 (crc 0 0 0) 0x7f1f400106b0 con 0x55f5965f33a0 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f5965f33a0 msgr2=0x55f5965e8420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f5965f33a0 0x55f5965e8420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f3406a810 msgr2=0x7f1f3406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f3406a810 0x7f1f3406ccd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x55f59656f8f0 tx=0x7f1f44056040 comp rx=0 tx=0).stop 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 msgr2=0x55f5965e7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 --2- 172.21.15.7:0/4291400384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f596553990 0x55f5965e7890 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c002d50 tx=0x7f1f4c0033a0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f52800640 1 -- 172.21.15.7:0/4291400384 reap_dead start 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 shutdown_connections 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 >> 172.21.15.7:0/4291400384 conn(0x55f5965504e0 msgr2=0x55f5965f9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 shutdown_connections 2024-08-19T00:43:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.831+0000 7f1f54cf6f40 1 -- 172.21.15.7:0/4291400384 wait complete. 2024-08-19T00:43:39.838 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-08-19T00:43:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.911+0000 7f13c7ddbf40 1 Processor -- start 2024-08-19T00:43:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.911+0000 7f13c7ddbf40 1 -- start start 2024-08-19T00:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13c7ddbf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf00f40 0x56003cf9ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13c7ddbf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf025b0 0x56003cfaa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13c7ddbf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf02990 0x56003cf9d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13c7ddbf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56003cf018f0 con 0x56003cf025b0 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13c7ddbf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56003ce76d00 con 0x56003cf02990 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13c7ddbf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56003cfa7dc0 con 0x56003cf00f40 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf025b0 0x56003cfaa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf025b0 0x56003cfaa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40504/0 (socket says 172.21.15.7:40504) 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.912+0000 7f13bfe00640 1 -- 172.21.15.7:0/2180221775 learned_addr learned my addr 172.21.15.7:0/2180221775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13c5000640 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf00f40 0x56003cf9ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13c5a00640 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf02990 0x56003cf9d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bfe00640 1 -- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf00f40 msgr2=0x56003cf9ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bfe00640 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf00f40 0x56003cf9ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bfe00640 1 -- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf02990 msgr2=0x56003cf9d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bfe00640 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf02990 0x56003cf9d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bfe00640 1 -- 172.21.15.7:0/2180221775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56003cdfbb30 con 0x56003cf025b0 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13c5a00640 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf02990 0x56003cf9d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bfe00640 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf025b0 0x56003cfaa140 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f13b000a770 tx=0x7f13b000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a291194541ce05 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bea00640 1 -- 172.21.15.7:0/2180221775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0018070 con 0x56003cf025b0 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bea00640 1 -- 172.21.15.7:0/2180221775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b0007600 con 0x56003cf025b0 2024-08-19T00:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.913+0000 7f13bea00640 1 -- 172.21.15.7:0/2180221775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b00079b0 con 0x56003cf025b0 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2180221775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf025b0 msgr2=0x56003cfaa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf025b0 0x56003cfaa140 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f13b000a770 tx=0x7f13b000a860 comp rx=0 tx=0).stop 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2180221775 shutdown_connections 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf02990 0x56003cf9d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf025b0 0x56003cfaa140 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2180221775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf00f40 0x56003cf9ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2180221775 >> 172.21.15.7:0/2180221775 conn(0x56003ceff4e0 msgr2=0x56003cf1a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2180221775 shutdown_connections 2024-08-19T00:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.914+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2180221775 wait complete. 2024-08-19T00:43:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.915+0000 7f13c7ddbf40 1 Processor -- start 2024-08-19T00:43:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.915+0000 7f13c7ddbf40 1 -- start start 2024-08-19T00:43:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c7ddbf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf00f40 0x56003cf999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c7ddbf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf025b0 0x56003cfa62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c7ddbf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf02990 0x56003cfa67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c7ddbf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56003cfa9cb0 con 0x56003cf00f40 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c7ddbf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56003ceff8c0 con 0x56003cf025b0 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c7ddbf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56003cfa9380 con 0x56003cf02990 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf00f40 0x56003cf999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf00f40 0x56003cf999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40506/0 (socket says 172.21.15.7:40506) 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c5000640 1 -- 172.21.15.7:0/2672095862 learned_addr learned my addr 172.21.15.7:0/2672095862 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13bfe00640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf025b0 0x56003cfa62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.916+0000 7f13c5a00640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf02990 0x56003cfa67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c5000640 1 -- 172.21.15.7:0/2672095862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf02990 msgr2=0x56003cfa67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c5000640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56003cf02990 0x56003cfa67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c5000640 1 -- 172.21.15.7:0/2672095862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf025b0 msgr2=0x56003cfa62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c5000640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf025b0 0x56003cfa62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c5000640 1 -- 172.21.15.7:0/2672095862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56003ce38080 con 0x56003cf00f40 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13bfe00640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56003cf025b0 0x56003cfa62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c5000640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf00f40 0x56003cf999c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f13b8001d60 tx=0x7f13b800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13bd600640 1 -- 172.21.15.7:0/2672095862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b800f860 con 0x56003cf00f40 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13bd600640 1 -- 172.21.15.7:0/2672095862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8013030 con 0x56003cf00f40 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13bd600640 1 -- 172.21.15.7:0/2672095862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b800fc40 con 0x56003cf00f40 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56003cfa7110 con 0x56003cf00f40 2024-08-19T00:43:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.917+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56003cfa2b00 con 0x56003cf00f40 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.919+0000 7f13bd600640 1 -- 172.21.15.7:0/2672095862 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13b80173d0 con 0x56003cf00f40 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.920+0000 7f13bd600640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13a406a810 0x7f13a406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.920+0000 7f13bd600640 1 -- 172.21.15.7:0/2672095862 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f13b808a480 con 0x56003cf00f40 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.920+0000 7f13bfe00640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13a406a810 0x7f13a406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.920+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56003cebd2a0 0x56003cfa3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.921+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x56003cfa4310 con 0x56003cebd2a0 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.921+0000 7f13c5a00640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56003cebd2a0 0x56003cfa3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.921+0000 7f13bfe00640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13a406a810 0x7f13a406ccd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x56003cefffa0 tx=0x7f13b000c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.921+0000 7f13c5a00640 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56003cebd2a0 0x56003cfa3dd0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c5a00640 1 -- 172.21.15.7:0/2672095862 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=20b] v0'0 uv6 ondisk = 0) ==== 154+0+20 (crc 0 0 0) 0x7f13c0052930 con 0x56003cebd2a0 2024-08-19T00:43:39.926 INFO:teuthology.orchestra.run.smithi007.stdout:subdir_head 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56003cebd2a0 msgr2=0x56003cfa3dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56003cebd2a0 0x56003cfa3dd0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13a406a810 msgr2=0x7f13a406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13a406a810 0x7f13a406ccd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x56003cefffa0 tx=0x7f13b000c000 comp rx=0 tx=0).stop 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf00f40 msgr2=0x56003cf999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 --2- 172.21.15.7:0/2672095862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56003cf00f40 0x56003cf999c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f13b8001d60 tx=0x7f13b800c730 comp rx=0 tx=0).stop 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c5a00640 1 -- 172.21.15.7:0/2672095862 reap_dead start 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 shutdown_connections 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 >> 172.21.15.7:0/2672095862 conn(0x56003ceff4e0 msgr2=0x56003cf005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:39.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 shutdown_connections 2024-08-19T00:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:39.922+0000 7f13c7ddbf40 1 -- 172.21.15.7:0/2672095862 wait complete. 2024-08-19T00:43:39.929 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-08-19T00:43:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 Processor -- start 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 -- start start 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b52f40 0x5640e9bec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b545b0 0x5640e9bf20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9bf2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5640e9b538f0 con 0x5640e9b52f40 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5640e9ac8d00 con 0x5640e9b545b0 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.003+0000 7f9ba1b28f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5640e9bf9dc0 con 0x5640e9b54990 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b52f40 0x5640e9bec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b52f40 0x5640e9bec2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40522/0 (socket says 172.21.15.7:40522) 2024-08-19T00:43:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 -- 172.21.15.7:0/2469530731 learned_addr learned my addr 172.21.15.7:0/2469530731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9f800640 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9bf2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9e400640 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b545b0 0x5640e9bf20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 -- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 msgr2=0x5640e9bf2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9bf2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 -- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b545b0 msgr2=0x5640e9bf20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b545b0 0x5640e9bf20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9ee00640 1 -- 172.21.15.7:0/2469530731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640e9a4db30 con 0x5640e9b52f40 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9f800640 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9bf2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.004+0000 7f9b9e400640 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b545b0 0x5640e9bf20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9b9ee00640 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b52f40 0x5640e9bec2f0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f9b900098b0 tx=0x7f9b90005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29632137b0d3883 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9b9d000640 1 -- 172.21.15.7:0/2469530731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90008930 con 0x5640e9b52f40 2024-08-19T00:43:40.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9b9d000640 1 -- 172.21.15.7:0/2469530731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b90018070 con 0x5640e9b52f40 2024-08-19T00:43:40.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9b9d000640 1 -- 172.21.15.7:0/2469530731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90008cd0 con 0x5640e9b52f40 2024-08-19T00:43:40.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/2469530731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b52f40 msgr2=0x5640e9bec2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b52f40 0x5640e9bec2f0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f9b900098b0 tx=0x7f9b90005a00 comp rx=0 tx=0).stop 2024-08-19T00:43:40.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/2469530731 shutdown_connections 2024-08-19T00:43:40.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9bf2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b545b0 0x5640e9bf20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/2469530731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b52f40 0x5640e9bec2f0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.005+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/2469530731 >> 172.21.15.7:0/2469530731 conn(0x5640e9b514e0 msgr2=0x5640e9b6c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.006+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/2469530731 shutdown_connections 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.006+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/2469530731 wait complete. 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.006+0000 7f9ba1b28f40 1 Processor -- start 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.006+0000 7f9ba1b28f40 1 -- start start 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9ba1b28f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b52f40 0x5640e9beb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9ba1b28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b545b0 0x5640e9be1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9ba1b28f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9be2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9ba1b28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5640e9b51db0 con 0x5640e9b545b0 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9ba1b28f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5640e9bf2b70 con 0x5640e9b52f40 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9ba1b28f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5640e9bf0ec0 con 0x5640e9b54990 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9b9e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b545b0 0x5640e9be1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.007+0000 7f9b9e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b545b0 0x5640e9be1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40528/0 (socket says 172.21.15.7:40528) 2024-08-19T00:43:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9e400640 1 -- 172.21.15.7:0/764788480 learned_addr learned my addr 172.21.15.7:0/764788480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9ee00640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b52f40 0x5640e9beb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9f800640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9be2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9e400640 1 -- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 msgr2=0x5640e9be2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9e400640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5640e9b54990 0x5640e9be2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9e400640 1 -- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b52f40 msgr2=0x5640e9beb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9e400640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640e9b52f40 0x5640e9beb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9e400640 1 -- 172.21.15.7:0/764788480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640e9a8a080 con 0x5640e9b545b0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b9e400640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b545b0 0x5640e9be1e30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c001ea0 tx=0x7f9b8c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b97400640 1 -- 172.21.15.7:0/764788480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c014020 con 0x5640e9b545b0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b97400640 1 -- 172.21.15.7:0/764788480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c010640 con 0x5640e9b545b0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9b97400640 1 -- 172.21.15.7:0/764788480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c010a10 con 0x5640e9b545b0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.008+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640e9bef1a0 con 0x5640e9b545b0 2024-08-19T00:43:40.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.009+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640e9beabe0 con 0x5640e9b545b0 2024-08-19T00:43:40.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.010+0000 7f9b97400640 1 -- 172.21.15.7:0/764788480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b8c017020 con 0x5640e9b545b0 2024-08-19T00:43:40.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.011+0000 7f9b97400640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b8006a810 0x7f9b8006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.011+0000 7f9b97400640 1 -- 172.21.15.7:0/764788480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f9b8c089f20 con 0x5640e9b545b0 2024-08-19T00:43:40.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.011+0000 7f9b9ee00640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b8006a810 0x7f9b8006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.012+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5640e9c92b70 0x5640e9c92f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.012+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5640e9c934c0 con 0x5640e9c92b70 2024-08-19T00:43:40.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.012+0000 7f9b9f800640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5640e9c92b70 0x5640e9c92f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.012+0000 7f9b9ee00640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b8006a810 0x7f9b8006ccd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9b90000c00 tx=0x7f9b90012000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9b9f800640 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5640e9c92b70 0x5640e9c92f80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9b9f800640 1 -- 172.21.15.7:0/764788480 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 10000000000.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x7f9b980518a0 con 0x5640e9c92b70 2024-08-19T00:43:40.017 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/10000000000.00000000 mtime 2024-08-19T00:43:36.000000+0000, size 0 2024-08-19T00:43:40.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5640e9c92b70 msgr2=0x5640e9c92f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5640e9c92b70 0x5640e9c92f80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b8006a810 msgr2=0x7f9b8006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b8006a810 0x7f9b8006ccd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9b90000c00 tx=0x7f9b90012000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b545b0 msgr2=0x5640e9be1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 --2- 172.21.15.7:0/764788480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5640e9b545b0 0x5640e9be1e30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c001ea0 tx=0x7f9b8c00b600 comp rx=0 tx=0).stop 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9b9f800640 1 -- 172.21.15.7:0/764788480 reap_dead start 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 shutdown_connections 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 >> 172.21.15.7:0/764788480 conn(0x5640e9b514e0 msgr2=0x5640e9bf8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 shutdown_connections 2024-08-19T00:43:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.013+0000 7f9ba1b28f40 1 -- 172.21.15.7:0/764788480 wait complete. 2024-08-19T00:43:40.020 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 600.00000000 2024-08-19T00:43:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.095+0000 7f02d3a61f40 1 Processor -- start 2024-08-19T00:43:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.095+0000 7f02d3a61f40 1 -- start start 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.096+0000 7f02d3a61f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b80022a0 0x5625b3e940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.096+0000 7f02d3a61f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f245d0 0x5625b3f1a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.096+0000 7f02d3a61f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625b3f1ab60 0x5625b3e78260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.096+0000 7f02d3a61f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625b3df0d00 con 0x7f02b80022a0 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.096+0000 7f02d3a61f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5625b3df4d40 con 0x5625b3f245d0 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.096+0000 7f02d3a61f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5625b3f21dc0 con 0x5625b3f1ab60 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b80022a0 0x5625b3e940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b80022a0 0x5625b3e940b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40546/0 (socket says 172.21.15.7:40546) 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 -- 172.21.15.7:0/4004679202 learned_addr learned my addr 172.21.15.7:0/4004679202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02cbe00640 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f245d0 0x5625b3f1a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d1600640 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625b3f1ab60 0x5625b3e78260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 -- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625b3f1ab60 msgr2=0x5625b3e78260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625b3f1ab60 0x5625b3e78260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 -- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f245d0 msgr2=0x5625b3f1a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f245d0 0x5625b3f1a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 -- 172.21.15.7:0/4004679202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b3db2080 con 0x7f02b80022a0 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.097+0000 7f02d0c00640 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b80022a0 0x5625b3e940b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f02c4045f70 tx=0x7f02c4052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb89d5fd9e912b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02caa00640 1 -- 172.21.15.7:0/4004679202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c406b070 con 0x7f02b80022a0 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02caa00640 1 -- 172.21.15.7:0/4004679202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c4053660 con 0x7f02b80022a0 2024-08-19T00:43:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02caa00640 1 -- 172.21.15.7:0/4004679202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4053a30 con 0x7f02b80022a0 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 -- 172.21.15.7:0/4004679202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b80022a0 msgr2=0x5625b3e940b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b80022a0 0x5625b3e940b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f02c4045f70 tx=0x7f02c4052000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 -- 172.21.15.7:0/4004679202 shutdown_connections 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625b3f1ab60 0x5625b3e78260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f245d0 0x5625b3f1a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/4004679202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b80022a0 0x5625b3e940b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 -- 172.21.15.7:0/4004679202 >> 172.21.15.7:0/4004679202 conn(0x5625b3e794e0 msgr2=0x5625b3e94af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 -- 172.21.15.7:0/4004679202 shutdown_connections 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.098+0000 7f02d3a61f40 1 -- 172.21.15.7:0/4004679202 wait complete. 2024-08-19T00:43:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.099+0000 7f02d3a61f40 1 Processor -- start 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.099+0000 7f02d3a61f40 1 -- start start 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02d3a61f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f1ab60 0x5625b3e78800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02d3a61f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625b3f245d0 0x5625b3e96550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02d3a61f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02b80022a0 0x5625b3f10440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02d3a61f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625b3e4a940 con 0x5625b3f245d0 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02d3a61f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5625b3e77660 con 0x5625b3f1ab60 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02d3a61f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5625b3e96d80 con 0x7f02b80022a0 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625b3f245d0 0x5625b3e96550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625b3f245d0 0x5625b3e96550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40560/0 (socket says 172.21.15.7:40560) 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.100+0000 7f02cbe00640 1 -- 172.21.15.7:0/1439063105 learned_addr learned my addr 172.21.15.7:0/1439063105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02d0c00640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f1ab60 0x5625b3e78800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02d1600640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02b80022a0 0x5625b3f10440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02cbe00640 1 -- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02b80022a0 msgr2=0x5625b3f10440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02cbe00640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02b80022a0 0x5625b3f10440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02cbe00640 1 -- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f1ab60 msgr2=0x5625b3e78800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02cbe00640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625b3f1ab60 0x5625b3e78800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02cbe00640 1 -- 172.21.15.7:0/1439063105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b3f20c60 con 0x5625b3f245d0 2024-08-19T00:43:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02cbe00640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625b3f245d0 0x5625b3e96550 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f02bc005fd0 tx=0x7f02bc008690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02c9600640 1 -- 172.21.15.7:0/1439063105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc016830 con 0x5625b3f245d0 2024-08-19T00:43:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02c9600640 1 -- 172.21.15.7:0/1439063105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc0169d0 con 0x5625b3f245d0 2024-08-19T00:43:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02c9600640 1 -- 172.21.15.7:0/1439063105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc016dc0 con 0x5625b3f245d0 2024-08-19T00:43:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625b3e95a70 con 0x5625b3f245d0 2024-08-19T00:43:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.101+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b3f20f40 con 0x5625b3f245d0 2024-08-19T00:43:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.103+0000 7f02c9600640 1 -- 172.21.15.7:0/1439063105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02bc01d3a0 con 0x5625b3f245d0 2024-08-19T00:43:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.104+0000 7f02c9600640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02b006a810 0x7f02b006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.104+0000 7f02c9600640 1 -- 172.21.15.7:0/1439063105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f02bc08a930 con 0x5625b3f245d0 2024-08-19T00:43:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.104+0000 7f02d0c00640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02b006a810 0x7f02b006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.104+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5625b3f10c80 0x5625b3f1cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.105+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0d82a743:::600.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5625b3f20750 con 0x5625b3f10c80 2024-08-19T00:43:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.105+0000 7f02d1600640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5625b3f10c80 0x5625b3f1cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.105+0000 7f02d0c00640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02b006a810 0x7f02b006ccd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f02c4045f70 tx=0x7f02c4055000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.105+0000 7f02d1600640 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5625b3f10c80 0x5625b3f1cc90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d1600640 1 -- 172.21.15.7:0/1439063105 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 600.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7f02cc003450 con 0x5625b3f10c80 2024-08-19T00:43:40.109 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/600.00000000 mtime 2024-08-19T00:43:27.000000+0000, size 0 2024-08-19T00:43:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5625b3f10c80 msgr2=0x5625b3f1cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5625b3f10c80 0x5625b3f1cc90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02b006a810 msgr2=0x7f02b006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02b006a810 0x7f02b006ccd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f02c4045f70 tx=0x7f02c4055000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625b3f245d0 msgr2=0x5625b3e96550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 --2- 172.21.15.7:0/1439063105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625b3f245d0 0x5625b3e96550 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f02bc005fd0 tx=0x7f02bc008690 comp rx=0 tx=0).stop 2024-08-19T00:43:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d1600640 1 -- 172.21.15.7:0/1439063105 reap_dead start 2024-08-19T00:43:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 shutdown_connections 2024-08-19T00:43:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 >> 172.21.15.7:0/1439063105 conn(0x5625b3e794e0 msgr2=0x5625b3fb0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 shutdown_connections 2024-08-19T00:43:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.106+0000 7f02d3a61f40 1 -- 172.21.15.7:0/1439063105 wait complete. 2024-08-19T00:43:40.113 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 1.00000000.inode 2024-08-19T00:43:40.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.187+0000 7fdabb306f40 1 Processor -- start 2024-08-19T00:43:40.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.188+0000 7fdabb306f40 1 -- start start 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.188+0000 7fdabb306f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c30040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.188+0000 7fdabb306f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 0x5594c2ff7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.188+0000 7fdabb306f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 0x5594c2ff8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.188+0000 7fdabb306f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5594c2ed1d00 con 0x7fda9c002c80 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.188+0000 7fdabb306f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5594c2ed5d40 con 0x5594c2f2a9a0 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.188+0000 7fdabb306f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5594c3002dc0 con 0x5594c2ff4b10 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c30040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c30040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40578/0 (socket says 172.21.15.7:40578) 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 -- 172.21.15.7:0/3155764522 learned_addr learned my addr 172.21.15.7:0/3155764522 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab7c00640 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 0x5594c2ff7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab9000640 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 0x5594c2ff8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 -- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 msgr2=0x5594c2ff7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 0x5594c2ff7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 -- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 msgr2=0x5594c2ff8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 0x5594c2ff8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 -- 172.21.15.7:0/3155764522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c2e93080 con 0x7fda9c002c80 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.189+0000 7fdab8600640 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c30040c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009730 tx=0x7fdaa8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150a842df6ae1688 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdab6800640 1 -- 172.21.15.7:0/3155764522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80078f0 con 0x7fda9c002c80 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdab6800640 1 -- 172.21.15.7:0/3155764522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa8007a90 con 0x7fda9c002c80 2024-08-19T00:43:40.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdab6800640 1 -- 172.21.15.7:0/3155764522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8007e60 con 0x7fda9c002c80 2024-08-19T00:43:40.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 -- 172.21.15.7:0/3155764522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 msgr2=0x5594c30040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c30040c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009730 tx=0x7fdaa8005a00 comp rx=0 tx=0).stop 2024-08-19T00:43:40.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 -- 172.21.15.7:0/3155764522 shutdown_connections 2024-08-19T00:43:40.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 0x5594c2ff8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 0x5594c2ff7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 --2- 172.21.15.7:0/3155764522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c30040c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 -- 172.21.15.7:0/3155764522 >> 172.21.15.7:0/3155764522 conn(0x5594c2f5a4e0 msgr2=0x5594c2f77b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 -- 172.21.15.7:0/3155764522 shutdown_connections 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.190+0000 7fdabb306f40 1 -- 172.21.15.7:0/3155764522 wait complete. 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.191+0000 7fdabb306f40 1 Processor -- start 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.191+0000 7fdabb306f40 1 -- start start 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdabb306f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 0x5594c2ff4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdabb306f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 0x5594c30992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdabb306f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c2f76940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdabb306f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5594c2f2bcb0 con 0x7fda9c002c80 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdabb306f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5594c3003c30 con 0x5594c2f2a9a0 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdabb306f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5594c2f2b9d0 con 0x5594c2ff4b10 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdab9000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c2f76940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdab9000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c2f76940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40584/0 (socket says 172.21.15.7:40584) 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdab9000640 1 -- 172.21.15.7:0/275367048 learned_addr learned my addr 172.21.15.7:0/275367048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdab7c00640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 0x5594c30992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.192+0000 7fdab8600640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 0x5594c2ff4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab9000640 1 -- 172.21.15.7:0/275367048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 msgr2=0x5594c30992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab9000640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5594c2ff4b10 0x5594c30992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab9000640 1 -- 172.21.15.7:0/275367048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 msgr2=0x5594c2ff4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab9000640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594c2f2a9a0 0x5594c2ff4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab9000640 1 -- 172.21.15.7:0/275367048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c3099810 con 0x7fda9c002c80 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab9000640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c2f76940 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x5594c2f5e3a0 tx=0x7fdab000f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab5400640 1 -- 172.21.15.7:0/275367048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab0018030 con 0x7fda9c002c80 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab5400640 1 -- 172.21.15.7:0/275367048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab0014670 con 0x7fda9c002c80 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdab5400640 1 -- 172.21.15.7:0/275367048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab0014aa0 con 0x7fda9c002c80 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594c2ff7010 con 0x7fda9c002c80 2024-08-19T00:43:40.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.193+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594c2ff6770 con 0x7fda9c002c80 2024-08-19T00:43:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.195+0000 7fdab5400640 1 -- 172.21.15.7:0/275367048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdab001b070 con 0x7fda9c002c80 2024-08-19T00:43:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.196+0000 7fdab5400640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda9806a840 0x7fda9806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.196+0000 7fdab5400640 1 -- 172.21.15.7:0/275367048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fdab0089710 con 0x7fda9c002c80 2024-08-19T00:43:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.196+0000 7fdab8600640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda9806a840 0x7fda9806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.197+0000 7fdabb306f40 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5594c309c350 0x5594c309c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.197+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5594c3000240 con 0x5594c309c350 2024-08-19T00:43:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.197+0000 7fdab7c00640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5594c309c350 0x5594c309c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.197+0000 7fdab8600640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda9806a840 0x7fda9806cd00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8000c00 tx=0x7fdaa8007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.197+0000 7fdab7c00640 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5594c309c350 0x5594c309c770 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdab7c00640 1 -- 172.21.15.7:0/275367048 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv15 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x7fdaa40013b0 con 0x5594c309c350 2024-08-19T00:43:40.201 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/1.00000000.inode mtime 2024-08-19T00:43:36.000000+0000, size 582 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5594c309c350 msgr2=0x5594c309c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5594c309c350 0x5594c309c770 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda9806a840 msgr2=0x7fda9806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda9806a840 0x7fda9806cd00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8000c00 tx=0x7fdaa8007000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 msgr2=0x5594c2f76940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 --2- 172.21.15.7:0/275367048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda9c002c80 0x5594c2f76940 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x5594c2f5e3a0 tx=0x7fdab000f8a0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdab9000640 1 -- 172.21.15.7:0/275367048 reap_dead start 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 shutdown_connections 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 >> 172.21.15.7:0/275367048 conn(0x5594c2f5a4e0 msgr2=0x5594c2ffaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 shutdown_connections 2024-08-19T00:43:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.198+0000 7fdabb306f40 1 -- 172.21.15.7:0/275367048 wait complete. 2024-08-19T00:43:40.205 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 200.00000000 2024-08-19T00:43:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.278+0000 7f6728578f40 1 Processor -- start 2024-08-19T00:43:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.279+0000 7f6728578f40 1 -- start start 2024-08-19T00:43:40.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.279+0000 7f6728578f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c8560f40 0x55b1c86004c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.279+0000 7f6728578f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c85625b0 0x55b1c8579e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.279+0000 7f6728578f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c857a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.279+0000 7f6728578f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1c84d6d00 con 0x55b1c8560f40 2024-08-19T00:43:40.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.279+0000 7f6728578f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b1c84dad40 con 0x55b1c8562990 2024-08-19T00:43:40.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.279+0000 7f6728578f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b1c8607dc0 con 0x55b1c85625b0 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c8560f40 0x55b1c86004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c8560f40 0x55b1c86004c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40594/0 (socket says 172.21.15.7:40594) 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 -- 172.21.15.7:0/1960397905 learned_addr learned my addr 172.21.15.7:0/1960397905 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6724e00640 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c85625b0 0x55b1c8579e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6726200640 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c857a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 -- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c85625b0 msgr2=0x55b1c8579e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c85625b0 0x55b1c8579e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 -- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 msgr2=0x55b1c857a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c857a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 -- 172.21.15.7:0/1960397905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c8498080 con 0x55b1c8560f40 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6726200640 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c857a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.280+0000 7f6725800640 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c8560f40 0x55b1c86004c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f671800b6c0 tx=0x7f671800bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5860439dce6ec6ec server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f671f400640 1 -- 172.21.15.7:0/1960397905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718012070 con 0x55b1c8560f40 2024-08-19T00:43:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f671f400640 1 -- 172.21.15.7:0/1960397905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6718009850 con 0x55b1c8560f40 2024-08-19T00:43:40.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f671f400640 1 -- 172.21.15.7:0/1960397905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718009c80 con 0x55b1c8560f40 2024-08-19T00:43:40.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 -- 172.21.15.7:0/1960397905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c8560f40 msgr2=0x55b1c86004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c8560f40 0x55b1c86004c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f671800b6c0 tx=0x7f671800bb80 comp rx=0 tx=0).stop 2024-08-19T00:43:40.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 -- 172.21.15.7:0/1960397905 shutdown_connections 2024-08-19T00:43:40.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c857a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c85625b0 0x55b1c8579e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 --2- 172.21.15.7:0/1960397905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c8560f40 0x55b1c86004c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 -- 172.21.15.7:0/1960397905 >> 172.21.15.7:0/1960397905 conn(0x55b1c855f4e0 msgr2=0x55b1c855f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 -- 172.21.15.7:0/1960397905 shutdown_connections 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.281+0000 7f6728578f40 1 -- 172.21.15.7:0/1960397905 wait complete. 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.282+0000 7f6728578f40 1 Processor -- start 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.282+0000 7f6728578f40 1 -- start start 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6728578f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c8560f40 0x55b1c85f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6728578f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c85625b0 0x55b1c85f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6728578f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c86004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6728578f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1c8609130 con 0x55b1c85625b0 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6728578f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b1c8608d20 con 0x55b1c8562990 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6728578f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b1c8608a40 con 0x55b1c8560f40 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6724e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c85625b0 0x55b1c85f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6724e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c85625b0 0x55b1c85f59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40600/0 (socket says 172.21.15.7:40600) 2024-08-19T00:43:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6724e00640 1 -- 172.21.15.7:0/700798209 learned_addr learned my addr 172.21.15.7:0/700798209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6726200640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c86004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.283+0000 7f6725800640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c8560f40 0x55b1c85f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.284+0000 7f6724e00640 1 -- 172.21.15.7:0/700798209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c8560f40 msgr2=0x55b1c85f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.284+0000 7f6724e00640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b1c8560f40 0x55b1c85f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.284+0000 7f6724e00640 1 -- 172.21.15.7:0/700798209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 msgr2=0x55b1c86004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.284+0000 7f6724e00640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b1c8562990 0x55b1c86004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.284+0000 7f6724e00640 1 -- 172.21.15.7:0/700798209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c85f6740 con 0x55b1c85625b0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.284+0000 7f6724e00640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c85625b0 0x55b1c85f59b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f671400a520 tx=0x7f6714002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.285+0000 7f671e000640 1 -- 172.21.15.7:0/700798209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714065030 con 0x55b1c85625b0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.285+0000 7f671e000640 1 -- 172.21.15.7:0/700798209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f671405a040 con 0x55b1c85625b0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.285+0000 7f671e000640 1 -- 172.21.15.7:0/700798209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714059070 con 0x55b1c85625b0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.285+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1c85f6a20 con 0x55b1c85625b0 2024-08-19T00:43:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.285+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c85f6fe0 con 0x55b1c85625b0 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.286+0000 7f671e000640 1 -- 172.21.15.7:0/700798209 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6714068030 con 0x55b1c85625b0 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.287+0000 7f671e000640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f670806a810 0x7f670806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.287+0000 7f671e000640 1 -- 172.21.15.7:0/700798209 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f67140cd7b0 con 0x55b1c85625b0 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.287+0000 7f6725800640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f670806a810 0x7f670806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.288+0000 7f6728578f40 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b1c85f8680 0x55b1c85f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.288+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:292cf221:::200.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55b1c85f8fa0 con 0x55b1c85f8680 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.288+0000 7f6726200640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b1c85f8680 0x55b1c85f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.288+0000 7f6725800640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f670806a810 0x7f670806ccd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6718014000 tx=0x7f671800f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.288+0000 7f6726200640 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b1c85f8680 0x55b1c85f8a60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6726200640 1 -- 172.21.15.7:0/700798209 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000000 [stat out=16b] v0'0 uv19 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7f6720003990 con 0x55b1c85f8680 2024-08-19T00:43:40.292 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/200.00000000 mtime 2024-08-19T00:43:36.000000+0000, size 90 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b1c85f8680 msgr2=0x55b1c85f8a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b1c85f8680 0x55b1c85f8a60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f670806a810 msgr2=0x7f670806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f670806a810 0x7f670806ccd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6718014000 tx=0x7f671800f000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c85625b0 msgr2=0x55b1c85f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 --2- 172.21.15.7:0/700798209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1c85625b0 0x55b1c85f59b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f671400a520 tx=0x7f6714002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6726200640 1 -- 172.21.15.7:0/700798209 reap_dead start 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 shutdown_connections 2024-08-19T00:43:40.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 >> 172.21.15.7:0/700798209 conn(0x55b1c855f4e0 msgr2=0x55b1c8530130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 shutdown_connections 2024-08-19T00:43:40.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.289+0000 7f6728578f40 1 -- 172.21.15.7:0/700798209 wait complete. 2024-08-19T00:43:40.296 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 200.00000001 2024-08-19T00:43:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.370+0000 7f8a4bf66f40 1 Processor -- start 2024-08-19T00:43:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.370+0000 7f8a4bf66f40 1 -- start start 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a4bf66f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda855b0 0x5581edb1ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a4bf66f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda85990 0x5581edb1f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a4bf66f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda9d8d0 0x5581edb1fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a4bf66f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5581edb2b0a0 con 0x5581eda855b0 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a4bf66f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5581edb2adc0 con 0x5581eda85990 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a4bf66f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5581edb2b380 con 0x5581eda9d8d0 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a49200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda855b0 0x5581edb1ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a49200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda855b0 0x5581edb1ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40630/0 (socket says 172.21.15.7:40630) 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a49200640 1 -- 172.21.15.7:0/1714194076 learned_addr learned my addr 172.21.15.7:0/1714194076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a43e00640 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda85990 0x5581edb1f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.371+0000 7f8a49c00640 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda9d8d0 0x5581edb1fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a49200640 1 -- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda9d8d0 msgr2=0x5581edb1fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a49200640 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda9d8d0 0x5581edb1fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a49200640 1 -- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda85990 msgr2=0x5581edb1f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a49200640 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda85990 0x5581edb1f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a49200640 1 -- 172.21.15.7:0/1714194076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581ed988130 con 0x5581eda855b0 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a43e00640 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda85990 0x5581edb1f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a49200640 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda855b0 0x5581edb1ceb0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00a4f0 tx=0x7f8a3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ddf610a9174d1d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a42a00640 1 -- 172.21.15.7:0/1714194076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c053ad0 con 0x5581eda855b0 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a42a00640 1 -- 172.21.15.7:0/1714194076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a3c063070 con 0x5581eda855b0 2024-08-19T00:43:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.372+0000 7f8a42a00640 1 -- 172.21.15.7:0/1714194076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c068470 con 0x5581eda855b0 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1714194076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda855b0 msgr2=0x5581edb1ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda855b0 0x5581edb1ceb0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00a4f0 tx=0x7f8a3c051000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1714194076 shutdown_connections 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda9d8d0 0x5581edb1fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda85990 0x5581edb1f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1714194076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda855b0 0x5581edb1ceb0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1714194076 >> 172.21.15.7:0/1714194076 conn(0x5581eda824e0 msgr2=0x5581eda9f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1714194076 shutdown_connections 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.373+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1714194076 wait complete. 2024-08-19T00:43:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.374+0000 7f8a4bf66f40 1 Processor -- start 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.374+0000 7f8a4bf66f40 1 -- start start 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a4bf66f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda855b0 0x5581edb1af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a4bf66f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda85990 0x5581edb1d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a4bf66f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda9d8d0 0x5581edb1d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a4bf66f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5581eda80890 con 0x5581eda85990 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a4bf66f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5581eda53720 con 0x5581eda9d8d0 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a4bf66f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5581edb1ca20 con 0x5581eda855b0 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda85990 0x5581edb1d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda85990 0x5581edb1d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40646/0 (socket says 172.21.15.7:40646) 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 -- 172.21.15.7:0/1790961227 learned_addr learned my addr 172.21.15.7:0/1790961227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a49200640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda855b0 0x5581edb1af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a49c00640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda9d8d0 0x5581edb1d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 -- 172.21.15.7:0/1790961227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda855b0 msgr2=0x5581edb1af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda855b0 0x5581edb1af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 -- 172.21.15.7:0/1790961227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda9d8d0 msgr2=0x5581edb1d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581eda9d8d0 0x5581edb1d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a43e00640 1 -- 172.21.15.7:0/1790961227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581ed97eb30 con 0x5581eda85990 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.375+0000 7f8a49200640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5581eda855b0 0x5581edb1af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.376+0000 7f8a43e00640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda85990 0x5581edb1d2e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f8a340086c0 tx=0x7f8a34008b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.376+0000 7f8a41600640 1 -- 172.21.15.7:0/1790961227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34018070 con 0x5581eda85990 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.376+0000 7f8a41600640 1 -- 172.21.15.7:0/1790961227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a34006970 con 0x5581eda85990 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.376+0000 7f8a41600640 1 -- 172.21.15.7:0/1790961227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34006d60 con 0x5581eda85990 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.376+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581ed9bb080 con 0x5581eda85990 2024-08-19T00:43:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.376+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581edbc3c80 con 0x5581eda85990 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.378+0000 7f8a41600640 1 -- 172.21.15.7:0/1790961227 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a3401b070 con 0x5581eda85990 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.379+0000 7f8a41600640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a2806a840 0x7f8a2806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.379+0000 7f8a41600640 1 -- 172.21.15.7:0/1790961227 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f8a34089410 con 0x5581eda85990 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.379+0000 7f8a49200640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a2806a840 0x7f8a2806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.379+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5581edbc4760 0x5581edb23d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.379+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5581edb1bee0 con 0x5581edbc4760 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.379+0000 7f8a49c00640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5581edbc4760 0x5581edb23d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.380+0000 7f8a49200640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a2806a840 0x7f8a2806cd00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c064000 tx=0x7f8a3c053000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.380+0000 7f8a49c00640 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5581edbc4760 0x5581edb23d80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.380+0000 7f8a49c00640 1 -- 172.21.15.7:0/1790961227 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000001 [stat out=16b] v0'0 uv16 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7f8a44011040 con 0x5581edbc4760 2024-08-19T00:43:40.384 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/200.00000001 mtime 2024-08-19T00:43:36.000000+0000, size 18118 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.380+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5581edbc4760 msgr2=0x5581edb23d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.380+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5581edbc4760 0x5581edb23d80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a2806a840 msgr2=0x7f8a2806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a2806a840 0x7f8a2806cd00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c064000 tx=0x7f8a3c053000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda85990 msgr2=0x5581edb1d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 --2- 172.21.15.7:0/1790961227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5581eda85990 0x5581edb1d2e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f8a340086c0 tx=0x7f8a34008b80 comp rx=0 tx=0).stop 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a49c00640 1 -- 172.21.15.7:0/1790961227 reap_dead start 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 shutdown_connections 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 >> 172.21.15.7:0/1790961227 conn(0x5581eda824e0 msgr2=0x5581edb29690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 shutdown_connections 2024-08-19T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.381+0000 7f8a4bf66f40 1 -- 172.21.15.7:0/1790961227 wait complete. 2024-08-19T00:43:40.387 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.0 2024-08-19T00:43:40.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 Processor -- start 2024-08-19T00:43:40.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 -- start start 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5607281075b0 0x5607280d5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560728107990 0x56072823d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56072811f8d0 0x56072823dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5607281ad0a0 con 0x560728107990 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5607281acdc0 con 0x56072811f8d0 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.461+0000 7f3b72011f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5607281ad380 con 0x5607281075b0 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560728107990 0x56072823d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560728107990 0x56072823d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40662/0 (socket says 172.21.15.7:40662) 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 -- 172.21.15.7:0/1360573491 learned_addr learned my addr 172.21.15.7:0/1360573491 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6f000640 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56072811f8d0 0x56072823dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6e600640 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5607281075b0 0x5607280d5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 -- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5607281075b0 msgr2=0x5607280d5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5607281075b0 0x5607280d5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 -- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56072811f8d0 msgr2=0x56072823dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56072811f8d0 0x56072823dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.462+0000 7f3b6dc00640 1 -- 172.21.15.7:0/1360573491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072800a130 con 0x560728107990 2024-08-19T00:43:40.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b6dc00640 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560728107990 0x56072823d5a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00a770 tx=0x7f3b5c00a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe333be9b2a322c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b67e00640 1 -- 172.21.15.7:0/1360573491 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c019070 con 0x560728107990 2024-08-19T00:43:40.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b67e00640 1 -- 172.21.15.7:0/1360573491 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c007600 con 0x560728107990 2024-08-19T00:43:40.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b67e00640 1 -- 172.21.15.7:0/1360573491 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0079d0 con 0x560728107990 2024-08-19T00:43:40.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 -- 172.21.15.7:0/1360573491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560728107990 msgr2=0x56072823d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560728107990 0x56072823d5a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00a770 tx=0x7f3b5c00a860 comp rx=0 tx=0).stop 2024-08-19T00:43:40.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 -- 172.21.15.7:0/1360573491 shutdown_connections 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56072811f8d0 0x56072823dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560728107990 0x56072823d5a0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 --2- 172.21.15.7:0/1360573491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5607281075b0 0x5607280d5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 -- 172.21.15.7:0/1360573491 >> 172.21.15.7:0/1360573491 conn(0x5607281044e0 msgr2=0x560728106b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 -- 172.21.15.7:0/1360573491 shutdown_connections 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.463+0000 7f3b72011f40 1 -- 172.21.15.7:0/1360573491 wait complete. 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.464+0000 7f3b72011f40 1 Processor -- start 2024-08-19T00:43:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.464+0000 7f3b72011f40 1 -- start start 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b72011f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607281075b0 0x5607281a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b72011f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560728107990 0x5607281a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b72011f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56072811f8d0 0x5607281a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b72011f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5607281a46e0 con 0x5607281075b0 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b72011f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5607281a4490 con 0x560728107990 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b72011f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560728102870 con 0x56072811f8d0 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b6e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607281075b0 0x5607281a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b6e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607281075b0 0x5607281a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40674/0 (socket says 172.21.15.7:40674) 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b6e600640 1 -- 172.21.15.7:0/3798100813 learned_addr learned my addr 172.21.15.7:0/3798100813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.465+0000 7f3b6f000640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56072811f8d0 0x5607281a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b6dc00640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560728107990 0x5607281a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b6e600640 1 -- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56072811f8d0 msgr2=0x5607281a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b6e600640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56072811f8d0 0x5607281a2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b6e600640 1 -- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560728107990 msgr2=0x5607281a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b6e600640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560728107990 0x5607281a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b6e600640 1 -- 172.21.15.7:0/3798100813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560728000b30 con 0x5607281075b0 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b6e600640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607281075b0 0x5607281a7370 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000a4f0 tx=0x7f3b60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b66a00640 1 -- 172.21.15.7:0/3798100813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6005a040 con 0x5607281075b0 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b66a00640 1 -- 172.21.15.7:0/3798100813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6005b040 con 0x5607281075b0 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b66a00640 1 -- 172.21.15.7:0/3798100813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60055dd0 con 0x5607281075b0 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.466+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072803d080 con 0x5607281075b0 2024-08-19T00:43:40.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.467+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607281ab730 con 0x5607281075b0 2024-08-19T00:43:40.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.469+0000 7f3b66a00640 1 -- 172.21.15.7:0/3798100813 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b600603f0 con 0x5607281075b0 2024-08-19T00:43:40.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.469+0000 7f3b66a00640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5006a810 0x7f3b5006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.469+0000 7f3b66a00640 1 -- 172.21.15.7:0/3798100813 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f3b600cd860 con 0x5607281075b0 2024-08-19T00:43:40.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.470+0000 7f3b6dc00640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5006a810 0x7f3b5006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.470+0000 7f3b72011f40 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560728246d30 0x56072819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.470+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.6 12:654134d2:::mds0_openfiles.0:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5607280d5170 con 0x560728246d30 2024-08-19T00:43:40.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.470+0000 7f3b6dc00640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5006a810 0x7f3b5006ccd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x560728121e40 tx=0x7f3b5c00c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.470+0000 7f3b6f000640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560728246d30 0x56072819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.471+0000 7f3b6f000640 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560728246d30 0x56072819f4d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b6f000640 1 -- 172.21.15.7:0/3798100813 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 mds0_openfiles.0 [stat out=16b] v0'0 uv4 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x7f3b6800d920 con 0x560728246d30 2024-08-19T00:43:40.474 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/mds0_openfiles.0 mtime 2024-08-19T00:43:36.000000+0000, size 0 2024-08-19T00:43:40.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560728246d30 msgr2=0x56072819f4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560728246d30 0x56072819f4d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5006a810 msgr2=0x7f3b5006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3b5006a810 0x7f3b5006ccd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x560728121e40 tx=0x7f3b5c00c000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607281075b0 msgr2=0x5607281a7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 --2- 172.21.15.7:0/3798100813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607281075b0 0x5607281a7370 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000a4f0 tx=0x7f3b60002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b6f000640 1 -- 172.21.15.7:0/3798100813 reap_dead start 2024-08-19T00:43:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 shutdown_connections 2024-08-19T00:43:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 >> 172.21.15.7:0/3798100813 conn(0x5607281044e0 msgr2=0x560728103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 shutdown_connections 2024-08-19T00:43:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.472+0000 7f3b72011f40 1 -- 172.21.15.7:0/3798100813 wait complete. 2024-08-19T00:43:40.479 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 500.00000000 2024-08-19T00:43:40.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.552+0000 7f5bd598ff40 1 Processor -- start 2024-08-19T00:43:40.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.552+0000 7f5bd598ff40 1 -- start start 2024-08-19T00:43:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd598ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74c05b0 0x5616a7557470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd598ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c0990 0x5616a75f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd598ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74d88d0 0x5616a75f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd598ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5616a7565dc0 con 0x5616a74c0990 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd598ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5616a7434d00 con 0x5616a74c05b0 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd598ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5616a75660a0 con 0x5616a74d88d0 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c0990 0x5616a75f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c0990 0x5616a75f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40690/0 (socket says 172.21.15.7:40690) 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 -- 172.21.15.7:0/2071238515 learned_addr learned my addr 172.21.15.7:0/2071238515 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2c00640 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74c05b0 0x5616a7557470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd3600640 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74d88d0 0x5616a75f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 -- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74d88d0 msgr2=0x5616a75f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74d88d0 0x5616a75f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 -- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74c05b0 msgr2=0x5616a7557470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74c05b0 0x5616a7557470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.553+0000 7f5bd2200640 1 -- 172.21.15.7:0/2071238515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a73b9b30 con 0x5616a74c0990 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd2200640 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c0990 0x5616a75f3a60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000a770 tx=0x7f5bc000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad43ad42373b99fe server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd0e00640 1 -- 172.21.15.7:0/2071238515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0019070 con 0x5616a74c0990 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd0e00640 1 -- 172.21.15.7:0/2071238515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc0007600 con 0x5616a74c0990 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd0e00640 1 -- 172.21.15.7:0/2071238515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00079d0 con 0x5616a74c0990 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2071238515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c0990 msgr2=0x5616a75f3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c0990 0x5616a75f3a60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000a770 tx=0x7f5bc000a860 comp rx=0 tx=0).stop 2024-08-19T00:43:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2071238515 shutdown_connections 2024-08-19T00:43:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74d88d0 0x5616a75f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c0990 0x5616a75f3a60 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2071238515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74c05b0 0x5616a7557470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.554+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2071238515 >> 172.21.15.7:0/2071238515 conn(0x5616a74bd4e0 msgr2=0x5616a74bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.555+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2071238515 shutdown_connections 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.555+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2071238515 wait complete. 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.555+0000 7f5bd598ff40 1 Processor -- start 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.555+0000 7f5bd598ff40 1 -- start start 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd598ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c05b0 0x5616a755baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd598ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74c0990 0x5616a7559f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd598ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74d88d0 0x5616a7567ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd598ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5616a7557fb0 con 0x5616a74c05b0 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd598ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5616a74bc530 con 0x5616a74d88d0 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd598ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5616a74bc1c0 con 0x5616a74c0990 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd2c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c05b0 0x5616a755baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd2c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c05b0 0x5616a755baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40698/0 (socket says 172.21.15.7:40698) 2024-08-19T00:43:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.556+0000 7f5bd2c00640 1 -- 172.21.15.7:0/2009411680 learned_addr learned my addr 172.21.15.7:0/2009411680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd2200640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74c0990 0x5616a7559f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd3600640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74d88d0 0x5616a7567ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd2c00640 1 -- 172.21.15.7:0/2009411680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74c0990 msgr2=0x5616a7559f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd2c00640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616a74c0990 0x5616a7559f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd2c00640 1 -- 172.21.15.7:0/2009411680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74d88d0 msgr2=0x5616a7567ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd2c00640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a74d88d0 0x5616a7567ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd2c00640 1 -- 172.21.15.7:0/2009411680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a73f6080 con 0x5616a74c05b0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd2c00640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c05b0 0x5616a755baf0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4000c00 tx=0x7f5bc4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bcb400640 1 -- 172.21.15.7:0/2009411680 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc406d070 con 0x5616a74c05b0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bcb400640 1 -- 172.21.15.7:0/2009411680 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc4060a90 con 0x5616a74c05b0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bcb400640 1 -- 172.21.15.7:0/2009411680 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc405e420 con 0x5616a74c05b0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.557+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616a748dbd0 con 0x5616a74c05b0 2024-08-19T00:43:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.558+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a748e190 con 0x5616a74c05b0 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.559+0000 7f5bcb400640 1 -- 172.21.15.7:0/2009411680 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bc4070070 con 0x5616a74c05b0 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.560+0000 7f5bcb400640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5bb406a810 0x7f5bb406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.560+0000 7f5bcb400640 1 -- 172.21.15.7:0/2009411680 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f5bc40cdfe0 con 0x5616a74c05b0 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.560+0000 7f5bd2200640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5bb406a810 0x7f5bb406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.561+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616a7568000 0x5616a7558a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.561+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:1 12.15 12:aa448500:::500.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5616a748d6d0 con 0x5616a7568000 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.561+0000 7f5bd3600640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616a7568000 0x5616a7558a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.561+0000 7f5bd2200640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5bb406a810 0x7f5bb406ccd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5616a75659d0 tx=0x7f5bc000c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.561+0000 7f5bd3600640 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616a7568000 0x5616a7558a80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd3600640 1 -- 172.21.15.7:0/2009411680 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(1 500.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7f5bcc006020 con 0x5616a7568000 2024-08-19T00:43:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/500.00000000 mtime 2024-08-19T00:43:27.000000+0000, size 90 2024-08-19T00:43:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616a7568000 msgr2=0x5616a7558a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616a7568000 0x5616a7558a80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5bb406a810 msgr2=0x7f5bb406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5bb406a810 0x7f5bb406ccd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5616a75659d0 tx=0x7f5bc000c000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c05b0 msgr2=0x5616a755baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 --2- 172.21.15.7:0/2009411680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616a74c05b0 0x5616a755baf0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4000c00 tx=0x7f5bc4002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd3600640 1 -- 172.21.15.7:0/2009411680 reap_dead start 2024-08-19T00:43:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 shutdown_connections 2024-08-19T00:43:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 >> 172.21.15.7:0/2009411680 conn(0x5616a74bd4e0 msgr2=0x5616a7564e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 shutdown_connections 2024-08-19T00:43:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.562+0000 7f5bd598ff40 1 -- 172.21.15.7:0/2009411680 wait complete. 2024-08-19T00:43:40.569 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds_snaptable 2024-08-19T00:43:40.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.642+0000 7fa376920f40 1 Processor -- start 2024-08-19T00:43:40.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.642+0000 7fa376920f40 1 -- start start 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa376920f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563603058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa376920f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556360232b90 0x5563603064e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa376920f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563602ebff0 0x556360306a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa376920f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5563602320b0 con 0x5563602ebff0 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa376920f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55636027b450 con 0x556360232b90 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa376920f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556360232390 con 0x556360231380 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563602ebff0 0x556360306a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563602ebff0 0x556360306a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40712/0 (socket says 172.21.15.7:40712) 2024-08-19T00:43:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 -- 172.21.15.7:0/396657530 learned_addr learned my addr 172.21.15.7:0/396657530 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa372800640 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556360232b90 0x5563603064e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373200640 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563603058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 -- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 msgr2=0x5563603058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563603058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 -- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556360232b90 msgr2=0x5563603064e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556360232b90 0x5563603064e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373c00640 1 -- 172.21.15.7:0/396657530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556360165130 con 0x5563602ebff0 2024-08-19T00:43:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.643+0000 7fa373200640 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563603058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa373c00640 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563602ebff0 0x556360306a20 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c4b0 tx=0x7fa36c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f788ed629f11d604 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa371400640 1 -- 172.21.15.7:0/396657530 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0116b0 con 0x5563602ebff0 2024-08-19T00:43:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa371400640 1 -- 172.21.15.7:0/396657530 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c017070 con 0x5563602ebff0 2024-08-19T00:43:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa371400640 1 -- 172.21.15.7:0/396657530 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c011a90 con 0x5563602ebff0 2024-08-19T00:43:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa376920f40 1 -- 172.21.15.7:0/396657530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563602ebff0 msgr2=0x556360306a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa376920f40 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563602ebff0 0x556360306a20 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c4b0 tx=0x7fa36c00c970 comp rx=0 tx=0).stop 2024-08-19T00:43:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa376920f40 1 -- 172.21.15.7:0/396657530 shutdown_connections 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa376920f40 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563602ebff0 0x556360306a20 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa376920f40 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556360232b90 0x5563603064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa376920f40 1 --2- 172.21.15.7:0/396657530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563603058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.644+0000 7fa376920f40 1 -- 172.21.15.7:0/396657530 >> 172.21.15.7:0/396657530 conn(0x55636025d5d0 msgr2=0x5563602ed740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.645+0000 7fa376920f40 1 -- 172.21.15.7:0/396657530 shutdown_connections 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.645+0000 7fa376920f40 1 -- 172.21.15.7:0/396657530 wait complete. 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.645+0000 7fa376920f40 1 Processor -- start 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.645+0000 7fa376920f40 1 -- start start 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.646+0000 7fa376920f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563602edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.646+0000 7fa376920f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556360232b90 0x5563603066d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.646+0000 7fa376920f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5563602ebff0 0x556360300300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.646+0000 7fa376920f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5563602e7730 con 0x556360232b90 2024-08-19T00:43:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.646+0000 7fa376920f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5563602ee0b0 con 0x5563602ebff0 2024-08-19T00:43:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.646+0000 7fa376920f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556360230e40 con 0x556360231380 2024-08-19T00:43:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556360232b90 0x5563603066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556360232b90 0x5563603066d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40718/0 (socket says 172.21.15.7:40718) 2024-08-19T00:43:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 -- 172.21.15.7:0/2578446760 learned_addr learned my addr 172.21.15.7:0/2578446760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa373c00640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5563602ebff0 0x556360300300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa373200640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563602edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 -- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 msgr2=0x5563602edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563602edad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 -- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5563602ebff0 msgr2=0x556360300300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5563602ebff0 0x556360300300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 -- 172.21.15.7:0/2578446760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55636015bb30 con 0x556360232b90 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa373c00640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5563602ebff0 0x556360300300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:40.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa373200640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556360231380 0x5563602edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.647+0000 7fa372800640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556360232b90 0x5563603066d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa360009ec0 tx=0x7fa360008400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.648+0000 7fa36be00640 1 -- 172.21.15.7:0/2578446760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360015660 con 0x556360232b90 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.648+0000 7fa36be00640 1 -- 172.21.15.7:0/2578446760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36001a070 con 0x556360232b90 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.648+0000 7fa36be00640 1 -- 172.21.15.7:0/2578446760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360015a00 con 0x556360232b90 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.648+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556360198080 con 0x556360232b90 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.648+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563602e3f30 con 0x556360232b90 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.650+0000 7fa36be00640 1 -- 172.21.15.7:0/2578446760 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa360013030 con 0x556360232b90 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.650+0000 7fa36be00640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa35406a810 0x7fa35406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.651+0000 7fa36be00640 1 -- 172.21.15.7:0/2578446760 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fa360089b20 con 0x556360232b90 2024-08-19T00:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.651+0000 7fa373200640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa35406a810 0x7fa35406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.651+0000 7fa376920f40 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x556360306c10 0x5563602e93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.651+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.d 12:b50e409b:::mds_snaptable:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5563602e9920 con 0x556360306c10 2024-08-19T00:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.651+0000 7fa373c00640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x556360306c10 0x5563602e93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa373200640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa35406a810 0x7fa35406ccd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa364057000 tx=0x7fa364052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa373c00640 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x556360306c10 0x5563602e93e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa373c00640 1 -- 172.21.15.7:0/2578446760 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 mds_snaptable [stat out=16b] v0'0 uv1 ondisk = 0) ==== 157+0+16 (crc 0 0 0) 0x7fa36c011730 con 0x556360306c10 2024-08-19T00:43:40.656 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/mds_snaptable mtime 2024-08-19T00:43:27.000000+0000, size 70 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x556360306c10 msgr2=0x5563602e93e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x556360306c10 0x5563602e93e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa35406a810 msgr2=0x7fa35406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa35406a810 0x7fa35406ccd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa364057000 tx=0x7fa364052000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556360232b90 msgr2=0x5563603066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 --2- 172.21.15.7:0/2578446760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556360232b90 0x5563603066d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa360009ec0 tx=0x7fa360008400 comp rx=0 tx=0).stop 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa373c00640 1 -- 172.21.15.7:0/2578446760 reap_dead start 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 shutdown_connections 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 >> 172.21.15.7:0/2578446760 conn(0x55636025d5d0 msgr2=0x5563602eab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 shutdown_connections 2024-08-19T00:43:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.652+0000 7fa376920f40 1 -- 172.21.15.7:0/2578446760 wait complete. 2024-08-19T00:43:40.659 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_inotable 2024-08-19T00:43:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.732+0000 7f873531ef40 1 Processor -- start 2024-08-19T00:43:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.732+0000 7f873531ef40 1 -- start start 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f873531ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a56fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f873531ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c95b0 0x55fb2a5678f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f873531ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c9990 0x55fb2a4c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f873531ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a4c88f0 con 0x55fb2a4c9990 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f873531ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a43dd00 con 0x55fb2a4c7f40 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f873531ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55fb2a56edc0 con 0x55fb2a4c95b0 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f8732400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c9990 0x55fb2a4c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f8732400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c9990 0x55fb2a4c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40724/0 (socket says 172.21.15.7:40724) 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.733+0000 7f8732400640 1 -- 172.21.15.7:0/4232933026 learned_addr learned my addr 172.21.15.7:0/4232933026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8731a00640 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a56fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8731000640 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c95b0 0x55fb2a5678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8732400640 1 -- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c95b0 msgr2=0x55fb2a5678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8732400640 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c95b0 0x55fb2a5678f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8732400640 1 -- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 msgr2=0x55fb2a56fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8732400640 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a56fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8732400640 1 -- 172.21.15.7:0/4232933026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2a3c2b30 con 0x55fb2a4c9990 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8731000640 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c95b0 0x55fb2a5678f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f8732400640 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c9990 0x55fb2a4c54f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f872c00a4b0 tx=0x7f872c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59595aa98d3a53be server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f872b400640 1 -- 172.21.15.7:0/4232933026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c054040 con 0x55fb2a4c9990 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f872b400640 1 -- 172.21.15.7:0/4232933026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872c050800 con 0x55fb2a4c9990 2024-08-19T00:43:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.734+0000 7f872b400640 1 -- 172.21.15.7:0/4232933026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c050bf0 con 0x55fb2a4c9990 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 -- 172.21.15.7:0/4232933026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c9990 msgr2=0x55fb2a4c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c9990 0x55fb2a4c54f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f872c00a4b0 tx=0x7f872c050000 comp rx=0 tx=0).stop 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 -- 172.21.15.7:0/4232933026 shutdown_connections 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c9990 0x55fb2a4c54f0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c95b0 0x55fb2a5678f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 --2- 172.21.15.7:0/4232933026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a56fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 -- 172.21.15.7:0/4232933026 >> 172.21.15.7:0/4232933026 conn(0x55fb2a4c64e0 msgr2=0x55fb2a4e1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 -- 172.21.15.7:0/4232933026 shutdown_connections 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.735+0000 7f873531ef40 1 -- 172.21.15.7:0/4232933026 wait complete. 2024-08-19T00:43:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.736+0000 7f873531ef40 1 Processor -- start 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.736+0000 7f873531ef40 1 -- start start 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f873531ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a4e1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f873531ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c95b0 0x55fb2a607eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f873531ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c9990 0x55fb2a6083f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f873531ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a571800 con 0x55fb2a4c95b0 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f873531ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a56f790 con 0x55fb2a4c7f40 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f873531ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55fb2a568230 con 0x55fb2a4c9990 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c95b0 0x55fb2a607eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c95b0 0x55fb2a607eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40730/0 (socket says 172.21.15.7:40730) 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 -- 172.21.15.7:0/3594696497 learned_addr learned my addr 172.21.15.7:0/3594696497 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731a00640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a4e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 -- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c9990 msgr2=0x55fb2a6083f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8732400640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c9990 0x55fb2a6083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fb2a4c9990 0x55fb2a6083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 -- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 msgr2=0x55fb2a4e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a4e1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731000640 1 -- 172.21.15.7:0/3594696497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2a3ff080 con 0x55fb2a4c95b0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.737+0000 7f8731a00640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fb2a4c7f40 0x55fb2a4e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.738+0000 7f8731000640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c95b0 0x55fb2a607eb0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f872000ce10 tx=0x7f872000a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.738+0000 7f872a000640 1 -- 172.21.15.7:0/3594696497 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872000f420 con 0x55fb2a4c95b0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.738+0000 7f872a000640 1 -- 172.21.15.7:0/3594696497 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8720014020 con 0x55fb2a4c95b0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.738+0000 7f872a000640 1 -- 172.21.15.7:0/3594696497 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872000f7e0 con 0x55fb2a4c95b0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.738+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb2a56e620 con 0x55fb2a4c95b0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.738+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2a4c57a0 con 0x55fb2a4c95b0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.740+0000 7f872a000640 1 -- 172.21.15.7:0/3594696497 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f872000f980 con 0x55fb2a4c95b0 2024-08-19T00:43:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.741+0000 7f872a000640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f871406a840 0x7f871406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.741+0000 7f872a000640 1 -- 172.21.15.7:0/3594696497 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f8720089f90 con 0x55fb2a4c95b0 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.741+0000 7f8731a00640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f871406a840 0x7f871406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.741+0000 7f873531ef40 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55fb2a4e0470 0x55fb2a60f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.741+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x55fb2a4e1a10 con 0x55fb2a4e0470 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.741+0000 7f8732400640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55fb2a4e0470 0x55fb2a60f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.742+0000 7f8731a00640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f871406a840 0x7f871406cd00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8724009740 tx=0x7f872400c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.742+0000 7f8732400640 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55fb2a4e0470 0x55fb2a60f170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.742+0000 7f8732400640 1 -- 172.21.15.7:0/3594696497 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 mds0_inotable [stat out=16b] v0'0 uv3 ondisk = 0) ==== 157+0+16 (crc 0 0 0) 0x7f872c056030 con 0x55fb2a4e0470 2024-08-19T00:43:40.748 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/mds0_inotable mtime 2024-08-19T00:43:36.000000+0000, size 34 2024-08-19T00:43:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55fb2a4e0470 msgr2=0x55fb2a60f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55fb2a4e0470 0x55fb2a60f170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f871406a840 msgr2=0x7f871406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f871406a840 0x7f871406cd00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8724009740 tx=0x7f872400c040 comp rx=0 tx=0).stop 2024-08-19T00:43:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c95b0 msgr2=0x55fb2a607eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 --2- 172.21.15.7:0/3594696497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb2a4c95b0 0x55fb2a607eb0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f872000ce10 tx=0x7f872000a5f0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f8732400640 1 -- 172.21.15.7:0/3594696497 reap_dead start 2024-08-19T00:43:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 shutdown_connections 2024-08-19T00:43:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 >> 172.21.15.7:0/3594696497 conn(0x55fb2a4c64e0 msgr2=0x55fb2a570e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 shutdown_connections 2024-08-19T00:43:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.743+0000 7f873531ef40 1 -- 172.21.15.7:0/3594696497 wait complete. 2024-08-19T00:43:40.751 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 100.00000000 2024-08-19T00:43:40.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.825+0000 7fd4efb0bf40 1 Processor -- start 2024-08-19T00:43:40.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.825+0000 7fd4efb0bf40 1 -- start start 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.825+0000 7fd4efb0bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe92650 0x5596bbf39ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.825+0000 7fd4efb0bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe935b0 0x5596bbfc9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.825+0000 7fd4efb0bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe93990 0x5596bbfca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4efb0bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596bbe07d00 con 0x5596bbe935b0 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4efb0bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5596bbe0bd40 con 0x5596bbe93990 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4efb0bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5596bbf38dc0 con 0x5596bbe92650 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe935b0 0x5596bbfc9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe935b0 0x5596bbfc9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40758/0 (socket says 172.21.15.7:40758) 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 -- 172.21.15.7:0/2733716533 learned_addr learned my addr 172.21.15.7:0/2733716533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4ece00640 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe92650 0x5596bbf39ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4ed800640 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe93990 0x5596bbfca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 -- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe92650 msgr2=0x5596bbf39ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe92650 0x5596bbf39ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 -- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe93990 msgr2=0x5596bbfca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe93990 0x5596bbfca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 -- 172.21.15.7:0/2733716533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596bbdc9080 con 0x5596bbe935b0 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.826+0000 7fd4e7e00640 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe935b0 0x5596bbfc9fd0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8001dd0 tx=0x7fd4d800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f677cc908e03c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4e6a00640 1 -- 172.21.15.7:0/2733716533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800bde0 con 0x5596bbe935b0 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4e6a00640 1 -- 172.21.15.7:0/2733716533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d800f400 con 0x5596bbe935b0 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4e6a00640 1 -- 172.21.15.7:0/2733716533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800f830 con 0x5596bbe935b0 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2733716533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe935b0 msgr2=0x5596bbfc9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe935b0 0x5596bbfc9fd0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8001dd0 tx=0x7fd4d800b5b0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2733716533 shutdown_connections 2024-08-19T00:43:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe93990 0x5596bbfca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe935b0 0x5596bbfc9fd0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2733716533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe92650 0x5596bbf39ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2733716533 >> 172.21.15.7:0/2733716533 conn(0x5596bbe904e0 msgr2=0x5596bbe606a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2733716533 shutdown_connections 2024-08-19T00:43:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.827+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2733716533 wait complete. 2024-08-19T00:43:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.828+0000 7fd4efb0bf40 1 Processor -- start 2024-08-19T00:43:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.828+0000 7fd4efb0bf40 1 -- start start 2024-08-19T00:43:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4efb0bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe92650 0x5596bbe4f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4efb0bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe935b0 0x5596bbf27320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4efb0bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe93990 0x5596bbf2a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4efb0bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596bbf2d440 con 0x5596bbe93990 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4efb0bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5596bbe61120 con 0x5596bbe92650 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4efb0bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5596bbf2d720 con 0x5596bbe935b0 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4ed800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe93990 0x5596bbf2a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4ed800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe93990 0x5596bbf2a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40766/0 (socket says 172.21.15.7:40766) 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4e7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe935b0 0x5596bbf27320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4ece00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe92650 0x5596bbe4f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.829+0000 7fd4ed800640 1 -- 172.21.15.7:0/2424250640 learned_addr learned my addr 172.21.15.7:0/2424250640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4ed800640 1 -- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe935b0 msgr2=0x5596bbf27320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4ed800640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5596bbe935b0 0x5596bbf27320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4ed800640 1 -- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe92650 msgr2=0x5596bbe4f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4ed800640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596bbe92650 0x5596bbe4f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4ed800640 1 -- 172.21.15.7:0/2424250640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596bbf341b0 con 0x5596bbe93990 2024-08-19T00:43:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4ed800640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe93990 0x5596bbf2a250 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8058040 tx=0x7fd4e8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4e5600640 1 -- 172.21.15.7:0/2424250640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8056b70 con 0x5596bbe93990 2024-08-19T00:43:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4e5600640 1 -- 172.21.15.7:0/2424250640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8056d10 con 0x5596bbe93990 2024-08-19T00:43:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596bbf34490 con 0x5596bbe93990 2024-08-19T00:43:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.830+0000 7fd4e5600640 1 -- 172.21.15.7:0/2424250640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e806b6c0 con 0x5596bbe93990 2024-08-19T00:43:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.831+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596bbf34a50 con 0x5596bbe93990 2024-08-19T00:43:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.832+0000 7fd4e5600640 1 -- 172.21.15.7:0/2424250640 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4e806b860 con 0x5596bbe93990 2024-08-19T00:43:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.833+0000 7fd4e5600640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4cc06a840 0x7fd4cc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.833+0000 7fd4e5600640 1 -- 172.21.15.7:0/2424250640 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7fd4e80ce910 con 0x5596bbe93990 2024-08-19T00:43:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.833+0000 7fd4ece00640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4cc06a840 0x7fd4cc06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.834+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5596bbf36060 0x5596bbf36440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.834+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:cd5a64a3:::100.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5596bbf2c900 con 0x5596bbf36060 2024-08-19T00:43:40.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.834+0000 7fd4ece00640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4cc06a840 0x7fd4cc06cd00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5596bbe616e0 tx=0x7fd4e00018a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.834+0000 7fd4e7e00640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5596bbf36060 0x5596bbf36440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4e7e00640 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5596bbf36060 0x5596bbf36440 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4e7e00640 1 -- 172.21.15.7:0/2424250640 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 100.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7fd4d800f5b0 con 0x5596bbf36060 2024-08-19T00:43:40.839 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/100.00000000 mtime 2024-08-19T00:43:27.000000+0000, size 0 2024-08-19T00:43:40.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5596bbf36060 msgr2=0x5596bbf36440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5596bbf36060 0x5596bbf36440 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4cc06a840 msgr2=0x7fd4cc06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd4cc06a840 0x7fd4cc06cd00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5596bbe616e0 tx=0x7fd4e00018a0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe93990 msgr2=0x5596bbf2a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.835+0000 7fd4efb0bf40 1 --2- 172.21.15.7:0/2424250640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596bbe93990 0x5596bbf2a250 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8058040 tx=0x7fd4e8003330 comp rx=0 tx=0).stop 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.836+0000 7fd4ed800640 1 -- 172.21.15.7:0/2424250640 reap_dead start 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.836+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 shutdown_connections 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.836+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 >> 172.21.15.7:0/2424250640 conn(0x5596bbe904e0 msgr2=0x5596bbe915d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.836+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 shutdown_connections 2024-08-19T00:43:40.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.836+0000 7fd4efb0bf40 1 -- 172.21.15.7:0/2424250640 wait complete. 2024-08-19T00:43:40.842 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_sessionmap 2024-08-19T00:43:40.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 Processor -- start 2024-08-19T00:43:40.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 -- start start 2024-08-19T00:43:40.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a6935b0 0x56390a72ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a693990 0x56390a72a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a660ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56390a738dc0 con 0x56390a6ab8d0 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56390a607d00 con 0x56390a693990 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.916+0000 7f62d608cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56390a7390a0 con 0x56390a6935b0 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a660ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a660ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40782/0 (socket says 172.21.15.7:40782) 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 -- 172.21.15.7:0/439262047 learned_addr learned my addr 172.21.15.7:0/439262047 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d2800640 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a693990 0x56390a72a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3200640 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a6935b0 0x56390a72ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 -- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a6935b0 msgr2=0x56390a72ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a6935b0 0x56390a72ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 -- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a693990 msgr2=0x56390a72a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a693990 0x56390a72a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 -- 172.21.15.7:0/439262047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390a58cb30 con 0x56390a6ab8d0 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d2800640 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a693990 0x56390a72a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.917+0000 7f62d3c00640 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a660ef0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00a4b0 tx=0x7f62cc00a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce39b46524368f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d1400640 1 -- 172.21.15.7:0/439262047 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc015070 con 0x56390a6ab8d0 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d1400640 1 -- 172.21.15.7:0/439262047 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62cc00e730 con 0x56390a6ab8d0 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d1400640 1 -- 172.21.15.7:0/439262047 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00eb20 con 0x56390a6ab8d0 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 -- 172.21.15.7:0/439262047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 msgr2=0x56390a660ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a660ef0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00a4b0 tx=0x7f62cc00a970 comp rx=0 tx=0).stop 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 -- 172.21.15.7:0/439262047 shutdown_connections 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a660ef0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a693990 0x56390a72a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 --2- 172.21.15.7:0/439262047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a6935b0 0x56390a72ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 -- 172.21.15.7:0/439262047 >> 172.21.15.7:0/439262047 conn(0x56390a6904e0 msgr2=0x56390a6908c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 -- 172.21.15.7:0/439262047 shutdown_connections 2024-08-19T00:43:40.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.918+0000 7f62d608cf40 1 -- 172.21.15.7:0/439262047 wait complete. 2024-08-19T00:43:40.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.919+0000 7f62d608cf40 1 Processor -- start 2024-08-19T00:43:40.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.919+0000 7f62d608cf40 1 -- start start 2024-08-19T00:43:40.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d608cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a6935b0 0x56390a737720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d608cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a693990 0x56390a731560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d608cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a731aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d608cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56390a64e730 con 0x56390a6ab8d0 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d608cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56390a68ed20 con 0x56390a6935b0 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d608cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56390a68e3f0 con 0x56390a693990 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a731aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a731aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40790/0 (socket says 172.21.15.7:40790) 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d3c00640 1 -- 172.21.15.7:0/1564690187 learned_addr learned my addr 172.21.15.7:0/1564690187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d3200640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a6935b0 0x56390a737720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d2800640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a693990 0x56390a731560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.920+0000 7f62d3c00640 1 -- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a693990 msgr2=0x56390a731560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62d3c00640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56390a693990 0x56390a731560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62d3c00640 1 -- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a6935b0 msgr2=0x56390a737720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62d3c00640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56390a6935b0 0x56390a737720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62d3c00640 1 -- 172.21.15.7:0/1564690187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390a5c9080 con 0x56390a6ab8d0 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62d3c00640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a731aa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0032c0 tx=0x7f62cc0032f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62cbe00640 1 -- 172.21.15.7:0/1564690187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc020070 con 0x56390a6ab8d0 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62cbe00640 1 -- 172.21.15.7:0/1564690187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62cc01b650 con 0x56390a6ab8d0 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62cbe00640 1 -- 172.21.15.7:0/1564690187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc015040 con 0x56390a6ab8d0 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56390a72b120 con 0x56390a6ab8d0 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.921+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390a72b6e0 con 0x56390a6ab8d0 2024-08-19T00:43:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.923+0000 7f62cbe00640 1 -- 172.21.15.7:0/1564690187 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62cc023070 con 0x56390a6ab8d0 2024-08-19T00:43:40.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.924+0000 7f62cbe00640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62b406a810 0x7f62b406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.924+0000 7f62cbe00640 1 -- 172.21.15.7:0/1564690187 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f62cc08b500 con 0x56390a6ab8d0 2024-08-19T00:43:40.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.924+0000 7f62d3200640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62b406a810 0x7f62b406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.924+0000 7f62d608cf40 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56390a728b80 0x56390a728f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:40.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.924+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:1 12.b 12:d0630e4c:::mds0_sessionmap:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x56390a7294a0 con 0x56390a728b80 2024-08-19T00:43:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.925+0000 7f62d2800640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56390a728b80 0x56390a728f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.925+0000 7f62d3200640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62b406a810 0x7f62b406ccd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f62c4005fd0 tx=0x7f62c4005af0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d2800640 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56390a728b80 0x56390a728f60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d2800640 1 -- 172.21.15.7:0/1564690187 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(1 mds0_sessionmap [stat out=16b] v0'0 uv3 ondisk = 0) ==== 159+0+16 (crc 0 0 0) 0x7f62c0052990 con 0x56390a728b80 2024-08-19T00:43:40.929 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/mds0_sessionmap mtime 2024-08-19T00:43:36.000000+0000, size 0 2024-08-19T00:43:40.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56390a728b80 msgr2=0x56390a728f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56390a728b80 0x56390a728f60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62b406a810 msgr2=0x7f62b406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f62b406a810 0x7f62b406ccd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f62c4005fd0 tx=0x7f62c4005af0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 msgr2=0x56390a731aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 --2- 172.21.15.7:0/1564690187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56390a6ab8d0 0x56390a731aa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0032c0 tx=0x7f62cc0032f0 comp rx=0 tx=0).stop 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d3c00640 1 -- 172.21.15.7:0/1564690187 reap_dead start 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 shutdown_connections 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.926+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 >> 172.21.15.7:0/1564690187 conn(0x56390a6904e0 msgr2=0x56390a691db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.927+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 shutdown_connections 2024-08-19T00:43:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:40.927+0000 7f62d608cf40 1 -- 172.21.15.7:0/1564690187 wait complete. 2024-08-19T00:43:40.933 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 400.00000000 2024-08-19T00:43:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.007+0000 7f20b71c0f40 1 Processor -- start 2024-08-19T00:43:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.007+0000 7f20b71c0f40 1 -- start start 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b71c0f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa20650 0x561e9aab83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b71c0f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa215b0 0x561e9aab94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b71c0f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aabe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b71c0f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561e9a995d00 con 0x561e9aa21990 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b71c0f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e9a999d40 con 0x561e9aa215b0 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b71c0f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561e9aac6dc0 con 0x561e9aa20650 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aabe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aabe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40796/0 (socket says 172.21.15.7:40796) 2024-08-19T00:43:41.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 -- 172.21.15.7:0/713339375 learned_addr learned my addr 172.21.15.7:0/713339375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 -- 172.21.15.7:0/713339375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa20650 msgr2=0x561e9aab83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 --2- 172.21.15.7:0/713339375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa20650 0x561e9aab83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 -- 172.21.15.7:0/713339375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa215b0 msgr2=0x561e9aab94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 --2- 172.21.15.7:0/713339375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa215b0 0x561e9aab94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.008+0000 7f20b4e00640 1 -- 172.21.15.7:0/713339375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9a957080 con 0x561e9aa21990 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b4e00640 1 --2- 172.21.15.7:0/713339375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aabe650 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f20ac055040 tx=0x7f20ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0560e8b4254fd04 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b2600640 1 -- 172.21.15.7:0/713339375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac056040 con 0x561e9aa21990 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b2600640 1 -- 172.21.15.7:0/713339375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac0526a0 con 0x561e9aa21990 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b2600640 1 -- 172.21.15.7:0/713339375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac052a90 con 0x561e9aa21990 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b71c0f40 1 -- 172.21.15.7:0/713339375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 msgr2=0x561e9aabe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/713339375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aabe650 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f20ac055040 tx=0x7f20ac051000 comp rx=0 tx=0).stop 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b71c0f40 1 -- 172.21.15.7:0/713339375 shutdown_connections 2024-08-19T00:43:41.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/713339375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aabe650 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/713339375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa215b0 0x561e9aab94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.009+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/713339375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa20650 0x561e9aab83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.010+0000 7f20b71c0f40 1 -- 172.21.15.7:0/713339375 >> 172.21.15.7:0/713339375 conn(0x561e9aa1e4e0 msgr2=0x561e9a9ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.010+0000 7f20b71c0f40 1 -- 172.21.15.7:0/713339375 shutdown_connections 2024-08-19T00:43:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.010+0000 7f20b71c0f40 1 -- 172.21.15.7:0/713339375 wait complete. 2024-08-19T00:43:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.010+0000 7f20b71c0f40 1 Processor -- start 2024-08-19T00:43:41.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.010+0000 7f20b71c0f40 1 -- start start 2024-08-19T00:43:41.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.011+0000 7f20b71c0f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa20650 0x561e9aab85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.011+0000 7f20b71c0f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa215b0 0x561e9aa1d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.011+0000 7f20b71c0f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aa1d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.011+0000 7f20b71c0f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561e9aabbd10 con 0x561e9aa21990 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.011+0000 7f20b71c0f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e9aabc110 con 0x561e9aa20650 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.011+0000 7f20b71c0f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561e9aac6150 con 0x561e9aa215b0 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aa1d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aa1d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40802/0 (socket says 172.21.15.7:40802) 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 -- 172.21.15.7:0/1557409712 learned_addr learned my addr 172.21.15.7:0/1557409712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b3a00640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa215b0 0x561e9aa1d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4400640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa20650 0x561e9aab85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 -- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa215b0 msgr2=0x561e9aa1d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa215b0 0x561e9aa1d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 -- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa20650 msgr2=0x561e9aab85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa20650 0x561e9aab85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 -- 172.21.15.7:0/1557409712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9aa3a060 con 0x561e9aa21990 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b3a00640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561e9aa215b0 0x561e9aa1d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4400640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e9aa20650 0x561e9aab85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b4e00640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aa1d580 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f20ac066040 tx=0x7f20ac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.012+0000 7f20b1200640 1 -- 172.21.15.7:0/1557409712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac056040 con 0x561e9aa21990 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.013+0000 7f20b1200640 1 -- 172.21.15.7:0/1557409712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac072070 con 0x561e9aa21990 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.013+0000 7f20b1200640 1 -- 172.21.15.7:0/1557409712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac06d6b0 con 0x561e9aa21990 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.013+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e9aac5170 con 0x561e9aa21990 2024-08-19T00:43:41.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.013+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e9a9eed40 con 0x561e9aa21990 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.014+0000 7f20b1200640 1 -- 172.21.15.7:0/1557409712 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20ac059020 con 0x561e9aa21990 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.015+0000 7f20b1200640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209406a840 0x7f209406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.015+0000 7f20b1200640 1 -- 172.21.15.7:0/1557409712 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f20ac0cefe0 con 0x561e9aa21990 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.016+0000 7f20b4400640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209406a840 0x7f209406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.016+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561e9aa1dac0 0x561e9ab60670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.016+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x561e9aac0e30 con 0x561e9aa1dac0 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.016+0000 7f20b3a00640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561e9aa1dac0 0x561e9ab60670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.016+0000 7f20b4400640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209406a840 0x7f209406cd00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f20a400d400 tx=0x7f20a40025e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b3a00640 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561e9aa1dac0 0x561e9ab60670 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b3a00640 1 -- 172.21.15.7:0/1557409712 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 400.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x7f20a000d7f0 con 0x561e9aa1dac0 2024-08-19T00:43:41.021 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/400.00000000 mtime 2024-08-19T00:43:27.000000+0000, size 22 2024-08-19T00:43:41.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561e9aa1dac0 msgr2=0x561e9ab60670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561e9aa1dac0 0x561e9ab60670 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209406a840 msgr2=0x7f209406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209406a840 0x7f209406cd00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f20a400d400 tx=0x7f20a40025e0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 msgr2=0x561e9aa1d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 --2- 172.21.15.7:0/1557409712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e9aa21990 0x561e9aa1d580 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f20ac066040 tx=0x7f20ac003330 comp rx=0 tx=0).stop 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b4e00640 1 -- 172.21.15.7:0/1557409712 reap_dead start 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 shutdown_connections 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 >> 172.21.15.7:0/1557409712 conn(0x561e9aa1e4e0 msgr2=0x561e9aabea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 shutdown_connections 2024-08-19T00:43:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.017+0000 7f20b71c0f40 1 -- 172.21.15.7:0/1557409712 wait complete. 2024-08-19T00:43:41.024 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 100.00000000.inode 2024-08-19T00:43:41.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.097+0000 7ff04d540f40 1 Processor -- start 2024-08-19T00:43:41.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.097+0000 7ff04d540f40 1 -- start start 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.098+0000 7ff04d540f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b564e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.098+0000 7ff04d540f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b564f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.098+0000 7ff04d540f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.098+0000 7ff04d540f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5626b56f8dc0 con 0x5626b5653990 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.098+0000 7ff04d540f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5626b55c7d00 con 0x5626b566b8d0 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.098+0000 7ff04d540f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5626b56f90a0 con 0x5626b56535b0 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b564f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b564f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40818/0 (socket says 172.21.15.7:40818) 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 -- 172.21.15.7:0/99041697 learned_addr learned my addr 172.21.15.7:0/99041697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:41.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff04b200640 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff04a800640 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b564e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 -- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 msgr2=0x5626b564e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b564e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 -- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 msgr2=0x5626b56ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 -- 172.21.15.7:0/99041697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b554cb30 con 0x5626b5653990 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff04b200640 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff04a800640 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b564e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.099+0000 7ff049e00640 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b564f3a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff038045f30 tx=0x7ff038051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55abd7feb3354b30 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff048a00640 1 -- 172.21.15.7:0/99041697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038053a40 con 0x5626b5653990 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff048a00640 1 -- 172.21.15.7:0/99041697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038063070 con 0x5626b5653990 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff048a00640 1 -- 172.21.15.7:0/99041697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038053e00 con 0x5626b5653990 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 -- 172.21.15.7:0/99041697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 msgr2=0x5626b564f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b564f3a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff038045f30 tx=0x7ff038051000 comp rx=0 tx=0).stop 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 -- 172.21.15.7:0/99041697 shutdown_connections 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b564f3a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 --2- 172.21.15.7:0/99041697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b564e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 -- 172.21.15.7:0/99041697 >> 172.21.15.7:0/99041697 conn(0x5626b56504e0 msgr2=0x5626b5620ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 -- 172.21.15.7:0/99041697 shutdown_connections 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.100+0000 7ff04d540f40 1 -- 172.21.15.7:0/99041697 wait complete. 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.101+0000 7ff04d540f40 1 Processor -- start 2024-08-19T00:43:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.101+0000 7ff04d540f40 1 -- start start 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04d540f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b56ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04d540f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b5792250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04d540f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56e8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04d540f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5626b56508c0 con 0x5626b5653990 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04d540f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5626b56edcf0 con 0x5626b566b8d0 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04d540f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5626b56edf50 con 0x5626b56535b0 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff049e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b5792250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff049e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b5792250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40832/0 (socket says 172.21.15.7:40832) 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff049e00640 1 -- 172.21.15.7:0/3327651913 learned_addr learned my addr 172.21.15.7:0/3327651913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04b200640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.102+0000 7ff04a800640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b56ebe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff049e00640 1 -- 172.21.15.7:0/3327651913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 msgr2=0x5626b56ebe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff049e00640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5626b56535b0 0x5626b56ebe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff049e00640 1 -- 172.21.15.7:0/3327651913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 msgr2=0x5626b56e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff049e00640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56e8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff049e00640 1 -- 172.21.15.7:0/3327651913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b5589080 con 0x5626b5653990 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff04b200640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626b566b8d0 0x5626b56e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff049e00640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b5792250 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff03800a4f0 tx=0x7ff038002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff043400640 1 -- 172.21.15.7:0/3327651913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0380539b0 con 0x5626b5653990 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff043400640 1 -- 172.21.15.7:0/3327651913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038053b50 con 0x5626b5653990 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff043400640 1 -- 172.21.15.7:0/3327651913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038068470 con 0x5626b5653990 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626b5792790 con 0x5626b5653990 2024-08-19T00:43:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.103+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b56e68d0 con 0x5626b5653990 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.105+0000 7ff043400640 1 -- 172.21.15.7:0/3327651913 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff038068610 con 0x5626b5653990 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.106+0000 7ff043400640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff02c06a840 0x7ff02c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.106+0000 7ff043400640 1 -- 172.21.15.7:0/3327651913 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7ff0380cf950 con 0x5626b5653990 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.106+0000 7ff04a800640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff02c06a840 0x7ff02c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.106+0000 7ff04d540f40 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5626b56e8f80 0x5626b56fa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.106+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5626b56faeb0 con 0x5626b56e8f80 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.107+0000 7ff04b200640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5626b56e8f80 0x5626b56fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.107+0000 7ff04a800640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff02c06a840 0x7ff02c06cd00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009850 tx=0x7ff03c005a00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.107+0000 7ff04b200640 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5626b56e8f80 0x5626b56fa970 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04b200640 1 -- 172.21.15.7:0/3327651913 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x7ff044003880 con 0x5626b56e8f80 2024-08-19T00:43:41.114 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/100.00000000.inode mtime 2024-08-19T00:43:27.000000+0000, size 582 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5626b56e8f80 msgr2=0x5626b56fa970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5626b56e8f80 0x5626b56fa970 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff02c06a840 msgr2=0x7ff02c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff02c06a840 0x7ff02c06cd00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009850 tx=0x7ff03c005a00 comp rx=0 tx=0).stop 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 msgr2=0x5626b5792250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 --2- 172.21.15.7:0/3327651913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626b5653990 0x5626b5792250 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff03800a4f0 tx=0x7ff038002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04b200640 1 -- 172.21.15.7:0/3327651913 reap_dead start 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 shutdown_connections 2024-08-19T00:43:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 >> 172.21.15.7:0/3327651913 conn(0x5626b56504e0 msgr2=0x5626b56f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 shutdown_connections 2024-08-19T00:43:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.108+0000 7ff04d540f40 1 -- 172.21.15.7:0/3327651913 wait complete. 2024-08-19T00:43:41.116 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 1.00000000 2024-08-19T00:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.190+0000 7f145ce5ef40 1 Processor -- start 2024-08-19T00:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.190+0000 7f145ce5ef40 1 -- start start 2024-08-19T00:43:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145ce5ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0413f40 0x5619f04ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145ce5ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 0x5619f04b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145ce5ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0415990 0x5619f04bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145ce5ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619f04148f0 con 0x5619f0413f40 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145ce5ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619f0389d00 con 0x5619f04155b0 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145ce5ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5619f04badc0 con 0x5619f0415990 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0413f40 0x5619f04ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0413f40 0x5619f04ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40854/0 (socket says 172.21.15.7:40854) 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 -- 172.21.15.7:0/1281427938 learned_addr learned my addr 172.21.15.7:0/1281427938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f1459600640 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 0x5619f04b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145aa00640 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0415990 0x5619f04bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 -- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0415990 msgr2=0x5619f04bbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0415990 0x5619f04bbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 -- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 msgr2=0x5619f04b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 0x5619f04b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.191+0000 7f145a000640 1 -- 172.21.15.7:0/1281427938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619f030eb30 con 0x5619f0413f40 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.192+0000 7f145a000640 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0413f40 0x5619f04ae6c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f144c00a4f0 tx=0x7f144c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80ff0ea7ce700fd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.192+0000 7f1453e00640 1 -- 172.21.15.7:0/1281427938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c063070 con 0x5619f0413f40 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.192+0000 7f1453e00640 1 -- 172.21.15.7:0/1281427938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144c00a220 con 0x5619f0413f40 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.192+0000 7f1453e00640 1 -- 172.21.15.7:0/1281427938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c054c10 con 0x5619f0413f40 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.192+0000 7f145ce5ef40 1 -- 172.21.15.7:0/1281427938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0413f40 msgr2=0x5619f04ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.192+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0413f40 0x5619f04ae6c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f144c00a4f0 tx=0x7f144c051000 comp rx=0 tx=0).stop 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.192+0000 7f145ce5ef40 1 -- 172.21.15.7:0/1281427938 shutdown_connections 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0415990 0x5619f04bbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 0x5619f04b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/1281427938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0413f40 0x5619f04ae6c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 -- 172.21.15.7:0/1281427938 >> 172.21.15.7:0/1281427938 conn(0x5619f04124e0 msgr2=0x5619f042e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 -- 172.21.15.7:0/1281427938 shutdown_connections 2024-08-19T00:43:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 -- 172.21.15.7:0/1281427938 wait complete. 2024-08-19T00:43:41.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 Processor -- start 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.193+0000 7f145ce5ef40 1 -- start start 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.194+0000 7f145ce5ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0413f40 0x5619f04a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.194+0000 7f145ce5ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 0x5619f04af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.194+0000 7f145ce5ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0415990 0x5619f04aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.194+0000 7f145ce5ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619f04ba520 con 0x5619f0415990 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.194+0000 7f145ce5ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619f04b3600 con 0x5619f04155b0 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.194+0000 7f145ce5ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5619f04b3320 con 0x5619f0413f40 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0415990 0x5619f04aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0415990 0x5619f04aed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40856/0 (socket says 172.21.15.7:40856) 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 -- 172.21.15.7:0/26395020 learned_addr learned my addr 172.21.15.7:0/26395020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f1459600640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 0x5619f04af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145a000640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0413f40 0x5619f04a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 -- 172.21.15.7:0/26395020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0413f40 msgr2=0x5619f04a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5619f0413f40 0x5619f04a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 -- 172.21.15.7:0/26395020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 msgr2=0x5619f04af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619f04155b0 0x5619f04af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 -- 172.21.15.7:0/26395020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619f034b080 con 0x5619f0415990 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.195+0000 7f145aa00640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0415990 0x5619f04aed00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f145400b480 tx=0x7f145400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.196+0000 7f1452a00640 1 -- 172.21.15.7:0/26395020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454017020 con 0x5619f0415990 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.196+0000 7f1452a00640 1 -- 172.21.15.7:0/26395020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454012660 con 0x5619f0415990 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.196+0000 7f1452a00640 1 -- 172.21.15.7:0/26395020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454012a50 con 0x5619f0415990 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.196+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619f04afe20 con 0x5619f0415990 2024-08-19T00:43:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.196+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619f04aca70 con 0x5619f0415990 2024-08-19T00:43:41.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.198+0000 7f1452a00640 1 -- 172.21.15.7:0/26395020 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f145401a020 con 0x5619f0415990 2024-08-19T00:43:41.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.199+0000 7f1452a00640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f143c06a840 0x7f143c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.199+0000 7f1452a00640 1 -- 172.21.15.7:0/26395020 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f1454089df0 con 0x5619f0415990 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.199+0000 7f145a000640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f143c06a840 0x7f143c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.199+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5619f04a7610 0x5619f04a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.199+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:ff5b34d6:::1.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5619f04a8880 con 0x5619f04a7610 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.199+0000 7f1459600640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5619f04a7610 0x5619f04a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.200+0000 7f145a000640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f143c06a840 0x7f143c06cd00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f144c064000 tx=0x7f144c053000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.200+0000 7f1459600640 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5619f04a7610 0x5619f04a79f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.200+0000 7f1459600640 1 -- 172.21.15.7:0/26395020 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 1.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 154+0+16 (crc 0 0 0) 0x7f1448011810 con 0x5619f04a7610 2024-08-19T00:43:41.204 INFO:teuthology.orchestra.run.smithi007.stdout:cephfs_metadata/1.00000000 mtime 2024-08-19T00:43:36.000000+0000, size 0 2024-08-19T00:43:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.200+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5619f04a7610 msgr2=0x5619f04a79f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.200+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5619f04a7610 0x5619f04a79f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f143c06a840 msgr2=0x7f143c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f143c06a840 0x7f143c06cd00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f144c064000 tx=0x7f144c053000 comp rx=0 tx=0).stop 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0415990 msgr2=0x5619f04aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 --2- 172.21.15.7:0/26395020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619f0415990 0x5619f04aed00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f145400b480 tx=0x7f145400b940 comp rx=0 tx=0).stop 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145aa00640 1 -- 172.21.15.7:0/26395020 reap_dead start 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 shutdown_connections 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 >> 172.21.15.7:0/26395020 conn(0x5619f04124e0 msgr2=0x5619f042e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 shutdown_connections 2024-08-19T00:43:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.201+0000 7f145ce5ef40 1 -- 172.21.15.7:0/26395020 wait complete. 2024-08-19T00:43:41.208 INFO:tasks.cephfs.test_damage:Expectation on rm '10000000000.00000000' will be 'no damage' 2024-08-19T00:43:41.208 INFO:tasks.cephfs.test_damage:Expectation on rm '600.00000000' will be 'damaged_on_start' 2024-08-19T00:43:41.208 INFO:tasks.cephfs.test_damage:Expectation on rm '1.00000000.inode' will be 'damaged_on_start' 2024-08-19T00:43:41.208 INFO:tasks.cephfs.test_damage:Expectation on rm '200.00000000' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm '200.00000001' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_openfiles.0' will be 'no damage' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm '500.00000000' will be 'no damage' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds_snaptable' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_inotable' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm '100.00000000' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_sessionmap' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm '400.00000000' will be 'no damage' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm '100.00000000.inode' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on rm '1.00000000' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '10000000000.00000000' will be 'no damage' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '600.00000000' will be 'damaged_on_start' 2024-08-19T00:43:41.209 INFO:tasks.cephfs.test_damage:Expectation on corrupt header 'mds0_openfiles.0' will be 'no damage' 2024-08-19T00:43:41.210 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '100.00000000' will be 'damaged_on_start' 2024-08-19T00:43:41.210 INFO:tasks.cephfs.test_damage:Expectation on corrupt header 'mds0_sessionmap' will be 'damaged_on_start' 2024-08-19T00:43:41.210 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '1.00000000' will be 'damaged_on_start' 2024-08-19T00:43:41.210 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 10000000000.00000000' 2024-08-19T00:43:41.210 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:41.210 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:41.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:43:41.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:43:41.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:41.246 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:43:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:43:41.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:43:41.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:43:41.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.518+0000 7f36bbe00640 1 Processor -- start 2024-08-19T00:43:41.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.518+0000 7f36bbe00640 1 -- start start 2024-08-19T00:43:41.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.519+0000 7f36bbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36bc0d27b0 0x7f36bc0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.519+0000 7f36bbe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36bc0b4df0 con 0x7f36bc15e3e0 2024-08-19T00:43:41.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.519+0000 7f36bbe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36bc0b50d0 con 0x7f36bc0b4150 2024-08-19T00:43:41.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.519+0000 7f36bbe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f36bc0d3140 con 0x7f36bc0d27b0 2024-08-19T00:43:41.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.519+0000 7f36baa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f36bc15e3e0 0x7f36bc0b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50872/0 (socket says 172.21.15.7:50872) 2024-08-19T00:43:41.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.519+0000 7f36baa00640 1 -- 172.21.15.7:0/1765112363 learned_addr learned my addr 172.21.15.7:0/1765112363 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:41.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36ba000640 1 --2- 172.21.15.7:0/1765112363 >> v2:172.21.15.162:3300/0 conn(0x7f36bc0d27b0 0x7f36bc0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255851410 0 0) 0x7f36bc0b4df0 con 0x7f36bc15e3e0 2024-08-19T00:43:41.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a0003520 con 0x7f36bc15e3e0 2024-08-19T00:43:41.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3052938061 0 0) 0x7f36a0003520 con 0x7f36bc15e3e0 2024-08-19T00:43:41.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 >> v2:172.21.15.162:3300/0 conn(0x7f36bc0d27b0 msgr2=0x7f36bc0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 --2- 172.21.15.7:0/1765112363 >> v2:172.21.15.162:3300/0 conn(0x7f36bc0d27b0 0x7f36bc0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 >> v1:172.21.15.162:6789/0 conn(0x7f36bc0b4150 legacy=0x7f36bc0b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0cf1e0 con 0x7f36bc15e3e0 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f36ac001670 con 0x7f36bc15e3e0 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 >> v1:172.21.15.7:6789/0 conn(0x7f36bc15e3e0 legacy=0x7f36bc0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00039e0 0x7f36a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0d3140 con 0x7f36a00051c0 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36a000c010 con 0x7f36a0004800 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.520+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36a000c210 con 0x7f36a00039e0 2024-08-19T00:43:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36ba000640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36baa00640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00039e0 0x7f36a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36bb400640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36ba000640 1 -- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00039e0 msgr2=0x7f36a0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36ba000640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00039e0 0x7f36a0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36ba000640 1 -- 172.21.15.7:0/1765112363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36a00051c0 msgr2=0x7f36a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36ba000640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36ba000640 1 -- 172.21.15.7:0/1765112363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a0003520 con 0x7f36a0004800 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36bb400640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.521+0000 7f36bb400640 1 -- 172.21.15.7:0/1765112363 reap_dead start 2024-08-19T00:43:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.522+0000 7f36ba000640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009ac0 tx=0x7f36a0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b15e12ae68d6b0c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.522+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8036070 con 0x7f36a0004800 2024-08-19T00:43:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.522+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a8031400 con 0x7f36a0004800 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.522+0000 7f36b9600640 1 -- 172.21.15.7:0/1765112363 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8009690 con 0x7f36a0004800 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.523+0000 7f36bbe00640 1 -- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a0004800 msgr2=0x7f36a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.523+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009ac0 tx=0x7f36a0005830 comp rx=0 tx=0).stop 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.523+0000 7f36bbe00640 1 -- 172.21.15.7:0/1765112363 shutdown_connections 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.523+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1765112363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.523+0000 7f36bbe00640 1 -- 172.21.15.7:0/1765112363 >> 172.21.15.7:0/1765112363 conn(0x7f36bc08dbe0 msgr2=0x7f36bc09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.523+0000 7f36bbe00640 1 -- 172.21.15.7:0/1765112363 shutdown_connections 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.523+0000 7f36bbe00640 1 -- 172.21.15.7:0/1765112363 wait complete. 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.525+0000 7f36bbe00640 1 Processor -- start 2024-08-19T00:43:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.525+0000 7f36bbe00640 1 -- start start 2024-08-19T00:43:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bbe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36bc1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36bc0b97f0 0x7f36bc0b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc0cd180 0x7f36bc0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0d2c00 con 0x7f36bc0cd180 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0cee90 con 0x7f36bc0b97f0 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bbe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc0d2d80 con 0x7f36a0004800 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc0cd180 0x7f36bc0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc0cd180 0x7f36bc0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40874/0 (socket says 172.21.15.7:40874) 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36bb400640 1 -- 172.21.15.7:0/1048477715 learned_addr learned my addr 172.21.15.7:0/1048477715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36ba000640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36bc0b97f0 0x7f36bc0b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.526+0000 7f36baa00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36bc1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bb400640 1 -- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 msgr2=0x7f36bc1f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bb400640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36bc1f45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bb400640 1 -- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36bc0b97f0 msgr2=0x7f36bc0b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bb400640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36bc0b97f0 0x7f36bc0b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bb400640 1 -- 172.21.15.7:0/1048477715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0cb440 con 0x7f36bc0cd180 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bb400640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc0cd180 0x7f36bc0cd610 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0ce7b0 tx=0x7f36b400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36b3400640 1 -- 172.21.15.7:0/1048477715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4001b30 con 0x7f36bc0cd180 2024-08-19T00:43:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36b3400640 1 -- 172.21.15.7:0/1048477715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b4018070 con 0x7f36bc0cd180 2024-08-19T00:43:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36b3400640 1 -- 172.21.15.7:0/1048477715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4003d80 con 0x7f36bc0cd180 2024-08-19T00:43:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc0cb720 con 0x7f36bc0cd180 2024-08-19T00:43:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.527+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc0cbce0 con 0x7f36bc0cd180 2024-08-19T00:43:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.528+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc0b45c0 con 0x7f36bc0cd180 2024-08-19T00:43:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.529+0000 7f36b3400640 1 -- 172.21.15.7:0/1048477715 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36b40050d0 con 0x7f36bc0cd180 2024-08-19T00:43:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.530+0000 7f36b3400640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f369c06be30 0x7f369c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.530+0000 7f36b3400640 1 -- 172.21.15.7:0/1048477715 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f36b408ad00 con 0x7f36bc0cd180 2024-08-19T00:43:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.530+0000 7f36baa00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f369c06be30 0x7f369c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.531+0000 7f36baa00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f369c06be30 0x7f369c06e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.535+0000 7f36b3400640 1 -- 172.21.15.7:0/1048477715 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f36b4059640 con 0x7f36bc0cd180 2024-08-19T00:43:41.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:41.756+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f36bc0d2060 con 0x7f36bc0cd180 2024-08-19T00:43:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.044+0000 7f36b3400640 1 -- 172.21.15.7:0/1048477715 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) ==== 161+0+0 (secure 0 0 0) 0x7f36b4058f40 con 0x7f36bc0cd180 2024-08-19T00:43:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f369c06be30 msgr2=0x7f369c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f369c06be30 0x7f369c06e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac000ed0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc0cd180 msgr2=0x7f36bc0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc0cd180 0x7f36bc0cd610 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0ce7b0 tx=0x7f36b400feb0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 shutdown_connections 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f369c06be30 0x7f369c06e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc0cd180 0x7f36bc0cd610 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36bc0b97f0 0x7f36bc0b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 --2- 172.21.15.7:0/1048477715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36bc1f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 >> 172.21.15.7:0/1048477715 conn(0x7f36bc08dbe0 msgr2=0x7f36bc0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 shutdown_connections 2024-08-19T00:43:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.047+0000 7f36bbe00640 1 -- 172.21.15.7:0/1048477715 wait complete. 2024-08-19T00:43:42.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:43:42.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.222+0000 7f13eb000640 1 Processor -- start 2024-08-19T00:43:42.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.222+0000 7f13eb000640 1 -- start start 2024-08-19T00:43:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.223+0000 7f13eb000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13e406b850 0x7f13e406bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.223+0000 7f13eb000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40d0320 con 0x7f13e406c480 2024-08-19T00:43:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.223+0000 7f13eb000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40b0cf0 con 0x7f13e4161a30 2024-08-19T00:43:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.223+0000 7f13eb000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f13e40d05c0 con 0x7f13e406b850 2024-08-19T00:43:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.224+0000 7f13e9000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13e406b850 0x7f13e406bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.224+0000 7f13e3400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f13e406c480 0x7f13e40b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50880/0 (socket says 172.21.15.7:50880) 2024-08-19T00:43:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.224+0000 7f13e3400640 1 -- 172.21.15.7:0/3832671415 learned_addr learned my addr 172.21.15.7:0/3832671415 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.224+0000 7f13e9000640 1 -- 172.21.15.7:0/3832671415 >> v1:172.21.15.162:6789/0 conn(0x7f13e4161a30 legacy=0x7f13e40b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.224+0000 7f13e9000640 1 -- 172.21.15.7:0/3832671415 >> v1:172.21.15.7:6789/0 conn(0x7f13e406c480 legacy=0x7f13e40b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.224+0000 7f13e9000640 1 -- 172.21.15.7:0/3832671415 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e40d08a0 con 0x7f13e406b850 2024-08-19T00:43:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.225+0000 7f13e9000640 1 --2- 172.21.15.7:0/3832671415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406b850 0x7f13e406bd00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009dc0 tx=0x7f13dc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd074e9d015a732e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.225+0000 7f13e2a00640 1 -- 172.21.15.7:0/3832671415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc037070 con 0x7f13e406b850 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.225+0000 7f13e2a00640 1 -- 172.21.15.7:0/3832671415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13dc007740 con 0x7f13e406b850 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.225+0000 7f13e2a00640 1 -- 172.21.15.7:0/3832671415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc007b10 con 0x7f13e406b850 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.226+0000 7f13eb000640 1 -- 172.21.15.7:0/3832671415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406b850 msgr2=0x7f13e406bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.226+0000 7f13eb000640 1 --2- 172.21.15.7:0/3832671415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406b850 0x7f13e406bd00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009dc0 tx=0x7f13dc02a7c0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.226+0000 7f13eb000640 1 -- 172.21.15.7:0/3832671415 shutdown_connections 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.226+0000 7f13eb000640 1 --2- 172.21.15.7:0/3832671415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406b850 0x7f13e406bd00 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.226+0000 7f13eb000640 1 -- 172.21.15.7:0/3832671415 >> 172.21.15.7:0/3832671415 conn(0x7f13e40b6840 msgr2=0x7f13e40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.226+0000 7f13eb000640 1 -- 172.21.15.7:0/3832671415 shutdown_connections 2024-08-19T00:43:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.226+0000 7f13eb000640 1 -- 172.21.15.7:0/3832671415 wait complete. 2024-08-19T00:43:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.227+0000 7f13eb000640 1 Processor -- start 2024-08-19T00:43:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.228+0000 7f13eb000640 1 -- start start 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.228+0000 7f13eb000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e406b850 0x7f13e41476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.228+0000 7f13eb000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406c480 0x7f13e414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13eb000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e4161a30 0x7f13e415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13eb000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4161e10 con 0x7f13e406c480 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13eb000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13e40d0b80 con 0x7f13e4161a30 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13eb000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13e40b14b0 con 0x7f13e406b850 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406c480 0x7f13e414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406c480 0x7f13e414a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40884/0 (socket says 172.21.15.7:40884) 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 -- 172.21.15.7:0/2430850426 learned_addr learned my addr 172.21.15.7:0/2430850426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e9000640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e4161a30 0x7f13e415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3e00640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e406b850 0x7f13e41476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 -- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e406b850 msgr2=0x7f13e41476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e406b850 0x7f13e41476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 -- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e4161a30 msgr2=0x7f13e415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e4161a30 0x7f13e415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3400640 1 -- 172.21.15.7:0/2430850426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e414ad20 con 0x7f13e406c480 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.229+0000 7f13e3e00640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e406b850 0x7f13e41476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.230+0000 7f13e3400640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406c480 0x7f13e414a7e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c500 tx=0x7f13d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.230+0000 7f13dbe00640 1 -- 172.21.15.7:0/2430850426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0017070 con 0x7f13e406c480 2024-08-19T00:43:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.230+0000 7f13dbe00640 1 -- 172.21.15.7:0/2430850426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d0005ce0 con 0x7f13e406c480 2024-08-19T00:43:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.230+0000 7f13dbe00640 1 -- 172.21.15.7:0/2430850426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00072f0 con 0x7f13e406c480 2024-08-19T00:43:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.230+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e40ca820 con 0x7f13e406c480 2024-08-19T00:43:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.230+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e40cade0 con 0x7f13e406c480 2024-08-19T00:43:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.231+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e406d760 con 0x7f13e406c480 2024-08-19T00:43:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.232+0000 7f13dbe00640 1 -- 172.21.15.7:0/2430850426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13d001a070 con 0x7f13e406c480 2024-08-19T00:43:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.233+0000 7f13dbe00640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c406be30 0x7f13c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.233+0000 7f13dbe00640 1 -- 172.21.15.7:0/2430850426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f13d008a100 con 0x7f13e406c480 2024-08-19T00:43:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.233+0000 7f13e3e00640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c406be30 0x7f13c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.234+0000 7f13e3e00640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c406be30 0x7f13c406e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f13e40cba20 tx=0x7f13d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.237+0000 7f13dbe00640 1 -- 172.21.15.7:0/2430850426 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f13e406d760 con 0x7f13e406c480 2024-08-19T00:43:42.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:42.499+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f13e406bd00 con 0x7f13e406c480 2024-08-19T00:43:43.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.046+0000 7f13dbe00640 1 -- 172.21.15.7:0/2430850426 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v88) ==== 107+0+0 (secure 0 0 0) 0x7f13d00583f0 con 0x7f13e406c480 2024-08-19T00:43:43.049 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:43:43.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c406be30 msgr2=0x7f13c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c406be30 0x7f13c406e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f13e40cba20 tx=0x7f13d4009040 comp rx=0 tx=0).stop 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406c480 msgr2=0x7f13e414a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406c480 0x7f13e414a7e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c500 tx=0x7f13d000c9c0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 shutdown_connections 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c406be30 0x7f13c406e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e4161a30 0x7f13e415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e406c480 0x7f13e414a7e0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 --2- 172.21.15.7:0/2430850426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e406b850 0x7f13e41476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 >> 172.21.15.7:0/2430850426 conn(0x7f13e40b6840 msgr2=0x7f13e4157560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 shutdown_connections 2024-08-19T00:43:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.049+0000 7f13eb000640 1 -- 172.21.15.7:0/2430850426 wait complete. 2024-08-19T00:43:43.071 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:43:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.147+0000 7f2341c32f40 1 Processor -- start 2024-08-19T00:43:43.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.147+0000 7f2341c32f40 1 -- start start 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f2341c32f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b45b0 0x55e39a73e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f2341c32f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b4990 0x55e39a75be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f2341c32f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a681ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f2341c32f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e39a759dc0 con 0x55e39a6cc8d0 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f2341c32f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e39a628d00 con 0x55e39a6b45b0 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f2341c32f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e39a75a0a0 con 0x55e39a6b4990 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a681ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a681ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40906/0 (socket says 172.21.15.7:40906) 2024-08-19T00:43:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 -- 172.21.15.7:0/1363390595 learned_addr learned my addr 172.21.15.7:0/1363390595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233ee00640 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b45b0 0x55e39a73e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233e400640 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b4990 0x55e39a75be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 -- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b4990 msgr2=0x55e39a75be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b4990 0x55e39a75be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 -- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b45b0 msgr2=0x55e39a73e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b45b0 0x55e39a73e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.148+0000 7f233f800640 1 -- 172.21.15.7:0/1363390595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39a5adb30 con 0x55e39a6cc8d0 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f233f800640 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a681ef0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f233800a4b0 tx=0x7f233800a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19092033e81e465d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f233d000640 1 -- 172.21.15.7:0/1363390595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338015070 con 0x55e39a6cc8d0 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f233d000640 1 -- 172.21.15.7:0/1363390595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f233800e730 con 0x55e39a6cc8d0 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f233d000640 1 -- 172.21.15.7:0/1363390595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233800eb20 con 0x55e39a6cc8d0 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 -- 172.21.15.7:0/1363390595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 msgr2=0x55e39a681ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a681ef0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f233800a4b0 tx=0x7f233800a970 comp rx=0 tx=0).stop 2024-08-19T00:43:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 -- 172.21.15.7:0/1363390595 shutdown_connections 2024-08-19T00:43:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a681ef0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b4990 0x55e39a75be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 --2- 172.21.15.7:0/1363390595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b45b0 0x55e39a73e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 -- 172.21.15.7:0/1363390595 >> 172.21.15.7:0/1363390595 conn(0x55e39a6b14e0 msgr2=0x55e39a6b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 -- 172.21.15.7:0/1363390595 shutdown_connections 2024-08-19T00:43:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.149+0000 7f2341c32f40 1 -- 172.21.15.7:0/1363390595 wait complete. 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.150+0000 7f2341c32f40 1 Processor -- start 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.150+0000 7f2341c32f40 1 -- start start 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f2341c32f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b45b0 0x55e39a73d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f2341c32f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b4990 0x55e39a7586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f2341c32f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a7547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f2341c32f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e39a752940 con 0x55e39a6cc8d0 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f2341c32f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e39a73e8e0 con 0x55e39a6b4990 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f2341c32f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e39a752c20 con 0x55e39a6b45b0 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f233f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a7547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f233f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a7547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40910/0 (socket says 172.21.15.7:40910) 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.151+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 learned_addr learned my addr 172.21.15.7:0/2698527612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233e400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b4990 0x55e39a7586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233ee00640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b45b0 0x55e39a73d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b45b0 msgr2=0x55e39a73d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233f800640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e39a6b45b0 0x55e39a73d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b4990 msgr2=0x55e39a7586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233f800640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e39a6b4990 0x55e39a7586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39a5ea080 con 0x55e39a6cc8d0 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f233f800640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a7547b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f233800a9b0 tx=0x7f23380032f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f2337400640 1 -- 172.21.15.7:0/2698527612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338020070 con 0x55e39a6cc8d0 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f2337400640 1 -- 172.21.15.7:0/2698527612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f233801b660 con 0x55e39a6cc8d0 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.152+0000 7f2337400640 1 -- 172.21.15.7:0/2698527612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338015040 con 0x55e39a6cc8d0 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.153+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e39a759040 con 0x55e39a6cc8d0 2024-08-19T00:43:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.153+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39a74c460 con 0x55e39a6cc8d0 2024-08-19T00:43:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.154+0000 7f2337400640 1 -- 172.21.15.7:0/2698527612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2338023070 con 0x55e39a6cc8d0 2024-08-19T00:43:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.155+0000 7f2337400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006a810 0x7f232006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.155+0000 7f2337400640 1 -- 172.21.15.7:0/2698527612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f233808b3e0 con 0x55e39a6cc8d0 2024-08-19T00:43:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.155+0000 7f233ee00640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006a810 0x7f232006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.159 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:43:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.156+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e39a74cf40 0x55e39a74d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.156+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a74d860 con 0x55e39a74cf40 2024-08-19T00:43:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.156+0000 7f233ee00640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006a810 0x7f232006ccd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f23300076a0 tx=0x7f2330005a60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.156+0000 7f233e400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e39a74cf40 0x55e39a74d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.157+0000 7f233e400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e39a74cf40 0x55e39a74d320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.159+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v87'11 uv6 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.159+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a74dc00 con 0x55e39a74cf40 2024-08-19T00:43:43.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.160+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v87'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.160+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a74e030 con 0x55e39a74cf40 2024-08-19T00:43:43.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.161+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v87'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.164 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:43:43.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.161+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fca40 con 0x55e39a74cf40 2024-08-19T00:43:43.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.163+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v87'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.163+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fcde0 con 0x55e39a74cf40 2024-08-19T00:43:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.164+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v87'15 uv15 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.164+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fba30 con 0x55e39a74cf40 2024-08-19T00:43:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.166+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v87'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.166+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fbe40 con 0x55e39a74cf40 2024-08-19T00:43:43.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.167+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v87'17 uv7 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.167+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc230 con 0x55e39a74cf40 2024-08-19T00:43:43.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.168+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v87'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.168+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc230 con 0x55e39a74cf40 2024-08-19T00:43:43.172 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:43:43.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.170+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v87'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.170+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.172+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v87'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.172+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.173+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v87'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.173+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.175+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v87'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.175+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.176+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v87'23 uv10 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.176+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.178+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v87'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.178+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.181 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:43:43.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.179+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v87'25 uv25 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.179+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.180+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v87'26 uv26 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.180+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.182+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v87'27 uv27 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.182+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc1e0 con 0x55e39a74cf40 2024-08-19T00:43:43.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.183+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v87'28 uv28 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.183+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc5c0 con 0x55e39a74cf40 2024-08-19T00:43:43.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.185+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v87'29 uv29 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.185+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc5c0 con 0x55e39a74cf40 2024-08-19T00:43:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.186+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v87'30 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.186+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc5c0 con 0x55e39a74cf40 2024-08-19T00:43:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.187+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v87'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.187+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc5c0 con 0x55e39a74cf40 2024-08-19T00:43:43.191 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:43:43.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.189+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v87'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.189+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc5c0 con 0x55e39a74cf40 2024-08-19T00:43:43.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.190+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v87'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.190+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.192+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v87'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.192+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.193+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v87'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.193+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.194+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v87'36 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.194+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.196+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v87'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.196+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.200 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:43:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.197+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v87'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.197+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.199+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v87'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.199+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.200+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v87'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.200+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a74cf40 2024-08-19T00:43:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.201+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v87'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.202+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e39a7fd690 0x55e39a7ffa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.202+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fc4a0 con 0x55e39a7fd690 2024-08-19T00:43:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.202+0000 7f233ee00640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e39a7fd690 0x55e39a7ffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.202+0000 7f233ee00640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e39a7fd690 0x55e39a7ffa80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.204+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v87'20 uv15 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.204+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a7fffc0 con 0x55e39a7fd690 2024-08-19T00:43:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.206+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v87'21 uv21 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.206+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a800360 con 0x55e39a7fd690 2024-08-19T00:43:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.207+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v87'22 uv22 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.210 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:43:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.207+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a6ce840 con 0x55e39a7fd690 2024-08-19T00:43:43.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.209+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v87'23 uv23 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.209+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a800780 con 0x55e39a7fd690 2024-08-19T00:43:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.211+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v87'24 uv24 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.211+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a800c80 con 0x55e39a7fd690 2024-08-19T00:43:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.212+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v87'25 uv19 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.212+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8015b0 con 0x55e39a7fd690 2024-08-19T00:43:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.215+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v87'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.215+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.218+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v87'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.221 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:43:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.218+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.221+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v87'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.221+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.224+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v87'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.224+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.227+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v87'30 uv16 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.227+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.228+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v87'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.228+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.231+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v87'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.233 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:43:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.231+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a806040 con 0x55e39a7fd690 2024-08-19T00:43:43.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.234+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v87'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.234+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a806040 con 0x55e39a7fd690 2024-08-19T00:43:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.236+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v87'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.236+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.238+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v87'35 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.238+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.239+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v87'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.239+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.241+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v87'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.243 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:43:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.241+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a802960 con 0x55e39a7fd690 2024-08-19T00:43:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.242+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v87'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.242+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a802960 con 0x55e39a7fd690 2024-08-19T00:43:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.243+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v87'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.243+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a801950 con 0x55e39a7fd690 2024-08-19T00:43:43.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.245+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v87'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a7fd690 2024-08-19T00:43:43.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.245+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e39a801fd0 0x55e39a8043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.245+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804990 con 0x55e39a801fd0 2024-08-19T00:43:43.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.245+0000 7f233e400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e39a801fd0 0x55e39a8043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.246+0000 7f233e400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e39a801fd0 0x55e39a8043c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.247+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v87'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.247+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804d60 con 0x55e39a801fd0 2024-08-19T00:43:43.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.249+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v87'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.249+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804d60 con 0x55e39a801fd0 2024-08-19T00:43:43.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.250+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v87'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.253 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:43:43.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.250+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a805d70 con 0x55e39a801fd0 2024-08-19T00:43:43.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.252+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v87'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.252+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a805d70 con 0x55e39a801fd0 2024-08-19T00:43:43.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.253+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v87'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.253+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804d60 con 0x55e39a801fd0 2024-08-19T00:43:43.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.255+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v87'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.256+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804d60 con 0x55e39a74cf40 2024-08-19T00:43:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.257+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v87'5 uv4 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.257+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804d60 con 0x55e39a74cf40 2024-08-19T00:43:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.259+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v87'6 uv6 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.259+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804d60 con 0x55e39a74cf40 2024-08-19T00:43:43.264 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:43:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.261+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v87'7 uv7 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.261+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a804d60 con 0x55e39a74cf40 2024-08-19T00:43:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.264+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v87'8 uv8 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.264+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e39a8056f0 0x55e39a807ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.264+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a808020 con 0x55e39a8056f0 2024-08-19T00:43:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.265+0000 7f233f800640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e39a8056f0 0x55e39a807ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.265+0000 7f233f800640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e39a8056f0 0x55e39a807ae0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.267+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v87'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.267+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8083c0 con 0x55e39a8056f0 2024-08-19T00:43:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.268+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v87'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.268+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a808870 con 0x55e39a8056f0 2024-08-19T00:43:43.273 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:43:43.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.271+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v87'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.271+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80a120 con 0x55e39a8056f0 2024-08-19T00:43:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.274+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v87'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.274+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80a4c0 con 0x55e39a8056f0 2024-08-19T00:43:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.276+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v87'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.277+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a809110 con 0x55e39a8056f0 2024-08-19T00:43:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.279+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v87'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.279+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e39a809a10 0x55e39a80c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.279+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80cdb0 con 0x55e39a809a10 2024-08-19T00:43:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.280+0000 7f233ee00640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e39a809a10 0x55e39a80c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.280+0000 7f233ee00640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e39a809a10 0x55e39a80c870 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.282+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v87'4 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.282+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80cdb0 con 0x55e39a809a10 2024-08-19T00:43:43.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.283+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v87'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.283+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80cdb0 con 0x55e39a809a10 2024-08-19T00:43:43.287 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:43:43.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.284+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v87'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.285+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80e1e0 con 0x55e39a809a10 2024-08-19T00:43:43.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.286+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v87'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.286+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80e1e0 con 0x55e39a809a10 2024-08-19T00:43:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.287+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v87'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.287+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80d1d0 con 0x55e39a809a10 2024-08-19T00:43:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.289+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v87'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.289+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80d1d0 con 0x55e39a809a10 2024-08-19T00:43:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.290+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v87'10 uv3 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.290+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80d1d0 con 0x55e39a809a10 2024-08-19T00:43:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.292+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v87'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.292+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80d1d0 con 0x55e39a809a10 2024-08-19T00:43:43.298 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:43:43.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.293+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v87'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.293+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80d1d0 con 0x55e39a809a10 2024-08-19T00:43:43.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.294+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v87'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.295+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a80d1d0 con 0x55e39a809a10 2024-08-19T00:43:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.296+0000 7f233ee00640 1 -- 172.21.15.7:0/2698527612 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v87'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f233001f040 con 0x55e39a809a10 2024-08-19T00:43:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.296+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e39a80d6e0 0x55e39a80fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.296+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8101d0 con 0x55e39a80d6e0 2024-08-19T00:43:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.296+0000 7f233e400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e39a80d6e0 0x55e39a80fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.297+0000 7f233e400640 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e39a80d6e0 0x55e39a80fad0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.298+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v87'2 uv1 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.298+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8101d0 con 0x55e39a80d6e0 2024-08-19T00:43:43.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.299+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v87'3 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.299+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a80d6e0 2024-08-19T00:43:43.304 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:43:43.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.302+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v87'4 uv4 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.302+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a80d6e0 2024-08-19T00:43:43.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.304+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v87'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.304+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a80d6e0 2024-08-19T00:43:43.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.307+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v87'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.307+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a74cf40 2024-08-19T00:43:43.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.309+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v87'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.309+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a74cf40 2024-08-19T00:43:43.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.310+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v87'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.310+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a74cf40 2024-08-19T00:43:43.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.311+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v87'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:43:43.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.311+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a811600 con 0x55e39a74cf40 2024-08-19T00:43:43.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.312+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v87'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.313+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a811600 con 0x55e39a74cf40 2024-08-19T00:43:43.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.314+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v87'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.314+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a74cf40 2024-08-19T00:43:43.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.315+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v87'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a74cf40 2024-08-19T00:43:43.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.315+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.316+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v87'4 uv3 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.316+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.318+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v87'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.318+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.322 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:43:43.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.319+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v87'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.320+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.321+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v87'7 uv7 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.321+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.324+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v87'8 uv8 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.324+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.327+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v87'9 uv1 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.327+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.330+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v87'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.330+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.333 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:43:43.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.331+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v87'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.331+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8105f0 con 0x55e39a801fd0 2024-08-19T00:43:43.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.334+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v87'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.334+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a813400 con 0x55e39a801fd0 2024-08-19T00:43:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.336+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v87'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a801fd0 2024-08-19T00:43:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.337+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810aa0 con 0x55e39a8056f0 2024-08-19T00:43:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.338+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v87'4 uv3 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.338+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e90 con 0x55e39a8056f0 2024-08-19T00:43:43.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.340+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v87'5 uv5 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.340+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e90 con 0x55e39a8056f0 2024-08-19T00:43:43.344 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:43:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.341+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v87'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.341+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a8056f0 2024-08-19T00:43:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.342+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v87'7 uv7 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.343+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a8056f0 2024-08-19T00:43:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.344+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v87'3 uv2 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.344+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a8056f0 2024-08-19T00:43:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.346+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v87'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.346+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a8056f0 2024-08-19T00:43:43.350 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:43:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.347+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v87'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.347+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a811e50 con 0x55e39a8056f0 2024-08-19T00:43:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.349+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v87'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.349+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a811e50 con 0x55e39a8056f0 2024-08-19T00:43:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.350+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v87'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.350+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a8056f0 2024-08-19T00:43:43.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.351+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v87'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2338022030 con 0x55e39a8056f0 2024-08-19T00:43:43.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.351+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.352+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v87'2 uv1 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.352+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.354+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v87'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.354+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.355+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v87'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.358 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:43:43.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.355+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.356+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v87'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.356+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.357+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v87'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.357+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.359+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v87'7 uv3 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.359+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.360+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v87'8 uv8 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.360+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.361+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v87'9 uv9 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.364 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:43:43.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.361+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.363+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v87'10 uv10 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.363+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.364+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v87'11 uv11 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.364+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.365+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v87'12 uv6 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.365+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.367+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v87'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.367+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.370 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:43:43.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.368+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v87'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.368+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.369+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v87'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.369+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.370+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v87'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.370+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a810e40 con 0x55e39a80d6e0 2024-08-19T00:43:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.372+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v87'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.372+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55e39a8116b0 con 0x55e39a80d6e0 2024-08-19T00:43:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f233e400640 1 -- 172.21.15.7:0/2698527612 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v87'18 uv18 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f232c052910 con 0x55e39a80d6e0 2024-08-19T00:43:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e39a7fd690 msgr2=0x55e39a7ffa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e39a7fd690 0x55e39a7ffa80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e39a809a10 msgr2=0x55e39a80c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e39a809a10 0x55e39a80c870 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e39a80d6e0 msgr2=0x55e39a80fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e39a80d6e0 0x55e39a80fad0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e39a801fd0 msgr2=0x55e39a8043c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e39a801fd0 0x55e39a8043c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e39a74cf40 msgr2=0x55e39a74d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e39a74cf40 0x55e39a74d320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e39a8056f0 msgr2=0x55e39a807ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e39a8056f0 0x55e39a807ae0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 reap_dead start 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f233f800640 1 -- 172.21.15.7:0/2698527612 reap_dead start 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006a810 msgr2=0x7f232006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006a810 0x7f232006ccd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f23300076a0 tx=0x7f2330005a60 comp rx=0 tx=0).stop 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 msgr2=0x55e39a7547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a7547b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f233800a9b0 tx=0x7f23380032f0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 shutdown_connections 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006a810 0x7f232006ccd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 --2- 172.21.15.7:0/2698527612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e39a6cc8d0 0x55e39a7547b0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 >> 172.21.15.7:0/2698527612 conn(0x55e39a6b14e0 msgr2=0x55e39a6b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 shutdown_connections 2024-08-19T00:43:43.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.373+0000 7f2341c32f40 1 -- 172.21.15.7:0/2698527612 wait complete. 2024-08-19T00:43:43.381 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-08-19T00:43:43.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.455+0000 7f7ee2d1cf40 1 Processor -- start 2024-08-19T00:43:43.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.455+0000 7f7ee2d1cf40 1 -- start start 2024-08-19T00:43:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee2d1cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c11b5b0 0x55785c1b9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee2d1cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c1162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee2d1cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c1338d0 0x55785c11a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee2d1cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55785c1c0dc0 con 0x55785c11b990 2024-08-19T00:43:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee2d1cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55785c08fd00 con 0x55785c11b5b0 2024-08-19T00:43:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee2d1cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55785c1c10a0 con 0x55785c1338d0 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c1162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c1162f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40934/0 (socket says 172.21.15.7:40934) 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 -- 172.21.15.7:0/1900239182 learned_addr learned my addr 172.21.15.7:0/1900239182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee0000640 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c1338d0 0x55785c11a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 -- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c1338d0 msgr2=0x55785c11a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c1338d0 0x55785c11a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 -- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c11b5b0 msgr2=0x55785c1b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c11b5b0 0x55785c1b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7edec00640 1 -- 172.21.15.7:0/1900239182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55785c014b30 con 0x55785c11b990 2024-08-19T00:43:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.456+0000 7f7ee0000640 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c1338d0 0x55785c11a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:43.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.457+0000 7f7edec00640 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c1162f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc025aa0 tx=0x7f7ecc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2a23bfca7cb4bd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.457+0000 7f7edd800640 1 -- 172.21.15.7:0/1900239182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc065070 con 0x55785c11b990 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.457+0000 7f7edd800640 1 -- 172.21.15.7:0/1900239182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ecc0549f0 con 0x55785c11b990 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.457+0000 7f7edd800640 1 -- 172.21.15.7:0/1900239182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc059040 con 0x55785c11b990 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.457+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/1900239182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 msgr2=0x55785c1162f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.457+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c1162f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc025aa0 tx=0x7f7ecc04e000 comp rx=0 tx=0).stop 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/1900239182 shutdown_connections 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c1338d0 0x55785c11a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c1162f0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/1900239182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c11b5b0 0x55785c1b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/1900239182 >> 172.21.15.7:0/1900239182 conn(0x55785c1184e0 msgr2=0x55785c133120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/1900239182 shutdown_connections 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/1900239182 wait complete. 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.458+0000 7f7ee2d1cf40 1 Processor -- start 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.459+0000 7f7ee2d1cf40 1 -- start start 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.459+0000 7f7ee2d1cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c11b5b0 0x55785c1b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.459+0000 7f7ee2d1cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c134940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.459+0000 7f7ee2d1cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c1338d0 0x55785c134e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.459+0000 7f7ee2d1cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55785c1b9070 con 0x55785c11b990 2024-08-19T00:43:43.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.459+0000 7f7ee2d1cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55785c116e20 con 0x55785c1338d0 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.459+0000 7f7ee2d1cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55785c116b40 con 0x55785c11b5b0 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c134940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c134940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40940/0 (socket says 172.21.15.7:40940) 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 -- 172.21.15.7:0/3831673202 learned_addr learned my addr 172.21.15.7:0/3831673202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edf600640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c11b5b0 0x55785c1b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7ee0000640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c1338d0 0x55785c134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 -- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c11b5b0 msgr2=0x55785c1b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55785c11b5b0 0x55785c1b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 -- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c1338d0 msgr2=0x55785c134e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55785c1338d0 0x55785c134e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 -- 172.21.15.7:0/3831673202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55785c051080 con 0x55785c11b990 2024-08-19T00:43:43.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.460+0000 7f7edec00640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c134940 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc025aa0 tx=0x7f7ecc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.461+0000 7f7ed7e00640 1 -- 172.21.15.7:0/3831673202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc065040 con 0x55785c11b990 2024-08-19T00:43:43.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.461+0000 7f7ed7e00640 1 -- 172.21.15.7:0/3831673202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ecc054da0 con 0x55785c11b990 2024-08-19T00:43:43.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.461+0000 7f7ed7e00640 1 -- 172.21.15.7:0/3831673202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc059040 con 0x55785c11b990 2024-08-19T00:43:43.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.461+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55785c1b96a0 con 0x55785c11b990 2024-08-19T00:43:43.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.461+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55785c1af330 con 0x55785c11b990 2024-08-19T00:43:43.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.463+0000 7f7ed7e00640 1 -- 172.21.15.7:0/3831673202 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ecc072060 con 0x55785c11b990 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.464+0000 7f7ed7e00640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ec006a810 0x7f7ec006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.464+0000 7f7ed7e00640 1 -- 172.21.15.7:0/3831673202 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f7ecc0ce330 con 0x55785c11b990 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.464+0000 7f7edf600640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ec006a810 0x7f7ec006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.464+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55785c1b09e0 0x55785c25a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.464+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e87) -- 0x55785c1c2f80 con 0x55785c1b09e0 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.464+0000 7f7ee0000640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55785c1b09e0 0x55785c25a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.464+0000 7f7edf600640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ec006a810 0x7f7ec006ccd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0003080 tx=0x7f7ed000c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.465+0000 7f7ee0000640 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55785c1b09e0 0x55785c25a300 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee0000640 1 -- 172.21.15.7:0/3831673202 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v87'42 uv42 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ed8006d70 con 0x55785c1b09e0 2024-08-19T00:43:43.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55785c1b09e0 msgr2=0x55785c25a300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55785c1b09e0 0x55785c25a300 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ec006a810 msgr2=0x7f7ec006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ec006a810 0x7f7ec006ccd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0003080 tx=0x7f7ed000c040 comp rx=0 tx=0).stop 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 msgr2=0x55785c134940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 --2- 172.21.15.7:0/3831673202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55785c11b990 0x55785c134940 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc025aa0 tx=0x7f7ecc002fb0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee0000640 1 -- 172.21.15.7:0/3831673202 reap_dead start 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 shutdown_connections 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 >> 172.21.15.7:0/3831673202 conn(0x55785c1184e0 msgr2=0x55785c1c2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 shutdown_connections 2024-08-19T00:43:43.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.467+0000 7f7ee2d1cf40 1 -- 172.21.15.7:0/3831673202 wait complete. 2024-08-19T00:43:43.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:43:43.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.630+0000 7ff72d800640 1 Processor -- start 2024-08-19T00:43:43.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.631+0000 7ff72d800640 1 -- start start 2024-08-19T00:43:43.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff72d800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff72806d780 0x7ff72806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff72d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72809ba80 0x7ff7280b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff72d800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7280b62e0 0x7ff7280b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff72d800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff72806e0a0 con 0x7ff7280b62e0 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff72d800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff7280b6cb0 con 0x7ff72806d780 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff72d800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7280b6f70 con 0x7ff72809ba80 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff727400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7280b62e0 0x7ff7280b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff727400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7280b62e0 0x7ff7280b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40952/0 (socket says 172.21.15.7:40952) 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff727400640 1 -- 172.21.15.7:0/284985305 learned_addr learned my addr 172.21.15.7:0/284985305 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff726a00640 1 --2- 172.21.15.7:0/284985305 >> v2:172.21.15.162:3300/0 conn(0x7ff72806d780 0x7ff72806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.632+0000 7ff726000640 1 --2- 172.21.15.7:0/284985305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72809ba80 0x7ff7280b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.633+0000 7ff727400640 1 -- 172.21.15.7:0/284985305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72809ba80 msgr2=0x7ff7280b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.633+0000 7ff727400640 1 --2- 172.21.15.7:0/284985305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72809ba80 0x7ff7280b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.633+0000 7ff727400640 1 -- 172.21.15.7:0/284985305 >> v2:172.21.15.162:3300/0 conn(0x7ff72806d780 msgr2=0x7ff72806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.633+0000 7ff727400640 1 --2- 172.21.15.7:0/284985305 >> v2:172.21.15.162:3300/0 conn(0x7ff72806d780 0x7ff72806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.633+0000 7ff727400640 1 -- 172.21.15.7:0/284985305 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7280b7250 con 0x7ff7280b62e0 2024-08-19T00:43:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.634+0000 7ff727400640 1 --2- 172.21.15.7:0/284985305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7280b62e0 0x7ff7280b6770 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff72806efc0 tx=0x7ff72002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2ef81f248d9e35 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.634+0000 7ff725600640 1 -- 172.21.15.7:0/284985305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720037070 con 0x7ff7280b62e0 2024-08-19T00:43:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.634+0000 7ff725600640 1 -- 172.21.15.7:0/284985305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff720032440 con 0x7ff7280b62e0 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.634+0000 7ff725600640 1 -- 172.21.15.7:0/284985305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720032810 con 0x7ff7280b62e0 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.634+0000 7ff72d800640 1 -- 172.21.15.7:0/284985305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7280b62e0 msgr2=0x7ff7280b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.634+0000 7ff72d800640 1 --2- 172.21.15.7:0/284985305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7280b62e0 0x7ff7280b6770 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff72806efc0 tx=0x7ff72002a270 comp rx=0 tx=0).stop 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.635+0000 7ff72d800640 1 -- 172.21.15.7:0/284985305 shutdown_connections 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.635+0000 7ff72d800640 1 --2- 172.21.15.7:0/284985305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7280b62e0 0x7ff7280b6770 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.635+0000 7ff72d800640 1 --2- 172.21.15.7:0/284985305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72809ba80 0x7ff7280b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.635+0000 7ff72d800640 1 --2- 172.21.15.7:0/284985305 >> v2:172.21.15.162:3300/0 conn(0x7ff72806d780 0x7ff72806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.635+0000 7ff72d800640 1 -- 172.21.15.7:0/284985305 >> 172.21.15.7:0/284985305 conn(0x7ff7280d2180 msgr2=0x7ff7280d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.635+0000 7ff72d800640 1 -- 172.21.15.7:0/284985305 shutdown_connections 2024-08-19T00:43:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.635+0000 7ff72d800640 1 -- 172.21.15.7:0/284985305 wait complete. 2024-08-19T00:43:43.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.636+0000 7ff72d800640 1 Processor -- start 2024-08-19T00:43:43.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.637+0000 7ff72d800640 1 -- start start 2024-08-19T00:43:43.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.637+0000 7ff72d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72806d780 0x7ff72809e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.637+0000 7ff72d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72809ba80 0x7ff7281f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff72d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7280b62e0 0x7ff72809cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff72d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff72806f9a0 con 0x7ff72806d780 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff72d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7280cb710 con 0x7ff72809ba80 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff72d800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff72815ea10 con 0x7ff7280b62e0 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72806d780 0x7ff72809e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72806d780 0x7ff72809e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40960/0 (socket says 172.21.15.7:40960) 2024-08-19T00:43:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 -- 172.21.15.7:0/1394407509 learned_addr learned my addr 172.21.15.7:0/1394407509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 -- 172.21.15.7:0/1394407509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7280b62e0 msgr2=0x7ff72809cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7280b62e0 0x7ff72809cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 -- 172.21.15.7:0/1394407509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72809ba80 msgr2=0x7ff7281f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72809ba80 0x7ff7281f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 -- 172.21.15.7:0/1394407509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7280ce710 con 0x7ff72806d780 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.638+0000 7ff726a00640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72806d780 0x7ff72809e450 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff71800eed0 tx=0x7ff71800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.639+0000 7ff71ea00640 1 -- 172.21.15.7:0/1394407509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718018020 con 0x7ff72806d780 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.639+0000 7ff71ea00640 1 -- 172.21.15.7:0/1394407509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff71800bd90 con 0x7ff72806d780 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.639+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7280ce9f0 con 0x7ff72806d780 2024-08-19T00:43:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.639+0000 7ff71ea00640 1 -- 172.21.15.7:0/1394407509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718014620 con 0x7ff72806d780 2024-08-19T00:43:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.639+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72809e990 con 0x7ff72806d780 2024-08-19T00:43:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.640+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72806d380 con 0x7ff72806d780 2024-08-19T00:43:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.641+0000 7ff71ea00640 1 -- 172.21.15.7:0/1394407509 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff718005d10 con 0x7ff72806d780 2024-08-19T00:43:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.641+0000 7ff71ea00640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff70806be60 0x7ff70806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.642+0000 7ff71ea00640 1 -- 172.21.15.7:0/1394407509 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7ff71808b7c0 con 0x7ff72806d780 2024-08-19T00:43:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.642+0000 7ff726000640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff70806be60 0x7ff70806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.642+0000 7ff726000640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff70806be60 0x7ff70806e320 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff714006a90 tx=0x7ff714006a20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.646+0000 7ff71ea00640 1 -- 172.21.15.7:0/1394407509 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff718022070 con 0x7ff72806d780 2024-08-19T00:43:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:43.866+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7ff7280b3b90 con 0x7ff72806d780 2024-08-19T00:43:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.055+0000 7ff71ea00640 1 -- 172.21.15.7:0/1394407509 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v89) ==== 162+0+0 (secure 0 0 0) 0x7ff71805a070 con 0x7ff72806d780 2024-08-19T00:43:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:43:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff70806be60 msgr2=0x7ff70806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff70806be60 0x7ff70806e320 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff714006a90 tx=0x7ff714006a20 comp rx=0 tx=0).stop 2024-08-19T00:43:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72806d780 msgr2=0x7ff72809e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72806d780 0x7ff72809e450 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff71800eed0 tx=0x7ff71800b480 comp rx=0 tx=0).stop 2024-08-19T00:43:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 shutdown_connections 2024-08-19T00:43:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff70806be60 0x7ff70806e320 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7280b62e0 0x7ff72809cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72809ba80 0x7ff7281f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 --2- 172.21.15.7:0/1394407509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff72806d780 0x7ff72809e450 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 >> 172.21.15.7:0/1394407509 conn(0x7ff7280d2180 msgr2=0x7ff7280cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 shutdown_connections 2024-08-19T00:43:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.058+0000 7ff72d800640 1 -- 172.21.15.7:0/1394407509 wait complete. 2024-08-19T00:43:44.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:44.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.639+0000 7f8a25c00640 1 Processor -- start 2024-08-19T00:43:44.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.639+0000 7f8a25c00640 1 -- start start 2024-08-19T00:43:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.640+0000 7f8a25c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015c510 0x7f8a2009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.640+0000 7f8a25c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a2015d490 0x7f8a200cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.640+0000 7f8a25c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a200ccd40 con 0x7f8a2015c8f0 2024-08-19T00:43:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.640+0000 7f8a25c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2009b370 con 0x7f8a2015d490 2024-08-19T00:43:44.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.640+0000 7f8a25c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2009b650 con 0x7f8a2015c510 2024-08-19T00:43:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015c510 0x7f8a2009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a2015d490 0x7f8a200cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015c510 0x7f8a2009aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53776/0 (socket says 172.21.15.7:53776) 2024-08-19T00:43:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1e000640 1 -- 172.21.15.7:0/1315405227 learned_addr learned my addr 172.21.15.7:0/1315405227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1ea00640 1 --1- 172.21.15.7:0/1315405227 >> v1:172.21.15.162:6789/0 conn(0x7f8a2015c8f0 0x7f8a2015ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:49548/0 (socket says 172.21.15.7:49548) 2024-08-19T00:43:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1e000640 1 -- 172.21.15.7:0/1315405227 >> v2:172.21.15.162:3300/0 conn(0x7f8a2015d490 msgr2=0x7f8a200cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1e000640 1 --2- 172.21.15.7:0/1315405227 >> v2:172.21.15.162:3300/0 conn(0x7f8a2015d490 0x7f8a200cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1e000640 1 -- 172.21.15.7:0/1315405227 >> v1:172.21.15.162:6789/0 conn(0x7f8a2015c8f0 legacy=0x7f8a2015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.641+0000 7f8a1e000640 1 -- 172.21.15.7:0/1315405227 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2009b930 con 0x7f8a2015c510 2024-08-19T00:43:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.642+0000 7f8a1e000640 1 --2- 172.21.15.7:0/1315405227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015c510 0x7f8a2009aa70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009870 tx=0x7f8a0c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff26a60288231c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a1d600640 1 -- 172.21.15.7:0/1315405227 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c037070 con 0x7f8a2015c510 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a1d600640 1 -- 172.21.15.7:0/1315405227 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a0c032440 con 0x7f8a2015c510 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a1d600640 1 -- 172.21.15.7:0/1315405227 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c032810 con 0x7f8a2015c510 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a25c00640 1 -- 172.21.15.7:0/1315405227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015c510 msgr2=0x7f8a2009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a25c00640 1 --2- 172.21.15.7:0/1315405227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015c510 0x7f8a2009aa70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009870 tx=0x7f8a0c02a250 comp rx=0 tx=0).stop 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a25c00640 1 -- 172.21.15.7:0/1315405227 shutdown_connections 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a25c00640 1 --2- 172.21.15.7:0/1315405227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015c510 0x7f8a2009aa70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a25c00640 1 --2- 172.21.15.7:0/1315405227 >> v2:172.21.15.162:3300/0 conn(0x7f8a2015d490 0x7f8a200cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a25c00640 1 -- 172.21.15.7:0/1315405227 >> 172.21.15.7:0/1315405227 conn(0x7f8a200d2190 msgr2=0x7f8a200d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.643+0000 7f8a25c00640 1 -- 172.21.15.7:0/1315405227 shutdown_connections 2024-08-19T00:43:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.644+0000 7f8a25c00640 1 -- 172.21.15.7:0/1315405227 wait complete. 2024-08-19T00:43:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.645+0000 7f8a25c00640 1 Processor -- start 2024-08-19T00:43:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.645+0000 7f8a25c00640 1 -- start start 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a25c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015c510 0x7f8a200c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a25c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a2015c8f0 0x7f8a200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a25c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015d490 0x7f8a200b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a25c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2009b130 con 0x7f8a2015c8f0 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a25c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2009afb0 con 0x7f8a2015c510 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a25c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a200cd760 con 0x7f8a2015d490 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a1e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a2015c8f0 0x7f8a200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a1e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a2015c8f0 0x7f8a200b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44736/0 (socket says 172.21.15.7:44736) 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.646+0000 7f8a1e000640 1 -- 172.21.15.7:0/2212522312 learned_addr learned my addr 172.21.15.7:0/2212522312 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1ea00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015c510 0x7f8a200c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1f400640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015d490 0x7f8a200b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1e000640 1 -- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015d490 msgr2=0x7f8a200b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1e000640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015d490 0x7f8a200b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1e000640 1 -- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015c510 msgr2=0x7f8a200c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1e000640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015c510 0x7f8a200c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1e000640 1 -- 172.21.15.7:0/2212522312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a200b5040 con 0x7f8a2015c8f0 2024-08-19T00:43:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1f400640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015d490 0x7f8a200b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.647+0000 7f8a1e000640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a2015c8f0 0x7f8a200b0070 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c000c00 tx=0x7f8a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.648+0000 7f8a16a00640 1 -- 172.21.15.7:0/2212522312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c037040 con 0x7f8a2015c8f0 2024-08-19T00:43:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.648+0000 7f8a16a00640 1 -- 172.21.15.7:0/2212522312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a0c042070 con 0x7f8a2015c8f0 2024-08-19T00:43:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.648+0000 7f8a16a00640 1 -- 172.21.15.7:0/2212522312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c030880 con 0x7f8a2015c8f0 2024-08-19T00:43:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.648+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2014ce40 con 0x7f8a2015c8f0 2024-08-19T00:43:44.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.648+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2014a520 con 0x7f8a2015c8f0 2024-08-19T00:43:44.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.649+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2009aa70 con 0x7f8a2015c8f0 2024-08-19T00:43:44.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.650+0000 7f8a16a00640 1 -- 172.21.15.7:0/2212522312 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a0c030a20 con 0x7f8a2015c8f0 2024-08-19T00:43:44.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.651+0000 7f8a16a00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a0006be60 0x7f8a0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:44.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.651+0000 7f8a16a00640 1 -- 172.21.15.7:0/2212522312 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f8a0c0ab6a0 con 0x7f8a2015c8f0 2024-08-19T00:43:44.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.651+0000 7f8a1ea00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a0006be60 0x7f8a0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:44.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.651+0000 7f8a1ea00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a0006be60 0x7f8a0006e320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000f60 tx=0x7f8a10007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:44.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.655+0000 7f8a16a00640 1 -- 172.21.15.7:0/2212522312 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8a200b5040 con 0x7f8a2015c8f0 2024-08-19T00:43:44.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.875+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a200d2cb0 con 0x7f8a2015c8f0 2024-08-19T00:43:44.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.876+0000 7f8a16a00640 1 -- 172.21.15.7:0/2212522312 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5219 (secure 0 0 0) 0x7f8a0c07ee20 con 0x7f8a2015c8f0 2024-08-19T00:43:44.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:44.879 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"btime":"2024-08-19T00:43:44:059889+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:44.059863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6502":{"gid":6502,"name":"b","rank":0,"incarnation":90,"state":"up:replay","state_seq":1,"addr":"172.21.15.162:6834/3482189423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3482189423},{"type":"v1","addr":"172.21.15.162:6834","nonce":3482189423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:43:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 90 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a0006be60 msgr2=0x7f8a0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a0006be60 0x7f8a0006e320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000f60 tx=0x7f8a10007cc0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a2015c8f0 msgr2=0x7f8a200b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a2015c8f0 0x7f8a200b0070 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c000c00 tx=0x7f8a0c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 shutdown_connections 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a0006be60 0x7f8a0006e320 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a2015d490 0x7f8a200b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a2015c8f0 0x7f8a200b0070 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 --2- 172.21.15.7:0/2212522312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015c510 0x7f8a200c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 >> 172.21.15.7:0/2212522312 conn(0x7f8a200d2190 msgr2=0x7f8a200d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 shutdown_connections 2024-08-19T00:43:44.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:44.878+0000 7f8a25c00640 1 -- 172.21.15.7:0/2212522312 wait complete. 2024-08-19T00:43:44.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:43:44.059863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6502': {'gid': 6502, 'name': 'b', 'rank': 0, 'incarnation': 90, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.162:6834/3482189423', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6833', 'nonce': 3482189423}, {'type': 'v1', 'addr': '172.21.15.162:6834', 'nonce': 3482189423}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:43:44.896 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6502:up:replay 2024-08-19T00:43:44.896 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:43:49.215 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-08-19T00:43:49.214+0000 7fd7a7c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:43:50.300 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:50.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.466+0000 7f73cd600640 1 Processor -- start 2024-08-19T00:43:50.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.467+0000 7f73cd600640 1 -- start start 2024-08-19T00:43:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73cd600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c815f5b0 0x7f73c80cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73cd600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f73c80d03c0 0x7f73c80d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73cd600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73c80b4380 0x7f73c80b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73cd600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f73c80d0d60 con 0x7f73c80b4380 2024-08-19T00:43:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73cd600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f73c815f990 con 0x7f73c80d03c0 2024-08-19T00:43:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73cd600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73c80cf120 con 0x7f73c815f5b0 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73c7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73c80b4380 0x7f73c80b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73c7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73c80b4380 0x7f73c80b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44746/0 (socket says 172.21.15.7:44746) 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73c7400640 1 -- 172.21.15.7:0/866667703 learned_addr learned my addr 172.21.15.7:0/866667703 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73c6a00640 1 --2- 172.21.15.7:0/866667703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c815f5b0 0x7f73c80cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73be000640 1 --2- 172.21.15.7:0/866667703 >> v2:172.21.15.162:3300/0 conn(0x7f73c80d03c0 0x7f73c80d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73c7400640 1 -- 172.21.15.7:0/866667703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c815f5b0 msgr2=0x7f73c80cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73c7400640 1 --2- 172.21.15.7:0/866667703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c815f5b0 0x7f73c80cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.468+0000 7f73c7400640 1 -- 172.21.15.7:0/866667703 >> v2:172.21.15.162:3300/0 conn(0x7f73c80d03c0 msgr2=0x7f73c80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.469+0000 7f73c7400640 1 --2- 172.21.15.7:0/866667703 >> v2:172.21.15.162:3300/0 conn(0x7f73c80d03c0 0x7f73c80d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.469+0000 7f73c7400640 1 -- 172.21.15.7:0/866667703 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c80cfaf0 con 0x7f73c80b4380 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73c7400640 1 --2- 172.21.15.7:0/866667703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c80b4380 0x7f73c80b4830 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f73c80cdac0 tx=0x7f73c002a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871ca4b4b6924fcf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73c6000640 1 -- 172.21.15.7:0/866667703 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0036070 con 0x7f73c80b4380 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73c6000640 1 -- 172.21.15.7:0/866667703 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c0031600 con 0x7f73c80b4380 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73c6000640 1 -- 172.21.15.7:0/866667703 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c00319d0 con 0x7f73c80b4380 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73cd600640 1 -- 172.21.15.7:0/866667703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c80b4380 msgr2=0x7f73c80b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73cd600640 1 --2- 172.21.15.7:0/866667703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c80b4380 0x7f73c80b4830 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f73c80cdac0 tx=0x7f73c002a600 comp rx=0 tx=0).stop 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73cd600640 1 -- 172.21.15.7:0/866667703 shutdown_connections 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73cd600640 1 --2- 172.21.15.7:0/866667703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c80b4380 0x7f73c80b4830 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73cd600640 1 --2- 172.21.15.7:0/866667703 >> v2:172.21.15.162:3300/0 conn(0x7f73c80d03c0 0x7f73c80d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73cd600640 1 --2- 172.21.15.7:0/866667703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c815f5b0 0x7f73c80cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.470+0000 7f73cd600640 1 -- 172.21.15.7:0/866667703 >> 172.21.15.7:0/866667703 conn(0x7f73c806bc70 msgr2=0x7f73c806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.471+0000 7f73cd600640 1 -- 172.21.15.7:0/866667703 shutdown_connections 2024-08-19T00:43:50.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.471+0000 7f73cd600640 1 -- 172.21.15.7:0/866667703 wait complete. 2024-08-19T00:43:50.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.472+0000 7f73cd600640 1 Processor -- start 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.472+0000 7f73cd600640 1 -- start start 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.473+0000 7f73cd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c80b4380 0x7f73c81586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.473+0000 7f73cd600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c80d03c0 0x7f73c809a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.473+0000 7f73cd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c815f5b0 0x7f73c80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.473+0000 7f73cd600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73c80cedb0 con 0x7f73c815f5b0 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.473+0000 7f73cd600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73c80cead0 con 0x7f73c80b4380 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.473+0000 7f73cd600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73c80b4d70 con 0x7f73c80d03c0 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.473+0000 7f73c7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c815f5b0 0x7f73c80ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c815f5b0 0x7f73c80ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44750/0 (socket says 172.21.15.7:44750) 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 -- 172.21.15.7:0/2969690410 learned_addr learned my addr 172.21.15.7:0/2969690410 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c6a00640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c80b4380 0x7f73c81586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73be000640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c80d03c0 0x7f73c809a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 -- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c80d03c0 msgr2=0x7f73c809a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c80d03c0 0x7f73c809a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 -- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c80b4380 msgr2=0x7f73c81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c80b4380 0x7f73c81586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 -- 172.21.15.7:0/2969690410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c809a9c0 con 0x7f73c815f5b0 2024-08-19T00:43:50.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73be000640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c80d03c0 0x7f73c809a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:50.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.474+0000 7f73c7400640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c815f5b0 0x7f73c80ae220 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f73c0034040 tx=0x7f73c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.475+0000 7f73bf400640 1 -- 172.21.15.7:0/2969690410 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0036050 con 0x7f73c815f5b0 2024-08-19T00:43:50.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.475+0000 7f73bf400640 1 -- 172.21.15.7:0/2969690410 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c0042070 con 0x7f73c815f5b0 2024-08-19T00:43:50.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.475+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c809d0e0 con 0x7f73c815f5b0 2024-08-19T00:43:50.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.475+0000 7f73bf400640 1 -- 172.21.15.7:0/2969690410 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0009510 con 0x7f73c815f5b0 2024-08-19T00:43:50.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.475+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c809d6a0 con 0x7f73c815f5b0 2024-08-19T00:43:50.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.476+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c80d0820 con 0x7f73c815f5b0 2024-08-19T00:43:50.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.477+0000 7f73bf400640 1 -- 172.21.15.7:0/2969690410 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73c0007bd0 con 0x7f73c815f5b0 2024-08-19T00:43:50.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.478+0000 7f73bf400640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f73a406be30 0x7f73a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.478+0000 7f73bf400640 1 -- 172.21.15.7:0/2969690410 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f73c00abd30 con 0x7f73c815f5b0 2024-08-19T00:43:50.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.478+0000 7f73c6a00640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f73a406be30 0x7f73a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.479+0000 7f73c6a00640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f73a406be30 0x7f73a406e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f73b8007920 tx=0x7f73b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.482+0000 7f73bf400640 1 -- 172.21.15.7:0/2969690410 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f73c002ae20 con 0x7f73c815f5b0 2024-08-19T00:43:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.704+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73c815d360 con 0x7f73c815f5b0 2024-08-19T00:43:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.704+0000 7f73bf400640 1 -- 172.21.15.7:0/2969690410 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5226 (secure 0 0 0) 0x7f73c007a5e0 con 0x7f73c815f5b0 2024-08-19T00:43:50.707 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:50.707 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"btime":"2024-08-19T00:43:47:071375+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:47.071366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6502":{"gid":6502,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6834/3482189423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3482189423},{"type":"v1","addr":"172.21.15.162:6834","nonce":3482189423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6502,"qdb_cluster":[6502]},"id":6}]} 2024-08-19T00:43:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 93 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f73a406be30 msgr2=0x7f73a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f73a406be30 0x7f73a406e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f73b8007920 tx=0x7f73b8008040 comp rx=0 tx=0).stop 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c815f5b0 msgr2=0x7f73c80ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c815f5b0 0x7f73c80ae220 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f73c0034040 tx=0x7f73c0004a40 comp rx=0 tx=0).stop 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 shutdown_connections 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f73a406be30 0x7f73a406e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73c815f5b0 0x7f73c80ae220 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73c80d03c0 0x7f73c809a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 --2- 172.21.15.7:0/2969690410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c80b4380 0x7f73c81586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 >> 172.21.15.7:0/2969690410 conn(0x7f73c806bc70 msgr2=0x7f73c815db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 shutdown_connections 2024-08-19T00:43:50.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.707+0000 7f73cd600640 1 -- 172.21.15.7:0/2969690410 wait complete. 2024-08-19T00:43:50.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:43:47.071366+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 87, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6502': {'gid': 6502, 'name': 'b', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.162:6834/3482189423', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6833', 'nonce': 3482189423}, {'type': 'v1', 'addr': '172.21.15.162:6834', 'nonce': 3482189423}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6502, 'qdb_cluster': [6502]} 2024-08-19T00:43:50.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:43:50.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-19T00:43:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.880+0000 7f67f2e00640 1 Processor -- start 2024-08-19T00:43:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.880+0000 7f67f2e00640 1 -- start start 2024-08-19T00:43:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67f2e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f67ec159bf0 0x7f67ec073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67f2e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f67ec0739a0 0x7f67ec0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67f2e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec0cea40 0x7f67ec0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67f2e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f67ec06f7f0 con 0x7f67ec159bf0 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67f2e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f67ec06f510 con 0x7f67ec0739a0 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67f2e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec072980 con 0x7f67ec0cea40 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67ebe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f67ec159bf0 0x7f67ec073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67ebe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f67ec159bf0 0x7f67ec073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44756/0 (socket says 172.21.15.7:44756) 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67ebe00640 1 -- 172.21.15.7:0/2862022892 learned_addr learned my addr 172.21.15.7:0/2862022892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67f0e00640 1 --2- 172.21.15.7:0/2862022892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec0cea40 0x7f67ec0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.881+0000 7f67e3400640 1 --2- 172.21.15.7:0/2862022892 >> v2:172.21.15.162:3300/0 conn(0x7f67ec0739a0 0x7f67ec0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.882+0000 7f67ebe00640 1 -- 172.21.15.7:0/2862022892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec0cea40 msgr2=0x7f67ec0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.882+0000 7f67ebe00640 1 --2- 172.21.15.7:0/2862022892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec0cea40 0x7f67ec0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.882+0000 7f67ebe00640 1 -- 172.21.15.7:0/2862022892 >> v2:172.21.15.162:3300/0 conn(0x7f67ec0739a0 msgr2=0x7f67ec0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.882+0000 7f67ebe00640 1 --2- 172.21.15.7:0/2862022892 >> v2:172.21.15.162:3300/0 conn(0x7f67ec0739a0 0x7f67ec0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.882+0000 7f67ebe00640 1 -- 172.21.15.7:0/2862022892 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec072c60 con 0x7f67ec159bf0 2024-08-19T00:43:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.882+0000 7f67f0e00640 1 --2- 172.21.15.7:0/2862022892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec0cea40 0x7f67ec0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.882+0000 7f67e3400640 1 --2- 172.21.15.7:0/2862022892 >> v2:172.21.15.162:3300/0 conn(0x7f67ec0739a0 0x7f67ec0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.883+0000 7f67ebe00640 1 --2- 172.21.15.7:0/2862022892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec159bf0 0x7f67ec073460 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0b1cc0 tx=0x7f67dc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6739e37376218c04 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.883+0000 7f67eb400640 1 -- 172.21.15.7:0/2862022892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc037070 con 0x7f67ec159bf0 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.883+0000 7f67eb400640 1 -- 172.21.15.7:0/2862022892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc032440 con 0x7f67ec159bf0 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.883+0000 7f67eb400640 1 -- 172.21.15.7:0/2862022892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc032810 con 0x7f67ec159bf0 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.883+0000 7f67f2e00640 1 -- 172.21.15.7:0/2862022892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec159bf0 msgr2=0x7f67ec073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.883+0000 7f67f2e00640 1 --2- 172.21.15.7:0/2862022892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec159bf0 0x7f67ec073460 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0b1cc0 tx=0x7f67dc02a140 comp rx=0 tx=0).stop 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.884+0000 7f67f2e00640 1 -- 172.21.15.7:0/2862022892 shutdown_connections 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.884+0000 7f67f2e00640 1 --2- 172.21.15.7:0/2862022892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec0cea40 0x7f67ec0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.884+0000 7f67f2e00640 1 --2- 172.21.15.7:0/2862022892 >> v2:172.21.15.162:3300/0 conn(0x7f67ec0739a0 0x7f67ec0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.884+0000 7f67f2e00640 1 --2- 172.21.15.7:0/2862022892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec159bf0 0x7f67ec073460 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.884+0000 7f67f2e00640 1 -- 172.21.15.7:0/2862022892 >> 172.21.15.7:0/2862022892 conn(0x7f67ec06bc70 msgr2=0x7f67ec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.884+0000 7f67f2e00640 1 -- 172.21.15.7:0/2862022892 shutdown_connections 2024-08-19T00:43:50.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.884+0000 7f67f2e00640 1 -- 172.21.15.7:0/2862022892 wait complete. 2024-08-19T00:43:50.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.885+0000 7f67f2e00640 1 Processor -- start 2024-08-19T00:43:50.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.885+0000 7f67f2e00640 1 -- start start 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.886+0000 7f67f2e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec0739a0 0x7f67ec150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.886+0000 7f67f2e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67ec0cea40 0x7f67ec09d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.886+0000 7f67f2e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec159bf0 0x7f67ec15e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.886+0000 7f67f2e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec15a150 con 0x7f67ec0739a0 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.886+0000 7f67f2e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec159fd0 con 0x7f67ec0cea40 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.886+0000 7f67f2e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec0d0900 con 0x7f67ec159bf0 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec0739a0 0x7f67ec150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec0739a0 0x7f67ec150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44764/0 (socket says 172.21.15.7:44764) 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 -- 172.21.15.7:0/3995922202 learned_addr learned my addr 172.21.15.7:0/3995922202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67e3400640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67ec0cea40 0x7f67ec09d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67f0e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec159bf0 0x7f67ec15e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 -- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec159bf0 msgr2=0x7f67ec15e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec159bf0 0x7f67ec15e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 -- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67ec0cea40 msgr2=0x7f67ec09d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67ec0cea40 0x7f67ec09d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 -- 172.21.15.7:0/3995922202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec1507a0 con 0x7f67ec0739a0 2024-08-19T00:43:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67f0e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec159bf0 0x7f67ec15e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.887+0000 7f67ebe00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec0739a0 0x7f67ec150260 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02a180 tx=0x7f67dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.888+0000 7f67e8c00640 1 -- 172.21.15.7:0/3995922202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc041020 con 0x7f67ec0739a0 2024-08-19T00:43:50.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.888+0000 7f67e8c00640 1 -- 172.21.15.7:0/3995922202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc0306c0 con 0x7f67ec0739a0 2024-08-19T00:43:50.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.888+0000 7f67e8c00640 1 -- 172.21.15.7:0/3995922202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc037040 con 0x7f67ec0739a0 2024-08-19T00:43:50.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.888+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec151f20 con 0x7f67ec0739a0 2024-08-19T00:43:50.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.888+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec1524e0 con 0x7f67ec0739a0 2024-08-19T00:43:50.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.891+0000 7f67e8c00640 1 -- 172.21.15.7:0/3995922202 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67dc044020 con 0x7f67ec0739a0 2024-08-19T00:43:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.891+0000 7f67e8c00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67c806be30 0x7f67c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.892+0000 7f67e8c00640 1 -- 172.21.15.7:0/3995922202 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f67dc0ab630 con 0x7f67ec0739a0 2024-08-19T00:43:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.892+0000 7f67e3400640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67c806be30 0x7f67c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.892+0000 7f67f5cda740 1 Processor -- start 2024-08-19T00:43:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.892+0000 7f67f5cda740 1 -- start start 2024-08-19T00:43:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67e3400640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67c806be30 0x7f67c806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f67ec15f510 tx=0x7f67d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf385f50 0x5629cf386330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf39edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67f5cda740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629cf2beba0 con 0x5629cf3a9dd0 2024-08-19T00:43:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5629cf257230 con 0x5629cf385f50 2024-08-19T00:43:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5629cf2bab60 con 0x5629cf3a9470 2024-08-19T00:43:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.893+0000 7f67f0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf39edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf39edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44770/0 (socket says 172.21.15.7:44770) 2024-08-19T00:43:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 -- 172.21.15.7:0/923629739 learned_addr learned my addr 172.21.15.7:0/923629739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67e3400640 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67ebe00640 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf385f50 0x5629cf386330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 -- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 msgr2=0x5629cf3a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 -- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf385f50 msgr2=0x5629cf386330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf385f50 0x5629cf386330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 -- 172.21.15.7:0/923629739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629cf288bb0 con 0x5629cf3a9dd0 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67f0e00640 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf39edf0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009bb0 tx=0x7f67e4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87c9423b3d45ae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67e0c00640 1 -- 172.21.15.7:0/923629739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4013780 con 0x5629cf3a9dd0 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67e0c00640 1 -- 172.21.15.7:0/923629739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e4019070 con 0x5629cf3a9dd0 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.894+0000 7f67e0c00640 1 -- 172.21.15.7:0/923629739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4013b60 con 0x5629cf3a9dd0 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 -- 172.21.15.7:0/923629739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 msgr2=0x5629cf39edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf39edf0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009bb0 tx=0x7f67e4004410 comp rx=0 tx=0).stop 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 -- 172.21.15.7:0/923629739 shutdown_connections 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf39edf0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 --2- 172.21.15.7:0/923629739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf385f50 0x5629cf386330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 -- 172.21.15.7:0/923629739 >> 172.21.15.7:0/923629739 conn(0x5629cf323110 msgr2=0x5629cf3a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 -- 172.21.15.7:0/923629739 shutdown_connections 2024-08-19T00:43:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.895+0000 7f67f5cda740 1 -- 172.21.15.7:0/923629739 wait complete. 2024-08-19T00:43:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.896+0000 7f67f5cda740 1 -- start start 2024-08-19T00:43:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.896+0000 7f67f5cda740 1 Processor -- start 2024-08-19T00:43:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf355d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3775b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf357420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67f5cda740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629cf3a2ea0 con 0x5629cf385f50 2024-08-19T00:43:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5629cf27a250 con 0x5629cf3a9dd0 2024-08-19T00:43:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5629cf3a25b0 con 0x5629cf3a9470 2024-08-19T00:43:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67f5cda740 10 client.0 _ll_register_callbacks cb 0x5629cf27e740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.897+0000 7f67ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf355d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67e3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67f0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf357420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf355d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44784/0 (socket says 172.21.15.7:44784) 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 -- 172.21.15.7:0/1654430270 learned_addr learned my addr 172.21.15.7:0/1654430270 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 -- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 msgr2=0x5629cf3775b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3775b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 -- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 msgr2=0x5629cf357420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf357420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 -- 172.21.15.7:0/1654430270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629cefd22d0 con 0x5629cf385f50 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67ebe00640 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf355d40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f67dc000c00 tx=0x7f67dc07a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64e382c195e7f17 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67d9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67d9600640 1 -- 172.21.15.7:0/1654430270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc082450 con 0x5629cf385f50 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67d9600640 1 -- 172.21.15.7:0/1654430270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f67dc081fc0 con 0x5629cf385f50 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.898+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67e4019070 con 0x5629cf385f50 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67d9600640 1 -- 172.21.15.7:0/1654430270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f67dc0821c0 con 0x5629cf385f50 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 10 client.7455 fetch_fsmap learned FSMap version 93 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5629cf09c6b0 con 0x5629cf385f50 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67d9600640 1 -- 172.21.15.7:0/1654430270 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e4019070 con 0x5629cf385f50 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67d9600640 1 -- 172.21.15.7:0/1654430270 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f67dc03a030 con 0x5629cf385f50 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 10 client.7455 fetch_fsmap finished waiting for FSMap version 93 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 10 client.7455 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 20 client.7455 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf3bc040 0x5629cf3be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 4 client.7455 mds_command: new command op to 6502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:43:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 --> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629cf2cc2d0 con 0x5629cf3bc040 2024-08-19T00:43:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.899+0000 7f67e3400640 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf3bc040 0x5629cf3be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.900+0000 7f67e3400640 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf3bc040 0x5629cf3be430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24cace966a57a5c server_cookie=b3021e69d42fcd73 in_seq=0 out_seq=0 2024-08-19T00:43:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.900+0000 7f67d9600640 10 client.7455 ms_handle_connect on v2:172.21.15.162:6833/3482189423 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.901+0000 7f67d9600640 1 -- 172.21.15.7:0/1654430270 <== mds.0 v2:172.21.15.162:6833/3482189423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629cf2cc2d0 con 0x5629cf3bc040 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.901+0000 7f67d9600640 10 client.7455 handle_command_reply: tid=0 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.901+0000 7f67f5cda740 1 client.7455 shutdown 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 msgr2=0x5629cf355d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf355d40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f67dc000c00 tx=0x7f67dc07a030 comp rx=0 tx=0).stop 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 shutdown_connections 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf3bc040 0x5629cf3be430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf357420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf3775b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1654430270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf355d40 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67d9600640 0 client.7455 ms_handle_reset on v2:172.21.15.162:6833/3482189423 2024-08-19T00:43:50.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 >> 172.21.15.7:0/1654430270 conn(0x5629cf323110 msgr2=0x5629cf3a0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 shutdown_connections 2024-08-19T00:43:50.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 1 -- 172.21.15.7:0/1654430270 wait complete. 2024-08-19T00:43:50.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.902+0000 7f67f5cda740 20 client.7455 trim_cache size 0 max 16384 2024-08-19T00:43:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.920+0000 7f67f5cda740 1 Processor -- start 2024-08-19T00:43:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.921+0000 7f67f5cda740 1 -- start start 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.921+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf3797b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.921+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf379cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.921+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf415e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.921+0000 7f67f5cda740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1ffc60 con 0x5629cf385f50 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.921+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1573e0 con 0x5629cf3a9dd0 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.921+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec157a30 con 0x5629cf3a9470 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf3797b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf3797b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44792/0 (socket says 172.21.15.7:44792) 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 -- 172.21.15.7:0/1934683633 learned_addr learned my addr 172.21.15.7:0/1934683633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67e3400640 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf379cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67f0e00640 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf415e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 -- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 msgr2=0x5629cf379cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf379cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 -- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 msgr2=0x5629cf415e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf415e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 -- 172.21.15.7:0/1934683633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629cf359ba0 con 0x5629cf385f50 2024-08-19T00:43:50.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.922+0000 7f67ebe00640 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf3797b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0796f0 tx=0x7f67dc03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335a64a619a3455 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67dbe00640 1 -- 172.21.15.7:0/1934683633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc082450 con 0x5629cf385f50 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67dbe00640 1 -- 172.21.15.7:0/1934683633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc07ace0 con 0x5629cf385f50 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67dbe00640 1 -- 172.21.15.7:0/1934683633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc078cc0 con 0x5629cf385f50 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 -- 172.21.15.7:0/1934683633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 msgr2=0x5629cf3797b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf3797b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0796f0 tx=0x7f67dc03f000 comp rx=0 tx=0).stop 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 -- 172.21.15.7:0/1934683633 shutdown_connections 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9dd0 0x5629cf415e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf3a9470 0x5629cf379cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 --2- 172.21.15.7:0/1934683633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf385f50 0x5629cf3797b0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 -- 172.21.15.7:0/1934683633 >> 172.21.15.7:0/1934683633 conn(0x5629cf323110 msgr2=0x5629cf357250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 -- 172.21.15.7:0/1934683633 shutdown_connections 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.923+0000 7f67f5cda740 1 -- 172.21.15.7:0/1934683633 wait complete. 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.924+0000 7f67f5cda740 1 -- start start 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.924+0000 7f67f5cda740 1 Processor -- start 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf385f50 0x5629cf3b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9470 0x5629cf405310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f5cda740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf381ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f5cda740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629cf356ee0 con 0x5629cf3a9dd0 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5629cf3569b0 con 0x5629cf3a9470 2024-08-19T00:43:50.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f5cda740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5629cf3b3eb0 con 0x5629cf385f50 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f5cda740 10 client.0 _ll_register_callbacks cb 0x7f67dc0791d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf381ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf381ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44798/0 (socket says 172.21.15.7:44798) 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67f0e00640 1 -- 172.21.15.7:0/745631622 learned_addr learned my addr 172.21.15.7:0/745631622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67e3400640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9470 0x5629cf405310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.925+0000 7f67ebe00640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf385f50 0x5629cf3b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67f0e00640 1 -- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf385f50 msgr2=0x5629cf3b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67f0e00640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf385f50 0x5629cf3b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67f0e00640 1 -- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9470 msgr2=0x5629cf405310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67f0e00640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9470 0x5629cf405310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67f0e00640 1 -- 172.21.15.7:0/745631622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629cf37cf60 con 0x5629cf3a9dd0 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67ebe00640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf385f50 0x5629cf3b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67f0e00640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf381ed0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f67e4015000 tx=0x7f67e4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682ee6361d5d9f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67d9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:43:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67d9600640 1 -- 172.21.15.7:0/745631622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e402e060 con 0x5629cf3a9dd0 2024-08-19T00:43:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67dc07ace0 con 0x5629cf3a9dd0 2024-08-19T00:43:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.926+0000 7f67d9600640 1 -- 172.21.15.7:0/745631622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f67e4013da0 con 0x5629cf3a9dd0 2024-08-19T00:43:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67d9600640 1 -- 172.21.15.7:0/745631622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f67e4034050 con 0x5629cf3a9dd0 2024-08-19T00:43:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 10 client.7461 fetch_fsmap learned FSMap version 93 2024-08-19T00:43:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5629cf382930 con 0x5629cf3a9dd0 2024-08-19T00:43:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67d9600640 1 -- 172.21.15.7:0/745631622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc07ace0 con 0x5629cf3a9dd0 2024-08-19T00:43:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67d9600640 1 -- 172.21.15.7:0/745631622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f67e4037020 con 0x5629cf3a9dd0 2024-08-19T00:43:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 10 client.7461 fetch_fsmap finished waiting for FSMap version 93 2024-08-19T00:43:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 10 client.7461 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:43:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 20 client.7461 populate_metadata read hostname 'smithi007' 2024-08-19T00:43:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf379ca0 0x5629cf35bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 4 client.7461 mds_command: new command op to 6502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.927+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 --> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] -- command(tid 0: {"prefix": "status"}) -- 0x5629cf2c6620 con 0x5629cf379ca0 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.928+0000 7f67ebe00640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf379ca0 0x5629cf35bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.928+0000 7f67ebe00640 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf379ca0 0x5629cf35bf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55e25ae527f2d3e3 server_cookie=f12228cc2ec3f872 in_seq=0 out_seq=0 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.928+0000 7f67d9600640 10 client.7461 ms_handle_connect on v2:172.21.15.162:6833/3482189423 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.928+0000 7f67d9600640 1 -- 172.21.15.7:0/745631622 <== mds.0 v2:172.21.15.162:6833/3482189423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5629cf2c6620 con 0x5629cf379ca0 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.928+0000 7f67d9600640 10 client.7461 handle_command_reply: tid=0 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.928+0000 7f67f5cda740 1 client.7461 shutdown 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 msgr2=0x5629cf381ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf381ed0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f67e4015000 tx=0x7f67e4004ab0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 shutdown_connections 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:6833/3482189423,v1:172.21.15.162:6834/3482189423] conn(0x5629cf379ca0 0x5629cf35bf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629cf3a9dd0 0x5629cf381ed0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629cf3a9470 0x5629cf405310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 --2- 172.21.15.7:0/745631622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5629cf385f50 0x5629cf3b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67d9600640 0 client.7461 ms_handle_reset on v2:172.21.15.162:6833/3482189423 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 >> 172.21.15.7:0/745631622 conn(0x5629cf323110 msgr2=0x5629cf39eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 shutdown_connections 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 1 -- 172.21.15.7:0/745631622 wait complete. 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.929+0000 7f67f5cda740 20 client.7461 trim_cache size 0 max 16384 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6502, 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8679402830000003, 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 93, 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 87, 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 87, 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 28.388268930999999 2024-08-19T00:43:50.937 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67c806be30 msgr2=0x7f67c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67c806be30 0x7f67c806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f67ec15f510 tx=0x7f67d4008040 comp rx=0 tx=0).stop 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec0739a0 msgr2=0x7f67ec150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec0739a0 0x7f67ec150260 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02a180 tx=0x7f67dc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 shutdown_connections 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f67c806be30 0x7f67c806e2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67ec159bf0 0x7f67ec15e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67ec0cea40 0x7f67ec09d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 --2- 172.21.15.7:0/3995922202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67ec0739a0 0x7f67ec150260 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 >> 172.21.15.7:0/3995922202 conn(0x7f67ec06bc70 msgr2=0x7f67ec15a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 shutdown_connections 2024-08-19T00:43:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:50.930+0000 7f67f2e00640 1 -- 172.21.15.7:0/3995922202 wait complete. 2024-08-19T00:43:50.949 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:43:50.949 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 10000000000.00000000', proceeding to ls 2024-08-19T00:43:50.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:43:51.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.103+0000 7f7b04600640 1 Processor -- start 2024-08-19T00:43:51.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.103+0000 7f7b04600640 1 -- start start 2024-08-19T00:43:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.104+0000 7f7b04600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 0x7f7afc06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.104+0000 7f7b04600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7afc15ec30 con 0x7f7afc0d0290 2024-08-19T00:43:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.104+0000 7f7b04600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7afc15ef10 con 0x7f7afc09aa70 2024-08-19T00:43:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.104+0000 7f7b04600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc15f1f0 con 0x7f7afc09b730 2024-08-19T00:43:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7b02600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7afc0d0290 0x7f7afc0d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34630/0 (socket says 172.21.15.7:34630) 2024-08-19T00:43:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7b02600640 1 -- 172.21.15.7:0/1326372333 learned_addr learned my addr 172.21.15.7:0/1326372333 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7b01200640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 0x7f7afc06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052019470 0 0) 0x7f7afc15ec30 con 0x7f7afc0d0290 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ae4003520 con 0x7f7afc0d0290 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102489543 0 0) 0x7f7afc15ef10 con 0x7f7afc09aa70 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7afc15ec30 con 0x7f7afc09aa70 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1219159432 0 0) 0x7f7ae4003520 con 0x7f7afc0d0290 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 msgr2=0x7f7afc06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 0x7f7afc06fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 >> v1:172.21.15.162:6789/0 conn(0x7f7afc09aa70 legacy=0x7f7afc09ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc15f4d0 con 0x7f7afc0d0290 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f7af40019f0 con 0x7f7afc0d0290 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7b01200640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 0x7f7afc06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 >> v1:172.21.15.7:6789/0 conn(0x7f7afc0d0290 legacy=0x7f7afc0d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.105+0000 7f7afbe00640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 0x7f7ae4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7afbe00640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ae4004100 0x7f7ae4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7afbe00640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae4004d40 0x7f7ae40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc15f1f0 con 0x7f7ae4004100 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae400bad0 con 0x7f7ae4004d40 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae400bcd0 con 0x7f7afc09b730 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b01200640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ae4004100 0x7f7ae4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b01c00640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 0x7f7ae4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b02600640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae4004d40 0x7f7ae40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b01200640 1 -- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 msgr2=0x7f7ae4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b01200640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc09b730 0x7f7ae4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b01200640 1 -- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae4004d40 msgr2=0x7f7ae40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b01200640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae4004d40 0x7f7ae40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b01200640 1 -- 172.21.15.7:0/1326372333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae4003520 con 0x7f7ae4004100 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.106+0000 7f7b02600640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae4004d40 0x7f7ae40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.107+0000 7f7b01200640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ae4004100 0x7f7ae4004800 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7afc071bd0 tx=0x7f7ae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fed98dcafe85dd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.107+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8036070 con 0x7f7ae4004100 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.107+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae8031400 con 0x7f7ae4004100 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.107+0000 7f7afbe00640 1 -- 172.21.15.7:0/1326372333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8009840 con 0x7f7ae4004100 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.108+0000 7f7b04600640 1 -- 172.21.15.7:0/1326372333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ae4004100 msgr2=0x7f7ae4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.108+0000 7f7b04600640 1 --2- 172.21.15.7:0/1326372333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ae4004100 0x7f7ae4004800 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7afc071bd0 tx=0x7f7ae4005830 comp rx=0 tx=0).stop 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.108+0000 7f7b02600640 1 -- 172.21.15.7:0/1326372333 reap_dead start 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.108+0000 7f7b04600640 1 -- 172.21.15.7:0/1326372333 shutdown_connections 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.108+0000 7f7b04600640 1 -- 172.21.15.7:0/1326372333 >> 172.21.15.7:0/1326372333 conn(0x7f7afc0d2190 msgr2=0x7f7afc0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.108+0000 7f7b04600640 1 -- 172.21.15.7:0/1326372333 shutdown_connections 2024-08-19T00:43:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.108+0000 7f7b04600640 1 -- 172.21.15.7:0/1326372333 wait complete. 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.110+0000 7f7b04600640 1 Processor -- start 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.110+0000 7f7b04600640 1 -- start start 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b04600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae4004100 0x7f7afc0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b04600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0b6c70 0x7f7afc15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b04600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0cd5d0 0x7f7afc0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b04600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc06fdb0 con 0x7f7afc0b6c70 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b04600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc06fc30 con 0x7f7afc0cd5d0 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b04600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc06ff30 con 0x7f7ae4004100 2024-08-19T00:43:51.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b01200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0b6c70 0x7f7afc15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b01200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0b6c70 0x7f7afc15c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44822/0 (socket says 172.21.15.7:44822) 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b01200640 1 -- 172.21.15.7:0/3158926298 learned_addr learned my addr 172.21.15.7:0/3158926298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b01c00640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae4004100 0x7f7afc0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.111+0000 7f7b02600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0cd5d0 0x7f7afc0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7b01200640 1 -- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae4004100 msgr2=0x7f7afc0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7b01200640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae4004100 0x7f7afc0b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7b01200640 1 -- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0cd5d0 msgr2=0x7f7afc0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7b01200640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0cd5d0 0x7f7afc0cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7b01200640 1 -- 172.21.15.7:0/3158926298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc15cd60 con 0x7f7afc0b6c70 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7b01200640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0b6c70 0x7f7afc15c280 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8034040 tx=0x7f7ae8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7af9600640 1 -- 172.21.15.7:0/3158926298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8040070 con 0x7f7afc0b6c70 2024-08-19T00:43:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7af9600640 1 -- 172.21.15.7:0/3158926298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae80093e0 con 0x7f7afc0b6c70 2024-08-19T00:43:51.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7af9600640 1 -- 172.21.15.7:0/3158926298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8036040 con 0x7f7afc0b6c70 2024-08-19T00:43:51.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.112+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc0b5710 con 0x7f7afc0b6c70 2024-08-19T00:43:51.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.113+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc0b71e0 con 0x7f7afc0b6c70 2024-08-19T00:43:51.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.114+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc09ae50 con 0x7f7afc0b6c70 2024-08-19T00:43:51.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.115+0000 7f7af9600640 1 -- 172.21.15.7:0/3158926298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ae8043070 con 0x7f7afc0b6c70 2024-08-19T00:43:51.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.116+0000 7f7af9600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7adc06be30 0x7f7adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:51.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.116+0000 7f7af9600640 1 -- 172.21.15.7:0/3158926298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f7ae80ab400 con 0x7f7afc0b6c70 2024-08-19T00:43:51.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.116+0000 7f7b01c00640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7adc06be30 0x7f7adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:51.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.117+0000 7f7b01c00640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7adc06be30 0x7f7adc06e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7af0001940 tx=0x7f7af0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:51.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.120+0000 7f7af9600640 1 -- 172.21.15.7:0/3158926298 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7afc15cd60 con 0x7f7afc0b6c70 2024-08-19T00:43:51.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.344+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7afc0d2cb0 con 0x7f7afc0b6c70 2024-08-19T00:43:51.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.344+0000 7f7af9600640 1 -- 172.21.15.7:0/3158926298 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) ==== 53+0+73 (secure 0 0 0) 0x7f7ae8031e20 con 0x7f7afc0b6c70 2024-08-19T00:43:51.347 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:43:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.346+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7adc06be30 msgr2=0x7f7adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.346+0000 7f7b04600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7adc06be30 0x7f7adc06e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7af0001940 tx=0x7f7af0009040 comp rx=0 tx=0).stop 2024-08-19T00:43:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.346+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0b6c70 msgr2=0x7f7afc15c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.346+0000 7f7b04600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0b6c70 0x7f7afc15c280 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8034040 tx=0x7f7ae8004730 comp rx=0 tx=0).stop 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 shutdown_connections 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7adc06be30 0x7f7adc06e2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0cd5d0 0x7f7afc0cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0b6c70 0x7f7afc15c280 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 --2- 172.21.15.7:0/3158926298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae4004100 0x7f7afc0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 >> 172.21.15.7:0/3158926298 conn(0x7f7afc0d2190 msgr2=0x7f7afc06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 shutdown_connections 2024-08-19T00:43:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51.347+0000 7f7b04600640 1 -- 172.21.15.7:0/3158926298 wait complete. 2024-08-19T00:43:51.365 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:43:51.366 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:43:51.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:51.367 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:43:51.403 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42430sec preferred_lft 42430sec 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:43:51.404 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:43:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:43:51.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:51.406 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:43:51.497 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:43:51.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:51.500 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:43:51.536 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:43:51.536 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:43:51.536 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:43:51.536 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:43:51.536 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:43:51.537 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:43:51.537 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:43:51.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:43:51.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:43:51.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:43:51.537 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:43:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:43:51.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:43:51.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:51.736 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:43:51.771 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:43:51.771 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:43:51.771 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:43:51.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:51.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:43:51.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:43:51.868 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:51.903 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:43:51.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:43:51.903 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:51.978 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:43:51.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:51.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:52.108 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:52.108 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:43:52.108 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:43:52.124 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:52.124 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:43:52.124 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:43:52.124 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:43:52.124 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:43:52.149 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:43:52.149 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:43:52.149 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:43:52.149 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:43:52.149 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:43:52.150 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:43:52.150 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:43:52.150 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:43:52.151 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:43:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:43:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:43:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:43:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:43:52.154 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:43:52.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:52.154 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:43:52.210 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:43:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:43:52.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:43:52.301 INFO:teuthology.orchestra.run.smithi007.stdout:client7084 2024-08-19T00:43:52.301 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:52.301 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:52.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:52.337 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:43:52.380 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:43:52.413 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-08-19T00:43:52.412+0000 7fd7a2c00640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/subdir) 2024-08-19T00:43:52.414 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:43:52.414 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:43:52.414 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:52.414 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:43:52.415 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 10000000000.00000000' did not caused DAMAGED state 2024-08-19T00:43:52.415 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 600.00000000' 2024-08-19T00:43:52.415 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:52.416 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:52.491 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:43:52.491 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:43:52.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:43:52.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.763+0000 7f083ce00640 1 Processor -- start 2024-08-19T00:43:52.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.764+0000 7f083ce00640 1 -- start start 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f083ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0838159bf0 0x7f0838073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f083ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08380cec10 0x7f08380d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f083ce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083806f7f0 con 0x7f08380739a0 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f083ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f083806f510 con 0x7f08380cec10 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f083ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0838072980 con 0x7f0838159bf0 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f0836800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08380cec10 0x7f08380d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f082d400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f08380739a0 0x7f08380ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34632/0 (socket says 172.21.15.7:34632) 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f082d400640 1 -- 172.21.15.7:0/1379711944 learned_addr learned my addr 172.21.15.7:0/1379711944 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:52.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.765+0000 7f0835e00640 1 --2- 172.21.15.7:0/1379711944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0838159bf0 0x7f0838073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.766+0000 7f0835400640 1 -- 172.21.15.7:0/1379711944 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775053537 0 0) 0x7f083806f7f0 con 0x7f08380739a0 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.766+0000 7f0835400640 1 -- 172.21.15.7:0/1379711944 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f081c003520 con 0x7f08380739a0 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.766+0000 7f0836800640 1 -- 172.21.15.7:0/1379711944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0838159bf0 msgr2=0x7f0838073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.766+0000 7f0836800640 1 --2- 172.21.15.7:0/1379711944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0838159bf0 0x7f0838073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.766+0000 7f0836800640 1 -- 172.21.15.7:0/1379711944 >> v1:172.21.15.7:6789/0 conn(0x7f08380739a0 legacy=0x7f08380ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.766+0000 7f0836800640 1 -- 172.21.15.7:0/1379711944 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0838072c60 con 0x7f08380cec10 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.766+0000 7f0835e00640 1 --2- 172.21.15.7:0/1379711944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0838159bf0 0x7f0838073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.767+0000 7f0836800640 1 --2- 172.21.15.7:0/1379711944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08380cec10 0x7f08380d03c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0830009d90 tx=0x7f083002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade75487a522853d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.767+0000 7f0835400640 1 -- 172.21.15.7:0/1379711944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830031600 con 0x7f08380cec10 2024-08-19T00:43:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.767+0000 7f0835400640 1 -- 172.21.15.7:0/1379711944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08300317a0 con 0x7f08380cec10 2024-08-19T00:43:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.767+0000 7f0835400640 1 -- 172.21.15.7:0/1379711944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830031b70 con 0x7f08380cec10 2024-08-19T00:43:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 -- 172.21.15.7:0/1379711944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08380cec10 msgr2=0x7f08380d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 --2- 172.21.15.7:0/1379711944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08380cec10 0x7f08380d03c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0830009d90 tx=0x7f083002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 -- 172.21.15.7:0/1379711944 shutdown_connections 2024-08-19T00:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 --2- 172.21.15.7:0/1379711944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08380cec10 0x7f08380d03c0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 --2- 172.21.15.7:0/1379711944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0838159bf0 0x7f0838073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 -- 172.21.15.7:0/1379711944 >> 172.21.15.7:0/1379711944 conn(0x7f083806bc70 msgr2=0x7f083806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 -- 172.21.15.7:0/1379711944 shutdown_connections 2024-08-19T00:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.768+0000 7f083ce00640 1 -- 172.21.15.7:0/1379711944 wait complete. 2024-08-19T00:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.770+0000 7f083ce00640 1 Processor -- start 2024-08-19T00:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.770+0000 7f083ce00640 1 -- start start 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f083ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08380739a0 0x7f083814c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f083ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0838159bf0 0x7f08381f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f083ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083814eb10 0x7f0838148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f083ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f083815a150 con 0x7f0838159bf0 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f083ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0838159fd0 con 0x7f083814eb10 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f083ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08380d0900 con 0x7f08380739a0 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0838159bf0 0x7f08381f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0838159bf0 0x7f08381f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44838/0 (socket says 172.21.15.7:44838) 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 -- 172.21.15.7:0/3159474574 learned_addr learned my addr 172.21.15.7:0/3159474574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f0835e00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08380739a0 0x7f083814c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f0836800640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083814eb10 0x7f0838148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 -- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08380739a0 msgr2=0x7f083814c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08380739a0 0x7f083814c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 -- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083814eb10 msgr2=0x7f0838148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083814eb10 0x7f0838148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f082d400640 1 -- 172.21.15.7:0/3159474574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08381f8250 con 0x7f0838159bf0 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f0835e00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08380739a0 0x7f083814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.771+0000 7f0836800640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083814eb10 0x7f0838148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.772+0000 7f082d400640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0838159bf0 0x7f08381f7d10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f082000c390 tx=0x7f082000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.772+0000 7f082ea00640 1 -- 172.21.15.7:0/3159474574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820017070 con 0x7f0838159bf0 2024-08-19T00:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.772+0000 7f082ea00640 1 -- 172.21.15.7:0/3159474574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0820005d00 con 0x7f0838159bf0 2024-08-19T00:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.772+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08381490f0 con 0x7f0838159bf0 2024-08-19T00:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.772+0000 7f082ea00640 1 -- 172.21.15.7:0/3159474574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820007310 con 0x7f0838159bf0 2024-08-19T00:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.772+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381496b0 con 0x7f0838159bf0 2024-08-19T00:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.773+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0838068c00 con 0x7f0838159bf0 2024-08-19T00:43:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.774+0000 7f082ea00640 1 -- 172.21.15.7:0/3159474574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f082001a070 con 0x7f0838159bf0 2024-08-19T00:43:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.775+0000 7f082ea00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f081406be30 0x7f081406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.775+0000 7f082ea00640 1 -- 172.21.15.7:0/3159474574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f082008a2e0 con 0x7f0838159bf0 2024-08-19T00:43:52.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.775+0000 7f0835e00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f081406be30 0x7f081406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:52.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.776+0000 7f0835e00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f081406be30 0x7f081406e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0828009ac0 tx=0x7f0828008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.780+0000 7f082ea00640 1 -- 172.21.15.7:0/3159474574 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0838068c00 con 0x7f0838159bf0 2024-08-19T00:43:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.975+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0838160580 con 0x7f0838159bf0 2024-08-19T00:43:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.976+0000 7f082ea00640 1 -- 172.21.15.7:0/3159474574 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v87) ==== 80+0+124 (secure 0 0 0) 0x7f08381f8250 con 0x7f0838159bf0 2024-08-19T00:43:52.979 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:43:52.979 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:43:52.979 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f081406be30 msgr2=0x7f081406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f081406be30 0x7f081406e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0828009ac0 tx=0x7f0828008040 comp rx=0 tx=0).stop 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0838159bf0 msgr2=0x7f08381f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0838159bf0 0x7f08381f7d10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f082000c390 tx=0x7f082000c850 comp rx=0 tx=0).stop 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 shutdown_connections 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f081406be30 0x7f081406e2f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f083814eb10 0x7f0838148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0838159bf0 0x7f08381f7d10 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 --2- 172.21.15.7:0/3159474574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08380739a0 0x7f083814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:52.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 >> 172.21.15.7:0/3159474574 conn(0x7f083806bc70 msgr2=0x7f083815f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:52.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 shutdown_connections 2024-08-19T00:43:52.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:52.978+0000 7f083ce00640 1 -- 172.21.15.7:0/3159474574 wait complete. 2024-08-19T00:43:52.996 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:43:52.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:52.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:43:53.065 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:43:53.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:43:53.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:43:53.102 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:43:53.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.297+0000 7f0031600640 1 Processor -- start 2024-08-19T00:43:53.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.298+0000 7f0031600640 1 -- start start 2024-08-19T00:43:53.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f0031600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f002c0d0ad0 0x7f002c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f0031600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c06f7f0 con 0x7f002c159bf0 2024-08-19T00:43:53.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f0031600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c06f510 con 0x7f002c0ce500 2024-08-19T00:43:53.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f0031600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f002c072980 con 0x7f002c0d0ad0 2024-08-19T00:43:53.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f002aa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f002c159bf0 0x7f002c073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34646/0 (socket says 172.21.15.7:34646) 2024-08-19T00:43:53.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f002aa00640 1 -- 172.21.15.7:0/2833539897 learned_addr learned my addr 172.21.15.7:0/2833539897 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:53.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f002b400640 1 --2- 172.21.15.7:0/2833539897 >> v2:172.21.15.162:3300/0 conn(0x7f002c0d0ad0 0x7f002c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458555191 0 0) 0x7f002c06f7f0 con 0x7f002c159bf0 2024-08-19T00:43:53.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.299+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0010003520 con 0x7f002c159bf0 2024-08-19T00:43:53.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264365971 0 0) 0x7f002c06f510 con 0x7f002c0ce500 2024-08-19T00:43:53.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f002c06f7f0 con 0x7f002c0ce500 2024-08-19T00:43:53.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2269145918 0 0) 0x7f0010003520 con 0x7f002c159bf0 2024-08-19T00:43:53.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 >> v2:172.21.15.162:3300/0 conn(0x7f002c0d0ad0 msgr2=0x7f002c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:53.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 --2- 172.21.15.7:0/2833539897 >> v2:172.21.15.162:3300/0 conn(0x7f002c0d0ad0 0x7f002c0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 >> v1:172.21.15.162:6789/0 conn(0x7f002c0ce500 legacy=0x7f002c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c072c60 con 0x7f002c159bf0 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f001c001670 con 0x7f002c159bf0 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002b400640 1 --2- 172.21.15.7:0/2833539897 >> v2:172.21.15.162:3300/0 conn(0x7f002c0d0ad0 0x7f002c0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 >> v1:172.21.15.7:6789/0 conn(0x7f002c159bf0 legacy=0x7f002c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0010003b90 0x7f0010003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0010004800 0x7f0010004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f001000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f002c072980 con 0x7f0010005210 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f001000c140 con 0x7f0010004800 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f001000c340 con 0x7f0010003b90 2024-08-19T00:43:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002b400640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f001000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f0023e00640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0010004800 0x7f0010004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002aa00640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0010003b90 0x7f0010003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002b400640 1 -- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0010003b90 msgr2=0x7f0010003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.300+0000 7f002b400640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0010003b90 0x7f0010003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.301+0000 7f002b400640 1 -- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0010004800 msgr2=0x7f0010004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.301+0000 7f002b400640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0010004800 0x7f0010004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.301+0000 7f002b400640 1 -- 172.21.15.7:0/2833539897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0010003520 con 0x7f0010005210 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.301+0000 7f0023e00640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0010004800 0x7f0010004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.301+0000 7f002b400640 1 -- 172.21.15.7:0/2833539897 reap_dead start 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.301+0000 7f002b400640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f001000b9c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f002400e320 tx=0x7f0010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ac8f5e85422a1f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024009de0 con 0x7f0010005210 2024-08-19T00:43:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0024003b90 con 0x7f0010005210 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f002a000640 1 -- 172.21.15.7:0/2833539897 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024004020 con 0x7f0010005210 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f0031600640 1 -- 172.21.15.7:0/2833539897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 msgr2=0x7f001000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f0031600640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f001000b9c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f002400e320 tx=0x7f0010005830 comp rx=0 tx=0).stop 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f0031600640 1 -- 172.21.15.7:0/2833539897 shutdown_connections 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f0031600640 1 --2- 172.21.15.7:0/2833539897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f001000b9c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f0031600640 1 -- 172.21.15.7:0/2833539897 >> 172.21.15.7:0/2833539897 conn(0x7f002c06bc70 msgr2=0x7f002c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f0031600640 1 -- 172.21.15.7:0/2833539897 shutdown_connections 2024-08-19T00:43:53.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.302+0000 7f0031600640 1 -- 172.21.15.7:0/2833539897 wait complete. 2024-08-19T00:43:53.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.304+0000 7f0031600640 1 Processor -- start 2024-08-19T00:43:53.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.304+0000 7f0031600640 1 -- start start 2024-08-19T00:43:53.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f0031600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f002c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f0031600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f002c14d2f0 0x7f002c099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f0031600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f002c0b4060 0x7f002c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f0031600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f002c15a150 con 0x7f0010005210 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f0031600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f002c159fd0 con 0x7f002c14d2f0 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f0031600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f002c0ce970 con 0x7f002c0b4060 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f002aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f002c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f002aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f002c14d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44862/0 (socket says 172.21.15.7:44862) 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f002aa00640 1 -- 172.21.15.7:0/2821698210 learned_addr learned my addr 172.21.15.7:0/2821698210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f0023e00640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f002c14d2f0 0x7f002c099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.305+0000 7f002b400640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f002c0b4060 0x7f002c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f002aa00640 1 -- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f002c0b4060 msgr2=0x7f002c0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f002aa00640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f002c0b4060 0x7f002c0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f002aa00640 1 -- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f002c14d2f0 msgr2=0x7f002c099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f002aa00640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f002c14d2f0 0x7f002c099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f002aa00640 1 -- 172.21.15.7:0/2821698210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c1effe0 con 0x7f0010005210 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f002b400640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f002c0b4060 0x7f002c0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f002aa00640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f002c14d820 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e790 tx=0x7f001c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f0022a00640 1 -- 172.21.15.7:0/2821698210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c00c660 con 0x7f0010005210 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f0022a00640 1 -- 172.21.15.7:0/2821698210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001c018070 con 0x7f0010005210 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c1f02c0 con 0x7f0010005210 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f0022a00640 1 -- 172.21.15.7:0/2821698210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c00ca60 con 0x7f0010005210 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.306+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c1f0880 con 0x7f0010005210 2024-08-19T00:43:53.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.307+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002c0ceca0 con 0x7f0010005210 2024-08-19T00:43:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.308+0000 7f0022a00640 1 -- 172.21.15.7:0/2821698210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f001c00cc00 con 0x7f0010005210 2024-08-19T00:43:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.309+0000 7f0022a00640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f000806be60 0x7f000806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.309+0000 7f0022a00640 1 -- 172.21.15.7:0/2821698210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5795+0+0 (secure 0 0 0) 0x7f001c08a820 con 0x7f0010005210 2024-08-19T00:43:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.309+0000 7f0023e00640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f000806be60 0x7f000806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.310+0000 7f0023e00640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f000806be60 0x7f000806e320 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f002c0cf8e0 tx=0x7f0014012040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:53.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.314+0000 7f0022a00640 1 -- 172.21.15.7:0/2821698210 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f001c0590d0 con 0x7f0010005210 2024-08-19T00:43:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.539+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f002c159490 con 0x7f0010005210 2024-08-19T00:43:53.542 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:43:53.539+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:43:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.541+0000 7f0022a00640 1 -- 172.21.15.7:0/2821698210 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) ==== 161+0+0 (secure 0 0 0) 0x7f001c0589d0 con 0x7f0010005210 2024-08-19T00:43:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:43:53.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.543+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f000806be60 msgr2=0x7f000806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f000806be60 0x7f000806e320 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f002c0cf8e0 tx=0x7f0014012040 comp rx=0 tx=0).stop 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 msgr2=0x7f002c14d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f002c14d820 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e790 tx=0x7f001c00ec50 comp rx=0 tx=0).stop 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 shutdown_connections 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f000806be60 0x7f000806e320 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f002c0b4060 0x7f002c0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f002c14d2f0 0x7f002c099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 --2- 172.21.15.7:0/2821698210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0010005210 0x7f002c14d820 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 >> 172.21.15.7:0/2821698210 conn(0x7f002c06bc70 msgr2=0x7f002c15e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 shutdown_connections 2024-08-19T00:43:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.544+0000 7f0031600640 1 -- 172.21.15.7:0/2821698210 wait complete. 2024-08-19T00:43:53.553 INFO:tasks.ceph.mds.b.smithi162.stderr: -607> 2024-08-19T00:43:49.214+0000 7fd7a7c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:43:53.554 INFO:tasks.ceph.mds.b.smithi162.stderr: -139> 2024-08-19T00:43:52.412+0000 7fd7a2c00640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/subdir) 2024-08-19T00:43:53.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:43:53.597 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:43:53.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.718+0000 7fee25e00640 1 Processor -- start 2024-08-19T00:43:53.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.718+0000 7fee25e00640 1 -- start start 2024-08-19T00:43:53.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.719+0000 7fee25e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee200d03c0 0x7fee20071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.719+0000 7fee25e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee200cdfb0 con 0x7fee200b3750 2024-08-19T00:43:53.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee25e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee200ce290 con 0x7fee2006e710 2024-08-19T00:43:53.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee25e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fee200cebc0 con 0x7fee200d03c0 2024-08-19T00:43:53.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee1ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee200d03c0 0x7fee20071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee1f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fee200b3750 0x7fee200cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34650/0 (socket says 172.21.15.7:34650) 2024-08-19T00:43:53.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee1f400640 1 -- 172.21.15.7:0/1227288956 learned_addr learned my addr 172.21.15.7:0/1227288956 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:53.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee1ea00640 1 -- 172.21.15.7:0/1227288956 >> v1:172.21.15.162:6789/0 conn(0x7fee2006e710 legacy=0x7fee200d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:53.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee1ea00640 1 -- 172.21.15.7:0/1227288956 >> v1:172.21.15.7:6789/0 conn(0x7fee200b3750 legacy=0x7fee200cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee1e000640 1 -- 172.21.15.7:0/1227288956 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735181954 0 0) 0x7fee200cdfb0 con 0x7fee200b3750 2024-08-19T00:43:53.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.720+0000 7fee1ea00640 1 -- 172.21.15.7:0/1227288956 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200ce570 con 0x7fee200d03c0 2024-08-19T00:43:53.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.721+0000 7fee1ea00640 1 --2- 172.21.15.7:0/1227288956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee20071980 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fee100097d0 tx=0x7fee1002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d022d92d7f3875a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:53.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.721+0000 7fee1e000640 1 -- 172.21.15.7:0/1227288956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10037070 con 0x7fee200d03c0 2024-08-19T00:43:53.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.721+0000 7fee1e000640 1 -- 172.21.15.7:0/1227288956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee10032440 con 0x7fee200d03c0 2024-08-19T00:43:53.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.721+0000 7fee1e000640 1 -- 172.21.15.7:0/1227288956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10032810 con 0x7fee200d03c0 2024-08-19T00:43:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.722+0000 7fee25e00640 1 -- 172.21.15.7:0/1227288956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 msgr2=0x7fee20071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.722+0000 7fee25e00640 1 --2- 172.21.15.7:0/1227288956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee20071980 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fee100097d0 tx=0x7fee1002a210 comp rx=0 tx=0).stop 2024-08-19T00:43:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.722+0000 7fee25e00640 1 -- 172.21.15.7:0/1227288956 shutdown_connections 2024-08-19T00:43:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.722+0000 7fee25e00640 1 --2- 172.21.15.7:0/1227288956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee20071980 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.722+0000 7fee25e00640 1 -- 172.21.15.7:0/1227288956 >> 172.21.15.7:0/1227288956 conn(0x7fee2006bc70 msgr2=0x7fee2006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.722+0000 7fee25e00640 1 -- 172.21.15.7:0/1227288956 shutdown_connections 2024-08-19T00:43:53.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.722+0000 7fee25e00640 1 -- 172.21.15.7:0/1227288956 wait complete. 2024-08-19T00:43:53.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.724+0000 7fee25e00640 1 Processor -- start 2024-08-19T00:43:53.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.724+0000 7fee25e00640 1 -- start start 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee25e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2006e710 0x7fee200ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee25e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee200b3750 0x7fee200cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee25e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee200c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee25e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee20073c60 con 0x7fee200d03c0 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee25e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee20073ae0 con 0x7fee200b3750 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee25e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee200b3be0 con 0x7fee2006e710 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee1f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee200c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee1f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee200c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44880/0 (socket says 172.21.15.7:44880) 2024-08-19T00:43:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee1f400640 1 -- 172.21.15.7:0/958446548 learned_addr learned my addr 172.21.15.7:0/958446548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee17e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee200b3750 0x7fee200cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee1ea00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2006e710 0x7fee200ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee1f400640 1 -- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2006e710 msgr2=0x7fee200ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.725+0000 7fee1f400640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2006e710 0x7fee200ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee1f400640 1 -- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee200b3750 msgr2=0x7fee200cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee1f400640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee200b3750 0x7fee200cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee1f400640 1 -- 172.21.15.7:0/958446548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2015ac60 con 0x7fee200d03c0 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee17e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee200b3750 0x7fee200cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee1f400640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee200c9390 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fee1800c7d0 tx=0x7fee1800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee17400640 1 -- 172.21.15.7:0/958446548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18018070 con 0x7fee200d03c0 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee17400640 1 -- 172.21.15.7:0/958446548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1800a640 con 0x7fee200d03c0 2024-08-19T00:43:53.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee201f4d80 con 0x7fee200d03c0 2024-08-19T00:43:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee17400640 1 -- 172.21.15.7:0/958446548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1800aa70 con 0x7fee200d03c0 2024-08-19T00:43:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.726+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee201f5340 con 0x7fee200d03c0 2024-08-19T00:43:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.727+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee20071980 con 0x7fee200d03c0 2024-08-19T00:43:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.728+0000 7fee17400640 1 -- 172.21.15.7:0/958446548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee1801b070 con 0x7fee200d03c0 2024-08-19T00:43:53.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.729+0000 7fee17400640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedfc06be30 0x7fedfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.729+0000 7fee17400640 1 -- 172.21.15.7:0/958446548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5881+0+0 (secure 0 0 0) 0x7fee1808a550 con 0x7fee200d03c0 2024-08-19T00:43:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.729+0000 7fee1ea00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedfc06be30 0x7fedfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:53.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.730+0000 7fee1ea00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedfc06be30 0x7fedfc06e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fee10034000 tx=0x7fee1002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:53.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.733+0000 7fee17400640 1 -- 172.21.15.7:0/958446548 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fee18058760 con 0x7fee200d03c0 2024-08-19T00:43:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:53.985+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fee200ad090 con 0x7fee200d03c0 2024-08-19T00:43:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.543+0000 7fee17400640 1 -- 172.21.15.7:0/958446548 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v95) ==== 107+0+0 (secure 0 0 0) 0x7fee1805ca60 con 0x7fee200d03c0 2024-08-19T00:43:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:43:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.545+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedfc06be30 msgr2=0x7fedfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.545+0000 7fee25e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedfc06be30 0x7fedfc06e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fee10034000 tx=0x7fee1002e000 comp rx=0 tx=0).stop 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.545+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 msgr2=0x7fee200c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.545+0000 7fee25e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee200c9390 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fee1800c7d0 tx=0x7fee1800cc90 comp rx=0 tx=0).stop 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 shutdown_connections 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fedfc06be30 0x7fedfc06e2f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee200d03c0 0x7fee200c9390 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee200b3750 0x7fee200cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 --2- 172.21.15.7:0/958446548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2006e710 0x7fee200ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 >> 172.21.15.7:0/958446548 conn(0x7fee2006bc70 msgr2=0x7fee200afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 shutdown_connections 2024-08-19T00:43:54.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.546+0000 7fee25e00640 1 -- 172.21.15.7:0/958446548 wait complete. 2024-08-19T00:43:54.568 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:43:54.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.642+0000 7f7fba1edf40 1 Processor -- start 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.642+0000 7f7fba1edf40 1 -- start start 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.643+0000 7f7fba1edf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16a9f40 0x55c2a16c3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.643+0000 7f7fba1edf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1747b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.643+0000 7f7fba1edf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16ab990 0x55c2a17ded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.643+0000 7f7fba1edf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c2a16aa8f0 con 0x55c2a16a9f40 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.643+0000 7f7fba1edf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c2a161fd00 con 0x55c2a16ab5b0 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.643+0000 7f7fba1edf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c2a1750dc0 con 0x55c2a16ab990 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16a9f40 0x55c2a16c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16a9f40 0x55c2a16c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42642/0 (socket says 172.21.15.7:42642) 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 -- 172.21.15.7:0/2590563559 learned_addr learned my addr 172.21.15.7:0/2590563559 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1747b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7e00640 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16ab990 0x55c2a17ded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 -- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16ab990 msgr2=0x55c2a17ded40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:54.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16ab990 0x55c2a17ded40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 -- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 msgr2=0x55c2a1747b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:54.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1747b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 -- 172.21.15.7:0/2590563559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a15a4b30 con 0x55c2a16a9f40 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.644+0000 7f7fb7400640 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16a9f40 0x55c2a16c3470 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001db0 tx=0x7f7fa800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c990a4eec83917af server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fb5600640 1 -- 172.21.15.7:0/2590563559 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800bde0 con 0x55c2a16a9f40 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fb5600640 1 -- 172.21.15.7:0/2590563559 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa800f400 con 0x55c2a16a9f40 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fb5600640 1 -- 172.21.15.7:0/2590563559 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800f7f0 con 0x55c2a16a9f40 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 -- 172.21.15.7:0/2590563559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16a9f40 msgr2=0x55c2a16c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16a9f40 0x55c2a16c3470 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001db0 tx=0x7f7fa800b5b0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 -- 172.21.15.7:0/2590563559 shutdown_connections 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16ab990 0x55c2a17ded40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1747b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/2590563559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16a9f40 0x55c2a16c3470 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 -- 172.21.15.7:0/2590563559 >> 172.21.15.7:0/2590563559 conn(0x55c2a16a84e0 msgr2=0x55c2a16a88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:54.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 -- 172.21.15.7:0/2590563559 shutdown_connections 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.645+0000 7f7fba1edf40 1 -- 172.21.15.7:0/2590563559 wait complete. 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.646+0000 7f7fba1edf40 1 Processor -- start 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.646+0000 7f7fba1edf40 1 -- start start 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fba1edf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16a9f40 0x55c2a173de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fba1edf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1741080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fba1edf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16ab990 0x55c2a17415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fba1edf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c2a1749c80 con 0x55c2a16ab990 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fba1edf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c2a1746e30 con 0x55c2a16ab5b0 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fba1edf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c2a1747080 con 0x55c2a16a9f40 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16ab990 0x55c2a17415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16ab990 0x55c2a17415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42652/0 (socket says 172.21.15.7:42652) 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 learned_addr learned my addr 172.21.15.7:0/3527211142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:54.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fb7400640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16a9f40 0x55c2a173de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.647+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1741080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16a9f40 msgr2=0x55c2a173de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fb7e00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2a16a9f40 0x55c2a173de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 msgr2=0x55c2a1741080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fb7e00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1741080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a15e1080 con 0x55c2a16ab990 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2a16ab5b0 0x55c2a1741080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:43:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fb7e00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16ab990 0x55c2a17415c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0010910 tx=0x7f7fb0010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fafe00640 1 -- 172.21.15.7:0/3527211142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0018070 con 0x55c2a16ab990 2024-08-19T00:43:54.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fafe00640 1 -- 172.21.15.7:0/3527211142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb000e9b0 con 0x55c2a16ab990 2024-08-19T00:43:54.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fafe00640 1 -- 172.21.15.7:0/3527211142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000eda0 con 0x55c2a16ab990 2024-08-19T00:43:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2a16a8230 con 0x55c2a16ab990 2024-08-19T00:43:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.648+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2a174f8b0 con 0x55c2a16ab990 2024-08-19T00:43:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.650+0000 7f7fafe00640 1 -- 172.21.15.7:0/3527211142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fb001b070 con 0x55c2a16ab990 2024-08-19T00:43:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.651+0000 7f7fafe00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f9806a810 0x7f7f9806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.651+0000 7f7fafe00640 1 -- 172.21.15.7:0/3527211142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5881+0+0 (secure 0 0 0) 0x7f7fb008a360 con 0x55c2a16ab990 2024-08-19T00:43:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.652+0000 7f7fb7400640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f9806a810 0x7f7f9806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.655 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:43:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.652+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c2a16aa3b0 0x55c2a173ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.652+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a173fb50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.652+0000 7f7fb7400640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f9806a810 0x7f7f9806ccd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001d50 tx=0x7f7fa8009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.652+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c2a16aa3b0 0x55c2a173ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.653+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c2a16aa3b0 0x55c2a173ee40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.655+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v88'43 uv16 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.655+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a173f380 con 0x55c2a16aa3b0 2024-08-19T00:43:54.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.656+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v88'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.656+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f2f20 con 0x55c2a16aa3b0 2024-08-19T00:43:54.661 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:43:54.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.660+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v88'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.660+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f42d0 con 0x55c2a16aa3b0 2024-08-19T00:43:54.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.663+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v88'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.663+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f4670 con 0x55c2a16aa3b0 2024-08-19T00:43:54.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.663+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v88'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.663+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f32c0 con 0x55c2a16aa3b0 2024-08-19T00:43:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.666+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v88'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.666+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f36b0 con 0x55c2a16aa3b0 2024-08-19T00:43:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.667+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v88'49 uv22 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.667+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3aa0 con 0x55c2a16aa3b0 2024-08-19T00:43:54.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.669+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v88'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.669+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3aa0 con 0x55c2a16aa3b0 2024-08-19T00:43:54.674 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:43:54.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.672+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v88'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.672+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.673+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v88'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.673+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.675+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v88'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.675+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.677+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v88'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.677+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.681 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:43:54.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.678+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v88'55 uv55 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.678+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.680+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [setxattr (30)] v88'56 uv56 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.680+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.681+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [setxattr (62)] v88'57 uv57 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.681+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.683+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v88'58 uv58 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.683+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3e10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.685+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [omap-set-vals] v88'59 uv59 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.685+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3e10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.688+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 600.00000000 [create] v88'60 uv35 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.688+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3e10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.689+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 600.00000000 [delete] v88'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.690+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.694 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:43:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.692+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v88'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.692+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.694+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [setxattr (30)] v88'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.695+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.696+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [setxattr (62)] v88'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.696+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.698+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [omap-set-header] v88'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.699+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.700+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 603.00000000 [create] v88'66 uv41 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.700+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.701+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 603.00000000 [delete] v88'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.701+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.706 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:43:54.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.704+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v88'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.704+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.706+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [setxattr (30)] v88'69 uv69 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.706+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.710+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [setxattr (62)] v88'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.710+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a16aa3b0 2024-08-19T00:43:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.712+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [omap-set-header] v88'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.712+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c2a17f4f20 0x55c2a17f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.712+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:30 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f3d10 con 0x55c2a17f4f20 2024-08-19T00:43:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.712+0000 7f7fb7400640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c2a17f4f20 0x55c2a17f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.713+0000 7f7fb7400640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c2a17f4f20 0x55c2a17f7310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.714+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(30 1.00000000.inode [create] v88'45 uv24 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.714+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:31 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f7850 con 0x55c2a17f4f20 2024-08-19T00:43:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.716+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(31 1.00000000.inode [delete] v88'46 uv46 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.716+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f7bf0 con 0x55c2a17f4f20 2024-08-19T00:43:54.720 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:43:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.718+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(32 1.00000000.inode [create] v88'47 uv47 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.718+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f7f90 con 0x55c2a17f4f20 2024-08-19T00:43:54.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.719+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(33 1.00000000.inode [write 0~582] v88'48 uv48 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.720+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8330 con 0x55c2a17f4f20 2024-08-19T00:43:54.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.721+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v88'49 uv49 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.721+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f86d0 con 0x55c2a17f4f20 2024-08-19T00:43:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.722+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(35 200.00000000 [create] v88'50 uv43 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.722+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8a70 con 0x55c2a17f4f20 2024-08-19T00:43:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.724+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(36 200.00000000 [delete] v88'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.724+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.728 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:43:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.725+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(37 200.00000000 [create] v88'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.725+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.727+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(38 200.00000000 [write 0~90] v88'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.727+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.728+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(39 200.00000000 [omap-set-header] v88'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.728+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.730+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(40 200.00000001 [create] v88'55 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.730+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.731+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(41 200.00000001 [delete] v88'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.731+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.735 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:43:54.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.733+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(42 200.00000001 [create] v88'57 uv57 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.733+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fd500 con 0x55c2a17f4f20 2024-08-19T00:43:54.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.735+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(43 200.00000001 [write 0~18118] v88'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.735+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fd500 con 0x55c2a17f4f20 2024-08-19T00:43:54.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.736+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(44 200.00000001 [omap-set-header] v88'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.736+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.737+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(45 606.00000000 [create] v88'60 uv40 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.737+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.739+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(46 606.00000000 [delete] v88'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.739+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.743 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:43:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.740+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(47 606.00000000 [create] v88'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.740+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f9e20 con 0x55c2a17f4f20 2024-08-19T00:43:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.742+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v88'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.742+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f9e20 con 0x55c2a17f4f20 2024-08-19T00:43:54.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.744+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v88'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.744+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17f8e10 con 0x55c2a17f4f20 2024-08-19T00:43:54.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.745+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(50 606.00000000 [omap-set-header] v88'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a17f4f20 2024-08-19T00:43:54.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.745+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c2a17f9490 0x55c2a17fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.745+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:51 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fbdc0 con 0x55c2a17f9490 2024-08-19T00:43:54.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.746+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c2a17f9490 0x55c2a17fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.747+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c2a17f9490 0x55c2a17fb880 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.748+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(51 607.00000000 [create] v88'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.748+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:52 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fbe40 con 0x55c2a17f9490 2024-08-19T00:43:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.750+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(52 607.00000000 [delete] v88'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.750+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fc230 con 0x55c2a17f9490 2024-08-19T00:43:54.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.751+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(53 607.00000000 [create] v88'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.754 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:43:54.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.751+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fd240 con 0x55c2a17f9490 2024-08-19T00:43:54.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.753+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v88'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.753+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fd240 con 0x55c2a17f9490 2024-08-19T00:43:54.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.755+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v88'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.755+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fc230 con 0x55c2a17f9490 2024-08-19T00:43:54.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.756+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v88'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.756+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:57 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fc230 con 0x55c2a16aa3b0 2024-08-19T00:43:54.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.757+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(57 mds0_openfiles.0 [create] v88'10 uv9 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.757+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:58 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fc230 con 0x55c2a16aa3b0 2024-08-19T00:43:54.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.760+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v88'11 uv11 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.760+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fc230 con 0x55c2a16aa3b0 2024-08-19T00:43:54.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.760+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v88'12 uv12 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.763 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:43:54.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.760+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17fc230 con 0x55c2a16aa3b0 2024-08-19T00:43:54.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.762+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v88'13 uv13 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.762+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2a17fcb80 0x55c2a17fef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.762+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:61 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17ff4b0 con 0x55c2a17fcb80 2024-08-19T00:43:54.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.762+0000 7f7fb7e00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2a17fcb80 0x55c2a17fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.763+0000 7f7fb7e00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2a17fcb80 0x55c2a17fef70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.764+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(61 608.00000000 [create] v88'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.764+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:62 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17ff850 con 0x55c2a17fcb80 2024-08-19T00:43:54.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.765+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(62 608.00000000 [delete] v88'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.765+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a17ffd30 con 0x55c2a17fcb80 2024-08-19T00:43:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.767+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(63 608.00000000 [create] v88'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.770 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:43:54.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.767+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a18015e0 con 0x55c2a17fcb80 2024-08-19T00:43:54.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.769+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v88'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.769+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1801980 con 0x55c2a17fcb80 2024-08-19T00:43:54.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.773+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v88'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.773+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a18005d0 con 0x55c2a17fcb80 2024-08-19T00:43:54.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.774+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v88'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.774+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c2a1800ed0 0x55c2a1803d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.774+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:67 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804270 con 0x55c2a1800ed0 2024-08-19T00:43:54.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.775+0000 7f7fb7400640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c2a1800ed0 0x55c2a1803d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.775+0000 7f7fb7400640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c2a1800ed0 0x55c2a1803d30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.777+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(67 604.00000000 [create] v88'15 uv9 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.777+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:68 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804270 con 0x55c2a1800ed0 2024-08-19T00:43:54.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.779+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(68 604.00000000 [delete] v88'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.779+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804270 con 0x55c2a1800ed0 2024-08-19T00:43:54.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.781+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(69 604.00000000 [create] v88'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.783 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:43:54.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.781+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a18056a0 con 0x55c2a1800ed0 2024-08-19T00:43:54.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.783+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v88'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.783+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a18056a0 con 0x55c2a1800ed0 2024-08-19T00:43:54.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.785+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v88'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.785+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804690 con 0x55c2a1800ed0 2024-08-19T00:43:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.787+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v88'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.787+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804690 con 0x55c2a1800ed0 2024-08-19T00:43:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.790+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(73 500.00000000 [create] v88'21 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.790+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804690 con 0x55c2a1800ed0 2024-08-19T00:43:54.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.792+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(74 500.00000000 [delete] v88'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.793+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804690 con 0x55c2a1800ed0 2024-08-19T00:43:54.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.794+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(75 500.00000000 [create] v88'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.796 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:43:54.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.794+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804690 con 0x55c2a1800ed0 2024-08-19T00:43:54.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.796+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v88'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.796+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1804690 con 0x55c2a1800ed0 2024-08-19T00:43:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.799+0000 7f7fb7400640 1 -- 172.21.15.7:0/3527211142 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v88'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa800f870 con 0x55c2a1800ed0 2024-08-19T00:43:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.799+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c2a1804ba0 0x55c2a1806f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.799+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:78 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a18075f0 con 0x55c2a1804ba0 2024-08-19T00:43:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.799+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c2a1804ba0 0x55c2a1806f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.799+0000 7f7fb6a00640 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c2a1804ba0 0x55c2a1806f90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.800+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(78 mds_snaptable [create] v88'7 uv6 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.800+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:79 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a18075f0 con 0x55c2a1804ba0 2024-08-19T00:43:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.802+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(79 mds_snaptable [delete] v88'8 uv8 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.802+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a1804ba0 2024-08-19T00:43:54.807 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:43:54.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.805+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(80 mds_snaptable [create] v88'9 uv9 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.805+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a1804ba0 2024-08-19T00:43:54.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.806+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v88'10 uv10 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.806+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a1804ba0 2024-08-19T00:43:54.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.807+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v88'11 uv11 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.807+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:83 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a16aa3b0 2024-08-19T00:43:54.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.809+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(83 605.00000000 [create] v88'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.809+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:84 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a16aa3b0 2024-08-19T00:43:54.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.810+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(84 605.00000000 [delete] v88'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.810+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a16aa3b0 2024-08-19T00:43:54.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.811+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v88'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.814 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:43:54.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.812+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1808a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.813+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v88'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.813+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1808a50 con 0x55c2a16aa3b0 2024-08-19T00:43:54.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.814+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v88'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.814+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a16aa3b0 2024-08-19T00:43:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.816+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [omap-set-header] v88'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a16aa3b0 2024-08-19T00:43:54.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.816+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:89 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.819+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(89 mds0_inotable [create] v88'14 uv8 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.819+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:90 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.819+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(90 mds0_inotable [delete] v88'15 uv15 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.819+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.823 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:43:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.822+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(91 mds0_inotable [create] v88'16 uv16 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.822+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.823+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(92 mds0_inotable [write 0~34] v88'17 uv17 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.823+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.825+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v88'18 uv18 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.825+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.827+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(94 100.00000000 [create] v88'19 uv13 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.827+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.828+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(95 100.00000000 [delete] v88'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.828+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.831 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:43:54.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.830+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(96 100.00000000 [create] v88'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.830+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807a40 con 0x55c2a17f9490 2024-08-19T00:43:54.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.831+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(97 100.00000000 [omap-set-header] v88'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.831+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a180a810 con 0x55c2a17f9490 2024-08-19T00:43:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.833+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v88'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a17f9490 2024-08-19T00:43:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.833+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a180a7d0 con 0x55c2a17fcb80 2024-08-19T00:43:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.835+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v88'9 uv7 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.835+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.837+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v88'10 uv10 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.837+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.840 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:43:54.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.838+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v88'11 uv11 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.838+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.840+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v88'12 uv12 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.840+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.840+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v88'9 uv8 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.840+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.842+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v88'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.842+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.847 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:43:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.845+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v88'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.845+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.846+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v88'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.846+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.847+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v88'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.847+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a17fcb80 2024-08-19T00:43:54.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.849+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v88'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fb0024070 con 0x55c2a17fcb80 2024-08-19T00:43:54.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.849+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807e30 con 0x55c2a1804ba0 2024-08-19T00:43:54.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.850+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v88'7 uv6 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.850+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.852+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v88'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.852+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.855 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:43:54.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.853+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v88'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.853+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.854+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v88'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.854+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.855+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v88'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.855+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.857+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v88'20 uv11 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.857+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.859+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v88'21 uv21 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.859+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.862 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:43:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.860+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v88'22 uv22 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.860+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.862+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v88'23 uv23 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.862+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.863+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v88'24 uv24 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.863+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.865+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v88'25 uv18 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.865+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.867+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v88'26 uv26 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.867+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.871 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:43:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.868+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v88'27 uv27 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.868+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.870+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v88'28 uv28 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.870+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.871+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v88'29 uv29 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.871+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a1807de0 con 0x55c2a1804ba0 2024-08-19T00:43:54.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.873+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v88'30 uv30 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.873+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55c2a18086d0 con 0x55c2a1804ba0 2024-08-19T00:43:54.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fb6a00640 1 -- 172.21.15.7:0/3527211142 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v88'31 uv31 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7fa4060620 con 0x55c2a1804ba0 2024-08-19T00:43:54.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c2a17f4f20 msgr2=0x55c2a17f7310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c2a17f4f20 0x55c2a17f7310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c2a1800ed0 msgr2=0x55c2a1803d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c2a1800ed0 0x55c2a1803d30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c2a1804ba0 msgr2=0x55c2a1806f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c2a1804ba0 0x55c2a1806f90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c2a17f9490 msgr2=0x55c2a17fb880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c2a17f9490 0x55c2a17fb880 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 reap_dead start 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c2a16aa3b0 msgr2=0x55c2a173ee40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c2a16aa3b0 0x55c2a173ee40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2a17fcb80 msgr2=0x55c2a17fef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2a17fcb80 0x55c2a17fef70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f9806a810 msgr2=0x7f7f9806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f9806a810 0x7f7f9806ccd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001d50 tx=0x7f7fa8009000 comp rx=0 tx=0).stop 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16ab990 msgr2=0x55c2a17415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 --2- 172.21.15.7:0/3527211142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2a16ab990 0x55c2a17415c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0010910 tx=0x7f7fb0010dd0 comp rx=0 tx=0).stop 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fb7e00640 1 -- 172.21.15.7:0/3527211142 reap_dead start 2024-08-19T00:43:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 shutdown_connections 2024-08-19T00:43:54.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 >> 172.21.15.7:0/3527211142 conn(0x55c2a16a84e0 msgr2=0x55c2a1747d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:54.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 shutdown_connections 2024-08-19T00:43:54.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.875+0000 7f7fba1edf40 1 -- 172.21.15.7:0/3527211142 wait complete. 2024-08-19T00:43:54.883 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 600.00000000 2024-08-19T00:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.997+0000 7fce6bbc2f40 1 Processor -- start 2024-08-19T00:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.997+0000 7fce6bbc2f40 1 -- start start 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce6bbc2f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a186650 0x56424a22dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce6bbc2f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a1875b0 0x56424a2bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce6bbc2f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a187990 0x56424a2be510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce6bbc2f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56424a0fbd00 con 0x56424a1875b0 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce6bbc2f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56424a0ffd40 con 0x56424a187990 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce6bbc2f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56424a22cdc0 con 0x56424a186650 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce63e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a1875b0 0x56424a2bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce63e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a1875b0 0x56424a2bdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42670/0 (socket says 172.21.15.7:42670) 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce63e00640 1 -- 172.21.15.7:0/3008292017 learned_addr learned my addr 172.21.15.7:0/3008292017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce69800640 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a187990 0x56424a2be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.998+0000 7fce68e00640 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a186650 0x56424a22dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce63e00640 1 -- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a186650 msgr2=0x56424a22dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce63e00640 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a186650 0x56424a22dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce63e00640 1 -- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a187990 msgr2=0x56424a2be510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce63e00640 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a187990 0x56424a2be510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce63e00640 1 -- 172.21.15.7:0/3008292017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424a0bd080 con 0x56424a1875b0 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce63e00640 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a1875b0 0x56424a2bdfd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fce54001dd0 tx=0x7fce5400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea33f7994abc9f98 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce62a00640 1 -- 172.21.15.7:0/3008292017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400bde0 con 0x56424a1875b0 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce62a00640 1 -- 172.21.15.7:0/3008292017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5400f400 con 0x56424a1875b0 2024-08-19T00:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:54.999+0000 7fce62a00640 1 -- 172.21.15.7:0/3008292017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400f830 con 0x56424a1875b0 2024-08-19T00:43:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3008292017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a1875b0 msgr2=0x56424a2bdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a1875b0 0x56424a2bdfd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fce54001dd0 tx=0x7fce5400b5b0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3008292017 shutdown_connections 2024-08-19T00:43:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a187990 0x56424a2be510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a1875b0 0x56424a2bdfd0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3008292017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a186650 0x56424a22dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3008292017 >> 172.21.15.7:0/3008292017 conn(0x56424a1844e0 msgr2=0x56424a1546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3008292017 shutdown_connections 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.000+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3008292017 wait complete. 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 Processor -- start 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 -- start start 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a186650 0x56424a21b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a1875b0 0x56424a22b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a187990 0x56424a21ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56424a221440 con 0x56424a186650 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56424a155120 con 0x56424a1875b0 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.001+0000 7fce6bbc2f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56424a221720 con 0x56424a187990 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a186650 0x56424a21b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a186650 0x56424a21b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42678/0 (socket says 172.21.15.7:42678) 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 -- 172.21.15.7:0/3495825695 learned_addr learned my addr 172.21.15.7:0/3495825695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce69800640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a187990 0x56424a21ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce63e00640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a1875b0 0x56424a22b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 -- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a187990 msgr2=0x56424a21ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56424a187990 0x56424a21ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 -- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a1875b0 msgr2=0x56424a22b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56424a1875b0 0x56424a22b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.002+0000 7fce68e00640 1 -- 172.21.15.7:0/3495825695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424a22a290 con 0x56424a186650 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.003+0000 7fce68e00640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a186650 0x56424a21b190 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00df80 tx=0x7fce5c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.003+0000 7fce61600640 1 -- 172.21.15.7:0/3495825695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c014020 con 0x56424a186650 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.003+0000 7fce61600640 1 -- 172.21.15.7:0/3495825695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c010620 con 0x56424a186650 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.003+0000 7fce61600640 1 -- 172.21.15.7:0/3495825695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c008030 con 0x56424a186650 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.003+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56424a228af0 con 0x56424a186650 2024-08-19T00:43:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.003+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56424a22a530 con 0x56424a186650 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.006+0000 7fce61600640 1 -- 172.21.15.7:0/3495825695 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce5c017020 con 0x56424a186650 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.006+0000 7fce61600640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce4806a810 0x7fce4806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.006+0000 7fce61600640 1 -- 172.21.15.7:0/3495825695 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5881+0+0 (secure 0 0 0) 0x7fce5c089bc0 con 0x56424a186650 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.006+0000 7fce63e00640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce4806a810 0x7fce4806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.006+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56424a2283f0 0x56424a21dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.006+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) -- 0x56424a21e110 con 0x56424a2283f0 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.006+0000 7fce69800640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56424a2283f0 0x56424a21dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.007+0000 7fce63e00640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce4806a810 0x7fce4806ccd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x56424a226430 tx=0x7fce54009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.007+0000 7fce69800640 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56424a2283f0 0x56424a21dbd0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:55.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce69800640 1 -- 172.21.15.7:0/3495825695 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 600.00000000 [delete] v88'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fce64056970 con 0x56424a2283f0 2024-08-19T00:43:55.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56424a2283f0 msgr2=0x56424a21dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56424a2283f0 0x56424a21dbd0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce4806a810 msgr2=0x7fce4806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce4806a810 0x7fce4806ccd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x56424a226430 tx=0x7fce54009000 comp rx=0 tx=0).stop 2024-08-19T00:43:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a186650 msgr2=0x56424a21b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 --2- 172.21.15.7:0/3495825695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56424a186650 0x56424a21b190 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00df80 tx=0x7fce5c00b6a0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce69800640 1 -- 172.21.15.7:0/3495825695 reap_dead start 2024-08-19T00:43:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 shutdown_connections 2024-08-19T00:43:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 >> 172.21.15.7:0/3495825695 conn(0x56424a1844e0 msgr2=0x56424a143150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 shutdown_connections 2024-08-19T00:43:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.009+0000 7fce6bbc2f40 1 -- 172.21.15.7:0/3495825695 wait complete. 2024-08-19T00:43:55.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:43:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.174+0000 7f7881200640 1 Processor -- start 2024-08-19T00:43:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.174+0000 7f7881200640 1 -- start start 2024-08-19T00:43:55.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7881200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c0731c0 0x7f787c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7881200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787c0aeae0 con 0x7f787c158cd0 2024-08-19T00:43:55.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7881200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787c0aedc0 con 0x7f787c0ae2b0 2024-08-19T00:43:55.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7881200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f787c0af0a0 con 0x7f787c0731c0 2024-08-19T00:43:55.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7879e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f787c158cd0 0x7f787c072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36048/0 (socket says 172.21.15.7:36048) 2024-08-19T00:43:55.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7879e00640 1 -- 172.21.15.7:0/1252607571 learned_addr learned my addr 172.21.15.7:0/1252607571 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:55.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7879400640 1 --2- 172.21.15.7:0/1252607571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c0731c0 0x7f787c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7878a00640 1 -- 172.21.15.7:0/1252607571 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269005044 0 0) 0x7f787c0aeae0 con 0x7f787c158cd0 2024-08-19T00:43:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7878a00640 1 -- 172.21.15.7:0/1252607571 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7860003520 con 0x7f787c158cd0 2024-08-19T00:43:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7878a00640 1 -- 172.21.15.7:0/1252607571 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785990883 0 0) 0x7f787c0aedc0 con 0x7f787c0ae2b0 2024-08-19T00:43:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.176+0000 7f7878a00640 1 -- 172.21.15.7:0/1252607571 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f787c0aeae0 con 0x7f787c0ae2b0 2024-08-19T00:43:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.177+0000 7f7879400640 1 -- 172.21.15.7:0/1252607571 >> v1:172.21.15.162:6789/0 conn(0x7f787c0ae2b0 legacy=0x7f787c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.177+0000 7f7879400640 1 -- 172.21.15.7:0/1252607571 >> v1:172.21.15.7:6789/0 conn(0x7f787c158cd0 legacy=0x7f787c072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.177+0000 7f7879400640 1 -- 172.21.15.7:0/1252607571 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c0af380 con 0x7f787c0731c0 2024-08-19T00:43:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.178+0000 7f7879400640 1 --2- 172.21.15.7:0/1252607571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c0731c0 0x7f787c0add70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f78680097d0 tx=0x7f786802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ca53253b083a272 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.178+0000 7f7878a00640 1 -- 172.21.15.7:0/1252607571 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868037070 con 0x7f787c0731c0 2024-08-19T00:43:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.178+0000 7f7878a00640 1 -- 172.21.15.7:0/1252607571 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786802ae50 con 0x7f787c0731c0 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.178+0000 7f7878a00640 1 -- 172.21.15.7:0/1252607571 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868032660 con 0x7f787c0731c0 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.178+0000 7f7881200640 1 -- 172.21.15.7:0/1252607571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c0731c0 msgr2=0x7f787c0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.178+0000 7f7881200640 1 --2- 172.21.15.7:0/1252607571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c0731c0 0x7f787c0add70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f78680097d0 tx=0x7f786802a100 comp rx=0 tx=0).stop 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.179+0000 7f7881200640 1 -- 172.21.15.7:0/1252607571 shutdown_connections 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.179+0000 7f7881200640 1 --2- 172.21.15.7:0/1252607571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c0731c0 0x7f787c0add70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.179+0000 7f7881200640 1 -- 172.21.15.7:0/1252607571 >> 172.21.15.7:0/1252607571 conn(0x7f787c0b2300 msgr2=0x7f787c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.179+0000 7f7881200640 1 -- 172.21.15.7:0/1252607571 shutdown_connections 2024-08-19T00:43:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.179+0000 7f7881200640 1 -- 172.21.15.7:0/1252607571 wait complete. 2024-08-19T00:43:55.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.180+0000 7f7881200640 1 Processor -- start 2024-08-19T00:43:55.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.180+0000 7f7881200640 1 -- start start 2024-08-19T00:43:55.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.181+0000 7f7881200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f787c0731c0 0x7f787c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.181+0000 7f7881200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787c0ae2b0 0x7f787c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.181+0000 7f7881200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c14d770 0x7f787c1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.181+0000 7f7881200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f787c0ae8a0 con 0x7f787c0731c0 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.181+0000 7f7881200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f787c0ae720 con 0x7f787c0ae2b0 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.181+0000 7f7881200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f787c0b3860 con 0x7f787c14d770 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f787c0731c0 0x7f787c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f787c0731c0 0x7f787c06ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42692/0 (socket says 172.21.15.7:42692) 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 -- 172.21.15.7:0/4204202656 learned_addr learned my addr 172.21.15.7:0/4204202656 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f787a800640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c14d770 0x7f787c1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879400640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787c0ae2b0 0x7f787c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 -- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c14d770 msgr2=0x7f787c1406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c14d770 0x7f787c1406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 -- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787c0ae2b0 msgr2=0x7f787c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787c0ae2b0 0x7f787c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.182+0000 7f7879e00640 1 -- 172.21.15.7:0/4204202656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c14dfe0 con 0x7f787c0731c0 2024-08-19T00:43:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.183+0000 7f7879e00640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f787c0731c0 0x7f787c06ec80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c440 tx=0x7f786c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.183+0000 7f7872000640 1 -- 172.21.15.7:0/4204202656 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c017070 con 0x7f787c0731c0 2024-08-19T00:43:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.183+0000 7f7872000640 1 -- 172.21.15.7:0/4204202656 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c005ce0 con 0x7f787c0731c0 2024-08-19T00:43:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.183+0000 7f7872000640 1 -- 172.21.15.7:0/4204202656 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c007270 con 0x7f787c0731c0 2024-08-19T00:43:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.183+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c155640 con 0x7f787c0731c0 2024-08-19T00:43:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.183+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c06e480 con 0x7f787c0731c0 2024-08-19T00:43:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.184+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c0add70 con 0x7f787c0731c0 2024-08-19T00:43:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.185+0000 7f7872000640 1 -- 172.21.15.7:0/4204202656 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f786c01a070 con 0x7f787c0731c0 2024-08-19T00:43:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.186+0000 7f7872000640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f785c06be30 0x7f785c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.186+0000 7f7872000640 1 -- 172.21.15.7:0/4204202656 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5881+0+0 (secure 0 0 0) 0x7f786c08a1b0 con 0x7f787c0731c0 2024-08-19T00:43:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.186+0000 7f7879400640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f785c06be30 0x7f785c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.187+0000 7f7879400640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f785c06be30 0x7f785c06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7868034000 tx=0x7f786802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.190+0000 7f7872000640 1 -- 172.21.15.7:0/4204202656 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f786c0583c0 con 0x7f787c0731c0 2024-08-19T00:43:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:55.411+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f787c0cfd30 con 0x7f787c0731c0 2024-08-19T00:43:56.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.111+0000 7f7872000640 1 -- 172.21.15.7:0/4204202656 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v96) ==== 162+0+0 (secure 0 0 0) 0x7f786c05c6c0 con 0x7f787c0731c0 2024-08-19T00:43:56.113 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:43:56.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f785c06be30 msgr2=0x7f785c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f785c06be30 0x7f785c06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7868034000 tx=0x7f786802e000 comp rx=0 tx=0).stop 2024-08-19T00:43:56.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f787c0731c0 msgr2=0x7f787c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f787c0731c0 0x7f787c06ec80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c440 tx=0x7f786c00c900 comp rx=0 tx=0).stop 2024-08-19T00:43:56.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 shutdown_connections 2024-08-19T00:43:56.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f785c06be30 0x7f785c06e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f787c14d770 0x7f787c1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787c0ae2b0 0x7f787c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 --2- 172.21.15.7:0/4204202656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f787c0731c0 0x7f787c06ec80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.115+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 >> 172.21.15.7:0/4204202656 conn(0x7f787c0b2300 msgr2=0x7f787c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:56.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.116+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 shutdown_connections 2024-08-19T00:43:56.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.116+0000 7f7881200640 1 -- 172.21.15.7:0/4204202656 wait complete. 2024-08-19T00:43:56.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:43:56.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.299+0000 7f9bdfa00640 1 Processor -- start 2024-08-19T00:43:56.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.299+0000 7f9bdfa00640 1 -- start start 2024-08-19T00:43:56.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.300+0000 7f9bdfa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd80d0ad0 0x7f9bd80ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:56.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.300+0000 7f9bdfa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd806f7f0 con 0x7f9bd80ce500 2024-08-19T00:43:56.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.300+0000 7f9bdfa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd806f510 con 0x7f9bd8159bf0 2024-08-19T00:43:56.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.300+0000 7f9bdfa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd8072980 con 0x7f9bd80d0ad0 2024-08-19T00:43:56.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.301+0000 7f9bd7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9bd80ce500 0x7f9bd80d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36062/0 (socket says 172.21.15.7:36062) 2024-08-19T00:43:56.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.301+0000 7f9bd7e00640 1 -- 172.21.15.7:0/1641615434 learned_addr learned my addr 172.21.15.7:0/1641615434 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:43:56.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.301+0000 7f9bdda00640 1 --2- 172.21.15.7:0/1641615434 >> v2:172.21.15.162:3300/0 conn(0x7f9bd80d0ad0 0x7f9bd80ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:56.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.301+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281850447 0 0) 0x7f9bd806f7f0 con 0x7f9bd80ce500 2024-08-19T00:43:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.301+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc0003520 con 0x7f9bd80ce500 2024-08-19T00:43:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.301+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878107048 0 0) 0x7f9bd806f510 con 0x7f9bd8159bf0 2024-08-19T00:43:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.301+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bd806f7f0 con 0x7f9bd8159bf0 2024-08-19T00:43:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.302+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255062444 0 0) 0x7f9bc0003520 con 0x7f9bd80ce500 2024-08-19T00:43:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.302+0000 7f9bdda00640 1 -- 172.21.15.7:0/1641615434 >> v1:172.21.15.162:6789/0 conn(0x7f9bd8159bf0 legacy=0x7f9bd8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.302+0000 7f9bdda00640 1 -- 172.21.15.7:0/1641615434 >> v1:172.21.15.7:6789/0 conn(0x7f9bd80ce500 legacy=0x7f9bd80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.302+0000 7f9bdda00640 1 -- 172.21.15.7:0/1641615434 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd8072c60 con 0x7f9bd80d0ad0 2024-08-19T00:43:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.303+0000 7f9bdda00640 1 --2- 172.21.15.7:0/1641615434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 0x7f9bd80ce970 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009d90 tx=0x7f9bd002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eaeb56dc55a2a1c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.303+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4001670 con 0x7f9bd80d0ad0 2024-08-19T00:43:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.303+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd0007540 con 0x7f9bd80d0ad0 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.303+0000 7f9bd7400640 1 -- 172.21.15.7:0/1641615434 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0007910 con 0x7f9bd80d0ad0 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.303+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1641615434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 msgr2=0x7f9bd80ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.303+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1641615434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 0x7f9bd80ce970 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009d90 tx=0x7f9bd002a5f0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.304+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1641615434 shutdown_connections 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.304+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1641615434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 0x7f9bd80ce970 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.304+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1641615434 >> 172.21.15.7:0/1641615434 conn(0x7f9bd806bc70 msgr2=0x7f9bd806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.304+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1641615434 shutdown_connections 2024-08-19T00:43:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.304+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1641615434 wait complete. 2024-08-19T00:43:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.305+0000 7f9bdfa00640 1 Processor -- start 2024-08-19T00:43:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.305+0000 7f9bdfa00640 1 -- start start 2024-08-19T00:43:56.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.306+0000 7f9bdfa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ce500 0x7f9bd8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.306+0000 7f9bdfa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 0x7f9bd8150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.306+0000 7f9bdfa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bd8159bf0 0x7f9bd8146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.306+0000 7f9bdfa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd8159fd0 con 0x7f9bd8159bf0 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.306+0000 7f9bdfa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd8073b70 con 0x7f9bd80d0ad0 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.306+0000 7f9bdfa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815a150 con 0x7f9bd80ce500 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bd8159bf0 0x7f9bd8146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bd8159bf0 0x7f9bd8146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42704/0 (socket says 172.21.15.7:42704) 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 -- 172.21.15.7:0/1275239084 learned_addr learned my addr 172.21.15.7:0/1275239084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdd000640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ce500 0x7f9bd8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bd7e00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 0x7f9bd8150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 -- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ce500 msgr2=0x7f9bd8151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ce500 0x7f9bd8151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 -- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 msgr2=0x7f9bd8150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 0x7f9bd8150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 -- 172.21.15.7:0/1275239084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd8152340 con 0x7f9bd8159bf0 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdd000640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ce500 0x7f9bd8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.307+0000 7f9bdda00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bd8159bf0 0x7f9bd8146270 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009d90 tx=0x7f9bd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.308+0000 7f9bd4c00640 1 -- 172.21.15.7:0/1275239084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0040070 con 0x7f9bd8159bf0 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.308+0000 7f9bd4c00640 1 -- 172.21.15.7:0/1275239084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd0031bc0 con 0x7f9bd8159bf0 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.308+0000 7f9bd4c00640 1 -- 172.21.15.7:0/1275239084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0007e90 con 0x7f9bd8159bf0 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.308+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd8150d60 con 0x7f9bd8159bf0 2024-08-19T00:43:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.308+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd8151320 con 0x7f9bd8159bf0 2024-08-19T00:43:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.309+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd8160c00 con 0x7f9bd8159bf0 2024-08-19T00:43:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.310+0000 7f9bd4c00640 1 -- 172.21.15.7:0/1275239084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bd0039040 con 0x7f9bd8159bf0 2024-08-19T00:43:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.311+0000 7f9bd4c00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bb806be30 0x7f9bb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:43:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.311+0000 7f9bd4c00640 1 -- 172.21.15.7:0/1275239084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5881+0+0 (secure 0 0 0) 0x7f9bd00abff0 con 0x7f9bd8159bf0 2024-08-19T00:43:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.311+0000 7f9bdd000640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bb806be30 0x7f9bb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:43:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.312+0000 7f9bdd000640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bb806be30 0x7f9bb806e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0011e0 tx=0x7f9bcc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:43:56.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.316+0000 7f9bd4c00640 1 -- 172.21.15.7:0/1275239084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9bd007a7e0 con 0x7f9bd8159bf0 2024-08-19T00:43:56.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.537+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bd8150a70 con 0x7f9bd8159bf0 2024-08-19T00:43:56.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.538+0000 7f9bd4c00640 1 -- 172.21.15.7:0/1275239084 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) ==== 94+0+5219 (secure 0 0 0) 0x7f9bd007a0e0 con 0x7f9bd8159bf0 2024-08-19T00:43:56.540 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:43:56.540 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":97,"btime":"2024-08-19T00:43:56:115183+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:56.115125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7099":{"gid":7099,"name":"b","rank":0,"incarnation":97,"state":"up:replay","state_seq":1,"addr":"172.21.15.162:6834/3169517259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":3169517259},{"type":"v1","addr":"172.21.15.162:6834","nonce":3169517259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:43:56.540 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 97 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bb806be30 msgr2=0x7f9bb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bb806be30 0x7f9bb806e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0011e0 tx=0x7f9bcc009040 comp rx=0 tx=0).stop 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bd8159bf0 msgr2=0x7f9bd8146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bd8159bf0 0x7f9bd8146270 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009d90 tx=0x7f9bd0004a40 comp rx=0 tx=0).stop 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 shutdown_connections 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bb806be30 0x7f9bb806e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bd8159bf0 0x7f9bd8146270 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd80d0ad0 0x7f9bd8150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 --2- 172.21.15.7:0/1275239084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ce500 0x7f9bd8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:43:56.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 >> 172.21.15.7:0/1275239084 conn(0x7f9bd806bc70 msgr2=0x7f9bd81604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:43:56.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 shutdown_connections 2024-08-19T00:43:56.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:43:56.540+0000 7f9bdfa00640 1 -- 172.21.15.7:0/1275239084 wait complete. 2024-08-19T00:43:56.558 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:43:59.133 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-08-19T00:43:59.132+0000 7f2425600640 -1 log_channel(cluster) log [ERR] : dir 0x600 object missing on disk; some files may be lost (~mds0/stray0) 2024-08-19T00:43:59.133 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-08-19T00:43:59.132+0000 7f2425600640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-08-19T00:43:59.141 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:43:59.139+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:43:59.141 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:43:59.139+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:43:59.558 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-08-19T00:43:59.553+0000 7f242a600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:01.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.725+0000 7fae32400640 1 Processor -- start 2024-08-19T00:44:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.725+0000 7fae32400640 1 -- start start 2024-08-19T00:44:01.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.726+0000 7fae32400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae2c0d03c0 0x7fae2c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:01.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae32400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c0cdfb0 con 0x7fae2c06e710 2024-08-19T00:44:01.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae32400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c0ce290 con 0x7fae2c0b3750 2024-08-19T00:44:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae32400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fae2c0cebc0 con 0x7fae2c0d03c0 2024-08-19T00:44:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae2b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae2c0d03c0 0x7fae2c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae2b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae2c0d03c0 0x7fae2c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42714/0 (socket says 172.21.15.7:42714) 2024-08-19T00:44:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae2b400640 1 -- 172.21.15.7:0/3410072339 learned_addr learned my addr 172.21.15.7:0/3410072339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae2b400640 1 -- 172.21.15.7:0/3410072339 >> v1:172.21.15.162:6789/0 conn(0x7fae2c0b3750 legacy=0x7fae2c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae2b400640 1 -- 172.21.15.7:0/3410072339 >> v1:172.21.15.7:6789/0 conn(0x7fae2c06e710 legacy=0x7fae2c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae2b400640 1 -- 172.21.15.7:0/3410072339 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c0ce570 con 0x7fae2c0d03c0 2024-08-19T00:44:01.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.727+0000 7fae2aa00640 1 -- 172.21.15.7:0/3410072339 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779752881 0 0) 0x7fae2c0cdfb0 con 0x7fae2c06e710 2024-08-19T00:44:01.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.728+0000 7fae2b400640 1 --2- 172.21.15.7:0/3410072339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c071980 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0098a0 tx=0x7fae1c02a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9958af08ba9d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:01.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae2aa00640 1 -- 172.21.15.7:0/3410072339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c037070 con 0x7fae2c0d03c0 2024-08-19T00:44:01.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae2aa00640 1 -- 172.21.15.7:0/3410072339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c032640 con 0x7fae2c0d03c0 2024-08-19T00:44:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae2aa00640 1 -- 172.21.15.7:0/3410072339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c032a10 con 0x7fae2c0d03c0 2024-08-19T00:44:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae32400640 1 -- 172.21.15.7:0/3410072339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 msgr2=0x7fae2c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae32400640 1 --2- 172.21.15.7:0/3410072339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c071980 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0098a0 tx=0x7fae1c02a320 comp rx=0 tx=0).stop 2024-08-19T00:44:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae32400640 1 -- 172.21.15.7:0/3410072339 shutdown_connections 2024-08-19T00:44:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae32400640 1 --2- 172.21.15.7:0/3410072339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c071980 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae32400640 1 -- 172.21.15.7:0/3410072339 >> 172.21.15.7:0/3410072339 conn(0x7fae2c06bc70 msgr2=0x7fae2c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae32400640 1 -- 172.21.15.7:0/3410072339 shutdown_connections 2024-08-19T00:44:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.729+0000 7fae32400640 1 -- 172.21.15.7:0/3410072339 wait complete. 2024-08-19T00:44:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.731+0000 7fae32400640 1 Processor -- start 2024-08-19T00:44:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.731+0000 7fae32400640 1 -- start start 2024-08-19T00:44:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae32400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae2c06e710 0x7fae2c15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae32400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae2c0b3750 0x7fae2c144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae32400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae32400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c073c60 con 0x7fae2c0d03c0 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae32400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c073ae0 con 0x7fae2c06e710 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae32400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fae2c0b3be0 con 0x7fae2c0b3750 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c0c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42716/0 (socket says 172.21.15.7:42716) 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae2be00640 1 -- 172.21.15.7:0/1900165775 learned_addr learned my addr 172.21.15.7:0/1900165775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae2b400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae2c06e710 0x7fae2c15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.732+0000 7fae23e00640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae2c0b3750 0x7fae2c144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae2be00640 1 -- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae2c0b3750 msgr2=0x7fae2c144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae2be00640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae2c0b3750 0x7fae2c144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae2be00640 1 -- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae2c06e710 msgr2=0x7fae2c15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae2be00640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae2c06e710 0x7fae2c15bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae2be00640 1 -- 172.21.15.7:0/1900165775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c0995d0 con 0x7fae2c0d03c0 2024-08-19T00:44:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae2be00640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c0c9390 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c7a0 tx=0x7fae2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae23400640 1 -- 172.21.15.7:0/1900165775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24003b70 con 0x7fae2c0d03c0 2024-08-19T00:44:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae23400640 1 -- 172.21.15.7:0/1900165775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae24003d30 con 0x7fae2c0d03c0 2024-08-19T00:44:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.733+0000 7fae23400640 1 -- 172.21.15.7:0/1900165775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2400aa90 con 0x7fae2c0d03c0 2024-08-19T00:44:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.734+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c0af2e0 con 0x7fae2c0d03c0 2024-08-19T00:44:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.734+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c099280 con 0x7fae2c0d03c0 2024-08-19T00:44:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.735+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c071980 con 0x7fae2c0d03c0 2024-08-19T00:44:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.736+0000 7fae23400640 1 -- 172.21.15.7:0/1900165775 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae2400ac30 con 0x7fae2c0d03c0 2024-08-19T00:44:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.736+0000 7fae23400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fae0806be60 0x7fae0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.737+0000 7fae23400640 1 -- 172.21.15.7:0/1900165775 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7fae2408add0 con 0x7fae2c0d03c0 2024-08-19T00:44:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.737+0000 7fae2b400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fae0806be60 0x7fae0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.738+0000 7fae2b400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fae0806be60 0x7fae0806e320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fae1c034000 tx=0x7fae1c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:01.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.741+0000 7fae23400640 1 -- 172.21.15.7:0/1900165775 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fae24058f90 con 0x7fae2c0d03c0 2024-08-19T00:44:01.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.963+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae2c0ad650 con 0x7fae2c0d03c0 2024-08-19T00:44:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.963+0000 7fae23400640 1 -- 172.21.15.7:0/1900165775 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+4384 (secure 0 0 0) 0x7fae2405d290 con 0x7fae2c0d03c0 2024-08-19T00:44:01.965 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:01.965 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"btime":"2024-08-19T00:43:59:140214+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:59.140208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-08-19T00:44:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fae0806be60 msgr2=0x7fae0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fae0806be60 0x7fae0806e320 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fae1c034000 tx=0x7fae1c02e000 comp rx=0 tx=0).stop 2024-08-19T00:44:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 msgr2=0x7fae2c0c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c0c9390 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c7a0 tx=0x7fae2400cc60 comp rx=0 tx=0).stop 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 shutdown_connections 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fae0806be60 0x7fae0806e320 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae2c0d03c0 0x7fae2c0c9390 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae2c0b3750 0x7fae2c144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 --2- 172.21.15.7:0/1900165775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae2c06e710 0x7fae2c15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.965+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 >> 172.21.15.7:0/1900165775 conn(0x7fae2c06bc70 msgr2=0x7fae2c0ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.966+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 shutdown_connections 2024-08-19T00:44:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:01.966+0000 7fae32400640 1 -- 172.21.15.7:0/1900165775 wait complete. 2024-08-19T00:44:01.983 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:44:01.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.138+0000 7f4638a00640 1 Processor -- start 2024-08-19T00:44:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.138+0000 7f4638a00640 1 -- start start 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4638a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4634159bf0 0x7f4634073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4638a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46340cec10 0x7f46340d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4638a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463406f7f0 con 0x7f46340739a0 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4638a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f463406f510 con 0x7f4634159bf0 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4638a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4634072980 con 0x7f46340cec10 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4631e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4634159bf0 0x7f4634073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4631e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4634159bf0 0x7f4634073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42720/0 (socket says 172.21.15.7:42720) 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4631e00640 1 -- 172.21.15.7:0/3177600850 learned_addr learned my addr 172.21.15.7:0/3177600850 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:02.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.139+0000 7f4632800640 1 --2- 172.21.15.7:0/3177600850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46340cec10 0x7f46340d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.140+0000 7f4631e00640 1 -- 172.21.15.7:0/3177600850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46340cec10 msgr2=0x7f46340d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:02.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.140+0000 7f4631e00640 1 --2- 172.21.15.7:0/3177600850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46340cec10 0x7f46340d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.140+0000 7f4631e00640 1 -- 172.21.15.7:0/3177600850 >> v1:172.21.15.162:6789/0 conn(0x7f46340739a0 legacy=0x7f46340ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.140+0000 7f4631e00640 1 -- 172.21.15.7:0/3177600850 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4634072c60 con 0x7f4634159bf0 2024-08-19T00:44:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.141+0000 7f4631e00640 1 --2- 172.21.15.7:0/3177600850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4634159bf0 0x7f4634073460 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f4624009870 tx=0x7f462402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc41153ed8b2c337 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.141+0000 7f4631400640 1 -- 172.21.15.7:0/3177600850 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624037070 con 0x7f4634159bf0 2024-08-19T00:44:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.141+0000 7f4631400640 1 -- 172.21.15.7:0/3177600850 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4624032440 con 0x7f4634159bf0 2024-08-19T00:44:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.141+0000 7f4631400640 1 -- 172.21.15.7:0/3177600850 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624032810 con 0x7f4634159bf0 2024-08-19T00:44:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.141+0000 7f4638a00640 1 -- 172.21.15.7:0/3177600850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4634159bf0 msgr2=0x7f4634073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.141+0000 7f4638a00640 1 --2- 172.21.15.7:0/3177600850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4634159bf0 0x7f4634073460 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f4624009870 tx=0x7f462402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.142+0000 7f4638a00640 1 -- 172.21.15.7:0/3177600850 shutdown_connections 2024-08-19T00:44:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.142+0000 7f4638a00640 1 --2- 172.21.15.7:0/3177600850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46340cec10 0x7f46340d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.142+0000 7f4638a00640 1 --2- 172.21.15.7:0/3177600850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4634159bf0 0x7f4634073460 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.142+0000 7f4638a00640 1 -- 172.21.15.7:0/3177600850 >> 172.21.15.7:0/3177600850 conn(0x7f463406bc70 msgr2=0x7f463406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.142+0000 7f4638a00640 1 -- 172.21.15.7:0/3177600850 shutdown_connections 2024-08-19T00:44:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.142+0000 7f4638a00640 1 -- 172.21.15.7:0/3177600850 wait complete. 2024-08-19T00:44:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.143+0000 7f4638a00640 1 Processor -- start 2024-08-19T00:44:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.143+0000 7f4638a00640 1 -- start start 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.144+0000 7f4638a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46340739a0 0x7f463414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.144+0000 7f4638a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4634159bf0 0x7f463415e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.144+0000 7f4638a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f463414d960 0x7f463415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.144+0000 7f4638a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f463415a150 con 0x7f46340739a0 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.144+0000 7f4638a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4634159fd0 con 0x7f4634159bf0 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.144+0000 7f4638a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46340d0900 con 0x7f463414d960 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.144+0000 7f4631e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46340739a0 0x7f463414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46340739a0 0x7f463414f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42730/0 (socket says 172.21.15.7:42730) 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 -- 172.21.15.7:0/3302463743 learned_addr learned my addr 172.21.15.7:0/3302463743 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4632800640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f463414d960 0x7f463415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f462be00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4634159bf0 0x7f463415e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 -- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f463414d960 msgr2=0x7f463415ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f463414d960 0x7f463415ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 -- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4634159bf0 msgr2=0x7f463415e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4634159bf0 0x7f463415e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 -- 172.21.15.7:0/3302463743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463409d990 con 0x7f46340739a0 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f462be00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4634159bf0 0x7f463415e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.145+0000 7f4631e00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46340739a0 0x7f463414f900 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4624000c00 tx=0x7f46240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.146+0000 7f462a000640 1 -- 172.21.15.7:0/3302463743 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624037040 con 0x7f46340739a0 2024-08-19T00:44:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.146+0000 7f462a000640 1 -- 172.21.15.7:0/3302463743 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4624042070 con 0x7f46340739a0 2024-08-19T00:44:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.146+0000 7f462a000640 1 -- 172.21.15.7:0/3302463743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624030880 con 0x7f46340739a0 2024-08-19T00:44:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.146+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463409dc70 con 0x7f46340739a0 2024-08-19T00:44:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.146+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463414dff0 con 0x7f46340739a0 2024-08-19T00:44:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.147+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4634068c00 con 0x7f46340739a0 2024-08-19T00:44:02.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.150+0000 7f462a000640 1 -- 172.21.15.7:0/3302463743 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f462402ad10 con 0x7f46340739a0 2024-08-19T00:44:02.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.151+0000 7f462a000640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f461006be80 0x7f461006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.151+0000 7f462a000640 1 -- 172.21.15.7:0/3302463743 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7f46240abf40 con 0x7f46340739a0 2024-08-19T00:44:02.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.151+0000 7f462be00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f461006be80 0x7f461006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.152+0000 7f462be00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f461006be80 0x7f461006e340 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f463415bd90 tx=0x7f461c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:02.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.154+0000 7f462a000640 1 -- 172.21.15.7:0/3302463743 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f462407a8f0 con 0x7f46340739a0 2024-08-19T00:44:02.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:44:02.270 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:44:02.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.375+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46340d0cd0 con 0x7f46340739a0 2024-08-19T00:44:02.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.376+0000 7f462a000640 1 -- 172.21.15.7:0/3302463743 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+4384 (secure 0 0 0) 0x7f462407a1f0 con 0x7f46340739a0 2024-08-19T00:44:02.378 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:02.378 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"btime":"2024-08-19T00:43:59:140214+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:59.140208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-08-19T00:44:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f461006be80 msgr2=0x7f461006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f461006be80 0x7f461006e340 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f463415bd90 tx=0x7f461c009040 comp rx=0 tx=0).stop 2024-08-19T00:44:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46340739a0 msgr2=0x7f463414f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46340739a0 0x7f463414f900 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4624000c00 tx=0x7f46240046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 shutdown_connections 2024-08-19T00:44:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f461006be80 0x7f461006e340 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f463414d960 0x7f463415ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4634159bf0 0x7f463415e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 --2- 172.21.15.7:0/3302463743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46340739a0 0x7f463414f900 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 >> 172.21.15.7:0/3302463743 conn(0x7f463406bc70 msgr2=0x7f46340cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 shutdown_connections 2024-08-19T00:44:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.378+0000 7f4638a00640 1 -- 172.21.15.7:0/3302463743 wait complete. 2024-08-19T00:44:02.397 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:02.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.591+0000 7fe2afe00640 1 Processor -- start 2024-08-19T00:44:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.592+0000 7fe2afe00640 1 -- start start 2024-08-19T00:44:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.593+0000 7fe2afe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 0x7fe2b006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.593+0000 7fe2afe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b006df60 con 0x7fe2b015bd70 2024-08-19T00:44:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.593+0000 7fe2afe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b0073140 con 0x7fe2b015cca0 2024-08-19T00:44:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.593+0000 7fe2afe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b00733f0 con 0x7fe2b006d600 2024-08-19T00:44:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.593+0000 7fe2aea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe2b015bd70 0x7fe2b0072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36086/0 (socket says 172.21.15.7:36086) 2024-08-19T00:44:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.593+0000 7fe2aea00640 1 -- 172.21.15.7:0/1016289746 learned_addr learned my addr 172.21.15.7:0/1016289746 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.593+0000 7fe2a7e00640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 0x7fe2b006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874038846 0 0) 0x7fe2b006df60 con 0x7fe2b015bd70 2024-08-19T00:44:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe294003520 con 0x7fe2b015bd70 2024-08-19T00:44:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075011642 0 0) 0x7fe2b0073140 con 0x7fe2b015cca0 2024-08-19T00:44:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b006df60 con 0x7fe2b015cca0 2024-08-19T00:44:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4151209987 0 0) 0x7fe294003520 con 0x7fe2b015bd70 2024-08-19T00:44:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 msgr2=0x7fe2b006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 0x7fe2b006da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 >> v1:172.21.15.162:6789/0 conn(0x7fe2b015cca0 legacy=0x7fe2b015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b00736d0 con 0x7fe2b015bd70 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fe2a0001670 con 0x7fe2b015bd70 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 >> v1:172.21.15.7:6789/0 conn(0x7fe2b015bd70 legacy=0x7fe2b0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 0x7fe294003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe294004120 0x7fe294004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe294004d40 0x7fe2940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b00733f0 con 0x7fe294004d40 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe29400bb00 con 0x7fe294004120 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe29400bd00 con 0x7fe2b006d600 2024-08-19T00:44:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2af400640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe294004d40 0x7fe2940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.594+0000 7fe2aea00640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 0x7fe294003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.595+0000 7fe2a7e00640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe294004120 0x7fe294004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.595+0000 7fe2af400640 1 -- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 msgr2=0x7fe294003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.595+0000 7fe2af400640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b006d600 0x7fe294003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.595+0000 7fe2af400640 1 -- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe294004120 msgr2=0x7fe294004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.595+0000 7fe2af400640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe294004120 0x7fe294004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.595+0000 7fe2af400640 1 -- 172.21.15.7:0/1016289746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe294003520 con 0x7fe294004d40 2024-08-19T00:44:02.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.596+0000 7fe2af400640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe294004d40 0x7fe2940051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8001fd0 tx=0x7fe294005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaa2db2b29598ea server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:02.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.596+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8001bf0 con 0x7fe294004d40 2024-08-19T00:44:02.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.596+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8003b70 con 0x7fe294004d40 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.596+0000 7fe2ae000640 1 -- 172.21.15.7:0/1016289746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80050d0 con 0x7fe294004d40 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.597+0000 7fe2afe00640 1 -- 172.21.15.7:0/1016289746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe294004d40 msgr2=0x7fe2940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.597+0000 7fe2afe00640 1 --2- 172.21.15.7:0/1016289746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe294004d40 0x7fe2940051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8001fd0 tx=0x7fe294005830 comp rx=0 tx=0).stop 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.597+0000 7fe2af400640 1 -- 172.21.15.7:0/1016289746 reap_dead start 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.597+0000 7fe2afe00640 1 -- 172.21.15.7:0/1016289746 shutdown_connections 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.597+0000 7fe2afe00640 1 -- 172.21.15.7:0/1016289746 >> 172.21.15.7:0/1016289746 conn(0x7fe2b006b850 msgr2=0x7fe2b006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.597+0000 7fe2afe00640 1 -- 172.21.15.7:0/1016289746 shutdown_connections 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.597+0000 7fe2afe00640 1 -- 172.21.15.7:0/1016289746 wait complete. 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.599+0000 7fe2afe00640 1 Processor -- start 2024-08-19T00:44:02.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.599+0000 7fe2afe00640 1 -- start start 2024-08-19T00:44:02.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b01f4bd0 0x7fe2b00addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2afe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b01f4fb0 0x7fe2b00ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2afe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2b01e7190 0x7fe2b01e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2afe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b015c780 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2afe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b015c4a0 con 0x7fe2b01e7190 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2afe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b015c150 con 0x7fe2b01f4fb0 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b01f4bd0 0x7fe2b00addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b01f4bd0 0x7fe2b00addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42744/0 (socket says 172.21.15.7:42744) 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 -- 172.21.15.7:0/984895793 learned_addr learned my addr 172.21.15.7:0/984895793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2a7e00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b01f4fb0 0x7fe2b00ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2af400640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2b01e7190 0x7fe2b01e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 -- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b01f4fb0 msgr2=0x7fe2b00ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b01f4fb0 0x7fe2b00ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 -- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2b01e7190 msgr2=0x7fe2b01e7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2b01e7190 0x7fe2b01e7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2aea00640 1 -- 172.21.15.7:0/984895793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b00abce0 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2a7e00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b01f4fb0 0x7fe2b00ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.600+0000 7fe2af400640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2b01e7190 0x7fe2b01e7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.601+0000 7fe2aea00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b01f4bd0 0x7fe2b00addd0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0004840 tx=0x7fe2a0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.601+0000 7fe2a6a00640 1 -- 172.21.15.7:0/984895793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000f940 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.601+0000 7fe2a6a00640 1 -- 172.21.15.7:0/984895793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a0018070 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.601+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b00abf60 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.601+0000 7fe2a6a00640 1 -- 172.21.15.7:0/984895793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000fd60 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.601+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b00ac520 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.602+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b006e3a0 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.603+0000 7fe2a6a00640 1 -- 172.21.15.7:0/984895793 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2a001d460 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.604+0000 7fe2a6a00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe28c06be30 0x7fe28c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.604+0000 7fe2a6a00640 1 -- 172.21.15.7:0/984895793 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7fe2a008b0e0 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.604+0000 7fe2a7e00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe28c06be30 0x7fe28c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:02.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.605+0000 7fe2a7e00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe28c06be30 0x7fe28c06e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe2b01e7e70 tx=0x7fe298008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.608+0000 7fe2a6a00640 1 -- 172.21.15.7:0/984895793 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe2b00abce0 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.828+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2b01e2480 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.828+0000 7fe2a6a00640 1 -- 172.21.15.7:0/984895793 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+4384 (secure 0 0 0) 0x7fe2a00598f0 con 0x7fe2b01f4bd0 2024-08-19T00:44:02.830 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:02.830 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"btime":"2024-08-19T00:43:59:140214+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2458713155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2458713155},{"type":"v1","addr":"172.21.15.7:6837","nonce":2458713155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:43:59.140208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:02.831 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.830+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe28c06be30 msgr2=0x7fe28c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.830+0000 7fe2afe00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe28c06be30 0x7fe28c06e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe2b01e7e70 tx=0x7fe298008040 comp rx=0 tx=0).stop 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.830+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b01f4bd0 msgr2=0x7fe2b00addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.830+0000 7fe2afe00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b01f4bd0 0x7fe2b00addd0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0004840 tx=0x7fe2a0007720 comp rx=0 tx=0).stop 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 shutdown_connections 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe28c06be30 0x7fe28c06e2f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2b01e7190 0x7fe2b01e7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2b01f4fb0 0x7fe2b00ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 --2- 172.21.15.7:0/984895793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b01f4bd0 0x7fe2b00addd0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 >> 172.21.15.7:0/984895793 conn(0x7fe2b006b850 msgr2=0x7fe2b00b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 shutdown_connections 2024-08-19T00:44:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:02.831+0000 7fe2afe00640 1 -- 172.21.15.7:0/984895793 wait complete. 2024-08-19T00:44:02.849 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 600.00000000' led to DAMAGED state 2024-08-19T00:44:02.849 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 1.00000000.inode' 2024-08-19T00:44:02.849 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:02.849 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:02.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:44:02.885 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:02.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:02.885 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:02.960 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:44:02.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:44:02.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:03.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.158+0000 7fb6b5000640 1 Processor -- start 2024-08-19T00:44:03.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.158+0000 7fb6b5000640 1 -- start start 2024-08-19T00:44:03.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.159+0000 7fb6b5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b00d27b0 0x7fb6b00d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:03.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.159+0000 7fb6b5000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b00d3110 con 0x7fb6b00b4150 2024-08-19T00:44:03.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.159+0000 7fb6b5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b00b4df0 con 0x7fb6b015e3e0 2024-08-19T00:44:03.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.159+0000 7fb6b5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00b50d0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.159+0000 7fb6afe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb6b00b4150 0x7fb6b00b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36100/0 (socket says 172.21.15.7:36100) 2024-08-19T00:44:03.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.159+0000 7fb6afe00640 1 -- 172.21.15.7:0/3159105534 learned_addr learned my addr 172.21.15.7:0/3159105534 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:03.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.160+0000 7fb6aea00640 1 --2- 172.21.15.7:0/3159105534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b00d27b0 0x7fb6b00d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.160+0000 7fb6ae000640 1 -- 172.21.15.7:0/3159105534 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651993333 0 0) 0x7fb6b00d3110 con 0x7fb6b00b4150 2024-08-19T00:44:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.160+0000 7fb6ae000640 1 -- 172.21.15.7:0/3159105534 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb694003520 con 0x7fb6b00b4150 2024-08-19T00:44:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.160+0000 7fb6ae000640 1 -- 172.21.15.7:0/3159105534 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2629700652 0 0) 0x7fb694003520 con 0x7fb6b00b4150 2024-08-19T00:44:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.160+0000 7fb6aea00640 1 -- 172.21.15.7:0/3159105534 >> v1:172.21.15.162:6789/0 conn(0x7fb6b015e3e0 legacy=0x7fb6b00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.160+0000 7fb6aea00640 1 -- 172.21.15.7:0/3159105534 >> v1:172.21.15.7:6789/0 conn(0x7fb6b00b4150 legacy=0x7fb6b00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.160+0000 7fb6aea00640 1 -- 172.21.15.7:0/3159105534 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b00cf1e0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.161+0000 7fb6aea00640 1 --2- 172.21.15.7:0/3159105534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b00d27b0 0x7fb6b00d2bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0097d0 tx=0x7fb69c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca9582d4912def37 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:03.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6ae000640 1 -- 172.21.15.7:0/3159105534 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c037070 con 0x7fb6b00d27b0 2024-08-19T00:44:03.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6ae000640 1 -- 172.21.15.7:0/3159105534 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c02ac30 con 0x7fb6b00d27b0 2024-08-19T00:44:03.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6ae000640 1 -- 172.21.15.7:0/3159105534 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80019f0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6b5000640 1 -- 172.21.15.7:0/3159105534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b00d27b0 msgr2=0x7fb6b00d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6b5000640 1 --2- 172.21.15.7:0/3159105534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b00d27b0 0x7fb6b00d2bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0097d0 tx=0x7fb69c02a1a0 comp rx=0 tx=0).stop 2024-08-19T00:44:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6b5000640 1 -- 172.21.15.7:0/3159105534 shutdown_connections 2024-08-19T00:44:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6b5000640 1 --2- 172.21.15.7:0/3159105534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b00d27b0 0x7fb6b00d2bd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6b5000640 1 -- 172.21.15.7:0/3159105534 >> 172.21.15.7:0/3159105534 conn(0x7fb6b008dbe0 msgr2=0x7fb6b009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:03.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.162+0000 7fb6b5000640 1 -- 172.21.15.7:0/3159105534 shutdown_connections 2024-08-19T00:44:03.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.163+0000 7fb6b5000640 1 -- 172.21.15.7:0/3159105534 wait complete. 2024-08-19T00:44:03.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.164+0000 7fb6b5000640 1 Processor -- start 2024-08-19T00:44:03.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.164+0000 7fb6b5000640 1 -- start start 2024-08-19T00:44:03.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6b5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6b00b4150 0x7fb6b0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:03.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6b5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6b00d27b0 0x7fb6b015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:03.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6b5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b015e3e0 0x7fb6b00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6b5000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00cf9e0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6b5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00cee90 con 0x7fb6b00b4150 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6b5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00cfb60 con 0x7fb6b015e3e0 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6aea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6b00d27b0 0x7fb6b015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6aea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6b00d27b0 0x7fb6b015fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42746/0 (socket says 172.21.15.7:42746) 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.165+0000 7fb6aea00640 1 -- 172.21.15.7:0/1287129829 learned_addr learned my addr 172.21.15.7:0/1287129829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6afe00640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b015e3e0 0x7fb6b00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6af400640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6b00b4150 0x7fb6b0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6aea00640 1 -- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b015e3e0 msgr2=0x7fb6b00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6aea00640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b015e3e0 0x7fb6b00cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6aea00640 1 -- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6b00b4150 msgr2=0x7fb6b0156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6aea00640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6b00b4150 0x7fb6b0156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:03.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6aea00640 1 -- 172.21.15.7:0/1287129829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b00cbc10 con 0x7fb6b00d27b0 2024-08-19T00:44:03.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6af400640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6b00b4150 0x7fb6b0156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:03.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6aea00640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6b00d27b0 0x7fb6b015fdf0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb69c035040 tx=0x7fb69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6a7400640 1 -- 172.21.15.7:0/1287129829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c041020 con 0x7fb6b00d27b0 2024-08-19T00:44:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6a7400640 1 -- 172.21.15.7:0/1287129829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c03d640 con 0x7fb6b00d27b0 2024-08-19T00:44:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b01572f0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6a7400640 1 -- 172.21.15.7:0/1287129829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c037040 con 0x7fb6b00d27b0 2024-08-19T00:44:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.166+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b00cb930 con 0x7fb6b00d27b0 2024-08-19T00:44:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.167+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b00b19b0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.168+0000 7fb6a7400640 1 -- 172.21.15.7:0/1287129829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb69c044020 con 0x7fb6b00d27b0 2024-08-19T00:44:03.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.169+0000 7fb6a7400640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb69006be30 0x7fb69006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:03.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.169+0000 7fb6a7400640 1 -- 172.21.15.7:0/1287129829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7fb69c0ab640 con 0x7fb6b00d27b0 2024-08-19T00:44:03.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.169+0000 7fb6af400640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb69006be30 0x7fb69006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:03.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.170+0000 7fb6af400640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb69006be30 0x7fb69006e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00015e0 tx=0x7fb6a0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:03.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.174+0000 7fb6a7400640 1 -- 172.21.15.7:0/1287129829 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb6b00b19b0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:03.393+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb6b00b22f0 con 0x7fb6b00d27b0 2024-08-19T00:44:03.887 INFO:tasks.ceph.mds.b.smithi162.stderr: -48> 2024-08-19T00:43:59.132+0000 7f2425600640 -1 log_channel(cluster) log [ERR] : dir 0x600 object missing on disk; some files may be lost (~mds0/stray0) 2024-08-19T00:44:03.888 INFO:tasks.ceph.mds.b.smithi162.stderr: -46> 2024-08-19T00:43:59.132+0000 7f2425600640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-08-19T00:44:03.888 INFO:tasks.ceph.mds.b.smithi162.stderr: -34> 2024-08-19T00:43:59.553+0000 7f242a600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:03.930 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:44:04.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.164+0000 7fb6a7400640 1 -- 172.21.15.7:0/1287129829 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) ==== 161+0+0 (secure 0 0 0) 0x7fb69c04b030 con 0x7fb6b00d27b0 2024-08-19T00:44:04.166 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb69006be30 msgr2=0x7fb69006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb69006be30 0x7fb69006e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00015e0 tx=0x7fb6a0009040 comp rx=0 tx=0).stop 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6b00d27b0 msgr2=0x7fb6b015fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6b00d27b0 0x7fb6b015fdf0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb69c035040 tx=0x7fb69c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 shutdown_connections 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb69006be30 0x7fb69006e2f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6b015e3e0 0x7fb6b00cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6b00d27b0 0x7fb6b015fdf0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 --2- 172.21.15.7:0/1287129829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6b00b4150 0x7fb6b0156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 >> 172.21.15.7:0/1287129829 conn(0x7fb6b008dbe0 msgr2=0x7fb6b00cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:04.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 shutdown_connections 2024-08-19T00:44:04.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.167+0000 7fb6b5000640 1 -- 172.21.15.7:0/1287129829 wait complete. 2024-08-19T00:44:04.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:04.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.349+0000 7fba5a800640 1 Processor -- start 2024-08-19T00:44:04.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.349+0000 7fba5a800640 1 -- start start 2024-08-19T00:44:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.350+0000 7fba5a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fba5406e710 0x7fba54071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.350+0000 7fba5a800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba540cdfb0 con 0x7fba540b3750 2024-08-19T00:44:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.350+0000 7fba5a800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba540ce290 con 0x7fba540d03c0 2024-08-19T00:44:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.350+0000 7fba5a800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fba540cebc0 con 0x7fba5406e710 2024-08-19T00:44:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.350+0000 7fba53e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fba540b3750 0x7fba540cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52094/0 (socket says 172.21.15.7:52094) 2024-08-19T00:44:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.350+0000 7fba53e00640 1 -- 172.21.15.7:0/3991077648 learned_addr learned my addr 172.21.15.7:0/3991077648 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:04.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52a00640 1 --2- 172.21.15.7:0/3991077648 >> v2:172.21.15.162:3300/0 conn(0x7fba5406e710 0x7fba54071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092393968 0 0) 0x7fba540cdfb0 con 0x7fba540b3750 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba38005730 con 0x7fba540b3750 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586253911 0 0) 0x7fba540ce290 con 0x7fba540d03c0 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba540cdfb0 con 0x7fba540d03c0 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1741336648 0 0) 0x7fba38005730 con 0x7fba540b3750 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 >> v2:172.21.15.162:3300/0 conn(0x7fba5406e710 msgr2=0x7fba54071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 --2- 172.21.15.7:0/3991077648 >> v2:172.21.15.162:3300/0 conn(0x7fba5406e710 0x7fba54071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 >> v1:172.21.15.162:6789/0 conn(0x7fba540d03c0 legacy=0x7fba540d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba540ce570 con 0x7fba540b3750 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fba4c0019f0 con 0x7fba540b3750 2024-08-19T00:44:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52a00640 1 --2- 172.21.15.7:0/3991077648 >> v2:172.21.15.162:3300/0 conn(0x7fba5406e710 0x7fba54071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 >> v1:172.21.15.7:6789/0 conn(0x7fba540b3750 legacy=0x7fba540cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba38005d80 0x7fba38006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba38006a10 0x7fba38006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba3800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba540cebc0 con 0x7fba380073d0 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba3800e270 con 0x7fba38006a10 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.351+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba3800e470 con 0x7fba38005d80 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53e00640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba3800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53400640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba38005d80 0x7fba38006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba52a00640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba38006a10 0x7fba38006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53e00640 1 -- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba38005d80 msgr2=0x7fba38006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53e00640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba38005d80 0x7fba38006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53e00640 1 -- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba38006a10 msgr2=0x7fba38006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53e00640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba38006a10 0x7fba38006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53e00640 1 -- 172.21.15.7:0/3991077648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba38005730 con 0x7fba380073d0 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.352+0000 7fba53400640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba38005d80 0x7fba38006180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.353+0000 7fba53e00640 1 -- 172.21.15.7:0/3991077648 reap_dead start 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.353+0000 7fba53e00640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba3800dbd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00a820 tx=0x7fba38007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e450c26cd2d97531 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.353+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00a450 con 0x7fba380073d0 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.353+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c02f070 con 0x7fba380073d0 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.353+0000 7fba52000640 1 -- 172.21.15.7:0/3991077648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c02bc90 con 0x7fba380073d0 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.354+0000 7fba5a800640 1 -- 172.21.15.7:0/3991077648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 msgr2=0x7fba3800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.354+0000 7fba5a800640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba3800dbd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00a820 tx=0x7fba38007a40 comp rx=0 tx=0).stop 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.354+0000 7fba5a800640 1 -- 172.21.15.7:0/3991077648 shutdown_connections 2024-08-19T00:44:04.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.354+0000 7fba5a800640 1 --2- 172.21.15.7:0/3991077648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba3800dbd0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.354+0000 7fba5a800640 1 -- 172.21.15.7:0/3991077648 >> 172.21.15.7:0/3991077648 conn(0x7fba5406bc70 msgr2=0x7fba5406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:04.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.354+0000 7fba5a800640 1 -- 172.21.15.7:0/3991077648 shutdown_connections 2024-08-19T00:44:04.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.354+0000 7fba5a800640 1 -- 172.21.15.7:0/3991077648 wait complete. 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.356+0000 7fba5a800640 1 Processor -- start 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.356+0000 7fba5a800640 1 -- start start 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba5a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba5415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba5a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba5406dc20 0x7fba541f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba5a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba541f11b0 0x7fba540cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba5a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba54073c60 con 0x7fba380073d0 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba5a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba54073ae0 con 0x7fba541f11b0 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba5a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba540b3be0 con 0x7fba5406dc20 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba53400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba5415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba53400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba5415c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47512/0 (socket says 172.21.15.7:47512) 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba53400640 1 -- 172.21.15.7:0/2362262342 learned_addr learned my addr 172.21.15.7:0/2362262342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba53e00640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba541f11b0 0x7fba540cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.357+0000 7fba52a00640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba5406dc20 0x7fba541f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba53400640 1 -- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba5406dc20 msgr2=0x7fba541f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba53400640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba5406dc20 0x7fba541f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba53400640 1 -- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba541f11b0 msgr2=0x7fba540cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba53400640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba541f11b0 0x7fba540cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba53400640 1 -- 172.21.15.7:0/2362262342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5406e0a0 con 0x7fba380073d0 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba53e00640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba541f11b0 0x7fba540cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba53400640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba5415c850 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fba4400e570 tx=0x7fba4400ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba4b400640 1 -- 172.21.15.7:0/2362262342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba440052e0 con 0x7fba380073d0 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba4b400640 1 -- 172.21.15.7:0/2362262342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba44005480 con 0x7fba380073d0 2024-08-19T00:44:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba4b400640 1 -- 172.21.15.7:0/2362262342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44007020 con 0x7fba380073d0 2024-08-19T00:44:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba541f4500 con 0x7fba380073d0 2024-08-19T00:44:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.358+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba541f4ac0 con 0x7fba380073d0 2024-08-19T00:44:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.360+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba540ce290 con 0x7fba380073d0 2024-08-19T00:44:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.360+0000 7fba4b400640 1 -- 172.21.15.7:0/2362262342 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba4401a020 con 0x7fba380073d0 2024-08-19T00:44:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.361+0000 7fba4b400640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba3406be60 0x7fba3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.361+0000 7fba4b400640 1 -- 172.21.15.7:0/2362262342 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7fba4408a780 con 0x7fba380073d0 2024-08-19T00:44:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.362+0000 7fba52a00640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba3406be60 0x7fba3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.362+0000 7fba52a00640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba3406be60 0x7fba3406e320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba54144f80 tx=0x7fba40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.365+0000 7fba4b400640 1 -- 172.21.15.7:0/2362262342 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fba44058f00 con 0x7fba380073d0 2024-08-19T00:44:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:04.619+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fba54072f30 con 0x7fba380073d0 2024-08-19T00:44:05.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.165+0000 7fba4b400640 1 -- 172.21.15.7:0/2362262342 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v103) ==== 101+0+0 (secure 0 0 0) 0x7fba44058800 con 0x7fba380073d0 2024-08-19T00:44:05.167 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:44:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba3406be60 msgr2=0x7fba3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba3406be60 0x7fba3406e320 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba54144f80 tx=0x7fba40008040 comp rx=0 tx=0).stop 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 msgr2=0x7fba5415c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba5415c850 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fba4400e570 tx=0x7fba4400ea30 comp rx=0 tx=0).stop 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 shutdown_connections 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba3406be60 0x7fba3406e320 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba541f11b0 0x7fba540cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba5406dc20 0x7fba541f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 --2- 172.21.15.7:0/2362262342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba380073d0 0x7fba5415c850 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 >> 172.21.15.7:0/2362262342 conn(0x7fba5406bc70 msgr2=0x7fba540acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.168+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 shutdown_connections 2024-08-19T00:44:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.169+0000 7fba5a800640 1 -- 172.21.15.7:0/2362262342 wait complete. 2024-08-19T00:44:05.189 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.266+0000 7f4e75234f40 1 Processor -- start 2024-08-19T00:44:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.266+0000 7f4e75234f40 1 -- start start 2024-08-19T00:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.267+0000 7f4e75234f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e58003630 0x564f362feec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.267+0000 7f4e75234f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.267+0000 7f4e75234f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f36256180 0x564f36256600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.267+0000 7f4e75234f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f361ced00 con 0x564f362f7c00 2024-08-19T00:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.267+0000 7f4e75234f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f361d2d40 con 0x564f36256180 2024-08-19T00:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.267+0000 7f4e75234f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564f362ffdc0 con 0x7f4e58003630 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.267+0000 7f4e71a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47528/0 (socket says 172.21.15.7:47528) 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 -- 172.21.15.7:0/845414114 learned_addr learned my addr 172.21.15.7:0/845414114 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e72400640 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e58003630 0x564f362feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e72e00640 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f36256180 0x564f36256600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 -- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e58003630 msgr2=0x564f362feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e58003630 0x564f362feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 -- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f36256180 msgr2=0x564f36256600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f36256180 0x564f36256600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 -- 172.21.15.7:0/845414114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f36190080 con 0x564f362f7c00 2024-08-19T00:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e71a00640 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f8080 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009690 tx=0x7f4e60009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8719704d11d43361 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.268+0000 7f4e6be00640 1 -- 172.21.15.7:0/845414114 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000e8e0 con 0x564f362f7c00 2024-08-19T00:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e6be00640 1 -- 172.21.15.7:0/845414114 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60013030 con 0x564f362f7c00 2024-08-19T00:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e6be00640 1 -- 172.21.15.7:0/845414114 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000ecc0 con 0x564f362f7c00 2024-08-19T00:44:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 -- 172.21.15.7:0/845414114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 msgr2=0x564f362f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f8080 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009690 tx=0x7f4e60009a90 comp rx=0 tx=0).stop 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 -- 172.21.15.7:0/845414114 shutdown_connections 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f36256180 0x564f36256600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f8080 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 --2- 172.21.15.7:0/845414114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e58003630 0x564f362feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 -- 172.21.15.7:0/845414114 >> 172.21.15.7:0/845414114 conn(0x564f362574e0 msgr2=0x564f36272a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 -- 172.21.15.7:0/845414114 shutdown_connections 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.269+0000 7f4e75234f40 1 -- 172.21.15.7:0/845414114 wait complete. 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.270+0000 7f4e75234f40 1 Processor -- start 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.270+0000 7f4e75234f40 1 -- start start 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e75234f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f36256180 0x564f36302220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e75234f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e75234f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e58003630 0x564f362e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e75234f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f362f8d00 con 0x564f362f7c00 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e75234f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f362f9640 con 0x7f4e58003630 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e75234f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564f362f8fe0 con 0x564f36256180 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e71a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e71a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47538/0 (socket says 172.21.15.7:47538) 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 learned_addr learned my addr 172.21.15.7:0/1472185969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e72400640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f36256180 0x564f36302220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.271+0000 7f4e72e00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e58003630 0x564f362e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f36256180 msgr2=0x564f36302220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e71a00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564f36256180 0x564f36302220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e58003630 msgr2=0x564f362e00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e71a00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e58003630 0x564f362e00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f362f7190 con 0x564f362f7c00 2024-08-19T00:44:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e71a00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f6490 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4e60001970 tx=0x7f4e60001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e6aa00640 1 -- 172.21.15.7:0/1472185969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000ee90 con 0x564f362f7c00 2024-08-19T00:44:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e6aa00640 1 -- 172.21.15.7:0/1472185969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6000f660 con 0x564f362f7c00 2024-08-19T00:44:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e6aa00640 1 -- 172.21.15.7:0/1472185969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000fa30 con 0x564f362f7c00 2024-08-19T00:44:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.272+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f362f7400 con 0x564f362f7c00 2024-08-19T00:44:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.273+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f362f76e0 con 0x564f362f7c00 2024-08-19T00:44:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.274+0000 7f4e6aa00640 1 -- 172.21.15.7:0/1472185969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e6000fbd0 con 0x564f362f7c00 2024-08-19T00:44:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.275+0000 7f4e6aa00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4e5406a9b0 0x7f4e5406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.275+0000 7f4e6aa00640 1 -- 172.21.15.7:0/1472185969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7f4e6008bc00 con 0x564f362f7c00 2024-08-19T00:44:05.279 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.275+0000 7f4e72400640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4e5406a9b0 0x7f4e5406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.276+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564f362fb980 0x564f362f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.276+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f362fd010 con 0x564f362fb980 2024-08-19T00:44:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.276+0000 7f4e72400640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4e5406a9b0 0x7f4e5406ce70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4e64012710 tx=0x7f4e64001730 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.276+0000 7f4e72e00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564f362fb980 0x564f362f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.277+0000 7f4e72e00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564f362fb980 0x564f362f55d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.279+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v89'73 uv48 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.279+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f362fd3e0 con 0x564f362fb980 2024-08-19T00:44:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.280+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v89'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.280+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f362fd840 con 0x564f362fb980 2024-08-19T00:44:05.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.281+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v89'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.283 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:05.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.281+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f362fdbe0 con 0x564f362fb980 2024-08-19T00:44:05.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.283+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v89'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.283+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a3540 con 0x564f362fb980 2024-08-19T00:44:05.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.284+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v89'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.284+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2530 con 0x564f362fb980 2024-08-19T00:44:05.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.285+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v89'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.285+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a28d0 con 0x564f362fb980 2024-08-19T00:44:05.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.287+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v89'79 uv54 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.287+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.288+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v89'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.288+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.291 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:05.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.290+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v89'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.290+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.291+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v89'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.291+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.293+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v89'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.293+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.294+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v89'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.294+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.296+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v89'85 uv59 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.296+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.297+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v89'86 uv86 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.297+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.300 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:05.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.299+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v89'87 uv87 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.299+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.300+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v89'88 uv88 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.300+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.302+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v89'89 uv89 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.302+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2c70 con 0x564f362fb980 2024-08-19T00:44:05.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.304+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v89'90 uv90 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.304+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a38e0 con 0x564f362fb980 2024-08-19T00:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.305+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v89'91 uv91 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.305+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a38e0 con 0x564f362fb980 2024-08-19T00:44:05.308 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.307+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v89'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.307+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a48f0 con 0x564f362fb980 2024-08-19T00:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.308+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [setxattr (30)] v89'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.308+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a48f0 con 0x564f362fb980 2024-08-19T00:44:05.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.310+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [setxattr (62)] v89'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.310+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a38e0 con 0x564f362fb980 2024-08-19T00:44:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.312+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [omap-set-header] v89'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.312+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a38e0 con 0x564f362fb980 2024-08-19T00:44:05.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.313+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 603.00000000 [create] v89'96 uv71 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.313+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363a38e0 con 0x564f362fb980 2024-08-19T00:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.314+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 603.00000000 [delete] v89'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.314+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a38e0 con 0x564f362fb980 2024-08-19T00:44:05.317 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.316+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v89'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.316+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a48f0 con 0x564f362fb980 2024-08-19T00:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.318+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [setxattr (30)] v89'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.318+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a48f0 con 0x564f362fb980 2024-08-19T00:44:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.319+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [setxattr (62)] v89'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.319+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a38e0 con 0x564f362fb980 2024-08-19T00:44:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.320+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [omap-set-header] v89'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.320+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564f363a3df0 0x564f363a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.320+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:30 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a6720 con 0x564f363a3df0 2024-08-19T00:44:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.321+0000 7f4e72400640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564f363a3df0 0x564f363a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.321+0000 7f4e72400640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564f363a3df0 0x564f363a61e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.323+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(30 1.00000000.inode [create] v89'67 uv49 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.323+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:31 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363a6ac0 con 0x564f363a3df0 2024-08-19T00:44:05.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.325+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(31 1.00000000.inode [delete] v89'68 uv68 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.325+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a6e60 con 0x564f363a3df0 2024-08-19T00:44:05.327 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.326+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(32 1.00000000.inode [create] v89'69 uv69 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.326+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a2fb0 con 0x564f363a3df0 2024-08-19T00:44:05.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.328+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(33 1.00000000.inode [write 0~582] v89'70 uv70 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.328+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7700 con 0x564f363a3df0 2024-08-19T00:44:05.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.329+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v89'71 uv71 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.329+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7af0 con 0x564f363a3df0 2024-08-19T00:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.331+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(35 200.00000000 [create] v89'72 uv54 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.331+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.332+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(36 200.00000000 [delete] v89'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.332+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.335 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:05.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.333+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(37 200.00000000 [create] v89'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.333+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.335+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(38 200.00000000 [write 0~90] v89'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.335+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.336+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(39 200.00000000 [omap-set-header] v89'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.336+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.337+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(40 200.00000001 [create] v89'77 uv59 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.337+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.339+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(41 200.00000001 [delete] v89'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.339+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:05.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.340+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(42 200.00000001 [create] v89'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.340+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.342+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(43 200.00000001 [write 0~18118] v89'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.342+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.343+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(44 200.00000001 [omap-set-header] v89'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.343+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7f20 con 0x564f363a3df0 2024-08-19T00:44:05.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.344+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(45 606.00000000 [create] v89'82 uv65 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.344+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7f20 con 0x564f363a3df0 2024-08-19T00:44:05.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.345+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(46 606.00000000 [delete] v89'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.346+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:05.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.347+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(47 606.00000000 [create] v89'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.347+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.348+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v89'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.348+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.349+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v89'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.349+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363a7ee0 con 0x564f363a3df0 2024-08-19T00:44:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.350+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(50 606.00000000 [omap-set-header] v89'87 uv87 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363a3df0 2024-08-19T00:44:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.350+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564f363a87f0 0x564f363a8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.350+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:51 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363ab420 con 0x564f363a87f0 2024-08-19T00:44:05.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.351+0000 7f4e71a00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564f363a87f0 0x564f363a8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.351+0000 7f4e71a00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564f363a87f0 0x564f363a8bd0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.353+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(51 607.00000000 [create] v89'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.353+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:52 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363ab7c0 con 0x564f363a87f0 2024-08-19T00:44:05.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.354+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(52 607.00000000 [delete] v89'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.354+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363abb60 con 0x564f363a87f0 2024-08-19T00:44:05.357 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.355+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(53 607.00000000 [create] v89'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.355+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363acf10 con 0x564f363a87f0 2024-08-19T00:44:05.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.357+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v89'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.357+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363ad390 con 0x564f363a87f0 2024-08-19T00:44:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.358+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v89'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.358+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363abf00 con 0x564f363a87f0 2024-08-19T00:44:05.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.360+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v89'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.360+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:57 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363ac2f0 con 0x564f362fb980 2024-08-19T00:44:05.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.361+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(57 mds0_openfiles.0 [create] v89'14 uv13 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.361+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:58 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363ac2f0 con 0x564f362fb980 2024-08-19T00:44:05.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.363+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v89'15 uv15 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.363+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363ac2f0 con 0x564f362fb980 2024-08-19T00:44:05.367 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.365+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v89'16 uv16 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.365+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363ac2f0 con 0x564f362fb980 2024-08-19T00:44:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.368+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v89'17 uv17 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.368+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564f363ad7c0 0x564f363afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.368+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:61 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b00f0 con 0x564f363ad7c0 2024-08-19T00:44:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.369+0000 7f4e72e00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564f363ad7c0 0x564f363afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.369+0000 7f4e72e00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564f363ad7c0 0x564f363afbb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.370+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(61 608.00000000 [create] v89'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.370+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:62 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b00f0 con 0x564f363ad7c0 2024-08-19T00:44:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.372+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(62 608.00000000 [delete] v89'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.372+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b00f0 con 0x564f363ad7c0 2024-08-19T00:44:05.374 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:05.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.373+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(63 608.00000000 [create] v89'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.373+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b1100 con 0x564f363ad7c0 2024-08-19T00:44:05.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.376+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v89'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.376+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b1100 con 0x564f363ad7c0 2024-08-19T00:44:05.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.378+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v89'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.378+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b00f0 con 0x564f363ad7c0 2024-08-19T00:44:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.381+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v89'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.381+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564f363b0770 0x564f363b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.381+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:67 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3260 con 0x564f363b0770 2024-08-19T00:44:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.382+0000 7f4e72400640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564f363b0770 0x564f363b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.382+0000 7f4e72400640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564f363b0770 0x564f363b2bc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.383+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(67 604.00000000 [create] v89'26 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.383+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:68 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3320 con 0x564f363b0770 2024-08-19T00:44:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.384+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(68 604.00000000 [delete] v89'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.384+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3710 con 0x564f363b0770 2024-08-19T00:44:05.387 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.386+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(69 604.00000000 [create] v89'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.386+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b4720 con 0x564f363b0770 2024-08-19T00:44:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.387+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v89'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.387+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b4720 con 0x564f363b0770 2024-08-19T00:44:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.388+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v89'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.388+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3710 con 0x564f363b0770 2024-08-19T00:44:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.390+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v89'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.390+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3710 con 0x564f363b0770 2024-08-19T00:44:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.391+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(73 500.00000000 [create] v89'32 uv25 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.391+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3710 con 0x564f363b0770 2024-08-19T00:44:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.392+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(74 500.00000000 [delete] v89'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.392+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3710 con 0x564f363b0770 2024-08-19T00:44:05.394 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.393+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(75 500.00000000 [create] v89'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.393+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3710 con 0x564f363b0770 2024-08-19T00:44:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.394+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v89'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.394+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b3710 con 0x564f363b0770 2024-08-19T00:44:05.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.396+0000 7f4e72400640 1 -- 172.21.15.7:0/1472185969 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v89'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e64011aa0 con 0x564f363b0770 2024-08-19T00:44:05.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.396+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564f363b3d90 0x564f363b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.396+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:78 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6790 con 0x564f363b3d90 2024-08-19T00:44:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.396+0000 7f4e71a00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564f363b3d90 0x564f363b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.397+0000 7f4e71a00640 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564f363b3d90 0x564f363b6180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.398+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(78 mds_snaptable [create] v89'12 uv11 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.398+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:79 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6b60 con 0x564f363b3d90 2024-08-19T00:44:05.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.399+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(79 mds_snaptable [delete] v89'13 uv13 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.399+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363b3d90 2024-08-19T00:44:05.403 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.402+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(80 mds_snaptable [create] v89'14 uv14 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.402+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363b3d90 2024-08-19T00:44:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.405+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v89'15 uv15 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.405+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363b3d90 2024-08-19T00:44:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.407+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v89'16 uv16 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.407+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:83 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f362fb980 2024-08-19T00:44:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.409+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(83 605.00000000 [create] v89'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.409+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:84 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f362fb980 2024-08-19T00:44:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.410+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(84 605.00000000 [delete] v89'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.410+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f362fb980 2024-08-19T00:44:05.413 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:05.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.411+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v89'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.411+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7f90 con 0x564f362fb980 2024-08-19T00:44:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.413+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v89'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.413+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7f90 con 0x564f362fb980 2024-08-19T00:44:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.414+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v89'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.414+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f362fb980 2024-08-19T00:44:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.415+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [omap-set-header] v89'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f362fb980 2024-08-19T00:44:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.415+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:89 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.416+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(89 mds0_inotable [create] v89'24 uv18 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.417+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:90 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.418+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(90 mds0_inotable [delete] v89'25 uv25 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.418+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.419+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(91 mds0_inotable [create] v89'26 uv26 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.421 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:05.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.419+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.421+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(92 mds0_inotable [write 0~34] v89'27 uv27 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.421+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.423+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v89'28 uv28 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.423+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.424+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(94 100.00000000 [create] v89'29 uv23 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.424+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.426+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(95 100.00000000 [delete] v89'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.426+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.427+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(96 100.00000000 [create] v89'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.429 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.428+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b6f80 con 0x564f363a87f0 2024-08-19T00:44:05.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.429+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(97 100.00000000 [omap-set-header] v89'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.429+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b9d90 con 0x564f363a87f0 2024-08-19T00:44:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.431+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v89'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363a87f0 2024-08-19T00:44:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.431+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.432+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v89'14 uv12 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.432+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.433+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v89'15 uv15 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.433+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.435+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v89'16 uv16 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.437 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.435+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.436+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v89'17 uv17 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.436+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.438+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v89'15 uv14 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.438+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.439+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v89'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.439+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.442 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.440+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v89'17 uv17 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.441+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b8440 con 0x564f363ad7c0 2024-08-19T00:44:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.442+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v89'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.442+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b8440 con 0x564f363ad7c0 2024-08-19T00:44:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.443+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v89'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.443+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363ad7c0 2024-08-19T00:44:05.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.445+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v89'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e6c005040 con 0x564f363ad7c0 2024-08-19T00:44:05.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.445+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.446+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v89'12 uv11 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.446+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.447+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v89'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.447+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.450 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.449+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v89'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.449+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.450+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v89'15 uv15 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.450+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.451+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v89'16 uv16 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.451+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.452+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v89'33 uv24 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.452+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.454+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v89'34 uv34 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.454+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.456 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.455+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v89'35 uv35 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.455+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.456+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v89'36 uv36 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.456+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.457+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v89'37 uv37 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.457+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.458+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v89'38 uv31 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.459+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.460+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v89'39 uv39 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.460+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.462 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.461+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v89'40 uv40 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.461+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b8440 con 0x564f363b3d90 2024-08-19T00:44:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.462+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v89'41 uv41 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.462+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b8440 con 0x564f363b3d90 2024-08-19T00:44:05.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.463+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v89'42 uv42 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.463+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7430 con 0x564f363b3d90 2024-08-19T00:44:05.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.464+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v89'43 uv43 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.464+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) -- 0x564f363b7990 con 0x564f363b3d90 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e71a00640 1 -- 172.21.15.7:0/1472185969 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v89'44 uv44 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f4e60022070 con 0x564f363b3d90 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564f363a3df0 msgr2=0x564f363a61e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564f363a3df0 0x564f363a61e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564f363b0770 msgr2=0x564f363b2bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564f363b0770 0x564f363b2bc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564f363b3d90 msgr2=0x564f363b6180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564f363b3d90 0x564f363b6180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564f363a87f0 msgr2=0x564f363a8bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564f363a87f0 0x564f363a8bd0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564f362fb980 msgr2=0x564f362f55d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564f362fb980 0x564f362f55d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564f363ad7c0 msgr2=0x564f363afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564f363ad7c0 0x564f363afbb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 reap_dead start 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 reap_dead start 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e72e00640 1 -- 172.21.15.7:0/1472185969 reap_dead start 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4e5406a9b0 msgr2=0x7f4e5406ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4e5406a9b0 0x7f4e5406ce70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4e64012710 tx=0x7f4e64001730 comp rx=0 tx=0).stop 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 msgr2=0x564f362f6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f6490 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4e60001970 tx=0x7f4e60001a40 comp rx=0 tx=0).stop 2024-08-19T00:44:05.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 shutdown_connections 2024-08-19T00:44:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4e5406a9b0 0x7f4e5406ce70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 --2- 172.21.15.7:0/1472185969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f362f7c00 0x564f362f6490 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 >> 172.21.15.7:0/1472185969 conn(0x564f362574e0 msgr2=0x564f362fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 shutdown_connections 2024-08-19T00:44:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.466+0000 7f4e75234f40 1 -- 172.21.15.7:0/1472185969 wait complete. 2024-08-19T00:44:05.472 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 1.00000000.inode 2024-08-19T00:44:05.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 Processor -- start 2024-08-19T00:44:05.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 -- start start 2024-08-19T00:44:05.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae77870f40 0x55ae779109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae778725b0 0x55ae7786dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7783f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ae777e6d00 con 0x55ae778725b0 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ae777ead40 con 0x55ae77870f40 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.587+0000 7ff414b95f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ae77917dc0 con 0x55ae77872990 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae778725b0 0x55ae7786dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae77870f40 0x55ae779109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae778725b0 0x55ae7786dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47562/0 (socket says 172.21.15.7:47562) 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 -- 172.21.15.7:0/1047442986 learned_addr learned my addr 172.21.15.7:0/1047442986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae77870f40 0x55ae779109a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:50134/0 (socket says 172.21.15.7:50134) 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff412800640 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7783f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 -- 172.21.15.7:0/1047442986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 msgr2=0x55ae7783f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:05.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7783f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 -- 172.21.15.7:0/1047442986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae77870f40 msgr2=0x55ae779109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:05.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae77870f40 0x55ae779109a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.588+0000 7ff411400640 1 -- 172.21.15.7:0/1047442986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae777a8080 con 0x55ae778725b0 2024-08-19T00:44:05.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff411400640 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae778725b0 0x55ae7786dc40 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff40000b260 tx=0x7ff40000b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d8074b5a2e29df server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff40be00640 1 -- 172.21.15.7:0/1047442986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40000e5c0 con 0x55ae778725b0 2024-08-19T00:44:05.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff40be00640 1 -- 172.21.15.7:0/1047442986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff400006070 con 0x55ae778725b0 2024-08-19T00:44:05.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff40be00640 1 -- 172.21.15.7:0/1047442986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40000e960 con 0x55ae778725b0 2024-08-19T00:44:05.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 -- 172.21.15.7:0/1047442986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae778725b0 msgr2=0x55ae7786dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae778725b0 0x55ae7786dc40 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff40000b260 tx=0x7ff40000b720 comp rx=0 tx=0).stop 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 -- 172.21.15.7:0/1047442986 shutdown_connections 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7783f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae778725b0 0x55ae7786dc40 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1047442986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae77870f40 0x55ae779109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 -- 172.21.15.7:0/1047442986 >> 172.21.15.7:0/1047442986 conn(0x55ae7786f4e0 msgr2=0x55ae7788ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.589+0000 7ff414b95f40 1 -- 172.21.15.7:0/1047442986 shutdown_connections 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.590+0000 7ff414b95f40 1 -- 172.21.15.7:0/1047442986 wait complete. 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.590+0000 7ff414b95f40 1 Processor -- start 2024-08-19T00:44:05.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.590+0000 7ff414b95f40 1 -- start start 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.591+0000 7ff414b95f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae77870f40 0x55ae7799f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.591+0000 7ff414b95f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae778725b0 0x55ae7790bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.591+0000 7ff414b95f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7786cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.591+0000 7ff414b95f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ae77911580 con 0x55ae77870f40 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.591+0000 7ff414b95f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ae77918930 con 0x55ae778725b0 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.591+0000 7ff414b95f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ae7783fd10 con 0x55ae77872990 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae77870f40 0x55ae7799f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae77870f40 0x55ae7799f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47574/0 (socket says 172.21.15.7:47574) 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 -- 172.21.15.7:0/1300943747 learned_addr learned my addr 172.21.15.7:0/1300943747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411400640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae778725b0 0x55ae7790bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff412800640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7786cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 -- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 msgr2=0x55ae7786cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7786cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 -- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae778725b0 msgr2=0x55ae7790bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae778725b0 0x55ae7790bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 -- 172.21.15.7:0/1300943747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae77916c60 con 0x55ae77870f40 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff412800640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ae77872990 0x55ae7786cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411400640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae778725b0 0x55ae7790bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff411e00640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae77870f40 0x55ae7799f990 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c00 tx=0x7ff40404f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.592+0000 7ff40aa00640 1 -- 172.21.15.7:0/1300943747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40406d070 con 0x55ae77870f40 2024-08-19T00:44:05.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.593+0000 7ff40aa00640 1 -- 172.21.15.7:0/1300943747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404051ce0 con 0x55ae77870f40 2024-08-19T00:44:05.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.593+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae77916f40 con 0x55ae77870f40 2024-08-19T00:44:05.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.593+0000 7ff40aa00640 1 -- 172.21.15.7:0/1300943747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404068680 con 0x55ae77870f40 2024-08-19T00:44:05.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.593+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae7790c1e0 con 0x55ae77870f40 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.595+0000 7ff40aa00640 1 -- 172.21.15.7:0/1300943747 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff404070070 con 0x55ae77870f40 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.595+0000 7ff40aa00640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3f406a840 0x7ff3f406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.596+0000 7ff40aa00640 1 -- 172.21.15.7:0/1300943747 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7ff4040cdfb0 con 0x55ae77870f40 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.596+0000 7ff411400640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3f406a840 0x7ff3f406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.596+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ae77910a30 0x55ae77915330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.596+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) -- 0x55ae77912f80 con 0x55ae77910a30 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.596+0000 7ff412800640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ae77910a30 0x55ae77915330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.596+0000 7ff411400640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3f406a840 0x7ff3f406cd00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff40000b260 tx=0x7ff400009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.597+0000 7ff412800640 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ae77910a30 0x55ae77915330 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff412800640 1 -- 172.21.15.7:0/1300943747 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 1.00000000.inode [delete] v89'88 uv88 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ff40c002700 con 0x55ae77910a30 2024-08-19T00:44:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ae77910a30 msgr2=0x55ae77915330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ae77910a30 0x55ae77915330 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3f406a840 msgr2=0x7ff3f406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3f406a840 0x7ff3f406cd00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff40000b260 tx=0x7ff400009000 comp rx=0 tx=0).stop 2024-08-19T00:44:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae77870f40 msgr2=0x55ae7799f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff414b95f40 1 --2- 172.21.15.7:0/1300943747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae77870f40 0x55ae7799f990 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c00 tx=0x7ff40404f000 comp rx=0 tx=0).stop 2024-08-19T00:44:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.598+0000 7ff412800640 1 -- 172.21.15.7:0/1300943747 reap_dead start 2024-08-19T00:44:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.599+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 shutdown_connections 2024-08-19T00:44:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.599+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 >> 172.21.15.7:0/1300943747 conn(0x55ae7786f4e0 msgr2=0x55ae77913340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.599+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 shutdown_connections 2024-08-19T00:44:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.599+0000 7ff414b95f40 1 -- 172.21.15.7:0/1300943747 wait complete. 2024-08-19T00:44:05.605 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.762+0000 7f5d7ba00640 1 Processor -- start 2024-08-19T00:44:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.762+0000 7f5d7ba00640 1 -- start start 2024-08-19T00:44:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d7ba00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5d740aed00 0x7f5d7406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d7ba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d7406f720 0x7f5d740b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d7ba00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d7415e720 con 0x7f5d740b3450 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d7ba00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5d740b38b0 con 0x7f5d740aed00 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d7ba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5d740b3c00 con 0x7f5d7406f720 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d79000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5d740aed00 0x7f5d7406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d79a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5d740b3450 0x7f5d7406deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52142/0 (socket says 172.21.15.7:52142) 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d79a00640 1 -- 172.21.15.7:0/2499790711 learned_addr learned my addr 172.21.15.7:0/2499790711 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d6be00640 1 --2- 172.21.15.7:0/2499790711 >> v2:172.21.15.162:3300/0 conn(0x7f5d7406f720 0x7f5d740b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d79000640 1 -- 172.21.15.7:0/2499790711 >> v2:172.21.15.162:3300/0 conn(0x7f5d7406f720 msgr2=0x7f5d740b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:05.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d79000640 1 --2- 172.21.15.7:0/2499790711 >> v2:172.21.15.162:3300/0 conn(0x7f5d7406f720 0x7f5d740b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.764+0000 7f5d79000640 1 -- 172.21.15.7:0/2499790711 >> v1:172.21.15.7:6789/0 conn(0x7f5d740b3450 legacy=0x7f5d7406deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.765+0000 7f5d73e00640 1 -- 172.21.15.7:0/2499790711 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47398920 0 0) 0x7f5d6c001490 con 0x7f5d740b3450 2024-08-19T00:44:05.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.765+0000 7f5d79000640 1 -- 172.21.15.7:0/2499790711 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d74072450 con 0x7f5d740aed00 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d79000640 1 --2- 172.21.15.7:0/2499790711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d740aed00 0x7f5d7406f0d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5d74161db0 tx=0x7f5d6402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283337685428e898 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d73e00640 1 -- 172.21.15.7:0/2499790711 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64037070 con 0x7f5d740aed00 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d73e00640 1 -- 172.21.15.7:0/2499790711 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6402add0 con 0x7f5d740aed00 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d73e00640 1 -- 172.21.15.7:0/2499790711 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64032660 con 0x7f5d740aed00 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2499790711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d740aed00 msgr2=0x7f5d7406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2499790711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d740aed00 0x7f5d7406f0d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5d74161db0 tx=0x7f5d6402a080 comp rx=0 tx=0).stop 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2499790711 shutdown_connections 2024-08-19T00:44:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2499790711 >> v2:172.21.15.162:3300/0 conn(0x7f5d7406f720 0x7f5d740b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2499790711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d740aed00 0x7f5d7406f0d0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2499790711 >> 172.21.15.7:0/2499790711 conn(0x7f5d740b2300 msgr2=0x7f5d7406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:05.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.766+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2499790711 shutdown_connections 2024-08-19T00:44:05.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.767+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2499790711 wait complete. 2024-08-19T00:44:05.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.768+0000 7f5d7ba00640 1 Processor -- start 2024-08-19T00:44:05.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.768+0000 7f5d7ba00640 1 -- start start 2024-08-19T00:44:05.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.769+0000 7f5d7ba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7406f720 0x7f5d74150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.769+0000 7f5d7ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d740aed00 0x7f5d740ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.769+0000 7f5d7ba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d740b3450 0x7f5d740b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.769+0000 7f5d7ba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74072cf0 con 0x7f5d7406f720 2024-08-19T00:44:05.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.769+0000 7f5d7ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74072a10 con 0x7f5d740aed00 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.769+0000 7f5d7ba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d740adf00 con 0x7f5d740b3450 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.769+0000 7f5d79000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7406f720 0x7f5d74150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7406f720 0x7f5d74150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47592/0 (socket says 172.21.15.7:47592) 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 -- 172.21.15.7:0/2863164163 learned_addr learned my addr 172.21.15.7:0/2863164163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d6be00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d740aed00 0x7f5d740ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79a00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d740b3450 0x7f5d740b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 -- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d740b3450 msgr2=0x7f5d740b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d740b3450 0x7f5d740b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 -- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d740aed00 msgr2=0x7f5d740ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:05.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d740aed00 0x7f5d740ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:05.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 -- 172.21.15.7:0/2863164163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7414e150 con 0x7f5d7406f720 2024-08-19T00:44:05.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79a00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d740b3450 0x7f5d740b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:05.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.770+0000 7f5d79000640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7406f720 0x7f5d74150e00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5d64000c00 tx=0x7f5d640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.771+0000 7f5d71600640 1 -- 172.21.15.7:0/2863164163 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64037040 con 0x7f5d7406f720 2024-08-19T00:44:05.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.771+0000 7f5d71600640 1 -- 172.21.15.7:0/2863164163 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d64042070 con 0x7f5d7406f720 2024-08-19T00:44:05.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.771+0000 7f5d71600640 1 -- 172.21.15.7:0/2863164163 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6403d660 con 0x7f5d7406f720 2024-08-19T00:44:05.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.771+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7414d5d0 con 0x7f5d7406f720 2024-08-19T00:44:05.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.771+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7414db90 con 0x7f5d7406f720 2024-08-19T00:44:05.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.772+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7406db70 con 0x7f5d7406f720 2024-08-19T00:44:05.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.773+0000 7f5d71600640 1 -- 172.21.15.7:0/2863164163 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d6403d800 con 0x7f5d7406f720 2024-08-19T00:44:05.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.773+0000 7f5d71600640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d5006be60 0x7f5d5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:05.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.773+0000 7f5d71600640 1 -- 172.21.15.7:0/2863164163 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5967+0+0 (secure 0 0 0) 0x7f5d640ab4a0 con 0x7f5d7406f720 2024-08-19T00:44:05.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.774+0000 7f5d6be00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d5006be60 0x7f5d5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:05.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.774+0000 7f5d6be00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d5006be60 0x7f5d5006e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5d7415be00 tx=0x7f5d5c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:05.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.778+0000 7f5d71600640 1 -- 172.21.15.7:0/2863164163 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5d7406db70 con 0x7f5d7406f720 2024-08-19T00:44:06.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:05.999+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f5d74073bf0 con 0x7f5d7406f720 2024-08-19T00:44:06.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.175+0000 7f5d71600640 1 -- 172.21.15.7:0/2863164163 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v104) ==== 162+0+0 (secure 0 0 0) 0x7f5d74073bf0 con 0x7f5d7406f720 2024-08-19T00:44:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d5006be60 msgr2=0x7f5d5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d5006be60 0x7f5d5006e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5d7415be00 tx=0x7f5d5c009190 comp rx=0 tx=0).stop 2024-08-19T00:44:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7406f720 msgr2=0x7f5d74150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7406f720 0x7f5d74150e00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5d64000c00 tx=0x7f5d640046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 shutdown_connections 2024-08-19T00:44:06.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5d5006be60 0x7f5d5006e320 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d740b3450 0x7f5d740b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d740aed00 0x7f5d740ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 --2- 172.21.15.7:0/2863164163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7406f720 0x7f5d74150e00 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 >> 172.21.15.7:0/2863164163 conn(0x7f5d740b2300 msgr2=0x7f5d74074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:06.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 shutdown_connections 2024-08-19T00:44:06.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.178+0000 7f5d7ba00640 1 -- 172.21.15.7:0/2863164163 wait complete. 2024-08-19T00:44:06.189 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:44:06.187+0000 7f91c6600640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-08-19T00:44:06.189 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:44:06.187+0000 7f91c6600640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:44:06.190 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:06.188+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:06.190 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:06.188+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:44:06.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.358+0000 7f3517600640 1 Processor -- start 2024-08-19T00:44:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.358+0000 7f3517600640 1 -- start start 2024-08-19T00:44:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.359+0000 7f3517600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35100d12a0 0x7f3510169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.359+0000 7f3517600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351015ec30 con 0x7f351009aa70 2024-08-19T00:44:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.359+0000 7f3517600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351015ef10 con 0x7f351009b730 2024-08-19T00:44:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.359+0000 7f3517600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f351015f1f0 con 0x7f35100d12a0 2024-08-19T00:44:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f3514c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f351009aa70 0x7f351009ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52148/0 (socket says 172.21.15.7:52148) 2024-08-19T00:44:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f3514c00640 1 -- 172.21.15.7:0/3259956817 learned_addr learned my addr 172.21.15.7:0/3259956817 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f3515600640 1 --2- 172.21.15.7:0/3259956817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35100d12a0 0x7f3510169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f350f400640 1 -- 172.21.15.7:0/3259956817 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254785752 0 0) 0x7f351015ef10 con 0x7f351009b730 2024-08-19T00:44:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f350f400640 1 -- 172.21.15.7:0/3259956817 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34f8003520 con 0x7f351009b730 2024-08-19T00:44:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f3515600640 1 -- 172.21.15.7:0/3259956817 >> v1:172.21.15.162:6789/0 conn(0x7f351009b730 legacy=0x7f351006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f350f400640 1 -- 172.21.15.7:0/3259956817 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107281670 0 0) 0x7f351015ec30 con 0x7f351009aa70 2024-08-19T00:44:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f3515600640 1 -- 172.21.15.7:0/3259956817 >> v1:172.21.15.7:6789/0 conn(0x7f351009aa70 legacy=0x7f351009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.360+0000 7f3515600640 1 -- 172.21.15.7:0/3259956817 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351015f4d0 con 0x7f35100d12a0 2024-08-19T00:44:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.361+0000 7f3515600640 1 --2- 172.21.15.7:0/3259956817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35100d12a0 0x7f3510169290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3508009dc0 tx=0x7f350802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=803ee358c086502c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f350f400640 1 -- 172.21.15.7:0/3259956817 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508007740 con 0x7f35100d12a0 2024-08-19T00:44:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f350f400640 1 -- 172.21.15.7:0/3259956817 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35080078e0 con 0x7f35100d12a0 2024-08-19T00:44:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f350f400640 1 -- 172.21.15.7:0/3259956817 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508007cb0 con 0x7f35100d12a0 2024-08-19T00:44:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f3517600640 1 -- 172.21.15.7:0/3259956817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35100d12a0 msgr2=0x7f3510169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f3517600640 1 --2- 172.21.15.7:0/3259956817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35100d12a0 0x7f3510169290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3508009dc0 tx=0x7f350802a6d0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f3517600640 1 -- 172.21.15.7:0/3259956817 shutdown_connections 2024-08-19T00:44:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f3517600640 1 --2- 172.21.15.7:0/3259956817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35100d12a0 0x7f3510169290 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f3517600640 1 -- 172.21.15.7:0/3259956817 >> 172.21.15.7:0/3259956817 conn(0x7f35100d2190 msgr2=0x7f35100d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f3517600640 1 -- 172.21.15.7:0/3259956817 shutdown_connections 2024-08-19T00:44:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.362+0000 7f3517600640 1 -- 172.21.15.7:0/3259956817 wait complete. 2024-08-19T00:44:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.364+0000 7f3517600640 1 Processor -- start 2024-08-19T00:44:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.364+0000 7f3517600640 1 -- start start 2024-08-19T00:44:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3517600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351009aa70 0x7f351015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3517600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351009b730 0x7f3510160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3517600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35100d12a0 0x7f351015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3517600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3510169950 con 0x7f35100d12a0 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3517600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35101697d0 con 0x7f351009aa70 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3517600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3510169ad0 con 0x7f351009b730 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3515600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35100d12a0 0x7f351015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3515600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35100d12a0 0x7f351015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47604/0 (socket says 172.21.15.7:47604) 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3515600640 1 -- 172.21.15.7:0/3162610904 learned_addr learned my addr 172.21.15.7:0/3162610904 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f3514c00640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351009aa70 0x7f351015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.365+0000 7f350fe00640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351009b730 0x7f3510160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3515600640 1 -- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351009b730 msgr2=0x7f3510160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3515600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351009b730 0x7f3510160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3515600640 1 -- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351009aa70 msgr2=0x7f351015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3515600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351009aa70 0x7f351015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3515600640 1 -- 172.21.15.7:0/3162610904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3510161370 con 0x7f35100d12a0 2024-08-19T00:44:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3514c00640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351009aa70 0x7f351015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3515600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35100d12a0 0x7f351015d330 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f350802acc0 tx=0x7f3508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f350cc00640 1 -- 172.21.15.7:0/3162610904 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350803f070 con 0x7f35100d12a0 2024-08-19T00:44:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f350cc00640 1 -- 172.21.15.7:0/3162610904 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3508031bc0 con 0x7f35100d12a0 2024-08-19T00:44:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f350cc00640 1 -- 172.21.15.7:0/3162610904 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508009450 con 0x7f35100d12a0 2024-08-19T00:44:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35100b6770 con 0x7f35100d12a0 2024-08-19T00:44:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.366+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35100b6260 con 0x7f35100d12a0 2024-08-19T00:44:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.367+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f351009ae50 con 0x7f35100d12a0 2024-08-19T00:44:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.368+0000 7f350cc00640 1 -- 172.21.15.7:0/3162610904 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f350803b410 con 0x7f35100d12a0 2024-08-19T00:44:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.369+0000 7f350cc00640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34f006be30 0x7f34f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.369+0000 7f350cc00640 1 -- 172.21.15.7:0/3162610904 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7f35080ac770 con 0x7f35100d12a0 2024-08-19T00:44:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.369+0000 7f3514c00640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34f006be30 0x7f34f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.370+0000 7f3514c00640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34f006be30 0x7f34f006e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3504007fd0 tx=0x7f3504007dc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.374+0000 7f350cc00640 1 -- 172.21.15.7:0/3162610904 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f350807afe0 con 0x7f35100d12a0 2024-08-19T00:44:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.594+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35100d2cb0 con 0x7f35100d12a0 2024-08-19T00:44:06.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.594+0000 7f350cc00640 1 -- 172.21.15.7:0/3162610904 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+4391 (secure 0 0 0) 0x7f350807fe20 con 0x7f35100d12a0 2024-08-19T00:44:06.596 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:06.596 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":106,"btime":"2024-08-19T00:44:06:189185+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:06.189116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:06.596 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 106 2024-08-19T00:44:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.596+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34f006be30 msgr2=0x7f34f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34f006be30 0x7f34f006e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3504007fd0 tx=0x7f3504007dc0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35100d12a0 msgr2=0x7f351015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35100d12a0 0x7f351015d330 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f350802acc0 tx=0x7f3508004a40 comp rx=0 tx=0).stop 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 shutdown_connections 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f34f006be30 0x7f34f006e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35100d12a0 0x7f351015d330 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351009b730 0x7f3510160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 --2- 172.21.15.7:0/3162610904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351009aa70 0x7f351015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 >> 172.21.15.7:0/3162610904 conn(0x7f35100d2190 msgr2=0x7f351006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 shutdown_connections 2024-08-19T00:44:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.597+0000 7f3517600640 1 -- 172.21.15.7:0/3162610904 wait complete. 2024-08-19T00:44:06.614 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:06.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:06.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.769+0000 7f56cbc00640 1 Processor -- start 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.770+0000 7f56cbc00640 1 -- start start 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56cbc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56c4159bf0 0x7f56c4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56cbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56cbc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56c40cea40 0x7f56c40d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56cbc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f56c406f7f0 con 0x7f56c4159bf0 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56cbc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f56c406f510 con 0x7f56c40cea40 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56cbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56c4072980 con 0x7f56c40739a0 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56c4159bf0 0x7f56c4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56c4159bf0 0x7f56c4073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47620/0 (socket says 172.21.15.7:47620) 2024-08-19T00:44:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 -- 172.21.15.7:0/769421498 learned_addr learned my addr 172.21.15.7:0/769421498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9c00640 1 --2- 172.21.15.7:0/769421498 >> v2:172.21.15.162:3300/0 conn(0x7f56c40cea40 0x7f56c40d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c3e00640 1 --2- 172.21.15.7:0/769421498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 -- 172.21.15.7:0/769421498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 msgr2=0x7f56c40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 --2- 172.21.15.7:0/769421498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c40ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 -- 172.21.15.7:0/769421498 >> v2:172.21.15.162:3300/0 conn(0x7f56c40cea40 msgr2=0x7f56c40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 --2- 172.21.15.7:0/769421498 >> v2:172.21.15.162:3300/0 conn(0x7f56c40cea40 0x7f56c40d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.771+0000 7f56c9200640 1 -- 172.21.15.7:0/769421498 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c4072c60 con 0x7f56c4159bf0 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.773+0000 7f56c9200640 1 --2- 172.21.15.7:0/769421498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c4073460 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f56c40cdd20 tx=0x7f56b802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe34a939edd56fa7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.773+0000 7f56c3400640 1 -- 172.21.15.7:0/769421498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b8037070 con 0x7f56c4159bf0 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.773+0000 7f56c3400640 1 -- 172.21.15.7:0/769421498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b8032440 con 0x7f56c4159bf0 2024-08-19T00:44:06.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.773+0000 7f56c3400640 1 -- 172.21.15.7:0/769421498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b8032810 con 0x7f56c4159bf0 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.773+0000 7f56cbc00640 1 -- 172.21.15.7:0/769421498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 msgr2=0x7f56c4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.773+0000 7f56cbc00640 1 --2- 172.21.15.7:0/769421498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c4073460 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f56c40cdd20 tx=0x7f56b802a140 comp rx=0 tx=0).stop 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.774+0000 7f56cbc00640 1 -- 172.21.15.7:0/769421498 shutdown_connections 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.774+0000 7f56cbc00640 1 --2- 172.21.15.7:0/769421498 >> v2:172.21.15.162:3300/0 conn(0x7f56c40cea40 0x7f56c40d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.774+0000 7f56cbc00640 1 --2- 172.21.15.7:0/769421498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c40ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.774+0000 7f56cbc00640 1 --2- 172.21.15.7:0/769421498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c4073460 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.774+0000 7f56cbc00640 1 -- 172.21.15.7:0/769421498 >> 172.21.15.7:0/769421498 conn(0x7f56c406bc70 msgr2=0x7f56c406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.774+0000 7f56cbc00640 1 -- 172.21.15.7:0/769421498 shutdown_connections 2024-08-19T00:44:06.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.774+0000 7f56cbc00640 1 -- 172.21.15.7:0/769421498 wait complete. 2024-08-19T00:44:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.775+0000 7f56cbc00640 1 Processor -- start 2024-08-19T00:44:06.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.775+0000 7f56cbc00640 1 -- start start 2024-08-19T00:44:06.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.776+0000 7f56cbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.776+0000 7f56cbc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c40cea40 0x7f56c4150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.776+0000 7f56cbc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c41576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.776+0000 7f56cbc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56c415a150 con 0x7f56c4159bf0 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.776+0000 7f56cbc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56c4159fd0 con 0x7f56c40cea40 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.776+0000 7f56cbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56c40d0900 con 0x7f56c40739a0 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c41576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c40cea40 0x7f56c4150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c41576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47636/0 (socket says 172.21.15.7:47636) 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c414e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:45144/0 (socket says 172.21.15.7:45144) 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 -- 172.21.15.7:0/1940217822 learned_addr learned my addr 172.21.15.7:0/1940217822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 -- 172.21.15.7:0/1940217822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 msgr2=0x7f56c414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 -- 172.21.15.7:0/1940217822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c40cea40 msgr2=0x7f56c4150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c40cea40 0x7f56c4150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 -- 172.21.15.7:0/1940217822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c4160c00 con 0x7f56c4159bf0 2024-08-19T00:44:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c9c00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c41576e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f56bc007e70 tx=0x7f56bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c0c00640 1 -- 172.21.15.7:0/1940217822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc014620 con 0x7f56c4159bf0 2024-08-19T00:44:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c0c00640 1 -- 172.21.15.7:0/1940217822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc019070 con 0x7f56c4159bf0 2024-08-19T00:44:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.777+0000 7f56c0c00640 1 -- 172.21.15.7:0/1940217822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc014a20 con 0x7f56c4159bf0 2024-08-19T00:44:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.778+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c4160640 con 0x7f56c4159bf0 2024-08-19T00:44:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.778+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c40b3240 con 0x7f56c4159bf0 2024-08-19T00:44:06.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.779+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c40d03c0 con 0x7f56c4159bf0 2024-08-19T00:44:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.780+0000 7f56c0c00640 1 -- 172.21.15.7:0/1940217822 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56bc014bc0 con 0x7f56c4159bf0 2024-08-19T00:44:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.780+0000 7f56c0c00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56a406be30 0x7f56a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.781+0000 7f56c0c00640 1 -- 172.21.15.7:0/1940217822 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7f56bc08b700 con 0x7f56c4159bf0 2024-08-19T00:44:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.781+0000 7f56c9200640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56a406be30 0x7f56a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:06.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.782+0000 7f56c9200640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56a406be30 0x7f56a406e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f56b8034000 tx=0x7f56b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:06.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:06.785+0000 7f56c0c00640 1 -- 172.21.15.7:0/1940217822 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f56bc0598f0 con 0x7f56c4159bf0 2024-08-19T00:44:07.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.005+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56c4150bc0 con 0x7f56c4159bf0 2024-08-19T00:44:07.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.006+0000 7f56c0c00640 1 -- 172.21.15.7:0/1940217822 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+4391 (secure 0 0 0) 0x7f56bc05dbf0 con 0x7f56c4159bf0 2024-08-19T00:44:07.007 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:07.008 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":106,"btime":"2024-08-19T00:44:06:189185+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:06.189116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:07.008 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 106 2024-08-19T00:44:07.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56a406be30 msgr2=0x7f56a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56a406be30 0x7f56a406e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f56b8034000 tx=0x7f56b802e000 comp rx=0 tx=0).stop 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 msgr2=0x7f56c41576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c41576e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f56bc007e70 tx=0x7f56bc00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 shutdown_connections 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56a406be30 0x7f56a406e2f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c4159bf0 0x7f56c41576e0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c40cea40 0x7f56c4150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 --2- 172.21.15.7:0/1940217822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56c40739a0 0x7f56c414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 >> 172.21.15.7:0/1940217822 conn(0x7f56c406bc70 msgr2=0x7f56c4074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 shutdown_connections 2024-08-19T00:44:07.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.008+0000 7f56cbc00640 1 -- 172.21.15.7:0/1940217822 wait complete. 2024-08-19T00:44:07.026 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:07.026 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.182+0000 7f8101800640 1 Processor -- start 2024-08-19T00:44:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.182+0000 7f8101800640 1 -- start start 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.183+0000 7f8101800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.183+0000 7f8101800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f80fc0b4380 0x7f80fc0b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.183+0000 7f8101800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc0b50b0 con 0x7f80fc15f5b0 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f8101800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f80fc15f990 con 0x7f80fc0b4380 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f8101800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80fc0cf120 con 0x7f80fc0d03c0 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80fb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f80fc0b4380 0x7f80fc0b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80fb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f80fc0b4380 0x7f80fc0b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47650/0 (socket says 172.21.15.7:47650) 2024-08-19T00:44:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80fb400640 1 -- 172.21.15.7:0/3155667164 learned_addr learned my addr 172.21.15.7:0/3155667164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80f3e00640 1 --2- 172.21.15.7:0/3155667164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80fb400640 1 -- 172.21.15.7:0/3155667164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 msgr2=0x7f80fc0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80fb400640 1 --2- 172.21.15.7:0/3155667164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80fb400640 1 -- 172.21.15.7:0/3155667164 >> v1:172.21.15.162:6789/0 conn(0x7f80fc15f5b0 legacy=0x7f80fc0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80fb400640 1 -- 172.21.15.7:0/3155667164 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc0cead0 con 0x7f80fc0b4380 2024-08-19T00:44:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.184+0000 7f80f3e00640 1 --2- 172.21.15.7:0/3155667164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.185+0000 7f80fb400640 1 --2- 172.21.15.7:0/3155667164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc0b4380 0x7f80fc0b4830 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009e50 tx=0x7f80f402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca87cc820922eb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.185+0000 7f80fa000640 1 -- 172.21.15.7:0/3155667164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4036070 con 0x7f80fc0b4380 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f80fa000640 1 -- 172.21.15.7:0/3155667164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f4031600 con 0x7f80fc0b4380 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f80fa000640 1 -- 172.21.15.7:0/3155667164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f40319d0 con 0x7f80fc0b4380 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 -- 172.21.15.7:0/3155667164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc0b4380 msgr2=0x7f80fc0b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 --2- 172.21.15.7:0/3155667164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc0b4380 0x7f80fc0b4830 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009e50 tx=0x7f80f402a680 comp rx=0 tx=0).stop 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 -- 172.21.15.7:0/3155667164 shutdown_connections 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 --2- 172.21.15.7:0/3155667164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc0b4380 0x7f80fc0b4830 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 --2- 172.21.15.7:0/3155667164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 -- 172.21.15.7:0/3155667164 >> 172.21.15.7:0/3155667164 conn(0x7f80fc06bc70 msgr2=0x7f80fc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 -- 172.21.15.7:0/3155667164 shutdown_connections 2024-08-19T00:44:07.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.186+0000 7f8101800640 1 -- 172.21.15.7:0/3155667164 wait complete. 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.188+0000 7f8101800640 1 Processor -- start 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.188+0000 7f8101800640 1 -- start start 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f8101800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0b4380 0x7f80fc151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f8101800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc1624d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f8101800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc15f5b0 0x7f80fc162a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f8101800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0b4d70 con 0x7f80fc15f5b0 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f8101800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0d0d40 con 0x7f80fc0b4380 2024-08-19T00:44:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f8101800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80fc06e660 con 0x7f80fc0d03c0 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc15f5b0 0x7f80fc162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc15f5b0 0x7f80fc162a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47652/0 (socket says 172.21.15.7:47652) 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 -- 172.21.15.7:0/1944051465 learned_addr learned my addr 172.21.15.7:0/1944051465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80f3e00640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc1624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80faa00640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0b4380 0x7f80fc151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 -- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 msgr2=0x7f80fc1624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc1624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 -- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0b4380 msgr2=0x7f80fc151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0b4380 0x7f80fc151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80fb400640 1 -- 172.21.15.7:0/1944051465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc0ae780 con 0x7f80fc15f5b0 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.189+0000 7f80f3e00640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.190+0000 7f80fb400640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc15f5b0 0x7f80fc162a10 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f80f4034040 tx=0x7f80f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.190+0000 7f80f2a00640 1 -- 172.21.15.7:0/1944051465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f403f020 con 0x7f80fc15f5b0 2024-08-19T00:44:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.190+0000 7f80f2a00640 1 -- 172.21.15.7:0/1944051465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f4037040 con 0x7f80fc15f5b0 2024-08-19T00:44:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.190+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80fc0adee0 con 0x7f80fc15f5b0 2024-08-19T00:44:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.190+0000 7f80f2a00640 1 -- 172.21.15.7:0/1944051465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4036070 con 0x7f80fc15f5b0 2024-08-19T00:44:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.190+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80fc0ae4a0 con 0x7f80fc15f5b0 2024-08-19T00:44:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.192+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80fc0b4830 con 0x7f80fc15f5b0 2024-08-19T00:44:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.192+0000 7f80f2a00640 1 -- 172.21.15.7:0/1944051465 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80f4042020 con 0x7f80fc15f5b0 2024-08-19T00:44:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.193+0000 7f80f2a00640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f80d806be30 0x7f80d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.193+0000 7f80f2a00640 1 -- 172.21.15.7:0/1944051465 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7f80f40ab410 con 0x7f80fc15f5b0 2024-08-19T00:44:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.193+0000 7f80faa00640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f80d806be30 0x7f80d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.194+0000 7f80faa00640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f80d806be30 0x7f80d806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f80ec000f60 tx=0x7f80ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:07.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.198+0000 7f80f2a00640 1 -- 172.21.15.7:0/1944051465 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f80f4049030 con 0x7f80fc15f5b0 2024-08-19T00:44:07.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.424+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80fc15fd60 con 0x7f80fc15f5b0 2024-08-19T00:44:07.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.425+0000 7f80f2a00640 1 -- 172.21.15.7:0/1944051465 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+4391 (secure 0 0 0) 0x7f80f4079cf0 con 0x7f80fc15f5b0 2024-08-19T00:44:07.427 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:07.427 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":106,"btime":"2024-08-19T00:44:06:189185+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":6496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1582667547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1582667547},{"type":"v1","addr":"172.21.15.7:6836","nonce":1582667547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:06.189116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:07.428 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 106 2024-08-19T00:44:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f80d806be30 msgr2=0x7f80d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f80d806be30 0x7f80d806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f80ec000f60 tx=0x7f80ec009040 comp rx=0 tx=0).stop 2024-08-19T00:44:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc15f5b0 msgr2=0x7f80fc162a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc15f5b0 0x7f80fc162a10 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f80f4034040 tx=0x7f80f4004a40 comp rx=0 tx=0).stop 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 shutdown_connections 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f80d806be30 0x7f80d806e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80fc15f5b0 0x7f80fc162a10 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80fc0d03c0 0x7f80fc1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 --2- 172.21.15.7:0/1944051465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0b4380 0x7f80fc151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.427+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 >> 172.21.15.7:0/1944051465 conn(0x7f80fc06bc70 msgr2=0x7f80fc15d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.428+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 shutdown_connections 2024-08-19T00:44:07.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.428+0000 7f8101800640 1 -- 172.21.15.7:0/1944051465 wait complete. 2024-08-19T00:44:07.445 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 1.00000000.inode' led to DAMAGED state 2024-08-19T00:44:07.445 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 200.00000000' 2024-08-19T00:44:07.445 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:07.445 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:07.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:44:07.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:07.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:07.481 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:44:07.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:44:07.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.755+0000 7f1648400640 1 Processor -- start 2024-08-19T00:44:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.755+0000 7f1648400640 1 -- start start 2024-08-19T00:44:07.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.756+0000 7f1648400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 0x7f16400ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.756+0000 7f1648400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164006f7f0 con 0x7f1640159bf0 2024-08-19T00:44:07.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.756+0000 7f1648400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164006f510 con 0x7f16400d03c0 2024-08-19T00:44:07.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.756+0000 7f1648400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16400cee80 con 0x7f16400ce500 2024-08-19T00:44:07.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.756+0000 7f1645a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1640159bf0 0x7f1640073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52150/0 (socket says 172.21.15.7:52150) 2024-08-19T00:44:07.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.756+0000 7f1645a00640 1 -- 172.21.15.7:0/3344478839 learned_addr learned my addr 172.21.15.7:0/3344478839 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605385651 0 0) 0x7f164006f7f0 con 0x7f1640159bf0 2024-08-19T00:44:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f1645000640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 0x7f16400ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1628003520 con 0x7f1640159bf0 2024-08-19T00:44:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3731487998 0 0) 0x7f1628003520 con 0x7f1640159bf0 2024-08-19T00:44:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 msgr2=0x7f16400ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 0x7f16400ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 >> v1:172.21.15.162:6789/0 conn(0x7f16400d03c0 legacy=0x7f164006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1640072980 con 0x7f1640159bf0 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f1634001670 con 0x7f1640159bf0 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 >> v1:172.21.15.7:6789/0 conn(0x7f1640159bf0 legacy=0x7f1640073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 0x7f16280039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1628003f60 0x7f1628004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1628004d40 0x7f16280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16400cee80 con 0x7f1628003f60 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f162800bb50 con 0x7f1628004d40 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.757+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f162800bd50 con 0x7f16400ce500 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1645a00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 0x7f16280039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1645000640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1628003f60 0x7f1628004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1646400640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1628004d40 0x7f16280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1645a00640 1 -- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1628004d40 msgr2=0x7f16280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1645a00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1628004d40 0x7f16280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1645a00640 1 -- 172.21.15.7:0/3344478839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1628003f60 msgr2=0x7f1628004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1645a00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1628003f60 0x7f1628004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.758+0000 7f1645a00640 1 -- 172.21.15.7:0/3344478839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1628003520 con 0x7f16400ce500 2024-08-19T00:44:07.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.759+0000 7f1645a00640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 0x7f16280039e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f163400c270 tx=0x7f1628005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea27ea589c78c967 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.759+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634007d10 con 0x7f16400ce500 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1634005ad0 con 0x7f16400ce500 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f163fe00640 1 -- 172.21.15.7:0/3344478839 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634007070 con 0x7f16400ce500 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f1648400640 1 -- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 msgr2=0x7f16280039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f1648400640 1 --2- 172.21.15.7:0/3344478839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16400ce500 0x7f16280039e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f163400c270 tx=0x7f1628005830 comp rx=0 tx=0).stop 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f1646400640 1 -- 172.21.15.7:0/3344478839 reap_dead start 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f1648400640 1 -- 172.21.15.7:0/3344478839 shutdown_connections 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f1648400640 1 -- 172.21.15.7:0/3344478839 >> 172.21.15.7:0/3344478839 conn(0x7f164006bc70 msgr2=0x7f164006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f1648400640 1 -- 172.21.15.7:0/3344478839 shutdown_connections 2024-08-19T00:44:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.760+0000 7f1648400640 1 -- 172.21.15.7:0/3344478839 wait complete. 2024-08-19T00:44:07.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.762+0000 7f1648400640 1 Processor -- start 2024-08-19T00:44:07.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.762+0000 7f1648400640 1 -- start start 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1648400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16400ce500 0x7f1640154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1648400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1640155270 0x7f164015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1648400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164015f360 0x7f164009b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1648400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1640073b70 con 0x7f1640155270 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1648400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1640072f40 con 0x7f16400ce500 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1648400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1640159fd0 con 0x7f164015f360 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1645000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1640155270 0x7f164015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1645000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1640155270 0x7f164015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47666/0 (socket says 172.21.15.7:47666) 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1645000640 1 -- 172.21.15.7:0/870605160 learned_addr learned my addr 172.21.15.7:0/870605160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1645a00640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16400ce500 0x7f1640154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.763+0000 7f1646400640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164015f360 0x7f164009b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1645000640 1 -- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164015f360 msgr2=0x7f164009b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1645000640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164015f360 0x7f164009b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1645000640 1 -- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16400ce500 msgr2=0x7f1640154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1645000640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16400ce500 0x7f1640154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1645000640 1 -- 172.21.15.7:0/870605160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1640155780 con 0x7f1640155270 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1645000640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1640155270 0x7f164015ee20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f162c011930 tx=0x7f162c011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f163d600640 1 -- 172.21.15.7:0/870605160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c00faf0 con 0x7f1640155270 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f163d600640 1 -- 172.21.15.7:0/870605160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162c00fc90 con 0x7f1640155270 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f163d600640 1 -- 172.21.15.7:0/870605160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c014440 con 0x7f1640155270 2024-08-19T00:44:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1640155a60 con 0x7f1640155270 2024-08-19T00:44:07.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.764+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1640156020 con 0x7f1640155270 2024-08-19T00:44:07.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.765+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16400ce940 con 0x7f1640155270 2024-08-19T00:44:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.766+0000 7f163d600640 1 -- 172.21.15.7:0/870605160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f162c012040 con 0x7f1640155270 2024-08-19T00:44:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.767+0000 7f163d600640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f162006be30 0x7f162006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.767+0000 7f163d600640 1 -- 172.21.15.7:0/870605160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7f162c08b6e0 con 0x7f1640155270 2024-08-19T00:44:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.768+0000 7f1645a00640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f162006be30 0x7f162006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.768+0000 7f1645a00640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f162006be30 0x7f162006e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1634033000 tx=0x7f1634009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.772+0000 7f163d600640 1 -- 172.21.15.7:0/870605160 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f162c019030 con 0x7f1640155270 2024-08-19T00:44:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:07.992+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f164015bd90 con 0x7f1640155270 2024-08-19T00:44:08.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.184+0000 7f163d600640 1 -- 172.21.15.7:0/870605160 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v107) ==== 161+0+0 (secure 0 0 0) 0x7f162c059e90 con 0x7f1640155270 2024-08-19T00:44:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.186+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f162006be30 msgr2=0x7f162006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:08.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.186+0000 7f1648400640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f162006be30 0x7f162006e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1634033000 tx=0x7f1634009030 comp rx=0 tx=0).stop 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.186+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1640155270 msgr2=0x7f164015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.186+0000 7f1648400640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1640155270 0x7f164015ee20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f162c011930 tx=0x7f162c011df0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 shutdown_connections 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f162006be30 0x7f162006e2f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f164015f360 0x7f164009b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1640155270 0x7f164015ee20 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 --2- 172.21.15.7:0/870605160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16400ce500 0x7f1640154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 >> 172.21.15.7:0/870605160 conn(0x7f164006bc70 msgr2=0x7f164015fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 shutdown_connections 2024-08-19T00:44:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.187+0000 7f1648400640 1 -- 172.21.15.7:0/870605160 wait complete. 2024-08-19T00:44:08.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.360+0000 7f9138800640 1 Processor -- start 2024-08-19T00:44:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.360+0000 7f9138800640 1 -- start start 2024-08-19T00:44:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.361+0000 7f9138800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9130159bf0 0x7f9130073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9138800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913006f7f0 con 0x7f91300cec10 2024-08-19T00:44:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9138800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913006f510 con 0x7f91300739a0 2024-08-19T00:44:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9138800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9130072980 con 0x7f9130159bf0 2024-08-19T00:44:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9136800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f91300cec10 0x7f91300d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52164/0 (socket says 172.21.15.7:52164) 2024-08-19T00:44:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9136800640 1 -- 172.21.15.7:0/1224920985 learned_addr learned my addr 172.21.15.7:0/1224920985 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9135e00640 1 --2- 172.21.15.7:0/1224920985 >> v2:172.21.15.162:3300/0 conn(0x7f9130159bf0 0x7f9130073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9134a00640 1 -- 172.21.15.7:0/1224920985 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745609603 0 0) 0x7f913006f7f0 con 0x7f91300cec10 2024-08-19T00:44:08.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9134a00640 1 -- 172.21.15.7:0/1224920985 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9118003520 con 0x7f91300cec10 2024-08-19T00:44:08.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.362+0000 7f9135e00640 1 -- 172.21.15.7:0/1224920985 >> v1:172.21.15.162:6789/0 conn(0x7f91300739a0 legacy=0x7f91300ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:08.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.363+0000 7f9135e00640 1 -- 172.21.15.7:0/1224920985 >> v1:172.21.15.7:6789/0 conn(0x7f91300cec10 legacy=0x7f91300d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:08.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.363+0000 7f9135e00640 1 -- 172.21.15.7:0/1224920985 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9130072c60 con 0x7f9130159bf0 2024-08-19T00:44:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.364+0000 7f9135e00640 1 --2- 172.21.15.7:0/1224920985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130073460 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f91240097a0 tx=0x7f912402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8733f1c2a9bcbff3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.364+0000 7f9134a00640 1 -- 172.21.15.7:0/1224920985 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124037070 con 0x7f9130159bf0 2024-08-19T00:44:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.364+0000 7f9134a00640 1 -- 172.21.15.7:0/1224920985 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9124032440 con 0x7f9130159bf0 2024-08-19T00:44:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.364+0000 7f9134a00640 1 -- 172.21.15.7:0/1224920985 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124032810 con 0x7f9130159bf0 2024-08-19T00:44:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.364+0000 7f9138800640 1 -- 172.21.15.7:0/1224920985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 msgr2=0x7f9130073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.364+0000 7f9138800640 1 --2- 172.21.15.7:0/1224920985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130073460 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f91240097a0 tx=0x7f912402a1a0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.365+0000 7f9138800640 1 -- 172.21.15.7:0/1224920985 shutdown_connections 2024-08-19T00:44:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.365+0000 7f9138800640 1 --2- 172.21.15.7:0/1224920985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130073460 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.365+0000 7f9138800640 1 -- 172.21.15.7:0/1224920985 >> 172.21.15.7:0/1224920985 conn(0x7f913006bc70 msgr2=0x7f913006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.365+0000 7f9138800640 1 -- 172.21.15.7:0/1224920985 shutdown_connections 2024-08-19T00:44:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.365+0000 7f9138800640 1 -- 172.21.15.7:0/1224920985 wait complete. 2024-08-19T00:44:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.366+0000 7f9138800640 1 Processor -- start 2024-08-19T00:44:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.366+0000 7f9138800640 1 -- start start 2024-08-19T00:44:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.367+0000 7f9138800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300739a0 0x7f913009db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.367+0000 7f9138800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.367+0000 7f9138800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91301574a0 0x7f9130155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.367+0000 7f9138800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f913015a150 con 0x7f91301574a0 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.367+0000 7f9138800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9130159fd0 con 0x7f9130159bf0 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.367+0000 7f9138800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91300d0ad0 con 0x7f91300739a0 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.367+0000 7f9136800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91301574a0 0x7f9130155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91301574a0 0x7f9130155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47678/0 (socket says 172.21.15.7:47678) 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 -- 172.21.15.7:0/4248429700 learned_addr learned my addr 172.21.15.7:0/4248429700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9135400640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9135e00640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300739a0 0x7f913009db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 -- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300739a0 msgr2=0x7f913009db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300739a0 0x7f913009db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 -- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 msgr2=0x7f9130156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 -- 172.21.15.7:0/4248429700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91301f55d0 con 0x7f91301574a0 2024-08-19T00:44:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9135400640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9135e00640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300739a0 0x7f913009db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f9136800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91301574a0 0x7f9130155c70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f912c00cbb0 tx=0x7f912c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.368+0000 7f912a000640 1 -- 172.21.15.7:0/4248429700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c017070 con 0x7f91301574a0 2024-08-19T00:44:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.369+0000 7f912a000640 1 -- 172.21.15.7:0/4248429700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c00ad40 con 0x7f91301574a0 2024-08-19T00:44:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.369+0000 7f912a000640 1 -- 172.21.15.7:0/4248429700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c012600 con 0x7f91301574a0 2024-08-19T00:44:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.369+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91301f58b0 con 0x7f91301574a0 2024-08-19T00:44:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.369+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91301f5e70 con 0x7f91301574a0 2024-08-19T00:44:08.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.370+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9130073460 con 0x7f91301574a0 2024-08-19T00:44:08.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.371+0000 7f912a000640 1 -- 172.21.15.7:0/4248429700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f912c01a070 con 0x7f91301574a0 2024-08-19T00:44:08.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.372+0000 7f912a000640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f911406be30 0x7f911406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:08.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.372+0000 7f912a000640 1 -- 172.21.15.7:0/4248429700 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7f912c08ad60 con 0x7f91301574a0 2024-08-19T00:44:08.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.372+0000 7f9135e00640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f911406be30 0x7f911406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:08.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.373+0000 7f9135e00640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f911406be30 0x7f911406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9124034000 tx=0x7f912402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:08.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.377+0000 7f912a000640 1 -- 172.21.15.7:0/4248429700 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f912c058ec0 con 0x7f91301574a0 2024-08-19T00:44:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:08.629+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f91300b1eb0 con 0x7f91301574a0 2024-08-19T00:44:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.185+0000 7f912a000640 1 -- 172.21.15.7:0/4248429700 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v108) ==== 101+0+0 (secure 0 0 0) 0x7f912c05d1c0 con 0x7f91301574a0 2024-08-19T00:44:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:44:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f911406be30 msgr2=0x7f911406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f911406be30 0x7f911406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9124034000 tx=0x7f912402e000 comp rx=0 tx=0).stop 2024-08-19T00:44:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91301574a0 msgr2=0x7f9130155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91301574a0 0x7f9130155c70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f912c00cbb0 tx=0x7f912c00a430 comp rx=0 tx=0).stop 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 shutdown_connections 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f911406be30 0x7f911406e2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91301574a0 0x7f9130155c70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9130159bf0 0x7f9130156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 --2- 172.21.15.7:0/4248429700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300739a0 0x7f913009db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.188+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 >> 172.21.15.7:0/4248429700 conn(0x7f913006bc70 msgr2=0x7f913006c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.189+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 shutdown_connections 2024-08-19T00:44:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.189+0000 7f9138800640 1 -- 172.21.15.7:0/4248429700 wait complete. 2024-08-19T00:44:09.209 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.285+0000 7f1f3ed71f40 1 Processor -- start 2024-08-19T00:44:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.285+0000 7f1f3ed71f40 1 -- start start 2024-08-19T00:44:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ed71f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c44f40 0x557e11c14170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ed71f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c465b0 0x557e11d7ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ed71f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11d7d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ed71f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e11c458f0 con 0x557e11c46990 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ed71f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e11bbad00 con 0x557e11c44f40 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ed71f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e11cebdc0 con 0x557e11c465b0 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11d7d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11d7d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47688/0 (socket says 172.21.15.7:47688) 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.286+0000 7f1f3ca00640 1 -- 172.21.15.7:0/779150649 learned_addr learned my addr 172.21.15.7:0/779150649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3c000640 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c44f40 0x557e11c14170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3ca00640 1 -- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c465b0 msgr2=0x557e11d7ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c465b0 0x557e11d7ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3ca00640 1 -- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c44f40 msgr2=0x557e11c14170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c44f40 0x557e11c14170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3ca00640 1 -- 172.21.15.7:0/779150649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e11b3fb30 con 0x557e11c46990 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3c000640 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c44f40 0x557e11c14170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11d7d350 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1f34025a80 tx=0x7f1f34050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507bcb829cedf460 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3a200640 1 -- 172.21.15.7:0/779150649 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3404fc20 con 0x557e11c46990 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3a200640 1 -- 172.21.15.7:0/779150649 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3404fdc0 con 0x557e11c46990 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.287+0000 7f1f3a200640 1 -- 172.21.15.7:0/779150649 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f34057640 con 0x557e11c46990 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/779150649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 msgr2=0x557e11d7d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11d7d350 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1f34025a80 tx=0x7f1f34050000 comp rx=0 tx=0).stop 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/779150649 shutdown_connections 2024-08-19T00:44:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11d7d350 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c465b0 0x557e11d7ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/779150649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c44f40 0x557e11c14170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/779150649 >> 172.21.15.7:0/779150649 conn(0x557e11c434e0 msgr2=0x557e11c438c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/779150649 shutdown_connections 2024-08-19T00:44:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/779150649 wait complete. 2024-08-19T00:44:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.288+0000 7f1f3ed71f40 1 Processor -- start 2024-08-19T00:44:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.289+0000 7f1f3ed71f40 1 -- start start 2024-08-19T00:44:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.289+0000 7f1f3ed71f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c44f40 0x557e11cda3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.289+0000 7f1f3ed71f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c465b0 0x557e11cdec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.289+0000 7f1f3ed71f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11cdab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.289+0000 7f1f3ed71f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e11ce0d20 con 0x557e11c46990 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.289+0000 7f1f3ed71f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e11c5f0b0 con 0x557e11c465b0 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.289+0000 7f1f3ed71f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557e11ce0f90 con 0x557e11c44f40 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11cdab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11cdab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47700/0 (socket says 172.21.15.7:47700) 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 learned_addr learned my addr 172.21.15.7:0/3527203905 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3c000640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c44f40 0x557e11cda3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3b600640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c465b0 0x557e11cdec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c44f40 msgr2=0x557e11cda3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557e11c44f40 0x557e11cda3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c465b0 msgr2=0x557e11cdec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e11c465b0 0x557e11cdec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e11b7c080 con 0x557e11c46990 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.290+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11cdab70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f1f34005780 tx=0x7f1f34003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.291+0000 7f1f38e00640 1 -- 172.21.15.7:0/3527203905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3404fa20 con 0x557e11c46990 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.291+0000 7f1f38e00640 1 -- 172.21.15.7:0/3527203905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3404fbe0 con 0x557e11c46990 2024-08-19T00:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.291+0000 7f1f38e00640 1 -- 172.21.15.7:0/3527203905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f34057a40 con 0x557e11c46990 2024-08-19T00:44:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.291+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e11ceb030 con 0x557e11c46990 2024-08-19T00:44:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.291+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e11cdfd80 con 0x557e11c46990 2024-08-19T00:44:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.293+0000 7f1f38e00640 1 -- 172.21.15.7:0/3527203905 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f34074030 con 0x557e11c46990 2024-08-19T00:44:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.294+0000 7f1f38e00640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f1c06a810 0x7f1f1c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.294+0000 7f1f38e00640 1 -- 172.21.15.7:0/3527203905 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7f1f340cecd0 con 0x557e11c46990 2024-08-19T00:44:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.294+0000 7f1f3c000640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f1c06a810 0x7f1f1c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.298 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.294+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557e11ce4900 0x557e11d81620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.294+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11cee420 con 0x557e11ce4900 2024-08-19T00:44:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.294+0000 7f1f3c000640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f1c06a810 0x7f1f1c06ccd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c000c00 tx=0x7f1f2c0017d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.294+0000 7f1f3b600640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557e11ce4900 0x557e11d81620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.295+0000 7f1f3b600640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557e11ce4900 0x557e11d81620 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.297+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v90'102 uv78 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.297+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d81b60 con 0x557e11ce4900 2024-08-19T00:44:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.298+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v90'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.298+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d81fc0 con 0x557e11ce4900 2024-08-19T00:44:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.300+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v90'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.302 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:09.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.300+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8ec50 con 0x557e11ce4900 2024-08-19T00:44:09.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.302+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v90'105 uv105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.302+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8eff0 con 0x557e11ce4900 2024-08-19T00:44:09.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.304+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v90'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.304+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8dc40 con 0x557e11ce4900 2024-08-19T00:44:09.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.305+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v90'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.305+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.307+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v90'108 uv84 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.307+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.308+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v90'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.308+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.309+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v90'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.311 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:09.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.310+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.311+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v90'111 uv111 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.311+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.312+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v90'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.313+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.314+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v90'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.314+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.315+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v90'114 uv91 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.316+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.317+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v90'115 uv115 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.317+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.318+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v90'116 uv116 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.320 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.318+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.320+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v90'117 uv117 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.320+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.321+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v90'118 uv118 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.321+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e030 con 0x557e11ce4900 2024-08-19T00:44:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.323+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v90'119 uv119 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.323+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8f390 con 0x557e11ce4900 2024-08-19T00:44:09.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.325+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v90'120 uv120 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.325+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8f390 con 0x557e11ce4900 2024-08-19T00:44:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.326+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v90'121 uv95 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.326+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8f390 con 0x557e11ce4900 2024-08-19T00:44:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.328+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v90'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.328+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8f390 con 0x557e11ce4900 2024-08-19T00:44:09.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.329+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v90'123 uv123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.331 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:09.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.329+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d903a0 con 0x557e11ce4900 2024-08-19T00:44:09.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.331+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v90'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.331+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.332+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v90'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.332+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.334+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v90'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.334+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.335+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v90'127 uv101 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.335+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.337+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v90'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.337+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.339+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v90'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.340 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:09.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.339+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.340+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v90'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.340+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.341+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v90'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.341+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d8e7a0 con 0x557e11ce4900 2024-08-19T00:44:09.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.343+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v90'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.343+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557e11d8e7a0 0x557e11d918b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.343+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d91df0 con 0x557e11d8e7a0 2024-08-19T00:44:09.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.343+0000 7f1f3c000640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557e11d8e7a0 0x557e11d918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.344+0000 7f1f3c000640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557e11d8e7a0 0x557e11d918b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.346 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:09.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.345+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v90'89 uv89 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.345+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d92190 con 0x557e11d8e7a0 2024-08-19T00:44:09.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.347+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [write 0~582] v90'90 uv90 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.347+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d92530 con 0x557e11d8e7a0 2024-08-19T00:44:09.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.348+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v90'91 uv91 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.348+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d928d0 con 0x557e11d8e7a0 2024-08-19T00:44:09.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.349+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 200.00000000 [create] v90'92 uv76 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.350+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d92c70 con 0x557e11d8e7a0 2024-08-19T00:44:09.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.351+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 200.00000000 [delete] v90'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.351+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93010 con 0x557e11d8e7a0 2024-08-19T00:44:09.353 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:09.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.352+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v90'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.352+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d933b0 con 0x557e11d8e7a0 2024-08-19T00:44:09.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.354+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [write 0~90] v90'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.354+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.355+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [omap-set-header] v90'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.355+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.356+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000001 [create] v90'97 uv81 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.356+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.358+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000001 [delete] v90'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.358+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.360 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.359+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v90'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.359+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d97e40 con 0x557e11d8e7a0 2024-08-19T00:44:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.361+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [write 0~18118] v90'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.361+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d97e40 con 0x557e11d8e7a0 2024-08-19T00:44:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.362+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v90'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.362+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.363+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 606.00000000 [create] v90'102 uv87 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.363+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.364+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 606.00000000 [delete] v90'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.364+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.367 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.366+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v90'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.366+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d94760 con 0x557e11d8e7a0 2024-08-19T00:44:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.367+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v90'105 uv105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.367+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d94760 con 0x557e11d8e7a0 2024-08-19T00:44:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.368+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v90'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.369+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d93750 con 0x557e11d8e7a0 2024-08-19T00:44:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.370+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v90'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d8e7a0 2024-08-19T00:44:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.370+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557e11d93dd0 0x557e11d961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.370+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:51 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d96700 con 0x557e11d93dd0 2024-08-19T00:44:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.370+0000 7f1f3b600640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557e11d93dd0 0x557e11d961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.371+0000 7f1f3b600640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557e11d93dd0 0x557e11d961c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.373+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(51 607.00000000 [create] v90'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.373+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:52 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d967c0 con 0x557e11d93dd0 2024-08-19T00:44:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.374+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(52 607.00000000 [delete] v90'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.374+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d96bb0 con 0x557e11d93dd0 2024-08-19T00:44:09.377 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:09.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.375+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(53 607.00000000 [create] v90'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.375+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d97bc0 con 0x557e11d93dd0 2024-08-19T00:44:09.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.377+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v90'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.377+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d97bc0 con 0x557e11d93dd0 2024-08-19T00:44:09.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.378+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v90'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.378+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d96bb0 con 0x557e11d93dd0 2024-08-19T00:44:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.380+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v90'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.380+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:57 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d96bb0 con 0x557e11ce4900 2024-08-19T00:44:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.382+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(57 mds0_openfiles.0 [create] v90'18 uv17 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.382+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:58 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d96bb0 con 0x557e11ce4900 2024-08-19T00:44:09.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.383+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v90'19 uv19 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.383+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d96bb0 con 0x557e11ce4900 2024-08-19T00:44:09.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.385+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(59 mds0_openfiles.0 [create] v90'20 uv20 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.386 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:09.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.385+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d96bb0 con 0x557e11ce4900 2024-08-19T00:44:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.386+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v90'21 uv21 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.386+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e11d97230 0x557e11d99620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.386+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:61 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d99bf0 con 0x557e11d97230 2024-08-19T00:44:09.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.386+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e11d97230 0x557e11d99620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.387+0000 7f1f3ca00640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e11d97230 0x557e11d99620 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.388+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(61 608.00000000 [create] v90'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.389+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:62 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9a070 con 0x557e11d97230 2024-08-19T00:44:09.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.390+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(62 608.00000000 [delete] v90'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.390+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9a550 con 0x557e11d97230 2024-08-19T00:44:09.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.391+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(63 608.00000000 [create] v90'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.395 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:09.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.391+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9be00 con 0x557e11d97230 2024-08-19T00:44:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.392+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v90'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.392+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9c1a0 con 0x557e11d97230 2024-08-19T00:44:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.394+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v90'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.394+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9adf0 con 0x557e11d97230 2024-08-19T00:44:09.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.395+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v90'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.395+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557e11d9b710 0x557e11d9e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.395+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:67 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9ea90 con 0x557e11d9b710 2024-08-19T00:44:09.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.396+0000 7f1f3c000640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557e11d9b710 0x557e11d9e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.396+0000 7f1f3c000640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557e11d9b710 0x557e11d9e550 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.398+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(67 604.00000000 [create] v90'37 uv31 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.398+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:68 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9ea90 con 0x557e11d9b710 2024-08-19T00:44:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.399+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(68 604.00000000 [delete] v90'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.399+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9ead0 con 0x557e11d9b710 2024-08-19T00:44:09.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.400+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(69 604.00000000 [create] v90'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.402 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:09.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.400+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9fed0 con 0x557e11d9b710 2024-08-19T00:44:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.402+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v90'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.402+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9fed0 con 0x557e11d9b710 2024-08-19T00:44:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.403+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v90'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.403+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9eec0 con 0x557e11d9b710 2024-08-19T00:44:09.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.404+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v90'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.404+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9eec0 con 0x557e11d9b710 2024-08-19T00:44:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.406+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(73 500.00000000 [create] v90'43 uv36 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.406+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9eec0 con 0x557e11d9b710 2024-08-19T00:44:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.407+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(74 500.00000000 [delete] v90'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.407+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9eec0 con 0x557e11d9b710 2024-08-19T00:44:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.408+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(75 500.00000000 [create] v90'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.410 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:09.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.408+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9eec0 con 0x557e11d9b710 2024-08-19T00:44:09.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.410+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v90'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.410+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11d9eec0 con 0x557e11d9b710 2024-08-19T00:44:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.411+0000 7f1f3c000640 1 -- 172.21.15.7:0/3527203905 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v90'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f2c01a040 con 0x557e11d9b710 2024-08-19T00:44:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.411+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e11d9f3d0 0x557e11da17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.411+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:78 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da1ec0 con 0x557e11d9f3d0 2024-08-19T00:44:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.411+0000 7f1f3b600640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e11d9f3d0 0x557e11da17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.412+0000 7f1f3b600640 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e11d9f3d0 0x557e11da17c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.413+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(78 mds_snaptable [create] v90'17 uv16 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.413+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:79 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da1ec0 con 0x557e11d9f3d0 2024-08-19T00:44:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.415+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(79 mds_snaptable [delete] v90'18 uv18 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.415+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d9f3d0 2024-08-19T00:44:09.418 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.417+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(80 mds_snaptable [create] v90'19 uv19 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.417+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d9f3d0 2024-08-19T00:44:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.419+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v90'20 uv20 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.419+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d9f3d0 2024-08-19T00:44:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.420+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v90'21 uv21 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.420+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:83 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11ce4900 2024-08-19T00:44:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.421+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(83 605.00000000 [create] v90'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.421+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:84 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11ce4900 2024-08-19T00:44:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.423+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(84 605.00000000 [delete] v90'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.423+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11ce4900 2024-08-19T00:44:09.426 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.424+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(85 605.00000000 [create] v90'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.424+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da32f0 con 0x557e11ce4900 2024-08-19T00:44:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.426+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v90'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.426+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da32f0 con 0x557e11ce4900 2024-08-19T00:44:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.427+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v90'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.427+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11ce4900 2024-08-19T00:44:09.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.428+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(88 605.00000000 [omap-set-header] v90'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11ce4900 2024-08-19T00:44:09.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.429+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:89 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.430+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(89 mds0_inotable [create] v90'34 uv28 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.430+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:90 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.432+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(90 mds0_inotable [delete] v90'35 uv35 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.432+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.433+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(91 mds0_inotable [create] v90'36 uv36 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.433+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.435+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(92 mds0_inotable [write 0~34] v90'37 uv37 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.435+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.436+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v90'38 uv38 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.436+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.438+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(94 100.00000000 [create] v90'39 uv33 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.438+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.439+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(95 100.00000000 [delete] v90'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.439+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.442 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:09.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.441+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(96 100.00000000 [create] v90'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.441+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da22e0 con 0x557e11d93dd0 2024-08-19T00:44:09.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.442+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(97 100.00000000 [omap-set-header] v90'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.442+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da50f0 con 0x557e11d93dd0 2024-08-19T00:44:09.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.444+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v90'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d93dd0 2024-08-19T00:44:09.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.444+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.445+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v90'18 uv17 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.445+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.447+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v90'19 uv19 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.447+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.450 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:09.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.448+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v90'20 uv20 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.448+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.450+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v90'21 uv21 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.450+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.452+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v90'21 uv20 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.452+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.453+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v90'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.453+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.454+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v90'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.456 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:09.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.454+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da37a0 con 0x557e11d97230 2024-08-19T00:44:09.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.455+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v90'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.455+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da37a0 con 0x557e11d97230 2024-08-19T00:44:09.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.457+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v90'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.457+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d97230 2024-08-19T00:44:09.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.458+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v90'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f34060070 con 0x557e11d97230 2024-08-19T00:44:09.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.458+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.460+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v90'17 uv16 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.460+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.461+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v90'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.461+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.464 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.462+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v90'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.462+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.464+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v90'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.464+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.465+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v90'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.465+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.467+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v90'45 uv37 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.467+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.468+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v90'46 uv46 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.468+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.469+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v90'47 uv47 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.471 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:09.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.469+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.471+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v90'48 uv48 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.471+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.472+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v90'49 uv49 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.472+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.473+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v90'50 uv44 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.473+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.474+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v90'51 uv51 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.475+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.477 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:09.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.476+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v90'52 uv52 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.476+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da37a0 con 0x557e11d9f3d0 2024-08-19T00:44:09.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.477+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v90'53 uv53 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.477+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da37a0 con 0x557e11d9f3d0 2024-08-19T00:44:09.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.478+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v90'54 uv54 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.478+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2790 con 0x557e11d9f3d0 2024-08-19T00:44:09.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.480+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v90'55 uv55 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.480+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x557e11da2cf0 con 0x557e11d9f3d0 2024-08-19T00:44:09.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3b600640 1 -- 172.21.15.7:0/3527203905 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v90'56 uv56 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f1f28009040 con 0x557e11d9f3d0 2024-08-19T00:44:09.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557e11d8e7a0 msgr2=0x557e11d918b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557e11d8e7a0 0x557e11d918b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557e11d9b710 msgr2=0x557e11d9e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557e11d9b710 0x557e11d9e550 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e11d9f3d0 msgr2=0x557e11da17c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557e11d9f3d0 0x557e11da17c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557e11d93dd0 msgr2=0x557e11d961c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557e11d93dd0 0x557e11d961c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 reap_dead start 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557e11ce4900 msgr2=0x557e11d81620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557e11ce4900 0x557e11d81620 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ca00640 1 -- 172.21.15.7:0/3527203905 reap_dead start 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e11d97230 msgr2=0x557e11d99620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e11d97230 0x557e11d99620 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f1c06a810 msgr2=0x7f1f1c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f1c06a810 0x7f1f1c06ccd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c000c00 tx=0x7f1f2c0017d0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 msgr2=0x557e11cdab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11cdab70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f1f34005780 tx=0x7f1f34003330 comp rx=0 tx=0).stop 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 shutdown_connections 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f1c06a810 0x7f1f1c06ccd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e11c46990 0x557e11cdab70 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 --2- 172.21.15.7:0/3527203905 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557e11d97230 0x557e11d99620 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 >> 172.21.15.7:0/3527203905 conn(0x557e11c434e0 msgr2=0x557e11c14250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.481+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 shutdown_connections 2024-08-19T00:44:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.482+0000 7f1f3ed71f40 1 -- 172.21.15.7:0/3527203905 wait complete. 2024-08-19T00:44:09.488 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 200.00000000 2024-08-19T00:44:09.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.603+0000 7faadc2f4f40 1 Processor -- start 2024-08-19T00:44:09.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.603+0000 7faadc2f4f40 1 -- start start 2024-08-19T00:44:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.604+0000 7faadc2f4f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x5645826532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.604+0000 7faadc2f4f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645826985b0 0x564582722210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.604+0000 7faadc2f4f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564582698990 0x56458273f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.604+0000 7faadc2f4f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5645826978f0 con 0x564582698990 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.604+0000 7faadc2f4f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56458260cd00 con 0x564582696f40 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.604+0000 7faadc2f4f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56458273ddc0 con 0x5645826985b0 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.604+0000 7faad9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564582698990 0x56458273f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x5645826532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad8a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645826985b0 0x564582722210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x5645826532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:50272/0 (socket says 172.21.15.7:50272) 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9400640 1 -- 172.21.15.7:0/3012356110 learned_addr learned my addr 172.21.15.7:0/3012356110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9e00640 1 -- 172.21.15.7:0/3012356110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645826985b0 msgr2=0x564582722210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:09.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9e00640 1 --2- 172.21.15.7:0/3012356110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645826985b0 0x564582722210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9e00640 1 -- 172.21.15.7:0/3012356110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 msgr2=0x5645826532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9e00640 1 --2- 172.21.15.7:0/3012356110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x5645826532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9e00640 1 -- 172.21.15.7:0/3012356110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564582591b30 con 0x564582698990 2024-08-19T00:44:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad9e00640 1 --2- 172.21.15.7:0/3012356110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564582698990 0x56458273f7a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7faad4053000 tx=0x7faad4050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e56694f7cfa73f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad3400640 1 -- 172.21.15.7:0/3012356110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4055040 con 0x564582698990 2024-08-19T00:44:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad3400640 1 -- 172.21.15.7:0/3012356110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad4051b80 con 0x564582698990 2024-08-19T00:44:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.605+0000 7faad3400640 1 -- 172.21.15.7:0/3012356110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad405c440 con 0x564582698990 2024-08-19T00:44:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 -- 172.21.15.7:0/3012356110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564582698990 msgr2=0x56458273f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/3012356110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564582698990 0x56458273f7a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7faad4053000 tx=0x7faad4050000 comp rx=0 tx=0).stop 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 -- 172.21.15.7:0/3012356110 shutdown_connections 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/3012356110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564582698990 0x56458273f7a0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/3012356110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645826985b0 0x564582722210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/3012356110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x5645826532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 -- 172.21.15.7:0/3012356110 >> 172.21.15.7:0/3012356110 conn(0x5645826954e0 msgr2=0x5645826b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 -- 172.21.15.7:0/3012356110 shutdown_connections 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.606+0000 7faadc2f4f40 1 -- 172.21.15.7:0/3012356110 wait complete. 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.607+0000 7faadc2f4f40 1 Processor -- start 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.607+0000 7faadc2f4f40 1 -- start start 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faadc2f4f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x564582666140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faadc2f4f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645826985b0 0x56458271ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faadc2f4f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564582698990 0x5645827303f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faadc2f4f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5645826947c0 con 0x5645826985b0 2024-08-19T00:44:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faadc2f4f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5645826537e0 con 0x564582696f40 2024-08-19T00:44:09.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faadc2f4f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564582694a60 con 0x564582698990 2024-08-19T00:44:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faad8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645826985b0 0x56458271ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faad9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x564582666140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faad8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645826985b0 0x56458271ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47728/0 (socket says 172.21.15.7:47728) 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faad8a00640 1 -- 172.21.15.7:0/1661056480 learned_addr learned my addr 172.21.15.7:0/1661056480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faad9e00640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564582698990 0x5645827303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.608+0000 7faad8a00640 1 -- 172.21.15.7:0/1661056480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564582698990 msgr2=0x5645827303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad8a00640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564582698990 0x5645827303f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad8a00640 1 -- 172.21.15.7:0/1661056480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 msgr2=0x564582666140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad8a00640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x564582666140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad8a00640 1 -- 172.21.15.7:0/1661056480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645825ce080 con 0x5645826985b0 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad9400640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564582696f40 0x564582666140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad8a00640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645826985b0 0x56458271ff30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7faac800bdb0 tx=0x7faac800a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad2000640 1 -- 172.21.15.7:0/1661056480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac800ae00 con 0x5645826985b0 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad2000640 1 -- 172.21.15.7:0/1661056480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac80085e0 con 0x5645826985b0 2024-08-19T00:44:09.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564582734eb0 con 0x5645826985b0 2024-08-19T00:44:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faad2000640 1 -- 172.21.15.7:0/1661056480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80089d0 con 0x5645826985b0 2024-08-19T00:44:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.609+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564582735470 con 0x5645826985b0 2024-08-19T00:44:09.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.611+0000 7faad2000640 1 -- 172.21.15.7:0/1661056480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faac8008b70 con 0x5645826985b0 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.612+0000 7faad2000640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faabc06a810 0x7faabc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.612+0000 7faad2000640 1 -- 172.21.15.7:0/1661056480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7faac8089ad0 con 0x5645826985b0 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.612+0000 7faad9400640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faabc06a810 0x7faabc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.612+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564582720470 0x5645827d7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.612+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) -- 0x564582730930 con 0x564582720470 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.613+0000 7faad9e00640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564582720470 0x5645827d7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.613+0000 7faad9400640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faabc06a810 0x7faabc06ccd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faacc005630 tx=0x7faacc00e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.613+0000 7faad9e00640 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564582720470 0x5645827d7180 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faad9e00640 1 -- 172.21.15.7:0/1661056480 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000000 [delete] v90'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faad4051d30 con 0x564582720470 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564582720470 msgr2=0x5645827d7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564582720470 0x5645827d7180 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faabc06a810 msgr2=0x7faabc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faabc06a810 0x7faabc06ccd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faacc005630 tx=0x7faacc00e040 comp rx=0 tx=0).stop 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645826985b0 msgr2=0x56458271ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 --2- 172.21.15.7:0/1661056480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645826985b0 0x56458271ff30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7faac800bdb0 tx=0x7faac800a750 comp rx=0 tx=0).stop 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faad9e00640 1 -- 172.21.15.7:0/1661056480 reap_dead start 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 shutdown_connections 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 >> 172.21.15.7:0/1661056480 conn(0x5645826954e0 msgr2=0x564582665720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 shutdown_connections 2024-08-19T00:44:09.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.615+0000 7faadc2f4f40 1 -- 172.21.15.7:0/1661056480 wait complete. 2024-08-19T00:44:09.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:09.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.780+0000 7f5b17400640 1 Processor -- start 2024-08-19T00:44:09.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.780+0000 7f5b17400640 1 -- start start 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b17400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b1015bfb0 0x7f5b100b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b17400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b10072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b17400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b100acef0 con 0x7f5b100b5130 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b17400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5b100ad790 con 0x7f5b1015bfb0 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b17400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b100ad1d0 con 0x7f5b1015c390 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b14a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b1015bfb0 0x7f5b100b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b15400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b10072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b14a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b1015bfb0 0x7f5b100b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:50280/0 (socket says 172.21.15.7:50280) 2024-08-19T00:44:09.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.781+0000 7f5b14a00640 1 -- 172.21.15.7:0/122060211 learned_addr learned my addr 172.21.15.7:0/122060211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:09.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.782+0000 7f5b14a00640 1 -- 172.21.15.7:0/122060211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 msgr2=0x7f5b10072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:09.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.782+0000 7f5b14a00640 1 --2- 172.21.15.7:0/122060211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b10072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.782+0000 7f5b14a00640 1 -- 172.21.15.7:0/122060211 >> v1:172.21.15.162:6789/0 conn(0x7f5b100b5130 legacy=0x7f5b100aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.782+0000 7f5b14a00640 1 -- 172.21.15.7:0/122060211 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100ad4b0 con 0x7f5b1015bfb0 2024-08-19T00:44:09.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.783+0000 7f5b14a00640 1 --2- 172.21.15.7:0/122060211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 0x7f5b100b3e00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009870 tx=0x7f5b0002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=347dba9582d328db server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.783+0000 7f5b0fe00640 1 -- 172.21.15.7:0/122060211 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00037070 con 0x7f5b1015bfb0 2024-08-19T00:44:09.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.783+0000 7f5b0fe00640 1 -- 172.21.15.7:0/122060211 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00032440 con 0x7f5b1015bfb0 2024-08-19T00:44:09.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.783+0000 7f5b0fe00640 1 -- 172.21.15.7:0/122060211 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00032810 con 0x7f5b1015bfb0 2024-08-19T00:44:09.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.783+0000 7f5b17400640 1 -- 172.21.15.7:0/122060211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 msgr2=0x7f5b100b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.783+0000 7f5b17400640 1 --2- 172.21.15.7:0/122060211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 0x7f5b100b3e00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009870 tx=0x7f5b0002a250 comp rx=0 tx=0).stop 2024-08-19T00:44:09.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.784+0000 7f5b17400640 1 -- 172.21.15.7:0/122060211 shutdown_connections 2024-08-19T00:44:09.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.784+0000 7f5b17400640 1 --2- 172.21.15.7:0/122060211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b10072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.784+0000 7f5b17400640 1 --2- 172.21.15.7:0/122060211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 0x7f5b100b3e00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.784+0000 7f5b17400640 1 -- 172.21.15.7:0/122060211 >> 172.21.15.7:0/122060211 conn(0x7f5b100b2300 msgr2=0x7f5b1006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:09.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.784+0000 7f5b17400640 1 -- 172.21.15.7:0/122060211 shutdown_connections 2024-08-19T00:44:09.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.784+0000 7f5b17400640 1 -- 172.21.15.7:0/122060211 wait complete. 2024-08-19T00:44:09.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.785+0000 7f5b17400640 1 Processor -- start 2024-08-19T00:44:09.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.785+0000 7f5b17400640 1 -- start start 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.786+0000 7f5b17400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100b5130 0x7f5b10159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.786+0000 7f5b17400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 0x7f5b10149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.786+0000 7f5b17400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b1015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.786+0000 7f5b17400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100b44c0 con 0x7f5b100b5130 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.786+0000 7f5b17400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100b4340 con 0x7f5b1015bfb0 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.786+0000 7f5b17400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b100af2e0 con 0x7f5b1015c390 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100b5130 0x7f5b10159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100b5130 0x7f5b10159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47730/0 (socket says 172.21.15.7:47730) 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 -- 172.21.15.7:0/2752692068 learned_addr learned my addr 172.21.15.7:0/2752692068 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b15400640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b1015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b07e00640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 0x7f5b10149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 -- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 msgr2=0x7f5b1015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b1015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 -- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 msgr2=0x7f5b10149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:09.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 0x7f5b10149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:09.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 -- 172.21.15.7:0/2752692068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b10158680 con 0x7f5b100b5130 2024-08-19T00:44:09.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.787+0000 7f5b14a00640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100b5130 0x7f5b10159720 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000c00 tx=0x7f5b000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.788+0000 7f5b0d600640 1 -- 172.21.15.7:0/2752692068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00037040 con 0x7f5b100b5130 2024-08-19T00:44:09.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.788+0000 7f5b0d600640 1 -- 172.21.15.7:0/2752692068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00042070 con 0x7f5b100b5130 2024-08-19T00:44:09.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.788+0000 7f5b0d600640 1 -- 172.21.15.7:0/2752692068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00030880 con 0x7f5b100b5130 2024-08-19T00:44:09.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.788+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b10158960 con 0x7f5b100b5130 2024-08-19T00:44:09.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.788+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b10158f20 con 0x7f5b100b5130 2024-08-19T00:44:09.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.789+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b100b3e00 con 0x7f5b100b5130 2024-08-19T00:44:09.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.790+0000 7f5b0d600640 1 -- 172.21.15.7:0/2752692068 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b00030a20 con 0x7f5b100b5130 2024-08-19T00:44:09.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.791+0000 7f5b0d600640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5aec06be60 0x7f5aec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:09.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.791+0000 7f5b0d600640 1 -- 172.21.15.7:0/2752692068 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6053+0+0 (secure 0 0 0) 0x7f5b000ab6b0 con 0x7f5b100b5130 2024-08-19T00:44:09.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.791+0000 7f5b07e00640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5aec06be60 0x7f5aec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:09.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.792+0000 7f5b07e00640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5aec06be60 0x7f5aec06e320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5b10154270 tx=0x7f5af8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:09.795+0000 7f5b0d600640 1 -- 172.21.15.7:0/2752692068 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5b000798a0 con 0x7f5b100b5130 2024-08-19T00:44:10.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.015+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f5b100cc5e0 con 0x7f5b100b5130 2024-08-19T00:44:10.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.195+0000 7f5b0d600640 1 -- 172.21.15.7:0/2752692068 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v109) ==== 162+0+0 (secure 0 0 0) 0x7f5b000800c0 con 0x7f5b100b5130 2024-08-19T00:44:10.197 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5aec06be60 msgr2=0x7f5aec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5aec06be60 0x7f5aec06e320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5b10154270 tx=0x7f5af8009040 comp rx=0 tx=0).stop 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100b5130 msgr2=0x7f5b10159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100b5130 0x7f5b10159720 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000c00 tx=0x7f5b000046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 shutdown_connections 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5aec06be60 0x7f5aec06e320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b1015c390 0x7f5b1015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b1015bfb0 0x7f5b10149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 --2- 172.21.15.7:0/2752692068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100b5130 0x7f5b10159720 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 >> 172.21.15.7:0/2752692068 conn(0x7f5b100b2300 msgr2=0x7f5b100b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 shutdown_connections 2024-08-19T00:44:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.199+0000 7f5b17400640 1 -- 172.21.15.7:0/2752692068 wait complete. 2024-08-19T00:44:10.210 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:10.206+0000 7f8edde00640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (2) No such file or directory 2024-08-19T00:44:10.210 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:10.208+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:10.210 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:10.208+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:44:10.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:10.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.382+0000 7f05e3600640 1 Processor -- start 2024-08-19T00:44:10.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.382+0000 7f05e3600640 1 -- start start 2024-08-19T00:44:10.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e3600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f05dc0d4e00 0x7f05dc0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e3600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05dc0d13d0 0x7f05dc161100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e3600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05dc0cf250 con 0x7f05dc06e520 2024-08-19T00:44:10.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e3600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc0cf020 con 0x7f05dc0d13d0 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e3600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc0d1820 con 0x7f05dc0d4e00 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e1600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05dc0d13d0 0x7f05dc161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e1600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05dc0d13d0 0x7f05dc161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47744/0 (socket says 172.21.15.7:47744) 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05e1600640 1 -- 172.21.15.7:0/847809818 learned_addr learned my addr 172.21.15.7:0/847809818 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.383+0000 7f05dbe00640 1 --2- 172.21.15.7:0/847809818 >> v2:172.21.15.162:3300/0 conn(0x7f05dc0d4e00 0x7f05dc0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.384+0000 7f05e1600640 1 -- 172.21.15.7:0/847809818 >> v2:172.21.15.162:3300/0 conn(0x7f05dc0d4e00 msgr2=0x7f05dc0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.384+0000 7f05e1600640 1 --2- 172.21.15.7:0/847809818 >> v2:172.21.15.162:3300/0 conn(0x7f05dc0d4e00 0x7f05dc0d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.384+0000 7f05e1600640 1 -- 172.21.15.7:0/847809818 >> v1:172.21.15.162:6789/0 conn(0x7f05dc06e520 legacy=0x7f05dc0d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.384+0000 7f05e1600640 1 -- 172.21.15.7:0/847809818 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc06d880 con 0x7f05dc0d13d0 2024-08-19T00:44:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.385+0000 7f05e1600640 1 --2- 172.21.15.7:0/847809818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d13d0 0x7f05dc161100 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0b3d30 tx=0x7f05d402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87624320eac3a0f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.385+0000 7f05db400640 1 -- 172.21.15.7:0/847809818 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4036070 con 0x7f05dc0d13d0 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.385+0000 7f05db400640 1 -- 172.21.15.7:0/847809818 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4031600 con 0x7f05dc0d13d0 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.385+0000 7f05db400640 1 -- 172.21.15.7:0/847809818 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40319d0 con 0x7f05dc0d13d0 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 -- 172.21.15.7:0/847809818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d13d0 msgr2=0x7f05dc161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 --2- 172.21.15.7:0/847809818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d13d0 0x7f05dc161100 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0b3d30 tx=0x7f05d402a730 comp rx=0 tx=0).stop 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 -- 172.21.15.7:0/847809818 shutdown_connections 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 --2- 172.21.15.7:0/847809818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d13d0 0x7f05dc161100 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 --2- 172.21.15.7:0/847809818 >> v2:172.21.15.162:3300/0 conn(0x7f05dc0d4e00 0x7f05dc0d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 -- 172.21.15.7:0/847809818 >> 172.21.15.7:0/847809818 conn(0x7f05dc09d710 msgr2=0x7f05dc0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 -- 172.21.15.7:0/847809818 shutdown_connections 2024-08-19T00:44:10.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.386+0000 7f05e3600640 1 -- 172.21.15.7:0/847809818 wait complete. 2024-08-19T00:44:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.388+0000 7f05e3600640 1 Processor -- start 2024-08-19T00:44:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.388+0000 7f05e3600640 1 -- start start 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e3600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05dc06e520 0x7f05dc0a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e3600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05dc0d13d0 0x7f05dc1e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d4e00 0x7f05dc09e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e3600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc0cf810 con 0x7f05dc0d4e00 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e3600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc0cfe60 con 0x7f05dc0d13d0 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e3600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc0cfaf0 con 0x7f05dc06e520 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d4e00 0x7f05dc09e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d4e00 0x7f05dc09e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47748/0 (socket says 172.21.15.7:47748) 2024-08-19T00:44:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 -- 172.21.15.7:0/3008120423 learned_addr learned my addr 172.21.15.7:0/3008120423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 -- 172.21.15.7:0/3008120423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05dc06e520 msgr2=0x7f05dc0a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05dc06e520 0x7f05dc0a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 -- 172.21.15.7:0/3008120423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05dc0d13d0 msgr2=0x7f05dc1e56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05dc0d13d0 0x7f05dc1e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.389+0000 7f05e1600640 1 -- 172.21.15.7:0/3008120423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc0a19a0 con 0x7f05dc0d4e00 2024-08-19T00:44:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.390+0000 7f05e1600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d4e00 0x7f05dc09e640 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f05d4034040 tx=0x7f05d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.390+0000 7f05d8c00640 1 -- 172.21.15.7:0/3008120423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4036050 con 0x7f05dc0d4e00 2024-08-19T00:44:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.390+0000 7f05d8c00640 1 -- 172.21.15.7:0/3008120423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4042070 con 0x7f05dc0d4e00 2024-08-19T00:44:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.390+0000 7f05d8c00640 1 -- 172.21.15.7:0/3008120423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4009510 con 0x7f05dc0d4e00 2024-08-19T00:44:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.390+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc0c9250 con 0x7f05dc0d4e00 2024-08-19T00:44:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.390+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc0c9810 con 0x7f05dc0d4e00 2024-08-19T00:44:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.391+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc0d02f0 con 0x7f05dc0d4e00 2024-08-19T00:44:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.392+0000 7f05d8c00640 1 -- 172.21.15.7:0/3008120423 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05d4007bf0 con 0x7f05dc0d4e00 2024-08-19T00:44:10.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.393+0000 7f05d8c00640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05bc06be30 0x7f05bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.393+0000 7f05d8c00640 1 -- 172.21.15.7:0/3008120423 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7f05d40abdc0 con 0x7f05dc0d4e00 2024-08-19T00:44:10.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.393+0000 7f05e0c00640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05bc06be30 0x7f05bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.394+0000 7f05e0c00640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05bc06be30 0x7f05bc06e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000f60 tx=0x7f05d00079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.398+0000 7f05d8c00640 1 -- 172.21.15.7:0/3008120423 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f05d407a6d0 con 0x7f05dc0d4e00 2024-08-19T00:44:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.620+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05dc0d0c70 con 0x7f05dc0d4e00 2024-08-19T00:44:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.621+0000 7f05d8c00640 1 -- 172.21.15.7:0/3008120423 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+3569 (secure 0 0 0) 0x7f05d4079fd0 con 0x7f05dc0d4e00 2024-08-19T00:44:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:10.625 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":111,"btime":"2024-08-19T00:44:10:209048+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:10.208994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:10.627 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 111 2024-08-19T00:44:10.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05bc06be30 msgr2=0x7f05bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05bc06be30 0x7f05bc06e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000f60 tx=0x7f05d00079d0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d4e00 msgr2=0x7f05dc09e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d4e00 0x7f05dc09e640 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f05d4034040 tx=0x7f05d4004a40 comp rx=0 tx=0).stop 2024-08-19T00:44:10.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 shutdown_connections 2024-08-19T00:44:10.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f05bc06be30 0x7f05bc06e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05dc0d4e00 0x7f05dc09e640 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05dc0d13d0 0x7f05dc1e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 --2- 172.21.15.7:0/3008120423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05dc06e520 0x7f05dc0a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 >> 172.21.15.7:0/3008120423 conn(0x7f05dc09d710 msgr2=0x7f05dc0b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:10.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 shutdown_connections 2024-08-19T00:44:10.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.623+0000 7f05e3600640 1 -- 172.21.15.7:0/3008120423 wait complete. 2024-08-19T00:44:10.641 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:10.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:10.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.795+0000 7f61bb000640 1 Processor -- start 2024-08-19T00:44:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.796+0000 7f61bb000640 1 -- start start 2024-08-19T00:44:10.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61bb000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f61b40b5940 0x7f61b40b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61bb000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b40b4150 0x7f61b415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61bb000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b406d6a0 con 0x7f61b4147a80 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61bb000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f61b40b4590 con 0x7f61b40b4150 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61bb000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f61b406d980 con 0x7f61b40b5940 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61ba600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b40b4150 0x7f61b415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61ba600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61b40b4150 0x7f61b415edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47762/0 (socket says 172.21.15.7:47762) 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.797+0000 7f61ba600640 1 -- 172.21.15.7:0/224095119 learned_addr learned my addr 172.21.15.7:0/224095119 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.798+0000 7f61b9200640 1 --2- 172.21.15.7:0/224095119 >> v2:172.21.15.162:3300/0 conn(0x7f61b40b5940 0x7f61b40b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.798+0000 7f61ba600640 1 -- 172.21.15.7:0/224095119 >> v2:172.21.15.162:3300/0 conn(0x7f61b40b5940 msgr2=0x7f61b40b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.798+0000 7f61ba600640 1 --2- 172.21.15.7:0/224095119 >> v2:172.21.15.162:3300/0 conn(0x7f61b40b5940 0x7f61b40b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.798+0000 7f61ba600640 1 -- 172.21.15.7:0/224095119 >> v1:172.21.15.162:6789/0 conn(0x7f61b4147a80 legacy=0x7f61b406ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.798+0000 7f61ba600640 1 -- 172.21.15.7:0/224095119 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b406dc60 con 0x7f61b40b4150 2024-08-19T00:44:10.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.799+0000 7f61ba600640 1 --2- 172.21.15.7:0/224095119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b4150 0x7f61b415edf0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f61b40b17c0 tx=0x7f61ac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dc181d13f93829 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:10.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.799+0000 7f61b3e00640 1 -- 172.21.15.7:0/224095119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac036070 con 0x7f61b40b4150 2024-08-19T00:44:10.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.799+0000 7f61b3e00640 1 -- 172.21.15.7:0/224095119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac031600 con 0x7f61b40b4150 2024-08-19T00:44:10.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.799+0000 7f61b3e00640 1 -- 172.21.15.7:0/224095119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0319d0 con 0x7f61b40b4150 2024-08-19T00:44:10.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 -- 172.21.15.7:0/224095119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b4150 msgr2=0x7f61b415edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 --2- 172.21.15.7:0/224095119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b4150 0x7f61b415edf0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f61b40b17c0 tx=0x7f61ac02a730 comp rx=0 tx=0).stop 2024-08-19T00:44:10.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 -- 172.21.15.7:0/224095119 shutdown_connections 2024-08-19T00:44:10.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 --2- 172.21.15.7:0/224095119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b4150 0x7f61b415edf0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 --2- 172.21.15.7:0/224095119 >> v2:172.21.15.162:3300/0 conn(0x7f61b40b5940 0x7f61b40b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 -- 172.21.15.7:0/224095119 >> 172.21.15.7:0/224095119 conn(0x7f61b40b74a0 msgr2=0x7f61b40b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:10.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 -- 172.21.15.7:0/224095119 shutdown_connections 2024-08-19T00:44:10.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.800+0000 7f61bb000640 1 -- 172.21.15.7:0/224095119 wait complete. 2024-08-19T00:44:10.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.801+0000 7f61bb000640 1 Processor -- start 2024-08-19T00:44:10.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.801+0000 7f61bb000640 1 -- start start 2024-08-19T00:44:10.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.802+0000 7f61bb000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61b40b4150 0x7f61b415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.802+0000 7f61bb000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b5940 0x7f61b40d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.802+0000 7f61bb000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61b4147a80 0x7f61b40cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.802+0000 7f61bb000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61b4147e60 con 0x7f61b40b5940 2024-08-19T00:44:10.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.802+0000 7f61bb000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61b415e8d0 con 0x7f61b4147a80 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.802+0000 7f61bb000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61b4147fe0 con 0x7f61b40b4150 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b5940 0x7f61b40d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b5940 0x7f61b40d07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47774/0 (socket says 172.21.15.7:47774) 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 -- 172.21.15.7:0/3852331001 learned_addr learned my addr 172.21.15.7:0/3852331001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61ba600640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61b4147a80 0x7f61b40cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9c00640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61b40b4150 0x7f61b415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 -- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61b40b4150 msgr2=0x7f61b415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61b40b4150 0x7f61b415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 -- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61b4147a80 msgr2=0x7f61b40cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61b4147a80 0x7f61b40cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 -- 172.21.15.7:0/3852331001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b413f6b0 con 0x7f61b40b5940 2024-08-19T00:44:10.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b9200640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b5940 0x7f61b40d07d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f61a000d800 tx=0x7f61a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.803+0000 7f61b1600640 1 -- 172.21.15.7:0/3852331001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a000b6c0 con 0x7f61b40b5940 2024-08-19T00:44:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.804+0000 7f61b1600640 1 -- 172.21.15.7:0/3852331001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0019070 con 0x7f61b40b5940 2024-08-19T00:44:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.804+0000 7f61b1600640 1 -- 172.21.15.7:0/3852331001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a000bac0 con 0x7f61b40b5940 2024-08-19T00:44:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.804+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b413f990 con 0x7f61b40b5940 2024-08-19T00:44:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.804+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b40cef20 con 0x7f61b40b5940 2024-08-19T00:44:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.805+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b40b3c10 con 0x7f61b40b5940 2024-08-19T00:44:10.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.806+0000 7f61b1600640 1 -- 172.21.15.7:0/3852331001 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61a000bc60 con 0x7f61b40b5940 2024-08-19T00:44:10.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.807+0000 7f61b1600640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f619406be30 0x7f619406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:10.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.807+0000 7f61b1600640 1 -- 172.21.15.7:0/3852331001 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7f61a008b3a0 con 0x7f61b40b5940 2024-08-19T00:44:10.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.807+0000 7f61b9c00640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f619406be30 0x7f619406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:10.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.808+0000 7f61b9c00640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f619406be30 0x7f619406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f61a80016e0 tx=0x7f61a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:10.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:10.811+0000 7f61b1600640 1 -- 172.21.15.7:0/3852331001 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f61a0059540 con 0x7f61b40b5940 2024-08-19T00:44:10.942 INFO:tasks.ceph.mds.a.smithi007.stderr: -38> 2024-08-19T00:44:06.187+0000 7f91c6600640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-08-19T00:44:10.942 INFO:tasks.ceph.mds.a.smithi007.stderr: -36> 2024-08-19T00:44:06.187+0000 7f91c6600640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:44:10.981 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:44:11.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.034+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61b40ce560 con 0x7f61b40b5940 2024-08-19T00:44:11.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.035+0000 7f61b1600640 1 -- 172.21.15.7:0/3852331001 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+3569 (secure 0 0 0) 0x7f61a005d840 con 0x7f61b40b5940 2024-08-19T00:44:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:11.037 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":111,"btime":"2024-08-19T00:44:10:209048+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:10.208994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:11.037 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 111 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f619406be30 msgr2=0x7f619406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f619406be30 0x7f619406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f61a80016e0 tx=0x7f61a8009040 comp rx=0 tx=0).stop 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b5940 msgr2=0x7f61b40d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b5940 0x7f61b40d07d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f61a000d800 tx=0x7f61a000dcc0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 shutdown_connections 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f619406be30 0x7f619406e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61b4147a80 0x7f61b40cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b40b5940 0x7f61b40d07d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 --2- 172.21.15.7:0/3852331001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61b40b4150 0x7f61b415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 >> 172.21.15.7:0/3852331001 conn(0x7f61b40b74a0 msgr2=0x7f61b4146450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:11.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 shutdown_connections 2024-08-19T00:44:11.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.037+0000 7f61bb000640 1 -- 172.21.15.7:0/3852331001 wait complete. 2024-08-19T00:44:11.055 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:11.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:11.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.211+0000 7f9223200640 1 Processor -- start 2024-08-19T00:44:11.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.211+0000 7f9223200640 1 -- start start 2024-08-19T00:44:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.212+0000 7f9223200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f922415bd70 0x7f9224072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.212+0000 7f9223200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92240733f0 con 0x7f9224072f70 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.212+0000 7f9223200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92240736d0 con 0x7f922406dd10 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.212+0000 7f9223200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f92240739b0 con 0x7f922415bd70 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.213+0000 7f9221e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f922415bd70 0x7f9224072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.213+0000 7f9221e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f922415bd70 0x7f9224072a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47788/0 (socket says 172.21.15.7:47788) 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.213+0000 7f9221400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9224072f70 0x7f922406d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52190/0 (socket says 172.21.15.7:52190) 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.213+0000 7f9221e00640 1 -- 172.21.15.7:0/4071856850 learned_addr learned my addr 172.21.15.7:0/4071856850 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.213+0000 7f9221e00640 1 -- 172.21.15.7:0/4071856850 >> v1:172.21.15.162:6789/0 conn(0x7f922406dd10 legacy=0x7f922415cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.213+0000 7f9221e00640 1 -- 172.21.15.7:0/4071856850 >> v1:172.21.15.7:6789/0 conn(0x7f9224072f70 legacy=0x7f922406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.213+0000 7f9221e00640 1 -- 172.21.15.7:0/4071856850 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922415c4a0 con 0x7f922415bd70 2024-08-19T00:44:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.214+0000 7f9221e00640 1 --2- 172.21.15.7:0/4071856850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922415bd70 0x7f9224072a30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9214009870 tx=0x7f921402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66dda11f25b0785 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.215+0000 7f9220a00640 1 -- 172.21.15.7:0/4071856850 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214037070 con 0x7f922415bd70 2024-08-19T00:44:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.215+0000 7f9220a00640 1 -- 172.21.15.7:0/4071856850 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9214032440 con 0x7f922415bd70 2024-08-19T00:44:11.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.215+0000 7f9220a00640 1 -- 172.21.15.7:0/4071856850 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214032810 con 0x7f922415bd70 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.215+0000 7f9223200640 1 -- 172.21.15.7:0/4071856850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922415bd70 msgr2=0x7f9224072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.215+0000 7f9223200640 1 --2- 172.21.15.7:0/4071856850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922415bd70 0x7f9224072a30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9214009870 tx=0x7f921402a270 comp rx=0 tx=0).stop 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.216+0000 7f9223200640 1 -- 172.21.15.7:0/4071856850 shutdown_connections 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.216+0000 7f9223200640 1 --2- 172.21.15.7:0/4071856850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922415bd70 0x7f9224072a30 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.216+0000 7f9223200640 1 -- 172.21.15.7:0/4071856850 >> 172.21.15.7:0/4071856850 conn(0x7f922406b850 msgr2=0x7f922406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.216+0000 7f9223200640 1 -- 172.21.15.7:0/4071856850 shutdown_connections 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.216+0000 7f9223200640 1 -- 172.21.15.7:0/4071856850 wait complete. 2024-08-19T00:44:11.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.218+0000 7f9223200640 1 Processor -- start 2024-08-19T00:44:11.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.218+0000 7f9223200640 1 -- start start 2024-08-19T00:44:11.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9223200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922406dd10 0x7f9224146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9223200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9224072f70 0x7f92241534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9223200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922415bd70 0x7f92241539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9223200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f922406e3a0 con 0x7f922406dd10 2024-08-19T00:44:11.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9223200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f922415c150 con 0x7f9224072f70 2024-08-19T00:44:11.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9223200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f922406e520 con 0x7f922415bd70 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9221e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922406dd10 0x7f9224146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9221e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922406dd10 0x7f9224146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47804/0 (socket says 172.21.15.7:47804) 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9221e00640 1 -- 172.21.15.7:0/67560924 learned_addr learned my addr 172.21.15.7:0/67560924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9221400640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9224072f70 0x7f92241534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.219+0000 7f9222800640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922415bd70 0x7f92241539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9221e00640 1 -- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922415bd70 msgr2=0x7f92241539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9221e00640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922415bd70 0x7f92241539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9221e00640 1 -- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9224072f70 msgr2=0x7f92241534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9221e00640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9224072f70 0x7f92241534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9221e00640 1 -- 172.21.15.7:0/67560924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9224146d40 con 0x7f922406dd10 2024-08-19T00:44:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9221e00640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922406dd10 0x7f9224146800 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f92140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f921a000640 1 -- 172.21.15.7:0/67560924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214037040 con 0x7f922406dd10 2024-08-19T00:44:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f921a000640 1 -- 172.21.15.7:0/67560924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9214042070 con 0x7f922406dd10 2024-08-19T00:44:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9224156080 con 0x7f922406dd10 2024-08-19T00:44:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f921a000640 1 -- 172.21.15.7:0/67560924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214030bd0 con 0x7f922406dd10 2024-08-19T00:44:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.220+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9224156640 con 0x7f922406dd10 2024-08-19T00:44:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.221+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224072a30 con 0x7f922406dd10 2024-08-19T00:44:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.222+0000 7f921a000640 1 -- 172.21.15.7:0/67560924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9214047460 con 0x7f922406dd10 2024-08-19T00:44:11.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.224+0000 7f921a000640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920406be30 0x7f920406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.224+0000 7f921a000640 1 -- 172.21.15.7:0/67560924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7f92140abaf0 con 0x7f922406dd10 2024-08-19T00:44:11.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.224+0000 7f9221400640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920406be30 0x7f920406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.225+0000 7f9221400640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920406be30 0x7f920406e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f92240ae980 tx=0x7f9210000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:11.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.228+0000 7f921a000640 1 -- 172.21.15.7:0/67560924 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9224146d40 con 0x7f922406dd10 2024-08-19T00:44:11.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.450+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92240b0800 con 0x7f922406dd10 2024-08-19T00:44:11.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.451+0000 7f921a000640 1 -- 172.21.15.7:0/67560924 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+4392 (secure 0 0 0) 0x7f9214079c90 con 0x7f922406dd10 2024-08-19T00:44:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:11.453 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":112,"btime":"2024-08-19T00:44:11:210990+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7668,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1850770580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1850770580},{"type":"v1","addr":"172.21.15.7:6837","nonce":1850770580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:10.208994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:11.453 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 112 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920406be30 msgr2=0x7f920406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920406be30 0x7f920406e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f92240ae980 tx=0x7f9210000ed0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922406dd10 msgr2=0x7f9224146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922406dd10 0x7f9224146800 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f92140046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 shutdown_connections 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920406be30 0x7f920406e2f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922415bd70 0x7f92241539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9224072f70 0x7f92241534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 --2- 172.21.15.7:0/67560924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922406dd10 0x7f9224146800 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 >> 172.21.15.7:0/67560924 conn(0x7f922406b850 msgr2=0x7f9224074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 shutdown_connections 2024-08-19T00:44:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.453+0000 7f9223200640 1 -- 172.21.15.7:0/67560924 wait complete. 2024-08-19T00:44:11.470 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 200.00000000' led to DAMAGED state 2024-08-19T00:44:11.470 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 200.00000001' 2024-08-19T00:44:11.470 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:11.470 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:11.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:44:11.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:11.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:11.506 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:11.581 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:44:11.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:44:11.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.778+0000 7fdb3b200640 1 Processor -- start 2024-08-19T00:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.778+0000 7fdb3b200640 1 -- start start 2024-08-19T00:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.779+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c15e3e0 0x7fdb3c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.779+0000 7fdb3b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdb3c0b4150 0x7fdb3c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.779+0000 7fdb3b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb3c0b4b20 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.779+0000 7fdb3b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdb3c0b4df0 con 0x7fdb3c0b4150 2024-08-19T00:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.779+0000 7fdb3b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3c0b50d0 con 0x7fdb3c15e3e0 2024-08-19T00:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.779+0000 7fdb39400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdb3c0d27b0 0x7fdb3c0d2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52202/0 (socket says 172.21.15.7:52202) 2024-08-19T00:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.779+0000 7fdb39400640 1 -- 172.21.15.7:0/1098370008 learned_addr learned my addr 172.21.15.7:0/1098370008 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb39e00640 1 --2- 172.21.15.7:0/1098370008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c15e3e0 0x7fdb3c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb3a800640 1 --2- 172.21.15.7:0/1098370008 >> v2:172.21.15.162:3300/0 conn(0x7fdb3c0b4150 0x7fdb3c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb38a00640 1 -- 172.21.15.7:0/1098370008 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047113221 0 0) 0x7fdb3c0b4b20 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb38a00640 1 -- 172.21.15.7:0/1098370008 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb20003520 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb39e00640 1 -- 172.21.15.7:0/1098370008 >> v2:172.21.15.162:3300/0 conn(0x7fdb3c0b4150 msgr2=0x7fdb3c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb39e00640 1 --2- 172.21.15.7:0/1098370008 >> v2:172.21.15.162:3300/0 conn(0x7fdb3c0b4150 0x7fdb3c0b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb39e00640 1 -- 172.21.15.7:0/1098370008 >> v1:172.21.15.7:6789/0 conn(0x7fdb3c0d27b0 legacy=0x7fdb3c0d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb39e00640 1 -- 172.21.15.7:0/1098370008 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3c0cf1e0 con 0x7fdb3c15e3e0 2024-08-19T00:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.780+0000 7fdb3a800640 1 --2- 172.21.15.7:0/1098370008 >> v2:172.21.15.162:3300/0 conn(0x7fdb3c0b4150 0x7fdb3c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.781+0000 7fdb39e00640 1 --2- 172.21.15.7:0/1098370008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c15e3e0 0x7fdb3c0b0e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0097a0 tx=0x7fdb2c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56357d2aca848e75 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb38a00640 1 -- 172.21.15.7:0/1098370008 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c037070 con 0x7fdb3c15e3e0 2024-08-19T00:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb38a00640 1 -- 172.21.15.7:0/1098370008 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2c032440 con 0x7fdb3c15e3e0 2024-08-19T00:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb38a00640 1 -- 172.21.15.7:0/1098370008 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c032810 con 0x7fdb3c15e3e0 2024-08-19T00:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 -- 172.21.15.7:0/1098370008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c15e3e0 msgr2=0x7fdb3c0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 --2- 172.21.15.7:0/1098370008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c15e3e0 0x7fdb3c0b0e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0097a0 tx=0x7fdb2c02a180 comp rx=0 tx=0).stop 2024-08-19T00:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 -- 172.21.15.7:0/1098370008 shutdown_connections 2024-08-19T00:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 --2- 172.21.15.7:0/1098370008 >> v2:172.21.15.162:3300/0 conn(0x7fdb3c0b4150 0x7fdb3c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 --2- 172.21.15.7:0/1098370008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c15e3e0 0x7fdb3c0b0e60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 -- 172.21.15.7:0/1098370008 >> 172.21.15.7:0/1098370008 conn(0x7fdb3c08dbe0 msgr2=0x7fdb3c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 -- 172.21.15.7:0/1098370008 shutdown_connections 2024-08-19T00:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.782+0000 7fdb3b200640 1 -- 172.21.15.7:0/1098370008 wait complete. 2024-08-19T00:44:11.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.784+0000 7fdb3b200640 1 Processor -- start 2024-08-19T00:44:11.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.784+0000 7fdb3b200640 1 -- start start 2024-08-19T00:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c0b4150 0x7fdb3c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb3c0d27b0 0x7fdb3c1f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb3c15e3e0 0x7fdb3c14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb3b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c0b13a0 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb3b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c0cee90 con 0x7fdb3c15e3e0 2024-08-19T00:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb3b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3c0cf9e0 con 0x7fdb3c0b4150 2024-08-19T00:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb39400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb3c0d27b0 0x7fdb3c1f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb39400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb3c0d27b0 0x7fdb3c1f7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47816/0 (socket says 172.21.15.7:47816) 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb39400640 1 -- 172.21.15.7:0/2733726458 learned_addr learned my addr 172.21.15.7:0/2733726458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb39400640 1 -- 172.21.15.7:0/2733726458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c0b4150 msgr2=0x7fdb3c0ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb39400640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c0b4150 0x7fdb3c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb39400640 1 -- 172.21.15.7:0/2733726458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb3c15e3e0 msgr2=0x7fdb3c14f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.785+0000 7fdb39400640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb3c15e3e0 0x7fdb3c14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.786+0000 7fdb39400640 1 -- 172.21.15.7:0/2733726458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3c1f8380 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.786+0000 7fdb39400640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb3c0d27b0 0x7fdb3c1f7e40 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c460 tx=0x7fdb2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.786+0000 7fdb32000640 1 -- 172.21.15.7:0/2733726458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28017070 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.786+0000 7fdb32000640 1 -- 172.21.15.7:0/2733726458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb28005ce0 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.786+0000 7fdb32000640 1 -- 172.21.15.7:0/2733726458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb280072f0 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.786+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3c0cb7d0 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.786+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3c0cbd90 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.787+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3c0b0e60 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.788+0000 7fdb32000640 1 -- 172.21.15.7:0/2733726458 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb2801a070 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.789+0000 7fdb32000640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb1c06be30 0x7fdb1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.789+0000 7fdb32000640 1 -- 172.21.15.7:0/2733726458 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7fdb2808a470 con 0x7fdb3c0d27b0 2024-08-19T00:44:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.789+0000 7fdb39e00640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb1c06be30 0x7fdb1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.790+0000 7fdb39e00640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb1c06be30 0x7fdb1c06e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c034000 tx=0x7fdb2c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:11.793+0000 7fdb32000640 1 -- 172.21.15.7:0/2733726458 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdb28058bd0 con 0x7fdb3c0d27b0 2024-08-19T00:44:12.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.014+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdb3c0d4b00 con 0x7fdb3c0d27b0 2024-08-19T00:44:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.217+0000 7fdb32000640 1 -- 172.21.15.7:0/2733726458 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v113) ==== 161+0+0 (secure 0 0 0) 0x7fdb280584d0 con 0x7fdb3c0d27b0 2024-08-19T00:44:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.219+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb1c06be30 msgr2=0x7fdb1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.219+0000 7fdb3b200640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb1c06be30 0x7fdb1c06e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c034000 tx=0x7fdb2c02c000 comp rx=0 tx=0).stop 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb3c0d27b0 msgr2=0x7fdb3c1f7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb3c0d27b0 0x7fdb3c1f7e40 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c460 tx=0x7fdb2800c920 comp rx=0 tx=0).stop 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 shutdown_connections 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb1c06be30 0x7fdb1c06e2f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb3c15e3e0 0x7fdb3c14f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb3c0d27b0 0x7fdb3c1f7e40 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 --2- 172.21.15.7:0/2733726458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb3c0b4150 0x7fdb3c0ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 >> 172.21.15.7:0/2733726458 conn(0x7fdb3c08dbe0 msgr2=0x7fdb3c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 shutdown_connections 2024-08-19T00:44:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.220+0000 7fdb3b200640 1 -- 172.21.15.7:0/2733726458 wait complete. 2024-08-19T00:44:12.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.394+0000 7f39d2200640 1 Processor -- start 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.394+0000 7f39d2200640 1 -- start start 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.395+0000 7f39d2200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39cc0ce500 0x7f39cc0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.395+0000 7f39d2200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc06f7f0 con 0x7f39cc159bf0 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.395+0000 7f39d2200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc06f510 con 0x7f39cc0d03c0 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.395+0000 7f39d2200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f39cc072980 con 0x7f39cc0ce500 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.396+0000 7f39c3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39cc0ce500 0x7f39cc0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.396+0000 7f39cb400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f39cc159bf0 0x7f39cc073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52208/0 (socket says 172.21.15.7:52208) 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.396+0000 7f39cb400640 1 -- 172.21.15.7:0/2008050178 learned_addr learned my addr 172.21.15.7:0/2008050178 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.396+0000 7f39c3e00640 1 -- 172.21.15.7:0/2008050178 >> v1:172.21.15.162:6789/0 conn(0x7f39cc0d03c0 legacy=0x7f39cc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.396+0000 7f39c3e00640 1 -- 172.21.15.7:0/2008050178 >> v1:172.21.15.7:6789/0 conn(0x7f39cc159bf0 legacy=0x7f39cc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.396+0000 7f39c3e00640 1 -- 172.21.15.7:0/2008050178 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc072c60 con 0x7f39cc0ce500 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.396+0000 7f39caa00640 1 -- 172.21.15.7:0/2008050178 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089790058 0 0) 0x7f39cc06f7f0 con 0x7f39cc159bf0 2024-08-19T00:44:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.397+0000 7f39c3e00640 1 --2- 172.21.15.7:0/2008050178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc0ce500 0x7f39cc0ce970 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f39b40097a0 tx=0x7f39b402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9323b1734c21c85c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.397+0000 7f39caa00640 1 -- 172.21.15.7:0/2008050178 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4037070 con 0x7f39cc0ce500 2024-08-19T00:44:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39caa00640 1 -- 172.21.15.7:0/2008050178 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b402ae50 con 0x7f39cc0ce500 2024-08-19T00:44:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39caa00640 1 -- 172.21.15.7:0/2008050178 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4032660 con 0x7f39cc0ce500 2024-08-19T00:44:12.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39d2200640 1 -- 172.21.15.7:0/2008050178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc0ce500 msgr2=0x7f39cc0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:12.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39d2200640 1 --2- 172.21.15.7:0/2008050178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc0ce500 0x7f39cc0ce970 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f39b40097a0 tx=0x7f39b402a140 comp rx=0 tx=0).stop 2024-08-19T00:44:12.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39d2200640 1 -- 172.21.15.7:0/2008050178 shutdown_connections 2024-08-19T00:44:12.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39d2200640 1 --2- 172.21.15.7:0/2008050178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc0ce500 0x7f39cc0ce970 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:12.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39d2200640 1 -- 172.21.15.7:0/2008050178 >> 172.21.15.7:0/2008050178 conn(0x7f39cc06bc70 msgr2=0x7f39cc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:12.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39d2200640 1 -- 172.21.15.7:0/2008050178 shutdown_connections 2024-08-19T00:44:12.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.398+0000 7f39d2200640 1 -- 172.21.15.7:0/2008050178 wait complete. 2024-08-19T00:44:12.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.400+0000 7f39d2200640 1 Processor -- start 2024-08-19T00:44:12.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.400+0000 7f39d2200640 1 -- start start 2024-08-19T00:44:12.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39d2200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39cc0ce500 0x7f39cc0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:12.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39d2200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39cc0d03c0 0x7f39cc149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:12.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39d2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc159bf0 0x7f39cc09b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39d2200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc159fd0 con 0x7f39cc159bf0 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39d2200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc073b70 con 0x7f39cc0ce500 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39d2200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc15a150 con 0x7f39cc0d03c0 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc159bf0 0x7f39cc09b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc159bf0 0x7f39cc09b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47836/0 (socket says 172.21.15.7:47836) 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39cbe00640 1 -- 172.21.15.7:0/2572367359 learned_addr learned my addr 172.21.15.7:0/2572367359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39cb400640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39cc0ce500 0x7f39cc0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39c3e00640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39cc0d03c0 0x7f39cc149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39cbe00640 1 -- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39cc0d03c0 msgr2=0x7f39cc149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.401+0000 7f39cbe00640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39cc0d03c0 0x7f39cc149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39cbe00640 1 -- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39cc0ce500 msgr2=0x7f39cc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39cbe00640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39cc0ce500 0x7f39cc0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39cbe00640 1 -- 172.21.15.7:0/2572367359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc0cd030 con 0x7f39cc159bf0 2024-08-19T00:44:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39cbe00640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc159bf0 0x7f39cc09b230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c780 tx=0x7f39c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:12.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39c3400640 1 -- 172.21.15.7:0/2572367359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4004b60 con 0x7f39cc159bf0 2024-08-19T00:44:12.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39c3400640 1 -- 172.21.15.7:0/2572367359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c4004d00 con 0x7f39cc159bf0 2024-08-19T00:44:12.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39c3400640 1 -- 172.21.15.7:0/2572367359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c400aa90 con 0x7f39cc159bf0 2024-08-19T00:44:12.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc14a140 con 0x7f39cc159bf0 2024-08-19T00:44:12.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.402+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc147830 con 0x7f39cc159bf0 2024-08-19T00:44:12.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.403+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc06e070 con 0x7f39cc159bf0 2024-08-19T00:44:12.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.404+0000 7f39c3400640 1 -- 172.21.15.7:0/2572367359 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39c400ac30 con 0x7f39cc159bf0 2024-08-19T00:44:12.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.405+0000 7f39c3400640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39a806be30 0x7f39a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:12.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.405+0000 7f39c3400640 1 -- 172.21.15.7:0/2572367359 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7f39c408b2b0 con 0x7f39cc159bf0 2024-08-19T00:44:12.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.405+0000 7f39cb400640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39a806be30 0x7f39a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:12.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.406+0000 7f39cb400640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39a806be30 0x7f39a806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:12.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.409+0000 7f39c3400640 1 -- 172.21.15.7:0/2572367359 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f39cc06e070 con 0x7f39cc159bf0 2024-08-19T00:44:12.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:12.665+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f39cc071b80 con 0x7f39cc159bf0 2024-08-19T00:44:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.223+0000 7f39c3400640 1 -- 172.21.15.7:0/2572367359 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v114) ==== 101+0+0 (secure 0 0 0) 0x7f39c4020070 con 0x7f39cc159bf0 2024-08-19T00:44:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39a806be30 msgr2=0x7f39a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39a806be30 0x7f39a806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc007b50 comp rx=0 tx=0).stop 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc159bf0 msgr2=0x7f39cc09b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc159bf0 0x7f39cc09b230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c780 tx=0x7f39c400cc40 comp rx=0 tx=0).stop 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 shutdown_connections 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39a806be30 0x7f39a806e2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39cc159bf0 0x7f39cc09b230 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39cc0d03c0 0x7f39cc149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 --2- 172.21.15.7:0/2572367359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39cc0ce500 0x7f39cc0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 >> 172.21.15.7:0/2572367359 conn(0x7f39cc06bc70 msgr2=0x7f39cc160490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:13.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 shutdown_connections 2024-08-19T00:44:13.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.226+0000 7f39d2200640 1 -- 172.21.15.7:0/2572367359 wait complete. 2024-08-19T00:44:13.245 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.323+0000 7f0f51472f40 1 Processor -- start 2024-08-19T00:44:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.323+0000 7f0f51472f40 1 -- start start 2024-08-19T00:44:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f51472f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f340022d0 0x5616e7e09a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f51472f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616e7eb55d0 0x5616e7ea3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f51472f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7e25050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f51472f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5616e7d81d00 con 0x5616e7e24ba0 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f51472f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5616e7d85d40 con 0x7f0f340022d0 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f51472f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5616e7eb2dc0 con 0x5616e7eb55d0 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f4f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7e25050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f4f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7e25050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47858/0 (socket says 172.21.15.7:47858) 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f4f000640 1 -- 172.21.15.7:0/2778479158 learned_addr learned my addr 172.21.15.7:0/2778479158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f4e600640 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f340022d0 0x5616e7e09a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.324+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616e7eb55d0 0x5616e7ea3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f4f000640 1 -- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616e7eb55d0 msgr2=0x5616e7ea3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f4f000640 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616e7eb55d0 0x5616e7ea3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f4f000640 1 -- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f340022d0 msgr2=0x5616e7e09a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f4f000640 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f340022d0 0x5616e7e09a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f4f000640 1 -- 172.21.15.7:0/2778479158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e7d43080 con 0x5616e7e24ba0 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f4e600640 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f340022d0 0x5616e7e09a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f4f000640 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7e25050 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x5616e7e0b540 tx=0x7f0f48001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ed9b9b35530de4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f47e00640 1 -- 172.21.15.7:0/2778479158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800f450 con 0x5616e7e24ba0 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f47e00640 1 -- 172.21.15.7:0/2778479158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4800f5f0 con 0x5616e7e24ba0 2024-08-19T00:44:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.325+0000 7f0f47e00640 1 -- 172.21.15.7:0/2778479158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800f9e0 con 0x5616e7e24ba0 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 -- 172.21.15.7:0/2778479158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 msgr2=0x5616e7e25050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7e25050 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x5616e7e0b540 tx=0x7f0f48001540 comp rx=0 tx=0).stop 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 -- 172.21.15.7:0/2778479158 shutdown_connections 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7e25050 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5616e7eb55d0 0x5616e7ea3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 --2- 172.21.15.7:0/2778479158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f340022d0 0x5616e7e09a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 -- 172.21.15.7:0/2778479158 >> 172.21.15.7:0/2778479158 conn(0x5616e7e0a4e0 msgr2=0x5616e7e083f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:13.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 -- 172.21.15.7:0/2778479158 shutdown_connections 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.326+0000 7f0f51472f40 1 -- 172.21.15.7:0/2778479158 wait complete. 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.327+0000 7f0f51472f40 1 Processor -- start 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.327+0000 7f0f51472f40 1 -- start start 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.327+0000 7f0f51472f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7f483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.327+0000 7f0f51472f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616e7eb55d0 0x5616e7f493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f51472f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f340022d0 0x5616e7ea9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f51472f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5616e7e09580 con 0x5616e7e24ba0 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f51472f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5616e7e092a0 con 0x5616e7eb55d0 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f51472f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5616e7e08d50 con 0x7f0f340022d0 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7f483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7f483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47860/0 (socket says 172.21.15.7:47860) 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 learned_addr learned my addr 172.21.15.7:0/270494186 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616e7eb55d0 0x5616e7f493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4f000640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f340022d0 0x5616e7ea9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f340022d0 msgr2=0x5616e7ea9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f340022d0 0x5616e7ea9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616e7eb55d0 msgr2=0x5616e7f493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616e7eb55d0 0x5616e7f493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e7ea8ef0 con 0x5616e7e24ba0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.328+0000 7f0f4f000640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f340022d0 0x5616e7ea9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.329+0000 7f0f4e600640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7f483f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f0f40025990 tx=0x7f0f40001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.329+0000 7f0f46a00640 1 -- 172.21.15.7:0/270494186 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40001ce0 con 0x5616e7e24ba0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.329+0000 7f0f46a00640 1 -- 172.21.15.7:0/270494186 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4004f070 con 0x5616e7e24ba0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.329+0000 7f0f46a00640 1 -- 172.21.15.7:0/270494186 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40053c00 con 0x5616e7e24ba0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.329+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616e7ea91d0 con 0x5616e7e24ba0 2024-08-19T00:44:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.329+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e7f49930 con 0x5616e7e24ba0 2024-08-19T00:44:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.331+0000 7f0f46a00640 1 -- 172.21.15.7:0/270494186 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f40066030 con 0x5616e7e24ba0 2024-08-19T00:44:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.332+0000 7f0f46a00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f3006a840 0x7f0f3006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.332+0000 7f0f46a00640 1 -- 172.21.15.7:0/270494186 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7f0f400cd5d0 con 0x5616e7e24ba0 2024-08-19T00:44:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.332+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f3006a840 0x7f0f3006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.335 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.332+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5616e7ea7240 0x5616e7f49e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.332+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f4a350 con 0x5616e7ea7240 2024-08-19T00:44:13.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.333+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f3006a840 0x7f0f3006cd00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005e80 tx=0x7f0f3c00c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.333+0000 7f0f4f000640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5616e7ea7240 0x5616e7f49e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.333+0000 7f0f4f000640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5616e7ea7240 0x5616e7f49e10 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.335+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v91'133 uv107 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.335+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f54f60 con 0x5616e7ea7240 2024-08-19T00:44:13.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.337+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v91'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.337+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55300 con 0x5616e7ea7240 2024-08-19T00:44:13.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.338+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v91'135 uv135 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.340 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:13.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.338+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f566b0 con 0x5616e7ea7240 2024-08-19T00:44:13.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.340+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v91'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.340+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f56a50 con 0x5616e7ea7240 2024-08-19T00:44:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.341+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v91'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.341+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f556a0 con 0x5616e7ea7240 2024-08-19T00:44:13.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.343+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v91'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.343+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55a40 con 0x5616e7ea7240 2024-08-19T00:44:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.344+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v91'139 uv113 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.344+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55e30 con 0x5616e7ea7240 2024-08-19T00:44:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.346+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v91'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.346+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55e30 con 0x5616e7ea7240 2024-08-19T00:44:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.347+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v91'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.349 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.347+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.349+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v91'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.349+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.351+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v91'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.351+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.353+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v91'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.353+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.354+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v91'145 uv120 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.354+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.355+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v91'146 uv146 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.355+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.358 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.357+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v91'147 uv147 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.357+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.358+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v91'148 uv148 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.359+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.360+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v91'149 uv149 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.360+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f55de0 con 0x5616e7ea7240 2024-08-19T00:44:13.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.361+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v91'150 uv150 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.362+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.363+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v91'151 uv151 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.363+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.365+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v91'152 uv126 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.365+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.366+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v91'153 uv153 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.366+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.368+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v91'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.370 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.368+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.369+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v91'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.369+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.371+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v91'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.371+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.372+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v91'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.372+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.374+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v91'158 uv132 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.374+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.375+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v91'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.375+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.378 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.377+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v91'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.377+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.378+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v91'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.378+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.379+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v91'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.379+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7ea7240 2024-08-19T00:44:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.381+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v91'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.381+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5616e7f57300 0x5616e7f596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.381+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f561c0 con 0x5616e7f57300 2024-08-19T00:44:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.381+0000 7f0f4e600640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5616e7f57300 0x5616e7f596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.382+0000 7f0f4e600640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5616e7f57300 0x5616e7f596f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.383+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v91'109 uv91 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.383+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f59c30 con 0x5616e7f57300 2024-08-19T00:44:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.385+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v91'110 uv110 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.385+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f59fd0 con 0x5616e7f57300 2024-08-19T00:44:13.388 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.386+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v91'111 uv111 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.386+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5a370 con 0x5616e7f57300 2024-08-19T00:44:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.388+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v91'112 uv112 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.388+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5a710 con 0x5616e7f57300 2024-08-19T00:44:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.389+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v91'113 uv113 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.389+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5aab0 con 0x5616e7f57300 2024-08-19T00:44:13.392 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.391+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v91'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.391+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5ae50 con 0x5616e7f57300 2024-08-19T00:44:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.392+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [write 0~90] v91'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.392+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.394+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [omap-set-header] v91'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.394+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.395+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000001 [create] v91'117 uv101 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.395+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.396+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000001 [delete] v91'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.396+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.399 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.398+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v91'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.398+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5f8e0 con 0x5616e7f57300 2024-08-19T00:44:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.399+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [write 0~18118] v91'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.400+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5f8e0 con 0x5616e7f57300 2024-08-19T00:44:13.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.401+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v91'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.401+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.402+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 606.00000000 [create] v91'122 uv107 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.402+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.404+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 606.00000000 [delete] v91'123 uv123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.404+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.406 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.405+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v91'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.405+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5c200 con 0x5616e7f57300 2024-08-19T00:44:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.406+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v91'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.406+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5c200 con 0x5616e7f57300 2024-08-19T00:44:13.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.408+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v91'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.408+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5b1f0 con 0x5616e7f57300 2024-08-19T00:44:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.409+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v91'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f57300 2024-08-19T00:44:13.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.409+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5616e7f5b750 0x5616e7f5db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.409+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:51 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e1a0 con 0x5616e7f5b750 2024-08-19T00:44:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.409+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5616e7f5b750 0x5616e7f5db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.410+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5616e7f5b750 0x5616e7f5db40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.412+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(51 607.00000000 [create] v91'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c019870 con 0x5616e7f5b750 2024-08-19T00:44:13.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.412+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:52 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e9f0 con 0x5616e7f5b750 2024-08-19T00:44:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.414+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(52 607.00000000 [delete] v91'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.414+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5ed90 con 0x5616e7f5b750 2024-08-19T00:44:13.416 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:13.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.415+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(53 607.00000000 [create] v91'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.415+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f60140 con 0x5616e7f5b750 2024-08-19T00:44:13.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.416+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v91'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.416+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f60530 con 0x5616e7f5b750 2024-08-19T00:44:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.418+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v91'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.418+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5f130 con 0x5616e7f5b750 2024-08-19T00:44:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.419+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v91'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.419+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:57 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5f520 con 0x5616e7ea7240 2024-08-19T00:44:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.421+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(57 mds0_openfiles.0 [create] v91'22 uv21 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.421+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:58 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5f520 con 0x5616e7ea7240 2024-08-19T00:44:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.422+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v91'23 uv23 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.423+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5f520 con 0x5616e7ea7240 2024-08-19T00:44:13.426 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.425+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(59 mds0_openfiles.0 [create] v91'24 uv24 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.425+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5f520 con 0x5616e7ea7240 2024-08-19T00:44:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.428+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v91'25 uv25 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.428+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5616e7f60920 0x5616e7f62d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.428+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:61 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f63250 con 0x5616e7f60920 2024-08-19T00:44:13.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.428+0000 7f0f4f000640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5616e7f60920 0x5616e7f62d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.429+0000 7f0f4f000640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5616e7f60920 0x5616e7f62d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.430+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(61 608.00000000 [create] v91'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.430+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:62 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f63250 con 0x5616e7f60920 2024-08-19T00:44:13.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.431+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(62 608.00000000 [delete] v91'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.431+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f63250 con 0x5616e7f60920 2024-08-19T00:44:13.434 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.433+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(63 608.00000000 [create] v91'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.433+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f64260 con 0x5616e7f60920 2024-08-19T00:44:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.434+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v91'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.435+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f64260 con 0x5616e7f60920 2024-08-19T00:44:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.436+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v91'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.436+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f63250 con 0x5616e7f60920 2024-08-19T00:44:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.437+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v91'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.437+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616e7f638d0 0x5616e7f65cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.437+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:67 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f663c0 con 0x5616e7f638d0 2024-08-19T00:44:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.438+0000 7f0f4e600640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616e7f638d0 0x5616e7f65cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.438+0000 7f0f4e600640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616e7f638d0 0x5616e7f65cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.439+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(67 604.00000000 [create] v91'48 uv42 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.439+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:68 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.441+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(68 604.00000000 [delete] v91'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.441+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.444 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:13.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.442+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(69 604.00000000 [create] v91'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.442+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f677a0 con 0x5616e7f638d0 2024-08-19T00:44:13.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.443+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v91'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.443+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f677a0 con 0x5616e7f638d0 2024-08-19T00:44:13.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.445+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v91'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.445+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.446+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v91'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.446+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.448+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(73 500.00000000 [create] v91'54 uv47 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.448+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.449+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(74 500.00000000 [delete] v91'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.449+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.452 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.450+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(75 500.00000000 [create] v91'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.450+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.452+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v91'57 uv57 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.452+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f66790 con 0x5616e7f638d0 2024-08-19T00:44:13.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.453+0000 7f0f4e600640 1 -- 172.21.15.7:0/270494186 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v91'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4006f070 con 0x5616e7f638d0 2024-08-19T00:44:13.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.453+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5616e7f66e10 0x5616e7f69200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.453+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:78 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f69930 con 0x5616e7f66e10 2024-08-19T00:44:13.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.453+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5616e7f66e10 0x5616e7f69200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.454+0000 7f0f4dc00640 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5616e7f66e10 0x5616e7f69200 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.455+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(78 mds_snaptable [create] v91'22 uv21 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.455+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:79 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f69d00 con 0x5616e7f66e10 2024-08-19T00:44:13.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.457+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(79 mds_snaptable [delete] v91'23 uv23 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.457+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7f66e10 2024-08-19T00:44:13.459 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.458+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(80 mds_snaptable [create] v91'24 uv24 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.458+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7f66e10 2024-08-19T00:44:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.459+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v91'25 uv25 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.459+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7f66e10 2024-08-19T00:44:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.461+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v91'26 uv26 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.461+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:83 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7ea7240 2024-08-19T00:44:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.462+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(83 605.00000000 [create] v91'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.462+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:84 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7ea7240 2024-08-19T00:44:13.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.464+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(84 605.00000000 [delete] v91'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.464+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7ea7240 2024-08-19T00:44:13.466 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.465+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(85 605.00000000 [create] v91'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.465+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6b130 con 0x5616e7ea7240 2024-08-19T00:44:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.466+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v91'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.466+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6b130 con 0x5616e7ea7240 2024-08-19T00:44:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.468+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v91'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.468+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7ea7240 2024-08-19T00:44:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.469+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(88 605.00000000 [omap-set-header] v91'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7ea7240 2024-08-19T00:44:13.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.469+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:89 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7f5b750 2024-08-19T00:44:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.470+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(89 mds0_inotable [create] v91'44 uv38 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.470+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:90 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7f5b750 2024-08-19T00:44:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.472+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(90 mds0_inotable [delete] v91'45 uv45 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.472+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a120 con 0x5616e7f5b750 2024-08-19T00:44:13.474 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.473+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(91 mds0_inotable [create] v91'46 uv46 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.473+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e5e0 con 0x5616e7f5b750 2024-08-19T00:44:13.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.476+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(92 mds0_inotable [write 0~34] v91'47 uv47 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.476+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e5e0 con 0x5616e7f5b750 2024-08-19T00:44:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.479+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v91'48 uv48 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.479+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e5e0 con 0x5616e7f5b750 2024-08-19T00:44:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.481+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(94 100.00000000 [create] v91'49 uv43 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.481+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e5e0 con 0x5616e7f5b750 2024-08-19T00:44:13.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.484+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(95 100.00000000 [delete] v91'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.484+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e5e0 con 0x5616e7f5b750 2024-08-19T00:44:13.486 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:13.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.485+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(96 100.00000000 [create] v91'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.485+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f5e5e0 con 0x5616e7f5b750 2024-08-19T00:44:13.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.488+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(97 100.00000000 [omap-set-header] v91'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.488+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6cf70 con 0x5616e7f5b750 2024-08-19T00:44:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.490+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v91'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f5b750 2024-08-19T00:44:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.490+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.493+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v91'22 uv21 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.493+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.495+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v91'23 uv23 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.495+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.498 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.496+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v91'24 uv24 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.497+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.498+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v91'25 uv25 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.498+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.499+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v91'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.499+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.501+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v91'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.501+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.504 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.502+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v91'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.502+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6b5e0 con 0x5616e7f60920 2024-08-19T00:44:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.503+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v91'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.503+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6b5e0 con 0x5616e7f60920 2024-08-19T00:44:13.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.505+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v91'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.505+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f60920 2024-08-19T00:44:13.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.506+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v91'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f4800fa00 con 0x5616e7f60920 2024-08-19T00:44:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.506+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.507+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v91'22 uv21 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.507+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.509+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v91'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.509+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.511 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:13.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.510+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v91'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.510+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.511+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v91'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.511+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.513+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v91'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.513+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.514+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v91'57 uv49 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.514+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.515+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v91'58 uv58 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.515+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.518 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.517+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v91'59 uv59 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.517+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.518+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v91'60 uv60 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.518+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.519+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v91'61 uv61 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.519+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.520+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v91'62 uv56 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.520+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.522+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v91'63 uv63 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.522+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.524 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:13.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.523+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v91'64 uv64 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.523+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.524+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v91'65 uv65 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.524+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.525+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v91'66 uv66 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.525+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6a5d0 con 0x5616e7f66e10 2024-08-19T00:44:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.527+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v91'67 uv67 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.527+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5616e7f6aec0 con 0x5616e7f66e10 2024-08-19T00:44:13.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f4dc00640 1 -- 172.21.15.7:0/270494186 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v91'68 uv68 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0f3c022040 con 0x5616e7f66e10 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5616e7f57300 msgr2=0x5616e7f596f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5616e7f57300 0x5616e7f596f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616e7f638d0 msgr2=0x5616e7f65cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5616e7f638d0 0x5616e7f65cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5616e7f66e10 msgr2=0x5616e7f69200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5616e7f66e10 0x5616e7f69200 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5616e7f5b750 msgr2=0x5616e7f5db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5616e7f5b750 0x5616e7f5db40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5616e7ea7240 msgr2=0x5616e7f49e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5616e7ea7240 0x5616e7f49e10 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f4f000640 1 -- 172.21.15.7:0/270494186 reap_dead start 2024-08-19T00:44:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5616e7f60920 msgr2=0x5616e7f62d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5616e7f60920 0x5616e7f62d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f3006a840 msgr2=0x7f0f3006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f3006a840 0x7f0f3006cd00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005e80 tx=0x7f0f3c00c040 comp rx=0 tx=0).stop 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 msgr2=0x5616e7f483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7f483f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f0f40025990 tx=0x7f0f40001230 comp rx=0 tx=0).stop 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 shutdown_connections 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5616e7ea7240 0x5616e7f49e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f3006a840 0x7f0f3006cd00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5616e7f60920 0x5616e7f62d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 --2- 172.21.15.7:0/270494186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616e7e24ba0 0x5616e7f483f0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 >> 172.21.15.7:0/270494186 conn(0x5616e7e0a4e0 msgr2=0x5616e7eabb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 shutdown_connections 2024-08-19T00:44:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.528+0000 7f0f51472f40 1 -- 172.21.15.7:0/270494186 wait complete. 2024-08-19T00:44:13.534 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 200.00000001 2024-08-19T00:44:13.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.649+0000 7f6fb1926f40 1 Processor -- start 2024-08-19T00:44:13.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.649+0000 7f6fb1926f40 1 -- start start 2024-08-19T00:44:13.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fb1926f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556691edf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fb1926f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556691faea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fb1926f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556691f9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fb1926f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556691fb70a0 con 0x556691f11990 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fb1926f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556691fb6dc0 con 0x556691f298d0 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fb1926f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556691fb7380 con 0x556691f115b0 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556691faea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556691faea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47870/0 (socket says 172.21.15.7:47870) 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 -- 172.21.15.7:0/3208265688 learned_addr learned my addr 172.21.15.7:0/3208265688 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 -- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 msgr2=0x556691edf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6faec00640 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556691edf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6faf600640 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556691f9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556691edf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 -- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 msgr2=0x556691f9ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556691f9ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6fae200640 1 -- 172.21.15.7:0/3208265688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556691e14130 con 0x556691f11990 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6faec00640 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556691edf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.650+0000 7f6faf600640 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556691f9ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.651+0000 7f6fae200640 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556691faea80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009760 tx=0x7f6f9c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72982686fbfe13 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.651+0000 7f6face00640 1 -- 172.21.15.7:0/3208265688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c017070 con 0x556691f11990 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.651+0000 7f6face00640 1 -- 172.21.15.7:0/3208265688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c0090d0 con 0x556691f11990 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.651+0000 7f6face00640 1 -- 172.21.15.7:0/3208265688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c006b60 con 0x556691f11990 2024-08-19T00:44:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.651+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3208265688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 msgr2=0x556691faea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.651+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556691faea80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009760 tx=0x7f6f9c009c20 comp rx=0 tx=0).stop 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3208265688 shutdown_connections 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556691f9ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556691faea80 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3208265688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556691edf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3208265688 >> 172.21.15.7:0/3208265688 conn(0x556691f0e4e0 msgr2=0x556691f29120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3208265688 shutdown_connections 2024-08-19T00:44:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3208265688 wait complete. 2024-08-19T00:44:13.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.652+0000 7f6fb1926f40 1 Processor -- start 2024-08-19T00:44:13.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.653+0000 7f6fb1926f40 1 -- start start 2024-08-19T00:44:13.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.653+0000 7f6fb1926f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556692048710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.653+0000 7f6fb1926f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556692050230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.653+0000 7f6fb1926f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556692050770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fb1926f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556691faf8a0 con 0x556691f11990 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fb1926f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556691faf5c0 con 0x556691f298d0 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fb1926f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556691fafb80 con 0x556691f115b0 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556692050230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556692050230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47888/0 (socket says 172.21.15.7:47888) 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 -- 172.21.15.7:0/3343312943 learned_addr learned my addr 172.21.15.7:0/3343312943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6faec00640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556692048710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6faf600640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556692050770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 -- 172.21.15.7:0/3343312943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 msgr2=0x556692048710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556691f115b0 0x556692048710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 -- 172.21.15.7:0/3343312943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 msgr2=0x556692050770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556691f298d0 0x556692050770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.654+0000 7f6fae200640 1 -- 172.21.15.7:0/3343312943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556691e0ab30 con 0x556691f11990 2024-08-19T00:44:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.655+0000 7f6fae200640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556692050230 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c015040 tx=0x7f6f9c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.655+0000 7f6fa7400640 1 -- 172.21.15.7:0/3343312943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c017070 con 0x556691f11990 2024-08-19T00:44:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.655+0000 7f6fa7400640 1 -- 172.21.15.7:0/3343312943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c021070 con 0x556691f11990 2024-08-19T00:44:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.655+0000 7f6fa7400640 1 -- 172.21.15.7:0/3343312943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c012a80 con 0x556691f11990 2024-08-19T00:44:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.655+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556691e47080 con 0x556691f11990 2024-08-19T00:44:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.655+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556691f29370 con 0x556691f11990 2024-08-19T00:44:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.657+0000 7f6fa7400640 1 -- 172.21.15.7:0/3343312943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f9c012c20 con 0x556691f11990 2024-08-19T00:44:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.658+0000 7f6fa7400640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f9006a810 0x7f6f9006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.658+0000 7f6fa7400640 1 -- 172.21.15.7:0/3343312943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7f6f9c08acd0 con 0x556691f11990 2024-08-19T00:44:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.658+0000 7f6faec00640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f9006a810 0x7f6f9006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.658+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556692048c50 0x556691fa7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.658+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e91) -- 0x556691fa8b60 con 0x556692048c50 2024-08-19T00:44:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.658+0000 7f6faf600640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556692048c50 0x556691fa7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.659+0000 7f6faec00640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f9006a810 0x7f6f9006ccd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0057000 tx=0x7f6fa0052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.659+0000 7f6faf600640 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556692048c50 0x556691fa7860 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.660+0000 7f6faf600640 1 -- 172.21.15.7:0/3343312943 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000001 [delete] v91'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6fa800c720 con 0x556692048c50 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.660+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556692048c50 msgr2=0x556691fa7860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.660+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x556692048c50 0x556691fa7860 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.660+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f9006a810 msgr2=0x7f6f9006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.660+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f9006a810 0x7f6f9006ccd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0057000 tx=0x7f6fa0052000 comp rx=0 tx=0).stop 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.660+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 msgr2=0x556692050230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.660+0000 7f6fb1926f40 1 --2- 172.21.15.7:0/3343312943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556691f11990 0x556692050230 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c015040 tx=0x7f6f9c003020 comp rx=0 tx=0).stop 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.661+0000 7f6faf600640 1 -- 172.21.15.7:0/3343312943 reap_dead start 2024-08-19T00:44:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.661+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 shutdown_connections 2024-08-19T00:44:13.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.661+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 >> 172.21.15.7:0/3343312943 conn(0x556691f0e4e0 msgr2=0x556691fb8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:13.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.661+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 shutdown_connections 2024-08-19T00:44:13.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.661+0000 7f6fb1926f40 1 -- 172.21.15.7:0/3343312943 wait complete. 2024-08-19T00:44:13.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:13.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.824+0000 7f3eb7800640 1 Processor -- start 2024-08-19T00:44:13.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.824+0000 7f3eb7800640 1 -- start start 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eb7800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3eb00b3620 0x7f3eb0162c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eb7800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3eb00719a0 0x7f3eb006deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eb7800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb0071e30 con 0x7f3eb006f740 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eb7800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb00b3cd0 con 0x7f3eb00b3620 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eb7800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb00720f0 con 0x7f3eb00719a0 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eafe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3eb00b3620 0x7f3eb0162c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eafe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3eb00b3620 0x7f3eb0162c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32928/0 (socket says 172.21.15.7:32928) 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eafe00640 1 -- 172.21.15.7:0/3248348264 learned_addr learned my addr 172.21.15.7:0/3248348264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:13.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eb5800640 1 --2- 172.21.15.7:0/3248348264 >> v2:172.21.15.162:3300/0 conn(0x7f3eb00719a0 0x7f3eb006deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eafe00640 1 -- 172.21.15.7:0/3248348264 >> v2:172.21.15.162:3300/0 conn(0x7f3eb00719a0 msgr2=0x7f3eb006deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eafe00640 1 --2- 172.21.15.7:0/3248348264 >> v2:172.21.15.162:3300/0 conn(0x7f3eb00719a0 0x7f3eb006deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eafe00640 1 -- 172.21.15.7:0/3248348264 >> v1:172.21.15.162:6789/0 conn(0x7f3eb006f740 legacy=0x7f3eb00b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eafe00640 1 -- 172.21.15.7:0/3248348264 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb00723d0 con 0x7f3eb00b3620 2024-08-19T00:44:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.826+0000 7f3eb5800640 1 --2- 172.21.15.7:0/3248348264 >> v2:172.21.15.162:3300/0 conn(0x7f3eb00719a0 0x7f3eb006deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:13.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.827+0000 7f3eafe00640 1 --2- 172.21.15.7:0/3248348264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00b3620 0x7f3eb0162c50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00b4a10 tx=0x7f3e9c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fe91023dcaeffc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eaf400640 1 -- 172.21.15.7:0/3248348264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c037070 con 0x7f3eb00b3620 2024-08-19T00:44:13.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eaf400640 1 -- 172.21.15.7:0/3248348264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9c032440 con 0x7f3eb00b3620 2024-08-19T00:44:13.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eaf400640 1 -- 172.21.15.7:0/3248348264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c032810 con 0x7f3eb00b3620 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 -- 172.21.15.7:0/3248348264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00b3620 msgr2=0x7f3eb0162c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 --2- 172.21.15.7:0/3248348264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00b3620 0x7f3eb0162c50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00b4a10 tx=0x7f3e9c02a230 comp rx=0 tx=0).stop 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 -- 172.21.15.7:0/3248348264 shutdown_connections 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 --2- 172.21.15.7:0/3248348264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00b3620 0x7f3eb0162c50 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 --2- 172.21.15.7:0/3248348264 >> v2:172.21.15.162:3300/0 conn(0x7f3eb00719a0 0x7f3eb006deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 -- 172.21.15.7:0/3248348264 >> 172.21.15.7:0/3248348264 conn(0x7f3eb00b2300 msgr2=0x7f3eb006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 -- 172.21.15.7:0/3248348264 shutdown_connections 2024-08-19T00:44:13.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.828+0000 7f3eb7800640 1 -- 172.21.15.7:0/3248348264 wait complete. 2024-08-19T00:44:13.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.830+0000 7f3eb7800640 1 Processor -- start 2024-08-19T00:44:13.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.830+0000 7f3eb7800640 1 -- start start 2024-08-19T00:44:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb7800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb006f740 0x7f3eb014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb7800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00719a0 0x7f3eb015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb7800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb00b3620 0x7f3eb009bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb7800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb0072c70 con 0x7f3eb00719a0 2024-08-19T00:44:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb7800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb0072990 con 0x7f3eb00b3620 2024-08-19T00:44:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb7800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb006fb20 con 0x7f3eb006f740 2024-08-19T00:44:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00719a0 0x7f3eb015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00719a0 0x7f3eb015e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32936/0 (socket says 172.21.15.7:32936) 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 -- 172.21.15.7:0/140324381 learned_addr learned my addr 172.21.15.7:0/140324381 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb5800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb00b3620 0x7f3eb009bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eb4e00640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb006f740 0x7f3eb014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 -- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb006f740 msgr2=0x7f3eb014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb006f740 0x7f3eb014d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 -- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb00b3620 msgr2=0x7f3eb009bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb00b3620 0x7f3eb009bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.831+0000 7f3eafe00640 1 -- 172.21.15.7:0/140324381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb01fbb40 con 0x7f3eb00719a0 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.832+0000 7f3eb5800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb00b3620 0x7f3eb009bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.832+0000 7f3eafe00640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00719a0 0x7f3eb015e6c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0090b0 tx=0x7f3e9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.832+0000 7f3eacc00640 1 -- 172.21.15.7:0/140324381 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c037040 con 0x7f3eb00719a0 2024-08-19T00:44:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.832+0000 7f3eacc00640 1 -- 172.21.15.7:0/140324381 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9c042070 con 0x7f3eb00719a0 2024-08-19T00:44:13.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.832+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb01fbe20 con 0x7f3eb00719a0 2024-08-19T00:44:13.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.832+0000 7f3eacc00640 1 -- 172.21.15.7:0/140324381 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c030bd0 con 0x7f3eb00719a0 2024-08-19T00:44:13.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.832+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb01fc3e0 con 0x7f3eb00719a0 2024-08-19T00:44:13.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.833+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb0073190 con 0x7f3eb00719a0 2024-08-19T00:44:13.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.834+0000 7f3eacc00640 1 -- 172.21.15.7:0/140324381 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e9c047460 con 0x7f3eb00719a0 2024-08-19T00:44:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.835+0000 7f3eacc00640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e9006be30 0x7f3e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.835+0000 7f3eacc00640 1 -- 172.21.15.7:0/140324381 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6139+0+0 (secure 0 0 0) 0x7f3e9c0abd60 con 0x7f3eb00719a0 2024-08-19T00:44:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.835+0000 7f3eb4e00640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e9006be30 0x7f3e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.836+0000 7f3eb4e00640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e9006be30 0x7f3e9006e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4004ea0 tx=0x7f3ea4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:13.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:13.840+0000 7f3eacc00640 1 -- 172.21.15.7:0/140324381 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3e9c045360 con 0x7f3eb00719a0 2024-08-19T00:44:14.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.061+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f3eb006f180 con 0x7f3eb00719a0 2024-08-19T00:44:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.228+0000 7f3eacc00640 1 -- 172.21.15.7:0/140324381 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v115) ==== 162+0+0 (secure 0 0 0) 0x7f3e9c07a4c0 con 0x7f3eb00719a0 2024-08-19T00:44:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e9006be30 msgr2=0x7f3e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e9006be30 0x7f3e9006e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4004ea0 tx=0x7f3ea4009040 comp rx=0 tx=0).stop 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00719a0 msgr2=0x7f3eb015e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00719a0 0x7f3eb015e6c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0090b0 tx=0x7f3e9c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 shutdown_connections 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e9006be30 0x7f3e9006e2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb00b3620 0x7f3eb009bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3eb00719a0 0x7f3eb015e6c0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 --2- 172.21.15.7:0/140324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb006f740 0x7f3eb014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 >> 172.21.15.7:0/140324381 conn(0x7f3eb00b2300 msgr2=0x7f3eb00b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 shutdown_connections 2024-08-19T00:44:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.231+0000 7f3eb7800640 1 -- 172.21.15.7:0/140324381 wait complete. 2024-08-19T00:44:14.242 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:44:14.241+0000 7ff8a8600640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-08-19T00:44:14.243 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:14.242+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:14.243 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:14.242+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:44:14.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.409+0000 7f971e000640 1 Processor -- start 2024-08-19T00:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.409+0000 7f971e000640 1 -- start start 2024-08-19T00:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971e000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f971815e360 0x7f971815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971e000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97180d2af0 0x7f97180d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971e000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97180b3ab0 con 0x7f971815e740 2024-08-19T00:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971e000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f971815f460 con 0x7f971815e360 2024-08-19T00:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971e000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f971815f740 con 0x7f97180d2af0 2024-08-19T00:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971cc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f971815e360 0x7f971815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971cc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f971815e360 0x7f971815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32944/0 (socket says 172.21.15.7:32944) 2024-08-19T00:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971cc00640 1 -- 172.21.15.7:0/3761797724 learned_addr learned my addr 172.21.15.7:0/3761797724 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.410+0000 7f971d600640 1 --1- 172.21.15.7:0/3761797724 >> v1:172.21.15.7:6789/0 conn(0x7f971815e740 0x7f971815eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59290/0 (socket says 172.21.15.7:59290) 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.411+0000 7f971cc00640 1 -- 172.21.15.7:0/3761797724 >> v2:172.21.15.162:3300/0 conn(0x7f97180d2af0 msgr2=0x7f97180d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.411+0000 7f971cc00640 1 --2- 172.21.15.7:0/3761797724 >> v2:172.21.15.162:3300/0 conn(0x7f97180d2af0 0x7f97180d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.411+0000 7f971cc00640 1 -- 172.21.15.7:0/3761797724 >> v1:172.21.15.7:6789/0 conn(0x7f971815e740 legacy=0x7f971815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.411+0000 7f971cc00640 1 -- 172.21.15.7:0/3761797724 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97180b3d60 con 0x7f971815e360 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.412+0000 7f971cc00640 1 --2- 172.21.15.7:0/3761797724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f971815e360 0x7f971815fab0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f971808db80 tx=0x7f970c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a7b12486223f56 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.412+0000 7f9717400640 1 -- 172.21.15.7:0/3761797724 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c037070 con 0x7f971815e360 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.412+0000 7f9717400640 1 -- 172.21.15.7:0/3761797724 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c032440 con 0x7f971815e360 2024-08-19T00:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.412+0000 7f9717400640 1 -- 172.21.15.7:0/3761797724 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c032810 con 0x7f971815e360 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 -- 172.21.15.7:0/3761797724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f971815e360 msgr2=0x7f971815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 --2- 172.21.15.7:0/3761797724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f971815e360 0x7f971815fab0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f971808db80 tx=0x7f970c02a270 comp rx=0 tx=0).stop 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 -- 172.21.15.7:0/3761797724 shutdown_connections 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 --2- 172.21.15.7:0/3761797724 >> v2:172.21.15.162:3300/0 conn(0x7f97180d2af0 0x7f97180d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 --2- 172.21.15.7:0/3761797724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f971815e360 0x7f971815fab0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 -- 172.21.15.7:0/3761797724 >> 172.21.15.7:0/3761797724 conn(0x7f971808dbf0 msgr2=0x7f971809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 -- 172.21.15.7:0/3761797724 shutdown_connections 2024-08-19T00:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.413+0000 7f971e000640 1 -- 172.21.15.7:0/3761797724 wait complete. 2024-08-19T00:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.414+0000 7f971e000640 1 Processor -- start 2024-08-19T00:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.415+0000 7f971e000640 1 -- start start 2024-08-19T00:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.415+0000 7f971e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97180d2af0 0x7f97180b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.415+0000 7f971e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971815e360 0x7f97180b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.415+0000 7f971e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f971815e740 0x7f97180cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.415+0000 7f971e000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97180b4560 con 0x7f97180d2af0 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.415+0000 7f971e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97180d2300 con 0x7f971815e360 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.415+0000 7f971e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97180b46e0 con 0x7f971815e740 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97180d2af0 0x7f97180b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97180d2af0 0x7f97180b8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32950/0 (socket says 172.21.15.7:32950) 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 -- 172.21.15.7:0/1496985442 learned_addr learned my addr 172.21.15.7:0/1496985442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f9717e00640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971815e360 0x7f97180b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971d600640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f971815e740 0x7f97180cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 -- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f971815e740 msgr2=0x7f97180cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f971815e740 0x7f97180cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 -- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971815e360 msgr2=0x7f97180b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971815e360 0x7f97180b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.416+0000 7f971cc00640 1 -- 172.21.15.7:0/1496985442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97180b7c10 con 0x7f97180d2af0 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.417+0000 7f971cc00640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97180d2af0 0x7f97180b8cb0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f970c000c00 tx=0x7f970c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.417+0000 7f9714c00640 1 -- 172.21.15.7:0/1496985442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c041020 con 0x7f97180d2af0 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.417+0000 7f9714c00640 1 -- 172.21.15.7:0/1496985442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c030970 con 0x7f97180d2af0 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.417+0000 7f9714c00640 1 -- 172.21.15.7:0/1496985442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c037040 con 0x7f97180d2af0 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.417+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97180b7ef0 con 0x7f97180d2af0 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.417+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97180b84b0 con 0x7f97180d2af0 2024-08-19T00:44:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.418+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97180d2f80 con 0x7f97180d2af0 2024-08-19T00:44:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.419+0000 7f9714c00640 1 -- 172.21.15.7:0/1496985442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f970c044020 con 0x7f97180d2af0 2024-08-19T00:44:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.420+0000 7f9714c00640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f96f806be30 0x7f96f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.420+0000 7f9714c00640 1 -- 172.21.15.7:0/1496985442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f970c0ab9d0 con 0x7f97180d2af0 2024-08-19T00:44:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.420+0000 7f9717e00640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f96f806be30 0x7f96f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.421+0000 7f9717e00640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f96f806be30 0x7f96f806e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f97180d0eb0 tx=0x7f9704009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.424+0000 7f9714c00640 1 -- 172.21.15.7:0/1496985442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f970c04b030 con 0x7f97180d2af0 2024-08-19T00:44:14.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.647+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97180d50d0 con 0x7f97180d2af0 2024-08-19T00:44:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.647+0000 7f9714c00640 1 -- 172.21.15.7:0/1496985442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+3569 (secure 0 0 0) 0x7f970c07a0d0 con 0x7f97180d2af0 2024-08-19T00:44:14.649 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:14.649 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":117,"btime":"2024-08-19T00:44:14:242789+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:14.242711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 117 2024-08-19T00:44:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.649+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f96f806be30 msgr2=0x7f96f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.649+0000 7f971e000640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f96f806be30 0x7f96f806e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f97180d0eb0 tx=0x7f9704009110 comp rx=0 tx=0).stop 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97180d2af0 msgr2=0x7f97180b8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97180d2af0 0x7f97180b8cb0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f970c000c00 tx=0x7f970c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 shutdown_connections 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f96f806be30 0x7f96f806e2f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f971815e740 0x7f97180cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971815e360 0x7f97180b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 --2- 172.21.15.7:0/1496985442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97180d2af0 0x7f97180b8cb0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 >> 172.21.15.7:0/1496985442 conn(0x7f971808dbf0 msgr2=0x7f9718160910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 shutdown_connections 2024-08-19T00:44:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.650+0000 7f971e000640 1 -- 172.21.15.7:0/1496985442 wait complete. 2024-08-19T00:44:14.667 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:14.667 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:14.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.823+0000 7fd98ac00640 1 Processor -- start 2024-08-19T00:44:14.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.823+0000 7fd98ac00640 1 -- start start 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd98ac00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9840d3200 0x7fd98415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd98ac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9840b3ab0 con 0x7fd98415e740 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd98ac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98415f460 con 0x7fd98415e360 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd98ac00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd98415f740 con 0x7fd9840d3200 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd988e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9840d3200 0x7fd98415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd988e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9840d3200 0x7fd98415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32952/0 (socket says 172.21.15.7:32952) 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd988e00640 1 -- 172.21.15.7:0/1958642288 learned_addr learned my addr 172.21.15.7:0/1958642288 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:14.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.824+0000 7fd98a200640 1 --1- 172.21.15.7:0/1958642288 >> v1:172.21.15.7:6789/0 conn(0x7fd98415e740 0x7fd98415eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59298/0 (socket says 172.21.15.7:59298) 2024-08-19T00:44:14.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.825+0000 7fd988e00640 1 -- 172.21.15.7:0/1958642288 >> v1:172.21.15.162:6789/0 conn(0x7fd98415e360 legacy=0x7fd9840d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.825+0000 7fd988e00640 1 -- 172.21.15.7:0/1958642288 >> v1:172.21.15.7:6789/0 conn(0x7fd98415e740 legacy=0x7fd98415eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.825+0000 7fd988e00640 1 -- 172.21.15.7:0/1958642288 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9840b3d60 con 0x7fd9840d3200 2024-08-19T00:44:14.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.825+0000 7fd983e00640 1 -- 172.21.15.7:0/1958642288 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77142655 0 0) 0x7fd9840b3ab0 con 0x7fd98415e740 2024-08-19T00:44:14.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.826+0000 7fd988e00640 1 --2- 172.21.15.7:0/1958642288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd98415fab0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd970009870 tx=0x7fd97002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e6fbe93db0b8df server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:14.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.826+0000 7fd983e00640 1 -- 172.21.15.7:0/1958642288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970037070 con 0x7fd9840d3200 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.826+0000 7fd983e00640 1 -- 172.21.15.7:0/1958642288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97002ae50 con 0x7fd9840d3200 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.826+0000 7fd983e00640 1 -- 172.21.15.7:0/1958642288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970032860 con 0x7fd9840d3200 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.827+0000 7fd98ac00640 1 -- 172.21.15.7:0/1958642288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 msgr2=0x7fd98415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.827+0000 7fd98ac00640 1 --2- 172.21.15.7:0/1958642288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd98415fab0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd970009870 tx=0x7fd97002a300 comp rx=0 tx=0).stop 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.827+0000 7fd98ac00640 1 -- 172.21.15.7:0/1958642288 shutdown_connections 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.827+0000 7fd98ac00640 1 --2- 172.21.15.7:0/1958642288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd98415fab0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.827+0000 7fd98ac00640 1 -- 172.21.15.7:0/1958642288 >> 172.21.15.7:0/1958642288 conn(0x7fd98408dbf0 msgr2=0x7fd98409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.827+0000 7fd98ac00640 1 -- 172.21.15.7:0/1958642288 shutdown_connections 2024-08-19T00:44:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.827+0000 7fd98ac00640 1 -- 172.21.15.7:0/1958642288 wait complete. 2024-08-19T00:44:14.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.828+0000 7fd98ac00640 1 Processor -- start 2024-08-19T00:44:14.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.829+0000 7fd98ac00640 1 -- start start 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.829+0000 7fd98ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd9840c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.829+0000 7fd98ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd98415e360 0x7fd9840d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.829+0000 7fd98ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd98415e740 0x7fd9840d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.829+0000 7fd98ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9840b4560 con 0x7fd9840d3200 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.829+0000 7fd98ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9840d2300 con 0x7fd98415e360 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.829+0000 7fd98ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd9840b46e0 con 0x7fd98415e740 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd9840c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd9840c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32960/0 (socket says 172.21.15.7:32960) 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 -- 172.21.15.7:0/3768784917 learned_addr learned my addr 172.21.15.7:0/3768784917 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd988e00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd98415e360 0x7fd9840d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd98a200640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd98415e740 0x7fd9840d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 -- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd98415e740 msgr2=0x7fd9840d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd98415e740 0x7fd9840d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 -- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd98415e360 msgr2=0x7fd9840d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd98415e360 0x7fd9840d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 -- 172.21.15.7:0/3768784917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9840b8500 con 0x7fd9840d3200 2024-08-19T00:44:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.830+0000 7fd989800640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd9840c7d10 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c450 tx=0x7fd97800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.831+0000 7fd981600640 1 -- 172.21.15.7:0/3768784917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9780052d0 con 0x7fd9840d3200 2024-08-19T00:44:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.831+0000 7fd981600640 1 -- 172.21.15.7:0/3768784917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd978005470 con 0x7fd9840d3200 2024-08-19T00:44:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.831+0000 7fd981600640 1 -- 172.21.15.7:0/3768784917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978012870 con 0x7fd9840d3200 2024-08-19T00:44:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.831+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9840cfa60 con 0x7fd9840d3200 2024-08-19T00:44:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.831+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9840d0020 con 0x7fd9840d3200 2024-08-19T00:44:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.832+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98415fab0 con 0x7fd9840d3200 2024-08-19T00:44:14.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.833+0000 7fd981600640 1 -- 172.21.15.7:0/3768784917 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd978012a10 con 0x7fd9840d3200 2024-08-19T00:44:14.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.834+0000 7fd981600640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd96406be30 0x7fd96406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:14.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.834+0000 7fd981600640 1 -- 172.21.15.7:0/3768784917 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7fd97808ad20 con 0x7fd9840d3200 2024-08-19T00:44:14.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.834+0000 7fd988e00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd96406be30 0x7fd96406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:14.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.835+0000 7fd988e00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd96406be30 0x7fd96406e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd970034000 tx=0x7fd97002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:14.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:14.838+0000 7fd981600640 1 -- 172.21.15.7:0/3768784917 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd978059390 con 0x7fd9840d3200 2024-08-19T00:44:14.961 INFO:tasks.ceph.mds.c.smithi007.stderr: -36> 2024-08-19T00:44:10.206+0000 7f8edde00640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (2) No such file or directory 2024-08-19T00:44:14.999 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:44:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.059+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9840d50d0 con 0x7fd9840d3200 2024-08-19T00:44:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.060+0000 7fd981600640 1 -- 172.21.15.7:0/3768784917 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+3569 (secure 0 0 0) 0x7fd97808ce80 con 0x7fd9840d3200 2024-08-19T00:44:15.062 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:15.062 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":117,"btime":"2024-08-19T00:44:14:242789+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:14.242711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 117 2024-08-19T00:44:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd96406be30 msgr2=0x7fd96406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd96406be30 0x7fd96406e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd970034000 tx=0x7fd97002e000 comp rx=0 tx=0).stop 2024-08-19T00:44:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 msgr2=0x7fd9840c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd9840c7d10 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c450 tx=0x7fd97800c910 comp rx=0 tx=0).stop 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 shutdown_connections 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd96406be30 0x7fd96406e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd98415e740 0x7fd9840d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd98415e360 0x7fd9840d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 --2- 172.21.15.7:0/3768784917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9840d3200 0x7fd9840c7d10 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 >> 172.21.15.7:0/3768784917 conn(0x7fd98408dbf0 msgr2=0x7fd98415d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 shutdown_connections 2024-08-19T00:44:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.062+0000 7fd98ac00640 1 -- 172.21.15.7:0/3768784917 wait complete. 2024-08-19T00:44:15.080 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:15.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.237+0000 7fa25a600640 1 Processor -- start 2024-08-19T00:44:15.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.237+0000 7fa25a600640 1 -- start start 2024-08-19T00:44:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.238+0000 7fa25a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 0x7fa25415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.238+0000 7fa25a600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2540b3ab0 con 0x7fa2540d2af0 2024-08-19T00:44:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.238+0000 7fa25a600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25415f460 con 0x7fa25415ee50 2024-08-19T00:44:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.238+0000 7fa25a600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa25415f740 con 0x7fa25415e360 2024-08-19T00:44:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.238+0000 7fa253e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa2540d2af0 0x7fa25415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59326/0 (socket says 172.21.15.7:59326) 2024-08-19T00:44:15.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.238+0000 7fa253e00640 1 -- 172.21.15.7:0/4083605497 learned_addr learned my addr 172.21.15.7:0/4083605497 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa259200640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 0x7fa25415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566539350 0 0) 0x7fa2540b3ab0 con 0x7fa2540d2af0 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa23c003520 con 0x7fa2540d2af0 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419336589 0 0) 0x7fa25415f460 con 0x7fa25415ee50 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2540b3ab0 con 0x7fa25415ee50 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 564506881 0 0) 0x7fa23c003520 con 0x7fa2540d2af0 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 msgr2=0x7fa25415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 0x7fa25415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 >> v1:172.21.15.162:6789/0 conn(0x7fa25415ee50 legacy=0x7fa2540b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2540b3d60 con 0x7fa2540d2af0 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fa240001670 con 0x7fa2540d2af0 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 >> v1:172.21.15.7:6789/0 conn(0x7fa2540d2af0 legacy=0x7fa25415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa23c003b70 0x7fa23c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa23c004800 0x7fa23c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 0x7fa23c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa25415f740 con 0x7fa23c003b70 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c00ba70 con 0x7fa23c004800 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.239+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa23c00bc70 con 0x7fa25415e360 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa259200640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa23c003b70 0x7fa23c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa253e00640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa23c004800 0x7fa23c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa259c00640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 0x7fa23c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa259200640 1 -- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 msgr2=0x7fa23c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa259200640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa25415e360 0x7fa23c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa259200640 1 -- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa23c004800 msgr2=0x7fa23c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa259200640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa23c004800 0x7fa23c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.240+0000 7fa259200640 1 -- 172.21.15.7:0/4083605497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c003520 con 0x7fa23c003b70 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.241+0000 7fa259200640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa23c003b70 0x7fa23c003f70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa248009ac0 tx=0x7fa23c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaf09cdfab7aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.241+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248036070 con 0x7fa23c003b70 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.241+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa248031400 con 0x7fa23c003b70 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.241+0000 7fa253400640 1 -- 172.21.15.7:0/4083605497 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248009690 con 0x7fa23c003b70 2024-08-19T00:44:15.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.242+0000 7fa25a600640 1 -- 172.21.15.7:0/4083605497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa23c003b70 msgr2=0x7fa23c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.242+0000 7fa25a600640 1 --2- 172.21.15.7:0/4083605497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa23c003b70 0x7fa23c003f70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa248009ac0 tx=0x7fa23c005830 comp rx=0 tx=0).stop 2024-08-19T00:44:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.242+0000 7fa259c00640 1 -- 172.21.15.7:0/4083605497 reap_dead start 2024-08-19T00:44:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.242+0000 7fa25a600640 1 -- 172.21.15.7:0/4083605497 shutdown_connections 2024-08-19T00:44:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.242+0000 7fa25a600640 1 -- 172.21.15.7:0/4083605497 >> 172.21.15.7:0/4083605497 conn(0x7fa25408dbf0 msgr2=0x7fa25409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.242+0000 7fa25a600640 1 -- 172.21.15.7:0/4083605497 shutdown_connections 2024-08-19T00:44:15.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.242+0000 7fa25a600640 1 -- 172.21.15.7:0/4083605497 wait complete. 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.244+0000 7fa25a600640 1 Processor -- start 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.244+0000 7fa25a600640 1 -- start start 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.245+0000 7fa25a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa23c003b70 0x7fa2540b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.245+0000 7fa25a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2540c9100 0x7fa2540c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.245+0000 7fa25a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2541600c0 0x7fa254160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.245+0000 7fa25a600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa25415fab0 con 0x7fa2540c9100 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.245+0000 7fa25a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2540d2300 con 0x7fa2541600c0 2024-08-19T00:44:15.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.245+0000 7fa25a600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa25415fc30 con 0x7fa23c003b70 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa259200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa23c003b70 0x7fa2540b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa253e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2540c9100 0x7fa2540c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa259200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa23c003b70 0x7fa2540b9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:48024/0 (socket says 172.21.15.7:48024) 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa259200640 1 -- 172.21.15.7:0/2696536175 learned_addr learned my addr 172.21.15.7:0/2696536175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa253e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2540c9100 0x7fa2540c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32992/0 (socket says 172.21.15.7:32992) 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa259c00640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2541600c0 0x7fa254160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa253e00640 1 -- 172.21.15.7:0/2696536175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa23c003b70 msgr2=0x7fa2540b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa253e00640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa23c003b70 0x7fa2540b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa253e00640 1 -- 172.21.15.7:0/2696536175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2541600c0 msgr2=0x7fa254160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa253e00640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2541600c0 0x7fa254160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.246+0000 7fa253e00640 1 -- 172.21.15.7:0/2696536175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2540c8060 con 0x7fa2540c9100 2024-08-19T00:44:15.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.247+0000 7fa253e00640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2540c9100 0x7fa2540c9540 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa240007fd0 tx=0x7fa240007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.248+0000 7fa250c00640 1 -- 172.21.15.7:0/2696536175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24000f7b0 con 0x7fa2540c9100 2024-08-19T00:44:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.248+0000 7fa250c00640 1 -- 172.21.15.7:0/2696536175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa240018070 con 0x7fa2540c9100 2024-08-19T00:44:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.248+0000 7fa250c00640 1 -- 172.21.15.7:0/2696536175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24000fbd0 con 0x7fa2540c9100 2024-08-19T00:44:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.249+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2540c8340 con 0x7fa2540c9100 2024-08-19T00:44:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.249+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2540c8900 con 0x7fa2540c9100 2024-08-19T00:44:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.250+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2540d2f50 con 0x7fa2540c9100 2024-08-19T00:44:15.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.251+0000 7fa250c00640 1 -- 172.21.15.7:0/2696536175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa24001d460 con 0x7fa2540c9100 2024-08-19T00:44:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.252+0000 7fa250c00640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23406be30 0x7fa23406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.252+0000 7fa250c00640 1 -- 172.21.15.7:0/2696536175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7fa24008ad90 con 0x7fa2540c9100 2024-08-19T00:44:15.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.252+0000 7fa259200640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23406be30 0x7fa23406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.253+0000 7fa259200640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23406be30 0x7fa23406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa248006f80 tx=0x7fa248008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:15.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.257+0000 7fa250c00640 1 -- 172.21.15.7:0/2696536175 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa240058f70 con 0x7fa2540c9100 2024-08-19T00:44:15.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.482+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2540b4a90 con 0x7fa2540c9100 2024-08-19T00:44:15.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.483+0000 7fa250c00640 1 -- 172.21.15.7:0/2696536175 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) ==== 95+0+4392 (secure 0 0 0) 0x7fa24005d270 con 0x7fa2540c9100 2024-08-19T00:44:15.485 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:15.485 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":118,"btime":"2024-08-19T00:44:15:244336+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3784682490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3784682490},{"type":"v1","addr":"172.21.15.7:6836","nonce":3784682490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:14.242711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:15.485 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 118 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23406be30 msgr2=0x7fa23406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23406be30 0x7fa23406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa248006f80 tx=0x7fa248008030 comp rx=0 tx=0).stop 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2540c9100 msgr2=0x7fa2540c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2540c9100 0x7fa2540c9540 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa240007fd0 tx=0x7fa240007430 comp rx=0 tx=0).stop 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 shutdown_connections 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa23406be30 0x7fa23406e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2541600c0 0x7fa254160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2540c9100 0x7fa2540c9540 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 --2- 172.21.15.7:0/2696536175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa23c003b70 0x7fa2540b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 >> 172.21.15.7:0/2696536175 conn(0x7fa25408dbf0 msgr2=0x7fa2540b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 shutdown_connections 2024-08-19T00:44:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.485+0000 7fa25a600640 1 -- 172.21.15.7:0/2696536175 wait complete. 2024-08-19T00:44:15.502 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 200.00000001' led to DAMAGED state 2024-08-19T00:44:15.503 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_openfiles.0' 2024-08-19T00:44:15.503 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:15.503 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:15.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:44:15.538 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:15.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:15.539 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:15.613 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:44:15.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:44:15.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:15.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.810+0000 7f8526c00640 1 Processor -- start 2024-08-19T00:44:15.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.810+0000 7f8526c00640 1 -- start start 2024-08-19T00:44:15.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.811+0000 7f8526c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f85200d03c0 0x7f85200d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.811+0000 7f8526c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85200b4380 0x7f85200b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.811+0000 7f8526c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85200b50b0 con 0x7f852015f5b0 2024-08-19T00:44:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8526c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f852015f990 con 0x7f85200b4380 2024-08-19T00:44:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8526c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f85200cf120 con 0x7f85200d03c0 2024-08-19T00:44:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8524c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85200b4380 0x7f85200b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f851fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f852015f5b0 0x7f85200cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59342/0 (socket says 172.21.15.7:59342) 2024-08-19T00:44:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f851fe00640 1 -- 172.21.15.7:0/303962890 learned_addr learned my addr 172.21.15.7:0/303962890 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8517e00640 1 --2- 172.21.15.7:0/303962890 >> v2:172.21.15.162:3300/0 conn(0x7f85200d03c0 0x7f85200d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8524c00640 1 -- 172.21.15.7:0/303962890 >> v2:172.21.15.162:3300/0 conn(0x7f85200d03c0 msgr2=0x7f85200d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8524c00640 1 --2- 172.21.15.7:0/303962890 >> v2:172.21.15.162:3300/0 conn(0x7f85200d03c0 0x7f85200d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8524c00640 1 -- 172.21.15.7:0/303962890 >> v1:172.21.15.7:6789/0 conn(0x7f852015f5b0 legacy=0x7f85200cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8524c00640 1 -- 172.21.15.7:0/303962890 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85200cead0 con 0x7f85200b4380 2024-08-19T00:44:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.812+0000 7f8517e00640 1 --2- 172.21.15.7:0/303962890 >> v2:172.21.15.162:3300/0 conn(0x7f85200d03c0 0x7f85200d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.813+0000 7f8524c00640 1 --2- 172.21.15.7:0/303962890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85200b4380 0x7f85200b47b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f85200b3340 tx=0x7f851802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57249e2ded88a348 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:15.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f851f400640 1 -- 172.21.15.7:0/303962890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518007740 con 0x7f85200b4380 2024-08-19T00:44:15.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f851f400640 1 -- 172.21.15.7:0/303962890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85180078e0 con 0x7f85200b4380 2024-08-19T00:44:15.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f851f400640 1 -- 172.21.15.7:0/303962890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518007cb0 con 0x7f85200b4380 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 -- 172.21.15.7:0/303962890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85200b4380 msgr2=0x7f85200b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 --2- 172.21.15.7:0/303962890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85200b4380 0x7f85200b47b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f85200b3340 tx=0x7f851802a5f0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 -- 172.21.15.7:0/303962890 shutdown_connections 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 --2- 172.21.15.7:0/303962890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85200b4380 0x7f85200b47b0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 --2- 172.21.15.7:0/303962890 >> v2:172.21.15.162:3300/0 conn(0x7f85200d03c0 0x7f85200d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 -- 172.21.15.7:0/303962890 >> 172.21.15.7:0/303962890 conn(0x7f852006bc70 msgr2=0x7f852006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 -- 172.21.15.7:0/303962890 shutdown_connections 2024-08-19T00:44:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.814+0000 7f8526c00640 1 -- 172.21.15.7:0/303962890 wait complete. 2024-08-19T00:44:15.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.816+0000 7f8526c00640 1 Processor -- start 2024-08-19T00:44:15.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.816+0000 7f8526c00640 1 -- start start 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8526c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85200b4380 0x7f852014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8526c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85200d03c0 0x7f8520073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8526c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852015f5b0 0x7f852015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8526c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85200b4cf0 con 0x7f852015f5b0 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8526c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85200d0d40 con 0x7f85200b4380 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8526c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f85200b4e70 con 0x7f85200d03c0 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8524c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852015f5b0 0x7f852015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8524c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852015f5b0 0x7f852015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33016/0 (socket says 172.21.15.7:33016) 2024-08-19T00:44:15.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.817+0000 7f8524c00640 1 -- 172.21.15.7:0/1832762840 learned_addr learned my addr 172.21.15.7:0/1832762840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f851fe00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85200b4380 0x7f852014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8517e00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85200d03c0 0x7f8520073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8524c00640 1 -- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85200d03c0 msgr2=0x7f8520073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8524c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85200d03c0 0x7f8520073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8524c00640 1 -- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85200b4380 msgr2=0x7f852014e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8524c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85200b4380 0x7f852014e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8524c00640 1 -- 172.21.15.7:0/1832762840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85200caa90 con 0x7f852015f5b0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8524c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852015f5b0 0x7f852015b660 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f851802abe0 tx=0x7f8518004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f851cc00640 1 -- 172.21.15.7:0/1832762840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518040070 con 0x7f852015f5b0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f851cc00640 1 -- 172.21.15.7:0/1832762840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8518031bc0 con 0x7f852015f5b0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8520159f90 con 0x7f852015f5b0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.818+0000 7f851cc00640 1 -- 172.21.15.7:0/1832762840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518045460 con 0x7f852015f5b0 2024-08-19T00:44:15.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.819+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852015a550 con 0x7f852015f5b0 2024-08-19T00:44:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.820+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85200b47b0 con 0x7f852015f5b0 2024-08-19T00:44:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.820+0000 7f851cc00640 1 -- 172.21.15.7:0/1832762840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8518039040 con 0x7f852015f5b0 2024-08-19T00:44:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.821+0000 7f851cc00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84fc06be60 0x7f84fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.821+0000 7f851cc00640 1 -- 172.21.15.7:0/1832762840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f85180ac960 con 0x7f852015f5b0 2024-08-19T00:44:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.822+0000 7f851fe00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84fc06be60 0x7f84fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.822+0000 7f851fe00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84fc06be60 0x7f84fc06e320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8510007fd0 tx=0x7f8510007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:15.826+0000 7f851cc00640 1 -- 172.21.15.7:0/1832762840 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f85200caa90 con 0x7f852015f5b0 2024-08-19T00:44:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.045+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f852015cbd0 con 0x7f852015f5b0 2024-08-19T00:44:16.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.251+0000 7f851cc00640 1 -- 172.21.15.7:0/1832762840 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v119) ==== 161+0+0 (secure 0 0 0) 0x7f851807b060 con 0x7f852015f5b0 2024-08-19T00:44:16.252 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84fc06be60 msgr2=0x7f84fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84fc06be60 0x7f84fc06e320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8510007fd0 tx=0x7f8510007e80 comp rx=0 tx=0).stop 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852015f5b0 msgr2=0x7f852015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852015f5b0 0x7f852015b660 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f851802abe0 tx=0x7f8518004a40 comp rx=0 tx=0).stop 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 shutdown_connections 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84fc06be60 0x7f84fc06e320 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852015f5b0 0x7f852015b660 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85200d03c0 0x7f8520073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 --2- 172.21.15.7:0/1832762840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85200b4380 0x7f852014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 >> 172.21.15.7:0/1832762840 conn(0x7f852006bc70 msgr2=0x7f852006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:16.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 shutdown_connections 2024-08-19T00:44:16.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.253+0000 7f8526c00640 1 -- 172.21.15.7:0/1832762840 wait complete. 2024-08-19T00:44:16.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:16.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.428+0000 7fc718200640 1 Processor -- start 2024-08-19T00:44:16.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.428+0000 7fc718200640 1 -- start start 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.429+0000 7fc718200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc710073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.429+0000 7fc718200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7100739a0 0x7fc7100ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc718200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71006f7f0 con 0x7fc7100cea40 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc718200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc71006f510 con 0x7fc7100739a0 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc718200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc710072980 con 0x7fc710159bf0 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc714e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7100739a0 0x7fc7100ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc714e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7100739a0 0x7fc7100ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33018/0 (socket says 172.21.15.7:33018) 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc714e00640 1 -- 172.21.15.7:0/3439784363 learned_addr learned my addr 172.21.15.7:0/3439784363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc715800640 1 --2- 172.21.15.7:0/3439784363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc710073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc714e00640 1 -- 172.21.15.7:0/3439784363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 msgr2=0x7fc710073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc714e00640 1 --2- 172.21.15.7:0/3439784363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc710073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc714e00640 1 -- 172.21.15.7:0/3439784363 >> v1:172.21.15.7:6789/0 conn(0x7fc7100cea40 legacy=0x7fc7100d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:16.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.430+0000 7fc714e00640 1 -- 172.21.15.7:0/3439784363 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc710072c60 con 0x7fc7100739a0 2024-08-19T00:44:16.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.431+0000 7fc714e00640 1 --2- 172.21.15.7:0/3439784363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc7100ce500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009870 tx=0x7fc6fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60efa88ea88ce78 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:16.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.431+0000 7fc70fe00640 1 -- 172.21.15.7:0/3439784363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc037070 con 0x7fc7100739a0 2024-08-19T00:44:16.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc70fe00640 1 -- 172.21.15.7:0/3439784363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc032440 con 0x7fc7100739a0 2024-08-19T00:44:16.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc70fe00640 1 -- 172.21.15.7:0/3439784363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc032810 con 0x7fc7100739a0 2024-08-19T00:44:16.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 -- 172.21.15.7:0/3439784363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 msgr2=0x7fc7100ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:16.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 --2- 172.21.15.7:0/3439784363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc7100ce500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009870 tx=0x7fc6fc02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 -- 172.21.15.7:0/3439784363 shutdown_connections 2024-08-19T00:44:16.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 --2- 172.21.15.7:0/3439784363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc7100ce500 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 --2- 172.21.15.7:0/3439784363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc710073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 -- 172.21.15.7:0/3439784363 >> 172.21.15.7:0/3439784363 conn(0x7fc71006bc70 msgr2=0x7fc71006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:16.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 -- 172.21.15.7:0/3439784363 shutdown_connections 2024-08-19T00:44:16.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.432+0000 7fc718200640 1 -- 172.21.15.7:0/3439784363 wait complete. 2024-08-19T00:44:16.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.434+0000 7fc718200640 1 Processor -- start 2024-08-19T00:44:16.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.434+0000 7fc718200640 1 -- start start 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc718200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc71014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc718200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7100cea40 0x7fc710149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc718200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc7100b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc718200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc71015a150 con 0x7fc7100739a0 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc718200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc710159fd0 con 0x7fc7100cea40 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc718200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7100d0ad0 con 0x7fc710159bf0 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc715800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc71014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc715800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc71014ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33030/0 (socket says 172.21.15.7:33030) 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc715800640 1 -- 172.21.15.7:0/1806483771 learned_addr learned my addr 172.21.15.7:0/1806483771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc714e00640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7100cea40 0x7fc710149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:16.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc716200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc7100b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc715800640 1 -- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 msgr2=0x7fc7100b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.435+0000 7fc715800640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc7100b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc715800640 1 -- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7100cea40 msgr2=0x7fc710149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc715800640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7100cea40 0x7fc710149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc715800640 1 -- 172.21.15.7:0/1806483771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71014b1c0 con 0x7fc7100739a0 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc714e00640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7100cea40 0x7fc710149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc716200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc7100b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc715800640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc71014ac80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d800 tx=0x7fc70400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc70d600640 1 -- 172.21.15.7:0/1806483771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70400b6c0 con 0x7fc7100739a0 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc70d600640 1 -- 172.21.15.7:0/1806483771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc704019070 con 0x7fc7100739a0 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc70d600640 1 -- 172.21.15.7:0/1806483771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70400ba80 con 0x7fc7100739a0 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71014a070 con 0x7fc7100739a0 2024-08-19T00:44:16.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.436+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7101f7f30 con 0x7fc7100739a0 2024-08-19T00:44:16.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.437+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7100ce500 con 0x7fc7100739a0 2024-08-19T00:44:16.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.438+0000 7fc70d600640 1 -- 172.21.15.7:0/1806483771 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc70400bc20 con 0x7fc7100739a0 2024-08-19T00:44:16.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.439+0000 7fc70d600640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6f006be30 0x7fc6f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:16.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.439+0000 7fc70d600640 1 -- 172.21.15.7:0/1806483771 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7fc70408b550 con 0x7fc7100739a0 2024-08-19T00:44:16.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.439+0000 7fc714e00640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6f006be30 0x7fc6f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:16.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.440+0000 7fc714e00640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6f006be30 0x7fc6f006e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc034000 tx=0x7fc6fc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:16.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.444+0000 7fc70d600640 1 -- 172.21.15.7:0/1806483771 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc71014b1c0 con 0x7fc7100739a0 2024-08-19T00:44:16.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:16.701+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fc7100b3110 con 0x7fc7100739a0 2024-08-19T00:44:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.253+0000 7fc70d600640 1 -- 172.21.15.7:0/1806483771 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v120) ==== 101+0+0 (secure 0 0 0) 0x7fc70401c360 con 0x7fc7100739a0 2024-08-19T00:44:17.255 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.255+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6f006be30 msgr2=0x7fc6f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.255+0000 7fc718200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6f006be30 0x7fc6f006e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc034000 tx=0x7fc6fc02e000 comp rx=0 tx=0).stop 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 msgr2=0x7fc71014ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc71014ac80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d800 tx=0x7fc70400dcc0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 shutdown_connections 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc6f006be30 0x7fc6f006e2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc710159bf0 0x7fc7100b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7100cea40 0x7fc710149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 --2- 172.21.15.7:0/1806483771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7100739a0 0x7fc71014ac80 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 >> 172.21.15.7:0/1806483771 conn(0x7fc71006bc70 msgr2=0x7fc71015fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:17.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 shutdown_connections 2024-08-19T00:44:17.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.256+0000 7fc718200640 1 -- 172.21.15.7:0/1806483771 wait complete. 2024-08-19T00:44:17.277 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 Processor -- start 2024-08-19T00:44:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 -- start start 2024-08-19T00:44:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 0x55c3453c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a5b0 0x55c3453c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a990 0x55c3453d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c3453298f0 con 0x55c34532a5b0 2024-08-19T00:44:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c34529ed00 con 0x55c34532a990 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.354+0000 7faf1f971f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c3453cfdc0 con 0x55c345328f40 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a5b0 0x55c3453c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a5b0 0x55c3453c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33044/0 (socket says 172.21.15.7:33044) 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 -- 172.21.15.7:0/2593317430 learned_addr learned my addr 172.21.15.7:0/2593317430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf1cc00640 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 0x55c3453c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf1d600640 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a990 0x55c3453d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 -- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 msgr2=0x55c3453c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 0x55c3453c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 -- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a990 msgr2=0x55c3453d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a990 0x55c3453d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 -- 172.21.15.7:0/2593317430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c345223b30 con 0x55c34532a5b0 2024-08-19T00:44:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.355+0000 7faf17e00640 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a5b0 0x55c3453c1c50 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7faf08025a80 tx=0x7faf0804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfabe4ad5db7b473 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf16a00640 1 -- 172.21.15.7:0/2593317430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08065070 con 0x55c34532a5b0 2024-08-19T00:44:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf16a00640 1 -- 172.21.15.7:0/2593317430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf080549f0 con 0x55c34532a5b0 2024-08-19T00:44:17.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf16a00640 1 -- 172.21.15.7:0/2593317430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08059040 con 0x55c34532a5b0 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 -- 172.21.15.7:0/2593317430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a5b0 msgr2=0x55c3453c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a5b0 0x55c3453c1c50 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7faf08025a80 tx=0x7faf0804e000 comp rx=0 tx=0).stop 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 -- 172.21.15.7:0/2593317430 shutdown_connections 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a990 0x55c3453d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a5b0 0x55c3453c1c50 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 --2- 172.21.15.7:0/2593317430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 0x55c3453c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 -- 172.21.15.7:0/2593317430 >> 172.21.15.7:0/2593317430 conn(0x55c3453274e0 msgr2=0x55c3453421f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.356+0000 7faf1f971f40 1 -- 172.21.15.7:0/2593317430 shutdown_connections 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.357+0000 7faf1f971f40 1 -- 172.21.15.7:0/2593317430 wait complete. 2024-08-19T00:44:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.357+0000 7faf1f971f40 1 Processor -- start 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.357+0000 7faf1f971f40 1 -- start start 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.358+0000 7faf1f971f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 0x55c3453d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.358+0000 7faf1f971f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a5b0 0x55c3453be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.358+0000 7faf1f971f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a990 0x55c3453cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.358+0000 7faf1f971f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c3453c6590 con 0x55c34532a990 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.358+0000 7faf1f971f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c3453c8b60 con 0x55c34532a5b0 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.358+0000 7faf1f971f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c3453c6870 con 0x55c345328f40 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a990 0x55c3453cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a990 0x55c3453cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33054/0 (socket says 172.21.15.7:33054) 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 learned_addr learned my addr 172.21.15.7:0/1501513504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1cc00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 0x55c3453d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf17e00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a5b0 0x55c3453be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 msgr2=0x55c3453d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c345328f40 0x55c3453d1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a5b0 msgr2=0x55c3453be2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c34532a5b0 0x55c3453be2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c345260080 con 0x55c34532a990 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.359+0000 7faf1d600640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a990 0x55c3453cdc90 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7faf1800f4e0 tx=0x7faf1800f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.360+0000 7faf15600640 1 -- 172.21.15.7:0/1501513504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18017070 con 0x55c34532a990 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.360+0000 7faf15600640 1 -- 172.21.15.7:0/1501513504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18013640 con 0x55c34532a990 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.360+0000 7faf15600640 1 -- 172.21.15.7:0/1501513504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18013a10 con 0x55c34532a990 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.360+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3453cee70 con 0x55c34532a990 2024-08-19T00:44:17.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.360+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3453cd1b0 con 0x55c34532a990 2024-08-19T00:44:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.362+0000 7faf15600640 1 -- 172.21.15.7:0/1501513504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf1801a070 con 0x55c34532a990 2024-08-19T00:44:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.363+0000 7faf15600640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faefc06a840 0x7faefc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.363+0000 7faf15600640 1 -- 172.21.15.7:0/1501513504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7faf1808a150 con 0x55c34532a990 2024-08-19T00:44:17.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.363+0000 7faf1cc00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faefc06a840 0x7faefc06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.366 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:17.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.363+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c3453ce1d0 0x55c3453c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.363+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345329490 con 0x55c3453ce1d0 2024-08-19T00:44:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.363+0000 7faf1cc00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faefc06a840 0x7faefc06cd00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faf10000f60 tx=0x7faf100016b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.364+0000 7faf17e00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c3453ce1d0 0x55c3453c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.364+0000 7faf17e00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c3453ce1d0 0x55c3453c3e20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.366+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v92'164 uv138 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.366+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c3453c4360 con 0x55c3453ce1d0 2024-08-19T00:44:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.368+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v92'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.368+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345471b30 con 0x55c3453ce1d0 2024-08-19T00:44:17.370 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.369+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v92'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.369+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472ee0 con 0x55c3453ce1d0 2024-08-19T00:44:17.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.371+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v92'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.371+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345473280 con 0x55c3453ce1d0 2024-08-19T00:44:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.372+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v92'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.372+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345471ed0 con 0x55c3453ce1d0 2024-08-19T00:44:17.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.373+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v92'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.374+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454722e0 con 0x55c3453ce1d0 2024-08-19T00:44:17.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.375+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v92'170 uv144 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.375+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c3454722e0 con 0x55c3453ce1d0 2024-08-19T00:44:17.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.377+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v92'171 uv171 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.377+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.380 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.378+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v92'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.378+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.380+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v92'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.380+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.381+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v92'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.381+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.383+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v92'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.383+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.385+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v92'176 uv151 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.385+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.386+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v92'177 uv177 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.386+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.389 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.388+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v92'178 uv178 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.388+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.389+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v92'179 uv179 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.389+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.390+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v92'180 uv180 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.390+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472270 con 0x55c3453ce1d0 2024-08-19T00:44:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.392+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v92'181 uv181 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.392+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472650 con 0x55c3453ce1d0 2024-08-19T00:44:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.393+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v92'182 uv182 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.393+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472ac0 con 0x55c3453ce1d0 2024-08-19T00:44:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.395+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v92'183 uv157 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.395+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345472ac0 con 0x55c3453ce1d0 2024-08-19T00:44:17.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.396+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v92'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.396+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.399 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:17.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.397+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v92'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.398+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.399+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v92'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.399+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.400+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v92'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.400+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.402+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v92'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.402+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.403+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v92'189 uv163 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.403+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.405+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v92'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.405+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.408 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.406+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v92'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.406+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.408+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v92'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.408+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.409+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v92'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.409+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c3453ce1d0 2024-08-19T00:44:17.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.410+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v92'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf0805c040 con 0x55c3453ce1d0 2024-08-19T00:44:17.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.411+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c345473620 0x55c345475a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.411+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345472530 con 0x55c345473620 2024-08-19T00:44:17.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.411+0000 7faf1cc00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c345473620 0x55c345475a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.411+0000 7faf1cc00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c345473620 0x55c345475a10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.413+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v92'129 uv113 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.413+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345475f50 con 0x55c345473620 2024-08-19T00:44:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.415+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v92'130 uv130 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.415+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454762f0 con 0x55c345473620 2024-08-19T00:44:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.416+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v92'131 uv131 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.418 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.416+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345476690 con 0x55c345473620 2024-08-19T00:44:17.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.418+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v92'132 uv132 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.418+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345476a30 con 0x55c345473620 2024-08-19T00:44:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.419+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v92'133 uv133 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.420+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345476dd0 con 0x55c345473620 2024-08-19T00:44:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.421+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v92'134 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.421+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345477170 con 0x55c345473620 2024-08-19T00:44:17.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.422+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v92'135 uv135 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.422+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.425 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:17.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.424+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v92'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.424+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.425+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v92'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.425+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.427+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v92'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.427+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.430 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:17.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.428+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v92'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.428+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547bc00 con 0x55c345473620 2024-08-19T00:44:17.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.430+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [write 0~18118] v92'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.430+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547bc00 con 0x55c345473620 2024-08-19T00:44:17.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.431+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v92'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.432+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.433+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 606.00000000 [create] v92'142 uv127 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.433+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.434+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 606.00000000 [delete] v92'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.434+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.437 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.436+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v92'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.436+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345478520 con 0x55c345473620 2024-08-19T00:44:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.437+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v92'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.437+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345478520 con 0x55c345473620 2024-08-19T00:44:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.439+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v92'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.439+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345477510 con 0x55c345473620 2024-08-19T00:44:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.440+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v92'147 uv147 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c345473620 2024-08-19T00:44:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.440+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c345477de0 0x55c34547a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.440+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:51 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547a710 con 0x55c345477de0 2024-08-19T00:44:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.441+0000 7faf17e00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c345477de0 0x55c34547a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.441+0000 7faf17e00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c345477de0 0x55c34547a1d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.443+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(51 607.00000000 [create] v92'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.443+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:52 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c34547a710 con 0x55c345477de0 2024-08-19T00:44:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.445+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(52 607.00000000 [delete] v92'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.445+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547a790 con 0x55c345477de0 2024-08-19T00:44:17.447 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.446+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(53 607.00000000 [create] v92'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.446+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547bb90 con 0x55c345477de0 2024-08-19T00:44:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.447+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v92'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.447+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547bb90 con 0x55c345477de0 2024-08-19T00:44:17.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.449+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v92'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.449+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547ab80 con 0x55c345477de0 2024-08-19T00:44:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.450+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v92'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.450+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:57 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547ab80 con 0x55c3453ce1d0 2024-08-19T00:44:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.452+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(57 mds0_openfiles.0 [create] v92'26 uv25 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.452+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:58 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c34547ab80 con 0x55c3453ce1d0 2024-08-19T00:44:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.453+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v92'27 uv27 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.453+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547ab80 con 0x55c3453ce1d0 2024-08-19T00:44:17.456 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.455+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(59 mds0_openfiles.0 [create] v92'28 uv28 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.455+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547ab80 con 0x55c3453ce1d0 2024-08-19T00:44:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.456+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v92'29 uv29 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.456+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c34547b200 0x55c34547d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.456+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:61 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547db30 con 0x55c34547b200 2024-08-19T00:44:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.457+0000 7faf1d600640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c34547b200 0x55c34547d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.457+0000 7faf1d600640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c34547b200 0x55c34547d5f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.459+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(61 608.00000000 [create] v92'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.459+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:62 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c34547df50 con 0x55c34547b200 2024-08-19T00:44:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.460+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(62 608.00000000 [delete] v92'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.460+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547e430 con 0x55c34547b200 2024-08-19T00:44:17.463 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.462+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(63 608.00000000 [create] v92'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.462+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547fce0 con 0x55c34547b200 2024-08-19T00:44:17.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.463+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v92'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.463+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345480080 con 0x55c34547b200 2024-08-19T00:44:17.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.464+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v92'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.465+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c34547ecd0 con 0x55c34547b200 2024-08-19T00:44:17.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.466+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(66 608.00000000 [omap-set-header] v92'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.466+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c34547f5d0 0x55c345482430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.466+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:67 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345482970 con 0x55c34547f5d0 2024-08-19T00:44:17.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.466+0000 7faf1cc00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c34547f5d0 0x55c345482430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.467+0000 7faf1cc00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c34547f5d0 0x55c345482430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.468+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(67 604.00000000 [create] v92'59 uv53 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.468+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:68 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345482970 con 0x55c34547f5d0 2024-08-19T00:44:17.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.469+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(68 604.00000000 [delete] v92'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.469+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345482970 con 0x55c34547f5d0 2024-08-19T00:44:17.472 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.471+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(69 604.00000000 [create] v92'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.471+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345483d70 con 0x55c34547f5d0 2024-08-19T00:44:17.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.472+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v92'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.472+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345483d70 con 0x55c34547f5d0 2024-08-19T00:44:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.473+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v92'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.473+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345482d60 con 0x55c34547f5d0 2024-08-19T00:44:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.475+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v92'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.475+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345482d60 con 0x55c34547f5d0 2024-08-19T00:44:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.476+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(73 500.00000000 [create] v92'65 uv58 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.476+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345482d60 con 0x55c34547f5d0 2024-08-19T00:44:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.477+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(74 500.00000000 [delete] v92'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.477+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345482d60 con 0x55c34547f5d0 2024-08-19T00:44:17.480 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:17.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.479+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(75 500.00000000 [create] v92'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.479+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345482d60 con 0x55c34547f5d0 2024-08-19T00:44:17.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.480+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v92'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.480+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345482d60 con 0x55c34547f5d0 2024-08-19T00:44:17.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.482+0000 7faf1cc00640 1 -- 172.21.15.7:0/1501513504 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v92'69 uv69 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf10009040 con 0x55c34547f5d0 2024-08-19T00:44:17.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.482+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c345483270 0x55c345485660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.482+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:78 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345485d10 con 0x55c345483270 2024-08-19T00:44:17.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.482+0000 7faf17e00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c345483270 0x55c345485660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.483+0000 7faf17e00640 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c345483270 0x55c345485660 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.484+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(78 mds_snaptable [create] v92'27 uv26 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.484+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:79 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345485d10 con 0x55c345483270 2024-08-19T00:44:17.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.486+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(79 mds_snaptable [delete] v92'28 uv28 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.486+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345483270 2024-08-19T00:44:17.489 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:17.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.487+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(80 mds_snaptable [create] v92'29 uv29 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.487+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345483270 2024-08-19T00:44:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.489+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v92'30 uv30 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.489+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345483270 2024-08-19T00:44:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.490+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v92'31 uv31 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.490+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:83 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c3453ce1d0 2024-08-19T00:44:17.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.491+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(83 605.00000000 [create] v92'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.491+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:84 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c3453ce1d0 2024-08-19T00:44:17.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.493+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(84 605.00000000 [delete] v92'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.493+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c3453ce1d0 2024-08-19T00:44:17.496 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:17.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.494+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(85 605.00000000 [create] v92'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.494+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345487170 con 0x55c3453ce1d0 2024-08-19T00:44:17.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.496+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v92'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.496+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345487170 con 0x55c3453ce1d0 2024-08-19T00:44:17.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.497+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v92'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.497+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c3453ce1d0 2024-08-19T00:44:17.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.498+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(88 605.00000000 [omap-set-header] v92'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c3453ce1d0 2024-08-19T00:44:17.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.498+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:89 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.500+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(89 mds0_inotable [create] v92'54 uv48 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.500+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:90 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.501+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(90 mds0_inotable [delete] v92'55 uv55 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.501+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.505 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:17.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.503+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(91 mds0_inotable [create] v92'56 uv56 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.503+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.505+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(92 mds0_inotable [write 0~34] v92'57 uv57 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.505+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.506+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v92'58 uv58 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.506+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.508+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(94 100.00000000 [create] v92'59 uv53 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.508+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.510+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(95 100.00000000 [delete] v92'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.510+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.514 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.512+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(96 100.00000000 [create] v92'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.512+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486160 con 0x55c345477de0 2024-08-19T00:44:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.515+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(97 100.00000000 [omap-set-header] v92'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.515+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345488f70 con 0x55c345477de0 2024-08-19T00:44:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.518+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v92'63 uv63 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345477de0 2024-08-19T00:44:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.518+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345486610 con 0x55c34547b200 2024-08-19T00:44:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.521+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v92'26 uv25 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.521+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c34547b200 2024-08-19T00:44:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.524+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v92'27 uv27 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.524+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c34547b200 2024-08-19T00:44:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.525+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v92'28 uv28 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.525+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c34547b200 2024-08-19T00:44:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.528+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v92'29 uv29 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.528+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c34547b200 2024-08-19T00:44:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.530+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v92'33 uv32 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.530+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c34547b200 2024-08-19T00:44:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.531+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v92'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.531+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c34547b200 2024-08-19T00:44:17.534 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.533+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v92'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.533+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454879c0 con 0x55c34547b200 2024-08-19T00:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.534+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v92'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.534+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454879c0 con 0x55c34547b200 2024-08-19T00:44:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.535+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v92'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.535+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c34547b200 2024-08-19T00:44:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.536+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v92'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf18023070 con 0x55c34547b200 2024-08-19T00:44:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.537+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.538+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v92'27 uv26 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.538+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.539+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v92'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.539+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.542 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:17.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.541+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v92'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.541+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.542+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v92'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.542+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.543+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v92'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.543+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.545+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v92'69 uv61 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.545+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.546+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v92'70 uv70 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.546+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.549 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:17.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.548+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v92'71 uv71 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.548+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.549+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v92'72 uv72 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.549+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.550+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v92'73 uv73 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.551+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.552+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v92'74 uv68 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.552+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.553+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v92'75 uv75 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.553+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.556 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.554+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v92'76 uv76 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.554+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454879c0 con 0x55c345483270 2024-08-19T00:44:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.556+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v92'77 uv77 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.556+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454879c0 con 0x55c345483270 2024-08-19T00:44:17.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.557+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v92'78 uv78 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.557+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c3454869b0 con 0x55c345483270 2024-08-19T00:44:17.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.558+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v92'79 uv79 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.558+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) -- 0x55c345487110 con 0x55c345483270 2024-08-19T00:44:17.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf17e00640 1 -- 172.21.15.7:0/1501513504 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v92'80 uv80 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7faf08068040 con 0x55c345483270 2024-08-19T00:44:17.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c345473620 msgr2=0x55c345475a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c345473620 0x55c345475a10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c34547f5d0 msgr2=0x55c345482430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c34547f5d0 0x55c345482430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c345483270 msgr2=0x55c345485660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c345483270 0x55c345485660 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c345477de0 msgr2=0x55c34547a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c345477de0 0x55c34547a1d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c3453ce1d0 msgr2=0x55c3453c3e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c3453ce1d0 0x55c3453c3e20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c34547b200 msgr2=0x55c34547d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c34547b200 0x55c34547d5f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 reap_dead start 2024-08-19T00:44:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1d600640 1 -- 172.21.15.7:0/1501513504 reap_dead start 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faefc06a840 msgr2=0x7faefc06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faefc06a840 0x7faefc06cd00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faf10000f60 tx=0x7faf100016b0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a990 msgr2=0x55c3453cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a990 0x55c3453cdc90 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7faf1800f4e0 tx=0x7faf1800f9a0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.559+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 shutdown_connections 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.560+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faefc06a840 0x7faefc06cd00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.560+0000 7faf1f971f40 1 --2- 172.21.15.7:0/1501513504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c34532a990 0x55c3453cdc90 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.560+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 >> 172.21.15.7:0/1501513504 conn(0x55c3453274e0 msgr2=0x55c3453278c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.560+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 shutdown_connections 2024-08-19T00:44:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.560+0000 7faf1f971f40 1 -- 172.21.15.7:0/1501513504 wait complete. 2024-08-19T00:44:17.565 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_openfiles.0 2024-08-19T00:44:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.681+0000 7f0cf7c1ef40 1 Processor -- start 2024-08-19T00:44:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.681+0000 7f0cf7c1ef40 1 -- start start 2024-08-19T00:44:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf7c1ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a0fef40 0x56136a197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf7c1ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a0fb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf7c1ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a100990 0x56136a1a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf7c1ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56136a0ff8f0 con 0x56136a1005b0 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf7c1ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56136a074d00 con 0x56136a100990 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf7c1ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56136a1a5dc0 con 0x56136a0fef40 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a0fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a0fb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33068/0 (socket says 172.21.15.7:33068) 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 -- 172.21.15.7:0/4097530501 learned_addr learned my addr 172.21.15.7:0/4097530501 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf4e00640 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a0fef40 0x56136a197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf5800640 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a100990 0x56136a1a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 -- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a0fef40 msgr2=0x56136a197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a0fef40 0x56136a197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 -- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a100990 msgr2=0x56136a1a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a100990 0x56136a1a77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cefe00640 1 -- 172.21.15.7:0/4097530501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561369ff9b30 con 0x56136a1005b0 2024-08-19T00:44:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf5800640 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a100990 0x56136a1a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.682+0000 7f0cf4e00640 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a0fef40 0x56136a197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cefe00640 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a0fb230 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000b3a0 tx=0x7f0ce000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28804fbf5e1cd49 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0ceea00640 1 -- 172.21.15.7:0/4097530501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0012020 con 0x56136a1005b0 2024-08-19T00:44:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0ceea00640 1 -- 172.21.15.7:0/4097530501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce000d6b0 con 0x56136a1005b0 2024-08-19T00:44:17.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0ceea00640 1 -- 172.21.15.7:0/4097530501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce000daa0 con 0x56136a1005b0 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/4097530501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 msgr2=0x56136a0fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a0fb230 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000b3a0 tx=0x7f0ce000b860 comp rx=0 tx=0).stop 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/4097530501 shutdown_connections 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a100990 0x56136a1a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a0fb230 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/4097530501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a0fef40 0x56136a197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.683+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/4097530501 >> 172.21.15.7:0/4097530501 conn(0x56136a0fd4e0 msgr2=0x56136a118650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.684+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/4097530501 shutdown_connections 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.684+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/4097530501 wait complete. 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.684+0000 7f0cf7c1ef40 1 Processor -- start 2024-08-19T00:44:17.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.684+0000 7f0cf7c1ef40 1 -- start start 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cf7c1ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a0fef40 0x56136a1a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cf7c1ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a1a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cf7c1ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a100990 0x56136a198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cf7c1ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56136a0ff3c0 con 0x56136a1005b0 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cf7c1ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56136a0fcc90 con 0x56136a0fef40 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cf7c1ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56136a19ec90 con 0x56136a100990 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cefe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a1a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cefe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a1a32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33072/0 (socket says 172.21.15.7:33072) 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.685+0000 7f0cefe00640 1 -- 172.21.15.7:0/2459437765 learned_addr learned my addr 172.21.15.7:0/2459437765 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cf4e00640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a0fef40 0x56136a1a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cf5800640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a100990 0x56136a198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cefe00640 1 -- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a100990 msgr2=0x56136a198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cefe00640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a100990 0x56136a198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cefe00640 1 -- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a0fef40 msgr2=0x56136a1a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cefe00640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56136a0fef40 0x56136a1a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cefe00640 1 -- 172.21.15.7:0/2459437765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56136a036080 con 0x56136a1005b0 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cf5800640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56136a100990 0x56136a198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cefe00640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a1a32e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000b3a0 tx=0x7f0ce0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0ced600640 1 -- 172.21.15.7:0/2459437765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce000ecb0 con 0x56136a1005b0 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0ced600640 1 -- 172.21.15.7:0/2459437765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce000ee50 con 0x56136a1005b0 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56136a1a4920 con 0x56136a1005b0 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.686+0000 7f0ced600640 1 -- 172.21.15.7:0/2459437765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0017670 con 0x56136a1005b0 2024-08-19T00:44:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.687+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56136a1a4ee0 con 0x56136a1005b0 2024-08-19T00:44:17.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.688+0000 7f0ced600640 1 -- 172.21.15.7:0/2459437765 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ce0015020 con 0x56136a1005b0 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.689+0000 7f0ced600640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cd406a840 0x7f0cd406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.689+0000 7f0ced600640 1 -- 172.21.15.7:0/2459437765 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f0ce008bcb0 con 0x56136a1005b0 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.690+0000 7f0cf4e00640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cd406a840 0x7f0cd406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.690+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56136a1989c0 0x56136a23eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.690+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e92) -- 0x56136a23eff0 con 0x56136a1989c0 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.690+0000 7f0cf5800640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56136a1989c0 0x56136a23eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.690+0000 7f0cf4e00640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cd406a840 0x7f0cd406cd00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8005fd0 tx=0x7f0ce80057d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.691+0000 7f0cf5800640 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56136a1989c0 0x56136a23eab0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf5800640 1 -- 172.21.15.7:0/2459437765 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 mds0_openfiles.0 [delete] v92'30 uv30 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0cf0053700 con 0x56136a1989c0 2024-08-19T00:44:17.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56136a1989c0 msgr2=0x56136a23eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56136a1989c0 0x56136a23eab0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cd406a840 msgr2=0x7f0cd406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0cd406a840 0x7f0cd406cd00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8005fd0 tx=0x7f0ce80057d0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 msgr2=0x56136a1a32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 --2- 172.21.15.7:0/2459437765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56136a1005b0 0x56136a1a32e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000b3a0 tx=0x7f0ce0000ed0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf5800640 1 -- 172.21.15.7:0/2459437765 reap_dead start 2024-08-19T00:44:17.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 shutdown_connections 2024-08-19T00:44:17.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 >> 172.21.15.7:0/2459437765 conn(0x56136a0fd4e0 msgr2=0x56136a197090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:17.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 shutdown_connections 2024-08-19T00:44:17.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.692+0000 7f0cf7c1ef40 1 -- 172.21.15.7:0/2459437765 wait complete. 2024-08-19T00:44:17.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:17.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.857+0000 7fc841600640 1 Processor -- start 2024-08-19T00:44:17.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.857+0000 7fc841600640 1 -- start start 2024-08-19T00:44:17.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.858+0000 7fc841600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc83c15e3e0 0x7fc83c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.858+0000 7fc841600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.858+0000 7fc841600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc83c0d3110 con 0x7fc83c0b4150 2024-08-19T00:44:17.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.858+0000 7fc841600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc83c0b4df0 con 0x7fc83c15e3e0 2024-08-19T00:44:17.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.858+0000 7fc841600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c0b50d0 con 0x7fc83c0d27b0 2024-08-19T00:44:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc840c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc83c0b4150 0x7fc83c0b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59394/0 (socket says 172.21.15.7:59394) 2024-08-19T00:44:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc840c00640 1 -- 172.21.15.7:0/973774989 learned_addr learned my addr 172.21.15.7:0/973774989 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83be00640 1 --2- 172.21.15.7:0/973774989 >> v2:172.21.15.162:3300/0 conn(0x7fc83c15e3e0 0x7fc83c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83b400640 1 --2- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83aa00640 1 -- 172.21.15.7:0/973774989 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616151361 0 0) 0x7fc83c0d3110 con 0x7fc83c0b4150 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83aa00640 1 -- 172.21.15.7:0/973774989 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc820003520 con 0x7fc83c0b4150 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83be00640 1 -- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 msgr2=0x7fc83c0d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83be00640 1 --2- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c0d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83aa00640 1 -- 172.21.15.7:0/973774989 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 560604692 0 0) 0x7fc820003520 con 0x7fc83c0b4150 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83be00640 1 -- 172.21.15.7:0/973774989 >> v1:172.21.15.7:6789/0 conn(0x7fc83c0b4150 legacy=0x7fc83c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83be00640 1 -- 172.21.15.7:0/973774989 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c0cf1e0 con 0x7fc83c15e3e0 2024-08-19T00:44:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.859+0000 7fc83b400640 1 --2- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.860+0000 7fc83be00640 1 --2- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c0b0e60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0097a0 tx=0x7fc82c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe901aa15373ac5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc83aa00640 1 -- 172.21.15.7:0/973774989 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c037070 con 0x7fc83c15e3e0 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc83aa00640 1 -- 172.21.15.7:0/973774989 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c02aba0 con 0x7fc83c15e3e0 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc83aa00640 1 -- 172.21.15.7:0/973774989 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340019f0 con 0x7fc83c15e3e0 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc841600640 1 -- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 msgr2=0x7fc83c0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc841600640 1 --2- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c0b0e60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0097a0 tx=0x7fc82c02a110 comp rx=0 tx=0).stop 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc841600640 1 -- 172.21.15.7:0/973774989 shutdown_connections 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc841600640 1 --2- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc841600640 1 --2- 172.21.15.7:0/973774989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c0b0e60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc841600640 1 -- 172.21.15.7:0/973774989 >> 172.21.15.7:0/973774989 conn(0x7fc83c08dbe0 msgr2=0x7fc83c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:17.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.861+0000 7fc841600640 1 -- 172.21.15.7:0/973774989 shutdown_connections 2024-08-19T00:44:17.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.862+0000 7fc841600640 1 -- 172.21.15.7:0/973774989 wait complete. 2024-08-19T00:44:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.863+0000 7fc841600640 1 Processor -- start 2024-08-19T00:44:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.863+0000 7fc841600640 1 -- start start 2024-08-19T00:44:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc841600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b4150 0x7fc83c160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc841600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c1f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc841600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc841600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c0b13a0 con 0x7fc83c0b4150 2024-08-19T00:44:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc841600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c0cee90 con 0x7fc83c15e3e0 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc841600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c0cf9e0 con 0x7fc83c0d27b0 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc83be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b4150 0x7fc83c160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc83be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b4150 0x7fc83c160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33086/0 (socket says 172.21.15.7:33086) 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc83be00640 1 -- 172.21.15.7:0/1664682101 learned_addr learned my addr 172.21.15.7:0/1664682101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc83b400640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c1f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.864+0000 7fc840c00640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc83be00640 1 -- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 msgr2=0x7fc83c1f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc83be00640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c1f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc83be00640 1 -- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 msgr2=0x7fc83c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc83be00640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc83be00640 1 -- 172.21.15.7:0/1664682101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c161490 con 0x7fc83c0b4150 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc83be00640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b4150 0x7fc83c160e40 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0097a0 tx=0x7fc82c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc833e00640 1 -- 172.21.15.7:0/1664682101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c037040 con 0x7fc83c0b4150 2024-08-19T00:44:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc833e00640 1 -- 172.21.15.7:0/1664682101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c004250 con 0x7fc83c0b4150 2024-08-19T00:44:17.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc833e00640 1 -- 172.21.15.7:0/1664682101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c006e10 con 0x7fc83c0b4150 2024-08-19T00:44:17.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.865+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83c161770 con 0x7fc83c0b4150 2024-08-19T00:44:17.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.866+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83c1f76d0 con 0x7fc83c0b4150 2024-08-19T00:44:17.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.867+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c0b0e60 con 0x7fc83c0b4150 2024-08-19T00:44:17.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.867+0000 7fc833e00640 1 -- 172.21.15.7:0/1664682101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc82c003610 con 0x7fc83c0b4150 2024-08-19T00:44:17.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.868+0000 7fc833e00640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:17.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.868+0000 7fc833e00640 1 -- 172.21.15.7:0/1664682101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7fc82c0abeb0 con 0x7fc83c0b4150 2024-08-19T00:44:17.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.869+0000 7fc83b400640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:17.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.869+0000 7fc83b400640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0cdc30 tx=0x7fc828009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:17.872+0000 7fc833e00640 1 -- 172.21.15.7:0/1664682101 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc82c07a080 con 0x7fc83c0b4150 2024-08-19T00:44:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.096+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fc83c0b2240 con 0x7fc83c0b4150 2024-08-19T00:44:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.106+0000 7fc833e00640 1 -- 172.21.15.7:0/1664682101 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v121) ==== 162+0+0 (secure 0 0 0) 0x7fc82c07e380 con 0x7fc83c0b4150 2024-08-19T00:44:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 msgr2=0x7fc81c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0cdc30 tx=0x7fc828009190 comp rx=0 tx=0).stop 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b4150 msgr2=0x7fc83c160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b4150 0x7fc83c160e40 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0097a0 tx=0x7fc82c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 shutdown_connections 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc81c06be30 0x7fc81c06e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0d27b0 0x7fc83c1f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 --2- 172.21.15.7:0/1664682101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c0b4150 0x7fc83c160e40 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 >> 172.21.15.7:0/1664682101 conn(0x7fc83c08dbe0 msgr2=0x7fc83c06d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 shutdown_connections 2024-08-19T00:44:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.109+0000 7fc841600640 1 -- 172.21.15.7:0/1664682101 wait complete. 2024-08-19T00:44:18.113 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:18.112+0000 7f955a800640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-08-19T00:44:18.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.689+0000 7f8a66c00640 1 Processor -- start 2024-08-19T00:44:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.689+0000 7f8a66c00640 1 -- start start 2024-08-19T00:44:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.690+0000 7f8a66c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a600d03c0 0x7f8a600d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.690+0000 7f8a66c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a600b50b0 con 0x7f8a6015f5b0 2024-08-19T00:44:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.690+0000 7f8a66c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a600cead0 con 0x7f8a600b4380 2024-08-19T00:44:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.690+0000 7f8a66c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6015f990 con 0x7f8a600d03c0 2024-08-19T00:44:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.691+0000 7f8a5fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8a6015f5b0 0x7f8a600cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59396/0 (socket says 172.21.15.7:59396) 2024-08-19T00:44:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.691+0000 7f8a5fe00640 1 -- 172.21.15.7:0/811418567 learned_addr learned my addr 172.21.15.7:0/811418567 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.691+0000 7f8a57e00640 1 --2- 172.21.15.7:0/811418567 >> v2:172.21.15.162:3300/0 conn(0x7f8a600d03c0 0x7f8a600d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.691+0000 7f8a5f400640 1 -- 172.21.15.7:0/811418567 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089883486 0 0) 0x7f8a600b50b0 con 0x7f8a6015f5b0 2024-08-19T00:44:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.691+0000 7f8a5f400640 1 -- 172.21.15.7:0/811418567 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a44003520 con 0x7f8a6015f5b0 2024-08-19T00:44:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.691+0000 7f8a5f400640 1 -- 172.21.15.7:0/811418567 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2577855214 0 0) 0x7f8a44003520 con 0x7f8a6015f5b0 2024-08-19T00:44:18.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.692+0000 7f8a57e00640 1 -- 172.21.15.7:0/811418567 >> v1:172.21.15.162:6789/0 conn(0x7f8a600b4380 legacy=0x7f8a600b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.692+0000 7f8a57e00640 1 -- 172.21.15.7:0/811418567 >> v1:172.21.15.7:6789/0 conn(0x7f8a6015f5b0 legacy=0x7f8a600cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.692+0000 7f8a57e00640 1 -- 172.21.15.7:0/811418567 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600cedb0 con 0x7f8a600d03c0 2024-08-19T00:44:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a57e00640 1 --2- 172.21.15.7:0/811418567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a600d0800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097a0 tx=0x7f8a4802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b7f18e73ca73d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a5f400640 1 -- 172.21.15.7:0/811418567 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48037070 con 0x7f8a600d03c0 2024-08-19T00:44:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a5f400640 1 -- 172.21.15.7:0/811418567 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4802abc0 con 0x7f8a600d03c0 2024-08-19T00:44:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a5f400640 1 -- 172.21.15.7:0/811418567 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50001670 con 0x7f8a600d03c0 2024-08-19T00:44:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a66c00640 1 -- 172.21.15.7:0/811418567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 msgr2=0x7f8a600d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a66c00640 1 --2- 172.21.15.7:0/811418567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a600d0800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097a0 tx=0x7f8a4802a130 comp rx=0 tx=0).stop 2024-08-19T00:44:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a66c00640 1 -- 172.21.15.7:0/811418567 shutdown_connections 2024-08-19T00:44:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a66c00640 1 --2- 172.21.15.7:0/811418567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a600d0800 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a66c00640 1 -- 172.21.15.7:0/811418567 >> 172.21.15.7:0/811418567 conn(0x7f8a6006bc70 msgr2=0x7f8a6006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.693+0000 7f8a66c00640 1 -- 172.21.15.7:0/811418567 shutdown_connections 2024-08-19T00:44:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.694+0000 7f8a66c00640 1 -- 172.21.15.7:0/811418567 wait complete. 2024-08-19T00:44:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.695+0000 7f8a66c00640 1 Processor -- start 2024-08-19T00:44:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.695+0000 7f8a66c00640 1 -- start start 2024-08-19T00:44:18.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a66c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a600b4380 0x7f8a600aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:18.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a66c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a601592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:18.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a66c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a6015f5b0 0x7f8a601470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a66c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6006ea30 con 0x7f8a600b4380 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a66c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6006e8b0 con 0x7f8a600d03c0 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a66c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6006ebb0 con 0x7f8a6015f5b0 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a600b4380 0x7f8a600aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a600b4380 0x7f8a600aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33094/0 (socket says 172.21.15.7:33094) 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.696+0000 7f8a5fe00640 1 -- 172.21.15.7:0/4193217929 learned_addr learned my addr 172.21.15.7:0/4193217929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a57e00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a601592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a64c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a6015f5b0 0x7f8a601470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5fe00640 1 -- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a6015f5b0 msgr2=0x7f8a601470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5fe00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a6015f5b0 0x7f8a601470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5fe00640 1 -- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 msgr2=0x7f8a601592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5fe00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a601592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5fe00640 1 -- 172.21.15.7:0/4193217929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6015c290 con 0x7f8a600b4380 2024-08-19T00:44:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a64c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a6015f5b0 0x7f8a601470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a57e00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a601592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:18.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5fe00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a600b4380 0x7f8a600aef60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c700 tx=0x7f8a5000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5cc00640 1 -- 172.21.15.7:0/4193217929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50005ad0 con 0x7f8a600b4380 2024-08-19T00:44:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a5cc00640 1 -- 172.21.15.7:0/4193217929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a50005c70 con 0x7f8a600b4380 2024-08-19T00:44:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.697+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6015b1f0 con 0x7f8a600b4380 2024-08-19T00:44:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.698+0000 7f8a5cc00640 1 -- 172.21.15.7:0/4193217929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50007290 con 0x7f8a600b4380 2024-08-19T00:44:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.698+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6015b7b0 con 0x7f8a600b4380 2024-08-19T00:44:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.699+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6006efa0 con 0x7f8a600b4380 2024-08-19T00:44:18.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.700+0000 7f8a5cc00640 1 -- 172.21.15.7:0/4193217929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a50007430 con 0x7f8a600b4380 2024-08-19T00:44:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.700+0000 7f8a5cc00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.701+0000 7f8a5cc00640 1 -- 172.21.15.7:0/4193217929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f8a5008af00 con 0x7f8a600b4380 2024-08-19T00:44:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.701+0000 7f8a57e00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:18.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.701+0000 7f8a57e00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8a48034000 tx=0x7f8a4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.705+0000 7f8a5cc00640 1 -- 172.21.15.7:0/4193217929 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8a50010300 con 0x7f8a600b4380 2024-08-19T00:44:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.924+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a6015eec0 con 0x7f8a600b4380 2024-08-19T00:44:18.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.925+0000 7f8a5cc00640 1 -- 172.21.15.7:0/4193217929 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+4401 (secure 0 0 0) 0x7f8a6015eec0 con 0x7f8a600b4380 2024-08-19T00:44:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:18.927 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":121,"btime":"2024-08-19T00:44:18:105901+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:18.105881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7740":{"gid":7740,"name":"c","rank":0,"incarnation":121,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/3784682490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3784682490},{"type":"v1","addr":"172.21.15.7:6836","nonce":3784682490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:18.927 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 121 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a3c06be30 msgr2=0x7f8a3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8a48034000 tx=0x7f8a4802e000 comp rx=0 tx=0).stop 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a600b4380 msgr2=0x7f8a600aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a600b4380 0x7f8a600aef60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c700 tx=0x7f8a5000cbc0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 shutdown_connections 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a6015f5b0 0x7f8a601470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a600d03c0 0x7f8a601592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 --2- 172.21.15.7:0/4193217929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a600b4380 0x7f8a600aef60 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 >> 172.21.15.7:0/4193217929 conn(0x7f8a6006bc70 msgr2=0x7f8a60074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:18.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 shutdown_connections 2024-08-19T00:44:18.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:18.927+0000 7f8a66c00640 1 -- 172.21.15.7:0/4193217929 wait complete. 2024-08-19T00:44:18.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 121, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:44:18.105881+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7740}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7740': {'gid': 7740, 'name': 'c', 'rank': 0, 'incarnation': 121, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6836/3784682490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3784682490}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3784682490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:44:18.945 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7740:up:replay 2024-08-19T00:44:18.945 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:44:18.995 INFO:tasks.ceph.mds.a.smithi007.stderr: -38> 2024-08-19T00:44:14.241+0000 7ff8a8600640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-08-19T00:44:19.034 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:44:24.349 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.516+0000 7fcdb0a00640 1 Processor -- start 2024-08-19T00:44:24.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.516+0000 7fcdb0a00640 1 -- start start 2024-08-19T00:44:24.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.517+0000 7fcdb0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.517+0000 7fcdb0a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcdac15ee50 0x7fcdac0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.517+0000 7fcdb0a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdac0b3ab0 con 0x7fcdac0d2af0 2024-08-19T00:44:24.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.517+0000 7fcdb0a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcdac0d3490 con 0x7fcdac15ee50 2024-08-19T00:44:24.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.517+0000 7fcdb0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcdac15f460 con 0x7fcdac15e360 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.517+0000 7fcdabe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcdac15ee50 0x7fcdac0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdabe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcdac15ee50 0x7fcdac0d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39952/0 (socket says 172.21.15.7:39952) 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdabe00640 1 -- 172.21.15.7:0/667668594 learned_addr learned my addr 172.21.15.7:0/667668594 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdab400640 1 --2- 172.21.15.7:0/667668594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdabe00640 1 -- 172.21.15.7:0/667668594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 msgr2=0x7fcdac15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdabe00640 1 --2- 172.21.15.7:0/667668594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdabe00640 1 -- 172.21.15.7:0/667668594 >> v1:172.21.15.162:6789/0 conn(0x7fcdac0d2af0 legacy=0x7fcdac15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdabe00640 1 -- 172.21.15.7:0/667668594 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac15f740 con 0x7fcdac15ee50 2024-08-19T00:44:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.518+0000 7fcdaa000640 1 -- 172.21.15.7:0/667668594 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550087048 0 0) 0x7fcdac0b3ab0 con 0x7fcdac0d2af0 2024-08-19T00:44:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.519+0000 7fcdabe00640 1 --2- 172.21.15.7:0/667668594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac15ee50 0x7fcdac0d2f50 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009e50 tx=0x7fcda402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aded3af0abc7d45 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.519+0000 7fcdaa000640 1 -- 172.21.15.7:0/667668594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4036070 con 0x7fcdac15ee50 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.519+0000 7fcdaa000640 1 -- 172.21.15.7:0/667668594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda4031600 con 0x7fcdac15ee50 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.519+0000 7fcdaa000640 1 -- 172.21.15.7:0/667668594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda40319d0 con 0x7fcdac15ee50 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 -- 172.21.15.7:0/667668594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac15ee50 msgr2=0x7fcdac0d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/667668594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac15ee50 0x7fcdac0d2f50 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009e50 tx=0x7fcda402a710 comp rx=0 tx=0).stop 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 -- 172.21.15.7:0/667668594 shutdown_connections 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/667668594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac15ee50 0x7fcdac0d2f50 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/667668594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 -- 172.21.15.7:0/667668594 >> 172.21.15.7:0/667668594 conn(0x7fcdac08dbf0 msgr2=0x7fcdac09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 -- 172.21.15.7:0/667668594 shutdown_connections 2024-08-19T00:44:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.520+0000 7fcdb0a00640 1 -- 172.21.15.7:0/667668594 wait complete. 2024-08-19T00:44:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.522+0000 7fcdb0a00640 1 Processor -- start 2024-08-19T00:44:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.522+0000 7fcdb0a00640 1 -- start start 2024-08-19T00:44:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdb0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac0d2af0 0x7fcdac15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdb0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac0b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdb0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdac15ee50 0x7fcdac06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdb0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac0d2300 con 0x7fcdac0d2af0 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdb0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac0b4040 con 0x7fcdac15ee50 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdb0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcdac0b4560 con 0x7fcdac15e360 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac0d2af0 0x7fcdac15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac0d2af0 0x7fcdac15c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39966/0 (socket says 172.21.15.7:39966) 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 -- 172.21.15.7:0/619392119 learned_addr learned my addr 172.21.15.7:0/619392119 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdabe00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdac15ee50 0x7fcdac06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdaaa00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac0b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 -- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 msgr2=0x7fcdac0b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac0b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 -- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdac15ee50 msgr2=0x7fcdac06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdac15ee50 0x7fcdac06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdab400640 1 -- 172.21.15.7:0/619392119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac0b8760 con 0x7fcdac0d2af0 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.523+0000 7fcdabe00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdac15ee50 0x7fcdac06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.524+0000 7fcdab400640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac0d2af0 0x7fcdac15c7e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00e9b0 tx=0x7fcd9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.524+0000 7fcda3400640 1 -- 172.21.15.7:0/619392119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c017070 con 0x7fcdac0d2af0 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.524+0000 7fcda3400640 1 -- 172.21.15.7:0/619392119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9c00c9a0 con 0x7fcdac0d2af0 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.524+0000 7fcda3400640 1 -- 172.21.15.7:0/619392119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c00cd90 con 0x7fcdac0d2af0 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.524+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdac0b8a40 con 0x7fcdac0d2af0 2024-08-19T00:44:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.524+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdac0b9000 con 0x7fcdac0d2af0 2024-08-19T00:44:24.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.525+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdac0d2f50 con 0x7fcdac0d2af0 2024-08-19T00:44:24.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.526+0000 7fcda3400640 1 -- 172.21.15.7:0/619392119 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd9c01a070 con 0x7fcdac0d2af0 2024-08-19T00:44:24.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.527+0000 7fcda3400640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd8c06be30 0x7fcd8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.527+0000 7fcda3400640 1 -- 172.21.15.7:0/619392119 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7fcd9c08b400 con 0x7fcdac0d2af0 2024-08-19T00:44:24.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.527+0000 7fcdaaa00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd8c06be30 0x7fcd8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.528+0000 7fcdaaa00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd8c06be30 0x7fcd8c06e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0d1640 tx=0x7fcd98009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.532+0000 7fcda3400640 1 -- 172.21.15.7:0/619392119 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcd9c059b90 con 0x7fcdac0d2af0 2024-08-19T00:44:24.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.754+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdac0d50d0 con 0x7fcdac0d2af0 2024-08-19T00:44:24.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.755+0000 7fcda3400640 1 -- 172.21.15.7:0/619392119 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+5228 (secure 0 0 0) 0x7fcd9c059490 con 0x7fcdac0d2af0 2024-08-19T00:44:24.757 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:24.757 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":124,"btime":"2024-08-19T00:44:21:111869+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/877185885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":877185885},{"type":"v1","addr":"172.21.15.7:6837","nonce":877185885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:21.111864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7740":{"gid":7740,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/3784682490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3784682490},{"type":"v1","addr":"172.21.15.7:6836","nonce":3784682490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7740,"qdb_cluster":[7740]},"id":6}]} 2024-08-19T00:44:24.757 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 124 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd8c06be30 msgr2=0x7fcd8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd8c06be30 0x7fcd8c06e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0d1640 tx=0x7fcd98009040 comp rx=0 tx=0).stop 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac0d2af0 msgr2=0x7fcdac15c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac0d2af0 0x7fcdac15c7e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00e9b0 tx=0x7fcd9c00ee70 comp rx=0 tx=0).stop 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 shutdown_connections 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd8c06be30 0x7fcd8c06e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdac15ee50 0x7fcdac06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdac15e360 0x7fcdac0b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 --2- 172.21.15.7:0/619392119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdac0d2af0 0x7fcdac15c7e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 >> 172.21.15.7:0/619392119 conn(0x7fcdac08dbf0 msgr2=0x7fcdac074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 shutdown_connections 2024-08-19T00:44:24.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.757+0000 7fcdb0a00640 1 -- 172.21.15.7:0/619392119 wait complete. 2024-08-19T00:44:24.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 124, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:44:21.111864+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7740}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7740': {'gid': 7740, 'name': 'c', 'rank': 0, 'incarnation': 121, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/3784682490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3784682490}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3784682490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7740, 'qdb_cluster': [7740]} 2024-08-19T00:44:24.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:44:24.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:44:24.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.932+0000 7f938f200640 1 Processor -- start 2024-08-19T00:44:24.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.932+0000 7f938f200640 1 -- start start 2024-08-19T00:44:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.933+0000 7f938f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f938815e3e0 0x7f93880b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.933+0000 7f938f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93880d27b0 0x7f93880d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.933+0000 7f938f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f93880b4150 0x7f93880b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.933+0000 7f938f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f93880d3110 con 0x7f93880d27b0 2024-08-19T00:44:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.933+0000 7f938f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f93880b4b20 con 0x7f93880b4150 2024-08-19T00:44:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.933+0000 7f938f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f93880b4df0 con 0x7f938815e3e0 2024-08-19T00:44:24.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.933+0000 7f938d400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93880d27b0 0x7f93880d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938d400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93880d27b0 0x7f93880d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39968/0 (socket says 172.21.15.7:39968) 2024-08-19T00:44:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938d400640 1 -- 172.21.15.7:0/746222144 learned_addr learned my addr 172.21.15.7:0/746222144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938de00640 1 --2- 172.21.15.7:0/746222144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f938815e3e0 0x7f93880b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938e800640 1 --2- 172.21.15.7:0/746222144 >> v2:172.21.15.162:3300/0 conn(0x7f93880b4150 0x7f93880b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938d400640 1 -- 172.21.15.7:0/746222144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f938815e3e0 msgr2=0x7f93880b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938d400640 1 --2- 172.21.15.7:0/746222144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f938815e3e0 0x7f93880b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938d400640 1 -- 172.21.15.7:0/746222144 >> v2:172.21.15.162:3300/0 conn(0x7f93880b4150 msgr2=0x7f93880b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938d400640 1 --2- 172.21.15.7:0/746222144 >> v2:172.21.15.162:3300/0 conn(0x7f93880b4150 0x7f93880b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.934+0000 7f938d400640 1 -- 172.21.15.7:0/746222144 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93880b50d0 con 0x7f93880d27b0 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.935+0000 7f938d400640 1 --2- 172.21.15.7:0/746222144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880d27b0 0x7f93880d2bd0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9388161d70 tx=0x7f937802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395c1742b488cdc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.935+0000 7f938ca00640 1 -- 172.21.15.7:0/746222144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378037070 con 0x7f93880d27b0 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.935+0000 7f938ca00640 1 -- 172.21.15.7:0/746222144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378032440 con 0x7f93880d27b0 2024-08-19T00:44:24.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.935+0000 7f938ca00640 1 -- 172.21.15.7:0/746222144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378032810 con 0x7f93880d27b0 2024-08-19T00:44:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 -- 172.21.15.7:0/746222144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880d27b0 msgr2=0x7f93880d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 --2- 172.21.15.7:0/746222144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880d27b0 0x7f93880d2bd0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9388161d70 tx=0x7f937802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 -- 172.21.15.7:0/746222144 shutdown_connections 2024-08-19T00:44:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 --2- 172.21.15.7:0/746222144 >> v2:172.21.15.162:3300/0 conn(0x7f93880b4150 0x7f93880b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 --2- 172.21.15.7:0/746222144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880d27b0 0x7f93880d2bd0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 --2- 172.21.15.7:0/746222144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f938815e3e0 0x7f93880b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 -- 172.21.15.7:0/746222144 >> 172.21.15.7:0/746222144 conn(0x7f938808dbe0 msgr2=0x7f938809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 -- 172.21.15.7:0/746222144 shutdown_connections 2024-08-19T00:44:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.936+0000 7f938f200640 1 -- 172.21.15.7:0/746222144 wait complete. 2024-08-19T00:44:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.938+0000 7f938f200640 1 Processor -- start 2024-08-19T00:44:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.938+0000 7f938f200640 1 -- start start 2024-08-19T00:44:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880b4150 0x7f93880b9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93880d27b0 0x7f9388156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f938815e3e0 0x7f93881572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f93880cee90 con 0x7f93880b4150 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93880cf4c0 con 0x7f938815e3e0 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f93880b13a0 con 0x7f93880d27b0 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880b4150 0x7f93880b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880b4150 0x7f93880b9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39980/0 (socket says 172.21.15.7:39980) 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938de00640 1 -- 172.21.15.7:0/2222597981 learned_addr learned my addr 172.21.15.7:0/2222597981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938e800640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f938815e3e0 0x7f93881572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938d400640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93880d27b0 0x7f9388156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938de00640 1 -- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93880d27b0 msgr2=0x7f9388156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.939+0000 7f938de00640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93880d27b0 0x7f9388156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f938de00640 1 -- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f938815e3e0 msgr2=0x7f93881572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f938de00640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f938815e3e0 0x7f93881572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f938de00640 1 -- 172.21.15.7:0/2222597981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93880b7830 con 0x7f93880b4150 2024-08-19T00:44:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f938de00640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880b4150 0x7f93880b9890 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f937c00e870 tx=0x7f937c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f9382000640 1 -- 172.21.15.7:0/2222597981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c017070 con 0x7f93880b4150 2024-08-19T00:44:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f9382000640 1 -- 172.21.15.7:0/2222597981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c00c8e0 con 0x7f93880b4150 2024-08-19T00:44:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938815b4a0 con 0x7f93880b4150 2024-08-19T00:44:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f9382000640 1 -- 172.21.15.7:0/2222597981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c00ccd0 con 0x7f93880b4150 2024-08-19T00:44:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.940+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93880b73a0 con 0x7f93880b4150 2024-08-19T00:44:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.942+0000 7f9382000640 1 -- 172.21.15.7:0/2222597981 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f937c01a070 con 0x7f93880b4150 2024-08-19T00:44:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.943+0000 7f9382000640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f936c06be60 0x7f936c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.943+0000 7f9382000640 1 -- 172.21.15.7:0/2222597981 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f937c08aeb0 con 0x7f93880b4150 2024-08-19T00:44:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.943+0000 7f938d400640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f936c06be60 0x7f936c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.944+0000 7f939387b740 1 Processor -- start 2024-08-19T00:44:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.944+0000 7f939387b740 1 -- start start 2024-08-19T00:44:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.944+0000 7f938d400640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f936c06be60 0x7f936c06e320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9378034000 tx=0x7f937802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f939387b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65630 0x5628a2b65a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65f90 0x5628a2b5afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f939387b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5628a2a7aba0 con 0x5628a2b65630 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5628a2a13230 con 0x5628a2b42110 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5628a2a76b60 con 0x5628a2b65f90 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65630 0x5628a2b65a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65630 0x5628a2b65a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39984/0 (socket says 172.21.15.7:39984) 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 -- 172.21.15.7:0/2291382917 learned_addr learned my addr 172.21.15.7:0/2291382917 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938e800640 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65f90 0x5628a2b5afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938de00640 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 -- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65f90 msgr2=0x5628a2b5afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65f90 0x5628a2b5afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 -- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 msgr2=0x5628a2b424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.945+0000 7f938d400640 1 -- 172.21.15.7:0/2291382917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628a2a44bb0 con 0x5628a2b65630 2024-08-19T00:44:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.946+0000 7f938d400640 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65630 0x5628a2b65a50 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f937802a7d0 tx=0x7f937802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b404b764735de8c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.946+0000 7f9376600640 1 -- 172.21.15.7:0/2291382917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937804e070 con 0x5628a2b65630 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.946+0000 7f9376600640 1 -- 172.21.15.7:0/2291382917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378032b50 con 0x5628a2b65630 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.946+0000 7f9376600640 1 -- 172.21.15.7:0/2291382917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378037040 con 0x5628a2b65630 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 -- 172.21.15.7:0/2291382917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65630 msgr2=0x5628a2b65a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65630 0x5628a2b65a50 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f937802a7d0 tx=0x7f937802c000 comp rx=0 tx=0).stop 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 -- 172.21.15.7:0/2291382917 shutdown_connections 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65f90 0x5628a2b5afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65630 0x5628a2b65a50 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 --2- 172.21.15.7:0/2291382917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 -- 172.21.15.7:0/2291382917 >> 172.21.15.7:0/2291382917 conn(0x5628a2adf110 msgr2=0x5628a2b5cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 -- 172.21.15.7:0/2291382917 shutdown_connections 2024-08-19T00:44:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 -- 172.21.15.7:0/2291382917 wait complete. 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.947+0000 7f939387b740 1 -- start start 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.948+0000 7f939387b740 1 Processor -- start 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b39cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f939387b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b3da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f939387b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5628a2b5f060 con 0x5628a2b65f90 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5628a2a36250 con 0x5628a2b42110 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5628a2b5e770 con 0x5628a2b65630 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f939387b740 10 client.0 _ll_register_callbacks cb 0x5628a2a3a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b3da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b3da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39990/0 (socket says 172.21.15.7:39990) 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 -- 172.21.15.7:0/3684924880 learned_addr learned my addr 172.21.15.7:0/3684924880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938de00640 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938d400640 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b39cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 -- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 msgr2=0x5628a2b39cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b39cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 -- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 msgr2=0x5628a2b306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.949+0000 7f938e800640 1 -- 172.21.15.7:0/3684924880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628a278e2d0 con 0x5628a2b65f90 2024-08-19T00:44:24.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f938e800640 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b3da30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f9384007d30 tx=0x7f9384012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8763cd6234f4dabf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f936aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f936aa00640 1 -- 172.21.15.7:0/3684924880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938401c020 con 0x5628a2b65f90 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f936aa00640 1 -- 172.21.15.7:0/3684924880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f9384018670 con 0x5628a2b65f90 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9378032b50 con 0x5628a2b65f90 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f936aa00640 1 -- 172.21.15.7:0/3684924880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f9384026050 con 0x5628a2b65f90 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f939387b740 10 client.7821 fetch_fsmap learned FSMap version 124 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.950+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=124,monmap=2+}) -- 0x5628a28586b0 con 0x5628a2b65f90 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f936aa00640 1 -- 172.21.15.7:0/3684924880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378032b50 con 0x5628a2b65f90 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f936aa00640 1 -- 172.21.15.7:0/3684924880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 124) ==== 3502+0+0 (secure 0 0 0) 0x7f9384029020 con 0x5628a2b65f90 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f939387b740 10 client.7821 fetch_fsmap finished waiting for FSMap version 124 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f939387b740 10 client.7821 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f939387b740 20 client.7821 populate_metadata read hostname 'smithi007' 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f939387b740 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b370c0 0x5628a2b125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f939387b740 4 client.7821 mds_command: new command op to 7740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 --> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628a2a882d0 con 0x5628a2b370c0 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.951+0000 7f938de00640 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b370c0 0x5628a2b125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.952+0000 7f938de00640 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b370c0 0x5628a2b125d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d4c4be7e3223bc server_cookie=122582c870c4bbb9 in_seq=0 out_seq=0 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.952+0000 7f936aa00640 10 client.7821 ms_handle_connect on v2:172.21.15.7:6834/3784682490 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.952+0000 7f936aa00640 1 -- 172.21.15.7:0/3684924880 <== mds.0 v2:172.21.15.7:6834/3784682490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628a2a882d0 con 0x5628a2b370c0 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.952+0000 7f936aa00640 10 client.7821 handle_command_reply: tid=0 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.952+0000 7f939387b740 1 client.7821 shutdown 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 msgr2=0x5628a2b3da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b3da30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f9384007d30 tx=0x7f9384012610 comp rx=0 tx=0).stop 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 shutdown_connections 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b370c0 0x5628a2b125d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b3da30 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b39cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 --2- 172.21.15.7:0/3684924880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b306b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f936aa00640 0 client.7821 ms_handle_reset on v2:172.21.15.7:6834/3784682490 2024-08-19T00:44:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 >> 172.21.15.7:0/3684924880 conn(0x5628a2adf110 msgr2=0x5628a2b603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 shutdown_connections 2024-08-19T00:44:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 1 -- 172.21.15.7:0/3684924880 wait complete. 2024-08-19T00:44:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.953+0000 7f939387b740 20 client.7821 trim_cache size 0 max 16384 2024-08-19T00:44:24.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.972+0000 7f939387b740 1 Processor -- start 2024-08-19T00:44:24.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.972+0000 7f939387b740 1 -- start start 2024-08-19T00:44:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b36a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f939387b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f939387b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9388200b80 con 0x5628a2b65f90 2024-08-19T00:44:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93881ffb80 con 0x5628a2b42110 2024-08-19T00:44:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f93881feee0 con 0x5628a2b65630 2024-08-19T00:44:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39992/0 (socket says 172.21.15.7:39992) 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938e800640 1 -- 172.21.15.7:0/1895829319 learned_addr learned my addr 172.21.15.7:0/1895829319 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938d400640 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938de00640 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b36a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938e800640 1 -- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 msgr2=0x5628a2b52ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938e800640 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938e800640 1 -- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 msgr2=0x5628a2b36a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.973+0000 7f938e800640 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b36a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.974+0000 7f938e800640 1 -- 172.21.15.7:0/1895829319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628a2b11c50 con 0x5628a2b65f90 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.974+0000 7f938de00640 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b36a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:24.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.974+0000 7f938e800640 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f9384000f80 tx=0x7f9384018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae6fb4ad95f654c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.974+0000 7f9375c00640 1 -- 172.21.15.7:0/1895829319 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938401c020 con 0x5628a2b65f90 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.974+0000 7f9375c00640 1 -- 172.21.15.7:0/1895829319 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9384018be0 con 0x5628a2b65f90 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.974+0000 7f9375c00640 1 -- 172.21.15.7:0/1895829319 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384016420 con 0x5628a2b65f90 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 -- 172.21.15.7:0/1895829319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 msgr2=0x5628a2b53010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f9384000f80 tx=0x7f9384018000 comp rx=0 tx=0).stop 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 -- 172.21.15.7:0/1895829319 shutdown_connections 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 --2- 172.21.15.7:0/1895829319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2b36a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 -- 172.21.15.7:0/1895829319 >> 172.21.15.7:0/1895829319 conn(0x5628a2adf110 msgr2=0x5628a2b0e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 -- 172.21.15.7:0/1895829319 shutdown_connections 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 -- 172.21.15.7:0/1895829319 wait complete. 2024-08-19T00:44:24.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.975+0000 7f939387b740 1 -- start start 2024-08-19T00:44:24.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.976+0000 7f939387b740 1 Processor -- start 2024-08-19T00:44:24.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.976+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2bde670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.976+0000 7f939387b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.976+0000 7f939387b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.976+0000 7f939387b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5628a2b13650 con 0x5628a2b65f90 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.976+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93881ff530 con 0x5628a2b42110 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.976+0000 7f939387b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5628a2b37bb0 con 0x5628a2b65630 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f939387b740 10 client.0 _ll_register_callbacks cb 0x7f9384009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40006/0 (socket says 172.21.15.7:40006) 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 -- 172.21.15.7:0/341994154 learned_addr learned my addr 172.21.15.7:0/341994154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938de00640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2bde670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938d400640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 -- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 msgr2=0x5628a2b52ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 -- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 msgr2=0x5628a2bde670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2bde670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 -- 172.21.15.7:0/341994154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628a2b3c2b0 con 0x5628a2b65f90 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938d400640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f938e800640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f938402c040 tx=0x7f9384015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c3db15adbcb116 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.977+0000 7f936aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f936aa00640 1 -- 172.21.15.7:0/341994154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938401c040 con 0x5628a2b65f90 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f936aa00640 1 -- 172.21.15.7:0/341994154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f9384016830 con 0x5628a2b65f90 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9384018be0 con 0x5628a2b65f90 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f936aa00640 1 -- 172.21.15.7:0/341994154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f938403f050 con 0x5628a2b65f90 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 10 client.7827 fetch_fsmap learned FSMap version 124 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=124,monmap=2+}) -- 0x5628a2b5e5e0 con 0x5628a2b65f90 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f936aa00640 1 -- 172.21.15.7:0/341994154 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9384018be0 con 0x5628a2b65f90 2024-08-19T00:44:24.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f936aa00640 1 -- 172.21.15.7:0/341994154 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 124) ==== 3502+0+0 (secure 0 0 0) 0x7f9384042020 con 0x5628a2b65f90 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 10 client.7827 fetch_fsmap finished waiting for FSMap version 124 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 10 client.7827 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 20 client.7827 populate_metadata read hostname 'smithi007' 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b33370 0x5628a2b59560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 4 client.7827 mds_command: new command op to 7740 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.978+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 --> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] -- command(tid 0: {"prefix": "status"}) -- 0x5628a2a82620 con 0x5628a2b33370 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.979+0000 7f938de00640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b33370 0x5628a2b59560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.979+0000 7f938de00640 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b33370 0x5628a2b59560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=971c11c28b361044 server_cookie=3dae12eb6800bd24 in_seq=0 out_seq=0 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.979+0000 7f936aa00640 10 client.7827 ms_handle_connect on v2:172.21.15.7:6834/3784682490 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.979+0000 7f936aa00640 1 -- 172.21.15.7:0/341994154 <== mds.0 v2:172.21.15.7:6834/3784682490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5628a2a82620 con 0x5628a2b33370 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.979+0000 7f936aa00640 10 client.7827 handle_command_reply: tid=0 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.979+0000 7f939387b740 1 client.7827 shutdown 2024-08-19T00:44:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.979+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 msgr2=0x5628a2b53010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f938402c040 tx=0x7f9384015000 comp rx=0 tx=0).stop 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 shutdown_connections 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:6834/3784682490,v1:172.21.15.7:6836/3784682490] conn(0x5628a2b33370 0x5628a2b59560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628a2b65f90 0x5628a2b53010 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5628a2b65630 0x5628a2b52ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 --2- 172.21.15.7:0/341994154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5628a2b42110 0x5628a2bde670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f936aa00640 0 client.7827 ms_handle_reset on v2:172.21.15.7:6834/3784682490 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 >> 172.21.15.7:0/341994154 conn(0x5628a2adf110 msgr2=0x5628a2b13930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 shutdown_connections 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 1 -- 172.21.15.7:0/341994154 wait complete. 2024-08-19T00:44:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f939387b740 20 client.7827 trim_cache size 0 max 16384 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7740, 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8722250980000004, 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 124, 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 92, 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 92, 2024-08-19T00:44:24.987 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 9.977456063 2024-08-19T00:44:24.988 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:44:24.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f936c06be60 msgr2=0x7f936c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f938f200640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f936c06be60 0x7f936c06e320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9378034000 tx=0x7f937802e000 comp rx=0 tx=0).stop 2024-08-19T00:44:24.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880b4150 msgr2=0x7f93880b9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.980+0000 7f938f200640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880b4150 0x7f93880b9890 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f937c00e870 tx=0x7f937c00ed30 comp rx=0 tx=0).stop 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 shutdown_connections 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f936c06be60 0x7f936c06e320 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f938815e3e0 0x7f93881572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93880d27b0 0x7f9388156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 --2- 172.21.15.7:0/2222597981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93880b4150 0x7f93880b9890 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 >> 172.21.15.7:0/2222597981 conn(0x7f938808dbe0 msgr2=0x7f93880b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 shutdown_connections 2024-08-19T00:44:24.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:24.981+0000 7f938f200640 1 -- 172.21.15.7:0/2222597981 wait complete. 2024-08-19T00:44:24.997 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:44:24.997 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete mds0_openfiles.0', proceeding to ls 2024-08-19T00:44:24.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:44:25.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.153+0000 7f08fd800640 1 Processor -- start 2024-08-19T00:44:25.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.153+0000 7f08fd800640 1 -- start start 2024-08-19T00:44:25.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08fd800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f08f806e710 0x7f08f8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08fd800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 0x7f08f80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08fd800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f80cdfb0 con 0x7f08f80d03c0 2024-08-19T00:44:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08fd800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f08f80cebc0 con 0x7f08f806e710 2024-08-19T00:44:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08fd800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08f80ce290 con 0x7f08f80b3750 2024-08-19T00:44:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08f6a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f08f80d03c0 0x7f08f80d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39408/0 (socket says 172.21.15.7:39408) 2024-08-19T00:44:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08f6a00640 1 -- 172.21.15.7:0/2922881193 learned_addr learned my addr 172.21.15.7:0/2922881193 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754427787 0 0) 0x7f08f80cdfb0 con 0x7f08f80d03c0 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08f6000640 1 --2- 172.21.15.7:0/2922881193 >> v2:172.21.15.162:3300/0 conn(0x7f08f806e710 0x7f08f8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08dc005730 con 0x7f08f80d03c0 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.155+0000 7f08f7400640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 0x7f08f80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 183769921 0 0) 0x7f08dc005730 con 0x7f08f80d03c0 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 msgr2=0x7f08f80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 0x7f08f80cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 >> v2:172.21.15.162:3300/0 conn(0x7f08f806e710 msgr2=0x7f08f8071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 --2- 172.21.15.7:0/2922881193 >> v2:172.21.15.162:3300/0 conn(0x7f08f806e710 0x7f08f8071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f80ce570 con 0x7f08f80d03c0 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f08e8001670 con 0x7f08f80d03c0 2024-08-19T00:44:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 >> v1:172.21.15.7:6789/0 conn(0x7f08f80d03c0 legacy=0x7f08f80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 0x7f08dc005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08dc006100 0x7f08dc006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006580 0x7f08dc006f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80cebc0 con 0x7f08dc006580 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80ce290 con 0x7f08dc006100 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08dc007810 con 0x7f08f80b3750 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f7400640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006580 0x7f08dc006f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f6000640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08dc006100 0x7f08dc006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.156+0000 7f08f6a00640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 0x7f08dc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.157+0000 7f08f6000640 1 -- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 msgr2=0x7f08dc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.157+0000 7f08f6000640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f80b3750 0x7f08dc005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.157+0000 7f08f6000640 1 -- 172.21.15.7:0/2922881193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006580 msgr2=0x7f08dc006f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.157+0000 7f08f6000640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006580 0x7f08dc006f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.157+0000 7f08f6000640 1 -- 172.21.15.7:0/2922881193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc005730 con 0x7f08dc006100 2024-08-19T00:44:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.157+0000 7f08f7400640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006580 0x7f08dc006f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.158+0000 7f08f6000640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08dc006100 0x7f08dc006a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009af0 tx=0x7f08dc007a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=520cc5bc40e2bdc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.158+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4036070 con 0x7f08dc006100 2024-08-19T00:44:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.158+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e4031400 con 0x7f08dc006100 2024-08-19T00:44:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.158+0000 7f08f5600640 1 -- 172.21.15.7:0/2922881193 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4009690 con 0x7f08dc006100 2024-08-19T00:44:25.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.158+0000 7f08fd800640 1 -- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08dc006100 msgr2=0x7f08dc006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.158+0000 7f08fd800640 1 --2- 172.21.15.7:0/2922881193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08dc006100 0x7f08dc006a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009af0 tx=0x7f08dc007a40 comp rx=0 tx=0).stop 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.158+0000 7f08f7400640 1 -- 172.21.15.7:0/2922881193 reap_dead start 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.159+0000 7f08fd800640 1 -- 172.21.15.7:0/2922881193 shutdown_connections 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.159+0000 7f08fd800640 1 -- 172.21.15.7:0/2922881193 >> 172.21.15.7:0/2922881193 conn(0x7f08f806bc70 msgr2=0x7f08f806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.159+0000 7f08fd800640 1 -- 172.21.15.7:0/2922881193 shutdown_connections 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.159+0000 7f08fd800640 1 -- 172.21.15.7:0/2922881193 wait complete. 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.160+0000 7f08fd800640 1 Processor -- start 2024-08-19T00:44:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.160+0000 7f08fd800640 1 -- start start 2024-08-19T00:44:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.161+0000 7f08fd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006100 0x7f08f81596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.161+0000 7f08fd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f809cd30 0x7f08f8158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.161+0000 7f08fd800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f81e5ad0 0x7f08f81e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.161+0000 7f08fd800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8073c60 con 0x7f08dc006100 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.161+0000 7f08fd800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8073ae0 con 0x7f08f809cd30 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.161+0000 7f08fd800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08f80b3be0 con 0x7f08f81e5ad0 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006100 0x7f08f81596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006100 0x7f08f81596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40030/0 (socket says 172.21.15.7:40030) 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 -- 172.21.15.7:0/4286578340 learned_addr learned my addr 172.21.15.7:0/4286578340 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 -- 172.21.15.7:0/4286578340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f81e5ad0 msgr2=0x7f08f81e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f81e5ad0 0x7f08f81e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 -- 172.21.15.7:0/4286578340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f809cd30 msgr2=0x7f08f8158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6000640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f809cd30 0x7f08f8158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f809cd30 0x7f08f8158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 -- 172.21.15.7:0/4286578340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f809d3a0 con 0x7f08dc006100 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.162+0000 7f08f6a00640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006100 0x7f08f81596c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f08e8007290 tx=0x7f08e8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.163+0000 7f08eea00640 1 -- 172.21.15.7:0/4286578340 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e800f8e0 con 0x7f08dc006100 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.163+0000 7f08eea00640 1 -- 172.21.15.7:0/4286578340 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e8018070 con 0x7f08dc006100 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.163+0000 7f08eea00640 1 -- 172.21.15.7:0/4286578340 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e800fca0 con 0x7f08dc006100 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.163+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f809d680 con 0x7f08dc006100 2024-08-19T00:44:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.163+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f809dc40 con 0x7f08dc006100 2024-08-19T00:44:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.164+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f80cdfb0 con 0x7f08dc006100 2024-08-19T00:44:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.165+0000 7f08eea00640 1 -- 172.21.15.7:0/4286578340 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08e801d460 con 0x7f08dc006100 2024-08-19T00:44:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.166+0000 7f08eea00640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08d806be30 0x7f08d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.166+0000 7f08eea00640 1 -- 172.21.15.7:0/4286578340 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f08e808b2a0 con 0x7f08dc006100 2024-08-19T00:44:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.166+0000 7f08f6000640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08d806be30 0x7f08d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.166+0000 7f08f6000640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08d806be30 0x7f08d806e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f08e4033000 tx=0x7f08e4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:25.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.170+0000 7f08eea00640 1 -- 172.21.15.7:0/4286578340 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f08e8059350 con 0x7f08dc006100 2024-08-19T00:44:25.255 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:25.254+0000 7f955f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:25.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.397+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f08f806e4f0 con 0x7f08dc006100 2024-08-19T00:44:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.397+0000 7f08eea00640 1 -- 172.21.15.7:0/4286578340 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v124) ==== 53+0+73 (secure 0 0 0) 0x7f08e805d650 con 0x7f08dc006100 2024-08-19T00:44:25.399 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:44:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08d806be30 msgr2=0x7f08d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08d806be30 0x7f08d806e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f08e4033000 tx=0x7f08e4008030 comp rx=0 tx=0).stop 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006100 msgr2=0x7f08f81596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006100 0x7f08f81596c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f08e8007290 tx=0x7f08e8007750 comp rx=0 tx=0).stop 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 shutdown_connections 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08d806be30 0x7f08d806e2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08f81e5ad0 0x7f08f81e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f809cd30 0x7f08f8158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 --2- 172.21.15.7:0/4286578340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08dc006100 0x7f08f81596c0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 >> 172.21.15.7:0/4286578340 conn(0x7f08f806bc70 msgr2=0x7f08f80aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 shutdown_connections 2024-08-19T00:44:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25.400+0000 7f08fd800640 1 -- 172.21.15.7:0/4286578340 wait complete. 2024-08-19T00:44:25.417 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:44:25.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:44:25.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:44:25.418 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:44:25.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:25.418 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:44:25.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:44:25.418 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:44:25.418 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:44:25.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:25.418 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:44:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42396sec preferred_lft 42396sec 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:44:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:44:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:44:25.457 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:25.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:25.457 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:44:25.548 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:44:25.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:25.551 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:44:25.587 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:44:25.587 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:44:25.587 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:44:25.587 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:44:25.587 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:44:25.587 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:44:25.588 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:44:25.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:44:25.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:44:25.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:44:25.588 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:44:25.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:44:25.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:44:25.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:25.787 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:44:25.822 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:44:25.822 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:44:25.823 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:44:25.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:25.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:44:25.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:44:25.919 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:25.953 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:44:25.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:44:25.954 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:26.029 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:44:26.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:26.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:26.159 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:26.160 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:44:26.160 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:44:26.175 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:26.175 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:44:26.175 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:44:26.175 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:44:26.175 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:44:26.198 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:26.198 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:44:26.198 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:44:26.199 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:44:26.199 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:44:26.199 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:44:26.199 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:44:26.199 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:44:26.200 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:44:26.200 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:44:26.200 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:44:26.200 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:44:26.200 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:44:26.203 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:44:26.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:26.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:26.259 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:44:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:44:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:44:26.349 INFO:teuthology.orchestra.run.smithi007.stdout:client6605 2024-08-19T00:44:26.350 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:26.350 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:26.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:26.386 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:44:26.430 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:44:26.463 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:44:26.463 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:44:26.464 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:26.464 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:44:26.464 INFO:teuthology.orchestra.run.smithi007.stdout:sixmegs 2024-08-19T00:44:26.464 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_openfiles.0' did not caused DAMAGED state 2024-08-19T00:44:26.465 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 500.00000000' 2024-08-19T00:44:26.465 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:26.465 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:26.539 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:26.540 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:26.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:44:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.811+0000 7f3ddea00640 1 Processor -- start 2024-08-19T00:44:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.811+0000 7f3ddea00640 1 -- start start 2024-08-19T00:44:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.812+0000 7f3ddea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3dd8140640 0x7f3dd806d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.812+0000 7f3ddea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.812+0000 7f3ddea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd815e930 con 0x7f3dd813dc30 2024-08-19T00:44:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.812+0000 7f3ddea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd81413f0 con 0x7f3dd8140640 2024-08-19T00:44:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.812+0000 7f3ddea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd815ec10 con 0x7f3dd806db40 2024-08-19T00:44:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.813+0000 7f3dde000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.813+0000 7f3ddcc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3dd8140640 0x7f3dd806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.813+0000 7f3dde000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd80ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:56756/0 (socket says 172.21.15.7:56756) 2024-08-19T00:44:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.813+0000 7f3dde000640 1 -- 172.21.15.7:0/2872945745 learned_addr learned my addr 172.21.15.7:0/2872945745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.813+0000 7f3ddd600640 1 --1- 172.21.15.7:0/2872945745 >> v1:172.21.15.162:6789/0 conn(0x7f3dd813dc30 0x7f3dd8140ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:54130/0 (socket says 172.21.15.7:54130) 2024-08-19T00:44:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.814+0000 7f3dde000640 1 -- 172.21.15.7:0/2872945745 >> v2:172.21.15.162:3300/0 conn(0x7f3dd8140640 msgr2=0x7f3dd806d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.814+0000 7f3dde000640 1 --2- 172.21.15.7:0/2872945745 >> v2:172.21.15.162:3300/0 conn(0x7f3dd8140640 0x7f3dd806d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.814+0000 7f3dde000640 1 -- 172.21.15.7:0/2872945745 >> v1:172.21.15.162:6789/0 conn(0x7f3dd813dc30 legacy=0x7f3dd8140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.814+0000 7f3dde000640 1 -- 172.21.15.7:0/2872945745 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd815eef0 con 0x7f3dd806db40 2024-08-19T00:44:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.814+0000 7f3ddcc00640 1 --2- 172.21.15.7:0/2872945745 >> v2:172.21.15.162:3300/0 conn(0x7f3dd8140640 0x7f3dd806d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.815+0000 7f3dde000640 1 --2- 172.21.15.7:0/2872945745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd80ce820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009e50 tx=0x7f3dd002c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c09c2a1796c3bc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.815+0000 7f3dd7e00640 1 -- 172.21.15.7:0/2872945745 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0032610 con 0x7f3dd806db40 2024-08-19T00:44:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.815+0000 7f3dd7e00640 1 -- 172.21.15.7:0/2872945745 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd0037070 con 0x7f3dd806db40 2024-08-19T00:44:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.815+0000 7f3dd7e00640 1 -- 172.21.15.7:0/2872945745 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00329d0 con 0x7f3dd806db40 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 -- 172.21.15.7:0/2872945745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 msgr2=0x7f3dd80ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 --2- 172.21.15.7:0/2872945745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd80ce820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009e50 tx=0x7f3dd002c920 comp rx=0 tx=0).stop 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 -- 172.21.15.7:0/2872945745 shutdown_connections 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 --2- 172.21.15.7:0/2872945745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd80ce820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 --2- 172.21.15.7:0/2872945745 >> v2:172.21.15.162:3300/0 conn(0x7f3dd8140640 0x7f3dd806d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 -- 172.21.15.7:0/2872945745 >> 172.21.15.7:0/2872945745 conn(0x7f3dd806b850 msgr2=0x7f3dd806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 -- 172.21.15.7:0/2872945745 shutdown_connections 2024-08-19T00:44:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.816+0000 7f3ddea00640 1 -- 172.21.15.7:0/2872945745 wait complete. 2024-08-19T00:44:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.818+0000 7f3ddea00640 1 Processor -- start 2024-08-19T00:44:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.818+0000 7f3ddea00640 1 -- start start 2024-08-19T00:44:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd81e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd813dc30 0x7f3dd813b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd8140640 0x7f3dd813b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd813e010 con 0x7f3dd813dc30 2024-08-19T00:44:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd815f4b0 con 0x7f3dd8140640 2024-08-19T00:44:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd813e190 con 0x7f3dd806db40 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd813dc30 0x7f3dd813b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd813dc30 0x7f3dd813b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40036/0 (socket says 172.21.15.7:40036) 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddcc00640 1 -- 172.21.15.7:0/1292984764 learned_addr learned my addr 172.21.15.7:0/1292984764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3ddd600640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd81e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.819+0000 7f3dde000640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd8140640 0x7f3dd813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3ddcc00640 1 -- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 msgr2=0x7f3dd81e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3ddcc00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd81e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3ddcc00640 1 -- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd8140640 msgr2=0x7f3dd813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3ddcc00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd8140640 0x7f3dd813b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3ddcc00640 1 -- 172.21.15.7:0/1292984764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd80b3220 con 0x7f3dd813dc30 2024-08-19T00:44:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3ddcc00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd813dc30 0x7f3dd813b220 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e910 tx=0x7f3dc400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3dd5600640 1 -- 172.21.15.7:0/1292984764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4017070 con 0x7f3dd813dc30 2024-08-19T00:44:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3dd5600640 1 -- 172.21.15.7:0/1292984764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc400ca00 con 0x7f3dd813dc30 2024-08-19T00:44:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd80b3500 con 0x7f3dd813dc30 2024-08-19T00:44:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.820+0000 7f3dd5600640 1 -- 172.21.15.7:0/1292984764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400cdb0 con 0x7f3dd813dc30 2024-08-19T00:44:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.821+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd80b3ac0 con 0x7f3dd813dc30 2024-08-19T00:44:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.821+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd80ce820 con 0x7f3dd813dc30 2024-08-19T00:44:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.822+0000 7f3dd5600640 1 -- 172.21.15.7:0/1292984764 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dc401a070 con 0x7f3dd813dc30 2024-08-19T00:44:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.823+0000 7f3dd5600640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3db806be30 0x7f3db806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.823+0000 7f3dd5600640 1 -- 172.21.15.7:0/1292984764 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f3dc408b2e0 con 0x7f3dd813dc30 2024-08-19T00:44:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.823+0000 7f3ddd600640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3db806be30 0x7f3db806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.824+0000 7f3ddd600640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3db806be30 0x7f3db806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3dd81f7af0 tx=0x7f3dcc007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:26.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:26.827+0000 7f3dd5600640 1 -- 172.21.15.7:0/1292984764 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3dc4059390 con 0x7f3dd813dc30 2024-08-19T00:44:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.025+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3dd806e520 con 0x7f3dd813dc30 2024-08-19T00:44:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.026+0000 7f3dd5600640 1 -- 172.21.15.7:0/1292984764 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v92) ==== 81+0+732 (secure 0 0 0) 0x7f3dc405d690 con 0x7f3dd813dc30 2024-08-19T00:44:27.027 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:44:27.028 INFO:teuthology.orchestra.run.smithi007.stderr:listed 12 entries 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3db806be30 msgr2=0x7f3db806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3db806be30 0x7f3db806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3dd81f7af0 tx=0x7f3dcc007e80 comp rx=0 tx=0).stop 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd813dc30 msgr2=0x7f3dd813b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd813dc30 0x7f3dd813b220 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e910 tx=0x7f3dc400edd0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 shutdown_connections 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3db806be30 0x7f3db806e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd8140640 0x7f3dd813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd813dc30 0x7f3dd813b220 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 --2- 172.21.15.7:0/1292984764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd806db40 0x7f3dd81e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 >> 172.21.15.7:0/1292984764 conn(0x7f3dd806b850 msgr2=0x7f3dd80afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 shutdown_connections 2024-08-19T00:44:27.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.028+0000 7f3ddea00640 1 -- 172.21.15.7:0/1292984764 wait complete. 2024-08-19T00:44:27.045 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:44:27.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:27.045 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:44:27.125 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:27.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:27.126 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:27.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:27.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.358+0000 7f8311a00640 1 Processor -- start 2024-08-19T00:44:27.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.359+0000 7f8311a00640 1 -- start start 2024-08-19T00:44:27.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f8311a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f830c159bf0 0x7f830c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f8311a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f830c06f7f0 con 0x7f830c0739a0 2024-08-19T00:44:27.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f8311a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f830c06f510 con 0x7f830c0cec10 2024-08-19T00:44:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f8311a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f830c072980 con 0x7f830c159bf0 2024-08-19T00:44:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f8303e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f830c0739a0 0x7f830c0ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39422/0 (socket says 172.21.15.7:39422) 2024-08-19T00:44:27.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f8303e00640 1 -- 172.21.15.7:0/3968627399 learned_addr learned my addr 172.21.15.7:0/3968627399 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f830aa00640 1 --2- 172.21.15.7:0/3968627399 >> v2:172.21.15.162:3300/0 conn(0x7f830c159bf0 0x7f830c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.360+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182849414 0 0) 0x7f830c06f7f0 con 0x7f830c0739a0 2024-08-19T00:44:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f0003520 con 0x7f830c0739a0 2024-08-19T00:44:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 532698671 0 0) 0x7f82f0003520 con 0x7f830c0739a0 2024-08-19T00:44:27.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 >> v2:172.21.15.162:3300/0 conn(0x7f830c159bf0 msgr2=0x7f830c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 --2- 172.21.15.7:0/3968627399 >> v2:172.21.15.162:3300/0 conn(0x7f830c159bf0 0x7f830c073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 >> v1:172.21.15.162:6789/0 conn(0x7f830c0cec10 legacy=0x7f830c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c072c60 con 0x7f830c0739a0 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f82f4001670 con 0x7f830c0739a0 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830aa00640 1 --2- 172.21.15.7:0/3968627399 >> v2:172.21.15.162:3300/0 conn(0x7f830c159bf0 0x7f830c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 >> v1:172.21.15.7:6789/0 conn(0x7f830c0739a0 legacy=0x7f830c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00039b0 0x7f82f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f00043b0 0x7f82f0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0005120 0x7f82f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f830c072980 con 0x7f82f00039b0 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82f000c060 con 0x7f82f0005120 2024-08-19T00:44:27.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82f000c260 con 0x7f82f00043b0 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.361+0000 7f830aa00640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00039b0 0x7f82f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f8303e00640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f00043b0 0x7f82f0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830b400640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0005120 0x7f82f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830aa00640 1 -- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f00043b0 msgr2=0x7f82f0004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830aa00640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f00043b0 0x7f82f0004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830aa00640 1 -- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0005120 msgr2=0x7f82f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830aa00640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0005120 0x7f82f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830aa00640 1 -- 172.21.15.7:0/3968627399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f0003520 con 0x7f82f00039b0 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830b400640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f0005120 0x7f82f000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.362+0000 7f830b400640 1 -- 172.21.15.7:0/3968627399 reap_dead start 2024-08-19T00:44:27.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.363+0000 7f830aa00640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00039b0 0x7f82f0003d90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009c90 tx=0x7f82f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502562f74c749ada server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.363+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc036070 con 0x7f82f00039b0 2024-08-19T00:44:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.363+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82fc031400 con 0x7f82f00039b0 2024-08-19T00:44:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.363+0000 7f830a000640 1 -- 172.21.15.7:0/3968627399 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc009860 con 0x7f82f00039b0 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.364+0000 7f8311a00640 1 -- 172.21.15.7:0/3968627399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00039b0 msgr2=0x7f82f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.364+0000 7f8311a00640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00039b0 0x7f82f0003d90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009c90 tx=0x7f82f0005830 comp rx=0 tx=0).stop 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.364+0000 7f8311a00640 1 -- 172.21.15.7:0/3968627399 shutdown_connections 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.364+0000 7f8311a00640 1 --2- 172.21.15.7:0/3968627399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00039b0 0x7f82f0003d90 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.364+0000 7f8311a00640 1 -- 172.21.15.7:0/3968627399 >> 172.21.15.7:0/3968627399 conn(0x7f830c06bc70 msgr2=0x7f830c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.364+0000 7f8311a00640 1 -- 172.21.15.7:0/3968627399 shutdown_connections 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.364+0000 7f8311a00640 1 -- 172.21.15.7:0/3968627399 wait complete. 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.365+0000 7f8311a00640 1 Processor -- start 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.366+0000 7f8311a00640 1 -- start start 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.366+0000 7f8311a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f00039b0 0x7f830c099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.366+0000 7f8311a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c154e00 0x7f830c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.366+0000 7f8311a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f830c09d750 0x7f830c09dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.366+0000 7f8311a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f830c15a150 con 0x7f830c154e00 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.366+0000 7f8311a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f830c159fd0 con 0x7f82f00039b0 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.366+0000 7f8311a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f830c073460 con 0x7f830c09d750 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c154e00 0x7f830c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c154e00 0x7f830c155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40054/0 (socket says 172.21.15.7:40054) 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 -- 172.21.15.7:0/390354854 learned_addr learned my addr 172.21.15.7:0/390354854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f830b400640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f830c09d750 0x7f830c09dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f830aa00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f00039b0 0x7f830c099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 -- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f830c09d750 msgr2=0x7f830c09dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f830c09d750 0x7f830c09dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 -- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f00039b0 msgr2=0x7f830c099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f00039b0 0x7f830c099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 -- 172.21.15.7:0/390354854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c15e480 con 0x7f830c154e00 2024-08-19T00:44:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.367+0000 7f8303e00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c154e00 0x7f830c155280 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f82f4007290 tx=0x7f82f4007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.368+0000 7f8302a00640 1 -- 172.21.15.7:0/390354854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4001620 con 0x7f830c154e00 2024-08-19T00:44:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.368+0000 7f8302a00640 1 -- 172.21.15.7:0/390354854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f4018070 con 0x7f830c154e00 2024-08-19T00:44:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.368+0000 7f8302a00640 1 -- 172.21.15.7:0/390354854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f400fb80 con 0x7f830c154e00 2024-08-19T00:44:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.368+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830c15e760 con 0x7f830c154e00 2024-08-19T00:44:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.368+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830c15ed20 con 0x7f830c154e00 2024-08-19T00:44:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.369+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830c073790 con 0x7f830c154e00 2024-08-19T00:44:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.370+0000 7f8302a00640 1 -- 172.21.15.7:0/390354854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82f400fd20 con 0x7f830c154e00 2024-08-19T00:44:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.371+0000 7f8302a00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82e806be60 0x7f82e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.371+0000 7f8302a00640 1 -- 172.21.15.7:0/390354854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6225+0+0 (secure 0 0 0) 0x7f82f408ae80 con 0x7f830c154e00 2024-08-19T00:44:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.371+0000 7f830aa00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82e806be60 0x7f82e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.372+0000 7f830aa00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82e806be60 0x7f82e806e320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f82fc033000 tx=0x7f82fc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.375+0000 7f8302a00640 1 -- 172.21.15.7:0/390354854 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f82f4059610 con 0x7f830c154e00 2024-08-19T00:44:27.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.594+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f830c15b760 con 0x7f830c154e00 2024-08-19T00:44:27.596 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:27.595+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:27.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.597+0000 7f8302a00640 1 -- 172.21.15.7:0/390354854 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v125) ==== 161+0+0 (secure 0 0 0) 0x7f82f4058f10 con 0x7f830c154e00 2024-08-19T00:44:27.598 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.600+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82e806be60 msgr2=0x7f82e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.600+0000 7f8311a00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82e806be60 0x7f82e806e320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f82fc033000 tx=0x7f82fc008030 comp rx=0 tx=0).stop 2024-08-19T00:44:27.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.600+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c154e00 msgr2=0x7f830c155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.600+0000 7f8311a00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c154e00 0x7f830c155280 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f82f4007290 tx=0x7f82f4007690 comp rx=0 tx=0).stop 2024-08-19T00:44:27.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.601+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 shutdown_connections 2024-08-19T00:44:27.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.601+0000 7f8311a00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82e806be60 0x7f82e806e320 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.601+0000 7f8311a00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f830c09d750 0x7f830c09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.601+0000 7f8311a00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c154e00 0x7f830c155280 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.601+0000 7f8311a00640 1 --2- 172.21.15.7:0/390354854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f00039b0 0x7f830c099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.601+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 >> 172.21.15.7:0/390354854 conn(0x7f830c06bc70 msgr2=0x7f830c0cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:27.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.602+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 shutdown_connections 2024-08-19T00:44:27.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.602+0000 7f8311a00640 1 -- 172.21.15.7:0/390354854 wait complete. 2024-08-19T00:44:27.604 INFO:tasks.ceph.mds.c.smithi007.stderr: -1772> 2024-08-19T00:44:18.112+0000 7f955a800640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-08-19T00:44:27.607 INFO:tasks.ceph.mds.c.smithi007.stderr: -519> 2024-08-19T00:44:25.254+0000 7f955f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:27.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:27.650 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:44:27.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.779+0000 7f3c24c00640 1 Processor -- start 2024-08-19T00:44:27.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.780+0000 7f3c24c00640 1 -- start start 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c24c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c200d03c0 0x7f3c20071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c24c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2006e710 0x7f3c200d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c24c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c200d0ce0 con 0x7f3c200b3750 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c24c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3c200cebc0 con 0x7f3c200d03c0 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c24c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c200cdfb0 con 0x7f3c2006e710 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c200d03c0 0x7f3c20071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c200d03c0 0x7f3c20071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40082/0 (socket says 172.21.15.7:40082) 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1de00640 1 -- 172.21.15.7:0/4221021549 learned_addr learned my addr 172.21.15.7:0/4221021549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1e800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3c200b3750 0x7f3c200cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39430/0 (socket says 172.21.15.7:39430) 2024-08-19T00:44:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c15400640 1 --2- 172.21.15.7:0/4221021549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2006e710 0x7f3c200d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1de00640 1 -- 172.21.15.7:0/4221021549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2006e710 msgr2=0x7f3c200d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1de00640 1 --2- 172.21.15.7:0/4221021549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2006e710 0x7f3c200d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1de00640 1 -- 172.21.15.7:0/4221021549 >> v1:172.21.15.7:6789/0 conn(0x7f3c200b3750 legacy=0x7f3c200cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.781+0000 7f3c1de00640 1 -- 172.21.15.7:0/4221021549 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c200ce290 con 0x7f3c200d03c0 2024-08-19T00:44:27.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.782+0000 7f3c1de00640 1 --2- 172.21.15.7:0/4221021549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20071980 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bb10 tx=0x7f3c1002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a700066f4c6adc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:27.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c1d400640 1 -- 172.21.15.7:0/4221021549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10036020 con 0x7f3c200d03c0 2024-08-19T00:44:27.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c1d400640 1 -- 172.21.15.7:0/4221021549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10032820 con 0x7f3c200d03c0 2024-08-19T00:44:27.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c1d400640 1 -- 172.21.15.7:0/4221021549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10032bf0 con 0x7f3c200d03c0 2024-08-19T00:44:27.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 -- 172.21.15.7:0/4221021549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 msgr2=0x7f3c20071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 --2- 172.21.15.7:0/4221021549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20071980 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bb10 tx=0x7f3c1002c920 comp rx=0 tx=0).stop 2024-08-19T00:44:27.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 -- 172.21.15.7:0/4221021549 shutdown_connections 2024-08-19T00:44:27.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 --2- 172.21.15.7:0/4221021549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2006e710 0x7f3c200d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 --2- 172.21.15.7:0/4221021549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20071980 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 -- 172.21.15.7:0/4221021549 >> 172.21.15.7:0/4221021549 conn(0x7f3c2006bc70 msgr2=0x7f3c2006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:27.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 -- 172.21.15.7:0/4221021549 shutdown_connections 2024-08-19T00:44:27.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.783+0000 7f3c24c00640 1 -- 172.21.15.7:0/4221021549 wait complete. 2024-08-19T00:44:27.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.785+0000 7f3c24c00640 1 Processor -- start 2024-08-19T00:44:27.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.785+0000 7f3c24c00640 1 -- start start 2024-08-19T00:44:27.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.786+0000 7f3c24c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2006e710 0x7f3c201e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.786+0000 7f3c24c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200b3750 0x7f3c200cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.786+0000 7f3c24c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.786+0000 7f3c24c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20073ae0 con 0x7f3c200d03c0 2024-08-19T00:44:27.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.786+0000 7f3c24c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c200ce850 con 0x7f3c2006e710 2024-08-19T00:44:27.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.786+0000 7f3c24c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c20073c60 con 0x7f3c200b3750 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.786+0000 7f3c1e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40090/0 (socket says 172.21.15.7:40090) 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 -- 172.21.15.7:0/3473774448 learned_addr learned my addr 172.21.15.7:0/3473774448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1de00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2006e710 0x7f3c201e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c15400640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200b3750 0x7f3c200cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 -- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200b3750 msgr2=0x7f3c200cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200b3750 0x7f3c200cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 -- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2006e710 msgr2=0x7f3c201e3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2006e710 0x7f3c201e3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 -- 172.21.15.7:0/3473774448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c20153f60 con 0x7f3c200d03c0 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c15400640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200b3750 0x7f3c200cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:27.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c1e800640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20153a20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c730 tx=0x7f3c1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:27.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.787+0000 7f3c16a00640 1 -- 172.21.15.7:0/3473774448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18017070 con 0x7f3c200d03c0 2024-08-19T00:44:27.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.788+0000 7f3c16a00640 1 -- 172.21.15.7:0/3473774448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1800ce40 con 0x7f3c200d03c0 2024-08-19T00:44:27.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.788+0000 7f3c16a00640 1 -- 172.21.15.7:0/3473774448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800a840 con 0x7f3c200d03c0 2024-08-19T00:44:27.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.788+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c201e4000 con 0x7f3c200d03c0 2024-08-19T00:44:27.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.788+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c201e45c0 con 0x7f3c200d03c0 2024-08-19T00:44:27.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.789+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2015bba0 con 0x7f3c200d03c0 2024-08-19T00:44:27.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.790+0000 7f3c16a00640 1 -- 172.21.15.7:0/3473774448 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c1801a070 con 0x7f3c200d03c0 2024-08-19T00:44:27.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.791+0000 7f3c16a00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:27.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.791+0000 7f3c16a00640 1 -- 172.21.15.7:0/3473774448 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7f3c1808a590 con 0x7f3c200d03c0 2024-08-19T00:44:27.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.791+0000 7f3c1de00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:27.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.792+0000 7f3c1de00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3c10037000 tx=0x7f3c10032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:27.795+0000 7f3c16a00640 1 -- 172.21.15.7:0/3473774448 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3c20153f60 con 0x7f3c200d03c0 2024-08-19T00:44:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.048+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f3c200b3be0 con 0x7f3c200d03c0 2024-08-19T00:44:28.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.598+0000 7f3c16a00640 1 -- 172.21.15.7:0/3473774448 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v126) ==== 107+0+0 (secure 0 0 0) 0x7f3c180585f0 con 0x7f3c200d03c0 2024-08-19T00:44:28.600 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 msgr2=0x7f3bfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3c10037000 tx=0x7f3c10032000 comp rx=0 tx=0).stop 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 msgr2=0x7f3c20153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20153a20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c730 tx=0x7f3c1800cbf0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 shutdown_connections 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c20153a20 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200b3750 0x7f3c200cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 --2- 172.21.15.7:0/3473774448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2006e710 0x7f3c201e3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 >> 172.21.15.7:0/3473774448 conn(0x7f3c2006bc70 msgr2=0x7f3c200cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 shutdown_connections 2024-08-19T00:44:28.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.601+0000 7f3c24c00640 1 -- 172.21.15.7:0/3473774448 wait complete. 2024-08-19T00:44:28.620 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:28.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.736+0000 7fed68924f40 1 Processor -- start 2024-08-19T00:44:28.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.737+0000 7fed68924f40 1 -- start start 2024-08-19T00:44:28.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.737+0000 7fed68924f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f3001c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.737+0000 7fed68924f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f2f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.737+0000 7fed68924f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f228ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.737+0000 7fed68924f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e18f25a8f0 con 0x55e18f25b5b0 2024-08-19T00:44:28.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.737+0000 7fed68924f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e18f1cfd00 con 0x55e18f259f40 2024-08-19T00:44:28.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.737+0000 7fed68924f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e18f300dc0 con 0x55e18f25b990 2024-08-19T00:44:28.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f2f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f2f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40100/0 (socket says 172.21.15.7:40100) 2024-08-19T00:44:28.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 -- 172.21.15.7:0/2595116012 learned_addr learned my addr 172.21.15.7:0/2595116012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:28.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed65000640 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f3001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 -- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 msgr2=0x55e18f228ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed65a00640 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f228ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f228ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 -- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 msgr2=0x55e18f3001c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f3001c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 -- 172.21.15.7:0/2595116012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18f154b30 con 0x55e18f25b5b0 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed65000640 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f3001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed65a00640 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f228ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.738+0000 7fed5fe00640 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f2f2ae0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fed50045eb0 tx=0x7fed50051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7585af6e616c023c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed5ea00640 1 -- 172.21.15.7:0/2595116012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50062070 con 0x55e18f25b5b0 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed5ea00640 1 -- 172.21.15.7:0/2595116012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed50054b50 con 0x55e18f25b5b0 2024-08-19T00:44:28.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed5ea00640 1 -- 172.21.15.7:0/2595116012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50067460 con 0x55e18f25b5b0 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 -- 172.21.15.7:0/2595116012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 msgr2=0x55e18f2f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f2f2ae0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fed50045eb0 tx=0x7fed50051000 comp rx=0 tx=0).stop 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 -- 172.21.15.7:0/2595116012 shutdown_connections 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f228ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f2f2ae0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 --2- 172.21.15.7:0/2595116012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f3001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 -- 172.21.15.7:0/2595116012 >> 172.21.15.7:0/2595116012 conn(0x55e18f2584e0 msgr2=0x55e18f2588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 -- 172.21.15.7:0/2595116012 shutdown_connections 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.739+0000 7fed68924f40 1 -- 172.21.15.7:0/2595116012 wait complete. 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.740+0000 7fed68924f40 1 Processor -- start 2024-08-19T00:44:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.740+0000 7fed68924f40 1 -- start start 2024-08-19T00:44:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed68924f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f2ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed68924f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f399a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed68924f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f399fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed68924f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e18f257c40 con 0x55e18f25b5b0 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed68924f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e18f302510 con 0x55e18f259f40 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed68924f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e18f2f91b0 con 0x55e18f25b990 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f399a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f399a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40106/0 (socket says 172.21.15.7:40106) 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 learned_addr learned my addr 172.21.15.7:0/1867320936 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed65a00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f399fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.741+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f2ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 msgr2=0x55e18f399fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5fe00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e18f25b990 0x55e18f399fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 msgr2=0x55e18f2ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5fe00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f2ef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18f191080 con 0x55e18f25b5b0 2024-08-19T00:44:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e18f259f40 0x55e18f2ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5fe00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f399a60 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fed50045eb0 tx=0x7fed50002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5d600640 1 -- 172.21.15.7:0/1867320936 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50075070 con 0x55e18f25b5b0 2024-08-19T00:44:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5d600640 1 -- 172.21.15.7:0/1867320936 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed50067460 con 0x55e18f25b5b0 2024-08-19T00:44:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed5d600640 1 -- 172.21.15.7:0/1867320936 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5006c070 con 0x55e18f25b5b0 2024-08-19T00:44:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.742+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e18f303070 con 0x55e18f25b5b0 2024-08-19T00:44:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.743+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e18f3035f0 con 0x55e18f25b5b0 2024-08-19T00:44:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.744+0000 7fed5d600640 1 -- 172.21.15.7:0/1867320936 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed50078070 con 0x55e18f25b5b0 2024-08-19T00:44:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.745+0000 7fed5d600640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed4406a810 0x7fed4406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.745+0000 7fed5d600640 1 -- 172.21.15.7:0/1867320936 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7fed500cf460 con 0x55e18f25b5b0 2024-08-19T00:44:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.745+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed4406a810 0x7fed4406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.748 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.746+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e18f2f65b0 0x55e18f2f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.746+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f2f6ed0 con 0x55e18f2f65b0 2024-08-19T00:44:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.746+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed4406a810 0x7fed4406ccd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55e18f2f8cf0 tx=0x7fed58003720 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.746+0000 7fed65a00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e18f2f65b0 0x55e18f2f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.747+0000 7fed65a00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e18f2f65b0 0x55e18f2f6990 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.751+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v93'195 uv169 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.751+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f2f72c0 con 0x55e18f2f65b0 2024-08-19T00:44:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.753+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v93'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.753+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a2da0 con 0x55e18f2f65b0 2024-08-19T00:44:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.754+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v93'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.756 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.754+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a4150 con 0x55e18f2f65b0 2024-08-19T00:44:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.756+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v93'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.756+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a44f0 con 0x55e18f2f65b0 2024-08-19T00:44:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.758+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v93'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.758+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3140 con 0x55e18f2f65b0 2024-08-19T00:44:28.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.760+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v93'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.760+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a34e0 con 0x55e18f2f65b0 2024-08-19T00:44:28.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.762+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v93'201 uv175 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.762+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.764+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v93'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.764+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.766+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v93'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.768 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:28.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.766+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.768+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v93'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.768+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.769+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v93'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.769+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.771+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v93'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.771+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.773+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v93'207 uv182 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.773+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.775+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v93'208 uv208 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.775+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.779 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.777+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v93'209 uv209 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.777+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.779+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v93'210 uv210 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.779+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.781+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v93'211 uv211 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.781+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3880 con 0x55e18f2f65b0 2024-08-19T00:44:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.782+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v93'212 uv212 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.783+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3c90 con 0x55e18f2f65b0 2024-08-19T00:44:28.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.784+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v93'213 uv213 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.785+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3c90 con 0x55e18f2f65b0 2024-08-19T00:44:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.786+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v93'214 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.786+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.788+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v93'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.788+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.791 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:28.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.789+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v93'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.790+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.791+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v93'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.792+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.793+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v93'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.793+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.795+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v93'219 uv219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.795+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.796+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v93'220 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.796+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.798+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v93'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.798+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.801 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.800+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v93'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.800+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.802+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v93'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.802+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.803+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v93'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.803+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f2f65b0 2024-08-19T00:44:28.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.805+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v93'225 uv225 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.805+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e18f3a4da0 0x55e18f3a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.805+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a3b40 con 0x55e18f3a4da0 2024-08-19T00:44:28.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.806+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e18f3a4da0 0x55e18f3a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.806+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e18f3a4da0 0x55e18f3a7190 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.808+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v93'152 uv133 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.808+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a76d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.809+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v93'153 uv153 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.809+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a7a70 con 0x55e18f3a4da0 2024-08-19T00:44:28.812 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:28.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.811+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v93'154 uv154 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.811+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a7e10 con 0x55e18f3a4da0 2024-08-19T00:44:28.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.812+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v93'155 uv155 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.812+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a81b0 con 0x55e18f3a4da0 2024-08-19T00:44:28.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.814+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v93'156 uv156 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.814+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a8550 con 0x55e18f3a4da0 2024-08-19T00:44:28.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.815+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v93'157 uv150 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.815+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.817+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v93'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.817+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.819 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:28.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.818+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v93'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.818+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.820+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v93'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.820+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.821+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v93'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.821+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.822+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v93'162 uv151 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.822+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.824+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v93'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.824+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.826 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:28.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.825+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v93'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.825+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3acfe0 con 0x55e18f3a4da0 2024-08-19T00:44:28.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.827+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v93'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.827+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3acfe0 con 0x55e18f3a4da0 2024-08-19T00:44:28.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.829+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v93'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.829+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.830+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v93'167 uv147 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.830+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.832+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v93'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.832+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.834 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:28.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.833+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v93'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.833+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a9900 con 0x55e18f3a4da0 2024-08-19T00:44:28.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.834+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v93'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.834+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a9900 con 0x55e18f3a4da0 2024-08-19T00:44:28.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.836+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v93'171 uv171 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.836+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3a88f0 con 0x55e18f3a4da0 2024-08-19T00:44:28.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.838+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v93'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3a4da0 2024-08-19T00:44:28.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.838+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e18f3a8e00 0x55e18f3ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.838+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3ab730 con 0x55e18f3a8e00 2024-08-19T00:44:28.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.838+0000 7fed5fe00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e18f3a8e00 0x55e18f3ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.839+0000 7fed5fe00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e18f3a8e00 0x55e18f3ab1f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.840+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v93'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.840+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3abad0 con 0x55e18f3a8e00 2024-08-19T00:44:28.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.841+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v93'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.842+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3abef0 con 0x55e18f3a8e00 2024-08-19T00:44:28.845 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:28.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.843+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v93'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.843+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3ad7a0 con 0x55e18f3a8e00 2024-08-19T00:44:28.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.845+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v93'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.845+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3adb40 con 0x55e18f3a8e00 2024-08-19T00:44:28.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.846+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v93'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.846+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3ac790 con 0x55e18f3a8e00 2024-08-19T00:44:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.847+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v93'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.847+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3acb80 con 0x55e18f2f65b0 2024-08-19T00:44:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.849+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v93'32 uv31 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.849+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3acb80 con 0x55e18f2f65b0 2024-08-19T00:44:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.851+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v93'33 uv33 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.851+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3acb80 con 0x55e18f2f65b0 2024-08-19T00:44:28.854 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:28.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.852+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v93'34 uv34 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.853+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3acb80 con 0x55e18f2f65b0 2024-08-19T00:44:28.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.854+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v93'35 uv35 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.854+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e18f3adee0 0x55e18f3b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.854+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b0810 con 0x55e18f3adee0 2024-08-19T00:44:28.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.855+0000 7fed65a00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e18f3adee0 0x55e18f3b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.855+0000 7fed65a00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e18f3adee0 0x55e18f3b02d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.857+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v93'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.857+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b0810 con 0x55e18f3adee0 2024-08-19T00:44:28.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.858+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v93'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.858+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b0810 con 0x55e18f3adee0 2024-08-19T00:44:28.861 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:28.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.859+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v93'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.859+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b1820 con 0x55e18f3adee0 2024-08-19T00:44:28.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.861+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v93'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.861+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b1820 con 0x55e18f3adee0 2024-08-19T00:44:28.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.862+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v93'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.862+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b0810 con 0x55e18f3adee0 2024-08-19T00:44:28.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.863+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v93'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.864+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e18f3b0d20 0x55e18f3b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.864+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b37c0 con 0x55e18f3b0d20 2024-08-19T00:44:28.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.864+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e18f3b0d20 0x55e18f3b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.864+0000 7fed65000640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e18f3b0d20 0x55e18f3b3110 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.866+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v93'70 uv64 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.866+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3880 con 0x55e18f3b0d20 2024-08-19T00:44:28.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.867+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v93'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.867+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3ca0 con 0x55e18f3b0d20 2024-08-19T00:44:28.870 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.868+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v93'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.868+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b4cb0 con 0x55e18f3b0d20 2024-08-19T00:44:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.870+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v93'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.870+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b4cb0 con 0x55e18f3b0d20 2024-08-19T00:44:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.871+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v93'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.871+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3ca0 con 0x55e18f3b0d20 2024-08-19T00:44:28.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.872+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v93'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.872+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3ca0 con 0x55e18f3b0d20 2024-08-19T00:44:28.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.873+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v93'76 uv69 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.873+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3ca0 con 0x55e18f3b0d20 2024-08-19T00:44:28.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.875+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v93'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.875+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3ca0 con 0x55e18f3b0d20 2024-08-19T00:44:28.877 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:28.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.876+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v93'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.876+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3ca0 con 0x55e18f3b0d20 2024-08-19T00:44:28.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.877+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v93'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.877+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b3ca0 con 0x55e18f3b0d20 2024-08-19T00:44:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.878+0000 7fed65000640 1 -- 172.21.15.7:0/1867320936 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v93'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed580107d0 con 0x55e18f3b0d20 2024-08-19T00:44:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.879+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e18f3b4320 0x55e18f3b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.879+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b6d20 con 0x55e18f3b4320 2024-08-19T00:44:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.879+0000 7fed5fe00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e18f3b4320 0x55e18f3b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.879+0000 7fed5fe00640 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e18f3b4320 0x55e18f3b6710 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.881+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v93'32 uv31 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.881+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b70f0 con 0x55e18f3b4320 2024-08-19T00:44:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.882+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v93'33 uv33 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.882+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3b4320 2024-08-19T00:44:28.885 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:28.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.883+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v93'34 uv34 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.883+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3b4320 2024-08-19T00:44:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.885+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v93'35 uv35 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.885+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3b4320 2024-08-19T00:44:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.887+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v93'36 uv36 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.887+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f2f65b0 2024-08-19T00:44:28.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.888+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v93'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.888+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f2f65b0 2024-08-19T00:44:28.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.889+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v93'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.889+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f2f65b0 2024-08-19T00:44:28.892 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:28.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.891+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v93'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.891+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b8520 con 0x55e18f2f65b0 2024-08-19T00:44:28.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.892+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v93'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.892+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b8520 con 0x55e18f2f65b0 2024-08-19T00:44:28.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.893+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v93'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.893+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f2f65b0 2024-08-19T00:44:28.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.895+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v93'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f2f65b0 2024-08-19T00:44:28.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.895+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.896+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v93'64 uv58 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.896+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.898+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v93'65 uv65 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.898+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.901 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:28.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.899+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v93'66 uv66 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.900+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.901+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v93'67 uv67 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.901+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.903+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v93'68 uv68 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.903+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.904+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v93'69 uv63 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.904+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.905+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v93'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.906+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.908 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:28.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.908+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v93'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.908+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7510 con 0x55e18f3a8e00 2024-08-19T00:44:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.908+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v93'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.909+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3ba320 con 0x55e18f3a8e00 2024-08-19T00:44:28.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.910+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v93'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3a8e00 2024-08-19T00:44:28.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.910+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.911+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v93'31 uv29 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.912+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.913+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v93'32 uv32 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.913+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.916 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:28.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.914+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v93'33 uv33 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.914+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.916+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v93'34 uv34 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.916+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.917+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v93'39 uv38 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.918+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.919+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v93'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.919+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.922 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:28.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.921+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v93'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.921+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b89d0 con 0x55e18f3adee0 2024-08-19T00:44:28.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.922+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v93'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.922+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b89d0 con 0x55e18f3adee0 2024-08-19T00:44:28.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.924+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v93'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.924+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3adee0 2024-08-19T00:44:28.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.925+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v93'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed60011040 con 0x55e18f3adee0 2024-08-19T00:44:28.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.925+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.926+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v93'32 uv31 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.926+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.928+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v93'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.928+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.930 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:28.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.929+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v93'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.929+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.931+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v93'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.931+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.932+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v93'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.932+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.934+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v93'82 uv73 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.934+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.935+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v93'83 uv83 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.935+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.936+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v93'84 uv84 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.938 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:28.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.936+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.937+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v93'85 uv85 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.938+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.940+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v93'86 uv86 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.940+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.942+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v93'87 uv80 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.942+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.943+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v93'88 uv88 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.943+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.944+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v93'89 uv89 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.946 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:28.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.944+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b89d0 con 0x55e18f3b4320 2024-08-19T00:44:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.945+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v93'90 uv90 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.945+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b89d0 con 0x55e18f3b4320 2024-08-19T00:44:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.947+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v93'91 uv91 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.947+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b79c0 con 0x55e18f3b4320 2024-08-19T00:44:28.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.948+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v93'92 uv92 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.948+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) -- 0x55e18f3b7f20 con 0x55e18f3b4320 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.949+0000 7fed5fe00640 1 -- 172.21.15.7:0/1867320936 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v93'93 uv93 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed50077030 con 0x55e18f3b4320 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.949+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e18f3a4da0 msgr2=0x55e18f3a7190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.949+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55e18f3a4da0 0x55e18f3a7190 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.949+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e18f3b0d20 msgr2=0x55e18f3b3110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.949+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55e18f3b0d20 0x55e18f3b3110 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.949+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e18f3b4320 msgr2=0x55e18f3b6710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.949+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e18f3b4320 0x55e18f3b6710 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e18f3a8e00 msgr2=0x55e18f3ab1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55e18f3a8e00 0x55e18f3ab1f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 reap_dead start 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e18f2f65b0 msgr2=0x55e18f2f6990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55e18f2f65b0 0x55e18f2f6990 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed65a00640 1 -- 172.21.15.7:0/1867320936 reap_dead start 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e18f3adee0 msgr2=0x55e18f3b02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e18f3adee0 0x55e18f3b02d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed4406a810 msgr2=0x7fed4406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed4406a810 0x7fed4406ccd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55e18f2f8cf0 tx=0x7fed58003720 comp rx=0 tx=0).stop 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 msgr2=0x55e18f399a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f399a60 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fed50045eb0 tx=0x7fed50002fb0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 shutdown_connections 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fed4406a810 0x7fed4406ccd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e18f25b5b0 0x55e18f399a60 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 --2- 172.21.15.7:0/1867320936 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55e18f3adee0 0x55e18f3b02d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 >> 172.21.15.7:0/1867320936 conn(0x55e18f2584e0 msgr2=0x55e18f3017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 shutdown_connections 2024-08-19T00:44:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:28.950+0000 7fed68924f40 1 -- 172.21.15.7:0/1867320936 wait complete. 2024-08-19T00:44:28.956 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 500.00000000 2024-08-19T00:44:29.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.071+0000 7febc6e23f40 1 Processor -- start 2024-08-19T00:44:29.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.071+0000 7febc6e23f40 1 -- start start 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.072+0000 7febc6e23f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80030f0 0x55d8608bff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.072+0000 7febc6e23f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8608aece0 0x55d86094f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.072+0000 7febc6e23f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 0x55d86094fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.072+0000 7febc6e23f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d8608bddc0 con 0x55d8608aece0 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.072+0000 7febc6e23f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d86078cd00 con 0x55d86094f6c0 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.072+0000 7febc6e23f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d8608be0a0 con 0x7feba80030f0 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8608aece0 0x55d86094f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc4000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80030f0 0x55d8608bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8608aece0 0x55d86094f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40126/0 (socket says 172.21.15.7:40126) 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 -- 172.21.15.7:0/3697022532 learned_addr learned my addr 172.21.15.7:0/3697022532 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:29.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc4a00640 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 0x55d86094fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 -- 172.21.15.7:0/3697022532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80030f0 msgr2=0x55d8608bff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80030f0 0x55d8608bff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 -- 172.21.15.7:0/3697022532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 msgr2=0x55d86094fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 0x55d86094fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 -- 172.21.15.7:0/3697022532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d860711b30 con 0x55d8608aece0 2024-08-19T00:44:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.073+0000 7febc3600640 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8608aece0 0x55d86094f180 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7febb0025e30 tx=0x7febb0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f53ca01eea1496 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc2200640 1 -- 172.21.15.7:0/3697022532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb004f4b0 con 0x55d8608aece0 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc2200640 1 -- 172.21.15.7:0/3697022532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb004f860 con 0x55d8608aece0 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc2200640 1 -- 172.21.15.7:0/3697022532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb004fc50 con 0x55d8608aece0 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 -- 172.21.15.7:0/3697022532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8608aece0 msgr2=0x55d86094f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8608aece0 0x55d86094f180 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7febb0025e30 tx=0x7febb0051000 comp rx=0 tx=0).stop 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 -- 172.21.15.7:0/3697022532 shutdown_connections 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 0x55d86094fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8608aece0 0x55d86094f180 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 --2- 172.21.15.7:0/3697022532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80030f0 0x55d8608bff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 -- 172.21.15.7:0/3697022532 >> 172.21.15.7:0/3697022532 conn(0x55d8608154e0 msgr2=0x55d8608175d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 -- 172.21.15.7:0/3697022532 shutdown_connections 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.074+0000 7febc6e23f40 1 -- 172.21.15.7:0/3697022532 wait complete. 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.075+0000 7febc6e23f40 1 Processor -- start 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.075+0000 7febc6e23f40 1 -- start start 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc6e23f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d8608aece0 0x55d8608c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc6e23f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 0x55d860831940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc6e23f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80030f0 0x55d860831e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc6e23f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d860832eb0 con 0x7feba80030f0 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc6e23f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d8608b7190 con 0x55d86094f6c0 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc6e23f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d8607e5ef0 con 0x55d8608aece0 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80030f0 0x55d860831e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80030f0 0x55d860831e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40138/0 (socket says 172.21.15.7:40138) 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc4a00640 1 -- 172.21.15.7:0/2780588285 learned_addr learned my addr 172.21.15.7:0/2780588285 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc3600640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 0x55d860831940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.076+0000 7febc4000640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d8608aece0 0x55d8608c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc4a00640 1 -- 172.21.15.7:0/2780588285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d8608aece0 msgr2=0x55d8608c03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc4a00640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d8608aece0 0x55d8608c03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc4a00640 1 -- 172.21.15.7:0/2780588285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 msgr2=0x55d860831940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc4a00640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86094f6c0 0x55d860831940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc4a00640 1 -- 172.21.15.7:0/2780588285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d86074e080 con 0x7feba80030f0 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc4a00640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80030f0 0x55d860831e80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x55d8607e51b0 tx=0x7febbc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc0e00640 1 -- 172.21.15.7:0/2780588285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc01a070 con 0x7feba80030f0 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc0e00640 1 -- 172.21.15.7:0/2780588285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc0135b0 con 0x7feba80030f0 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc0e00640 1 -- 172.21.15.7:0/2780588285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc0139a0 con 0x7feba80030f0 2024-08-19T00:44:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8608b33a0 con 0x7feba80030f0 2024-08-19T00:44:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.077+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8608b3610 con 0x7feba80030f0 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.079+0000 7febc0e00640 1 -- 172.21.15.7:0/2780588285 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febbc012040 con 0x7feba80030f0 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.080+0000 7febc0e00640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feba406a840 0x7feba406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.080+0000 7febc0e00640 1 -- 172.21.15.7:0/2780588285 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7febbc0893d0 con 0x7feba80030f0 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.080+0000 7febc4000640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feba406a840 0x7feba406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.080+0000 7febc6e23f40 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d8608b5ed0 0x55d8608b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.080+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:1 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) -- 0x55d8608a8600 con 0x55d8608b5ed0 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.081+0000 7febc3600640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d8608b5ed0 0x55d8608b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.081+0000 7febc4000640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feba406a840 0x7feba406cd00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7febb4005cf0 tx=0x7febb400c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.081+0000 7febc3600640 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d8608b5ed0 0x55d8608b62b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc3600640 1 -- 172.21.15.7:0/2780588285 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(1 500.00000000 [delete] v93'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7febb001a320 con 0x55d8608b5ed0 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d8608b5ed0 msgr2=0x55d8608b62b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d8608b5ed0 0x55d8608b62b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feba406a840 msgr2=0x7feba406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feba406a840 0x7feba406cd00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7febb4005cf0 tx=0x7febb400c040 comp rx=0 tx=0).stop 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80030f0 msgr2=0x55d860831e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 --2- 172.21.15.7:0/2780588285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80030f0 0x55d860831e80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x55d8607e51b0 tx=0x7febbc003820 comp rx=0 tx=0).stop 2024-08-19T00:44:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc4a00640 1 -- 172.21.15.7:0/2780588285 reap_dead start 2024-08-19T00:44:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 shutdown_connections 2024-08-19T00:44:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 >> 172.21.15.7:0/2780588285 conn(0x55d8608154e0 msgr2=0x55d8608bf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 shutdown_connections 2024-08-19T00:44:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.083+0000 7febc6e23f40 1 -- 172.21.15.7:0/2780588285 wait complete. 2024-08-19T00:44:29.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.248+0000 7f6089c00640 1 Processor -- start 2024-08-19T00:44:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.248+0000 7f6089c00640 1 -- start start 2024-08-19T00:44:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6089c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f608413dc30 0x7f6084140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6089c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608415e930 con 0x7f608406dd10 2024-08-19T00:44:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6089c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608415ec10 con 0x7f6084140640 2024-08-19T00:44:29.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6089c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f608415eef0 con 0x7f608413dc30 2024-08-19T00:44:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6083e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f608413dc30 0x7f6084140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6083e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f608413dc30 0x7f6084140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40154/0 (socket says 172.21.15.7:40154) 2024-08-19T00:44:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6083e00640 1 -- 172.21.15.7:0/3494787008 learned_addr learned my addr 172.21.15.7:0/3494787008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.249+0000 7f6089200640 1 --1- 172.21.15.7:0/3494787008 >> v1:172.21.15.7:6789/0 conn(0x7f608406dd10 0x7f60840ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39458/0 (socket says 172.21.15.7:39458) 2024-08-19T00:44:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.250+0000 7f6083e00640 1 -- 172.21.15.7:0/3494787008 >> v1:172.21.15.162:6789/0 conn(0x7f6084140640 legacy=0x7f608406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.250+0000 7f6083e00640 1 -- 172.21.15.7:0/3494787008 >> v1:172.21.15.7:6789/0 conn(0x7f608406dd10 legacy=0x7f60840ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.250+0000 7f6083e00640 1 -- 172.21.15.7:0/3494787008 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608415f1d0 con 0x7f608413dc30 2024-08-19T00:44:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.251+0000 7f6083e00640 1 --2- 172.21.15.7:0/3494787008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f6084140ce0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6074009870 tx=0x7f607402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc8b6a9f17f83ff server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.251+0000 7f6082a00640 1 -- 172.21.15.7:0/3494787008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074037070 con 0x7f608413dc30 2024-08-19T00:44:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.251+0000 7f6082a00640 1 -- 172.21.15.7:0/3494787008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607402ae50 con 0x7f608413dc30 2024-08-19T00:44:29.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.251+0000 7f6082a00640 1 -- 172.21.15.7:0/3494787008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074032860 con 0x7f608413dc30 2024-08-19T00:44:29.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.252+0000 7f6089c00640 1 -- 172.21.15.7:0/3494787008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 msgr2=0x7f6084140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.252+0000 7f6089c00640 1 --2- 172.21.15.7:0/3494787008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f6084140ce0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6074009870 tx=0x7f607402a300 comp rx=0 tx=0).stop 2024-08-19T00:44:29.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.252+0000 7f6089c00640 1 -- 172.21.15.7:0/3494787008 shutdown_connections 2024-08-19T00:44:29.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.252+0000 7f6089c00640 1 --2- 172.21.15.7:0/3494787008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f6084140ce0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.252+0000 7f6089c00640 1 -- 172.21.15.7:0/3494787008 >> 172.21.15.7:0/3494787008 conn(0x7f608406b850 msgr2=0x7f608406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:29.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.252+0000 7f6089c00640 1 -- 172.21.15.7:0/3494787008 shutdown_connections 2024-08-19T00:44:29.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.252+0000 7f6089c00640 1 -- 172.21.15.7:0/3494787008 wait complete. 2024-08-19T00:44:29.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.253+0000 7f6089c00640 1 Processor -- start 2024-08-19T00:44:29.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.254+0000 7f6089c00640 1 -- start start 2024-08-19T00:44:29.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.254+0000 7f6089c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608406dd10 0x7f6084154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.254+0000 7f6089c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f60840b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.254+0000 7f6089c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6084140640 0x7f60840b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.254+0000 7f6089c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60841413a0 con 0x7f608413dc30 2024-08-19T00:44:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.254+0000 7f6089c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6084141220 con 0x7f6084140640 2024-08-19T00:44:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.254+0000 7f6089c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f608413e010 con 0x7f608406dd10 2024-08-19T00:44:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f60840b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f60840b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40164/0 (socket says 172.21.15.7:40164) 2024-08-19T00:44:29.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 -- 172.21.15.7:0/2492014933 learned_addr learned my addr 172.21.15.7:0/2492014933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083e00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608406dd10 0x7f6084154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6089200640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6084140640 0x7f60840b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 -- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608406dd10 msgr2=0x7f6084154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608406dd10 0x7f6084154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 -- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6084140640 msgr2=0x7f60840b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6084140640 0x7f60840b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 -- 172.21.15.7:0/2492014933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60841f5860 con 0x7f608413dc30 2024-08-19T00:44:29.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6089200640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6084140640 0x7f60840b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.255+0000 7f6083400640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f60840b4270 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f607000c440 tx=0x7f607000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.256+0000 7f607be00640 1 -- 172.21.15.7:0/2492014933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60700052d0 con 0x7f608413dc30 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.256+0000 7f607be00640 1 -- 172.21.15.7:0/2492014933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6070005470 con 0x7f608413dc30 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.256+0000 7f607be00640 1 -- 172.21.15.7:0/2492014933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070007260 con 0x7f608413dc30 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.256+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6084140380 con 0x7f608413dc30 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.256+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60841e4830 con 0x7f608413dc30 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.257+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6084140ce0 con 0x7f608413dc30 2024-08-19T00:44:29.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.258+0000 7f607be00640 1 -- 172.21.15.7:0/2492014933 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60700074c0 con 0x7f608413dc30 2024-08-19T00:44:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.259+0000 7f607be00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606406be30 0x7f606406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:29.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.259+0000 7f607be00640 1 -- 172.21.15.7:0/2492014933 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7f607008a560 con 0x7f608413dc30 2024-08-19T00:44:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.259+0000 7f6083e00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606406be30 0x7f606406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.260+0000 7f6083e00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606406be30 0x7f606406e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6074034000 tx=0x7f607402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:29.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.264+0000 7f607be00640 1 -- 172.21.15.7:0/2492014933 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f60841f5860 con 0x7f608413dc30 2024-08-19T00:44:29.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:29.485+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f608406e520 con 0x7f608413dc30 2024-08-19T00:44:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.144+0000 7f607be00640 1 -- 172.21.15.7:0/2492014933 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v127) ==== 162+0+0 (secure 0 0 0) 0x7f6070058ca0 con 0x7f608413dc30 2024-08-19T00:44:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.146+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606406be30 msgr2=0x7f606406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606406be30 0x7f606406e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6074034000 tx=0x7f607402e000 comp rx=0 tx=0).stop 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 msgr2=0x7f60840b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f60840b4270 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f607000c440 tx=0x7f607000c900 comp rx=0 tx=0).stop 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 shutdown_connections 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606406be30 0x7f606406e2f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6084140640 0x7f60840b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f608413dc30 0x7f60840b4270 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 --2- 172.21.15.7:0/2492014933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608406dd10 0x7f6084154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 >> 172.21.15.7:0/2492014933 conn(0x7f608406b850 msgr2=0x7f608406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 shutdown_connections 2024-08-19T00:44:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.147+0000 7f6089c00640 1 -- 172.21.15.7:0/2492014933 wait complete. 2024-08-19T00:44:30.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:30.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.741+0000 7fc5a5c00640 1 Processor -- start 2024-08-19T00:44:30.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.741+0000 7fc5a5c00640 1 -- start start 2024-08-19T00:44:30.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.742+0000 7fc5a5c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5a015e360 0x7fc5a015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:30.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.742+0000 7fc5a5c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a00d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:30.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.742+0000 7fc5a5c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a00b3ab0 con 0x7fc5a00d2af0 2024-08-19T00:44:30.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.742+0000 7fc5a5c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a015f460 con 0x7fc5a015e360 2024-08-19T00:44:30.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.742+0000 7fc5a5c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a015f740 con 0x7fc5a015ee50 2024-08-19T00:44:30.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a00d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:30.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a00d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:56906/0 (socket says 172.21.15.7:56906) 2024-08-19T00:44:30.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc5a5200640 1 -- 172.21.15.7:0/665886155 learned_addr learned my addr 172.21.15.7:0/665886155 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:30.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc59fe00640 1 --2- 172.21.15.7:0/665886155 >> v2:172.21.15.162:3300/0 conn(0x7fc5a015e360 0x7fc5a015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:30.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc59f400640 1 --1- 172.21.15.7:0/665886155 >> v1:172.21.15.162:6789/0 conn(0x7fc5a00d2af0 0x7fc5a015e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:54154/0 (socket says 172.21.15.7:54154) 2024-08-19T00:44:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc5a5200640 1 -- 172.21.15.7:0/665886155 >> v2:172.21.15.162:3300/0 conn(0x7fc5a015e360 msgr2=0x7fc5a015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc5a5200640 1 --2- 172.21.15.7:0/665886155 >> v2:172.21.15.162:3300/0 conn(0x7fc5a015e360 0x7fc5a015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc5a5200640 1 -- 172.21.15.7:0/665886155 >> v1:172.21.15.162:6789/0 conn(0x7fc5a00d2af0 legacy=0x7fc5a015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc59ea00640 1 -- 172.21.15.7:0/665886155 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883372244 0 0) 0x7fc5a00b3ab0 con 0x7fc5a00d2af0 2024-08-19T00:44:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.743+0000 7fc5a5200640 1 -- 172.21.15.7:0/665886155 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a00b3d60 con 0x7fc5a015ee50 2024-08-19T00:44:30.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.744+0000 7fc5a5200640 1 --2- 172.21.15.7:0/665886155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a00d2f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc598009e50 tx=0x7fc59802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08d3af1edfff44e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:30.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc59ea00640 1 -- 172.21.15.7:0/665886155 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598036070 con 0x7fc5a015ee50 2024-08-19T00:44:30.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc59ea00640 1 -- 172.21.15.7:0/665886155 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc598031600 con 0x7fc5a015ee50 2024-08-19T00:44:30.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc59ea00640 1 -- 172.21.15.7:0/665886155 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5980319d0 con 0x7fc5a015ee50 2024-08-19T00:44:30.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 -- 172.21.15.7:0/665886155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 msgr2=0x7fc5a00d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/665886155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a00d2f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc598009e50 tx=0x7fc59802a710 comp rx=0 tx=0).stop 2024-08-19T00:44:30.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 -- 172.21.15.7:0/665886155 shutdown_connections 2024-08-19T00:44:30.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/665886155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a00d2f80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/665886155 >> v2:172.21.15.162:3300/0 conn(0x7fc5a015e360 0x7fc5a015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 -- 172.21.15.7:0/665886155 >> 172.21.15.7:0/665886155 conn(0x7fc5a008dbf0 msgr2=0x7fc5a009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:30.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 -- 172.21.15.7:0/665886155 shutdown_connections 2024-08-19T00:44:30.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.745+0000 7fc5a5c00640 1 -- 172.21.15.7:0/665886155 wait complete. 2024-08-19T00:44:30.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.747+0000 7fc5a5c00640 1 Processor -- start 2024-08-19T00:44:30.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.747+0000 7fc5a5c00640 1 -- start start 2024-08-19T00:44:30.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc5a5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a00d2af0 0x7fc5a00b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:30.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc5a5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5a015e360 0x7fc5a015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc5a5c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a01544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc5a5c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00b4560 con 0x7fc5a015e360 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc5a5c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00d2300 con 0x7fc5a00d2af0 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc5a5c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a00b46e0 con 0x7fc5a015ee50 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc59f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5a015e360 0x7fc5a015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc59f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5a015e360 0x7fc5a015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40178/0 (socket says 172.21.15.7:40178) 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc59f400640 1 -- 172.21.15.7:0/248060843 learned_addr learned my addr 172.21.15.7:0/248060843 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc59fe00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a00d2af0 0x7fc5a00b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.748+0000 7fc5a5200640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a01544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc59f400640 1 -- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 msgr2=0x7fc5a01544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc59f400640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a01544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc59f400640 1 -- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a00d2af0 msgr2=0x7fc5a00b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc59f400640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a00d2af0 0x7fc5a00b8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc59f400640 1 -- 172.21.15.7:0/248060843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a00b9580 con 0x7fc5a015e360 2024-08-19T00:44:30.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc59f400640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5a015e360 0x7fc5a015ba30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00c4d0 tx=0x7fc58c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc597e00640 1 -- 172.21.15.7:0/248060843 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c018070 con 0x7fc5a015e360 2024-08-19T00:44:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc597e00640 1 -- 172.21.15.7:0/248060843 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58c007500 con 0x7fc5a015e360 2024-08-19T00:44:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc597e00640 1 -- 172.21.15.7:0/248060843 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c004a20 con 0x7fc5a015e360 2024-08-19T00:44:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.749+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a00b8740 con 0x7fc5a015e360 2024-08-19T00:44:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.750+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a00b8ce0 con 0x7fc5a015e360 2024-08-19T00:44:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.751+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a015fab0 con 0x7fc5a015e360 2024-08-19T00:44:30.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.752+0000 7fc597e00640 1 -- 172.21.15.7:0/248060843 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc58c004bc0 con 0x7fc5a015e360 2024-08-19T00:44:30.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.752+0000 7fc597e00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc58006be60 0x7fc58006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:30.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.753+0000 7fc597e00640 1 -- 172.21.15.7:0/248060843 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7fc58c08a380 con 0x7fc5a015e360 2024-08-19T00:44:30.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.753+0000 7fc59fe00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc58006be60 0x7fc58006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:30.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.753+0000 7fc59fe00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc58006be60 0x7fc58006e320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc590009b40 tx=0x7fc590009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:30.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.757+0000 7fc597e00640 1 -- 172.21.15.7:0/248060843 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc58c0583e0 con 0x7fc5a015e360 2024-08-19T00:44:30.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.979+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5a00d50d0 con 0x7fc5a015e360 2024-08-19T00:44:30.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.980+0000 7fc597e00640 1 -- 172.21.15.7:0/248060843 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5218 (secure 0 0 0) 0x7fc58c05c6e0 con 0x7fc5a015e360 2024-08-19T00:44:30.982 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:30.982 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":128,"btime":"2024-08-19T00:44:30:147162+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/877185885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":877185885},{"type":"v1","addr":"172.21.15.7:6837","nonce":877185885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:30.147148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"c","rank":0,"incarnation":128,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/918472079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":918472079},{"type":"v1","addr":"172.21.15.7:6836","nonce":918472079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:30.982 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 128 2024-08-19T00:44:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc58006be60 msgr2=0x7fc58006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc58006be60 0x7fc58006e320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc590009b40 tx=0x7fc590009190 comp rx=0 tx=0).stop 2024-08-19T00:44:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5a015e360 msgr2=0x7fc5a015ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5a015e360 0x7fc5a015ba30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00c4d0 tx=0x7fc58c00c990 comp rx=0 tx=0).stop 2024-08-19T00:44:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 shutdown_connections 2024-08-19T00:44:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc58006be60 0x7fc58006e320 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a015ee50 0x7fc5a01544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5a015e360 0x7fc5a015ba30 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 --2- 172.21.15.7:0/248060843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a00d2af0 0x7fc5a00b8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 >> 172.21.15.7:0/248060843 conn(0x7fc5a008dbf0 msgr2=0x7fc5a00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 shutdown_connections 2024-08-19T00:44:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:30.982+0000 7fc5a5c00640 1 -- 172.21.15.7:0/248060843 wait complete. 2024-08-19T00:44:31.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 128, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:44:30.147148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 93, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7851}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7851': {'gid': 7851, 'name': 'c', 'rank': 0, 'incarnation': 128, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6836/918472079', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 918472079}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 918472079}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:44:31.001 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7851:up:replay 2024-08-19T00:44:31.001 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:44:32.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:44:32.380 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:44:33.608 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:33.606+0000 7f0a35000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:36.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:36.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.574+0000 7f2b8da00640 1 Processor -- start 2024-08-19T00:44:36.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.574+0000 7f2b8da00640 1 -- start start 2024-08-19T00:44:36.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.575+0000 7f2b8da00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b880d03c0 0x7f2b88071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.575+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8806e710 0x7f2b880d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.575+0000 7f2b8da00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b880d0ce0 con 0x7f2b880b3750 2024-08-19T00:44:36.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.575+0000 7f2b8da00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2b880cebc0 con 0x7f2b880d03c0 2024-08-19T00:44:36.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.575+0000 7f2b8da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b880cdfb0 con 0x7f2b8806e710 2024-08-19T00:44:36.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.576+0000 7f2b7fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8806e710 0x7f2b880d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.576+0000 7f2b7fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8806e710 0x7f2b880d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:54452/0 (socket says 172.21.15.7:54452) 2024-08-19T00:44:36.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.576+0000 7f2b7fe00640 1 -- 172.21.15.7:0/2423503096 learned_addr learned my addr 172.21.15.7:0/2423503096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:36.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.576+0000 7f2b86a00640 1 --2- 172.21.15.7:0/2423503096 >> v2:172.21.15.162:3300/0 conn(0x7f2b880d03c0 0x7f2b88071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.577+0000 7f2b7fe00640 1 -- 172.21.15.7:0/2423503096 >> v2:172.21.15.162:3300/0 conn(0x7f2b880d03c0 msgr2=0x7f2b88071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:36.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.577+0000 7f2b7fe00640 1 --2- 172.21.15.7:0/2423503096 >> v2:172.21.15.162:3300/0 conn(0x7f2b880d03c0 0x7f2b88071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.577+0000 7f2b7fe00640 1 -- 172.21.15.7:0/2423503096 >> v1:172.21.15.162:6789/0 conn(0x7f2b880b3750 legacy=0x7f2b880cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.577+0000 7f2b7fe00640 1 -- 172.21.15.7:0/2423503096 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b880ce290 con 0x7f2b8806e710 2024-08-19T00:44:36.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.577+0000 7f2b86000640 1 -- 172.21.15.7:0/2423503096 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895640021 0 0) 0x7f2b880d0ce0 con 0x7f2b880b3750 2024-08-19T00:44:36.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.578+0000 7f2b7fe00640 1 --2- 172.21.15.7:0/2423503096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8806e710 0x7f2b880d07a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009870 tx=0x7f2b7002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbb0bf6a333ac42 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:36.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.578+0000 7f2b86000640 1 -- 172.21.15.7:0/2423503096 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70037070 con 0x7f2b8806e710 2024-08-19T00:44:36.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.578+0000 7f2b86000640 1 -- 172.21.15.7:0/2423503096 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b70032440 con 0x7f2b8806e710 2024-08-19T00:44:36.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.578+0000 7f2b86000640 1 -- 172.21.15.7:0/2423503096 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70032810 con 0x7f2b8806e710 2024-08-19T00:44:36.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.578+0000 7f2b8da00640 1 -- 172.21.15.7:0/2423503096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8806e710 msgr2=0x7f2b880d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.578+0000 7f2b8da00640 1 --2- 172.21.15.7:0/2423503096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8806e710 0x7f2b880d07a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009870 tx=0x7f2b7002a250 comp rx=0 tx=0).stop 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.579+0000 7f2b8da00640 1 -- 172.21.15.7:0/2423503096 shutdown_connections 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.579+0000 7f2b8da00640 1 --2- 172.21.15.7:0/2423503096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8806e710 0x7f2b880d07a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.579+0000 7f2b8da00640 1 --2- 172.21.15.7:0/2423503096 >> v2:172.21.15.162:3300/0 conn(0x7f2b880d03c0 0x7f2b88071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.579+0000 7f2b8da00640 1 -- 172.21.15.7:0/2423503096 >> 172.21.15.7:0/2423503096 conn(0x7f2b8806bc70 msgr2=0x7f2b8806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.579+0000 7f2b8da00640 1 -- 172.21.15.7:0/2423503096 shutdown_connections 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.579+0000 7f2b8da00640 1 -- 172.21.15.7:0/2423503096 wait complete. 2024-08-19T00:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.580+0000 7f2b8da00640 1 Processor -- start 2024-08-19T00:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.580+0000 7f2b8da00640 1 -- start start 2024-08-19T00:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.581+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806e710 0x7f2b881f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.581+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b880b3750 0x7f2b880c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.581+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b880d03c0 0x7f2b880cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.581+0000 7f2b8da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88073ae0 con 0x7f2b880b3750 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.581+0000 7f2b8da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880ce850 con 0x7f2b8806e710 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.581+0000 7f2b8da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b88073c60 con 0x7f2b880d03c0 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b880b3750 0x7f2b880c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b880b3750 0x7f2b880c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41662/0 (socket says 172.21.15.7:41662) 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 -- 172.21.15.7:0/772365497 learned_addr learned my addr 172.21.15.7:0/772365497 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b86a00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806e710 0x7f2b881f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b87400640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b880d03c0 0x7f2b880cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 -- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b880d03c0 msgr2=0x7f2b880cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b880d03c0 0x7f2b880cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 -- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806e710 msgr2=0x7f2b881f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806e710 0x7f2b881f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 -- 172.21.15.7:0/772365497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b880c9d00 con 0x7f2b880b3750 2024-08-19T00:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7fe00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b880b3750 0x7f2b880c9400 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009870 tx=0x7f2b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.582+0000 7f2b7ea00640 1 -- 172.21.15.7:0/772365497 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70037040 con 0x7f2b880b3750 2024-08-19T00:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.583+0000 7f2b7ea00640 1 -- 172.21.15.7:0/772365497 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b70004250 con 0x7f2b880b3750 2024-08-19T00:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.583+0000 7f2b7ea00640 1 -- 172.21.15.7:0/772365497 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7003c670 con 0x7f2b880b3750 2024-08-19T00:44:36.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.583+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b880c9fe0 con 0x7f2b880b3750 2024-08-19T00:44:36.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.583+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b880ca880 con 0x7f2b880b3750 2024-08-19T00:44:36.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.584+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b880b3be0 con 0x7f2b880b3750 2024-08-19T00:44:36.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.585+0000 7f2b7ea00640 1 -- 172.21.15.7:0/772365497 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b7003a070 con 0x7f2b880b3750 2024-08-19T00:44:36.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.585+0000 7f2b7ea00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6406be30 0x7f2b6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.586+0000 7f2b7ea00640 1 -- 172.21.15.7:0/772365497 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7f2b700ab940 con 0x7f2b880b3750 2024-08-19T00:44:36.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.586+0000 7f2b86a00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6406be30 0x7f2b6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.587+0000 7f2b86a00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6406be30 0x7f2b6406e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009ad0 tx=0x7f2b78008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:36.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.590+0000 7f2b7ea00640 1 -- 172.21.15.7:0/772365497 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2b70041020 con 0x7f2b880b3750 2024-08-19T00:44:36.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.812+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b880b2910 con 0x7f2b880b3750 2024-08-19T00:44:36.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.813+0000 7f2b7ea00640 1 -- 172.21.15.7:0/772365497 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 131 v131) ==== 95+0+5225 (secure 0 0 0) 0x7f2b7007a110 con 0x7f2b880b3750 2024-08-19T00:44:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:36.815 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":131,"btime":"2024-08-19T00:44:33:158560+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/877185885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":877185885},{"type":"v1","addr":"172.21.15.7:6837","nonce":877185885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:33.158551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/918472079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":918472079},{"type":"v1","addr":"172.21.15.7:6836","nonce":918472079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7851,"qdb_cluster":[7851]},"id":6}]} 2024-08-19T00:44:36.816 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 131 2024-08-19T00:44:36.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6406be30 msgr2=0x7f2b6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6406be30 0x7f2b6406e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009ad0 tx=0x7f2b78008040 comp rx=0 tx=0).stop 2024-08-19T00:44:36.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b880b3750 msgr2=0x7f2b880c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b880b3750 0x7f2b880c9400 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009870 tx=0x7f2b700046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 shutdown_connections 2024-08-19T00:44:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2b6406be30 0x7f2b6406e2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b880d03c0 0x7f2b880cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b880b3750 0x7f2b880c9400 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 --2- 172.21.15.7:0/772365497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806e710 0x7f2b881f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 >> 172.21.15.7:0/772365497 conn(0x7f2b8806bc70 msgr2=0x7f2b880afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 shutdown_connections 2024-08-19T00:44:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.815+0000 7f2b8da00640 1 -- 172.21.15.7:0/772365497 wait complete. 2024-08-19T00:44:36.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 131, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:44:33.158551+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 93, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7851}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7851': {'gid': 7851, 'name': 'c', 'rank': 0, 'incarnation': 128, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/918472079', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 918472079}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 918472079}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7851, 'qdb_cluster': [7851]} 2024-08-19T00:44:36.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:44:36.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:44:36.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.989+0000 7f986b200640 1 Processor -- start 2024-08-19T00:44:36.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.989+0000 7f986b200640 1 -- start start 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.990+0000 7f986b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.990+0000 7f986b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f986c0d27b0 0x7f986c0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.990+0000 7f986b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f986c0b4150 0x7f986c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f986b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f986c0d3110 con 0x7f986c0d27b0 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f986b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f986c0b4b20 con 0x7f986c0b4150 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f986b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f986c0b4df0 con 0x7f986c15e3e0 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f986c0d27b0 0x7f986c0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f986c0d27b0 0x7f986c0d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41674/0 (socket says 172.21.15.7:41674) 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 -- 172.21.15.7:0/2676860342 learned_addr learned my addr 172.21.15.7:0/2676860342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869e00640 1 --2- 172.21.15.7:0/2676860342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f986a800640 1 --2- 172.21.15.7:0/2676860342 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b4150 0x7f986c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 -- 172.21.15.7:0/2676860342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 msgr2=0x7f986c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 --2- 172.21.15.7:0/2676860342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 -- 172.21.15.7:0/2676860342 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b4150 msgr2=0x7f986c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 --2- 172.21.15.7:0/2676860342 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b4150 0x7f986c0b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.991+0000 7f9869400640 1 -- 172.21.15.7:0/2676860342 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c0b50d0 con 0x7f986c0d27b0 2024-08-19T00:44:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.992+0000 7f9869400640 1 --2- 172.21.15.7:0/2676860342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0d27b0 0x7f986c0d2bd0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f986c161d70 tx=0x7f985802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b787272ab61f1ce0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f9868a00640 1 -- 172.21.15.7:0/2676860342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858037070 con 0x7f986c0d27b0 2024-08-19T00:44:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f9868a00640 1 -- 172.21.15.7:0/2676860342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9858032440 con 0x7f986c0d27b0 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f9868a00640 1 -- 172.21.15.7:0/2676860342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858032810 con 0x7f986c0d27b0 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 -- 172.21.15.7:0/2676860342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0d27b0 msgr2=0x7f986c0d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 --2- 172.21.15.7:0/2676860342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0d27b0 0x7f986c0d2bd0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f986c161d70 tx=0x7f985802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 -- 172.21.15.7:0/2676860342 shutdown_connections 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 --2- 172.21.15.7:0/2676860342 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b4150 0x7f986c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 --2- 172.21.15.7:0/2676860342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0d27b0 0x7f986c0d2bd0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 --2- 172.21.15.7:0/2676860342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 -- 172.21.15.7:0/2676860342 >> 172.21.15.7:0/2676860342 conn(0x7f986c08dbe0 msgr2=0x7f986c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 -- 172.21.15.7:0/2676860342 shutdown_connections 2024-08-19T00:44:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.993+0000 7f986b200640 1 -- 172.21.15.7:0/2676860342 wait complete. 2024-08-19T00:44:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.995+0000 7f986b200640 1 Processor -- start 2024-08-19T00:44:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.995+0000 7f986b200640 1 -- start start 2024-08-19T00:44:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f986b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0b4150 0x7f986c0b9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f986b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0d27b0 0x7f986c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f986b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f986b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0cee90 con 0x7f986c0b4150 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f986b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0cf4c0 con 0x7f986c0d27b0 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f986b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f986c0b13a0 con 0x7f986c15e3e0 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f9869e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0b4150 0x7f986c0b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f9869e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0b4150 0x7f986c0b9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41682/0 (socket says 172.21.15.7:41682) 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f9869e00640 1 -- 172.21.15.7:0/2101789321 learned_addr learned my addr 172.21.15.7:0/2101789321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.996+0000 7f986a800640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869400640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0d27b0 0x7f986c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869e00640 1 -- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 msgr2=0x7f986c1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869e00640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c1572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869e00640 1 -- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0d27b0 msgr2=0x7f986c156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869e00640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0d27b0 0x7f986c156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869e00640 1 -- 172.21.15.7:0/2101789321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c0b7830 con 0x7f986c0b4150 2024-08-19T00:44:37.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869400640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0d27b0 0x7f986c156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:37.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9869e00640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0b4150 0x7f986c0b9890 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d5f0 tx=0x7f985c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9862000640 1 -- 172.21.15.7:0/2101789321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c0125f0 con 0x7f986c0b4150 2024-08-19T00:44:37.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9862000640 1 -- 172.21.15.7:0/2101789321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985c019070 con 0x7f986c0b4150 2024-08-19T00:44:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f9862000640 1 -- 172.21.15.7:0/2101789321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c0129d0 con 0x7f986c0b4150 2024-08-19T00:44:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.997+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c15b4a0 con 0x7f986c0b4150 2024-08-19T00:44:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:36.998+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c0b73a0 con 0x7f986c0b4150 2024-08-19T00:44:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.000+0000 7f9862000640 1 -- 172.21.15.7:0/2101789321 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f985c012b70 con 0x7f986c0b4150 2024-08-19T00:44:37.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.001+0000 7f9862000640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f984c06be60 0x7f984c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.001+0000 7f9862000640 1 -- 172.21.15.7:0/2101789321 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7f985c08b420 con 0x7f986c0b4150 2024-08-19T00:44:37.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.001+0000 7f9869400640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f984c06be60 0x7f984c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.002+0000 7f98739d2740 1 Processor -- start 2024-08-19T00:44:37.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.002+0000 7f98739d2740 1 -- start start 2024-08-19T00:44:37.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.002+0000 7f9869400640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f984c06be60 0x7f984c06e320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9858034000 tx=0x7f985802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f98739d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cb630 0x55db493cba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cbf90 0x55db493c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f98739d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db492e0ba0 con 0x55db493a8110 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55db49279230 con 0x55db493cbf90 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55db492dcb60 con 0x55db493cb630 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41686/0 (socket says 172.21.15.7:41686) 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 -- 172.21.15.7:0/468857924 learned_addr learned my addr 172.21.15.7:0/468857924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869400640 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cb630 0x55db493cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f986a800640 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cbf90 0x55db493c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 -- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cb630 msgr2=0x55db493cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cb630 0x55db493cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 -- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cbf90 msgr2=0x55db493c0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cbf90 0x55db493c0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f9869e00640 1 -- 172.21.15.7:0/468857924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db492aabb0 con 0x55db493a8110 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.003+0000 7f986a800640 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cbf90 0x55db493c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.004+0000 7f9869e00640 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493a84f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f985c089590 tx=0x7f985c059b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe297c3eb295fe0e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.004+0000 7f9856600640 1 -- 172.21.15.7:0/468857924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c061fb0 con 0x55db493a8110 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.004+0000 7f9856600640 1 -- 172.21.15.7:0/468857924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985c0576d0 con 0x55db493a8110 2024-08-19T00:44:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.004+0000 7f9856600640 1 -- 172.21.15.7:0/468857924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c08b070 con 0x55db493a8110 2024-08-19T00:44:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.004+0000 7f98739d2740 1 -- 172.21.15.7:0/468857924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 msgr2=0x55db493a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.004+0000 7f98739d2740 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493a84f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f985c089590 tx=0x7f985c059b90 comp rx=0 tx=0).stop 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 -- 172.21.15.7:0/468857924 shutdown_connections 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cbf90 0x55db493c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cb630 0x55db493cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 --2- 172.21.15.7:0/468857924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493a84f0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 -- 172.21.15.7:0/468857924 >> 172.21.15.7:0/468857924 conn(0x55db49345110 msgr2=0x55db493c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 -- 172.21.15.7:0/468857924 shutdown_connections 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 -- 172.21.15.7:0/468857924 wait complete. 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.005+0000 7f98739d2740 1 -- start start 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.006+0000 7f98739d2740 1 Processor -- start 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49379c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f98739d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db493a1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db493a4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f98739d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db493c5060 con 0x55db493cb630 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55db4929c250 con 0x55db493a8110 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55db493c4770 con 0x55db493cbf90 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f98739d2740 10 client.0 _ll_register_callbacks cb 0x55db492a0740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db493a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db493a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41690/0 (socket says 172.21.15.7:41690) 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 -- 172.21.15.7:0/2087588359 learned_addr learned my addr 172.21.15.7:0/2087588359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869e00640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49379c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f986a800640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db493a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 -- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 msgr2=0x55db493a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db493a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 -- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 msgr2=0x55db49379c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49379c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869400640 1 -- 172.21.15.7:0/2087588359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db48ff42d0 con 0x55db493cb630 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.007+0000 7f9869e00640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49379c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f9869400640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db493a1980 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f9858009960 tx=0x7f9858004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d95ef31a6f31f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f984aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f984aa00640 1 -- 172.21.15.7:0/2087588359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858037040 con 0x55db493cb630 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f985c0576d0 con 0x55db493cb630 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f984aa00640 1 -- 172.21.15.7:0/2087588359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7f985803c850 con 0x55db493cb630 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f984aa00640 1 -- 172.21.15.7:0/2087588359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=131) ==== 24+0+0 (secure 0 0 0) 0x7f9858057050 con 0x55db493cb630 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f98739d2740 10 client.7905 fetch_fsmap learned FSMap version 131 2024-08-19T00:44:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.008+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=131,monmap=2+}) -- 0x55db490be6b0 con 0x55db493cb630 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f984aa00640 1 -- 172.21.15.7:0/2087588359 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985c0576d0 con 0x55db493cb630 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f984aa00640 1 -- 172.21.15.7:0/2087588359 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 131) ==== 3502+0+0 (secure 0 0 0) 0x7f985805a020 con 0x55db493cb630 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f98739d2740 10 client.7905 fetch_fsmap finished waiting for FSMap version 131 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f98739d2740 10 client.7905 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f98739d2740 20 client.7905 populate_metadata read hostname 'smithi007' 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f98739d2740 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bd6d0 0x55db4937cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f98739d2740 4 client.7905 mds_command: new command op to 7851 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:44:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 --> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db492ee2d0 con 0x55db493bd6d0 2024-08-19T00:44:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.009+0000 7f9869e00640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bd6d0 0x55db4937cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.010+0000 7f9869e00640 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bd6d0 0x55db4937cf90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3a53e0cdc86c89 server_cookie=f7826653c612604d in_seq=0 out_seq=0 2024-08-19T00:44:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.010+0000 7f984aa00640 10 client.7905 ms_handle_connect on v2:172.21.15.7:6834/918472079 2024-08-19T00:44:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.010+0000 7f984aa00640 1 -- 172.21.15.7:0/2087588359 <== mds.0 v2:172.21.15.7:6834/918472079 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db492ee2d0 con 0x55db493bd6d0 2024-08-19T00:44:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.010+0000 7f984aa00640 10 client.7905 handle_command_reply: tid=0 2024-08-19T00:44:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.010+0000 7f98739d2740 1 client.7905 shutdown 2024-08-19T00:44:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 msgr2=0x55db493a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db493a1980 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f9858009960 tx=0x7f9858004730 comp rx=0 tx=0).stop 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 shutdown_connections 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bd6d0 0x55db4937cf90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db493a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db493a1980 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 --2- 172.21.15.7:0/2087588359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49379c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f984aa00640 0 client.7905 ms_handle_reset on v2:172.21.15.7:6834/918472079 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 >> 172.21.15.7:0/2087588359 conn(0x55db49345110 msgr2=0x55db493c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 shutdown_connections 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 1 -- 172.21.15.7:0/2087588359 wait complete. 2024-08-19T00:44:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.011+0000 7f98739d2740 20 client.7905 trim_cache size 0 max 16384 2024-08-19T00:44:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.030+0000 7f98739d2740 1 Processor -- start 2024-08-19T00:44:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.030+0000 7f98739d2740 1 -- start start 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f98739d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cb630 0x55db493a1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db493a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f98739d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1ffc90 con 0x55db493a8110 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1feff0 con 0x55db493cb630 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f986c1ff640 con 0x55db493cbf90 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493bf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41694/0 (socket says 172.21.15.7:41694) 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 -- 172.21.15.7:0/694836462 learned_addr learned my addr 172.21.15.7:0/694836462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 -- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 msgr2=0x55db493a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db493a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 -- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cb630 msgr2=0x55db493a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869400640 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cb630 0x55db493a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cb630 0x55db493a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869e00640 1 -- 172.21.15.7:0/694836462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db493a7d50 con 0x55db493a8110 2024-08-19T00:44:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.031+0000 7f9869400640 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cb630 0x55db493a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f9869e00640 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493bf6e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f985c059c80 tx=0x7f985c08b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98089fbadc3d448c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f9855c00640 1 -- 172.21.15.7:0/694836462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c055670 con 0x55db493a8110 2024-08-19T00:44:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f9855c00640 1 -- 172.21.15.7:0/694836462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985c089350 con 0x55db493a8110 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f9855c00640 1 -- 172.21.15.7:0/694836462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c0576d0 con 0x55db493a8110 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f98739d2740 1 -- 172.21.15.7:0/694836462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 msgr2=0x55db493bf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f98739d2740 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493bf6e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f985c059c80 tx=0x7f985c08b000 comp rx=0 tx=0).stop 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f98739d2740 1 -- 172.21.15.7:0/694836462 shutdown_connections 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f98739d2740 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db493a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f98739d2740 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493cb630 0x55db493a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f98739d2740 1 --2- 172.21.15.7:0/694836462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493a8110 0x55db493bf6e0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.032+0000 7f98739d2740 1 -- 172.21.15.7:0/694836462 >> 172.21.15.7:0/694836462 conn(0x55db49345110 msgr2=0x55db493a84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.033+0000 7f98739d2740 1 -- 172.21.15.7:0/694836462 shutdown_connections 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.033+0000 7f98739d2740 1 -- 172.21.15.7:0/694836462 wait complete. 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.033+0000 7f98739d2740 1 -- start start 2024-08-19T00:44:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.033+0000 7f98739d2740 1 Processor -- start 2024-08-19T00:44:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49429eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f98739d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db4937d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f98739d2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db49440a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f98739d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db493bd550 con 0x55db493cb630 2024-08-19T00:44:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55db4937ddb0 con 0x55db493a8110 2024-08-19T00:44:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f98739d2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55db493bdb70 con 0x55db493cbf90 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f98739d2740 10 client.0 _ll_register_callbacks cb 0x7f98580096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.034+0000 7f9869400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db4937d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db4937d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41696/0 (socket says 172.21.15.7:41696) 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 -- 172.21.15.7:0/2022755792 learned_addr learned my addr 172.21.15.7:0/2022755792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869e00640 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49429eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f986a800640 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db49440a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 -- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 msgr2=0x55db49440a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db49440a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 -- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 msgr2=0x55db49429eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49429eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 -- 172.21.15.7:0/2022755792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db493bf280 con 0x55db493cb630 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f9869400640 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db4937d600 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9858009630 tx=0x7f985803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3c1da94c916fd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f984aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f984aa00640 1 -- 172.21.15.7:0/2022755792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858037040 con 0x55db493cb630 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f984aa00640 1 -- 172.21.15.7:0/2022755792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7f9858052550 con 0x55db493cb630 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.035+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f985c089350 con 0x55db493cb630 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f984aa00640 1 -- 172.21.15.7:0/2022755792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=131) ==== 24+0+0 (secure 0 0 0) 0x7f9858068050 con 0x55db493cb630 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 10 client.7911 fetch_fsmap learned FSMap version 131 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=131,monmap=2+}) -- 0x55db4937db40 con 0x55db493cb630 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f984aa00640 1 -- 172.21.15.7:0/2022755792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985c089350 con 0x55db493cb630 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f984aa00640 1 -- 172.21.15.7:0/2022755792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 131) ==== 3502+0+0 (secure 0 0 0) 0x7f985806b020 con 0x55db493cb630 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 10 client.7911 fetch_fsmap finished waiting for FSMap version 131 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 10 client.7911 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:44:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 20 client.7911 populate_metadata read hostname 'smithi007' 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bf9d0 0x55db493bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 4 client.7911 mds_command: new command op to 7851 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 --> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] -- command(tid 0: {"prefix": "status"}) -- 0x55db492e8620 con 0x55db493bf9d0 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.036+0000 7f9869e00640 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bf9d0 0x55db493bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f9869e00640 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bf9d0 0x55db493bbe40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94860d05076bb656 server_cookie=5f4c5b481ec9e4cf in_seq=0 out_seq=0 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f984aa00640 10 client.7911 ms_handle_connect on v2:172.21.15.7:6834/918472079 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f984aa00640 1 -- 172.21.15.7:0/2022755792 <== mds.0 v2:172.21.15.7:6834/918472079 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55db492e8620 con 0x55db493bf9d0 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f984aa00640 10 client.7911 handle_command_reply: tid=0 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 client.7911 shutdown 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 msgr2=0x55db4937d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db4937d600 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9858009630 tx=0x7f985803c000 comp rx=0 tx=0).stop 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 shutdown_connections 2024-08-19T00:44:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:6834/918472079,v1:172.21.15.7:6836/918472079] conn(0x55db493bf9d0 0x55db493bbe40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55db493cbf90 0x55db49440a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db493cb630 0x55db4937d600 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f984aa00640 0 client.7911 ms_handle_reset on v2:172.21.15.7:6834/918472079 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 --2- 172.21.15.7:0/2022755792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db493a8110 0x55db49429eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 >> 172.21.15.7:0/2022755792 conn(0x55db49345110 msgr2=0x55db493a1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 shutdown_connections 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.037+0000 7f98739d2740 1 -- 172.21.15.7:0/2022755792 wait complete. 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f98739d2740 20 client.7911 trim_cache size 0 max 16384 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:44:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7851, 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8883233930000003, 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 131, 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 93, 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 9.3845928829999998 2024-08-19T00:44:37.045 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:44:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f984c06be60 msgr2=0x7f984c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f984c06be60 0x7f984c06e320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9858034000 tx=0x7f985802e000 comp rx=0 tx=0).stop 2024-08-19T00:44:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0b4150 msgr2=0x7f986c0b9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0b4150 0x7f986c0b9890 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d5f0 tx=0x7f985c00dab0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 shutdown_connections 2024-08-19T00:44:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f984c06be60 0x7f984c06e320 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c15e3e0 0x7f986c1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0d27b0 0x7f986c156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 --2- 172.21.15.7:0/2101789321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f986c0b4150 0x7f986c0b9890 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 >> 172.21.15.7:0/2101789321 conn(0x7f986c08dbe0 msgr2=0x7f986c0b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 shutdown_connections 2024-08-19T00:44:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.038+0000 7f986b200640 1 -- 172.21.15.7:0/2101789321 wait complete. 2024-08-19T00:44:37.055 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:44:37.055 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 500.00000000', proceeding to ls 2024-08-19T00:44:37.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:44:37.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.211+0000 7f426a600640 1 Processor -- start 2024-08-19T00:44:37.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.211+0000 7f426a600640 1 -- start start 2024-08-19T00:44:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.212+0000 7f426a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640ce500 0x7f42640ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.212+0000 7f426a600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42640d03c0 0x7f42640d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.212+0000 7f426a600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f426406f7f0 con 0x7f4264159bf0 2024-08-19T00:44:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.212+0000 7f426a600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f42640cee80 con 0x7f42640d03c0 2024-08-19T00:44:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.212+0000 7f426a600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42640d0d70 con 0x7f42640ce500 2024-08-19T00:44:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f4263e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42640d03c0 0x7f42640d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f4263e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42640d03c0 0x7f42640d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41700/0 (socket says 172.21.15.7:41700) 2024-08-19T00:44:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f4263e00640 1 -- 172.21.15.7:0/791703936 learned_addr learned my addr 172.21.15.7:0/791703936 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f425be00640 1 --2- 172.21.15.7:0/791703936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640ce500 0x7f42640ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f4263e00640 1 -- 172.21.15.7:0/791703936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640ce500 msgr2=0x7f42640ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f4263e00640 1 --2- 172.21.15.7:0/791703936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640ce500 0x7f42640ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f4263e00640 1 -- 172.21.15.7:0/791703936 >> v1:172.21.15.162:6789/0 conn(0x7f4264159bf0 legacy=0x7f4264073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.213+0000 7f4263e00640 1 -- 172.21.15.7:0/791703936 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426406f510 con 0x7f42640d03c0 2024-08-19T00:44:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.214+0000 7f4263e00640 1 --2- 172.21.15.7:0/791703936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42640d03c0 0x7f42640d0830 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f425c009e50 tx=0x7f425c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f1cf41d6f61b2b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.214+0000 7f4262a00640 1 -- 172.21.15.7:0/791703936 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c036070 con 0x7f42640d03c0 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f4262a00640 1 -- 172.21.15.7:0/791703936 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c031600 con 0x7f42640d03c0 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f4262a00640 1 -- 172.21.15.7:0/791703936 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0319d0 con 0x7f42640d03c0 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 -- 172.21.15.7:0/791703936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42640d03c0 msgr2=0x7f42640d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 --2- 172.21.15.7:0/791703936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42640d03c0 0x7f42640d0830 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f425c009e50 tx=0x7f425c02a680 comp rx=0 tx=0).stop 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 -- 172.21.15.7:0/791703936 shutdown_connections 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 --2- 172.21.15.7:0/791703936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42640d03c0 0x7f42640d0830 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 --2- 172.21.15.7:0/791703936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640ce500 0x7f42640ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 -- 172.21.15.7:0/791703936 >> 172.21.15.7:0/791703936 conn(0x7f426406bc70 msgr2=0x7f426406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:37.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 -- 172.21.15.7:0/791703936 shutdown_connections 2024-08-19T00:44:37.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.215+0000 7f426a600640 1 -- 172.21.15.7:0/791703936 wait complete. 2024-08-19T00:44:37.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.217+0000 7f426a600640 1 Processor -- start 2024-08-19T00:44:37.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.217+0000 7f426a600640 1 -- start start 2024-08-19T00:44:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f426a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42640ce500 0x7f426414c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f426a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640d03c0 0x7f42641e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f426a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4264159bf0 0x7f426414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f426a600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4264072f40 con 0x7f4264159bf0 2024-08-19T00:44:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f426a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4264072c60 con 0x7f42640ce500 2024-08-19T00:44:37.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f426a600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4264073b70 con 0x7f42640d03c0 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f4263e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4264159bf0 0x7f426414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f4263e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4264159bf0 0x7f426414da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41716/0 (socket says 172.21.15.7:41716) 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f4263e00640 1 -- 172.21.15.7:0/2433411062 learned_addr learned my addr 172.21.15.7:0/2433411062 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f4263400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42640ce500 0x7f426414c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f425be00640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640d03c0 0x7f42641e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.218+0000 7f4263e00640 1 -- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640d03c0 msgr2=0x7f42641e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f4263e00640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640d03c0 0x7f42641e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f4263e00640 1 -- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42640ce500 msgr2=0x7f426414c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f4263e00640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42640ce500 0x7f426414c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f4263e00640 1 -- 172.21.15.7:0/2433411062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426414c9b0 con 0x7f4264159bf0 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f425be00640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640d03c0 0x7f42641e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:37.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f4263e00640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4264159bf0 0x7f426414da00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f425c009f70 tx=0x7f425c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f425b400640 1 -- 172.21.15.7:0/2433411062 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c03f020 con 0x7f4264159bf0 2024-08-19T00:44:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f425b400640 1 -- 172.21.15.7:0/2433411062 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c037040 con 0x7f4264159bf0 2024-08-19T00:44:37.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f425b400640 1 -- 172.21.15.7:0/2433411062 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c036070 con 0x7f4264159bf0 2024-08-19T00:44:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42641e6530 con 0x7f4264159bf0 2024-08-19T00:44:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.219+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426414d200 con 0x7f4264159bf0 2024-08-19T00:44:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.220+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426414cd40 con 0x7f4264159bf0 2024-08-19T00:44:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.221+0000 7f425b400640 1 -- 172.21.15.7:0/2433411062 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f425c042020 con 0x7f4264159bf0 2024-08-19T00:44:37.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.222+0000 7f425b400640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:37.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.222+0000 7f425b400640 1 -- 172.21.15.7:0/2433411062 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7f425c0ab3f0 con 0x7f4264159bf0 2024-08-19T00:44:37.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.222+0000 7f4263400640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:37.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.223+0000 7f4263400640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4254001780 tx=0x7f4254009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:37.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.226+0000 7f425b400640 1 -- 172.21.15.7:0/2433411062 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f426414cd40 con 0x7f4264159bf0 2024-08-19T00:44:37.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.448+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4264159fd0 con 0x7f4264159bf0 2024-08-19T00:44:37.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.448+0000 7f425b400640 1 -- 172.21.15.7:0/2433411062 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v131) ==== 53+0+73 (secure 0 0 0) 0x7f425c049030 con 0x7f4264159bf0 2024-08-19T00:44:37.450 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:44:37.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 msgr2=0x7f424006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4254001780 tx=0x7f4254009040 comp rx=0 tx=0).stop 2024-08-19T00:44:37.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4264159bf0 msgr2=0x7f426414da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:37.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4264159bf0 0x7f426414da00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f425c009f70 tx=0x7f425c004a40 comp rx=0 tx=0).stop 2024-08-19T00:44:37.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 shutdown_connections 2024-08-19T00:44:37.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4264159bf0 0x7f426414da00 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42640d03c0 0x7f42641e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 --2- 172.21.15.7:0/2433411062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42640ce500 0x7f426414c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:37.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 >> 172.21.15.7:0/2433411062 conn(0x7f426406bc70 msgr2=0x7f4264074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:37.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 shutdown_connections 2024-08-19T00:44:37.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37.450+0000 7f426a600640 1 -- 172.21.15.7:0/2433411062 wait complete. 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:44:37.468 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:44:37.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:37.469 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:44:37.504 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42384sec preferred_lft 42384sec 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:44:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:44:37.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:37.508 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:44:37.599 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:44:37.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:37.602 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:44:37.638 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:44:37.639 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:44:37.639 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:44:37.639 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:44:37.639 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:44:37.639 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:44:37.639 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:44:37.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:44:37.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:44:37.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:44:37.639 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:44:37.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:44:37.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:44:37.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:37.839 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:44:37.875 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:44:37.875 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:44:37.875 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:44:37.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:37.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:44:37.971 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:44:37.971 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:38.006 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:44:38.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:44:38.007 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:38.081 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:44:38.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:38.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:38.211 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:38.212 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:44:38.212 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:44:38.227 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:38.227 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:44:38.227 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:44:38.227 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:44:38.228 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:44:38.250 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:44:38.250 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:44:38.250 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:44:38.250 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:44:38.250 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:44:38.251 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:44:38.251 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:44:38.251 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:44:38.252 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:44:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:44:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:44:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:44:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:44:38.255 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:44:38.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:38.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:44:38.312 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:44:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:44:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:44:38.402 INFO:teuthology.orchestra.run.smithi007.stdout:client7456 2024-08-19T00:44:38.403 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:38.403 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:38.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:38.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:44:38.483 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:44:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:44:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:44:38.516 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:44:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:sixmegs 2024-08-19T00:44:38.517 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 500.00000000' did not caused DAMAGED state 2024-08-19T00:44:38.517 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds_snaptable' 2024-08-19T00:44:38.517 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:38.517 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:38.593 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:38.593 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:38.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:44:38.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.866+0000 7feeaf000640 1 Processor -- start 2024-08-19T00:44:38.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.866+0000 7feeaf000640 1 -- start start 2024-08-19T00:44:38.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.867+0000 7feeaf000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feea806fc10 0x7feea806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:38.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.867+0000 7feeaf000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea806cf60 con 0x7feea806fff0 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.867+0000 7feeaf000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea806d200 con 0x7feea80b5620 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.867+0000 7feeaf000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feea8162d90 con 0x7feea806fc10 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.867+0000 7feead200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feea806fff0 0x7feea80b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59216/0 (socket says 172.21.15.7:59216) 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.867+0000 7feead200640 1 -- 172.21.15.7:0/2682100614 learned_addr learned my addr 172.21.15.7:0/2682100614 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.868+0000 7feeadc00640 1 --2- 172.21.15.7:0/2682100614 >> v2:172.21.15.162:3300/0 conn(0x7feea806fc10 0x7feea806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.868+0000 7feea7e00640 1 -- 172.21.15.7:0/2682100614 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149238366 0 0) 0x7feea806cf60 con 0x7feea806fff0 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.868+0000 7feea7e00640 1 -- 172.21.15.7:0/2682100614 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee90003520 con 0x7feea806fff0 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.868+0000 7feeadc00640 1 -- 172.21.15.7:0/2682100614 >> v1:172.21.15.162:6789/0 conn(0x7feea80b5620 legacy=0x7feea815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.868+0000 7feeadc00640 1 -- 172.21.15.7:0/2682100614 >> v1:172.21.15.7:6789/0 conn(0x7feea806fff0 legacy=0x7feea80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.868+0000 7feeadc00640 1 -- 172.21.15.7:0/2682100614 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea806d4e0 con 0x7feea806fc10 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.869+0000 7feeadc00640 1 --2- 172.21.15.7:0/2682100614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea806dce0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0097a0 tx=0x7fee9c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63410f3f7b9d94e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.869+0000 7feea7e00640 1 -- 172.21.15.7:0/2682100614 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c037070 con 0x7feea806fc10 2024-08-19T00:44:38.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feea7e00640 1 -- 172.21.15.7:0/2682100614 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c032440 con 0x7feea806fc10 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feea7e00640 1 -- 172.21.15.7:0/2682100614 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c032810 con 0x7feea806fc10 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feeaf000640 1 -- 172.21.15.7:0/2682100614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 msgr2=0x7feea806dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feeaf000640 1 --2- 172.21.15.7:0/2682100614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea806dce0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0097a0 tx=0x7fee9c02a1a0 comp rx=0 tx=0).stop 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feeaf000640 1 -- 172.21.15.7:0/2682100614 shutdown_connections 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feeaf000640 1 --2- 172.21.15.7:0/2682100614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea806dce0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feeaf000640 1 -- 172.21.15.7:0/2682100614 >> 172.21.15.7:0/2682100614 conn(0x7feea80d1fa0 msgr2=0x7feea80d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feeaf000640 1 -- 172.21.15.7:0/2682100614 shutdown_connections 2024-08-19T00:44:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.870+0000 7feeaf000640 1 -- 172.21.15.7:0/2682100614 wait complete. 2024-08-19T00:44:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.872+0000 7feeaf000640 1 Processor -- start 2024-08-19T00:44:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.872+0000 7feeaf000640 1 -- start start 2024-08-19T00:44:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeaf000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeaf000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feea806fff0 0x7feea80d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeaf000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b5620 0x7feea8162590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeaf000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feea8147ee0 con 0x7feea80b5620 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeaf000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feea806d850 con 0x7feea806fc10 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeaf000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feea8070430 con 0x7feea806fff0 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeae600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b5620 0x7feea8162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeae600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b5620 0x7feea8162590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41730/0 (socket says 172.21.15.7:41730) 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeae600640 1 -- 172.21.15.7:0/96450429 learned_addr learned my addr 172.21.15.7:0/96450429 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feeadc00640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.873+0000 7feead200640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feea806fff0 0x7feea80d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeae600640 1 -- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feea806fff0 msgr2=0x7feea80d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeae600640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feea806fff0 0x7feea80d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeae600640 1 -- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 msgr2=0x7feea815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeae600640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea815dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeae600640 1 -- 172.21.15.7:0/96450429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea8162ad0 con 0x7feea80b5620 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeadc00640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feead200640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feea806fff0 0x7feea80d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeae600640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b5620 0x7feea8162590 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7feea000c730 tx=0x7feea000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feea5600640 1 -- 172.21.15.7:0/96450429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0003b70 con 0x7feea80b5620 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feea5600640 1 -- 172.21.15.7:0/96450429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea0003d10 con 0x7feea80b5620 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feea5600640 1 -- 172.21.15.7:0/96450429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea000aa90 con 0x7feea80b5620 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea80cbd40 con 0x7feea80b5620 2024-08-19T00:44:38.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.874+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea80cc300 con 0x7feea80b5620 2024-08-19T00:44:38.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.875+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea80b1810 con 0x7feea80b5620 2024-08-19T00:44:38.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.876+0000 7feea5600640 1 -- 172.21.15.7:0/96450429 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feea000ac30 con 0x7feea80b5620 2024-08-19T00:44:38.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.877+0000 7feea5600640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee8806be30 0x7fee8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:38.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.877+0000 7feea5600640 1 -- 172.21.15.7:0/96450429 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7feea008b100 con 0x7feea80b5620 2024-08-19T00:44:38.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.877+0000 7feeadc00640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee8806be30 0x7fee8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:38.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.878+0000 7feeadc00640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee8806be30 0x7fee8806e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fee9c034000 tx=0x7fee9c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:38.882+0000 7feea5600640 1 -- 172.21.15.7:0/96450429 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feea0059730 con 0x7feea80b5620 2024-08-19T00:44:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.076+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feea806cc10 con 0x7feea80b5620 2024-08-19T00:44:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.077+0000 7feea5600640 1 -- 172.21.15.7:0/96450429 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 14 entries v93) ==== 81+0+852 (secure 0 0 0) 0x7feea0059030 con 0x7feea80b5620 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:44:39.079 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:44:39.080 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:44:39.080 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:44:39.080 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:listed 14 entries 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee8806be30 msgr2=0x7fee8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee8806be30 0x7fee8806e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fee9c034000 tx=0x7fee9c02e000 comp rx=0 tx=0).stop 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b5620 msgr2=0x7feea8162590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b5620 0x7feea8162590 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7feea000c730 tx=0x7feea000cbf0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 shutdown_connections 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee8806be30 0x7fee8806e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feea80b5620 0x7feea8162590 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feea806fff0 0x7feea80d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 --2- 172.21.15.7:0/96450429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea806fc10 0x7feea815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 >> 172.21.15.7:0/96450429 conn(0x7feea80d1fa0 msgr2=0x7feea81437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 shutdown_connections 2024-08-19T00:44:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.079+0000 7feeaf000640 1 -- 172.21.15.7:0/96450429 wait complete. 2024-08-19T00:44:39.096 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:44:39.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:39.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:44:39.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:39.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:39.178 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:39.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:39.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.412+0000 7fc160e00640 1 Processor -- start 2024-08-19T00:44:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.412+0000 7fc160e00640 1 -- start start 2024-08-19T00:44:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.413+0000 7fc160e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc15c06cad0 0x7fc15c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.413+0000 7fc160e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc15c15dc30 0x7fc15c15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.413+0000 7fc160e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c0ae780 con 0x7fc15c06ceb0 2024-08-19T00:44:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.413+0000 7fc160e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc15c0b5dd0 con 0x7fc15c15dc30 2024-08-19T00:44:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.413+0000 7fc160e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc15c0aea00 con 0x7fc15c06cad0 2024-08-19T00:44:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.413+0000 7fc15a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc15c15dc30 0x7fc15c15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc159400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc15c06ceb0 0x7fc15c0b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59224/0 (socket says 172.21.15.7:59224) 2024-08-19T00:44:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc159400640 1 -- 172.21.15.7:0/3004138033 learned_addr learned my addr 172.21.15.7:0/3004138033 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc159e00640 1 --2- 172.21.15.7:0/3004138033 >> v2:172.21.15.162:3300/0 conn(0x7fc15c06cad0 0x7fc15c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc15a800640 1 -- 172.21.15.7:0/3004138033 >> v2:172.21.15.162:3300/0 conn(0x7fc15c06cad0 msgr2=0x7fc15c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc15a800640 1 --2- 172.21.15.7:0/3004138033 >> v2:172.21.15.162:3300/0 conn(0x7fc15c06cad0 0x7fc15c0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc15a800640 1 -- 172.21.15.7:0/3004138033 >> v1:172.21.15.7:6789/0 conn(0x7fc15c06ceb0 legacy=0x7fc15c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc15a800640 1 -- 172.21.15.7:0/3004138033 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c0aece0 con 0x7fc15c15dc30 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.414+0000 7fc158a00640 1 -- 172.21.15.7:0/3004138033 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660077016 0 0) 0x7fc148001110 con 0x7fc15c06ceb0 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.415+0000 7fc15a800640 1 --2- 172.21.15.7:0/3004138033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c15dc30 0x7fc15c15e0c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc154009d90 tx=0x7fc15402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad36e9b72b8ef36 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.415+0000 7fc158a00640 1 -- 172.21.15.7:0/3004138033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154031600 con 0x7fc15c15dc30 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.415+0000 7fc158a00640 1 -- 172.21.15.7:0/3004138033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1540317a0 con 0x7fc15c15dc30 2024-08-19T00:44:39.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.415+0000 7fc158a00640 1 -- 172.21.15.7:0/3004138033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154031b70 con 0x7fc15c15dc30 2024-08-19T00:44:39.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 -- 172.21.15.7:0/3004138033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c15dc30 msgr2=0x7fc15c15e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 --2- 172.21.15.7:0/3004138033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c15dc30 0x7fc15c15e0c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc154009d90 tx=0x7fc15402a610 comp rx=0 tx=0).stop 2024-08-19T00:44:39.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 -- 172.21.15.7:0/3004138033 shutdown_connections 2024-08-19T00:44:39.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 --2- 172.21.15.7:0/3004138033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c15dc30 0x7fc15c15e0c0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 --2- 172.21.15.7:0/3004138033 >> v2:172.21.15.162:3300/0 conn(0x7fc15c06cad0 0x7fc15c0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 -- 172.21.15.7:0/3004138033 >> 172.21.15.7:0/3004138033 conn(0x7fc15c0721b0 msgr2=0x7fc15c0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 -- 172.21.15.7:0/3004138033 shutdown_connections 2024-08-19T00:44:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.416+0000 7fc160e00640 1 -- 172.21.15.7:0/3004138033 wait complete. 2024-08-19T00:44:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.418+0000 7fc160e00640 1 Processor -- start 2024-08-19T00:44:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.418+0000 7fc160e00640 1 -- start start 2024-08-19T00:44:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.418+0000 7fc160e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c06cad0 0x7fc15c1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.418+0000 7fc160e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc15c06ceb0 0x7fc15c15e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc160e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc15c15dc30 0x7fc15c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc160e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c0afd00 con 0x7fc15c06cad0 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc160e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c0af2a0 con 0x7fc15c15dc30 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc160e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc15c15e600 con 0x7fc15c06ceb0 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c06cad0 0x7fc15c1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c06cad0 0x7fc15c1602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41758/0 (socket says 172.21.15.7:41758) 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 -- 172.21.15.7:0/2692156817 learned_addr learned my addr 172.21.15.7:0/2692156817 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159400640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc15c06ceb0 0x7fc15c15e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc15a800640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc15c15dc30 0x7fc15c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 -- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc15c06ceb0 msgr2=0x7fc15c15e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc15c06ceb0 0x7fc15c15e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 -- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc15c15dc30 msgr2=0x7fc15c150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc15c15dc30 0x7fc15c150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159e00640 1 -- 172.21.15.7:0/2692156817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c15f230 con 0x7fc15c06cad0 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.419+0000 7fc159400640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc15c06ceb0 0x7fc15c15e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.420+0000 7fc159e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c06cad0 0x7fc15c1602d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00e870 tx=0x7fc14c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.420+0000 7fc152000640 1 -- 172.21.15.7:0/2692156817 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c017070 con 0x7fc15c06cad0 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.420+0000 7fc152000640 1 -- 172.21.15.7:0/2692156817 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c00c940 con 0x7fc15c06cad0 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.420+0000 7fc152000640 1 -- 172.21.15.7:0/2692156817 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c00cd30 con 0x7fc15c06cad0 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.420+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c15f510 con 0x7fc15c06cad0 2024-08-19T00:44:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.420+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15c15fad0 con 0x7fc15c06cad0 2024-08-19T00:44:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.421+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15c0b4a00 con 0x7fc15c06cad0 2024-08-19T00:44:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.422+0000 7fc152000640 1 -- 172.21.15.7:0/2692156817 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc14c01a070 con 0x7fc15c06cad0 2024-08-19T00:44:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.423+0000 7fc152000640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc13c06be30 0x7fc13c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.423+0000 7fc152000640 1 -- 172.21.15.7:0/2692156817 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6311+0+0 (secure 0 0 0) 0x7fc14c08b250 con 0x7fc15c06cad0 2024-08-19T00:44:39.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.423+0000 7fc159400640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc13c06be30 0x7fc13c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.424+0000 7fc159400640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc13c06be30 0x7fc13c06e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0b5730 tx=0x7fc148007a10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.428+0000 7fc152000640 1 -- 172.21.15.7:0/2692156817 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc14c059a30 con 0x7fc15c06cad0 2024-08-19T00:44:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.646+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc15c06d390 con 0x7fc15c06cad0 2024-08-19T00:44:39.649 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:39.647+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.649+0000 7fc152000640 1 -- 172.21.15.7:0/2692156817 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v132) ==== 161+0+0 (secure 0 0 0) 0x7fc14c059330 con 0x7fc15c06cad0 2024-08-19T00:44:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc13c06be30 msgr2=0x7fc13c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc13c06be30 0x7fc13c06e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0b5730 tx=0x7fc148007a10 comp rx=0 tx=0).stop 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c06cad0 msgr2=0x7fc15c1602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c06cad0 0x7fc15c1602d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00e870 tx=0x7fc14c00ed30 comp rx=0 tx=0).stop 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 shutdown_connections 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc13c06be30 0x7fc13c06e2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc15c15dc30 0x7fc15c150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc15c06ceb0 0x7fc15c15e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 --2- 172.21.15.7:0/2692156817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc15c06cad0 0x7fc15c1602d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 >> 172.21.15.7:0/2692156817 conn(0x7fc15c0721b0 msgr2=0x7fc15c157180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 shutdown_connections 2024-08-19T00:44:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.653+0000 7fc160e00640 1 -- 172.21.15.7:0/2692156817 wait complete. 2024-08-19T00:44:39.660 INFO:tasks.ceph.mds.c.smithi007.stderr: -690> 2024-08-19T00:44:33.606+0000 7f0a35000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:39.673 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:39.703 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:44:39.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.830+0000 7fe283e00640 1 Processor -- start 2024-08-19T00:44:39.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.830+0000 7fe283e00640 1 -- start start 2024-08-19T00:44:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe283e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2840d10c0 0x7fe28415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe283e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe2840d4b30 0x7fe2840ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe283e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28415e760 con 0x7fe28415e380 2024-08-19T00:44:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe283e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe2840d1b90 con 0x7fe2840d4b30 2024-08-19T00:44:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe283e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe28415f8b0 con 0x7fe2840d10c0 2024-08-19T00:44:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe282a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe28415e380 0x7fe2840d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59240/0 (socket says 172.21.15.7:59240) 2024-08-19T00:44:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe282a00640 1 -- 172.21.15.7:0/3514268886 learned_addr learned my addr 172.21.15.7:0/3514268886 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe283400640 1 --2- 172.21.15.7:0/3514268886 >> v2:172.21.15.162:3300/0 conn(0x7fe2840d4b30 0x7fe2840ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe27be00640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2840d10c0 0x7fe28415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260171533 0 0) 0x7fe28415e760 con 0x7fe28415e380 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.832+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe268003520 con 0x7fe28415e380 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414272721 0 0) 0x7fe268003520 con 0x7fe28415e380 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2840d10c0 msgr2=0x7fe28415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2840d10c0 0x7fe28415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 >> v2:172.21.15.162:3300/0 conn(0x7fe2840d4b30 msgr2=0x7fe2840ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 --2- 172.21.15.7:0/3514268886 >> v2:172.21.15.162:3300/0 conn(0x7fe2840d4b30 0x7fe2840ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2840d2280 con 0x7fe28415e380 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fe274001670 con 0x7fe28415e380 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 >> v1:172.21.15.7:6789/0 conn(0x7fe28415e380 legacy=0x7fe2840d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2680039b0 0x7fe268003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe268004800 0x7fe268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2680051c0 0x7fe26800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840d1b90 con 0x7fe2680051c0 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe28415f8b0 con 0x7fe2680039b0 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe26800bf00 con 0x7fe268004800 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe27be00640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2840d10c0 0x7fe28415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe283400640 1 --2- 172.21.15.7:0/3514268886 >> v2:172.21.15.162:3300/0 conn(0x7fe2840d4b30 0x7fe2840ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe283400640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2680051c0 0x7fe26800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe282a00640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2680039b0 0x7fe268003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.833+0000 7fe27be00640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe268004800 0x7fe268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.834+0000 7fe283400640 1 -- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe268004800 msgr2=0x7fe268004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.834+0000 7fe283400640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe268004800 0x7fe268004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.834+0000 7fe283400640 1 -- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2680039b0 msgr2=0x7fe268003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:39.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.834+0000 7fe283400640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2680039b0 0x7fe268003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.834+0000 7fe283400640 1 -- 172.21.15.7:0/3514268886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe268003520 con 0x7fe2680051c0 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe283400640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2680051c0 0x7fe26800b9c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e350 tx=0x7fe268005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f360ae0453026695 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c009dc0 con 0x7fe2680051c0 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c003b90 con 0x7fe2680051c0 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe282000640 1 -- 172.21.15.7:0/3514268886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c004020 con 0x7fe2680051c0 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe283e00640 1 -- 172.21.15.7:0/3514268886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2680051c0 msgr2=0x7fe26800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe283e00640 1 --2- 172.21.15.7:0/3514268886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2680051c0 0x7fe26800b9c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e350 tx=0x7fe268005830 comp rx=0 tx=0).stop 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe283400640 1 -- 172.21.15.7:0/3514268886 reap_dead start 2024-08-19T00:44:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe283e00640 1 -- 172.21.15.7:0/3514268886 shutdown_connections 2024-08-19T00:44:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.835+0000 7fe283e00640 1 -- 172.21.15.7:0/3514268886 >> 172.21.15.7:0/3514268886 conn(0x7fe28409d4d0 msgr2=0x7fe2840d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.836+0000 7fe283e00640 1 -- 172.21.15.7:0/3514268886 shutdown_connections 2024-08-19T00:44:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.836+0000 7fe283e00640 1 -- 172.21.15.7:0/3514268886 wait complete. 2024-08-19T00:44:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.837+0000 7fe283e00640 1 Processor -- start 2024-08-19T00:44:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.837+0000 7fe283e00640 1 -- start start 2024-08-19T00:44:39.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.838+0000 7fe283e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2680051c0 0x7fe28409e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.838+0000 7fe283e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2840b79a0 0x7fe2841f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.838+0000 7fe283e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2841f4480 0x7fe2841f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.838+0000 7fe283e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840d2520 con 0x7fe2841f4480 2024-08-19T00:44:39.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.838+0000 7fe283e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840d2b70 con 0x7fe2840b79a0 2024-08-19T00:44:39.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.838+0000 7fe283e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2840d2800 con 0x7fe2680051c0 2024-08-19T00:44:39.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2841f4480 0x7fe2841f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2841f4480 0x7fe2841f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41796/0 (socket says 172.21.15.7:41796) 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 -- 172.21.15.7:0/3477193776 learned_addr learned my addr 172.21.15.7:0/3477193776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe282a00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2680051c0 0x7fe28409e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe27be00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2840b79a0 0x7fe2841f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 -- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2680051c0 msgr2=0x7fe28409e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2680051c0 0x7fe28409e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 -- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2840b79a0 msgr2=0x7fe2841f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2840b79a0 0x7fe2841f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.839+0000 7fe283400640 1 -- 172.21.15.7:0/3477193776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2840b8130 con 0x7fe2841f4480 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.840+0000 7fe283400640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2841f4480 0x7fe2841f4910 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fe27c02b0b0 tx=0x7fe27c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.840+0000 7fe27aa00640 1 -- 172.21.15.7:0/3477193776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c046070 con 0x7fe2841f4480 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.840+0000 7fe27aa00640 1 -- 172.21.15.7:0/3477193776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c02ee30 con 0x7fe2841f4480 2024-08-19T00:44:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.840+0000 7fe27aa00640 1 -- 172.21.15.7:0/3477193776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c009dc0 con 0x7fe2841f4480 2024-08-19T00:44:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.840+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2840b8410 con 0x7fe2841f4480 2024-08-19T00:44:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.840+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2840b89d0 con 0x7fe2841f4480 2024-08-19T00:44:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.841+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2840d3170 con 0x7fe2841f4480 2024-08-19T00:44:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.842+0000 7fe27aa00640 1 -- 172.21.15.7:0/3477193776 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe27c036810 con 0x7fe2841f4480 2024-08-19T00:44:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.843+0000 7fe27aa00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe26006be60 0x7fe26006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.843+0000 7fe27aa00640 1 -- 172.21.15.7:0/3477193776 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6397+0+0 (secure 0 0 0) 0x7fe27c0abae0 con 0x7fe2841f4480 2024-08-19T00:44:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.843+0000 7fe282a00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe26006be60 0x7fe26006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.844+0000 7fe282a00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe26006be60 0x7fe26006e320 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe28409f4d0 tx=0x7fe2740078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:39.848+0000 7fe27aa00640 1 -- 172.21.15.7:0/3477193776 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe27c032030 con 0x7fe2841f4480 2024-08-19T00:44:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.101+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fe2840d4910 con 0x7fe2841f4480 2024-08-19T00:44:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.651+0000 7fe27aa00640 1 -- 172.21.15.7:0/3477193776 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v133) ==== 107+0+0 (secure 0 0 0) 0x7fe27c079b80 con 0x7fe2841f4480 2024-08-19T00:44:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe26006be60 msgr2=0x7fe26006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe26006be60 0x7fe26006e320 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe28409f4d0 tx=0x7fe2740078f0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2841f4480 msgr2=0x7fe2841f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2841f4480 0x7fe2841f4910 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fe27c02b0b0 tx=0x7fe27c009750 comp rx=0 tx=0).stop 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 shutdown_connections 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe26006be60 0x7fe26006e320 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2841f4480 0x7fe2841f4910 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2840b79a0 0x7fe2841f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 --2- 172.21.15.7:0/3477193776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2680051c0 0x7fe28409e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 >> 172.21.15.7:0/3477193776 conn(0x7fe28409d4d0 msgr2=0x7fe2840cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:40.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 shutdown_connections 2024-08-19T00:44:40.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.655+0000 7fe283e00640 1 -- 172.21.15.7:0/3477193776 wait complete. 2024-08-19T00:44:40.675 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.789+0000 7f27a9411f40 1 Processor -- start 2024-08-19T00:44:40.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.789+0000 7f27a9411f40 1 -- start start 2024-08-19T00:44:40.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a9411f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae4650 0x55d4f2b8bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a9411f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 0x55d4f2c1bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a9411f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae5990 0x55d4f2c1c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a9411f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d4f2a59d00 con 0x55d4f2ae4650 2024-08-19T00:44:40.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a9411f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4f2a5dd40 con 0x55d4f2ae5990 2024-08-19T00:44:40.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a9411f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d4f2b8adc0 con 0x55d4f2ae55b0 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae4650 0x55d4f2b8bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae4650 0x55d4f2b8bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41808/0 (socket says 172.21.15.7:41808) 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.790+0000 7f27a5a00640 1 -- 172.21.15.7:0/2359433726 learned_addr learned my addr 172.21.15.7:0/2359433726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a5a00640 1 -- 172.21.15.7:0/2359433726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 msgr2=0x55d4f2c1bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2359433726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 0x55d4f2c1bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a5a00640 1 -- 172.21.15.7:0/2359433726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae5990 msgr2=0x55d4f2c1c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2359433726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae5990 0x55d4f2c1c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a5a00640 1 -- 172.21.15.7:0/2359433726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f2a1b080 con 0x55d4f2ae4650 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2359433726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae4650 0x55d4f2b8bca0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f279800b2c0 tx=0x7f279800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1245d09f02217d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f279f400640 1 -- 172.21.15.7:0/2359433726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798008070 con 0x55d4f2ae4650 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f279f400640 1 -- 172.21.15.7:0/2359433726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279800d500 con 0x55d4f2ae4650 2024-08-19T00:44:40.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f279f400640 1 -- 172.21.15.7:0/2359433726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279800d930 con 0x55d4f2ae4650 2024-08-19T00:44:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a9411f40 1 -- 172.21.15.7:0/2359433726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae4650 msgr2=0x55d4f2b8bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.791+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2359433726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae4650 0x55d4f2b8bca0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f279800b2c0 tx=0x7f279800b780 comp rx=0 tx=0).stop 2024-08-19T00:44:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 -- 172.21.15.7:0/2359433726 shutdown_connections 2024-08-19T00:44:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2359433726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae5990 0x55d4f2c1c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2359433726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 0x55d4f2c1bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2359433726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae4650 0x55d4f2b8bca0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 -- 172.21.15.7:0/2359433726 >> 172.21.15.7:0/2359433726 conn(0x55d4f2ae24e0 msgr2=0x55d4f2ab26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 -- 172.21.15.7:0/2359433726 shutdown_connections 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 -- 172.21.15.7:0/2359433726 wait complete. 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 Processor -- start 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.792+0000 7f27a9411f40 1 -- start start 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.793+0000 7f27a9411f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae4650 0x55d4f2b85c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.793+0000 7f27a9411f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 0x55d4f2b79270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.793+0000 7f27a9411f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae5990 0x55d4f2b7d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.793+0000 7f27a9411f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d4f2b7f440 con 0x55d4f2ae5990 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.793+0000 7f27a9411f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4f2ab3120 con 0x55d4f2ae4650 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.793+0000 7f27a9411f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d4f2b7f720 con 0x55d4f2ae55b0 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.793+0000 7f27a6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae5990 0x55d4f2b7d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae5990 0x55d4f2b7d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41818/0 (socket says 172.21.15.7:41818) 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 learned_addr learned my addr 172.21.15.7:0/2525450486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 0x55d4f2b79270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae4650 0x55d4f2b85c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 msgr2=0x55d4f2b79270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 0x55d4f2b79270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae4650 msgr2=0x55d4f2b85c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae4650 0x55d4f2b85c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f2b84c00 con 0x55d4f2ae5990 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4f2ae55b0 0x55d4f2b79270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4f2ae4650 0x55d4f2b85c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.794+0000 7f27a6400640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae5990 0x55d4f2b7d8f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f27a00462b0 tx=0x7f27a004db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.795+0000 7f279e000640 1 -- 172.21.15.7:0/2525450486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0064070 con 0x55d4f2ae5990 2024-08-19T00:44:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.795+0000 7f279e000640 1 -- 172.21.15.7:0/2525450486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a004dc70 con 0x55d4f2ae5990 2024-08-19T00:44:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.795+0000 7f279e000640 1 -- 172.21.15.7:0/2525450486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0005b40 con 0x55d4f2ae5990 2024-08-19T00:44:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.795+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4f2b84ea0 con 0x55d4f2ae5990 2024-08-19T00:44:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.795+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f2b85460 con 0x55d4f2ae5990 2024-08-19T00:44:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.797+0000 7f279e000640 1 -- 172.21.15.7:0/2525450486 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27a0067070 con 0x55d4f2ae5990 2024-08-19T00:44:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.797+0000 7f279e000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f278806a860 0x7f278806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.797+0000 7f279e000640 1 -- 172.21.15.7:0/2525450486 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6397+0+0 (secure 0 0 0) 0x7f27a00cdca0 con 0x55d4f2ae5990 2024-08-19T00:44:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.798+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f278806a860 0x7f278806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.802 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:40.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.798+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d4f2b7de30 0x55d4f2b883c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.798+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2b88900 con 0x55d4f2b7de30 2024-08-19T00:44:40.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.798+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f278806a860 0x7f278806cd20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f279800b2c0 tx=0x7f2798009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.799+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d4f2b7de30 0x55d4f2b883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.799+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d4f2b7de30 0x55d4f2b883c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.801+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v94'226 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.801+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2b88ca0 con 0x55d4f2b7de30 2024-08-19T00:44:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.803+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v94'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.803+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2c800 con 0x55d4f2b7de30 2024-08-19T00:44:40.806 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:40.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.804+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v94'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.804+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2dbb0 con 0x55d4f2b7de30 2024-08-19T00:44:40.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.806+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v94'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.806+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2df50 con 0x55d4f2b7de30 2024-08-19T00:44:40.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.807+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v94'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.807+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2cba0 con 0x55d4f2b7de30 2024-08-19T00:44:40.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.808+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v94'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.808+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2cf90 con 0x55d4f2b7de30 2024-08-19T00:44:40.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.810+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v94'232 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.810+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d380 con 0x55d4f2b7de30 2024-08-19T00:44:40.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.812+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v94'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.812+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d380 con 0x55d4f2b7de30 2024-08-19T00:44:40.815 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.813+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v94'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.813+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.815+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v94'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.815+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.816+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v94'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.816+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.817+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v94'237 uv237 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.817+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.819+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v94'238 uv213 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.819+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.820+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v94'239 uv239 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.820+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.824 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:40.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.822+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v94'240 uv240 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.822+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.823+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v94'241 uv241 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.823+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.825+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v94'242 uv242 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.825+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d330 con 0x55d4f2b7de30 2024-08-19T00:44:40.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.826+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v94'243 uv243 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.826+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d6f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.828+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v94'244 uv244 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.828+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d6f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.830+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v94'245 uv219 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.830+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.831+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v94'246 uv246 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.831+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.835 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.832+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v94'247 uv247 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.832+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.834+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v94'248 uv248 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.834+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.835+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v94'249 uv249 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.835+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.836+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v94'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.836+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.838+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v94'251 uv225 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.838+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.840+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v94'252 uv252 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.840+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.844 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.841+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v94'253 uv253 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.841+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.843+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v94'254 uv254 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.843+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.844+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v94'255 uv255 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.844+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2b7de30 2024-08-19T00:44:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.846+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v94'256 uv256 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.846+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d4f2c2e800 0x55d4f2c30bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.846+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c2d5f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.846+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d4f2c2e800 0x55d4f2c30bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.847+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d4f2c2e800 0x55d4f2c30bf0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.848+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v94'177 uv156 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f279801d450 con 0x55d4f2c2e800 2024-08-19T00:44:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.848+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c31130 con 0x55d4f2c2e800 2024-08-19T00:44:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.850+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v94'178 uv178 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f279801d450 con 0x55d4f2c2e800 2024-08-19T00:44:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.850+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c314d0 con 0x55d4f2c2e800 2024-08-19T00:44:40.853 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.851+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v94'179 uv179 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f279801d450 con 0x55d4f2c2e800 2024-08-19T00:44:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.851+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c31870 con 0x55d4f2c2e800 2024-08-19T00:44:40.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.852+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v94'180 uv180 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f279801d450 con 0x55d4f2c2e800 2024-08-19T00:44:40.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.852+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c31c10 con 0x55d4f2c2e800 2024-08-19T00:44:40.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.854+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v94'181 uv181 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f279801d450 con 0x55d4f2c2e800 2024-08-19T00:44:40.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.854+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c31fb0 con 0x55d4f2c2e800 2024-08-19T00:44:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.855+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v94'182 uv175 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279801d450 con 0x55d4f2c2e800 2024-08-19T00:44:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.855+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c32350 con 0x55d4f2c2e800 2024-08-19T00:44:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.857+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v94'183 uv183 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279801d450 con 0x55d4f2c2e800 2024-08-19T00:44:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.857+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.860 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.858+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v94'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.858+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.860+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v94'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.860+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.861+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v94'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.861+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.863+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v94'187 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.863+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.864+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v94'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.864+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.868 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.866+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v94'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.866+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c36de0 con 0x55d4f2c2e800 2024-08-19T00:44:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.868+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v94'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.868+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c36de0 con 0x55d4f2c2e800 2024-08-19T00:44:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.869+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v94'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.869+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.870+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v94'192 uv172 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.870+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.872+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v94'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.872+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.875 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:40.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.873+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v94'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.873+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c33700 con 0x55d4f2c2e800 2024-08-19T00:44:40.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.874+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v94'195 uv195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.874+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c33700 con 0x55d4f2c2e800 2024-08-19T00:44:40.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.876+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v94'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.876+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c326f0 con 0x55d4f2c2e800 2024-08-19T00:44:40.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.877+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v94'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c2e800 2024-08-19T00:44:40.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.877+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d4f2c32d70 0x55d4f2c35160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.877+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35730 con 0x55d4f2c32d70 2024-08-19T00:44:40.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.878+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d4f2c32d70 0x55d4f2c35160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.878+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d4f2c32d70 0x55d4f2c35160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.880+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v94'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.880+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35b20 con 0x55d4f2c32d70 2024-08-19T00:44:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.881+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v94'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.881+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35b20 con 0x55d4f2c32d70 2024-08-19T00:44:40.885 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.883+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v94'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.883+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c36b30 con 0x55d4f2c32d70 2024-08-19T00:44:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.884+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v94'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.884+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c36b30 con 0x55d4f2c32d70 2024-08-19T00:44:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.885+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v94'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.885+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35b20 con 0x55d4f2c32d70 2024-08-19T00:44:40.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.887+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v94'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.887+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35b20 con 0x55d4f2b7de30 2024-08-19T00:44:40.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.889+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v94'38 uv37 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.889+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35b20 con 0x55d4f2b7de30 2024-08-19T00:44:40.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.890+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v94'39 uv39 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.890+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35b20 con 0x55d4f2b7de30 2024-08-19T00:44:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.892+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v94'40 uv40 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.894 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:40.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.892+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c35b20 con 0x55d4f2b7de30 2024-08-19T00:44:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.895+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v94'41 uv41 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.895+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d4f2c364f0 0x55d4f2c388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.895+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c38e20 con 0x55d4f2c364f0 2024-08-19T00:44:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.895+0000 7f27a6400640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d4f2c364f0 0x55d4f2c388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.896+0000 7f27a6400640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d4f2c364f0 0x55d4f2c388e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.897+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v94'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.897+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c391c0 con 0x55d4f2c364f0 2024-08-19T00:44:40.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.898+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v94'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.899+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39610 con 0x55d4f2c364f0 2024-08-19T00:44:40.902 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:40.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.900+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v94'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.900+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3aec0 con 0x55d4f2c364f0 2024-08-19T00:44:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.901+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v94'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.901+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3b260 con 0x55d4f2c364f0 2024-08-19T00:44:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.902+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v94'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.903+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39eb0 con 0x55d4f2c364f0 2024-08-19T00:44:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.904+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v94'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.904+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d4f2c3a7b0 0x55d4f2c3d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.904+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3db50 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.904+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d4f2c3a7b0 0x55d4f2c3d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.905+0000 7f27a5a00640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d4f2c3a7b0 0x55d4f2c3d610 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.906+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v94'83 uv75 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.906+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3db50 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.907+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v94'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.907+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3db50 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.914 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.909+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v94'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.909+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3ef80 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.910+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v94'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.910+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3ef80 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.911+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v94'87 uv87 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.911+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3df70 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.912+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v94'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.912+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3df70 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.914+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v94'89 uv82 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.914+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3df70 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.915+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v94'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.915+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3df70 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.919 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:40.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.916+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v94'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.917+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3df70 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.918+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v94'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.918+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c3df70 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.919+0000 7f27a5a00640 1 -- 172.21.15.7:0/2525450486 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v94'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2798023040 con 0x55d4f2c3a7b0 2024-08-19T00:44:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.919+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d4f2c3e480 0x55d4f2c40870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.920+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c40f70 con 0x55d4f2c3e480 2024-08-19T00:44:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.920+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d4f2c3e480 0x55d4f2c40870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:40.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.920+0000 7f27a5000640 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d4f2c3e480 0x55d4f2c40870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:40.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.922+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v94'37 uv36 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.922+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c40ff0 con 0x55d4f2c3e480 2024-08-19T00:44:40.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.923+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v94'38 uv38 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.923+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2c3e480 2024-08-19T00:44:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.924+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v94'39 uv39 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.927 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:40.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.925+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2c3e480 2024-08-19T00:44:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.926+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v94'40 uv40 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.926+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2c3e480 2024-08-19T00:44:40.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.927+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v94'41 uv41 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.927+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2b7de30 2024-08-19T00:44:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.929+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v94'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.929+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2b7de30 2024-08-19T00:44:40.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.931+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v94'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.931+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2b7de30 2024-08-19T00:44:40.934 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:40.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.932+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v94'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.932+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c42420 con 0x55d4f2b7de30 2024-08-19T00:44:40.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.933+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v94'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.933+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c42420 con 0x55d4f2b7de30 2024-08-19T00:44:40.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.934+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v94'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.934+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2b7de30 2024-08-19T00:44:40.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.936+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v94'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2b7de30 2024-08-19T00:44:40.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.936+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2c32d70 2024-08-19T00:44:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.937+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v94'74 uv68 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.937+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2c32d70 2024-08-19T00:44:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.939+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v94'75 uv75 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.939+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41410 con 0x55d4f2c32d70 2024-08-19T00:44:40.942 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.940+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v94'76 uv76 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.940+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39aa0 con 0x55d4f2c32d70 2024-08-19T00:44:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.942+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v94'77 uv77 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.942+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39aa0 con 0x55d4f2c32d70 2024-08-19T00:44:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.943+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v94'78 uv78 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.943+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39aa0 con 0x55d4f2c32d70 2024-08-19T00:44:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.944+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v94'79 uv73 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.944+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39aa0 con 0x55d4f2c32d70 2024-08-19T00:44:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.946+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v94'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.946+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39aa0 con 0x55d4f2c32d70 2024-08-19T00:44:40.949 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.948+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v94'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.948+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c39aa0 con 0x55d4f2c32d70 2024-08-19T00:44:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.949+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v94'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.949+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c44220 con 0x55d4f2c32d70 2024-08-19T00:44:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.950+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v94'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c32d70 2024-08-19T00:44:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.950+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c418c0 con 0x55d4f2c364f0 2024-08-19T00:44:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.952+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v94'36 uv34 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.952+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c364f0 2024-08-19T00:44:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.953+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v94'37 uv37 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.953+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c364f0 2024-08-19T00:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.954+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v94'38 uv38 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.957 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.954+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c364f0 2024-08-19T00:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.955+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v94'39 uv39 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.955+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c364f0 2024-08-19T00:44:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.957+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v94'45 uv44 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.957+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c364f0 2024-08-19T00:44:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.959+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v94'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.959+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c364f0 2024-08-19T00:44:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.960+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v94'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.963 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:40.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.960+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c42c70 con 0x55d4f2c364f0 2024-08-19T00:44:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.961+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v94'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.961+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c42c70 con 0x55d4f2c364f0 2024-08-19T00:44:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.962+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v94'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.962+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c364f0 2024-08-19T00:44:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.964+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v94'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f27a0070070 con 0x55d4f2c364f0 2024-08-19T00:44:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.964+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.965+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v94'37 uv36 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.965+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.967+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v94'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.967+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.970 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.968+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v94'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.968+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.969+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v94'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.969+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.971+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v94'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.971+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.972+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v94'95 uv86 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.972+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.974+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v94'96 uv96 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.974+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.978 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.975+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v94'97 uv97 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.975+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.977+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v94'98 uv98 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.977+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.979+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v94'99 uv99 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.979+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.980+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v94'100 uv93 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.980+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.982+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v94'101 uv101 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.982+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.983+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v94'102 uv102 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.986 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:40.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.983+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c42c70 con 0x55d4f2c3e480 2024-08-19T00:44:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.985+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v94'103 uv103 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.985+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c42c70 con 0x55d4f2c3e480 2024-08-19T00:44:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.986+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v94'104 uv104 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.986+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c41c60 con 0x55d4f2c3e480 2024-08-19T00:44:40.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.988+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v94'105 uv105 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.988+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55d4f2c423c0 con 0x55d4f2c3e480 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a5000640 1 -- 172.21.15.7:0/2525450486 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v94'106 uv106 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f279400e040 con 0x55d4f2c3e480 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d4f2c2e800 msgr2=0x55d4f2c30bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d4f2c2e800 0x55d4f2c30bf0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d4f2c3a7b0 msgr2=0x55d4f2c3d610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d4f2c3a7b0 0x55d4f2c3d610 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d4f2c3e480 msgr2=0x55d4f2c40870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d4f2c3e480 0x55d4f2c40870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d4f2c32d70 msgr2=0x55d4f2c35160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d4f2c32d70 0x55d4f2c35160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d4f2b7de30 msgr2=0x55d4f2b883c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d4f2b7de30 0x55d4f2b883c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d4f2c364f0 msgr2=0x55d4f2c388e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d4f2c364f0 0x55d4f2c388e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.989+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 reap_dead start 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a6400640 1 -- 172.21.15.7:0/2525450486 reap_dead start 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f278806a860 msgr2=0x7f278806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f278806a860 0x7f278806cd20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f279800b2c0 tx=0x7f2798009000 comp rx=0 tx=0).stop 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae5990 msgr2=0x55d4f2b7d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae5990 0x55d4f2b7d8f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f27a00462b0 tx=0x7f27a004db00 comp rx=0 tx=0).stop 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 shutdown_connections 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f278806a860 0x7f278806cd20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 --2- 172.21.15.7:0/2525450486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4f2ae5990 0x55d4f2b7d8f0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:40.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 >> 172.21.15.7:0/2525450486 conn(0x55d4f2ae24e0 msgr2=0x55d4f2aa1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:40.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 shutdown_connections 2024-08-19T00:44:40.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:40.990+0000 7f27a9411f40 1 -- 172.21.15.7:0/2525450486 wait complete. 2024-08-19T00:44:40.997 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds_snaptable 2024-08-19T00:44:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.111+0000 7f446f1d7f40 1 Processor -- start 2024-08-19T00:44:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.111+0000 7f446f1d7f40 1 -- start start 2024-08-19T00:44:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446f1d7f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726febf40 0x558727084500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446f1d7f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726fed5b0 0x558726fe93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446f1d7f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558726fe9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446f1d7f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558726f61d00 con 0x558726fed990 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446f1d7f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558726f65d40 con 0x558726fed5b0 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446f1d7f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558727092dc0 con 0x558726febf40 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558726fe9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726fed5b0 0x558726fe93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558726fe9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41834/0 (socket says 172.21.15.7:41834) 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ce00640 1 -- 172.21.15.7:0/232289082 learned_addr learned my addr 172.21.15.7:0/232289082 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446c400640 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726febf40 0x558727084500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ba00640 1 -- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726febf40 msgr2=0x558727084500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ba00640 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726febf40 0x558727084500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ba00640 1 -- 172.21.15.7:0/232289082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 msgr2=0x558726fe9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:41.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ba00640 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558726fe9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ba00640 1 -- 172.21.15.7:0/232289082 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558726f23080 con 0x558726fed5b0 2024-08-19T00:44:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.112+0000 7f446ce00640 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558726fe9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.113+0000 7f446ba00640 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726fed5b0 0x558726fe93e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4458053000 tx=0x7f445804e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=242c01e879b32f1c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.113+0000 7f446a600640 1 -- 172.21.15.7:0/232289082 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458064070 con 0x558726fed5b0 2024-08-19T00:44:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.113+0000 7f446a600640 1 -- 172.21.15.7:0/232289082 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f445800a260 con 0x558726fed5b0 2024-08-19T00:44:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.113+0000 7f446a600640 1 -- 172.21.15.7:0/232289082 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458059040 con 0x558726fed5b0 2024-08-19T00:44:41.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 -- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726fed5b0 msgr2=0x558726fe93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726fed5b0 0x558726fe93e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4458053000 tx=0x7f445804e000 comp rx=0 tx=0).stop 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 -- 172.21.15.7:0/232289082 shutdown_connections 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558726fe9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726fed5b0 0x558726fe93e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/232289082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726febf40 0x558727084500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 -- 172.21.15.7:0/232289082 >> 172.21.15.7:0/232289082 conn(0x558726fea4e0 msgr2=0x558726fba6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 -- 172.21.15.7:0/232289082 shutdown_connections 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 -- 172.21.15.7:0/232289082 wait complete. 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.114+0000 7f446f1d7f40 1 Processor -- start 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.115+0000 7f446f1d7f40 1 -- start start 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.115+0000 7f446f1d7f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726febf40 0x558727095460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.115+0000 7f446f1d7f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726fed5b0 0x55872708cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.115+0000 7f446f1d7f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558727091610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446f1d7f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5587270940c0 con 0x558726fed990 2024-08-19T00:44:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446f1d7f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558726fbaf10 con 0x558726febf40 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446f1d7f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558727094360 con 0x558726fed5b0 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558727091610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558727091610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41846/0 (socket says 172.21.15.7:41846) 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 -- 172.21.15.7:0/1817953562 learned_addr learned my addr 172.21.15.7:0/1817953562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446c400640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726febf40 0x558727095460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ba00640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726fed5b0 0x55872708cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 -- 172.21.15.7:0/1817953562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726fed5b0 msgr2=0x55872708cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558726fed5b0 0x55872708cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 -- 172.21.15.7:0/1817953562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726febf40 msgr2=0x558727095460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558726febf40 0x558727095460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.116+0000 7f446ce00640 1 -- 172.21.15.7:0/1817953562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872708d2a0 con 0x558726fed990 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.117+0000 7f446ce00640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558727091610 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f4464005e10 tx=0x7f4464001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.117+0000 7f4469200640 1 -- 172.21.15.7:0/1817953562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464002090 con 0x558726fed990 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.117+0000 7f4469200640 1 -- 172.21.15.7:0/1817953562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4464017070 con 0x558726fed990 2024-08-19T00:44:41.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.117+0000 7f4469200640 1 -- 172.21.15.7:0/1817953562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464011780 con 0x558726fed990 2024-08-19T00:44:41.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.117+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55872708d540 con 0x558726fed990 2024-08-19T00:44:41.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.117+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558727090270 con 0x558726fed990 2024-08-19T00:44:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.119+0000 7f4469200640 1 -- 172.21.15.7:0/1817953562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4464011920 con 0x558726fed990 2024-08-19T00:44:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.120+0000 7f4469200640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444c06a840 0x7f444c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.120+0000 7f4469200640 1 -- 172.21.15.7:0/1817953562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6397+0+0 (secure 0 0 0) 0x7f4464089580 con 0x558726fed990 2024-08-19T00:44:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.120+0000 7f446c400640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444c06a840 0x7f444c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.120+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558727090790 0x558727090b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.120+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) -- 0x558727083450 con 0x558727090790 2024-08-19T00:44:41.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.120+0000 7f446ba00640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558727090790 0x558727090b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.121+0000 7f446c400640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444c06a840 0x7f444c06cd00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f445c011560 tx=0x7f445c0017b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:41.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.121+0000 7f446ba00640 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558727090790 0x558727090b70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446ba00640 1 -- 172.21.15.7:0/1817953562 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 mds_snaptable [delete] v94'42 uv42 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f4458067040 con 0x558727090790 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558727090790 msgr2=0x558727090b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558727090790 0x558727090b70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444c06a840 msgr2=0x7f444c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444c06a840 0x7f444c06cd00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f445c011560 tx=0x7f445c0017b0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 msgr2=0x558727091610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 --2- 172.21.15.7:0/1817953562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726fed990 0x558727091610 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f4464005e10 tx=0x7f4464001980 comp rx=0 tx=0).stop 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446ce00640 1 -- 172.21.15.7:0/1817953562 reap_dead start 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 shutdown_connections 2024-08-19T00:44:41.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 >> 172.21.15.7:0/1817953562 conn(0x558726fea4e0 msgr2=0x558726fba6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 shutdown_connections 2024-08-19T00:44:41.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.123+0000 7f446f1d7f40 1 -- 172.21.15.7:0/1817953562 wait complete. 2024-08-19T00:44:41.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:41.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.288+0000 7faee8e00640 1 Processor -- start 2024-08-19T00:44:41.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.288+0000 7faee8e00640 1 -- start start 2024-08-19T00:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.289+0000 7faee8e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faee415e3e0 0x7faee40b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.289+0000 7faee8e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faee40d27b0 0x7faee40d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.289+0000 7faee8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee40b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.289+0000 7faee8e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7faee40d3140 con 0x7faee40d27b0 2024-08-19T00:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.289+0000 7faee8e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faee40b4b20 con 0x7faee415e3e0 2024-08-19T00:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.289+0000 7faee8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faee40b4df0 con 0x7faee40b4150 2024-08-19T00:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.289+0000 7faee2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faee40d27b0 0x7faee40d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faee40d27b0 0x7faee40d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41858/0 (socket says 172.21.15.7:41858) 2024-08-19T00:44:41.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee2a00640 1 -- 172.21.15.7:0/3188274698 learned_addr learned my addr 172.21.15.7:0/3188274698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:41.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee3400640 1 --2- 172.21.15.7:0/3188274698 >> v2:172.21.15.162:3300/0 conn(0x7faee415e3e0 0x7faee40b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee3e00640 1 --2- 172.21.15.7:0/3188274698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee40b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee2a00640 1 -- 172.21.15.7:0/3188274698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 msgr2=0x7faee40b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee2a00640 1 --2- 172.21.15.7:0/3188274698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee40b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee2a00640 1 -- 172.21.15.7:0/3188274698 >> v2:172.21.15.162:3300/0 conn(0x7faee415e3e0 msgr2=0x7faee40b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee2a00640 1 --2- 172.21.15.7:0/3188274698 >> v2:172.21.15.162:3300/0 conn(0x7faee415e3e0 0x7faee40b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.290+0000 7faee2a00640 1 -- 172.21.15.7:0/3188274698 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee40b50d0 con 0x7faee40d27b0 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.291+0000 7faee2a00640 1 --2- 172.21.15.7:0/3188274698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee40d27b0 0x7faee40d2c00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7faed0009870 tx=0x7faed002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc263248aec95669 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.291+0000 7faee2000640 1 -- 172.21.15.7:0/3188274698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0037070 con 0x7faee40d27b0 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.291+0000 7faee2000640 1 -- 172.21.15.7:0/3188274698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed0032440 con 0x7faee40d27b0 2024-08-19T00:44:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.291+0000 7faee2000640 1 -- 172.21.15.7:0/3188274698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0032810 con 0x7faee40d27b0 2024-08-19T00:44:41.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 -- 172.21.15.7:0/3188274698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee40d27b0 msgr2=0x7faee40d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 --2- 172.21.15.7:0/3188274698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee40d27b0 0x7faee40d2c00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7faed0009870 tx=0x7faed002a200 comp rx=0 tx=0).stop 2024-08-19T00:44:41.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 -- 172.21.15.7:0/3188274698 shutdown_connections 2024-08-19T00:44:41.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 --2- 172.21.15.7:0/3188274698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee40b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 --2- 172.21.15.7:0/3188274698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee40d27b0 0x7faee40d2c00 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 --2- 172.21.15.7:0/3188274698 >> v2:172.21.15.162:3300/0 conn(0x7faee415e3e0 0x7faee40b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 -- 172.21.15.7:0/3188274698 >> 172.21.15.7:0/3188274698 conn(0x7faee408dbe0 msgr2=0x7faee409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:41.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 -- 172.21.15.7:0/3188274698 shutdown_connections 2024-08-19T00:44:41.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.292+0000 7faee8e00640 1 -- 172.21.15.7:0/3188274698 wait complete. 2024-08-19T00:44:41.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.293+0000 7faee8e00640 1 Processor -- start 2024-08-19T00:44:41.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.294+0000 7faee8e00640 1 -- start start 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.294+0000 7faee8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.294+0000 7faee8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faee40d27b0 0x7faee40b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee415e3e0 0x7faee414e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee8e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee40cee90 con 0x7faee415e3e0 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faee40cf4c0 con 0x7faee40d27b0 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faee40b13a0 con 0x7faee40b4150 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee415e3e0 0x7faee414e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee415e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:54668/0 (socket says 172.21.15.7:54668) 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee415e3e0 0x7faee414e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41868/0 (socket says 172.21.15.7:41868) 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3400640 1 -- 172.21.15.7:0/2875216693 learned_addr learned my addr 172.21.15.7:0/2875216693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee2a00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faee40d27b0 0x7faee40b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3e00640 1 -- 172.21.15.7:0/2875216693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 msgr2=0x7faee415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3e00640 1 -- 172.21.15.7:0/2875216693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faee40d27b0 msgr2=0x7faee40b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faee40d27b0 0x7faee40b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.295+0000 7faee3e00640 1 -- 172.21.15.7:0/2875216693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee4160c60 con 0x7faee415e3e0 2024-08-19T00:44:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.296+0000 7faee3e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee415e3e0 0x7faee414e450 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7faedc007dc0 tx=0x7faedc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.296+0000 7faedb400640 1 -- 172.21.15.7:0/2875216693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc00edd0 con 0x7faee415e3e0 2024-08-19T00:44:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.296+0000 7faedb400640 1 -- 172.21.15.7:0/2875216693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faedc003990 con 0x7faee415e3e0 2024-08-19T00:44:41.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.296+0000 7faedb400640 1 -- 172.21.15.7:0/2875216693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc003d80 con 0x7faee415e3e0 2024-08-19T00:44:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.296+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee4160f40 con 0x7faee415e3e0 2024-08-19T00:44:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.296+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee4161500 con 0x7faee415e3e0 2024-08-19T00:44:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.297+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee40d2be0 con 0x7faee415e3e0 2024-08-19T00:44:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.298+0000 7faedb400640 1 -- 172.21.15.7:0/2875216693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faedc01b020 con 0x7faee415e3e0 2024-08-19T00:44:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.299+0000 7faedb400640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faec406be30 0x7faec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.299+0000 7faedb400640 1 -- 172.21.15.7:0/2875216693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6397+0+0 (secure 0 0 0) 0x7faedc08b270 con 0x7faee415e3e0 2024-08-19T00:44:41.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.299+0000 7faee3400640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faec406be30 0x7faec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.299+0000 7faee3400640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faec406be30 0x7faec406e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faed40079e0 tx=0x7faed4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.303+0000 7faedb400640 1 -- 172.21.15.7:0/2875216693 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faedc059280 con 0x7faee415e3e0 2024-08-19T00:44:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:41.525+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7faee40b67d0 con 0x7faee415e3e0 2024-08-19T00:44:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.191+0000 7faedb400640 1 -- 172.21.15.7:0/2875216693 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v134) ==== 162+0+0 (secure 0 0 0) 0x7faedc05d580 con 0x7faee415e3e0 2024-08-19T00:44:42.194 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:42.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faec406be30 msgr2=0x7faec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faec406be30 0x7faec406e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faed40079e0 tx=0x7faed4008040 comp rx=0 tx=0).stop 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee415e3e0 msgr2=0x7faee414e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee415e3e0 0x7faee414e450 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7faedc007dc0 tx=0x7faedc00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 shutdown_connections 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faec406be30 0x7faec406e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee415e3e0 0x7faee414e450 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faee40d27b0 0x7faee40b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 --2- 172.21.15.7:0/2875216693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faee40b4150 0x7faee415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 >> 172.21.15.7:0/2875216693 conn(0x7faee408dbe0 msgr2=0x7faee406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 shutdown_connections 2024-08-19T00:44:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.194+0000 7faee8e00640 1 -- 172.21.15.7:0/2875216693 wait complete. 2024-08-19T00:44:42.203 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:42.200+0000 7fccb4400640 -1 mds.0.snaptable: load_2 could not read table: -2 2024-08-19T00:44:42.203 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:42.200+0000 7fccb4400640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2024-08-19T00:44:42.203 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:42.201+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:42.203 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:42.201+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:44:42.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.379+0000 7fc2e0600640 1 Processor -- start 2024-08-19T00:44:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.379+0000 7fc2e0600640 1 -- start start 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2e0600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80d03c0 0x7fc2d8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2e0600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2d806e710 0x7fc2d80d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2e0600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc2d80b3750 0x7fc2d80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2e0600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80cebc0 con 0x7fc2d806e710 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2e0600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80d0ce0 con 0x7fc2d80b3750 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2e0600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d80cdfb0 con 0x7fc2d80d03c0 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2dd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2d806e710 0x7fc2d80d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2dd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2d806e710 0x7fc2d80d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41878/0 (socket says 172.21.15.7:41878) 2024-08-19T00:44:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2dd200640 1 -- 172.21.15.7:0/633919961 learned_addr learned my addr 172.21.15.7:0/633919961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2ddc00640 1 --2- 172.21.15.7:0/633919961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80d03c0 0x7fc2d8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.380+0000 7fc2de600640 1 --2- 172.21.15.7:0/633919961 >> v2:172.21.15.162:3300/0 conn(0x7fc2d80b3750 0x7fc2d80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.381+0000 7fc2dd200640 1 -- 172.21.15.7:0/633919961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80d03c0 msgr2=0x7fc2d8071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.381+0000 7fc2dd200640 1 --2- 172.21.15.7:0/633919961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80d03c0 0x7fc2d8071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.381+0000 7fc2dd200640 1 -- 172.21.15.7:0/633919961 >> v2:172.21.15.162:3300/0 conn(0x7fc2d80b3750 msgr2=0x7fc2d80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.381+0000 7fc2dd200640 1 --2- 172.21.15.7:0/633919961 >> v2:172.21.15.162:3300/0 conn(0x7fc2d80b3750 0x7fc2d80cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.381+0000 7fc2dd200640 1 -- 172.21.15.7:0/633919961 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d80ce290 con 0x7fc2d806e710 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.382+0000 7fc2dd200640 1 --2- 172.21.15.7:0/633919961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d806e710 0x7fc2d80d07a0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fc2d809e320 tx=0x7fc2c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6cf93d0d0a81a3f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.382+0000 7fc2d7e00640 1 -- 172.21.15.7:0/633919961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4037070 con 0x7fc2d806e710 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.382+0000 7fc2d7e00640 1 -- 172.21.15.7:0/633919961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c4032440 con 0x7fc2d806e710 2024-08-19T00:44:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.382+0000 7fc2d7e00640 1 -- 172.21.15.7:0/633919961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4032810 con 0x7fc2d806e710 2024-08-19T00:44:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 -- 172.21.15.7:0/633919961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d806e710 msgr2=0x7fc2d80d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 --2- 172.21.15.7:0/633919961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d806e710 0x7fc2d80d07a0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fc2d809e320 tx=0x7fc2c402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 -- 172.21.15.7:0/633919961 shutdown_connections 2024-08-19T00:44:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 --2- 172.21.15.7:0/633919961 >> v2:172.21.15.162:3300/0 conn(0x7fc2d80b3750 0x7fc2d80cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 --2- 172.21.15.7:0/633919961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d806e710 0x7fc2d80d07a0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 --2- 172.21.15.7:0/633919961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80d03c0 0x7fc2d8071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 -- 172.21.15.7:0/633919961 >> 172.21.15.7:0/633919961 conn(0x7fc2d806bc70 msgr2=0x7fc2d806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 -- 172.21.15.7:0/633919961 shutdown_connections 2024-08-19T00:44:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.383+0000 7fc2e0600640 1 -- 172.21.15.7:0/633919961 wait complete. 2024-08-19T00:44:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.384+0000 7fc2e0600640 1 Processor -- start 2024-08-19T00:44:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.385+0000 7fc2e0600640 1 -- start start 2024-08-19T00:44:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.385+0000 7fc2e0600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d806e710 0x7fc2d80af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.385+0000 7fc2e0600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80b3750 0x7fc2d81f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.385+0000 7fc2e0600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d80d03c0 0x7fc2d815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.385+0000 7fc2e0600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8073ae0 con 0x7fc2d80d03c0 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.385+0000 7fc2e0600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80ce850 con 0x7fc2d806e710 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2e0600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d8073c60 con 0x7fc2d80b3750 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d80d03c0 0x7fc2d815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d80d03c0 0x7fc2d815dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41890/0 (socket says 172.21.15.7:41890) 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 -- 172.21.15.7:0/3386195175 learned_addr learned my addr 172.21.15.7:0/3386195175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2ddc00640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d806e710 0x7fc2d80af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2dd200640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80b3750 0x7fc2d81f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 -- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80b3750 msgr2=0x7fc2d81f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80b3750 0x7fc2d81f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 -- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d806e710 msgr2=0x7fc2d80af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d806e710 0x7fc2d80af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.386+0000 7fc2de600640 1 -- 172.21.15.7:0/3386195175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d8156190 con 0x7fc2d80d03c0 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.387+0000 7fc2de600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d80d03c0 0x7fc2d815dd30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000eed0 tx=0x7fc2d000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.387+0000 7fc2d5600640 1 -- 172.21.15.7:0/3386195175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0018020 con 0x7fc2d80d03c0 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.387+0000 7fc2d5600640 1 -- 172.21.15.7:0/3386195175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d000bd20 con 0x7fc2d80d03c0 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.387+0000 7fc2d5600640 1 -- 172.21.15.7:0/3386195175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0014640 con 0x7fc2d80d03c0 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.387+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d8156710 con 0x7fc2d80d03c0 2024-08-19T00:44:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.387+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d8153780 con 0x7fc2d80d03c0 2024-08-19T00:44:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.388+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d80b3be0 con 0x7fc2d80d03c0 2024-08-19T00:44:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.389+0000 7fc2d5600640 1 -- 172.21.15.7:0/3386195175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2d0005d10 con 0x7fc2d80d03c0 2024-08-19T00:44:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.390+0000 7fc2d5600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2b806be30 0x7fc2b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.390+0000 7fc2d5600640 1 -- 172.21.15.7:0/3386195175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7fc2d008b6b0 con 0x7fc2d80d03c0 2024-08-19T00:44:42.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.390+0000 7fc2ddc00640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2b806be30 0x7fc2b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.391+0000 7fc2ddc00640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2b806be30 0x7fc2b806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009b40 tx=0x7fc2cc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.394+0000 7fc2d5600640 1 -- 172.21.15.7:0/3386195175 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc2d0022070 con 0x7fc2d80d03c0 2024-08-19T00:44:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.613+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2d80ae2a0 con 0x7fc2d80d03c0 2024-08-19T00:44:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.614+0000 7fc2d5600640 1 -- 172.21.15.7:0/3386195175 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+4389 (secure 0 0 0) 0x7fc2d0059660 con 0x7fc2d80d03c0 2024-08-19T00:44:42.617 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:42.617 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":136,"btime":"2024-08-19T00:44:42:203029+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/877185885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":877185885},{"type":"v1","addr":"172.21.15.7:6837","nonce":877185885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:42.202966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 136 2024-08-19T00:44:42.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2b806be30 msgr2=0x7fc2b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2b806be30 0x7fc2b806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009b40 tx=0x7fc2cc009190 comp rx=0 tx=0).stop 2024-08-19T00:44:42.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d80d03c0 msgr2=0x7fc2d815dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d80d03c0 0x7fc2d815dd30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000eed0 tx=0x7fc2d000b480 comp rx=0 tx=0).stop 2024-08-19T00:44:42.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 shutdown_connections 2024-08-19T00:44:42.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc2b806be30 0x7fc2b806e2f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2d80d03c0 0x7fc2d815dd30 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2d80b3750 0x7fc2d81f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 --2- 172.21.15.7:0/3386195175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d806e710 0x7fc2d80af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 >> 172.21.15.7:0/3386195175 conn(0x7fc2d806bc70 msgr2=0x7fc2d80acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 shutdown_connections 2024-08-19T00:44:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.616+0000 7fc2e0600640 1 -- 172.21.15.7:0/3386195175 wait complete. 2024-08-19T00:44:42.636 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:42.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.790+0000 7f69a3200640 1 Processor -- start 2024-08-19T00:44:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.790+0000 7f69a3200640 1 -- start start 2024-08-19T00:44:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.791+0000 7f69a3200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69a415e360 0x7f69a415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.791+0000 7f69a3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f69a40d2af0 0x7f69a40d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.791+0000 7f69a3200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a40b3ab0 con 0x7f69a415e740 2024-08-19T00:44:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.791+0000 7f69a3200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f69a415f460 con 0x7f69a40d2af0 2024-08-19T00:44:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.791+0000 7f69a3200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f69a415f740 con 0x7f69a415e360 2024-08-19T00:44:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f699be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f69a40d2af0 0x7f69a40d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f69a1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69a415e360 0x7f69a415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f699be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f69a40d2af0 0x7f69a40d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41900/0 (socket says 172.21.15.7:41900) 2024-08-19T00:44:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f699be00640 1 -- 172.21.15.7:0/3803718866 learned_addr learned my addr 172.21.15.7:0/3803718866 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f699be00640 1 -- 172.21.15.7:0/3803718866 >> v2:172.21.15.162:3300/0 conn(0x7f69a415e360 msgr2=0x7f69a415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f699be00640 1 --2- 172.21.15.7:0/3803718866 >> v2:172.21.15.162:3300/0 conn(0x7f69a415e360 0x7f69a415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f699be00640 1 -- 172.21.15.7:0/3803718866 >> v1:172.21.15.7:6789/0 conn(0x7f69a415e740 legacy=0x7f69a415eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.792+0000 7f699be00640 1 -- 172.21.15.7:0/3803718866 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a40b3d60 con 0x7f69a40d2af0 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.793+0000 7f699be00640 1 --2- 172.21.15.7:0/3803718866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a40d2f80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f69a408e8a0 tx=0x7f698c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd619ec47279e5df server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.793+0000 7f69a1400640 1 -- 172.21.15.7:0/3803718866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c037070 con 0x7f69a40d2af0 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.793+0000 7f69a1400640 1 -- 172.21.15.7:0/3803718866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698c032440 con 0x7f69a40d2af0 2024-08-19T00:44:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.793+0000 7f69a1400640 1 -- 172.21.15.7:0/3803718866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c032810 con 0x7f69a40d2af0 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 -- 172.21.15.7:0/3803718866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 msgr2=0x7f69a40d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 --2- 172.21.15.7:0/3803718866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a40d2f80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f69a408e8a0 tx=0x7f698c02a270 comp rx=0 tx=0).stop 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 -- 172.21.15.7:0/3803718866 shutdown_connections 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 --2- 172.21.15.7:0/3803718866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a40d2f80 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 --2- 172.21.15.7:0/3803718866 >> v2:172.21.15.162:3300/0 conn(0x7f69a415e360 0x7f69a415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 -- 172.21.15.7:0/3803718866 >> 172.21.15.7:0/3803718866 conn(0x7f69a408dbf0 msgr2=0x7f69a409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 -- 172.21.15.7:0/3803718866 shutdown_connections 2024-08-19T00:44:42.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.794+0000 7f69a3200640 1 -- 172.21.15.7:0/3803718866 wait complete. 2024-08-19T00:44:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.796+0000 7f69a3200640 1 Processor -- start 2024-08-19T00:44:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.796+0000 7f69a3200640 1 -- start start 2024-08-19T00:44:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69a415e360 0x7f69a415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69a415e740 0x7f69a40cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40b4560 con 0x7f69a40d2af0 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40d2300 con 0x7f69a415e740 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69a40b46e0 con 0x7f69a415e360 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a414f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41914/0 (socket says 172.21.15.7:41914) 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 -- 172.21.15.7:0/2729300259 learned_addr learned my addr 172.21.15.7:0/2729300259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a2800640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69a415e740 0x7f69a40cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f699be00640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69a415e360 0x7f69a415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 -- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69a415e360 msgr2=0x7f69a415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69a415e360 0x7f69a415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 -- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69a415e740 msgr2=0x7f69a40cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69a415e740 0x7f69a40cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.797+0000 7f69a1e00640 1 -- 172.21.15.7:0/2729300259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a40c7e90 con 0x7f69a40d2af0 2024-08-19T00:44:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.798+0000 7f69a1e00640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a414f7c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f699400e9b0 tx=0x7f699400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.798+0000 7f699a000640 1 -- 172.21.15.7:0/2729300259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994017070 con 0x7f69a40d2af0 2024-08-19T00:44:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.798+0000 7f699a000640 1 -- 172.21.15.7:0/2729300259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699400c9a0 con 0x7f69a40d2af0 2024-08-19T00:44:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.798+0000 7f699a000640 1 -- 172.21.15.7:0/2729300259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699400cd90 con 0x7f69a40d2af0 2024-08-19T00:44:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.798+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a40c8170 con 0x7f69a40d2af0 2024-08-19T00:44:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.798+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a40cb7f0 con 0x7f69a40d2af0 2024-08-19T00:44:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.799+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a40d2f80 con 0x7f69a40d2af0 2024-08-19T00:44:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.800+0000 7f699a000640 1 -- 172.21.15.7:0/2729300259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f699401a070 con 0x7f69a40d2af0 2024-08-19T00:44:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.801+0000 7f699a000640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f698006be30 0x7f698006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.801+0000 7f699a000640 1 -- 172.21.15.7:0/2729300259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7f699408b560 con 0x7f69a40d2af0 2024-08-19T00:44:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.801+0000 7f699be00640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f698006be30 0x7f698006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.802+0000 7f699be00640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f698006be30 0x7f698006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f698c034000 tx=0x7f698c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:42.806+0000 7f699a000640 1 -- 172.21.15.7:0/2729300259 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6994059ba0 con 0x7f69a40d2af0 2024-08-19T00:44:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.026+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69a40d50d0 con 0x7f69a40d2af0 2024-08-19T00:44:43.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.026+0000 7f699a000640 1 -- 172.21.15.7:0/2729300259 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+4389 (secure 0 0 0) 0x7f69940594a0 con 0x7f69a40d2af0 2024-08-19T00:44:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:43.029 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":136,"btime":"2024-08-19T00:44:42:203029+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/877185885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":877185885},{"type":"v1","addr":"172.21.15.7:6837","nonce":877185885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:42.202966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:43.029 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 136 2024-08-19T00:44:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.028+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f698006be30 msgr2=0x7f698006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.028+0000 7f69a3200640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f698006be30 0x7f698006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f698c034000 tx=0x7f698c02e000 comp rx=0 tx=0).stop 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.028+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 msgr2=0x7f69a414f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.028+0000 7f69a3200640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a414f7c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f699400e9b0 tx=0x7f699400ee70 comp rx=0 tx=0).stop 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 shutdown_connections 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f698006be30 0x7f698006e2f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69a415e740 0x7f69a40cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69a415e360 0x7f69a415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 --2- 172.21.15.7:0/2729300259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69a40d2af0 0x7f69a414f7c0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 >> 172.21.15.7:0/2729300259 conn(0x7f69a408dbf0 msgr2=0x7f69a406da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 shutdown_connections 2024-08-19T00:44:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.029+0000 7f69a3200640 1 -- 172.21.15.7:0/2729300259 wait complete. 2024-08-19T00:44:43.047 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:43.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.202+0000 7f795ac00640 1 Processor -- start 2024-08-19T00:44:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.203+0000 7f795ac00640 1 -- start start 2024-08-19T00:44:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.204+0000 7f795ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795406cad0 0x7f79540af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.204+0000 7f795ac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f795406ceb0 0x7f79540b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.204+0000 7f795ac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79540ae780 con 0x7f79540b5c00 2024-08-19T00:44:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.204+0000 7f795ac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f79540aea00 con 0x7f795406ceb0 2024-08-19T00:44:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.204+0000 7f795ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79540aece0 con 0x7f795406cad0 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.204+0000 7f7953e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795406cad0 0x7f79540af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f794be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f795406ceb0 0x7f79540b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f7953e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795406cad0 0x7f79540af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:54686/0 (socket says 172.21.15.7:54686) 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f7953e00640 1 -- 172.21.15.7:0/72809447 learned_addr learned my addr 172.21.15.7:0/72809447 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f7958c00640 1 --1- 172.21.15.7:0/72809447 >> v1:172.21.15.162:6789/0 conn(0x7f79540b5c00 0x7f795415dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:58318/0 (socket says 172.21.15.7:58318) 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f7953e00640 1 -- 172.21.15.7:0/72809447 >> v2:172.21.15.162:3300/0 conn(0x7f795406ceb0 msgr2=0x7f79540b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f7953e00640 1 --2- 172.21.15.7:0/72809447 >> v2:172.21.15.162:3300/0 conn(0x7f795406ceb0 0x7f79540b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f7953e00640 1 -- 172.21.15.7:0/72809447 >> v1:172.21.15.162:6789/0 conn(0x7f79540b5c00 legacy=0x7f795415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.205+0000 7f7953e00640 1 -- 172.21.15.7:0/72809447 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79540aefc0 con 0x7f795406cad0 2024-08-19T00:44:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.206+0000 7f7953e00640 1 --2- 172.21.15.7:0/72809447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795406cad0 0x7f79540af7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7944009870 tx=0x7f794402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63790f89b3f38886 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.206+0000 7f7953400640 1 -- 172.21.15.7:0/72809447 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944037070 con 0x7f795406cad0 2024-08-19T00:44:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.206+0000 7f7953400640 1 -- 172.21.15.7:0/72809447 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7944032440 con 0x7f795406cad0 2024-08-19T00:44:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.206+0000 7f7953400640 1 -- 172.21.15.7:0/72809447 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944032810 con 0x7f795406cad0 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 -- 172.21.15.7:0/72809447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795406cad0 msgr2=0x7f79540af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 --2- 172.21.15.7:0/72809447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795406cad0 0x7f79540af7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7944009870 tx=0x7f794402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 -- 172.21.15.7:0/72809447 shutdown_connections 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 --2- 172.21.15.7:0/72809447 >> v2:172.21.15.162:3300/0 conn(0x7f795406ceb0 0x7f79540b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 --2- 172.21.15.7:0/72809447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795406cad0 0x7f79540af7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 -- 172.21.15.7:0/72809447 >> 172.21.15.7:0/72809447 conn(0x7f79540721b0 msgr2=0x7f79540725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 -- 172.21.15.7:0/72809447 shutdown_connections 2024-08-19T00:44:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.207+0000 7f795ac00640 1 -- 172.21.15.7:0/72809447 wait complete. 2024-08-19T00:44:43.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.209+0000 7f795ac00640 1 Processor -- start 2024-08-19T00:44:43.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.209+0000 7f795ac00640 1 -- start start 2024-08-19T00:44:43.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f795ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795406cad0 0x7f79541f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f795ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795406ceb0 0x7f79541432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f795ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79540b5c00 0x7f795406f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f795ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79540b4a00 con 0x7f795406ceb0 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f795ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79540afd00 con 0x7f795406cad0 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f795ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79540b4b80 con 0x7f79540b5c00 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795406ceb0 0x7f79541432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795406ceb0 0x7f79541432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41916/0 (socket says 172.21.15.7:41916) 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 -- 172.21.15.7:0/2321006105 learned_addr learned my addr 172.21.15.7:0/2321006105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f7953e00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795406cad0 0x7f79541f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f7958c00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79540b5c00 0x7f795406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 -- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79540b5c00 msgr2=0x7f795406f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79540b5c00 0x7f795406f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 -- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795406cad0 msgr2=0x7f79541f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795406cad0 0x7f79541f7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.210+0000 7f794be00640 1 -- 172.21.15.7:0/2321006105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79541f8470 con 0x7f795406ceb0 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.211+0000 7f794be00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795406ceb0 0x7f79541432d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e9e0 tx=0x7f793c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.211+0000 7f7950c00640 1 -- 172.21.15.7:0/2321006105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c017070 con 0x7f795406ceb0 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.211+0000 7f7950c00640 1 -- 172.21.15.7:0/2321006105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c00c9d0 con 0x7f795406ceb0 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.211+0000 7f7950c00640 1 -- 172.21.15.7:0/2321006105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c00cdc0 con 0x7f795406ceb0 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.211+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795415c260 con 0x7f795406ceb0 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.211+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795415c820 con 0x7f795406ceb0 2024-08-19T00:44:43.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.212+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795415e3d0 con 0x7f795406ceb0 2024-08-19T00:44:43.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.213+0000 7f7950c00640 1 -- 172.21.15.7:0/2321006105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f793c01a070 con 0x7f795406ceb0 2024-08-19T00:44:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.214+0000 7f7950c00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793006be30 0x7f793006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.214+0000 7f7950c00640 1 -- 172.21.15.7:0/2321006105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7f793c08b190 con 0x7f795406ceb0 2024-08-19T00:44:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.214+0000 7f7953e00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793006be30 0x7f793006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.215+0000 7f7953e00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793006be30 0x7f793006e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7944034000 tx=0x7f794402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.219+0000 7f7950c00640 1 -- 172.21.15.7:0/2321006105 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f79541f8470 con 0x7f795406ceb0 2024-08-19T00:44:43.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.439+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7954159990 con 0x7f795406ceb0 2024-08-19T00:44:43.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.440+0000 7f7950c00640 1 -- 172.21.15.7:0/2321006105 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+4389 (secure 0 0 0) 0x7f793c059140 con 0x7f795406ceb0 2024-08-19T00:44:43.442 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:43.443 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":136,"btime":"2024-08-19T00:44:42:203029+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/877185885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":877185885},{"type":"v1","addr":"172.21.15.7:6837","nonce":877185885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:42.202966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:43.443 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 136 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793006be30 msgr2=0x7f793006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793006be30 0x7f793006e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7944034000 tx=0x7f794402e000 comp rx=0 tx=0).stop 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795406ceb0 msgr2=0x7f79541432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795406ceb0 0x7f79541432d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e9e0 tx=0x7f793c00eea0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 shutdown_connections 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793006be30 0x7f793006e2f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79540b5c00 0x7f795406f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795406ceb0 0x7f79541432d0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 --2- 172.21.15.7:0/2321006105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795406cad0 0x7f79541f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 >> 172.21.15.7:0/2321006105 conn(0x7f79540721b0 msgr2=0x7f7954072590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 shutdown_connections 2024-08-19T00:44:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.442+0000 7f795ac00640 1 -- 172.21.15.7:0/2321006105 wait complete. 2024-08-19T00:44:43.460 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds_snaptable' led to DAMAGED state 2024-08-19T00:44:43.460 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_inotable' 2024-08-19T00:44:43.461 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:43.461 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:43.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:44:43.497 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:43.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:43.497 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:44:43.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:44:43.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.767+0000 7ff07ce00640 1 Processor -- start 2024-08-19T00:44:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.768+0000 7ff07ce00640 1 -- start start 2024-08-19T00:44:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff07ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0780ce500 0x7ff0780ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff07ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff07ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff07806f7f0 con 0x7ff078159bf0 2024-08-19T00:44:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff07ce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff0780d0d50 con 0x7ff0780ce500 2024-08-19T00:44:43.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff07ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff07806f510 con 0x7ff0780d03c0 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff076800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff076800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:54706/0 (socket says 172.21.15.7:54706) 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff075e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff078159bf0 0x7ff078073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:58320/0 (socket says 172.21.15.7:58320) 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff076800640 1 -- 172.21.15.7:0/3043471416 learned_addr learned my addr 172.21.15.7:0/3043471416 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.769+0000 7ff06d400640 1 --2- 172.21.15.7:0/3043471416 >> v2:172.21.15.162:3300/0 conn(0x7ff0780ce500 0x7ff0780ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.770+0000 7ff075400640 1 -- 172.21.15.7:0/3043471416 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493622884 0 0) 0x7ff07806f7f0 con 0x7ff078159bf0 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.770+0000 7ff076800640 1 -- 172.21.15.7:0/3043471416 >> v2:172.21.15.162:3300/0 conn(0x7ff0780ce500 msgr2=0x7ff0780ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.770+0000 7ff076800640 1 --2- 172.21.15.7:0/3043471416 >> v2:172.21.15.162:3300/0 conn(0x7ff0780ce500 0x7ff0780ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.770+0000 7ff076800640 1 -- 172.21.15.7:0/3043471416 >> v1:172.21.15.162:6789/0 conn(0x7ff078159bf0 legacy=0x7ff078073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.770+0000 7ff076800640 1 -- 172.21.15.7:0/3043471416 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff078072980 con 0x7ff0780d03c0 2024-08-19T00:44:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.771+0000 7ff076800640 1 --2- 172.21.15.7:0/3043471416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780d0810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff070009e50 tx=0x7ff07002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5daf04cc240d6f4f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.771+0000 7ff075400640 1 -- 172.21.15.7:0/3043471416 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070036070 con 0x7ff0780d03c0 2024-08-19T00:44:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.771+0000 7ff075400640 1 -- 172.21.15.7:0/3043471416 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff070031600 con 0x7ff0780d03c0 2024-08-19T00:44:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.771+0000 7ff075400640 1 -- 172.21.15.7:0/3043471416 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0700319d0 con 0x7ff0780d03c0 2024-08-19T00:44:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 -- 172.21.15.7:0/3043471416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 msgr2=0x7ff0780d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 --2- 172.21.15.7:0/3043471416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780d0810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff070009e50 tx=0x7ff07002a680 comp rx=0 tx=0).stop 2024-08-19T00:44:43.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 -- 172.21.15.7:0/3043471416 shutdown_connections 2024-08-19T00:44:43.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 --2- 172.21.15.7:0/3043471416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780d0810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 --2- 172.21.15.7:0/3043471416 >> v2:172.21.15.162:3300/0 conn(0x7ff0780ce500 0x7ff0780ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 -- 172.21.15.7:0/3043471416 >> 172.21.15.7:0/3043471416 conn(0x7ff07806bc70 msgr2=0x7ff07806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:43.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 -- 172.21.15.7:0/3043471416 shutdown_connections 2024-08-19T00:44:43.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.772+0000 7ff07ce00640 1 -- 172.21.15.7:0/3043471416 wait complete. 2024-08-19T00:44:43.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.774+0000 7ff07ce00640 1 Processor -- start 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.774+0000 7ff07ce00640 1 -- start start 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff07ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0780ce500 0x7ff078155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff07ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff07ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff078159bf0 0x7ff07814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff07ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff078073b70 con 0x7ff0780ce500 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff07ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff078072f40 con 0x7ff078159bf0 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff07ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff078159fd0 con 0x7ff0780d03c0 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0780ce500 0x7ff078155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0780ce500 0x7ff078155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41918/0 (socket says 172.21.15.7:41918) 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 -- 172.21.15.7:0/1216325001 learned_addr learned my addr 172.21.15.7:0/1216325001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:43.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff076800640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff078159bf0 0x7ff07814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff06d400640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 -- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 msgr2=0x7ff0780c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 -- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff078159bf0 msgr2=0x7ff07814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff078159bf0 0x7ff07814b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.775+0000 7ff075e00640 1 -- 172.21.15.7:0/1216325001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff078156560 con 0x7ff0780ce500 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.776+0000 7ff075e00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0780ce500 0x7ff078155ea0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ff06800c4d0 tx=0x7ff06800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.776+0000 7ff06ea00640 1 -- 172.21.15.7:0/1216325001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068018070 con 0x7ff0780ce500 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.776+0000 7ff06ea00640 1 -- 172.21.15.7:0/1216325001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff068007500 con 0x7ff0780ce500 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.776+0000 7ff06ea00640 1 -- 172.21.15.7:0/1216325001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068004a20 con 0x7ff0780ce500 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.776+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff078156840 con 0x7ff0780ce500 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.776+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff078156e00 con 0x7ff0780ce500 2024-08-19T00:44:43.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.777+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0780d07f0 con 0x7ff0780ce500 2024-08-19T00:44:43.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.778+0000 7ff06ea00640 1 -- 172.21.15.7:0/1216325001 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff06801b070 con 0x7ff0780ce500 2024-08-19T00:44:43.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.779+0000 7ff06ea00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff05406be30 0x7ff05406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:43.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.779+0000 7ff06ea00640 1 -- 172.21.15.7:0/1216325001 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7ff06808a570 con 0x7ff0780ce500 2024-08-19T00:44:43.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.779+0000 7ff06d400640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff05406be30 0x7ff05406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:43.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.780+0000 7ff06d400640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff05406be30 0x7ff05406e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff0780d0b80 tx=0x7ff060008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:43.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:43.783+0000 7ff06ea00640 1 -- 172.21.15.7:0/1216325001 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff068058490 con 0x7ff0780ce500 2024-08-19T00:44:44.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.004+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff0780c6440 con 0x7ff0780ce500 2024-08-19T00:44:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.199+0000 7ff06ea00640 1 -- 172.21.15.7:0/1216325001 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v137) ==== 161+0+0 (secure 0 0 0) 0x7ff06805c790 con 0x7ff0780ce500 2024-08-19T00:44:44.202 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff05406be30 msgr2=0x7ff05406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff05406be30 0x7ff05406e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff0780d0b80 tx=0x7ff060008040 comp rx=0 tx=0).stop 2024-08-19T00:44:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0780ce500 msgr2=0x7ff078155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0780ce500 0x7ff078155ea0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ff06800c4d0 tx=0x7ff06800c990 comp rx=0 tx=0).stop 2024-08-19T00:44:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 shutdown_connections 2024-08-19T00:44:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff05406be30 0x7ff05406e2f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff078159bf0 0x7ff07814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0780d03c0 0x7ff0780c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 --2- 172.21.15.7:0/1216325001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0780ce500 0x7ff078155ea0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.201+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 >> 172.21.15.7:0/1216325001 conn(0x7ff07806bc70 msgr2=0x7ff0780ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.202+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 shutdown_connections 2024-08-19T00:44:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.202+0000 7ff07ce00640 1 -- 172.21.15.7:0/1216325001 wait complete. 2024-08-19T00:44:44.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.376+0000 7f20b7e00640 1 Processor -- start 2024-08-19T00:44:44.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.376+0000 7f20b7e00640 1 -- start start 2024-08-19T00:44:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.377+0000 7f20b7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f20b815f7f0 0x7f20b80b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.377+0000 7f20b7e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b815ee10 con 0x7f20b806b850 2024-08-19T00:44:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.377+0000 7f20b7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b815f0f0 con 0x7f20b8070670 2024-08-19T00:44:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.377+0000 7f20b7e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f20b815f3d0 con 0x7f20b815f7f0 2024-08-19T00:44:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.378+0000 7f20b7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f20b815f7f0 0x7f20b80b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:44.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.378+0000 7f20b6a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f20b806b850 0x7f20b815e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50724/0 (socket says 172.21.15.7:50724) 2024-08-19T00:44:44.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.378+0000 7f20b6a00640 1 -- 172.21.15.7:0/321977717 learned_addr learned my addr 172.21.15.7:0/321977717 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:44.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.378+0000 7f20b7400640 1 -- 172.21.15.7:0/321977717 >> v1:172.21.15.162:6789/0 conn(0x7f20b8070670 legacy=0x7f20b806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:44.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.378+0000 7f20b7400640 1 -- 172.21.15.7:0/321977717 >> v1:172.21.15.7:6789/0 conn(0x7f20b806b850 legacy=0x7f20b815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:44.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.378+0000 7f20b7400640 1 -- 172.21.15.7:0/321977717 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b80b6010 con 0x7f20b815f7f0 2024-08-19T00:44:44.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.379+0000 7f20b7400640 1 --2- 172.21.15.7:0/321977717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b815f7f0 0x7f20b80b47f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009d90 tx=0x7f20b002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cec76e07d5a817 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.379+0000 7f20b5600640 1 -- 172.21.15.7:0/321977717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0007740 con 0x7f20b815f7f0 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.379+0000 7f20b5600640 1 -- 172.21.15.7:0/321977717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b00078e0 con 0x7f20b815f7f0 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.379+0000 7f20b5600640 1 -- 172.21.15.7:0/321977717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0007cb0 con 0x7f20b815f7f0 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.380+0000 7f20b7e00640 1 -- 172.21.15.7:0/321977717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b815f7f0 msgr2=0x7f20b80b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.380+0000 7f20b7e00640 1 --2- 172.21.15.7:0/321977717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b815f7f0 0x7f20b80b47f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009d90 tx=0x7f20b002a6f0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.380+0000 7f20b7e00640 1 -- 172.21.15.7:0/321977717 shutdown_connections 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.380+0000 7f20b7e00640 1 --2- 172.21.15.7:0/321977717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b815f7f0 0x7f20b80b47f0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.380+0000 7f20b7e00640 1 -- 172.21.15.7:0/321977717 >> 172.21.15.7:0/321977717 conn(0x7f20b80b2e50 msgr2=0x7f20b80b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.380+0000 7f20b7e00640 1 -- 172.21.15.7:0/321977717 shutdown_connections 2024-08-19T00:44:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.380+0000 7f20b7e00640 1 -- 172.21.15.7:0/321977717 wait complete. 2024-08-19T00:44:44.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.382+0000 7f20b7e00640 1 Processor -- start 2024-08-19T00:44:44.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.382+0000 7f20b7e00640 1 -- start start 2024-08-19T00:44:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806b850 0x7f20b8143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b8070670 0x7f20b81523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b815f7f0 0x7f20b8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20b80b4d30 con 0x7f20b8070670 2024-08-19T00:44:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20b815fed0 con 0x7f20b815f7f0 2024-08-19T00:44:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b7e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20b80b4eb0 con 0x7f20b806b850 2024-08-19T00:44:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b8070670 0x7f20b81523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b8070670 0x7f20b81523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37724/0 (socket says 172.21.15.7:37724) 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 -- 172.21.15.7:0/2323997323 learned_addr learned my addr 172.21.15.7:0/2323997323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6a00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806b850 0x7f20b8143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b7400640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b815f7f0 0x7f20b8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 -- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806b850 msgr2=0x7f20b8143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806b850 0x7f20b8143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 -- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b815f7f0 msgr2=0x7f20b8157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b815f7f0 0x7f20b8157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.383+0000 7f20b6000640 1 -- 172.21.15.7:0/2323997323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b8143af0 con 0x7f20b8070670 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.384+0000 7f20b6000640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b8070670 0x7f20b81523d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c430 tx=0x7f20a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.384+0000 7f20aea00640 1 -- 172.21.15.7:0/2323997323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a40052d0 con 0x7f20b8070670 2024-08-19T00:44:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.384+0000 7f20aea00640 1 -- 172.21.15.7:0/2323997323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4005490 con 0x7f20b8070670 2024-08-19T00:44:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.384+0000 7f20aea00640 1 -- 172.21.15.7:0/2323997323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007260 con 0x7f20b8070670 2024-08-19T00:44:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.384+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b8143dd0 con 0x7f20b8070670 2024-08-19T00:44:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.384+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b8144390 con 0x7f20b8070670 2024-08-19T00:44:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.385+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b80b5240 con 0x7f20b8070670 2024-08-19T00:44:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.386+0000 7f20aea00640 1 -- 172.21.15.7:0/2323997323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20a4007400 con 0x7f20b8070670 2024-08-19T00:44:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.387+0000 7f20aea00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209806be30 0x7f209806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.387+0000 7f20aea00640 1 -- 172.21.15.7:0/2323997323 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7f20a408a5f0 con 0x7f20b8070670 2024-08-19T00:44:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.387+0000 7f20b6a00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209806be30 0x7f209806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.388+0000 7f20b6a00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209806be30 0x7f209806e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f20a8005880 tx=0x7f20a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.391+0000 7f20aea00640 1 -- 172.21.15.7:0/2323997323 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f20a4058630 con 0x7f20b8070670 2024-08-19T00:44:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:44.643+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f20b8070210 con 0x7f20b8070670 2024-08-19T00:44:45.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.201+0000 7f20aea00640 1 -- 172.21.15.7:0/2323997323 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v138) ==== 101+0+0 (secure 0 0 0) 0x7f20a405c930 con 0x7f20b8070670 2024-08-19T00:44:45.204 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:44:45.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.203+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209806be30 msgr2=0x7f209806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.203+0000 7f20b7e00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209806be30 0x7f209806e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f20a8005880 tx=0x7f20a8009040 comp rx=0 tx=0).stop 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.203+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b8070670 msgr2=0x7f20b81523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.203+0000 7f20b7e00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b8070670 0x7f20b81523d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c430 tx=0x7f20a400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 shutdown_connections 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f209806be30 0x7f209806e2f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b815f7f0 0x7f20b8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b8070670 0x7f20b81523d0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 --2- 172.21.15.7:0/2323997323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806b850 0x7f20b8143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 >> 172.21.15.7:0/2323997323 conn(0x7f20b80b2e50 msgr2=0x7f20b80b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 shutdown_connections 2024-08-19T00:44:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.204+0000 7f20b7e00640 1 -- 172.21.15.7:0/2323997323 wait complete. 2024-08-19T00:44:45.225 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:45.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.302+0000 7fb357197f40 1 Processor -- start 2024-08-19T00:44:45.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.302+0000 7fb357197f40 1 -- start start 2024-08-19T00:44:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb357197f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 0x559da0425280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb357197f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d5b0 0x559da0424c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb357197f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d990 0x559da035af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb357197f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559da038c8f0 con 0x559da038d990 2024-08-19T00:44:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb357197f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559da0301d00 con 0x559da038d5b0 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb357197f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559da0432dc0 con 0x559da038bf40 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d990 0x559da035af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d990 0x559da035af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37750/0 (socket says 172.21.15.7:37750) 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354e00640 1 -- 172.21.15.7:0/643709280 learned_addr learned my addr 172.21.15.7:0/643709280 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354400640 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 0x559da0425280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb353a00640 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d5b0 0x559da0424c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354e00640 1 -- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 msgr2=0x559da0425280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354e00640 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 0x559da0425280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354e00640 1 -- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d5b0 msgr2=0x559da0424c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.303+0000 7fb354e00640 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d5b0 0x559da0424c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.304+0000 7fb354e00640 1 -- 172.21.15.7:0/643709280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da0286b30 con 0x559da038d990 2024-08-19T00:44:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.304+0000 7fb354e00640 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d990 0x559da035af40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fb34c025a20 tx=0x7fb34c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4395db0f386b4b42 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.304+0000 7fb352600640 1 -- 172.21.15.7:0/643709280 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c054040 con 0x559da038d990 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.304+0000 7fb352600640 1 -- 172.21.15.7:0/643709280 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c0508c0 con 0x559da038d990 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.304+0000 7fb352600640 1 -- 172.21.15.7:0/643709280 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c050cb0 con 0x559da038d990 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 -- 172.21.15.7:0/643709280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d990 msgr2=0x559da035af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d990 0x559da035af40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fb34c025a20 tx=0x7fb34c050000 comp rx=0 tx=0).stop 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 -- 172.21.15.7:0/643709280 shutdown_connections 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d990 0x559da035af40 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d5b0 0x559da0424c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 --2- 172.21.15.7:0/643709280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 0x559da0425280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 -- 172.21.15.7:0/643709280 >> 172.21.15.7:0/643709280 conn(0x559da038a4e0 msgr2=0x559da038a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 -- 172.21.15.7:0/643709280 shutdown_connections 2024-08-19T00:44:45.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 -- 172.21.15.7:0/643709280 wait complete. 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.305+0000 7fb357197f40 1 Processor -- start 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.306+0000 7fb357197f40 1 -- start start 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.306+0000 7fb357197f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 0x559da04268c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.306+0000 7fb357197f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d5b0 0x559da0422590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.306+0000 7fb357197f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d990 0x559da0423240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.306+0000 7fb357197f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559da04285b0 con 0x559da038d5b0 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.306+0000 7fb357197f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559da0428e60 con 0x559da038d990 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.306+0000 7fb357197f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559da0433aa0 con 0x559da038bf40 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d5b0 0x559da0422590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d5b0 0x559da0422590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37754/0 (socket says 172.21.15.7:37754) 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 learned_addr learned my addr 172.21.15.7:0/340864794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:45.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb354e00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d990 0x559da0423240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb354400640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 0x559da04268c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 msgr2=0x559da04268c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559da038bf40 0x559da04268c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d990 msgr2=0x559da0423240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da038d990 0x559da0423240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.307+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da02c3080 con 0x559da038d5b0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.308+0000 7fb353a00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d5b0 0x559da0422590 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb34000dbc0 tx=0x7fb34000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.308+0000 7fb351200640 1 -- 172.21.15.7:0/340864794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3400030d0 con 0x559da038d5b0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.308+0000 7fb351200640 1 -- 172.21.15.7:0/340864794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb340016070 con 0x559da038d5b0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.308+0000 7fb351200640 1 -- 172.21.15.7:0/340864794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340001510 con 0x559da038d5b0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.308+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559da0359c60 con 0x559da038d5b0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.308+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559da04260c0 con 0x559da038d5b0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.310+0000 7fb351200640 1 -- 172.21.15.7:0/340864794 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3400018c0 con 0x559da038d5b0 2024-08-19T00:44:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.311+0000 7fb351200640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb33406a810 0x7fb33406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.311+0000 7fb351200640 1 -- 172.21.15.7:0/340864794 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7fb340089e80 con 0x559da038d5b0 2024-08-19T00:44:45.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.311+0000 7fb354400640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb33406a810 0x7fb33406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.314 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:45.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.311+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559da0422ad0 0x559da04cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.311+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da042b8b0 con 0x559da0422ad0 2024-08-19T00:44:45.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.312+0000 7fb354e00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559da0422ad0 0x559da04cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.312+0000 7fb354400640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb33406a810 0x7fb33406ccd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb344005fd0 tx=0x7fb344005a70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.312+0000 7fb354e00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559da0422ad0 0x559da04cbf00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.314+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v95'257 uv231 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.314+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da0423c90 con 0x559da0422ad0 2024-08-19T00:44:45.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.316+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v95'258 uv258 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.316+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04cc440 con 0x559da0422ad0 2024-08-19T00:44:45.320 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:45.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.317+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v95'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.318+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04cc7e0 con 0x559da0422ad0 2024-08-19T00:44:45.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.319+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v95'260 uv260 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.319+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d61e0 con 0x559da0422ad0 2024-08-19T00:44:45.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.321+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v95'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.321+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d51d0 con 0x559da0422ad0 2024-08-19T00:44:45.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.322+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v95'262 uv262 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.322+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5570 con 0x559da0422ad0 2024-08-19T00:44:45.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.324+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v95'263 uv237 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.324+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.325+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v95'264 uv264 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.325+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.329 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:45.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.327+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v95'265 uv265 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.327+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.328+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v95'266 uv266 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.328+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.330+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v95'267 uv267 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.330+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.332+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v95'268 uv268 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.332+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.333+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v95'269 uv244 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.333+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.335+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v95'270 uv270 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.335+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.339 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:45.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.336+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v95'271 uv271 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.336+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.338+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v95'272 uv272 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.338+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.340+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v95'273 uv273 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.340+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5910 con 0x559da0422ad0 2024-08-19T00:44:45.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.341+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v95'274 uv274 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.341+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.343+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v95'275 uv275 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.343+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.344+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v95'276 uv250 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.344+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.346+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v95'277 uv277 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.346+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.350 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.348+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v95'278 uv278 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.348+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.349+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v95'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.349+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.350+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v95'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.350+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.352+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v95'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.352+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.353+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v95'282 uv256 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.353+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.354+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v95'283 uv283 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.354+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da041eaa0 con 0x559da0422ad0 2024-08-19T00:44:45.358 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:45.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.356+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v95'284 uv284 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.356+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5bd0 con 0x559da0422ad0 2024-08-19T00:44:45.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.357+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v95'285 uv285 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.357+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5bd0 con 0x559da0422ad0 2024-08-19T00:44:45.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.358+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v95'286 uv286 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.358+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d5bd0 con 0x559da0422ad0 2024-08-19T00:44:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.360+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v95'287 uv287 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.360+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559da04d5bd0 0x559da04d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.360+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d8fe0 con 0x559da04d5bd0 2024-08-19T00:44:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.360+0000 7fb354400640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559da04d5bd0 0x559da04d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.361+0000 7fb354400640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559da04d5bd0 0x559da04d8aa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.362+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v95'198 uv181 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.362+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04d9380 con 0x559da04d5bd0 2024-08-19T00:44:45.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.364+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v95'199 uv199 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.364+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d9720 con 0x559da04d5bd0 2024-08-19T00:44:45.368 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:45.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.365+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v95'200 uv200 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.365+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d9ac0 con 0x559da04d5bd0 2024-08-19T00:44:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.367+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v95'201 uv201 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.367+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04d9e60 con 0x559da04d5bd0 2024-08-19T00:44:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.369+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v95'202 uv202 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.369+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da200 con 0x559da04d5bd0 2024-08-19T00:44:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.370+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v95'203 uv186 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.370+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04da5a0 con 0x559da04d5bd0 2024-08-19T00:44:45.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.372+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v95'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.372+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.375 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.373+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v95'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.373+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.375+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v95'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.375+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.376+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v95'207 uv207 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.376+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.377+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v95'208 uv191 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.377+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.379+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v95'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.379+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.383 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:45.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.380+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v95'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.380+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04df030 con 0x559da04d5bd0 2024-08-19T00:44:45.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.382+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v95'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.382+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04df030 con 0x559da04d5bd0 2024-08-19T00:44:45.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.383+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v95'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.383+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.385+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v95'213 uv197 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.385+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.386+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v95'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.386+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.390 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:45.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.387+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v95'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.387+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04db950 con 0x559da04d5bd0 2024-08-19T00:44:45.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.389+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v95'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.389+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04db950 con 0x559da04d5bd0 2024-08-19T00:44:45.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.390+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v95'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.390+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04da940 con 0x559da04d5bd0 2024-08-19T00:44:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.392+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v95'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04d5bd0 2024-08-19T00:44:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.392+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x559da04dafc0 0x559da04dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.392+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04dd980 con 0x559da04dafc0 2024-08-19T00:44:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.392+0000 7fb353a00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x559da04dafc0 0x559da04dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.393+0000 7fb353a00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x559da04dafc0 0x559da04dd3b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.394+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v95'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.394+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04dde60 con 0x559da04dafc0 2024-08-19T00:44:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.395+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v95'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.395+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04de340 con 0x559da04dafc0 2024-08-19T00:44:45.399 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.397+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v95'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.397+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04dfbf0 con 0x559da04dafc0 2024-08-19T00:44:45.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.398+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v95'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.398+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04dff90 con 0x559da04dafc0 2024-08-19T00:44:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.399+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v95'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.399+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04debe0 con 0x559da04dafc0 2024-08-19T00:44:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.400+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v95'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.400+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04defd0 con 0x559da0422ad0 2024-08-19T00:44:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.402+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v95'42 uv41 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.402+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04defd0 con 0x559da0422ad0 2024-08-19T00:44:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.404+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v95'43 uv43 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.404+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04defd0 con 0x559da0422ad0 2024-08-19T00:44:45.408 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:45.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.405+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v95'44 uv44 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.405+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04defd0 con 0x559da0422ad0 2024-08-19T00:44:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.407+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v95'45 uv45 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.407+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x559da04df4e0 0x559da04e2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.407+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e2880 con 0x559da04df4e0 2024-08-19T00:44:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.407+0000 7fb354e00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x559da04df4e0 0x559da04e2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.408+0000 7fb354e00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x559da04df4e0 0x559da04e2340 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.409+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v95'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.409+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e2880 con 0x559da04df4e0 2024-08-19T00:44:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.411+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v95'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.411+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e2880 con 0x559da04df4e0 2024-08-19T00:44:45.414 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:45.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.412+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v95'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.412+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04de7a0 con 0x559da04df4e0 2024-08-19T00:44:45.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.413+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v95'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.413+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04de7a0 con 0x559da04df4e0 2024-08-19T00:44:45.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.414+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v95'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.414+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04de7a0 con 0x559da04df4e0 2024-08-19T00:44:45.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.416+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v95'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.416+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x559da04e3260 0x559da04e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.416+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e5b90 con 0x559da04e3260 2024-08-19T00:44:45.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.417+0000 7fb354400640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x559da04e3260 0x559da04e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.417+0000 7fb354400640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x559da04e3260 0x559da04e5650 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.418+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v95'94 uv88 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.418+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e5c10 con 0x559da04e3260 2024-08-19T00:44:45.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.420+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v95'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.420+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e6030 con 0x559da04e3260 2024-08-19T00:44:45.424 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.421+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v95'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.421+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e7040 con 0x559da04e3260 2024-08-19T00:44:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.423+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v95'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.423+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e7040 con 0x559da04e3260 2024-08-19T00:44:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.424+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v95'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.424+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e6030 con 0x559da04e3260 2024-08-19T00:44:45.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.426+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v95'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.426+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e6030 con 0x559da04e3260 2024-08-19T00:44:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.427+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v95'100 uv93 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.427+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e6030 con 0x559da04e3260 2024-08-19T00:44:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.428+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v95'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.429+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e6030 con 0x559da04e3260 2024-08-19T00:44:45.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.430+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v95'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.432 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:45.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.430+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e6030 con 0x559da04e3260 2024-08-19T00:44:45.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.431+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v95'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.431+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e6030 con 0x559da04e3260 2024-08-19T00:44:45.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.433+0000 7fb354400640 1 -- 172.21.15.7:0/340864794 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v95'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb344020040 con 0x559da04e3260 2024-08-19T00:44:45.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.433+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x559da04e6540 0x559da04e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.433+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9070 con 0x559da04e6540 2024-08-19T00:44:45.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.433+0000 7fb353a00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x559da04e6540 0x559da04e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.434+0000 7fb353a00640 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x559da04e6540 0x559da04e8970 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.437 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:45.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.435+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v95'43 uv43 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.435+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9480 con 0x559da04e6540 2024-08-19T00:44:45.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.437+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [write 0~70] v95'44 uv44 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.437+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04e6540 2024-08-19T00:44:45.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.438+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v95'45 uv45 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.438+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:83 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da0422ad0 2024-08-19T00:44:45.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.439+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(83 605.00000000 [create] v95'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.439+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:84 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da0422ad0 2024-08-19T00:44:45.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.441+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(84 605.00000000 [delete] v95'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.441+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da0422ad0 2024-08-19T00:44:45.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.442+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(85 605.00000000 [create] v95'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.445 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:45.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.442+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ea8d0 con 0x559da0422ad0 2024-08-19T00:44:45.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.443+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v95'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.443+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ea8d0 con 0x559da0422ad0 2024-08-19T00:44:45.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.445+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v95'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.445+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da0422ad0 2024-08-19T00:44:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.447+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(88 605.00000000 [omap-set-header] v95'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da0422ad0 2024-08-19T00:44:45.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.447+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:89 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.448+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(89 mds0_inotable [create] v95'84 uv78 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.448+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:90 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.449+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(90 mds0_inotable [delete] v95'85 uv85 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.450+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.454 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:45.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.451+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(91 mds0_inotable [create] v95'86 uv86 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.451+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.452+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(92 mds0_inotable [write 0~34] v95'87 uv87 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.452+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.454+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v95'88 uv88 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.454+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.455+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(94 100.00000000 [create] v95'89 uv83 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.455+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.456+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(95 100.00000000 [delete] v95'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.456+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.460 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:45.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.458+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(96 100.00000000 [create] v95'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.458+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e98c0 con 0x559da04dafc0 2024-08-19T00:44:45.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.459+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(97 100.00000000 [omap-set-header] v95'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.459+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec6b0 con 0x559da04dafc0 2024-08-19T00:44:45.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.461+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v95'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04dafc0 2024-08-19T00:44:45.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.461+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.462+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v95'40 uv39 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.462+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.464+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v95'41 uv41 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.464+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.468 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.465+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v95'42 uv42 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.465+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.467+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v95'43 uv43 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.467+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.469+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v95'51 uv50 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.469+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.470+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v95'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.470+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.474 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:45.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.471+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v95'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.471+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec670 con 0x559da04df4e0 2024-08-19T00:44:45.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.473+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v95'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.473+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec650 con 0x559da04df4e0 2024-08-19T00:44:45.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.474+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v95'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.474+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec650 con 0x559da04df4e0 2024-08-19T00:44:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.477+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v95'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34c056030 con 0x559da04df4e0 2024-08-19T00:44:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.477+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec650 con 0x559da04e6540 2024-08-19T00:44:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.478+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(109 400.00000000 [create] v95'42 uv41 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.478+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04ec650 con 0x559da04e6540 2024-08-19T00:44:45.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.480+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(110 400.00000000 [delete] v95'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.480+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.481+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v95'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.484 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.481+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.483+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [write 0~22] v95'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.483+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.484+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [omap-set-header] v95'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.484+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.486+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 100.00000000.inode [create] v95'107 uv99 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.486+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.487+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 100.00000000.inode [delete] v95'108 uv108 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.487+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.491 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:45.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.489+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v95'109 uv109 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.489+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.490+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v95'110 uv110 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.490+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.491+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v95'111 uv111 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.492+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.493+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 1.00000000 [create] v95'112 uv106 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.493+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.494+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 1.00000000 [delete] v95'113 uv113 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.494+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.498 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:45.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.495+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v95'114 uv114 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.495+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04eac40 con 0x559da04e6540 2024-08-19T00:44:45.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.497+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v95'115 uv115 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.497+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04eac40 con 0x559da04e6540 2024-08-19T00:44:45.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.498+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v95'116 uv116 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.498+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04e9c30 con 0x559da04e6540 2024-08-19T00:44:45.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.500+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [omap-set-header] v95'117 uv117 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.500+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x559da04ea4d0 con 0x559da04e6540 2024-08-19T00:44:45.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb353a00640 1 -- 172.21.15.7:0/340864794 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v95'118 uv118 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb34000e040 con 0x559da04e6540 2024-08-19T00:44:45.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559da04d5bd0 msgr2=0x559da04d8aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x559da04d5bd0 0x559da04d8aa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x559da04e3260 msgr2=0x559da04e5650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x559da04e3260 0x559da04e5650 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x559da04e6540 msgr2=0x559da04e8970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x559da04e6540 0x559da04e8970 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x559da04dafc0 msgr2=0x559da04dd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x559da04dafc0 0x559da04dd3b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 reap_dead start 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559da0422ad0 msgr2=0x559da04cbf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x559da0422ad0 0x559da04cbf00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb354e00640 1 -- 172.21.15.7:0/340864794 reap_dead start 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x559da04df4e0 msgr2=0x559da04e2340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x559da04df4e0 0x559da04e2340 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb33406a810 msgr2=0x7fb33406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb33406a810 0x7fb33406ccd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb344005fd0 tx=0x7fb344005a70 comp rx=0 tx=0).stop 2024-08-19T00:44:45.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d5b0 msgr2=0x559da0422590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d5b0 0x559da0422590 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb34000dbc0 tx=0x7fb34000b5b0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 shutdown_connections 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb33406a810 0x7fb33406ccd0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x559da04df4e0 0x559da04e2340 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 --2- 172.21.15.7:0/340864794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559da038d5b0 0x559da0422590 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 >> 172.21.15.7:0/340864794 conn(0x559da038a4e0 msgr2=0x559da0428730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 shutdown_connections 2024-08-19T00:44:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.501+0000 7fb357197f40 1 -- 172.21.15.7:0/340864794 wait complete. 2024-08-19T00:44:45.510 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_inotable 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.624+0000 7fa8196f6f40 1 Processor -- start 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.625+0000 7fa8196f6f40 1 -- start start 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.625+0000 7fa8196f6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726df40 0x55a5473070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.625+0000 7fa8196f6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726f5b0 0x55a54723c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.625+0000 7fa8196f6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f990 0x55a54730c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.625+0000 7fa8196f6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a5471e3d00 con 0x55a54726f990 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.625+0000 7fa8196f6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5471e7d40 con 0x55a54726df40 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.625+0000 7fa8196f6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a547314dc0 con 0x55a54726f5b0 2024-08-19T00:44:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f990 0x55a54730c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f990 0x55a54730c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37756/0 (socket says 172.21.15.7:37756) 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 -- 172.21.15.7:0/4039447127 learned_addr learned my addr 172.21.15.7:0/4039447127 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa816800640 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726df40 0x55a5473070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa815e00640 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726f5b0 0x55a54723c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 -- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726f5b0 msgr2=0x55a54723c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726f5b0 0x55a54723c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 -- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726df40 msgr2=0x55a5473070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726df40 0x55a5473070c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 -- 172.21.15.7:0/4039447127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5471a5080 con 0x55a54726f990 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.626+0000 7fa817200640 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f990 0x55a54730c650 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa8100015b0 tx=0x7fa810001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1775e01c19ea3bf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa814a00640 1 -- 172.21.15.7:0/4039447127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810016070 con 0x55a54726f990 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa814a00640 1 -- 172.21.15.7:0/4039447127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81000f710 con 0x55a54726f990 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa814a00640 1 -- 172.21.15.7:0/4039447127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81000fb20 con 0x55a54726f990 2024-08-19T00:44:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 -- 172.21.15.7:0/4039447127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f990 msgr2=0x55a54730c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f990 0x55a54730c650 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa8100015b0 tx=0x7fa810001a70 comp rx=0 tx=0).stop 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 -- 172.21.15.7:0/4039447127 shutdown_connections 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f990 0x55a54730c650 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726f5b0 0x55a54723c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/4039447127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726df40 0x55a5473070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 -- 172.21.15.7:0/4039447127 >> 172.21.15.7:0/4039447127 conn(0x55a54726c4e0 msgr2=0x55a54726b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 -- 172.21.15.7:0/4039447127 shutdown_connections 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.627+0000 7fa8196f6f40 1 -- 172.21.15.7:0/4039447127 wait complete. 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.628+0000 7fa8196f6f40 1 Processor -- start 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.628+0000 7fa8196f6f40 1 -- start start 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa8196f6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726df40 0x55a54726a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa8196f6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f5b0 0x55a547313030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa8196f6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726f990 0x55a547300dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa8196f6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a54723d710 con 0x55a54726f5b0 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa8196f6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a54726b600 con 0x55a54726f990 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa8196f6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a5473158c0 con 0x55a54726df40 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa815e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f5b0 0x55a547313030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa816800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726df40 0x55a54726a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa815e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f5b0 0x55a547313030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37762/0 (socket says 172.21.15.7:37762) 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa815e00640 1 -- 172.21.15.7:0/3955221914 learned_addr learned my addr 172.21.15.7:0/3955221914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.629+0000 7fa817200640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726f990 0x55a547300dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa816800640 1 -- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726f990 msgr2=0x55a547300dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa816800640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54726f990 0x55a547300dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa816800640 1 -- 172.21.15.7:0/3955221914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f5b0 msgr2=0x55a547313030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa816800640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a54726f5b0 0x55a547313030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa816800640 1 -- 172.21.15.7:0/3955221914 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a547313af0 con 0x55a54726df40 2024-08-19T00:44:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa816800640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726df40 0x55a54726a420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa808000f60 tx=0x7fa80800b6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa80f400640 1 -- 172.21.15.7:0/3955221914 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80800f650 con 0x55a54726df40 2024-08-19T00:44:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa80f400640 1 -- 172.21.15.7:0/3955221914 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80800f7f0 con 0x55a54726df40 2024-08-19T00:44:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa80f400640 1 -- 172.21.15.7:0/3955221914 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80800fbe0 con 0x55a54726df40 2024-08-19T00:44:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.630+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a547313dd0 con 0x55a54726df40 2024-08-19T00:44:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.631+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a547314390 con 0x55a54726df40 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.632+0000 7fa80f400640 1 -- 172.21.15.7:0/3955221914 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa808017400 con 0x55a54726df40 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.633+0000 7fa80f400640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7f806a810 0x7fa7f806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.633+0000 7fa80f400640 1 -- 172.21.15.7:0/3955221914 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7fa80808a530 con 0x55a54726df40 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.633+0000 7fa815e00640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7f806a810 0x7fa7f806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.634+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55a54726a960 0x55a547311d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.634+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e95) -- 0x55a5473122b0 con 0x55a54726a960 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.634+0000 7fa815e00640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7f806a810 0x7fa7f806ccd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa804000c00 tx=0x7fa804050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.634+0000 7fa817200640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55a54726a960 0x55a547311d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.635+0000 7fa817200640 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55a54726a960 0x55a547311d70 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa817200640 1 -- 172.21.15.7:0/3955221914 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 mds0_inotable [delete] v95'94 uv94 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa81000f070 con 0x55a54726a960 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55a54726a960 msgr2=0x55a547311d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55a54726a960 0x55a547311d70 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7f806a810 msgr2=0x7fa7f806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa7f806a810 0x7fa7f806ccd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa804000c00 tx=0x7fa804050000 comp rx=0 tx=0).stop 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726df40 msgr2=0x55a54726a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 --2- 172.21.15.7:0/3955221914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54726df40 0x55a54726a420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa808000f60 tx=0x7fa80800b6c0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa817200640 1 -- 172.21.15.7:0/3955221914 reap_dead start 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 shutdown_connections 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.636+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 >> 172.21.15.7:0/3955221914 conn(0x55a54726c4e0 msgr2=0x55a54730dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.637+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 shutdown_connections 2024-08-19T00:44:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.637+0000 7fa8196f6f40 1 -- 172.21.15.7:0/3955221914 wait complete. 2024-08-19T00:44:45.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:45.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.799+0000 7f13eaa00640 1 Processor -- start 2024-08-19T00:44:45.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.799+0000 7f13eaa00640 1 -- start start 2024-08-19T00:44:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13eaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13e415bfb0 0x7f13e40b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e40b5130 0x7f13e40aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13eaa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40acef0 con 0x7f13e415c390 2024-08-19T00:44:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13eaa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f13e40ad790 con 0x7f13e415bfb0 2024-08-19T00:44:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13eaa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13e40ad1d0 con 0x7f13e40b5130 2024-08-19T00:44:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13e3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13e415bfb0 0x7f13e40b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13e3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13e415bfb0 0x7f13e40b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37766/0 (socket says 172.21.15.7:37766) 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13e3e00640 1 -- 172.21.15.7:0/4275221355 learned_addr learned my addr 172.21.15.7:0/4275221355 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13e8a00640 1 --1- 172.21.15.7:0/4275221355 >> v1:172.21.15.7:6789/0 conn(0x7f13e415c390 0x7f13e415fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50756/0 (socket says 172.21.15.7:50756) 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13dbe00640 1 --2- 172.21.15.7:0/4275221355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e40b5130 0x7f13e40aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13e3e00640 1 -- 172.21.15.7:0/4275221355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e40b5130 msgr2=0x7f13e40aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13e3e00640 1 --2- 172.21.15.7:0/4275221355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e40b5130 0x7f13e40aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.801+0000 7f13e3e00640 1 -- 172.21.15.7:0/4275221355 >> v1:172.21.15.7:6789/0 conn(0x7f13e415c390 legacy=0x7f13e415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.802+0000 7f13e3e00640 1 -- 172.21.15.7:0/4275221355 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e40ad4b0 con 0x7f13e415bfb0 2024-08-19T00:44:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.802+0000 7f13e3400640 1 -- 172.21.15.7:0/4275221355 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100605706 0 0) 0x7f13e40acef0 con 0x7f13e415c390 2024-08-19T00:44:45.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13e3e00640 1 --2- 172.21.15.7:0/4275221355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e415bfb0 0x7f13e40b3e00 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009870 tx=0x7f13d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e7512ebd6a46cc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13e3400640 1 -- 172.21.15.7:0/4275221355 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4037070 con 0x7f13e415bfb0 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13e3400640 1 -- 172.21.15.7:0/4275221355 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d4032440 con 0x7f13e415bfb0 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13e3400640 1 -- 172.21.15.7:0/4275221355 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4032810 con 0x7f13e415bfb0 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13eaa00640 1 -- 172.21.15.7:0/4275221355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e415bfb0 msgr2=0x7f13e40b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13eaa00640 1 --2- 172.21.15.7:0/4275221355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e415bfb0 0x7f13e40b3e00 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009870 tx=0x7f13d402a270 comp rx=0 tx=0).stop 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13eaa00640 1 -- 172.21.15.7:0/4275221355 shutdown_connections 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13eaa00640 1 --2- 172.21.15.7:0/4275221355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e40b5130 0x7f13e40aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13eaa00640 1 --2- 172.21.15.7:0/4275221355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e415bfb0 0x7f13e40b3e00 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13eaa00640 1 -- 172.21.15.7:0/4275221355 >> 172.21.15.7:0/4275221355 conn(0x7f13e40b2300 msgr2=0x7f13e406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.803+0000 7f13eaa00640 1 -- 172.21.15.7:0/4275221355 shutdown_connections 2024-08-19T00:44:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.804+0000 7f13eaa00640 1 -- 172.21.15.7:0/4275221355 wait complete. 2024-08-19T00:44:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.805+0000 7f13eaa00640 1 Processor -- start 2024-08-19T00:44:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.805+0000 7f13eaa00640 1 -- start start 2024-08-19T00:44:45.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e40b5130 0x7f13e4147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e415bfb0 0x7f13e406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e415c390 0x7f13e41443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13eaa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13e40b44c0 con 0x7f13e40b5130 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13eaa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13e40b4340 con 0x7f13e415bfb0 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13eaa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13e4073050 con 0x7f13e415c390 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e40b5130 0x7f13e4147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e40b5130 0x7f13e4147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37772/0 (socket says 172.21.15.7:37772) 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.806+0000 7f13e3e00640 1 -- 172.21.15.7:0/3216483492 learned_addr learned my addr 172.21.15.7:0/3216483492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13dbe00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e415bfb0 0x7f13e406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e8a00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e415c390 0x7f13e41443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e3e00640 1 -- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e415c390 msgr2=0x7f13e41443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e3e00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e415c390 0x7f13e41443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e3e00640 1 -- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e415bfb0 msgr2=0x7f13e406ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e3e00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e415bfb0 0x7f13e406ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:45.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e3e00640 1 -- 172.21.15.7:0/3216483492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e4147cd0 con 0x7f13e40b5130 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e8a00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e415c390 0x7f13e41443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.807+0000 7f13e3e00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e40b5130 0x7f13e4147790 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009870 tx=0x7f13d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.808+0000 7f13e0c00640 1 -- 172.21.15.7:0/3216483492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4037040 con 0x7f13e40b5130 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.808+0000 7f13e0c00640 1 -- 172.21.15.7:0/3216483492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d4004030 con 0x7f13e40b5130 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.808+0000 7f13e0c00640 1 -- 172.21.15.7:0/3216483492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004400 con 0x7f13e40b5130 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.808+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e406dc70 con 0x7f13e40b5130 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.808+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e406e230 con 0x7f13e40b5130 2024-08-19T00:44:45.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.809+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e40b3e00 con 0x7f13e40b5130 2024-08-19T00:44:45.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.810+0000 7f13e0c00640 1 -- 172.21.15.7:0/3216483492 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13d403a070 con 0x7f13e40b5130 2024-08-19T00:44:45.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.811+0000 7f13e0c00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c006be60 0x7f13c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:45.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.811+0000 7f13e0c00640 1 -- 172.21.15.7:0/3216483492 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6483+0+0 (secure 0 0 0) 0x7f13d40ab610 con 0x7f13e40b5130 2024-08-19T00:44:45.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.811+0000 7f13dbe00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c006be60 0x7f13c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:45.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.811+0000 7f13dbe00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c006be60 0x7f13c006e320 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13e41f7b40 tx=0x7f13cc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:45.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:45.815+0000 7f13e0c00640 1 -- 172.21.15.7:0/3216483492 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f13e4147cd0 con 0x7f13e40b5130 2024-08-19T00:44:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.034+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f13e41581e0 con 0x7f13e40b5130 2024-08-19T00:44:46.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.212+0000 7f13e0c00640 1 -- 172.21.15.7:0/3216483492 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v139) ==== 162+0+0 (secure 0 0 0) 0x7f13d4041020 con 0x7f13e40b5130 2024-08-19T00:44:46.215 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c006be60 msgr2=0x7f13c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c006be60 0x7f13c006e320 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13e41f7b40 tx=0x7f13cc009190 comp rx=0 tx=0).stop 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e40b5130 msgr2=0x7f13e4147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e40b5130 0x7f13e4147790 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009870 tx=0x7f13d40046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 shutdown_connections 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13c006be60 0x7f13c006e320 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13e415c390 0x7f13e41443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13e415bfb0 0x7f13e406ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 --2- 172.21.15.7:0/3216483492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e40b5130 0x7f13e4147790 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 >> 172.21.15.7:0/3216483492 conn(0x7f13e40b2300 msgr2=0x7f13e4074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:46.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 shutdown_connections 2024-08-19T00:44:46.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.215+0000 7f13eaa00640 1 -- 172.21.15.7:0/3216483492 wait complete. 2024-08-19T00:44:46.225 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:44:46.222+0000 7f555ce00640 -1 mds.0.inotable: load_2 could not read table: -2 2024-08-19T00:44:46.225 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:44:46.222+0000 7f555ce00640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2024-08-19T00:44:46.226 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:46.223+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:46.226 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:46.223+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:44:46.236 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:46.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.395+0000 7f889be00640 1 Processor -- start 2024-08-19T00:44:46.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.395+0000 7f889be00640 1 -- start start 2024-08-19T00:44:46.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f889c15e360 0x7f889c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f889c15e740 0x7f889c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889be00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f889c0d3490 con 0x7f889c15e360 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889be00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f889c0b3ab0 con 0x7f889c15e740 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f889c15f460 con 0x7f889c0d2af0 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f889c15e360 0x7f889c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f889c15e360 0x7f889c15fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37776/0 (socket says 172.21.15.7:37776) 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.396+0000 7f889aa00640 1 -- 172.21.15.7:0/2263340237 learned_addr learned my addr 172.21.15.7:0/2263340237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889a000640 1 --2- 172.21.15.7:0/2263340237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889b400640 1 --2- 172.21.15.7:0/2263340237 >> v2:172.21.15.162:3300/0 conn(0x7f889c15e740 0x7f889c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889aa00640 1 -- 172.21.15.7:0/2263340237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 msgr2=0x7f889c0d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889aa00640 1 --2- 172.21.15.7:0/2263340237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c0d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889aa00640 1 -- 172.21.15.7:0/2263340237 >> v2:172.21.15.162:3300/0 conn(0x7f889c15e740 msgr2=0x7f889c15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:46.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889aa00640 1 --2- 172.21.15.7:0/2263340237 >> v2:172.21.15.162:3300/0 conn(0x7f889c15e740 0x7f889c15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889aa00640 1 -- 172.21.15.7:0/2263340237 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c15f740 con 0x7f889c15e360 2024-08-19T00:44:46.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889a000640 1 --2- 172.21.15.7:0/2263340237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c0d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:46.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.397+0000 7f889b400640 1 --2- 172.21.15.7:0/2263340237 >> v2:172.21.15.162:3300/0 conn(0x7f889c15e740 0x7f889c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:46.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.398+0000 7f889aa00640 1 --2- 172.21.15.7:0/2263340237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e360 0x7f889c15fab0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f889c08d500 tx=0x7f888c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b69929c128ae4ec server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:46.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.398+0000 7f8899600640 1 -- 172.21.15.7:0/2263340237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c037070 con 0x7f889c15e360 2024-08-19T00:44:46.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.398+0000 7f8899600640 1 -- 172.21.15.7:0/2263340237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c032440 con 0x7f889c15e360 2024-08-19T00:44:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.398+0000 7f8899600640 1 -- 172.21.15.7:0/2263340237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c032810 con 0x7f889c15e360 2024-08-19T00:44:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 -- 172.21.15.7:0/2263340237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e360 msgr2=0x7f889c15fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 --2- 172.21.15.7:0/2263340237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e360 0x7f889c15fab0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f889c08d500 tx=0x7f888c02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 -- 172.21.15.7:0/2263340237 shutdown_connections 2024-08-19T00:44:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 --2- 172.21.15.7:0/2263340237 >> v2:172.21.15.162:3300/0 conn(0x7f889c15e740 0x7f889c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 --2- 172.21.15.7:0/2263340237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c0d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 --2- 172.21.15.7:0/2263340237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e360 0x7f889c15fab0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 -- 172.21.15.7:0/2263340237 >> 172.21.15.7:0/2263340237 conn(0x7f889c08dbf0 msgr2=0x7f889c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 -- 172.21.15.7:0/2263340237 shutdown_connections 2024-08-19T00:44:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.399+0000 7f889be00640 1 -- 172.21.15.7:0/2263340237 wait complete. 2024-08-19T00:44:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.400+0000 7f889be00640 1 Processor -- start 2024-08-19T00:44:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.401+0000 7f889be00640 1 -- start start 2024-08-19T00:44:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.401+0000 7f889be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c1f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.401+0000 7f889be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c15e360 0x7f889c15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.401+0000 7f889be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e740 0x7f889c0b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.401+0000 7f889be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f889c15f110 con 0x7f889c15e740 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.401+0000 7f889be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f889c0b4040 con 0x7f889c15e360 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.401+0000 7f889be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f889c0d2300 con 0x7f889c0d2af0 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e740 0x7f889c0b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e740 0x7f889c0b8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37784/0 (socket says 172.21.15.7:37784) 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 -- 172.21.15.7:0/986370693 learned_addr learned my addr 172.21.15.7:0/986370693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889aa00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c1f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889a000640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c15e360 0x7f889c15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 -- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 msgr2=0x7f889c1f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c1f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 -- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c15e360 msgr2=0x7f889c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c15e360 0x7f889c15cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 -- 172.21.15.7:0/986370693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c0b9560 con 0x7f889c15e740 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889a000640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c15e360 0x7f889c15cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.402+0000 7f889b400640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e740 0x7f889c0b8d10 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f8894007df0 tx=0x7f889400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.403+0000 7f8892a00640 1 -- 172.21.15.7:0/986370693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889401a070 con 0x7f889c15e740 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.403+0000 7f8892a00640 1 -- 172.21.15.7:0/986370693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894003990 con 0x7f889c15e740 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.403+0000 7f8892a00640 1 -- 172.21.15.7:0/986370693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894003d80 con 0x7f889c15e740 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.403+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c0b9840 con 0x7f889c15e740 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.403+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c0c7eb0 con 0x7f889c15e740 2024-08-19T00:44:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.404+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c0c80b0 con 0x7f889c15e740 2024-08-19T00:44:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.405+0000 7f8892a00640 1 -- 172.21.15.7:0/986370693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f889401d070 con 0x7f889c15e740 2024-08-19T00:44:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.406+0000 7f8892a00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f887c06be30 0x7f887c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.406+0000 7f8892a00640 1 -- 172.21.15.7:0/986370693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7f889408b4c0 con 0x7f889c15e740 2024-08-19T00:44:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.406+0000 7f889aa00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f887c06be30 0x7f887c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.407+0000 7f889aa00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f887c06be30 0x7f887c06e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f888c034000 tx=0x7f888c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.410+0000 7f8892a00640 1 -- 172.21.15.7:0/986370693 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f889c0c80b0 con 0x7f889c15e740 2024-08-19T00:44:46.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.630+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f889c0d2f50 con 0x7f889c15e740 2024-08-19T00:44:46.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.630+0000 7f8892a00640 1 -- 172.21.15.7:0/986370693 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+3569 (secure 0 0 0) 0x7f8894010070 con 0x7f889c15e740 2024-08-19T00:44:46.633 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:46.634 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":141,"btime":"2024-08-19T00:44:46:225048+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:46.224990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:46.634 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 141 2024-08-19T00:44:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.632+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f887c06be30 msgr2=0x7f887c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.632+0000 7f889be00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f887c06be30 0x7f887c06e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f888c034000 tx=0x7f888c02e000 comp rx=0 tx=0).stop 2024-08-19T00:44:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.632+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e740 msgr2=0x7f889c0b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.632+0000 7f889be00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e740 0x7f889c0b8d10 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f8894007df0 tx=0x7f889400d4a0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 shutdown_connections 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f887c06be30 0x7f887c06e2f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f889c15e740 0x7f889c0b8d10 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c15e360 0x7f889c15cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 --2- 172.21.15.7:0/986370693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c0d2af0 0x7f889c1f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 >> 172.21.15.7:0/986370693 conn(0x7f889c08dbf0 msgr2=0x7f889c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 shutdown_connections 2024-08-19T00:44:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.633+0000 7f889be00640 1 -- 172.21.15.7:0/986370693 wait complete. 2024-08-19T00:44:46.655 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:46.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.809+0000 7f56ee600640 1 Processor -- start 2024-08-19T00:44:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.809+0000 7f56ee600640 1 -- start start 2024-08-19T00:44:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.810+0000 7f56ee600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.810+0000 7f56ee600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56e80cec10 0x7f56e80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.810+0000 7f56ee600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e806f7f0 con 0x7f56e80739a0 2024-08-19T00:44:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.810+0000 7f56ee600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f56e806f510 con 0x7f56e80cec10 2024-08-19T00:44:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.810+0000 7f56ee600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56e8072980 con 0x7f56e8159bf0 2024-08-19T00:44:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56dfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f56e80739a0 0x7f56e80ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50770/0 (socket says 172.21.15.7:50770) 2024-08-19T00:44:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56dfe00640 1 -- 172.21.15.7:0/1744261514 learned_addr learned my addr 172.21.15.7:0/1744261514 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e7e00640 1 --2- 172.21.15.7:0/1744261514 >> v2:172.21.15.162:3300/0 conn(0x7f56e80cec10 0x7f56e80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e7400640 1 --2- 172.21.15.7:0/1744261514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e6a00640 1 -- 172.21.15.7:0/1744261514 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328243045 0 0) 0x7f56e806f7f0 con 0x7f56e80739a0 2024-08-19T00:44:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e6a00640 1 -- 172.21.15.7:0/1744261514 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56cc003520 con 0x7f56e80739a0 2024-08-19T00:44:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e7400640 1 -- 172.21.15.7:0/1744261514 >> v2:172.21.15.162:3300/0 conn(0x7f56e80cec10 msgr2=0x7f56e80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e7400640 1 --2- 172.21.15.7:0/1744261514 >> v2:172.21.15.162:3300/0 conn(0x7f56e80cec10 0x7f56e80d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e7400640 1 -- 172.21.15.7:0/1744261514 >> v1:172.21.15.7:6789/0 conn(0x7f56e80739a0 legacy=0x7f56e80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.811+0000 7f56e7400640 1 -- 172.21.15.7:0/1744261514 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e8072c60 con 0x7f56e8159bf0 2024-08-19T00:44:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.812+0000 7f56e7400640 1 --2- 172.21.15.7:0/1744261514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e8073460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097a0 tx=0x7f56d802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6b375afe5349c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:46.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56e6a00640 1 -- 172.21.15.7:0/1744261514 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8037070 con 0x7f56e8159bf0 2024-08-19T00:44:46.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56e6a00640 1 -- 172.21.15.7:0/1744261514 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d802ae50 con 0x7f56e8159bf0 2024-08-19T00:44:46.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56e6a00640 1 -- 172.21.15.7:0/1744261514 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8032660 con 0x7f56e8159bf0 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56ee600640 1 -- 172.21.15.7:0/1744261514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 msgr2=0x7f56e8073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56ee600640 1 --2- 172.21.15.7:0/1744261514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e8073460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097a0 tx=0x7f56d802a100 comp rx=0 tx=0).stop 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56ee600640 1 -- 172.21.15.7:0/1744261514 shutdown_connections 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56ee600640 1 --2- 172.21.15.7:0/1744261514 >> v2:172.21.15.162:3300/0 conn(0x7f56e80cec10 0x7f56e80d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56ee600640 1 --2- 172.21.15.7:0/1744261514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e8073460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.813+0000 7f56ee600640 1 -- 172.21.15.7:0/1744261514 >> 172.21.15.7:0/1744261514 conn(0x7f56e806bc70 msgr2=0x7f56e806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.814+0000 7f56ee600640 1 -- 172.21.15.7:0/1744261514 shutdown_connections 2024-08-19T00:44:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.814+0000 7f56ee600640 1 -- 172.21.15.7:0/1744261514 wait complete. 2024-08-19T00:44:46.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.815+0000 7f56ee600640 1 Processor -- start 2024-08-19T00:44:46.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.815+0000 7f56ee600640 1 -- start start 2024-08-19T00:44:46.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56ee600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e80739a0 0x7f56e8158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56ee600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e814c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56ee600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e814fc70 0x7f56e80b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56ee600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56e815a150 con 0x7f56e80739a0 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56ee600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8159fd0 con 0x7f56e814fc70 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56ee600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56e80d0900 con 0x7f56e8159bf0 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e80739a0 0x7f56e8158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e80739a0 0x7f56e8158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37788/0 (socket says 172.21.15.7:37788) 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.816+0000 7f56e7400640 1 -- 172.21.15.7:0/3221955293 learned_addr learned my addr 172.21.15.7:0/3221955293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56dfe00640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e814c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56e7e00640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e814fc70 0x7f56e80b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56e7400640 1 -- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 msgr2=0x7f56e814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56e7400640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e814c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56e7400640 1 -- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e814fc70 msgr2=0x7f56e80b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56e7400640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e814fc70 0x7f56e80b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56e7400640 1 -- 172.21.15.7:0/3221955293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e81560f0 con 0x7f56e80739a0 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56dfe00640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e814c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56e7400640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e80739a0 0x7f56e8158070 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f56d8000c00 tx=0x7f56d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56df400640 1 -- 172.21.15.7:0/3221955293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8041070 con 0x7f56e80739a0 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56df400640 1 -- 172.21.15.7:0/3221955293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d803c460 con 0x7f56e80739a0 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56df400640 1 -- 172.21.15.7:0/3221955293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8037040 con 0x7f56e80739a0 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.817+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e81501e0 con 0x7f56e80739a0 2024-08-19T00:44:46.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.818+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e8155e10 con 0x7f56e80739a0 2024-08-19T00:44:46.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.819+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e8155940 con 0x7f56e80739a0 2024-08-19T00:44:46.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.820+0000 7f56df400640 1 -- 172.21.15.7:0/3221955293 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56d8044070 con 0x7f56e80739a0 2024-08-19T00:44:46.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.820+0000 7f56df400640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56c406be30 0x7f56c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:46.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.821+0000 7f56df400640 1 -- 172.21.15.7:0/3221955293 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7f56d80ab5f0 con 0x7f56e80739a0 2024-08-19T00:44:46.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.821+0000 7f56dfe00640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56c406be30 0x7f56c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:46.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.821+0000 7f56dfe00640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56c406be30 0x7f56c406e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f56d0007fd0 tx=0x7f56d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:46.825+0000 7f56df400640 1 -- 172.21.15.7:0/3221955293 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f56d8079ba0 con 0x7f56e80739a0 2024-08-19T00:44:46.955 INFO:tasks.ceph.mds.c.smithi007.stderr: -43> 2024-08-19T00:44:42.200+0000 7fccb4400640 -1 mds.0.snaptable: load_2 could not read table: -2 2024-08-19T00:44:46.955 INFO:tasks.ceph.mds.c.smithi007.stderr: -42> 2024-08-19T00:44:42.200+0000 7fccb4400640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2024-08-19T00:44:46.995 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:44:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.046+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56e8068c00 con 0x7f56e80739a0 2024-08-19T00:44:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.047+0000 7f56df400640 1 -- 172.21.15.7:0/3221955293 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+3569 (secure 0 0 0) 0x7f56d80794a0 con 0x7f56e80739a0 2024-08-19T00:44:47.050 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:47.050 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":141,"btime":"2024-08-19T00:44:46:225048+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:46.224990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 141 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56c406be30 msgr2=0x7f56c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56c406be30 0x7f56c406e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f56d0007fd0 tx=0x7f56d0009040 comp rx=0 tx=0).stop 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e80739a0 msgr2=0x7f56e8158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e80739a0 0x7f56e8158070 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f56d8000c00 tx=0x7f56d80046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 shutdown_connections 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56c406be30 0x7f56c406e2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e814fc70 0x7f56e80b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e8159bf0 0x7f56e814c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 --2- 172.21.15.7:0/3221955293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e80739a0 0x7f56e8158070 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 >> 172.21.15.7:0/3221955293 conn(0x7f56e806bc70 msgr2=0x7f56e815b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 shutdown_connections 2024-08-19T00:44:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.049+0000 7f56ee600640 1 -- 172.21.15.7:0/3221955293 wait complete. 2024-08-19T00:44:47.067 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:47.068 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:47.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.222+0000 7f7b03200640 1 Processor -- start 2024-08-19T00:44:47.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.222+0000 7f7b03200640 1 -- start start 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.223+0000 7f7b03200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7afc0ce500 0x7f7afc0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.223+0000 7f7b03200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7afc0d03c0 0x7f7afc0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.223+0000 7f7b03200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7afc06f7f0 con 0x7f7afc159bf0 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.223+0000 7f7b03200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7afc0d0d50 con 0x7f7afc0d03c0 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.223+0000 7f7b03200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7afc06f510 con 0x7f7afc0ce500 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7afbe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7afc159bf0 0x7f7afc073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50788/0 (socket says 172.21.15.7:50788) 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7afbe00640 1 -- 172.21.15.7:0/2155756752 learned_addr learned my addr 172.21.15.7:0/2155756752 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7b01200640 1 --2- 172.21.15.7:0/2155756752 >> v2:172.21.15.7:3300/0 conn(0x7f7afc0d03c0 0x7f7afc0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7af3e00640 1 --2- 172.21.15.7:0/2155756752 >> v2:172.21.15.162:3300/0 conn(0x7f7afc0ce500 0x7f7afc0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7b01200640 1 -- 172.21.15.7:0/2155756752 >> v2:172.21.15.162:3300/0 conn(0x7f7afc0ce500 msgr2=0x7f7afc0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7b01200640 1 --2- 172.21.15.7:0/2155756752 >> v2:172.21.15.162:3300/0 conn(0x7f7afc0ce500 0x7f7afc0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7b01200640 1 -- 172.21.15.7:0/2155756752 >> v1:172.21.15.7:6789/0 conn(0x7f7afc159bf0 legacy=0x7f7afc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.224+0000 7f7b01200640 1 -- 172.21.15.7:0/2155756752 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc072980 con 0x7f7afc0d03c0 2024-08-19T00:44:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.225+0000 7f7b01200640 1 --2- 172.21.15.7:0/2155756752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0d03c0 0x7f7afc0d0810 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0b1cc0 tx=0x7f7af402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f154b23719b17294 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.225+0000 7f7afb400640 1 -- 172.21.15.7:0/2155756752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4007740 con 0x7f7afc0d03c0 2024-08-19T00:44:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7afb400640 1 -- 172.21.15.7:0/2155756752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af40078e0 con 0x7f7afc0d03c0 2024-08-19T00:44:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7afb400640 1 -- 172.21.15.7:0/2155756752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4007cb0 con 0x7f7afc0d03c0 2024-08-19T00:44:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7b03200640 1 -- 172.21.15.7:0/2155756752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0d03c0 msgr2=0x7f7afc0d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7b03200640 1 --2- 172.21.15.7:0/2155756752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0d03c0 0x7f7afc0d0810 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0b1cc0 tx=0x7f7af402a5f0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7b03200640 1 -- 172.21.15.7:0/2155756752 shutdown_connections 2024-08-19T00:44:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7b03200640 1 --2- 172.21.15.7:0/2155756752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc0d03c0 0x7f7afc0d0810 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7b03200640 1 --2- 172.21.15.7:0/2155756752 >> v2:172.21.15.162:3300/0 conn(0x7f7afc0ce500 0x7f7afc0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7b03200640 1 -- 172.21.15.7:0/2155756752 >> 172.21.15.7:0/2155756752 conn(0x7f7afc06bc70 msgr2=0x7f7afc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.226+0000 7f7b03200640 1 -- 172.21.15.7:0/2155756752 shutdown_connections 2024-08-19T00:44:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.227+0000 7f7b03200640 1 -- 172.21.15.7:0/2155756752 wait complete. 2024-08-19T00:44:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.228+0000 7f7b03200640 1 Processor -- start 2024-08-19T00:44:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.228+0000 7f7b03200640 1 -- start start 2024-08-19T00:44:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.229+0000 7f7b03200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc0ce500 0x7f7afc143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.229+0000 7f7b03200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0d03c0 0x7f7afc09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.229+0000 7f7b03200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc159bf0 0x7f7afc0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.229+0000 7f7b03200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc073b70 con 0x7f7afc159bf0 2024-08-19T00:44:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.229+0000 7f7b03200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc072f40 con 0x7f7afc0d03c0 2024-08-19T00:44:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.229+0000 7f7b03200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc159fd0 con 0x7f7afc0ce500 2024-08-19T00:44:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc159bf0 0x7f7afc0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc159bf0 0x7f7afc0b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37814/0 (socket says 172.21.15.7:37814) 2024-08-19T00:44:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 -- 172.21.15.7:0/1268312076 learned_addr learned my addr 172.21.15.7:0/1268312076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7afbe00640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc0ce500 0x7f7afc143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7af3e00640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0d03c0 0x7f7afc09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 -- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc0ce500 msgr2=0x7f7afc143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc0ce500 0x7f7afc143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 -- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0d03c0 msgr2=0x7f7afc09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0d03c0 0x7f7afc09daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 -- 172.21.15.7:0/1268312076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc1463e0 con 0x7f7afc159bf0 2024-08-19T00:44:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.230+0000 7f7b01200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc159bf0 0x7f7afc0b1400 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f7af402abe0 tx=0x7f7af4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.231+0000 7f7af8c00640 1 -- 172.21.15.7:0/1268312076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4040070 con 0x7f7afc159bf0 2024-08-19T00:44:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.231+0000 7f7af8c00640 1 -- 172.21.15.7:0/1268312076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af4031bc0 con 0x7f7afc159bf0 2024-08-19T00:44:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.231+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc1466c0 con 0x7f7afc159bf0 2024-08-19T00:44:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.231+0000 7f7af8c00640 1 -- 172.21.15.7:0/1268312076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4045460 con 0x7f7afc159bf0 2024-08-19T00:44:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.231+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc146c80 con 0x7f7afc159bf0 2024-08-19T00:44:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.232+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc0d0810 con 0x7f7afc159bf0 2024-08-19T00:44:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.233+0000 7f7af8c00640 1 -- 172.21.15.7:0/1268312076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7af4039040 con 0x7f7afc159bf0 2024-08-19T00:44:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.234+0000 7f7af8c00640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ad806be60 0x7f7ad806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.234+0000 7f7af8c00640 1 -- 172.21.15.7:0/1268312076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7f7af40aca30 con 0x7f7afc159bf0 2024-08-19T00:44:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.234+0000 7f7afbe00640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ad806be60 0x7f7ad806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.235+0000 7f7afbe00640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ad806be60 0x7f7ad806e320 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:47.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.239+0000 7f7af8c00640 1 -- 172.21.15.7:0/1268312076 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7af407aab0 con 0x7f7afc159bf0 2024-08-19T00:44:47.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.462+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7afc144390 con 0x7f7afc159bf0 2024-08-19T00:44:47.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.463+0000 7f7af8c00640 1 -- 172.21.15.7:0/1268312076 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) ==== 95+0+4392 (secure 0 0 0) 0x7f7af407edb0 con 0x7f7afc159bf0 2024-08-19T00:44:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:47.466 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":142,"btime":"2024-08-19T00:44:47:226535+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3482025847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3482025847},{"type":"v1","addr":"172.21.15.7:6836","nonce":3482025847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:46.224990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 142 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ad806be60 msgr2=0x7f7ad806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ad806be60 0x7f7ad806e320 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec007e80 comp rx=0 tx=0).stop 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc159bf0 msgr2=0x7f7afc0b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc159bf0 0x7f7afc0b1400 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f7af402abe0 tx=0x7f7af4004a40 comp rx=0 tx=0).stop 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 shutdown_connections 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ad806be60 0x7f7ad806e320 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7afc159bf0 0x7f7afc0b1400 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7afc0d03c0 0x7f7afc09daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 --2- 172.21.15.7:0/1268312076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7afc0ce500 0x7f7afc143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 >> 172.21.15.7:0/1268312076 conn(0x7f7afc06bc70 msgr2=0x7f7afc06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 shutdown_connections 2024-08-19T00:44:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.465+0000 7f7b03200640 1 -- 172.21.15.7:0/1268312076 wait complete. 2024-08-19T00:44:47.484 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_inotable' led to DAMAGED state 2024-08-19T00:44:47.484 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 100.00000000' 2024-08-19T00:44:47.484 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:47.484 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:47.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:44:47.519 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:47.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:47.520 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:44:47.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:44:47.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:47.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.791+0000 7f646b400640 1 Processor -- start 2024-08-19T00:44:47.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.791+0000 7f646b400640 1 -- start start 2024-08-19T00:44:47.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.792+0000 7f646b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f646406e710 0x7f6464071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.792+0000 7f646b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64640b3750 0x7f64640cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.792+0000 7f646b400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64640cdfb0 con 0x7f64640d03c0 2024-08-19T00:44:47.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.792+0000 7f646b400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f64640cebc0 con 0x7f64640b3750 2024-08-19T00:44:47.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.792+0000 7f646b400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f64640ce290 con 0x7f646406e710 2024-08-19T00:44:47.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f6469400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64640b3750 0x7f64640cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f6469400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64640b3750 0x7f64640cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37822/0 (socket says 172.21.15.7:37822) 2024-08-19T00:44:47.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f6469400640 1 -- 172.21.15.7:0/842304610 learned_addr learned my addr 172.21.15.7:0/842304610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:47.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f645be00640 1 --2- 172.21.15.7:0/842304610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f646406e710 0x7f6464071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f6469400640 1 -- 172.21.15.7:0/842304610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f646406e710 msgr2=0x7f6464071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:47.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f6469400640 1 --2- 172.21.15.7:0/842304610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f646406e710 0x7f6464071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f6469400640 1 -- 172.21.15.7:0/842304610 >> v1:172.21.15.162:6789/0 conn(0x7f64640d03c0 legacy=0x7f64640d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:47.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.793+0000 7f6469400640 1 -- 172.21.15.7:0/842304610 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64640ce570 con 0x7f64640b3750 2024-08-19T00:44:47.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.794+0000 7f6469400640 1 --2- 172.21.15.7:0/842304610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64640b3750 0x7f64640cf050 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f645c009e50 tx=0x7f645c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5530607263b9e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:47.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f6463e00640 1 -- 172.21.15.7:0/842304610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c036070 con 0x7f64640b3750 2024-08-19T00:44:47.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f6463e00640 1 -- 172.21.15.7:0/842304610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c031600 con 0x7f64640b3750 2024-08-19T00:44:47.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f6463e00640 1 -- 172.21.15.7:0/842304610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c0319d0 con 0x7f64640b3750 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 -- 172.21.15.7:0/842304610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64640b3750 msgr2=0x7f64640cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 --2- 172.21.15.7:0/842304610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64640b3750 0x7f64640cf050 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f645c009e50 tx=0x7f645c02a6c0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 -- 172.21.15.7:0/842304610 shutdown_connections 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 --2- 172.21.15.7:0/842304610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64640b3750 0x7f64640cf050 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 --2- 172.21.15.7:0/842304610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f646406e710 0x7f6464071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 -- 172.21.15.7:0/842304610 >> 172.21.15.7:0/842304610 conn(0x7f646406bc70 msgr2=0x7f646406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 -- 172.21.15.7:0/842304610 shutdown_connections 2024-08-19T00:44:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.795+0000 7f646b400640 1 -- 172.21.15.7:0/842304610 wait complete. 2024-08-19T00:44:47.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.797+0000 7f646b400640 1 Processor -- start 2024-08-19T00:44:47.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.797+0000 7f646b400640 1 -- start start 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f646b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646406e710 0x7f6464147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f646b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64640b3750 0x7f64640cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f646b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64640d03c0 0x7f64640b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f646b400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6464073c60 con 0x7f646406e710 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f646b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6464073ae0 con 0x7f64640d03c0 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f646b400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f64640b3be0 con 0x7f64640b3750 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f6468a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646406e710 0x7f6464147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f6468a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646406e710 0x7f6464147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37834/0 (socket says 172.21.15.7:37834) 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f6468a00640 1 -- 172.21.15.7:0/912603054 learned_addr learned my addr 172.21.15.7:0/912603054 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f645be00640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64640b3750 0x7f64640cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.798+0000 7f6469400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64640d03c0 0x7f64640b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6468a00640 1 -- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64640b3750 msgr2=0x7f64640cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6468a00640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64640b3750 0x7f64640cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6468a00640 1 -- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64640d03c0 msgr2=0x7f64640b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6468a00640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64640d03c0 0x7f64640b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6468a00640 1 -- 172.21.15.7:0/912603054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64640ca0c0 con 0x7f646406e710 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f645be00640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64640b3750 0x7f64640cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6469400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64640d03c0 0x7f64640b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6468a00640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646406e710 0x7f6464147680 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f645400c430 tx=0x7f645400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6461600640 1 -- 172.21.15.7:0/912603054 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454011790 con 0x7f646406e710 2024-08-19T00:44:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6461600640 1 -- 172.21.15.7:0/912603054 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454017070 con 0x7f646406e710 2024-08-19T00:44:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f6461600640 1 -- 172.21.15.7:0/912603054 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454011bb0 con 0x7f646406e710 2024-08-19T00:44:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64640cac50 con 0x7f646406e710 2024-08-19T00:44:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.799+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64640cb210 con 0x7f646406e710 2024-08-19T00:44:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.800+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64640cb410 con 0x7f646406e710 2024-08-19T00:44:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.801+0000 7f6461600640 1 -- 172.21.15.7:0/912603054 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f645401c460 con 0x7f646406e710 2024-08-19T00:44:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.802+0000 7f6461600640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f644006be30 0x7f644006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.802+0000 7f6461600640 1 -- 172.21.15.7:0/912603054 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7f645408b130 con 0x7f646406e710 2024-08-19T00:44:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.802+0000 7f645be00640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f644006be30 0x7f644006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.803+0000 7f645be00640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f644006be30 0x7f644006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f644c006fd0 tx=0x7f644c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:47.806+0000 7f6461600640 1 -- 172.21.15.7:0/912603054 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f64640cb410 con 0x7f646406e710 2024-08-19T00:44:48.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.027+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6464071980 con 0x7f646406e710 2024-08-19T00:44:48.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.231+0000 7f6461600640 1 -- 172.21.15.7:0/912603054 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v143) ==== 161+0+0 (secure 0 0 0) 0x7f64540596e0 con 0x7f646406e710 2024-08-19T00:44:48.234 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f644006be30 msgr2=0x7f644006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f644006be30 0x7f644006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f644c006fd0 tx=0x7f644c008040 comp rx=0 tx=0).stop 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646406e710 msgr2=0x7f6464147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646406e710 0x7f6464147680 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f645400c430 tx=0x7f645400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 shutdown_connections 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f644006be30 0x7f644006e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64640d03c0 0x7f64640b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64640b3750 0x7f64640cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 --2- 172.21.15.7:0/912603054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f646406e710 0x7f6464147680 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 >> 172.21.15.7:0/912603054 conn(0x7f646406bc70 msgr2=0x7f64641e9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 shutdown_connections 2024-08-19T00:44:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.234+0000 7f646b400640 1 -- 172.21.15.7:0/912603054 wait complete. 2024-08-19T00:44:48.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:48.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.409+0000 7f05bce00640 1 Processor -- start 2024-08-19T00:44:48.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.409+0000 7f05bce00640 1 -- start start 2024-08-19T00:44:48.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.410+0000 7f05bce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f05b8071980 0x7f05b80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.410+0000 7f05bce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b80cdfb0 con 0x7f05b80d03c0 2024-08-19T00:44:48.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.410+0000 7f05bce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b80ce290 con 0x7f05b806e710 2024-08-19T00:44:48.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.410+0000 7f05bce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f05b80cebc0 con 0x7f05b8071980 2024-08-19T00:44:48.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f05b80d03c0 0x7f05b80d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50792/0 (socket says 172.21.15.7:50792) 2024-08-19T00:44:48.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5e00640 1 -- 172.21.15.7:0/3093371392 learned_addr learned my addr 172.21.15.7:0/3093371392 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b6800640 1 --2- 172.21.15.7:0/3093371392 >> v2:172.21.15.162:3300/0 conn(0x7f05b8071980 0x7f05b80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292744732 0 0) 0x7f05b80cdfb0 con 0x7f05b80d03c0 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f059c003520 con 0x7f05b80d03c0 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4047191188 0 0) 0x7f059c003520 con 0x7f05b80d03c0 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 >> v2:172.21.15.162:3300/0 conn(0x7f05b8071980 msgr2=0x7f05b80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5400640 1 --2- 172.21.15.7:0/3093371392 >> v2:172.21.15.162:3300/0 conn(0x7f05b8071980 0x7f05b80cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 >> v1:172.21.15.162:6789/0 conn(0x7f05b806e710 legacy=0x7f05b80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.411+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b80ce570 con 0x7f05b80d03c0 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f05a8001670 con 0x7f05b80d03c0 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 >> v1:172.21.15.7:6789/0 conn(0x7f05b80d03c0 legacy=0x7f05b80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f059c003a00 0x7f059c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059c004800 0x7f059c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c0051c0 0x7f059c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05b80cebc0 con 0x7f059c003a00 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f059c00c0c0 con 0x7f059c004800 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f059c00c2c0 con 0x7f059c0051c0 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5e00640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f059c003a00 0x7f059c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b6800640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c0051c0 0x7f059c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05afe00640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059c004800 0x7f059c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5e00640 1 -- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c0051c0 msgr2=0x7f059c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5e00640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c0051c0 0x7f059c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5e00640 1 -- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059c004800 msgr2=0x7f059c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5e00640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059c004800 0x7f059c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b5e00640 1 -- 172.21.15.7:0/3093371392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059c003520 con 0x7f059c003a00 2024-08-19T00:44:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b6800640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c0051c0 0x7f059c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.412+0000 7f05b6800640 1 -- 172.21.15.7:0/3093371392 reap_dead start 2024-08-19T00:44:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.413+0000 7f05b5e00640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f059c003a00 0x7f059c003e20 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c190 tx=0x7f059c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa00bbe8a478ae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8007c60 con 0x7f059c003a00 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8005af0 con 0x7f059c003a00 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05b5400640 1 -- 172.21.15.7:0/3093371392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8007070 con 0x7f059c003a00 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05bce00640 1 -- 172.21.15.7:0/3093371392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f059c003a00 msgr2=0x7f059c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05bce00640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f059c003a00 0x7f059c003e20 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c190 tx=0x7f059c005830 comp rx=0 tx=0).stop 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05bce00640 1 -- 172.21.15.7:0/3093371392 shutdown_connections 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05bce00640 1 --2- 172.21.15.7:0/3093371392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f059c003a00 0x7f059c003e20 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05bce00640 1 -- 172.21.15.7:0/3093371392 >> 172.21.15.7:0/3093371392 conn(0x7f05b806bc70 msgr2=0x7f05b806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05bce00640 1 -- 172.21.15.7:0/3093371392 shutdown_connections 2024-08-19T00:44:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.414+0000 7f05bce00640 1 -- 172.21.15.7:0/3093371392 wait complete. 2024-08-19T00:44:48.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.416+0000 7f05bce00640 1 Processor -- start 2024-08-19T00:44:48.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.416+0000 7f05bce00640 1 -- start start 2024-08-19T00:44:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05bce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c003a00 0x7f05b8153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05bce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b8099bf0 0x7f05b8154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05bce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05b8098f70 0x7f05b80acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05bce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8073c60 con 0x7f05b8099bf0 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05bce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8073ae0 con 0x7f05b8098f70 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05bce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05b80d07a0 con 0x7f059c003a00 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b8099bf0 0x7f05b8154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b8099bf0 0x7f05b8154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37854/0 (socket says 172.21.15.7:37854) 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05afe00640 1 -- 172.21.15.7:0/496870328 learned_addr learned my addr 172.21.15.7:0/496870328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05b5e00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c003a00 0x7f05b8153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.417+0000 7f05b6800640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05b8098f70 0x7f05b80acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05afe00640 1 -- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c003a00 msgr2=0x7f05b8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05afe00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c003a00 0x7f05b8153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05afe00640 1 -- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05b8098f70 msgr2=0x7f05b80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05afe00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05b8098f70 0x7f05b80acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05afe00640 1 -- 172.21.15.7:0/496870328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b8154370 con 0x7f05b8099bf0 2024-08-19T00:44:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05afe00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b8099bf0 0x7f05b8154650 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f05a000e4e0 tx=0x7f05a000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05ae000640 1 -- 172.21.15.7:0/496870328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a00052e0 con 0x7f05b8099bf0 2024-08-19T00:44:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05ae000640 1 -- 172.21.15.7:0/496870328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a0018070 con 0x7f05b8099bf0 2024-08-19T00:44:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05ae000640 1 -- 172.21.15.7:0/496870328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0003830 con 0x7f05b8099bf0 2024-08-19T00:44:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b8098490 con 0x7f05b8099bf0 2024-08-19T00:44:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.418+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b8154ec0 con 0x7f05b8099bf0 2024-08-19T00:44:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.420+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b80cdfb0 con 0x7f05b8099bf0 2024-08-19T00:44:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.420+0000 7f05ae000640 1 -- 172.21.15.7:0/496870328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05a00039d0 con 0x7f05b8099bf0 2024-08-19T00:44:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.421+0000 7f05ae000640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.421+0000 7f05ae000640 1 -- 172.21.15.7:0/496870328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7f05a008ac90 con 0x7f05b8099bf0 2024-08-19T00:44:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.422+0000 7f05b5e00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.422+0000 7f05b5e00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f059406be30 0x7f059406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c160 tx=0x7f05a802d000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:48.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.426+0000 7f05ae000640 1 -- 172.21.15.7:0/496870328 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f05a0058c80 con 0x7f05b8099bf0 2024-08-19T00:44:48.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:48.679+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f05b806c570 con 0x7f05b8099bf0 2024-08-19T00:44:49.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.238+0000 7f05ae000640 1 -- 172.21.15.7:0/496870328 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v144) ==== 101+0+0 (secure 0 0 0) 0x7f05a005cf80 con 0x7f05b8099bf0 2024-08-19T00:44:49.241 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:44:49.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f059406be30 msgr2=0x7f059406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f059406be30 0x7f059406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c160 tx=0x7f05a802d000 comp rx=0 tx=0).stop 2024-08-19T00:44:49.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b8099bf0 msgr2=0x7f05b8154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b8099bf0 0x7f05b8154650 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f05a000e4e0 tx=0x7f05a000e9a0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 shutdown_connections 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05b8098f70 0x7f05b80acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b8099bf0 0x7f05b8154650 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 --2- 172.21.15.7:0/496870328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f059c003a00 0x7f05b8153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.241+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 >> 172.21.15.7:0/496870328 conn(0x7f05b806bc70 msgr2=0x7f05b80cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.242+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 shutdown_connections 2024-08-19T00:44:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.242+0000 7f05bce00640 1 -- 172.21.15.7:0/496870328 wait complete. 2024-08-19T00:44:49.261 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.335+0000 7f592e87af40 1 Processor -- start 2024-08-19T00:44:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.335+0000 7f592e87af40 1 -- start start 2024-08-19T00:44:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.336+0000 7f592e87af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb25b0 0x563a07d3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.336+0000 7f592e87af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb2990 0x563a07d39080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.336+0000 7f592e87af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.336+0000 7f592e87af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563a07d57dc0 con 0x563a07cca8d0 2024-08-19T00:44:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.336+0000 7f592e87af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563a07c26d00 con 0x563a07cb25b0 2024-08-19T00:44:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.336+0000 7f592e87af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563a07d580a0 con 0x563a07cb2990 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d59080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37864/0 (socket says 172.21.15.7:37864) 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 -- 172.21.15.7:0/4268160264 learned_addr learned my addr 172.21.15.7:0/4268160264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592ba00640 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb25b0 0x563a07d3c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592b000640 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb2990 0x563a07d39080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 -- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb2990 msgr2=0x563a07d39080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb2990 0x563a07d39080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 -- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb25b0 msgr2=0x563a07d3c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb25b0 0x563a07d3c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 -- 172.21.15.7:0/4268160264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a07babb30 con 0x563a07cca8d0 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.337+0000 7f592c400640 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d59080 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f592400a4b0 tx=0x7f592400a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eff87cf385edf1e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f5929c00640 1 -- 172.21.15.7:0/4268160264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924015070 con 0x563a07cca8d0 2024-08-19T00:44:49.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f5929c00640 1 -- 172.21.15.7:0/4268160264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592400e710 con 0x563a07cca8d0 2024-08-19T00:44:49.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f5929c00640 1 -- 172.21.15.7:0/4268160264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592400eb00 con 0x563a07cca8d0 2024-08-19T00:44:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 -- 172.21.15.7:0/4268160264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 msgr2=0x563a07d59080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d59080 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f592400a4b0 tx=0x7f592400a970 comp rx=0 tx=0).stop 2024-08-19T00:44:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 -- 172.21.15.7:0/4268160264 shutdown_connections 2024-08-19T00:44:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d59080 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb2990 0x563a07d39080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 --2- 172.21.15.7:0/4268160264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb25b0 0x563a07d3c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 -- 172.21.15.7:0/4268160264 >> 172.21.15.7:0/4268160264 conn(0x563a07caf4e0 msgr2=0x563a07cb1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 -- 172.21.15.7:0/4268160264 shutdown_connections 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.338+0000 7f592e87af40 1 -- 172.21.15.7:0/4268160264 wait complete. 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.339+0000 7f592e87af40 1 Processor -- start 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.339+0000 7f592e87af40 1 -- start start 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.340+0000 7f592e87af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb25b0 0x563a07d39040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.340+0000 7f592e87af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb2990 0x563a07c7f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.340+0000 7f592e87af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d52ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.340+0000 7f592e87af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563a07d5a200 con 0x563a07cca8d0 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.340+0000 7f592e87af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563a07d59d60 con 0x563a07cb2990 2024-08-19T00:44:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.340+0000 7f592e87af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563a07d58a80 con 0x563a07cb25b0 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.340+0000 7f592c400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d52ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592ba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb25b0 0x563a07d39040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d52ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37878/0 (socket says 172.21.15.7:37878) 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 learned_addr learned my addr 172.21.15.7:0/891024260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592b000640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb2990 0x563a07c7f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb25b0 msgr2=0x563a07d39040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563a07cb25b0 0x563a07d39040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb2990 msgr2=0x563a07c7f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a07cb2990 0x563a07c7f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a07be8080 con 0x563a07cca8d0 2024-08-19T00:44:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f592c400640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d52ea0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f5924010000 tx=0x7f59240032b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.341+0000 7f5923e00640 1 -- 172.21.15.7:0/891024260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924020070 con 0x563a07cca8d0 2024-08-19T00:44:49.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.342+0000 7f5923e00640 1 -- 172.21.15.7:0/891024260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592401c600 con 0x563a07cca8d0 2024-08-19T00:44:49.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.342+0000 7f5923e00640 1 -- 172.21.15.7:0/891024260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924015040 con 0x563a07cca8d0 2024-08-19T00:44:49.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.342+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a07d53f50 con 0x563a07cca8d0 2024-08-19T00:44:49.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.342+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a07d54510 con 0x563a07cca8d0 2024-08-19T00:44:49.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.344+0000 7f5923e00640 1 -- 172.21.15.7:0/891024260 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5924023070 con 0x563a07cca8d0 2024-08-19T00:44:49.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.344+0000 7f5923e00640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590c06a810 0x7f590c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.344+0000 7f5923e00640 1 -- 172.21.15.7:0/891024260 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7f592408ab50 con 0x563a07cca8d0 2024-08-19T00:44:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.345+0000 7f592ba00640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590c06a810 0x7f590c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.350 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.345+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563a07c7fe50 0x563a07d538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.345+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07ddfde0 con 0x563a07c7fe50 2024-08-19T00:44:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.345+0000 7f592ba00640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590c06a810 0x7f590c06ccd0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f591c057000 tx=0x7f591c052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.345+0000 7f592b000640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563a07c7fe50 0x563a07d538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.346+0000 7f592b000640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563a07c7fe50 0x563a07d538f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.348+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v96'288 uv262 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.348+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07de01b0 con 0x563a07c7fe50 2024-08-19T00:44:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.349+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v96'289 uv289 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.349+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07de0580 con 0x563a07c7fe50 2024-08-19T00:44:49.353 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.351+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v96'290 uv290 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.351+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07de0920 con 0x563a07c7fe50 2024-08-19T00:44:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.352+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v96'291 uv291 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.352+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07de0d00 con 0x563a07c7fe50 2024-08-19T00:44:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.354+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v96'292 uv292 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.354+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa3b0 con 0x563a07c7fe50 2024-08-19T00:44:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.356+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v96'293 uv293 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.356+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.357+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v96'294 uv268 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.357+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.358+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v96'295 uv295 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.358+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.362 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:49.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.360+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v96'296 uv296 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.360+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfb760 con 0x563a07c7fe50 2024-08-19T00:44:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.361+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v96'297 uv297 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.361+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfb760 con 0x563a07c7fe50 2024-08-19T00:44:49.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.362+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v96'298 uv298 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.362+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.364+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v96'299 uv299 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.364+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.365+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v96'300 uv275 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.365+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.366+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v96'301 uv301 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.366+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.368+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v96'302 uv302 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.371 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.368+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfb760 con 0x563a07c7fe50 2024-08-19T00:44:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.370+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v96'303 uv303 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.370+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfb760 con 0x563a07c7fe50 2024-08-19T00:44:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.371+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v96'304 uv304 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.371+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa750 con 0x563a07c7fe50 2024-08-19T00:44:49.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.373+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v96'305 uv305 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.373+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.375+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v96'306 uv306 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.375+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.376+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v96'307 uv281 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.376+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.378+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v96'308 uv308 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.378+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.379+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v96'309 uv309 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.382 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:49.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.379+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfbc10 con 0x563a07c7fe50 2024-08-19T00:44:49.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.380+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v96'310 uv310 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.380+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfbc10 con 0x563a07c7fe50 2024-08-19T00:44:49.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.381+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v96'311 uv311 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.381+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.383+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v96'312 uv312 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.383+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.384+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v96'313 uv287 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.384+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.386+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v96'314 uv314 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.386+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.387+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v96'315 uv315 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.390 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:49.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.387+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfbc10 con 0x563a07c7fe50 2024-08-19T00:44:49.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.388+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v96'316 uv316 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.388+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfbc10 con 0x563a07c7fe50 2024-08-19T00:44:49.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.390+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v96'317 uv317 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.390+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfac00 con 0x563a07c7fe50 2024-08-19T00:44:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.391+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v96'318 uv318 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.391+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563a07dfb110 0x563a07dfd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.391+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfda40 con 0x563a07dfb110 2024-08-19T00:44:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.391+0000 7f592ba00640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563a07dfb110 0x563a07dfd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.392+0000 7f592ba00640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563a07dfb110 0x563a07dfd500 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.393+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v96'219 uv202 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.393+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfdde0 con 0x563a07dfb110 2024-08-19T00:44:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.395+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v96'220 uv220 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.395+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfe290 con 0x563a07dfb110 2024-08-19T00:44:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.396+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v96'221 uv221 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.399 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.396+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfa830 con 0x563a07dfb110 2024-08-19T00:44:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.398+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v96'222 uv222 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.398+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfebc0 con 0x563a07dfb110 2024-08-19T00:44:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.400+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v96'223 uv223 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.400+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dfefb0 con 0x563a07dfb110 2024-08-19T00:44:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.401+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v96'224 uv207 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.401+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.402+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v96'225 uv225 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.403+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.404+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v96'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.406 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.404+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.405+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v96'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.405+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.407+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v96'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.407+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.408+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v96'229 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.408+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.409+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v96'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.409+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.411+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v96'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.414 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:49.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.411+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.413+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v96'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.413+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff350 con 0x563a07dfb110 2024-08-19T00:44:49.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.414+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v96'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.414+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff390 con 0x563a07dfb110 2024-08-19T00:44:49.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.415+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v96'234 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.415+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff7e0 con 0x563a07dfb110 2024-08-19T00:44:49.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.417+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v96'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.417+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff7e0 con 0x563a07dfb110 2024-08-19T00:44:49.420 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.418+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v96'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.418+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e007a0 con 0x563a07dfb110 2024-08-19T00:44:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.419+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v96'237 uv237 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.419+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e00750 con 0x563a07dfb110 2024-08-19T00:44:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.421+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v96'238 uv238 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.421+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07dff740 con 0x563a07dfb110 2024-08-19T00:44:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.422+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v96'239 uv239 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07dfb110 2024-08-19T00:44:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.422+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563a07dffe10 0x563a07e001f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.422+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07dffe10 2024-08-19T00:44:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.423+0000 7f592b000640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563a07dffe10 0x563a07e001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.424+0000 7f592b000640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563a07dffe10 0x563a07e001f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.425+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v96'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.425+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07dffe10 2024-08-19T00:44:49.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.427+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v96'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.427+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07dffe10 2024-08-19T00:44:49.430 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.428+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v96'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.428+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e03c10 con 0x563a07dffe10 2024-08-19T00:44:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.429+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v96'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.429+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e03bd0 con 0x563a07dffe10 2024-08-19T00:44:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.430+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v96'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.430+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07dffe10 2024-08-19T00:44:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.431+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v96'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.431+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07c7fe50 2024-08-19T00:44:49.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.433+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v96'46 uv45 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.433+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07c7fe50 2024-08-19T00:44:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.434+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v96'47 uv47 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.434+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07c7fe50 2024-08-19T00:44:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.436+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v96'48 uv48 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.439 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.436+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e02bc0 con 0x563a07c7fe50 2024-08-19T00:44:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.437+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v96'49 uv49 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.438+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563a07e03580 0x563a07e03980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.438+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e06020 con 0x563a07e03580 2024-08-19T00:44:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.438+0000 7f592c400640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563a07e03580 0x563a07e03980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.439+0000 7f592c400640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563a07e03580 0x563a07e03980 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.440+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v96'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.440+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e063c0 con 0x563a07e03580 2024-08-19T00:44:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.441+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v96'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.441+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e067e0 con 0x563a07e03580 2024-08-19T00:44:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.442+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v96'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.445 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.443+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e08090 con 0x563a07e03580 2024-08-19T00:44:49.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.444+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v96'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.444+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e08430 con 0x563a07e03580 2024-08-19T00:44:49.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.445+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v96'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.445+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e07080 con 0x563a07e03580 2024-08-19T00:44:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.446+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v96'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.446+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563a07e07980 0x563a07e0a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.446+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ad20 con 0x563a07e07980 2024-08-19T00:44:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.447+0000 7f592ba00640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563a07e07980 0x563a07e0a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.447+0000 7f592ba00640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563a07e07980 0x563a07e0a7e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.448+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v96'105 uv99 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.448+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ad20 con 0x563a07e07980 2024-08-19T00:44:49.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.450+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v96'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.450+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ada0 con 0x563a07e07980 2024-08-19T00:44:49.453 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.451+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v96'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.451+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0c1a0 con 0x563a07e07980 2024-08-19T00:44:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.453+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v96'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.453+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0c1a0 con 0x563a07e07980 2024-08-19T00:44:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.454+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v96'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.454+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0b190 con 0x563a07e07980 2024-08-19T00:44:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.455+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v96'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.455+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0b190 con 0x563a07e07980 2024-08-19T00:44:49.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.456+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v96'111 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.456+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0b190 con 0x563a07e07980 2024-08-19T00:44:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.458+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v96'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.458+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0b190 con 0x563a07e07980 2024-08-19T00:44:49.461 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.459+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v96'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.459+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0b190 con 0x563a07e07980 2024-08-19T00:44:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.460+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v96'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.460+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0b190 con 0x563a07e07980 2024-08-19T00:44:49.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.461+0000 7f592ba00640 1 -- 172.21.15.7:0/891024260 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v96'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591c053c00 con 0x563a07e07980 2024-08-19T00:44:49.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.462+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563a07e0b6a0 0x563a07e0da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.462+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e190 con 0x563a07e0b6a0 2024-08-19T00:44:49.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.462+0000 7f592b000640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563a07e0b6a0 0x563a07e0da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.462+0000 7f592b000640 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563a07e0b6a0 0x563a07e0da90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.464+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v96'46 uv45 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.464+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e190 con 0x563a07e0b6a0 2024-08-19T00:44:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.465+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v96'47 uv47 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.465+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07e0b6a0 2024-08-19T00:44:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.466+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v96'48 uv48 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.469 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.466+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07e0b6a0 2024-08-19T00:44:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.468+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v96'49 uv49 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.468+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07e0b6a0 2024-08-19T00:44:49.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.469+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v96'50 uv50 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.469+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07c7fe50 2024-08-19T00:44:49.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.471+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v96'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.471+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07c7fe50 2024-08-19T00:44:49.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.472+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v96'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.472+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07c7fe50 2024-08-19T00:44:49.476 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.473+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v96'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.473+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0f5c0 con 0x563a07c7fe50 2024-08-19T00:44:49.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.475+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v96'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.475+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0f5c0 con 0x563a07c7fe50 2024-08-19T00:44:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.476+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v96'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.476+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07c7fe50 2024-08-19T00:44:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.478+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v96'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07c7fe50 2024-08-19T00:44:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.478+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0e5b0 con 0x563a07dffe10 2024-08-19T00:44:49.482 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.480+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v96'95 uv95 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.480+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e06c70 con 0x563a07dffe10 2024-08-19T00:44:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.481+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [write 0~34] v96'96 uv96 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.481+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e06c70 con 0x563a07dffe10 2024-08-19T00:44:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.482+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v96'97 uv97 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.483+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e06c70 con 0x563a07dffe10 2024-08-19T00:44:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.484+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 100.00000000 [create] v96'98 uv93 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.484+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e06c70 con 0x563a07dffe10 2024-08-19T00:44:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.486+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 100.00000000 [delete] v96'99 uv99 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.486+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e06c70 con 0x563a07dffe10 2024-08-19T00:44:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.487+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v96'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.490 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.487+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e06c70 con 0x563a07dffe10 2024-08-19T00:44:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.489+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [omap-set-header] v96'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.489+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e113c0 con 0x563a07dffe10 2024-08-19T00:44:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.490+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v96'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07dffe10 2024-08-19T00:44:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.490+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ea60 con 0x563a07e03580 2024-08-19T00:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.494+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v96'44 uv43 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.494+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee50 con 0x563a07e03580 2024-08-19T00:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.495+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v96'45 uv45 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.495+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee50 con 0x563a07e03580 2024-08-19T00:44:49.499 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:49.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.496+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v96'46 uv46 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.496+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e03580 2024-08-19T00:44:49.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.498+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v96'47 uv47 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.498+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e03580 2024-08-19T00:44:49.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.500+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v96'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.500+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e03580 2024-08-19T00:44:49.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.501+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v96'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.501+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e03580 2024-08-19T00:44:49.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.502+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v96'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.505 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:49.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.502+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0fe10 con 0x563a07e03580 2024-08-19T00:44:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.504+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v96'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.504+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0fe10 con 0x563a07e03580 2024-08-19T00:44:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.505+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v96'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.505+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e03580 2024-08-19T00:44:49.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.507+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v96'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5924022030 con 0x563a07e03580 2024-08-19T00:44:49.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.507+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.508+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v96'47 uv46 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.508+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.510+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v96'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.510+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.511+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v96'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.514 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:49.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.511+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.512+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v96'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.512+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.514+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v96'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.514+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.515+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v96'119 uv111 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.515+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.516+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v96'120 uv120 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.516+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.518+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v96'121 uv121 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.520 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.518+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.519+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v96'122 uv122 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.519+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.520+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v96'123 uv123 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.520+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.522+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v96'124 uv118 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.522+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.523+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v96'125 uv125 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.523+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.524+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v96'126 uv126 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.527 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:49.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.524+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0fe10 con 0x563a07e0b6a0 2024-08-19T00:44:49.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.526+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v96'127 uv127 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.526+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0fe10 con 0x563a07e0b6a0 2024-08-19T00:44:49.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.527+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v96'128 uv128 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.527+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0ee00 con 0x563a07e0b6a0 2024-08-19T00:44:49.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.528+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v96'129 uv129 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.528+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) -- 0x563a07e0f560 con 0x563a07e0b6a0 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592b000640 1 -- 172.21.15.7:0/891024260 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v96'130 uv130 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f591800a950 con 0x563a07e0b6a0 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563a07dfb110 msgr2=0x563a07dfd500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563a07dfb110 0x563a07dfd500 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563a07e07980 msgr2=0x563a07e0a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563a07e07980 0x563a07e0a7e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563a07e0b6a0 msgr2=0x563a07e0da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563a07e0b6a0 0x563a07e0da90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563a07dffe10 msgr2=0x563a07e001f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563a07dffe10 0x563a07e001f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563a07c7fe50 msgr2=0x563a07d538f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592c400640 1 -- 172.21.15.7:0/891024260 reap_dead start 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563a07c7fe50 0x563a07d538f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563a07e03580 msgr2=0x563a07e03980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563a07e03580 0x563a07e03980 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590c06a810 msgr2=0x7f590c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590c06a810 0x7f590c06ccd0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f591c057000 tx=0x7f591c052000 comp rx=0 tx=0).stop 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 msgr2=0x563a07d52ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d52ea0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f5924010000 tx=0x7f59240032b0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 shutdown_connections 2024-08-19T00:44:49.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563a07c7fe50 0x563a07d538f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590c06a810 0x7f590c06ccd0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a07cca8d0 0x563a07d52ea0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 --2- 172.21.15.7:0/891024260 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563a07e03580 0x563a07e03980 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 >> 172.21.15.7:0/891024260 conn(0x563a07caf4e0 msgr2=0x563a07ccc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 shutdown_connections 2024-08-19T00:44:49.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.530+0000 7f592e87af40 1 -- 172.21.15.7:0/891024260 wait complete. 2024-08-19T00:44:49.537 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 100.00000000 2024-08-19T00:44:49.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.650+0000 7fbf1911df40 1 Processor -- start 2024-08-19T00:44:49.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.650+0000 7fbf1911df40 1 -- start start 2024-08-19T00:44:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.651+0000 7fbf1911df40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743a85b0 0x561174432430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.651+0000 7fbf1911df40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x561174375ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.651+0000 7fbf1911df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743c08d0 0x561174376430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.651+0000 7fbf1911df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56117444ddc0 con 0x5611743c08d0 2024-08-19T00:44:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.651+0000 7fbf1911df40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56117431cd00 con 0x5611743a85b0 2024-08-19T00:44:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.651+0000 7fbf1911df40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56117444e0a0 con 0x5611743a8990 2024-08-19T00:44:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743c08d0 0x561174376430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743c08d0 0x561174376430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37896/0 (socket says 172.21.15.7:37896) 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 -- 172.21.15.7:0/3499200279 learned_addr learned my addr 172.21.15.7:0/3499200279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf15800640 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743a85b0 0x561174432430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf14e00640 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x561174375ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 -- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 msgr2=0x561174375ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x561174375ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 -- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743a85b0 msgr2=0x561174432430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743a85b0 0x561174432430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 -- 172.21.15.7:0/3499200279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611742a1b30 con 0x5611743c08d0 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.652+0000 7fbf16200640 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743c08d0 0x561174376430 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000a4b0 tx=0x7fbf1000a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db9e426977cfcf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf0f400640 1 -- 172.21.15.7:0/3499200279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10015070 con 0x5611743c08d0 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf0f400640 1 -- 172.21.15.7:0/3499200279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1000e730 con 0x5611743c08d0 2024-08-19T00:44:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf0f400640 1 -- 172.21.15.7:0/3499200279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000eb20 con 0x5611743c08d0 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 -- 172.21.15.7:0/3499200279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743c08d0 msgr2=0x561174376430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743c08d0 0x561174376430 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000a4b0 tx=0x7fbf1000a970 comp rx=0 tx=0).stop 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 -- 172.21.15.7:0/3499200279 shutdown_connections 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743c08d0 0x561174376430 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x561174375ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 --2- 172.21.15.7:0/3499200279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743a85b0 0x561174432430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 -- 172.21.15.7:0/3499200279 >> 172.21.15.7:0/3499200279 conn(0x5611743a54e0 msgr2=0x5611743c0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 -- 172.21.15.7:0/3499200279 shutdown_connections 2024-08-19T00:44:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.653+0000 7fbf1911df40 1 -- 172.21.15.7:0/3499200279 wait complete. 2024-08-19T00:44:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.654+0000 7fbf1911df40 1 Processor -- start 2024-08-19T00:44:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.654+0000 7fbf1911df40 1 -- start start 2024-08-19T00:44:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf1911df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743a85b0 0x561174448e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf1911df40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x5611744e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf1911df40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743c08d0 0x56117444fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf1911df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5611744426a0 con 0x5611743a85b0 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf1911df40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561174442c60 con 0x5611743c08d0 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf1911df40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561174442980 con 0x5611743a8990 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf15800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743a85b0 0x561174448e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf16200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743c08d0 0x56117444fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf15800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743a85b0 0x561174448e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37898/0 (socket says 172.21.15.7:37898) 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf14e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x5611744e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.655+0000 7fbf15800640 1 -- 172.21.15.7:0/1425183602 learned_addr learned my addr 172.21.15.7:0/1425183602 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf16200640 1 -- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 msgr2=0x5611744e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf16200640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x5611744e62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf16200640 1 -- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743a85b0 msgr2=0x561174448e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf16200640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743a85b0 0x561174448e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf16200640 1 -- 172.21.15.7:0/1425183602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611742de080 con 0x5611743c08d0 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf14e00640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5611743a8990 0x5611744e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf15800640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611743a85b0 0x561174448e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf16200640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743c08d0 0x56117444fa50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbf10012000 tx=0x7fbf100032f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf0e000640 1 -- 172.21.15.7:0/1425183602 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10020070 con 0x5611743c08d0 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf0e000640 1 -- 172.21.15.7:0/1425183602 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1001b660 con 0x5611743c08d0 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf0e000640 1 -- 172.21.15.7:0/1425183602 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10015040 con 0x5611743c08d0 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.656+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561174431d60 con 0x5611743c08d0 2024-08-19T00:44:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.657+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611744460b0 con 0x5611743c08d0 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.659+0000 7fbf0e000640 1 -- 172.21.15.7:0/1425183602 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf1001ba50 con 0x5611743c08d0 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.659+0000 7fbf0e000640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbef806a840 0x7fbef806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.660+0000 7fbf0e000640 1 -- 172.21.15.7:0/1425183602 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7fbf1008b080 con 0x5611743c08d0 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.660+0000 7fbf15800640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbef806a840 0x7fbef806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.660+0000 7fbf1911df40 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56117444b300 0x56117444b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.660+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) -- 0x56117444bc20 con 0x56117444b300 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.660+0000 7fbf14e00640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56117444b300 0x56117444b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.660+0000 7fbf15800640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbef806a840 0x7fbef806cd00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbf08045ac0 tx=0x7fbf08052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.661+0000 7fbf14e00640 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56117444b300 0x56117444b6e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf14e00640 1 -- 172.21.15.7:0/1425183602 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 100.00000000 [delete] v96'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fbf04009990 con 0x56117444b300 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56117444b300 msgr2=0x56117444b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf1911df40 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56117444b300 0x56117444b6e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbef806a840 msgr2=0x7fbef806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf1911df40 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbef806a840 0x7fbef806cd00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbf08045ac0 tx=0x7fbf08052000 comp rx=0 tx=0).stop 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743c08d0 msgr2=0x56117444fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf1911df40 1 --2- 172.21.15.7:0/1425183602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611743c08d0 0x56117444fa50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbf10012000 tx=0x7fbf100032f0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.662+0000 7fbf16200640 1 -- 172.21.15.7:0/1425183602 reap_dead start 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.663+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 shutdown_connections 2024-08-19T00:44:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.663+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 >> 172.21.15.7:0/1425183602 conn(0x5611743a54e0 msgr2=0x5611743c0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:49.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.663+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 shutdown_connections 2024-08-19T00:44:49.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.663+0000 7fbf1911df40 1 -- 172.21.15.7:0/1425183602 wait complete. 2024-08-19T00:44:49.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:49.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.827+0000 7f0158c00640 1 Processor -- start 2024-08-19T00:44:49.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.827+0000 7f0158c00640 1 -- start start 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0158c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0158c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f01540d27b0 0x7f01540d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0158c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f01540b4150 0x7f01540b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0158c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f01540d3110 con 0x7f01540b4150 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0158c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f01540b4b20 con 0x7f01540d27b0 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0158c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f01540b4df0 con 0x7f015415e3e0 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0153e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f01540b4150 0x7f01540b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0153e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f01540b4150 0x7f01540b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37908/0 (socket says 172.21.15.7:37908) 2024-08-19T00:44:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.828+0000 7f0153e00640 1 -- 172.21.15.7:0/1540129267 learned_addr learned my addr 172.21.15.7:0/1540129267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f014be00640 1 --2- 172.21.15.7:0/1540129267 >> v2:172.21.15.162:3300/0 conn(0x7f01540d27b0 0x7f01540d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f0153400640 1 --2- 172.21.15.7:0/1540129267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f0153e00640 1 -- 172.21.15.7:0/1540129267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 msgr2=0x7f01540b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f0153e00640 1 --2- 172.21.15.7:0/1540129267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f0153e00640 1 -- 172.21.15.7:0/1540129267 >> v2:172.21.15.162:3300/0 conn(0x7f01540d27b0 msgr2=0x7f01540d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f0153e00640 1 --2- 172.21.15.7:0/1540129267 >> v2:172.21.15.162:3300/0 conn(0x7f01540d27b0 0x7f01540d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f0153e00640 1 -- 172.21.15.7:0/1540129267 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01540b50d0 con 0x7f01540b4150 2024-08-19T00:44:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.829+0000 7f014be00640 1 --2- 172.21.15.7:0/1540129267 >> v2:172.21.15.162:3300/0 conn(0x7f01540d27b0 0x7f01540d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.830+0000 7f0153e00640 1 --2- 172.21.15.7:0/1540129267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f01540b45e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f015408e960 tx=0x7f014c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ad91d629cf52a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.830+0000 7f0152a00640 1 -- 172.21.15.7:0/1540129267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c036070 con 0x7f01540b4150 2024-08-19T00:44:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.830+0000 7f0152a00640 1 -- 172.21.15.7:0/1540129267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014c031600 con 0x7f01540b4150 2024-08-19T00:44:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.830+0000 7f0152a00640 1 -- 172.21.15.7:0/1540129267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0319d0 con 0x7f01540b4150 2024-08-19T00:44:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 -- 172.21.15.7:0/1540129267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 msgr2=0x7f01540b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 --2- 172.21.15.7:0/1540129267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f01540b45e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f015408e960 tx=0x7f014c02a6a0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 -- 172.21.15.7:0/1540129267 shutdown_connections 2024-08-19T00:44:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 --2- 172.21.15.7:0/1540129267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f01540b45e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 --2- 172.21.15.7:0/1540129267 >> v2:172.21.15.162:3300/0 conn(0x7f01540d27b0 0x7f01540d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 --2- 172.21.15.7:0/1540129267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 -- 172.21.15.7:0/1540129267 >> 172.21.15.7:0/1540129267 conn(0x7f015408dbe0 msgr2=0x7f015409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 -- 172.21.15.7:0/1540129267 shutdown_connections 2024-08-19T00:44:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.831+0000 7f0158c00640 1 -- 172.21.15.7:0/1540129267 wait complete. 2024-08-19T00:44:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.832+0000 7f0158c00640 1 Processor -- start 2024-08-19T00:44:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.833+0000 7f0158c00640 1 -- start start 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.833+0000 7f0158c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f0154157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.833+0000 7f0158c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01540d27b0 0x7f01541f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.833+0000 7f0158c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.833+0000 7f0158c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01540cee90 con 0x7f01540b4150 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.833+0000 7f0158c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01540cf4c0 con 0x7f01540d27b0 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.833+0000 7f0158c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f01540b13a0 con 0x7f015415e3e0 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f0154157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f0154157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37912/0 (socket says 172.21.15.7:37912) 2024-08-19T00:44:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 -- 172.21.15.7:0/1459119633 learned_addr learned my addr 172.21.15.7:0/1459119633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f014be00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01540d27b0 0x7f01541f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153e00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 -- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 msgr2=0x7f01540cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 -- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01540d27b0 msgr2=0x7f01541f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01540d27b0 0x7f01541f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 -- 172.21.15.7:0/1459119633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01540cc430 con 0x7f01540b4150 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.834+0000 7f0153400640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f0154157830 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f014400d5f0 tx=0x7f014400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.835+0000 7f014b400640 1 -- 172.21.15.7:0/1459119633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01440125f0 con 0x7f01540b4150 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.835+0000 7f014b400640 1 -- 172.21.15.7:0/1459119633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0144019070 con 0x7f01540b4150 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.835+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01541f46c0 con 0x7f01540b4150 2024-08-19T00:44:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.835+0000 7f014b400640 1 -- 172.21.15.7:0/1459119633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01440129d0 con 0x7f01540b4150 2024-08-19T00:44:49.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.835+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01541f4c80 con 0x7f01540b4150 2024-08-19T00:44:49.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.836+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01540d2bd0 con 0x7f01540b4150 2024-08-19T00:44:49.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.837+0000 7f014b400640 1 -- 172.21.15.7:0/1459119633 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0144012b70 con 0x7f01540b4150 2024-08-19T00:44:49.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.838+0000 7f014b400640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f013006be30 0x7f013006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:49.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.838+0000 7f014b400640 1 -- 172.21.15.7:0/1459119633 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7f014408b4a0 con 0x7f01540b4150 2024-08-19T00:44:49.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.838+0000 7f014be00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f013006be30 0x7f013006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:49.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.839+0000 7f014be00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f013006be30 0x7f013006e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f01540b2160 tx=0x7f013c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:49.843+0000 7f014b400640 1 -- 172.21.15.7:0/1459119633 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0144059400 con 0x7f01540b4150 2024-08-19T00:44:50.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.065+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f01541f4480 con 0x7f01540b4150 2024-08-19T00:44:50.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.247+0000 7f014b400640 1 -- 172.21.15.7:0/1459119633 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v145) ==== 162+0+0 (secure 0 0 0) 0x7f014405d700 con 0x7f01540b4150 2024-08-19T00:44:50.250 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:44:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f013006be30 msgr2=0x7f013006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f013006be30 0x7f013006e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f01540b2160 tx=0x7f013c008040 comp rx=0 tx=0).stop 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 msgr2=0x7f0154157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f0154157830 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f014400d5f0 tx=0x7f014400dab0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 shutdown_connections 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f013006be30 0x7f013006e2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f015415e3e0 0x7f01540cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01540d27b0 0x7f01541f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 --2- 172.21.15.7:0/1459119633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01540b4150 0x7f0154157830 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 >> 172.21.15.7:0/1459119633 conn(0x7f015408dbe0 msgr2=0x7f01540b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 shutdown_connections 2024-08-19T00:44:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.251+0000 7f0158c00640 1 -- 172.21.15.7:0/1459119633 wait complete. 2024-08-19T00:44:50.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:50.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.428+0000 7fe4c6e00640 1 Processor -- start 2024-08-19T00:44:50.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.428+0000 7fe4c6e00640 1 -- start start 2024-08-19T00:44:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.429+0000 7fe4c6e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c00ce500 0x7fe4c00ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.429+0000 7fe4c6e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4c00d03c0 0x7fe4c00d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.429+0000 7fe4c6e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c006f7f0 con 0x7fe4c0159bf0 2024-08-19T00:44:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.429+0000 7fe4c6e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c00cee80 con 0x7fe4c00d03c0 2024-08-19T00:44:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.429+0000 7fe4c6e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c00d0d70 con 0x7fe4c00ce500 2024-08-19T00:44:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4c4e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4c00d03c0 0x7fe4c00d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4c4e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4c00d03c0 0x7fe4c00d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37926/0 (socket says 172.21.15.7:37926) 2024-08-19T00:44:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4c4e00640 1 -- 172.21.15.7:0/3953941315 learned_addr learned my addr 172.21.15.7:0/3953941315 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4b7e00640 1 --2- 172.21.15.7:0/3953941315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c00ce500 0x7fe4c00ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4c4e00640 1 -- 172.21.15.7:0/3953941315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c00ce500 msgr2=0x7fe4c00ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4c4e00640 1 --2- 172.21.15.7:0/3953941315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c00ce500 0x7fe4c00ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4c4e00640 1 -- 172.21.15.7:0/3953941315 >> v1:172.21.15.162:6789/0 conn(0x7fe4c0159bf0 legacy=0x7fe4c0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:50.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4c4e00640 1 -- 172.21.15.7:0/3953941315 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c006f510 con 0x7fe4c00d03c0 2024-08-19T00:44:50.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.430+0000 7fe4b7e00640 1 --2- 172.21.15.7:0/3953941315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c00ce500 0x7fe4c00ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.431+0000 7fe4c4e00640 1 --2- 172.21.15.7:0/3953941315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00d03c0 0x7fe4c00d0830 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009e50 tx=0x7fe4b802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa94fd50ace2601 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4bf400640 1 -- 172.21.15.7:0/3953941315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8036070 con 0x7fe4c00d03c0 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4bf400640 1 -- 172.21.15.7:0/3953941315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b8031600 con 0x7fe4c00d03c0 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4bf400640 1 -- 172.21.15.7:0/3953941315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80319d0 con 0x7fe4c00d03c0 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 -- 172.21.15.7:0/3953941315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00d03c0 msgr2=0x7fe4c00d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/3953941315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00d03c0 0x7fe4c00d0830 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009e50 tx=0x7fe4b802a630 comp rx=0 tx=0).stop 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 -- 172.21.15.7:0/3953941315 shutdown_connections 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/3953941315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00d03c0 0x7fe4c00d0830 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/3953941315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c00ce500 0x7fe4c00ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 -- 172.21.15.7:0/3953941315 >> 172.21.15.7:0/3953941315 conn(0x7fe4c006bc70 msgr2=0x7fe4c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 -- 172.21.15.7:0/3953941315 shutdown_connections 2024-08-19T00:44:50.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.432+0000 7fe4c6e00640 1 -- 172.21.15.7:0/3953941315 wait complete. 2024-08-19T00:44:50.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.434+0000 7fe4c6e00640 1 Processor -- start 2024-08-19T00:44:50.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.434+0000 7fe4c6e00640 1 -- start start 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4c6e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00ce500 0x7fe4c014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4c6e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c00d03c0 0x7fe4c015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4c6e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c0159bf0 0x7fe4c015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4c6e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c0072f40 con 0x7fe4c00ce500 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4c6e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c0072c60 con 0x7fe4c00d03c0 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4c6e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c0073b70 con 0x7fe4c0159bf0 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00ce500 0x7fe4c014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00ce500 0x7fe4c014e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37928/0 (socket says 172.21.15.7:37928) 2024-08-19T00:44:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4bfe00640 1 -- 172.21.15.7:0/2611309600 learned_addr learned my addr 172.21.15.7:0/2611309600 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4b7e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c00d03c0 0x7fe4c015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.435+0000 7fe4c4e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c0159bf0 0x7fe4c015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bfe00640 1 -- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c0159bf0 msgr2=0x7fe4c015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bfe00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c0159bf0 0x7fe4c015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bfe00640 1 -- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c00d03c0 msgr2=0x7fe4c015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bfe00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c00d03c0 0x7fe4c015e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bfe00640 1 -- 172.21.15.7:0/2611309600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c0152d00 con 0x7fe4c00ce500 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4b7e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c00d03c0 0x7fe4c015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bfe00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00ce500 0x7fe4c014e400 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c430 tx=0x7fe4b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bcc00640 1 -- 172.21.15.7:0/2611309600 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0011790 con 0x7fe4c00ce500 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bcc00640 1 -- 172.21.15.7:0/2611309600 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0017070 con 0x7fe4c00ce500 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4bcc00640 1 -- 172.21.15.7:0/2611309600 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0011bb0 con 0x7fe4c00ce500 2024-08-19T00:44:50.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c0152fe0 con 0x7fe4c00ce500 2024-08-19T00:44:50.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.436+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c01535a0 con 0x7fe4c00ce500 2024-08-19T00:44:50.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.437+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c015b150 con 0x7fe4c00ce500 2024-08-19T00:44:50.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.438+0000 7fe4bcc00640 1 -- 172.21.15.7:0/2611309600 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4b001c460 con 0x7fe4c00ce500 2024-08-19T00:44:50.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.439+0000 7fe4bcc00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe49c06be80 0x7fe49c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:50.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.439+0000 7fe4bcc00640 1 -- 172.21.15.7:0/2611309600 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6569+0+0 (secure 0 0 0) 0x7fe4b008ae90 con 0x7fe4c00ce500 2024-08-19T00:44:50.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.439+0000 7fe4b7e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe49c06be80 0x7fe49c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:50.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.440+0000 7fe4b7e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe49c06be80 0x7fe49c06e340 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0158c70 tx=0x7fe4a8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:50.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.444+0000 7fe4bcc00640 1 -- 172.21.15.7:0/2611309600 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe4b0058f70 con 0x7fe4c00ce500 2024-08-19T00:44:50.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.664+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4c014e990 con 0x7fe4c00ce500 2024-08-19T00:44:50.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.665+0000 7fe4bcc00640 1 -- 172.21.15.7:0/2611309600 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+4401 (secure 0 0 0) 0x7fe4b005d270 con 0x7fe4c00ce500 2024-08-19T00:44:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:50.668 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":146,"btime":"2024-08-19T00:44:50:251744+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:50.251702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8046":{"gid":8046,"name":"c","rank":0,"incarnation":146,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/3482025847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3482025847},{"type":"v1","addr":"172.21.15.7:6836","nonce":3482025847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:50.668 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 146 2024-08-19T00:44:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe49c06be80 msgr2=0x7fe49c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe49c06be80 0x7fe49c06e340 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0158c70 tx=0x7fe4a8008040 comp rx=0 tx=0).stop 2024-08-19T00:44:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00ce500 msgr2=0x7fe4c014e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00ce500 0x7fe4c014e400 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c430 tx=0x7fe4b000c8f0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 shutdown_connections 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe49c06be80 0x7fe49c06e340 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c0159bf0 0x7fe4c015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c00d03c0 0x7fe4c015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 --2- 172.21.15.7:0/2611309600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4c00ce500 0x7fe4c014e400 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.667+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 >> 172.21.15.7:0/2611309600 conn(0x7fe4c006bc70 msgr2=0x7fe4c0160650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.668+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 shutdown_connections 2024-08-19T00:44:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:50.668+0000 7fe4c6e00640 1 -- 172.21.15.7:0/2611309600 wait complete. 2024-08-19T00:44:50.687 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:44:50.977 INFO:tasks.ceph.mds.a.smithi007.stderr: -47> 2024-08-19T00:44:46.222+0000 7f555ce00640 -1 mds.0.inotable: load_2 could not read table: -2 2024-08-19T00:44:50.977 INFO:tasks.ceph.mds.a.smithi007.stderr: -46> 2024-08-19T00:44:46.222+0000 7f555ce00640 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2024-08-19T00:44:51.016 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:44:53.272 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:53.269+0000 7ff147400640 -1 log_channel(cluster) log [ERR] : dir 0x100 object missing on disk; some files may be lost (~mds0) 2024-08-19T00:44:53.273 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:53.271+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:44:53.273 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:44:53.271+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:44:55.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:55.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.853+0000 7f46ee800640 1 Processor -- start 2024-08-19T00:44:55.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.854+0000 7f46ee800640 1 -- start start 2024-08-19T00:44:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46ee800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46e80cc9f0 0x7f46e80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46ee800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e815b290 con 0x7f46e806dcc0 2024-08-19T00:44:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46ee800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e815b570 con 0x7f46e81585c0 2024-08-19T00:44:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46ee800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f46e80cd370 con 0x7f46e80cc9f0 2024-08-19T00:44:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46e7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f46e806dcc0 0x7f46e806e0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:51790/0 (socket says 172.21.15.7:51790) 2024-08-19T00:44:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46e7e00640 1 -- 172.21.15.7:0/858740028 learned_addr learned my addr 172.21.15.7:0/858740028 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46dfe00640 1 --2- 172.21.15.7:0/858740028 >> v2:172.21.15.162:3300/0 conn(0x7f46e80cc9f0 0x7f46e80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.855+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448900441 0 0) 0x7f46e815b290 con 0x7f46e806dcc0 2024-08-19T00:44:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46cc003440 con 0x7f46e806dcc0 2024-08-19T00:44:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372625292 0 0) 0x7f46e815b570 con 0x7f46e81585c0 2024-08-19T00:44:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e815b290 con 0x7f46e81585c0 2024-08-19T00:44:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4094709489 0 0) 0x7f46cc003440 con 0x7f46e806dcc0 2024-08-19T00:44:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 >> v2:172.21.15.162:3300/0 conn(0x7f46e80cc9f0 msgr2=0x7f46e80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 --2- 172.21.15.7:0/858740028 >> v2:172.21.15.162:3300/0 conn(0x7f46e80cc9f0 0x7f46e80cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 >> v1:172.21.15.162:6789/0 conn(0x7f46e81585c0 legacy=0x7f46e806f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e815b850 con 0x7f46e806dcc0 2024-08-19T00:44:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f46e00019f0 con 0x7f46e806dcc0 2024-08-19T00:44:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 >> v1:172.21.15.7:6789/0 conn(0x7f46e806dcc0 legacy=0x7f46e806e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46cc003c30 0x7f46cc008850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc008d90 0x7f46cc00b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc00b6c0 0x7f46cc00dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80cd370 con 0x7f46cc00b6c0 2024-08-19T00:44:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc00e280 con 0x7f46cc008d90 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46cc00e480 con 0x7f46cc003c30 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e7e00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc00b6c0 0x7f46cc00dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46dfe00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc008d90 0x7f46cc00b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.856+0000 7f46e7400640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46cc003c30 0x7f46cc008850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.857+0000 7f46e7e00640 1 -- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46cc003c30 msgr2=0x7f46cc008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.857+0000 7f46e7e00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46cc003c30 0x7f46cc008850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.857+0000 7f46e7e00640 1 -- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc008d90 msgr2=0x7f46cc00b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.857+0000 7f46e7e00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc008d90 0x7f46cc00b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.857+0000 7f46e7e00640 1 -- 172.21.15.7:0/858740028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc003440 con 0x7f46cc00b6c0 2024-08-19T00:44:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.858+0000 7f46e7e00640 1 -- 172.21.15.7:0/858740028 reap_dead start 2024-08-19T00:44:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.858+0000 7f46e7e00640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc00b6c0 0x7f46cc00dab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f46e000a7e0 tx=0x7f46cc003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97d8c21bd02613a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.858+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e000a430 con 0x7f46cc00b6c0 2024-08-19T00:44:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.858+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e002f070 con 0x7f46cc00b6c0 2024-08-19T00:44:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.858+0000 7f46e6a00640 1 -- 172.21.15.7:0/858740028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e002bc30 con 0x7f46cc00b6c0 2024-08-19T00:44:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.859+0000 7f46ee800640 1 -- 172.21.15.7:0/858740028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc00b6c0 msgr2=0x7f46cc00dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.859+0000 7f46ee800640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc00b6c0 0x7f46cc00dab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f46e000a7e0 tx=0x7f46cc003730 comp rx=0 tx=0).stop 2024-08-19T00:44:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.859+0000 7f46ee800640 1 -- 172.21.15.7:0/858740028 shutdown_connections 2024-08-19T00:44:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.859+0000 7f46ee800640 1 --2- 172.21.15.7:0/858740028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc00b6c0 0x7f46cc00dab0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.859+0000 7f46ee800640 1 -- 172.21.15.7:0/858740028 >> 172.21.15.7:0/858740028 conn(0x7f46e806bc70 msgr2=0x7f46e806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.859+0000 7f46ee800640 1 -- 172.21.15.7:0/858740028 shutdown_connections 2024-08-19T00:44:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.859+0000 7f46ee800640 1 -- 172.21.15.7:0/858740028 wait complete. 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.860+0000 7f46ee800640 1 Processor -- start 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.861+0000 7f46ee800640 1 -- start start 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46ee800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc00b6c0 0x7f46e8152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46ee800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e815ef40 0x7f46e80ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e80ceef0 0x7f46e80cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46ee800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8071980 con 0x7f46e80ceef0 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46ee800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46e815be10 con 0x7f46cc00b6c0 2024-08-19T00:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46ee800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46e8071b00 con 0x7f46e815ef40 2024-08-19T00:44:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e80ceef0 0x7f46e80cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e80ceef0 0x7f46e80cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40804/0 (socket says 172.21.15.7:40804) 2024-08-19T00:44:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 -- 172.21.15.7:0/4257726999 learned_addr learned my addr 172.21.15.7:0/4257726999 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46dfe00640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e815ef40 0x7f46e80ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7400640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc00b6c0 0x7f46e8152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 -- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e815ef40 msgr2=0x7f46e80ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e815ef40 0x7f46e80ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 -- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc00b6c0 msgr2=0x7f46e8152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc00b6c0 0x7f46e8152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.862+0000 7f46e7e00640 1 -- 172.21.15.7:0/4257726999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80adca0 con 0x7f46e80ceef0 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.863+0000 7f46e7e00640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e80ceef0 0x7f46e80cf370 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f46e000a7e0 tx=0x7f46e815b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.863+0000 7f46df400640 1 -- 172.21.15.7:0/4257726999 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e000a430 con 0x7f46e80ceef0 2024-08-19T00:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.863+0000 7f46df400640 1 -- 172.21.15.7:0/4257726999 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e002bb00 con 0x7f46e80ceef0 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.863+0000 7f46df400640 1 -- 172.21.15.7:0/4257726999 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0001f70 con 0x7f46e80ceef0 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.863+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e80adf80 con 0x7f46e80ceef0 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.863+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e80ad9b0 con 0x7f46e80ceef0 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.864+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e815ae60 con 0x7f46e80ceef0 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.865+0000 7f46df400640 1 -- 172.21.15.7:0/4257726999 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46e0047060 con 0x7f46e80ceef0 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.866+0000 7f46df400640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c406be60 0x7f46c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.866+0000 7f46df400640 1 -- 172.21.15.7:0/4257726999 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7f46e00aaf50 con 0x7f46e80ceef0 2024-08-19T00:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.866+0000 7f46e7400640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c406be60 0x7f46c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.867+0000 7f46e7400640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c406be60 0x7f46c406e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001850 tx=0x7f46d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:55.871+0000 7f46df400640 1 -- 172.21.15.7:0/4257726999 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f46e0079570 con 0x7f46e80ceef0 2024-08-19T00:44:56.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.090+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46e80cc7d0 con 0x7f46e80ceef0 2024-08-19T00:44:56.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.090+0000 7f46df400640 1 -- 172.21.15.7:0/4257726999 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+4392 (secure 0 0 0) 0x7f46e0078e70 con 0x7f46e80ceef0 2024-08-19T00:44:56.093 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:56.093 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":150,"btime":"2024-08-19T00:44:53:272605+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:53.272600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:56.093 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 150 2024-08-19T00:44:56.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c406be60 msgr2=0x7f46c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c406be60 0x7f46c406e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001850 tx=0x7f46d8009040 comp rx=0 tx=0).stop 2024-08-19T00:44:56.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e80ceef0 msgr2=0x7f46e80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e80ceef0 0x7f46e80cf370 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f46e000a7e0 tx=0x7f46e815b740 comp rx=0 tx=0).stop 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 shutdown_connections 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c406be60 0x7f46c406e320 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e80ceef0 0x7f46e80cf370 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e815ef40 0x7f46e80ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 --2- 172.21.15.7:0/4257726999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc00b6c0 0x7f46e8152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 >> 172.21.15.7:0/4257726999 conn(0x7f46e806bc70 msgr2=0x7f46e8071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 shutdown_connections 2024-08-19T00:44:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.092+0000 7f46ee800640 1 -- 172.21.15.7:0/4257726999 wait complete. 2024-08-19T00:44:56.111 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:44:56.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.266+0000 7f2215000640 1 Processor -- start 2024-08-19T00:44:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.266+0000 7f2215000640 1 -- start start 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f2215000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f22100ce500 0x7f22100ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f2215000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22100d03c0 0x7f22100d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f2215000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221006f7f0 con 0x7f2210159bf0 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f2215000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f22100d0d50 con 0x7f22100d03c0 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f2215000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f221006f510 con 0x7f22100ce500 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22100d03c0 0x7f22100d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220de00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2210159bf0 0x7f2210073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:51806/0 (socket says 172.21.15.7:51806) 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220de00640 1 -- 172.21.15.7:0/3875671527 learned_addr learned my addr 172.21.15.7:0/3875671527 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220d400640 1 --2- 172.21.15.7:0/3875671527 >> v2:172.21.15.162:3300/0 conn(0x7f22100ce500 0x7f22100ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220e800640 1 -- 172.21.15.7:0/3875671527 >> v2:172.21.15.162:3300/0 conn(0x7f22100ce500 msgr2=0x7f22100ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:56.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220e800640 1 --2- 172.21.15.7:0/3875671527 >> v2:172.21.15.162:3300/0 conn(0x7f22100ce500 0x7f22100ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220e800640 1 -- 172.21.15.7:0/3875671527 >> v1:172.21.15.7:6789/0 conn(0x7f2210159bf0 legacy=0x7f2210073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220e800640 1 -- 172.21.15.7:0/3875671527 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2210072980 con 0x7f22100d03c0 2024-08-19T00:44:56.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.268+0000 7f220ca00640 1 -- 172.21.15.7:0/3875671527 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474800878 0 0) 0x7f221006f7f0 con 0x7f2210159bf0 2024-08-19T00:44:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.269+0000 7f220e800640 1 --2- 172.21.15.7:0/3875671527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100d0810 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f22100b1cc0 tx=0x7f220802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22be1af152f213f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f220ca00640 1 -- 172.21.15.7:0/3875671527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208007740 con 0x7f22100d03c0 2024-08-19T00:44:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f220ca00640 1 -- 172.21.15.7:0/3875671527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22080078e0 con 0x7f22100d03c0 2024-08-19T00:44:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f220ca00640 1 -- 172.21.15.7:0/3875671527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208007cb0 con 0x7f22100d03c0 2024-08-19T00:44:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 -- 172.21.15.7:0/3875671527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 msgr2=0x7f22100d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 --2- 172.21.15.7:0/3875671527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100d0810 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f22100b1cc0 tx=0x7f220802a5f0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 -- 172.21.15.7:0/3875671527 shutdown_connections 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 --2- 172.21.15.7:0/3875671527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100d0810 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 --2- 172.21.15.7:0/3875671527 >> v2:172.21.15.162:3300/0 conn(0x7f22100ce500 0x7f22100ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 -- 172.21.15.7:0/3875671527 >> 172.21.15.7:0/3875671527 conn(0x7f221006bc70 msgr2=0x7f221006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 -- 172.21.15.7:0/3875671527 shutdown_connections 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.270+0000 7f2215000640 1 -- 172.21.15.7:0/3875671527 wait complete. 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.272+0000 7f2215000640 1 Processor -- start 2024-08-19T00:44:56.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.272+0000 7f2215000640 1 -- start start 2024-08-19T00:44:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f2215000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22100ce500 0x7f221009cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f2215000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f2215000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210159bf0 0x7f22100b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f2215000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2210073b70 con 0x7f22100d03c0 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f2215000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2210072f40 con 0x7f2210159bf0 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f2215000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2210159fd0 con 0x7f22100ce500 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f220d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f220d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40828/0 (socket says 172.21.15.7:40828) 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.273+0000 7f220d400640 1 -- 172.21.15.7:0/2797047865 learned_addr learned my addr 172.21.15.7:0/2797047865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220de00640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22100ce500 0x7f221009cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220e800640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210159bf0 0x7f22100b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220d400640 1 -- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22100ce500 msgr2=0x7f221009cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220d400640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22100ce500 0x7f221009cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220d400640 1 -- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210159bf0 msgr2=0x7f22100b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220d400640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210159bf0 0x7f22100b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220d400640 1 -- 172.21.15.7:0/2797047865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22101f29e0 con 0x7f22100d03c0 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220de00640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22100ce500 0x7f221009cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f220d400640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100b0cc0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00d5f0 tx=0x7f21fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f2206000640 1 -- 172.21.15.7:0/2797047865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0125f0 con 0x7f22100d03c0 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f2206000640 1 -- 172.21.15.7:0/2797047865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21fc019070 con 0x7f22100d03c0 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22100b1740 con 0x7f22100d03c0 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.274+0000 7f2206000640 1 -- 172.21.15.7:0/2797047865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0129d0 con 0x7f22100d03c0 2024-08-19T00:44:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.275+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22101f1f00 con 0x7f22100d03c0 2024-08-19T00:44:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.276+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22100d0810 con 0x7f22100d03c0 2024-08-19T00:44:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.276+0000 7f2206000640 1 -- 172.21.15.7:0/2797047865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21fc012b70 con 0x7f22100d03c0 2024-08-19T00:44:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.277+0000 7f2206000640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21f006be30 0x7f21f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.277+0000 7f2206000640 1 -- 172.21.15.7:0/2797047865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7f21fc08b660 con 0x7f22100d03c0 2024-08-19T00:44:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.278+0000 7f220de00640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21f006be30 0x7f21f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.278+0000 7f220de00640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21f006be30 0x7f21f006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2200000f60 tx=0x7f2200007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.282+0000 7f2206000640 1 -- 172.21.15.7:0/2797047865 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f21fc059bc0 con 0x7f22100d03c0 2024-08-19T00:44:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.502+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f221006c980 con 0x7f22100d03c0 2024-08-19T00:44:56.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.503+0000 7f2206000640 1 -- 172.21.15.7:0/2797047865 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+4392 (secure 0 0 0) 0x7f21fc0594c0 con 0x7f22100d03c0 2024-08-19T00:44:56.506 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:56.506 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":150,"btime":"2024-08-19T00:44:53:272605+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:53.272600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:56.506 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 150 2024-08-19T00:44:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.505+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21f006be30 msgr2=0x7f21f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.505+0000 7f2215000640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21f006be30 0x7f21f006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2200000f60 tx=0x7f2200007c10 comp rx=0 tx=0).stop 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 msgr2=0x7f22100b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100b0cc0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00d5f0 tx=0x7f21fc00dab0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 shutdown_connections 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21f006be30 0x7f21f006e2f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210159bf0 0x7f22100b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22100d03c0 0x7f22100b0cc0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 --2- 172.21.15.7:0/2797047865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22100ce500 0x7f221009cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 >> 172.21.15.7:0/2797047865 conn(0x7f221006bc70 msgr2=0x7f2210160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 shutdown_connections 2024-08-19T00:44:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.506+0000 7f2215000640 1 -- 172.21.15.7:0/2797047865 wait complete. 2024-08-19T00:44:56.524 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:44:56.524 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:44:56.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.677+0000 7fa61ce00640 1 Processor -- start 2024-08-19T00:44:56.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.678+0000 7fa61ce00640 1 -- start start 2024-08-19T00:44:56.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa61ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa618073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa61ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa6180739a0 0x7fa6180ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa61ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa6180cea40 0x7fa6180d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa61ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa61806f7f0 con 0x7fa6180cea40 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa61ce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa61806f510 con 0x7fa6180739a0 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa61ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa618072980 con 0x7fa618159bf0 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa616800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa6180cea40 0x7fa6180d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa616800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa6180cea40 0x7fa6180d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40834/0 (socket says 172.21.15.7:40834) 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa616800640 1 -- 172.21.15.7:0/3680102223 learned_addr learned my addr 172.21.15.7:0/3680102223 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa60d400640 1 --2- 172.21.15.7:0/3680102223 >> v2:172.21.15.162:3300/0 conn(0x7fa6180739a0 0x7fa6180ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.679+0000 7fa615e00640 1 --2- 172.21.15.7:0/3680102223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa618073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.680+0000 7fa616800640 1 -- 172.21.15.7:0/3680102223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 msgr2=0x7fa618073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:56.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.680+0000 7fa616800640 1 --2- 172.21.15.7:0/3680102223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa618073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.680+0000 7fa616800640 1 -- 172.21.15.7:0/3680102223 >> v2:172.21.15.162:3300/0 conn(0x7fa6180739a0 msgr2=0x7fa6180ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:56.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.680+0000 7fa616800640 1 --2- 172.21.15.7:0/3680102223 >> v2:172.21.15.162:3300/0 conn(0x7fa6180739a0 0x7fa6180ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.680+0000 7fa616800640 1 -- 172.21.15.7:0/3680102223 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa618072c60 con 0x7fa6180cea40 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa616800640 1 --2- 172.21.15.7:0/3680102223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa6180d03c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa6180b5370 tx=0x7fa61002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d5bb06247fef02 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa615400640 1 -- 172.21.15.7:0/3680102223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610036070 con 0x7fa6180cea40 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa615400640 1 -- 172.21.15.7:0/3680102223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa610031600 con 0x7fa6180cea40 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa615400640 1 -- 172.21.15.7:0/3680102223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6100319d0 con 0x7fa6180cea40 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa61ce00640 1 -- 172.21.15.7:0/3680102223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 msgr2=0x7fa6180d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3680102223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa6180d03c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa6180b5370 tx=0x7fa61002a610 comp rx=0 tx=0).stop 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa61ce00640 1 -- 172.21.15.7:0/3680102223 shutdown_connections 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3680102223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa6180d03c0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3680102223 >> v2:172.21.15.162:3300/0 conn(0x7fa6180739a0 0x7fa6180ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3680102223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa618073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.681+0000 7fa61ce00640 1 -- 172.21.15.7:0/3680102223 >> 172.21.15.7:0/3680102223 conn(0x7fa61806bc70 msgr2=0x7fa61806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.682+0000 7fa61ce00640 1 -- 172.21.15.7:0/3680102223 shutdown_connections 2024-08-19T00:44:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.682+0000 7fa61ce00640 1 -- 172.21.15.7:0/3680102223 wait complete. 2024-08-19T00:44:56.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.683+0000 7fa61ce00640 1 Processor -- start 2024-08-19T00:44:56.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.683+0000 7fa61ce00640 1 -- start start 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.684+0000 7fa61ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6180739a0 0x7fa61814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.684+0000 7fa61ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa61809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.684+0000 7fa61ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa6180b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.684+0000 7fa61ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa61815a150 con 0x7fa6180cea40 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.684+0000 7fa61ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa618159fd0 con 0x7fa6180739a0 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.684+0000 7fa61ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6180d0900 con 0x7fa618159bf0 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa61809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa61809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40836/0 (socket says 172.21.15.7:40836) 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 -- 172.21.15.7:0/3551416241 learned_addr learned my addr 172.21.15.7:0/3551416241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa615e00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6180739a0 0x7fa61814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa616800640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa6180b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 -- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 msgr2=0x7fa6180b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa6180b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 -- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6180739a0 msgr2=0x7fa61814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6180739a0 0x7fa61814b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 -- 172.21.15.7:0/3551416241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61814b800 con 0x7fa6180cea40 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa616800640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa6180b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60d400640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa61809aa40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d5d0 tx=0x7fa60000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.685+0000 7fa60ea00640 1 -- 172.21.15.7:0/3551416241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600004240 con 0x7fa6180cea40 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.686+0000 7fa60ea00640 1 -- 172.21.15.7:0/3551416241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6000043e0 con 0x7fa6180cea40 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.686+0000 7fa60ea00640 1 -- 172.21.15.7:0/3551416241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600003830 con 0x7fa6180cea40 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.686+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6181f4440 con 0x7fa6180cea40 2024-08-19T00:44:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.686+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6181f4a00 con 0x7fa6180cea40 2024-08-19T00:44:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.687+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6180d03c0 con 0x7fa6180cea40 2024-08-19T00:44:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.688+0000 7fa60ea00640 1 -- 172.21.15.7:0/3551416241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6000039d0 con 0x7fa6180cea40 2024-08-19T00:44:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.689+0000 7fa60ea00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa5f406be30 0x7fa5f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.689+0000 7fa60ea00640 1 -- 172.21.15.7:0/3551416241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7fa60008b4c0 con 0x7fa6180cea40 2024-08-19T00:44:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.689+0000 7fa615e00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa5f406be30 0x7fa5f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.690+0000 7fa615e00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa5f406be30 0x7fa5f406e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa608006fd0 tx=0x7fa608008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.693+0000 7fa60ea00640 1 -- 172.21.15.7:0/3551416241 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa600059a20 con 0x7fa6180cea40 2024-08-19T00:44:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.915+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa618073780 con 0x7fa6180cea40 2024-08-19T00:44:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.915+0000 7fa60ea00640 1 -- 172.21.15.7:0/3551416241 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+4392 (secure 0 0 0) 0x7fa600059320 con 0x7fa6180cea40 2024-08-19T00:44:56.918 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:44:56.918 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":150,"btime":"2024-08-19T00:44:53:272605+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:44:53.272600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:44:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 150 2024-08-19T00:44:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.917+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa5f406be30 msgr2=0x7fa5f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.917+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa5f406be30 0x7fa5f406e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa608006fd0 tx=0x7fa608008040 comp rx=0 tx=0).stop 2024-08-19T00:44:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.917+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 msgr2=0x7fa61809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.917+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa61809aa40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d5d0 tx=0x7fa60000da90 comp rx=0 tx=0).stop 2024-08-19T00:44:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 shutdown_connections 2024-08-19T00:44:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa5f406be30 0x7fa5f406e2f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa618159bf0 0x7fa6180b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6180cea40 0x7fa61809aa40 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 --2- 172.21.15.7:0/3551416241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6180739a0 0x7fa61814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 >> 172.21.15.7:0/3551416241 conn(0x7fa61806bc70 msgr2=0x7fa61815ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 shutdown_connections 2024-08-19T00:44:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:56.918+0000 7fa61ce00640 1 -- 172.21.15.7:0/3551416241 wait complete. 2024-08-19T00:44:56.936 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 100.00000000' led to DAMAGED state 2024-08-19T00:44:56.936 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_sessionmap' 2024-08-19T00:44:56.936 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:44:56.937 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:44:56.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:44:56.972 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:44:56.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:44:56.972 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:44:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:44:57.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:44:57.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:44:57.237 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:44:57.234+0000 7ff14c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.246+0000 7f4d82600640 1 Processor -- start 2024-08-19T00:44:57.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.246+0000 7f4d82600640 1 -- start start 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d82600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4d7c15e3e0 0x7f4d7c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d82600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0b4860 0x7f4d7c0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d82600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7c0b4df0 con 0x7f4d7c0d27b0 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d82600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4d7c0d3140 con 0x7f4d7c15e3e0 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d82600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c0b50d0 con 0x7f4d7c0b4860 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d81200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4d7c15e3e0 0x7f4d7c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d7be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4d7c0d27b0 0x7f4d7c0b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:51808/0 (socket says 172.21.15.7:51808) 2024-08-19T00:44:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d81200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4d7c15e3e0 0x7f4d7c0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40844/0 (socket says 172.21.15.7:40844) 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.247+0000 7f4d7be00640 1 -- 172.21.15.7:0/3369478597 learned_addr learned my addr 172.21.15.7:0/3369478597 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.248+0000 7f4d81200640 1 -- 172.21.15.7:0/3369478597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0b4860 msgr2=0x7f4d7c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.248+0000 7f4d81c00640 1 --2- 172.21.15.7:0/3369478597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0b4860 0x7f4d7c0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.248+0000 7f4d81200640 1 --2- 172.21.15.7:0/3369478597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0b4860 0x7f4d7c0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.248+0000 7f4d81200640 1 -- 172.21.15.7:0/3369478597 >> v1:172.21.15.7:6789/0 conn(0x7f4d7c0d27b0 legacy=0x7f4d7c0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.248+0000 7f4d81200640 1 -- 172.21.15.7:0/3369478597 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c0cf1e0 con 0x7f4d7c15e3e0 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.248+0000 7f4d81c00640 1 --2- 172.21.15.7:0/3369478597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0b4860 0x7f4d7c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.248+0000 7f4d7b400640 1 -- 172.21.15.7:0/3369478597 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430597615 0 0) 0x7f4d7c0b4df0 con 0x7f4d7c0d27b0 2024-08-19T00:44:57.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.249+0000 7f4d81200640 1 --2- 172.21.15.7:0/3369478597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0b0e60 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097d0 tx=0x7f4d7002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f2aa30473d6f9d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:57.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.249+0000 7f4d7b400640 1 -- 172.21.15.7:0/3369478597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70037070 con 0x7f4d7c15e3e0 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.249+0000 7f4d7b400640 1 -- 172.21.15.7:0/3369478597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d70032440 con 0x7f4d7c15e3e0 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.249+0000 7f4d7b400640 1 -- 172.21.15.7:0/3369478597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70032810 con 0x7f4d7c15e3e0 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 -- 172.21.15.7:0/3369478597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c15e3e0 msgr2=0x7f4d7c0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 --2- 172.21.15.7:0/3369478597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0b0e60 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097d0 tx=0x7f4d7002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 -- 172.21.15.7:0/3369478597 shutdown_connections 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 --2- 172.21.15.7:0/3369478597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0b4860 0x7f4d7c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 --2- 172.21.15.7:0/3369478597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0b0e60 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 -- 172.21.15.7:0/3369478597 >> 172.21.15.7:0/3369478597 conn(0x7f4d7c08dbe0 msgr2=0x7f4d7c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 -- 172.21.15.7:0/3369478597 shutdown_connections 2024-08-19T00:44:57.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.250+0000 7f4d82600640 1 -- 172.21.15.7:0/3369478597 wait complete. 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.251+0000 7f4d82600640 1 Processor -- start 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.252+0000 7f4d82600640 1 -- start start 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.252+0000 7f4d82600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c0b4860 0x7f4d7c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d82600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0d27b0 0x7f4d7c0b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d82600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d82600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0b13a0 con 0x7f4d7c0b4860 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d82600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0cee90 con 0x7f4d7c15e3e0 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d82600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c0cf9e0 con 0x7f4d7c0d27b0 2024-08-19T00:44:57.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c0b4860 0x7f4d7c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c0b4860 0x7f4d7c15d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40856/0 (socket says 172.21.15.7:40856) 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 -- 172.21.15.7:0/3968957071 learned_addr learned my addr 172.21.15.7:0/3968957071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d7be00640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0d27b0 0x7f4d7c0b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81c00640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 -- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0d27b0 msgr2=0x7f4d7c0b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0d27b0 0x7f4d7c0b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 -- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c15e3e0 msgr2=0x7f4d7c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81200640 1 -- 172.21.15.7:0/3968957071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c0b9220 con 0x7f4d7c0b4860 2024-08-19T00:44:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d7be00640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0d27b0 0x7f4d7c0b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.253+0000 7f4d81c00640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.254+0000 7f4d81200640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c0b4860 0x7f4d7c15d320 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4d700098f0 tx=0x7f4d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.254+0000 7f4d78c00640 1 -- 172.21.15.7:0/3968957071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70037040 con 0x7f4d7c0b4860 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.254+0000 7f4d78c00640 1 -- 172.21.15.7:0/3968957071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d70030770 con 0x7f4d7c0b4860 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.254+0000 7f4d78c00640 1 -- 172.21.15.7:0/3968957071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70030b40 con 0x7f4d7c0b4860 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.254+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c0b9500 con 0x7f4d7c0b4860 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.254+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c0b9ac0 con 0x7f4d7c0b4860 2024-08-19T00:44:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.255+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c0d2c00 con 0x7f4d7c0b4860 2024-08-19T00:44:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.256+0000 7f4d78c00640 1 -- 172.21.15.7:0/3968957071 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d70044020 con 0x7f4d7c0b4860 2024-08-19T00:44:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.257+0000 7f4d78c00640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d5c06be30 0x7f4d5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.257+0000 7f4d78c00640 1 -- 172.21.15.7:0/3968957071 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7f4d700ab7e0 con 0x7f4d7c0b4860 2024-08-19T00:44:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.257+0000 7f4d7be00640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d5c06be30 0x7f4d5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:57.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.258+0000 7f4d7be00640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d5c06be30 0x7f4d5c06e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c161550 tx=0x7f4d68009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:57.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.261+0000 7f4d78c00640 1 -- 172.21.15.7:0/3968957071 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4d70032e20 con 0x7f4d7c0b4860 2024-08-19T00:44:57.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:57.483+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4d7c0d0350 con 0x7f4d7c0b4860 2024-08-19T00:44:58.025 INFO:tasks.ceph.mds.c.smithi007.stderr: -52> 2024-08-19T00:44:53.269+0000 7ff147400640 -1 log_channel(cluster) log [ERR] : dir 0x100 object missing on disk; some files may be lost (~mds0) 2024-08-19T00:44:58.025 INFO:tasks.ceph.mds.c.smithi007.stderr: -17> 2024-08-19T00:44:57.234+0000 7ff14c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:44:58.066 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:44:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.294+0000 7f4d78c00640 1 -- 172.21.15.7:0/3968957071 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v151) ==== 161+0+0 (secure 0 0 0) 0x7f4d70079dd0 con 0x7f4d7c0b4860 2024-08-19T00:44:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d5c06be30 msgr2=0x7f4d5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d5c06be30 0x7f4d5c06e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c161550 tx=0x7f4d68009040 comp rx=0 tx=0).stop 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c0b4860 msgr2=0x7f4d7c15d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c0b4860 0x7f4d7c15d320 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4d700098f0 tx=0x7f4d700046c0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 shutdown_connections 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4d5c06be30 0x7f4d5c06e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c15e3e0 0x7f4d7c0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d7c0d27b0 0x7f4d7c0b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 --2- 172.21.15.7:0/3968957071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c0b4860 0x7f4d7c15d320 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 >> 172.21.15.7:0/3968957071 conn(0x7f4d7c08dbe0 msgr2=0x7f4d7c0b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 shutdown_connections 2024-08-19T00:44:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.297+0000 7f4d82600640 1 -- 172.21.15.7:0/3968957071 wait complete. 2024-08-19T00:44:58.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:44:58.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.479+0000 7fd96fe00640 1 Processor -- start 2024-08-19T00:44:58.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.479+0000 7fd96fe00640 1 -- start start 2024-08-19T00:44:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.480+0000 7fd96fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9700d28c0 0x7fd9701441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.480+0000 7fd96fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9700b4610 0x7fd9701419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.480+0000 7fd96fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd970161f80 con 0x7fd9701439c0 2024-08-19T00:44:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.480+0000 7fd96fe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd970161d30 con 0x7fd9700b4610 2024-08-19T00:44:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.480+0000 7fd96fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd970162b90 con 0x7fd9700d28c0 2024-08-19T00:44:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9700b4610 0x7fd9701419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:58.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9700b4610 0x7fd9701419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40882/0 (socket says 172.21.15.7:40882) 2024-08-19T00:44:58.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96f400640 1 -- 172.21.15.7:0/1020392640 learned_addr learned my addr 172.21.15.7:0/1020392640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:58.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96ea00640 1 --2- 172.21.15.7:0/1020392640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9700d28c0 0x7fd9701441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:58.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96f400640 1 -- 172.21.15.7:0/1020392640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9700d28c0 msgr2=0x7fd9701441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:58.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96f400640 1 --2- 172.21.15.7:0/1020392640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9700d28c0 0x7fd9701441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96f400640 1 -- 172.21.15.7:0/1020392640 >> v1:172.21.15.162:6789/0 conn(0x7fd9701439c0 legacy=0x7fd9700b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:58.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.481+0000 7fd96f400640 1 -- 172.21.15.7:0/1020392640 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd970162260 con 0x7fd9700b4610 2024-08-19T00:44:58.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.482+0000 7fd96f400640 1 --2- 172.21.15.7:0/1020392640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700b4610 0x7fd9701419e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd968009e50 tx=0x7fd96802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2829447b39f9690c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.482+0000 7fd96d600640 1 -- 172.21.15.7:0/1020392640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968036070 con 0x7fd9700b4610 2024-08-19T00:44:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.482+0000 7fd96d600640 1 -- 172.21.15.7:0/1020392640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd968031600 con 0x7fd9700b4610 2024-08-19T00:44:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.482+0000 7fd96d600640 1 -- 172.21.15.7:0/1020392640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680319d0 con 0x7fd9700b4610 2024-08-19T00:44:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 -- 172.21.15.7:0/1020392640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700b4610 msgr2=0x7fd9701419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 --2- 172.21.15.7:0/1020392640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700b4610 0x7fd9701419e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd968009e50 tx=0x7fd96802a710 comp rx=0 tx=0).stop 2024-08-19T00:44:58.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 -- 172.21.15.7:0/1020392640 shutdown_connections 2024-08-19T00:44:58.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 --2- 172.21.15.7:0/1020392640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700b4610 0x7fd9701419e0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 --2- 172.21.15.7:0/1020392640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9700d28c0 0x7fd9701441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 -- 172.21.15.7:0/1020392640 >> 172.21.15.7:0/1020392640 conn(0x7fd970062540 msgr2=0x7fd970062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:58.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 -- 172.21.15.7:0/1020392640 shutdown_connections 2024-08-19T00:44:58.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.483+0000 7fd96fe00640 1 -- 172.21.15.7:0/1020392640 wait complete. 2024-08-19T00:44:58.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.485+0000 7fd96fe00640 1 Processor -- start 2024-08-19T00:44:58.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.485+0000 7fd96fe00640 1 -- start start 2024-08-19T00:44:58.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9700b4610 0x7fd970146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:58.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700d28c0 0x7fd97013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:58.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9701439c0 0x7fd97015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:58.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd970144720 con 0x7fd9700d28c0 2024-08-19T00:44:58.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd970162820 con 0x7fd9700b4610 2024-08-19T00:44:58.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd9700d2ca0 con 0x7fd9701439c0 2024-08-19T00:44:58.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700d28c0 0x7fd97013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700d28c0 0x7fd97013fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40886/0 (socket says 172.21.15.7:40886) 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96e000640 1 -- 172.21.15.7:0/3773204430 learned_addr learned my addr 172.21.15.7:0/3773204430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96ea00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9700b4610 0x7fd970146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96e000640 1 -- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9701439c0 msgr2=0x7fd97015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.486+0000 7fd96f400640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9701439c0 0x7fd97015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96e000640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9701439c0 0x7fd97015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96e000640 1 -- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9700b4610 msgr2=0x7fd970146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96e000640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9700b4610 0x7fd970146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:58.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96e000640 1 -- 172.21.15.7:0/3773204430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9701471a0 con 0x7fd9700d28c0 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96ea00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9700b4610 0x7fd970146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96f400640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9701439c0 0x7fd97015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96e000640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700d28c0 0x7fd97013fd40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c370 tx=0x7fd95c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd966a00640 1 -- 172.21.15.7:0/3773204430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0052d0 con 0x7fd9700d28c0 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd966a00640 1 -- 172.21.15.7:0/3773204430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95c005470 con 0x7fd9700d28c0 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd970147480 con 0x7fd9700d28c0 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd966a00640 1 -- 172.21.15.7:0/3773204430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c007260 con 0x7fd9700d28c0 2024-08-19T00:44:58.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.487+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd970147a40 con 0x7fd9700d28c0 2024-08-19T00:44:58.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.488+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9701441e0 con 0x7fd9700d28c0 2024-08-19T00:44:58.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.489+0000 7fd966a00640 1 -- 172.21.15.7:0/3773204430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd95c007400 con 0x7fd9700d28c0 2024-08-19T00:44:58.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.490+0000 7fd966a00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd95006be30 0x7fd95006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:58.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.491+0000 7fd966a00640 1 -- 172.21.15.7:0/3773204430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7fd95c08a6e0 con 0x7fd9700d28c0 2024-08-19T00:44:58.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.491+0000 7fd96ea00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd95006be30 0x7fd95006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:58.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.491+0000 7fd96ea00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd95006be30 0x7fd95006e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd960009ac0 tx=0x7fd960008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:58.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.495+0000 7fd966a00640 1 -- 172.21.15.7:0/3773204430 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd95c058cd0 con 0x7fd9700d28c0 2024-08-19T00:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:58.752+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fd970147c80 con 0x7fd9700d28c0 2024-08-19T00:44:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.295+0000 7fd966a00640 1 -- 172.21.15.7:0/3773204430 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v152) ==== 101+0+0 (secure 0 0 0) 0x7fd95c0585d0 con 0x7fd9700d28c0 2024-08-19T00:44:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:44:59.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd95006be30 msgr2=0x7fd95006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd95006be30 0x7fd95006e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd960009ac0 tx=0x7fd960008040 comp rx=0 tx=0).stop 2024-08-19T00:44:59.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700d28c0 msgr2=0x7fd97013fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700d28c0 0x7fd97013fd40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c370 tx=0x7fd95c00c830 comp rx=0 tx=0).stop 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 shutdown_connections 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd95006be30 0x7fd95006e2f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9701439c0 0x7fd97015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9700d28c0 0x7fd97013fd40 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 --2- 172.21.15.7:0/3773204430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9700b4610 0x7fd970146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.298+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 >> 172.21.15.7:0/3773204430 conn(0x7fd970062540 msgr2=0x7fd9700b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.299+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 shutdown_connections 2024-08-19T00:44:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.299+0000 7fd96fe00640 1 -- 172.21.15.7:0/3773204430 wait complete. 2024-08-19T00:44:59.320 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:44:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.396+0000 7f05a7731f40 1 Processor -- start 2024-08-19T00:44:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.396+0000 7f05a7731f40 1 -- start start 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a7731f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1161475b0 0x55d1161edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a7731f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d116147990 0x55d1161e5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a7731f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d11615f8d0 0x55d116114ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a7731f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1161ecdc0 con 0x55d11615f8d0 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a7731f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d1160bbd00 con 0x55d1161475b0 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a7731f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d1161ed0a0 con 0x55d116147990 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d11615f8d0 0x55d116114ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d11615f8d0 0x55d116114ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40910/0 (socket says 172.21.15.7:40910) 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.397+0000 7f05a5400640 1 -- 172.21.15.7:0/3376227236 learned_addr learned my addr 172.21.15.7:0/3376227236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f059fe00640 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d116147990 0x55d1161e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1161475b0 0x55d1161edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a5400640 1 -- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d116147990 msgr2=0x55d1161e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a5400640 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d116147990 0x55d1161e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a5400640 1 -- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1161475b0 msgr2=0x55d1161edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a5400640 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1161475b0 0x55d1161edcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a5400640 1 -- 172.21.15.7:0/3376227236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d116040b30 con 0x55d11615f8d0 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f059fe00640 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d116147990 0x55d1161e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1161475b0 0x55d1161edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f05a5400640 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d11615f8d0 0x55d116114ef0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f05a00015c0 tx=0x7f05a0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b88eb0765fe84e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f059ea00640 1 -- 172.21.15.7:0/3376227236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0003650 con 0x55d11615f8d0 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f059ea00640 1 -- 172.21.15.7:0/3376227236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a00037f0 con 0x55d11615f8d0 2024-08-19T00:44:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.398+0000 7f059ea00640 1 -- 172.21.15.7:0/3376227236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0003c20 con 0x55d11615f8d0 2024-08-19T00:44:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 -- 172.21.15.7:0/3376227236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d11615f8d0 msgr2=0x55d116114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d11615f8d0 0x55d116114ef0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f05a00015c0 tx=0x7f05a0001a80 comp rx=0 tx=0).stop 2024-08-19T00:44:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 -- 172.21.15.7:0/3376227236 shutdown_connections 2024-08-19T00:44:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d11615f8d0 0x55d116114ef0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d116147990 0x55d1161e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3376227236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1161475b0 0x55d1161edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 -- 172.21.15.7:0/3376227236 >> 172.21.15.7:0/3376227236 conn(0x55d1161444e0 msgr2=0x55d116146b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 -- 172.21.15.7:0/3376227236 shutdown_connections 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.399+0000 7f05a7731f40 1 -- 172.21.15.7:0/3376227236 wait complete. 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 Processor -- start 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 -- start start 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d1161475b0 0x55d1161e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d116147990 0x55d1161d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d11615f8d0 0x55d1161ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1161422d0 con 0x55d116147990 2024-08-19T00:44:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d1161ee200 con 0x55d11615f8d0 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.400+0000 7f05a7731f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d1161425b0 con 0x55d1161475b0 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d116147990 0x55d1161d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d116147990 0x55d1161d06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40924/0 (socket says 172.21.15.7:40924) 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 learned_addr learned my addr 172.21.15.7:0/3586454938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d1161475b0 0x55d1161e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f05a5400640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d11615f8d0 0x55d1161ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d1161475b0 msgr2=0x55d1161e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d1161475b0 0x55d1161e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d11615f8d0 msgr2=0x55d1161ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d11615f8d0 0x55d1161ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.401+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d11607d080 con 0x55d116147990 2024-08-19T00:44:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.402+0000 7f059fe00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d116147990 0x55d1161d06c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f059000be70 tx=0x7f059000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.402+0000 7f059d600640 1 -- 172.21.15.7:0/3586454938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590007b80 con 0x55d116147990 2024-08-19T00:44:59.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.402+0000 7f059d600640 1 -- 172.21.15.7:0/3586454938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0590007d20 con 0x55d116147990 2024-08-19T00:44:59.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.402+0000 7f059d600640 1 -- 172.21.15.7:0/3586454938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590015660 con 0x55d116147990 2024-08-19T00:44:59.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.402+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d11615e1b0 con 0x55d116147990 2024-08-19T00:44:59.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.402+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1161ebab0 con 0x55d116147990 2024-08-19T00:44:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.404+0000 7f059d600640 1 -- 172.21.15.7:0/3586454938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f059001e440 con 0x55d116147990 2024-08-19T00:44:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.405+0000 7f059d600640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f058406a810 0x7f058406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.405+0000 7f059d600640 1 -- 172.21.15.7:0/3586454938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7f0590089630 con 0x55d116147990 2024-08-19T00:44:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.405+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f058406a810 0x7f058406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.409 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:44:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.405+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d116157750 0x55d116157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.405+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116158070 con 0x55d116157750 2024-08-19T00:44:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.406+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f058406a810 0x7f058406ccd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0598057000 tx=0x7f0598052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.406+0000 7f05a5400640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d116157750 0x55d116157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.406+0000 7f05a5400640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d116157750 0x55d116157b30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.408+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v97'319 uv293 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.408+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d116158440 con 0x55d116157750 2024-08-19T00:44:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.410+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v97'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.410+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628e970 con 0x55d116157750 2024-08-19T00:44:59.414 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:44:59.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.411+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v97'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.411+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628fd20 con 0x55d116157750 2024-08-19T00:44:59.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.413+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v97'322 uv322 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.413+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162900c0 con 0x55d116157750 2024-08-19T00:44:59.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.414+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v97'323 uv323 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.414+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628ed10 con 0x55d116157750 2024-08-19T00:44:59.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.416+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v97'324 uv324 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.416+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f100 con 0x55d116157750 2024-08-19T00:44:59.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.418+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v97'325 uv299 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.418+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f100 con 0x55d116157750 2024-08-19T00:44:59.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.419+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v97'326 uv326 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.419+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.423 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:44:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.421+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v97'327 uv327 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.421+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.422+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v97'328 uv328 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.422+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.426+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v97'329 uv329 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.426+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.428+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v97'330 uv330 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.428+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.430+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v97'331 uv306 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.430+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.431+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v97'332 uv332 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.431+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.435 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:44:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.433+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v97'333 uv333 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.433+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.434+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v97'334 uv334 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.434+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.436+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v97'335 uv335 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.436+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.437+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v97'336 uv336 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.437+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.438+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v97'337 uv337 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.438+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.440+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v97'338 uv312 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.440+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.441+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v97'339 uv339 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.441+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.445 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:44:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.443+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v97'340 uv340 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.443+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.444+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v97'341 uv341 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.444+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.445+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v97'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.445+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.447+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v97'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.447+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.448+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v97'344 uv318 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.448+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.449+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v97'345 uv345 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.449+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.453 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:44:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.451+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v97'346 uv346 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.451+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.452+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v97'347 uv347 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.452+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.453+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v97'348 uv348 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.453+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116157750 2024-08-19T00:44:59.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.455+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v97'349 uv349 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.455+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d116290460 0x55d116292850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.455+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11628f0b0 con 0x55d116290460 2024-08-19T00:44:59.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.455+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d116290460 0x55d116292850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.455+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d116290460 0x55d116292850 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.457+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v97'241 uv223 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.457+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d116292d90 con 0x55d116290460 2024-08-19T00:44:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.458+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v97'242 uv242 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.458+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116293130 con 0x55d116290460 2024-08-19T00:44:59.462 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:44:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.460+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v97'243 uv243 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.460+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116293980 con 0x55d116290460 2024-08-19T00:44:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.462+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v97'244 uv244 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.462+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116293d20 con 0x55d116290460 2024-08-19T00:44:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.463+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v97'245 uv245 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.463+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162940c0 con 0x55d116290460 2024-08-19T00:44:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.464+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v97'246 uv228 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.464+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d116294460 con 0x55d116290460 2024-08-19T00:44:59.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.466+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v97'247 uv247 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.466+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.469 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:44:59.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.467+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v97'248 uv248 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.467+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.469+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v97'249 uv249 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.469+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.470+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v97'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.470+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.471+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v97'251 uv233 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.471+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.473+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v97'252 uv252 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.473+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.476 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:44:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.474+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v97'253 uv253 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.474+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116298ef0 con 0x55d116290460 2024-08-19T00:44:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.476+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v97'254 uv254 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.476+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116298ef0 con 0x55d116290460 2024-08-19T00:44:59.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.477+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v97'255 uv255 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.477+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.479+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v97'256 uv239 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.479+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.480+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v97'257 uv257 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.480+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.484 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:44:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.482+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v97'258 uv258 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.482+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116295810 con 0x55d116290460 2024-08-19T00:44:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.483+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v97'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.483+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116295810 con 0x55d116290460 2024-08-19T00:44:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.485+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v97'260 uv260 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.485+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116294800 con 0x55d116290460 2024-08-19T00:44:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.486+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v97'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d116290460 2024-08-19T00:44:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.486+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d116294d10 0x55d116297100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.487+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116297640 con 0x55d116294d10 2024-08-19T00:44:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.487+0000 7f059fe00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d116294d10 0x55d116297100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.487+0000 7f059fe00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d116294d10 0x55d116297100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.489+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v97'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.489+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d116297af0 con 0x55d116294d10 2024-08-19T00:44:59.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.490+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v97'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.490+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116297fd0 con 0x55d116294d10 2024-08-19T00:44:59.494 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:44:59.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.491+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v97'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.491+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116299880 con 0x55d116294d10 2024-08-19T00:44:59.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.493+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v97'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.493+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116299c20 con 0x55d116294d10 2024-08-19T00:44:59.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.494+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v97'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.494+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116298870 con 0x55d116294d10 2024-08-19T00:44:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.495+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v97'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.495+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116298c60 con 0x55d116157750 2024-08-19T00:44:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.497+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v97'50 uv49 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.497+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d116298c60 con 0x55d116157750 2024-08-19T00:44:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.499+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v97'51 uv51 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.499+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116298c60 con 0x55d116157750 2024-08-19T00:44:59.502 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:44:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.500+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v97'52 uv52 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.500+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d116298c60 con 0x55d116157750 2024-08-19T00:44:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.501+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v97'53 uv53 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.501+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d116299fc0 0x55d11629c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.502+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629c8f0 con 0x55d116299fc0 2024-08-19T00:44:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.502+0000 7f05a5400640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d116299fc0 0x55d11629c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.503+0000 7f05a5400640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d116299fc0 0x55d11629c3b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.504+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v97'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.504+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d11629c8f0 con 0x55d116299fc0 2024-08-19T00:44:59.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.505+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v97'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.505+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629c8f0 con 0x55d116299fc0 2024-08-19T00:44:59.509 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:44:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.506+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v97'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.506+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629d900 con 0x55d116299fc0 2024-08-19T00:44:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.507+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v97'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.507+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629d900 con 0x55d116299fc0 2024-08-19T00:44:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.509+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v97'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.509+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629c8f0 con 0x55d116299fc0 2024-08-19T00:44:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.511+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v97'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.511+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d11629ce00 0x55d11629f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.511+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629f860 con 0x55d11629ce00 2024-08-19T00:44:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.511+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d11629ce00 0x55d11629f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.511+0000 7f05a4a00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d11629ce00 0x55d11629f1f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.513+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v97'116 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.513+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d11629f940 con 0x55d11629ce00 2024-08-19T00:44:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.514+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v97'117 uv117 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.514+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629fd60 con 0x55d11629ce00 2024-08-19T00:44:59.518 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:44:59.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.516+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v97'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.516+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a0d70 con 0x55d11629ce00 2024-08-19T00:44:59.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.517+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v97'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.517+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a0d70 con 0x55d11629ce00 2024-08-19T00:44:59.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.518+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v97'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.518+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629fd60 con 0x55d11629ce00 2024-08-19T00:44:59.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.520+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v97'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.520+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629fd60 con 0x55d11629ce00 2024-08-19T00:44:59.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.521+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v97'122 uv115 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.521+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d11629fd60 con 0x55d11629ce00 2024-08-19T00:44:59.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.522+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v97'123 uv123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.522+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629fd60 con 0x55d11629ce00 2024-08-19T00:44:59.525 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:44:59.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.523+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v97'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.523+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629fd60 con 0x55d11629ce00 2024-08-19T00:44:59.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.525+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v97'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.525+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d11629fd60 con 0x55d11629ce00 2024-08-19T00:44:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.526+0000 7f05a4a00640 1 -- 172.21.15.7:0/3586454938 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v97'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0598068070 con 0x55d11629ce00 2024-08-19T00:44:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.526+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d1162a03e0 0x55d1162a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.526+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a2e60 con 0x55d1162a03e0 2024-08-19T00:44:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.526+0000 7f059fe00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d1162a03e0 0x55d1162a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.527+0000 7f059fe00640 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d1162a03e0 0x55d1162a27d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.528+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v97'51 uv50 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.528+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a2e60 con 0x55d1162a03e0 2024-08-19T00:44:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.529+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v97'52 uv52 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.529+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d1162a03e0 2024-08-19T00:44:59.533 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:44:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.530+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v97'53 uv53 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.531+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d1162a03e0 2024-08-19T00:44:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.532+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v97'54 uv54 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.532+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d1162a03e0 2024-08-19T00:44:59.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.533+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v97'55 uv55 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.533+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116157750 2024-08-19T00:44:59.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.535+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v97'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.535+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116157750 2024-08-19T00:44:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.536+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v97'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.536+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116157750 2024-08-19T00:44:59.540 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:44:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.537+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v97'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.537+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a42c0 con 0x55d116157750 2024-08-19T00:44:59.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.539+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v97'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.539+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a42c0 con 0x55d116157750 2024-08-19T00:44:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.540+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v97'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.540+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116157750 2024-08-19T00:44:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.542+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v97'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116157750 2024-08-19T00:44:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.542+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116294d10 2024-08-19T00:44:59.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.544+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v97'104 uv97 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.544+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116294d10 2024-08-19T00:44:59.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.545+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v97'105 uv105 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.545+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116294d10 2024-08-19T00:44:59.549 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:44:59.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.546+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v97'106 uv106 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.546+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116294d10 2024-08-19T00:44:59.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.549+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v97'107 uv107 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.549+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116294d10 2024-08-19T00:44:59.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.549+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v97'108 uv108 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.549+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116294d10 2024-08-19T00:44:59.553 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:44:59.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.551+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v97'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.551+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a32b0 con 0x55d116294d10 2024-08-19T00:44:59.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.552+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [omap-set-header] v97'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.552+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a60c0 con 0x55d116294d10 2024-08-19T00:44:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.554+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v97'111 uv111 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d116294d10 2024-08-19T00:44:59.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.554+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:99 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.555+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(99 mds0_sessionmap [create] v97'49 uv47 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.555+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:100 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.557+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(100 mds0_sessionmap [delete] v97'50 uv50 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.557+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.561 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:44:59.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.559+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(101 mds0_sessionmap [create] v97'51 uv51 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.559+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.561+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v97'52 uv52 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.561+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.562+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(103 609.00000000 [create] v97'63 uv62 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.562+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.563+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(104 609.00000000 [delete] v97'64 uv64 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.563+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.567 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:44:59.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.565+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(105 609.00000000 [create] v97'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.565+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a4770 con 0x55d116299fc0 2024-08-19T00:44:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.566+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v97'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.566+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a4770 con 0x55d116299fc0 2024-08-19T00:44:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.568+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v97'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.568+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d116299fc0 2024-08-19T00:44:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.569+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(108 609.00000000 [omap-set-header] v97'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f05a000f030 con 0x55d116299fc0 2024-08-19T00:44:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.569+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.571+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v97'52 uv51 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.571+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.572+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v97'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.572+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.573+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v97'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.576 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:44:59.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.573+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.574+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v97'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.575+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.576+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v97'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.576+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.577+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v97'132 uv123 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.577+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.579+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v97'133 uv133 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.579+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.580+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v97'134 uv134 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.583 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:44:59.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.580+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.581+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v97'135 uv135 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.581+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.582+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v97'136 uv136 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.582+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.583+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v97'137 uv130 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.584+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.585+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v97'138 uv138 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.585+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.586+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v97'139 uv139 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.589 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:44:59.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.586+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.587+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v97'140 uv140 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.587+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.589+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v97'141 uv141 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.589+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3760 con 0x55d1162a03e0 2024-08-19T00:44:59.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.590+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v97'142 uv142 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.590+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) -- 0x55d1162a3fe0 con 0x55d1162a03e0 2024-08-19T00:44:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f059fe00640 1 -- 172.21.15.7:0/3586454938 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v97'143 uv143 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f059001b020 con 0x55d1162a03e0 2024-08-19T00:44:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d116290460 msgr2=0x55d116292850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d116290460 0x55d116292850 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d11629ce00 msgr2=0x55d11629f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55d11629ce00 0x55d11629f1f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d1162a03e0 msgr2=0x55d1162a27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55d1162a03e0 0x55d1162a27d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d116294d10 msgr2=0x55d116297100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55d116294d10 0x55d116297100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d116157750 msgr2=0x55d116157b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a5400640 1 -- 172.21.15.7:0/3586454938 reap_dead start 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d116157750 0x55d116157b30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d116299fc0 msgr2=0x55d11629c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.591+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d116299fc0 0x55d11629c3b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f058406a810 msgr2=0x7f058406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f058406a810 0x7f058406ccd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0598057000 tx=0x7f0598052000 comp rx=0 tx=0).stop 2024-08-19T00:44:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d116147990 msgr2=0x55d1161d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d116147990 0x55d1161d06c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f059000be70 tx=0x7f059000bf60 comp rx=0 tx=0).stop 2024-08-19T00:44:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 shutdown_connections 2024-08-19T00:44:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d116157750 0x55d116157b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f058406a810 0x7f058406ccd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55d116299fc0 0x55d11629c3b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 --2- 172.21.15.7:0/3586454938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d116147990 0x55d1161d06c0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 >> 172.21.15.7:0/3586454938 conn(0x55d1161444e0 msgr2=0x55d116142960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:59.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 shutdown_connections 2024-08-19T00:44:59.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.592+0000 7f05a7731f40 1 -- 172.21.15.7:0/3586454938 wait complete. 2024-08-19T00:44:59.600 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_sessionmap 2024-08-19T00:44:59.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 Processor -- start 2024-08-19T00:44:59.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 -- start start 2024-08-19T00:44:59.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7e650 0x56298ef1c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 0x56298ef1cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7f990 0x56298ee7a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56298edf3d00 con 0x56298ee7e650 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56298edf7d40 con 0x56298ee7f990 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.714+0000 7feb052b1f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56298ef24dc0 con 0x56298ee7f5b0 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7e650 0x56298ef1c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7e650 0x56298ef1c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40938/0 (socket says 172.21.15.7:40938) 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 -- 172.21.15.7:0/1091166900 learned_addr learned my addr 172.21.15.7:0/1091166900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02e00640 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7f990 0x56298ee7a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb01a00640 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 0x56298ef1cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 -- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 msgr2=0x56298ef1cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 0x56298ef1cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 -- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7f990 msgr2=0x56298ee7a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7f990 0x56298ee7a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 -- 172.21.15.7:0/1091166900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298edb5080 con 0x56298ee7e650 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.715+0000 7feb02400640 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7e650 0x56298ef1c750 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7feaf4001e00 tx=0x7feaf400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fa6ea37904591a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feafbe00640 1 -- 172.21.15.7:0/1091166900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf400be40 con 0x56298ee7e650 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feafbe00640 1 -- 172.21.15.7:0/1091166900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf400f400 con 0x56298ee7e650 2024-08-19T00:44:59.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feafbe00640 1 -- 172.21.15.7:0/1091166900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf400f7d0 con 0x56298ee7e650 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 -- 172.21.15.7:0/1091166900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7e650 msgr2=0x56298ef1c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7e650 0x56298ef1c750 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7feaf4001e00 tx=0x7feaf400b670 comp rx=0 tx=0).stop 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 -- 172.21.15.7:0/1091166900 shutdown_connections 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7f990 0x56298ee7a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 0x56298ef1cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 --2- 172.21.15.7:0/1091166900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7e650 0x56298ef1c750 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 -- 172.21.15.7:0/1091166900 >> 172.21.15.7:0/1091166900 conn(0x56298ee7c4e0 msgr2=0x56298ee4c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 -- 172.21.15.7:0/1091166900 shutdown_connections 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.716+0000 7feb052b1f40 1 -- 172.21.15.7:0/1091166900 wait complete. 2024-08-19T00:44:59.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.717+0000 7feb052b1f40 1 Processor -- start 2024-08-19T00:44:59.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.717+0000 7feb052b1f40 1 -- start start 2024-08-19T00:44:59.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb052b1f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7e650 0x56298ef22c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb052b1f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 0x56298ef233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb052b1f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7f990 0x56298ef16830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb052b1f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56298ef25ef0 con 0x56298ee7f990 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb052b1f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56298ef256f0 con 0x56298ee7e650 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb052b1f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56298ee4d710 con 0x56298ee7f5b0 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb02e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7f990 0x56298ef16830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb02e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7f990 0x56298ef16830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40952/0 (socket says 172.21.15.7:40952) 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb01a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 0x56298ef233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb02e00640 1 -- 172.21.15.7:0/2764778425 learned_addr learned my addr 172.21.15.7:0/2764778425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.718+0000 7feb02400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7e650 0x56298ef22c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feb02e00640 1 -- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 msgr2=0x56298ef233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feb02e00640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56298ee7f5b0 0x56298ef233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feb02e00640 1 -- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7e650 msgr2=0x56298ef22c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feb02e00640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56298ee7e650 0x56298ef22c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feb02e00640 1 -- 172.21.15.7:0/2764778425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298ef23920 con 0x56298ee7f990 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feb02e00640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7f990 0x56298ef16830 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7feafc00a3f0 tx=0x7feafc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feafaa00640 1 -- 172.21.15.7:0/2764778425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc056b70 con 0x56298ee7f990 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feafaa00640 1 -- 172.21.15.7:0/2764778425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feafc056d10 con 0x56298ee7f990 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feafaa00640 1 -- 172.21.15.7:0/2764778425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc06b6c0 con 0x56298ee7f990 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.719+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56298ef1fa20 con 0x56298ee7f990 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.720+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298ef1ffe0 con 0x56298ee7f990 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.721+0000 7feafaa00640 1 -- 172.21.15.7:0/2764778425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feafc06b860 con 0x56298ee7f990 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.722+0000 7feafaa00640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feae406a840 0x7feae406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.722+0000 7feafaa00640 1 -- 172.21.15.7:0/2764778425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7feafc0ce900 con 0x56298ee7f990 2024-08-19T00:44:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.722+0000 7feb02400640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feae406a840 0x7feae406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.722+0000 7feb052b1f40 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56298ef21a50 0x56298ef21e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.722+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:1 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) -- 0x56298ef223a0 con 0x56298ef21a50 2024-08-19T00:44:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.723+0000 7feb01a00640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56298ef21a50 0x56298ef21e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.723+0000 7feb02400640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feae406a840 0x7feae406cd00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7feaf4000c00 tx=0x7feaf4009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.723+0000 7feb01a00640 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56298ef21a50 0x56298ef21e60 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb01a00640 1 -- 172.21.15.7:0/2764778425 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(1 mds0_sessionmap [delete] v97'53 uv53 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7feaf0010700 con 0x56298ef21a50 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56298ef21a50 msgr2=0x56298ef21e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56298ef21a50 0x56298ef21e60 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feae406a840 msgr2=0x7feae406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feae406a840 0x7feae406cd00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7feaf4000c00 tx=0x7feaf4009000 comp rx=0 tx=0).stop 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7f990 msgr2=0x56298ef16830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 --2- 172.21.15.7:0/2764778425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56298ee7f990 0x56298ef16830 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7feafc00a3f0 tx=0x7feafc003330 comp rx=0 tx=0).stop 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb02e00640 1 -- 172.21.15.7:0/2764778425 reap_dead start 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 shutdown_connections 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 >> 172.21.15.7:0/2764778425 conn(0x56298ee7c4e0 msgr2=0x56298ef1ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 shutdown_connections 2024-08-19T00:44:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.725+0000 7feb052b1f40 1 -- 172.21.15.7:0/2764778425 wait complete. 2024-08-19T00:44:59.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:44:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.889+0000 7f9c20c00640 1 Processor -- start 2024-08-19T00:44:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.890+0000 7f9c20c00640 1 -- start start 2024-08-19T00:44:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c20c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9c1c158cd0 0x7f9c1c072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c20c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c20c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1c0aeae0 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c20c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1c073460 con 0x7f9c1c158cd0 2024-08-19T00:44:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c20c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c0aedc0 con 0x7f9c1c072ff0 2024-08-19T00:44:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c1a800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9c1c0ae2b0 0x7f9c1c15ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:51836/0 (socket says 172.21.15.7:51836) 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c1a800640 1 -- 172.21.15.7:0/74698788 learned_addr learned my addr 172.21.15.7:0/74698788 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c19e00640 1 --2- 172.21.15.7:0/74698788 >> v2:172.21.15.162:3300/0 conn(0x7f9c1c158cd0 0x7f9c1c072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.891+0000 7f9c13e00640 1 --2- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.892+0000 7f9c19400640 1 -- 172.21.15.7:0/74698788 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268644336 0 0) 0x7f9c1c0aeae0 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.892+0000 7f9c19400640 1 -- 172.21.15.7:0/74698788 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c00003520 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.892+0000 7f9c19e00640 1 -- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 msgr2=0x7f9c1c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.892+0000 7f9c19e00640 1 --2- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c0add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.892+0000 7f9c19e00640 1 -- 172.21.15.7:0/74698788 >> v1:172.21.15.7:6789/0 conn(0x7f9c1c0ae2b0 legacy=0x7f9c1c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.892+0000 7f9c19e00640 1 -- 172.21.15.7:0/74698788 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c0af0a0 con 0x7f9c1c158cd0 2024-08-19T00:44:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.893+0000 7f9c19e00640 1 --2- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c158cd0 0x7f9c1c072ab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9b2d58d9127354 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.893+0000 7f9c19400640 1 -- 172.21.15.7:0/74698788 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c037070 con 0x7f9c1c158cd0 2024-08-19T00:44:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.893+0000 7f9c19400640 1 -- 172.21.15.7:0/74698788 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c02adb0 con 0x7f9c1c158cd0 2024-08-19T00:44:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.893+0000 7f9c19400640 1 -- 172.21.15.7:0/74698788 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c032660 con 0x7f9c1c158cd0 2024-08-19T00:44:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.893+0000 7f9c20c00640 1 -- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c158cd0 msgr2=0x7f9c1c072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.893+0000 7f9c20c00640 1 --2- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c158cd0 0x7f9c1c072ab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a060 comp rx=0 tx=0).stop 2024-08-19T00:44:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.894+0000 7f9c20c00640 1 -- 172.21.15.7:0/74698788 shutdown_connections 2024-08-19T00:44:59.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.894+0000 7f9c20c00640 1 --2- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c0add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.894+0000 7f9c20c00640 1 --2- 172.21.15.7:0/74698788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c158cd0 0x7f9c1c072ab0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.894+0000 7f9c20c00640 1 -- 172.21.15.7:0/74698788 >> 172.21.15.7:0/74698788 conn(0x7f9c1c0b2300 msgr2=0x7f9c1c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:44:59.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.894+0000 7f9c20c00640 1 -- 172.21.15.7:0/74698788 shutdown_connections 2024-08-19T00:44:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.894+0000 7f9c20c00640 1 -- 172.21.15.7:0/74698788 wait complete. 2024-08-19T00:44:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.895+0000 7f9c20c00640 1 Processor -- start 2024-08-19T00:44:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.895+0000 7f9c20c00640 1 -- start start 2024-08-19T00:44:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.896+0000 7f9c20c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.896+0000 7f9c20c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c0ae2b0 0x7f9c1c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.896+0000 7f9c20c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c09d410 0x7f9c1c144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.896+0000 7f9c20c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0ae6d0 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.896+0000 7f9c20c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0af660 con 0x7f9c1c09d410 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.896+0000 7f9c20c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c0ae850 con 0x7f9c1c072ff0 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.896+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c0ae2b0 0x7f9c1c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c0ae2b0 0x7f9c1c15cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40958/0 (socket says 172.21.15.7:40958) 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 -- 172.21.15.7:0/420571735 learned_addr learned my addr 172.21.15.7:0/420571735 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c19e00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c1a800640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c09d410 0x7f9c1c144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 -- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 msgr2=0x7f9c1c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 -- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c09d410 msgr2=0x7f9c1c144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c09d410 0x7f9c1c144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:44:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 -- 172.21.15.7:0/420571735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c15d180 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c1a800640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c09d410 0x7f9c1c144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c13e00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c0ae2b0 0x7f9c1c15cc40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400e870 tx=0x7f9c0400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.897+0000 7f9c12000640 1 -- 172.21.15.7:0/420571735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04017070 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.898+0000 7f9c12000640 1 -- 172.21.15.7:0/420571735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0400c940 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.898+0000 7f9c12000640 1 -- 172.21.15.7:0/420571735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400cd30 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.898+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1c157520 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.898+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1c157ae0 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.899+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1c0b4240 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.900+0000 7f9c12000640 1 -- 172.21.15.7:0/420571735 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c0401a070 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.900+0000 7f9c12000640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bf806be60 0x7f9bf806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:44:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.901+0000 7f9c12000640 1 -- 172.21.15.7:0/420571735 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6655+0+0 (secure 0 0 0) 0x7f9c0408b0a0 con 0x7f9c1c0ae2b0 2024-08-19T00:44:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.901+0000 7f9c19e00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bf806be60 0x7f9bf806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:44:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.901+0000 7f9c19e00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bf806be60 0x7f9bf806e320 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c034000 tx=0x7f9c0c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:44:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:44:59.905+0000 7f9c12000640 1 -- 172.21.15.7:0/420571735 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9c1c15d180 con 0x7f9c1c0ae2b0 2024-08-19T00:45:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.126+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f9c1c0cfd30 con 0x7f9c1c0ae2b0 2024-08-19T00:45:00.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.305+0000 7f9c12000640 1 -- 172.21.15.7:0/420571735 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v153) ==== 162+0+0 (secure 0 0 0) 0x7f9c04058fc0 con 0x7f9c1c0ae2b0 2024-08-19T00:45:00.308 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:00.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bf806be60 msgr2=0x7f9bf806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bf806be60 0x7f9bf806e320 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c034000 tx=0x7f9c0c02e000 comp rx=0 tx=0).stop 2024-08-19T00:45:00.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c0ae2b0 msgr2=0x7f9c1c15cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c0ae2b0 0x7f9c1c15cc40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400e870 tx=0x7f9c0400ed30 comp rx=0 tx=0).stop 2024-08-19T00:45:00.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 shutdown_connections 2024-08-19T00:45:00.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bf806be60 0x7f9bf806e320 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c1c09d410 0x7f9c1c144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c0ae2b0 0x7f9c1c15cc40 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 --2- 172.21.15.7:0/420571735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c1c072ff0 0x7f9c1c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 >> 172.21.15.7:0/420571735 conn(0x7f9c1c0b2300 msgr2=0x7f9c1c154850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:00.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 shutdown_connections 2024-08-19T00:45:00.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.307+0000 7f9c20c00640 1 -- 172.21.15.7:0/420571735 wait complete. 2024-08-19T00:45:00.316 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:45:00.314+0000 7f7264600640 -1 mds.0.sessionmap _load_finish got (2) No such file or directory 2024-08-19T00:45:00.316 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:45:00.314+0000 7f7264600640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds0_sessionmap' -2 ((2) No such file or directory) 2024-08-19T00:45:00.317 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:00.315+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:00.318 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:00.315+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:45:00.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:00.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.486+0000 7f6ac8c00640 1 Processor -- start 2024-08-19T00:45:00.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.486+0000 7f6ac8c00640 1 -- start start 2024-08-19T00:45:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac8c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6ac415bd70 0x7f6ac4072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac406dd10 0x7f6ac415cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac8c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40733f0 con 0x7f6ac4072f70 2024-08-19T00:45:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac8c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac40736d0 con 0x7f6ac415bd70 2024-08-19T00:45:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40739b0 con 0x7f6ac406dd10 2024-08-19T00:45:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac2a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6ac4072f70 0x7f6ac406d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:51850/0 (socket says 172.21.15.7:51850) 2024-08-19T00:45:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac2a00640 1 -- 172.21.15.7:0/3899774363 learned_addr learned my addr 172.21.15.7:0/3899774363 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac3e00640 1 --2- 172.21.15.7:0/3899774363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac406dd10 0x7f6ac415cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac3400640 1 --2- 172.21.15.7:0/3899774363 >> v2:172.21.15.162:3300/0 conn(0x7f6ac415bd70 0x7f6ac4072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.487+0000 7f6ac2000640 1 -- 172.21.15.7:0/3899774363 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101186896 0 0) 0x7f6ac40733f0 con 0x7f6ac4072f70 2024-08-19T00:45:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.488+0000 7f6ac2000640 1 -- 172.21.15.7:0/3899774363 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa8003520 con 0x7f6ac4072f70 2024-08-19T00:45:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.488+0000 7f6ac2000640 1 -- 172.21.15.7:0/3899774363 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3246593331 0 0) 0x7f6aa8003520 con 0x7f6ac4072f70 2024-08-19T00:45:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.488+0000 7f6ac3e00640 1 -- 172.21.15.7:0/3899774363 >> v2:172.21.15.162:3300/0 conn(0x7f6ac415bd70 msgr2=0x7f6ac4072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:00.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.488+0000 7f6ac3e00640 1 --2- 172.21.15.7:0/3899774363 >> v2:172.21.15.162:3300/0 conn(0x7f6ac415bd70 0x7f6ac4072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.488+0000 7f6ac3e00640 1 -- 172.21.15.7:0/3899774363 >> v1:172.21.15.7:6789/0 conn(0x7f6ac4072f70 legacy=0x7f6ac406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.488+0000 7f6ac3e00640 1 -- 172.21.15.7:0/3899774363 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac415c4a0 con 0x7f6ac406dd10 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.489+0000 7f6ac3e00640 1 --2- 172.21.15.7:0/3899774363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac406dd10 0x7f6ac415cca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d90 tx=0x7f6abc02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddcc8039c2be32c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.489+0000 7f6ac2000640 1 -- 172.21.15.7:0/3899774363 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0001670 con 0x7f6ac406dd10 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.489+0000 7f6ac2000640 1 -- 172.21.15.7:0/3899774363 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc007540 con 0x7f6ac406dd10 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.489+0000 7f6ac2000640 1 -- 172.21.15.7:0/3899774363 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007910 con 0x7f6ac406dd10 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3899774363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac406dd10 msgr2=0x7f6ac415cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3899774363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac406dd10 0x7f6ac415cca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d90 tx=0x7f6abc02a5f0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3899774363 shutdown_connections 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3899774363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac406dd10 0x7f6ac415cca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3899774363 >> v2:172.21.15.162:3300/0 conn(0x7f6ac415bd70 0x7f6ac4072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3899774363 >> 172.21.15.7:0/3899774363 conn(0x7f6ac406b850 msgr2=0x7f6ac406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3899774363 shutdown_connections 2024-08-19T00:45:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.490+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3899774363 wait complete. 2024-08-19T00:45:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.492+0000 7f6ac8c00640 1 Processor -- start 2024-08-19T00:45:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.492+0000 7f6ac8c00640 1 -- start start 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac406dd10 0x7f6ac414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac4072f70 0x7f6ac4153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac415bd70 0x7f6ac4150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac8c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac406e3a0 con 0x7f6ac415bd70 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac415c150 con 0x7f6ac406dd10 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac406e520 con 0x7f6ac4072f70 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac415bd70 0x7f6ac4150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac415bd70 0x7f6ac4150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40970/0 (socket says 172.21.15.7:40970) 2024-08-19T00:45:00.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac3e00640 1 -- 172.21.15.7:0/3765200719 learned_addr learned my addr 172.21.15.7:0/3765200719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.493+0000 7f6ac2a00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac4072f70 0x7f6ac4153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3400640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac406dd10 0x7f6ac414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3e00640 1 -- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac4072f70 msgr2=0x7f6ac4153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3e00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac4072f70 0x7f6ac4153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3e00640 1 -- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac406dd10 msgr2=0x7f6ac414eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3e00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac406dd10 0x7f6ac414eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3e00640 1 -- 172.21.15.7:0/3765200719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac414fed0 con 0x7f6ac415bd70 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3400640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac406dd10 0x7f6ac414eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac3e00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac415bd70 0x7f6ac4150f60 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d90 tx=0x7f6abc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6abb400640 1 -- 172.21.15.7:0/3765200719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc040070 con 0x7f6ac415bd70 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6abb400640 1 -- 172.21.15.7:0/3765200719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc031b40 con 0x7f6ac415bd70 2024-08-19T00:45:00.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6abb400640 1 -- 172.21.15.7:0/3765200719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007e90 con 0x7f6ac415bd70 2024-08-19T00:45:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac414fbf0 con 0x7f6ac415bd70 2024-08-19T00:45:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.494+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac40adf40 con 0x7f6ac415bd70 2024-08-19T00:45:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.495+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac4072a30 con 0x7f6ac415bd70 2024-08-19T00:45:00.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.496+0000 7f6abb400640 1 -- 172.21.15.7:0/3765200719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6abc039040 con 0x7f6ac415bd70 2024-08-19T00:45:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.497+0000 7f6abb400640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa406be30 0x7f6aa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.497+0000 7f6abb400640 1 -- 172.21.15.7:0/3765200719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f6abc0ac390 con 0x7f6ac415bd70 2024-08-19T00:45:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.497+0000 7f6ac3400640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa406be30 0x7f6aa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.498+0000 7f6ac3400640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa406be30 0x7f6aa406e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009a20 tx=0x7f6ab4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:00.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.502+0000 7f6abb400640 1 -- 172.21.15.7:0/3765200719 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6abc07a810 con 0x7f6ac415bd70 2024-08-19T00:45:00.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.724+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ac415b260 con 0x7f6ac415bd70 2024-08-19T00:45:00.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.725+0000 7f6abb400640 1 -- 172.21.15.7:0/3765200719 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 155 v155) ==== 95+0+4392 (secure 0 0 0) 0x7f6abc07a110 con 0x7f6ac415bd70 2024-08-19T00:45:00.728 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:00.728 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":155,"btime":"2024-08-19T00:45:00:316748+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":155,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:00.316673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:00.728 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 155 2024-08-19T00:45:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa406be30 msgr2=0x7f6aa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa406be30 0x7f6aa406e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009a20 tx=0x7f6ab4008040 comp rx=0 tx=0).stop 2024-08-19T00:45:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac415bd70 msgr2=0x7f6ac4150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac415bd70 0x7f6ac4150f60 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d90 tx=0x7f6abc004a40 comp rx=0 tx=0).stop 2024-08-19T00:45:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 shutdown_connections 2024-08-19T00:45:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6aa406be30 0x7f6aa406e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac415bd70 0x7f6ac4150f60 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ac4072f70 0x7f6ac4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 --2- 172.21.15.7:0/3765200719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac406dd10 0x7f6ac414eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 >> 172.21.15.7:0/3765200719 conn(0x7f6ac406b850 msgr2=0x7f6ac41591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:00.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 shutdown_connections 2024-08-19T00:45:00.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.727+0000 7f6ac8c00640 1 -- 172.21.15.7:0/3765200719 wait complete. 2024-08-19T00:45:00.747 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:00.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:00.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.902+0000 7f3162800640 1 Processor -- start 2024-08-19T00:45:00.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.903+0000 7f3162800640 1 -- start start 2024-08-19T00:45:00.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3162800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f315c0d03c0 0x7f315c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3162800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4380 0x7f315c0b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3162800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c0b50b0 con 0x7f315c15f5b0 2024-08-19T00:45:00.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3162800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f315c15f990 con 0x7f315c0d03c0 2024-08-19T00:45:00.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3162800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0cf120 con 0x7f315c0b4380 2024-08-19T00:45:00.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3153e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f315c0d03c0 0x7f315c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3153e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f315c0d03c0 0x7f315c0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40972/0 (socket says 172.21.15.7:40972) 2024-08-19T00:45:00.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f3153e00640 1 -- 172.21.15.7:0/2797143953 learned_addr learned my addr 172.21.15.7:0/2797143953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:00.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.904+0000 7f315be00640 1 --2- 172.21.15.7:0/2797143953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4380 0x7f315c0b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.905+0000 7f3153e00640 1 -- 172.21.15.7:0/2797143953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4380 msgr2=0x7f315c0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:00.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.905+0000 7f3153e00640 1 --2- 172.21.15.7:0/2797143953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4380 0x7f315c0b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.905+0000 7f3153e00640 1 -- 172.21.15.7:0/2797143953 >> v1:172.21.15.162:6789/0 conn(0x7f315c15f5b0 legacy=0x7f315c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.905+0000 7f3153e00640 1 -- 172.21.15.7:0/2797143953 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c0cead0 con 0x7f315c0d03c0 2024-08-19T00:45:00.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.905+0000 7f315be00640 1 --2- 172.21.15.7:0/2797143953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4380 0x7f315c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:00.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f3153e00640 1 --2- 172.21.15.7:0/2797143953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0d03c0 0x7f315c0d0800 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3144009870 tx=0x7f314402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c13c3581aadd412 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:00.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f315aa00640 1 -- 172.21.15.7:0/2797143953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144037070 con 0x7f315c0d03c0 2024-08-19T00:45:00.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f315aa00640 1 -- 172.21.15.7:0/2797143953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3144032440 con 0x7f315c0d03c0 2024-08-19T00:45:00.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f315aa00640 1 -- 172.21.15.7:0/2797143953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144032810 con 0x7f315c0d03c0 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f3162800640 1 -- 172.21.15.7:0/2797143953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0d03c0 msgr2=0x7f315c0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f3162800640 1 --2- 172.21.15.7:0/2797143953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0d03c0 0x7f315c0d0800 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3144009870 tx=0x7f314402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f3162800640 1 -- 172.21.15.7:0/2797143953 shutdown_connections 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f3162800640 1 --2- 172.21.15.7:0/2797143953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4380 0x7f315c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.906+0000 7f3162800640 1 --2- 172.21.15.7:0/2797143953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0d03c0 0x7f315c0d0800 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.907+0000 7f3162800640 1 -- 172.21.15.7:0/2797143953 >> 172.21.15.7:0/2797143953 conn(0x7f315c06bc70 msgr2=0x7f315c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.907+0000 7f3162800640 1 -- 172.21.15.7:0/2797143953 shutdown_connections 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.907+0000 7f3162800640 1 -- 172.21.15.7:0/2797143953 wait complete. 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.908+0000 7f3162800640 1 Processor -- start 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.908+0000 7f3162800640 1 -- start start 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f3162800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0b4380 0x7f315c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f3162800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c0d03c0 0x7f315c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f3162800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c15f5b0 0x7f315c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f3162800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0b4d30 con 0x7f315c0b4380 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f3162800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0d0d40 con 0x7f315c0d03c0 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f3162800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f315c06e660 con 0x7f315c15f5b0 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f315b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0b4380 0x7f315c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.909+0000 7f315b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0b4380 0x7f315c0ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40978/0 (socket says 172.21.15.7:40978) 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315b400640 1 -- 172.21.15.7:0/4049430021 learned_addr learned my addr 172.21.15.7:0/4049430021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f3153e00640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c0d03c0 0x7f315c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315be00640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c15f5b0 0x7f315c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315b400640 1 -- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c15f5b0 msgr2=0x7f315c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315b400640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c15f5b0 0x7f315c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315b400640 1 -- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c0d03c0 msgr2=0x7f315c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315b400640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c0d03c0 0x7f315c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:00.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315b400640 1 -- 172.21.15.7:0/4049430021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c1595e0 con 0x7f315c0b4380 2024-08-19T00:45:00.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f315b400640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0b4380 0x7f315c0ae7f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c400 tx=0x7f314c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:00.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.910+0000 7f3153400640 1 -- 172.21.15.7:0/4049430021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c017070 con 0x7f315c0b4380 2024-08-19T00:45:00.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.911+0000 7f3153400640 1 -- 172.21.15.7:0/4049430021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314c0052d0 con 0x7f315c0b4380 2024-08-19T00:45:00.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.911+0000 7f3153400640 1 -- 172.21.15.7:0/4049430021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c003830 con 0x7f315c0b4380 2024-08-19T00:45:00.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.911+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c0aeeb0 con 0x7f315c0b4380 2024-08-19T00:45:00.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.911+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c0ad090 con 0x7f315c0b4380 2024-08-19T00:45:00.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.912+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c0ad7a0 con 0x7f315c0b4380 2024-08-19T00:45:00.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.913+0000 7f3153400640 1 -- 172.21.15.7:0/4049430021 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f314c01a070 con 0x7f315c0b4380 2024-08-19T00:45:00.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.913+0000 7f3153400640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f313806be60 0x7f313806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:00.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.914+0000 7f3153400640 1 -- 172.21.15.7:0/4049430021 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f314c08a500 con 0x7f315c0b4380 2024-08-19T00:45:00.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.914+0000 7f3153e00640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f313806be60 0x7f313806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:00.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.915+0000 7f3153e00640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f313806be60 0x7f313806e320 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3144034000 tx=0x7f314402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:00.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:00.918+0000 7f3153400640 1 -- 172.21.15.7:0/4049430021 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f314c058440 con 0x7f315c0b4380 2024-08-19T00:45:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.136+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f315c0b47f0 con 0x7f315c0b4380 2024-08-19T00:45:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.136+0000 7f3153400640 1 -- 172.21.15.7:0/4049430021 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 155 v155) ==== 95+0+4392 (secure 0 0 0) 0x7f314c05c740 con 0x7f315c0b4380 2024-08-19T00:45:01.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:01.139 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":155,"btime":"2024-08-19T00:45:00:316748+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":155,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:00.316673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:01.140 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 155 2024-08-19T00:45:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.138+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f313806be60 msgr2=0x7f313806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.138+0000 7f3162800640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f313806be60 0x7f313806e320 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3144034000 tx=0x7f314402e000 comp rx=0 tx=0).stop 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0b4380 msgr2=0x7f315c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0b4380 0x7f315c0ae7f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c400 tx=0x7f314c00c8c0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 shutdown_connections 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f313806be60 0x7f313806e320 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c15f5b0 0x7f315c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c0d03c0 0x7f315c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 --2- 172.21.15.7:0/4049430021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f315c0b4380 0x7f315c0ae7f0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 >> 172.21.15.7:0/4049430021 conn(0x7f315c06bc70 msgr2=0x7f315c162740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 shutdown_connections 2024-08-19T00:45:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.139+0000 7f3162800640 1 -- 172.21.15.7:0/4049430021 wait complete. 2024-08-19T00:45:01.158 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:01.158 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:01.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.313+0000 7f6596e00640 1 Processor -- start 2024-08-19T00:45:01.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.313+0000 7f6596e00640 1 -- start start 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6596e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f659006e710 0x7f6590071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6596e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65900b3750 0x7f65900cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6596e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65900cdfb0 con 0x7f65900d03c0 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6596e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f65900cebc0 con 0x7f65900b3750 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6596e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65900ce290 con 0x7f659006e710 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6594e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65900b3750 0x7f65900cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6594e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65900b3750 0x7f65900cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40984/0 (socket says 172.21.15.7:40984) 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6594e00640 1 -- 172.21.15.7:0/1585555550 learned_addr learned my addr 172.21.15.7:0/1585555550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:01.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f658fe00640 1 --1- 172.21.15.7:0/1585555550 >> v1:172.21.15.162:6789/0 conn(0x7f65900d03c0 0x7f65900d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:57834/0 (socket says 172.21.15.7:57834) 2024-08-19T00:45:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6587400640 1 --2- 172.21.15.7:0/1585555550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f659006e710 0x7f6590071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6594e00640 1 -- 172.21.15.7:0/1585555550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f659006e710 msgr2=0x7f6590071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6594e00640 1 --2- 172.21.15.7:0/1585555550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f659006e710 0x7f6590071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6594e00640 1 -- 172.21.15.7:0/1585555550 >> v1:172.21.15.162:6789/0 conn(0x7f65900d03c0 legacy=0x7f65900d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.315+0000 7f6594e00640 1 -- 172.21.15.7:0/1585555550 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65900ce570 con 0x7f65900b3750 2024-08-19T00:45:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.316+0000 7f6594e00640 1 --2- 172.21.15.7:0/1585555550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65900cf050 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f6588009e50 tx=0x7f658802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f01a417cd721865 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f658f400640 1 -- 172.21.15.7:0/1585555550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588036070 con 0x7f65900b3750 2024-08-19T00:45:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f658f400640 1 -- 172.21.15.7:0/1585555550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6588031600 con 0x7f65900b3750 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f658f400640 1 -- 172.21.15.7:0/1585555550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65880319d0 con 0x7f65900b3750 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 -- 172.21.15.7:0/1585555550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 msgr2=0x7f65900cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 --2- 172.21.15.7:0/1585555550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65900cf050 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f6588009e50 tx=0x7f658802a730 comp rx=0 tx=0).stop 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 -- 172.21.15.7:0/1585555550 shutdown_connections 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 --2- 172.21.15.7:0/1585555550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65900cf050 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 --2- 172.21.15.7:0/1585555550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f659006e710 0x7f6590071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 -- 172.21.15.7:0/1585555550 >> 172.21.15.7:0/1585555550 conn(0x7f659006bc70 msgr2=0x7f659006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 -- 172.21.15.7:0/1585555550 shutdown_connections 2024-08-19T00:45:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.317+0000 7f6596e00640 1 -- 172.21.15.7:0/1585555550 wait complete. 2024-08-19T00:45:01.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.319+0000 7f6596e00640 1 Processor -- start 2024-08-19T00:45:01.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.319+0000 7f6596e00640 1 -- start start 2024-08-19T00:45:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6596e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f659006e710 0x7f65901f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6596e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65901f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6596e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65900d03c0 0x7f65900b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6596e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6590073c60 con 0x7f65900b3750 2024-08-19T00:45:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6596e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6590073ae0 con 0x7f659006e710 2024-08-19T00:45:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6596e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65900b3be0 con 0x7f65900d03c0 2024-08-19T00:45:01.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6587400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65901f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6587400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65901f3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40992/0 (socket says 172.21.15.7:40992) 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.320+0000 7f6587400640 1 -- 172.21.15.7:0/2038084719 learned_addr learned my addr 172.21.15.7:0/2038084719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f658fe00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f659006e710 0x7f65901f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6594e00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65900d03c0 0x7f65900b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6587400640 1 -- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65900d03c0 msgr2=0x7f65900b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6587400640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65900d03c0 0x7f65900b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6587400640 1 -- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f659006e710 msgr2=0x7f65901f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6587400640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f659006e710 0x7f65901f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6587400640 1 -- 172.21.15.7:0/2038084719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659015da50 con 0x7f65900b3750 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f658fe00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f659006e710 0x7f65901f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:01.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6587400640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65901f3f30 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f657800e870 tx=0x7f657800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f658cc00640 1 -- 172.21.15.7:0/2038084719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578017070 con 0x7f65900b3750 2024-08-19T00:45:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f658cc00640 1 -- 172.21.15.7:0/2038084719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657800c940 con 0x7f65900b3750 2024-08-19T00:45:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659015dd30 con 0x7f65900b3750 2024-08-19T00:45:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.321+0000 7f658cc00640 1 -- 172.21.15.7:0/2038084719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657800cd30 con 0x7f65900b3750 2024-08-19T00:45:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.322+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659015e2f0 con 0x7f65900b3750 2024-08-19T00:45:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.323+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6590068c00 con 0x7f65900b3750 2024-08-19T00:45:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.323+0000 7f658cc00640 1 -- 172.21.15.7:0/2038084719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f657801a070 con 0x7f65900b3750 2024-08-19T00:45:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.324+0000 7f658cc00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be30 0x7f656c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.324+0000 7f658cc00640 1 -- 172.21.15.7:0/2038084719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f657808b350 con 0x7f65900b3750 2024-08-19T00:45:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.324+0000 7f658fe00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be30 0x7f656c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.325+0000 7f658fe00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be30 0x7f656c06e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6580007fd0 tx=0x7f6580007d60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:01.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.329+0000 7f658cc00640 1 -- 172.21.15.7:0/2038084719 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6590068c00 con 0x7f65900b3750 2024-08-19T00:45:01.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.554+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6590073090 con 0x7f65900b3750 2024-08-19T00:45:01.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.555+0000 7f658cc00640 1 -- 172.21.15.7:0/2038084719 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 155 v155) ==== 95+0+4392 (secure 0 0 0) 0x7f6578059330 con 0x7f65900b3750 2024-08-19T00:45:01.558 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:01.558 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":155,"btime":"2024-08-19T00:45:00:316748+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":155,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:00.316673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 155 2024-08-19T00:45:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be30 msgr2=0x7f656c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be30 0x7f656c06e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6580007fd0 tx=0x7f6580007d60 comp rx=0 tx=0).stop 2024-08-19T00:45:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 msgr2=0x7f65901f3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65901f3f30 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f657800e870 tx=0x7f657800ed30 comp rx=0 tx=0).stop 2024-08-19T00:45:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 shutdown_connections 2024-08-19T00:45:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be30 0x7f656c06e2f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65900d03c0 0x7f65900b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65900b3750 0x7f65901f3f30 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 --2- 172.21.15.7:0/2038084719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f659006e710 0x7f65901f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 >> 172.21.15.7:0/2038084719 conn(0x7f659006bc70 msgr2=0x7f65900aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.557+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 shutdown_connections 2024-08-19T00:45:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.558+0000 7f6596e00640 1 -- 172.21.15.7:0/2038084719 wait complete. 2024-08-19T00:45:01.577 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_sessionmap' led to DAMAGED state 2024-08-19T00:45:01.577 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 400.00000000' 2024-08-19T00:45:01.577 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:01.578 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:01.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:45:01.614 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:01.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:01.614 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:45:01.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:01.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:01.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c74e00640 1 Processor -- start 2024-08-19T00:45:01.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c74e00640 1 -- start start 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c74e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c700d27b0 0x7f6c700d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c74e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700b4150 0x7f6c700b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c74e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c700b4b20 con 0x7f6c7015e3e0 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c74e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6c700d3140 con 0x7f6c700d27b0 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c74e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c700b4df0 con 0x7f6c700b4150 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c700d27b0 0x7f6c700d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c700d27b0 0x7f6c700d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41000/0 (socket says 172.21.15.7:41000) 2024-08-19T00:45:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.886+0000 7f6c67e00640 1 -- 172.21.15.7:0/3364470931 learned_addr learned my addr 172.21.15.7:0/3364470931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:01.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.887+0000 7f6c67e00640 1 -- 172.21.15.7:0/3364470931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700b4150 msgr2=0x7f6c700b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.887+0000 7f6c6fe00640 1 --2- 172.21.15.7:0/3364470931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700b4150 0x7f6c700b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.887+0000 7f6c67e00640 1 --2- 172.21.15.7:0/3364470931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700b4150 0x7f6c700b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.887+0000 7f6c67e00640 1 -- 172.21.15.7:0/3364470931 >> v1:172.21.15.162:6789/0 conn(0x7f6c7015e3e0 legacy=0x7f6c700b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.887+0000 7f6c67e00640 1 -- 172.21.15.7:0/3364470931 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c700b50d0 con 0x7f6c700d27b0 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.887+0000 7f6c6fe00640 1 --2- 172.21.15.7:0/3364470931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700b4150 0x7f6c700b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.888+0000 7f6c67e00640 1 --2- 172.21.15.7:0/3364470931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c700d27b0 0x7f6c700d2c00 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f6c580098a0 tx=0x7f6c5802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe594434b3f3a88 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.888+0000 7f6c6ea00640 1 -- 172.21.15.7:0/3364470931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58037070 con 0x7f6c700d27b0 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.888+0000 7f6c6ea00640 1 -- 172.21.15.7:0/3364470931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58032440 con 0x7f6c700d27b0 2024-08-19T00:45:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.888+0000 7f6c6ea00640 1 -- 172.21.15.7:0/3364470931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58032810 con 0x7f6c700d27b0 2024-08-19T00:45:01.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.888+0000 7f6c74e00640 1 -- 172.21.15.7:0/3364470931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c700d27b0 msgr2=0x7f6c700d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.888+0000 7f6c74e00640 1 --2- 172.21.15.7:0/3364470931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c700d27b0 0x7f6c700d2c00 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f6c580098a0 tx=0x7f6c5802a250 comp rx=0 tx=0).stop 2024-08-19T00:45:01.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.890+0000 7f6c74e00640 1 -- 172.21.15.7:0/3364470931 shutdown_connections 2024-08-19T00:45:01.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.890+0000 7f6c74e00640 1 --2- 172.21.15.7:0/3364470931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700b4150 0x7f6c700b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.890+0000 7f6c74e00640 1 --2- 172.21.15.7:0/3364470931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c700d27b0 0x7f6c700d2c00 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.890+0000 7f6c74e00640 1 -- 172.21.15.7:0/3364470931 >> 172.21.15.7:0/3364470931 conn(0x7f6c7008dbe0 msgr2=0x7f6c7009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.890+0000 7f6c74e00640 1 -- 172.21.15.7:0/3364470931 shutdown_connections 2024-08-19T00:45:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.890+0000 7f6c74e00640 1 -- 172.21.15.7:0/3364470931 wait complete. 2024-08-19T00:45:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.890+0000 7f6c74e00640 1 Processor -- start 2024-08-19T00:45:01.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.891+0000 7f6c74e00640 1 -- start start 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.891+0000 7f6c74e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c700b4150 0x7f6c701575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.891+0000 7f6c74e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700d27b0 0x7f6c70157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.891+0000 7f6c74e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c7015e3e0 0x7f6c700b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.891+0000 7f6c74e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c700cee90 con 0x7f6c7015e3e0 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.891+0000 7f6c74e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c700cf4c0 con 0x7f6c700b4150 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.891+0000 7f6c74e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c700cf9e0 con 0x7f6c700d27b0 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c7015e3e0 0x7f6c700b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c7015e3e0 0x7f6c700b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41014/0 (socket says 172.21.15.7:41014) 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 -- 172.21.15.7:0/693353247 learned_addr learned my addr 172.21.15.7:0/693353247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6f400640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c700b4150 0x7f6c701575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c67e00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700d27b0 0x7f6c70157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 -- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700d27b0 msgr2=0x7f6c70157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700d27b0 0x7f6c70157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 -- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c700b4150 msgr2=0x7f6c701575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c700b4150 0x7f6c701575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:01.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.892+0000 7f6c6fe00640 1 -- 172.21.15.7:0/693353247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c700ce160 con 0x7f6c7015e3e0 2024-08-19T00:45:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.893+0000 7f6c6fe00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c7015e3e0 0x7f6c700b7020 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800cef0 tx=0x7f6c6800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.893+0000 7f6c67400640 1 -- 172.21.15.7:0/693353247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6801a070 con 0x7f6c7015e3e0 2024-08-19T00:45:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.893+0000 7f6c67400640 1 -- 172.21.15.7:0/693353247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6800d860 con 0x7f6c7015e3e0 2024-08-19T00:45:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.893+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c700b8e80 con 0x7f6c7015e3e0 2024-08-19T00:45:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.893+0000 7f6c67400640 1 -- 172.21.15.7:0/693353247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6800dc50 con 0x7f6c7015e3e0 2024-08-19T00:45:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.893+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c700b9440 con 0x7f6c7015e3e0 2024-08-19T00:45:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.894+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c700b45e0 con 0x7f6c7015e3e0 2024-08-19T00:45:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.895+0000 7f6c67400640 1 -- 172.21.15.7:0/693353247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c6801d070 con 0x7f6c7015e3e0 2024-08-19T00:45:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.896+0000 7f6c67400640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.896+0000 7f6c67400640 1 -- 172.21.15.7:0/693353247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f6c6808bb40 con 0x7f6c7015e3e0 2024-08-19T00:45:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.896+0000 7f6c6f400640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:01.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.898+0000 7f6c6f400640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b0f60 tx=0x7f6c60009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:01.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:01.901+0000 7f6c67400640 1 -- 172.21.15.7:0/693353247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6c700ce160 con 0x7f6c7015e3e0 2024-08-19T00:45:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.120+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6c7006c990 con 0x7f6c7015e3e0 2024-08-19T00:45:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.312+0000 7f6c67400640 1 -- 172.21.15.7:0/693353247 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v156) ==== 161+0+0 (secure 0 0 0) 0x7f6c68059ab0 con 0x7f6c7015e3e0 2024-08-19T00:45:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c4c06be30 msgr2=0x7f6c4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b0f60 tx=0x7f6c60009060 comp rx=0 tx=0).stop 2024-08-19T00:45:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c7015e3e0 msgr2=0x7f6c700b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c7015e3e0 0x7f6c700b7020 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800cef0 tx=0x7f6c6800a710 comp rx=0 tx=0).stop 2024-08-19T00:45:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 shutdown_connections 2024-08-19T00:45:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c7015e3e0 0x7f6c700b7020 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c700d27b0 0x7f6c70157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 --2- 172.21.15.7:0/693353247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c700b4150 0x7f6c701575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 >> 172.21.15.7:0/693353247 conn(0x7f6c7008dbe0 msgr2=0x7f6c700b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 shutdown_connections 2024-08-19T00:45:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.316+0000 7f6c74e00640 1 -- 172.21.15.7:0/693353247 wait complete. 2024-08-19T00:45:02.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:02.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:45:02.482 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:45:02.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.496+0000 7f4c84600640 1 Processor -- start 2024-08-19T00:45:02.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.496+0000 7f4c84600640 1 -- start start 2024-08-19T00:45:02.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.496+0000 7f4c84600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c7c0ce500 0x7f4c7c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:02.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.496+0000 7f4c84600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:02.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.496+0000 7f4c84600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c06f7f0 con 0x7f4c7c159bf0 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.496+0000 7f4c84600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7c0d0d50 con 0x7f4c7c0ce500 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.496+0000 7f4c84600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c06f510 con 0x7f4c7c0d03c0 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c81200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c7c0ce500 0x7f4c7c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c81200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c7c0ce500 0x7f4c7c0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41024/0 (socket says 172.21.15.7:41024) 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c81200640 1 -- 172.21.15.7:0/2476833420 learned_addr learned my addr 172.21.15.7:0/2476833420 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c82600640 1 --2- 172.21.15.7:0/2476833420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c81200640 1 -- 172.21.15.7:0/2476833420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 msgr2=0x7f4c7c0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:02.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c81200640 1 --2- 172.21.15.7:0/2476833420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c0d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c81200640 1 -- 172.21.15.7:0/2476833420 >> v1:172.21.15.162:6789/0 conn(0x7f4c7c159bf0 legacy=0x7f4c7c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:02.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c81200640 1 -- 172.21.15.7:0/2476833420 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c072980 con 0x7f4c7c0ce500 2024-08-19T00:45:02.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.497+0000 7f4c7be00640 1 -- 172.21.15.7:0/2476833420 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147465051 0 0) 0x7f4c7c06f7f0 con 0x7f4c7c159bf0 2024-08-19T00:45:02.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.498+0000 7f4c81200640 1 --2- 172.21.15.7:0/2476833420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c0ce970 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32142a10cb90e98 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:02.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c7be00640 1 -- 172.21.15.7:0/2476833420 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68037070 con 0x7f4c7c0ce500 2024-08-19T00:45:02.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c7be00640 1 -- 172.21.15.7:0/2476833420 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68032440 con 0x7f4c7c0ce500 2024-08-19T00:45:02.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c7be00640 1 -- 172.21.15.7:0/2476833420 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68032810 con 0x7f4c7c0ce500 2024-08-19T00:45:02.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c84600640 1 -- 172.21.15.7:0/2476833420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 msgr2=0x7f4c7c0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:02.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c84600640 1 --2- 172.21.15.7:0/2476833420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c0ce970 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c84600640 1 -- 172.21.15.7:0/2476833420 shutdown_connections 2024-08-19T00:45:02.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c84600640 1 --2- 172.21.15.7:0/2476833420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c84600640 1 --2- 172.21.15.7:0/2476833420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c0ce970 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.499+0000 7f4c84600640 1 -- 172.21.15.7:0/2476833420 >> 172.21.15.7:0/2476833420 conn(0x7f4c7c06bc70 msgr2=0x7f4c7c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:02.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.500+0000 7f4c84600640 1 -- 172.21.15.7:0/2476833420 shutdown_connections 2024-08-19T00:45:02.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.500+0000 7f4c84600640 1 -- 172.21.15.7:0/2476833420 wait complete. 2024-08-19T00:45:02.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.501+0000 7f4c84600640 1 Processor -- start 2024-08-19T00:45:02.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.501+0000 7f4c84600640 1 -- start start 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.502+0000 7f4c84600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c1f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.502+0000 7f4c84600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.502+0000 7f4c84600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c7c159bf0 0x7f4c7c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.502+0000 7f4c84600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c073b70 con 0x7f4c7c0ce500 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.502+0000 7f4c84600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c072f40 con 0x7f4c7c159bf0 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.502+0000 7f4c84600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c159fd0 con 0x7f4c7c0d03c0 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.502+0000 7f4c81c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c1f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c1f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41030/0 (socket says 172.21.15.7:41030) 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 -- 172.21.15.7:0/3958017295 learned_addr learned my addr 172.21.15.7:0/3958017295 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c82600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c7c159bf0 0x7f4c7c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:02.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 -- 172.21.15.7:0/3958017295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 msgr2=0x7f4c7c149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:02.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 -- 172.21.15.7:0/3958017295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c7c159bf0 msgr2=0x7f4c7c0b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:02.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c7c159bf0 0x7f4c7c0b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:02.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 -- 172.21.15.7:0/3958017295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c0b4f40 con 0x7f4c7c0ce500 2024-08-19T00:45:02.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.503+0000 7f4c81c00640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c1f4dc0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c4b0 tx=0x7f4c7000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.504+0000 7f4c79600640 1 -- 172.21.15.7:0/3958017295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70017070 con 0x7f4c7c0ce500 2024-08-19T00:45:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.504+0000 7f4c79600640 1 -- 172.21.15.7:0/3958017295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70005480 con 0x7f4c7c0ce500 2024-08-19T00:45:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.504+0000 7f4c79600640 1 -- 172.21.15.7:0/3958017295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70003830 con 0x7f4c7c0ce500 2024-08-19T00:45:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.504+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c1f42e0 con 0x7f4c7c0ce500 2024-08-19T00:45:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.504+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1f48a0 con 0x7f4c7c0ce500 2024-08-19T00:45:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.505+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7c1f40d0 con 0x7f4c7c0ce500 2024-08-19T00:45:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.506+0000 7f4c79600640 1 -- 172.21.15.7:0/3958017295 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c7001a070 con 0x7f4c7c0ce500 2024-08-19T00:45:02.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.507+0000 7f4c79600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c5c06be30 0x7f4c5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:02.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.507+0000 7f4c79600640 1 -- 172.21.15.7:0/3958017295 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f4c7008a770 con 0x7f4c7c0ce500 2024-08-19T00:45:02.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.507+0000 7f4c81200640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c5c06be30 0x7f4c5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:02.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.508+0000 7f4c81200640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c5c06be30 0x7f4c5c06e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4c68034000 tx=0x7f4c6802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:02.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.512+0000 7f4c79600640 1 -- 172.21.15.7:0/3958017295 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4c70058510 con 0x7f4c7c0ce500 2024-08-19T00:45:02.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:02.770+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f4c7c0d0810 con 0x7f4c7c0ce500 2024-08-19T00:45:03.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.316+0000 7f4c79600640 1 -- 172.21.15.7:0/3958017295 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v157) ==== 101+0+0 (secure 0 0 0) 0x7f4c7005c810 con 0x7f4c7c0ce500 2024-08-19T00:45:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:45:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c5c06be30 msgr2=0x7f4c5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c5c06be30 0x7f4c5c06e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4c68034000 tx=0x7f4c6802e000 comp rx=0 tx=0).stop 2024-08-19T00:45:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 msgr2=0x7f4c7c1f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c1f4dc0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c4b0 tx=0x7f4c7000c970 comp rx=0 tx=0).stop 2024-08-19T00:45:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 shutdown_connections 2024-08-19T00:45:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4c5c06be30 0x7f4c5c06e2f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c7c159bf0 0x7f4c7c0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c7c0d03c0 0x7f4c7c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 --2- 172.21.15.7:0/3958017295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c0ce500 0x7f4c7c1f4dc0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 >> 172.21.15.7:0/3958017295 conn(0x7f4c7c06bc70 msgr2=0x7f4c7c15a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.318+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 shutdown_connections 2024-08-19T00:45:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.319+0000 7f4c84600640 1 -- 172.21.15.7:0/3958017295 wait complete. 2024-08-19T00:45:03.339 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.415+0000 7f763fc85f40 1 Processor -- start 2024-08-19T00:45:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.415+0000 7f763fc85f40 1 -- start start 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763fc85f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b4105b0 0x562d1b4a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763fc85f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b410990 0x562d1b40edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763fc85f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b40f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763fc85f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d1b4b5dc0 con 0x562d1b4105b0 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763fc85f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562d1b384d00 con 0x562d1b4288d0 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763fc85f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562d1b4b60a0 con 0x562d1b410990 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b4105b0 0x562d1b4a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b4105b0 0x562d1b4a7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41044/0 (socket says 172.21.15.7:41044) 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.416+0000 7f763ce00640 1 -- 172.21.15.7:0/532810599 learned_addr learned my addr 172.21.15.7:0/532810599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f7637e00640 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b410990 0x562d1b40edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763d800640 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b40f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763ce00640 1 -- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b410990 msgr2=0x562d1b40edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763ce00640 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b410990 0x562d1b40edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763ce00640 1 -- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 msgr2=0x562d1b40f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763ce00640 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b40f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763ce00640 1 -- 172.21.15.7:0/532810599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1b309b30 con 0x562d1b4105b0 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763d800640 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b40f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f763ce00640 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b4105b0 0x562d1b4a7cf0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7630009760 tx=0x7f7630009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4db31bdd1d41629 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f7636a00640 1 -- 172.21.15.7:0/532810599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630017070 con 0x562d1b4105b0 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f7636a00640 1 -- 172.21.15.7:0/532810599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76300090d0 con 0x562d1b4105b0 2024-08-19T00:45:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.417+0000 7f7636a00640 1 -- 172.21.15.7:0/532810599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630006b60 con 0x562d1b4105b0 2024-08-19T00:45:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 -- 172.21.15.7:0/532810599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b4105b0 msgr2=0x562d1b4a7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b4105b0 0x562d1b4a7cf0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7630009760 tx=0x7f7630009c20 comp rx=0 tx=0).stop 2024-08-19T00:45:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 -- 172.21.15.7:0/532810599 shutdown_connections 2024-08-19T00:45:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b40f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b410990 0x562d1b40edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 --2- 172.21.15.7:0/532810599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b4105b0 0x562d1b4a7cf0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 -- 172.21.15.7:0/532810599 >> 172.21.15.7:0/532810599 conn(0x562d1b40d4e0 msgr2=0x562d1b3ddef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 -- 172.21.15.7:0/532810599 shutdown_connections 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.418+0000 7f763fc85f40 1 -- 172.21.15.7:0/532810599 wait complete. 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.419+0000 7f763fc85f40 1 Processor -- start 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.419+0000 7f763fc85f40 1 -- start start 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763fc85f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b4105b0 0x562d1b4b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763fc85f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b410990 0x562d1b4a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763fc85f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b4a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763fc85f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d1b4a8230 con 0x562d1b410990 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763fc85f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562d1b42aa90 con 0x562d1b4288d0 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763fc85f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562d1b4b5440 con 0x562d1b4105b0 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b410990 0x562d1b4a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b410990 0x562d1b4a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41050/0 (socket says 172.21.15.7:41050) 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 learned_addr learned my addr 172.21.15.7:0/3643312671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763ce00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b4105b0 0x562d1b4b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f763d800640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b4a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b4105b0 msgr2=0x562d1b4b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562d1b4105b0 0x562d1b4b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 msgr2=0x562d1b4a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1b4288d0 0x562d1b4a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.420+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1b346080 con 0x562d1b410990 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.421+0000 7f7637e00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b410990 0x562d1b4a6d80 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f7628025da0 tx=0x7f7628002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.421+0000 7f7635600640 1 -- 172.21.15.7:0/3643312671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762806a070 con 0x562d1b410990 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.421+0000 7f7635600640 1 -- 172.21.15.7:0/3643312671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7628051a30 con 0x562d1b410990 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.421+0000 7f7635600640 1 -- 172.21.15.7:0/3643312671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628051e20 con 0x562d1b410990 2024-08-19T00:45:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.421+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d1b4ae400 con 0x562d1b410990 2024-08-19T00:45:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.421+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1b4ae120 con 0x562d1b410990 2024-08-19T00:45:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.423+0000 7f7635600640 1 -- 172.21.15.7:0/3643312671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f762806d070 con 0x562d1b410990 2024-08-19T00:45:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.424+0000 7f7635600640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f761c06a840 0x7f761c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.424+0000 7f7635600640 1 -- 172.21.15.7:0/3643312671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f76280cdd10 con 0x562d1b410990 2024-08-19T00:45:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.424+0000 7f763ce00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f761c06a840 0x7f761c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.427 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.424+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x562d1b4a5680 0x562d1b544d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.424+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b4b0990 con 0x562d1b4a5680 2024-08-19T00:45:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.425+0000 7f763d800640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x562d1b4a5680 0x562d1b544d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.425+0000 7f763ce00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f761c06a840 0x7f761c06cd00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7630000c00 tx=0x7f763000f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.425+0000 7f763d800640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x562d1b4a5680 0x562d1b544d50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.427+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v98'350 uv324 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.427+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b545290 con 0x562d1b4a5680 2024-08-19T00:45:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.428+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v98'351 uv351 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.428+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5456f0 con 0x562d1b4a5680 2024-08-19T00:45:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.430+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v98'352 uv352 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.432 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.430+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b545ac0 con 0x562d1b4a5680 2024-08-19T00:45:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.431+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v98'353 uv353 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.431+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b559350 con 0x562d1b4a5680 2024-08-19T00:45:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.433+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v98'354 uv354 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.433+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558340 con 0x562d1b4a5680 2024-08-19T00:45:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.434+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v98'355 uv355 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.434+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558730 con 0x562d1b4a5680 2024-08-19T00:45:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.436+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v98'356 uv330 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.436+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558b20 con 0x562d1b4a5680 2024-08-19T00:45:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.437+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v98'357 uv357 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.437+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558f10 con 0x562d1b4a5680 2024-08-19T00:45:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.439+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v98'358 uv358 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.440 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:03.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.439+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558f10 con 0x562d1b4a5680 2024-08-19T00:45:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.440+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v98'359 uv359 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.440+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.442+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v98'360 uv360 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.442+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.443+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v98'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.443+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.445+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v98'362 uv337 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.445+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.446+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v98'363 uv363 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.447+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.448+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v98'364 uv364 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.450 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:03.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.448+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.449+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v98'365 uv365 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.449+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.451+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v98'366 uv366 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.451+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.452+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v98'367 uv367 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.452+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.454+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v98'368 uv368 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.454+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.455+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v98'369 uv343 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.455+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.456+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v98'370 uv370 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.456+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.459 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.458+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v98'371 uv371 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.458+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.459+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v98'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.459+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.461+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v98'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.461+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.462+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v98'374 uv374 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.462+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.463+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v98'375 uv349 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.463+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.465+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v98'376 uv376 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.465+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.468 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.466+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v98'377 uv377 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.466+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.468+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v98'378 uv378 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.468+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.469+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v98'379 uv379 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.469+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b558ec0 con 0x562d1b4a5680 2024-08-19T00:45:03.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.471+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v98'380 uv380 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.471+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562d1b559c00 0x562d1b55bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.471+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55c530 con 0x562d1b559c00 2024-08-19T00:45:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.471+0000 7f763ce00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562d1b559c00 0x562d1b55bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.471+0000 7f763ce00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562d1b559c00 0x562d1b55bff0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.473+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v98'262 uv245 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.473+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55c8d0 con 0x562d1b559c00 2024-08-19T00:45:03.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.475+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v98'263 uv263 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.475+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55cc70 con 0x562d1b559c00 2024-08-19T00:45:03.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.476+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v98'264 uv264 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.478 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:03.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.476+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55d010 con 0x562d1b559c00 2024-08-19T00:45:03.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.478+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v98'265 uv265 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.478+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55d3b0 con 0x562d1b559c00 2024-08-19T00:45:03.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.479+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v98'266 uv266 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.479+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55d750 con 0x562d1b559c00 2024-08-19T00:45:03.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.481+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v98'267 uv250 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.481+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.482+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v98'268 uv268 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.482+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.485 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.483+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v98'269 uv269 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.483+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.485+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v98'270 uv270 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.485+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.486+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v98'271 uv271 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.486+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.487+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v98'272 uv255 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.488+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.489+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v98'273 uv273 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.489+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.492 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:03.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.491+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v98'274 uv274 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.491+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5621e0 con 0x562d1b559c00 2024-08-19T00:45:03.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.492+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v98'275 uv275 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.493+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5621e0 con 0x562d1b559c00 2024-08-19T00:45:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.494+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v98'276 uv276 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.494+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.495+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v98'277 uv261 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.495+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.497+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v98'278 uv278 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.497+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.499 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:03.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.498+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v98'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.498+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.500+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v98'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.500+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55eb00 con 0x562d1b559c00 2024-08-19T00:45:03.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.501+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v98'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.501+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b55daf0 con 0x562d1b559c00 2024-08-19T00:45:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.502+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v98'282 uv282 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b559c00 2024-08-19T00:45:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.502+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562d1b55e3f0 0x562d1b55e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.502+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b560f00 con 0x562d1b55e3f0 2024-08-19T00:45:03.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.503+0000 7f7637e00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562d1b55e3f0 0x562d1b55e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.503+0000 7f7637e00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562d1b55e3f0 0x562d1b55e7d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.505+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v98'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.505+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5612a0 con 0x562d1b55e3f0 2024-08-19T00:45:03.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.506+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v98'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.506+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b561640 con 0x562d1b55e3f0 2024-08-19T00:45:03.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.507+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v98'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.508 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:03.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.507+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b543e20 con 0x562d1b55e3f0 2024-08-19T00:45:03.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.508+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v98'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.508+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b562f80 con 0x562d1b55e3f0 2024-08-19T00:45:03.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.509+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v98'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.509+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b561e90 con 0x562d1b55e3f0 2024-08-19T00:45:03.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.511+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v98'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.511+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5622a0 con 0x562d1b4a5680 2024-08-19T00:45:03.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.512+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v98'54 uv53 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.512+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5622a0 con 0x562d1b4a5680 2024-08-19T00:45:03.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.513+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v98'55 uv55 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.513+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5622a0 con 0x562d1b4a5680 2024-08-19T00:45:03.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.515+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v98'56 uv56 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.516 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:03.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.515+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b562670 con 0x562d1b4a5680 2024-08-19T00:45:03.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.516+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v98'57 uv57 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.516+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562d1b5633b0 0x562d1b5657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.517+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b565ce0 con 0x562d1b5633b0 2024-08-19T00:45:03.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.517+0000 7f763d800640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562d1b5633b0 0x562d1b5657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.518+0000 7f763d800640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562d1b5633b0 0x562d1b5657a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.519+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v98'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.519+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b565ce0 con 0x562d1b5633b0 2024-08-19T00:45:03.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.520+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v98'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.520+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b565ce0 con 0x562d1b5633b0 2024-08-19T00:45:03.523 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:03.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.521+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v98'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.521+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b566cf0 con 0x562d1b5633b0 2024-08-19T00:45:03.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.522+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v98'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.523+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b566cf0 con 0x562d1b5633b0 2024-08-19T00:45:03.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.524+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v98'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.524+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b565ce0 con 0x562d1b5633b0 2024-08-19T00:45:03.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.525+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v98'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.525+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562d1b566360 0x562d1b566790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.525+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.525+0000 7f763ce00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562d1b566360 0x562d1b566790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.526+0000 7f763ce00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562d1b566360 0x562d1b566790 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.527+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v98'127 uv121 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.527+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.529+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v98'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.529+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.530+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v98'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.532 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:03.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.530+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56a140 con 0x562d1b566360 2024-08-19T00:45:03.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.532+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v98'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.532+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56a100 con 0x562d1b566360 2024-08-19T00:45:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.533+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v98'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.533+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.535+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v98'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.535+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.536+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v98'133 uv126 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.536+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.537+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v98'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.537+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.540 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:03.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.539+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v98'135 uv135 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.539+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.540+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v98'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.540+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b5690f0 con 0x562d1b566360 2024-08-19T00:45:03.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.542+0000 7f763ce00640 1 -- 172.21.15.7:0/3643312671 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v98'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f763001a040 con 0x562d1b566360 2024-08-19T00:45:03.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.542+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562d1b569a40 0x562d1b569e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.542+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56c550 con 0x562d1b569a40 2024-08-19T00:45:03.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.542+0000 7f7637e00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562d1b569a40 0x562d1b569e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.542+0000 7f7637e00640 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562d1b569a40 0x562d1b569e80 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.544+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v98'56 uv55 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.544+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56c8f0 con 0x562d1b569a40 2024-08-19T00:45:03.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.545+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v98'57 uv57 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.545+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cc90 con 0x562d1b569a40 2024-08-19T00:45:03.548 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.546+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v98'58 uv58 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.546+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d080 con 0x562d1b569a40 2024-08-19T00:45:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.548+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v98'59 uv59 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.548+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d080 con 0x562d1b569a40 2024-08-19T00:45:03.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.549+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v98'60 uv60 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.549+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cdb0 con 0x562d1b4a5680 2024-08-19T00:45:03.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.550+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v98'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.550+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cdb0 con 0x562d1b4a5680 2024-08-19T00:45:03.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.552+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v98'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.552+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cdb0 con 0x562d1b4a5680 2024-08-19T00:45:03.555 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.553+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v98'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.553+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56de40 con 0x562d1b4a5680 2024-08-19T00:45:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.555+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v98'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.555+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56de00 con 0x562d1b4a5680 2024-08-19T00:45:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.556+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v98'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.556+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56de00 con 0x562d1b4a5680 2024-08-19T00:45:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.558+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v98'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b4a5680 2024-08-19T00:45:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.558+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56de00 con 0x562d1b55e3f0 2024-08-19T00:45:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.559+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v98'112 uv108 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.559+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56de00 con 0x562d1b55e3f0 2024-08-19T00:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.560+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v98'113 uv113 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.561+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56de00 con 0x562d1b55e3f0 2024-08-19T00:45:03.564 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.562+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v98'114 uv114 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.562+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cdb0 con 0x562d1b55e3f0 2024-08-19T00:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.563+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v98'115 uv115 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.564+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cdb0 con 0x562d1b55e3f0 2024-08-19T00:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.565+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v98'116 uv116 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.565+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cd60 con 0x562d1b55e3f0 2024-08-19T00:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.566+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v98'117 uv111 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.567+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cd60 con 0x562d1b55e3f0 2024-08-19T00:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.568+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v98'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.568+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cd10 con 0x562d1b55e3f0 2024-08-19T00:45:03.571 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.569+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v98'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.569+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cd10 con 0x562d1b55e3f0 2024-08-19T00:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.571+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v98'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.571+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d100 con 0x562d1b55e3f0 2024-08-19T00:45:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.573+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v98'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b55e3f0 2024-08-19T00:45:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.573+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.576 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.575+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v98'54 uv54 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.575+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.576+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v98'55 uv55 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.577+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.578+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 609.00000000 [create] v98'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.578+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.579+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 609.00000000 [delete] v98'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.579+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.582 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.581+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v98'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.581+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.582+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v98'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.582+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.583+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v98'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.583+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b5633b0 2024-08-19T00:45:03.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.585+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [omap-set-header] v98'74 uv74 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76380044c0 con 0x562d1b5633b0 2024-08-19T00:45:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.585+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:109 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b569a40 2024-08-19T00:45:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.586+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(109 400.00000000 [create] v98'57 uv56 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.586+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:110 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d7c0 con 0x562d1b569a40 2024-08-19T00:45:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.588+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(110 400.00000000 [delete] v98'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.588+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cec0 con 0x562d1b569a40 2024-08-19T00:45:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.589+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(111 400.00000000 [create] v98'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.591 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.589+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cea0 con 0x562d1b569a40 2024-08-19T00:45:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.590+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(112 400.00000000 [write 0~22] v98'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.590+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56cea0 con 0x562d1b569a40 2024-08-19T00:45:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.592+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(113 400.00000000 [omap-set-header] v98'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.592+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.593+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(114 100.00000000.inode [create] v98'144 uv136 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.593+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.594+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(115 100.00000000.inode [delete] v98'145 uv145 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.594+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.597 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:03.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.596+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(116 100.00000000.inode [create] v98'146 uv146 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.596+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.597+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v98'147 uv147 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.597+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.599+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v98'148 uv148 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.599+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.600+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(119 1.00000000 [create] v98'149 uv143 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.600+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.601+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(120 1.00000000 [delete] v98'150 uv150 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.601+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.604 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.602+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(121 1.00000000 [create] v98'151 uv151 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.602+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.603+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v98'152 uv152 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.603+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.605+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v98'153 uv153 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.605+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56ce70 con 0x562d1b569a40 2024-08-19T00:45:03.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.606+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(124 1.00000000 [omap-set-header] v98'154 uv154 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.606+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) -- 0x562d1b56d720 con 0x562d1b569a40 2024-08-19T00:45:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f7637e00640 1 -- 172.21.15.7:0/3643312671 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v98'155 uv155 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f762806c030 con 0x562d1b569a40 2024-08-19T00:45:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562d1b559c00 msgr2=0x562d1b55bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562d1b559c00 0x562d1b55bff0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562d1b566360 msgr2=0x562d1b566790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562d1b566360 0x562d1b566790 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562d1b569a40 msgr2=0x562d1b569e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562d1b569a40 0x562d1b569e80 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562d1b55e3f0 msgr2=0x562d1b55e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562d1b55e3f0 0x562d1b55e7d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x562d1b4a5680 msgr2=0x562d1b544d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763d800640 1 -- 172.21.15.7:0/3643312671 reap_dead start 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x562d1b4a5680 0x562d1b544d50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562d1b5633b0 msgr2=0x562d1b5657a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562d1b5633b0 0x562d1b5657a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f761c06a840 msgr2=0x7f761c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f761c06a840 0x7f761c06cd00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7630000c00 tx=0x7f763000f000 comp rx=0 tx=0).stop 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b410990 msgr2=0x562d1b4a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b410990 0x562d1b4a6d80 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f7628025da0 tx=0x7f7628002fb0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 shutdown_connections 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x562d1b4a5680 0x562d1b544d50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f761c06a840 0x7f761c06cd00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562d1b5633b0 0x562d1b5657a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 --2- 172.21.15.7:0/3643312671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1b410990 0x562d1b4a6d80 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.607+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 >> 172.21.15.7:0/3643312671 conn(0x562d1b40d4e0 msgr2=0x562d1b40f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.608+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 shutdown_connections 2024-08-19T00:45:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.608+0000 7f763fc85f40 1 -- 172.21.15.7:0/3643312671 wait complete. 2024-08-19T00:45:03.614 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 400.00000000 2024-08-19T00:45:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.730+0000 7ff92691bf40 1 Processor -- start 2024-08-19T00:45:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.730+0000 7ff92691bf40 1 -- start start 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff92691bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8faf40 0x555e5c993930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff92691bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8fc5b0 0x555e5c9a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff92691bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc990 0x555e5c9a3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff92691bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555e5c8fb8f0 con 0x555e5c8fc5b0 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff92691bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555e5c870d00 con 0x555e5c8faf40 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff92691bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555e5c9a1dc0 con 0x555e5c8fc990 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff922600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8fc5b0 0x555e5c9a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff922600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8fc5b0 0x555e5c9a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41056/0 (socket says 172.21.15.7:41056) 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff922600640 1 -- 172.21.15.7:0/3434631144 learned_addr learned my addr 172.21.15.7:0/3434631144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.731+0000 7ff923a00640 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc990 0x555e5c9a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff923000640 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8faf40 0x555e5c993930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff922600640 1 -- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc990 msgr2=0x555e5c9a3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff922600640 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc990 0x555e5c9a3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff922600640 1 -- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8faf40 msgr2=0x555e5c993930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff922600640 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8faf40 0x555e5c993930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff922600640 1 -- 172.21.15.7:0/3434631144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5c7f5b30 con 0x555e5c8fc5b0 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff922600640 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8fc5b0 0x555e5c9a2c20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff910001dc0 tx=0x7ff91000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d84ab0b2be21cd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff921200640 1 -- 172.21.15.7:0/3434631144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910012020 con 0x555e5c8fc5b0 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff921200640 1 -- 172.21.15.7:0/3434631144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91000e670 con 0x555e5c8fc5b0 2024-08-19T00:45:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.732+0000 7ff921200640 1 -- 172.21.15.7:0/3434631144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91000ea80 con 0x555e5c8fc5b0 2024-08-19T00:45:03.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 -- 172.21.15.7:0/3434631144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8fc5b0 msgr2=0x555e5c9a2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8fc5b0 0x555e5c9a2c20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff910001dc0 tx=0x7ff91000b6c0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 -- 172.21.15.7:0/3434631144 shutdown_connections 2024-08-19T00:45:03.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc990 0x555e5c9a3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8fc5b0 0x555e5c9a2c20 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 --2- 172.21.15.7:0/3434631144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8faf40 0x555e5c993930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 -- 172.21.15.7:0/3434631144 >> 172.21.15.7:0/3434631144 conn(0x555e5c8f94e0 msgr2=0x555e5c8f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:03.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 -- 172.21.15.7:0/3434631144 shutdown_connections 2024-08-19T00:45:03.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.733+0000 7ff92691bf40 1 -- 172.21.15.7:0/3434631144 wait complete. 2024-08-19T00:45:03.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.734+0000 7ff92691bf40 1 Processor -- start 2024-08-19T00:45:03.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.734+0000 7ff92691bf40 1 -- start start 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff92691bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8faf40 0x555e5c97d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff92691bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc5b0 0x555e5c8ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff92691bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8fc990 0x555e5c8ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff92691bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555e5c8f7610 con 0x555e5c8faf40 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff92691bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555e5c8f8220 con 0x555e5c8fc990 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff92691bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555e5c8f78f0 con 0x555e5c8fc5b0 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8faf40 0x555e5c97d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8faf40 0x555e5c97d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41058/0 (socket says 172.21.15.7:41058) 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 -- 172.21.15.7:0/1967953152 learned_addr learned my addr 172.21.15.7:0/1967953152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923a00640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8fc990 0x555e5c8ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff922600640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc5b0 0x555e5c8ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 -- 172.21.15.7:0/1967953152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc5b0 msgr2=0x555e5c8ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555e5c8fc5b0 0x555e5c8ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 -- 172.21.15.7:0/1967953152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8fc990 msgr2=0x555e5c8ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555e5c8fc990 0x555e5c8ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.735+0000 7ff923000640 1 -- 172.21.15.7:0/1967953152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e5c832080 con 0x555e5c8faf40 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.736+0000 7ff923000640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8faf40 0x555e5c97d910 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff91400a4f0 tx=0x7ff914002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.736+0000 7ff91b400640 1 -- 172.21.15.7:0/1967953152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914064030 con 0x555e5c8faf40 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.736+0000 7ff91b400640 1 -- 172.21.15.7:0/1967953152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9140549b0 con 0x555e5c8faf40 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.736+0000 7ff91b400640 1 -- 172.21.15.7:0/1967953152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914059040 con 0x555e5c8faf40 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.736+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e5c97de50 con 0x555e5c8faf40 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.736+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e5c97e3b0 con 0x555e5c8faf40 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.738+0000 7ff91b400640 1 -- 172.21.15.7:0/1967953152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff914067030 con 0x555e5c8faf40 2024-08-19T00:45:03.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.739+0000 7ff91b400640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90406a810 0x7ff90406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.739+0000 7ff91b400640 1 -- 172.21.15.7:0/1967953152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7ff9140cdc10 con 0x555e5c8faf40 2024-08-19T00:45:03.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.739+0000 7ff922600640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90406a810 0x7ff90406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.739+0000 7ff92691bf40 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x555e5c990020 0x555e5c97bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.739+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) -- 0x555e5c97c430 con 0x555e5c990020 2024-08-19T00:45:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.740+0000 7ff923a00640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x555e5c990020 0x555e5c97bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.740+0000 7ff922600640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90406a810 0x7ff90406ccd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff910001dc0 tx=0x7ff910009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.740+0000 7ff923a00640 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x555e5c990020 0x555e5c97bef0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff923a00640 1 -- 172.21.15.7:0/1967953152 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 400.00000000 [delete] v98'62 uv62 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ff91c002b60 con 0x555e5c990020 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x555e5c990020 msgr2=0x555e5c97bef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x555e5c990020 0x555e5c97bef0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90406a810 msgr2=0x7ff90406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90406a810 0x7ff90406ccd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff910001dc0 tx=0x7ff910009000 comp rx=0 tx=0).stop 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8faf40 msgr2=0x555e5c97d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 --2- 172.21.15.7:0/1967953152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e5c8faf40 0x555e5c97d910 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff91400a4f0 tx=0x7ff914002fb0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff923a00640 1 -- 172.21.15.7:0/1967953152 reap_dead start 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 shutdown_connections 2024-08-19T00:45:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 >> 172.21.15.7:0/1967953152 conn(0x555e5c8f94e0 msgr2=0x555e5c9a2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:03.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 shutdown_connections 2024-08-19T00:45:03.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.742+0000 7ff92691bf40 1 -- 172.21.15.7:0/1967953152 wait complete. 2024-08-19T00:45:03.748 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:03.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.908+0000 7f6fc7400640 1 Processor -- start 2024-08-19T00:45:03.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.908+0000 7f6fc7400640 1 -- start start 2024-08-19T00:45:03.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fc7400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6fc00731c0 0x7f6fc00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc00ae2b0 0x7f6fc00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fc7400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fc00aeae0 con 0x7f6fc0158cd0 2024-08-19T00:45:03.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fc7400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc00aedc0 con 0x7f6fc00731c0 2024-08-19T00:45:03.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fc7400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc00af0a0 con 0x7f6fc00ae2b0 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fc5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc00ae2b0 0x7f6fc00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fbfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6fc00731c0 0x7f6fc00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.909+0000 7f6fc4a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6fc0158cd0 0x7f6fc0072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:49598/0 (socket says 172.21.15.7:49598) 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.910+0000 7f6fc4a00640 1 -- 172.21.15.7:0/1075944744 learned_addr learned my addr 172.21.15.7:0/1075944744 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.910+0000 7f6fc5400640 1 -- 172.21.15.7:0/1075944744 >> v2:172.21.15.162:3300/0 conn(0x7f6fc00731c0 msgr2=0x7f6fc00add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.910+0000 7f6fc5400640 1 --2- 172.21.15.7:0/1075944744 >> v2:172.21.15.162:3300/0 conn(0x7f6fc00731c0 0x7f6fc00add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.910+0000 7f6fc5400640 1 -- 172.21.15.7:0/1075944744 >> v1:172.21.15.162:6789/0 conn(0x7f6fc0158cd0 legacy=0x7f6fc0072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.910+0000 7f6fbf400640 1 -- 172.21.15.7:0/1075944744 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183420080 0 0) 0x7f6fc00aeae0 con 0x7f6fc0158cd0 2024-08-19T00:45:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.910+0000 7f6fc5400640 1 -- 172.21.15.7:0/1075944744 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc00af380 con 0x7f6fc00ae2b0 2024-08-19T00:45:03.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.911+0000 7f6fc5400640 1 --2- 172.21.15.7:0/1075944744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc00ae2b0 0x7f6fc00b3150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009d90 tx=0x7f6fb802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1732efbb45669826 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.911+0000 7f6fbf400640 1 -- 172.21.15.7:0/1075944744 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8007740 con 0x7f6fc00ae2b0 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.911+0000 7f6fbf400640 1 -- 172.21.15.7:0/1075944744 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb80078e0 con 0x7f6fc00ae2b0 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.911+0000 7f6fbf400640 1 -- 172.21.15.7:0/1075944744 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8007cb0 con 0x7f6fc00ae2b0 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 -- 172.21.15.7:0/1075944744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc00ae2b0 msgr2=0x7f6fc00b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 --2- 172.21.15.7:0/1075944744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc00ae2b0 0x7f6fc00b3150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009d90 tx=0x7f6fb802a530 comp rx=0 tx=0).stop 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 -- 172.21.15.7:0/1075944744 shutdown_connections 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 --2- 172.21.15.7:0/1075944744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc00ae2b0 0x7f6fc00b3150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 --2- 172.21.15.7:0/1075944744 >> v2:172.21.15.162:3300/0 conn(0x7f6fc00731c0 0x7f6fc00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 -- 172.21.15.7:0/1075944744 >> 172.21.15.7:0/1075944744 conn(0x7f6fc00b2300 msgr2=0x7f6fc006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 -- 172.21.15.7:0/1075944744 shutdown_connections 2024-08-19T00:45:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.912+0000 7f6fc7400640 1 -- 172.21.15.7:0/1075944744 wait complete. 2024-08-19T00:45:03.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.914+0000 7f6fc7400640 1 Processor -- start 2024-08-19T00:45:03.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.914+0000 7f6fc7400640 1 -- start start 2024-08-19T00:45:03.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fc00731c0 0x7f6fc015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc00ae2b0 0x7f6fc015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc7400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc014bdd0 0x7f6fc015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc7400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00b3690 con 0x7f6fc00731c0 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc7400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00ae760 con 0x7f6fc00ae2b0 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc7400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc00b3810 con 0x7f6fc014bdd0 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fc00731c0 0x7f6fc015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fc00731c0 0x7f6fc015a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60460/0 (socket says 172.21.15.7:60460) 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc4a00640 1 -- 172.21.15.7:0/854954748 learned_addr learned my addr 172.21.15.7:0/854954748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fc5400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc014bdd0 0x7f6fc015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.915+0000 7f6fbfe00640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc00ae2b0 0x7f6fc015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fc5400640 1 -- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc00ae2b0 msgr2=0x7f6fc015ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fc5400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc00ae2b0 0x7f6fc015ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fc5400640 1 -- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fc00731c0 msgr2=0x7f6fc015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fc5400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fc00731c0 0x7f6fc015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:03.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fc5400640 1 -- 172.21.15.7:0/854954748 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc015d530 con 0x7f6fc014bdd0 2024-08-19T00:45:03.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fc5400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc014bdd0 0x7f6fc015c8c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8031000 tx=0x7f6fb8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fbcc00640 1 -- 172.21.15.7:0/854954748 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8040070 con 0x7f6fc014bdd0 2024-08-19T00:45:03.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fbcc00640 1 -- 172.21.15.7:0/854954748 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb8031bc0 con 0x7f6fc014bdd0 2024-08-19T00:45:03.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc015d810 con 0x7f6fc014bdd0 2024-08-19T00:45:03.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.916+0000 7f6fbcc00640 1 -- 172.21.15.7:0/854954748 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8045460 con 0x7f6fc014bdd0 2024-08-19T00:45:03.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.917+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc00ccbc0 con 0x7f6fc014bdd0 2024-08-19T00:45:03.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.917+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc00cf850 con 0x7f6fc014bdd0 2024-08-19T00:45:03.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.918+0000 7f6fbcc00640 1 -- 172.21.15.7:0/854954748 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fb8039040 con 0x7f6fc014bdd0 2024-08-19T00:45:03.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.919+0000 7f6fbcc00640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:03.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.919+0000 7f6fbcc00640 1 -- 172.21.15.7:0/854954748 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f6fb80ac930 con 0x7f6fc014bdd0 2024-08-19T00:45:03.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.920+0000 7f6fc4a00640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:03.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.920+0000 7f6fc4a00640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6fa006be30 0x7f6fa006e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000f60 tx=0x7f6fb4007240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:03.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:03.924+0000 7f6fbcc00640 1 -- 172.21.15.7:0/854954748 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6fc00cf850 con 0x7f6fc014bdd0 2024-08-19T00:45:04.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.146+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f6fc00ccdc0 con 0x7f6fc014bdd0 2024-08-19T00:45:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.327+0000 7f6fbcc00640 1 -- 172.21.15.7:0/854954748 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v158) ==== 162+0+0 (secure 0 0 0) 0x7f6fc00ccdc0 con 0x7f6fc014bdd0 2024-08-19T00:45:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6fa006be30 msgr2=0x7f6fa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6fa006be30 0x7f6fa006e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000f60 tx=0x7f6fb4007240 comp rx=0 tx=0).stop 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc014bdd0 msgr2=0x7f6fc015c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc014bdd0 0x7f6fc015c8c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8031000 tx=0x7f6fb8004a40 comp rx=0 tx=0).stop 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 shutdown_connections 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fc014bdd0 0x7f6fc015c8c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fc00ae2b0 0x7f6fc015ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 --2- 172.21.15.7:0/854954748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fc00731c0 0x7f6fc015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 >> 172.21.15.7:0/854954748 conn(0x7f6fc00b2300 msgr2=0x7f6fc00b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 shutdown_connections 2024-08-19T00:45:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.330+0000 7f6fc7400640 1 -- 172.21.15.7:0/854954748 wait complete. 2024-08-19T00:45:04.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:04.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.911+0000 7f4264800640 1 Processor -- start 2024-08-19T00:45:04.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.911+0000 7f4264800640 1 -- start start 2024-08-19T00:45:04.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.912+0000 7f4264800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c159bf0 0x7f425c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:04.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.912+0000 7f4264800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f425c0cec10 0x7f425c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:04.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.912+0000 7f4264800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425c06f7f0 con 0x7f425c0739a0 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.912+0000 7f4264800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f425c06f510 con 0x7f425c0cec10 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.912+0000 7f4264800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f425c072980 con 0x7f425c159bf0 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4262800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f425c0cec10 0x7f425c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4262800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f425c0cec10 0x7f425c0d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60466/0 (socket says 172.21.15.7:60466) 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4261400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f425c0739a0 0x7f425c0ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54358/0 (socket says 172.21.15.7:54358) 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4262800640 1 -- 172.21.15.7:0/394333035 learned_addr learned my addr 172.21.15.7:0/394333035 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4261e00640 1 --2- 172.21.15.7:0/394333035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c159bf0 0x7f425c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4262800640 1 -- 172.21.15.7:0/394333035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c159bf0 msgr2=0x7f425c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:04.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4262800640 1 --2- 172.21.15.7:0/394333035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c159bf0 0x7f425c073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4262800640 1 -- 172.21.15.7:0/394333035 >> v1:172.21.15.7:6789/0 conn(0x7f425c0739a0 legacy=0x7f425c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:04.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.913+0000 7f4262800640 1 -- 172.21.15.7:0/394333035 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425c072c60 con 0x7f425c0cec10 2024-08-19T00:45:04.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.914+0000 7f4262800640 1 --2- 172.21.15.7:0/394333035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c0cec10 0x7f425c0d03c0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f4258009e50 tx=0x7f425802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d670ebb04542def9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:04.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.914+0000 7f4260a00640 1 -- 172.21.15.7:0/394333035 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258036070 con 0x7f425c0cec10 2024-08-19T00:45:04.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4260a00640 1 -- 172.21.15.7:0/394333035 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4258031600 con 0x7f425c0cec10 2024-08-19T00:45:04.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4260a00640 1 -- 172.21.15.7:0/394333035 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580319d0 con 0x7f425c0cec10 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 -- 172.21.15.7:0/394333035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c0cec10 msgr2=0x7f425c0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 --2- 172.21.15.7:0/394333035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c0cec10 0x7f425c0d03c0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f4258009e50 tx=0x7f425802a680 comp rx=0 tx=0).stop 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 -- 172.21.15.7:0/394333035 shutdown_connections 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 --2- 172.21.15.7:0/394333035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c0cec10 0x7f425c0d03c0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 --2- 172.21.15.7:0/394333035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c159bf0 0x7f425c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 -- 172.21.15.7:0/394333035 >> 172.21.15.7:0/394333035 conn(0x7f425c06bc70 msgr2=0x7f425c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 -- 172.21.15.7:0/394333035 shutdown_connections 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.915+0000 7f4264800640 1 -- 172.21.15.7:0/394333035 wait complete. 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.917+0000 7f4264800640 1 Processor -- start 2024-08-19T00:45:04.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.917+0000 7f4264800640 1 -- start start 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4264800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0739a0 0x7f425c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4264800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c159bf0 0x7f425c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4264800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c1529d0 0x7f425c15fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4264800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f425c15a150 con 0x7f425c159bf0 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4264800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f425c159fd0 con 0x7f425c0739a0 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4264800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f425c0d0900 con 0x7f425c1529d0 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c159bf0 0x7f425c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:04.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c159bf0 0x7f425c153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60474/0 (socket says 172.21.15.7:60474) 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 -- 172.21.15.7:0/2898316657 learned_addr learned my addr 172.21.15.7:0/2898316657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4262800640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c1529d0 0x7f425c15fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261e00640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0739a0 0x7f425c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 -- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c1529d0 msgr2=0x7f425c15fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c1529d0 0x7f425c15fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 -- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0739a0 msgr2=0x7f425c14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0739a0 0x7f425c14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261400640 1 -- 172.21.15.7:0/2898316657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425c152e60 con 0x7f425c159bf0 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.918+0000 7f4261e00640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0739a0 0x7f425c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.919+0000 7f4261400640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c159bf0 0x7f425c153f00 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c440 tx=0x7f424c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.919+0000 7f4256000640 1 -- 172.21.15.7:0/2898316657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c0074e0 con 0x7f425c159bf0 2024-08-19T00:45:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.919+0000 7f4256000640 1 -- 172.21.15.7:0/2898316657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c007680 con 0x7f425c159bf0 2024-08-19T00:45:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.919+0000 7f4256000640 1 -- 172.21.15.7:0/2898316657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c004a20 con 0x7f425c159bf0 2024-08-19T00:45:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.919+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425c153140 con 0x7f425c159bf0 2024-08-19T00:45:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.919+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425c153700 con 0x7f425c159bf0 2024-08-19T00:45:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.920+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425c0d0c30 con 0x7f425c159bf0 2024-08-19T00:45:04.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.921+0000 7f4256000640 1 -- 172.21.15.7:0/2898316657 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f424c01a020 con 0x7f425c159bf0 2024-08-19T00:45:04.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.922+0000 7f4256000640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:04.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.922+0000 7f4256000640 1 -- 172.21.15.7:0/2898316657 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f424c08aa70 con 0x7f425c159bf0 2024-08-19T00:45:04.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.922+0000 7f4261e00640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:04.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.923+0000 7f4261e00640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4250006fd0 tx=0x7f4250008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:04.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:04.927+0000 7f4256000640 1 -- 172.21.15.7:0/2898316657 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f424c010300 con 0x7f425c159bf0 2024-08-19T00:45:05.068 INFO:tasks.ceph.mds.c.smithi007.stderr: -47> 2024-08-19T00:45:00.314+0000 7f7264600640 -1 mds.0.sessionmap _load_finish got (2) No such file or directory 2024-08-19T00:45:05.069 INFO:tasks.ceph.mds.c.smithi007.stderr: -46> 2024-08-19T00:45:00.314+0000 7f7264600640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds0_sessionmap' -2 ((2) No such file or directory) 2024-08-19T00:45:05.107 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:45:05.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.148+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f425c158ca0 con 0x7f425c159bf0 2024-08-19T00:45:05.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.149+0000 7f4256000640 1 -- 172.21.15.7:0/2898316657 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+4401 (secure 0 0 0) 0x7f424c058f80 con 0x7f425c159bf0 2024-08-19T00:45:05.150 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:05.151 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":159,"btime":"2024-08-19T00:45:04:327930+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:04.327920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":159,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:05.151 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 159 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 msgr2=0x7f424006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4250006fd0 tx=0x7f4250008040 comp rx=0 tx=0).stop 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c159bf0 msgr2=0x7f425c153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c159bf0 0x7f425c153f00 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c440 tx=0x7f424c00c900 comp rx=0 tx=0).stop 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 shutdown_connections 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f424006be30 0x7f424006e2f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c1529d0 0x7f425c15fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f425c159bf0 0x7f425c153f00 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 --2- 172.21.15.7:0/2898316657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0739a0 0x7f425c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 >> 172.21.15.7:0/2898316657 conn(0x7f425c06bc70 msgr2=0x7f425c15b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 shutdown_connections 2024-08-19T00:45:05.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:05.151+0000 7f4264800640 1 -- 172.21.15.7:0/2898316657 wait complete. 2024-08-19T00:45:05.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 159, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:45:04.327920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8103': {'gid': 8103, 'name': 'a', 'rank': 0, 'incarnation': 159, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/1092992076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1092992076}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1092992076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:45:05.168 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8103:up:replay 2024-08-19T00:45:05.168 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:45:10.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.740+0000 7fd69b200640 1 Processor -- start 2024-08-19T00:45:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.740+0000 7fd69b200640 1 -- start start 2024-08-19T00:45:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c15bd70 0x7fd69c072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd69c072f70 0x7fd69c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd69c06db40 0x7fd69c071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:10.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c0733f0 con 0x7fd69c06db40 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c0736d0 con 0x7fd69c072f70 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c0739b0 con 0x7fd69c15bd70 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd69c06db40 0x7fd69c071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd69c06db40 0x7fd69c071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60510/0 (socket says 172.21.15.7:60510) 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd69a800640 1 -- 172.21.15.7:0/39957905 learned_addr learned my addr 172.21.15.7:0/39957905 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.741+0000 7fd693e00640 1 --2- 172.21.15.7:0/39957905 >> v2:172.21.15.162:3300/0 conn(0x7fd69c072f70 0x7fd69c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.742+0000 7fd699e00640 1 --2- 172.21.15.7:0/39957905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c15bd70 0x7fd69c072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.742+0000 7fd69a800640 1 -- 172.21.15.7:0/39957905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c15bd70 msgr2=0x7fd69c072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.742+0000 7fd69a800640 1 --2- 172.21.15.7:0/39957905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c15bd70 0x7fd69c072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.742+0000 7fd69a800640 1 -- 172.21.15.7:0/39957905 >> v2:172.21.15.162:3300/0 conn(0x7fd69c072f70 msgr2=0x7fd69c06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.742+0000 7fd69a800640 1 --2- 172.21.15.7:0/39957905 >> v2:172.21.15.162:3300/0 conn(0x7fd69c072f70 0x7fd69c06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.742+0000 7fd69a800640 1 -- 172.21.15.7:0/39957905 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c15c4a0 con 0x7fd69c06db40 2024-08-19T00:45:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.742+0000 7fd693e00640 1 --2- 172.21.15.7:0/39957905 >> v2:172.21.15.162:3300/0 conn(0x7fd69c072f70 0x7fd69c06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.743+0000 7fd69a800640 1 --2- 172.21.15.7:0/39957905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c071810 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0696e0 tx=0x7fd69402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0defcae7bc80b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.743+0000 7fd699400640 1 -- 172.21.15.7:0/39957905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694036070 con 0x7fd69c06db40 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.743+0000 7fd699400640 1 -- 172.21.15.7:0/39957905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd694031600 con 0x7fd69c06db40 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.743+0000 7fd699400640 1 -- 172.21.15.7:0/39957905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6940319d0 con 0x7fd69c06db40 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 -- 172.21.15.7:0/39957905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 msgr2=0x7fd69c071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 --2- 172.21.15.7:0/39957905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c071810 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0696e0 tx=0x7fd69402a6a0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 -- 172.21.15.7:0/39957905 shutdown_connections 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 --2- 172.21.15.7:0/39957905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c071810 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 --2- 172.21.15.7:0/39957905 >> v2:172.21.15.162:3300/0 conn(0x7fd69c072f70 0x7fd69c06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 --2- 172.21.15.7:0/39957905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c15bd70 0x7fd69c072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 -- 172.21.15.7:0/39957905 >> 172.21.15.7:0/39957905 conn(0x7fd69c06b850 msgr2=0x7fd69c06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 -- 172.21.15.7:0/39957905 shutdown_connections 2024-08-19T00:45:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.744+0000 7fd69b200640 1 -- 172.21.15.7:0/39957905 wait complete. 2024-08-19T00:45:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.746+0000 7fd69b200640 1 Processor -- start 2024-08-19T00:45:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.746+0000 7fd69b200640 1 -- start start 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd69b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c1f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd69b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072f70 0x7fd69c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd69b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c15bd70 0x7fd69c147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd69b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c06e3a0 con 0x7fd69c06db40 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd69b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c15c150 con 0x7fd69c15bd70 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd69b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c06e520 con 0x7fd69c072f70 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd699e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c1f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd699e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c1f1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60518/0 (socket says 172.21.15.7:60518) 2024-08-19T00:45:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd699e00640 1 -- 172.21.15.7:0/2417444478 learned_addr learned my addr 172.21.15.7:0/2417444478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:10.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd693e00640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072f70 0x7fd69c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd69a800640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c15bd70 0x7fd69c147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.747+0000 7fd699e00640 1 -- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072f70 msgr2=0x7fd69c14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd699e00640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072f70 0x7fd69c14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd699e00640 1 -- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c15bd70 msgr2=0x7fd69c147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd699e00640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c15bd70 0x7fd69c147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd699e00640 1 -- 172.21.15.7:0/2417444478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c1577f0 con 0x7fd69c06db40 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd693e00640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072f70 0x7fd69c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd69a800640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c15bd70 0x7fd69c147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd699e00640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c1f1300 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00d5f0 tx=0x7fd68c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd692000640 1 -- 172.21.15.7:0/2417444478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0125f0 con 0x7fd69c06db40 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd692000640 1 -- 172.21.15.7:0/2417444478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68c019070 con 0x7fd69c06db40 2024-08-19T00:45:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd692000640 1 -- 172.21.15.7:0/2417444478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0129d0 con 0x7fd69c06db40 2024-08-19T00:45:10.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c156c70 con 0x7fd69c06db40 2024-08-19T00:45:10.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.748+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c157230 con 0x7fd69c06db40 2024-08-19T00:45:10.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.749+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c06d600 con 0x7fd69c06db40 2024-08-19T00:45:10.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.750+0000 7fd692000640 1 -- 172.21.15.7:0/2417444478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd68c012b70 con 0x7fd69c06db40 2024-08-19T00:45:10.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.751+0000 7fd692000640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67806be60 0x7fd67806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:10.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.751+0000 7fd692000640 1 -- 172.21.15.7:0/2417444478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7fd68c08b5e0 con 0x7fd69c06db40 2024-08-19T00:45:10.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.751+0000 7fd693e00640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67806be60 0x7fd67806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:10.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.752+0000 7fd693e00640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67806be60 0x7fd67806e320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd69c075720 tx=0x7fd684008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:10.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.756+0000 7fd692000640 1 -- 172.21.15.7:0/2417444478 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd68c059b70 con 0x7fd69c06db40 2024-08-19T00:45:10.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.978+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd69c158e90 con 0x7fd69c06db40 2024-08-19T00:45:10.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.979+0000 7fd692000640 1 -- 172.21.15.7:0/2417444478 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 162 v162) ==== 95+0+5228 (secure 0 0 0) 0x7fd68c059470 con 0x7fd69c06db40 2024-08-19T00:45:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:10.981 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":162,"btime":"2024-08-19T00:45:07:339193+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":162,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:07.339185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":159,"state":"up:active","state_seq":7,"addr":"172.21.15.7:6837/1092992076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1092992076},{"type":"v1","addr":"172.21.15.7:6837","nonce":1092992076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":6}]} 2024-08-19T00:45:10.981 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 162 2024-08-19T00:45:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67806be60 msgr2=0x7fd67806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67806be60 0x7fd67806e320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd69c075720 tx=0x7fd684008040 comp rx=0 tx=0).stop 2024-08-19T00:45:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 msgr2=0x7fd69c1f1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c1f1300 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00d5f0 tx=0x7fd68c00dab0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 shutdown_connections 2024-08-19T00:45:10.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67806be60 0x7fd67806e320 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c15bd70 0x7fd69c147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072f70 0x7fd69c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 --2- 172.21.15.7:0/2417444478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69c06db40 0x7fd69c1f1300 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:10.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 >> 172.21.15.7:0/2417444478 conn(0x7fd69c06b850 msgr2=0x7fd69c0b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:10.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 shutdown_connections 2024-08-19T00:45:10.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:10.981+0000 7fd69b200640 1 -- 172.21.15.7:0/2417444478 wait complete. 2024-08-19T00:45:10.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 162, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:45:07.339185+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8103': {'gid': 8103, 'name': 'a', 'rank': 0, 'incarnation': 159, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.7:6837/1092992076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1092992076}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1092992076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8103, 'qdb_cluster': [8103]} 2024-08-19T00:45:10.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:45:10.999 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:45:11.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.155+0000 7fc00ea00640 1 Processor -- start 2024-08-19T00:45:11.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.155+0000 7fc00ea00640 1 -- start start 2024-08-19T00:45:11.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.156+0000 7fc00ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc0080d03c0 0x7fc008071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.156+0000 7fc00ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080b3750 0x7fc0080cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.156+0000 7fc00ea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0080cdfb0 con 0x7fc00806e710 2024-08-19T00:45:11.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.156+0000 7fc00ea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc0080cebc0 con 0x7fc0080d03c0 2024-08-19T00:45:11.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.156+0000 7fc00ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0080ce290 con 0x7fc0080b3750 2024-08-19T00:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc00ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080b3750 0x7fc0080cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc007e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc0080d03c0 0x7fc008071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc00ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080b3750 0x7fc0080cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:41778/0 (socket says 172.21.15.7:41778) 2024-08-19T00:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc007400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc00806e710 0x7fc0080d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:49612/0 (socket says 172.21.15.7:49612) 2024-08-19T00:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc00ca00640 1 -- 172.21.15.7:0/2627101245 learned_addr learned my addr 172.21.15.7:0/2627101245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc007e00640 1 -- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080b3750 msgr2=0x7fc0080cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc007e00640 1 --2- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080b3750 0x7fc0080cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc007e00640 1 -- 172.21.15.7:0/2627101245 >> v1:172.21.15.162:6789/0 conn(0x7fc00806e710 legacy=0x7fc0080d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc007e00640 1 -- 172.21.15.7:0/2627101245 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0080ce570 con 0x7fc0080d03c0 2024-08-19T00:45:11.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.157+0000 7fc00ca00640 1 --2- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080b3750 0x7fc0080cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:11.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.158+0000 7fc007e00640 1 --2- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080d03c0 0x7fc008071980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbff80097d0 tx=0x7fbff802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53075490c06600ae server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.159+0000 7fc006a00640 1 -- 172.21.15.7:0/2627101245 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8037070 con 0x7fc0080d03c0 2024-08-19T00:45:11.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.159+0000 7fc006a00640 1 -- 172.21.15.7:0/2627101245 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8032440 con 0x7fc0080d03c0 2024-08-19T00:45:11.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.159+0000 7fc006a00640 1 -- 172.21.15.7:0/2627101245 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8032810 con 0x7fc0080d03c0 2024-08-19T00:45:11.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.159+0000 7fc00ea00640 1 -- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080d03c0 msgr2=0x7fc008071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.159+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080d03c0 0x7fc008071980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbff80097d0 tx=0x7fbff802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.160+0000 7fc00ea00640 1 -- 172.21.15.7:0/2627101245 shutdown_connections 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.160+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080b3750 0x7fc0080cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.160+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2627101245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080d03c0 0x7fc008071980 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.160+0000 7fc00ea00640 1 -- 172.21.15.7:0/2627101245 >> 172.21.15.7:0/2627101245 conn(0x7fc00806bc70 msgr2=0x7fc00806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.160+0000 7fc00ea00640 1 -- 172.21.15.7:0/2627101245 shutdown_connections 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.160+0000 7fc00ea00640 1 -- 172.21.15.7:0/2627101245 wait complete. 2024-08-19T00:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.161+0000 7fc00ea00640 1 Processor -- start 2024-08-19T00:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.161+0000 7fc00ea00640 1 -- start start 2024-08-19T00:45:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc00ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00806e710 0x7fc00809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc00ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080b3750 0x7fc008158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc00ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080d03c0 0x7fc00809a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc00ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc008073c60 con 0x7fc00806e710 2024-08-19T00:45:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc00ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc008073ae0 con 0x7fc0080b3750 2024-08-19T00:45:11.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc00ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0080b3be0 con 0x7fc0080d03c0 2024-08-19T00:45:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00806e710 0x7fc00809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00806e710 0x7fc00809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60530/0 (socket says 172.21.15.7:60530) 2024-08-19T00:45:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.162+0000 7fc007e00640 1 -- 172.21.15.7:0/2712461464 learned_addr learned my addr 172.21.15.7:0/2712461464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007400640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080b3750 0x7fc008158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc00ca00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080d03c0 0x7fc00809a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007e00640 1 -- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080d03c0 msgr2=0x7fc00809a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007e00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080d03c0 0x7fc00809a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007e00640 1 -- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080b3750 msgr2=0x7fc008158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007e00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080b3750 0x7fc008158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007e00640 1 -- 172.21.15.7:0/2712461464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00809d560 con 0x7fc00806e710 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007400640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080b3750 0x7fc008158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.163+0000 7fc007e00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00806e710 0x7fc00809cf60 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fbff8035040 tx=0x7fbff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.164+0000 7fbfffe00640 1 -- 172.21.15.7:0/2712461464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8037040 con 0x7fc00806e710 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.164+0000 7fbfffe00640 1 -- 172.21.15.7:0/2712461464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8030500 con 0x7fc00806e710 2024-08-19T00:45:11.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.164+0000 7fbfffe00640 1 -- 172.21.15.7:0/2712461464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff80308d0 con 0x7fc00806e710 2024-08-19T00:45:11.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.164+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00809d840 con 0x7fc00806e710 2024-08-19T00:45:11.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.164+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00809de00 con 0x7fc00806e710 2024-08-19T00:45:11.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.166+0000 7fbfffe00640 1 -- 172.21.15.7:0/2712461464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbff8044020 con 0x7fc00806e710 2024-08-19T00:45:11.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.167+0000 7fbfffe00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbfe806be30 0x7fbfe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.167+0000 7fbfffe00640 1 -- 172.21.15.7:0/2712461464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7fbff80ab620 con 0x7fc00806e710 2024-08-19T00:45:11.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.167+0000 7fc007400640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbfe806be30 0x7fbfe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 Processor -- start 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc007400640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbfe806be30 0x7fbfe806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007fd0 tx=0x7fbff4007d60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 -- start start 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043d0f50 0x5572043d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043f4470 0x5572043f4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043e9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557204309ba0 con 0x5572043f4470 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5572042a2230 con 0x5572043d0f50 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.168+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557204305b60 con 0x5572043f4dd0 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043f4470 0x5572043f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043f4470 0x5572043f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60540/0 (socket says 172.21.15.7:60540) 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 -- 172.21.15.7:0/2354515128 learned_addr learned my addr 172.21.15.7:0/2354515128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007e00640 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043d0f50 0x5572043d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc00ca00640 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043e9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 -- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 msgr2=0x5572043e9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043e9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 -- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043d0f50 msgr2=0x5572043d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043d0f50 0x5572043d1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 -- 172.21.15.7:0/2354515128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572042d3bb0 con 0x5572043f4470 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.169+0000 7fc007400640 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043f4470 0x5572043f4890 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fbff40076a0 tx=0x7fbff4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571c1d5b9127aee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fbff3e00640 1 -- 172.21.15.7:0/2354515128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4001b60 con 0x5572043f4470 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fbff3e00640 1 -- 172.21.15.7:0/2354515128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff4001d00 con 0x5572043f4470 2024-08-19T00:45:11.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fbff3e00640 1 -- 172.21.15.7:0/2354515128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4015bc0 con 0x5572043f4470 2024-08-19T00:45:11.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 -- 172.21.15.7:0/2354515128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043f4470 msgr2=0x5572043f4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043f4470 0x5572043f4890 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fbff40076a0 tx=0x7fbff4012000 comp rx=0 tx=0).stop 2024-08-19T00:45:11.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 -- 172.21.15.7:0/2354515128 shutdown_connections 2024-08-19T00:45:11.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043e9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043f4470 0x5572043f4890 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 --2- 172.21.15.7:0/2354515128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043d0f50 0x5572043d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 -- 172.21.15.7:0/2354515128 >> 172.21.15.7:0/2354515128 conn(0x55720436e110 msgr2=0x5572043ebd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 -- 172.21.15.7:0/2354515128 shutdown_connections 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.170+0000 7fc01185b740 1 -- 172.21.15.7:0/2354515128 wait complete. 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.171+0000 7fc01185b740 1 -- start start 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.171+0000 7fc01185b740 1 Processor -- start 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.172+0000 7fc01185b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.172+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.172+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.172+0000 7fc01185b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572043edea0 con 0x5572043d0f50 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.172+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5572042c5250 con 0x5572043f4dd0 2024-08-19T00:45:11.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.172+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5572043ed5b0 con 0x5572043f4470 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.172+0000 7fc01185b740 10 client.0 _ll_register_callbacks cb 0x5572042c9740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60552/0 (socket says 172.21.15.7:60552) 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 -- 172.21.15.7:0/3470940563 learned_addr learned my addr 172.21.15.7:0/3470940563 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007400640 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc00ca00640 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 -- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 msgr2=0x5572043c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 -- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 msgr2=0x5572043c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 -- 172.21.15.7:0/3470940563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55720401d2d0 con 0x5572043d0f50 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fc007e00640 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043c6940 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009560 tx=0x7fbff8079be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d195e6a0ca5c7503 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.173+0000 7fbff0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fbff0c00640 1 -- 172.21.15.7:0/3470940563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8082000 con 0x5572043d0f50 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbff4001d00 con 0x5572043d0f50 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fbff0c00640 1 -- 172.21.15.7:0/3470940563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7fbff8081b70 con 0x5572043d0f50 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fbff0c00640 1 -- 172.21.15.7:0/3470940563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=162) ==== 24+0+0 (secure 0 0 0) 0x7fbff8081d70 con 0x5572043d0f50 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 10 client.8265 fetch_fsmap learned FSMap version 162 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=162,monmap=2+}) -- 0x5572040e76b0 con 0x5572043d0f50 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fbff0c00640 1 -- 172.21.15.7:0/3470940563 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff4001d00 con 0x5572043d0f50 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fbff0c00640 1 -- 172.21.15.7:0/3470940563 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 162) ==== 3502+0+0 (secure 0 0 0) 0x7fbff803a070 con 0x5572043d0f50 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 10 client.8265 fetch_fsmap finished waiting for FSMap version 162 2024-08-19T00:45:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 10 client.8265 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:45:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 20 client.8265 populate_metadata read hostname 'smithi007' 2024-08-19T00:45:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c0bb0 0x5572043c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 4 client.8265 mds_command: new command op to 8103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:45:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.174+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 --> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572043172d0 con 0x5572043c0bb0 2024-08-19T00:45:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.175+0000 7fc007400640 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c0bb0 0x5572043c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.175+0000 7fc007400640 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c0bb0 0x5572043c9d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93b3af15248abe1e server_cookie=c17ff600e9e2b49d in_seq=0 out_seq=0 2024-08-19T00:45:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.175+0000 7fbff0c00640 10 client.8265 ms_handle_connect on v2:172.21.15.7:6835/1092992076 2024-08-19T00:45:11.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.176+0000 7fbff0c00640 1 -- 172.21.15.7:0/3470940563 <== mds.0 v2:172.21.15.7:6835/1092992076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572043172d0 con 0x5572043c0bb0 2024-08-19T00:45:11.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.176+0000 7fbff0c00640 10 client.8265 handle_command_reply: tid=0 2024-08-19T00:45:11.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.176+0000 7fc01185b740 1 client.8265 shutdown 2024-08-19T00:45:11.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.176+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 msgr2=0x5572043c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.176+0000 7fc01185b740 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043c6940 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009560 tx=0x7fbff8079be0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 shutdown_connections 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c0bb0 0x5572043c9d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fbff0c00640 0 client.8265 ms_handle_reset on v2:172.21.15.7:6835/1092992076 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 --2- 172.21.15.7:0/3470940563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043c6940 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 >> 172.21.15.7:0/3470940563 conn(0x55720436e110 msgr2=0x5572043ebc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 shutdown_connections 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 1 -- 172.21.15.7:0/3470940563 wait complete. 2024-08-19T00:45:11.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.177+0000 7fc01185b740 20 client.8265 trim_cache size 0 max 16384 2024-08-19T00:45:11.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.196+0000 7fc01185b740 1 Processor -- start 2024-08-19T00:45:11.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.196+0000 7fc01185b740 1 -- start start 2024-08-19T00:45:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc01185b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043ef930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043ec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc01185b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc008201180 con 0x5572043d0f50 2024-08-19T00:45:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc008200200 con 0x5572043f4dd0 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc00815e360 con 0x5572043f4470 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60566/0 (socket says 172.21.15.7:60566) 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 -- 172.21.15.7:0/4251675612 learned_addr learned my addr 172.21.15.7:0/4251675612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc00ca00640 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007400640 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 -- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 msgr2=0x5572043ef930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043ef930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 -- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 msgr2=0x5572043ec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043ec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007e00640 1 -- 172.21.15.7:0/4251675612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572043ef1f0 con 0x5572043d0f50 2024-08-19T00:45:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc00ca00640 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043ec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.197+0000 7fc007400640 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043ef930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc007e00640 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043a0d80 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fbff8077970 tx=0x7fbff807b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214d916551d35ba7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fbff3400640 1 -- 172.21.15.7:0/4251675612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8078f60 con 0x5572043d0f50 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fbff3400640 1 -- 172.21.15.7:0/4251675612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8082000 con 0x5572043d0f50 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fbff3400640 1 -- 172.21.15.7:0/4251675612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff80a9260 con 0x5572043d0f50 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 -- 172.21.15.7:0/4251675612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 msgr2=0x5572043a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043a0d80 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fbff8077970 tx=0x7fbff807b000 comp rx=0 tx=0).stop 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 -- 172.21.15.7:0/4251675612 shutdown_connections 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4dd0 0x5572043ec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4470 0x5572043ef930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 --2- 172.21.15.7:0/4251675612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043a0d80 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 -- 172.21.15.7:0/4251675612 >> 172.21.15.7:0/4251675612 conn(0x55720436e110 msgr2=0x5572043c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.198+0000 7fc01185b740 1 -- 172.21.15.7:0/4251675612 shutdown_connections 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.199+0000 7fc01185b740 1 -- 172.21.15.7:0/4251675612 wait complete. 2024-08-19T00:45:11.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.199+0000 7fc01185b740 1 -- start start 2024-08-19T00:45:11.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.199+0000 7fc01185b740 1 Processor -- start 2024-08-19T00:45:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc01185b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4470 0x557204469cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc01185b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc01185b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572043c7490 con 0x5572043d0f50 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081ffcb0 con 0x5572043f4470 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc01185b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5572043c0620 con 0x5572043f4dd0 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc01185b740 10 client.0 _ll_register_callbacks cb 0x7fbff8006e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043e8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60576/0 (socket says 172.21.15.7:60576) 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.200+0000 7fc007e00640 1 -- 172.21.15.7:0/826325566 learned_addr learned my addr 172.21.15.7:0/826325566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc00ca00640 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc007400640 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4470 0x557204469cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc007e00640 1 -- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 msgr2=0x5572043ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc007e00640 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc007e00640 1 -- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4470 msgr2=0x557204469cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc007e00640 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4470 0x557204469cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc007e00640 1 -- 172.21.15.7:0/826325566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572043cbc00 con 0x5572043d0f50 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc007e00640 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043e8db0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fbff8077970 tx=0x7fbff80a9570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa19340810ebddfb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fbff0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fbff0c00640 1 -- 172.21.15.7:0/826325566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff809e060 con 0x5572043d0f50 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fbff0c00640 1 -- 172.21.15.7:0/826325566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7fbff8081b70 con 0x5572043d0f50 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.201+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbff8082000 con 0x5572043d0f50 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fbff0c00640 1 -- 172.21.15.7:0/826325566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=162) ==== 24+0+0 (secure 0 0 0) 0x7fbff8078f60 con 0x5572043d0f50 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 10 client.8271 fetch_fsmap learned FSMap version 162 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=162,monmap=2+}) -- 0x5572043cbc00 con 0x5572043d0f50 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fbff0c00640 1 -- 172.21.15.7:0/826325566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8082000 con 0x5572043d0f50 2024-08-19T00:45:11.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fbff0c00640 1 -- 172.21.15.7:0/826325566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 162) ==== 3502+0+0 (secure 0 0 0) 0x7fbff803a040 con 0x5572043d0f50 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 10 client.8271 fetch_fsmap finished waiting for FSMap version 162 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 10 client.8271 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 20 client.8271 populate_metadata read hostname 'smithi007' 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c7c60 0x5572043c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 4 client.8271 mds_command: new command op to 8103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 --> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] -- command(tid 0: {"prefix": "status"}) -- 0x5572043a1b20 con 0x5572043c7c60 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.202+0000 7fc007400640 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c7c60 0x5572043c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc007400640 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c7c60 0x5572043c8040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d9f1b707b09e6a6 server_cookie=3ee75f6a94b619c1 in_seq=0 out_seq=0 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fbff0c00640 10 client.8271 ms_handle_connect on v2:172.21.15.7:6835/1092992076 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fbff0c00640 1 -- 172.21.15.7:0/826325566 <== mds.0 v2:172.21.15.7:6835/1092992076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5572043a1b20 con 0x5572043c7c60 2024-08-19T00:45:11.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fbff0c00640 10 client.8271 handle_command_reply: tid=0 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 client.8271 shutdown 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 msgr2=0x5572043e8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043e8db0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fbff8077970 tx=0x7fbff80a9570 comp rx=0 tx=0).stop 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 shutdown_connections 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:6835/1092992076,v1:172.21.15.7:6837/1092992076] conn(0x5572043c7c60 0x5572043c8040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5572043f4dd0 0x5572043ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572043f4470 0x557204469cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fbff0c00640 0 client.8271 ms_handle_reset on v2:172.21.15.7:6835/1092992076 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 --2- 172.21.15.7:0/826325566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572043d0f50 0x5572043e8db0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 >> 172.21.15.7:0/826325566 conn(0x55720436e110 msgr2=0x5572043a38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 shutdown_connections 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 1 -- 172.21.15.7:0/826325566 wait complete. 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.203+0000 7fc01185b740 20 client.8271 trim_cache size 0 max 16384 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8103, 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:45:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:45:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8739275449999999, 2024-08-19T00:45:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 162, 2024-08-19T00:45:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 98, 2024-08-19T00:45:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 98, 2024-08-19T00:45:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 20.184456698000002 2024-08-19T00:45:11.214 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbfe806be30 msgr2=0x7fbfe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbfe806be30 0x7fbfe806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007fd0 tx=0x7fbff4007d60 comp rx=0 tx=0).stop 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00806e710 msgr2=0x7fc00809cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00806e710 0x7fc00809cf60 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fbff8035040 tx=0x7fbff80046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 shutdown_connections 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbfe806be30 0x7fbfe806e2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0080d03c0 0x7fc00809a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0080b3750 0x7fc008158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 --2- 172.21.15.7:0/2712461464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00806e710 0x7fc00809cf60 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 >> 172.21.15.7:0/2712461464 conn(0x7fc00806bc70 msgr2=0x7fc00806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 shutdown_connections 2024-08-19T00:45:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.204+0000 7fc00ea00640 1 -- 172.21.15.7:0/2712461464 wait complete. 2024-08-19T00:45:11.223 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:45:11.223 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 400.00000000', proceeding to ls 2024-08-19T00:45:11.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:45:11.264 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:11.262+0000 7f498d800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:45:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.382+0000 7fd239400640 1 Processor -- start 2024-08-19T00:45:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.382+0000 7fd239400640 1 -- start start 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.383+0000 7fd239400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd234159bf0 0x7fd234073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.383+0000 7fd239400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2340739a0 0x7fd2340ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.383+0000 7fd239400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2340cea40 0x7fd2340d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.383+0000 7fd239400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd23406f7f0 con 0x7fd2340739a0 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.383+0000 7fd239400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd23406f510 con 0x7fd2340cea40 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.383+0000 7fd239400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd234072980 con 0x7fd234159bf0 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2340739a0 0x7fd2340ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2340739a0 0x7fd2340ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60586/0 (socket says 172.21.15.7:60586) 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 -- 172.21.15.7:0/1574191559 learned_addr learned my addr 172.21.15.7:0/1574191559 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd232800640 1 --2- 172.21.15.7:0/1574191559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd234159bf0 0x7fd234073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd233200640 1 --2- 172.21.15.7:0/1574191559 >> v2:172.21.15.162:3300/0 conn(0x7fd2340cea40 0x7fd2340d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 -- 172.21.15.7:0/1574191559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd234159bf0 msgr2=0x7fd234073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 --2- 172.21.15.7:0/1574191559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd234159bf0 0x7fd234073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 -- 172.21.15.7:0/1574191559 >> v2:172.21.15.162:3300/0 conn(0x7fd2340cea40 msgr2=0x7fd2340d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:11.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 --2- 172.21.15.7:0/1574191559 >> v2:172.21.15.162:3300/0 conn(0x7fd2340cea40 0x7fd2340d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.384+0000 7fd22be00640 1 -- 172.21.15.7:0/1574191559 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd234072c60 con 0x7fd2340739a0 2024-08-19T00:45:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.385+0000 7fd22be00640 1 --2- 172.21.15.7:0/1574191559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340739a0 0x7fd2340ce500 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd2340cdd20 tx=0x7fd21c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880133d06ddf02d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.385+0000 7fd231e00640 1 -- 172.21.15.7:0/1574191559 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c037070 con 0x7fd2340739a0 2024-08-19T00:45:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.385+0000 7fd231e00640 1 -- 172.21.15.7:0/1574191559 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21c032440 con 0x7fd2340739a0 2024-08-19T00:45:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd231e00640 1 -- 172.21.15.7:0/1574191559 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c032810 con 0x7fd2340739a0 2024-08-19T00:45:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 -- 172.21.15.7:0/1574191559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340739a0 msgr2=0x7fd2340ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 --2- 172.21.15.7:0/1574191559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340739a0 0x7fd2340ce500 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd2340cdd20 tx=0x7fd21c02a140 comp rx=0 tx=0).stop 2024-08-19T00:45:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 -- 172.21.15.7:0/1574191559 shutdown_connections 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 --2- 172.21.15.7:0/1574191559 >> v2:172.21.15.162:3300/0 conn(0x7fd2340cea40 0x7fd2340d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 --2- 172.21.15.7:0/1574191559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2340739a0 0x7fd2340ce500 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 --2- 172.21.15.7:0/1574191559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd234159bf0 0x7fd234073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 -- 172.21.15.7:0/1574191559 >> 172.21.15.7:0/1574191559 conn(0x7fd23406bc70 msgr2=0x7fd23406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 -- 172.21.15.7:0/1574191559 shutdown_connections 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.386+0000 7fd239400640 1 -- 172.21.15.7:0/1574191559 wait complete. 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.388+0000 7fd239400640 1 Processor -- start 2024-08-19T00:45:11.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.388+0000 7fd239400640 1 -- start start 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd239400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340739a0 0x7fd234155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd239400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340cea40 0x7fd23409d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd239400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234159bf0 0x7fd2340aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd239400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd23415a150 con 0x7fd234159bf0 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd239400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd234159fd0 con 0x7fd2340cea40 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd239400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340d0900 con 0x7fd2340739a0 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd233200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234159bf0 0x7fd2340aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd233200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234159bf0 0x7fd2340aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60596/0 (socket says 172.21.15.7:60596) 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd233200640 1 -- 172.21.15.7:0/3963523392 learned_addr learned my addr 172.21.15.7:0/3963523392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd232800640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340739a0 0x7fd234155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.389+0000 7fd22be00640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340cea40 0x7fd23409d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd233200640 1 -- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340739a0 msgr2=0x7fd234155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd233200640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340739a0 0x7fd234155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd233200640 1 -- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340cea40 msgr2=0x7fd23409d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd233200640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340cea40 0x7fd23409d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd233200640 1 -- 172.21.15.7:0/3963523392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2341f56c0 con 0x7fd234159bf0 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd233200640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234159bf0 0x7fd2340aea10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009dd0 tx=0x7fd22c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd22aa00640 1 -- 172.21.15.7:0/3963523392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c018020 con 0x7fd234159bf0 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd22aa00640 1 -- 172.21.15.7:0/3963523392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c014480 con 0x7fd234159bf0 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd22aa00640 1 -- 172.21.15.7:0/3963523392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c014870 con 0x7fd234159bf0 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2341f59a0 con 0x7fd234159bf0 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.390+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2341f5f60 con 0x7fd234159bf0 2024-08-19T00:45:11.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.392+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2340d03c0 con 0x7fd234159bf0 2024-08-19T00:45:11.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.392+0000 7fd22aa00640 1 -- 172.21.15.7:0/3963523392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd22c005d10 con 0x7fd234159bf0 2024-08-19T00:45:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.393+0000 7fd22aa00640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd21006be30 0x7fd21006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.393+0000 7fd22aa00640 1 -- 172.21.15.7:0/3963523392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7fd22c08bc50 con 0x7fd234159bf0 2024-08-19T00:45:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.394+0000 7fd232800640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd21006be30 0x7fd21006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.394+0000 7fd232800640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd21006be30 0x7fd21006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd23409d480 tx=0x7fd224009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:11.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.398+0000 7fd22aa00640 1 -- 172.21.15.7:0/3963523392 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd22c091020 con 0x7fd234159bf0 2024-08-19T00:45:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.619+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd234073630 con 0x7fd234159bf0 2024-08-19T00:45:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.619+0000 7fd22aa00640 1 -- 172.21.15.7:0/3963523392 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v162) ==== 53+0+73 (secure 0 0 0) 0x7fd22c022070 con 0x7fd234159bf0 2024-08-19T00:45:11.621 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:45:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.621+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd21006be30 msgr2=0x7fd21006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.621+0000 7fd239400640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd21006be30 0x7fd21006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd23409d480 tx=0x7fd224009190 comp rx=0 tx=0).stop 2024-08-19T00:45:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.621+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234159bf0 msgr2=0x7fd2340aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.621+0000 7fd239400640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234159bf0 0x7fd2340aea10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009dd0 tx=0x7fd22c00c490 comp rx=0 tx=0).stop 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.621+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 shutdown_connections 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.621+0000 7fd239400640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd21006be30 0x7fd21006e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.621+0000 7fd239400640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd234159bf0 0x7fd2340aea10 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.622+0000 7fd239400640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340cea40 0x7fd23409d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.622+0000 7fd239400640 1 --2- 172.21.15.7:0/3963523392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340739a0 0x7fd234155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.622+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 >> 172.21.15.7:0/3963523392 conn(0x7fd23406bc70 msgr2=0x7fd234075280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.622+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 shutdown_connections 2024-08-19T00:45:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11.622+0000 7fd239400640 1 -- 172.21.15.7:0/3963523392 wait complete. 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:45:11.639 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:45:11.640 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:45:11.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:11.640 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:45:11.715 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:45:11.715 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:45:11.715 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:45:11.715 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:45:11.716 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42350sec preferred_lft 42350sec 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:45:11.717 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:45:11.718 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:45:11.718 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:11.718 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:45:11.718 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:45:11.718 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:45:11.718 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:11.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:11.718 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:45:11.809 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:45:11.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:11.812 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:45:11.848 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:45:11.848 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:45:11.849 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:45:11.849 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:45:11.849 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:45:11.849 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:45:11.849 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:45:11.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:45:11.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:45:11.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:45:11.849 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:45:11.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:45:12.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:45:12.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:12.047 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:45:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:45:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:45:12.084 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:45:12.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:12.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:45:12.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:45:12.181 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:12.216 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:45:12.216 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:45:12.216 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:12.291 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:45:12.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:12.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:12.422 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:12.422 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:45:12.422 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:45:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:45:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:45:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:45:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:45:12.460 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:45:12.461 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:45:12.461 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:45:12.462 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:45:12.462 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:45:12.462 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:45:12.464 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:45:12.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:12.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:12.520 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:45:12.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:45:12.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:45:12.610 INFO:teuthology.orchestra.run.smithi007.stdout:client7744 2024-08-19T00:45:12.610 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:12.610 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:12.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:12.646 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:45:12.691 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:45:12.725 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:45:12.725 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:45:12.725 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:12.726 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:45:12.726 INFO:teuthology.orchestra.run.smithi007.stdout:sixmegs 2024-08-19T00:45:12.726 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 400.00000000' did not caused DAMAGED state 2024-08-19T00:45:12.726 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 100.00000000.inode' 2024-08-19T00:45:12.726 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:12.726 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:12.801 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:12.801 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:12.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:45:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.074+0000 7f8710200640 1 Processor -- start 2024-08-19T00:45:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.074+0000 7f8710200640 1 -- start start 2024-08-19T00:45:13.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.075+0000 7f8710200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87080d03c0 0x7f8708071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.075+0000 7f8710200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87080b3750 0x7f87080cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.075+0000 7f8710200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87080cdfb0 con 0x7f870806e710 2024-08-19T00:45:13.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.075+0000 7f8710200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f87080cebc0 con 0x7f87080d03c0 2024-08-19T00:45:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.075+0000 7f8710200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87080ce290 con 0x7f87080b3750 2024-08-19T00:45:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870ce00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f870806e710 0x7f87080d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54376/0 (socket says 172.21.15.7:54376) 2024-08-19T00:45:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870ce00640 1 -- 172.21.15.7:0/1886952343 learned_addr learned my addr 172.21.15.7:0/1886952343 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870d800640 1 --2- 172.21.15.7:0/1886952343 >> v2:172.21.15.162:3300/0 conn(0x7f87080d03c0 0x7f8708071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870e200640 1 --2- 172.21.15.7:0/1886952343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87080b3750 0x7f87080cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f8707e00640 1 -- 172.21.15.7:0/1886952343 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160117652 0 0) 0x7f87080cdfb0 con 0x7f870806e710 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f8707e00640 1 -- 172.21.15.7:0/1886952343 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f0003520 con 0x7f870806e710 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870e200640 1 -- 172.21.15.7:0/1886952343 >> v2:172.21.15.162:3300/0 conn(0x7f87080d03c0 msgr2=0x7f8708071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870e200640 1 --2- 172.21.15.7:0/1886952343 >> v2:172.21.15.162:3300/0 conn(0x7f87080d03c0 0x7f8708071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870e200640 1 -- 172.21.15.7:0/1886952343 >> v1:172.21.15.7:6789/0 conn(0x7f870806e710 legacy=0x7f87080d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.076+0000 7f870e200640 1 -- 172.21.15.7:0/1886952343 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87080ce570 con 0x7f87080b3750 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.077+0000 7f870d800640 1 --2- 172.21.15.7:0/1886952343 >> v2:172.21.15.162:3300/0 conn(0x7f87080d03c0 0x7f8708071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f870e200640 1 --2- 172.21.15.7:0/1886952343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87080b3750 0x7f87080cf050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8700009dc0 tx=0x7f870002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b29fe4a2f43a4488 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:13.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8707e00640 1 -- 172.21.15.7:0/1886952343 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870002ae60 con 0x7f87080b3750 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8707e00640 1 -- 172.21.15.7:0/1886952343 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8700007740 con 0x7f87080b3750 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8707e00640 1 -- 172.21.15.7:0/1886952343 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700007b10 con 0x7f87080b3750 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8710200640 1 -- 172.21.15.7:0/1886952343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87080b3750 msgr2=0x7f87080cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8710200640 1 --2- 172.21.15.7:0/1886952343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87080b3750 0x7f87080cf050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8700009dc0 tx=0x7f870002a680 comp rx=0 tx=0).stop 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8710200640 1 -- 172.21.15.7:0/1886952343 shutdown_connections 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8710200640 1 --2- 172.21.15.7:0/1886952343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87080b3750 0x7f87080cf050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8710200640 1 --2- 172.21.15.7:0/1886952343 >> v2:172.21.15.162:3300/0 conn(0x7f87080d03c0 0x7f8708071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.078+0000 7f8710200640 1 -- 172.21.15.7:0/1886952343 >> 172.21.15.7:0/1886952343 conn(0x7f870806bc70 msgr2=0x7f870806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.079+0000 7f8710200640 1 -- 172.21.15.7:0/1886952343 shutdown_connections 2024-08-19T00:45:13.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.079+0000 7f8710200640 1 -- 172.21.15.7:0/1886952343 wait complete. 2024-08-19T00:45:13.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.080+0000 7f8710200640 1 Processor -- start 2024-08-19T00:45:13.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.080+0000 7f8710200640 1 -- start start 2024-08-19T00:45:13.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f8710200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f870806e710 0x7f870815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f8710200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87080b3750 0x7f87080aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f8710200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87080d03c0 0x7f87080af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f8710200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8708073c60 con 0x7f87080d03c0 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f8710200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8708073ae0 con 0x7f87080b3750 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f8710200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87080b3be0 con 0x7f870806e710 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f870e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87080d03c0 0x7f87080af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f870e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87080d03c0 0x7f87080af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60606/0 (socket says 172.21.15.7:60606) 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f870e200640 1 -- 172.21.15.7:0/1739355674 learned_addr learned my addr 172.21.15.7:0/1739355674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f870d800640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f870806e710 0x7f870815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.081+0000 7f870ce00640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87080b3750 0x7f87080aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.082+0000 7f870e200640 1 -- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f870806e710 msgr2=0x7f870815dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.082+0000 7f870e200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f870806e710 0x7f870815dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.082+0000 7f870e200640 1 -- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87080b3750 msgr2=0x7f87080aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.082+0000 7f870e200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87080b3750 0x7f87080aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.082+0000 7f870e200640 1 -- 172.21.15.7:0/1739355674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870815b6d0 con 0x7f87080d03c0 2024-08-19T00:45:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.082+0000 7f870e200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87080d03c0 0x7f87080af490 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ee0 tx=0x7f8700004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.082+0000 7f8705600640 1 -- 172.21.15.7:0/1739355674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700040070 con 0x7f87080d03c0 2024-08-19T00:45:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.083+0000 7f8705600640 1 -- 172.21.15.7:0/1739355674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87000319c0 con 0x7f87080d03c0 2024-08-19T00:45:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.083+0000 7f8705600640 1 -- 172.21.15.7:0/1739355674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700031b90 con 0x7f87080d03c0 2024-08-19T00:45:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.083+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870815b9b0 con 0x7f87080d03c0 2024-08-19T00:45:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.083+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f870815bf70 con 0x7f87080d03c0 2024-08-19T00:45:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.084+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8708071980 con 0x7f87080d03c0 2024-08-19T00:45:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.085+0000 7f8705600640 1 -- 172.21.15.7:0/1739355674 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8700039040 con 0x7f87080d03c0 2024-08-19T00:45:13.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.085+0000 7f8705600640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f86e806be30 0x7f86e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.086+0000 7f8705600640 1 -- 172.21.15.7:0/1739355674 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f87000ac700 con 0x7f87080d03c0 2024-08-19T00:45:13.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.086+0000 7f870d800640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f86e806be30 0x7f86e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.087+0000 7f870d800640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f86e806be30 0x7f86e806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009560 tx=0x7f86fc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:13.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.090+0000 7f8705600640 1 -- 172.21.15.7:0/1739355674 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f870007a800 con 0x7f87080d03c0 2024-08-19T00:45:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.289+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8708168450 con 0x7f87080d03c0 2024-08-19T00:45:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.290+0000 7f8705600640 1 -- 172.21.15.7:0/1739355674 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 24 entries v98) ==== 81+0+1448 (secure 0 0 0) 0x7f870007eb00 con 0x7f87080d03c0 2024-08-19T00:45:13.292 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:45:13.292 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:45:13.292 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:45:13.292 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:45:13.293 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:45:13.294 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:45:13.295 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:listed 24 entries 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f86e806be30 msgr2=0x7f86e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f86e806be30 0x7f86e806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009560 tx=0x7f86fc009190 comp rx=0 tx=0).stop 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87080d03c0 msgr2=0x7f87080af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87080d03c0 0x7f87080af490 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ee0 tx=0x7f8700004a40 comp rx=0 tx=0).stop 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 shutdown_connections 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f86e806be30 0x7f86e806e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87080d03c0 0x7f87080af490 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87080b3750 0x7f87080aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 --2- 172.21.15.7:0/1739355674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f870806e710 0x7f870815dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 >> 172.21.15.7:0/1739355674 conn(0x7f870806bc70 msgr2=0x7f870815aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 shutdown_connections 2024-08-19T00:45:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.292+0000 7f8710200640 1 -- 172.21.15.7:0/1739355674 wait complete. 2024-08-19T00:45:13.309 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:45:13.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:13.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:45:13.381 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:13.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:13.381 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:13.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:13.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.615+0000 7f61e2e00640 1 Processor -- start 2024-08-19T00:45:13.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.615+0000 7f61e2e00640 1 -- start start 2024-08-19T00:45:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61e2e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61dc1585c0 0x7f61dc06f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61e2e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f61dc06f5e0 0x7f61dc0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61e2e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61dc15b290 con 0x7f61dc0ccf30 2024-08-19T00:45:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61e2e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f61dc06ecd0 con 0x7f61dc1585c0 2024-08-19T00:45:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61e2e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f61dc0cd380 con 0x7f61dc06f5e0 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61dbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61dc1585c0 0x7f61dc06f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61dbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61dc1585c0 0x7f61dc06f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60620/0 (socket says 172.21.15.7:60620) 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.616+0000 7f61dbe00640 1 -- 172.21.15.7:0/99420875 learned_addr learned my addr 172.21.15.7:0/99420875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.617+0000 7f61d3e00640 1 --2- 172.21.15.7:0/99420875 >> v2:172.21.15.162:3300/0 conn(0x7f61dc06f5e0 0x7f61dc0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.617+0000 7f61dbe00640 1 -- 172.21.15.7:0/99420875 >> v2:172.21.15.162:3300/0 conn(0x7f61dc06f5e0 msgr2=0x7f61dc0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.617+0000 7f61dbe00640 1 --2- 172.21.15.7:0/99420875 >> v2:172.21.15.162:3300/0 conn(0x7f61dc06f5e0 0x7f61dc0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.617+0000 7f61dbe00640 1 -- 172.21.15.7:0/99420875 >> v1:172.21.15.162:6789/0 conn(0x7f61dc0ccf30 legacy=0x7f61dc15e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.617+0000 7f61dbe00640 1 -- 172.21.15.7:0/99420875 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc15b570 con 0x7f61dc1585c0 2024-08-19T00:45:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.618+0000 7f61dbe00640 1 --2- 172.21.15.7:0/99420875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc06f0a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0cdab0 tx=0x7f61cc02b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7398f27bae4d0904 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.618+0000 7f61db400640 1 -- 172.21.15.7:0/99420875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc00b040 con 0x7f61dc1585c0 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.618+0000 7f61db400640 1 -- 172.21.15.7:0/99420875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc02be50 con 0x7f61dc1585c0 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.618+0000 7f61db400640 1 -- 172.21.15.7:0/99420875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc030930 con 0x7f61dc1585c0 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 -- 172.21.15.7:0/99420875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 msgr2=0x7f61dc06f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 --2- 172.21.15.7:0/99420875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc06f0a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0cdab0 tx=0x7f61cc02b630 comp rx=0 tx=0).stop 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 -- 172.21.15.7:0/99420875 shutdown_connections 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 --2- 172.21.15.7:0/99420875 >> v2:172.21.15.162:3300/0 conn(0x7f61dc06f5e0 0x7f61dc0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 --2- 172.21.15.7:0/99420875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc06f0a0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 -- 172.21.15.7:0/99420875 >> 172.21.15.7:0/99420875 conn(0x7f61dc06bc70 msgr2=0x7f61dc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 -- 172.21.15.7:0/99420875 shutdown_connections 2024-08-19T00:45:13.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.619+0000 7f61e2e00640 1 -- 172.21.15.7:0/99420875 wait complete. 2024-08-19T00:45:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.621+0000 7f61e2e00640 1 Processor -- start 2024-08-19T00:45:13.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.621+0000 7f61e2e00640 1 -- start start 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e2e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc06f5e0 0x7f61dc155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e2e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc0ccf30 0x7f61dc1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e2e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e2e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc15be10 con 0x7f61dc1585c0 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e2e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc15bb30 con 0x7f61dc0ccf30 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e2e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc071980 con 0x7f61dc06f5e0 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60636/0 (socket says 172.21.15.7:60636) 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 -- 172.21.15.7:0/3814095200 learned_addr learned my addr 172.21.15.7:0/3814095200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61dbe00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc06f5e0 0x7f61dc155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61d3e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc0ccf30 0x7f61dc1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 -- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc06f5e0 msgr2=0x7f61dc155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc06f5e0 0x7f61dc155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 -- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc0ccf30 msgr2=0x7f61dc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc0ccf30 0x7f61dc1589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.622+0000 7f61e0e00640 1 -- 172.21.15.7:0/3814095200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc0ca2f0 con 0x7f61dc1585c0 2024-08-19T00:45:13.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.623+0000 7f61e0e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc158ee0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c7a0 tx=0x7f61d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.623+0000 7f61d8c00640 1 -- 172.21.15.7:0/3814095200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4003b70 con 0x7f61dc1585c0 2024-08-19T00:45:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.623+0000 7f61d8c00640 1 -- 172.21.15.7:0/3814095200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d4003d30 con 0x7f61dc1585c0 2024-08-19T00:45:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.623+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc0ca5d0 con 0x7f61dc1585c0 2024-08-19T00:45:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.623+0000 7f61d8c00640 1 -- 172.21.15.7:0/3814095200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d400aa90 con 0x7f61dc1585c0 2024-08-19T00:45:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.623+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc15bf90 con 0x7f61dc1585c0 2024-08-19T00:45:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.624+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61dc15ae60 con 0x7f61dc1585c0 2024-08-19T00:45:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.625+0000 7f61d8c00640 1 -- 172.21.15.7:0/3814095200 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61d400ac30 con 0x7f61dc1585c0 2024-08-19T00:45:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.626+0000 7f61d8c00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be60 0x7f61b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.626+0000 7f61d8c00640 1 -- 172.21.15.7:0/3814095200 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6741+0+0 (secure 0 0 0) 0x7f61d408afd0 con 0x7f61dc1585c0 2024-08-19T00:45:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.626+0000 7f61dbe00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be60 0x7f61b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.627+0000 7f61dbe00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be60 0x7f61b806e320 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f61cc035000 tx=0x7f61cc00c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.631+0000 7f61d8c00640 1 -- 172.21.15.7:0/3814095200 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f61d4058f10 con 0x7f61dc1585c0 2024-08-19T00:45:13.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.852+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f61dc0cc7d0 con 0x7f61dc1585c0 2024-08-19T00:45:13.854 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:13.853+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.855+0000 7f61d8c00640 1 -- 172.21.15.7:0/3814095200 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v163) ==== 161+0+0 (secure 0 0 0) 0x7f61d405d210 con 0x7f61dc1585c0 2024-08-19T00:45:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be60 msgr2=0x7f61b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be60 0x7f61b806e320 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f61cc035000 tx=0x7f61cc00c040 comp rx=0 tx=0).stop 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 msgr2=0x7f61dc158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc158ee0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c7a0 tx=0x7f61d400cc60 comp rx=0 tx=0).stop 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 shutdown_connections 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be60 0x7f61b806e320 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61dc1585c0 0x7f61dc158ee0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc0ccf30 0x7f61dc1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 --2- 172.21.15.7:0/3814095200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc06f5e0 0x7f61dc155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.858+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 >> 172.21.15.7:0/3814095200 conn(0x7f61dc06bc70 msgr2=0x7f61dc0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.859+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 shutdown_connections 2024-08-19T00:45:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:13.859+0000 7f61e2e00640 1 -- 172.21.15.7:0/3814095200 wait complete. 2024-08-19T00:45:13.865 INFO:tasks.ceph.mds.a.smithi007.stderr: -553> 2024-08-19T00:45:11.262+0000 7f498d800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:45:13.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:13.907 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:45:14.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.038+0000 7fc7b6600640 1 Processor -- start 2024-08-19T00:45:14.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.038+0000 7fc7b6600640 1 -- start start 2024-08-19T00:45:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7b6600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b00d03c0 0x7fc7b00d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7b6600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc7b00b4380 0x7fc7b00b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7b6600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b00b50b0 con 0x7fc7b015f5b0 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7b6600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b015f990 con 0x7fc7b00b4380 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7b6600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b00cf120 con 0x7fc7b00d03c0 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7a7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b00d03c0 0x7fc7b00d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7afe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc7b00b4380 0x7fc7b00b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7af400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc7b015f5b0 0x7fc7b00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:38698/0 (socket says 172.21.15.7:38698) 2024-08-19T00:45:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7afe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc7b00b4380 0x7fc7b00b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:40662/0 (socket says 172.21.15.7:40662) 2024-08-19T00:45:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7a7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b00d03c0 0x7fc7b00d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:51530/0 (socket says 172.21.15.7:51530) 2024-08-19T00:45:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.040+0000 7fc7af400640 1 -- 172.21.15.7:0/4098930613 learned_addr learned my addr 172.21.15.7:0/4098930613 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.041+0000 7fc7a7e00640 1 -- 172.21.15.7:0/4098930613 >> v2:172.21.15.162:3300/0 conn(0x7fc7b00b4380 msgr2=0x7fc7b00b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.041+0000 7fc7a7e00640 1 --2- 172.21.15.7:0/4098930613 >> v2:172.21.15.162:3300/0 conn(0x7fc7b00b4380 0x7fc7b00b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.041+0000 7fc7a7e00640 1 -- 172.21.15.7:0/4098930613 >> v1:172.21.15.162:6789/0 conn(0x7fc7b015f5b0 legacy=0x7fc7b00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.041+0000 7fc7a7e00640 1 -- 172.21.15.7:0/4098930613 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b00cead0 con 0x7fc7b00d03c0 2024-08-19T00:45:14.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.041+0000 7fc7afe00640 1 --2- 172.21.15.7:0/4098930613 >> v2:172.21.15.162:3300/0 conn(0x7fc7b00b4380 0x7fc7b00b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.042+0000 7fc7a7e00640 1 --2- 172.21.15.7:0/4098930613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b00d03c0 0x7fc7b00d0800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7980097a0 tx=0x7fc79802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfe96cf1ec8a1c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.042+0000 7fc7aea00640 1 -- 172.21.15.7:0/4098930613 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798037070 con 0x7fc7b00d03c0 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.042+0000 7fc7aea00640 1 -- 172.21.15.7:0/4098930613 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79802ae50 con 0x7fc7b00d03c0 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.042+0000 7fc7aea00640 1 -- 172.21.15.7:0/4098930613 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798032660 con 0x7fc7b00d03c0 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.042+0000 7fc7b6600640 1 -- 172.21.15.7:0/4098930613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b00d03c0 msgr2=0x7fc7b00d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.042+0000 7fc7b6600640 1 --2- 172.21.15.7:0/4098930613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b00d03c0 0x7fc7b00d0800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7980097a0 tx=0x7fc79802a100 comp rx=0 tx=0).stop 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.043+0000 7fc7b6600640 1 -- 172.21.15.7:0/4098930613 shutdown_connections 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.043+0000 7fc7b6600640 1 --2- 172.21.15.7:0/4098930613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b00d03c0 0x7fc7b00d0800 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.043+0000 7fc7b6600640 1 --2- 172.21.15.7:0/4098930613 >> v2:172.21.15.162:3300/0 conn(0x7fc7b00b4380 0x7fc7b00b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.043+0000 7fc7b6600640 1 -- 172.21.15.7:0/4098930613 >> 172.21.15.7:0/4098930613 conn(0x7fc7b006bc70 msgr2=0x7fc7b006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.043+0000 7fc7b6600640 1 -- 172.21.15.7:0/4098930613 shutdown_connections 2024-08-19T00:45:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.043+0000 7fc7b6600640 1 -- 172.21.15.7:0/4098930613 wait complete. 2024-08-19T00:45:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.044+0000 7fc7b6600640 1 Processor -- start 2024-08-19T00:45:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.044+0000 7fc7b6600640 1 -- start start 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.045+0000 7fc7b6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7b00b4380 0x7fc7b01f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.045+0000 7fc7b6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7b00d03c0 0x7fc7b00b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.045+0000 7fc7b6600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b015f5b0 0x7fc7b00b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.045+0000 7fc7b6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b00b4d70 con 0x7fc7b00b4380 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.045+0000 7fc7b6600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b00d0d40 con 0x7fc7b00d03c0 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.045+0000 7fc7b6600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b006e660 con 0x7fc7b015f5b0 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7b00b4380 0x7fc7b01f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7b00b4380 0x7fc7b01f42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33942/0 (socket says 172.21.15.7:33942) 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 -- 172.21.15.7:0/3057342816 learned_addr learned my addr 172.21.15.7:0/3057342816 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7a7e00640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7b00d03c0 0x7fc7b00b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7afe00640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b015f5b0 0x7fc7b00b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 -- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b015f5b0 msgr2=0x7fc7b00b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b015f5b0 0x7fc7b00b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 -- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7b00d03c0 msgr2=0x7fc7b00b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7b00d03c0 0x7fc7b00b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 -- 172.21.15.7:0/3057342816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b00ad240 con 0x7fc7b00b4380 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7afe00640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b015f5b0 0x7fc7b00b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.046+0000 7fc7af400640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7b00b4380 0x7fc7b01f42c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c3c0 tx=0x7fc7a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.047+0000 7fc7a7400640 1 -- 172.21.15.7:0/3057342816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0017070 con 0x7fc7b00b4380 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.047+0000 7fc7a7400640 1 -- 172.21.15.7:0/3057342816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a0005ce0 con 0x7fc7b00b4380 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.047+0000 7fc7a7400640 1 -- 172.21.15.7:0/3057342816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00072f0 con 0x7fc7b00b4380 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.047+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b00ad520 con 0x7fc7b00b4380 2024-08-19T00:45:14.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.047+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b00adae0 con 0x7fc7b00b4380 2024-08-19T00:45:14.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.048+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b0073c50 con 0x7fc7b00b4380 2024-08-19T00:45:14.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.049+0000 7fc7a7400640 1 -- 172.21.15.7:0/3057342816 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7a001a070 con 0x7fc7b00b4380 2024-08-19T00:45:14.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.050+0000 7fc7a7400640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc78c06be30 0x7fc78c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.050+0000 7fc7a7400640 1 -- 172.21.15.7:0/3057342816 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6827+0+0 (secure 0 0 0) 0x7fc7a008a630 con 0x7fc7b00b4380 2024-08-19T00:45:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.050+0000 7fc7a7e00640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc78c06be30 0x7fc78c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.051+0000 7fc7a7e00640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc78c06be30 0x7fc78c06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc798034000 tx=0x7fc79802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:14.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.054+0000 7fc7a7400640 1 -- 172.21.15.7:0/3057342816 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc7a0058b70 con 0x7fc7b00b4380 2024-08-19T00:45:14.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.307+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fc7b00adef0 con 0x7fc7b00b4380 2024-08-19T00:45:14.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.857+0000 7fc7a7400640 1 -- 172.21.15.7:0/3057342816 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v164) ==== 107+0+0 (secure 0 0 0) 0x7fc7a0058470 con 0x7fc7b00b4380 2024-08-19T00:45:14.859 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc78c06be30 msgr2=0x7fc78c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc78c06be30 0x7fc78c06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc798034000 tx=0x7fc79802e000 comp rx=0 tx=0).stop 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7b00b4380 msgr2=0x7fc7b01f42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7b00b4380 0x7fc7b01f42c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c3c0 tx=0x7fc7a000c880 comp rx=0 tx=0).stop 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 shutdown_connections 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc78c06be30 0x7fc78c06e2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7b015f5b0 0x7fc7b00b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7b00d03c0 0x7fc7b00b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 --2- 172.21.15.7:0/3057342816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7b00b4380 0x7fc7b01f42c0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 >> 172.21.15.7:0/3057342816 conn(0x7fc7b006bc70 msgr2=0x7fc7b0157990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 shutdown_connections 2024-08-19T00:45:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.860+0000 7fc7b6600640 1 -- 172.21.15.7:0/3057342816 wait complete. 2024-08-19T00:45:14.881 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:15.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:14.999+0000 7f55b3578f40 1 Processor -- start 2024-08-19T00:45:15.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.000+0000 7f55b3578f40 1 -- start start 2024-08-19T00:45:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.000+0000 7f55b3578f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c249003f40 0x55c24901d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.000+0000 7f55b3578f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2490055b0 0x55c2490a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.000+0000 7f55b3578f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249005990 0x55c2490aba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.000+0000 7f55b3578f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c2490048f0 con 0x55c249005990 2024-08-19T00:45:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.000+0000 7f55b3578f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c248f79d00 con 0x55c2490055b0 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.000+0000 7f55b3578f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c2490aadc0 con 0x55c249003f40 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249005990 0x55c2490aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b0800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c249003f40 0x55c24901d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b0800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c249003f40 0x55c24901d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:51546/0 (socket says 172.21.15.7:51546) 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55afe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2490055b0 0x55c2490a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b0800640 1 -- 172.21.15.7:0/732393371 learned_addr learned my addr 172.21.15.7:0/732393371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b1200640 1 -- 172.21.15.7:0/732393371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c249003f40 msgr2=0x55c24901d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b1200640 1 --2- 172.21.15.7:0/732393371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c249003f40 0x55c24901d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b1200640 1 -- 172.21.15.7:0/732393371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2490055b0 msgr2=0x55c2490a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b1200640 1 --2- 172.21.15.7:0/732393371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2490055b0 0x55c2490a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.001+0000 7f55b1200640 1 -- 172.21.15.7:0/732393371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c248efeb30 con 0x55c249005990 2024-08-19T00:45:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b1200640 1 --2- 172.21.15.7:0/732393371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249005990 0x55c2490aba20 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f55a800a870 tx=0x7f55a800ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4df816387d40792 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55aea00640 1 -- 172.21.15.7:0/732393371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a800d9c0 con 0x55c249005990 2024-08-19T00:45:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55aea00640 1 -- 172.21.15.7:0/732393371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a800db60 con 0x55c249005990 2024-08-19T00:45:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55aea00640 1 -- 172.21.15.7:0/732393371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8012470 con 0x55c249005990 2024-08-19T00:45:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b3578f40 1 -- 172.21.15.7:0/732393371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249005990 msgr2=0x55c2490aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b3578f40 1 --2- 172.21.15.7:0/732393371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249005990 0x55c2490aba20 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f55a800a870 tx=0x7f55a800ad30 comp rx=0 tx=0).stop 2024-08-19T00:45:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b3578f40 1 -- 172.21.15.7:0/732393371 shutdown_connections 2024-08-19T00:45:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b3578f40 1 --2- 172.21.15.7:0/732393371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249005990 0x55c2490aba20 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b3578f40 1 --2- 172.21.15.7:0/732393371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c2490055b0 0x55c2490a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b3578f40 1 --2- 172.21.15.7:0/732393371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c249003f40 0x55c24901d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.002+0000 7f55b3578f40 1 -- 172.21.15.7:0/732393371 >> 172.21.15.7:0/732393371 conn(0x55c2490024e0 msgr2=0x55c249001870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.003+0000 7f55b3578f40 1 -- 172.21.15.7:0/732393371 shutdown_connections 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.003+0000 7f55b3578f40 1 -- 172.21.15.7:0/732393371 wait complete. 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.003+0000 7f55b3578f40 1 Processor -- start 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.003+0000 7f55b3578f40 1 -- start start 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.004+0000 7f55b3578f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249003f40 0x55c2490a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.004+0000 7f55b3578f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2490055b0 0x55c2490a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.004+0000 7f55b3578f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c249005990 0x55c2490a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.004+0000 7f55b3578f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c2490a4040 con 0x55c249003f40 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.004+0000 7f55b3578f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c2490016c0 con 0x55c249005990 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.004+0000 7f55b3578f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c24901e020 con 0x55c2490055b0 2024-08-19T00:45:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.004+0000 7f55b0800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249003f40 0x55c2490a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249003f40 0x55c2490a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33946/0 (socket says 172.21.15.7:33946) 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 learned_addr learned my addr 172.21.15.7:0/2797784109 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55afe00640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2490055b0 0x55c2490a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b1200640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c249005990 0x55c2490a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2490055b0 msgr2=0x55c2490a6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c2490055b0 0x55c2490a6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c249005990 msgr2=0x55c2490a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c249005990 0x55c2490a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c248f3b080 con 0x55c249003f40 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.005+0000 7f55b0800640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249003f40 0x55c2490a5c50 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f55a4045db0 tx=0x7f55a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.006+0000 7f55ad600640 1 -- 172.21.15.7:0/2797784109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4064070 con 0x55c249003f40 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.006+0000 7f55ad600640 1 -- 172.21.15.7:0/2797784109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a4054c30 con 0x55c249003f40 2024-08-19T00:45:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.006+0000 7f55ad600640 1 -- 172.21.15.7:0/2797784109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4059040 con 0x55c249003f40 2024-08-19T00:45:15.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.006+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2490a6330 con 0x55c249003f40 2024-08-19T00:45:15.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.006+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2490a68f0 con 0x55c249003f40 2024-08-19T00:45:15.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.008+0000 7f55ad600640 1 -- 172.21.15.7:0/2797784109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55a4067070 con 0x55c249003f40 2024-08-19T00:45:15.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.008+0000 7f55ad600640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f559006a840 0x7f559006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.009+0000 7f55ad600640 1 -- 172.21.15.7:0/2797784109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6827+0+0 (secure 0 0 0) 0x7f55a40cdfa0 con 0x55c249003f40 2024-08-19T00:45:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.009+0000 7f55afe00640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f559006a840 0x7f559006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.011 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.009+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c249140930 0x55c248fd39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.009+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249132fe0 con 0x55c249140930 2024-08-19T00:45:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.009+0000 7f55afe00640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f559006a840 0x7f559006cd00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55c2490ac4f0 tx=0x7f559c0016f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.010+0000 7f55b1200640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c249140930 0x55c248fd39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.010+0000 7f55b1200640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c249140930 0x55c248fd39b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.012+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v99'381 uv355 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.012+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c2491333c0 con 0x55c249140930 2024-08-19T00:45:15.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.013+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v99'382 uv382 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.013+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c2491337b0 con 0x55c249140930 2024-08-19T00:45:15.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.015+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v99'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.017 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:15.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.015+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914da90 con 0x55c249140930 2024-08-19T00:45:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.016+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v99'384 uv384 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.017+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914de30 con 0x55c249140930 2024-08-19T00:45:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.018+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v99'385 uv385 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.018+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914ca80 con 0x55c249140930 2024-08-19T00:45:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.020+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v99'386 uv386 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.020+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914ce70 con 0x55c249140930 2024-08-19T00:45:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.021+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v99'387 uv361 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.021+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d260 con 0x55c249140930 2024-08-19T00:45:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.023+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v99'388 uv388 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.023+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d260 con 0x55c249140930 2024-08-19T00:45:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.024+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v99'389 uv389 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.026 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.024+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.026+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v99'390 uv390 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.026+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.027+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v99'391 uv391 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.028+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.029+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v99'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.029+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.031+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v99'393 uv368 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.031+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.032+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v99'394 uv394 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.032+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.034+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v99'395 uv395 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.036 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.034+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.035+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v99'396 uv396 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.036+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.037+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v99'397 uv397 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.037+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914d210 con 0x55c249140930 2024-08-19T00:45:15.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.038+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v99'398 uv398 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.039+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.040+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v99'399 uv399 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.040+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.041+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v99'400 uv374 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.041+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.043+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v99'401 uv401 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.043+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.046 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.045+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v99'402 uv402 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.045+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914f1e0 con 0x55c249140930 2024-08-19T00:45:15.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.046+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v99'403 uv403 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.046+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914f1e0 con 0x55c249140930 2024-08-19T00:45:15.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.048+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v99'404 uv404 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.048+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.049+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v99'405 uv405 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.049+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.051+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v99'406 uv380 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.051+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.052+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v99'407 uv407 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.052+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.054+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v99'408 uv408 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.056 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:15.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.054+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914f1e0 con 0x55c249140930 2024-08-19T00:45:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.055+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v99'409 uv409 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.055+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914f1e0 con 0x55c249140930 2024-08-19T00:45:15.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.057+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v99'410 uv410 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.057+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24914e1d0 con 0x55c249140930 2024-08-19T00:45:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.058+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v99'411 uv411 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.058+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c24914e6e0 0x55c249150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.058+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249151010 con 0x55c24914e6e0 2024-08-19T00:45:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.058+0000 7f55b0800640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c24914e6e0 0x55c249150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.059+0000 7f55b0800640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c24914e6e0 0x55c249150ad0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.061+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v99'287 uv266 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.061+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c2491513b0 con 0x55c24914e6e0 2024-08-19T00:45:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.062+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v99'288 uv288 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.062+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249151750 con 0x55c24914e6e0 2024-08-19T00:45:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.064+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v99'289 uv289 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.065 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:15.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.064+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249151af0 con 0x55c24914e6e0 2024-08-19T00:45:15.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.065+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v99'290 uv290 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.065+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249151e90 con 0x55c24914e6e0 2024-08-19T00:45:15.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.067+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v99'291 uv291 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.067+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152230 con 0x55c24914e6e0 2024-08-19T00:45:15.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.068+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v99'292 uv285 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.068+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c2491525d0 con 0x55c24914e6e0 2024-08-19T00:45:15.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.070+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v99'293 uv293 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.070+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.072 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.071+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v99'294 uv294 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.071+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.073+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v99'295 uv295 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.073+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.074+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v99'296 uv296 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.074+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.075+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v99'297 uv286 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.075+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.077+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v99'298 uv298 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.077+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.078+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v99'299 uv299 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.078+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249157060 con 0x55c24914e6e0 2024-08-19T00:45:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.080+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v99'300 uv300 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.080+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249157060 con 0x55c24914e6e0 2024-08-19T00:45:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.082+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v99'301 uv301 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.082+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.083+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v99'302 uv282 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.083+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.084+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v99'303 uv303 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.084+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.086+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v99'304 uv304 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.087 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:15.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.086+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249153980 con 0x55c24914e6e0 2024-08-19T00:45:15.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.087+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v99'305 uv305 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.087+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249153980 con 0x55c24914e6e0 2024-08-19T00:45:15.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.089+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v99'306 uv306 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.089+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249152970 con 0x55c24914e6e0 2024-08-19T00:45:15.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.090+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v99'307 uv307 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24914e6e0 2024-08-19T00:45:15.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.090+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c249152e80 0x55c249155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.090+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249155890 con 0x55c249152e80 2024-08-19T00:45:15.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.091+0000 7f55afe00640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c249152e80 0x55c249155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.091+0000 7f55afe00640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c249152e80 0x55c249155270 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.092+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v99'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f559c00fa50 con 0x55c249152e80 2024-08-19T00:45:15.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.092+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249156110 con 0x55c249152e80 2024-08-19T00:45:15.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.094+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v99'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c00fa50 con 0x55c249152e80 2024-08-19T00:45:15.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.094+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c2491564b0 con 0x55c249152e80 2024-08-19T00:45:15.096 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:15.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.095+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v99'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c00fa50 con 0x55c249152e80 2024-08-19T00:45:15.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.095+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249157860 con 0x55c249152e80 2024-08-19T00:45:15.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.096+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v99'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c00fa50 con 0x55c249152e80 2024-08-19T00:45:15.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.096+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249157ce0 con 0x55c249152e80 2024-08-19T00:45:15.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.097+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v99'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c00fa50 con 0x55c249152e80 2024-08-19T00:45:15.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.097+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249156850 con 0x55c249152e80 2024-08-19T00:45:15.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.099+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v99'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c00fa50 con 0x55c249152e80 2024-08-19T00:45:15.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.099+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249156c40 con 0x55c249140930 2024-08-19T00:45:15.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.100+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v99'60 uv59 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.100+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249156c40 con 0x55c249140930 2024-08-19T00:45:15.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.101+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v99'61 uv61 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.101+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249156c40 con 0x55c249140930 2024-08-19T00:45:15.104 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:15.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.103+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v99'62 uv62 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.103+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249156c60 con 0x55c249140930 2024-08-19T00:45:15.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.104+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v99'63 uv63 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.104+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2491580d0 0x55c24915a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.104+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915aa00 con 0x55c2491580d0 2024-08-19T00:45:15.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.105+0000 7f55b1200640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2491580d0 0x55c24915a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.106+0000 7f55b1200640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2491580d0 0x55c24915a4c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.107+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v99'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.107+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c24915add0 con 0x55c2491580d0 2024-08-19T00:45:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.108+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v99'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.108+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915add0 con 0x55c2491580d0 2024-08-19T00:45:15.114 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:15.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.110+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v99'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.110+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915bde0 con 0x55c2491580d0 2024-08-19T00:45:15.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.111+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v99'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.111+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915bde0 con 0x55c2491580d0 2024-08-19T00:45:15.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.112+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v99'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.112+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915add0 con 0x55c2491580d0 2024-08-19T00:45:15.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.114+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v99'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.114+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c24915b6a0 0x55c24915bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.114+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e1b0 con 0x55c24915b6a0 2024-08-19T00:45:15.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.114+0000 7f55b0800640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c24915b6a0 0x55c24915bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.115+0000 7f55b0800640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c24915b6a0 0x55c24915bac0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.116+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v99'138 uv132 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.116+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e1b0 con 0x55c24915b6a0 2024-08-19T00:45:15.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.117+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v99'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.117+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e1b0 con 0x55c24915b6a0 2024-08-19T00:45:15.120 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.118+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v99'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.118+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915f5e0 con 0x55c24915b6a0 2024-08-19T00:45:15.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.120+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v99'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.120+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915f5e0 con 0x55c24915b6a0 2024-08-19T00:45:15.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.121+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v99'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.121+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e5d0 con 0x55c24915b6a0 2024-08-19T00:45:15.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.123+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v99'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.123+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e5d0 con 0x55c24915b6a0 2024-08-19T00:45:15.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.124+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v99'144 uv137 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.124+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e1d0 con 0x55c24915b6a0 2024-08-19T00:45:15.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.126+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v99'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.126+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e620 con 0x55c24915b6a0 2024-08-19T00:45:15.128 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:15.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.127+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v99'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a4070070 con 0x55c24915b6a0 2024-08-19T00:45:15.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.127+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e620 con 0x55c24915b6a0 2024-08-19T00:45:15.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.128+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v99'147 uv147 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a40be040 con 0x55c24915b6a0 2024-08-19T00:45:15.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.128+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c24915e5d0 con 0x55c24915b6a0 2024-08-19T00:45:15.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.130+0000 7f55b0800640 1 -- 172.21.15.7:0/2797784109 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v99'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a40be040 con 0x55c24915b6a0 2024-08-19T00:45:15.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.130+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c24915ef70 0x55c249161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.130+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c2491618a0 con 0x55c24915ef70 2024-08-19T00:45:15.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.130+0000 7f55afe00640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c24915ef70 0x55c249161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.131+0000 7f55afe00640 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c24915ef70 0x55c249161360 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.132+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v99'61 uv60 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.132+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249161c70 con 0x55c24915ef70 2024-08-19T00:45:15.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.133+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v99'62 uv62 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.133+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c24915ef70 2024-08-19T00:45:15.136 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:15.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.135+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v99'63 uv63 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.135+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c24915ef70 2024-08-19T00:45:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.136+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v99'64 uv64 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.136+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c24915ef70 2024-08-19T00:45:15.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.138+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v99'65 uv65 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.138+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249140930 2024-08-19T00:45:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.139+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v99'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.139+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249140930 2024-08-19T00:45:15.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.141+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v99'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.141+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249140930 2024-08-19T00:45:15.143 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:15.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.142+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v99'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.142+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c2491630a0 con 0x55c249140930 2024-08-19T00:45:15.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.143+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v99'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.143+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c2491630a0 con 0x55c249140930 2024-08-19T00:45:15.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.145+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v99'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.145+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249140930 2024-08-19T00:45:15.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.146+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v99'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c249140930 2024-08-19T00:45:15.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.146+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.147+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v99'122 uv116 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.147+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.149+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v99'123 uv123 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.149+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.152 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:15.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.150+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v99'124 uv124 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.150+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.152+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v99'125 uv125 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.152+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.153+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v99'126 uv126 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.153+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.155+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v99'127 uv121 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.155+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.156+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v99'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.156+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.159 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:15.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.158+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v99'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.158+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162090 con 0x55c249152e80 2024-08-19T00:45:15.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.159+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v99'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.159+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249164ea0 con 0x55c249152e80 2024-08-19T00:45:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.161+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v99'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c249152e80 2024-08-19T00:45:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.161+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.162+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v99'57 uv55 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.162+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.164+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v99'58 uv58 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.164+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.165+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v99'59 uv59 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.167 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.166+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.167+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v99'60 uv60 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.167+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.168+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v99'75 uv74 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.169+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.170+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v99'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.170+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.171+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v99'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.173 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.171+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249163550 con 0x55c2491580d0 2024-08-19T00:45:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.173+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v99'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.173+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249163550 con 0x55c2491580d0 2024-08-19T00:45:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.174+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v99'79 uv79 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.174+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c2491580d0 2024-08-19T00:45:15.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.176+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v99'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f55a8018020 con 0x55c2491580d0 2024-08-19T00:45:15.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.176+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.177+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v99'64 uv63 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.177+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.178+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v99'65 uv65 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.178+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.180+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v99'66 uv66 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.180+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.181+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v99'67 uv67 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.181+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.182+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v99'68 uv68 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.182+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.184+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v99'157 uv148 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.184+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.185+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v99'158 uv158 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.185+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.186+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v99'159 uv159 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.188 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.186+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.188+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v99'160 uv160 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.188+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.189+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v99'161 uv161 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.189+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.190+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v99'162 uv155 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.190+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.191+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v99'163 uv163 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.191+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.193+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v99'164 uv164 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.194 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:15.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.193+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.194+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v99'165 uv165 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.194+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.195+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v99'166 uv166 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.195+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162540 con 0x55c24915ef70 2024-08-19T00:45:15.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.196+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v99'167 uv167 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.196+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) -- 0x55c249162de0 con 0x55c24915ef70 2024-08-19T00:45:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55afe00640 1 -- 172.21.15.7:0/2797784109 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v99'168 uv168 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f559c017040 con 0x55c24915ef70 2024-08-19T00:45:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c24914e6e0 msgr2=0x55c249150ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c24914e6e0 0x55c249150ad0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c24915b6a0 msgr2=0x55c24915bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c24915b6a0 0x55c24915bac0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c24915ef70 msgr2=0x55c249161360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c24915ef70 0x55c249161360 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c249152e80 msgr2=0x55c249155270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c249152e80 0x55c249155270 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 reap_dead start 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c249140930 msgr2=0x55c248fd39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c249140930 0x55c248fd39b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b1200640 1 -- 172.21.15.7:0/2797784109 reap_dead start 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2491580d0 msgr2=0x55c24915a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2491580d0 0x55c24915a4c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f559006a840 msgr2=0x7f559006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f559006a840 0x7f559006cd00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55c2490ac4f0 tx=0x7f559c0016f0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249003f40 msgr2=0x55c2490a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249003f40 0x55c2490a5c50 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f55a4045db0 tx=0x7f55a4002fb0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 shutdown_connections 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f559006a840 0x7f559006cd00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c2491580d0 0x55c24915a4c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 --2- 172.21.15.7:0/2797784109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c249003f40 0x55c2490a5c50 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 >> 172.21.15.7:0/2797784109 conn(0x55c2490024e0 msgr2=0x55c2490a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 shutdown_connections 2024-08-19T00:45:15.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.198+0000 7f55b3578f40 1 -- 172.21.15.7:0/2797784109 wait complete. 2024-08-19T00:45:15.204 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 100.00000000.inode 2024-08-19T00:45:15.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.319+0000 7fd7e77fef40 1 Processor -- start 2024-08-19T00:45:15.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.319+0000 7fd7e77fef40 1 -- start start 2024-08-19T00:45:15.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e77fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af537620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e77fef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af49c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e77fef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 0x55c1af4995b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e77fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c1af5430a0 con 0x55c1af49d5b0 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e77fef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c1af542dc0 con 0x55c1af4b58d0 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e77fef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c1af543380 con 0x55c1af49d990 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af537620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af537620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33970/0 (socket says 172.21.15.7:33970) 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 -- 172.21.15.7:0/3079982917 learned_addr learned my addr 172.21.15.7:0/3079982917 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7dfe00640 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af49c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e5400640 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 0x55c1af4995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 -- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 msgr2=0x55c1af49c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af49c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 -- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 msgr2=0x55c1af4995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 0x55c1af4995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7e4a00640 1 -- 172.21.15.7:0/3079982917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1af3a0130 con 0x55c1af49d5b0 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.320+0000 7fd7dfe00640 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af49c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e4a00640 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af537620 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800a5e0 tx=0x7fd7d8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d85243b2a0958d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7dea00640 1 -- 172.21.15.7:0/3079982917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8008a40 con 0x55c1af49d5b0 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7dea00640 1 -- 172.21.15.7:0/3079982917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d8008c00 con 0x55c1af49d5b0 2024-08-19T00:45:15.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7dea00640 1 -- 172.21.15.7:0/3079982917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8013440 con 0x55c1af49d5b0 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 -- 172.21.15.7:0/3079982917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 msgr2=0x55c1af537620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af537620 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800a5e0 tx=0x7fd7d8005f90 comp rx=0 tx=0).stop 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 -- 172.21.15.7:0/3079982917 shutdown_connections 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 0x55c1af4995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af49c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/3079982917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af537620 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 -- 172.21.15.7:0/3079982917 >> 172.21.15.7:0/3079982917 conn(0x55c1af49a4e0 msgr2=0x55c1af46b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 -- 172.21.15.7:0/3079982917 shutdown_connections 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.321+0000 7fd7e77fef40 1 -- 172.21.15.7:0/3079982917 wait complete. 2024-08-19T00:45:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.322+0000 7fd7e77fef40 1 Processor -- start 2024-08-19T00:45:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.322+0000 7fd7e77fef40 1 -- start start 2024-08-19T00:45:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e77fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af499a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e77fef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af526270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e77fef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 0x55c1af52b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e77fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c1af535400 con 0x55c1af49d5b0 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e77fef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c1af535120 con 0x55c1af4b58d0 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e77fef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c1af4985b0 con 0x55c1af49d990 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af499a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af499a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33982/0 (socket says 172.21.15.7:33982) 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e4a00640 1 -- 172.21.15.7:0/2336821530 learned_addr learned my addr 172.21.15.7:0/2336821530 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7dfe00640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af526270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.323+0000 7fd7e5400640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 0x55c1af52b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7e4a00640 1 -- 172.21.15.7:0/2336821530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 msgr2=0x55c1af526270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7e4a00640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1af49d990 0x55c1af526270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7e4a00640 1 -- 172.21.15.7:0/2336821530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 msgr2=0x55c1af52b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7e4a00640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1af4b58d0 0x55c1af52b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7e4a00640 1 -- 172.21.15.7:0/2336821530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1af396b30 con 0x55c1af49d5b0 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7e4a00640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af499a10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8010000 tx=0x7fd7d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7dd600640 1 -- 172.21.15.7:0/2336821530 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8020070 con 0x55c1af49d5b0 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7dd600640 1 -- 172.21.15.7:0/2336821530 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d8013a80 con 0x55c1af49d5b0 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7dd600640 1 -- 172.21.15.7:0/2336821530 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8013e50 con 0x55c1af49d5b0 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.324+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c1af3d3080 con 0x55c1af49d5b0 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.325+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1af5267b0 con 0x55c1af49d5b0 2024-08-19T00:45:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.326+0000 7fd7dd600640 1 -- 172.21.15.7:0/2336821530 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7d8023070 con 0x55c1af49d5b0 2024-08-19T00:45:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.327+0000 7fd7dd600640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7c406a9e0 0x7fd7c406cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.327+0000 7fd7dd600640 1 -- 172.21.15.7:0/2336821530 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6827+0+0 (secure 0 0 0) 0x7fd7d808b8c0 con 0x55c1af49d5b0 2024-08-19T00:45:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.328+0000 7fd7dfe00640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7c406a9e0 0x7fd7c406cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.328+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c1af5dbc80 0x55c1af5dc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.328+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) -- 0x55c1af52e0d0 con 0x55c1af5dbc80 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.328+0000 7fd7e5400640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c1af5dbc80 0x55c1af5dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.328+0000 7fd7dfe00640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7c406a9e0 0x7fd7c406cea0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0057000 tx=0x7fd7d005e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.329+0000 7fd7e5400640 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c1af5dbc80 0x55c1af5dc080 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e5400640 1 -- 172.21.15.7:0/2336821530 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 100.00000000.inode [delete] v99'169 uv169 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fd7e000d750 con 0x55c1af5dbc80 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c1af5dbc80 msgr2=0x55c1af5dc080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c1af5dbc80 0x55c1af5dc080 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7c406a9e0 msgr2=0x7fd7c406cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7c406a9e0 0x7fd7c406cea0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0057000 tx=0x7fd7d005e040 comp rx=0 tx=0).stop 2024-08-19T00:45:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 msgr2=0x55c1af499a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 --2- 172.21.15.7:0/2336821530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1af49d5b0 0x55c1af499a10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8010000 tx=0x7fd7d8002fb0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e5400640 1 -- 172.21.15.7:0/2336821530 reap_dead start 2024-08-19T00:45:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 shutdown_connections 2024-08-19T00:45:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 >> 172.21.15.7:0/2336821530 conn(0x55c1af49a4e0 msgr2=0x55c1af49c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 shutdown_connections 2024-08-19T00:45:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.330+0000 7fd7e77fef40 1 -- 172.21.15.7:0/2336821530 wait complete. 2024-08-19T00:45:15.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.496+0000 7f00ae600640 1 Processor -- start 2024-08-19T00:45:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.496+0000 7f00ae600640 1 -- start start 2024-08-19T00:45:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00ae600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00a813dc30 0x7f00a8140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00ae600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00a8140640 0x7f00a806d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00ae600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a815e930 con 0x7f00a806db40 2024-08-19T00:45:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00ae600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f00a815ec10 con 0x7f00a8140640 2024-08-19T00:45:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00ae600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00a815eef0 con 0x7f00a813dc30 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00adc00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f00a806db40 0x7f00a8072920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36136/0 (socket says 172.21.15.7:36136) 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00adc00640 1 -- 172.21.15.7:0/3436010671 learned_addr learned my addr 172.21.15.7:0/3436010671 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.497+0000 7f00a7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f00a8140640 0x7f00a806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.498+0000 7f00ad200640 1 --2- 172.21.15.7:0/3436010671 >> v2:172.21.15.162:3300/0 conn(0x7f00a813dc30 0x7f00a8140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.498+0000 7f00a7400640 1 -- 172.21.15.7:0/3436010671 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928407135 0 0) 0x7f00a815e930 con 0x7f00a806db40 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.498+0000 7f00a7e00640 1 -- 172.21.15.7:0/3436010671 >> v2:172.21.15.162:3300/0 conn(0x7f00a813dc30 msgr2=0x7f00a8140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.498+0000 7f00a7e00640 1 --2- 172.21.15.7:0/3436010671 >> v2:172.21.15.162:3300/0 conn(0x7f00a813dc30 0x7f00a8140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.498+0000 7f00a7e00640 1 -- 172.21.15.7:0/3436010671 >> v1:172.21.15.7:6789/0 conn(0x7f00a806db40 legacy=0x7f00a8072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.498+0000 7f00a7e00640 1 -- 172.21.15.7:0/3436010671 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a815f1d0 con 0x7f00a8140640 2024-08-19T00:45:15.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.499+0000 7f00a7e00640 1 --2- 172.21.15.7:0/3436010671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a8140640 0x7f00a806d600 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f00a80b2cd0 tx=0x7f009402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6117de8f47f57e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.499+0000 7f00a7400640 1 -- 172.21.15.7:0/3436010671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094037070 con 0x7f00a8140640 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.499+0000 7f00a7400640 1 -- 172.21.15.7:0/3436010671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0094032440 con 0x7f00a8140640 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.499+0000 7f00a7400640 1 -- 172.21.15.7:0/3436010671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094032810 con 0x7f00a8140640 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 -- 172.21.15.7:0/3436010671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a8140640 msgr2=0x7f00a806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 --2- 172.21.15.7:0/3436010671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a8140640 0x7f00a806d600 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f00a80b2cd0 tx=0x7f009402a1a0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 -- 172.21.15.7:0/3436010671 shutdown_connections 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 --2- 172.21.15.7:0/3436010671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a8140640 0x7f00a806d600 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 --2- 172.21.15.7:0/3436010671 >> v2:172.21.15.162:3300/0 conn(0x7f00a813dc30 0x7f00a8140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 -- 172.21.15.7:0/3436010671 >> 172.21.15.7:0/3436010671 conn(0x7f00a806b850 msgr2=0x7f00a806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 -- 172.21.15.7:0/3436010671 shutdown_connections 2024-08-19T00:45:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.500+0000 7f00ae600640 1 -- 172.21.15.7:0/3436010671 wait complete. 2024-08-19T00:45:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.501+0000 7f00ae600640 1 Processor -- start 2024-08-19T00:45:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.502+0000 7f00ae600640 1 -- start start 2024-08-19T00:45:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.502+0000 7f00ae600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a806db40 0x7f00a80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.502+0000 7f00ae600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a813dc30 0x7f00a8157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.502+0000 7f00ae600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a8140640 0x7f00a81f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.502+0000 7f00ae600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81413a0 con 0x7f00a806db40 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.502+0000 7f00ae600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8141220 con 0x7f00a813dc30 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.502+0000 7f00ae600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00a813e010 con 0x7f00a8140640 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a806db40 0x7f00a80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a806db40 0x7f00a80aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34002/0 (socket says 172.21.15.7:34002) 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 -- 172.21.15.7:0/1966870206 learned_addr learned my addr 172.21.15.7:0/1966870206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00adc00640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a8140640 0x7f00a81f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00a7e00640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a813dc30 0x7f00a8157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 -- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a8140640 msgr2=0x7f00a81f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a8140640 0x7f00a81f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 -- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a813dc30 msgr2=0x7f00a8157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a813dc30 0x7f00a8157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 -- 172.21.15.7:0/1966870206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a815a9f0 con 0x7f00a806db40 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00a7e00640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a813dc30 0x7f00a8157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00adc00640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a8140640 0x7f00a81f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.503+0000 7f00ad200640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a806db40 0x7f00a80aef30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f009c00e9e0 tx=0x7f009c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.504+0000 7f00a4c00640 1 -- 172.21.15.7:0/1966870206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c017070 con 0x7f00a806db40 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.504+0000 7f00a4c00640 1 -- 172.21.15.7:0/1966870206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c00c9d0 con 0x7f00a806db40 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.504+0000 7f00a4c00640 1 -- 172.21.15.7:0/1966870206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c00cdc0 con 0x7f00a806db40 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.504+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a815acd0 con 0x7f00a806db40 2024-08-19T00:45:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.504+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a81f5660 con 0x7f00a806db40 2024-08-19T00:45:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.505+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a8140ce0 con 0x7f00a806db40 2024-08-19T00:45:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.506+0000 7f00a4c00640 1 -- 172.21.15.7:0/1966870206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f009c01a070 con 0x7f00a806db40 2024-08-19T00:45:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.507+0000 7f00a4c00640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f008806be30 0x7f008806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.507+0000 7f00a4c00640 1 -- 172.21.15.7:0/1966870206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6827+0+0 (secure 0 0 0) 0x7f009c08b300 con 0x7f00a806db40 2024-08-19T00:45:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.507+0000 7f00a7e00640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f008806be30 0x7f008806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.508+0000 7f00a7e00640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f008806be30 0x7f008806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0094034000 tx=0x7f009402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:15.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.511+0000 7f00a4c00640 1 -- 172.21.15.7:0/1966870206 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f009c059840 con 0x7f00a806db40 2024-08-19T00:45:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.737+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f00a8158000 con 0x7f00a806db40 2024-08-19T00:45:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.862+0000 7f00a4c00640 1 -- 172.21.15.7:0/1966870206 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v165) ==== 162+0+0 (secure 0 0 0) 0x7f009c059140 con 0x7f00a806db40 2024-08-19T00:45:15.864 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:15.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.864+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f008806be30 msgr2=0x7f008806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.864+0000 7f00ae600640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f008806be30 0x7f008806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0094034000 tx=0x7f009402e000 comp rx=0 tx=0).stop 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.864+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a806db40 msgr2=0x7f00a80aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.864+0000 7f00ae600640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a806db40 0x7f00a80aef30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f009c00e9e0 tx=0x7f009c00eea0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 shutdown_connections 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f008806be30 0x7f008806e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00a8140640 0x7f00a81f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00a813dc30 0x7f00a8157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 --2- 172.21.15.7:0/1966870206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a806db40 0x7f00a80aef30 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 >> 172.21.15.7:0/1966870206 conn(0x7f00a806b850 msgr2=0x7f00a8071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 shutdown_connections 2024-08-19T00:45:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:15.865+0000 7f00ae600640 1 -- 172.21.15.7:0/1966870206 wait complete. 2024-08-19T00:45:15.874 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:15.873+0000 7f76fd800640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-08-19T00:45:15.875 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:15.873+0000 7f76fd800640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:45:15.875 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:15.874+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:15.875 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:15.874+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:45:15.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.040+0000 7fe35d400640 1 Processor -- start 2024-08-19T00:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.040+0000 7fe35d400640 1 -- start start 2024-08-19T00:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe35d400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe35806d600 0x7fe35806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe35d400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815cca0 0x7fe35815d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe35d400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe358073140 con 0x7fe35815bd70 2024-08-19T00:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe35d400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe35806df90 con 0x7fe35806d600 2024-08-19T00:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe35d400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe3580733f0 con 0x7fe35815cca0 2024-08-19T00:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe357e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe35815bd70 0x7fe358072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36142/0 (socket says 172.21.15.7:36142) 2024-08-19T00:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe357e00640 1 -- 172.21.15.7:0/519103135 learned_addr learned my addr 172.21.15.7:0/519103135 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.041+0000 7fe34f400640 1 --2- 172.21.15.7:0/519103135 >> v2:172.21.15.7:3300/0 conn(0x7fe35806d600 0x7fe35806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.042+0000 7fe35ca00640 1 --2- 172.21.15.7:0/519103135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815cca0 0x7fe35815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.042+0000 7fe34f400640 1 -- 172.21.15.7:0/519103135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815cca0 msgr2=0x7fe35815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.042+0000 7fe34f400640 1 --2- 172.21.15.7:0/519103135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815cca0 0x7fe35815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.042+0000 7fe34f400640 1 -- 172.21.15.7:0/519103135 >> v1:172.21.15.7:6789/0 conn(0x7fe35815bd70 legacy=0x7fe358072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.042+0000 7fe34f400640 1 -- 172.21.15.7:0/519103135 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3580736d0 con 0x7fe35806d600 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.042+0000 7fe357400640 1 -- 172.21.15.7:0/519103135 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289442487 0 0) 0x7fe358073140 con 0x7fe35815bd70 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.042+0000 7fe35ca00640 1 --2- 172.21.15.7:0/519103135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815cca0 0x7fe35815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.043+0000 7fe34f400640 1 --2- 172.21.15.7:0/519103135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe35806da50 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe3400097a0 tx=0x7fe34002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1897deb8d309b76 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.043+0000 7fe357400640 1 -- 172.21.15.7:0/519103135 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340037070 con 0x7fe35806d600 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.043+0000 7fe357400640 1 -- 172.21.15.7:0/519103135 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe340032440 con 0x7fe35806d600 2024-08-19T00:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.043+0000 7fe357400640 1 -- 172.21.15.7:0/519103135 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340032810 con 0x7fe35806d600 2024-08-19T00:45:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 -- 172.21.15.7:0/519103135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 msgr2=0x7fe35806da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 --2- 172.21.15.7:0/519103135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe35806da50 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe3400097a0 tx=0x7fe34002a180 comp rx=0 tx=0).stop 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 -- 172.21.15.7:0/519103135 shutdown_connections 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 --2- 172.21.15.7:0/519103135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815cca0 0x7fe35815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 --2- 172.21.15.7:0/519103135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe35806da50 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 -- 172.21.15.7:0/519103135 >> 172.21.15.7:0/519103135 conn(0x7fe35806b850 msgr2=0x7fe35806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 -- 172.21.15.7:0/519103135 shutdown_connections 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.044+0000 7fe35d400640 1 -- 172.21.15.7:0/519103135 wait complete. 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.045+0000 7fe35d400640 1 Processor -- start 2024-08-19T00:45:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.046+0000 7fe35d400640 1 -- start start 2024-08-19T00:45:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.046+0000 7fe35d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe3580ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.046+0000 7fe35d400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815bd70 0x7fe3581588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.046+0000 7fe35d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe35815cca0 0x7fe358155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.046+0000 7fe35d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe35815c780 con 0x7fe35806d600 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.046+0000 7fe35d400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe35815c4a0 con 0x7fe35815cca0 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.046+0000 7fe35d400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe35815c150 con 0x7fe35815bd70 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe3580ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe3580ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34006/0 (socket says 172.21.15.7:34006) 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 -- 172.21.15.7:0/2138147079 learned_addr learned my addr 172.21.15.7:0/2138147079 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe34f400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815bd70 0x7fe3581588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe35ca00640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe35815cca0 0x7fe358155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 -- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815bd70 msgr2=0x7fe3581588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815bd70 0x7fe3581588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 -- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe35815cca0 msgr2=0x7fe358155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe35815cca0 0x7fe358155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 -- 172.21.15.7:0/2138147079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe358151cb0 con 0x7fe35806d600 2024-08-19T00:45:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.047+0000 7fe357e00640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe3580ae0c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe34800c500 tx=0x7fe34800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.048+0000 7fe354c00640 1 -- 172.21.15.7:0/2138147079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348018070 con 0x7fe35806d600 2024-08-19T00:45:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.048+0000 7fe354c00640 1 -- 172.21.15.7:0/2138147079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348007580 con 0x7fe35806d600 2024-08-19T00:45:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.048+0000 7fe354c00640 1 -- 172.21.15.7:0/2138147079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348004a20 con 0x7fe35806d600 2024-08-19T00:45:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.048+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3580ad020 con 0x7fe35806d600 2024-08-19T00:45:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.048+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3580ad5e0 con 0x7fe35806d600 2024-08-19T00:45:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.049+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35806e3a0 con 0x7fe35806d600 2024-08-19T00:45:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.050+0000 7fe354c00640 1 -- 172.21.15.7:0/2138147079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe348004bc0 con 0x7fe35806d600 2024-08-19T00:45:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.051+0000 7fe354c00640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.051+0000 7fe354c00640 1 -- 172.21.15.7:0/2138147079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7fe34808a550 con 0x7fe35806d600 2024-08-19T00:45:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.051+0000 7fe34f400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.052+0000 7fe34f400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe33406be30 0x7fe33406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe340034000 tx=0x7fe34002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.055+0000 7fe354c00640 1 -- 172.21.15.7:0/2138147079 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe348058a30 con 0x7fe35806d600 2024-08-19T00:45:16.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.275+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe358159270 con 0x7fe35806d600 2024-08-19T00:45:16.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.276+0000 7fe354c00640 1 -- 172.21.15.7:0/2138147079 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 167 v167) ==== 95+0+4390 (secure 0 0 0) 0x7fe348058330 con 0x7fe35806d600 2024-08-19T00:45:16.278 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:16.278 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":167,"btime":"2024-08-19T00:45:15:874727+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:15.874670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:16.278 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 167 2024-08-19T00:45:16.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.278+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe33406be30 msgr2=0x7fe33406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.278+0000 7fe35d400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe33406be30 0x7fe33406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe340034000 tx=0x7fe34002e000 comp rx=0 tx=0).stop 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.278+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 msgr2=0x7fe3580ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.278+0000 7fe35d400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe3580ae0c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe34800c500 tx=0x7fe34800c9c0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 shutdown_connections 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe35815cca0 0x7fe358155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35815bd70 0x7fe3581588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 --2- 172.21.15.7:0/2138147079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35806d600 0x7fe3580ae0c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 >> 172.21.15.7:0/2138147079 conn(0x7fe35806b850 msgr2=0x7fe3580ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 shutdown_connections 2024-08-19T00:45:16.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.279+0000 7fe35d400640 1 -- 172.21.15.7:0/2138147079 wait complete. 2024-08-19T00:45:16.296 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:16.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:16.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.452+0000 7f6123200640 1 Processor -- start 2024-08-19T00:45:16.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.452+0000 7f6123200640 1 -- start start 2024-08-19T00:45:16.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.453+0000 7f6123200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f612415ee50 0x7f612415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.453+0000 7f6123200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61240b3ab0 con 0x7f612415e360 2024-08-19T00:45:16.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.453+0000 7f6123200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612415f460 con 0x7f61240d3200 2024-08-19T00:45:16.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.453+0000 7f6123200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f612415f740 con 0x7f612415ee50 2024-08-19T00:45:16.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.453+0000 7f6121e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f612415e360 0x7f61240d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36154/0 (socket says 172.21.15.7:36154) 2024-08-19T00:45:16.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.453+0000 7f6121e00640 1 -- 172.21.15.7:0/1367508174 learned_addr learned my addr 172.21.15.7:0/1367508174 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.454+0000 7f6122800640 1 --2- 172.21.15.7:0/1367508174 >> v2:172.21.15.162:3300/0 conn(0x7f612415ee50 0x7f612415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.454+0000 7f6120a00640 1 -- 172.21.15.7:0/1367508174 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291474462 0 0) 0x7f61240b3ab0 con 0x7f612415e360 2024-08-19T00:45:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.454+0000 7f6120a00640 1 -- 172.21.15.7:0/1367508174 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6108003520 con 0x7f612415e360 2024-08-19T00:45:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.454+0000 7f6122800640 1 -- 172.21.15.7:0/1367508174 >> v1:172.21.15.162:6789/0 conn(0x7f61240d3200 legacy=0x7f612415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.454+0000 7f6122800640 1 -- 172.21.15.7:0/1367508174 >> v1:172.21.15.7:6789/0 conn(0x7f612415e360 legacy=0x7f61240d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.454+0000 7f6122800640 1 -- 172.21.15.7:0/1367508174 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61240b3d60 con 0x7f612415ee50 2024-08-19T00:45:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.455+0000 7f6122800640 1 --2- 172.21.15.7:0/1367508174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 0x7f612415fab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f611c009d90 tx=0x7f611c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9b28a772a7a4ac7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6120a00640 1 -- 172.21.15.7:0/1367508174 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c007740 con 0x7f612415ee50 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6120a00640 1 -- 172.21.15.7:0/1367508174 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c0078e0 con 0x7f612415ee50 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6120a00640 1 -- 172.21.15.7:0/1367508174 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c007cb0 con 0x7f612415ee50 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6123200640 1 -- 172.21.15.7:0/1367508174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 msgr2=0x7f612415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6123200640 1 --2- 172.21.15.7:0/1367508174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 0x7f612415fab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f611c009d90 tx=0x7f611c02a6f0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6123200640 1 -- 172.21.15.7:0/1367508174 shutdown_connections 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6123200640 1 --2- 172.21.15.7:0/1367508174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 0x7f612415fab0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6123200640 1 -- 172.21.15.7:0/1367508174 >> 172.21.15.7:0/1367508174 conn(0x7f612408dbf0 msgr2=0x7f612409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6123200640 1 -- 172.21.15.7:0/1367508174 shutdown_connections 2024-08-19T00:45:16.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.456+0000 7f6123200640 1 -- 172.21.15.7:0/1367508174 wait complete. 2024-08-19T00:45:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.458+0000 7f6123200640 1 Processor -- start 2024-08-19T00:45:16.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.458+0000 7f6123200640 1 -- start start 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6123200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61240d3200 0x7f61241507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6123200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612415e360 0x7f61240cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6123200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 0x7f61240b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6123200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61240b4560 con 0x7f612415e360 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6123200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61240d2300 con 0x7f612415ee50 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6123200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61240b46e0 con 0x7f61240d3200 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6121400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612415e360 0x7f61240cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6121400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612415e360 0x7f61240cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34010/0 (socket says 172.21.15.7:34010) 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.459+0000 7f6121400640 1 -- 172.21.15.7:0/1425942548 learned_addr learned my addr 172.21.15.7:0/1425942548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:16.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6122800640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 0x7f61240b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121e00640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61240d3200 0x7f61241507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121400640 1 -- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61240d3200 msgr2=0x7f61241507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121400640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61240d3200 0x7f61241507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121400640 1 -- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 msgr2=0x7f61240b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121400640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 0x7f61240b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121400640 1 -- 172.21.15.7:0/1425942548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61240cf130 con 0x7f612415e360 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121e00640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61240d3200 0x7f61241507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6121400640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612415e360 0x7f61240cce80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f611000c450 tx=0x7f611000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f611a000640 1 -- 172.21.15.7:0/1425942548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61100052d0 con 0x7f612415e360 2024-08-19T00:45:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f611a000640 1 -- 172.21.15.7:0/1425942548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6110005470 con 0x7f612415e360 2024-08-19T00:45:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f611a000640 1 -- 172.21.15.7:0/1425942548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6110012870 con 0x7f612415e360 2024-08-19T00:45:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61240cf410 con 0x7f612415e360 2024-08-19T00:45:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.460+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61240cf9d0 con 0x7f612415e360 2024-08-19T00:45:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.462+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612415fab0 con 0x7f612415e360 2024-08-19T00:45:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.462+0000 7f611a000640 1 -- 172.21.15.7:0/1425942548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6110012a10 con 0x7f612415e360 2024-08-19T00:45:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.464+0000 7f611a000640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f610406be60 0x7f610406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.464+0000 7f611a000640 1 -- 172.21.15.7:0/1425942548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7f611008ae70 con 0x7f612415e360 2024-08-19T00:45:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.464+0000 7f6121e00640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f610406be60 0x7f610406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.465+0000 7f6121e00640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f610406be60 0x7f610406e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f61140011e0 tx=0x7f6114009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.468+0000 7f611a000640 1 -- 172.21.15.7:0/1425942548 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f61100593f0 con 0x7f612415e360 2024-08-19T00:45:16.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.689+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61240d50d0 con 0x7f612415e360 2024-08-19T00:45:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.689+0000 7f611a000640 1 -- 172.21.15.7:0/1425942548 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 167 v167) ==== 95+0+4390 (secure 0 0 0) 0x7f6110058cf0 con 0x7f612415e360 2024-08-19T00:45:16.691 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:16.691 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":167,"btime":"2024-08-19T00:45:15:874727+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:15.874670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 167 2024-08-19T00:45:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.691+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f610406be60 msgr2=0x7f610406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.691+0000 7f6123200640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f610406be60 0x7f610406e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f61140011e0 tx=0x7f6114009040 comp rx=0 tx=0).stop 2024-08-19T00:45:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.691+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612415e360 msgr2=0x7f61240cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.691+0000 7f6123200640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612415e360 0x7f61240cce80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f611000c450 tx=0x7f611000c910 comp rx=0 tx=0).stop 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.691+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 shutdown_connections 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.691+0000 7f6123200640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f610406be60 0x7f610406e320 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.692+0000 7f6123200640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612415ee50 0x7f61240b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.692+0000 7f6123200640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f612415e360 0x7f61240cce80 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.692+0000 7f6123200640 1 --2- 172.21.15.7:0/1425942548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61240d3200 0x7f61241507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.692+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 >> 172.21.15.7:0/1425942548 conn(0x7f612408dbf0 msgr2=0x7f612415d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.692+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 shutdown_connections 2024-08-19T00:45:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.692+0000 7f6123200640 1 -- 172.21.15.7:0/1425942548 wait complete. 2024-08-19T00:45:16.710 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:16.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:16.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.869+0000 7ffa53e00640 1 Processor -- start 2024-08-19T00:45:16.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.869+0000 7ffa53e00640 1 -- start start 2024-08-19T00:45:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.870+0000 7ffa53e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa5415e360 0x7ffa5415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.870+0000 7ffa53e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa540b3ab0 con 0x7ffa540d2af0 2024-08-19T00:45:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.870+0000 7ffa53e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5415f460 con 0x7ffa5415ee50 2024-08-19T00:45:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.870+0000 7ffa53e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ffa5415f740 con 0x7ffa5415e360 2024-08-19T00:45:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.870+0000 7ffa52a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa5415e360 0x7ffa5415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.871+0000 7ffa52a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa5415e360 0x7ffa5415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34016/0 (socket says 172.21.15.7:34016) 2024-08-19T00:45:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.871+0000 7ffa52a00640 1 -- 172.21.15.7:0/3770119401 learned_addr learned my addr 172.21.15.7:0/3770119401 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:16.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.871+0000 7ffa52000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffa540d2af0 0x7ffa5415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36166/0 (socket says 172.21.15.7:36166) 2024-08-19T00:45:16.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.871+0000 7ffa52a00640 1 -- 172.21.15.7:0/3770119401 >> v1:172.21.15.162:6789/0 conn(0x7ffa5415ee50 legacy=0x7ffa540b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:16.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.871+0000 7ffa52a00640 1 -- 172.21.15.7:0/3770119401 >> v1:172.21.15.7:6789/0 conn(0x7ffa540d2af0 legacy=0x7ffa5415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.871+0000 7ffa52a00640 1 -- 172.21.15.7:0/3770119401 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa540b3d60 con 0x7ffa5415e360 2024-08-19T00:45:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.872+0000 7ffa52a00640 1 --2- 172.21.15.7:0/3770119401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa5415fab0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009870 tx=0x7ffa4402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acc8fa46ca51d61 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.872+0000 7ffa51600640 1 -- 172.21.15.7:0/3770119401 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44037070 con 0x7ffa5415e360 2024-08-19T00:45:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.872+0000 7ffa51600640 1 -- 172.21.15.7:0/3770119401 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa44032440 con 0x7ffa5415e360 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.872+0000 7ffa51600640 1 -- 172.21.15.7:0/3770119401 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44032810 con 0x7ffa5415e360 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.873+0000 7ffa53e00640 1 -- 172.21.15.7:0/3770119401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 msgr2=0x7ffa5415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.873+0000 7ffa53e00640 1 --2- 172.21.15.7:0/3770119401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa5415fab0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009870 tx=0x7ffa4402a2a0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.873+0000 7ffa53e00640 1 -- 172.21.15.7:0/3770119401 shutdown_connections 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.873+0000 7ffa53e00640 1 --2- 172.21.15.7:0/3770119401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa5415fab0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.873+0000 7ffa53e00640 1 -- 172.21.15.7:0/3770119401 >> 172.21.15.7:0/3770119401 conn(0x7ffa5408dbf0 msgr2=0x7ffa5409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.873+0000 7ffa53e00640 1 -- 172.21.15.7:0/3770119401 shutdown_connections 2024-08-19T00:45:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.873+0000 7ffa53e00640 1 -- 172.21.15.7:0/3770119401 wait complete. 2024-08-19T00:45:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.875+0000 7ffa53e00640 1 Processor -- start 2024-08-19T00:45:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.875+0000 7ffa53e00640 1 -- start start 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.875+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540d2af0 0x7ffa5415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.875+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa540b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.875+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa5415ee50 0x7ffa54161d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa53e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa540d2f80 con 0x7ffa5415e360 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa53e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffa540d2300 con 0x7ffa540d2af0 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa53e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffa540d3100 con 0x7ffa5415ee50 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa540b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa540b8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34032/0 (socket says 172.21.15.7:34032) 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 -- 172.21.15.7:0/419060029 learned_addr learned my addr 172.21.15.7:0/419060029 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52a00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540d2af0 0x7ffa5415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa53400640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa5415ee50 0x7ffa54161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 -- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa5415ee50 msgr2=0x7ffa54161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa5415ee50 0x7ffa54161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 -- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540d2af0 msgr2=0x7ffa5415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540d2af0 0x7ffa5415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.876+0000 7ffa52000640 1 -- 172.21.15.7:0/419060029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa540b9c90 con 0x7ffa5415e360 2024-08-19T00:45:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.877+0000 7ffa52000640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa540b8c80 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c400 tx=0x7ffa4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.877+0000 7ffa4b400640 1 -- 172.21.15.7:0/419060029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400074e0 con 0x7ffa5415e360 2024-08-19T00:45:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.877+0000 7ffa4b400640 1 -- 172.21.15.7:0/419060029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa40007680 con 0x7ffa5415e360 2024-08-19T00:45:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.877+0000 7ffa4b400640 1 -- 172.21.15.7:0/419060029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40004a00 con 0x7ffa5415e360 2024-08-19T00:45:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.877+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa540b96d0 con 0x7ffa5415e360 2024-08-19T00:45:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.877+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa540c8100 con 0x7ffa5415e360 2024-08-19T00:45:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.878+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa540c8300 con 0x7ffa5415e360 2024-08-19T00:45:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.879+0000 7ffa4b400640 1 -- 172.21.15.7:0/419060029 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa4001a020 con 0x7ffa5415e360 2024-08-19T00:45:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.880+0000 7ffa4b400640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa3406be30 0x7ffa3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.880+0000 7ffa4b400640 1 -- 172.21.15.7:0/419060029 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7ffa4008ab40 con 0x7ffa5415e360 2024-08-19T00:45:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.880+0000 7ffa52a00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa3406be30 0x7ffa3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.881+0000 7ffa52a00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa3406be30 0x7ffa3406e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa44034000 tx=0x7ffa4402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:16.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:16.885+0000 7ffa4b400640 1 -- 172.21.15.7:0/419060029 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ffa540c8300 con 0x7ffa5415e360 2024-08-19T00:45:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.105+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa5415fab0 con 0x7ffa5415e360 2024-08-19T00:45:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.106+0000 7ffa4b400640 1 -- 172.21.15.7:0/419060029 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 167 v167) ==== 95+0+4390 (secure 0 0 0) 0x7ffa40058f90 con 0x7ffa5415e360 2024-08-19T00:45:17.107 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:17.108 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":167,"btime":"2024-08-19T00:45:15:874727+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:15.874670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 167 2024-08-19T00:45:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa3406be30 msgr2=0x7ffa3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa3406be30 0x7ffa3406e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa44034000 tx=0x7ffa4402e000 comp rx=0 tx=0).stop 2024-08-19T00:45:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 msgr2=0x7ffa540b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa540b8c80 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c400 tx=0x7ffa4000c8c0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 shutdown_connections 2024-08-19T00:45:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa3406be30 0x7ffa3406e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa5415ee50 0x7ffa54161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5415e360 0x7ffa540b8c80 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 --2- 172.21.15.7:0/419060029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540d2af0 0x7ffa5415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 >> 172.21.15.7:0/419060029 conn(0x7ffa5408dbf0 msgr2=0x7ffa5415e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 shutdown_connections 2024-08-19T00:45:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.108+0000 7ffa53e00640 1 -- 172.21.15.7:0/419060029 wait complete. 2024-08-19T00:45:17.126 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 100.00000000.inode' led to DAMAGED state 2024-08-19T00:45:17.126 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 1.00000000' 2024-08-19T00:45:17.126 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:17.126 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:17.163 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:45:17.163 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:17.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:17.163 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:45:17.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:17.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.435+0000 7f7e6ee00640 1 Processor -- start 2024-08-19T00:45:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.436+0000 7f7e6ee00640 1 -- start start 2024-08-19T00:45:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e6ee00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7e68161a30 0x7f7e680b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e6ee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6806c480 0x7f7e680b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e6ee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7e6806b850 0x7f7e6806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e6ee00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7e680b4640 con 0x7f7e68161a30 2024-08-19T00:45:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e6ee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7e680d0320 con 0x7f7e6806b850 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e6ee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e680b0cf0 con 0x7f7e6806c480 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7e68161a30 0x7f7e680b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7e68161a30 0x7f7e680b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34034/0 (socket says 172.21.15.7:34034) 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e67e00640 1 -- 172.21.15.7:0/856699996 learned_addr learned my addr 172.21.15.7:0/856699996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e6ce00640 1 --2- 172.21.15.7:0/856699996 >> v2:172.21.15.162:3300/0 conn(0x7f7e6806b850 0x7f7e6806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.437+0000 7f7e5f400640 1 --2- 172.21.15.7:0/856699996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6806c480 0x7f7e680b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.438+0000 7f7e67e00640 1 -- 172.21.15.7:0/856699996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6806c480 msgr2=0x7f7e680b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.438+0000 7f7e67e00640 1 --2- 172.21.15.7:0/856699996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6806c480 0x7f7e680b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.438+0000 7f7e67e00640 1 -- 172.21.15.7:0/856699996 >> v2:172.21.15.162:3300/0 conn(0x7f7e6806b850 msgr2=0x7f7e6806bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.438+0000 7f7e67e00640 1 --2- 172.21.15.7:0/856699996 >> v2:172.21.15.162:3300/0 conn(0x7f7e6806b850 0x7f7e6806bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.438+0000 7f7e67e00640 1 -- 172.21.15.7:0/856699996 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e680b3cf0 con 0x7f7e68161a30 2024-08-19T00:45:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e67e00640 1 --2- 172.21.15.7:0/856699996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e68161a30 0x7f7e680b4100 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009870 tx=0x7f7e5802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d018edb0e8d9ae1c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e67400640 1 -- 172.21.15.7:0/856699996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e58037070 con 0x7f7e68161a30 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e67400640 1 -- 172.21.15.7:0/856699996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e58032440 con 0x7f7e68161a30 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e67400640 1 -- 172.21.15.7:0/856699996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e58032810 con 0x7f7e68161a30 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 -- 172.21.15.7:0/856699996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e68161a30 msgr2=0x7f7e680b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/856699996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e68161a30 0x7f7e680b4100 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009870 tx=0x7f7e5802a2a0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 -- 172.21.15.7:0/856699996 shutdown_connections 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/856699996 >> v2:172.21.15.162:3300/0 conn(0x7f7e6806b850 0x7f7e6806bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/856699996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6806c480 0x7f7e680b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/856699996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e68161a30 0x7f7e680b4100 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 -- 172.21.15.7:0/856699996 >> 172.21.15.7:0/856699996 conn(0x7f7e680b6840 msgr2=0x7f7e680b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.439+0000 7f7e6ee00640 1 -- 172.21.15.7:0/856699996 shutdown_connections 2024-08-19T00:45:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.440+0000 7f7e6ee00640 1 -- 172.21.15.7:0/856699996 wait complete. 2024-08-19T00:45:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.441+0000 7f7e6ee00640 1 Processor -- start 2024-08-19T00:45:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.441+0000 7f7e6ee00640 1 -- start start 2024-08-19T00:45:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e6ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6806b850 0x7f7e68159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e6ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e6806c480 0x7f7e68158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e6ee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e68161a30 0x7f7e680cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e6ee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e680b0f90 con 0x7f7e6806c480 2024-08-19T00:45:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e6ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e680d08a0 con 0x7f7e6806b850 2024-08-19T00:45:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e6ee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e680d0b80 con 0x7f7e68161a30 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e5f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e6806c480 0x7f7e68158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e5f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e6806c480 0x7f7e68158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34038/0 (socket says 172.21.15.7:34038) 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.442+0000 7f7e5f400640 1 -- 172.21.15.7:0/4275324339 learned_addr learned my addr 172.21.15.7:0/4275324339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e67e00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6806b850 0x7f7e68159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e6ce00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e68161a30 0x7f7e680cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e5f400640 1 -- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e68161a30 msgr2=0x7f7e680cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e5f400640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e68161a30 0x7f7e680cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e5f400640 1 -- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6806b850 msgr2=0x7f7e68159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e5f400640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6806b850 0x7f7e68159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e5f400640 1 -- 172.21.15.7:0/4275324339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e68159ee0 con 0x7f7e6806c480 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e6ce00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e68161a30 0x7f7e680cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e5f400640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e6806c480 0x7f7e68158a60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000d7d0 tx=0x7f7e5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e64c00640 1 -- 172.21.15.7:0/4275324339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50004030 con 0x7f7e6806c480 2024-08-19T00:45:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e64c00640 1 -- 172.21.15.7:0/4275324339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e500041d0 con 0x7f7e6806c480 2024-08-19T00:45:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e68157f80 con 0x7f7e6806c480 2024-08-19T00:45:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.443+0000 7f7e64c00640 1 -- 172.21.15.7:0/4275324339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5000b6c0 con 0x7f7e6806c480 2024-08-19T00:45:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.444+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e68158fa0 con 0x7f7e6806c480 2024-08-19T00:45:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.445+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e680b00f0 con 0x7f7e6806c480 2024-08-19T00:45:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.445+0000 7f7e64c00640 1 -- 172.21.15.7:0/4275324339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e5000b860 con 0x7f7e6806c480 2024-08-19T00:45:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.446+0000 7f7e64c00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7e4406be30 0x7f7e4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.446+0000 7f7e64c00640 1 -- 172.21.15.7:0/4275324339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7f7e5008b630 con 0x7f7e6806c480 2024-08-19T00:45:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.447+0000 7f7e67e00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7e4406be30 0x7f7e4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.447+0000 7f7e67e00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7e4406be30 0x7f7e4406e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7e58034000 tx=0x7f7e5802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.451+0000 7f7e64c00640 1 -- 172.21.15.7:0/4275324339 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7e680b00f0 con 0x7f7e6806c480 2024-08-19T00:45:17.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.670+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7e68161e10 con 0x7f7e6806c480 2024-08-19T00:45:17.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.869+0000 7f7e64c00640 1 -- 172.21.15.7:0/4275324339 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v168) ==== 161+0+0 (secure 0 0 0) 0x7f7e50059a80 con 0x7f7e6806c480 2024-08-19T00:45:17.871 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7e4406be30 msgr2=0x7f7e4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7e4406be30 0x7f7e4406e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7e58034000 tx=0x7f7e5802e000 comp rx=0 tx=0).stop 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e6806c480 msgr2=0x7f7e68158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e6806c480 0x7f7e68158a60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000d7d0 tx=0x7f7e5000dc90 comp rx=0 tx=0).stop 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 shutdown_connections 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7e4406be30 0x7f7e4406e2f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e68161a30 0x7f7e680cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e6806c480 0x7f7e68158a60 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 --2- 172.21.15.7:0/4275324339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6806b850 0x7f7e68159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 >> 172.21.15.7:0/4275324339 conn(0x7f7e680b6840 msgr2=0x7f7e680b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 shutdown_connections 2024-08-19T00:45:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:17.872+0000 7f7e6ee00640 1 -- 172.21.15.7:0/4275324339 wait complete. 2024-08-19T00:45:17.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.047+0000 7fcc55400640 1 Processor -- start 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.047+0000 7fcc55400640 1 -- start start 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.048+0000 7fcc55400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc5006da50 0x7fcc5015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.048+0000 7fcc55400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc50073140 con 0x7fcc5015bd70 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.048+0000 7fcc55400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc500733f0 con 0x7fcc5006d600 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.048+0000 7fcc55400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcc500736d0 con 0x7fcc5006da50 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.048+0000 7fcc54a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc5006da50 0x7fcc5015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.049+0000 7fcc54a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc5006da50 0x7fcc5015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34042/0 (socket says 172.21.15.7:34042) 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.049+0000 7fcc54a00640 1 -- 172.21.15.7:0/3456598277 learned_addr learned my addr 172.21.15.7:0/3456598277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.049+0000 7fcc54a00640 1 -- 172.21.15.7:0/3456598277 >> v1:172.21.15.162:6789/0 conn(0x7fcc5006d600 legacy=0x7fcc5015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.049+0000 7fcc54a00640 1 -- 172.21.15.7:0/3456598277 >> v1:172.21.15.7:6789/0 conn(0x7fcc5015bd70 legacy=0x7fcc50072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.049+0000 7fcc54a00640 1 -- 172.21.15.7:0/3456598277 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500739b0 con 0x7fcc5006da50 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.049+0000 7fcc4ea00640 1 -- 172.21.15.7:0/3456598277 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184375483 0 0) 0x7fcc50073140 con 0x7fcc5015bd70 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.050+0000 7fcc54a00640 1 --2- 172.21.15.7:0/3456598277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5006da50 0x7fcc5015d3b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009e50 tx=0x7fcc4802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46332216f53aee41 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.050+0000 7fcc4ea00640 1 -- 172.21.15.7:0/3456598277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48036070 con 0x7fcc5006da50 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.050+0000 7fcc4ea00640 1 -- 172.21.15.7:0/3456598277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48031600 con 0x7fcc5006da50 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.050+0000 7fcc4ea00640 1 -- 172.21.15.7:0/3456598277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc480319f0 con 0x7fcc5006da50 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.051+0000 7fcc55400640 1 -- 172.21.15.7:0/3456598277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5006da50 msgr2=0x7fcc5015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.051+0000 7fcc55400640 1 --2- 172.21.15.7:0/3456598277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5006da50 0x7fcc5015d3b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009e50 tx=0x7fcc4802a7c0 comp rx=0 tx=0).stop 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.051+0000 7fcc55400640 1 -- 172.21.15.7:0/3456598277 shutdown_connections 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.051+0000 7fcc55400640 1 --2- 172.21.15.7:0/3456598277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5006da50 0x7fcc5015d3b0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.051+0000 7fcc55400640 1 -- 172.21.15.7:0/3456598277 >> 172.21.15.7:0/3456598277 conn(0x7fcc5006b850 msgr2=0x7fcc5006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.051+0000 7fcc55400640 1 -- 172.21.15.7:0/3456598277 shutdown_connections 2024-08-19T00:45:18.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.051+0000 7fcc55400640 1 -- 172.21.15.7:0/3456598277 wait complete. 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.053+0000 7fcc55400640 1 Processor -- start 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.053+0000 7fcc55400640 1 -- start start 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc55400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc5006d600 0x7fcc50151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc55400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc5006da50 0x7fcc50153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc55400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5015bd70 0x7fcc500ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc55400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5006dec0 con 0x7fcc5015bd70 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc55400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5015c780 con 0x7fcc5006d600 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc55400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5015c150 con 0x7fcc5006da50 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5015bd70 0x7fcc500ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:18.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5015bd70 0x7fcc500ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34052/0 (socket says 172.21.15.7:34052) 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 -- 172.21.15.7:0/3129531954 learned_addr learned my addr 172.21.15.7:0/3129531954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc4fe00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc5006d600 0x7fcc50151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc4f400640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc5006da50 0x7fcc50153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 -- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc5006da50 msgr2=0x7fcc50153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc5006da50 0x7fcc50153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 -- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc5006d600 msgr2=0x7fcc50151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc5006d600 0x7fcc50151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc54a00640 1 -- 172.21.15.7:0/3129531954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc50154770 con 0x7fcc5015bd70 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.054+0000 7fcc4fe00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc5006d600 0x7fcc50151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.055+0000 7fcc54a00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5015bd70 0x7fcc500ac980 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009f70 tx=0x7fcc48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.055+0000 7fcc47e00640 1 -- 172.21.15.7:0/3129531954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48036050 con 0x7fcc5015bd70 2024-08-19T00:45:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.055+0000 7fcc47e00640 1 -- 172.21.15.7:0/3129531954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48042070 con 0x7fcc5015bd70 2024-08-19T00:45:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.055+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc50154a50 con 0x7fcc5015bd70 2024-08-19T00:45:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.055+0000 7fcc47e00640 1 -- 172.21.15.7:0/3129531954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48009510 con 0x7fcc5015bd70 2024-08-19T00:45:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.055+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc50155010 con 0x7fcc5015bd70 2024-08-19T00:45:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.056+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5006e3a0 con 0x7fcc5015bd70 2024-08-19T00:45:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.057+0000 7fcc47e00640 1 -- 172.21.15.7:0/3129531954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc48004490 con 0x7fcc5015bd70 2024-08-19T00:45:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.058+0000 7fcc47e00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc3006be30 0x7fcc3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.058+0000 7fcc47e00640 1 -- 172.21.15.7:0/3129531954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7fcc480ac170 con 0x7fcc5015bd70 2024-08-19T00:45:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.058+0000 7fcc4fe00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc3006be30 0x7fcc3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.059+0000 7fcc4fe00640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc3006be30 0x7fcc3006e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcc40000f60 tx=0x7fcc40009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:18.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.062+0000 7fcc47e00640 1 -- 172.21.15.7:0/3129531954 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcc4804c020 con 0x7fcc5015bd70 2024-08-19T00:45:18.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:18.320+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fcc5006c860 con 0x7fcc5015bd70 2024-08-19T00:45:19.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.122+0000 7fcc47e00640 1 -- 172.21.15.7:0/3129531954 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v169) ==== 101+0+0 (secure 0 0 0) 0x7fcc4807a5c0 con 0x7fcc5015bd70 2024-08-19T00:45:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:45:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.125+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc3006be30 msgr2=0x7fcc3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.125+0000 7fcc55400640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc3006be30 0x7fcc3006e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcc40000f60 tx=0x7fcc40009040 comp rx=0 tx=0).stop 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.125+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5015bd70 msgr2=0x7fcc500ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5015bd70 0x7fcc500ac980 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009f70 tx=0x7fcc48004a40 comp rx=0 tx=0).stop 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 shutdown_connections 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc3006be30 0x7fcc3006e2f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5015bd70 0x7fcc500ac980 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc5006da50 0x7fcc50153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 --2- 172.21.15.7:0/3129531954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc5006d600 0x7fcc50151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 >> 172.21.15.7:0/3129531954 conn(0x7fcc5006b850 msgr2=0x7fcc500afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 shutdown_connections 2024-08-19T00:45:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.126+0000 7fcc55400640 1 -- 172.21.15.7:0/3129531954 wait complete. 2024-08-19T00:45:19.145 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:19.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.223+0000 7f0bffa15f40 1 Processor -- start 2024-08-19T00:45:19.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.223+0000 7f0bffa15f40 1 -- start start 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.224+0000 7f0bffa15f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c6f40 0x55928e5521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.224+0000 7f0bffa15f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e495ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.224+0000 7f0bffa15f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c8990 0x55928e496430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.224+0000 7f0bffa15f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55928e4c78f0 con 0x55928e4c8990 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.224+0000 7f0bffa15f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55928e43cd00 con 0x55928e4c6f40 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.224+0000 7f0bffa15f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55928e56ddc0 con 0x55928e4c85b0 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c8990 0x55928e496430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c8990 0x55928e496430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34074/0 (socket says 172.21.15.7:34074) 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 -- 172.21.15.7:0/28784062 learned_addr learned my addr 172.21.15.7:0/28784062 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e495ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c6f40 0x55928e5521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 -- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 msgr2=0x55928e495ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e495ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 -- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c6f40 msgr2=0x55928e5521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c6f40 0x55928e5521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 -- 172.21.15.7:0/28784062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55928e3c1b30 con 0x55928e4c8990 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.225+0000 7f0bfd600640 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c8990 0x55928e496430 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c480 tx=0x7f0bf800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75167f0bdb859dd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bf6a00640 1 -- 172.21.15.7:0/28784062 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80116b0 con 0x55928e4c8990 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bf6a00640 1 -- 172.21.15.7:0/28784062 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf8017070 con 0x55928e4c8990 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bf6a00640 1 -- 172.21.15.7:0/28784062 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8011a90 con 0x55928e4c8990 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 -- 172.21.15.7:0/28784062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c8990 msgr2=0x55928e496430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c8990 0x55928e496430 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c480 tx=0x7f0bf800c940 comp rx=0 tx=0).stop 2024-08-19T00:45:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 -- 172.21.15.7:0/28784062 shutdown_connections 2024-08-19T00:45:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c8990 0x55928e496430 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e495ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/28784062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c6f40 0x55928e5521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 -- 172.21.15.7:0/28784062 >> 172.21.15.7:0/28784062 conn(0x55928e4c54e0 msgr2=0x55928e4c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 -- 172.21.15.7:0/28784062 shutdown_connections 2024-08-19T00:45:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.226+0000 7f0bffa15f40 1 -- 172.21.15.7:0/28784062 wait complete. 2024-08-19T00:45:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.227+0000 7f0bffa15f40 1 Processor -- start 2024-08-19T00:45:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.227+0000 7f0bffa15f40 1 -- start start 2024-08-19T00:45:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bffa15f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c6f40 0x55928e56e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bffa15f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e4958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bffa15f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c8990 0x55928e495e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bffa15f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55928e551410 con 0x55928e4c6f40 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bffa15f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55928e551130 con 0x55928e4c8990 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bffa15f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55928e5516f0 con 0x55928e4c85b0 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bfcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c6f40 0x55928e56e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bfcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c6f40 0x55928e56e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34080/0 (socket says 172.21.15.7:34080) 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 learned_addr learned my addr 172.21.15.7:0/3724808844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.228+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e4958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfd600640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c8990 0x55928e495e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 msgr2=0x55928e4958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e4958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c8990 msgr2=0x55928e495e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c8990 0x55928e495e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55928e3fe080 con 0x55928e4c6f40 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55928e4c85b0 0x55928e4958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfd600640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55928e4c8990 0x55928e495e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c6f40 0x55928e56e800 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000df70 tx=0x7f0bf000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bf5600640 1 -- 172.21.15.7:0/3724808844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00032d0 con 0x55928e4c6f40 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bf5600640 1 -- 172.21.15.7:0/3724808844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf0016070 con 0x55928e4c6f40 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bf5600640 1 -- 172.21.15.7:0/3724808844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00116a0 con 0x55928e4c6f40 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55928e563970 con 0x55928e4c6f40 2024-08-19T00:45:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.229+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55928e563f30 con 0x55928e4c6f40 2024-08-19T00:45:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.231+0000 7f0bf5600640 1 -- 172.21.15.7:0/3724808844 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bf0011840 con 0x55928e4c6f40 2024-08-19T00:45:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.232+0000 7f0bf5600640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0bdc06a810 0x7f0bdc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.232+0000 7f0bf5600640 1 -- 172.21.15.7:0/3724808844 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7f0bf0089fc0 con 0x55928e4c6f40 2024-08-19T00:45:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.233+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0bdc06a810 0x7f0bdc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.235 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.233+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55928e54f660 0x55928e568160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.233+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e496340 con 0x55928e54f660 2024-08-19T00:45:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.233+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0bdc06a810 0x7f0bdc06ccd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0be8057000 tx=0x7f0be8052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.233+0000 7f0bfd600640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55928e54f660 0x55928e568160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.234+0000 7f0bfd600640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55928e54f660 0x55928e568160 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.236+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v100'412 uv386 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.236+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e564730 con 0x55928e54f660 2024-08-19T00:45:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.238+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v100'413 uv413 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.238+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e5686a0 con 0x55928e54f660 2024-08-19T00:45:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.240+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v100'414 uv414 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.241 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.240+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e568a40 con 0x55928e54f660 2024-08-19T00:45:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.241+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v100'415 uv415 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.241+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e568e40 con 0x55928e54f660 2024-08-19T00:45:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.243+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v100'416 uv416 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.243+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6101a0 con 0x55928e54f660 2024-08-19T00:45:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.244+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v100'417 uv417 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.245+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e610540 con 0x55928e54f660 2024-08-19T00:45:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.246+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v100'418 uv392 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.246+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e6108e0 con 0x55928e54f660 2024-08-19T00:45:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.248+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v100'419 uv419 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.248+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e610c80 con 0x55928e54f660 2024-08-19T00:45:19.251 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.249+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v100'420 uv420 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.249+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e611c90 con 0x55928e54f660 2024-08-19T00:45:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.251+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v100'421 uv421 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.251+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e611c90 con 0x55928e54f660 2024-08-19T00:45:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.252+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v100'422 uv422 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.252+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e610c80 con 0x55928e54f660 2024-08-19T00:45:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.253+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v100'423 uv423 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.253+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e610c80 con 0x55928e54f660 2024-08-19T00:45:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.255+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v100'424 uv399 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.255+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e610c80 con 0x55928e54f660 2024-08-19T00:45:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.256+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v100'425 uv425 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.256+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e610c80 con 0x55928e54f660 2024-08-19T00:45:19.259 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.258+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v100'426 uv426 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.258+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e611c90 con 0x55928e54f660 2024-08-19T00:45:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.259+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v100'427 uv427 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.259+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e611c90 con 0x55928e54f660 2024-08-19T00:45:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.261+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v100'428 uv428 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.261+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e610c80 con 0x55928e54f660 2024-08-19T00:45:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.262+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v100'429 uv429 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.262+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.264+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v100'430 uv430 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.264+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.265+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v100'431 uv405 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.265+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.267+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v100'432 uv432 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.267+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.268+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v100'433 uv433 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.270 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:19.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.268+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e612400 con 0x55928e54f660 2024-08-19T00:45:19.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.270+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v100'434 uv434 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.270+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e612400 con 0x55928e54f660 2024-08-19T00:45:19.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.271+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v100'435 uv435 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.271+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.272+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v100'436 uv436 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.272+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.273+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v100'437 uv411 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.273+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.275+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v100'438 uv438 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.275+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.276+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v100'439 uv439 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.278 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:19.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.276+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e612400 con 0x55928e54f660 2024-08-19T00:45:19.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.278+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v100'440 uv440 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.278+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e612400 con 0x55928e54f660 2024-08-19T00:45:19.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.279+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v100'441 uv441 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.279+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6113f0 con 0x55928e54f660 2024-08-19T00:45:19.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.280+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v100'442 uv442 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.281+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55928e611900 0x55928e613cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.281+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e614230 con 0x55928e611900 2024-08-19T00:45:19.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.281+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55928e611900 0x55928e613cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.281+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55928e611900 0x55928e613cf0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.283+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v100'308 uv291 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.283+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e6145d0 con 0x55928e611900 2024-08-19T00:45:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.285+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v100'309 uv309 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.285+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e614990 con 0x55928e611900 2024-08-19T00:45:19.287 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.286+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v100'310 uv310 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.286+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e611020 con 0x55928e611900 2024-08-19T00:45:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.287+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v100'311 uv311 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.287+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6152c0 con 0x55928e611900 2024-08-19T00:45:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.289+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v100'312 uv312 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.289+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6156b0 con 0x55928e611900 2024-08-19T00:45:19.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.290+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v100'313 uv296 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.290+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e615a50 con 0x55928e611900 2024-08-19T00:45:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.291+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v100'314 uv314 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.292+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615e40 con 0x55928e611900 2024-08-19T00:45:19.294 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:19.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.293+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v100'315 uv315 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.293+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615e40 con 0x55928e611900 2024-08-19T00:45:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.294+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v100'316 uv316 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.294+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.296+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v100'317 uv317 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.296+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.297+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v100'318 uv301 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.297+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.298+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v100'319 uv319 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.298+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.301 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.299+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v100'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.299+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.301+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v100'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.301+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.302+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v100'322 uv322 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.302+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.303+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v100'323 uv307 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.304+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.305+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v100'324 uv324 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.305+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615df0 con 0x55928e611900 2024-08-19T00:45:19.307 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.306+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v100'325 uv325 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.306+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e615e30 con 0x55928e611900 2024-08-19T00:45:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.307+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v100'326 uv326 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.307+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e617340 con 0x55928e611900 2024-08-19T00:45:19.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.309+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v100'327 uv327 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.309+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e616250 con 0x55928e611900 2024-08-19T00:45:19.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.310+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v100'328 uv328 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e611900 2024-08-19T00:45:19.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.311+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55928e616b50 0x55928e619300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.311+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e619840 con 0x55928e616b50 2024-08-19T00:45:19.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.311+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55928e616b50 0x55928e619300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.312+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55928e616b50 0x55928e619300 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.313+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v100'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.313+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e619be0 con 0x55928e616b50 2024-08-19T00:45:19.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.314+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v100'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.314+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e619f80 con 0x55928e616b50 2024-08-19T00:45:19.317 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:19.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.316+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v100'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.316+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61b330 con 0x55928e616b50 2024-08-19T00:45:19.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.317+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v100'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.317+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61b720 con 0x55928e616b50 2024-08-19T00:45:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.318+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v100'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.318+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61a320 con 0x55928e616b50 2024-08-19T00:45:19.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.320+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v100'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.320+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61a730 con 0x55928e54f660 2024-08-19T00:45:19.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.321+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v100'64 uv63 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.321+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e61a730 con 0x55928e54f660 2024-08-19T00:45:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.322+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v100'65 uv65 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.323+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61a730 con 0x55928e54f660 2024-08-19T00:45:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.324+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v100'66 uv66 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.326 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.324+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61a730 con 0x55928e54f660 2024-08-19T00:45:19.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.325+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v100'67 uv67 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.326+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55928e61bac0 0x55928e61deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.326+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61e3f0 con 0x55928e61bac0 2024-08-19T00:45:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.326+0000 7f0bfd600640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55928e61bac0 0x55928e61deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.327+0000 7f0bfd600640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55928e61bac0 0x55928e61deb0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.328+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v100'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.328+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e61e3f0 con 0x55928e61bac0 2024-08-19T00:45:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.329+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v100'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.329+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61e3f0 con 0x55928e61bac0 2024-08-19T00:45:19.332 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:19.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.330+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v100'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.330+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61f400 con 0x55928e61bac0 2024-08-19T00:45:19.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.332+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v100'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.332+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61f400 con 0x55928e61bac0 2024-08-19T00:45:19.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.333+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v100'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.333+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e61e3f0 con 0x55928e61bac0 2024-08-19T00:45:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.334+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v100'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.334+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55928e61ecc0 0x55928e6210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.334+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6215f0 con 0x55928e61ecc0 2024-08-19T00:45:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.335+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55928e61ecc0 0x55928e6210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.335+0000 7f0bfcc00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55928e61ecc0 0x55928e6210b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.336+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v100'149 uv143 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.336+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e621630 con 0x55928e61ecc0 2024-08-19T00:45:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.338+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v100'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.338+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e621a50 con 0x55928e61ecc0 2024-08-19T00:45:19.340 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.339+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v100'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.339+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e622a60 con 0x55928e61ecc0 2024-08-19T00:45:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.341+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v100'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.341+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e622a60 con 0x55928e61ecc0 2024-08-19T00:45:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.342+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v100'153 uv153 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.342+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e621a50 con 0x55928e61ecc0 2024-08-19T00:45:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.343+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v100'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.343+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e621a50 con 0x55928e61ecc0 2024-08-19T00:45:19.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.345+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v100'155 uv148 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.345+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e621a50 con 0x55928e61ecc0 2024-08-19T00:45:19.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.346+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v100'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.346+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e621a50 con 0x55928e61ecc0 2024-08-19T00:45:19.349 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:19.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.347+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v100'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.347+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e621a50 con 0x55928e61ecc0 2024-08-19T00:45:19.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.349+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v100'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.349+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e621a50 con 0x55928e61ecc0 2024-08-19T00:45:19.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.350+0000 7f0bfcc00640 1 -- 172.21.15.7:0/3724808844 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v100'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf000e040 con 0x55928e61ecc0 2024-08-19T00:45:19.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.351+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55928e621f60 0x55928e624390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.351+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e624aa0 con 0x55928e621f60 2024-08-19T00:45:19.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.351+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55928e621f60 0x55928e624390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.351+0000 7f0bf7e00640 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55928e621f60 0x55928e624390 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.352+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v100'66 uv65 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.352+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e624e70 con 0x55928e621f60 2024-08-19T00:45:19.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.354+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v100'67 uv67 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.354+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e621f60 2024-08-19T00:45:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.355+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v100'68 uv68 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.357 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.355+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e621f60 2024-08-19T00:45:19.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.356+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v100'69 uv69 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.356+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e621f60 2024-08-19T00:45:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.358+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v100'70 uv70 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.358+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e54f660 2024-08-19T00:45:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.359+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v100'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.359+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e54f660 2024-08-19T00:45:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.360+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v100'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.360+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e54f660 2024-08-19T00:45:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.362+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v100'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.364 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.362+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6262a0 con 0x55928e54f660 2024-08-19T00:45:19.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.363+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v100'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.363+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6262a0 con 0x55928e54f660 2024-08-19T00:45:19.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.365+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v100'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.365+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e54f660 2024-08-19T00:45:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.366+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v100'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e54f660 2024-08-19T00:45:19.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.366+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.368+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v100'132 uv126 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.368+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.369+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v100'133 uv133 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.369+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.370+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v100'134 uv134 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.372 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.370+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.372+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v100'135 uv135 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.372+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.373+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v100'136 uv136 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.373+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.374+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v100'137 uv131 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.375+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.376+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v100'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.376+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.377+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v100'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.379 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.377+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625290 con 0x55928e616b50 2024-08-19T00:45:19.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.378+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v100'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.378+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280e0 con 0x55928e616b50 2024-08-19T00:45:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.380+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v100'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e616b50 2024-08-19T00:45:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.380+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.382+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v100'61 uv60 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.382+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.384+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v100'62 uv62 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.384+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.387 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.386+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v100'63 uv63 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.386+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.387+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v100'64 uv64 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.387+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.389+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v100'81 uv80 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.389+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.391+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v100'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.391+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.394 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.392+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v100'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.392+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e6280a0 con 0x55928e61bac0 2024-08-19T00:45:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.394+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v100'84 uv84 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.394+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e626730 con 0x55928e61bac0 2024-08-19T00:45:19.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.395+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v100'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.395+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625720 con 0x55928e61bac0 2024-08-19T00:45:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.396+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v100'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0bf8011990 con 0x55928e61bac0 2024-08-19T00:45:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.396+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625720 con 0x55928e621f60 2024-08-19T00:45:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.398+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v100'69 uv68 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.398+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e625660 con 0x55928e621f60 2024-08-19T00:45:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.399+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v100'70 uv70 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.399+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625660 con 0x55928e621f60 2024-08-19T00:45:19.402 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.401+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v100'71 uv71 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.401+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625660 con 0x55928e621f60 2024-08-19T00:45:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.402+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v100'72 uv72 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.402+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625660 con 0x55928e621f60 2024-08-19T00:45:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.403+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v100'73 uv73 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.403+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625640 con 0x55928e621f60 2024-08-19T00:45:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.405+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v100'170 uv170 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.407 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:19.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.405+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625640 con 0x55928e621f60 2024-08-19T00:45:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.406+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [write 0~582] v100'171 uv171 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.406+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625640 con 0x55928e621f60 2024-08-19T00:45:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.408+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v100'172 uv172 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.408+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625640 con 0x55928e621f60 2024-08-19T00:45:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.409+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 1.00000000 [create] v100'173 uv168 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.409+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x55928e625640 con 0x55928e621f60 2024-08-19T00:45:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.410+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 1.00000000 [delete] v100'174 uv174 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.410+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625640 con 0x55928e621f60 2024-08-19T00:45:19.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.411+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v100'175 uv175 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.413 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:19.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.412+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e626650 con 0x55928e621f60 2024-08-19T00:45:19.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.413+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v100'176 uv176 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.413+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e626650 con 0x55928e621f60 2024-08-19T00:45:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.414+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v100'177 uv177 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.414+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625640 con 0x55928e621f60 2024-08-19T00:45:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.415+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [omap-set-header] v100'178 uv178 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.415+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x55928e625da0 con 0x55928e621f60 2024-08-19T00:45:19.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bf7e00640 1 -- 172.21.15.7:0/3724808844 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v100'179 uv179 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f0be8069070 con 0x55928e621f60 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55928e611900 msgr2=0x55928e613cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55928e611900 0x55928e613cf0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55928e61ecc0 msgr2=0x55928e6210b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55928e61ecc0 0x55928e6210b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55928e621f60 msgr2=0x55928e624390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55928e621f60 0x55928e624390 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55928e616b50 msgr2=0x55928e619300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55928e616b50 0x55928e619300 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 reap_dead start 2024-08-19T00:45:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55928e54f660 msgr2=0x55928e568160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55928e54f660 0x55928e568160 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bfd600640 1 -- 172.21.15.7:0/3724808844 reap_dead start 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55928e61bac0 msgr2=0x55928e61deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55928e61bac0 0x55928e61deb0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0bdc06a810 msgr2=0x7f0bdc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0bdc06a810 0x7f0bdc06ccd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0be8057000 tx=0x7f0be8052000 comp rx=0 tx=0).stop 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c6f40 msgr2=0x55928e56e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c6f40 0x55928e56e800 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000df70 tx=0x7f0bf000b5b0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 shutdown_connections 2024-08-19T00:45:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0bdc06a810 0x7f0bdc06ccd0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55928e61bac0 0x55928e61deb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 --2- 172.21.15.7:0/3724808844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928e4c6f40 0x55928e56e800 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 >> 172.21.15.7:0/3724808844 conn(0x55928e4c54e0 msgr2=0x55928e4c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 shutdown_connections 2024-08-19T00:45:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.417+0000 7f0bffa15f40 1 -- 172.21.15.7:0/3724808844 wait complete. 2024-08-19T00:45:19.423 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 1.00000000 2024-08-19T00:45:19.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.538+0000 7fba3d32ff40 1 Processor -- start 2024-08-19T00:45:19.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.539+0000 7fba3d32ff40 1 -- start start 2024-08-19T00:45:19.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.539+0000 7fba3d32ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ed27d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.539+0000 7fba3d32ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2be70 0x558e9ed2e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.539+0000 7fba3d32ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2edb0 0x558e9ec8c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.539+0000 7fba3d32ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558e9ed32dc0 con 0x7fba200022a0 2024-08-19T00:45:19.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.539+0000 7fba3d32ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558e9ec01d00 con 0x558e9ed2edb0 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.539+0000 7fba3d32ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558e9ed330a0 con 0x558e9ed2be70 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ed27d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ed27d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34094/0 (socket says 172.21.15.7:34094) 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 -- 172.21.15.7:0/886267227 learned_addr learned my addr 172.21.15.7:0/886267227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba39c00640 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2be70 0x558e9ed2e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3b000640 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2edb0 0x558e9ec8c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 -- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2be70 msgr2=0x558e9ed2e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2be70 0x558e9ed2e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 -- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2edb0 msgr2=0x558e9ec8c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2edb0 0x558e9ec8c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 -- 172.21.15.7:0/886267227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9eb86b30 con 0x7fba200022a0 2024-08-19T00:45:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3b000640 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2edb0 0x558e9ec8c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:19.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.540+0000 7fba3a600640 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ed27d40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fba2c025e70 tx=0x7fba2c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384af6dea200369 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba33e00640 1 -- 172.21.15.7:0/886267227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c04f8a0 con 0x7fba200022a0 2024-08-19T00:45:19.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba33e00640 1 -- 172.21.15.7:0/886267227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2c04fa60 con 0x7fba200022a0 2024-08-19T00:45:19.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba33e00640 1 -- 172.21.15.7:0/886267227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c04fe50 con 0x7fba200022a0 2024-08-19T00:45:19.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 -- 172.21.15.7:0/886267227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 msgr2=0x558e9ed27d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ed27d40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fba2c025e70 tx=0x7fba2c051000 comp rx=0 tx=0).stop 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 -- 172.21.15.7:0/886267227 shutdown_connections 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2edb0 0x558e9ec8c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2be70 0x558e9ed2e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/886267227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ed27d40 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 -- 172.21.15.7:0/886267227 >> 172.21.15.7:0/886267227 conn(0x558e9ec8a4e0 msgr2=0x558e9ec88990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 -- 172.21.15.7:0/886267227 shutdown_connections 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.541+0000 7fba3d32ff40 1 -- 172.21.15.7:0/886267227 wait complete. 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.542+0000 7fba3d32ff40 1 Processor -- start 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.542+0000 7fba3d32ff40 1 -- start start 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3d32ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2be70 0x558e9ed10210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3d32ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2edb0 0x558e9ec5a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3d32ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ec5ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3d32ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558e9ed2c600 con 0x7fba200022a0 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3d32ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558e9ed2bac0 con 0x558e9ed2be70 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3d32ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558e9eca7ba0 con 0x558e9ed2edb0 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ec5ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ec5ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34100/0 (socket says 172.21.15.7:34100) 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3b000640 1 -- 172.21.15.7:0/2307689624 learned_addr learned my addr 172.21.15.7:0/2307689624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba39c00640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2edb0 0x558e9ec5a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.543+0000 7fba3a600640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2be70 0x558e9ed10210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3b000640 1 -- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2edb0 msgr2=0x558e9ec5a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3b000640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2edb0 0x558e9ec5a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3b000640 1 -- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2be70 msgr2=0x558e9ed10210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3b000640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2be70 0x558e9ed10210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3b000640 1 -- 172.21.15.7:0/2307689624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9ebc3080 con 0x7fba200022a0 2024-08-19T00:45:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba39c00640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558e9ed2edb0 0x558e9ec5a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3a600640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e9ed2be70 0x558e9ed10210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3b000640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ec5ac10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x558e9ec5a1b0 tx=0x7fba34006f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba32a00640 1 -- 172.21.15.7:0/2307689624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34019070 con 0x7fba200022a0 2024-08-19T00:45:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba32a00640 1 -- 172.21.15.7:0/2307689624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba34003d90 con 0x7fba200022a0 2024-08-19T00:45:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba32a00640 1 -- 172.21.15.7:0/2307689624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34004180 con 0x7fba200022a0 2024-08-19T00:45:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e9ed343a0 con 0x7fba200022a0 2024-08-19T00:45:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.544+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e9ed34960 con 0x7fba200022a0 2024-08-19T00:45:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.547+0000 7fba32a00640 1 -- 172.21.15.7:0/2307689624 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba34012070 con 0x7fba200022a0 2024-08-19T00:45:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.547+0000 7fba32a00640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba1c06a810 0x7fba1c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.547+0000 7fba32a00640 1 -- 172.21.15.7:0/2307689624 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7fba340892b0 con 0x7fba200022a0 2024-08-19T00:45:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.548+0000 7fba3a600640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba1c06a810 0x7fba1c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.548+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558e9ed24b50 0x558e9ed29810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.548+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) -- 0x558e9ed29d50 con 0x558e9ed24b50 2024-08-19T00:45:19.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.548+0000 7fba39c00640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558e9ed24b50 0x558e9ed29810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.548+0000 7fba3a600640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba1c06a810 0x7fba1c06ccd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000c00 tx=0x7fba2c053000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.549+0000 7fba39c00640 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558e9ed24b50 0x558e9ed29810 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba39c00640 1 -- 172.21.15.7:0/2307689624 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 1.00000000 [delete] v100'180 uv180 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fba28009970 con 0x558e9ed24b50 2024-08-19T00:45:19.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558e9ed24b50 msgr2=0x558e9ed29810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558e9ed24b50 0x558e9ed29810 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba1c06a810 msgr2=0x7fba1c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba1c06a810 0x7fba1c06ccd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000c00 tx=0x7fba2c053000 comp rx=0 tx=0).stop 2024-08-19T00:45:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 msgr2=0x558e9ec5ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3d32ff40 1 --2- 172.21.15.7:0/2307689624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba200022a0 0x558e9ec5ac10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x558e9ec5a1b0 tx=0x7fba34006f40 comp rx=0 tx=0).stop 2024-08-19T00:45:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3b000640 1 -- 172.21.15.7:0/2307689624 reap_dead start 2024-08-19T00:45:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.550+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 shutdown_connections 2024-08-19T00:45:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.551+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 >> 172.21.15.7:0/2307689624 conn(0x558e9ec8a4e0 msgr2=0x558e9ed31a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.551+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 shutdown_connections 2024-08-19T00:45:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.551+0000 7fba3d32ff40 1 -- 172.21.15.7:0/2307689624 wait complete. 2024-08-19T00:45:19.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:19.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.714+0000 7f4a38000640 1 Processor -- start 2024-08-19T00:45:19.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.715+0000 7f4a38000640 1 -- start start 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a38000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a38000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a3006f720 0x7f4a300b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a38000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3015e720 con 0x7f4a300b3450 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a38000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4a300b3c00 con 0x7f4a3006f720 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a38000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a30072450 con 0x7f4a300aed00 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a34c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a3006f720 0x7f4a300b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a35600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a34c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a3006f720 0x7f4a300b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34108/0 (socket says 172.21.15.7:34108) 2024-08-19T00:45:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.716+0000 7f4a34c00640 1 -- 172.21.15.7:0/1927169408 learned_addr learned my addr 172.21.15.7:0/1927169408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:19.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.717+0000 7f4a34c00640 1 -- 172.21.15.7:0/1927169408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 msgr2=0x7f4a3006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:19.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.717+0000 7f4a34c00640 1 --2- 172.21.15.7:0/1927169408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.717+0000 7f4a34c00640 1 -- 172.21.15.7:0/1927169408 >> v1:172.21.15.162:6789/0 conn(0x7f4a300b3450 legacy=0x7f4a3006deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.717+0000 7f4a34c00640 1 -- 172.21.15.7:0/1927169408 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a30072730 con 0x7f4a3006f720 2024-08-19T00:45:19.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.717+0000 7f4a35600640 1 --2- 172.21.15.7:0/1927169408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:19.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.717+0000 7f4a2fe00640 1 -- 172.21.15.7:0/1927169408 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331514202 0 0) 0x7f4a28001490 con 0x7f4a300b3450 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.718+0000 7f4a34c00640 1 --2- 172.21.15.7:0/1927169408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a3006f720 0x7f4a300b2f10 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009870 tx=0x7f4a1c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8e091cc3ba438 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.718+0000 7f4a2fe00640 1 -- 172.21.15.7:0/1927169408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c037070 con 0x7f4a3006f720 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.718+0000 7f4a2fe00640 1 -- 172.21.15.7:0/1927169408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c032440 con 0x7f4a3006f720 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.718+0000 7f4a2fe00640 1 -- 172.21.15.7:0/1927169408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c032810 con 0x7f4a3006f720 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.718+0000 7f4a38000640 1 -- 172.21.15.7:0/1927169408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a3006f720 msgr2=0x7f4a300b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.718+0000 7f4a38000640 1 --2- 172.21.15.7:0/1927169408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a3006f720 0x7f4a300b2f10 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009870 tx=0x7f4a1c02a130 comp rx=0 tx=0).stop 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.719+0000 7f4a38000640 1 -- 172.21.15.7:0/1927169408 shutdown_connections 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.719+0000 7f4a38000640 1 --2- 172.21.15.7:0/1927169408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a3006f720 0x7f4a300b2f10 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.719+0000 7f4a38000640 1 --2- 172.21.15.7:0/1927169408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.719+0000 7f4a38000640 1 -- 172.21.15.7:0/1927169408 >> 172.21.15.7:0/1927169408 conn(0x7f4a300b2300 msgr2=0x7f4a3006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.719+0000 7f4a38000640 1 -- 172.21.15.7:0/1927169408 shutdown_connections 2024-08-19T00:45:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.719+0000 7f4a38000640 1 -- 172.21.15.7:0/1927169408 wait complete. 2024-08-19T00:45:19.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.720+0000 7f4a38000640 1 Processor -- start 2024-08-19T00:45:19.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.720+0000 7f4a38000640 1 -- start start 2024-08-19T00:45:19.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a38000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a3006f720 0x7f4a300ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a38000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3009caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a38000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a300b3450 0x7f4a3009cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a38000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300adf00 con 0x7f4a300b3450 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a38000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a30072cf0 con 0x7f4a3006f720 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a38000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a300ae080 con 0x7f4a300aed00 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a36000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a300b3450 0x7f4a3009cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a36000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a300b3450 0x7f4a3009cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34120/0 (socket says 172.21.15.7:34120) 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.721+0000 7f4a36000640 1 -- 172.21.15.7:0/1709472033 learned_addr learned my addr 172.21.15.7:0/1709472033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a34c00640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3009caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a35600640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a3006f720 0x7f4a300ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a36000640 1 -- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 msgr2=0x7f4a3009caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a36000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3009caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a36000640 1 -- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a3006f720 msgr2=0x7f4a300ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a36000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a3006f720 0x7f4a300ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:19.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a36000640 1 -- 172.21.15.7:0/1709472033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3009d660 con 0x7f4a300b3450 2024-08-19T00:45:19.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a36000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a300b3450 0x7f4a3009cfe0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c7b0 tx=0x7f4a2800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a2d600640 1 -- 172.21.15.7:0/1709472033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28003ba0 con 0x7f4a300b3450 2024-08-19T00:45:19.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a2d600640 1 -- 172.21.15.7:0/1709472033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a28003d40 con 0x7f4a300b3450 2024-08-19T00:45:19.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3009d940 con 0x7f4a300b3450 2024-08-19T00:45:19.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.722+0000 7f4a2d600640 1 -- 172.21.15.7:0/1709472033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28005270 con 0x7f4a300b3450 2024-08-19T00:45:19.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.723+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a30150bc0 con 0x7f4a300b3450 2024-08-19T00:45:19.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.724+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a300b2f10 con 0x7f4a300b3450 2024-08-19T00:45:19.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.725+0000 7f4a2d600640 1 -- 172.21.15.7:0/1709472033 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a28005410 con 0x7f4a300b3450 2024-08-19T00:45:19.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.726+0000 7f4a2d600640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a1006be30 0x7f4a1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:19.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.726+0000 7f4a2d600640 1 -- 172.21.15.7:0/1709472033 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7f4a2808b140 con 0x7f4a300b3450 2024-08-19T00:45:19.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.726+0000 7f4a35600640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a1006be30 0x7f4a1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:19.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.727+0000 7f4a35600640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a1006be30 0x7f4a1006e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4a30152ad0 tx=0x7f4a24009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:19.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.730+0000 7f4a2d600640 1 -- 172.21.15.7:0/1709472033 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4a3015e720 con 0x7f4a300b3450 2024-08-19T00:45:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:19.953+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f4a300afb70 con 0x7f4a300b3450 2024-08-19T00:45:20.627 INFO:tasks.ceph.mds.a.smithi007.stderr: -43> 2024-08-19T00:45:15.873+0000 7f76fd800640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-08-19T00:45:20.628 INFO:tasks.ceph.mds.a.smithi007.stderr: -33> 2024-08-19T00:45:15.873+0000 7f76fd800640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:45:20.671 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:45:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.881+0000 7f4a2d600640 1 -- 172.21.15.7:0/1709472033 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v170) ==== 162+0+0 (secure 0 0 0) 0x7f4a28058f40 con 0x7f4a300b3450 2024-08-19T00:45:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a1006be30 msgr2=0x7f4a1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a1006be30 0x7f4a1006e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4a30152ad0 tx=0x7f4a24009190 comp rx=0 tx=0).stop 2024-08-19T00:45:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a300b3450 msgr2=0x7f4a3009cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a300b3450 0x7f4a3009cfe0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c7b0 tx=0x7f4a2800cbb0 comp rx=0 tx=0).stop 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 shutdown_connections 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a1006be30 0x7f4a1006e2f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a300b3450 0x7f4a3009cfe0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a300aed00 0x7f4a3009caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 --2- 172.21.15.7:0/1709472033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a3006f720 0x7f4a300ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.884+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 >> 172.21.15.7:0/1709472033 conn(0x7f4a300b2300 msgr2=0x7f4a300719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.885+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 shutdown_connections 2024-08-19T00:45:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:20.885+0000 7f4a38000640 1 -- 172.21.15.7:0/1709472033 wait complete. 2024-08-19T00:45:20.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.068+0000 7fba1fa00640 1 Processor -- start 2024-08-19T00:45:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.069+0000 7fba1fa00640 1 -- start start 2024-08-19T00:45:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1fa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba18159bf0 0x7fba18073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1fa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1806f7f0 con 0x7fba180739a0 2024-08-19T00:45:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1fa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1806f510 con 0x7fba180cec10 2024-08-19T00:45:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1fa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fba18072980 con 0x7fba18159bf0 2024-08-19T00:45:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba18159bf0 0x7fba18073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba18159bf0 0x7fba18073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34142/0 (socket says 172.21.15.7:34142) 2024-08-19T00:45:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba17e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fba180739a0 0x7fba180ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36194/0 (socket says 172.21.15.7:36194) 2024-08-19T00:45:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1d000640 1 -- 172.21.15.7:0/3872102481 learned_addr learned my addr 172.21.15.7:0/3872102481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1d000640 1 -- 172.21.15.7:0/3872102481 >> v1:172.21.15.162:6789/0 conn(0x7fba180cec10 legacy=0x7fba180d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1d000640 1 -- 172.21.15.7:0/3872102481 >> v1:172.21.15.7:6789/0 conn(0x7fba180739a0 legacy=0x7fba180ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.070+0000 7fba1d000640 1 -- 172.21.15.7:0/3872102481 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba18072c60 con 0x7fba18159bf0 2024-08-19T00:45:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.071+0000 7fba1d000640 1 --2- 172.21.15.7:0/3872102481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba18159bf0 0x7fba18073460 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009870 tx=0x7fba0c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f2619c4c05b00a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba17400640 1 -- 172.21.15.7:0/3872102481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c037070 con 0x7fba18159bf0 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba17400640 1 -- 172.21.15.7:0/3872102481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c032440 con 0x7fba18159bf0 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba17400640 1 -- 172.21.15.7:0/3872102481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c032810 con 0x7fba18159bf0 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba1fa00640 1 -- 172.21.15.7:0/3872102481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba18159bf0 msgr2=0x7fba18073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3872102481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba18159bf0 0x7fba18073460 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009870 tx=0x7fba0c02a210 comp rx=0 tx=0).stop 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba1fa00640 1 -- 172.21.15.7:0/3872102481 shutdown_connections 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3872102481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba18159bf0 0x7fba18073460 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba1fa00640 1 -- 172.21.15.7:0/3872102481 >> 172.21.15.7:0/3872102481 conn(0x7fba1806bc70 msgr2=0x7fba1806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba1fa00640 1 -- 172.21.15.7:0/3872102481 shutdown_connections 2024-08-19T00:45:21.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.072+0000 7fba1fa00640 1 -- 172.21.15.7:0/3872102481 wait complete. 2024-08-19T00:45:21.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.074+0000 7fba1fa00640 1 Processor -- start 2024-08-19T00:45:21.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.074+0000 7fba1fa00640 1 -- start start 2024-08-19T00:45:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba180739a0 0x7fba1809a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba18159bf0 0x7fba18152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba181527c0 0x7fba180b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1fa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba1815a150 con 0x7fba181527c0 2024-08-19T00:45:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba18159fd0 con 0x7fba180739a0 2024-08-19T00:45:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba180d0ad0 con 0x7fba18159bf0 2024-08-19T00:45:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba181527c0 0x7fba180b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba181527c0 0x7fba180b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34144/0 (socket says 172.21.15.7:34144) 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1da00640 1 -- 172.21.15.7:0/3041983574 learned_addr learned my addr 172.21.15.7:0/3041983574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.075+0000 7fba1d000640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba180739a0 0x7fba1809a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba17e00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba18159bf0 0x7fba18152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba1da00640 1 -- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba18159bf0 msgr2=0x7fba18152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba1da00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba18159bf0 0x7fba18152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba1da00640 1 -- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba180739a0 msgr2=0x7fba1809a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba1da00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba180739a0 0x7fba1809a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba1da00640 1 -- 172.21.15.7:0/3041983574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba180b4050 con 0x7fba181527c0 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba17e00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba18159bf0 0x7fba18152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba1da00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba181527c0 0x7fba180b3110 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fba1000c730 tx=0x7fba1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba14c00640 1 -- 172.21.15.7:0/3041983574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10016020 con 0x7fba181527c0 2024-08-19T00:45:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba14c00640 1 -- 172.21.15.7:0/3041983574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1000aa50 con 0x7fba181527c0 2024-08-19T00:45:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1809a720 con 0x7fba181527c0 2024-08-19T00:45:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.076+0000 7fba14c00640 1 -- 172.21.15.7:0/3041983574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1000ce40 con 0x7fba181527c0 2024-08-19T00:45:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.077+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba18156390 con 0x7fba181527c0 2024-08-19T00:45:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.078+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba18073460 con 0x7fba181527c0 2024-08-19T00:45:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.079+0000 7fba14c00640 1 -- 172.21.15.7:0/3041983574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba10019020 con 0x7fba181527c0 2024-08-19T00:45:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.079+0000 7fba14c00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb9f806be30 0x7fb9f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.080+0000 7fba14c00640 1 -- 172.21.15.7:0/3041983574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6913+0+0 (secure 0 0 0) 0x7fba1008b210 con 0x7fba181527c0 2024-08-19T00:45:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.080+0000 7fba1d000640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb9f806be30 0x7fb9f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.080+0000 7fba1d000640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb9f806be30 0x7fb9f806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fba0c034000 tx=0x7fba0c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.084+0000 7fba14c00640 1 -- 172.21.15.7:0/3041983574 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fba10020030 con 0x7fba181527c0 2024-08-19T00:45:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.304+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba1815bcc0 con 0x7fba181527c0 2024-08-19T00:45:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.305+0000 7fba14c00640 1 -- 172.21.15.7:0/3041983574 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 171 v171) ==== 95+0+5222 (secure 0 0 0) 0x7fba180b4050 con 0x7fba181527c0 2024-08-19T00:45:21.306 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:21.306 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":171,"btime":"2024-08-19T00:45:20:884391+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":171,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:20.884374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8394":{"gid":8394,"name":"a","rank":0,"incarnation":171,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/2121313657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2121313657},{"type":"v1","addr":"172.21.15.7:6837","nonce":2121313657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 171 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb9f806be30 msgr2=0x7fb9f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb9f806be30 0x7fb9f806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fba0c034000 tx=0x7fba0c02e000 comp rx=0 tx=0).stop 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba181527c0 msgr2=0x7fba180b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba181527c0 0x7fba180b3110 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fba1000c730 tx=0x7fba1000cbf0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 shutdown_connections 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb9f806be30 0x7fb9f806e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba181527c0 0x7fba180b3110 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba18159bf0 0x7fba18152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 --2- 172.21.15.7:0/3041983574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba180739a0 0x7fba1809a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 >> 172.21.15.7:0/3041983574 conn(0x7fba1806bc70 msgr2=0x7fba1815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 shutdown_connections 2024-08-19T00:45:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:21.307+0000 7fba1fa00640 1 -- 172.21.15.7:0/3041983574 wait complete. 2024-08-19T00:45:21.325 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:45:23.908 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:23.907+0000 7f27db400640 -1 log_channel(cluster) log [ERR] : dir 0x1 object missing on disk; some files may be lost () 2024-08-19T00:45:23.909 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:23.907+0000 7f27db400640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-08-19T00:45:23.909 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:23.907+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:23.909 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:23.907+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:45:25.894 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:25.892+0000 7f27e0400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:45:26.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:26.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.493+0000 7f592ae00640 1 Processor -- start 2024-08-19T00:45:26.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.494+0000 7f592ae00640 1 -- start start 2024-08-19T00:45:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f592ae00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5924159bf0 0x7f5924073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f592ae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240cec10 0x7f59240d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f592ae00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592406f7f0 con 0x7f59240739a0 2024-08-19T00:45:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f592ae00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f592406f510 con 0x7f5924159bf0 2024-08-19T00:45:26.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f592ae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5924072980 con 0x7f59240cec10 2024-08-19T00:45:26.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f5928e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240cec10 0x7f59240d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f5928e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240cec10 0x7f59240d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52074/0 (socket says 172.21.15.7:52074) 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f5928e00640 1 -- 172.21.15.7:0/2363325209 learned_addr learned my addr 172.21.15.7:0/2363325209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.495+0000 7f5923e00640 1 --2- 172.21.15.7:0/2363325209 >> v2:172.21.15.162:3300/0 conn(0x7f5924159bf0 0x7f5924073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.496+0000 7f5923e00640 1 -- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240cec10 msgr2=0x7f59240d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.496+0000 7f5923e00640 1 --2- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240cec10 0x7f59240d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.496+0000 7f5923e00640 1 -- 172.21.15.7:0/2363325209 >> v1:172.21.15.162:6789/0 conn(0x7f59240739a0 legacy=0x7f59240ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.496+0000 7f5923e00640 1 -- 172.21.15.7:0/2363325209 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5924072c60 con 0x7f5924159bf0 2024-08-19T00:45:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.496+0000 7f5928e00640 1 --2- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240cec10 0x7f59240d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.497+0000 7f5923e00640 1 --2- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5924159bf0 0x7f5924073460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f59140097a0 tx=0x7f591402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8a9c89582df8fa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.497+0000 7f5923400640 1 -- 172.21.15.7:0/2363325209 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914037070 con 0x7f5924159bf0 2024-08-19T00:45:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.497+0000 7f5923400640 1 -- 172.21.15.7:0/2363325209 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591402ae40 con 0x7f5924159bf0 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.497+0000 7f5923400640 1 -- 172.21.15.7:0/2363325209 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914032660 con 0x7f5924159bf0 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 -- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5924159bf0 msgr2=0x7f5924073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 --2- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5924159bf0 0x7f5924073460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f59140097a0 tx=0x7f591402a0f0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 -- 172.21.15.7:0/2363325209 shutdown_connections 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 --2- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240cec10 0x7f59240d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 --2- 172.21.15.7:0/2363325209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5924159bf0 0x7f5924073460 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 -- 172.21.15.7:0/2363325209 >> 172.21.15.7:0/2363325209 conn(0x7f592406bc70 msgr2=0x7f592406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 -- 172.21.15.7:0/2363325209 shutdown_connections 2024-08-19T00:45:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.498+0000 7f592ae00640 1 -- 172.21.15.7:0/2363325209 wait complete. 2024-08-19T00:45:26.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.500+0000 7f592ae00640 1 Processor -- start 2024-08-19T00:45:26.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.500+0000 7f592ae00640 1 -- start start 2024-08-19T00:45:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f592ae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240739a0 0x7f59241524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f592ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5924159bf0 0x7f592414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f592ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f592414f050 0x7f592414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f592ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f592415a150 con 0x7f5924159bf0 2024-08-19T00:45:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f592ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5924159fd0 con 0x7f592414f050 2024-08-19T00:45:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f592ae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f59240d0900 con 0x7f59240739a0 2024-08-19T00:45:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f591b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5924159bf0 0x7f592414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f5923e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240739a0 0x7f59241524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f5923e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240739a0 0x7f59241524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52090/0 (socket says 172.21.15.7:52090) 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f5923e00640 1 -- 172.21.15.7:0/2502156713 learned_addr learned my addr 172.21.15.7:0/2502156713 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f5928e00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f592414f050 0x7f592414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f5923e00640 1 -- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f592414f050 msgr2=0x7f592414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f5923e00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f592414f050 0x7f592414e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.501+0000 7f5923e00640 1 -- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5924159bf0 msgr2=0x7f592414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f5923e00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5924159bf0 0x7f592414daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f5923e00640 1 -- 172.21.15.7:0/2502156713 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592415fb00 con 0x7f59240739a0 2024-08-19T00:45:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f591b400640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5924159bf0 0x7f592414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f5923e00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240739a0 0x7f59241524a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5914035040 tx=0x7f59140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f5920c00640 1 -- 172.21.15.7:0/2502156713 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914041070 con 0x7f59240739a0 2024-08-19T00:45:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f5920c00640 1 -- 172.21.15.7:0/2502156713 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591403c460 con 0x7f59240739a0 2024-08-19T00:45:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f5920c00640 1 -- 172.21.15.7:0/2502156713 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914037040 con 0x7f59240739a0 2024-08-19T00:45:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592415fde0 con 0x7f59240739a0 2024-08-19T00:45:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.502+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59241529e0 con 0x7f59240739a0 2024-08-19T00:45:26.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.503+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5924068c00 con 0x7f59240739a0 2024-08-19T00:45:26.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.505+0000 7f5920c00640 1 -- 172.21.15.7:0/2502156713 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f591403a070 con 0x7f59240739a0 2024-08-19T00:45:26.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.506+0000 7f5920c00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590006be30 0x7f590006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.506+0000 7f5920c00640 1 -- 172.21.15.7:0/2502156713 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7f59140abd60 con 0x7f59240739a0 2024-08-19T00:45:26.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.506+0000 7f591b400640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590006be30 0x7f590006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.507+0000 7f591b400640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590006be30 0x7f590006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f592409e340 tx=0x7f590c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.509+0000 7f5920c00640 1 -- 172.21.15.7:0/2502156713 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5914079cb0 con 0x7f59240739a0 2024-08-19T00:45:26.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.728+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59240d0cd0 con 0x7f59240739a0 2024-08-19T00:45:26.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.729+0000 7f5920c00640 1 -- 172.21.15.7:0/2502156713 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+4390 (secure 0 0 0) 0x7f591407dfb0 con 0x7f59240739a0 2024-08-19T00:45:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":175,"btime":"2024-08-19T00:45:23:908407+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:23.908404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:26.731 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 175 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590006be30 msgr2=0x7f590006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590006be30 0x7f590006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f592409e340 tx=0x7f590c009040 comp rx=0 tx=0).stop 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240739a0 msgr2=0x7f59241524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240739a0 0x7f59241524a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5914035040 tx=0x7f59140046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 shutdown_connections 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f590006be30 0x7f590006e2f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f592414f050 0x7f592414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5924159bf0 0x7f592414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 --2- 172.21.15.7:0/2502156713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59240739a0 0x7f59241524a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 >> 172.21.15.7:0/2502156713 conn(0x7f592406bc70 msgr2=0x7f59240cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 shutdown_connections 2024-08-19T00:45:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.731+0000 7f592ae00640 1 -- 172.21.15.7:0/2502156713 wait complete. 2024-08-19T00:45:26.749 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:45:26.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:26.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.911+0000 7f2fb3e00640 1 Processor -- start 2024-08-19T00:45:26.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.911+0000 7f2fb3e00640 1 -- start start 2024-08-19T00:45:26.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.912+0000 7f2fb3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fb415e360 0x7f2fb415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.912+0000 7f2fb3e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb40b3ab0 con 0x7f2fb40d2af0 2024-08-19T00:45:26.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb3e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb415f460 con 0x7f2fb415ee50 2024-08-19T00:45:26.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb3e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb415f740 con 0x7f2fb415e360 2024-08-19T00:45:26.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fb415e360 0x7f2fb415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fb415e360 0x7f2fb415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54486/0 (socket says 172.21.15.7:54486) 2024-08-19T00:45:26.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb2a00640 1 -- 172.21.15.7:0/811287486 learned_addr learned my addr 172.21.15.7:0/811287486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:26.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb2a00640 1 -- 172.21.15.7:0/811287486 >> v1:172.21.15.162:6789/0 conn(0x7f2fb415ee50 legacy=0x7f2fb40b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb2a00640 1 -- 172.21.15.7:0/811287486 >> v1:172.21.15.7:6789/0 conn(0x7f2fb40d2af0 legacy=0x7f2fb415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.913+0000 7f2fb2a00640 1 -- 172.21.15.7:0/811287486 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb40b3d60 con 0x7f2fb415e360 2024-08-19T00:45:26.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.914+0000 7f2fb2a00640 1 --2- 172.21.15.7:0/811287486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb415e360 0x7f2fb415fab0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009870 tx=0x7f2fa402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06ceaec9bb6a634 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:26.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.914+0000 7f2fb1600640 1 -- 172.21.15.7:0/811287486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4037070 con 0x7f2fb415e360 2024-08-19T00:45:26.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.914+0000 7f2fb1600640 1 -- 172.21.15.7:0/811287486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa402ae50 con 0x7f2fb415e360 2024-08-19T00:45:26.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb1600640 1 -- 172.21.15.7:0/811287486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4032860 con 0x7f2fb415e360 2024-08-19T00:45:26.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb3e00640 1 -- 172.21.15.7:0/811287486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb415e360 msgr2=0x7f2fb415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/811287486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb415e360 0x7f2fb415fab0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009870 tx=0x7f2fa402a300 comp rx=0 tx=0).stop 2024-08-19T00:45:26.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb3e00640 1 -- 172.21.15.7:0/811287486 shutdown_connections 2024-08-19T00:45:26.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/811287486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb415e360 0x7f2fb415fab0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb3e00640 1 -- 172.21.15.7:0/811287486 >> 172.21.15.7:0/811287486 conn(0x7f2fb408dbf0 msgr2=0x7f2fb409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:26.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb3e00640 1 -- 172.21.15.7:0/811287486 shutdown_connections 2024-08-19T00:45:26.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.915+0000 7f2fb3e00640 1 -- 172.21.15.7:0/811287486 wait complete. 2024-08-19T00:45:26.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.917+0000 7f2fb3e00640 1 Processor -- start 2024-08-19T00:45:26.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.917+0000 7f2fb3e00640 1 -- start start 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d2af0 0x7f2fb40b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415e360 0x7f2fb41f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb415ee50 0x7f2fb41f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb40d2f80 con 0x7f2fb40d2af0 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb40d2300 con 0x7f2fb415ee50 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb40d3100 con 0x7f2fb415e360 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d2af0 0x7f2fb40b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d2af0 0x7f2fb40b84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54490/0 (socket says 172.21.15.7:54490) 2024-08-19T00:45:26.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb2a00640 1 -- 172.21.15.7:0/3068666779 learned_addr learned my addr 172.21.15.7:0/3068666779 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb3400640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb415ee50 0x7f2fb41f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.918+0000 7f2fb2000640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415e360 0x7f2fb41f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb2a00640 1 -- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415e360 msgr2=0x7f2fb41f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb2a00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415e360 0x7f2fb41f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb2a00640 1 -- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb415ee50 msgr2=0x7f2fb41f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb2a00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb415ee50 0x7f2fb41f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb2a00640 1 -- 172.21.15.7:0/3068666779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb41ea070 con 0x7f2fb40d2af0 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb2000640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415e360 0x7f2fb41f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb3400640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb415ee50 0x7f2fb41f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb2a00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d2af0 0x7f2fb40b84e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4000c00 tx=0x7f2fa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2faaa00640 1 -- 172.21.15.7:0/3068666779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4041070 con 0x7f2fb40d2af0 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2faaa00640 1 -- 172.21.15.7:0/3068666779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa403c890 con 0x7f2fb40d2af0 2024-08-19T00:45:26.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2faaa00640 1 -- 172.21.15.7:0/3068666779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4037040 con 0x7f2fb40d2af0 2024-08-19T00:45:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb41ea310 con 0x7f2fb40d2af0 2024-08-19T00:45:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.919+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb41ea8d0 con 0x7f2fb40d2af0 2024-08-19T00:45:26.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.921+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb415fab0 con 0x7f2fb40d2af0 2024-08-19T00:45:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.921+0000 7f2faaa00640 1 -- 172.21.15.7:0/3068666779 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fa4044070 con 0x7f2fb40d2af0 2024-08-19T00:45:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.922+0000 7f2faaa00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.922+0000 7f2faaa00640 1 -- 172.21.15.7:0/3068666779 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7f2fa40abe20 con 0x7f2fb40d2af0 2024-08-19T00:45:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.922+0000 7f2fb2000640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:26.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.923+0000 7f2fb2000640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0007fd0 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:26.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:26.927+0000 7f2faaa00640 1 -- 172.21.15.7:0/3068666779 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2fa407a3d0 con 0x7f2fb40d2af0 2024-08-19T00:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.148+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fb4162b50 con 0x7f2fb40d2af0 2024-08-19T00:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.149+0000 7f2faaa00640 1 -- 172.21.15.7:0/3068666779 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+4390 (secure 0 0 0) 0x7f2fa4079cd0 con 0x7f2fb40d2af0 2024-08-19T00:45:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:27.151 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":175,"btime":"2024-08-19T00:45:23:908407+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:23.908404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:27.151 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 175 2024-08-19T00:45:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9406be30 msgr2=0x7f2f9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0007fd0 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2024-08-19T00:45:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d2af0 msgr2=0x7f2fb40b84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d2af0 0x7f2fb40b84e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4000c00 tx=0x7f2fa40046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 shutdown_connections 2024-08-19T00:45:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb415ee50 0x7f2fb41f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415e360 0x7f2fb41f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3068666779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d2af0 0x7f2fb40b84e0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 >> 172.21.15.7:0/3068666779 conn(0x7f2fb408dbf0 msgr2=0x7f2fb406c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 shutdown_connections 2024-08-19T00:45:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.151+0000 7f2fb3e00640 1 -- 172.21.15.7:0/3068666779 wait complete. 2024-08-19T00:45:27.169 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:27.169 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.327+0000 7fe978800640 1 Processor -- start 2024-08-19T00:45:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.328+0000 7fe978800640 1 -- start start 2024-08-19T00:45:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.329+0000 7fe978800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700d03c0 0x7fe970071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.329+0000 7fe978800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe9700b3750 0x7fe9700cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.329+0000 7fe978800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9700cdfb0 con 0x7fe97006e710 2024-08-19T00:45:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.329+0000 7fe978800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe9700cebc0 con 0x7fe9700b3750 2024-08-19T00:45:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.329+0000 7fe978800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9700ce290 con 0x7fe9700d03c0 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.329+0000 7fe975e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700d03c0 0x7fe970071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.329+0000 7fe975e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700d03c0 0x7fe970071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52108/0 (socket says 172.21.15.7:52108) 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe975400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe97006e710 0x7fe9700d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:57488/0 (socket says 172.21.15.7:57488) 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe975e00640 1 -- 172.21.15.7:0/231201528 learned_addr learned my addr 172.21.15.7:0/231201528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe976800640 1 --2- 172.21.15.7:0/231201528 >> v2:172.21.15.162:3300/0 conn(0x7fe9700b3750 0x7fe9700cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe974a00640 1 -- 172.21.15.7:0/231201528 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670349391 0 0) 0x7fe9700cdfb0 con 0x7fe97006e710 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe974a00640 1 -- 172.21.15.7:0/231201528 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe958005730 con 0x7fe97006e710 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe976800640 1 -- 172.21.15.7:0/231201528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700d03c0 msgr2=0x7fe970071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe976800640 1 --2- 172.21.15.7:0/231201528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700d03c0 0x7fe970071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe976800640 1 -- 172.21.15.7:0/231201528 >> v1:172.21.15.162:6789/0 conn(0x7fe97006e710 legacy=0x7fe9700d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.330+0000 7fe976800640 1 -- 172.21.15.7:0/231201528 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9700ce570 con 0x7fe9700b3750 2024-08-19T00:45:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.331+0000 7fe976800640 1 --2- 172.21.15.7:0/231201528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700b3750 0x7fe9700cf050 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009d90 tx=0x7fe96c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb3b64f583fbc53 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.331+0000 7fe974a00640 1 -- 172.21.15.7:0/231201528 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c007740 con 0x7fe9700b3750 2024-08-19T00:45:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.331+0000 7fe974a00640 1 -- 172.21.15.7:0/231201528 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c0078e0 con 0x7fe9700b3750 2024-08-19T00:45:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.331+0000 7fe974a00640 1 -- 172.21.15.7:0/231201528 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c007cb0 con 0x7fe9700b3750 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 -- 172.21.15.7:0/231201528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700b3750 msgr2=0x7fe9700cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 --2- 172.21.15.7:0/231201528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700b3750 0x7fe9700cf050 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009d90 tx=0x7fe96c02a660 comp rx=0 tx=0).stop 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 -- 172.21.15.7:0/231201528 shutdown_connections 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 --2- 172.21.15.7:0/231201528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700b3750 0x7fe9700cf050 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 --2- 172.21.15.7:0/231201528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700d03c0 0x7fe970071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 -- 172.21.15.7:0/231201528 >> 172.21.15.7:0/231201528 conn(0x7fe97006bc70 msgr2=0x7fe97006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 -- 172.21.15.7:0/231201528 shutdown_connections 2024-08-19T00:45:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.332+0000 7fe978800640 1 -- 172.21.15.7:0/231201528 wait complete. 2024-08-19T00:45:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.334+0000 7fe978800640 1 Processor -- start 2024-08-19T00:45:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.334+0000 7fe978800640 1 -- start start 2024-08-19T00:45:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe978800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe97006e710 0x7fe970071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe978800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9700b3750 0x7fe970156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe978800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700d03c0 0x7fe97009ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe978800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe970073c60 con 0x7fe9700b3750 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe978800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe970073ae0 con 0x7fe9700d03c0 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe978800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9700b3be0 con 0x7fe97006e710 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe975400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9700b3750 0x7fe970156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe975400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9700b3750 0x7fe970156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54496/0 (socket says 172.21.15.7:54496) 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe975400640 1 -- 172.21.15.7:0/126429964 learned_addr learned my addr 172.21.15.7:0/126429964 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe975e00640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe97006e710 0x7fe970071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.335+0000 7fe976800640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700d03c0 0x7fe97009ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe975400640 1 -- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe97006e710 msgr2=0x7fe970071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe975400640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe97006e710 0x7fe970071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe975400640 1 -- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700d03c0 msgr2=0x7fe97009ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe975400640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700d03c0 0x7fe97009ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe975400640 1 -- 172.21.15.7:0/126429964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe970156f90 con 0x7fe9700b3750 2024-08-19T00:45:27.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe975400640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9700b3750 0x7fe970156a50 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c390 tx=0x7fe96000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe96a000640 1 -- 172.21.15.7:0/126429964 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9600074e0 con 0x7fe9700b3750 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe96a000640 1 -- 172.21.15.7:0/126429964 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9600047e0 con 0x7fe9700b3750 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe96a000640 1 -- 172.21.15.7:0/126429964 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960004bd0 con 0x7fe9700b3750 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97009dc50 con 0x7fe9700b3750 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.336+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97015dea0 con 0x7fe9700b3750 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.338+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9700cdfb0 con 0x7fe9700b3750 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.338+0000 7fe96a000640 1 -- 172.21.15.7:0/126429964 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe96001a020 con 0x7fe9700b3750 2024-08-19T00:45:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.339+0000 7fe96a000640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe95406be30 0x7fe95406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.339+0000 7fe96a000640 1 -- 172.21.15.7:0/126429964 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7fe96008aae0 con 0x7fe9700b3750 2024-08-19T00:45:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.340+0000 7fe975e00640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe95406be30 0x7fe95406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.340+0000 7fe975e00640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe95406be30 0x7fe95406e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe964009b30 tx=0x7fe964009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:27.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.344+0000 7fe96a000640 1 -- 172.21.15.7:0/126429964 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe970156f90 con 0x7fe9700b3750 2024-08-19T00:45:27.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.565+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe97015b6d0 con 0x7fe9700b3750 2024-08-19T00:45:27.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.566+0000 7fe96a000640 1 -- 172.21.15.7:0/126429964 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+4390 (secure 0 0 0) 0x7fe960058950 con 0x7fe9700b3750 2024-08-19T00:45:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:27.568 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":175,"btime":"2024-08-19T00:45:23:908407+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:23.908404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:27.568 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 175 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe95406be30 msgr2=0x7fe95406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe95406be30 0x7fe95406e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe964009b30 tx=0x7fe964009240 comp rx=0 tx=0).stop 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9700b3750 msgr2=0x7fe970156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9700b3750 0x7fe970156a50 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c390 tx=0x7fe96000c850 comp rx=0 tx=0).stop 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 shutdown_connections 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe95406be30 0x7fe95406e2f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9700d03c0 0x7fe97009ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9700b3750 0x7fe970156a50 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 --2- 172.21.15.7:0/126429964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe97006e710 0x7fe970071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 >> 172.21.15.7:0/126429964 conn(0x7fe97006bc70 msgr2=0x7fe97006d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:27.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 shutdown_connections 2024-08-19T00:45:27.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.568+0000 7fe978800640 1 -- 172.21.15.7:0/126429964 wait complete. 2024-08-19T00:45:27.585 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 1.00000000' led to DAMAGED state 2024-08-19T00:45:27.585 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 1.00000000.inode' 2024-08-19T00:45:27.585 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:27.585 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:27.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:45:27.621 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:27.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:27.621 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:27.696 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:45:27.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:27.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.893+0000 7f9c9a400640 1 Processor -- start 2024-08-19T00:45:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.894+0000 7f9c9a400640 1 -- start start 2024-08-19T00:45:27.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c9a400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c94071980 0x7f9c940cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c9a400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c940cdfb0 con 0x7f9c940d03c0 2024-08-19T00:45:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c9a400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c940ce290 con 0x7f9c9406e710 2024-08-19T00:45:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c9a400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9c940cebc0 con 0x7f9c94071980 2024-08-19T00:45:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c93400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9c940d03c0 0x7f9c940d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49406/0 (socket says 172.21.15.7:49406) 2024-08-19T00:45:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c93400640 1 -- 172.21.15.7:0/3417606367 learned_addr learned my addr 172.21.15.7:0/3417606367 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:27.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c93e00640 1 --2- 172.21.15.7:0/3417606367 >> v2:172.21.15.7:3300/0 conn(0x7f9c94071980 0x7f9c940cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c92a00640 1 -- 172.21.15.7:0/3417606367 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907579877 0 0) 0x7f9c940cdfb0 con 0x7f9c940d03c0 2024-08-19T00:45:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.895+0000 7f9c92a00640 1 -- 172.21.15.7:0/3417606367 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c78003520 con 0x7f9c940d03c0 2024-08-19T00:45:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.896+0000 7f9c93e00640 1 -- 172.21.15.7:0/3417606367 >> v1:172.21.15.162:6789/0 conn(0x7f9c9406e710 legacy=0x7f9c940b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.896+0000 7f9c93e00640 1 -- 172.21.15.7:0/3417606367 >> v1:172.21.15.7:6789/0 conn(0x7f9c940d03c0 legacy=0x7f9c940d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.896+0000 7f9c93e00640 1 -- 172.21.15.7:0/3417606367 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c940ce570 con 0x7f9c94071980 2024-08-19T00:45:27.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c93e00640 1 --2- 172.21.15.7:0/3417606367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c940cf050 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009dc0 tx=0x7f9c8c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286544e67f888add server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:27.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c92a00640 1 -- 172.21.15.7:0/3417606367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c007740 con 0x7f9c94071980 2024-08-19T00:45:27.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c92a00640 1 -- 172.21.15.7:0/3417606367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0078e0 con 0x7f9c94071980 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c92a00640 1 -- 172.21.15.7:0/3417606367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c007cb0 con 0x7f9c94071980 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c9a400640 1 -- 172.21.15.7:0/3417606367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 msgr2=0x7f9c940cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c9a400640 1 --2- 172.21.15.7:0/3417606367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c940cf050 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009dc0 tx=0x7f9c8c02a730 comp rx=0 tx=0).stop 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c9a400640 1 -- 172.21.15.7:0/3417606367 shutdown_connections 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c9a400640 1 --2- 172.21.15.7:0/3417606367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c940cf050 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.897+0000 7f9c9a400640 1 -- 172.21.15.7:0/3417606367 >> 172.21.15.7:0/3417606367 conn(0x7f9c9406bc70 msgr2=0x7f9c9406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.898+0000 7f9c9a400640 1 -- 172.21.15.7:0/3417606367 shutdown_connections 2024-08-19T00:45:27.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.898+0000 7f9c9a400640 1 -- 172.21.15.7:0/3417606367 wait complete. 2024-08-19T00:45:27.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.899+0000 7f9c9a400640 1 Processor -- start 2024-08-19T00:45:27.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.899+0000 7f9c9a400640 1 -- start start 2024-08-19T00:45:27.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c9a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9406e710 0x7f9c94099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c9a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c9415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c9a400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c940d03c0 0x7f9c940ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c9a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94073c60 con 0x7f9c94071980 2024-08-19T00:45:27.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c9a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94073ae0 con 0x7f9c9406e710 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c9a400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9c940cf590 con 0x7f9c940d03c0 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c8aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c9415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c8aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c9415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54512/0 (socket says 172.21.15.7:54512) 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.900+0000 7f9c8aa00640 1 -- 172.21.15.7:0/1540436344 learned_addr learned my addr 172.21.15.7:0/1540436344 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c93400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9406e710 0x7f9c94099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c93e00640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c940d03c0 0x7f9c940ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8aa00640 1 -- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c940d03c0 msgr2=0x7f9c940ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8aa00640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c940d03c0 0x7f9c940ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8aa00640 1 -- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9406e710 msgr2=0x7f9c94099b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8aa00640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9406e710 0x7f9c94099b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8aa00640 1 -- 172.21.15.7:0/1540436344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9409a430 con 0x7f9c94071980 2024-08-19T00:45:27.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8aa00640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c9415dd70 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c430 tx=0x7f9c7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8be00640 1 -- 172.21.15.7:0/1540436344 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c017070 con 0x7f9c94071980 2024-08-19T00:45:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8be00640 1 -- 172.21.15.7:0/1540436344 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0052d0 con 0x7f9c94071980 2024-08-19T00:45:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c8be00640 1 -- 172.21.15.7:0/1540436344 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003830 con 0x7f9c94071980 2024-08-19T00:45:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.901+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9409a710 con 0x7f9c94071980 2024-08-19T00:45:27.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.902+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9409acd0 con 0x7f9c94071980 2024-08-19T00:45:27.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.903+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c940cf050 con 0x7f9c94071980 2024-08-19T00:45:27.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.903+0000 7f9c8be00640 1 -- 172.21.15.7:0/1540436344 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c7c01a070 con 0x7f9c94071980 2024-08-19T00:45:27.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.904+0000 7f9c8be00640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9c7006be30 0x7f9c7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:27.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.904+0000 7f9c8be00640 1 -- 172.21.15.7:0/1540436344 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7f9c7c08a810 con 0x7f9c94071980 2024-08-19T00:45:27.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.905+0000 7f9c93400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9c7006be30 0x7f9c7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:27.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.905+0000 7f9c93400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9c7006be30 0x7f9c7006e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9c840011e0 tx=0x7f9c84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:27.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:27.909+0000 7f9c8be00640 1 -- 172.21.15.7:0/1540436344 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9c7c058b80 con 0x7f9c94071980 2024-08-19T00:45:28.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.130+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9c9415e980 con 0x7f9c94071980 2024-08-19T00:45:28.663 INFO:tasks.ceph.mds.a.smithi007.stderr: -48> 2024-08-19T00:45:23.907+0000 7f27db400640 -1 log_channel(cluster) log [ERR] : dir 0x1 object missing on disk; some files may be lost () 2024-08-19T00:45:28.663 INFO:tasks.ceph.mds.a.smithi007.stderr: -46> 2024-08-19T00:45:23.907+0000 7f27db400640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-08-19T00:45:28.663 INFO:tasks.ceph.mds.a.smithi007.stderr: -25> 2024-08-19T00:45:25.892+0000 7f27e0400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:45:28.704 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:45:28.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.922+0000 7f9c8be00640 1 -- 172.21.15.7:0/1540436344 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v176) ==== 161+0+0 (secure 0 0 0) 0x7f9c7c058480 con 0x7f9c94071980 2024-08-19T00:45:28.924 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9c7006be30 msgr2=0x7f9c7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9c7006be30 0x7f9c7006e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9c840011e0 tx=0x7f9c84009040 comp rx=0 tx=0).stop 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 msgr2=0x7f9c9415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c9415dd70 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c430 tx=0x7f9c7c00c8f0 comp rx=0 tx=0).stop 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 shutdown_connections 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9c7006be30 0x7f9c7006e2f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c940d03c0 0x7f9c940ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:28.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c94071980 0x7f9c9415dd70 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:28.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 --2- 172.21.15.7:0/1540436344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9406e710 0x7f9c94099b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:28.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 >> 172.21.15.7:0/1540436344 conn(0x7f9c9406bc70 msgr2=0x7f9c940aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:28.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 shutdown_connections 2024-08-19T00:45:28.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:28.926+0000 7f9c9a400640 1 -- 172.21.15.7:0/1540436344 wait complete. 2024-08-19T00:45:28.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:29.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.105+0000 7f2e64600640 1 Processor -- start 2024-08-19T00:45:29.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.105+0000 7f2e64600640 1 -- start start 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e64600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e5c0ce500 0x7f2e5c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e64600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e5c0d03c0 0x7f2e5c0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e64600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5c06f7f0 con 0x7f2e5c159bf0 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e64600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c0d0d50 con 0x7f2e5c0ce500 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e64600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c06f510 con 0x7f2e5c0d03c0 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e61c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2e5c159bf0 0x7f2e5c073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49412/0 (socket says 172.21.15.7:49412) 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e61c00640 1 -- 172.21.15.7:0/561752128 learned_addr learned my addr 172.21.15.7:0/561752128 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e61200640 1 --2- 172.21.15.7:0/561752128 >> v2:172.21.15.7:3300/0 conn(0x7f2e5c0ce500 0x7f2e5c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:29.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.106+0000 7f2e62600640 1 --2- 172.21.15.7:0/561752128 >> v2:172.21.15.162:3300/0 conn(0x7f2e5c0d03c0 0x7f2e5c0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:29.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.107+0000 7f2e5be00640 1 -- 172.21.15.7:0/561752128 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503194313 0 0) 0x7f2e5c06f7f0 con 0x7f2e5c159bf0 2024-08-19T00:45:29.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.107+0000 7f2e5be00640 1 -- 172.21.15.7:0/561752128 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e44003520 con 0x7f2e5c159bf0 2024-08-19T00:45:29.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.107+0000 7f2e61200640 1 -- 172.21.15.7:0/561752128 >> v2:172.21.15.162:3300/0 conn(0x7f2e5c0d03c0 msgr2=0x7f2e5c0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:29.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.107+0000 7f2e61200640 1 --2- 172.21.15.7:0/561752128 >> v2:172.21.15.162:3300/0 conn(0x7f2e5c0d03c0 0x7f2e5c0d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.107+0000 7f2e61200640 1 -- 172.21.15.7:0/561752128 >> v1:172.21.15.7:6789/0 conn(0x7f2e5c159bf0 legacy=0x7f2e5c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:29.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.107+0000 7f2e61200640 1 -- 172.21.15.7:0/561752128 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c072980 con 0x7f2e5c0ce500 2024-08-19T00:45:29.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.108+0000 7f2e61200640 1 --2- 172.21.15.7:0/561752128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c0ce500 0x7f2e5c0ce970 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0d0fb0 tx=0x7f2e4802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142e6ad3961571fd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.108+0000 7f2e5be00640 1 -- 172.21.15.7:0/561752128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48037070 con 0x7f2e5c0ce500 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.108+0000 7f2e5be00640 1 -- 172.21.15.7:0/561752128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e48032440 con 0x7f2e5c0ce500 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.108+0000 7f2e5be00640 1 -- 172.21.15.7:0/561752128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4802ae60 con 0x7f2e5c0ce500 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 -- 172.21.15.7:0/561752128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c0ce500 msgr2=0x7f2e5c0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 --2- 172.21.15.7:0/561752128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c0ce500 0x7f2e5c0ce970 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0d0fb0 tx=0x7f2e4802a110 comp rx=0 tx=0).stop 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 -- 172.21.15.7:0/561752128 shutdown_connections 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 --2- 172.21.15.7:0/561752128 >> v2:172.21.15.162:3300/0 conn(0x7f2e5c0d03c0 0x7f2e5c0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 --2- 172.21.15.7:0/561752128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c0ce500 0x7f2e5c0ce970 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 -- 172.21.15.7:0/561752128 >> 172.21.15.7:0/561752128 conn(0x7f2e5c06bc70 msgr2=0x7f2e5c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 -- 172.21.15.7:0/561752128 shutdown_connections 2024-08-19T00:45:29.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.109+0000 7f2e64600640 1 -- 172.21.15.7:0/561752128 wait complete. 2024-08-19T00:45:29.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.110+0000 7f2e64600640 1 Processor -- start 2024-08-19T00:45:29.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.111+0000 7f2e64600640 1 -- start start 2024-08-19T00:45:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.111+0000 7f2e64600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e5c0ce500 0x7f2e5c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.111+0000 7f2e64600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e5c0d03c0 0x7f2e5c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.111+0000 7f2e64600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c159bf0 0x7f2e5c15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.111+0000 7f2e64600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c073b70 con 0x7f2e5c159bf0 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.111+0000 7f2e64600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c072f40 con 0x7f2e5c0d03c0 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.111+0000 7f2e64600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5c159fd0 con 0x7f2e5c0ce500 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c159bf0 0x7f2e5c15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c159bf0 0x7f2e5c15e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54550/0 (socket says 172.21.15.7:54550) 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 -- 172.21.15.7:0/772078367 learned_addr learned my addr 172.21.15.7:0/772078367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e61200640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e5c0d03c0 0x7f2e5c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e61c00640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e5c0ce500 0x7f2e5c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 -- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e5c0ce500 msgr2=0x7f2e5c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e5c0ce500 0x7f2e5c0ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 -- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e5c0d03c0 msgr2=0x7f2e5c0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e5c0d03c0 0x7f2e5c0b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 -- 172.21.15.7:0/772078367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c0b4530 con 0x7f2e5c159bf0 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e61c00640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e5c0ce500 0x7f2e5c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.112+0000 7f2e62600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c159bf0 0x7f2e5c15e410 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400efc0 tx=0x7f2e5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.113+0000 7f2e59600640 1 -- 172.21.15.7:0/772078367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54018020 con 0x7f2e5c159bf0 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.113+0000 7f2e59600640 1 -- 172.21.15.7:0/772078367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54014480 con 0x7f2e5c159bf0 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.113+0000 7f2e59600640 1 -- 172.21.15.7:0/772078367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54014870 con 0x7f2e5c159bf0 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.113+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c0b4810 con 0x7f2e5c159bf0 2024-08-19T00:45:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.113+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c0b4dd0 con 0x7f2e5c159bf0 2024-08-19T00:45:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.114+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c0d0810 con 0x7f2e5c159bf0 2024-08-19T00:45:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.115+0000 7f2e59600640 1 -- 172.21.15.7:0/772078367 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e54005d10 con 0x7f2e5c159bf0 2024-08-19T00:45:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.116+0000 7f2e59600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e3c06be30 0x7f2e3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.116+0000 7f2e59600640 1 -- 172.21.15.7:0/772078367 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7f2e5408bf60 con 0x7f2e5c159bf0 2024-08-19T00:45:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.116+0000 7f2e61c00640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e3c06be30 0x7f2e3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:29.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.117+0000 7f2e61c00640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e3c06be30 0x7f2e3c06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005880 tx=0x7f2e50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:29.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.120+0000 7f2e59600640 1 -- 172.21.15.7:0/772078367 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2e54022070 con 0x7f2e5c159bf0 2024-08-19T00:45:29.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.375+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f2e5c071c80 con 0x7f2e5c159bf0 2024-08-19T00:45:29.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.928+0000 7f2e59600640 1 -- 172.21.15.7:0/772078367 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v177) ==== 101+0+0 (secure 0 0 0) 0x7f2e54010040 con 0x7f2e5c159bf0 2024-08-19T00:45:29.931 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e3c06be30 msgr2=0x7f2e3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e3c06be30 0x7f2e3c06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005880 tx=0x7f2e50009040 comp rx=0 tx=0).stop 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c159bf0 msgr2=0x7f2e5c15e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c159bf0 0x7f2e5c15e410 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400efc0 tx=0x7f2e5400c490 comp rx=0 tx=0).stop 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 shutdown_connections 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e3c06be30 0x7f2e3c06e2f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c159bf0 0x7f2e5c15e410 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e5c0d03c0 0x7f2e5c0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 --2- 172.21.15.7:0/772078367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e5c0ce500 0x7f2e5c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:29.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 >> 172.21.15.7:0/772078367 conn(0x7f2e5c06bc70 msgr2=0x7f2e5c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:29.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.932+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 shutdown_connections 2024-08-19T00:45:29.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:29.933+0000 7f2e64600640 1 -- 172.21.15.7:0/772078367 wait complete. 2024-08-19T00:45:29.952 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:30.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.029+0000 7f72b8d28f40 1 Processor -- start 2024-08-19T00:45:30.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.029+0000 7f72b8d28f40 1 -- start start 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.029+0000 7f72b8d28f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 0x557a0e69a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.029+0000 7f72b8d28f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e6035b0 0x557a0e5d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.029+0000 7f72b8d28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e603990 0x557a0e5d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b8d28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a0e577d00 con 0x557a0e603990 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b8d28f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a0e57bd40 con 0x557a0e6035b0 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b8d28f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557a0e6a8dc0 con 0x557a0e601f40 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e603990 0x557a0e5d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e603990 0x557a0e5d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54566/0 (socket says 172.21.15.7:54566) 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 -- 172.21.15.7:0/3925602281 learned_addr learned my addr 172.21.15.7:0/3925602281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b5600640 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e6035b0 0x557a0e5d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6000640 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 0x557a0e69a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 -- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 msgr2=0x557a0e69a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 0x557a0e69a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 -- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e6035b0 msgr2=0x557a0e5d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e6035b0 0x557a0e5d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 -- 172.21.15.7:0/3925602281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0e539080 con 0x557a0e603990 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.030+0000 7f72b6a00640 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e603990 0x557a0e5d0c10 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f72b00065e0 tx=0x7f72b0006aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d434ff637605276c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72afe00640 1 -- 172.21.15.7:0/3925602281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0016070 con 0x557a0e603990 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72afe00640 1 -- 172.21.15.7:0/3925602281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b0004540 con 0x557a0e603990 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72afe00640 1 -- 172.21.15.7:0/3925602281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0004910 con 0x557a0e603990 2024-08-19T00:45:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 -- 172.21.15.7:0/3925602281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e603990 msgr2=0x557a0e5d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e603990 0x557a0e5d0c10 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f72b00065e0 tx=0x7f72b0006aa0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 -- 172.21.15.7:0/3925602281 shutdown_connections 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e603990 0x557a0e5d0c10 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e6035b0 0x557a0e5d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/3925602281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 0x557a0e69a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 -- 172.21.15.7:0/3925602281 >> 172.21.15.7:0/3925602281 conn(0x557a0e6004e0 msgr2=0x557a0e5d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 -- 172.21.15.7:0/3925602281 shutdown_connections 2024-08-19T00:45:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.031+0000 7f72b8d28f40 1 -- 172.21.15.7:0/3925602281 wait complete. 2024-08-19T00:45:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.032+0000 7f72b8d28f40 1 Processor -- start 2024-08-19T00:45:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.032+0000 7f72b8d28f40 1 -- start start 2024-08-19T00:45:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b8d28f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 0x557a0e61a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b8d28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e6035b0 0x557a0e6a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b8d28f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e603990 0x557a0e699080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b8d28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a0e69e560 con 0x557a0e6035b0 2024-08-19T00:45:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b8d28f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a0e6a9f80 con 0x557a0e603990 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b8d28f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557a0e69e280 con 0x557a0e601f40 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e6035b0 0x557a0e6a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e6035b0 0x557a0e6a7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54570/0 (socket says 172.21.15.7:54570) 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 learned_addr learned my addr 172.21.15.7:0/2218144067 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b6a00640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e603990 0x557a0e699080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.033+0000 7f72b6000640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 0x557a0e61a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 msgr2=0x557a0e61a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b5600640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a0e601f40 0x557a0e61a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e603990 msgr2=0x557a0e699080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b5600640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0e603990 0x557a0e699080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0e61a610 con 0x557a0e6035b0 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b5600640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e6035b0 0x557a0e6a7b40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x557a0e600e50 tx=0x7f72a400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72aea00640 1 -- 172.21.15.7:0/2218144067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a400be60 con 0x557a0e6035b0 2024-08-19T00:45:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72aea00640 1 -- 172.21.15.7:0/2218144067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a4016070 con 0x557a0e6035b0 2024-08-19T00:45:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72aea00640 1 -- 172.21.15.7:0/2218144067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4003310 con 0x557a0e6035b0 2024-08-19T00:45:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a0e6a7060 con 0x557a0e6035b0 2024-08-19T00:45:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.034+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a0e6a7620 con 0x557a0e6035b0 2024-08-19T00:45:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.036+0000 7f72aea00640 1 -- 172.21.15.7:0/2218144067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72a4001590 con 0x557a0e6035b0 2024-08-19T00:45:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.037+0000 7f72aea00640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f729806a810 0x7f729806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.037+0000 7f72aea00640 1 -- 172.21.15.7:0/2218144067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7f72a4089e50 con 0x557a0e6035b0 2024-08-19T00:45:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.037+0000 7f72b6000640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f729806a810 0x7f729806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.040 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:30.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.038+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a0e6a8130 0x557a0e6a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.038+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e6a3140 con 0x557a0e6a8130 2024-08-19T00:45:30.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.038+0000 7f72b6a00640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a0e6a8130 0x557a0e6a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.038+0000 7f72b6000640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f729806a810 0x7f729806ccd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f72a8056000 tx=0x7f72a8050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.039+0000 7f72b6a00640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a0e6a8130 0x557a0e6a2c00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.041+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v101'443 uv417 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.041+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e6a3510 con 0x557a0e6a8130 2024-08-19T00:45:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.042+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v101'444 uv444 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.042+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74a9c0 con 0x557a0e6a8130 2024-08-19T00:45:30.045 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.044+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v101'445 uv445 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.044+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74bd70 con 0x557a0e6a8130 2024-08-19T00:45:30.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.045+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v101'446 uv446 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.045+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74c110 con 0x557a0e6a8130 2024-08-19T00:45:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.047+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v101'447 uv447 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.048+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74ad60 con 0x557a0e6a8130 2024-08-19T00:45:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.049+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v101'448 uv448 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.049+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b100 con 0x557a0e6a8130 2024-08-19T00:45:30.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.051+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v101'449 uv423 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.051+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.052+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v101'450 uv450 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.052+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.055 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.054+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v101'451 uv451 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.054+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.056+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v101'452 uv452 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.056+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.057+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v101'453 uv453 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.057+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.058+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v101'454 uv454 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.058+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.060+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v101'455 uv430 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.060+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.061+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v101'456 uv456 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.061+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.064 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:30.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.063+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v101'457 uv457 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.063+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.064+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v101'458 uv458 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.064+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.065+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v101'459 uv459 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.065+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.067+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v101'460 uv460 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.067+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.068+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v101'461 uv461 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.068+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.070+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v101'462 uv436 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.070+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.071+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v101'463 uv463 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.071+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.075 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.073+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v101'464 uv464 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.073+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.075+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v101'465 uv465 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.075+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.076+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v101'466 uv466 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.076+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.078+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v101'467 uv467 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.078+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.079+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v101'468 uv442 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.079+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.081+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v101'469 uv469 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.081+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.083 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.082+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v101'470 uv470 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.082+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.084+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v101'471 uv471 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.084+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.085+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v101'472 uv472 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.085+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b4a0 con 0x557a0e6a8130 2024-08-19T00:45:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.087+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v101'473 uv473 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.087+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557a0e74c4b0 0x557a0e74e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.087+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74b9b0 con 0x557a0e74c4b0 2024-08-19T00:45:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.087+0000 7f72b6000640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557a0e74c4b0 0x557a0e74e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.088+0000 7f72b6000640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557a0e74c4b0 0x557a0e74e8a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.089+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v101'330 uv312 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.089+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74ede0 con 0x557a0e74c4b0 2024-08-19T00:45:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.091+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v101'331 uv331 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.091+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74f290 con 0x557a0e74c4b0 2024-08-19T00:45:30.093 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.092+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v101'332 uv332 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.092+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74f700 con 0x557a0e74c4b0 2024-08-19T00:45:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.094+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v101'333 uv333 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.094+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74fb30 con 0x557a0e74c4b0 2024-08-19T00:45:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.095+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v101'334 uv334 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.095+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e74fed0 con 0x557a0e74c4b0 2024-08-19T00:45:30.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.097+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v101'335 uv317 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.097+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7502c0 con 0x557a0e74c4b0 2024-08-19T00:45:30.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.098+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v101'336 uv336 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.098+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7502c0 con 0x557a0e74c4b0 2024-08-19T00:45:30.101 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:30.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.100+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v101'337 uv337 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.100+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.101+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v101'338 uv338 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.101+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.103+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v101'339 uv339 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.103+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.104+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v101'340 uv322 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.104+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.105+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v101'341 uv341 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.105+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.108 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.107+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v101'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.107+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.109+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v101'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.109+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.110+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v101'344 uv344 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.110+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.111+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v101'345 uv328 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.112+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.113+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v101'346 uv346 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.113+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.116 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:30.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.114+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v101'347 uv347 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.114+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.116+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v101'348 uv348 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.116+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.117+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v101'349 uv349 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.117+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e750270 con 0x557a0e74c4b0 2024-08-19T00:45:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.119+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v101'350 uv350 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e74c4b0 2024-08-19T00:45:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.119+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557a0e750b90 0x557a0e750f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.119+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7536a0 con 0x557a0e750b90 2024-08-19T00:45:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.119+0000 7f72b5600640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557a0e750b90 0x557a0e750f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.120+0000 7f72b5600640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557a0e750b90 0x557a0e750f70 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.121+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v101'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.121+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e753a40 con 0x557a0e750b90 2024-08-19T00:45:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.123+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v101'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.123+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e753de0 con 0x557a0e750b90 2024-08-19T00:45:30.125 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.124+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v101'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.124+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e6a1200 con 0x557a0e750b90 2024-08-19T00:45:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.125+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v101'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.125+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7557a0 con 0x557a0e750b90 2024-08-19T00:45:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.126+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v101'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.126+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e754630 con 0x557a0e750b90 2024-08-19T00:45:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.128+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v101'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.128+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e754a20 con 0x557a0e6a8130 2024-08-19T00:45:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.130+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v101'68 uv67 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.130+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e754a20 con 0x557a0e6a8130 2024-08-19T00:45:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.131+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v101'69 uv69 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.131+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e754a20 con 0x557a0e6a8130 2024-08-19T00:45:30.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.133+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v101'70 uv70 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.134 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:30.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.133+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e754a20 con 0x557a0e6a8130 2024-08-19T00:45:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.134+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v101'71 uv71 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.134+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557a0e755b90 0x557a0e757f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.134+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7584c0 con 0x557a0e755b90 2024-08-19T00:45:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.135+0000 7f72b6a00640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557a0e755b90 0x557a0e757f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.135+0000 7f72b6a00640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557a0e755b90 0x557a0e757f80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.136+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v101'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.137+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7584c0 con 0x557a0e755b90 2024-08-19T00:45:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.138+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v101'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.138+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7584c0 con 0x557a0e755b90 2024-08-19T00:45:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.139+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v101'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.141 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.139+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7594d0 con 0x557a0e755b90 2024-08-19T00:45:30.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.140+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v101'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.140+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7594d0 con 0x557a0e755b90 2024-08-19T00:45:30.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.141+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v101'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.142+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e7584c0 con 0x557a0e755b90 2024-08-19T00:45:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.143+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v101'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.143+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557a0e758b40 0x557a0e75af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.143+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75b5f0 con 0x557a0e758b40 2024-08-19T00:45:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.143+0000 7f72b6000640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557a0e758b40 0x557a0e75af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.144+0000 7f72b6000640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557a0e758b40 0x557a0e75af30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.145+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v101'160 uv154 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.145+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75b6b0 con 0x557a0e758b40 2024-08-19T00:45:30.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.146+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v101'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.146+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75bad0 con 0x557a0e758b40 2024-08-19T00:45:30.151 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:30.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.147+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v101'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.147+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75cae0 con 0x557a0e758b40 2024-08-19T00:45:30.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.149+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v101'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.149+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75cae0 con 0x557a0e758b40 2024-08-19T00:45:30.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.150+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v101'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.150+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75bad0 con 0x557a0e758b40 2024-08-19T00:45:30.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.151+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v101'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.151+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75bad0 con 0x557a0e758b40 2024-08-19T00:45:30.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.153+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v101'166 uv159 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.153+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75bad0 con 0x557a0e758b40 2024-08-19T00:45:30.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.154+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v101'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.154+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75bad0 con 0x557a0e758b40 2024-08-19T00:45:30.157 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:30.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.156+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v101'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.156+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75bad0 con 0x557a0e758b40 2024-08-19T00:45:30.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.157+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v101'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.157+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75bad0 con 0x557a0e758b40 2024-08-19T00:45:30.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.158+0000 7f72b6000640 1 -- 172.21.15.7:0/2218144067 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v101'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a8054c20 con 0x557a0e758b40 2024-08-19T00:45:30.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.158+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557a0e75c150 0x557a0e75e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.158+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75eb80 con 0x557a0e75c150 2024-08-19T00:45:30.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.159+0000 7f72b5600640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557a0e75c150 0x557a0e75e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.159+0000 7f72b5600640 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557a0e75c150 0x557a0e75e540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.160+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v101'71 uv70 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.161+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75ef50 con 0x557a0e75c150 2024-08-19T00:45:30.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.162+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v101'72 uv72 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.162+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f400 con 0x557a0e75c150 2024-08-19T00:45:30.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.163+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v101'73 uv73 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.165 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:30.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.164+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e75c150 2024-08-19T00:45:30.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.165+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v101'74 uv74 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.165+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e75c150 2024-08-19T00:45:30.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.166+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v101'75 uv75 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.166+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e6a8130 2024-08-19T00:45:30.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.168+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v101'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.168+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e6a8130 2024-08-19T00:45:30.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.169+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v101'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.169+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e6a8130 2024-08-19T00:45:30.172 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:30.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.170+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v101'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.170+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e760800 con 0x557a0e6a8130 2024-08-19T00:45:30.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.171+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v101'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.172+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e760800 con 0x557a0e6a8130 2024-08-19T00:45:30.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.173+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v101'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.173+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e6a8130 2024-08-19T00:45:30.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.174+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v101'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e6a8130 2024-08-19T00:45:30.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.174+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.176+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v101'142 uv136 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.176+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.177+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v101'143 uv143 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.177+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.180 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:30.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.178+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v101'144 uv144 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.179+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.180+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v101'145 uv145 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.180+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.182+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v101'146 uv146 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.182+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.183+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v101'147 uv141 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.183+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.184+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v101'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.184+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.186+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v101'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.187 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:30.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.186+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75f7f0 con 0x557a0e750b90 2024-08-19T00:45:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.187+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v101'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.187+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e762600 con 0x557a0e750b90 2024-08-19T00:45:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.189+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v101'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e750b90 2024-08-19T00:45:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.189+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.190+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v101'66 uv64 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.190+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.192+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v101'67 uv67 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.192+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.195 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.193+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v101'68 uv68 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.193+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.195+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v101'69 uv69 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.195+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.196+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v101'87 uv86 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.196+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.198+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v101'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.198+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.201 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.199+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v101'89 uv89 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.199+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.201+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v101'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.201+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e760cb0 con 0x557a0e755b90 2024-08-19T00:45:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.203+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v101'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.203+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e755b90 2024-08-19T00:45:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.204+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v101'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72b000f070 con 0x557a0e755b90 2024-08-19T00:45:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.204+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.206+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v101'74 uv73 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.206+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.207+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v101'75 uv75 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.207+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.210 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.208+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v101'76 uv76 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.208+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.210+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v101'77 uv77 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.210+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.211+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v101'78 uv78 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.211+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.213+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v101'182 uv172 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.213+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.214+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v101'183 uv183 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.214+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.217 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.215+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v101'184 uv184 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.215+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.217+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v101'185 uv185 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.217+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.218+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v101'186 uv186 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.218+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.221 INFO:teuthology.orchestra.run.smithi007.stdout:Write #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.219+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v101'187 uv187 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.219+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e760cb0 con 0x557a0e75c150 2024-08-19T00:45:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.220+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v101'188 uv188 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.220+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e760cb0 con 0x557a0e75c150 2024-08-19T00:45:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.222+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v101'189 uv189 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.222+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e75fca0 con 0x557a0e75c150 2024-08-19T00:45:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.223+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [omap-set-header] v101'190 uv190 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.223+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x557a0e760200 con 0x557a0e75c150 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b5600640 1 -- 172.21.15.7:0/2218144067 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v101'191 uv191 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f72a400e040 con 0x557a0e75c150 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557a0e74c4b0 msgr2=0x557a0e74e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557a0e74c4b0 0x557a0e74e8a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557a0e758b40 msgr2=0x557a0e75af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557a0e758b40 0x557a0e75af30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557a0e75c150 msgr2=0x557a0e75e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557a0e75c150 0x557a0e75e540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557a0e750b90 msgr2=0x557a0e750f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557a0e750b90 0x557a0e750f70 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a0e6a8130 msgr2=0x557a0e6a2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a0e6a8130 0x557a0e6a2c00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557a0e755b90 msgr2=0x557a0e757f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557a0e755b90 0x557a0e757f80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 reap_dead start 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.224+0000 7f72b6a00640 1 -- 172.21.15.7:0/2218144067 reap_dead start 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f729806a810 msgr2=0x7f729806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f729806a810 0x7f729806ccd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f72a8056000 tx=0x7f72a8050000 comp rx=0 tx=0).stop 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e6035b0 msgr2=0x557a0e6a7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e6035b0 0x557a0e6a7b40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x557a0e600e50 tx=0x7f72a400b5b0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 shutdown_connections 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f729806a810 0x7f729806ccd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557a0e755b90 0x557a0e757f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 --2- 172.21.15.7:0/2218144067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a0e6035b0 0x557a0e6a7b40 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 >> 172.21.15.7:0/2218144067 conn(0x557a0e6004e0 msgr2=0x557a0e5d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 shutdown_connections 2024-08-19T00:45:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.225+0000 7f72b8d28f40 1 -- 172.21.15.7:0/2218144067 wait complete. 2024-08-19T00:45:30.231 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 1.00000000.inode - 2024-08-19T00:45:30.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.347+0000 7eff59c0bf40 1 Processor -- start 2024-08-19T00:45:30.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.347+0000 7eff59c0bf40 1 -- start start 2024-08-19T00:45:30.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.348+0000 7eff59c0bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb15b0 0x55b337057e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.348+0000 7eff59c0bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fb1990 0x55b336f7f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.348+0000 7eff59c0bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fc98d0 0x55b336fac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.348+0000 7eff59c0bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b337056dc0 con 0x55b336fc98d0 2024-08-19T00:45:30.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.348+0000 7eff59c0bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b336f25d00 con 0x55b336fb15b0 2024-08-19T00:45:30.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.348+0000 7eff59c0bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b3370570a0 con 0x55b336fb1990 2024-08-19T00:45:30.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.348+0000 7eff56200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb15b0 0x55b337057e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff55800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fb1990 0x55b336f7f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb15b0 0x55b337057e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:60270/0 (socket says 172.21.15.7:60270) 2024-08-19T00:45:30.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 -- 172.21.15.7:0/3447385664 learned_addr learned my addr 172.21.15.7:0/3447385664 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:30.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fc98d0 0x55b336fac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 -- 172.21.15.7:0/3447385664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fb1990 msgr2=0x55b336f7f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:30.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 --2- 172.21.15.7:0/3447385664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fb1990 0x55b336f7f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 -- 172.21.15.7:0/3447385664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fc98d0 msgr2=0x55b336fac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 --2- 172.21.15.7:0/3447385664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fc98d0 0x55b336fac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 -- 172.21.15.7:0/3447385664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b336eaab30 con 0x55b336fb15b0 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff56200640 1 --2- 172.21.15.7:0/3447385664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb15b0 0x55b337057e90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7eff4800a4f0 tx=0x7eff4804e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5932adfe37b0e929 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.349+0000 7eff4fe00640 1 -- 172.21.15.7:0/3447385664 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48065070 con 0x55b336fb15b0 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff4fe00640 1 -- 172.21.15.7:0/3447385664 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff480549f0 con 0x55b336fb15b0 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff4fe00640 1 -- 172.21.15.7:0/3447385664 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48059040 con 0x55b336fb15b0 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3447385664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb15b0 msgr2=0x55b337057e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3447385664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb15b0 0x55b337057e90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7eff4800a4f0 tx=0x7eff4804e000 comp rx=0 tx=0).stop 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3447385664 shutdown_connections 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3447385664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fc98d0 0x55b336fac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3447385664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fb1990 0x55b336f7f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3447385664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb15b0 0x55b337057e90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3447385664 >> 172.21.15.7:0/3447385664 conn(0x55b336fae4e0 msgr2=0x55b336fad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3447385664 shutdown_connections 2024-08-19T00:45:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.350+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3447385664 wait complete. 2024-08-19T00:45:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.351+0000 7eff59c0bf40 1 Processor -- start 2024-08-19T00:45:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.351+0000 7eff59c0bf40 1 -- start start 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff59c0bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fb15b0 0x55b3370466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff59c0bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb1990 0x55b3370518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff59c0bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fc98d0 0x55b33704f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff59c0bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b336faecc0 con 0x55b336fb15b0 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff59c0bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b336fadfc0 con 0x55b336fb1990 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff59c0bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b337048f20 con 0x55b336fc98d0 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff56200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fb15b0 0x55b3370466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff56200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fb15b0 0x55b3370466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54584/0 (socket says 172.21.15.7:54584) 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff56200640 1 -- 172.21.15.7:0/3959158039 learned_addr learned my addr 172.21.15.7:0/3959158039 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:30.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff56c00640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fc98d0 0x55b33704f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff55800640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb1990 0x55b3370518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.352+0000 7eff56200640 1 -- 172.21.15.7:0/3959158039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fc98d0 msgr2=0x55b33704f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff56200640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b336fc98d0 0x55b33704f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff56200640 1 -- 172.21.15.7:0/3959158039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb1990 msgr2=0x55b3370518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff56200640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b336fb1990 0x55b3370518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff56200640 1 -- 172.21.15.7:0/3959158039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b336ee7080 con 0x55b336fb15b0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff56200640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fb15b0 0x55b3370466f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7eff48063040 tx=0x7eff48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff4ea00640 1 -- 172.21.15.7:0/3959158039 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48070070 con 0x55b336fb15b0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff4ea00640 1 -- 172.21.15.7:0/3959158039 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff48054da0 con 0x55b336fb15b0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b337046f30 con 0x55b336fb15b0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.353+0000 7eff4ea00640 1 -- 172.21.15.7:0/3959158039 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48065040 con 0x55b336fb15b0 2024-08-19T00:45:30.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.354+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33704af30 con 0x55b336fb15b0 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.355+0000 7eff4ea00640 1 -- 172.21.15.7:0/3959158039 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff48073070 con 0x55b336fb15b0 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.356+0000 7eff4ea00640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff3806a860 0x7eff3806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.356+0000 7eff4ea00640 1 -- 172.21.15.7:0/3959158039 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7eff480ce790 con 0x55b336fb15b0 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.356+0000 7eff55800640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff3806a860 0x7eff3806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.356+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b336fcbe20 0x55b337053a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.356+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) -- 0x55b337051de0 con 0x55b336fcbe20 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.357+0000 7eff56c00640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b336fcbe20 0x55b337053a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.357+0000 7eff55800640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff3806a860 0x7eff3806cd20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55b336fac4e0 tx=0x7eff4400c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.357+0000 7eff56c00640 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b336fcbe20 0x55b337053a30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff56c00640 1 -- 172.21.15.7:0/3959158039 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 1.00000000.inode [writefull 0~80] v101'351 uv351 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7eff500034b0 con 0x55b336fcbe20 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b336fcbe20 msgr2=0x55b337053a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b336fcbe20 0x55b337053a30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff3806a860 msgr2=0x7eff3806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7eff3806a860 0x7eff3806cd20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55b336fac4e0 tx=0x7eff4400c040 comp rx=0 tx=0).stop 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fb15b0 msgr2=0x55b3370466f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 --2- 172.21.15.7:0/3959158039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b336fb15b0 0x55b3370466f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7eff48063040 tx=0x7eff48002fb0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff56c00640 1 -- 172.21.15.7:0/3959158039 reap_dead start 2024-08-19T00:45:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 shutdown_connections 2024-08-19T00:45:30.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 >> 172.21.15.7:0/3959158039 conn(0x55b336fae4e0 msgr2=0x55b337057bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:30.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 shutdown_connections 2024-08-19T00:45:30.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.359+0000 7eff59c0bf40 1 -- 172.21.15.7:0/3959158039 wait complete. 2024-08-19T00:45:30.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:30.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.563+0000 7f88cfc00640 1 Processor -- start 2024-08-19T00:45:30.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.563+0000 7f88cfc00640 1 -- start start 2024-08-19T00:45:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.564+0000 7f88cfc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f88c806d780 0x7f88c806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.564+0000 7f88cfc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c80b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.564+0000 7f88cfc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c806e0a0 con 0x7f88c809ba80 2024-08-19T00:45:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.564+0000 7f88cfc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f88c80b6f70 con 0x7f88c806d780 2024-08-19T00:45:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.564+0000 7f88cfc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f88c80b7250 con 0x7f88c80ccc40 2024-08-19T00:45:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88cd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f88c806d780 0x7f88c806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88c7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f88c809ba80 0x7f88c80b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49436/0 (socket says 172.21.15.7:49436) 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88cd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f88c806d780 0x7f88c806db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54588/0 (socket says 172.21.15.7:54588) 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88c7e00640 1 -- 172.21.15.7:0/1111582678 learned_addr learned my addr 172.21.15.7:0/1111582678 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88cdc00640 1 --2- 172.21.15.7:0/1111582678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c80b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88cd200640 1 -- 172.21.15.7:0/1111582678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 msgr2=0x7f88c80b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88cd200640 1 --2- 172.21.15.7:0/1111582678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c80b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88cd200640 1 -- 172.21.15.7:0/1111582678 >> v1:172.21.15.7:6789/0 conn(0x7f88c809ba80 legacy=0x7f88c80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88cd200640 1 -- 172.21.15.7:0/1111582678 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c80cb430 con 0x7f88c806d780 2024-08-19T00:45:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.565+0000 7f88c7400640 1 -- 172.21.15.7:0/1111582678 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876329440 0 0) 0x7f88c806e0a0 con 0x7f88c809ba80 2024-08-19T00:45:30.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.566+0000 7f88cd200640 1 --2- 172.21.15.7:0/1111582678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c806db60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0097a0 tx=0x7f88bc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8f880daa205239 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.566+0000 7f88c7400640 1 -- 172.21.15.7:0/1111582678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc037070 con 0x7f88c806d780 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.566+0000 7f88c7400640 1 -- 172.21.15.7:0/1111582678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88bc032440 con 0x7f88c806d780 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.566+0000 7f88c7400640 1 -- 172.21.15.7:0/1111582678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc032810 con 0x7f88c806d780 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 -- 172.21.15.7:0/1111582678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 msgr2=0x7f88c806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 --2- 172.21.15.7:0/1111582678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c806db60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0097a0 tx=0x7f88bc02a210 comp rx=0 tx=0).stop 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 -- 172.21.15.7:0/1111582678 shutdown_connections 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 --2- 172.21.15.7:0/1111582678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c80b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 --2- 172.21.15.7:0/1111582678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c806db60 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 -- 172.21.15.7:0/1111582678 >> 172.21.15.7:0/1111582678 conn(0x7f88c80d2180 msgr2=0x7f88c80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 -- 172.21.15.7:0/1111582678 shutdown_connections 2024-08-19T00:45:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.567+0000 7f88cfc00640 1 -- 172.21.15.7:0/1111582678 wait complete. 2024-08-19T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.569+0000 7f88cfc00640 1 Processor -- start 2024-08-19T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.569+0000 7f88cfc00640 1 -- start start 2024-08-19T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cfc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c81e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cfc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88c809ba80 0x7f88c8155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cfc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cfc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f88c815ea10 con 0x7f88c806d780 2024-08-19T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cfc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88c806f9a0 con 0x7f88c809ba80 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cfc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f88c806d380 con 0x7f88c80ccc40 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c81e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c81e7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54594/0 (socket says 172.21.15.7:54594) 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 -- 172.21.15.7:0/526024684 learned_addr learned my addr 172.21.15.7:0/526024684 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cdc00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88c7e00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88c809ba80 0x7f88c8155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 -- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 msgr2=0x7f88c809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 -- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88c809ba80 msgr2=0x7f88c8155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88c809ba80 0x7f88c8155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.570+0000 7f88cd200640 1 -- 172.21.15.7:0/526024684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c81e8640 con 0x7f88c806d780 2024-08-19T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.571+0000 7f88cd200640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c81e7dc0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f88bc000c00 tx=0x7f88bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.571+0000 7f88c4c00640 1 -- 172.21.15.7:0/526024684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc037040 con 0x7f88c806d780 2024-08-19T00:45:30.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.571+0000 7f88c4c00640 1 -- 172.21.15.7:0/526024684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88bc042070 con 0x7f88c806d780 2024-08-19T00:45:30.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.571+0000 7f88c4c00640 1 -- 172.21.15.7:0/526024684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc030940 con 0x7f88c806d780 2024-08-19T00:45:30.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.571+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c81e8920 con 0x7f88c806d780 2024-08-19T00:45:30.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.571+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c81e8ee0 con 0x7f88c806d780 2024-08-19T00:45:30.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.572+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c80b3b90 con 0x7f88c806d780 2024-08-19T00:45:30.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.573+0000 7f88c4c00640 1 -- 172.21.15.7:0/526024684 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88bc030ae0 con 0x7f88c806d780 2024-08-19T00:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.575+0000 7f88c4c00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f88a806be30 0x7f88a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.575+0000 7f88c4c00640 1 -- 172.21.15.7:0/526024684 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6999+0+0 (secure 0 0 0) 0x7f88bc0abda0 con 0x7f88c806d780 2024-08-19T00:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.575+0000 7f88c7e00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f88a806be30 0x7f88a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.576+0000 7f88c7e00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f88a806be30 0x7f88a806e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f88c8071840 tx=0x7f88b4007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:30.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.579+0000 7f88c4c00640 1 -- 172.21.15.7:0/526024684 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f88bc045360 con 0x7f88c806d780 2024-08-19T00:45:30.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.802+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f88c80d2770 con 0x7f88c806d780 2024-08-19T00:45:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.930+0000 7f88c4c00640 1 -- 172.21.15.7:0/526024684 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v178) ==== 162+0+0 (secure 0 0 0) 0x7f88bc07a1a0 con 0x7f88c806d780 2024-08-19T00:45:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f88a806be30 msgr2=0x7f88a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f88a806be30 0x7f88a806e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f88c8071840 tx=0x7f88b4007c00 comp rx=0 tx=0).stop 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 msgr2=0x7f88c81e7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c81e7dc0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f88bc000c00 tx=0x7f88bc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 shutdown_connections 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f88a806be30 0x7f88a806e2f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88c80ccc40 0x7f88c809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88c809ba80 0x7f88c8155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 --2- 172.21.15.7:0/526024684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c806d780 0x7f88c81e7dc0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:30.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 >> 172.21.15.7:0/526024684 conn(0x7f88c80d2180 msgr2=0x7f88c806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:30.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 shutdown_connections 2024-08-19T00:45:30.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:30.934+0000 7f88cfc00640 1 -- 172.21.15.7:0/526024684 wait complete. 2024-08-19T00:45:30.946 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:30.945+0000 7f438fa00640 -1 mds.0.cache.ino(0x1) Corrupt inode 0x1: End of buffer [buffer:2] 2024-08-19T00:45:30.946 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:30.945+0000 7f438fa00640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:45:30.947 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:30.945+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:30.947 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:30.946+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:45:30.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:31.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.111+0000 7f42b9400640 1 Processor -- start 2024-08-19T00:45:31.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.111+0000 7f42b9400640 1 -- start start 2024-08-19T00:45:31.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.112+0000 7f42b9400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f42b40d03c0 0x7f42b4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.112+0000 7f42b9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42b406e710 0x7f42b40d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.112+0000 7f42b9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b40cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.112+0000 7f42b9400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f42b40cebc0 con 0x7f42b406e710 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.112+0000 7f42b9400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f42b40d0ce0 con 0x7f42b40d03c0 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.112+0000 7f42b9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42b40cdfb0 con 0x7f42b40b3750 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.112+0000 7f42b1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42b406e710 0x7f42b40d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42b406e710 0x7f42b40d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54604/0 (socket says 172.21.15.7:54604) 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b1e00640 1 -- 172.21.15.7:0/3106356128 learned_addr learned my addr 172.21.15.7:0/3106356128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b3200640 1 --2- 172.21.15.7:0/3106356128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b40cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b1e00640 1 -- 172.21.15.7:0/3106356128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 msgr2=0x7f42b40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b1e00640 1 --2- 172.21.15.7:0/3106356128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b40cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b1e00640 1 -- 172.21.15.7:0/3106356128 >> v2:172.21.15.162:3300/0 conn(0x7f42b40d03c0 msgr2=0x7f42b4071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:31.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b1e00640 1 --2- 172.21.15.7:0/3106356128 >> v2:172.21.15.162:3300/0 conn(0x7f42b40d03c0 0x7f42b4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b1e00640 1 -- 172.21.15.7:0/3106356128 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b40ce290 con 0x7f42b406e710 2024-08-19T00:45:31.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.113+0000 7f42b3200640 1 --2- 172.21.15.7:0/3106356128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b40cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.114+0000 7f42b1e00640 1 --2- 172.21.15.7:0/3106356128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b40d07a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009870 tx=0x7f42a002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa480b9636c52fde server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.114+0000 7f42b1400640 1 -- 172.21.15.7:0/3106356128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0037070 con 0x7f42b406e710 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.114+0000 7f42b1400640 1 -- 172.21.15.7:0/3106356128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a0032440 con 0x7f42b406e710 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.114+0000 7f42b1400640 1 -- 172.21.15.7:0/3106356128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0032810 con 0x7f42b406e710 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 -- 172.21.15.7:0/3106356128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 msgr2=0x7f42b40d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 --2- 172.21.15.7:0/3106356128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b40d07a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009870 tx=0x7f42a002a210 comp rx=0 tx=0).stop 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 -- 172.21.15.7:0/3106356128 shutdown_connections 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 --2- 172.21.15.7:0/3106356128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b40cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 --2- 172.21.15.7:0/3106356128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b40d07a0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 --2- 172.21.15.7:0/3106356128 >> v2:172.21.15.162:3300/0 conn(0x7f42b40d03c0 0x7f42b4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 -- 172.21.15.7:0/3106356128 >> 172.21.15.7:0/3106356128 conn(0x7f42b406bc70 msgr2=0x7f42b406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:31.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 -- 172.21.15.7:0/3106356128 shutdown_connections 2024-08-19T00:45:31.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.115+0000 7f42b9400640 1 -- 172.21.15.7:0/3106356128 wait complete. 2024-08-19T00:45:31.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.117+0000 7f42b9400640 1 Processor -- start 2024-08-19T00:45:31.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.117+0000 7f42b9400640 1 -- start start 2024-08-19T00:45:31.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b4099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b9400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b40d03c0 0x7f42b409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4073ae0 con 0x7f42b406e710 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42b40ce850 con 0x7f42b40d03c0 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b9400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42b4073c60 con 0x7f42b40b3750 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b4099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b4099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54608/0 (socket says 172.21.15.7:54608) 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 -- 172.21.15.7:0/1943716018 learned_addr learned my addr 172.21.15.7:0/1943716018 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b1e00640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b3200640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b40d03c0 0x7f42b409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 -- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 msgr2=0x7f42b415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 -- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b40d03c0 msgr2=0x7f42b409bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b40d03c0 0x7f42b409bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.118+0000 7f42b2800640 1 -- 172.21.15.7:0/1943716018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b415c790 con 0x7f42b406e710 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.119+0000 7f42b2800640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b4099a50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f42a400b4d0 tx=0x7f42a400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.119+0000 7f42aaa00640 1 -- 172.21.15.7:0/1943716018 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4014070 con 0x7f42b406e710 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.119+0000 7f42aaa00640 1 -- 172.21.15.7:0/1943716018 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a4010870 con 0x7f42b406e710 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.119+0000 7f42aaa00640 1 -- 172.21.15.7:0/1943716018 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4010c60 con 0x7f42b406e710 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.119+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b415ca30 con 0x7f42b406e710 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.119+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b415cff0 con 0x7f42b406e710 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.120+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b40b3be0 con 0x7f42b406e710 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.121+0000 7f42aaa00640 1 -- 172.21.15.7:0/1943716018 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42a4017070 con 0x7f42b406e710 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.122+0000 7f42aaa00640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.122+0000 7f42aaa00640 1 -- 172.21.15.7:0/1943716018 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7f42a408b180 con 0x7f42b406e710 2024-08-19T00:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.122+0000 7f42b1e00640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.123+0000 7f42b1e00640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f429406be30 0x7f429406e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f42a0034000 tx=0x7f42a002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.126+0000 7f42aaa00640 1 -- 172.21.15.7:0/1943716018 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f42a4058f70 con 0x7f42b406e710 2024-08-19T00:45:31.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.349+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42b40cc7e0 con 0x7f42b406e710 2024-08-19T00:45:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.350+0000 7f42aaa00640 1 -- 172.21.15.7:0/1943716018 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 180 v180) ==== 95+0+4390 (secure 0 0 0) 0x7f42a405d270 con 0x7f42b406e710 2024-08-19T00:45:31.351 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:31.352 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":180,"btime":"2024-08-19T00:45:30:946557+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":180,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:30.946498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 180 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f429406be30 msgr2=0x7f429406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f429406be30 0x7f429406e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f42a0034000 tx=0x7f42a002e000 comp rx=0 tx=0).stop 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 msgr2=0x7f42b4099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b4099a50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f42a400b4d0 tx=0x7f42a400b990 comp rx=0 tx=0).stop 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 shutdown_connections 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b40d03c0 0x7f42b409bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b40b3750 0x7f42b415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 --2- 172.21.15.7:0/1943716018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42b406e710 0x7f42b4099a50 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 >> 172.21.15.7:0/1943716018 conn(0x7f42b406bc70 msgr2=0x7f42b40b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 shutdown_connections 2024-08-19T00:45:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.352+0000 7f42b9400640 1 -- 172.21.15.7:0/1943716018 wait complete. 2024-08-19T00:45:31.369 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:31.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:31.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.525+0000 7f0f41800640 1 Processor -- start 2024-08-19T00:45:31.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.525+0000 7f0f41800640 1 -- start start 2024-08-19T00:45:31.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.526+0000 7f0f41800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c071980 0x7f0f3c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.526+0000 7f0f41800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3c0cdfb0 con 0x7f0f3c06e710 2024-08-19T00:45:31.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.526+0000 7f0f41800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3c0ce290 con 0x7f0f3c0d03c0 2024-08-19T00:45:31.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.526+0000 7f0f41800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c0cebc0 con 0x7f0f3c071980 2024-08-19T00:45:31.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f33e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0f3c06e710 0x7f0f3c0b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49440/0 (socket says 172.21.15.7:49440) 2024-08-19T00:45:31.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f33e00640 1 -- 172.21.15.7:0/1263178156 learned_addr learned my addr 172.21.15.7:0/1263178156 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:31.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3b400640 1 --2- 172.21.15.7:0/1263178156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c071980 0x7f0f3c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3a000640 1 -- 172.21.15.7:0/1263178156 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650002084 0 0) 0x7f0f3c0cdfb0 con 0x7f0f3c06e710 2024-08-19T00:45:31.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3a000640 1 -- 172.21.15.7:0/1263178156 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f20003520 con 0x7f0f3c06e710 2024-08-19T00:45:31.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3a000640 1 -- 172.21.15.7:0/1263178156 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183288706 0 0) 0x7f0f3c0ce290 con 0x7f0f3c0d03c0 2024-08-19T00:45:31.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3a000640 1 -- 172.21.15.7:0/1263178156 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f3c0cdfb0 con 0x7f0f3c0d03c0 2024-08-19T00:45:31.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3b400640 1 -- 172.21.15.7:0/1263178156 >> v1:172.21.15.162:6789/0 conn(0x7f0f3c0d03c0 legacy=0x7f0f3c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3b400640 1 -- 172.21.15.7:0/1263178156 >> v1:172.21.15.7:6789/0 conn(0x7f0f3c06e710 legacy=0x7f0f3c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.527+0000 7f0f3b400640 1 -- 172.21.15.7:0/1263178156 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c0ce570 con 0x7f0f3c071980 2024-08-19T00:45:31.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.528+0000 7f0f3b400640 1 --2- 172.21.15.7:0/1263178156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c071980 0x7f0f3c0cf050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009df0 tx=0x7f0f3402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd99892effc2265 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f3a000640 1 -- 172.21.15.7:0/1263178156 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34007740 con 0x7f0f3c071980 2024-08-19T00:45:31.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f3a000640 1 -- 172.21.15.7:0/1263178156 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f340078e0 con 0x7f0f3c071980 2024-08-19T00:45:31.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f3a000640 1 -- 172.21.15.7:0/1263178156 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34007cb0 con 0x7f0f3c071980 2024-08-19T00:45:31.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f41800640 1 -- 172.21.15.7:0/1263178156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c071980 msgr2=0x7f0f3c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f41800640 1 --2- 172.21.15.7:0/1263178156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c071980 0x7f0f3c0cf050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009df0 tx=0x7f0f3402a710 comp rx=0 tx=0).stop 2024-08-19T00:45:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f41800640 1 -- 172.21.15.7:0/1263178156 shutdown_connections 2024-08-19T00:45:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f41800640 1 --2- 172.21.15.7:0/1263178156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c071980 0x7f0f3c0cf050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f41800640 1 -- 172.21.15.7:0/1263178156 >> 172.21.15.7:0/1263178156 conn(0x7f0f3c06bc70 msgr2=0x7f0f3c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f41800640 1 -- 172.21.15.7:0/1263178156 shutdown_connections 2024-08-19T00:45:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.529+0000 7f0f41800640 1 -- 172.21.15.7:0/1263178156 wait complete. 2024-08-19T00:45:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.531+0000 7f0f41800640 1 Processor -- start 2024-08-19T00:45:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.531+0000 7f0f41800640 1 -- start start 2024-08-19T00:45:31.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f41800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f3c06e710 0x7f0f3c0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f41800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f3c071980 0x7f0f3c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f41800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c0d03c0 0x7f0f3c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f41800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c073c60 con 0x7f0f3c071980 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f41800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c073ae0 con 0x7f0f3c06e710 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f41800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c0cf590 con 0x7f0f3c0d03c0 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f33e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f3c071980 0x7f0f3c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f33e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f3c071980 0x7f0f3c156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54610/0 (socket says 172.21.15.7:54610) 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f33e00640 1 -- 172.21.15.7:0/1714771333 learned_addr learned my addr 172.21.15.7:0/1714771333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f3b400640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c0d03c0 0x7f0f3c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.532+0000 7f0f3aa00640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f3c06e710 0x7f0f3c0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f33e00640 1 -- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c0d03c0 msgr2=0x7f0f3c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f33e00640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c0d03c0 0x7f0f3c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f33e00640 1 -- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f3c06e710 msgr2=0x7f0f3c0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f33e00640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f3c06e710 0x7f0f3c0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f33e00640 1 -- 172.21.15.7:0/1714771333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c158b00 con 0x7f0f3c071980 2024-08-19T00:45:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f33e00640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f3c071980 0x7f0f3c156390 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c410 tx=0x7f0f2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f32a00640 1 -- 172.21.15.7:0/1714771333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24017070 con 0x7f0f3c071980 2024-08-19T00:45:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f32a00640 1 -- 172.21.15.7:0/1714771333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f24005ce0 con 0x7f0f3c071980 2024-08-19T00:45:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c09bf60 con 0x7f0f3c071980 2024-08-19T00:45:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f32a00640 1 -- 172.21.15.7:0/1714771333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f240072d0 con 0x7f0f3c071980 2024-08-19T00:45:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.533+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c0b0330 con 0x7f0f3c071980 2024-08-19T00:45:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.534+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c0cf050 con 0x7f0f3c071980 2024-08-19T00:45:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.535+0000 7f0f32a00640 1 -- 172.21.15.7:0/1714771333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f2401a070 con 0x7f0f3c071980 2024-08-19T00:45:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.536+0000 7f0f32a00640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f1806be30 0x7f0f1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.536+0000 7f0f32a00640 1 -- 172.21.15.7:0/1714771333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7f0f2408a6b0 con 0x7f0f3c071980 2024-08-19T00:45:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.537+0000 7f0f3aa00640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f1806be30 0x7f0f1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.537+0000 7f0f3aa00640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f1806be30 0x7f0f1806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0011e0 tx=0x7f0f2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.541+0000 7f0f32a00640 1 -- 172.21.15.7:0/1714771333 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0f240584a0 con 0x7f0f3c071980 2024-08-19T00:45:31.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.762+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f3c0ad3a0 con 0x7f0f3c071980 2024-08-19T00:45:31.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.763+0000 7f0f32a00640 1 -- 172.21.15.7:0/1714771333 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 180 v180) ==== 95+0+4390 (secure 0 0 0) 0x7f0f2405c7a0 con 0x7f0f3c071980 2024-08-19T00:45:31.765 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:31.765 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":180,"btime":"2024-08-19T00:45:30:946557+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":180,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:30.946498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 180 2024-08-19T00:45:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f1806be30 msgr2=0x7f0f1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f1806be30 0x7f0f1806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0011e0 tx=0x7f0f2c009040 comp rx=0 tx=0).stop 2024-08-19T00:45:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f3c071980 msgr2=0x7f0f3c156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f3c071980 0x7f0f3c156390 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c410 tx=0x7f0f2400c8d0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 shutdown_connections 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0f1806be30 0x7f0f1806e2f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3c0d03c0 0x7f0f3c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f3c071980 0x7f0f3c156390 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 --2- 172.21.15.7:0/1714771333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f3c06e710 0x7f0f3c0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 >> 172.21.15.7:0/1714771333 conn(0x7f0f3c06bc70 msgr2=0x7f0f3c06d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.765+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 shutdown_connections 2024-08-19T00:45:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.766+0000 7f0f41800640 1 -- 172.21.15.7:0/1714771333 wait complete. 2024-08-19T00:45:31.784 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:31.784 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:31.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.941+0000 7ff0db200640 1 Processor -- start 2024-08-19T00:45:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.941+0000 7ff0db200640 1 -- start start 2024-08-19T00:45:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.942+0000 7ff0db200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0d40d3200 0x7ff0d415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.942+0000 7ff0db200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d40b3ab0 con 0x7ff0d415e740 2024-08-19T00:45:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.942+0000 7ff0db200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d415f460 con 0x7ff0d415e360 2024-08-19T00:45:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.942+0000 7ff0db200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d415f740 con 0x7ff0d40d3200 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.942+0000 7ff0da800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0d415e740 0x7ff0d415eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49452/0 (socket says 172.21.15.7:49452) 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.942+0000 7ff0da800640 1 -- 172.21.15.7:0/1457076407 learned_addr learned my addr 172.21.15.7:0/1457076407 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.942+0000 7ff0d9400640 1 --2- 172.21.15.7:0/1457076407 >> v2:172.21.15.162:3300/0 conn(0x7ff0d40d3200 0x7ff0d415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.943+0000 7ff0d8a00640 1 -- 172.21.15.7:0/1457076407 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690197958 0 0) 0x7ff0d415f460 con 0x7ff0d415e360 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.943+0000 7ff0d8a00640 1 -- 172.21.15.7:0/1457076407 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0bc003520 con 0x7ff0d415e360 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.943+0000 7ff0d8a00640 1 -- 172.21.15.7:0/1457076407 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401166260 0 0) 0x7ff0d40b3ab0 con 0x7ff0d415e740 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.943+0000 7ff0d8a00640 1 -- 172.21.15.7:0/1457076407 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0d415f460 con 0x7ff0d415e740 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.943+0000 7ff0d9400640 1 -- 172.21.15.7:0/1457076407 >> v1:172.21.15.162:6789/0 conn(0x7ff0d415e360 legacy=0x7ff0d40d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.943+0000 7ff0d9400640 1 -- 172.21.15.7:0/1457076407 >> v1:172.21.15.7:6789/0 conn(0x7ff0d415e740 legacy=0x7ff0d415eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.943+0000 7ff0d9400640 1 -- 172.21.15.7:0/1457076407 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40b3d60 con 0x7ff0d40d3200 2024-08-19T00:45:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.944+0000 7ff0d9400640 1 --2- 172.21.15.7:0/1457076407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d40d3200 0x7ff0d415fab0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40097a0 tx=0x7ff0c402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f50c4a751fab3250 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.944+0000 7ff0d8a00640 1 -- 172.21.15.7:0/1457076407 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4037070 con 0x7ff0d40d3200 2024-08-19T00:45:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.944+0000 7ff0d8a00640 1 -- 172.21.15.7:0/1457076407 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c4032440 con 0x7ff0d40d3200 2024-08-19T00:45:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.944+0000 7ff0d8a00640 1 -- 172.21.15.7:0/1457076407 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4032810 con 0x7ff0d40d3200 2024-08-19T00:45:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.945+0000 7ff0db200640 1 -- 172.21.15.7:0/1457076407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d40d3200 msgr2=0x7ff0d415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.945+0000 7ff0db200640 1 --2- 172.21.15.7:0/1457076407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d40d3200 0x7ff0d415fab0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40097a0 tx=0x7ff0c402a230 comp rx=0 tx=0).stop 2024-08-19T00:45:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.945+0000 7ff0db200640 1 -- 172.21.15.7:0/1457076407 shutdown_connections 2024-08-19T00:45:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.945+0000 7ff0db200640 1 --2- 172.21.15.7:0/1457076407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d40d3200 0x7ff0d415fab0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.945+0000 7ff0db200640 1 -- 172.21.15.7:0/1457076407 >> 172.21.15.7:0/1457076407 conn(0x7ff0d408dbf0 msgr2=0x7ff0d409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.945+0000 7ff0db200640 1 -- 172.21.15.7:0/1457076407 shutdown_connections 2024-08-19T00:45:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.945+0000 7ff0db200640 1 -- 172.21.15.7:0/1457076407 wait complete. 2024-08-19T00:45:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.947+0000 7ff0db200640 1 Processor -- start 2024-08-19T00:45:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.947+0000 7ff0db200640 1 -- start start 2024-08-19T00:45:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0db200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0d40d3200 0x7ff0d4155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0db200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d415e360 0x7ff0d40b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0db200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d415e740 0x7ff0d40d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0db200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40b4560 con 0x7ff0d415e360 2024-08-19T00:45:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0db200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40d2300 con 0x7ff0d415e740 2024-08-19T00:45:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0db200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d40b46e0 con 0x7ff0d40d3200 2024-08-19T00:45:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0d9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d415e360 0x7ff0d40b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0d9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d415e360 0x7ff0d40b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54624/0 (socket says 172.21.15.7:54624) 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0d9400640 1 -- 172.21.15.7:0/2319775598 learned_addr learned my addr 172.21.15.7:0/2319775598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0d9e00640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0d40d3200 0x7ff0d4155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.948+0000 7ff0da800640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d415e740 0x7ff0d40d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.949+0000 7ff0d9400640 1 -- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0d40d3200 msgr2=0x7ff0d4155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.949+0000 7ff0d9400640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0d40d3200 0x7ff0d4155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.949+0000 7ff0d9400640 1 -- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d415e740 msgr2=0x7ff0d40d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.949+0000 7ff0d9400640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d415e740 0x7ff0d40d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.949+0000 7ff0d9400640 1 -- 172.21.15.7:0/2319775598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40c82d0 con 0x7ff0d415e360 2024-08-19T00:45:31.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.949+0000 7ff0d9400640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d415e360 0x7ff0d40b7030 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40098c0 tx=0x7ff0c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.951+0000 7ff0ce000640 1 -- 172.21.15.7:0/2319775598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4041030 con 0x7ff0d415e360 2024-08-19T00:45:31.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.951+0000 7ff0ce000640 1 -- 172.21.15.7:0/2319775598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c403d4e0 con 0x7ff0d415e360 2024-08-19T00:45:31.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.951+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d40b7ab0 con 0x7ff0d415e360 2024-08-19T00:45:31.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.951+0000 7ff0ce000640 1 -- 172.21.15.7:0/2319775598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4037040 con 0x7ff0d415e360 2024-08-19T00:45:31.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.951+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d40c8550 con 0x7ff0d415e360 2024-08-19T00:45:31.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.952+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d40b7fd0 con 0x7ff0d415e360 2024-08-19T00:45:31.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.953+0000 7ff0ce000640 1 -- 172.21.15.7:0/2319775598 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0c4044070 con 0x7ff0d415e360 2024-08-19T00:45:31.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.954+0000 7ff0ce000640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0b806be30 0x7ff0b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:31.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.954+0000 7ff0ce000640 1 -- 172.21.15.7:0/2319775598 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7ff0c40aba00 con 0x7ff0d415e360 2024-08-19T00:45:31.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.954+0000 7ff0d9e00640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0b806be30 0x7ff0b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:31.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.955+0000 7ff0d9e00640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0b806be30 0x7ff0b806e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8001010 tx=0x7ff0c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:31.958+0000 7ff0ce000640 1 -- 172.21.15.7:0/2319775598 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff0d40c82d0 con 0x7ff0d415e360 2024-08-19T00:45:32.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.180+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0d40d50d0 con 0x7ff0d415e360 2024-08-19T00:45:32.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.180+0000 7ff0ce000640 1 -- 172.21.15.7:0/2319775598 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 180 v180) ==== 95+0+4390 (secure 0 0 0) 0x7ff0c4079dc0 con 0x7ff0d415e360 2024-08-19T00:45:32.182 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:32.182 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":180,"btime":"2024-08-19T00:45:30:946557+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/835453535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":835453535},{"type":"v1","addr":"172.21.15.7:6836","nonce":835453535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":160}],"filesystems":[{"mdsmap":{"epoch":180,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:30.946498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:32.182 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 180 2024-08-19T00:45:32.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.182+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0b806be30 msgr2=0x7ff0b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.182+0000 7ff0db200640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0b806be30 0x7ff0b806e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8001010 tx=0x7ff0c8009040 comp rx=0 tx=0).stop 2024-08-19T00:45:32.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.182+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d415e360 msgr2=0x7ff0d40b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.182+0000 7ff0db200640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d415e360 0x7ff0d40b7030 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40098c0 tx=0x7ff0c40046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 shutdown_connections 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0b806be30 0x7ff0b806e2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0d415e740 0x7ff0d40d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d415e360 0x7ff0d40b7030 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 --2- 172.21.15.7:0/2319775598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0d40d3200 0x7ff0d4155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 >> 172.21.15.7:0/2319775598 conn(0x7ff0d408dbf0 msgr2=0x7ff0d415fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 shutdown_connections 2024-08-19T00:45:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.183+0000 7ff0db200640 1 -- 172.21.15.7:0/2319775598 wait complete. 2024-08-19T00:45:32.200 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 1.00000000.inode' led to DAMAGED state 2024-08-19T00:45:32.200 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 200.00000000' 2024-08-19T00:45:32.200 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:32.200 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:32.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:45:32.236 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:32.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:32.236 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:45:32.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:32.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:32.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.510+0000 7f1f9f200640 1 Processor -- start 2024-08-19T00:45:32.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.510+0000 7f1f9f200640 1 -- start start 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f9f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1fa0140640 0x7f1fa006d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f9f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fa006db40 0x7f1fa00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f9f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa015e930 con 0x7f1fa013dc30 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f9f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1fa01413f0 con 0x7f1fa0140640 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f9f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1fa015ec10 con 0x7f1fa006db40 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f9de00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1fa013dc30 0x7f1fa0140ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49468/0 (socket says 172.21.15.7:49468) 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f9de00640 1 -- 172.21.15.7:0/158503737 learned_addr learned my addr 172.21.15.7:0/158503737 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.511+0000 7f1f97e00640 1 --2- 172.21.15.7:0/158503737 >> v2:172.21.15.7:3300/0 conn(0x7f1fa0140640 0x7f1fa006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f9d400640 1 -- 172.21.15.7:0/158503737 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262978646 0 0) 0x7f1fa015e930 con 0x7f1fa013dc30 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f9d400640 1 -- 172.21.15.7:0/158503737 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f84005730 con 0x7f1fa013dc30 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f9e800640 1 --2- 172.21.15.7:0/158503737 >> v2:172.21.15.162:3300/0 conn(0x7f1fa006db40 0x7f1fa00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f97e00640 1 -- 172.21.15.7:0/158503737 >> v2:172.21.15.162:3300/0 conn(0x7f1fa006db40 msgr2=0x7f1fa00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f97e00640 1 --2- 172.21.15.7:0/158503737 >> v2:172.21.15.162:3300/0 conn(0x7f1fa006db40 0x7f1fa00ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f97e00640 1 -- 172.21.15.7:0/158503737 >> v1:172.21.15.7:6789/0 conn(0x7f1fa013dc30 legacy=0x7f1fa0140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f97e00640 1 -- 172.21.15.7:0/158503737 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa015eef0 con 0x7f1fa0140640 2024-08-19T00:45:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.512+0000 7f1f9e800640 1 --2- 172.21.15.7:0/158503737 >> v2:172.21.15.162:3300/0 conn(0x7f1fa006db40 0x7f1fa00ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.513+0000 7f1f97e00640 1 --2- 172.21.15.7:0/158503737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa0140640 0x7f1fa006d600 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00cdda0 tx=0x7f1f8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f718a81f0b2c458e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.513+0000 7f1f9d400640 1 -- 172.21.15.7:0/158503737 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88037070 con 0x7f1fa0140640 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.513+0000 7f1f9d400640 1 -- 172.21.15.7:0/158503737 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f88032440 con 0x7f1fa0140640 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.513+0000 7f1f9d400640 1 -- 172.21.15.7:0/158503737 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88032810 con 0x7f1fa0140640 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 -- 172.21.15.7:0/158503737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa0140640 msgr2=0x7f1fa006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 --2- 172.21.15.7:0/158503737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa0140640 0x7f1fa006d600 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00cdda0 tx=0x7f1f8802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 -- 172.21.15.7:0/158503737 shutdown_connections 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 --2- 172.21.15.7:0/158503737 >> v2:172.21.15.162:3300/0 conn(0x7f1fa006db40 0x7f1fa00ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 --2- 172.21.15.7:0/158503737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa0140640 0x7f1fa006d600 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 -- 172.21.15.7:0/158503737 >> 172.21.15.7:0/158503737 conn(0x7f1fa006b850 msgr2=0x7f1fa006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 -- 172.21.15.7:0/158503737 shutdown_connections 2024-08-19T00:45:32.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.514+0000 7f1f9f200640 1 -- 172.21.15.7:0/158503737 wait complete. 2024-08-19T00:45:32.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.515+0000 7f1f9f200640 1 Processor -- start 2024-08-19T00:45:32.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.516+0000 7f1f9f200640 1 -- start start 2024-08-19T00:45:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.516+0000 7f1f9f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa006db40 0x7f1fa01f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.516+0000 7f1f9f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fa013dc30 0x7f1fa01e4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.516+0000 7f1f9f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fa0140640 0x7f1fa01f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.516+0000 7f1f9f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa013e010 con 0x7f1fa006db40 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.516+0000 7f1f9f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa015f4b0 con 0x7f1fa013dc30 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.516+0000 7f1f9f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa013e190 con 0x7f1fa0140640 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa006db40 0x7f1fa01f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa006db40 0x7f1fa01f10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54634/0 (socket says 172.21.15.7:54634) 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 -- 172.21.15.7:0/2761857019 learned_addr learned my addr 172.21.15.7:0/2761857019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f97e00640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fa013dc30 0x7f1fa01e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9e800640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fa0140640 0x7f1fa01f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 -- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fa0140640 msgr2=0x7f1fa01f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fa0140640 0x7f1fa01f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 -- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fa013dc30 msgr2=0x7f1fa01e4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fa013dc30 0x7f1fa01e4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9de00640 1 -- 172.21.15.7:0/2761857019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa01f1600 con 0x7f1fa006db40 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.517+0000 7f1f9e800640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fa0140640 0x7f1fa01f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.518+0000 7f1f9de00640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa006db40 0x7f1fa01f10c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c460 tx=0x7f1f9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.518+0000 7f1f96000640 1 -- 172.21.15.7:0/2761857019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90017070 con 0x7f1fa006db40 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.518+0000 7f1f96000640 1 -- 172.21.15.7:0/2761857019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f90005ce0 con 0x7f1fa006db40 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.518+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa01e52c0 con 0x7f1fa006db40 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.518+0000 7f1f96000640 1 -- 172.21.15.7:0/2761857019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90007290 con 0x7f1fa006db40 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.518+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa013b3c0 con 0x7f1fa006db40 2024-08-19T00:45:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.519+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa006d600 con 0x7f1fa006db40 2024-08-19T00:45:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.520+0000 7f1f96000640 1 -- 172.21.15.7:0/2761857019 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f9001a070 con 0x7f1fa006db40 2024-08-19T00:45:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.521+0000 7f1f96000640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.521+0000 7f1f96000640 1 -- 172.21.15.7:0/2761857019 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7f1f9008a6b0 con 0x7f1fa006db40 2024-08-19T00:45:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.521+0000 7f1f97e00640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.522+0000 7f1f97e00640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1f88034000 tx=0x7f1f8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.525+0000 7f1f96000640 1 -- 172.21.15.7:0/2761857019 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1f900584b0 con 0x7f1fa006db40 2024-08-19T00:45:32.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:45:32.581 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:45:32.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.747+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1fa006e520 con 0x7f1fa006db40 2024-08-19T00:45:32.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.951+0000 7f1f96000640 1 -- 172.21.15.7:0/2761857019 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v181) ==== 161+0+0 (secure 0 0 0) 0x7f1f9005c7b0 con 0x7f1fa006db40 2024-08-19T00:45:32.952 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f7c06be30 msgr2=0x7f1f7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1f88034000 tx=0x7f1f8802e000 comp rx=0 tx=0).stop 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa006db40 msgr2=0x7f1fa01f10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa006db40 0x7f1fa01f10c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c460 tx=0x7f1f9000c920 comp rx=0 tx=0).stop 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 shutdown_connections 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fa0140640 0x7f1fa01f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fa013dc30 0x7f1fa01e4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 --2- 172.21.15.7:0/2761857019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fa006db40 0x7f1fa01f10c0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:32.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 >> 172.21.15.7:0/2761857019 conn(0x7f1fa006b850 msgr2=0x7f1fa00afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:32.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 shutdown_connections 2024-08-19T00:45:32.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:32.953+0000 7f1f9f200640 1 -- 172.21.15.7:0/2761857019 wait complete. 2024-08-19T00:45:32.971 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.127+0000 7efc7fe00640 1 Processor -- start 2024-08-19T00:45:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.127+0000 7efc7fe00640 1 -- start start 2024-08-19T00:45:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.128+0000 7efc7fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efc78159bf0 0x7efc78073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.128+0000 7efc7fe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc7806f7f0 con 0x7efc780cec10 2024-08-19T00:45:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.128+0000 7efc7fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc7806f510 con 0x7efc780739a0 2024-08-19T00:45:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.128+0000 7efc7fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efc78072980 con 0x7efc78159bf0 2024-08-19T00:45:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.128+0000 7efc7de00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efc780cec10 0x7efc780d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49480/0 (socket says 172.21.15.7:49480) 2024-08-19T00:45:33.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.128+0000 7efc7de00640 1 -- 172.21.15.7:0/2901891881 learned_addr learned my addr 172.21.15.7:0/2901891881 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.128+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726527897 0 0) 0x7efc7806f7f0 con 0x7efc780cec10 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc60003520 con 0x7efc780cec10 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc7d400640 1 --2- 172.21.15.7:0/2901891881 >> v2:172.21.15.162:3300/0 conn(0x7efc78159bf0 0x7efc78073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1070486575 0 0) 0x7efc60003520 con 0x7efc780cec10 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 >> v2:172.21.15.162:3300/0 conn(0x7efc78159bf0 msgr2=0x7efc78073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 --2- 172.21.15.7:0/2901891881 >> v2:172.21.15.162:3300/0 conn(0x7efc78159bf0 0x7efc78073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 >> v1:172.21.15.162:6789/0 conn(0x7efc780739a0 legacy=0x7efc780ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc78072c60 con 0x7efc780cec10 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7efc700019f0 con 0x7efc780cec10 2024-08-19T00:45:33.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 >> v1:172.21.15.7:6789/0 conn(0x7efc780cec10 legacy=0x7efc780d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc60003a00 0x7efc60003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc60004800 0x7efc60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc600052e0 0x7efc6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efc78072980 con 0x7efc600052e0 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc6000c200 con 0x7efc60003a00 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efc6000c400 con 0x7efc60004800 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc7d400640 1 --2- 172.21.15.7:0/2901891881 >> v2:172.21.15.162:3300/0 conn(0x7efc78159bf0 0x7efc78073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc7de00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc600052e0 0x7efc6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc7ca00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc60004800 0x7efc60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.129+0000 7efc7d400640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc60003a00 0x7efc60003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.130+0000 7efc7de00640 1 -- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc60004800 msgr2=0x7efc60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.130+0000 7efc7de00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc60004800 0x7efc60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.130+0000 7efc7de00640 1 -- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc60003a00 msgr2=0x7efc60003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:33.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.130+0000 7efc7de00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc60003a00 0x7efc60003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.130+0000 7efc7de00640 1 -- 172.21.15.7:0/2901891881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc60003520 con 0x7efc600052e0 2024-08-19T00:45:33.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.131+0000 7efc7de00640 1 -- 172.21.15.7:0/2901891881 reap_dead start 2024-08-19T00:45:33.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.131+0000 7efc7de00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc600052e0 0x7efc6000b9c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7efc7000a740 tx=0x7efc60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d377730743b893 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:33.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.131+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7000a390 con 0x7efc600052e0 2024-08-19T00:45:33.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.131+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7002f070 con 0x7efc600052e0 2024-08-19T00:45:33.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.131+0000 7efc77e00640 1 -- 172.21.15.7:0/2901891881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7002bbc0 con 0x7efc600052e0 2024-08-19T00:45:33.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.132+0000 7efc7fe00640 1 -- 172.21.15.7:0/2901891881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc600052e0 msgr2=0x7efc6000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:33.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.132+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc600052e0 0x7efc6000b9c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7efc7000a740 tx=0x7efc60005830 comp rx=0 tx=0).stop 2024-08-19T00:45:33.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.132+0000 7efc7fe00640 1 -- 172.21.15.7:0/2901891881 shutdown_connections 2024-08-19T00:45:33.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.132+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2901891881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc600052e0 0x7efc6000b9c0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.132+0000 7efc7fe00640 1 -- 172.21.15.7:0/2901891881 >> 172.21.15.7:0/2901891881 conn(0x7efc7806bc70 msgr2=0x7efc7806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:33.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.132+0000 7efc7fe00640 1 -- 172.21.15.7:0/2901891881 shutdown_connections 2024-08-19T00:45:33.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.132+0000 7efc7fe00640 1 -- 172.21.15.7:0/2901891881 wait complete. 2024-08-19T00:45:33.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.133+0000 7efc7fe00640 1 Processor -- start 2024-08-19T00:45:33.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.134+0000 7efc7fe00640 1 -- start start 2024-08-19T00:45:33.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.134+0000 7efc7fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc600052e0 0x7efc781467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.134+0000 7efc7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc780b3a70 0x7efc7815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.134+0000 7efc7fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc780b3ef0 0x7efc7815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.134+0000 7efc7fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efc7815a150 con 0x7efc780b3a70 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.134+0000 7efc7fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc78159fd0 con 0x7efc780b3ef0 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.134+0000 7efc7fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efc78073460 con 0x7efc600052e0 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc780b3a70 0x7efc7815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc780b3a70 0x7efc7815a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54652/0 (socket says 172.21.15.7:54652) 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 -- 172.21.15.7:0/2495596763 learned_addr learned my addr 172.21.15.7:0/2495596763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7d400640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc600052e0 0x7efc781467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7de00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc780b3ef0 0x7efc7815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 -- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc600052e0 msgr2=0x7efc781467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:33.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc600052e0 0x7efc781467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 -- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc780b3ef0 msgr2=0x7efc7815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc780b3ef0 0x7efc7815ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 -- 172.21.15.7:0/2495596763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc780b44c0 con 0x7efc780b3a70 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7de00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc780b3ef0 0x7efc7815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.135+0000 7efc7ca00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc780b3a70 0x7efc7815a940 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7efc6400f620 tx=0x7efc6400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.136+0000 7efc75600640 1 -- 172.21.15.7:0/2495596763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640052e0 con 0x7efc780b3a70 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.136+0000 7efc75600640 1 -- 172.21.15.7:0/2495596763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64018070 con 0x7efc780b3a70 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.136+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc780b47a0 con 0x7efc780b3a70 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.136+0000 7efc75600640 1 -- 172.21.15.7:0/2495596763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64003810 con 0x7efc780b3a70 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.136+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc780b4d60 con 0x7efc780b3a70 2024-08-19T00:45:33.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.137+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7806e0e0 con 0x7efc780b3a70 2024-08-19T00:45:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.138+0000 7efc75600640 1 -- 172.21.15.7:0/2495596763 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc640039b0 con 0x7efc780b3a70 2024-08-19T00:45:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.140+0000 7efc75600640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efc5806be30 0x7efc5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:33.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.140+0000 7efc75600640 1 -- 172.21.15.7:0/2495596763 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7efc6408b1d0 con 0x7efc780b3a70 2024-08-19T00:45:33.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.140+0000 7efc7d400640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efc5806be30 0x7efc5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:33.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.141+0000 7efc7d400640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efc5806be30 0x7efc5806e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fa0 tx=0x7efc6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.144+0000 7efc75600640 1 -- 172.21.15.7:0/2495596763 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efc7806e0e0 con 0x7efc780b3a70 2024-08-19T00:45:33.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.399+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7efc78073790 con 0x7efc780b3a70 2024-08-19T00:45:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.962+0000 7efc75600640 1 -- 172.21.15.7:0/2495596763 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v182) ==== 101+0+0 (secure 0 0 0) 0x7efc64059580 con 0x7efc780b3a70 2024-08-19T00:45:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efc5806be30 msgr2=0x7efc5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efc5806be30 0x7efc5806e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fa0 tx=0x7efc6c008040 comp rx=0 tx=0).stop 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc780b3a70 msgr2=0x7efc7815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc780b3a70 0x7efc7815a940 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7efc6400f620 tx=0x7efc6400fae0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 shutdown_connections 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efc5806be30 0x7efc5806e2f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc780b3ef0 0x7efc7815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc780b3a70 0x7efc7815a940 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 --2- 172.21.15.7:0/2495596763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc600052e0 0x7efc781467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:33.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 >> 172.21.15.7:0/2495596763 conn(0x7efc7806bc70 msgr2=0x7efc7815d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:33.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 shutdown_connections 2024-08-19T00:45:33.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:33.965+0000 7efc7fe00640 1 -- 172.21.15.7:0/2495596763 wait complete. 2024-08-19T00:45:33.984 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:34.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 Processor -- start 2024-08-19T00:45:34.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 -- start start 2024-08-19T00:45:34.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fde980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ea8990 0x560116ea3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ec08d0 0x560116fdc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560116f4e0a0 con 0x560116ea85b0 2024-08-19T00:45:34.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560116f4ddc0 con 0x560116ec08d0 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.061+0000 7f9d52bfef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560116f4e380 con 0x560116ea8990 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fde980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fde980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45518/0 (socket says 172.21.15.7:45518) 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 -- 172.21.15.7:0/3160738167 learned_addr learned my addr 172.21.15.7:0/3160738167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4f400640 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ea8990 0x560116ea3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d50800640 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ec08d0 0x560116fdc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 -- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ea8990 msgr2=0x560116ea3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ea8990 0x560116ea3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 -- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ec08d0 msgr2=0x560116fdc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ec08d0 0x560116fdc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 -- 172.21.15.7:0/3160738167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560116dab130 con 0x560116ea85b0 2024-08-19T00:45:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d50800640 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ec08d0 0x560116fdc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.062+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fde980 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000a5e0 tx=0x7f9d4000a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c689725fb94e43f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d4e000640 1 -- 172.21.15.7:0/3160738167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40018070 con 0x560116ea85b0 2024-08-19T00:45:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d4e000640 1 -- 172.21.15.7:0/3160738167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d40007600 con 0x560116ea85b0 2024-08-19T00:45:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d4e000640 1 -- 172.21.15.7:0/3160738167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d400079b0 con 0x560116ea85b0 2024-08-19T00:45:34.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 -- 172.21.15.7:0/3160738167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 msgr2=0x560116fde980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fde980 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000a5e0 tx=0x7f9d4000a6d0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 -- 172.21.15.7:0/3160738167 shutdown_connections 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ec08d0 0x560116fdc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ea8990 0x560116ea3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/3160738167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fde980 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 -- 172.21.15.7:0/3160738167 >> 172.21.15.7:0/3160738167 conn(0x560116ea54e0 msgr2=0x560116f4ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 -- 172.21.15.7:0/3160738167 shutdown_connections 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.063+0000 7f9d52bfef40 1 -- 172.21.15.7:0/3160738167 wait complete. 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.064+0000 7f9d52bfef40 1 Processor -- start 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.064+0000 7f9d52bfef40 1 -- start start 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d52bfef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fe3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d52bfef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ea8990 0x560116f3b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d52bfef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ec08d0 0x560116f40460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d52bfef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560116ea4980 con 0x560116ea85b0 2024-08-19T00:45:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d52bfef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560116f4bd20 con 0x560116ea8990 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d52bfef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560116ea3640 con 0x560116ec08d0 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fe3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fe3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45522/0 (socket says 172.21.15.7:45522) 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 learned_addr learned my addr 172.21.15.7:0/2899659332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d50800640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ec08d0 0x560116f40460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.065+0000 7f9d4f400640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ea8990 0x560116f3b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ec08d0 msgr2=0x560116f40460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560116ec08d0 0x560116f40460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ea8990 msgr2=0x560116f3b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560116ea8990 0x560116f3b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560116da1b30 con 0x560116ea85b0 2024-08-19T00:45:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fe3a40 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9d40016040 tx=0x7f9d40003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4cc00640 1 -- 172.21.15.7:0/2899659332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40018040 con 0x560116ea85b0 2024-08-19T00:45:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4cc00640 1 -- 172.21.15.7:0/2899659332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d40021070 con 0x560116ea85b0 2024-08-19T00:45:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d4cc00640 1 -- 172.21.15.7:0/2899659332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40007de0 con 0x560116ea85b0 2024-08-19T00:45:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.066+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560116dde080 con 0x560116ea85b0 2024-08-19T00:45:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.067+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560116f4bfa0 con 0x560116ea85b0 2024-08-19T00:45:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.068+0000 7f9d4cc00640 1 -- 172.21.15.7:0/2899659332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d4001c430 con 0x560116ea85b0 2024-08-19T00:45:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.069+0000 7f9d4cc00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9d3006a810 0x7f9d3006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.069+0000 7f9d4cc00640 1 -- 172.21.15.7:0/2899659332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7f9d4008a630 con 0x560116ea85b0 2024-08-19T00:45:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.070+0000 7f9d4f400640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9d3006a810 0x7f9d3006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.072 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.070+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560116f3ffb0 0x560116f4c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.070+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116f46b30 con 0x560116f3ffb0 2024-08-19T00:45:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.070+0000 7f9d50800640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560116f3ffb0 0x560116f4c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.070+0000 7f9d4f400640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9d3006a810 0x7f9d3006ccd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x560116f3ff60 tx=0x7f9d3c00c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.071+0000 7f9d50800640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560116f3ffb0 0x560116f4c9d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.073+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v102'474 uv448 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.073+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116f3bda0 con 0x560116f3ffb0 2024-08-19T00:45:34.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.075+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v102'475 uv475 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.075+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116f4cf10 con 0x560116f3ffb0 2024-08-19T00:45:34.078 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:34.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.076+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v102'476 uv476 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.076+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1010 con 0x560116f3ffb0 2024-08-19T00:45:34.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.078+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v102'477 uv477 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.078+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff13b0 con 0x560116f3ffb0 2024-08-19T00:45:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.079+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v102'478 uv478 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.079+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0000 con 0x560116f3ffb0 2024-08-19T00:45:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.081+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v102'479 uv479 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.081+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff03f0 con 0x560116f3ffb0 2024-08-19T00:45:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.082+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v102'480 uv454 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.082+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff07e0 con 0x560116f3ffb0 2024-08-19T00:45:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.084+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v102'481 uv481 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.084+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff07e0 con 0x560116f3ffb0 2024-08-19T00:45:34.087 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.085+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v102'482 uv482 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.085+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.087+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v102'483 uv483 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.087+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.088+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v102'484 uv484 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.088+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.090+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v102'485 uv485 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.090+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.091+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v102'486 uv461 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.091+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.093+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v102'487 uv487 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.093+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.096 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.094+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v102'488 uv488 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.094+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.096+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v102'489 uv489 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.096+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.097+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v102'490 uv490 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.097+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff0790 con 0x560116f3ffb0 2024-08-19T00:45:34.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.098+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v102'491 uv491 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.098+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.099+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v102'492 uv492 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.099+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.101+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v102'493 uv467 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.101+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.102+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v102'494 uv494 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.102+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.106 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.104+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v102'495 uv495 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.104+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff2760 con 0x560116f3ffb0 2024-08-19T00:45:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.106+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v102'496 uv496 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.106+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff2760 con 0x560116f3ffb0 2024-08-19T00:45:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.108+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v102'497 uv497 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.108+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.109+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v102'498 uv498 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.109+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.111+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v102'499 uv473 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.111+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.112+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v102'500 uv500 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.112+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.115 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.114+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v102'501 uv501 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.114+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff2760 con 0x560116f3ffb0 2024-08-19T00:45:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.115+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v102'502 uv502 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.115+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff2760 con 0x560116f3ffb0 2024-08-19T00:45:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.116+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v102'503 uv503 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.116+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff1750 con 0x560116f3ffb0 2024-08-19T00:45:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.118+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v102'504 uv504 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.118+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560116ff1c60 0x560116ff4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.118+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff4590 con 0x560116ff1c60 2024-08-19T00:45:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.118+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560116ff1c60 0x560116ff4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.119+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560116ff1c60 0x560116ff4050 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.120+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v102'352 uv351 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.120+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff4930 con 0x560116ff1c60 2024-08-19T00:45:34.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.122+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v102'353 uv353 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.122+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff4cd0 con 0x560116ff1c60 2024-08-19T00:45:34.125 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:34.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.123+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v102'354 uv354 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.123+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff5070 con 0x560116ff1c60 2024-08-19T00:45:34.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.125+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v102'355 uv355 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.125+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff5410 con 0x560116ff1c60 2024-08-19T00:45:34.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.126+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v102'356 uv356 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.126+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.128+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v102'357 uv339 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.128+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.129+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v102'358 uv358 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.129+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.134 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:34.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.131+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v102'359 uv359 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.131+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.132+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v102'360 uv360 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.132+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.134+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v102'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.134+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.135+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v102'362 uv344 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.135+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.137+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v102'363 uv363 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.137+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.139 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:34.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.138+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v102'364 uv364 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.138+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff9ea0 con 0x560116ff1c60 2024-08-19T00:45:34.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.140+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v102'365 uv365 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.140+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff9ea0 con 0x560116ff1c60 2024-08-19T00:45:34.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.141+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v102'366 uv366 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.141+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.142+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v102'367 uv350 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.142+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.144+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v102'368 uv368 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.144+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.147 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.145+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v102'369 uv369 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.145+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff67c0 con 0x560116ff1c60 2024-08-19T00:45:34.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.147+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v102'370 uv370 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.147+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff67c0 con 0x560116ff1c60 2024-08-19T00:45:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.148+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v102'371 uv371 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.148+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff57b0 con 0x560116ff1c60 2024-08-19T00:45:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.149+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v102'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ff1c60 2024-08-19T00:45:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.149+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560116ff5cc0 0x560116ff80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.149+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff85f0 con 0x560116ff5cc0 2024-08-19T00:45:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.150+0000 7f9d4f400640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560116ff5cc0 0x560116ff80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.151+0000 7f9d4f400640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560116ff5cc0 0x560116ff80b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.152+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v102'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.152+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff8990 con 0x560116ff5cc0 2024-08-19T00:45:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.153+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v102'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.153+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff8e40 con 0x560116ff5cc0 2024-08-19T00:45:34.156 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.155+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v102'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.155+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116f40aa0 con 0x560116ff5cc0 2024-08-19T00:45:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.156+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v102'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.156+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ffa7d0 con 0x560116ff5cc0 2024-08-19T00:45:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.157+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v102'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.157+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff96e0 con 0x560116ff5cc0 2024-08-19T00:45:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.158+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v102'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.158+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff9b50 con 0x560116f3ffb0 2024-08-19T00:45:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.160+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v102'72 uv71 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.160+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff9f40 con 0x560116f3ffb0 2024-08-19T00:45:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.161+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v102'73 uv73 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.161+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff9f40 con 0x560116f3ffb0 2024-08-19T00:45:34.164 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.163+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v102'74 uv74 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.163+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ffa350 con 0x560116f3ffb0 2024-08-19T00:45:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.164+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v102'75 uv75 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.164+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560116ffabc0 0x560116ffcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.164+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ffd4f0 con 0x560116ffabc0 2024-08-19T00:45:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.165+0000 7f9d50800640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560116ffabc0 0x560116ffcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.165+0000 7f9d50800640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560116ffabc0 0x560116ffcfb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.166+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v102'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.166+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ffd4f0 con 0x560116ffabc0 2024-08-19T00:45:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.168+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v102'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.168+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ffd4f0 con 0x560116ffabc0 2024-08-19T00:45:34.170 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.169+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v102'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.169+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ffe500 con 0x560116ffabc0 2024-08-19T00:45:34.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.170+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v102'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.170+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ffe500 con 0x560116ffabc0 2024-08-19T00:45:34.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.171+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v102'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.171+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ffd4f0 con 0x560116ffabc0 2024-08-19T00:45:34.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.172+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v102'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.172+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560116ffdb70 0x560116ffff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.172+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117000690 con 0x560116ffdb70 2024-08-19T00:45:34.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.173+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560116ffdb70 0x560116ffff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.173+0000 7f9d4fe00640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560116ffdb70 0x560116ffff60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.174+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v102'171 uv165 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.174+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.176+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v102'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.176+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.178 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.177+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v102'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.177+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117001a70 con 0x560116ffdb70 2024-08-19T00:45:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.178+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v102'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.178+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117001a70 con 0x560116ffdb70 2024-08-19T00:45:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.180+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v102'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.180+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.181+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v102'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.181+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.182+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v102'177 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.183+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.184+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v102'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.184+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.185+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v102'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.187 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:34.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.185+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.187+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v102'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.187+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117000a60 con 0x560116ffdb70 2024-08-19T00:45:34.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.188+0000 7f9d4fe00640 1 -- 172.21.15.7:0/2899659332 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v102'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d40054b10 con 0x560116ffdb70 2024-08-19T00:45:34.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.188+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5601170010e0 0x5601170034d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.188+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117003bd0 con 0x5601170010e0 2024-08-19T00:45:34.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.188+0000 7f9d4f400640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5601170010e0 0x5601170034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.189+0000 7f9d4f400640 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5601170010e0 0x5601170034d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.191+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v102'76 uv75 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.191+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117003fa0 con 0x5601170010e0 2024-08-19T00:45:34.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.192+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v102'77 uv77 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.192+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170044a0 con 0x5601170010e0 2024-08-19T00:45:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.193+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v102'78 uv78 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.195 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.193+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004890 con 0x5601170010e0 2024-08-19T00:45:34.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.195+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v102'79 uv79 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.195+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004890 con 0x5601170010e0 2024-08-19T00:45:34.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.196+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v102'80 uv80 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.196+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004600 con 0x560116f3ffb0 2024-08-19T00:45:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.198+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v102'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.198+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117004600 con 0x560116f3ffb0 2024-08-19T00:45:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.199+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v102'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.199+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004600 con 0x560116f3ffb0 2024-08-19T00:45:34.201 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:34.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.200+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v102'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.200+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117005610 con 0x560116f3ffb0 2024-08-19T00:45:34.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.202+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v102'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.202+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117005610 con 0x560116f3ffb0 2024-08-19T00:45:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.203+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v102'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.203+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004600 con 0x560116f3ffb0 2024-08-19T00:45:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.204+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v102'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116f3ffb0 2024-08-19T00:45:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.204+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004600 con 0x560116ff5cc0 2024-08-19T00:45:34.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.206+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v102'152 uv146 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.206+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117004600 con 0x560116ff5cc0 2024-08-19T00:45:34.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.207+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v102'153 uv153 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.207+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ff5cc0 2024-08-19T00:45:34.210 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:34.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.209+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v102'154 uv154 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.209+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff92d0 con 0x560116ff5cc0 2024-08-19T00:45:34.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.211+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v102'155 uv155 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.211+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff92d0 con 0x560116ff5cc0 2024-08-19T00:45:34.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.212+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v102'156 uv156 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.212+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff92d0 con 0x560116ff5cc0 2024-08-19T00:45:34.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.214+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v102'157 uv151 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.214+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560116ff92d0 con 0x560116ff5cc0 2024-08-19T00:45:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.216+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v102'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.216+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff92d0 con 0x560116ff5cc0 2024-08-19T00:45:34.218 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.217+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v102'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.217+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560116ff92d0 con 0x560116ff5cc0 2024-08-19T00:45:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.218+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v102'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.219+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045f0 con 0x560116ff5cc0 2024-08-19T00:45:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.220+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v102'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x560116ff5cc0 2024-08-19T00:45:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.220+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.222+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v102'70 uv69 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.222+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.223+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v102'71 uv71 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.223+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.226 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.225+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v102'72 uv72 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.225+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.226+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v102'73 uv73 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.226+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.228+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v102'93 uv92 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.228+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.229+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v102'94 uv94 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.229+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.232 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.231+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v102'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.231+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170045b0 con 0x560116ffabc0 2024-08-19T00:45:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.232+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v102'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.232+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004590 con 0x560116ffabc0 2024-08-19T00:45:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.233+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v102'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.234+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004590 con 0x560116ffabc0 2024-08-19T00:45:34.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.235+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v102'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d480516f0 con 0x560116ffabc0 2024-08-19T00:45:34.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.235+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004590 con 0x5601170010e0 2024-08-19T00:45:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.236+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v102'79 uv78 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.237+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117004590 con 0x5601170010e0 2024-08-19T00:45:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.238+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v102'80 uv80 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.238+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.240 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.239+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v102'81 uv81 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.239+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.240+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v102'82 uv82 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.241+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.242+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v102'83 uv83 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.242+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.243+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v102'192 uv186 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.243+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.245+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v102'193 uv193 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.245+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.247 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:34.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.246+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v102'194 uv194 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.246+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.248+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v102'195 uv195 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.248+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.249+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v102'196 uv196 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.249+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.250+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v102'197 uv191 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.250+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.252+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v102'198 uv198 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.252+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.253+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v102'199 uv199 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.255 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:34.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.253+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170055a0 con 0x5601170010e0 2024-08-19T00:45:34.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.254+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v102'200 uv200 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.254+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5601170055a0 con 0x5601170010e0 2024-08-19T00:45:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.255+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v102'201 uv201 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.256+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117004a40 con 0x5601170010e0 2024-08-19T00:45:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.257+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v102'202 uv202 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.257+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x560117005300 con 0x5601170010e0 2024-08-19T00:45:34.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d4f400640 1 -- 172.21.15.7:0/2899659332 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v102'203 uv203 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f9d3c0088e0 con 0x5601170010e0 2024-08-19T00:45:34.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560116ff1c60 msgr2=0x560116ff4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560116ff1c60 0x560116ff4050 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560116ffdb70 msgr2=0x560116ffff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560116ffdb70 0x560116ffff60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5601170010e0 msgr2=0x5601170034d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5601170010e0 0x5601170034d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560116ff5cc0 msgr2=0x560116ff80b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560116ff5cc0 0x560116ff80b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560116f3ffb0 msgr2=0x560116f4c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560116f3ffb0 0x560116f4c9d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560116ffabc0 msgr2=0x560116ffcfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560116ffabc0 0x560116ffcfb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 reap_dead start 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 reap_dead start 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d50800640 1 -- 172.21.15.7:0/2899659332 reap_dead start 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9d3006a810 msgr2=0x7f9d3006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9d3006a810 0x7f9d3006ccd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x560116f3ff60 tx=0x7f9d3c00c040 comp rx=0 tx=0).stop 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 msgr2=0x560116fe3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fe3a40 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9d40016040 tx=0x7f9d40003020 comp rx=0 tx=0).stop 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 shutdown_connections 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9d3006a810 0x7f9d3006ccd0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 --2- 172.21.15.7:0/2899659332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560116ea85b0 0x560116fe3a40 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.258+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 >> 172.21.15.7:0/2899659332 conn(0x560116ea54e0 msgr2=0x560116ea6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.259+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 shutdown_connections 2024-08-19T00:45:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.259+0000 7f9d52bfef40 1 -- 172.21.15.7:0/2899659332 wait complete. 2024-08-19T00:45:34.265 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 200.00000000 - 2024-08-19T00:45:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 Processor -- start 2024-08-19T00:45:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 -- start start 2024-08-19T00:45:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb77650 0x5588bcc13800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb785b0 0x5588bcc1e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb78990 0x5588bcc1eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5588bcaecd00 con 0x5588bcb78990 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5588bcaf0d40 con 0x5588bcb785b0 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.383+0000 7f3d95501f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5588bcc1ddc0 con 0x5588bcb77650 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb78990 0x5588bcc1eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb78990 0x5588bcc1eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45532/0 (socket says 172.21.15.7:45532) 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 -- 172.21.15.7:0/168791891 learned_addr learned my addr 172.21.15.7:0/168791891 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d91c00640 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb785b0 0x5588bcc1e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d92600640 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb77650 0x5588bcc13800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 -- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb77650 msgr2=0x5588bcc13800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb77650 0x5588bcc13800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 -- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb785b0 msgr2=0x5588bcc1e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb785b0 0x5588bcc1e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.384+0000 7f3d93000640 1 -- 172.21.15.7:0/168791891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588bcaae080 con 0x5588bcb78990 2024-08-19T00:45:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.385+0000 7f3d93000640 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb78990 0x5588bcc1eb00 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c046100 tx=0x7f3d8c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295217f2f3fcf2ed server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.385+0000 7f3d8be00640 1 -- 172.21.15.7:0/168791891 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c050960 con 0x5588bcb78990 2024-08-19T00:45:34.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.385+0000 7f3d8be00640 1 -- 172.21.15.7:0/168791891 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c067070 con 0x5588bcb78990 2024-08-19T00:45:34.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.385+0000 7f3d8be00640 1 -- 172.21.15.7:0/168791891 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c050d20 con 0x5588bcb78990 2024-08-19T00:45:34.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.385+0000 7f3d95501f40 1 -- 172.21.15.7:0/168791891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb78990 msgr2=0x5588bcc1eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.385+0000 7f3d95501f40 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb78990 0x5588bcc1eb00 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c046100 tx=0x7f3d8c051000 comp rx=0 tx=0).stop 2024-08-19T00:45:34.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 -- 172.21.15.7:0/168791891 shutdown_connections 2024-08-19T00:45:34.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb78990 0x5588bcc1eb00 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb785b0 0x5588bcc1e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 --2- 172.21.15.7:0/168791891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb77650 0x5588bcc13800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 -- 172.21.15.7:0/168791891 >> 172.21.15.7:0/168791891 conn(0x5588bcb754e0 msgr2=0x5588bcb456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 -- 172.21.15.7:0/168791891 shutdown_connections 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 -- 172.21.15.7:0/168791891 wait complete. 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 Processor -- start 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.386+0000 7f3d95501f40 1 -- start start 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.387+0000 7f3d95501f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb77650 0x5588bcb74260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.387+0000 7f3d95501f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb785b0 0x5588bccb6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.387+0000 7f3d95501f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb78990 0x5588bccb72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.387+0000 7f3d95501f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5588bcc16660 con 0x5588bcb785b0 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.387+0000 7f3d95501f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5588bcb461f0 con 0x5588bcb77650 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.387+0000 7f3d95501f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5588bcc16360 con 0x5588bcb78990 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb785b0 0x5588bccb6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb785b0 0x5588bccb6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45534/0 (socket says 172.21.15.7:45534) 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 -- 172.21.15.7:0/3541913498 learned_addr learned my addr 172.21.15.7:0/3541913498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 -- 172.21.15.7:0/3541913498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb78990 msgr2=0x5588bccb72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d92600640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb77650 0x5588bcb74260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588bcb78990 0x5588bccb72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 -- 172.21.15.7:0/3541913498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb77650 msgr2=0x5588bcb74260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb77650 0x5588bcb74260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 -- 172.21.15.7:0/3541913498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588bcc13140 con 0x5588bcb785b0 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d92600640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588bcb77650 0x5588bcb74260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d91c00640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb785b0 0x5588bccb6d90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3d800011e0 tx=0x7f3d8000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d8aa00640 1 -- 172.21.15.7:0/3541913498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000f860 con 0x5588bcb785b0 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d8aa00640 1 -- 172.21.15.7:0/3541913498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d80013030 con 0x5588bcb785b0 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d8aa00640 1 -- 172.21.15.7:0/3541913498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000fc20 con 0x5588bcb785b0 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.388+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588bcb458f0 con 0x5588bcb785b0 2024-08-19T00:45:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.389+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588bcb751b0 con 0x5588bcb785b0 2024-08-19T00:45:34.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.391+0000 7f3d8aa00640 1 -- 172.21.15.7:0/3541913498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d800173d0 con 0x5588bcb785b0 2024-08-19T00:45:34.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.391+0000 7f3d8aa00640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d7406a810 0x7f3d7406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.391+0000 7f3d8aa00640 1 -- 172.21.15.7:0/3541913498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7f3d8008a9a0 con 0x5588bcb785b0 2024-08-19T00:45:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.392+0000 7f3d92600640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d7406a810 0x7f3d7406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.392+0000 7f3d95501f40 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5588bcb92de0 0x5588bd0be060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.392+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:292cf221:::200.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) -- 0x5588bcb747a0 con 0x5588bcb92de0 2024-08-19T00:45:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.392+0000 7f3d93000640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5588bcb92de0 0x5588bd0be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.392+0000 7f3d92600640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d7406a810 0x7f3d7406ccd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400f480 tx=0x7f3d840017b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.393+0000 7f3d93000640 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5588bcb92de0 0x5588bd0be060 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.394+0000 7f3d93000640 1 -- 172.21.15.7:0/3541913498 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000000 [writefull 0~80] v102'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3d8c050960 con 0x5588bcb92de0 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.394+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5588bcb92de0 msgr2=0x5588bd0be060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.394+0000 7f3d95501f40 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5588bcb92de0 0x5588bd0be060 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d7406a810 msgr2=0x7f3d7406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d7406a810 0x7f3d7406ccd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400f480 tx=0x7f3d840017b0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb785b0 msgr2=0x5588bccb6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 --2- 172.21.15.7:0/3541913498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588bcb785b0 0x5588bccb6d90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3d800011e0 tx=0x7f3d8000c730 comp rx=0 tx=0).stop 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d93000640 1 -- 172.21.15.7:0/3541913498 reap_dead start 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 shutdown_connections 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 >> 172.21.15.7:0/3541913498 conn(0x5588bcb754e0 msgr2=0x5588bcc1cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 shutdown_connections 2024-08-19T00:45:34.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.395+0000 7f3d95501f40 1 -- 172.21.15.7:0/3541913498 wait complete. 2024-08-19T00:45:34.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:34.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.599+0000 7efd0fc00640 1 Processor -- start 2024-08-19T00:45:34.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.599+0000 7efd0fc00640 1 -- start start 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.600+0000 7efd0fc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efd08158cd0 0x7efd08072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.600+0000 7efd0fc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd08072ff0 0x7efd080add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.600+0000 7efd0fc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd080ae2b0 0x7efd0815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.600+0000 7efd0fc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7efd08073460 con 0x7efd080ae2b0 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.600+0000 7efd0fc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efd080aeae0 con 0x7efd08158cd0 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.600+0000 7efd0fc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd080aedc0 con 0x7efd08072ff0 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd080ae2b0 0x7efd0815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd080ae2b0 0x7efd0815ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45550/0 (socket says 172.21.15.7:45550) 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 -- 172.21.15.7:0/3032070088 learned_addr learned my addr 172.21.15.7:0/3032070088 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efcffe00640 1 --2- 172.21.15.7:0/3032070088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd08072ff0 0x7efd080add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0d200640 1 --2- 172.21.15.7:0/3032070088 >> v2:172.21.15.162:3300/0 conn(0x7efd08158cd0 0x7efd08072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 -- 172.21.15.7:0/3032070088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd08072ff0 msgr2=0x7efd080add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:34.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 --2- 172.21.15.7:0/3032070088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd08072ff0 0x7efd080add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 -- 172.21.15.7:0/3032070088 >> v2:172.21.15.162:3300/0 conn(0x7efd08158cd0 msgr2=0x7efd08072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:34.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 --2- 172.21.15.7:0/3032070088 >> v2:172.21.15.162:3300/0 conn(0x7efd08158cd0 0x7efd08072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.601+0000 7efd0dc00640 1 -- 172.21.15.7:0/3032070088 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd080af0a0 con 0x7efd080ae2b0 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.602+0000 7efd0dc00640 1 --2- 172.21.15.7:0/3032070088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd080ae2b0 0x7efd0815ea90 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7efd080b2ca0 tx=0x7efd0002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575342a6d92e1972 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.602+0000 7efd07e00640 1 -- 172.21.15.7:0/3032070088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00036070 con 0x7efd080ae2b0 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd07e00640 1 -- 172.21.15.7:0/3032070088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00031600 con 0x7efd080ae2b0 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd07e00640 1 -- 172.21.15.7:0/3032070088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd000319d0 con 0x7efd080ae2b0 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 -- 172.21.15.7:0/3032070088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd080ae2b0 msgr2=0x7efd0815ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3032070088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd080ae2b0 0x7efd0815ea90 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7efd080b2ca0 tx=0x7efd0002a570 comp rx=0 tx=0).stop 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 -- 172.21.15.7:0/3032070088 shutdown_connections 2024-08-19T00:45:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3032070088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd080ae2b0 0x7efd0815ea90 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3032070088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd08072ff0 0x7efd080add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3032070088 >> v2:172.21.15.162:3300/0 conn(0x7efd08158cd0 0x7efd08072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 -- 172.21.15.7:0/3032070088 >> 172.21.15.7:0/3032070088 conn(0x7efd080b2300 msgr2=0x7efd0806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 -- 172.21.15.7:0/3032070088 shutdown_connections 2024-08-19T00:45:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.603+0000 7efd0fc00640 1 -- 172.21.15.7:0/3032070088 wait complete. 2024-08-19T00:45:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.605+0000 7efd0fc00640 1 Processor -- start 2024-08-19T00:45:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.605+0000 7efd0fc00640 1 -- start start 2024-08-19T00:45:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0fc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd08072ff0 0x7efd0814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd080ae2b0 0x7efd0815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0fc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd0815aab0 0x7efd08152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0fc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd080ae6d0 con 0x7efd08072ff0 2024-08-19T00:45:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0fc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd080af660 con 0x7efd080ae2b0 2024-08-19T00:45:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0fc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd080ae850 con 0x7efd0815aab0 2024-08-19T00:45:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd08072ff0 0x7efd0814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd08072ff0 0x7efd0814d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45560/0 (socket says 172.21.15.7:45560) 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0d200640 1 -- 172.21.15.7:0/3160935933 learned_addr learned my addr 172.21.15.7:0/3160935933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efd0dc00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd0815aab0 0x7efd08152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.606+0000 7efcffe00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd080ae2b0 0x7efd0815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0d200640 1 -- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd0815aab0 msgr2=0x7efd08152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0d200640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd0815aab0 0x7efd08152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0d200640 1 -- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd080ae2b0 msgr2=0x7efd0815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0d200640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd080ae2b0 0x7efd0815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0d200640 1 -- 172.21.15.7:0/3160935933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0815b730 con 0x7efd08072ff0 2024-08-19T00:45:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0d200640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd08072ff0 0x7efd0814d980 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7efcf800d830 tx=0x7efcf800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd05600640 1 -- 172.21.15.7:0/3160935933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf800b6c0 con 0x7efd08072ff0 2024-08-19T00:45:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd05600640 1 -- 172.21.15.7:0/3160935933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf8019070 con 0x7efd08072ff0 2024-08-19T00:45:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd05600640 1 -- 172.21.15.7:0/3160935933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf800ba80 con 0x7efd08072ff0 2024-08-19T00:45:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0815ba10 con 0x7efd08072ff0 2024-08-19T00:45:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.607+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0815bfd0 con 0x7efd08072ff0 2024-08-19T00:45:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.608+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd080b1a30 con 0x7efd08072ff0 2024-08-19T00:45:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.609+0000 7efd05600640 1 -- 172.21.15.7:0/3160935933 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcf801e460 con 0x7efd08072ff0 2024-08-19T00:45:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.610+0000 7efd05600640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efce406be30 0x7efce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.610+0000 7efd05600640 1 -- 172.21.15.7:0/3160935933 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 7085+0+0 (secure 0 0 0) 0x7efcf808b930 con 0x7efd08072ff0 2024-08-19T00:45:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.611+0000 7efcffe00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efce406be30 0x7efce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.611+0000 7efcffe00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efce406be30 0x7efce406e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efd0815b250 tx=0x7efcf0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:34.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.615+0000 7efd05600640 1 -- 172.21.15.7:0/3160935933 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efd080b1a30 con 0x7efd08072ff0 2024-08-19T00:45:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.837+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7efd0815aec0 con 0x7efd08072ff0 2024-08-19T00:45:34.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.964+0000 7efd05600640 1 -- 172.21.15.7:0/3160935933 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v183) ==== 162+0+0 (secure 0 0 0) 0x7efd0815aec0 con 0x7efd08072ff0 2024-08-19T00:45:34.966 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efce406be30 msgr2=0x7efce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efce406be30 0x7efce406e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efd0815b250 tx=0x7efcf0008040 comp rx=0 tx=0).stop 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd08072ff0 msgr2=0x7efd0814d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd08072ff0 0x7efd0814d980 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7efcf800d830 tx=0x7efcf800dcf0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 shutdown_connections 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efce406be30 0x7efce406e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd0815aab0 0x7efd08152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd080ae2b0 0x7efd0815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 --2- 172.21.15.7:0/3160935933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd08072ff0 0x7efd0814d980 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 >> 172.21.15.7:0/3160935933 conn(0x7efd080b2300 msgr2=0x7efd080afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 shutdown_connections 2024-08-19T00:45:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:34.967+0000 7efd0fc00640 1 -- 172.21.15.7:0/3160935933 wait complete. 2024-08-19T00:45:34.977 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:45:34.976+0000 7f9907600640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (22) Invalid argument 2024-08-19T00:45:34.978 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:34.977+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:34.978 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:34.977+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:45:34.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.143+0000 7fcd76000640 1 Processor -- start 2024-08-19T00:45:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.143+0000 7fcd76000640 1 -- start start 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd76000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcd7009aa70 0x7fcd7009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd76000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7009b390 con 0x7fcd700d0290 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd76000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7015ec30 con 0x7fcd7009b730 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd76000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7015ef10 con 0x7fcd7009aa70 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd6f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcd7009aa70 0x7fcd7009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd6f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcd7009aa70 0x7fcd7009ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45574/0 (socket says 172.21.15.7:45574) 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd6fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcd700d0290 0x7fcd700d0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47670/0 (socket says 172.21.15.7:47670) 2024-08-19T00:45:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.144+0000 7fcd6f400640 1 -- 172.21.15.7:0/3364691056 learned_addr learned my addr 172.21.15.7:0/3364691056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.145+0000 7fcd6f400640 1 -- 172.21.15.7:0/3364691056 >> v1:172.21.15.162:6789/0 conn(0x7fcd7009b730 legacy=0x7fcd7006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.145+0000 7fcd6f400640 1 -- 172.21.15.7:0/3364691056 >> v1:172.21.15.7:6789/0 conn(0x7fcd700d0290 legacy=0x7fcd700d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.145+0000 7fcd6f400640 1 -- 172.21.15.7:0/3364691056 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7015f1f0 con 0x7fcd7009aa70 2024-08-19T00:45:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.146+0000 7fcd6f400640 1 --2- 172.21.15.7:0/3364691056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009aa70 0x7fcd7009ae50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009870 tx=0x7fcd6002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e2cb0acd77b56b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.146+0000 7fcd6e000640 1 -- 172.21.15.7:0/3364691056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd60037070 con 0x7fcd7009aa70 2024-08-19T00:45:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.146+0000 7fcd6e000640 1 -- 172.21.15.7:0/3364691056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6002ae50 con 0x7fcd7009aa70 2024-08-19T00:45:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.146+0000 7fcd6e000640 1 -- 172.21.15.7:0/3364691056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd60032860 con 0x7fcd7009aa70 2024-08-19T00:45:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.147+0000 7fcd76000640 1 -- 172.21.15.7:0/3364691056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009aa70 msgr2=0x7fcd7009ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.147+0000 7fcd76000640 1 --2- 172.21.15.7:0/3364691056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009aa70 0x7fcd7009ae50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009870 tx=0x7fcd6002a300 comp rx=0 tx=0).stop 2024-08-19T00:45:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.147+0000 7fcd76000640 1 -- 172.21.15.7:0/3364691056 shutdown_connections 2024-08-19T00:45:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.147+0000 7fcd76000640 1 --2- 172.21.15.7:0/3364691056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009aa70 0x7fcd7009ae50 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.147+0000 7fcd76000640 1 -- 172.21.15.7:0/3364691056 >> 172.21.15.7:0/3364691056 conn(0x7fcd700d2190 msgr2=0x7fcd700d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.147+0000 7fcd76000640 1 -- 172.21.15.7:0/3364691056 shutdown_connections 2024-08-19T00:45:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.147+0000 7fcd76000640 1 -- 172.21.15.7:0/3364691056 wait complete. 2024-08-19T00:45:35.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.148+0000 7fcd76000640 1 Processor -- start 2024-08-19T00:45:35.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.149+0000 7fcd76000640 1 -- start start 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.149+0000 7fcd76000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7009aa70 0x7fcd70153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd76000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009b730 0x7fcd700c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd76000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd700d0290 0x7fcd700c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd76000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcd700d0e30 con 0x7fcd7009b730 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd76000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7015e8f0 con 0x7fcd700d0290 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd76000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd700d0fb0 con 0x7fcd7009aa70 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009b730 0x7fcd700c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009b730 0x7fcd700c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45576/0 (socket says 172.21.15.7:45576) 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 -- 172.21.15.7:0/4127452093 learned_addr learned my addr 172.21.15.7:0/4127452093 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6f400640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7009aa70 0x7fcd70153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6fe00640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd700d0290 0x7fcd700c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 -- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7009aa70 msgr2=0x7fcd70153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7009aa70 0x7fcd70153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 -- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd700d0290 msgr2=0x7fcd700c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd700d0290 0x7fcd700c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6ea00640 1 -- 172.21.15.7:0/4127452093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd700c6830 con 0x7fcd7009b730 2024-08-19T00:45:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.150+0000 7fcd6f400640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7009aa70 0x7fcd70153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.151+0000 7fcd6ea00640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009b730 0x7fcd700c5cc0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00c400 tx=0x7fcd5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.151+0000 7fcd67400640 1 -- 172.21.15.7:0/4127452093 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0052d0 con 0x7fcd7009b730 2024-08-19T00:45:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.151+0000 7fcd67400640 1 -- 172.21.15.7:0/4127452093 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd5c005490 con 0x7fcd7009b730 2024-08-19T00:45:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.151+0000 7fcd67400640 1 -- 172.21.15.7:0/4127452093 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c007260 con 0x7fcd7009b730 2024-08-19T00:45:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.151+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd700c6b10 con 0x7fcd7009b730 2024-08-19T00:45:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.151+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd700c70d0 con 0x7fcd7009b730 2024-08-19T00:45:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.152+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd700d1370 con 0x7fcd7009b730 2024-08-19T00:45:35.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.153+0000 7fcd67400640 1 -- 172.21.15.7:0/4127452093 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd5c007400 con 0x7fcd7009b730 2024-08-19T00:45:35.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.154+0000 7fcd67400640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd5006be30 0x7fcd5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.154+0000 7fcd67400640 1 -- 172.21.15.7:0/4127452093 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7fcd5c08aa40 con 0x7fcd7009b730 2024-08-19T00:45:35.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.154+0000 7fcd6f400640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd5006be30 0x7fcd5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.155+0000 7fcd6f400640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd5006be30 0x7fcd5006e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcd60034000 tx=0x7fcd6002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.159+0000 7fcd67400640 1 -- 172.21.15.7:0/4127452093 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcd5c058da0 con 0x7fcd7009b730 2024-08-19T00:45:35.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.384+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd7006c930 con 0x7fcd7009b730 2024-08-19T00:45:35.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.385+0000 7fcd67400640 1 -- 172.21.15.7:0/4127452093 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 185 v185) ==== 95+0+3570 (secure 0 0 0) 0x7fcd5c08ae20 con 0x7fcd7009b730 2024-08-19T00:45:35.387 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:35.387 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":185,"btime":"2024-08-19T00:45:34:977723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":185,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:34.977637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:35.387 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 185 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd5006be30 msgr2=0x7fcd5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd5006be30 0x7fcd5006e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcd60034000 tx=0x7fcd6002e000 comp rx=0 tx=0).stop 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009b730 msgr2=0x7fcd700c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009b730 0x7fcd700c5cc0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00c400 tx=0x7fcd5c00c8c0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 shutdown_connections 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcd5006be30 0x7fcd5006e2f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd700d0290 0x7fcd700c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd7009b730 0x7fcd700c5cc0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 --2- 172.21.15.7:0/4127452093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7009aa70 0x7fcd70153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 >> 172.21.15.7:0/4127452093 conn(0x7fcd700d2190 msgr2=0x7fcd700d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 shutdown_connections 2024-08-19T00:45:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.387+0000 7fcd76000640 1 -- 172.21.15.7:0/4127452093 wait complete. 2024-08-19T00:45:35.405 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:35.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:35.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.559+0000 7fe85de00640 1 Processor -- start 2024-08-19T00:45:35.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.559+0000 7fe85de00640 1 -- start start 2024-08-19T00:45:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe85de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe85806e710 0x7fe858071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe85de00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8580cdfb0 con 0x7fe8580b3750 2024-08-19T00:45:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe85de00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8580ce290 con 0x7fe8580d03c0 2024-08-19T00:45:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe85de00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe8580cebc0 con 0x7fe85806e710 2024-08-19T00:45:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe84fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe85806e710 0x7fe858071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe84fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe85806e710 0x7fe858071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45586/0 (socket says 172.21.15.7:45586) 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe84fe00640 1 -- 172.21.15.7:0/4082602243 learned_addr learned my addr 172.21.15.7:0/4082602243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe857400640 1 --1- 172.21.15.7:0/4082602243 >> v1:172.21.15.7:6789/0 conn(0x7fe8580b3750 0x7fe8580cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47686/0 (socket says 172.21.15.7:47686) 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe84fe00640 1 -- 172.21.15.7:0/4082602243 >> v1:172.21.15.162:6789/0 conn(0x7fe8580d03c0 legacy=0x7fe8580d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe84fe00640 1 -- 172.21.15.7:0/4082602243 >> v1:172.21.15.7:6789/0 conn(0x7fe8580b3750 legacy=0x7fe8580cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.561+0000 7fe84fe00640 1 -- 172.21.15.7:0/4082602243 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8580ce570 con 0x7fe85806e710 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.562+0000 7fe84fe00640 1 --2- 172.21.15.7:0/4082602243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858071980 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fe8400098a0 tx=0x7fe84002c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d93026186b75724 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe856000640 1 -- 172.21.15.7:0/4082602243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840038070 con 0x7fe85806e710 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe856000640 1 -- 172.21.15.7:0/4082602243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe840031710 con 0x7fe85806e710 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe856000640 1 -- 172.21.15.7:0/4082602243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840031ae0 con 0x7fe85806e710 2024-08-19T00:45:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe85de00640 1 -- 172.21.15.7:0/4082602243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 msgr2=0x7fe858071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe85de00640 1 --2- 172.21.15.7:0/4082602243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858071980 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fe8400098a0 tx=0x7fe84002c530 comp rx=0 tx=0).stop 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe85de00640 1 -- 172.21.15.7:0/4082602243 shutdown_connections 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe85de00640 1 --2- 172.21.15.7:0/4082602243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858071980 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe85de00640 1 -- 172.21.15.7:0/4082602243 >> 172.21.15.7:0/4082602243 conn(0x7fe85806bc70 msgr2=0x7fe85806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.563+0000 7fe85de00640 1 -- 172.21.15.7:0/4082602243 shutdown_connections 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.564+0000 7fe85de00640 1 -- 172.21.15.7:0/4082602243 wait complete. 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.565+0000 7fe85de00640 1 Processor -- start 2024-08-19T00:45:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.565+0000 7fe85de00640 1 -- start start 2024-08-19T00:45:35.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe85de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe85de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8580b3750 0x7fe8581570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe85de00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8580d03c0 0x7fe85815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe85de00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe858073c60 con 0x7fe85806e710 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe85de00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe858073ae0 con 0x7fe8580b3750 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe85de00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8580b3be0 con 0x7fe8580d03c0 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe856a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe856a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45594/0 (socket says 172.21.15.7:45594) 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe856a00640 1 -- 172.21.15.7:0/4147993049 learned_addr learned my addr 172.21.15.7:0/4147993049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.566+0000 7fe84fe00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8580b3750 0x7fe8581570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe857400640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8580d03c0 0x7fe85815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe856a00640 1 -- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8580d03c0 msgr2=0x7fe85815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe856a00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8580d03c0 0x7fe85815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe856a00640 1 -- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8580b3750 msgr2=0x7fe8581570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe856a00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8580b3750 0x7fe8581570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe856a00640 1 -- 172.21.15.7:0/4147993049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85806e2b0 con 0x7fe85806e710 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe857400640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8580d03c0 0x7fe85815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe856a00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858153d60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fe84800c480 tx=0x7fe84800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe84f400640 1 -- 172.21.15.7:0/4147993049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8480052d0 con 0x7fe85806e710 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe84f400640 1 -- 172.21.15.7:0/4147993049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe848005470 con 0x7fe85806e710 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe84f400640 1 -- 172.21.15.7:0/4147993049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848012870 con 0x7fe85806e710 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8581f0870 con 0x7fe85806e710 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.567+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8581f0e30 con 0x7fe85806e710 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.569+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe858071980 con 0x7fe85806e710 2024-08-19T00:45:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.569+0000 7fe84f400640 1 -- 172.21.15.7:0/4147993049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe848012a10 con 0x7fe85806e710 2024-08-19T00:45:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.570+0000 7fe84f400640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe83406be30 0x7fe83406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.570+0000 7fe84f400640 1 -- 172.21.15.7:0/4147993049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7fe84808b040 con 0x7fe85806e710 2024-08-19T00:45:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.571+0000 7fe84fe00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe83406be30 0x7fe83406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.571+0000 7fe84fe00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe83406be30 0x7fe83406e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe840035000 tx=0x7fe840008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.575+0000 7fe84f400640 1 -- 172.21.15.7:0/4147993049 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe85806e2b0 con 0x7fe85806e710 2024-08-19T00:45:35.699 INFO:tasks.ceph.mds.a.smithi007.stderr: -35> 2024-08-19T00:45:30.945+0000 7f438fa00640 -1 mds.0.cache.ino(0x1) Corrupt inode 0x1: End of buffer [buffer:2] 2024-08-19T00:45:35.699 INFO:tasks.ceph.mds.a.smithi007.stderr: -33> 2024-08-19T00:45:30.945+0000 7f438fa00640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:45:35.738 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:45:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.798+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe85815ab20 con 0x7fe85806e710 2024-08-19T00:45:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.798+0000 7fe84f400640 1 -- 172.21.15.7:0/4147993049 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 185 v185) ==== 95+0+3570 (secure 0 0 0) 0x7fe848059420 con 0x7fe85806e710 2024-08-19T00:45:35.800 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:35.800 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":185,"btime":"2024-08-19T00:45:34:977723+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":185,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:34.977637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:35.801 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 185 2024-08-19T00:45:35.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.800+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe83406be30 msgr2=0x7fe83406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.800+0000 7fe85de00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe83406be30 0x7fe83406e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe840035000 tx=0x7fe840008030 comp rx=0 tx=0).stop 2024-08-19T00:45:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 msgr2=0x7fe858153d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858153d60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fe84800c480 tx=0x7fe84800c940 comp rx=0 tx=0).stop 2024-08-19T00:45:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 shutdown_connections 2024-08-19T00:45:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe83406be30 0x7fe83406e2f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8580d03c0 0x7fe85815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8580b3750 0x7fe8581570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 --2- 172.21.15.7:0/4147993049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe85806e710 0x7fe858153d60 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 >> 172.21.15.7:0/4147993049 conn(0x7fe85806bc70 msgr2=0x7fe8580cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:35.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 shutdown_connections 2024-08-19T00:45:35.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.801+0000 7fe85de00640 1 -- 172.21.15.7:0/4147993049 wait complete. 2024-08-19T00:45:35.818 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:35.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.974+0000 7f554ca00640 1 Processor -- start 2024-08-19T00:45:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.975+0000 7f554ca00640 1 -- start start 2024-08-19T00:45:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f554ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f554806d600 0x7f554806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f554ca00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5548073140 con 0x7f554815bd70 2024-08-19T00:45:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f554ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55480733f0 con 0x7f554815cca0 2024-08-19T00:45:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f554ca00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f554806df90 con 0x7f554806d600 2024-08-19T00:45:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f5545e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f554806d600 0x7f554806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f5546800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f554815bd70 0x7f5548072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47708/0 (socket says 172.21.15.7:47708) 2024-08-19T00:45:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f5545e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f554806d600 0x7f554806da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45612/0 (socket says 172.21.15.7:45612) 2024-08-19T00:45:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f5546800640 1 -- 172.21.15.7:0/3439037730 learned_addr learned my addr 172.21.15.7:0/3439037730 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f5545e00640 1 -- 172.21.15.7:0/3439037730 >> v1:172.21.15.162:6789/0 conn(0x7f554815cca0 legacy=0x7f554815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f5545e00640 1 -- 172.21.15.7:0/3439037730 >> v1:172.21.15.7:6789/0 conn(0x7f554815bd70 legacy=0x7f5548072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.976+0000 7f5545400640 1 -- 172.21.15.7:0/3439037730 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228591814 0 0) 0x7f5548073140 con 0x7f554815bd70 2024-08-19T00:45:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.977+0000 7f5545e00640 1 -- 172.21.15.7:0/3439037730 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55480736d0 con 0x7f554806d600 2024-08-19T00:45:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.977+0000 7f5545e00640 1 --2- 172.21.15.7:0/3439037730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554806d600 0x7f554806da50 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f55340097a0 tx=0x7f553402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163f0ec4b2c96c6b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f5545400640 1 -- 172.21.15.7:0/3439037730 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534037070 con 0x7f554806d600 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f5545400640 1 -- 172.21.15.7:0/3439037730 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5534032440 con 0x7f554806d600 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f5545400640 1 -- 172.21.15.7:0/3439037730 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534032810 con 0x7f554806d600 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f554ca00640 1 -- 172.21.15.7:0/3439037730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554806d600 msgr2=0x7f554806da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f554ca00640 1 --2- 172.21.15.7:0/3439037730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554806d600 0x7f554806da50 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f55340097a0 tx=0x7f553402a230 comp rx=0 tx=0).stop 2024-08-19T00:45:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f554ca00640 1 -- 172.21.15.7:0/3439037730 shutdown_connections 2024-08-19T00:45:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f554ca00640 1 --2- 172.21.15.7:0/3439037730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554806d600 0x7f554806da50 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.978+0000 7f554ca00640 1 -- 172.21.15.7:0/3439037730 >> 172.21.15.7:0/3439037730 conn(0x7f554806b850 msgr2=0x7f554806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.979+0000 7f554ca00640 1 -- 172.21.15.7:0/3439037730 shutdown_connections 2024-08-19T00:45:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.979+0000 7f554ca00640 1 -- 172.21.15.7:0/3439037730 wait complete. 2024-08-19T00:45:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.980+0000 7f554ca00640 1 Processor -- start 2024-08-19T00:45:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.981+0000 7f554ca00640 1 -- start start 2024-08-19T00:45:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.981+0000 7f554ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554806d600 0x7f55481554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.981+0000 7f554ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554815bd70 0x7f55480aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.981+0000 7f554ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554815cca0 0x7f55481f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f554ca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f554815c780 con 0x7f554815cca0 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f554ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f554815c4a0 con 0x7f554806d600 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f554ca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f554815c150 con 0x7f554815bd70 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5547200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554815cca0 0x7f55481f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5545e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554815bd70 0x7f55480aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5546800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554806d600 0x7f55481554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5545e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554815bd70 0x7f55480aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:48998/0 (socket says 172.21.15.7:48998) 2024-08-19T00:45:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5545e00640 1 -- 172.21.15.7:0/2512589804 learned_addr learned my addr 172.21.15.7:0/2512589804 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5547200640 1 -- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554815bd70 msgr2=0x7f55480aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5547200640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554815bd70 0x7f55480aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5547200640 1 -- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554806d600 msgr2=0x7f55481554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5547200640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554806d600 0x7f55481554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.982+0000 7f5547200640 1 -- 172.21.15.7:0/2512589804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55481f5440 con 0x7f554815cca0 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f5546800640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554806d600 0x7f55481554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f5545e00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554815bd70 0x7f55480aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f5547200640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554815cca0 0x7f55481f14f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f554000c700 tx=0x7f554000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f553ea00640 1 -- 172.21.15.7:0/2512589804 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540003b70 con 0x7f554815cca0 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f553ea00640 1 -- 172.21.15.7:0/2512589804 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5540003d10 con 0x7f554815cca0 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f553ea00640 1 -- 172.21.15.7:0/2512589804 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540005310 con 0x7f554815cca0 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55481f5720 con 0x7f554815cca0 2024-08-19T00:45:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.983+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55481f1a30 con 0x7f554815cca0 2024-08-19T00:45:35.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.984+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55481f61e0 con 0x7f554815cca0 2024-08-19T00:45:35.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.985+0000 7f553ea00640 1 -- 172.21.15.7:0/2512589804 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55400054b0 con 0x7f554815cca0 2024-08-19T00:45:35.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.986+0000 7f553ea00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f552806be30 0x7f552806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:35.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.986+0000 7f553ea00640 1 -- 172.21.15.7:0/2512589804 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7f554008b080 con 0x7f554815cca0 2024-08-19T00:45:35.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.986+0000 7f5546800640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f552806be30 0x7f552806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:35.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.987+0000 7f5546800640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f552806be30 0x7f552806e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5538007f70 tx=0x7f5538007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:35.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:35.990+0000 7f553ea00640 1 -- 172.21.15.7:0/2512589804 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5540058d80 con 0x7f554815cca0 2024-08-19T00:45:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.211+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55480af980 con 0x7f554815cca0 2024-08-19T00:45:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.211+0000 7f553ea00640 1 -- 172.21.15.7:0/2512589804 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) ==== 95+0+4393 (secure 0 0 0) 0x7f55480af980 con 0x7f554815cca0 2024-08-19T00:45:36.213 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:36.213 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":186,"btime":"2024-08-19T00:45:35:979633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3619862411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3619862411},{"type":"v1","addr":"172.21.15.7:6837","nonce":3619862411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":186}],"filesystems":[{"mdsmap":{"epoch":185,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:34.977637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 186 2024-08-19T00:45:36.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.213+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f552806be30 msgr2=0x7f552806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:36.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.213+0000 7f554ca00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f552806be30 0x7f552806e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5538007f70 tx=0x7f5538007f00 comp rx=0 tx=0).stop 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.213+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554815cca0 msgr2=0x7f55481f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.213+0000 7f554ca00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554815cca0 0x7f55481f14f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f554000c700 tx=0x7f554000cbc0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 shutdown_connections 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f552806be30 0x7f552806e2f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f554815cca0 0x7f55481f14f0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554815bd70 0x7f55480aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 --2- 172.21.15.7:0/2512589804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554806d600 0x7f55481554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 >> 172.21.15.7:0/2512589804 conn(0x7f554806b850 msgr2=0x7f5548159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 shutdown_connections 2024-08-19T00:45:36.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.214+0000 7f554ca00640 1 -- 172.21.15.7:0/2512589804 wait complete. 2024-08-19T00:45:36.231 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 200.00000000' led to DAMAGED state 2024-08-19T00:45:36.231 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 200.00000001' 2024-08-19T00:45:36.231 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:36.231 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:36.267 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:45:36.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:36.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:36.267 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:36.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:45:36.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.539+0000 7fef3dc00640 1 Processor -- start 2024-08-19T00:45:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.539+0000 7fef3dc00640 1 -- start start 2024-08-19T00:45:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.540+0000 7fef3dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef380d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.540+0000 7fef3dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef380b4380 0x7fef380b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:36.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.540+0000 7fef3dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef380b50b0 con 0x7fef3815f5b0 2024-08-19T00:45:36.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.540+0000 7fef3dc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fef3815f990 con 0x7fef380b4380 2024-08-19T00:45:36.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.540+0000 7fef3dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef380cf120 con 0x7fef380d03c0 2024-08-19T00:45:36.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef36a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fef3815f5b0 0x7fef380cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47716/0 (socket says 172.21.15.7:47716) 2024-08-19T00:45:36.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef36a00640 1 -- 172.21.15.7:0/296099294 learned_addr learned my addr 172.21.15.7:0/296099294 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:36.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef37400640 1 --2- 172.21.15.7:0/296099294 >> v2:172.21.15.7:3300/0 conn(0x7fef380b4380 0x7fef380b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:36.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef2fe00640 1 --2- 172.21.15.7:0/296099294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef380d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:36.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef36000640 1 -- 172.21.15.7:0/296099294 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542522745 0 0) 0x7fef380b50b0 con 0x7fef3815f5b0 2024-08-19T00:45:36.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef36000640 1 -- 172.21.15.7:0/296099294 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c003520 con 0x7fef3815f5b0 2024-08-19T00:45:36.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef37400640 1 -- 172.21.15.7:0/296099294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 msgr2=0x7fef380d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:36.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef37400640 1 --2- 172.21.15.7:0/296099294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef380d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef37400640 1 -- 172.21.15.7:0/296099294 >> v1:172.21.15.7:6789/0 conn(0x7fef3815f5b0 legacy=0x7fef380cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:36.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.541+0000 7fef37400640 1 -- 172.21.15.7:0/296099294 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef380cead0 con 0x7fef380b4380 2024-08-19T00:45:36.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.542+0000 7fef37400640 1 --2- 172.21.15.7:0/296099294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef380b4830 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fef30009d90 tx=0x7fef3002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73623fa1a0f7c7c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef36000640 1 -- 172.21.15.7:0/296099294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30031600 con 0x7fef380b4380 2024-08-19T00:45:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef36000640 1 -- 172.21.15.7:0/296099294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef300317a0 con 0x7fef380b4380 2024-08-19T00:45:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef36000640 1 -- 172.21.15.7:0/296099294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30031b70 con 0x7fef380b4380 2024-08-19T00:45:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 -- 172.21.15.7:0/296099294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 msgr2=0x7fef380b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 --2- 172.21.15.7:0/296099294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef380b4830 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fef30009d90 tx=0x7fef3002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 -- 172.21.15.7:0/296099294 shutdown_connections 2024-08-19T00:45:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 --2- 172.21.15.7:0/296099294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef380b4830 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 --2- 172.21.15.7:0/296099294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef380d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 -- 172.21.15.7:0/296099294 >> 172.21.15.7:0/296099294 conn(0x7fef3806bc70 msgr2=0x7fef3806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 -- 172.21.15.7:0/296099294 shutdown_connections 2024-08-19T00:45:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.543+0000 7fef3dc00640 1 -- 172.21.15.7:0/296099294 wait complete. 2024-08-19T00:45:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.545+0000 7fef3dc00640 1 Processor -- start 2024-08-19T00:45:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.545+0000 7fef3dc00640 1 -- start start 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef3dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef38158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef3dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef3814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef3dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3815f5b0 0x7fef3809ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef3dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef380b4d70 con 0x7fef380b4380 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef3dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef380d0d40 con 0x7fef3815f5b0 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef3dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef3806e660 con 0x7fef380d03c0 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef36a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef38158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef36a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef38158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45626/0 (socket says 172.21.15.7:45626) 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.546+0000 7fef36a00640 1 -- 172.21.15.7:0/2004420918 learned_addr learned my addr 172.21.15.7:0/2004420918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef2fe00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef3814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef37400640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3815f5b0 0x7fef3809ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef36a00640 1 -- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 msgr2=0x7fef3814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef36a00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef3814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef36a00640 1 -- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3815f5b0 msgr2=0x7fef3809ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef36a00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3815f5b0 0x7fef3809ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef36a00640 1 -- 172.21.15.7:0/2004420918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3814b190 con 0x7fef380b4380 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef37400640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3815f5b0 0x7fef3809ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef36a00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef38158250 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fef2800c390 tx=0x7fef2800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef2ea00640 1 -- 172.21.15.7:0/2004420918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28017070 con 0x7fef380b4380 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef2ea00640 1 -- 172.21.15.7:0/2004420918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef28005ce0 con 0x7fef380b4380 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef2ea00640 1 -- 172.21.15.7:0/2004420918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280072f0 con 0x7fef380b4380 2024-08-19T00:45:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef381483c0 con 0x7fef380b4380 2024-08-19T00:45:36.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.547+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef38148980 con 0x7fef380b4380 2024-08-19T00:45:36.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.549+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef380b4830 con 0x7fef380b4380 2024-08-19T00:45:36.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.549+0000 7fef2ea00640 1 -- 172.21.15.7:0/2004420918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef2801a070 con 0x7fef380b4380 2024-08-19T00:45:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.550+0000 7fef2ea00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef1406be80 0x7fef1406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.550+0000 7fef2ea00640 1 -- 172.21.15.7:0/2004420918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7fef2808a8c0 con 0x7fef380b4380 2024-08-19T00:45:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.551+0000 7fef2fe00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef1406be80 0x7fef1406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.551+0000 7fef2fe00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef1406be80 0x7fef1406e340 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fef3814e8c0 tx=0x7fef20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.555+0000 7fef2ea00640 1 -- 172.21.15.7:0/2004420918 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fef3814b190 con 0x7fef380b4380 2024-08-19T00:45:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.775+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fef3815c8c0 con 0x7fef380b4380 2024-08-19T00:45:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.997+0000 7fef2ea00640 1 -- 172.21.15.7:0/2004420918 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v187) ==== 161+0+0 (secure 0 0 0) 0x7fef28058c90 con 0x7fef380b4380 2024-08-19T00:45:36.999 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef1406be80 msgr2=0x7fef1406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef1406be80 0x7fef1406e340 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fef3814e8c0 tx=0x7fef20008040 comp rx=0 tx=0).stop 2024-08-19T00:45:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 msgr2=0x7fef38158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef38158250 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fef2800c390 tx=0x7fef2800c850 comp rx=0 tx=0).stop 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 shutdown_connections 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fef1406be80 0x7fef1406e340 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3815f5b0 0x7fef3809ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef380d03c0 0x7fef3814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:36.999+0000 7fef3dc00640 1 --2- 172.21.15.7:0/2004420918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef380b4380 0x7fef38158250 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.000+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 >> 172.21.15.7:0/2004420918 conn(0x7fef3806bc70 msgr2=0x7fef38074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.000+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 shutdown_connections 2024-08-19T00:45:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.000+0000 7fef3dc00640 1 -- 172.21.15.7:0/2004420918 wait complete. 2024-08-19T00:45:37.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.174+0000 7fc44cc00640 1 Processor -- start 2024-08-19T00:45:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.174+0000 7fc44cc00640 1 -- start start 2024-08-19T00:45:37.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc44cc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc44815e3e0 0x7fc4480b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc44cc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4480b4860 0x7fc4480d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc44cc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4480b4df0 con 0x7fc4480d27b0 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc44cc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc4480d3140 con 0x7fc44815e3e0 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc44cc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc4480b50d0 con 0x7fc4480b4860 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc447400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc44815e3e0 0x7fc4480b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc446a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc4480d27b0 0x7fc4480b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47720/0 (socket says 172.21.15.7:47720) 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.175+0000 7fc446a00640 1 -- 172.21.15.7:0/352504953 learned_addr learned my addr 172.21.15.7:0/352504953 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.176+0000 7fc447e00640 1 --2- 172.21.15.7:0/352504953 >> v2:172.21.15.162:3300/0 conn(0x7fc4480b4860 0x7fc4480d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.176+0000 7fc447400640 1 -- 172.21.15.7:0/352504953 >> v2:172.21.15.162:3300/0 conn(0x7fc4480b4860 msgr2=0x7fc4480d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.176+0000 7fc447400640 1 --2- 172.21.15.7:0/352504953 >> v2:172.21.15.162:3300/0 conn(0x7fc4480b4860 0x7fc4480d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.176+0000 7fc447400640 1 -- 172.21.15.7:0/352504953 >> v1:172.21.15.7:6789/0 conn(0x7fc4480d27b0 legacy=0x7fc4480b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.176+0000 7fc447400640 1 -- 172.21.15.7:0/352504953 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4480cf1e0 con 0x7fc44815e3e0 2024-08-19T00:45:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.176+0000 7fc446000640 1 -- 172.21.15.7:0/352504953 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489768146 0 0) 0x7fc4480b4df0 con 0x7fc4480d27b0 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.177+0000 7fc447400640 1 --2- 172.21.15.7:0/352504953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc44815e3e0 0x7fc4480b0e60 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097a0 tx=0x7fc43802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3ac85fbd876a5c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.177+0000 7fc446000640 1 -- 172.21.15.7:0/352504953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438037070 con 0x7fc44815e3e0 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.177+0000 7fc446000640 1 -- 172.21.15.7:0/352504953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438032440 con 0x7fc44815e3e0 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.177+0000 7fc446000640 1 -- 172.21.15.7:0/352504953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438032810 con 0x7fc44815e3e0 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 -- 172.21.15.7:0/352504953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc44815e3e0 msgr2=0x7fc4480b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 --2- 172.21.15.7:0/352504953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc44815e3e0 0x7fc4480b0e60 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097a0 tx=0x7fc43802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 -- 172.21.15.7:0/352504953 shutdown_connections 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 --2- 172.21.15.7:0/352504953 >> v2:172.21.15.162:3300/0 conn(0x7fc4480b4860 0x7fc4480d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 --2- 172.21.15.7:0/352504953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc44815e3e0 0x7fc4480b0e60 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 -- 172.21.15.7:0/352504953 >> 172.21.15.7:0/352504953 conn(0x7fc44808dbe0 msgr2=0x7fc44809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 -- 172.21.15.7:0/352504953 shutdown_connections 2024-08-19T00:45:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.178+0000 7fc44cc00640 1 -- 172.21.15.7:0/352504953 wait complete. 2024-08-19T00:45:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.180+0000 7fc44cc00640 1 Processor -- start 2024-08-19T00:45:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.180+0000 7fc44cc00640 1 -- start start 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc44cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4480b4860 0x7fc4480cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc44cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d27b0 0x7fc4480b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc44cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc44815e3e0 0x7fc4481f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc44cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480b13a0 con 0x7fc4480d27b0 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc44cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480cee90 con 0x7fc44815e3e0 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc44cc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4480cf9e0 con 0x7fc4480b4860 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d27b0 0x7fc4480b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d27b0 0x7fc4480b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45634/0 (socket says 172.21.15.7:45634) 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 -- 172.21.15.7:0/3838225726 learned_addr learned my addr 172.21.15.7:0/3838225726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 -- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4480b4860 msgr2=0x7fc4480cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4480b4860 0x7fc4480cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 -- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc44815e3e0 msgr2=0x7fc4481f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc447e00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc44815e3e0 0x7fc4481f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc44815e3e0 0x7fc4481f70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc446a00640 1 -- 172.21.15.7:0/3838225726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44815d4d0 con 0x7fc4480d27b0 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.181+0000 7fc447e00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc44815e3e0 0x7fc4481f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.182+0000 7fc446a00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d27b0 0x7fc4480b83d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fc43400c500 tx=0x7fc43400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.182+0000 7fc43f400640 1 -- 172.21.15.7:0/3838225726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434018070 con 0x7fc4480d27b0 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.182+0000 7fc43f400640 1 -- 172.21.15.7:0/3838225726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc434007580 con 0x7fc4480d27b0 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.182+0000 7fc43f400640 1 -- 172.21.15.7:0/3838225726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434004a20 con 0x7fc4480d27b0 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.182+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4480cc980 con 0x7fc4480d27b0 2024-08-19T00:45:37.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.182+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4480ccf40 con 0x7fc4480d27b0 2024-08-19T00:45:37.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.183+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4480d2c00 con 0x7fc4480d27b0 2024-08-19T00:45:37.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.184+0000 7fc43f400640 1 -- 172.21.15.7:0/3838225726 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc43401b070 con 0x7fc4480d27b0 2024-08-19T00:45:37.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.185+0000 7fc43f400640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc42806be60 0x7fc42806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:37.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.185+0000 7fc43f400640 1 -- 172.21.15.7:0/3838225726 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7fc43408a720 con 0x7fc4480d27b0 2024-08-19T00:45:37.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.185+0000 7fc447400640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc42806be60 0x7fc42806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:37.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.186+0000 7fc447400640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc42806be60 0x7fc42806e320 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc438034000 tx=0x7fc43802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:37.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.189+0000 7fc43f400640 1 -- 172.21.15.7:0/3838225726 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc434058b00 con 0x7fc4480d27b0 2024-08-19T00:45:37.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:37.443+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fc4480d0420 con 0x7fc4480d27b0 2024-08-19T00:45:38.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.002+0000 7fc43f400640 1 -- 172.21.15.7:0/3838225726 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v188) ==== 101+0+0 (secure 0 0 0) 0x7fc434058400 con 0x7fc4480d27b0 2024-08-19T00:45:38.004 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:45:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc42806be60 msgr2=0x7fc42806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc42806be60 0x7fc42806e320 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc438034000 tx=0x7fc43802c000 comp rx=0 tx=0).stop 2024-08-19T00:45:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d27b0 msgr2=0x7fc4480b83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d27b0 0x7fc4480b83d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fc43400c500 tx=0x7fc43400c9c0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 shutdown_connections 2024-08-19T00:45:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc42806be60 0x7fc42806e320 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc44815e3e0 0x7fc4481f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d27b0 0x7fc4480b83d0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 --2- 172.21.15.7:0/3838225726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4480b4860 0x7fc4480cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.005+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 >> 172.21.15.7:0/3838225726 conn(0x7fc44808dbe0 msgr2=0x7fc44809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.006+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 shutdown_connections 2024-08-19T00:45:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.006+0000 7fc44cc00640 1 -- 172.21.15.7:0/3838225726 wait complete. 2024-08-19T00:45:38.025 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:38.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.102+0000 7f71a47fef40 1 Processor -- start 2024-08-19T00:45:38.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.102+0000 7f71a47fef40 1 -- start start 2024-08-19T00:45:38.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a47fef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a405b0 0x558192ad7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a47fef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a40990 0x558192a3b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a47fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a588d0 0x558192a3f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a47fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558192ae60a0 con 0x558192a588d0 2024-08-19T00:45:38.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a47fef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558192ae5dc0 con 0x558192a405b0 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a47fef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558192ae6380 con 0x558192a40990 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a588d0 0x558192a3f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a588d0 0x558192a3f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45652/0 (socket says 172.21.15.7:45652) 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a2400640 1 -- 172.21.15.7:0/1651727020 learned_addr learned my addr 172.21.15.7:0/1651727020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a1000640 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a40990 0x558192a3b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.103+0000 7f71a1a00640 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a405b0 0x558192ad7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f71a2400640 1 -- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a40990 msgr2=0x558192a3b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f71a2400640 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a40990 0x558192a3b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f71a2400640 1 -- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a405b0 msgr2=0x558192ad7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f71a2400640 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a405b0 0x558192ad7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f71a2400640 1 -- 172.21.15.7:0/1651727020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558192943130 con 0x558192a588d0 2024-08-19T00:45:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f71a2400640 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a588d0 0x558192a3f5d0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f719c054040 tx=0x7f719c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c69f1550d1ff905 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f719b400640 1 -- 172.21.15.7:0/1651727020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c055040 con 0x558192a588d0 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f719b400640 1 -- 172.21.15.7:0/1651727020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719c051b60 con 0x558192a588d0 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.104+0000 7f719b400640 1 -- 172.21.15.7:0/1651727020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c065440 con 0x558192a588d0 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 -- 172.21.15.7:0/1651727020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a588d0 msgr2=0x558192a3f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a588d0 0x558192a3f5d0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f719c054040 tx=0x7f719c050000 comp rx=0 tx=0).stop 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 -- 172.21.15.7:0/1651727020 shutdown_connections 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a588d0 0x558192a3f5d0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a40990 0x558192a3b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 --2- 172.21.15.7:0/1651727020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a405b0 0x558192ad7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 -- 172.21.15.7:0/1651727020 >> 172.21.15.7:0/1651727020 conn(0x558192a3d4e0 msgr2=0x558192a0e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 -- 172.21.15.7:0/1651727020 shutdown_connections 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.105+0000 7f71a47fef40 1 -- 172.21.15.7:0/1651727020 wait complete. 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.106+0000 7f71a47fef40 1 Processor -- start 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.106+0000 7f71a47fef40 1 -- start start 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a47fef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a405b0 0x558192addda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a47fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a40990 0x558192b7b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a47fef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a588d0 0x558192ae2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a47fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558192ae8820 con 0x558192a40990 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a47fef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558192ae7ff0 con 0x558192a588d0 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a47fef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558192ae8260 con 0x558192a405b0 2024-08-19T00:45:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a40990 0x558192b7b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a40990 0x558192b7b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45658/0 (socket says 172.21.15.7:45658) 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 learned_addr learned my addr 172.21.15.7:0/2845188624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a2400640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a588d0 0x558192ae2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1a00640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a405b0 0x558192addda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a405b0 msgr2=0x558192addda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558192a405b0 0x558192addda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a588d0 msgr2=0x558192ae2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558192a588d0 0x558192ae2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.107+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558192939b30 con 0x558192a40990 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.108+0000 7f71a1000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a40990 0x558192b7b6c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7190009f40 tx=0x7f71900084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.108+0000 7f719a000640 1 -- 172.21.15.7:0/2845188624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71900145f0 con 0x558192a40990 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.108+0000 7f719a000640 1 -- 172.21.15.7:0/2845188624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7190019070 con 0x558192a40990 2024-08-19T00:45:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.108+0000 7f719a000640 1 -- 172.21.15.7:0/2845188624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71900149d0 con 0x558192a40990 2024-08-19T00:45:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.108+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558192976080 con 0x558192a40990 2024-08-19T00:45:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.108+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558192adeba0 con 0x558192a40990 2024-08-19T00:45:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.110+0000 7f719a000640 1 -- 172.21.15.7:0/2845188624 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7190014b70 con 0x558192a40990 2024-08-19T00:45:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.111+0000 7f719a000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f718406a810 0x7f718406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.111+0000 7f719a000640 1 -- 172.21.15.7:0/2845188624 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7f7190089d90 con 0x558192a40990 2024-08-19T00:45:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.111+0000 7f71a1a00640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f718406a810 0x7f718406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.114 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.111+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558192b7bc00 0x558192ae1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.111+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae77b0 con 0x558192b7bc00 2024-08-19T00:45:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.112+0000 7f71a2400640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558192b7bc00 0x558192ae1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.112+0000 7f71a1a00640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f718406a810 0x7f718406ccd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7194009720 tx=0x7f7194005ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.112+0000 7f71a2400640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558192b7bc00 0x558192ae1df0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.114+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v103'505 uv479 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.114+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192a0bef0 con 0x558192b7bc00 2024-08-19T00:45:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.116+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v103'506 uv506 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.116+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ad52d0 con 0x558192b7bc00 2024-08-19T00:45:38.119 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.117+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v103'507 uv507 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.117+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88ce0 con 0x558192b7bc00 2024-08-19T00:45:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.119+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v103'508 uv508 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.119+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b89080 con 0x558192b7bc00 2024-08-19T00:45:38.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.120+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v103'509 uv509 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.120+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b87cd0 con 0x558192b7bc00 2024-08-19T00:45:38.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.122+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v103'510 uv510 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.122+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b880e0 con 0x558192b7bc00 2024-08-19T00:45:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.123+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v103'511 uv485 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.123+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.125+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v103'512 uv512 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.125+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.128 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:38.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.126+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v103'513 uv513 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.127+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.128+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v103'514 uv514 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.128+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.129+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v103'515 uv515 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.129+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.131+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v103'516 uv516 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.131+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.133+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v103'517 uv492 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.133+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.134+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v103'518 uv518 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.135+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.136+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v103'519 uv519 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.138 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.136+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.137+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v103'520 uv520 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.138+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.139+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v103'521 uv521 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.139+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b88480 con 0x558192b7bc00 2024-08-19T00:45:38.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.140+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v103'522 uv522 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.141+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b888d0 con 0x558192b7bc00 2024-08-19T00:45:38.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.142+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v103'523 uv523 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.142+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.143+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v103'524 uv498 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.143+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.145+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v103'525 uv525 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.145+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.146+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v103'526 uv526 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.148 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:38.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.146+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.148+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v103'527 uv527 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.148+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.149+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v103'528 uv528 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.149+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.151+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v103'529 uv529 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.151+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.152+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v103'530 uv504 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.153+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.154+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v103'531 uv531 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.154+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.156+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v103'532 uv532 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.157 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:38.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.156+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.157+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v103'533 uv533 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.157+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.158+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v103'534 uv534 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.159+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b7bc00 2024-08-19T00:45:38.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.160+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v103'535 uv535 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.160+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558192b89930 0x558192b8bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.160+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192ae2ab0 con 0x558192b89930 2024-08-19T00:45:38.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.160+0000 7f71a1a00640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558192b89930 0x558192b8bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.161+0000 7f71a1a00640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558192b89930 0x558192b8bd20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.163+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v103'374 uv356 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f71940164a0 con 0x558192b89930 2024-08-19T00:45:38.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.163+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b8c260 con 0x558192b89930 2024-08-19T00:45:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.164+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v103'375 uv375 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.164+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8c600 con 0x558192b89930 2024-08-19T00:45:38.168 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.166+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v103'376 uv376 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.166+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8c9a0 con 0x558192b89930 2024-08-19T00:45:38.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.168+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v103'377 uv377 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.168+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8cd40 con 0x558192b89930 2024-08-19T00:45:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.169+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v103'378 uv378 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.169+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d0e0 con 0x558192b89930 2024-08-19T00:45:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.171+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v103'379 uv373 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.171+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d480 con 0x558192b89930 2024-08-19T00:45:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.172+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v103'380 uv380 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.172+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.175 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.174+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v103'381 uv381 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.174+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.175+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v103'382 uv382 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.175+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.176+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v103'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.176+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.178+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v103'384 uv366 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.178+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.179+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v103'385 uv385 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.179+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.182 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:38.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.180+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v103'386 uv386 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.180+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91f10 con 0x558192b89930 2024-08-19T00:45:38.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.182+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v103'387 uv387 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.182+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91f10 con 0x558192b89930 2024-08-19T00:45:38.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.183+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v103'388 uv388 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.183+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.185+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v103'389 uv372 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.185+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.186+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v103'390 uv390 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.186+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.189 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:38.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.187+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v103'391 uv391 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.188+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8e830 con 0x558192b89930 2024-08-19T00:45:38.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.189+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v103'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.189+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8e830 con 0x558192b89930 2024-08-19T00:45:38.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.190+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v103'393 uv393 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.190+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b8d820 con 0x558192b89930 2024-08-19T00:45:38.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.192+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v103'394 uv394 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b89930 2024-08-19T00:45:38.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.192+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558192b8dd30 0x558192b90120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.192+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b906f0 con 0x558192b8dd30 2024-08-19T00:45:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.192+0000 7f71a1000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558192b8dd30 0x558192b90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.193+0000 7f71a1000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558192b8dd30 0x558192b90120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.194+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v103'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.194+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b90bc0 con 0x558192b8dd30 2024-08-19T00:45:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.195+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v103'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.195+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b910a0 con 0x558192b8dd30 2024-08-19T00:45:38.198 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.197+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v103'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.197+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b92950 con 0x558192b8dd30 2024-08-19T00:45:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.198+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v103'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.198+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b92cf0 con 0x558192b8dd30 2024-08-19T00:45:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.199+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v103'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.199+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91940 con 0x558192b8dd30 2024-08-19T00:45:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.201+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v103'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.201+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91d30 con 0x558192b7bc00 2024-08-19T00:45:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.202+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v103'76 uv75 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.202+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b91d30 con 0x558192b7bc00 2024-08-19T00:45:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.204+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v103'77 uv77 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.204+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91d30 con 0x558192b7bc00 2024-08-19T00:45:38.206 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:38.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.205+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v103'78 uv78 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.205+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91d30 con 0x558192b7bc00 2024-08-19T00:45:38.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.206+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v103'79 uv79 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.207+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558192b93090 0x558192b95480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.207+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b959c0 con 0x558192b93090 2024-08-19T00:45:38.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.207+0000 7f71a2400640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558192b93090 0x558192b95480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.208+0000 7f71a2400640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558192b93090 0x558192b95480 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.209+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v103'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.209+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b959c0 con 0x558192b93090 2024-08-19T00:45:38.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.210+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v103'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.210+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b959c0 con 0x558192b93090 2024-08-19T00:45:38.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.212+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v103'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.213 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:38.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.212+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b969d0 con 0x558192b93090 2024-08-19T00:45:38.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.213+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v103'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.213+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b969d0 con 0x558192b93090 2024-08-19T00:45:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.215+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v103'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.215+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b959c0 con 0x558192b93090 2024-08-19T00:45:38.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.216+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v103'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.216+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558192b96040 0x558192b98430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.216+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b98970 con 0x558192b96040 2024-08-19T00:45:38.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.217+0000 7f71a1a00640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558192b96040 0x558192b98430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.217+0000 7f71a1a00640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558192b96040 0x558192b98430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.219+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v103'182 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.219+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b98a30 con 0x558192b96040 2024-08-19T00:45:38.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.220+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v103'183 uv183 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.220+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b98e50 con 0x558192b96040 2024-08-19T00:45:38.223 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:38.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.221+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v103'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.221+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b99e60 con 0x558192b96040 2024-08-19T00:45:38.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.222+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v103'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.223+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b99e60 con 0x558192b96040 2024-08-19T00:45:38.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.224+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v103'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.224+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b98e50 con 0x558192b96040 2024-08-19T00:45:38.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.225+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v103'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.225+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b98e50 con 0x558192b96040 2024-08-19T00:45:38.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.227+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v103'188 uv181 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.227+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b98e50 con 0x558192b96040 2024-08-19T00:45:38.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.228+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v103'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.228+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b98e50 con 0x558192b96040 2024-08-19T00:45:38.231 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.229+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v103'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.229+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b98e50 con 0x558192b96040 2024-08-19T00:45:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.231+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v103'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.231+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b98e50 con 0x558192b96040 2024-08-19T00:45:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.232+0000 7f71a1a00640 1 -- 172.21.15.7:0/2845188624 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v103'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f71940168e0 con 0x558192b96040 2024-08-19T00:45:38.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.232+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558192b994d0 0x558192b9b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.232+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9bf20 con 0x558192b994d0 2024-08-19T00:45:38.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.232+0000 7f71a1000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558192b994d0 0x558192b9b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.233+0000 7f71a1000640 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558192b994d0 0x558192b9b8c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.234+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v103'81 uv80 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.234+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c2f0 con 0x558192b994d0 2024-08-19T00:45:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.235+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v103'82 uv82 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.235+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b994d0 2024-08-19T00:45:38.238 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.236+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v103'83 uv83 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.236+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b994d0 2024-08-19T00:45:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.238+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v103'84 uv84 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.238+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b994d0 2024-08-19T00:45:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.239+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v103'85 uv85 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.239+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b7bc00 2024-08-19T00:45:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.240+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v103'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.241+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b7bc00 2024-08-19T00:45:38.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.242+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v103'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.242+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b7bc00 2024-08-19T00:45:38.245 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.244+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v103'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.244+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9d720 con 0x558192b7bc00 2024-08-19T00:45:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.245+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v103'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.245+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9d720 con 0x558192b7bc00 2024-08-19T00:45:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.246+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v103'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.246+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b7bc00 2024-08-19T00:45:38.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.248+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v103'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b7bc00 2024-08-19T00:45:38.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.248+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.249+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v103'162 uv156 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.249+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.251+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v103'163 uv163 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.251+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.254 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.252+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v103'164 uv164 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.252+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.254+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v103'165 uv165 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.254+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.255+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v103'166 uv166 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.255+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.257+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v103'167 uv161 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.257+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.259+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v103'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.259+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.261 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.260+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v103'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.260+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9c710 con 0x558192b8dd30 2024-08-19T00:45:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.261+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v103'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.261+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b8dd30 2024-08-19T00:45:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.262+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v103'171 uv171 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b8dd30 2024-08-19T00:45:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.263+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.264+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v103'74 uv73 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.264+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.265+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v103'75 uv75 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.265+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.268 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.267+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v103'76 uv76 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.267+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.268+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v103'77 uv77 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.268+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.270+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v103'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.270+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.272+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v103'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.272+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.274 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:38.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.273+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v103'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.273+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91520 con 0x558192b93090 2024-08-19T00:45:38.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.274+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v103'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.274+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914e0 con 0x558192b93090 2024-08-19T00:45:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.275+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v103'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.275+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914e0 con 0x558192b93090 2024-08-19T00:45:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.277+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v103'104 uv104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f719c05b430 con 0x558192b93090 2024-08-19T00:45:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.277+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914e0 con 0x558192b994d0 2024-08-19T00:45:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.278+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v103'84 uv83 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.278+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b914e0 con 0x558192b994d0 2024-08-19T00:45:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.280+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v103'85 uv85 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.280+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914e0 con 0x558192b994d0 2024-08-19T00:45:38.282 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.281+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v103'86 uv86 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.281+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914e0 con 0x558192b994d0 2024-08-19T00:45:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.282+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v103'87 uv87 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.282+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914e0 con 0x558192b994d0 2024-08-19T00:45:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.284+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v103'88 uv88 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.284+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914c0 con 0x558192b994d0 2024-08-19T00:45:38.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.285+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v103'204 uv196 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.285+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b914c0 con 0x558192b994d0 2024-08-19T00:45:38.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.287+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v103'205 uv205 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.287+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914c0 con 0x558192b994d0 2024-08-19T00:45:38.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.288+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v103'206 uv206 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.290 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:38.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.288+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914c0 con 0x558192b994d0 2024-08-19T00:45:38.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.290+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v103'207 uv207 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.290+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914c0 con 0x558192b994d0 2024-08-19T00:45:38.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.291+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v103'208 uv208 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.291+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b914c0 con 0x558192b994d0 2024-08-19T00:45:38.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.292+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v103'209 uv203 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.292+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) -- 0x558192b91490 con 0x558192b994d0 2024-08-19T00:45:38.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.293+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v103'210 uv210 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.293+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91490 con 0x558192b994d0 2024-08-19T00:45:38.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.294+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v103'211 uv211 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.296 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:38.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.295+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91490 con 0x558192b994d0 2024-08-19T00:45:38.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.296+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v103'212 uv212 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.296+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91490 con 0x558192b994d0 2024-08-19T00:45:38.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.297+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v103'213 uv213 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.297+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b91490 con 0x558192b994d0 2024-08-19T00:45:38.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.299+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v103'214 uv214 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.299+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x558192b9d1e0 con 0x558192b994d0 2024-08-19T00:45:38.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a1000640 1 -- 172.21.15.7:0/2845188624 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v103'215 uv215 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7190054190 con 0x558192b994d0 2024-08-19T00:45:38.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558192b89930 msgr2=0x558192b8bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558192b89930 0x558192b8bd20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558192b96040 msgr2=0x558192b98430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558192b96040 0x558192b98430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558192b994d0 msgr2=0x558192b9b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558192b994d0 0x558192b9b8c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558192b8dd30 msgr2=0x558192b90120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558192b8dd30 0x558192b90120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 reap_dead start 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558192b7bc00 msgr2=0x558192ae1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558192b7bc00 0x558192ae1df0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a2400640 1 -- 172.21.15.7:0/2845188624 reap_dead start 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558192b93090 msgr2=0x558192b95480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558192b93090 0x558192b95480 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f718406a810 msgr2=0x7f718406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f718406a810 0x7f718406ccd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7194009720 tx=0x7f7194005ac0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a40990 msgr2=0x558192b7b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a40990 0x558192b7b6c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7190009f40 tx=0x7f71900084c0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 shutdown_connections 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f718406a810 0x7f718406ccd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558192b93090 0x558192b95480 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 --2- 172.21.15.7:0/2845188624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558192a40990 0x558192b7b6c0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 >> 172.21.15.7:0/2845188624 conn(0x558192a3d4e0 msgr2=0x558192ad59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 shutdown_connections 2024-08-19T00:45:38.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.300+0000 7f71a47fef40 1 -- 172.21.15.7:0/2845188624 wait complete. 2024-08-19T00:45:38.306 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 200.00000001 - 2024-08-19T00:45:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.422+0000 7f570a65ef40 1 Processor -- start 2024-08-19T00:45:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.422+0000 7f570a65ef40 1 -- start start 2024-08-19T00:45:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f570a65ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe85ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f570a65ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df5b0 0x55bfe867cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f570a65ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df990 0x55bfe867d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f570a65ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bfe8553d00 con 0x55bfe85df990 2024-08-19T00:45:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f570a65ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bfe8557d40 con 0x55bfe85df5b0 2024-08-19T00:45:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f570a65ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55bfe86850a0 con 0x55bfe85ddf40 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df990 0x55bfe867d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df990 0x55bfe867d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45668/0 (socket says 172.21.15.7:45668) 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 -- 172.21.15.7:0/3286610362 learned_addr learned my addr 172.21.15.7:0/3286610362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5706e00640 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df5b0 0x55bfe867cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5707800640 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe85ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 -- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 msgr2=0x55bfe85ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe85ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 -- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df5b0 msgr2=0x55bfe867cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df5b0 0x55bfe867cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5708200640 1 -- 172.21.15.7:0/3286610362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe8515080 con 0x55bfe85df990 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5706e00640 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df5b0 0x55bfe867cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.423+0000 7f5707800640 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe85ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f5708200640 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df990 0x55bfe867d0e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f5700001750 tx=0x7f5700001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c8911aa43bdeb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f5705a00640 1 -- 172.21.15.7:0/3286610362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700003450 con 0x55bfe85df990 2024-08-19T00:45:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f5705a00640 1 -- 172.21.15.7:0/3286610362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57000035f0 con 0x55bfe85df990 2024-08-19T00:45:38.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f5705a00640 1 -- 172.21.15.7:0/3286610362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700003a00 con 0x55bfe85df990 2024-08-19T00:45:38.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 -- 172.21.15.7:0/3286610362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df990 msgr2=0x55bfe867d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df990 0x55bfe867d0e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f5700001750 tx=0x7f5700001c10 comp rx=0 tx=0).stop 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 -- 172.21.15.7:0/3286610362 shutdown_connections 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df990 0x55bfe867d0e0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df5b0 0x55bfe867cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 --2- 172.21.15.7:0/3286610362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe85ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 -- 172.21.15.7:0/3286610362 >> 172.21.15.7:0/3286610362 conn(0x55bfe85dc4e0 msgr2=0x55bfe8687070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 -- 172.21.15.7:0/3286610362 shutdown_connections 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.424+0000 7f570a65ef40 1 -- 172.21.15.7:0/3286610362 wait complete. 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.425+0000 7f570a65ef40 1 Processor -- start 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.425+0000 7f570a65ef40 1 -- start start 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f570a65ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe8682780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f570a65ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df5b0 0x55bfe85d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f570a65ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df990 0x55bfe866d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f570a65ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bfe85db7f0 con 0x55bfe85df5b0 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f570a65ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bfe866ec80 con 0x55bfe85df990 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f570a65ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55bfe85dbad0 con 0x55bfe85ddf40 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f5706e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df5b0 0x55bfe85d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f5706e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df5b0 0x55bfe85d1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45678/0 (socket says 172.21.15.7:45678) 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f5706e00640 1 -- 172.21.15.7:0/2141758777 learned_addr learned my addr 172.21.15.7:0/2141758777 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f5708200640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df990 0x55bfe866d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.426+0000 7f5707800640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe8682780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f5706e00640 1 -- 172.21.15.7:0/2141758777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 msgr2=0x55bfe8682780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f5706e00640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe8682780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f5706e00640 1 -- 172.21.15.7:0/2141758777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df990 msgr2=0x55bfe866d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f5706e00640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bfe85df990 0x55bfe866d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f5706e00640 1 -- 172.21.15.7:0/2141758777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe867b2b0 con 0x55bfe85df5b0 2024-08-19T00:45:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f5707800640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55bfe85ddf40 0x55bfe8682780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f5706e00640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df5b0 0x55bfe85d1dd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f56f4025450 tx=0x7f56f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f56ffe00640 1 -- 172.21.15.7:0/2141758777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f406b070 con 0x55bfe85df5b0 2024-08-19T00:45:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f56ffe00640 1 -- 172.21.15.7:0/2141758777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f4052710 con 0x55bfe85df5b0 2024-08-19T00:45:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.427+0000 7f56ffe00640 1 -- 172.21.15.7:0/2141758777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4052ae0 con 0x55bfe85df5b0 2024-08-19T00:45:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.428+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bfe867acf0 con 0x55bfe85df5b0 2024-08-19T00:45:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.428+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe8681f80 con 0x55bfe85df5b0 2024-08-19T00:45:38.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.429+0000 7f56ffe00640 1 -- 172.21.15.7:0/2141758777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56f406e070 con 0x55bfe85df5b0 2024-08-19T00:45:38.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.430+0000 7f56ffe00640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56e806a810 0x7f56e806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.430+0000 7f56ffe00640 1 -- 172.21.15.7:0/2141758777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7f56f40ccc30 con 0x55bfe85df5b0 2024-08-19T00:45:38.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.430+0000 7f5707800640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56e806a810 0x7f56e806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.431+0000 7f570a65ef40 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55bfe866dc50 0x55bfe85d3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.431+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:2e2fa760:::200.00000001:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) -- 0x55bfe866e0b0 con 0x55bfe866dc50 2024-08-19T00:45:38.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.431+0000 7f5708200640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55bfe866dc50 0x55bfe85d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.431+0000 7f5707800640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56e806a810 0x7f56e806ccd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f56f8000c00 tx=0x7f56f8001750 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.431+0000 7f5708200640 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55bfe866dc50 0x55bfe85d3850 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f5708200640 1 -- 172.21.15.7:0/2141758777 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000001 [writefull 0~80] v103'395 uv395 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f570000f030 con 0x55bfe866dc50 2024-08-19T00:45:38.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55bfe866dc50 msgr2=0x55bfe85d3850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55bfe866dc50 0x55bfe85d3850 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56e806a810 msgr2=0x7f56e806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56e806a810 0x7f56e806ccd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f56f8000c00 tx=0x7f56f8001750 comp rx=0 tx=0).stop 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df5b0 msgr2=0x55bfe85d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 --2- 172.21.15.7:0/2141758777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfe85df5b0 0x55bfe85d1dd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f56f4025450 tx=0x7f56f4002fb0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f5708200640 1 -- 172.21.15.7:0/2141758777 reap_dead start 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 shutdown_connections 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 >> 172.21.15.7:0/2141758777 conn(0x55bfe85dc4e0 msgr2=0x55bfe85dd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.433+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 shutdown_connections 2024-08-19T00:45:38.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.434+0000 7f570a65ef40 1 -- 172.21.15.7:0/2141758777 wait complete. 2024-08-19T00:45:38.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:38.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.637+0000 7f6cb9c00640 1 Processor -- start 2024-08-19T00:45:38.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.637+0000 7f6cb9c00640 1 -- start start 2024-08-19T00:45:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.638+0000 7f6cb9c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.638+0000 7f6cb9c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6cb40d4b30 0x7f6cb40d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.638+0000 7f6cb9c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cb40cfd90 con 0x7f6cb40d3000 2024-08-19T00:45:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.638+0000 7f6cb9c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6cb40d1b90 con 0x7f6cb40d4b30 2024-08-19T00:45:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.638+0000 7f6cb9c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb415f8b0 con 0x7f6cb415e380 2024-08-19T00:45:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cab400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6cb40d4b30 0x7f6cb40d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cab400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6cb40d4b30 0x7f6cb40d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45682/0 (socket says 172.21.15.7:45682) 2024-08-19T00:45:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cab400640 1 -- 172.21.15.7:0/613780626 learned_addr learned my addr 172.21.15.7:0/613780626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cb3e00640 1 --2- 172.21.15.7:0/613780626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cab400640 1 -- 172.21.15.7:0/613780626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 msgr2=0x7f6cb415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cab400640 1 --2- 172.21.15.7:0/613780626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cab400640 1 -- 172.21.15.7:0/613780626 >> v1:172.21.15.162:6789/0 conn(0x7f6cb40d3000 legacy=0x7f6cb4161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:38.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.639+0000 7f6cab400640 1 -- 172.21.15.7:0/613780626 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb415e760 con 0x7f6cb40d4b30 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.640+0000 7f6cab400640 1 --2- 172.21.15.7:0/613780626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb40d09b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009870 tx=0x7f6c9c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c456bb732327562 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.640+0000 7f6cb3400640 1 -- 172.21.15.7:0/613780626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c037070 con 0x7f6cb40d4b30 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.640+0000 7f6cb3400640 1 -- 172.21.15.7:0/613780626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c032440 con 0x7f6cb40d4b30 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.640+0000 7f6cb3400640 1 -- 172.21.15.7:0/613780626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c032810 con 0x7f6cb40d4b30 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 -- 172.21.15.7:0/613780626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 msgr2=0x7f6cb40d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/613780626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb40d09b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009870 tx=0x7f6c9c02a2a0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 -- 172.21.15.7:0/613780626 shutdown_connections 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/613780626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb40d09b0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/613780626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 -- 172.21.15.7:0/613780626 >> 172.21.15.7:0/613780626 conn(0x7f6cb409d4d0 msgr2=0x7f6cb40d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:38.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 -- 172.21.15.7:0/613780626 shutdown_connections 2024-08-19T00:45:38.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.641+0000 7f6cb9c00640 1 -- 172.21.15.7:0/613780626 wait complete. 2024-08-19T00:45:38.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.643+0000 7f6cb9c00640 1 Processor -- start 2024-08-19T00:45:38.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.643+0000 7f6cb9c00640 1 -- start start 2024-08-19T00:45:38.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb40d3000 0x7f6cb4159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb4161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb9c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb4162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb9c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb40d2520 con 0x7f6cb40d4b30 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb9c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb40d2280 con 0x7f6cb40d3000 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb9c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb40d2800 con 0x7f6cb415e380 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb4161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb40d3000 0x7f6cb4159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb40d3000 0x7f6cb4159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:38930/0 (socket says 172.21.15.7:38930) 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb4161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45692/0 (socket says 172.21.15.7:45692) 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb3e00640 1 -- 172.21.15.7:0/3220416485 learned_addr learned my addr 172.21.15.7:0/3220416485 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cb9200640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb4162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cab400640 1 -- 172.21.15.7:0/3220416485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 msgr2=0x7f6cb4162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cab400640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb4162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cab400640 1 -- 172.21.15.7:0/3220416485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb40d3000 msgr2=0x7f6cb4159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cab400640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb40d3000 0x7f6cb4159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.644+0000 7f6cab400640 1 -- 172.21.15.7:0/3220416485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb40cbd80 con 0x7f6cb40d4b30 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.645+0000 7f6cab400640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb4161e40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c031000 tx=0x7f6c9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.645+0000 7f6cb0c00640 1 -- 172.21.15.7:0/3220416485 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c041020 con 0x7f6cb40d4b30 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.645+0000 7f6cb0c00640 1 -- 172.21.15.7:0/3220416485 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c030780 con 0x7f6cb40d4b30 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.645+0000 7f6cb0c00640 1 -- 172.21.15.7:0/3220416485 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c037040 con 0x7f6cb40d4b30 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.645+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb40cc060 con 0x7f6cb40d4b30 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.645+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb40cc620 con 0x7f6cb40d4b30 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.646+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb4075fb0 con 0x7f6cb40d4b30 2024-08-19T00:45:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.647+0000 7f6cb0c00640 1 -- 172.21.15.7:0/3220416485 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c9c044020 con 0x7f6cb40d4b30 2024-08-19T00:45:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.648+0000 7f6cb0c00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c9006be30 0x7f6c9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.648+0000 7f6cb0c00640 1 -- 172.21.15.7:0/3220416485 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 7171+0+0 (secure 0 0 0) 0x7f6c9c0abb20 con 0x7f6cb40d4b30 2024-08-19T00:45:38.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.648+0000 7f6cb3e00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c9006be30 0x7f6c9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:38.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.649+0000 7f6cb3e00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c9006be30 0x7f6c9006e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4006fd0 tx=0x7f6ca4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.653+0000 7f6cb0c00640 1 -- 172.21.15.7:0/3220416485 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6cb4075fb0 con 0x7f6cb40d4b30 2024-08-19T00:45:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:38.872+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f6cb40d0fd0 con 0x7f6cb40d4b30 2024-08-19T00:45:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.004+0000 7f6cb0c00640 1 -- 172.21.15.7:0/3220416485 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v189) ==== 162+0+0 (secure 0 0 0) 0x7f6c9c04b030 con 0x7f6cb40d4b30 2024-08-19T00:45:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c9006be30 msgr2=0x7f6c9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c9006be30 0x7f6c9006e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4006fd0 tx=0x7f6ca4008040 comp rx=0 tx=0).stop 2024-08-19T00:45:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 msgr2=0x7f6cb4161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb4161e40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c031000 tx=0x7f6c9c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 shutdown_connections 2024-08-19T00:45:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c9006be30 0x7f6c9006e2f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cb415e380 0x7f6cb4162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb40d4b30 0x7f6cb4161e40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 --2- 172.21.15.7:0/3220416485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb40d3000 0x7f6cb4159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.006+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 >> 172.21.15.7:0/3220416485 conn(0x7f6cb409d4d0 msgr2=0x7f6cb40b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.007+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 shutdown_connections 2024-08-19T00:45:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.007+0000 7f6cb9c00640 1 -- 172.21.15.7:0/3220416485 wait complete. 2024-08-19T00:45:39.018 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:45:39.017+0000 7f970d200640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-08-19T00:45:39.018 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:39.017+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:39.019 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:39.017+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:45:39.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.183+0000 7fc1c5e00640 1 Processor -- start 2024-08-19T00:45:39.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.183+0000 7fc1c5e00640 1 -- start start 2024-08-19T00:45:39.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.184+0000 7fc1c5e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1c00ce500 0x7fc1c00ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.184+0000 7fc1c5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00d03c0 0x7fc1c00d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.184+0000 7fc1c5e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c006f7f0 con 0x7fc1c0159bf0 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.184+0000 7fc1c5e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c00d0d50 con 0x7fc1c00ce500 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.184+0000 7fc1c5e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c006f510 con 0x7fc1c00d03c0 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.184+0000 7fc1be000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1c00ce500 0x7fc1c00ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.185+0000 7fc1be000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1c00ce500 0x7fc1c00ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45694/0 (socket says 172.21.15.7:45694) 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.185+0000 7fc1be000640 1 -- 172.21.15.7:0/313005345 learned_addr learned my addr 172.21.15.7:0/313005345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.185+0000 7fc1bf400640 1 --2- 172.21.15.7:0/313005345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00d03c0 0x7fc1c00d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.185+0000 7fc1be000640 1 -- 172.21.15.7:0/313005345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00d03c0 msgr2=0x7fc1c00d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.185+0000 7fc1be000640 1 --2- 172.21.15.7:0/313005345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00d03c0 0x7fc1c00d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.185+0000 7fc1be000640 1 -- 172.21.15.7:0/313005345 >> v1:172.21.15.162:6789/0 conn(0x7fc1c0159bf0 legacy=0x7fc1c0073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.185+0000 7fc1be000640 1 -- 172.21.15.7:0/313005345 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c0072980 con 0x7fc1c00ce500 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.186+0000 7fc1be000640 1 --2- 172.21.15.7:0/313005345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00ce500 0x7fc1c00ce970 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009870 tx=0x7fc1ac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b8a3fe394b5c72 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.186+0000 7fc1bd600640 1 -- 172.21.15.7:0/313005345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac037070 con 0x7fc1c00ce500 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.186+0000 7fc1bd600640 1 -- 172.21.15.7:0/313005345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac032440 con 0x7fc1c00ce500 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.186+0000 7fc1bd600640 1 -- 172.21.15.7:0/313005345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac032810 con 0x7fc1c00ce500 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 -- 172.21.15.7:0/313005345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00ce500 msgr2=0x7fc1c00ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/313005345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00ce500 0x7fc1c00ce970 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009870 tx=0x7fc1ac02a1c0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 -- 172.21.15.7:0/313005345 shutdown_connections 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/313005345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00d03c0 0x7fc1c00d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/313005345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00ce500 0x7fc1c00ce970 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 -- 172.21.15.7:0/313005345 >> 172.21.15.7:0/313005345 conn(0x7fc1c006bc70 msgr2=0x7fc1c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 -- 172.21.15.7:0/313005345 shutdown_connections 2024-08-19T00:45:39.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.187+0000 7fc1c5e00640 1 -- 172.21.15.7:0/313005345 wait complete. 2024-08-19T00:45:39.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.189+0000 7fc1c5e00640 1 Processor -- start 2024-08-19T00:45:39.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.189+0000 7fc1c5e00640 1 -- start start 2024-08-19T00:45:39.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1c5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00ce500 0x7fc1c009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00d03c0 0x7fc1c0150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1c5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c0159bf0 0x7fc1c009c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1c5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0073b70 con 0x7fc1c00d03c0 2024-08-19T00:45:39.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1c5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0072f40 con 0x7fc1c0159bf0 2024-08-19T00:45:39.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1c5e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c0159fd0 con 0x7fc1c00ce500 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00d03c0 0x7fc1c0150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00d03c0 0x7fc1c0150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45708/0 (socket says 172.21.15.7:45708) 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 -- 172.21.15.7:0/1722039686 learned_addr learned my addr 172.21.15.7:0/1722039686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1bea00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00ce500 0x7fc1c009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1bf400640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c0159bf0 0x7fc1c009c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 -- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00ce500 msgr2=0x7fc1c009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00ce500 0x7fc1c009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 -- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c0159bf0 msgr2=0x7fc1c009c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c0159bf0 0x7fc1c009c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.190+0000 7fc1be000640 1 -- 172.21.15.7:0/1722039686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c0160530 con 0x7fc1c00d03c0 2024-08-19T00:45:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.191+0000 7fc1be000640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00d03c0 0x7fc1c0150f70 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000c00 tx=0x7fc1ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.191+0000 7fc1b7400640 1 -- 172.21.15.7:0/1722039686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac041020 con 0x7fc1c00d03c0 2024-08-19T00:45:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.191+0000 7fc1b7400640 1 -- 172.21.15.7:0/1722039686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac0306c0 con 0x7fc1c00d03c0 2024-08-19T00:45:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.191+0000 7fc1b7400640 1 -- 172.21.15.7:0/1722039686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac037040 con 0x7fc1c00d03c0 2024-08-19T00:45:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.191+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c01607a0 con 0x7fc1c00d03c0 2024-08-19T00:45:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.191+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c01514b0 con 0x7fc1c00d03c0 2024-08-19T00:45:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.192+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c009bad0 con 0x7fc1c00d03c0 2024-08-19T00:45:39.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.193+0000 7fc1b7400640 1 -- 172.21.15.7:0/1722039686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1ac044020 con 0x7fc1c00d03c0 2024-08-19T00:45:39.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.195+0000 7fc1b7400640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1a006be30 0x7fc1a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.195+0000 7fc1b7400640 1 -- 172.21.15.7:0/1722039686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fc1ac0abb70 con 0x7fc1c00d03c0 2024-08-19T00:45:39.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.195+0000 7fc1bea00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1a006be30 0x7fc1a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.196+0000 7fc1bea00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1a006be30 0x7fc1a006e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0001780 tx=0x7fc1b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:39.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.199+0000 7fc1b7400640 1 -- 172.21.15.7:0/1722039686 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc1ac04b030 con 0x7fc1c00d03c0 2024-08-19T00:45:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.423+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1c00d0810 con 0x7fc1c00d03c0 2024-08-19T00:45:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.423+0000 7fc1b7400640 1 -- 172.21.15.7:0/1722039686 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 191 v191) ==== 95+0+3570 (secure 0 0 0) 0x7fc1ac0800d0 con 0x7fc1c00d03c0 2024-08-19T00:45:39.425 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:39.425 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":191,"btime":"2024-08-19T00:45:39:018297+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":191,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:39.018238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 191 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1a006be30 msgr2=0x7fc1a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1a006be30 0x7fc1a006e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0001780 tx=0x7fc1b0009040 comp rx=0 tx=0).stop 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00d03c0 msgr2=0x7fc1c0150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00d03c0 0x7fc1c0150f70 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000c00 tx=0x7fc1ac0046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 shutdown_connections 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc1a006be30 0x7fc1a006e2f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c0159bf0 0x7fc1c009c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c00d03c0 0x7fc1c0150f70 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 --2- 172.21.15.7:0/1722039686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c00ce500 0x7fc1c009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 >> 172.21.15.7:0/1722039686 conn(0x7fc1c006bc70 msgr2=0x7fc1c015b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 shutdown_connections 2024-08-19T00:45:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.426+0000 7fc1c5e00640 1 -- 172.21.15.7:0/1722039686 wait complete. 2024-08-19T00:45:39.445 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:39.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:39.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.600+0000 7fb376800640 1 Processor -- start 2024-08-19T00:45:39.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.601+0000 7fb376800640 1 -- start start 2024-08-19T00:45:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb376800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3700ce500 0x7fb3700ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb376800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37006f7f0 con 0x7fb370159bf0 2024-08-19T00:45:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb376800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37006f510 con 0x7fb3700d03c0 2024-08-19T00:45:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb376800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb370072980 con 0x7fb3700ce500 2024-08-19T00:45:39.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb367e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3700ce500 0x7fb3700ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb367e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3700ce500 0x7fb3700ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45710/0 (socket says 172.21.15.7:45710) 2024-08-19T00:45:39.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb367e00640 1 -- 172.21.15.7:0/3288285796 learned_addr learned my addr 172.21.15.7:0/3288285796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:39.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb36f400640 1 --1- 172.21.15.7:0/3288285796 >> v1:172.21.15.7:6789/0 conn(0x7fb370159bf0 0x7fb370073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47748/0 (socket says 172.21.15.7:47748) 2024-08-19T00:45:39.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb367e00640 1 -- 172.21.15.7:0/3288285796 >> v1:172.21.15.162:6789/0 conn(0x7fb3700d03c0 legacy=0x7fb37006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:39.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb367e00640 1 -- 172.21.15.7:0/3288285796 >> v1:172.21.15.7:6789/0 conn(0x7fb370159bf0 legacy=0x7fb370073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.602+0000 7fb367e00640 1 -- 172.21.15.7:0/3288285796 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb370072c60 con 0x7fb3700ce500 2024-08-19T00:45:39.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.603+0000 7fb367e00640 1 --2- 172.21.15.7:0/3288285796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700ce500 0x7fb3700ce970 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb35802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dd8a3e5bcbbdd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:39.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb36ea00640 1 -- 172.21.15.7:0/3288285796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358037070 con 0x7fb3700ce500 2024-08-19T00:45:39.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb36ea00640 1 -- 172.21.15.7:0/3288285796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358032440 con 0x7fb3700ce500 2024-08-19T00:45:39.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb36ea00640 1 -- 172.21.15.7:0/3288285796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358032810 con 0x7fb3700ce500 2024-08-19T00:45:39.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb376800640 1 -- 172.21.15.7:0/3288285796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700ce500 msgr2=0x7fb3700ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb376800640 1 --2- 172.21.15.7:0/3288285796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700ce500 0x7fb3700ce970 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb35802a210 comp rx=0 tx=0).stop 2024-08-19T00:45:39.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb376800640 1 -- 172.21.15.7:0/3288285796 shutdown_connections 2024-08-19T00:45:39.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb376800640 1 --2- 172.21.15.7:0/3288285796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700ce500 0x7fb3700ce970 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb376800640 1 -- 172.21.15.7:0/3288285796 >> 172.21.15.7:0/3288285796 conn(0x7fb37006bc70 msgr2=0x7fb37006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:39.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb376800640 1 -- 172.21.15.7:0/3288285796 shutdown_connections 2024-08-19T00:45:39.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.604+0000 7fb376800640 1 -- 172.21.15.7:0/3288285796 wait complete. 2024-08-19T00:45:39.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.606+0000 7fb376800640 1 Processor -- start 2024-08-19T00:45:39.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.606+0000 7fb376800640 1 -- start start 2024-08-19T00:45:39.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb376800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3700ce500 0x7fb3701f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb376800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700d03c0 0x7fb3701f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb376800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb370159bf0 0x7fb370150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb376800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb370159fd0 con 0x7fb3700d03c0 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb376800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb370073b70 con 0x7fb3700ce500 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb376800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb37015a150 con 0x7fb370159bf0 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb367e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700d03c0 0x7fb3701f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb367e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700d03c0 0x7fb3701f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45716/0 (socket says 172.21.15.7:45716) 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb367e00640 1 -- 172.21.15.7:0/143224378 learned_addr learned my addr 172.21.15.7:0/143224378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb36fe00640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb370159bf0 0x7fb370150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.607+0000 7fb36f400640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3700ce500 0x7fb3701f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367e00640 1 -- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb370159bf0 msgr2=0x7fb370150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367e00640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb370159bf0 0x7fb370150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367e00640 1 -- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3700ce500 msgr2=0x7fb3701f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367e00640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3700ce500 0x7fb3701f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367e00640 1 -- 172.21.15.7:0/143224378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb370151cb0 con 0x7fb3700d03c0 2024-08-19T00:45:39.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367e00640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700d03c0 0x7fb3701f8460 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb3580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:39.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367400640 1 -- 172.21.15.7:0/143224378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358041020 con 0x7fb3700d03c0 2024-08-19T00:45:39.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367400640 1 -- 172.21.15.7:0/143224378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358030970 con 0x7fb3700d03c0 2024-08-19T00:45:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb367400640 1 -- 172.21.15.7:0/143224378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358037040 con 0x7fb3700d03c0 2024-08-19T00:45:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3701f4420 con 0x7fb3700d03c0 2024-08-19T00:45:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.608+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3701519d0 con 0x7fb3700d03c0 2024-08-19T00:45:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.609+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3700cf130 con 0x7fb3700d03c0 2024-08-19T00:45:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.610+0000 7fb367400640 1 -- 172.21.15.7:0/143224378 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb358044020 con 0x7fb3700d03c0 2024-08-19T00:45:39.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.611+0000 7fb367400640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb34c06be30 0x7fb34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:39.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.611+0000 7fb367400640 1 -- 172.21.15.7:0/143224378 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fb3580abb30 con 0x7fb3700d03c0 2024-08-19T00:45:39.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.612+0000 7fb36f400640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb34c06be30 0x7fb34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:39.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.612+0000 7fb36f400640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb34c06be30 0x7fb34c06e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb360000f60 tx=0x7fb360007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:39.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.616+0000 7fb367400640 1 -- 172.21.15.7:0/143224378 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb35804b070 con 0x7fb3700d03c0 2024-08-19T00:45:39.730 INFO:tasks.ceph.mds.c.smithi007.stderr: -36> 2024-08-19T00:45:34.976+0000 7f9907600640 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (22) Invalid argument 2024-08-19T00:45:39.770 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:45:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.839+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb37015bbc0 con 0x7fb3700d03c0 2024-08-19T00:45:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.840+0000 7fb367400640 1 -- 172.21.15.7:0/143224378 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 191 v191) ==== 95+0+3570 (secure 0 0 0) 0x7fb358079ec0 con 0x7fb3700d03c0 2024-08-19T00:45:39.842 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:39.842 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":191,"btime":"2024-08-19T00:45:39:018297+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":191,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:39.018238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:39.842 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 191 2024-08-19T00:45:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb34c06be30 msgr2=0x7fb34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb34c06be30 0x7fb34c06e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb360000f60 tx=0x7fb360007cc0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700d03c0 msgr2=0x7fb3701f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700d03c0 0x7fb3701f8460 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb3580046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 shutdown_connections 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb34c06be30 0x7fb34c06e2f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb370159bf0 0x7fb370150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3700d03c0 0x7fb3701f8460 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 --2- 172.21.15.7:0/143224378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3700ce500 0x7fb3701f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.842+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 >> 172.21.15.7:0/143224378 conn(0x7fb37006bc70 msgr2=0x7fb37015ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.843+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 shutdown_connections 2024-08-19T00:45:39.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:39.843+0000 7fb376800640 1 -- 172.21.15.7:0/143224378 wait complete. 2024-08-19T00:45:39.859 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:39.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:40.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.015+0000 7f820aa00640 1 Processor -- start 2024-08-19T00:45:40.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.015+0000 7f820aa00640 1 -- start start 2024-08-19T00:45:40.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.016+0000 7f820aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f820415e360 0x7f820415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.016+0000 7f820aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f820415ee50 0x7f82040d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.016+0000 7f820aa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82040b3ab0 con 0x7f82040d2af0 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.016+0000 7f820aa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f820415f460 con 0x7f820415ee50 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.016+0000 7f820aa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f820415f740 con 0x7f820415e360 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.016+0000 7f820a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f820415ee50 0x7f82040d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f820a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f820415ee50 0x7f82040d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45740/0 (socket says 172.21.15.7:45740) 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f8208c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f82040d2af0 0x7f820415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47756/0 (socket says 172.21.15.7:47756) 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f820a000640 1 -- 172.21.15.7:0/1593526865 learned_addr learned my addr 172.21.15.7:0/1593526865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f8209600640 1 --2- 172.21.15.7:0/1593526865 >> v2:172.21.15.162:3300/0 conn(0x7f820415e360 0x7f820415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f820a000640 1 -- 172.21.15.7:0/1593526865 >> v2:172.21.15.162:3300/0 conn(0x7f820415e360 msgr2=0x7f820415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f820a000640 1 --2- 172.21.15.7:0/1593526865 >> v2:172.21.15.162:3300/0 conn(0x7f820415e360 0x7f820415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f820a000640 1 -- 172.21.15.7:0/1593526865 >> v1:172.21.15.7:6789/0 conn(0x7f82040d2af0 legacy=0x7f820415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.017+0000 7f820a000640 1 -- 172.21.15.7:0/1593526865 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82040b3d60 con 0x7f820415ee50 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.018+0000 7f820a000640 1 --2- 172.21.15.7:0/1593526865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415ee50 0x7f82040d2f80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f820408e8a0 tx=0x7f81fc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5504ebcb1816677c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.018+0000 7f8203e00640 1 -- 172.21.15.7:0/1593526865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc036070 con 0x7f820415ee50 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.018+0000 7f8203e00640 1 -- 172.21.15.7:0/1593526865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc031600 con 0x7f820415ee50 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.018+0000 7f8203e00640 1 -- 172.21.15.7:0/1593526865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0319d0 con 0x7f820415ee50 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 -- 172.21.15.7:0/1593526865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415ee50 msgr2=0x7f82040d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 --2- 172.21.15.7:0/1593526865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415ee50 0x7f82040d2f80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f820408e8a0 tx=0x7f81fc02a730 comp rx=0 tx=0).stop 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 -- 172.21.15.7:0/1593526865 shutdown_connections 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 --2- 172.21.15.7:0/1593526865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415ee50 0x7f82040d2f80 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 --2- 172.21.15.7:0/1593526865 >> v2:172.21.15.162:3300/0 conn(0x7f820415e360 0x7f820415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 -- 172.21.15.7:0/1593526865 >> 172.21.15.7:0/1593526865 conn(0x7f820408dbf0 msgr2=0x7f820409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:40.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 -- 172.21.15.7:0/1593526865 shutdown_connections 2024-08-19T00:45:40.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.019+0000 7f820aa00640 1 -- 172.21.15.7:0/1593526865 wait complete. 2024-08-19T00:45:40.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.021+0000 7f820aa00640 1 Processor -- start 2024-08-19T00:45:40.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.021+0000 7f820aa00640 1 -- start start 2024-08-19T00:45:40.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f820aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82040d2af0 0x7f820415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f820aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415e360 0x7f82040b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f820aa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f820415ee50 0x7f82040b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f820aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82040b4560 con 0x7f820415e360 2024-08-19T00:45:40.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f820aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82040d2300 con 0x7f82040d2af0 2024-08-19T00:45:40.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f820aa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82040b46e0 con 0x7f820415ee50 2024-08-19T00:45:40.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f8208c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415e360 0x7f82040b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f8208c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415e360 0x7f82040b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45744/0 (socket says 172.21.15.7:45744) 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f8208c00640 1 -- 172.21.15.7:0/1324173143 learned_addr learned my addr 172.21.15.7:0/1324173143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f8209600640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82040d2af0 0x7f820415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.022+0000 7f820a000640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f820415ee50 0x7f82040b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8208c00640 1 -- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f820415ee50 msgr2=0x7f82040b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8208c00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f820415ee50 0x7f82040b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8208c00640 1 -- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82040d2af0 msgr2=0x7f820415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8208c00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82040d2af0 0x7f820415d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8208c00640 1 -- 172.21.15.7:0/1324173143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82040b1b30 con 0x7f820415e360 2024-08-19T00:45:40.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8208c00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415e360 0x7f82040b7030 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c400 tx=0x7f81f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:40.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8201600640 1 -- 172.21.15.7:0/1324173143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00074e0 con 0x7f820415e360 2024-08-19T00:45:40.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8201600640 1 -- 172.21.15.7:0/1324173143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f0007680 con 0x7f820415e360 2024-08-19T00:45:40.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f8201600640 1 -- 172.21.15.7:0/1324173143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0004a00 con 0x7f820415e360 2024-08-19T00:45:40.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.023+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82040b1e10 con 0x7f820415e360 2024-08-19T00:45:40.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.024+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82040b23d0 con 0x7f820415e360 2024-08-19T00:45:40.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.025+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820414b2c0 con 0x7f820415e360 2024-08-19T00:45:40.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.026+0000 7f8201600640 1 -- 172.21.15.7:0/1324173143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81f001a020 con 0x7f820415e360 2024-08-19T00:45:40.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.027+0000 7f8201600640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81e406be30 0x7f81e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.027+0000 7f8201600640 1 -- 172.21.15.7:0/1324173143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7f81f008abd0 con 0x7f820415e360 2024-08-19T00:45:40.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.027+0000 7f8209600640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81e406be30 0x7f81e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.028+0000 7f8209600640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81e406be30 0x7f81e406e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009b40 tx=0x7f81f8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:40.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.031+0000 7f8201600640 1 -- 172.21.15.7:0/1324173143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f820414b2c0 con 0x7f820415e360 2024-08-19T00:45:40.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.249+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f820415fab0 con 0x7f820415e360 2024-08-19T00:45:40.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.250+0000 7f8201600640 1 -- 172.21.15.7:0/1324173143 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 192 v192) ==== 95+0+4393 (secure 0 0 0) 0x7f81f0058890 con 0x7f820415e360 2024-08-19T00:45:40.252 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:40.252 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":192,"btime":"2024-08-19T00:45:40:019771+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3399848835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3399848835},{"type":"v1","addr":"172.21.15.7:6836","nonce":3399848835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":192}],"filesystems":[{"mdsmap":{"epoch":191,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:39.018238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:40.252 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 192 2024-08-19T00:45:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81e406be30 msgr2=0x7f81e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81e406be30 0x7f81e406e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009b40 tx=0x7f81f8009190 comp rx=0 tx=0).stop 2024-08-19T00:45:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415e360 msgr2=0x7f82040b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415e360 0x7f82040b7030 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c400 tx=0x7f81f000c8c0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 shutdown_connections 2024-08-19T00:45:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81e406be30 0x7f81e406e2f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f820415ee50 0x7f82040b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f820415e360 0x7f82040b7030 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 --2- 172.21.15.7:0/1324173143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82040d2af0 0x7f820415d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 >> 172.21.15.7:0/1324173143 conn(0x7f820408dbf0 msgr2=0x7f8204074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 shutdown_connections 2024-08-19T00:45:40.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.252+0000 7f820aa00640 1 -- 172.21.15.7:0/1324173143 wait complete. 2024-08-19T00:45:40.270 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 200.00000001' led to DAMAGED state 2024-08-19T00:45:40.270 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 500.00000000' 2024-08-19T00:45:40.270 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:40.270 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:40.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:45:40.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:40.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:40.305 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:45:40.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:40.381 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:40.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.578+0000 7fe90e200640 1 Processor -- start 2024-08-19T00:45:40.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.578+0000 7fe90e200640 1 -- start start 2024-08-19T00:45:40.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.579+0000 7fe90e200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.579+0000 7fe90e200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9080cdfb0 con 0x7fe9080b3750 2024-08-19T00:45:40.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.579+0000 7fe90e200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9080ce290 con 0x7fe90806e710 2024-08-19T00:45:40.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.579+0000 7fe90e200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9080cebc0 con 0x7fe9080d03c0 2024-08-19T00:45:40.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.579+0000 7fe907e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe9080b3750 0x7fe9080cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47770/0 (socket says 172.21.15.7:47770) 2024-08-19T00:45:40.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.579+0000 7fe907e00640 1 -- 172.21.15.7:0/2248431380 learned_addr learned my addr 172.21.15.7:0/2248431380 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe907400640 1 --2- 172.21.15.7:0/2248431380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe906a00640 1 -- 172.21.15.7:0/2248431380 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688627191 0 0) 0x7fe9080cdfb0 con 0x7fe9080b3750 2024-08-19T00:45:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe906a00640 1 -- 172.21.15.7:0/2248431380 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ec003520 con 0x7fe9080b3750 2024-08-19T00:45:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe906a00640 1 -- 172.21.15.7:0/2248431380 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621835091 0 0) 0x7fe9080ce290 con 0x7fe90806e710 2024-08-19T00:45:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe906a00640 1 -- 172.21.15.7:0/2248431380 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9080cdfb0 con 0x7fe90806e710 2024-08-19T00:45:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe907400640 1 -- 172.21.15.7:0/2248431380 >> v1:172.21.15.162:6789/0 conn(0x7fe90806e710 legacy=0x7fe9080d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe907400640 1 -- 172.21.15.7:0/2248431380 >> v1:172.21.15.7:6789/0 conn(0x7fe9080b3750 legacy=0x7fe9080cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.580+0000 7fe907400640 1 -- 172.21.15.7:0/2248431380 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9080ce570 con 0x7fe9080d03c0 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.581+0000 7fe907400640 1 --2- 172.21.15.7:0/2248431380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908071980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80097d0 tx=0x7fe8f802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6754c33d3e6a58de server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe906a00640 1 -- 172.21.15.7:0/2248431380 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8037070 con 0x7fe9080d03c0 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe906a00640 1 -- 172.21.15.7:0/2248431380 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f8032440 con 0x7fe9080d03c0 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe906a00640 1 -- 172.21.15.7:0/2248431380 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8032810 con 0x7fe9080d03c0 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe90e200640 1 -- 172.21.15.7:0/2248431380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 msgr2=0x7fe908071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe90e200640 1 --2- 172.21.15.7:0/2248431380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908071980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80097d0 tx=0x7fe8f802a200 comp rx=0 tx=0).stop 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe90e200640 1 -- 172.21.15.7:0/2248431380 shutdown_connections 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe90e200640 1 --2- 172.21.15.7:0/2248431380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908071980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe90e200640 1 -- 172.21.15.7:0/2248431380 >> 172.21.15.7:0/2248431380 conn(0x7fe90806bc70 msgr2=0x7fe90806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe90e200640 1 -- 172.21.15.7:0/2248431380 shutdown_connections 2024-08-19T00:45:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.582+0000 7fe90e200640 1 -- 172.21.15.7:0/2248431380 wait complete. 2024-08-19T00:45:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.584+0000 7fe90e200640 1 Processor -- start 2024-08-19T00:45:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.584+0000 7fe90e200640 1 -- start start 2024-08-19T00:45:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe90e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe90806e710 0x7fe908158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe90e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9080b3750 0x7fe9081f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe90e200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe90e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe908073c60 con 0x7fe90806e710 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe90e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe908073ae0 con 0x7fe9080b3750 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe90e200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9080b3be0 con 0x7fe9080d03c0 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe907400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe90806e710 0x7fe908158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe907400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe90806e710 0x7fe908158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45754/0 (socket says 172.21.15.7:45754) 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe907400640 1 -- 172.21.15.7:0/1588812951 learned_addr learned my addr 172.21.15.7:0/1588812951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe907e00640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.585+0000 7fe8ffe00640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9080b3750 0x7fe9081f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe907400640 1 -- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 msgr2=0x7fe908154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe907400640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe907400640 1 -- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9080b3750 msgr2=0x7fe9081f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe907400640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9080b3750 0x7fe9081f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe907400640 1 -- 172.21.15.7:0/1588812951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90809daf0 con 0x7fe90806e710 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe907e00640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe907400640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe90806e710 0x7fe908158360 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8035040 tx=0x7fe8f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe8ff400640 1 -- 172.21.15.7:0/1588812951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8041020 con 0x7fe90806e710 2024-08-19T00:45:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe8ff400640 1 -- 172.21.15.7:0/1588812951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f803d720 con 0x7fe90806e710 2024-08-19T00:45:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe8ff400640 1 -- 172.21.15.7:0/1588812951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8037040 con 0x7fe90806e710 2024-08-19T00:45:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081578a0 con 0x7fe90806e710 2024-08-19T00:45:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.586+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90809e050 con 0x7fe90806e710 2024-08-19T00:45:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.587+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9080ce290 con 0x7fe90806e710 2024-08-19T00:45:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.588+0000 7fe8ff400640 1 -- 172.21.15.7:0/1588812951 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8f8044020 con 0x7fe90806e710 2024-08-19T00:45:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.589+0000 7fe8ff400640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe8e406be30 0x7fe8e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.589+0000 7fe8ff400640 1 -- 172.21.15.7:0/1588812951 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fe8f80abbb0 con 0x7fe90806e710 2024-08-19T00:45:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.589+0000 7fe8ffe00640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe8e406be30 0x7fe8e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.590+0000 7fe8ffe00640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe8e406be30 0x7fe8e406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe908157630 tx=0x7fe8f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.593+0000 7fe8ff400640 1 -- 172.21.15.7:0/1588812951 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe8f804b030 con 0x7fe90806e710 2024-08-19T00:45:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:40.813+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe9080ad5b0 con 0x7fe90806e710 2024-08-19T00:45:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.027+0000 7fe8ff400640 1 -- 172.21.15.7:0/1588812951 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v193) ==== 161+0+0 (secure 0 0 0) 0x7fe90809daf0 con 0x7fe90806e710 2024-08-19T00:45:41.029 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe8e406be30 msgr2=0x7fe8e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe8e406be30 0x7fe8e406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe908157630 tx=0x7fe8f0009040 comp rx=0 tx=0).stop 2024-08-19T00:45:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe90806e710 msgr2=0x7fe908158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe90806e710 0x7fe908158360 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8035040 tx=0x7fe8f80046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 shutdown_connections 2024-08-19T00:45:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe8e406be30 0x7fe8e406e2f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9080d03c0 0x7fe908154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9080b3750 0x7fe9081f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 --2- 172.21.15.7:0/1588812951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe90806e710 0x7fe908158360 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 >> 172.21.15.7:0/1588812951 conn(0x7fe90806bc70 msgr2=0x7fe90806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 shutdown_connections 2024-08-19T00:45:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.029+0000 7fe90e200640 1 -- 172.21.15.7:0/1588812951 wait complete. 2024-08-19T00:45:41.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:41.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.206+0000 7f43c1200640 1 Processor -- start 2024-08-19T00:45:41.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.206+0000 7f43c1200640 1 -- start start 2024-08-19T00:45:41.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.207+0000 7f43c1200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f43bc140640 0x7f43bc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.207+0000 7f43c1200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43bc15e930 con 0x7f43bc13dc30 2024-08-19T00:45:41.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.207+0000 7f43c1200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43bc15ec10 con 0x7f43bc06db40 2024-08-19T00:45:41.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.207+0000 7f43c1200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f43bc1413f0 con 0x7f43bc140640 2024-08-19T00:45:41.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.207+0000 7f43bb400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f43bc13dc30 0x7f43bc140ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47780/0 (socket says 172.21.15.7:47780) 2024-08-19T00:45:41.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.207+0000 7f43bb400640 1 -- 172.21.15.7:0/2300922854 learned_addr learned my addr 172.21.15.7:0/2300922854 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741621205 0 0) 0x7f43bc15e930 con 0x7f43bc13dc30 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43a0003520 con 0x7f43bc13dc30 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43b3e00640 1 --2- 172.21.15.7:0/2300922854 >> v2:172.21.15.162:3300/0 conn(0x7f43bc140640 0x7f43bc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1499988421 0 0) 0x7f43a0003520 con 0x7f43bc13dc30 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 >> v2:172.21.15.162:3300/0 conn(0x7f43bc140640 msgr2=0x7f43bc06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 --2- 172.21.15.7:0/2300922854 >> v2:172.21.15.162:3300/0 conn(0x7f43bc140640 0x7f43bc06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 >> v1:172.21.15.162:6789/0 conn(0x7f43bc06db40 legacy=0x7f43bc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc15eef0 con 0x7f43bc13dc30 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f43ac001670 con 0x7f43bc13dc30 2024-08-19T00:45:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 >> v1:172.21.15.7:6789/0 conn(0x7f43bc13dc30 legacy=0x7f43bc140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43a0004800 0x7f43a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43a00051c0 0x7f43a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc1413f0 con 0x7f43a0003a00 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43a000c0c0 con 0x7f43a00051c0 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f43a000e4d0 con 0x7f43a0004800 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.208+0000 7f43bb400640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.209+0000 7f43bb400640 1 -- 172.21.15.7:0/2300922854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43a0004800 msgr2=0x7f43a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.209+0000 7f43bb400640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43a0004800 0x7f43a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.209+0000 7f43bb400640 1 -- 172.21.15.7:0/2300922854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43a00051c0 msgr2=0x7f43a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.209+0000 7f43bb400640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43a00051c0 0x7f43a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.209+0000 7f43bb400640 1 -- 172.21.15.7:0/2300922854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a0003520 con 0x7f43a0003a00 2024-08-19T00:45:41.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.209+0000 7f43bbe00640 1 -- 172.21.15.7:0/2300922854 reap_dead start 2024-08-19T00:45:41.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.210+0000 7f43bb400640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43a0003e20 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c110 tx=0x7f43a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8584e4fb999937b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.210+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac007c40 con 0x7f43a0003a00 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.210+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac005af0 con 0x7f43a0003a00 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.210+0000 7f43baa00640 1 -- 172.21.15.7:0/2300922854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac007070 con 0x7f43a0003a00 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.211+0000 7f43c1200640 1 -- 172.21.15.7:0/2300922854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 msgr2=0x7f43a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.211+0000 7f43c1200640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43a0003e20 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c110 tx=0x7f43a0005830 comp rx=0 tx=0).stop 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.211+0000 7f43c1200640 1 -- 172.21.15.7:0/2300922854 shutdown_connections 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.211+0000 7f43c1200640 1 --2- 172.21.15.7:0/2300922854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43a0003e20 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.211+0000 7f43c1200640 1 -- 172.21.15.7:0/2300922854 >> 172.21.15.7:0/2300922854 conn(0x7f43bc06b850 msgr2=0x7f43bc06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.211+0000 7f43c1200640 1 -- 172.21.15.7:0/2300922854 shutdown_connections 2024-08-19T00:45:41.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.211+0000 7f43c1200640 1 -- 172.21.15.7:0/2300922854 wait complete. 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.213+0000 7f43c1200640 1 Processor -- start 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.213+0000 7f43c1200640 1 -- start start 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43c1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43bc13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43c1200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43bc072990 0x7f43bc072e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43c1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43bc13ee70 0x7f43bc13f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43c1200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc13e010 con 0x7f43a0003a00 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43c1200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc15f4b0 con 0x7f43bc13ee70 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43c1200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc13e190 con 0x7f43bc072990 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43bc13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43bc13b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45772/0 (socket says 172.21.15.7:45772) 2024-08-19T00:45:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 -- 172.21.15.7:0/4147595703 learned_addr learned my addr 172.21.15.7:0/4147595703 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43b3e00640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43bc072990 0x7f43bc072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bbe00640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43bc13ee70 0x7f43bc13f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 -- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43bc072990 msgr2=0x7f43bc072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43bc072990 0x7f43bc072e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 -- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43bc13ee70 msgr2=0x7f43bc13f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43bc13ee70 0x7f43bc13f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.214+0000 7f43bb400640 1 -- 172.21.15.7:0/4147595703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc13fba0 con 0x7f43a0003a00 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.215+0000 7f43bb400640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43bc13b7e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c200 tx=0x7f43bc15ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.215+0000 7f43b3400640 1 -- 172.21.15.7:0/4147595703 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac042070 con 0x7f43a0003a00 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.215+0000 7f43b3400640 1 -- 172.21.15.7:0/4147595703 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac0047e0 con 0x7f43a0003a00 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.215+0000 7f43b3400640 1 -- 172.21.15.7:0/4147595703 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac037040 con 0x7f43a0003a00 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.215+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43bc13fe80 con 0x7f43a0003a00 2024-08-19T00:45:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.215+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43bc150a60 con 0x7f43a0003a00 2024-08-19T00:45:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.216+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43bc06d690 con 0x7f43a0003a00 2024-08-19T00:45:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.217+0000 7f43b3400640 1 -- 172.21.15.7:0/4147595703 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43ac045070 con 0x7f43a0003a00 2024-08-19T00:45:41.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.218+0000 7f43b3400640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:41.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.218+0000 7f43b3400640 1 -- 172.21.15.7:0/4147595703 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7f43ac0aad00 con 0x7f43a0003a00 2024-08-19T00:45:41.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.218+0000 7f43b3e00640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:41.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.219+0000 7f43b3e00640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f43bc152e10 tx=0x7f43a4009320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:41.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.223+0000 7f43b3400640 1 -- 172.21.15.7:0/4147595703 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f43ac078920 con 0x7f43a0003a00 2024-08-19T00:45:41.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:41.480+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f43bc06c040 con 0x7f43a0003a00 2024-08-19T00:45:42.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.032+0000 7f43b3400640 1 -- 172.21.15.7:0/4147595703 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v194) ==== 101+0+0 (secure 0 0 0) 0x7f43ac07cc20 con 0x7f43a0003a00 2024-08-19T00:45:42.034 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:45:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.035+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f439806be30 msgr2=0x7f439806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.035+0000 7f43c1200640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f43bc152e10 tx=0x7f43a4009320 comp rx=0 tx=0).stop 2024-08-19T00:45:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.035+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 msgr2=0x7f43bc13b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.035+0000 7f43c1200640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43bc13b7e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c200 tx=0x7f43bc15ede0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 shutdown_connections 2024-08-19T00:45:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43bc13ee70 0x7f43bc13f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43bc072990 0x7f43bc072e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 --2- 172.21.15.7:0/4147595703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a0003a00 0x7f43bc13b7e0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 >> 172.21.15.7:0/4147595703 conn(0x7f43bc06b850 msgr2=0x7f43bc15cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 shutdown_connections 2024-08-19T00:45:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.036+0000 7f43c1200640 1 -- 172.21.15.7:0/4147595703 wait complete. 2024-08-19T00:45:42.055 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.130+0000 7fe32d249f40 1 Processor -- start 2024-08-19T00:45:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.130+0000 7fe32d249f40 1 -- start start 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.131+0000 7fe32d249f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc54700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.131+0000 7fe32d249f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc5a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.131+0000 7fe32d249f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dcf09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.131+0000 7fe32d249f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56466dbbc8c0 con 0x56466dbbd990 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.131+0000 7fe32d249f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56466db31d00 con 0x56466dbbbf40 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.131+0000 7fe32d249f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56466dc62dc0 con 0x56466dbbd5b0 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.131+0000 7fe32ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dcf09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dcf09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45794/0 (socket says 172.21.15.7:45794) 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 -- 172.21.15.7:0/2435309564 learned_addr learned my addr 172.21.15.7:0/2435309564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32a400640 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc54700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe329a00640 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc5a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 -- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 msgr2=0x56466dc5a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc5a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 -- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 msgr2=0x56466dc54700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc54700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 -- 172.21.15.7:0/2435309564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466dab6b30 con 0x56466dbbd990 2024-08-19T00:45:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.132+0000 7fe32ae00640 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dcf09f0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe32400a4b0 tx=0x7fe324050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ef185712934c49 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe323e00640 1 -- 172.21.15.7:0/2435309564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324055040 con 0x56466dbbd990 2024-08-19T00:45:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe323e00640 1 -- 172.21.15.7:0/2435309564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe324051c00 con 0x56466dbbd990 2024-08-19T00:45:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe323e00640 1 -- 172.21.15.7:0/2435309564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32405c440 con 0x56466dbbd990 2024-08-19T00:45:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 -- 172.21.15.7:0/2435309564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 msgr2=0x56466dcf09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dcf09f0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe32400a4b0 tx=0x7fe324050000 comp rx=0 tx=0).stop 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 -- 172.21.15.7:0/2435309564 shutdown_connections 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dcf09f0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc5a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 --2- 172.21.15.7:0/2435309564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc54700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 -- 172.21.15.7:0/2435309564 >> 172.21.15.7:0/2435309564 conn(0x56466dbba4e0 msgr2=0x56466dbba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 -- 172.21.15.7:0/2435309564 shutdown_connections 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.133+0000 7fe32d249f40 1 -- 172.21.15.7:0/2435309564 wait complete. 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.134+0000 7fe32d249f40 1 Processor -- start 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.134+0000 7fe32d249f40 1 -- start start 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32d249f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc51390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32d249f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc56b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32d249f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dbd6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32d249f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56466dc63aa0 con 0x56466dbbd990 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32d249f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56466dc5bf60 con 0x56466dbbbf40 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32d249f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56466dc63f30 con 0x56466dbbd5b0 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dbd6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dbd6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45804/0 (socket says 172.21.15.7:45804) 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 learned_addr learned my addr 172.21.15.7:0/3414885200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.135+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc56b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc51390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 msgr2=0x56466dc56b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32ae00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc56b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 msgr2=0x56466dc51390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32ae00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc51390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466daf3080 con 0x56466dbbd990 2024-08-19T00:45:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56466dbbd5b0 0x56466dc56b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56466dbbbf40 0x56466dc51390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32ae00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dbd6940 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe324025960 tx=0x7fe324003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe322a00640 1 -- 172.21.15.7:0/3414885200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324055050 con 0x56466dbbd990 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe322a00640 1 -- 172.21.15.7:0/3414885200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3240519e0 con 0x56466dbbd990 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe322a00640 1 -- 172.21.15.7:0/3414885200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32405ca40 con 0x56466dbbd990 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56466dc54060 con 0x56466dbbd990 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.136+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466dc56370 con 0x56466dbbd990 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.138+0000 7fe322a00640 1 -- 172.21.15.7:0/3414885200 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe324058020 con 0x56466dbbd990 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.139+0000 7fe322a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe30c06a810 0x7fe30c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.139+0000 7fe322a00640 1 -- 172.21.15.7:0/3414885200 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fe3240cf6d0 con 0x56466dbbd990 2024-08-19T00:45:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.139+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe30c06a810 0x7fe30c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.142 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:42.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.139+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56466dc5ce20 0x56466dc5d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.139+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dc5d770 con 0x56466dc5ce20 2024-08-19T00:45:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.140+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe30c06a810 0x7fe30c06ccd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe31c002fd0 tx=0x7fe31c001790 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.140+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56466dc5ce20 0x56466dc5d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.141+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56466dc5ce20 0x56466dc5d230 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.143+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v104'536 uv510 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.143+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd04e90 con 0x56466dc5ce20 2024-08-19T00:45:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.144+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v104'537 uv537 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.144+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05230 con 0x56466dc5ce20 2024-08-19T00:45:42.147 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.145+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v104'538 uv538 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.145+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd065e0 con 0x56466dc5ce20 2024-08-19T00:45:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.147+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v104'539 uv539 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.147+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd06980 con 0x56466dc5ce20 2024-08-19T00:45:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.148+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v104'540 uv540 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.148+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd055d0 con 0x56466dc5ce20 2024-08-19T00:45:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.150+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v104'541 uv541 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.150+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05970 con 0x56466dc5ce20 2024-08-19T00:45:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.152+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v104'542 uv516 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.152+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.153+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v104'543 uv543 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.153+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.156 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.155+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v104'544 uv544 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.155+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.156+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v104'545 uv545 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.156+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.158+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v104'546 uv546 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.158+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.159+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v104'547 uv547 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.160+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.161+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v104'548 uv523 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.161+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.163+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v104'549 uv549 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.163+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.165 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:42.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.164+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v104'550 uv550 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.164+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.166+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v104'551 uv551 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.166+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.167+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v104'552 uv552 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.167+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05d10 con 0x56466dc5ce20 2024-08-19T00:45:42.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.169+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v104'553 uv553 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.169+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd06140 con 0x56466dc5ce20 2024-08-19T00:45:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.171+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v104'554 uv554 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.171+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.172+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v104'555 uv529 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.172+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.174+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v104'556 uv556 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.174+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.177 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.175+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v104'557 uv557 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.175+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.177+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v104'558 uv558 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.177+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.178+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v104'559 uv559 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.178+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.179+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v104'560 uv560 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.180+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.181+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v104'561 uv535 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.181+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.183+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v104'562 uv562 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.183+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.186 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.185+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v104'563 uv563 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.185+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd060f0 con 0x56466dc5ce20 2024-08-19T00:45:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.186+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v104'564 uv564 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.186+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05fd0 con 0x56466dc5ce20 2024-08-19T00:45:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.187+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v104'565 uv565 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.187+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05fd0 con 0x56466dc5ce20 2024-08-19T00:45:42.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.189+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v104'566 uv566 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.189+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56466dd07230 0x56466dd09620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.189+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd05fd0 con 0x56466dd07230 2024-08-19T00:45:42.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.190+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56466dd07230 0x56466dd09620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.190+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56466dd07230 0x56466dd09620 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.192+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v104'396 uv378 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.192+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd09b60 con 0x56466dd07230 2024-08-19T00:45:42.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.193+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v104'397 uv397 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.193+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd09f00 con 0x56466dd07230 2024-08-19T00:45:42.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.195+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v104'398 uv398 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.196 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.195+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0a750 con 0x56466dd07230 2024-08-19T00:45:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.196+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v104'399 uv399 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.196+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0aaf0 con 0x56466dd07230 2024-08-19T00:45:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.198+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v104'400 uv400 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.198+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0ae90 con 0x56466dd07230 2024-08-19T00:45:42.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.199+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v104'401 uv383 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.199+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b230 con 0x56466dd07230 2024-08-19T00:45:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.200+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v104'402 uv402 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.201+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.202+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v104'403 uv403 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.203 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:42.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.202+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.203+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v104'404 uv404 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.203+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.205+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v104'405 uv405 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.205+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.206+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v104'406 uv395 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.206+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.207+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v104'407 uv407 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.207+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.210 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:42.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.209+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v104'408 uv408 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.209+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0fcc0 con 0x56466dd07230 2024-08-19T00:45:42.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.210+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v104'409 uv409 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.210+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0fcc0 con 0x56466dd07230 2024-08-19T00:45:42.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.212+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v104'410 uv410 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.212+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.213+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v104'411 uv394 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.213+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.215+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v104'412 uv412 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.215+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.217 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:42.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.216+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v104'413 uv413 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.216+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0c5e0 con 0x56466dd07230 2024-08-19T00:45:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.218+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v104'414 uv414 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.218+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0c5e0 con 0x56466dd07230 2024-08-19T00:45:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.219+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v104'415 uv415 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.219+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0b5d0 con 0x56466dd07230 2024-08-19T00:45:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.220+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v104'416 uv416 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd07230 2024-08-19T00:45:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.220+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56466dd0bae0 0x56466dd0ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.221+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dd0bae0 2024-08-19T00:45:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.221+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56466dd0bae0 0x56466dd0ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.221+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56466dd0bae0 0x56466dd0ded0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.223+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v104'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.223+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dd0bae0 2024-08-19T00:45:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.224+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v104'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.224+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dd0bae0 2024-08-19T00:45:42.227 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.225+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v104'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.225+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0f420 con 0x56466dd0bae0 2024-08-19T00:45:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.226+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v104'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.227+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0f420 con 0x56466dd0bae0 2024-08-19T00:45:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.228+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v104'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.228+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dd0bae0 2024-08-19T00:45:42.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.229+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v104'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.229+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dc5ce20 2024-08-19T00:45:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.231+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v104'80 uv79 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.231+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dc5ce20 2024-08-19T00:45:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.232+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v104'81 uv81 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.232+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dc5ce20 2024-08-19T00:45:42.234 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.233+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v104'82 uv82 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.233+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd0e410 con 0x56466dc5ce20 2024-08-19T00:45:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.234+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v104'83 uv83 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.234+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56466dd0e920 0x56466dd10d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.234+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd11320 con 0x56466dd0e920 2024-08-19T00:45:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.235+0000 7fe32ae00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56466dd0e920 0x56466dd10d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.235+0000 7fe32ae00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56466dd0e920 0x56466dd10d10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.237+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v104'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.237+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd117c0 con 0x56466dd0e920 2024-08-19T00:45:42.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.238+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v104'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.238+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd11ca0 con 0x56466dd0e920 2024-08-19T00:45:42.243 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.239+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v104'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.239+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd13550 con 0x56466dd0e920 2024-08-19T00:45:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.241+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v104'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.241+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd138f0 con 0x56466dd0e920 2024-08-19T00:45:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.242+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v104'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.242+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd12540 con 0x56466dd0e920 2024-08-19T00:45:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.243+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v104'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.244+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56466dd12e40 0x56466dd15ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.244+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd161e0 con 0x56466dd12e40 2024-08-19T00:45:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.244+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56466dd12e40 0x56466dd15ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.244+0000 7fe32a400640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56466dd12e40 0x56466dd15ca0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.246+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v104'193 uv187 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.246+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd161e0 con 0x56466dd12e40 2024-08-19T00:45:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.247+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v104'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.247+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd161e0 con 0x56466dd12e40 2024-08-19T00:45:42.250 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.249+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v104'195 uv195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.249+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd17610 con 0x56466dd12e40 2024-08-19T00:45:42.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.250+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v104'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.250+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd17610 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.251+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v104'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.251+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd16600 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.252+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v104'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.253+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd16600 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.254+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v104'199 uv192 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.254+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd16600 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.255+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v104'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.255+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd16600 con 0x56466dd12e40 2024-08-19T00:45:42.397 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.256+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v104'201 uv201 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.256+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd16600 con 0x56466dd12e40 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.258+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v104'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.258+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd16600 con 0x56466dd12e40 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.259+0000 7fe32a400640 1 -- 172.21.15.7:0/3414885200 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v104'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe31c00e040 con 0x56466dd12e40 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.259+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56466dd16b10 0x56466dd18f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.259+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd19560 con 0x56466dd16b10 2024-08-19T00:45:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.259+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56466dd16b10 0x56466dd18f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.260+0000 7fe329a00640 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56466dd16b10 0x56466dd18f00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.261+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v104'86 uv85 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.261+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd19560 con 0x56466dd16b10 2024-08-19T00:45:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.263+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v104'87 uv87 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.263+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd16b10 2024-08-19T00:45:42.400 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:42.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.264+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v104'88 uv88 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.264+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd16b10 2024-08-19T00:45:42.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.265+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v104'89 uv89 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.265+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd16b10 2024-08-19T00:45:42.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.267+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v104'90 uv90 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.267+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dc5ce20 2024-08-19T00:45:42.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.268+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v104'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.268+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dc5ce20 2024-08-19T00:45:42.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.269+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v104'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.269+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dc5ce20 2024-08-19T00:45:42.402 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:42.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.271+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v104'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.271+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1a9c0 con 0x56466dc5ce20 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.272+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v104'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.272+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1a9c0 con 0x56466dc5ce20 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.274+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v104'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.274+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dc5ce20 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.275+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v104'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dc5ce20 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.275+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.276+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v104'172 uv166 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.276+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.278+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v104'173 uv173 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.278+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.405 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.279+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v104'174 uv174 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.279+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.281+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v104'175 uv175 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.281+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.282+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v104'176 uv176 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.282+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.284+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v104'177 uv171 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.284+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.285+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v104'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.285+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.406 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.287+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v104'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.287+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd199b0 con 0x56466dd0bae0 2024-08-19T00:45:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.288+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v104'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.288+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c760 con 0x56466dd0bae0 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.289+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v104'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd0bae0 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.289+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.291+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v104'78 uv77 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.291+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.292+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v104'79 uv79 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.292+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.408 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.293+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v104'80 uv80 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.293+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.295+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v104'81 uv81 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.295+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.296+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v104'105 uv104 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.296+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.298+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v104'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.298+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.410 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.299+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v104'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.299+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.301+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v104'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.301+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.302+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v104'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.302+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd0e920 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.304+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v104'110 uv110 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe324076020 con 0x56466dd0e920 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.304+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.305+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v104'89 uv88 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.305+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.307+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v104'90 uv90 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.307+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.308+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v104'91 uv91 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.412 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.308+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.309+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v104'92 uv92 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.309+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.311+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v104'93 uv93 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.311+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.312+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v104'216 uv208 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.312+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.313+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v104'217 uv217 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.313+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.315+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v104'218 uv218 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.414 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.315+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.316+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v104'219 uv219 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.316+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.317+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v104'220 uv220 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.317+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.318+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v104'221 uv215 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.318+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.320+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v104'222 uv222 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.320+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.321+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v104'223 uv223 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.416 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.321+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.322+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v104'224 uv224 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.322+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.323+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v104'225 uv225 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.323+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1c720 con 0x56466dd16b10 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.325+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v104'226 uv226 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.325+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x56466dd1a150 con 0x56466dd16b10 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe329a00640 1 -- 172.21.15.7:0/3414885200 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v104'227 uv227 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fe3180097d0 con 0x56466dd16b10 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56466dd07230 msgr2=0x56466dd09620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56466dd07230 0x56466dd09620 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56466dd12e40 msgr2=0x56466dd15ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56466dd12e40 0x56466dd15ca0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56466dd16b10 msgr2=0x56466dd18f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56466dd16b10 0x56466dd18f00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56466dd0bae0 msgr2=0x56466dd0ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56466dd0bae0 0x56466dd0ded0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 reap_dead start 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56466dc5ce20 msgr2=0x56466dc5d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56466dc5ce20 0x56466dc5d230 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56466dd0e920 msgr2=0x56466dd10d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32ae00640 1 -- 172.21.15.7:0/3414885200 reap_dead start 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56466dd0e920 0x56466dd10d10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe30c06a810 msgr2=0x7fe30c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe30c06a810 0x7fe30c06ccd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe31c002fd0 tx=0x7fe31c001790 comp rx=0 tx=0).stop 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 msgr2=0x56466dbd6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dbd6940 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe324025960 tx=0x7fe324003330 comp rx=0 tx=0).stop 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 shutdown_connections 2024-08-19T00:45:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.326+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe30c06a810 0x7fe30c06ccd0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.327+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56466dbbd990 0x56466dbd6940 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.327+0000 7fe32d249f40 1 --2- 172.21.15.7:0/3414885200 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56466dd0e920 0x56466dd10d10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.327+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 >> 172.21.15.7:0/3414885200 conn(0x56466dbba4e0 msgr2=0x56466dbba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.327+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 shutdown_connections 2024-08-19T00:45:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.327+0000 7fe32d249f40 1 -- 172.21.15.7:0/3414885200 wait complete. 2024-08-19T00:45:42.422 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 500.00000000 - 2024-08-19T00:45:42.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.534+0000 7f8bfeddbf40 1 Processor -- start 2024-08-19T00:45:42.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.534+0000 7f8bfeddbf40 1 -- start start 2024-08-19T00:45:42.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.535+0000 7f8bfeddbf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a35b0 0x558875a3abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.535+0000 7f8bfeddbf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a3990 0x558875a3f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.535+0000 7f8bfeddbf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.535+0000 7f8bfeddbf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558875a48dc0 con 0x5588759bb8d0 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.535+0000 7f8bfeddbf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558875917d00 con 0x5588759a3990 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.535+0000 7f8bfeddbf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558875a490a0 con 0x5588759a35b0 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45812/0 (socket says 172.21.15.7:45812) 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 -- 172.21.15.7:0/3009794756 learned_addr learned my addr 172.21.15.7:0/3009794756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfc000640 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a35b0 0x558875a3abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfb600640 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a3990 0x558875a3f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 -- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a35b0 msgr2=0x558875a3abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:42.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a35b0 0x558875a3abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 -- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a3990 msgr2=0x558875a3f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:42.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a3990 0x558875a3f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 -- 172.21.15.7:0/3009794756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887589cb30 con 0x5588759bb8d0 2024-08-19T00:45:42.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.536+0000 7f8bfca00640 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001530 tx=0x7f8bf40019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86af90a6c5f167b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfa200640 1 -- 172.21.15.7:0/3009794756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4013620 con 0x5588759bb8d0 2024-08-19T00:45:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfa200640 1 -- 172.21.15.7:0/3009794756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40137c0 con 0x5588759bb8d0 2024-08-19T00:45:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfa200640 1 -- 172.21.15.7:0/3009794756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4013bb0 con 0x5588759bb8d0 2024-08-19T00:45:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/3009794756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 msgr2=0x558875a497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001530 tx=0x7f8bf40019f0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/3009794756 shutdown_connections 2024-08-19T00:45:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a3990 0x558875a3f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/3009794756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a35b0 0x558875a3abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/3009794756 >> 172.21.15.7:0/3009794756 conn(0x5588759a04e0 msgr2=0x558875970ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/3009794756 shutdown_connections 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.537+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/3009794756 wait complete. 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.538+0000 7f8bfeddbf40 1 Processor -- start 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.538+0000 7f8bfeddbf40 1 -- start start 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfeddbf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a35b0 0x558875a45200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfeddbf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a3990 0x558875a36180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfeddbf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfeddbf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558875a414d0 con 0x5588759bb8d0 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfeddbf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55887595e720 con 0x5588759a35b0 2024-08-19T00:45:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfeddbf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55887595e440 con 0x5588759a3990 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45818/0 (socket says 172.21.15.7:45818) 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfc000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a35b0 0x558875a45200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfca00640 1 -- 172.21.15.7:0/1874780307 learned_addr learned my addr 172.21.15.7:0/1874780307 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.539+0000 7f8bfb600640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a3990 0x558875a36180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfca00640 1 -- 172.21.15.7:0/1874780307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a3990 msgr2=0x558875a36180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfca00640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5588759a3990 0x558875a36180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfca00640 1 -- 172.21.15.7:0/1874780307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a35b0 msgr2=0x558875a45200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfca00640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588759a35b0 0x558875a45200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfca00640 1 -- 172.21.15.7:0/1874780307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588758d9080 con 0x5588759bb8d0 2024-08-19T00:45:42.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfca00640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400f000 tx=0x7f8bf4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bf8e00640 1 -- 172.21.15.7:0/1874780307 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4023070 con 0x5588759bb8d0 2024-08-19T00:45:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bf8e00640 1 -- 172.21.15.7:0/1874780307 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf401e670 con 0x5588759bb8d0 2024-08-19T00:45:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bf8e00640 1 -- 172.21.15.7:0/1874780307 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4018040 con 0x5588759bb8d0 2024-08-19T00:45:42.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558875a3ee80 con 0x5588759bb8d0 2024-08-19T00:45:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.540+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558875a36ab0 con 0x5588759bb8d0 2024-08-19T00:45:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.542+0000 7f8bf8e00640 1 -- 172.21.15.7:0/1874780307 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bf4026070 con 0x5588759bb8d0 2024-08-19T00:45:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.543+0000 7f8bf8e00640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8bdc06a810 0x7f8bdc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.543+0000 7f8bf8e00640 1 -- 172.21.15.7:0/1874780307 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7f8bf408b160 con 0x5588759bb8d0 2024-08-19T00:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.543+0000 7f8bfc000640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8bdc06a810 0x7f8bdc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.543+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558875a48640 0x558875a3d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.543+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:1 12.15 12:aa448500:::500.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x558875a45740 con 0x558875a48640 2024-08-19T00:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.544+0000 7f8bfb600640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558875a48640 0x558875a3d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.544+0000 7f8bfc000640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8bdc06a810 0x7f8bdc06ccd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0097c0 tx=0x7f8bec005b30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.544+0000 7f8bfb600640 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558875a48640 0x558875a3d6f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfb600640 1 -- 172.21.15.7:0/1874780307 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(1 500.00000000 [writefull 0~80] v104'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8be8050050 con 0x558875a48640 2024-08-19T00:45:42.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558875a48640 msgr2=0x558875a3d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558875a48640 0x558875a3d6f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8bdc06a810 msgr2=0x7f8bdc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8bdc06a810 0x7f8bdc06ccd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0097c0 tx=0x7f8bec005b30 comp rx=0 tx=0).stop 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 msgr2=0x558875a497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfeddbf40 1 --2- 172.21.15.7:0/1874780307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588759bb8d0 0x558875a497e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400f000 tx=0x7f8bf4000f40 comp rx=0 tx=0).stop 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.546+0000 7f8bfca00640 1 -- 172.21.15.7:0/1874780307 reap_dead start 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.547+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 shutdown_connections 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.547+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 >> 172.21.15.7:0/1874780307 conn(0x5588759a04e0 msgr2=0x558875a41dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.547+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 shutdown_connections 2024-08-19T00:45:42.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.547+0000 7f8bfeddbf40 1 -- 172.21.15.7:0/1874780307 wait complete. 2024-08-19T00:45:42.553 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.753+0000 7fdf9ea00640 1 Processor -- start 2024-08-19T00:45:42.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.753+0000 7fdf9ea00640 1 -- start start 2024-08-19T00:45:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.754+0000 7fdf9ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980b4160 0x7fdf980ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.754+0000 7fdf9ea00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf980aeae0 con 0x7fdf980731c0 2024-08-19T00:45:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.754+0000 7fdf9ea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf980aedc0 con 0x7fdf98158cd0 2024-08-19T00:45:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.754+0000 7fdf9ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdf980af0a0 con 0x7fdf980b4160 2024-08-19T00:45:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.754+0000 7fdf8f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdf980731c0 0x7fdf980add70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47796/0 (socket says 172.21.15.7:47796) 2024-08-19T00:45:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.754+0000 7fdf8f400640 1 -- 172.21.15.7:0/1529538818 learned_addr learned my addr 172.21.15.7:0/1529538818 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:42.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.754+0000 7fdf9ca00640 1 --2- 172.21.15.7:0/1529538818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980b4160 0x7fdf980ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.755+0000 7fdf97400640 1 -- 172.21.15.7:0/1529538818 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143330774 0 0) 0x7fdf980aedc0 con 0x7fdf98158cd0 2024-08-19T00:45:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.755+0000 7fdf9ca00640 1 -- 172.21.15.7:0/1529538818 >> v1:172.21.15.162:6789/0 conn(0x7fdf98158cd0 legacy=0x7fdf98072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.755+0000 7fdf9ca00640 1 -- 172.21.15.7:0/1529538818 >> v1:172.21.15.7:6789/0 conn(0x7fdf980731c0 legacy=0x7fdf980add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.755+0000 7fdf9ca00640 1 -- 172.21.15.7:0/1529538818 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf980af380 con 0x7fdf980b4160 2024-08-19T00:45:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.756+0000 7fdf9ca00640 1 --2- 172.21.15.7:0/1529538818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980b4160 0x7fdf980ae480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf900097d0 tx=0x7fdf9002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd07a6052e2def3e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.756+0000 7fdf97400640 1 -- 172.21.15.7:0/1529538818 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90037070 con 0x7fdf980b4160 2024-08-19T00:45:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.756+0000 7fdf97400640 1 -- 172.21.15.7:0/1529538818 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf90032440 con 0x7fdf980b4160 2024-08-19T00:45:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.756+0000 7fdf97400640 1 -- 172.21.15.7:0/1529538818 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90032810 con 0x7fdf980b4160 2024-08-19T00:45:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.757+0000 7fdf9ea00640 1 -- 172.21.15.7:0/1529538818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980b4160 msgr2=0x7fdf980ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.757+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/1529538818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980b4160 0x7fdf980ae480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf900097d0 tx=0x7fdf9002a180 comp rx=0 tx=0).stop 2024-08-19T00:45:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.757+0000 7fdf9ea00640 1 -- 172.21.15.7:0/1529538818 shutdown_connections 2024-08-19T00:45:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.757+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/1529538818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980b4160 0x7fdf980ae480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.757+0000 7fdf9ea00640 1 -- 172.21.15.7:0/1529538818 >> 172.21.15.7:0/1529538818 conn(0x7fdf980b2300 msgr2=0x7fdf9806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.757+0000 7fdf9ea00640 1 -- 172.21.15.7:0/1529538818 shutdown_connections 2024-08-19T00:45:42.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.757+0000 7fdf9ea00640 1 -- 172.21.15.7:0/1529538818 wait complete. 2024-08-19T00:45:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.759+0000 7fdf9ea00640 1 Processor -- start 2024-08-19T00:45:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.759+0000 7fdf9ea00640 1 -- start start 2024-08-19T00:45:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.759+0000 7fdf9ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980731c0 0x7fdf9806f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.759+0000 7fdf9ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf980b4160 0x7fdf98164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9814bb90 0x7fdf981653f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98165d70 con 0x7fdf9814bb90 2024-08-19T00:45:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98165bf0 con 0x7fdf980b4160 2024-08-19T00:45:42.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdf98165ef0 con 0x7fdf980731c0 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9814bb90 0x7fdf981653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9814bb90 0x7fdf981653f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45834/0 (socket says 172.21.15.7:45834) 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 -- 172.21.15.7:0/205005302 learned_addr learned my addr 172.21.15.7:0/205005302 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf8f400640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf980b4160 0x7fdf98164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf97e00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980731c0 0x7fdf9806f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 -- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980731c0 msgr2=0x7fdf9806f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980731c0 0x7fdf9806f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 -- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf980b4160 msgr2=0x7fdf98164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf980b4160 0x7fdf98164eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.760+0000 7fdf9ca00640 1 -- 172.21.15.7:0/205005302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9814e970 con 0x7fdf9814bb90 2024-08-19T00:45:42.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.761+0000 7fdf9ca00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9814bb90 0x7fdf981653f0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fdf900097d0 tx=0x7fdf900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.761+0000 7fdf94c00640 1 -- 172.21.15.7:0/205005302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90037040 con 0x7fdf9814bb90 2024-08-19T00:45:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.761+0000 7fdf94c00640 1 -- 172.21.15.7:0/205005302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf90004250 con 0x7fdf9814bb90 2024-08-19T00:45:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.761+0000 7fdf94c00640 1 -- 172.21.15.7:0/205005302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90032e20 con 0x7fdf9814bb90 2024-08-19T00:45:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.761+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9806f290 con 0x7fdf9814bb90 2024-08-19T00:45:42.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.761+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9806e960 con 0x7fdf9814bb90 2024-08-19T00:45:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.762+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf980cfd30 con 0x7fdf9814bb90 2024-08-19T00:45:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.763+0000 7fdf94c00640 1 -- 172.21.15.7:0/205005302 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf90030770 con 0x7fdf9814bb90 2024-08-19T00:45:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.764+0000 7fdf94c00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdf7406be30 0x7fdf7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.764+0000 7fdf94c00640 1 -- 172.21.15.7:0/205005302 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fdf900ac620 con 0x7fdf9814bb90 2024-08-19T00:45:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.764+0000 7fdf97e00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdf7406be30 0x7fdf7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.765+0000 7fdf97e00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdf7406be30 0x7fdf7406e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdf9809df80 tx=0x7fdf88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:42.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.769+0000 7fdf94c00640 1 -- 172.21.15.7:0/205005302 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdf9007a3f0 con 0x7fdf9814bb90 2024-08-19T00:45:42.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:42.989+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fdf980cc950 con 0x7fdf9814bb90 2024-08-19T00:45:43.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.038+0000 7fdf94c00640 1 -- 172.21.15.7:0/205005302 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v195) ==== 162+0+0 (secure 0 0 0) 0x7fdf9007e6f0 con 0x7fdf9814bb90 2024-08-19T00:45:43.040 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdf7406be30 msgr2=0x7fdf7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdf7406be30 0x7fdf7406e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdf9809df80 tx=0x7fdf88009040 comp rx=0 tx=0).stop 2024-08-19T00:45:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9814bb90 msgr2=0x7fdf981653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9814bb90 0x7fdf981653f0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fdf900097d0 tx=0x7fdf900046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 shutdown_connections 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdf7406be30 0x7fdf7406e2f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9814bb90 0x7fdf981653f0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf980b4160 0x7fdf98164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 --2- 172.21.15.7:0/205005302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf980731c0 0x7fdf9806f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 >> 172.21.15.7:0/205005302 conn(0x7fdf980b2300 msgr2=0x7fdf98153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 shutdown_connections 2024-08-19T00:45:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.041+0000 7fdf9ea00640 1 -- 172.21.15.7:0/205005302 wait complete. 2024-08-19T00:45:43.047 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:45:43.046+0000 7fa4a7800640 -1 mds.0.purge_queue operator(): Error -22 loading Journaler 2024-08-19T00:45:43.048 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:45:43.046+0000 7fa4a7800640 -1 mds.0.196 unhandled write error (22) Invalid argument, force readonly... 2024-08-19T00:45:43.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:43.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.216+0000 7f9eaf200640 1 Processor -- start 2024-08-19T00:45:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.216+0000 7f9eaf200640 1 -- start start 2024-08-19T00:45:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.217+0000 7f9eaf200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9eb015ee50 0x7f9eb015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.217+0000 7f9eaf200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb00b3ab0 con 0x7f9eb015e360 2024-08-19T00:45:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.217+0000 7f9eaf200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb015f460 con 0x7f9eb00d3200 2024-08-19T00:45:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.217+0000 7f9eaf200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb015f740 con 0x7f9eb015ee50 2024-08-19T00:45:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eade00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9eb015e360 0x7f9eb00d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47808/0 (socket says 172.21.15.7:47808) 2024-08-19T00:45:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eade00640 1 -- 172.21.15.7:0/962319862 learned_addr learned my addr 172.21.15.7:0/962319862 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eae800640 1 --2- 172.21.15.7:0/962319862 >> v2:172.21.15.162:3300/0 conn(0x7f9eb015ee50 0x7f9eb015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eaca00640 1 -- 172.21.15.7:0/962319862 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309203418 0 0) 0x7f9eb00b3ab0 con 0x7f9eb015e360 2024-08-19T00:45:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eaca00640 1 -- 172.21.15.7:0/962319862 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e94003520 con 0x7f9eb015e360 2024-08-19T00:45:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eaca00640 1 -- 172.21.15.7:0/962319862 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582449574 0 0) 0x7f9eb015f460 con 0x7f9eb00d3200 2024-08-19T00:45:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eaca00640 1 -- 172.21.15.7:0/962319862 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9eb00b3ab0 con 0x7f9eb00d3200 2024-08-19T00:45:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eae800640 1 -- 172.21.15.7:0/962319862 >> v1:172.21.15.162:6789/0 conn(0x7f9eb00d3200 legacy=0x7f9eb015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eae800640 1 -- 172.21.15.7:0/962319862 >> v1:172.21.15.7:6789/0 conn(0x7f9eb015e360 legacy=0x7f9eb00d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.218+0000 7f9eae800640 1 -- 172.21.15.7:0/962319862 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb00b3d60 con 0x7f9eb015ee50 2024-08-19T00:45:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.219+0000 7f9eae800640 1 --2- 172.21.15.7:0/962319862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 0x7f9eb015fab0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b5551d7afa64a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaca00640 1 -- 172.21.15.7:0/962319862 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007740 con 0x7f9eb015ee50 2024-08-19T00:45:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaca00640 1 -- 172.21.15.7:0/962319862 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea80078e0 con 0x7f9eb015ee50 2024-08-19T00:45:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaca00640 1 -- 172.21.15.7:0/962319862 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007cb0 con 0x7f9eb015ee50 2024-08-19T00:45:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaf200640 1 -- 172.21.15.7:0/962319862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 msgr2=0x7f9eb015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaf200640 1 --2- 172.21.15.7:0/962319862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 0x7f9eb015fab0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea802a6f0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaf200640 1 -- 172.21.15.7:0/962319862 shutdown_connections 2024-08-19T00:45:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaf200640 1 --2- 172.21.15.7:0/962319862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 0x7f9eb015fab0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaf200640 1 -- 172.21.15.7:0/962319862 >> 172.21.15.7:0/962319862 conn(0x7f9eb008dbf0 msgr2=0x7f9eb009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaf200640 1 -- 172.21.15.7:0/962319862 shutdown_connections 2024-08-19T00:45:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.220+0000 7f9eaf200640 1 -- 172.21.15.7:0/962319862 wait complete. 2024-08-19T00:45:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.222+0000 7f9eaf200640 1 Processor -- start 2024-08-19T00:45:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.222+0000 7f9eaf200640 1 -- start start 2024-08-19T00:45:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eaf200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb00d3200 0x7f9eb00cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eaf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb015e360 0x7f9eb01f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eaf200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 0x7f9eb00cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eaf200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb00b4560 con 0x7f9eb015e360 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eaf200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb00d2300 con 0x7f9eb015ee50 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eaf200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb00b46e0 con 0x7f9eb00d3200 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9ead400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb015e360 0x7f9eb01f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9ead400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb015e360 0x7f9eb01f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45842/0 (socket says 172.21.15.7:45842) 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9ead400640 1 -- 172.21.15.7:0/197466833 learned_addr learned my addr 172.21.15.7:0/197466833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eade00640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb00d3200 0x7f9eb00cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.223+0000 7f9eae800640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 0x7f9eb00cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:43.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ead400640 1 -- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb00d3200 msgr2=0x7f9eb00cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ead400640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb00d3200 0x7f9eb00cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ead400640 1 -- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 msgr2=0x7f9eb00cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ead400640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 0x7f9eb00cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ead400640 1 -- 172.21.15.7:0/197466833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb01f5430 con 0x7f9eb015e360 2024-08-19T00:45:43.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ead400640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb015e360 0x7f9eb01f4bb0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c490 tx=0x7f9e9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ea6000640 1 -- 172.21.15.7:0/197466833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0052d0 con 0x7f9eb015e360 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ea6000640 1 -- 172.21.15.7:0/197466833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c005470 con 0x7f9eb015e360 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb01f5710 con 0x7f9eb015e360 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9ea6000640 1 -- 172.21.15.7:0/197466833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c012870 con 0x7f9eb015e360 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.224+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb00b1080 con 0x7f9eb015e360 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.226+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb00b1280 con 0x7f9eb015e360 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.226+0000 7f9ea6000640 1 -- 172.21.15.7:0/197466833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e9c012a10 con 0x7f9eb015e360 2024-08-19T00:45:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.228+0000 7f9ea6000640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9006be30 0x7f9e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.228+0000 7f9ea6000640 1 -- 172.21.15.7:0/197466833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7f9e9c08afa0 con 0x7f9eb015e360 2024-08-19T00:45:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.228+0000 7f9eade00640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9006be30 0x7f9e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.229+0000 7f9eade00640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9006be30 0x7f9e9006e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00011e0 tx=0x7f9ea0007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.232+0000 7f9ea6000640 1 -- 172.21.15.7:0/197466833 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9eb00b1280 con 0x7f9eb015e360 2024-08-19T00:45:43.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.459+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eb00d50d0 con 0x7f9eb015e360 2024-08-19T00:45:43.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.459+0000 7f9ea6000640 1 -- 172.21.15.7:0/197466833 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 196 v196) ==== 95+0+4402 (secure 0 0 0) 0x7f9e9c058d80 con 0x7f9eb015e360 2024-08-19T00:45:43.461 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:43.461 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":196,"btime":"2024-08-19T00:45:43:040855+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":196,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:43.040843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":196,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/3399848835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3399848835},{"type":"v1","addr":"172.21.15.7:6836","nonce":3399848835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:43.461 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 196 2024-08-19T00:45:43.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.461+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9006be30 msgr2=0x7f9e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.461+0000 7f9eaf200640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9006be30 0x7f9e9006e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00011e0 tx=0x7f9ea0007d30 comp rx=0 tx=0).stop 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb015e360 msgr2=0x7f9eb01f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb015e360 0x7f9eb01f4bb0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c490 tx=0x7f9e9c00c950 comp rx=0 tx=0).stop 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 shutdown_connections 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e9006be30 0x7f9e9006e2f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015ee50 0x7f9eb00cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9eb015e360 0x7f9eb01f4bb0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 --2- 172.21.15.7:0/197466833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eb00d3200 0x7f9eb00cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 >> 172.21.15.7:0/197466833 conn(0x7f9eb008dbf0 msgr2=0x7f9eb015cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 shutdown_connections 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:43.462+0000 7f9eaf200640 1 -- 172.21.15.7:0/197466833 wait complete. 2024-08-19T00:45:43.771 INFO:tasks.ceph.mds.a.smithi007.stderr: -36> 2024-08-19T00:45:39.017+0000 7f970d200640 -1 log_channel(cluster) log [ERR] : missing journal object 2024-08-19T00:45:43.811 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:45:43.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.039+0000 7ff70c200640 1 Processor -- start 2024-08-19T00:45:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.039+0000 7ff70c200640 1 -- start start 2024-08-19T00:45:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.040+0000 7ff70c200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff70406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.040+0000 7ff70c200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70415ec30 con 0x7ff7040d0290 2024-08-19T00:45:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.040+0000 7ff70c200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70415ef10 con 0x7ff70409aa70 2024-08-19T00:45:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.040+0000 7ff70c200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff70415f1f0 con 0x7ff70409b730 2024-08-19T00:45:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.041+0000 7ff709800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff70409aa70 0x7ff70409ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:36546/0 (socket says 172.21.15.7:36546) 2024-08-19T00:45:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.041+0000 7ff709800640 1 -- 172.21.15.7:0/2961524438 learned_addr learned my addr 172.21.15.7:0/2961524438 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.041+0000 7ff708e00640 1 --2- 172.21.15.7:0/2961524438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff70406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.041+0000 7ff70a200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff7040d0290 0x7ff7040d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40532/0 (socket says 172.21.15.7:40532) 2024-08-19T00:45:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.041+0000 7ff708e00640 1 -- 172.21.15.7:0/2961524438 >> v1:172.21.15.162:6789/0 conn(0x7ff70409aa70 legacy=0x7ff70409ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.041+0000 7ff708e00640 1 -- 172.21.15.7:0/2961524438 >> v1:172.21.15.7:6789/0 conn(0x7ff7040d0290 legacy=0x7ff7040d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.041+0000 7ff708e00640 1 -- 172.21.15.7:0/2961524438 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70415f4d0 con 0x7ff70409b730 2024-08-19T00:45:44.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.042+0000 7ff708e00640 1 --2- 172.21.15.7:0/2961524438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff70406fc30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009800 tx=0x7ff6f002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=645f50ac49d704eb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:44.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.048+0000 7ff703e00640 1 -- 172.21.15.7:0/2961524438 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0037070 con 0x7ff70409b730 2024-08-19T00:45:44.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.048+0000 7ff703e00640 1 -- 172.21.15.7:0/2961524438 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0032440 con 0x7ff70409b730 2024-08-19T00:45:44.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.048+0000 7ff703e00640 1 -- 172.21.15.7:0/2961524438 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0032810 con 0x7ff70409b730 2024-08-19T00:45:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.049+0000 7ff70c200640 1 -- 172.21.15.7:0/2961524438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 msgr2=0x7ff70406fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.049+0000 7ff70c200640 1 --2- 172.21.15.7:0/2961524438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff70406fc30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009800 tx=0x7ff6f002a230 comp rx=0 tx=0).stop 2024-08-19T00:45:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.049+0000 7ff70c200640 1 -- 172.21.15.7:0/2961524438 shutdown_connections 2024-08-19T00:45:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.049+0000 7ff70c200640 1 --2- 172.21.15.7:0/2961524438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff70406fc30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.049+0000 7ff70c200640 1 -- 172.21.15.7:0/2961524438 >> 172.21.15.7:0/2961524438 conn(0x7ff7040d2190 msgr2=0x7ff7040d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.049+0000 7ff70c200640 1 -- 172.21.15.7:0/2961524438 shutdown_connections 2024-08-19T00:45:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.049+0000 7ff70c200640 1 -- 172.21.15.7:0/2961524438 wait complete. 2024-08-19T00:45:44.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.051+0000 7ff70c200640 1 Processor -- start 2024-08-19T00:45:44.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.051+0000 7ff70c200640 1 -- start start 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff70c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff70409aa70 0x7ff704157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff70c200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff7040ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff70c200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7040d0290 0x7ff7040ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff70c200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7040d0e50 con 0x7ff7040d0290 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff70c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff70415e8f0 con 0x7ff70409aa70 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff70c200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7040d0fd0 con 0x7ff70409b730 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff70a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7040d0290 0x7ff7040ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:44.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff708e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff7040ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:44.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.052+0000 7ff709800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff70409aa70 0x7ff704157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:44.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff70a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7040d0290 0x7ff7040ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43464/0 (socket says 172.21.15.7:43464) 2024-08-19T00:45:44.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff70a200640 1 -- 172.21.15.7:0/254717604 learned_addr learned my addr 172.21.15.7:0/254717604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:44.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff70a200640 1 -- 172.21.15.7:0/254717604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 msgr2=0x7ff7040ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:44.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff70a200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff7040ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff70a200640 1 -- 172.21.15.7:0/254717604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff70409aa70 msgr2=0x7ff704157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff70a200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff70409aa70 0x7ff704157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff70a200640 1 -- 172.21.15.7:0/254717604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7040cd490 con 0x7ff7040d0290 2024-08-19T00:45:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.053+0000 7ff709800640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff70409aa70 0x7ff704157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.054+0000 7ff70a200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7040d0290 0x7ff7040ccb20 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c760 tx=0x7ff6fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.055+0000 7ff701600640 1 -- 172.21.15.7:0/254717604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc017070 con 0x7ff7040d0290 2024-08-19T00:45:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.056+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7040cd770 con 0x7ff7040d0290 2024-08-19T00:45:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.056+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7040cdd30 con 0x7ff7040d0290 2024-08-19T00:45:44.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.056+0000 7ff701600640 1 -- 172.21.15.7:0/254717604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00a640 con 0x7ff7040d0290 2024-08-19T00:45:44.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.056+0000 7ff701600640 1 -- 172.21.15.7:0/254717604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc021060 con 0x7ff7040d0290 2024-08-19T00:45:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.057+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e0005290 con 0x7ff7040d0290 2024-08-19T00:45:44.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.058+0000 7ff701600640 1 -- 172.21.15.7:0/254717604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6fc01a070 con 0x7ff7040d0290 2024-08-19T00:45:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.059+0000 7ff701600640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.059+0000 7ff701600640 1 -- 172.21.15.7:0/254717604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7ff6fc08aa00 con 0x7ff7040d0290 2024-08-19T00:45:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.059+0000 7ff709800640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:44.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.060+0000 7ff709800640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6e406be30 0x7ff6e406e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8005880 tx=0x7ff6f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.063+0000 7ff701600640 1 -- 172.21.15.7:0/254717604 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff6fc058630 con 0x7ff7040d0290 2024-08-19T00:45:44.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.283+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6e0005580 con 0x7ff7040d0290 2024-08-19T00:45:44.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.283+0000 7ff701600640 1 -- 172.21.15.7:0/254717604 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 197 v197) ==== 95+0+5228 (secure 0 0 0) 0x7ff6fc05c930 con 0x7ff7040d0290 2024-08-19T00:45:44.285 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:44.285 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":197,"btime":"2024-08-19T00:45:44:043846+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2555026980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2555026980},{"type":"v1","addr":"172.21.15.7:6837","nonce":2555026980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":197,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:43.050879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":196,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.7:6836/3399848835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3399848835},{"type":"v1","addr":"172.21.15.7:6836","nonce":3399848835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:44.285 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 197 2024-08-19T00:45:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6e406be30 msgr2=0x7ff6e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6e406be30 0x7ff6e406e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8005880 tx=0x7ff6f8009040 comp rx=0 tx=0).stop 2024-08-19T00:45:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7040d0290 msgr2=0x7ff7040ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7040d0290 0x7ff7040ccb20 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c760 tx=0x7ff6fc00cc20 comp rx=0 tx=0).stop 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 shutdown_connections 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7040d0290 0x7ff7040ccb20 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff70409b730 0x7ff7040ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 --2- 172.21.15.7:0/254717604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff70409aa70 0x7ff704157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 >> 172.21.15.7:0/254717604 conn(0x7ff7040d2190 msgr2=0x7ff7040af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.285+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 shutdown_connections 2024-08-19T00:45:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:44.286+0000 7ff70c200640 1 -- 172.21.15.7:0/254717604 wait complete. 2024-08-19T00:45:44.303 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 197, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:45:43.050879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8622': {'gid': 8622, 'name': 'c', 'rank': 0, 'incarnation': 196, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.7:6836/3399848835', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3399848835}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3399848835}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:45:44.303 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8622:up:reconnect 2024-08-19T00:45:44.303 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:45:49.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.472+0000 7f78c8800640 1 Processor -- start 2024-08-19T00:45:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.473+0000 7f78c8800640 1 -- start start 2024-08-19T00:45:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c8800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c00d03c0 0x7f78c0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c8800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78c006e710 0x7f78c00d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c8800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f78c00b3750 0x7f78c00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c8800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f78c00cebc0 con 0x7f78c006e710 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c8800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f78c00d0ce0 con 0x7f78c00b3750 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c8800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f78c00cdfb0 con 0x7f78c00d03c0 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78c006e710 0x7f78c00d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78c006e710 0x7f78c00d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43466/0 (socket says 172.21.15.7:43466) 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5400640 1 -- 172.21.15.7:0/3937589479 learned_addr learned my addr 172.21.15.7:0/3937589479 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c6800640 1 --2- 172.21.15.7:0/3937589479 >> v2:172.21.15.162:3300/0 conn(0x7f78c00b3750 0x7f78c00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5e00640 1 --2- 172.21.15.7:0/3937589479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c00d03c0 0x7f78c0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:49.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5400640 1 -- 172.21.15.7:0/3937589479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c00d03c0 msgr2=0x7f78c0071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:49.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5400640 1 --2- 172.21.15.7:0/3937589479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c00d03c0 0x7f78c0071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5400640 1 -- 172.21.15.7:0/3937589479 >> v2:172.21.15.162:3300/0 conn(0x7f78c00b3750 msgr2=0x7f78c00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.474+0000 7f78c5400640 1 --2- 172.21.15.7:0/3937589479 >> v2:172.21.15.162:3300/0 conn(0x7f78c00b3750 0x7f78c00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.475+0000 7f78c5400640 1 -- 172.21.15.7:0/3937589479 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c00ce290 con 0x7f78c006e710 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.475+0000 7f78c6800640 1 --2- 172.21.15.7:0/3937589479 >> v2:172.21.15.162:3300/0 conn(0x7f78c00b3750 0x7f78c00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.475+0000 7f78c5e00640 1 --2- 172.21.15.7:0/3937589479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c00d03c0 0x7f78c0071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.476+0000 7f78c5400640 1 --2- 172.21.15.7:0/3937589479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c006e710 0x7f78c00d07a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f78c009e320 tx=0x7f78b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8c95959d3062d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.476+0000 7f78c4a00640 1 -- 172.21.15.7:0/3937589479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0037070 con 0x7f78c006e710 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.476+0000 7f78c4a00640 1 -- 172.21.15.7:0/3937589479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b0032440 con 0x7f78c006e710 2024-08-19T00:45:49.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.476+0000 7f78c4a00640 1 -- 172.21.15.7:0/3937589479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0032810 con 0x7f78c006e710 2024-08-19T00:45:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.476+0000 7f78c8800640 1 -- 172.21.15.7:0/3937589479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c006e710 msgr2=0x7f78c00d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.476+0000 7f78c8800640 1 --2- 172.21.15.7:0/3937589479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c006e710 0x7f78c00d07a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f78c009e320 tx=0x7f78b002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.477+0000 7f78c8800640 1 -- 172.21.15.7:0/3937589479 shutdown_connections 2024-08-19T00:45:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.477+0000 7f78c8800640 1 --2- 172.21.15.7:0/3937589479 >> v2:172.21.15.162:3300/0 conn(0x7f78c00b3750 0x7f78c00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.477+0000 7f78c8800640 1 --2- 172.21.15.7:0/3937589479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c006e710 0x7f78c00d07a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.477+0000 7f78c8800640 1 --2- 172.21.15.7:0/3937589479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c00d03c0 0x7f78c0071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.477+0000 7f78c8800640 1 -- 172.21.15.7:0/3937589479 >> 172.21.15.7:0/3937589479 conn(0x7f78c006bc70 msgr2=0x7f78c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.477+0000 7f78c8800640 1 -- 172.21.15.7:0/3937589479 shutdown_connections 2024-08-19T00:45:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.477+0000 7f78c8800640 1 -- 172.21.15.7:0/3937589479 wait complete. 2024-08-19T00:45:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.478+0000 7f78c8800640 1 Processor -- start 2024-08-19T00:45:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.479+0000 7f78c8800640 1 -- start start 2024-08-19T00:45:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.479+0000 7f78c8800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c006e710 0x7f78c01f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:49.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c8800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78c00b3750 0x7f78c0157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c8800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00d03c0 0x7f78c01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c8800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0073ae0 con 0x7f78c00d03c0 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c8800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78c00ce850 con 0x7f78c00b3750 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c8800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f78c0073c60 con 0x7f78c006e710 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00d03c0 0x7f78c01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00d03c0 0x7f78c01545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43470/0 (socket says 172.21.15.7:43470) 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 -- 172.21.15.7:0/1850879364 learned_addr learned my addr 172.21.15.7:0/1850879364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c5e00640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c006e710 0x7f78c01f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c5400640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78c00b3750 0x7f78c0157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 -- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c006e710 msgr2=0x7f78c01f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c006e710 0x7f78c01f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 -- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78c00b3750 msgr2=0x7f78c0157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78c00b3750 0x7f78c0157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c6800640 1 -- 172.21.15.7:0/1850879364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c01f43e0 con 0x7f78c00d03c0 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.480+0000 7f78c5400640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78c00b3750 0x7f78c0157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.481+0000 7f78c6800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00d03c0 0x7f78c01545b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f78bc007db0 tx=0x7f78bc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.481+0000 7f78ba000640 1 -- 172.21.15.7:0/1850879364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc01a070 con 0x7f78c00d03c0 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.481+0000 7f78ba000640 1 -- 172.21.15.7:0/1850879364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78bc003990 con 0x7f78c00d03c0 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.481+0000 7f78ba000640 1 -- 172.21.15.7:0/1850879364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc003d80 con 0x7f78c00d03c0 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.481+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c0155e60 con 0x7f78c00d03c0 2024-08-19T00:45:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.481+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c0156910 con 0x7f78c00d03c0 2024-08-19T00:45:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.482+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c00b3be0 con 0x7f78c00d03c0 2024-08-19T00:45:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.483+0000 7f78ba000640 1 -- 172.21.15.7:0/1850879364 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78bc01d070 con 0x7f78c00d03c0 2024-08-19T00:45:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.484+0000 7f78ba000640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78a406be30 0x7f78a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.484+0000 7f78ba000640 1 -- 172.21.15.7:0/1850879364 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7f78bc08b5f0 con 0x7f78c00d03c0 2024-08-19T00:45:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.484+0000 7f78c5e00640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78a406be30 0x7f78a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.485+0000 7f78c5e00640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78a406be30 0x7f78a406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f78c01f7a10 tx=0x7f78b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.489+0000 7f78ba000640 1 -- 172.21.15.7:0/1850879364 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f78bc010070 con 0x7f78c00d03c0 2024-08-19T00:45:49.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.708+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78c00adaa0 con 0x7f78c00d03c0 2024-08-19T00:45:49.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.709+0000 7f78ba000640 1 -- 172.21.15.7:0/1850879364 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 199 v199) ==== 95+0+5232 (secure 0 0 0) 0x7f78bc0592a0 con 0x7f78c00d03c0 2024-08-19T00:45:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:49.711 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":199,"btime":"2024-08-19T00:45:46:060595+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2555026980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2555026980},{"type":"v1","addr":"172.21.15.7:6837","nonce":2555026980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":199,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:46.060586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":196,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/3399848835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3399848835},{"type":"v1","addr":"172.21.15.7:6836","nonce":3399848835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8622,"qdb_cluster":[8622]},"id":6}]} 2024-08-19T00:45:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 199 2024-08-19T00:45:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78a406be30 msgr2=0x7f78a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78a406be30 0x7f78a406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f78c01f7a10 tx=0x7f78b4008040 comp rx=0 tx=0).stop 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00d03c0 msgr2=0x7f78c01545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00d03c0 0x7f78c01545b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f78bc007db0 tx=0x7f78bc00d4a0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 shutdown_connections 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78a406be30 0x7f78a406e2f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00d03c0 0x7f78c01545b0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78c00b3750 0x7f78c0157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 --2- 172.21.15.7:0/1850879364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78c006e710 0x7f78c01f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 >> 172.21.15.7:0/1850879364 conn(0x7f78c006bc70 msgr2=0x7f78c0071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 shutdown_connections 2024-08-19T00:45:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:49.711+0000 7f78c8800640 1 -- 172.21.15.7:0/1850879364 wait complete. 2024-08-19T00:45:50.030 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:45:50.028+0000 7fa4ab400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:45:50.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:50.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.289+0000 7f7963000640 1 Processor -- start 2024-08-19T00:45:50.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.289+0000 7f7963000640 1 -- start start 2024-08-19T00:45:50.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.290+0000 7f7963000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 0x7f795c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.290+0000 7f7963000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795c0b3ab0 con 0x7f795c15e360 2024-08-19T00:45:50.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.290+0000 7f7963000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795c15f460 con 0x7f795c0d3200 2024-08-19T00:45:50.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.290+0000 7f7963000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f795c15f740 con 0x7f795c15ee50 2024-08-19T00:45:50.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.290+0000 7f7961c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f795c15e360 0x7f795c0d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40546/0 (socket says 172.21.15.7:40546) 2024-08-19T00:45:50.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.290+0000 7f7961c00640 1 -- 172.21.15.7:0/776287424 learned_addr learned my addr 172.21.15.7:0/776287424 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:50.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f7962600640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 0x7f795c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108263922 0 0) 0x7f795c0b3ab0 con 0x7f795c15e360 2024-08-19T00:45:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7944003520 con 0x7f795c15e360 2024-08-19T00:45:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 896162105 0 0) 0x7f795c15f460 con 0x7f795c0d3200 2024-08-19T00:45:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c0b3ab0 con 0x7f795c0d3200 2024-08-19T00:45:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109171573 0 0) 0x7f7944003520 con 0x7f795c15e360 2024-08-19T00:45:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 msgr2=0x7f795c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 0x7f795c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 >> v1:172.21.15.162:6789/0 conn(0x7f795c0d3200 legacy=0x7f795c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c0b3d60 con 0x7f795c15e360 2024-08-19T00:45:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f7950001670 con 0x7f795c15e360 2024-08-19T00:45:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 >> v1:172.21.15.7:6789/0 conn(0x7f795c15e360 legacy=0x7f795c0d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 0x7f7944003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79440040d0 0x7f7944004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944004d40 0x7f79440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f795c15f740 con 0x7f79440040d0 2024-08-19T00:45:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f794400baa0 con 0x7f7944004d40 2024-08-19T00:45:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.291+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f794400bca0 con 0x7f795c15ee50 2024-08-19T00:45:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7961200640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79440040d0 0x7f7944004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7961c00640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 0x7f7944003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7962600640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944004d40 0x7f79440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7961200640 1 -- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 msgr2=0x7f7944003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7961200640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c15ee50 0x7f7944003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7961200640 1 -- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944004d40 msgr2=0x7f79440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7961200640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944004d40 0x7f79440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.292+0000 7f7961200640 1 -- 172.21.15.7:0/776287424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7944003520 con 0x7f79440040d0 2024-08-19T00:45:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.293+0000 7f7961200640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79440040d0 0x7f7944004800 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f79480018d0 tx=0x7f7944005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a099dcc52b054b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.293+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79480014f0 con 0x7f79440040d0 2024-08-19T00:45:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.293+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79480052d0 con 0x7f79440040d0 2024-08-19T00:45:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.293+0000 7f795be00640 1 -- 172.21.15.7:0/776287424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794802aca0 con 0x7f79440040d0 2024-08-19T00:45:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.294+0000 7f7963000640 1 -- 172.21.15.7:0/776287424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79440040d0 msgr2=0x7f7944004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.294+0000 7f7963000640 1 --2- 172.21.15.7:0/776287424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79440040d0 0x7f7944004800 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f79480018d0 tx=0x7f7944005830 comp rx=0 tx=0).stop 2024-08-19T00:45:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.294+0000 7f7962600640 1 -- 172.21.15.7:0/776287424 reap_dead start 2024-08-19T00:45:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.294+0000 7f7963000640 1 -- 172.21.15.7:0/776287424 shutdown_connections 2024-08-19T00:45:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.294+0000 7f7963000640 1 -- 172.21.15.7:0/776287424 >> 172.21.15.7:0/776287424 conn(0x7f795c08dbf0 msgr2=0x7f795c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.294+0000 7f7963000640 1 -- 172.21.15.7:0/776287424 shutdown_connections 2024-08-19T00:45:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.294+0000 7f7963000640 1 -- 172.21.15.7:0/776287424 wait complete. 2024-08-19T00:45:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.296+0000 7f7963000640 1 Processor -- start 2024-08-19T00:45:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.296+0000 7f7963000640 1 -- start start 2024-08-19T00:45:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7963000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79440040d0 0x7f795c0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7963000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795c0b8ae0 0x7f795c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7963000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0b7010 0x7f795c0d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7963000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f795c15fab0 con 0x7f795c0b8ae0 2024-08-19T00:45:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7963000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0d2300 con 0x7f79440040d0 2024-08-19T00:45:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7963000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f795c15fc30 con 0x7f795c0b7010 2024-08-19T00:45:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7961200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795c0b8ae0 0x7f795c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7961200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795c0b8ae0 0x7f795c15c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43480/0 (socket says 172.21.15.7:43480) 2024-08-19T00:45:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7961200640 1 -- 172.21.15.7:0/1323411979 learned_addr learned my addr 172.21.15.7:0/1323411979 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7962600640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0b7010 0x7f795c0d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7961200640 1 -- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0b7010 msgr2=0x7f795c0d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.297+0000 7f7961200640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0b7010 0x7f795c0d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7961200640 1 -- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79440040d0 msgr2=0x7f795c0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7961200640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79440040d0 0x7f795c0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7961200640 1 -- 172.21.15.7:0/1323411979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c0b9250 con 0x7f795c0b8ae0 2024-08-19T00:45:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7962600640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0b7010 0x7f795c0d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7961200640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795c0b8ae0 0x7f795c15c340 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f79480019f0 tx=0x7f79480012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7959600640 1 -- 172.21.15.7:0/1323411979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794803f020 con 0x7f795c0b8ae0 2024-08-19T00:45:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7959600640 1 -- 172.21.15.7:0/1323411979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7948006e50 con 0x7f795c0b8ae0 2024-08-19T00:45:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7959600640 1 -- 172.21.15.7:0/1323411979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7948037040 con 0x7f795c0b8ae0 2024-08-19T00:45:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795c0b9530 con 0x7f795c0b8ae0 2024-08-19T00:45:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.298+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795c0c8eb0 con 0x7f795c0b8ae0 2024-08-19T00:45:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.299+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795c15e740 con 0x7f795c0b8ae0 2024-08-19T00:45:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.300+0000 7f7959600640 1 -- 172.21.15.7:0/1323411979 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7948042020 con 0x7f795c0b8ae0 2024-08-19T00:45:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.301+0000 7f7959600640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793c06be30 0x7f793c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.301+0000 7f7959600640 1 -- 172.21.15.7:0/1323411979 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7f79480ab3d0 con 0x7f795c0b8ae0 2024-08-19T00:45:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.301+0000 7f7961c00640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793c06be30 0x7f793c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.302+0000 7f7961c00640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793c06be30 0x7f793c06e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7950001c50 tx=0x7f7950001ba0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.305+0000 7f7959600640 1 -- 172.21.15.7:0/1323411979 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7948049020 con 0x7f795c0b8ae0 2024-08-19T00:45:50.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.526+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f795c0b3250 con 0x7f795c0b8ae0 2024-08-19T00:45:50.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.526+0000 7f7959600640 1 -- 172.21.15.7:0/1323411979 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 199 v199) ==== 95+0+5232 (secure 0 0 0) 0x7f79480797f0 con 0x7f795c0b8ae0 2024-08-19T00:45:50.529 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":199,"btime":"2024-08-19T00:45:46:060595+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2555026980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2555026980},{"type":"v1","addr":"172.21.15.7:6837","nonce":2555026980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":199,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:46.060586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":196,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/3399848835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3399848835},{"type":"v1","addr":"172.21.15.7:6836","nonce":3399848835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8622,"qdb_cluster":[8622]},"id":6}]} 2024-08-19T00:45:50.530 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 199 2024-08-19T00:45:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793c06be30 msgr2=0x7f793c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793c06be30 0x7f793c06e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7950001c50 tx=0x7f7950001ba0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795c0b8ae0 msgr2=0x7f795c15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795c0b8ae0 0x7f795c15c340 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f79480019f0 tx=0x7f79480012d0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 shutdown_connections 2024-08-19T00:45:50.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f793c06be30 0x7f793c06e2f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0b7010 0x7f795c0d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f795c0b8ae0 0x7f795c15c340 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 --2- 172.21.15.7:0/1323411979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79440040d0 0x7f795c0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 >> 172.21.15.7:0/1323411979 conn(0x7f795c08dbf0 msgr2=0x7f795c162550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 shutdown_connections 2024-08-19T00:45:50.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.529+0000 7f7963000640 1 -- 172.21.15.7:0/1323411979 wait complete. 2024-08-19T00:45:50.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 199, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:45:46.060586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8622': {'gid': 8622, 'name': 'c', 'rank': 0, 'incarnation': 196, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/3399848835', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3399848835}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3399848835}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8622, 'qdb_cluster': [8622]} 2024-08-19T00:45:50.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:45:50.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:45:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.702+0000 7fc943600640 1 Processor -- start 2024-08-19T00:45:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.703+0000 7fc943600640 1 -- start start 2024-08-19T00:45:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc943600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c0ce500 0x7fc93c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc943600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc93c0d03c0 0x7fc93c0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc943600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93c06f7f0 con 0x7fc93c159bf0 2024-08-19T00:45:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc943600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc93c0cee80 con 0x7fc93c0d03c0 2024-08-19T00:45:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc943600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c0d0d70 con 0x7fc93c0ce500 2024-08-19T00:45:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc933e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c0ce500 0x7fc93c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc933e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c0ce500 0x7fc93c0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:52114/0 (socket says 172.21.15.7:52114) 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc940c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc93c159bf0 0x7fc93c073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:36562/0 (socket says 172.21.15.7:36562) 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc933e00640 1 -- 172.21.15.7:0/1111513457 learned_addr learned my addr 172.21.15.7:0/1111513457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.704+0000 7fc941600640 1 --2- 172.21.15.7:0/1111513457 >> v2:172.21.15.162:3300/0 conn(0x7fc93c0d03c0 0x7fc93c0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.705+0000 7fc941600640 1 -- 172.21.15.7:0/1111513457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c0ce500 msgr2=0x7fc93c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.705+0000 7fc941600640 1 --2- 172.21.15.7:0/1111513457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c0ce500 0x7fc93c0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.705+0000 7fc941600640 1 -- 172.21.15.7:0/1111513457 >> v1:172.21.15.162:6789/0 conn(0x7fc93c159bf0 legacy=0x7fc93c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.705+0000 7fc941600640 1 -- 172.21.15.7:0/1111513457 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c06f510 con 0x7fc93c0d03c0 2024-08-19T00:45:50.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.706+0000 7fc941600640 1 --2- 172.21.15.7:0/1111513457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0d03c0 0x7fc93c0d0830 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc934009d90 tx=0x7fc93402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a97b2883036866c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.706+0000 7fc93be00640 1 -- 172.21.15.7:0/1111513457 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934031600 con 0x7fc93c0d03c0 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.706+0000 7fc93be00640 1 -- 172.21.15.7:0/1111513457 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340317a0 con 0x7fc93c0d03c0 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.706+0000 7fc93be00640 1 -- 172.21.15.7:0/1111513457 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934031b70 con 0x7fc93c0d03c0 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 -- 172.21.15.7:0/1111513457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0d03c0 msgr2=0x7fc93c0d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 --2- 172.21.15.7:0/1111513457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0d03c0 0x7fc93c0d0830 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc934009d90 tx=0x7fc93402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 -- 172.21.15.7:0/1111513457 shutdown_connections 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 --2- 172.21.15.7:0/1111513457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c0ce500 0x7fc93c0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 --2- 172.21.15.7:0/1111513457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0d03c0 0x7fc93c0d0830 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 -- 172.21.15.7:0/1111513457 >> 172.21.15.7:0/1111513457 conn(0x7fc93c06bc70 msgr2=0x7fc93c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 -- 172.21.15.7:0/1111513457 shutdown_connections 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.707+0000 7fc943600640 1 -- 172.21.15.7:0/1111513457 wait complete. 2024-08-19T00:45:50.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.708+0000 7fc943600640 1 Processor -- start 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.709+0000 7fc943600640 1 -- start start 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.709+0000 7fc943600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0ce500 0x7fc93c1f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc943600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc93c0d03c0 0x7fc93c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc943600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c159bf0 0x7fc93c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc943600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c072f40 con 0x7fc93c0d03c0 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc943600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c072c60 con 0x7fc93c0ce500 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc943600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c073b70 con 0x7fc93c159bf0 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc93c0d03c0 0x7fc93c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc93c0d03c0 0x7fc93c158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43482/0 (socket says 172.21.15.7:43482) 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 -- 172.21.15.7:0/1646702220 learned_addr learned my addr 172.21.15.7:0/1646702220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc940c00640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0ce500 0x7fc93c1f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc941600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c159bf0 0x7fc93c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 -- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c159bf0 msgr2=0x7fc93c156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c159bf0 0x7fc93c156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 -- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0ce500 msgr2=0x7fc93c1f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0ce500 0x7fc93c1f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc933e00640 1 -- 172.21.15.7:0/1646702220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c09a430 con 0x7fc93c0d03c0 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.710+0000 7fc941600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c159bf0 0x7fc93c156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.711+0000 7fc933e00640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc93c0d03c0 0x7fc93c158970 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e870 tx=0x7fc92400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.711+0000 7fc939600640 1 -- 172.21.15.7:0/1646702220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924017070 con 0x7fc93c0d03c0 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.711+0000 7fc939600640 1 -- 172.21.15.7:0/1646702220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92400c940 con 0x7fc93c0d03c0 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.711+0000 7fc939600640 1 -- 172.21.15.7:0/1646702220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92400cd10 con 0x7fc93c0d03c0 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.711+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c09a710 con 0x7fc93c0d03c0 2024-08-19T00:45:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.711+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c09acd0 con 0x7fc93c0d03c0 2024-08-19T00:45:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.713+0000 7fc939600640 1 -- 172.21.15.7:0/1646702220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc92401a070 con 0x7fc93c0d03c0 2024-08-19T00:45:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.715+0000 7fc939600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc91806be30 0x7fc91806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.715+0000 7fc939600640 1 -- 172.21.15.7:0/1646702220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fc92408b610 con 0x7fc93c0d03c0 2024-08-19T00:45:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.715+0000 7fc940c00640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc91806be30 0x7fc91806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.715+0000 7fc9463cd740 1 Processor -- start 2024-08-19T00:45:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc9463cd740 1 -- start start 2024-08-19T00:45:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc940c00640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc91806be30 0x7fc91806e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc92c007fd0 tx=0x7fc92c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d0225b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022596d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225972a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc9463cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d0224cfba0 con 0x55d02256a950 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d022468230 con 0x55d022568950 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.716+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d0224cbb60 con 0x55d0225b3920 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022596d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022596d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43494/0 (socket says 172.21.15.7:43494) 2024-08-19T00:45:50.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 -- 172.21.15.7:0/3543947650 learned_addr learned my addr 172.21.15.7:0/3543947650 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc940c00640 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d0225b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc941600640 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 -- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 msgr2=0x55d0225b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d0225b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 -- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 msgr2=0x55d0225972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 -- 172.21.15.7:0/3543947650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d022499bb0 con 0x55d02256a950 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.717+0000 7fc933e00640 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022596d60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc924061950 tx=0x7fc924058d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d9a14586729655 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc931200640 1 -- 172.21.15.7:0/3543947650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924021070 con 0x55d02256a950 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc931200640 1 -- 172.21.15.7:0/3543947650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924061e80 con 0x55d02256a950 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc931200640 1 -- 172.21.15.7:0/3543947650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9240711c0 con 0x55d02256a950 2024-08-19T00:45:50.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 -- 172.21.15.7:0/3543947650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 msgr2=0x55d022596d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022596d60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc924061950 tx=0x7fc924058d70 comp rx=0 tx=0).stop 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 -- 172.21.15.7:0/3543947650 shutdown_connections 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022596d60 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3543947650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d0225b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 -- 172.21.15.7:0/3543947650 >> 172.21.15.7:0/3543947650 conn(0x55d022534110 msgr2=0x55d0225b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 -- 172.21.15.7:0/3543947650 shutdown_connections 2024-08-19T00:45:50.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.718+0000 7fc9463cd740 1 -- 172.21.15.7:0/3543947650 wait complete. 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.719+0000 7fc9463cd740 1 -- start start 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.719+0000 7fc9463cd740 1 Processor -- start 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022590cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d0225b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc9463cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d0225684c0 con 0x55d02256a950 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d02248b250 con 0x55d022568950 2024-08-19T00:45:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d0225678b0 con 0x55d0225b3920 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc9463cd740 10 client.0 _ll_register_callbacks cb 0x55d02248f740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.720+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022590cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022590cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43506/0 (socket says 172.21.15.7:43506) 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 -- 172.21.15.7:0/3503283689 learned_addr learned my addr 172.21.15.7:0/3503283689 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 -- 172.21.15.7:0/3503283689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 msgr2=0x55d0225b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d0225b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 -- 172.21.15.7:0/3503283689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 msgr2=0x55d0225ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 -- 172.21.15.7:0/3503283689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0221e32d0 con 0x55d02256a950 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc933e00640 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022590cd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc9240557b0 tx=0x7fc92408b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e59e73d07531a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc929600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc929600640 1 -- 172.21.15.7:0/3503283689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924089220 con 0x55d02256a950 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc929600640 1 -- 172.21.15.7:0/3503283689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fc92405d170 con 0x55d02256a950 2024-08-19T00:45:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.721+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc924061e80 con 0x55d02256a950 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc929600640 1 -- 172.21.15.7:0/3503283689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=199) ==== 24+0+0 (secure 0 0 0) 0x7fc92405d370 con 0x55d02256a950 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 10 client.8706 fetch_fsmap learned FSMap version 199 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=199,monmap=2+}) -- 0x55d0222ad6b0 con 0x55d02256a950 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc929600640 1 -- 172.21.15.7:0/3503283689 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924061e80 con 0x55d02256a950 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc929600640 1 -- 172.21.15.7:0/3503283689 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 199) ==== 3502+0+0 (secure 0 0 0) 0x7fc9240781a0 con 0x55d02256a950 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 10 client.8706 fetch_fsmap finished waiting for FSMap version 199 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 10 client.8706 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 20 client.8706 populate_metadata read hostname 'smithi007' 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022591c10 0x55d0225d7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 4 client.8706 mds_command: new command op to 8622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:45:50.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 --> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0224dd2d0 con 0x55d022591c10 2024-08-19T00:45:50.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.722+0000 7fc940c00640 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022591c10 0x55d0225d7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.723+0000 7fc940c00640 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022591c10 0x55d0225d7f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e681a7ddfa64dec0 server_cookie=6679fbd60b22ff38 in_seq=0 out_seq=0 2024-08-19T00:45:50.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.723+0000 7fc929600640 10 client.8706 ms_handle_connect on v2:172.21.15.7:6834/3399848835 2024-08-19T00:45:50.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc929600640 1 -- 172.21.15.7:0/3503283689 <== mds.0 v2:172.21.15.7:6834/3399848835 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0224dd2d0 con 0x55d022591c10 2024-08-19T00:45:50.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc929600640 10 client.8706 handle_command_reply: tid=0 2024-08-19T00:45:50.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 client.8706 shutdown 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 msgr2=0x55d022590cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022590cd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc9240557b0 tx=0x7fc92408b040 comp rx=0 tx=0).stop 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 shutdown_connections 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022591c10 0x55d0225d7f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d0225b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022590cd0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 --2- 172.21.15.7:0/3503283689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc929600640 0 client.8706 ms_handle_reset on v2:172.21.15.7:6834/3399848835 2024-08-19T00:45:50.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 >> 172.21.15.7:0/3503283689 conn(0x55d022534110 msgr2=0x55d022566680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 shutdown_connections 2024-08-19T00:45:50.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 1 -- 172.21.15.7:0/3503283689 wait complete. 2024-08-19T00:45:50.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.724+0000 7fc9463cd740 20 client.8706 trim_cache size 0 max 16384 2024-08-19T00:45:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.743+0000 7fc9463cd740 1 Processor -- start 2024-08-19T00:45:50.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.743+0000 7fc9463cd740 1 -- start start 2024-08-19T00:45:50.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d022568950 0x55d02262a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d02256a950 0x55d022568d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0225b3920 0x55d022569270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc9463cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c0af630 con 0x55d0225b3920 2024-08-19T00:45:50.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c09e1d0 con 0x55d02256a950 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c0aefe0 con 0x55d022568950 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc941600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0225b3920 0x55d022569270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc941600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0225b3920 0x55d022569270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43508/0 (socket says 172.21.15.7:43508) 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc941600640 1 -- 172.21.15.7:0/2793089422 learned_addr learned my addr 172.21.15.7:0/2793089422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc940c00640 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d022568950 0x55d02262a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.744+0000 7fc933e00640 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d02256a950 0x55d022568d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc941600640 1 -- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d022568950 msgr2=0x55d02262a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc941600640 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d022568950 0x55d02262a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc941600640 1 -- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d02256a950 msgr2=0x55d022568d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc941600640 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d02256a950 0x55d022568d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc941600640 1 -- 172.21.15.7:0/2793089422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0225948a0 con 0x55d0225b3920 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc933e00640 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d02256a950 0x55d022568d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:50.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc941600640 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0225b3920 0x55d022569270 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc934009e80 tx=0x7fc93402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1e2d76f1fe5e13 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc92be00640 1 -- 172.21.15.7:0/2793089422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93404b070 con 0x55d0225b3920 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc92be00640 1 -- 172.21.15.7:0/2793089422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93403e800 con 0x55d0225b3920 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.745+0000 7fc92be00640 1 -- 172.21.15.7:0/2793089422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93403ebf0 con 0x55d0225b3920 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 -- 172.21.15.7:0/2793089422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0225b3920 msgr2=0x55d022569270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0225b3920 0x55d022569270 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc934009e80 tx=0x7fc93402c000 comp rx=0 tx=0).stop 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 -- 172.21.15.7:0/2793089422 shutdown_connections 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0225b3920 0x55d022569270 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d02256a950 0x55d022568d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2793089422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d022568950 0x55d02262a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 -- 172.21.15.7:0/2793089422 >> 172.21.15.7:0/2793089422 conn(0x55d022534110 msgr2=0x55d0225cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 -- 172.21.15.7:0/2793089422 shutdown_connections 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.746+0000 7fc9463cd740 1 -- 172.21.15.7:0/2793089422 wait complete. 2024-08-19T00:45:50.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.747+0000 7fc9463cd740 1 -- start start 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.747+0000 7fc9463cd740 1 Processor -- start 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022628890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc9463cd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d022568d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc9463cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d0225684c0 con 0x55d02256a950 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d02248b250 con 0x55d022568950 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc9463cd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d022593760 con 0x55d0225b3920 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc9463cd740 10 client.0 _ll_register_callbacks cb 0x7fc92c004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022628890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022628890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43510/0 (socket says 172.21.15.7:43510) 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 -- 172.21.15.7:0/2927091434 learned_addr learned my addr 172.21.15.7:0/2927091434 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc940c00640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc941600640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d022568d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 -- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 msgr2=0x55d022568d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d022568d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 -- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 msgr2=0x55d0225d47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225d47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc933e00640 1 -- 172.21.15.7:0/2927091434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0225cfde0 con 0x55d02256a950 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc941600640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d022568d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.748+0000 7fc940c00640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc933e00640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022628890 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c520 tx=0x7fc924009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385b2f92f3b4b699 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc929600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc929600640 1 -- 172.21.15.7:0/2927091434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924021070 con 0x55d02256a950 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc929600640 1 -- 172.21.15.7:0/2927091434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fc924073d30 con 0x55d02256a950 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc93403e800 con 0x55d02256a950 2024-08-19T00:45:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc929600640 1 -- 172.21.15.7:0/2927091434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=199) ==== 24+0+0 (secure 0 0 0) 0x7fc924058ad0 con 0x55d02256a950 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 10 client.8712 fetch_fsmap learned FSMap version 199 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=199,monmap=2+}) -- 0x55d0225d18a0 con 0x55d02256a950 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc929600640 1 -- 172.21.15.7:0/2927091434 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93403e800 con 0x55d02256a950 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc929600640 1 -- 172.21.15.7:0/2927091434 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 199) ==== 3502+0+0 (secure 0 0 0) 0x7fc9240550a0 con 0x55d02256a950 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 10 client.8712 fetch_fsmap finished waiting for FSMap version 199 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 10 client.8712 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 20 client.8712 populate_metadata read hostname 'smithi007' 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022595e80 0x55d022596260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 4 client.8712 mds_command: new command op to 8622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.749+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 --> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] -- command(tid 0: {"prefix": "status"}) -- 0x55d0224d7620 con 0x55d022595e80 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.750+0000 7fc940c00640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022595e80 0x55d022596260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.750+0000 7fc940c00640 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022595e80 0x55d022596260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2109986975c7826 server_cookie=6a02c2d60e8188d8 in_seq=0 out_seq=0 2024-08-19T00:45:50.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.750+0000 7fc929600640 10 client.8712 ms_handle_connect on v2:172.21.15.7:6834/3399848835 2024-08-19T00:45:50.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.750+0000 7fc929600640 1 -- 172.21.15.7:0/2927091434 <== mds.0 v2:172.21.15.7:6834/3399848835 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55d0224d7620 con 0x55d022595e80 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.750+0000 7fc929600640 10 client.8712 handle_command_reply: tid=0 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.750+0000 7fc9463cd740 1 client.8712 shutdown 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 msgr2=0x55d022628890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022628890 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c520 tx=0x7fc924009630 comp rx=0 tx=0).stop 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 shutdown_connections 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:6834/3399848835,v1:172.21.15.7:6836/3399848835] conn(0x55d022595e80 0x55d022596260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d0225b3920 0x55d022568d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d02256a950 0x55d022628890 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc929600640 0 client.8712 ms_handle_reset on v2:172.21.15.7:6834/3399848835 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 --2- 172.21.15.7:0/2927091434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d022568950 0x55d0225d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 >> 172.21.15.7:0/2927091434 conn(0x55d022534110 msgr2=0x55d0225ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 shutdown_connections 2024-08-19T00:45:50.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 1 -- 172.21.15.7:0/2927091434 wait complete. 2024-08-19T00:45:50.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.751+0000 7fc9463cd740 20 client.8712 trim_cache size 0 max 16384 2024-08-19T00:45:50.759 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:45:50.759 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:45:50.759 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:45:50.759 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8622, 2024-08-19T00:45:50.759 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 7.7095189880000001, 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 199, 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 104, 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 104, 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.978630096 2024-08-19T00:45:50.760 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc91806be30 msgr2=0x7fc91806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc91806be30 0x7fc91806e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc92c007fd0 tx=0x7fc92c007e80 comp rx=0 tx=0).stop 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc93c0d03c0 msgr2=0x7fc93c158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc93c0d03c0 0x7fc93c158970 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e870 tx=0x7fc92400ed30 comp rx=0 tx=0).stop 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 shutdown_connections 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc91806be30 0x7fc91806e2f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93c159bf0 0x7fc93c156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc93c0d03c0 0x7fc93c158970 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 --2- 172.21.15.7:0/1646702220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93c0ce500 0x7fc93c1f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 >> 172.21.15.7:0/1646702220 conn(0x7fc93c06bc70 msgr2=0x7fc93c15f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 shutdown_connections 2024-08-19T00:45:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.752+0000 7fc943600640 1 -- 172.21.15.7:0/1646702220 wait complete. 2024-08-19T00:45:50.770 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:45:50.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:50.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.925+0000 7fcb1b800640 1 Processor -- start 2024-08-19T00:45:50.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.925+0000 7fcb1b800640 1 -- start start 2024-08-19T00:45:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.926+0000 7fcb1b800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcb14071980 0x7fcb140cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.926+0000 7fcb1b800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb140cdfb0 con 0x7fcb140d03c0 2024-08-19T00:45:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.926+0000 7fcb1b800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb140ce290 con 0x7fcb1406e710 2024-08-19T00:45:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.926+0000 7fcb1b800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcb140cebc0 con 0x7fcb14071980 2024-08-19T00:45:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb18e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcb140d03c0 0x7fcb140d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40560/0 (socket says 172.21.15.7:40560) 2024-08-19T00:45:50.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb18e00640 1 -- 172.21.15.7:0/111390514 learned_addr learned my addr 172.21.15.7:0/111390514 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb19800640 1 --2- 172.21.15.7:0/111390514 >> v2:172.21.15.162:3300/0 conn(0x7fcb14071980 0x7fcb140cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078134832 0 0) 0x7fcb140cdfb0 con 0x7fcb140d03c0 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcafc003520 con 0x7fcb140d03c0 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398437695 0 0) 0x7fcb140ce290 con 0x7fcb1406e710 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb140cdfb0 con 0x7fcb1406e710 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4067762370 0 0) 0x7fcafc003520 con 0x7fcb140d03c0 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 >> v2:172.21.15.162:3300/0 conn(0x7fcb14071980 msgr2=0x7fcb140cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 --2- 172.21.15.7:0/111390514 >> v2:172.21.15.162:3300/0 conn(0x7fcb14071980 0x7fcb140cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 >> v1:172.21.15.162:6789/0 conn(0x7fcb1406e710 legacy=0x7fcb140b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.927+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb140ce570 con 0x7fcb140d03c0 2024-08-19T00:45:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fcb08001670 con 0x7fcb140d03c0 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 >> v1:172.21.15.7:6789/0 conn(0x7fcb140d03c0 legacy=0x7fcb140d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc003b40 0x7fcafc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcafc004800 0x7fcafc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcafc0051c0 0x7fcafc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb140cebc0 con 0x7fcafc0051c0 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc00c040 con 0x7fcafc003b40 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc00c240 con 0x7fcafc004800 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb19800640 1 --2- 172.21.15.7:0/111390514 >> v2:172.21.15.162:3300/0 conn(0x7fcb14071980 0x7fcb140cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb19800640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcafc0051c0 0x7fcafc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb18e00640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc003b40 0x7fcafc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb13e00640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcafc004800 0x7fcafc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb19800640 1 -- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcafc004800 msgr2=0x7fcafc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb19800640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcafc004800 0x7fcafc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb19800640 1 -- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc003b40 msgr2=0x7fcafc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb19800640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc003b40 0x7fcafc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.928+0000 7fcb19800640 1 -- 172.21.15.7:0/111390514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc003520 con 0x7fcafc0051c0 2024-08-19T00:45:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.929+0000 7fcb19800640 1 -- 172.21.15.7:0/111390514 reap_dead start 2024-08-19T00:45:50.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.929+0000 7fcb19800640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcafc0051c0 0x7fcafc00b9c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009d80 tx=0x7fcafc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18be01d361dc1cab server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c009dc0 con 0x7fcafc0051c0 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb0c003bb0 con 0x7fcafc0051c0 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb13400640 1 -- 172.21.15.7:0/111390514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004020 con 0x7fcafc0051c0 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb1b800640 1 -- 172.21.15.7:0/111390514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcafc0051c0 msgr2=0x7fcafc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb1b800640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcafc0051c0 0x7fcafc00b9c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009d80 tx=0x7fcafc005830 comp rx=0 tx=0).stop 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb1b800640 1 -- 172.21.15.7:0/111390514 shutdown_connections 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb1b800640 1 --2- 172.21.15.7:0/111390514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcafc0051c0 0x7fcafc00b9c0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb1b800640 1 -- 172.21.15.7:0/111390514 >> 172.21.15.7:0/111390514 conn(0x7fcb1406bc70 msgr2=0x7fcb1406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb1b800640 1 -- 172.21.15.7:0/111390514 shutdown_connections 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.930+0000 7fcb1b800640 1 -- 172.21.15.7:0/111390514 wait complete. 2024-08-19T00:45:50.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.932+0000 7fcb1b800640 1 Processor -- start 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.932+0000 7fcb1b800640 1 -- start start 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb1b800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc0051c0 0x7fcb14159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb1b800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb14152dc0 0x7fcb1415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb1b800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb1415ebf0 0x7fcb1415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb1b800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14073c60 con 0x7fcb14152dc0 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb1b800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14073ae0 con 0x7fcafc0051c0 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb1b800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcb140d07a0 con 0x7fcb1415ebf0 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb14152dc0 0x7fcb1415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb14152dc0 0x7fcb1415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43534/0 (socket says 172.21.15.7:43534) 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb13e00640 1 -- 172.21.15.7:0/1196710921 learned_addr learned my addr 172.21.15.7:0/1196710921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.933+0000 7fcb19800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb1415ebf0 0x7fcb1415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb18e00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc0051c0 0x7fcb14159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb13e00640 1 -- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb1415ebf0 msgr2=0x7fcb1415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb13e00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb1415ebf0 0x7fcb1415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb13e00640 1 -- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc0051c0 msgr2=0x7fcb14159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb13e00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc0051c0 0x7fcb14159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb13e00640 1 -- 172.21.15.7:0/1196710921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb14155730 con 0x7fcb14152dc0 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb19800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb1415ebf0 0x7fcb1415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb18e00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc0051c0 0x7fcb14159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb13e00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb14152dc0 0x7fcb1415a4c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000f7d0 tx=0x7fcb0000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb10c00640 1 -- 172.21.15.7:0/1196710921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0001a070 con 0x7fcb14152dc0 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb10c00640 1 -- 172.21.15.7:0/1196710921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb0000fe80 con 0x7fcb14152dc0 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb10c00640 1 -- 172.21.15.7:0/1196710921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00007050 con 0x7fcb14152dc0 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb141559d0 con 0x7fcb14152dc0 2024-08-19T00:45:50.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.934+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb14155f90 con 0x7fcb14152dc0 2024-08-19T00:45:50.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.935+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb140b3230 con 0x7fcb14152dc0 2024-08-19T00:45:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.936+0000 7fcb10c00640 1 -- 172.21.15.7:0/1196710921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb000071f0 con 0x7fcb14152dc0 2024-08-19T00:45:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.937+0000 7fcb10c00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaf406be30 0x7fcaf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.937+0000 7fcb10c00640 1 -- 172.21.15.7:0/1196710921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fcb0008ac20 con 0x7fcb14152dc0 2024-08-19T00:45:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.938+0000 7fcb18e00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaf406be30 0x7fcaf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:50.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.938+0000 7fcb18e00640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaf406be30 0x7fcaf406e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcb141f1cb0 tx=0x7fcb08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:50.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:50.942+0000 7fcb10c00640 1 -- 172.21.15.7:0/1196710921 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcb140b3230 con 0x7fcb14152dc0 2024-08-19T00:45:51.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.162+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb1415ac00 con 0x7fcb14152dc0 2024-08-19T00:45:51.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.163+0000 7fcb10c00640 1 -- 172.21.15.7:0/1196710921 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 199 v199) ==== 95+0+5232 (secure 0 0 0) 0x7fcb1415ac00 con 0x7fcb14152dc0 2024-08-19T00:45:51.166 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:51.166 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":199,"btime":"2024-08-19T00:45:46:060595+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2555026980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2555026980},{"type":"v1","addr":"172.21.15.7:6837","nonce":2555026980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":199,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:46.060586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":196,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/3399848835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3399848835},{"type":"v1","addr":"172.21.15.7:6836","nonce":3399848835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8622,"qdb_cluster":[8622]},"id":6}]} 2024-08-19T00:45:51.167 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 199 2024-08-19T00:45:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaf406be30 msgr2=0x7fcaf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaf406be30 0x7fcaf406e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcb141f1cb0 tx=0x7fcb08009040 comp rx=0 tx=0).stop 2024-08-19T00:45:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb14152dc0 msgr2=0x7fcb1415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb14152dc0 0x7fcb1415a4c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000f7d0 tx=0x7fcb0000fc90 comp rx=0 tx=0).stop 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 shutdown_connections 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaf406be30 0x7fcaf406e2f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb1415ebf0 0x7fcb1415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb14152dc0 0x7fcb1415a4c0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.165+0000 7fcb1b800640 1 --2- 172.21.15.7:0/1196710921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc0051c0 0x7fcb14159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.166+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 >> 172.21.15.7:0/1196710921 conn(0x7fcb1406bc70 msgr2=0x7fcb140cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.166+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 shutdown_connections 2024-08-19T00:45:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.166+0000 7fcb1b800640 1 -- 172.21.15.7:0/1196710921 wait complete. 2024-08-19T00:45:51.185 INFO:tasks.cephfs.test_damage:Mutation 'Corrupt 500.00000000' did not prevent MDS startup, attempting ls... 2024-08-19T00:45:51.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:45:51.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.344+0000 7f098ea00640 1 Processor -- start 2024-08-19T00:45:51.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.344+0000 7f098ea00640 1 -- start start 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f098ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09880ce500 0x7f09880ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f098ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880d03c0 0x7f09880d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f098ea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f098806f7f0 con 0x7f0988159bf0 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f098ea00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f09880d0d50 con 0x7f09880ce500 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f098ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f098806f510 con 0x7f09880d03c0 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f097fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09880ce500 0x7f09880ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f097fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09880ce500 0x7f09880ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43538/0 (socket says 172.21.15.7:43538) 2024-08-19T00:45:51.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f097fe00640 1 -- 172.21.15.7:0/1472533054 learned_addr learned my addr 172.21.15.7:0/1472533054 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f098ca00640 1 --2- 172.21.15.7:0/1472533054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880d03c0 0x7f09880d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f097fe00640 1 -- 172.21.15.7:0/1472533054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880d03c0 msgr2=0x7f09880d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f097fe00640 1 --2- 172.21.15.7:0/1472533054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880d03c0 0x7f09880d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.345+0000 7f097fe00640 1 -- 172.21.15.7:0/1472533054 >> v1:172.21.15.162:6789/0 conn(0x7f0988159bf0 legacy=0x7f0988073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.346+0000 7f097fe00640 1 -- 172.21.15.7:0/1472533054 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0988072980 con 0x7f09880ce500 2024-08-19T00:45:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.346+0000 7f097fe00640 1 --2- 172.21.15.7:0/1472533054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880ce500 0x7f09880ce970 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0970009870 tx=0x7f097002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d623f2ba4f3876 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f0987400640 1 -- 172.21.15.7:0/1472533054 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970037070 con 0x7f09880ce500 2024-08-19T00:45:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f0987400640 1 -- 172.21.15.7:0/1472533054 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0970032440 con 0x7f09880ce500 2024-08-19T00:45:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f0987400640 1 -- 172.21.15.7:0/1472533054 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970032810 con 0x7f09880ce500 2024-08-19T00:45:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f098ea00640 1 -- 172.21.15.7:0/1472533054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880ce500 msgr2=0x7f09880ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f098ea00640 1 --2- 172.21.15.7:0/1472533054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880ce500 0x7f09880ce970 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0970009870 tx=0x7f097002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f098ea00640 1 -- 172.21.15.7:0/1472533054 shutdown_connections 2024-08-19T00:45:51.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f098ea00640 1 --2- 172.21.15.7:0/1472533054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880d03c0 0x7f09880d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f098ea00640 1 --2- 172.21.15.7:0/1472533054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880ce500 0x7f09880ce970 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.347+0000 7f098ea00640 1 -- 172.21.15.7:0/1472533054 >> 172.21.15.7:0/1472533054 conn(0x7f098806bc70 msgr2=0x7f098806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:51.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.348+0000 7f098ea00640 1 -- 172.21.15.7:0/1472533054 shutdown_connections 2024-08-19T00:45:51.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.348+0000 7f098ea00640 1 -- 172.21.15.7:0/1472533054 wait complete. 2024-08-19T00:45:51.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.349+0000 7f098ea00640 1 Processor -- start 2024-08-19T00:45:51.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.349+0000 7f098ea00640 1 -- start start 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f098ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880ce500 0x7f098809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f098ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880d03c0 0x7f0988150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f098ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0988159bf0 0x7f098809c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f098ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0988073b70 con 0x7f09880d03c0 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f098ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0988072f40 con 0x7f0988159bf0 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f098ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0988159fd0 con 0x7f09880ce500 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f097fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880d03c0 0x7f0988150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f097fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880d03c0 0x7f0988150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43546/0 (socket says 172.21.15.7:43546) 2024-08-19T00:45:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.350+0000 7f097fe00640 1 -- 172.21.15.7:0/1543918928 learned_addr learned my addr 172.21.15.7:0/1543918928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f097fe00640 1 -- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880ce500 msgr2=0x7f098809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f097fe00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880ce500 0x7f098809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f098ca00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0988159bf0 0x7f098809c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f097fe00640 1 -- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0988159bf0 msgr2=0x7f098809c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f097fe00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0988159bf0 0x7f098809c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f097fe00640 1 -- 172.21.15.7:0/1543918928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0988160530 con 0x7f09880d03c0 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f098ca00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0988159bf0 0x7f098809c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f097fe00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880d03c0 0x7f0988150f70 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f0970000c00 tx=0x7f09700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f0984c00640 1 -- 172.21.15.7:0/1543918928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970041020 con 0x7f09880d03c0 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f0984c00640 1 -- 172.21.15.7:0/1543918928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09700306c0 con 0x7f09880d03c0 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f0984c00640 1 -- 172.21.15.7:0/1543918928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970037040 con 0x7f09880d03c0 2024-08-19T00:45:51.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.351+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09881607a0 con 0x7f09880d03c0 2024-08-19T00:45:51.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.352+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09881514b0 con 0x7f09880d03c0 2024-08-19T00:45:51.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.353+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f098809bad0 con 0x7f09880d03c0 2024-08-19T00:45:51.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.354+0000 7f0984c00640 1 -- 172.21.15.7:0/1543918928 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0970044020 con 0x7f09880d03c0 2024-08-19T00:45:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.355+0000 7f0984c00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f096406be30 0x7f096406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.355+0000 7f0984c00640 1 -- 172.21.15.7:0/1543918928 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7f09700abc60 con 0x7f09880d03c0 2024-08-19T00:45:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.355+0000 7f0987e00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f096406be30 0x7f096406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.356+0000 7f0987e00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f096406be30 0x7f096406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0978000f60 tx=0x7f09780079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.359+0000 7f0984c00640 1 -- 172.21.15.7:0/1543918928 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f097004b030 con 0x7f09880d03c0 2024-08-19T00:45:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.582+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f09880d0810 con 0x7f09880d03c0 2024-08-19T00:45:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.583+0000 7f0984c00640 1 -- 172.21.15.7:0/1543918928 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v199) ==== 53+0+73 (secure 0 0 0) 0x7f097007a090 con 0x7f09880d03c0 2024-08-19T00:45:51.585 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f096406be30 msgr2=0x7f096406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f096406be30 0x7f096406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0978000f60 tx=0x7f09780079d0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880d03c0 msgr2=0x7f0988150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880d03c0 0x7f0988150f70 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f0970000c00 tx=0x7f09700046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 shutdown_connections 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f096406be30 0x7f096406e2f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0988159bf0 0x7f098809c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09880d03c0 0x7f0988150f70 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 --2- 172.21.15.7:0/1543918928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09880ce500 0x7f098809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 >> 172.21.15.7:0/1543918928 conn(0x7f098806bc70 msgr2=0x7f098815b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 shutdown_connections 2024-08-19T00:45:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51.585+0000 7f098ea00640 1 -- 172.21.15.7:0/1543918928 wait complete. 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:45:51.603 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:45:51.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:51.604 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:45:51.640 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42310sec preferred_lft 42310sec 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:45:51.641 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:45:51.642 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:45:51.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:51.643 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:45:51.734 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:45:51.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:51.737 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:45:51.773 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:45:51.773 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:45:51.773 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:45:51.773 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:45:51.773 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:45:51.774 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:45:51.774 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:45:51.774 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:45:51.774 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:45:51.774 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:45:51.774 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:45:51.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:45:51.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:45:51.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:51.972 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:45:52.008 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:45:52.008 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:45:52.008 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:45:52.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:52.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:45:52.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:45:52.105 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:52.141 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:45:52.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:45:52.141 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:52.216 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:45:52.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:52.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:52.347 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:52.347 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:45:52.347 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:45:52.362 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:52.363 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:45:52.363 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:45:52.363 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:45:52.363 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:45:52.385 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:45:52.385 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:45:52.385 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:45:52.385 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:45:52.385 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:45:52.385 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:45:52.386 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:45:52.386 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:45:52.387 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:45:52.387 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:45:52.387 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:45:52.387 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:45:52.387 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:45:52.390 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:45:52.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:52.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:45:52.446 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:45:52.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:45:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:45:52.536 INFO:teuthology.orchestra.run.smithi007.stdout:client7220 2024-08-19T00:45:52.536 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:52.537 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:52.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:52.572 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:45:52.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:52.617 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir foo) 2024-08-19T00:45:52.651 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:45:52.651 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:45:52.651 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:52.651 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:45:52.651 INFO:teuthology.orchestra.run.smithi007.stdout:sixmegs 2024-08-19T00:45:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:mkdir: cannot create directory ‘foo’: Read-only file system 2024-08-19T00:45:52.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:52.685 INFO:tasks.cephfs.test_damage:mkdir: cannot create directory ‘foo’: Read-only file system 2024-08-19T00:45:52.686 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt mds_snaptable' 2024-08-19T00:45:52.686 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:52.686 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:52.762 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:52.762 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:52.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:45:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.034+0000 7fa254a00640 1 Processor -- start 2024-08-19T00:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.034+0000 7fa254a00640 1 -- start start 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa254a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa250159bf0 0x7fa250073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa254a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa2500739a0 0x7fa2500ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa254a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2500cea40 0x7fa2500d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa254a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa25006f7f0 con 0x7fa250159bf0 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa254a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa25006f510 con 0x7fa2500739a0 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa254a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa250072980 con 0x7fa2500cea40 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa24de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa250159bf0 0x7fa250073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa24de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa250159bf0 0x7fa250073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43550/0 (socket says 172.21.15.7:43550) 2024-08-19T00:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa24de00640 1 -- 172.21.15.7:0/2656611145 learned_addr learned my addr 172.21.15.7:0/2656611145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa247e00640 1 --2- 172.21.15.7:0/2656611145 >> v2:172.21.15.162:3300/0 conn(0x7fa2500739a0 0x7fa2500ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.035+0000 7fa24e800640 1 --2- 172.21.15.7:0/2656611145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2500cea40 0x7fa2500d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.036+0000 7fa24de00640 1 -- 172.21.15.7:0/2656611145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2500cea40 msgr2=0x7fa2500d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.036+0000 7fa24de00640 1 --2- 172.21.15.7:0/2656611145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2500cea40 0x7fa2500d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.036+0000 7fa24de00640 1 -- 172.21.15.7:0/2656611145 >> v2:172.21.15.162:3300/0 conn(0x7fa2500739a0 msgr2=0x7fa2500ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.036+0000 7fa24de00640 1 --2- 172.21.15.7:0/2656611145 >> v2:172.21.15.162:3300/0 conn(0x7fa2500739a0 0x7fa2500ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.036+0000 7fa24de00640 1 -- 172.21.15.7:0/2656611145 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa250072c60 con 0x7fa250159bf0 2024-08-19T00:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.036+0000 7fa24e800640 1 --2- 172.21.15.7:0/2656611145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2500cea40 0x7fa2500d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:53.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.037+0000 7fa24de00640 1 --2- 172.21.15.7:0/2656611145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa250159bf0 0x7fa250073460 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa2500b1cc0 tx=0x7fa24002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfd5a8a90921011 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:53.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.037+0000 7fa24d400640 1 -- 172.21.15.7:0/2656611145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240037070 con 0x7fa250159bf0 2024-08-19T00:45:53.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.037+0000 7fa24d400640 1 -- 172.21.15.7:0/2656611145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa240032440 con 0x7fa250159bf0 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.037+0000 7fa24d400640 1 -- 172.21.15.7:0/2656611145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240032810 con 0x7fa250159bf0 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.037+0000 7fa254a00640 1 -- 172.21.15.7:0/2656611145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa250159bf0 msgr2=0x7fa250073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.037+0000 7fa254a00640 1 --2- 172.21.15.7:0/2656611145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa250159bf0 0x7fa250073460 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa2500b1cc0 tx=0x7fa24002a140 comp rx=0 tx=0).stop 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.038+0000 7fa254a00640 1 -- 172.21.15.7:0/2656611145 shutdown_connections 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.038+0000 7fa254a00640 1 --2- 172.21.15.7:0/2656611145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2500cea40 0x7fa2500d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.038+0000 7fa254a00640 1 --2- 172.21.15.7:0/2656611145 >> v2:172.21.15.162:3300/0 conn(0x7fa2500739a0 0x7fa2500ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.038+0000 7fa254a00640 1 --2- 172.21.15.7:0/2656611145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa250159bf0 0x7fa250073460 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.038+0000 7fa254a00640 1 -- 172.21.15.7:0/2656611145 >> 172.21.15.7:0/2656611145 conn(0x7fa25006bc70 msgr2=0x7fa25006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.038+0000 7fa254a00640 1 -- 172.21.15.7:0/2656611145 shutdown_connections 2024-08-19T00:45:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.038+0000 7fa254a00640 1 -- 172.21.15.7:0/2656611145 wait complete. 2024-08-19T00:45:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.039+0000 7fa254a00640 1 Processor -- start 2024-08-19T00:45:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.039+0000 7fa254a00640 1 -- start start 2024-08-19T00:45:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.040+0000 7fa254a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2500739a0 0x7fa250154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.040+0000 7fa254a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2500cea40 0x7fa25009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.040+0000 7fa254a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa250159bf0 0x7fa25009a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.040+0000 7fa254a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa25015a150 con 0x7fa2500739a0 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.040+0000 7fa254a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa250159fd0 con 0x7fa2500cea40 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.040+0000 7fa254a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2500d0900 con 0x7fa250159bf0 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2500739a0 0x7fa250154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2500739a0 0x7fa250154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43554/0 (socket says 172.21.15.7:43554) 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 -- 172.21.15.7:0/3550714947 learned_addr learned my addr 172.21.15.7:0/3550714947 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa247e00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2500cea40 0x7fa25009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24e800640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa250159bf0 0x7fa25009a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 -- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa250159bf0 msgr2=0x7fa25009a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa250159bf0 0x7fa25009a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 -- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2500cea40 msgr2=0x7fa25009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2500cea40 0x7fa25009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 -- 172.21.15.7:0/3550714947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25009aa30 con 0x7fa2500739a0 2024-08-19T00:45:53.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.041+0000 7fa24de00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2500739a0 0x7fa250154e90 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa24002a180 tx=0x7fa2400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:53.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.042+0000 7fa246000640 1 -- 172.21.15.7:0/3550714947 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240037040 con 0x7fa2500739a0 2024-08-19T00:45:53.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.042+0000 7fa246000640 1 -- 172.21.15.7:0/3550714947 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa240042070 con 0x7fa2500739a0 2024-08-19T00:45:53.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.042+0000 7fa246000640 1 -- 172.21.15.7:0/3550714947 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240030880 con 0x7fa2500739a0 2024-08-19T00:45:53.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.042+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25009ad10 con 0x7fa2500739a0 2024-08-19T00:45:53.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.042+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25009b2d0 con 0x7fa2500739a0 2024-08-19T00:45:53.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.043+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2500d03c0 con 0x7fa2500739a0 2024-08-19T00:45:53.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.044+0000 7fa246000640 1 -- 172.21.15.7:0/3550714947 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa240030a20 con 0x7fa2500739a0 2024-08-19T00:45:53.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.045+0000 7fa246000640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa22c06be30 0x7fa22c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.045+0000 7fa246000640 1 -- 172.21.15.7:0/3550714947 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fa2400abc60 con 0x7fa2500739a0 2024-08-19T00:45:53.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.045+0000 7fa247e00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa22c06be30 0x7fa22c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.046+0000 7fa247e00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa22c06be30 0x7fa22c06e2f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa2501f50c0 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:53.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.049+0000 7fa246000640 1 -- 172.21.15.7:0/3550714947 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa240079ff0 con 0x7fa2500739a0 2024-08-19T00:45:53.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.244+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2500b20b0 con 0x7fa2500739a0 2024-08-19T00:45:53.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.245+0000 7fa246000640 1 -- 172.21.15.7:0/3550714947 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 36 entries v104) ==== 81+0+2164 (secure 0 0 0) 0x7fa2400798f0 con 0x7fa2500739a0 2024-08-19T00:45:53.248 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:45:53.248 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:45:53.248 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:45:53.248 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:45:53.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:45:53.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:45:53.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:45:53.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:45:53.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:45:53.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:45:53.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:45:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:45:53.251 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:45:53.252 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:45:53.252 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:45:53.252 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:45:53.252 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:listed 36 entries 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa22c06be30 msgr2=0x7fa22c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa22c06be30 0x7fa22c06e2f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa2501f50c0 tx=0x7fa238008040 comp rx=0 tx=0).stop 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2500739a0 msgr2=0x7fa250154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2500739a0 0x7fa250154e90 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa24002a180 tx=0x7fa2400046c0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 shutdown_connections 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa22c06be30 0x7fa22c06e2f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa250159bf0 0x7fa25009a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2500cea40 0x7fa25009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 --2- 172.21.15.7:0/3550714947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2500739a0 0x7fa250154e90 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 >> 172.21.15.7:0/3550714947 conn(0x7fa25006bc70 msgr2=0x7fa25006c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 shutdown_connections 2024-08-19T00:45:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.247+0000 7fa254a00640 1 -- 172.21.15.7:0/3550714947 wait complete. 2024-08-19T00:45:53.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:45:53.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:53.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:45:53.347 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:53.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:53.347 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:53.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:53.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.580+0000 7fcce1800640 1 Processor -- start 2024-08-19T00:45:53.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.580+0000 7fcce1800640 1 -- start start 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.581+0000 7fcce1800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccdc09aa70 0x7fccdc09ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.581+0000 7fcce1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09b730 0x7fccdc06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.581+0000 7fcce1800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc09b390 con 0x7fccdc161f20 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.581+0000 7fcce1800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc15ec30 con 0x7fccdc09aa70 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.581+0000 7fcce1800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fccdc15ef10 con 0x7fccdc09b730 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.581+0000 7fccdaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccdc09aa70 0x7fccdc09ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.582+0000 7fccdaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccdc09aa70 0x7fccdc09ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43560/0 (socket says 172.21.15.7:43560) 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.582+0000 7fccdaa00640 1 -- 172.21.15.7:0/1868120183 learned_addr learned my addr 172.21.15.7:0/1868120183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.582+0000 7fccda000640 1 --2- 172.21.15.7:0/1868120183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09b730 0x7fccdc06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.582+0000 7fccdaa00640 1 -- 172.21.15.7:0/1868120183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09b730 msgr2=0x7fccdc06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:53.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.582+0000 7fccdaa00640 1 --2- 172.21.15.7:0/1868120183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09b730 0x7fccdc06fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.582+0000 7fccdaa00640 1 -- 172.21.15.7:0/1868120183 >> v1:172.21.15.162:6789/0 conn(0x7fccdc161f20 legacy=0x7fccdc1623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:53.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.582+0000 7fccdaa00640 1 -- 172.21.15.7:0/1868120183 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc15f1f0 con 0x7fccdc09aa70 2024-08-19T00:45:53.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.583+0000 7fccdaa00640 1 --2- 172.21.15.7:0/1868120183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09aa70 0x7fccdc09ae50 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0098a0 tx=0x7fcccc02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ec7f917ba6055a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:53.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.583+0000 7fccd9600640 1 -- 172.21.15.7:0/1868120183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc037070 con 0x7fccdc09aa70 2024-08-19T00:45:53.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.583+0000 7fccd9600640 1 -- 172.21.15.7:0/1868120183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc032440 con 0x7fccdc09aa70 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.583+0000 7fccd9600640 1 -- 172.21.15.7:0/1868120183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc032810 con 0x7fccdc09aa70 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 -- 172.21.15.7:0/1868120183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09aa70 msgr2=0x7fccdc09ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 --2- 172.21.15.7:0/1868120183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09aa70 0x7fccdc09ae50 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0098a0 tx=0x7fcccc02a290 comp rx=0 tx=0).stop 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 -- 172.21.15.7:0/1868120183 shutdown_connections 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 --2- 172.21.15.7:0/1868120183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09b730 0x7fccdc06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 --2- 172.21.15.7:0/1868120183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09aa70 0x7fccdc09ae50 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 -- 172.21.15.7:0/1868120183 >> 172.21.15.7:0/1868120183 conn(0x7fccdc0d2190 msgr2=0x7fccdc0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 -- 172.21.15.7:0/1868120183 shutdown_connections 2024-08-19T00:45:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.584+0000 7fcce1800640 1 -- 172.21.15.7:0/1868120183 wait complete. 2024-08-19T00:45:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.586+0000 7fcce1800640 1 Processor -- start 2024-08-19T00:45:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.586+0000 7fcce1800640 1 -- start start 2024-08-19T00:45:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fcce1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09aa70 0x7fccdc0b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fcce1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09b730 0x7fccdc0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fcce1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccdc161f20 0x7fccdc15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fcce1800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc15e8f0 con 0x7fccdc09b730 2024-08-19T00:45:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fcce1800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc070170 con 0x7fccdc161f20 2024-08-19T00:45:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fcce1800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fccdc162ae0 con 0x7fccdc09aa70 2024-08-19T00:45:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fccda000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09b730 0x7fccdc0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fccda000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09b730 0x7fccdc0b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43572/0 (socket says 172.21.15.7:43572) 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fccda000640 1 -- 172.21.15.7:0/946352238 learned_addr learned my addr 172.21.15.7:0/946352238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fccdaa00640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09aa70 0x7fccdc0b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.587+0000 7fccdb400640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccdc161f20 0x7fccdc15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccda000640 1 -- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09aa70 msgr2=0x7fccdc0b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccda000640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09aa70 0x7fccdc0b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccda000640 1 -- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccdc161f20 msgr2=0x7fccdc15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccda000640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccdc161f20 0x7fccdc15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccda000640 1 -- 172.21.15.7:0/946352238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc0b0d20 con 0x7fccdc09b730 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccdaa00640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09aa70 0x7fccdc0b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccda000640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09b730 0x7fccdc0b07e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d800 tx=0x7fccc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccd2a00640 1 -- 172.21.15.7:0/946352238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8004020 con 0x7fccdc09b730 2024-08-19T00:45:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccd2a00640 1 -- 172.21.15.7:0/946352238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc80041c0 con 0x7fccdc09b730 2024-08-19T00:45:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fccd2a00640 1 -- 172.21.15.7:0/946352238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8004390 con 0x7fccdc09b730 2024-08-19T00:45:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc0b0fc0 con 0x7fccdc09b730 2024-08-19T00:45:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.588+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc0b77a0 con 0x7fccdc09b730 2024-08-19T00:45:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.589+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc09ae50 con 0x7fccdc09b730 2024-08-19T00:45:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.590+0000 7fccd2a00640 1 -- 172.21.15.7:0/946352238 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccc801b020 con 0x7fccdc09b730 2024-08-19T00:45:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.591+0000 7fccd2a00640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fccbc06be30 0x7fccbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.591+0000 7fccd2a00640 1 -- 172.21.15.7:0/946352238 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 7257+0+0 (secure 0 0 0) 0x7fccc808b200 con 0x7fccdc09b730 2024-08-19T00:45:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.592+0000 7fccdaa00640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fccbc06be30 0x7fccbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.592+0000 7fccdaa00640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fccbc06be30 0x7fccbc06e2f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcccc034000 tx=0x7fcccc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:53.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.596+0000 7fccd2a00640 1 -- 172.21.15.7:0/946352238 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fccc8059590 con 0x7fccdc09b730 2024-08-19T00:45:53.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.815+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fccdc0d2cb0 con 0x7fccdc09b730 2024-08-19T00:45:53.818 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:53.816+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.818+0000 7fccd2a00640 1 -- 172.21.15.7:0/946352238 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v200) ==== 161+0+0 (secure 0 0 0) 0x7fccc8058e90 con 0x7fccdc09b730 2024-08-19T00:45:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.821+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fccbc06be30 msgr2=0x7fccbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.821+0000 7fcce1800640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fccbc06be30 0x7fccbc06e2f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcccc034000 tx=0x7fcccc02e000 comp rx=0 tx=0).stop 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.821+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09b730 msgr2=0x7fccdc0b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.821+0000 7fcce1800640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09b730 0x7fccdc0b07e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d800 tx=0x7fccc800dcc0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 shutdown_connections 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fccbc06be30 0x7fccbc06e2f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccdc161f20 0x7fccdc15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc09b730 0x7fccdc0b07e0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 --2- 172.21.15.7:0/946352238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccdc09aa70 0x7fccdc0b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 >> 172.21.15.7:0/946352238 conn(0x7fccdc0d2190 msgr2=0x7fccdc15fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 shutdown_connections 2024-08-19T00:45:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:53.822+0000 7fcce1800640 1 -- 172.21.15.7:0/946352238 wait complete. 2024-08-19T00:45:53.827 INFO:tasks.ceph.mds.c.smithi007.stderr: -1779> 2024-08-19T00:45:43.046+0000 7fa4a7800640 -1 mds.0.purge_queue operator(): Error -22 loading Journaler 2024-08-19T00:45:53.827 INFO:tasks.ceph.mds.c.smithi007.stderr: -1776> 2024-08-19T00:45:43.046+0000 7fa4a7800640 -1 mds.0.196 unhandled write error (22) Invalid argument, force readonly... 2024-08-19T00:45:53.831 INFO:tasks.ceph.mds.c.smithi007.stderr: -618> 2024-08-19T00:45:50.028+0000 7fa4ab400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:45:53.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:53.877 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:45:54.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.002+0000 7f1e60a00640 1 Processor -- start 2024-08-19T00:45:54.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.002+0000 7f1e60a00640 1 -- start start 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.003+0000 7f1e60a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e5c15d0b0 0x7f1e5c0733b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.003+0000 7f1e60a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e5c06b850 0x7f1e5c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.003+0000 7f1e60a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c06c1a0 con 0x7f1e5c1599e0 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.003+0000 7f1e60a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5c0738f0 con 0x7f1e5c06b850 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.003+0000 7f1e60a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5c072910 con 0x7f1e5c15d0b0 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e5b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e5c06b850 0x7f1e5c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e5b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e5c06b850 0x7f1e5c06bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60150/0 (socket says 172.21.15.7:60150) 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e5b200640 1 -- 172.21.15.7:0/3387438417 learned_addr learned my addr 172.21.15.7:0/3387438417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:54.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e53e00640 1 --2- 172.21.15.7:0/3387438417 >> v2:172.21.15.162:3300/0 conn(0x7f1e5c15d0b0 0x7f1e5c0733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e5b200640 1 -- 172.21.15.7:0/3387438417 >> v2:172.21.15.162:3300/0 conn(0x7f1e5c15d0b0 msgr2=0x7f1e5c0733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:54.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e5b200640 1 --2- 172.21.15.7:0/3387438417 >> v2:172.21.15.162:3300/0 conn(0x7f1e5c15d0b0 0x7f1e5c0733b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e5b200640 1 -- 172.21.15.7:0/3387438417 >> v1:172.21.15.162:6789/0 conn(0x7f1e5c1599e0 legacy=0x7f1e5c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:54.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e5b200640 1 -- 172.21.15.7:0/3387438417 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c0cf180 con 0x7f1e5c06b850 2024-08-19T00:45:54.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.004+0000 7f1e53e00640 1 --2- 172.21.15.7:0/3387438417 >> v2:172.21.15.162:3300/0 conn(0x7f1e5c15d0b0 0x7f1e5c0733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.005+0000 7f1e5b200640 1 --2- 172.21.15.7:0/3387438417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c06bc60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c06c910 tx=0x7f1e5402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c6fef309fcb651 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.005+0000 7f1e59e00640 1 -- 172.21.15.7:0/3387438417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54036070 con 0x7f1e5c06b850 2024-08-19T00:45:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.005+0000 7f1e59e00640 1 -- 172.21.15.7:0/3387438417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e54031600 con 0x7f1e5c06b850 2024-08-19T00:45:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.005+0000 7f1e59e00640 1 -- 172.21.15.7:0/3387438417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e540319d0 con 0x7f1e5c06b850 2024-08-19T00:45:54.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 -- 172.21.15.7:0/3387438417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 msgr2=0x7f1e5c06bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 --2- 172.21.15.7:0/3387438417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c06bc60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c06c910 tx=0x7f1e5402a660 comp rx=0 tx=0).stop 2024-08-19T00:45:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 -- 172.21.15.7:0/3387438417 shutdown_connections 2024-08-19T00:45:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 --2- 172.21.15.7:0/3387438417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c06bc60 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 --2- 172.21.15.7:0/3387438417 >> v2:172.21.15.162:3300/0 conn(0x7f1e5c15d0b0 0x7f1e5c0733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 -- 172.21.15.7:0/3387438417 >> 172.21.15.7:0/3387438417 conn(0x7f1e5c0b2e50 msgr2=0x7f1e5c0b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 -- 172.21.15.7:0/3387438417 shutdown_connections 2024-08-19T00:45:54.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.006+0000 7f1e60a00640 1 -- 172.21.15.7:0/3387438417 wait complete. 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.008+0000 7f1e60a00640 1 Processor -- start 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.008+0000 7f1e60a00640 1 -- start start 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e60a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c1f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e60a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5c1599e0 0x7f1e5c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e60a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5c15d0b0 0x7f1e5c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e60a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c159dc0 con 0x7f1e5c06b850 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e60a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c072bb0 con 0x7f1e5c1599e0 2024-08-19T00:45:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e60a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5c0702a0 con 0x7f1e5c15d0b0 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c1f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c1f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60166/0 (socket says 172.21.15.7:60166) 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 -- 172.21.15.7:0/2489016205 learned_addr learned my addr 172.21.15.7:0/2489016205 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5b200640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5c15d0b0 0x7f1e5c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e53e00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5c1599e0 0x7f1e5c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 -- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5c15d0b0 msgr2=0x7f1e5c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5c15d0b0 0x7f1e5c151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 -- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5c1599e0 msgr2=0x7f1e5c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5c1599e0 0x7f1e5c0c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5a800640 1 -- 172.21.15.7:0/2489016205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c1f1f90 con 0x7f1e5c06b850 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e5b200640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5c15d0b0 0x7f1e5c151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.009+0000 7f1e53e00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5c1599e0 0x7f1e5c0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.010+0000 7f1e5a800640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c1f2d00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c430 tx=0x7f1e4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.010+0000 7f1e52a00640 1 -- 172.21.15.7:0/2489016205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011790 con 0x7f1e5c06b850 2024-08-19T00:45:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.010+0000 7f1e52a00640 1 -- 172.21.15.7:0/2489016205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c017070 con 0x7f1e5c06b850 2024-08-19T00:45:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.010+0000 7f1e52a00640 1 -- 172.21.15.7:0/2489016205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011b70 con 0x7f1e5c06b850 2024-08-19T00:45:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.010+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c1f2270 con 0x7f1e5c06b850 2024-08-19T00:45:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.010+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c1f2830 con 0x7f1e5c06b850 2024-08-19T00:45:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.011+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c06bc60 con 0x7f1e5c06b850 2024-08-19T00:45:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.012+0000 7f1e52a00640 1 -- 172.21.15.7:0/2489016205 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e4c011d10 con 0x7f1e5c06b850 2024-08-19T00:45:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.013+0000 7f1e52a00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e3806be30 0x7f1e3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.013+0000 7f1e52a00640 1 -- 172.21.15.7:0/2489016205 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7343+0+0 (secure 0 0 0) 0x7f1e4c08b340 con 0x7f1e5c06b850 2024-08-19T00:45:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.013+0000 7f1e53e00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e3806be30 0x7f1e3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.014+0000 7f1e53e00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e3806be30 0x7f1e3806e2f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c1547a0 tx=0x7f1e44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:54.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.017+0000 7f1e52a00640 1 -- 172.21.15.7:0/2489016205 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1e4c0595f0 con 0x7f1e5c06b850 2024-08-19T00:45:54.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.275+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f1e5c0cd850 con 0x7f1e5c06b850 2024-08-19T00:45:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.820+0000 7f1e52a00640 1 -- 172.21.15.7:0/2489016205 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v201) ==== 107+0+0 (secure 0 0 0) 0x7f1e4c058ef0 con 0x7f1e5c06b850 2024-08-19T00:45:54.823 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e3806be30 msgr2=0x7f1e3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e3806be30 0x7f1e3806e2f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c1547a0 tx=0x7f1e44008040 comp rx=0 tx=0).stop 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 msgr2=0x7f1e5c1f2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c1f2d00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c430 tx=0x7f1e4c00c8f0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 shutdown_connections 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e3806be30 0x7f1e3806e2f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5c15d0b0 0x7f1e5c151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5c1599e0 0x7f1e5c0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 --2- 172.21.15.7:0/2489016205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c06b850 0x7f1e5c1f2d00 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 >> 172.21.15.7:0/2489016205 conn(0x7f1e5c0b2e50 msgr2=0x7f1e5c0b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 shutdown_connections 2024-08-19T00:45:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.823+0000 7f1e60a00640 1 -- 172.21.15.7:0/2489016205 wait complete. 2024-08-19T00:45:54.845 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.966+0000 7f8329ef6f40 1 Processor -- start 2024-08-19T00:45:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.966+0000 7f8329ef6f40 1 -- start start 2024-08-19T00:45:54.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.967+0000 7f8329ef6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 0x558387b35bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.967+0000 7f8329ef6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e5b0 0x558387b45a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.967+0000 7f8329ef6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e990 0x558387b45fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.967+0000 7f8329ef6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558387a9d8f0 con 0x558387a9e990 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.967+0000 7f8329ef6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558387a12d00 con 0x558387a9e5b0 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.967+0000 7f8329ef6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558387b43dc0 con 0x558387a9cf40 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e990 0x558387b45fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e990 0x558387b45fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60188/0 (socket says 172.21.15.7:60188) 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 -- 172.21.15.7:0/3487964215 learned_addr learned my addr 172.21.15.7:0/3487964215 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327000640 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 0x558387b35bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8326600640 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e5b0 0x558387b45a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 -- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 msgr2=0x558387b35bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:54.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 0x558387b35bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 -- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e5b0 msgr2=0x558387b45a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e5b0 0x558387b45a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 -- 172.21.15.7:0/3487964215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558387997b30 con 0x558387a9e990 2024-08-19T00:45:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8327a00640 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e990 0x558387b45fc0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f832000c480 tx=0x7f832000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b440e56d50ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.968+0000 7f8325200640 1 -- 172.21.15.7:0/3487964215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200115f0 con 0x558387a9e990 2024-08-19T00:45:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8325200640 1 -- 172.21.15.7:0/3487964215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8320011790 con 0x558387a9e990 2024-08-19T00:45:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8325200640 1 -- 172.21.15.7:0/3487964215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320011b80 con 0x558387a9e990 2024-08-19T00:45:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 -- 172.21.15.7:0/3487964215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e990 msgr2=0x558387b45fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e990 0x558387b45fc0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f832000c480 tx=0x7f832000c940 comp rx=0 tx=0).stop 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 -- 172.21.15.7:0/3487964215 shutdown_connections 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e990 0x558387b45fc0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e5b0 0x558387b45a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/3487964215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 0x558387b35bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 -- 172.21.15.7:0/3487964215 >> 172.21.15.7:0/3487964215 conn(0x558387a9b4e0 msgr2=0x558387a9a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 -- 172.21.15.7:0/3487964215 shutdown_connections 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.969+0000 7f8329ef6f40 1 -- 172.21.15.7:0/3487964215 wait complete. 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.970+0000 7f8329ef6f40 1 Processor -- start 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.970+0000 7f8329ef6f40 1 -- start start 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8329ef6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 0x558387b2d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8329ef6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e5b0 0x558387b2d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8329ef6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e990 0x558387a9a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8329ef6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558387b3cac0 con 0x558387a9e5b0 2024-08-19T00:45:54.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8329ef6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558387b449e0 con 0x558387a9e990 2024-08-19T00:45:54.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8329ef6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558387b44c30 con 0x558387a9cf40 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8326600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e5b0 0x558387b2d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8326600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e5b0 0x558387b2d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60192/0 (socket says 172.21.15.7:60192) 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 learned_addr learned my addr 172.21.15.7:0/2993785943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8327000640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 0x558387b2d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.971+0000 7f8327a00640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e990 0x558387a9a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 msgr2=0x558387b2d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8326600640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558387a9cf40 0x558387b2d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e990 msgr2=0x558387a9a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:54.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8326600640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558387a9e990 0x558387a9a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583879d4080 con 0x558387a9e5b0 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8326600640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e5b0 0x558387b2d850 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f831400df70 tx=0x7f831400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f831f400640 1 -- 172.21.15.7:0/2993785943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83140032d0 con 0x558387a9e5b0 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f831f400640 1 -- 172.21.15.7:0/2993785943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314016070 con 0x558387a9e5b0 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558387b388b0 con 0x558387a9e5b0 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f831f400640 1 -- 172.21.15.7:0/2993785943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314001750 con 0x558387a9e5b0 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.972+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558387b38b20 con 0x558387a9e5b0 2024-08-19T00:45:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.974+0000 7f831f400640 1 -- 172.21.15.7:0/2993785943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83140018f0 con 0x558387a9e5b0 2024-08-19T00:45:54.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.975+0000 7f831f400640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806a810 0x7f830806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.975+0000 7f831f400640 1 -- 172.21.15.7:0/2993785943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7343+0+0 (secure 0 0 0) 0x7f8314089f30 con 0x558387a9e5b0 2024-08-19T00:45:54.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.976+0000 7f8327000640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806a810 0x7f830806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.979 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.976+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558387a9ab50 0x558387b39600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.976+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387b39b40 con 0x558387a9ab50 2024-08-19T00:45:54.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.976+0000 7f8327000640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806a810 0x7f830806ccd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8318057000 tx=0x7f8318062040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.976+0000 7f8327a00640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558387a9ab50 0x558387b39600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.977+0000 7f8327a00640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558387a9ab50 0x558387b39600 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:54.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.979+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v105'567 uv541 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.979+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387b39f10 con 0x558387a9ab50 2024-08-19T00:45:54.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.981+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v105'568 uv568 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.981+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be5d00 con 0x558387a9ab50 2024-08-19T00:45:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.983+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v105'569 uv569 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.983+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be70b0 con 0x558387a9ab50 2024-08-19T00:45:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.985+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v105'570 uv570 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.985+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be7450 con 0x558387a9ab50 2024-08-19T00:45:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.986+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v105'571 uv571 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.986+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be60a0 con 0x558387a9ab50 2024-08-19T00:45:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.988+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v105'572 uv572 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.988+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6490 con 0x558387a9ab50 2024-08-19T00:45:54.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.989+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v105'573 uv547 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.989+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:54.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.991+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v105'574 uv574 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.991+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:54.995 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.992+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v105'575 uv575 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.992+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.994+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v105'576 uv576 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.994+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.995+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v105'577 uv577 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.995+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.997+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v105'578 uv578 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.997+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:55.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.999+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v105'579 uv554 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:54.999+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.000+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v105'580 uv580 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.000+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:55.004 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.002+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v105'581 uv581 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.002+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.003+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v105'582 uv582 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.004+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.005+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v105'583 uv583 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.005+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be6830 con 0x558387a9ab50 2024-08-19T00:45:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.007+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v105'584 uv584 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.007+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.009+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v105'585 uv585 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.009+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.010+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v105'586 uv560 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.010+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.011+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v105'587 uv587 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.012+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.016 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.013+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v105'588 uv588 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.013+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be8800 con 0x558387a9ab50 2024-08-19T00:45:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.015+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v105'589 uv589 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.015+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be8800 con 0x558387a9ab50 2024-08-19T00:45:55.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.016+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v105'590 uv590 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.016+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.018+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v105'591 uv591 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.018+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.019+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v105'592 uv566 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.019+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.021+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v105'593 uv593 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.021+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.025 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.022+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v105'594 uv594 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.022+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be8800 con 0x558387a9ab50 2024-08-19T00:45:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.024+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v105'595 uv595 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.024+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be8800 con 0x558387a9ab50 2024-08-19T00:45:55.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.025+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v105'596 uv596 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.025+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387be77f0 con 0x558387a9ab50 2024-08-19T00:45:55.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.027+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v105'597 uv597 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.027+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558387be7d00 0x558387bea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.027+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bea630 con 0x558387be7d00 2024-08-19T00:45:55.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.027+0000 7f8327000640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558387be7d00 0x558387bea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.028+0000 7f8327000640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558387be7d00 0x558387bea0f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.032+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v105'421 uv400 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.032+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bea9d0 con 0x558387be7d00 2024-08-19T00:45:55.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.034+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v105'422 uv422 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.034+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bead70 con 0x558387be7d00 2024-08-19T00:45:55.037 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:55.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.035+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v105'423 uv423 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.035+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387beb110 con 0x558387be7d00 2024-08-19T00:45:55.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.036+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v105'424 uv424 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.036+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387beb4b0 con 0x558387be7d00 2024-08-19T00:45:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.038+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v105'425 uv425 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.038+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387beb850 con 0x558387be7d00 2024-08-19T00:45:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.039+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v105'426 uv419 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.039+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bebbf0 con 0x558387be7d00 2024-08-19T00:45:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.041+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v105'427 uv427 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.041+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.045 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.042+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v105'428 uv428 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.043+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.044+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v105'429 uv429 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.044+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.046+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v105'430 uv430 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.046+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.047+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v105'431 uv420 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.047+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.049+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v105'432 uv432 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.049+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.052 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.050+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v105'433 uv433 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.050+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf0680 con 0x558387be7d00 2024-08-19T00:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.051+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v105'434 uv434 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.051+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf0680 con 0x558387be7d00 2024-08-19T00:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.053+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v105'435 uv435 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.053+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.054+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v105'436 uv416 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.054+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.056+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v105'437 uv437 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.056+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.059 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.057+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v105'438 uv438 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.057+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387becfa0 con 0x558387be7d00 2024-08-19T00:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.058+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v105'439 uv439 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.058+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387becfa0 con 0x558387be7d00 2024-08-19T00:45:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.060+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v105'440 uv440 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.060+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bebf90 con 0x558387be7d00 2024-08-19T00:45:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.062+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v105'441 uv441 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387be7d00 2024-08-19T00:45:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.062+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558387bec4a0 0x558387bee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.062+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387beedd0 con 0x558387bec4a0 2024-08-19T00:45:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.062+0000 7f8326600640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558387bec4a0 0x558387bee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.063+0000 7f8326600640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558387bec4a0 0x558387bee890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.065+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v105'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.065+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bef170 con 0x558387bec4a0 2024-08-19T00:45:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.067+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v105'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.067+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bef510 con 0x558387bec4a0 2024-08-19T00:45:55.071 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.068+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v105'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.068+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf08c0 con 0x558387bec4a0 2024-08-19T00:45:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.070+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v105'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.070+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf0c60 con 0x558387bec4a0 2024-08-19T00:45:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.071+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v105'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.071+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bef8b0 con 0x558387bec4a0 2024-08-19T00:45:55.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.072+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v105'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.072+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387befca0 con 0x558387a9ab50 2024-08-19T00:45:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.073+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v105'84 uv83 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.073+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387befca0 con 0x558387a9ab50 2024-08-19T00:45:55.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.075+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v105'85 uv85 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.075+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387befca0 con 0x558387a9ab50 2024-08-19T00:45:55.079 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.076+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v105'86 uv86 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.076+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387befca0 con 0x558387a9ab50 2024-08-19T00:45:55.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.078+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v105'87 uv87 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.078+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558387bf1090 0x558387bf3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.078+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf39c0 con 0x558387bf1090 2024-08-19T00:45:55.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.078+0000 7f8327a00640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558387bf1090 0x558387bf3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.080+0000 7f8327a00640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558387bf1090 0x558387bf3480 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.082+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v105'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.082+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bf39c0 con 0x558387bf1090 2024-08-19T00:45:55.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.083+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v105'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.083+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf39c0 con 0x558387bf1090 2024-08-19T00:45:55.086 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:55.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.084+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v105'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.084+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf49d0 con 0x558387bf1090 2024-08-19T00:45:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.085+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v105'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.085+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf49d0 con 0x558387bf1090 2024-08-19T00:45:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.087+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v105'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.087+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf39c0 con 0x558387bf1090 2024-08-19T00:45:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.088+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v105'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.088+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558387bf42c0 0x558387bf46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.088+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf6dd0 con 0x558387bf42c0 2024-08-19T00:45:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.088+0000 7f8327000640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558387bf42c0 0x558387bf46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.089+0000 7f8327000640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558387bf42c0 0x558387bf46e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.090+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v105'205 uv198 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.090+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bf6dd0 con 0x558387bf42c0 2024-08-19T00:45:55.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.092+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v105'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.092+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf6dd0 con 0x558387bf42c0 2024-08-19T00:45:55.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.093+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v105'207 uv207 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.096 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:55.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.093+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf81d0 con 0x558387bf42c0 2024-08-19T00:45:55.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.094+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v105'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.094+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf81d0 con 0x558387bf42c0 2024-08-19T00:45:55.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.095+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v105'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.095+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf71c0 con 0x558387bf42c0 2024-08-19T00:45:55.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.097+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v105'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.097+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf71c0 con 0x558387bf42c0 2024-08-19T00:45:55.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.098+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v105'211 uv204 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.098+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bf71c0 con 0x558387bf42c0 2024-08-19T00:45:55.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.099+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v105'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.099+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf71c0 con 0x558387bf42c0 2024-08-19T00:45:55.103 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:55.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.101+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v105'213 uv213 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.101+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf71c0 con 0x558387bf42c0 2024-08-19T00:45:55.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.102+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v105'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.102+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bf71c0 con 0x558387bf42c0 2024-08-19T00:45:55.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.104+0000 7f8327000640 1 -- 172.21.15.7:0/2993785943 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v105'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831805fb00 con 0x558387bf42c0 2024-08-19T00:45:55.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.104+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558387bf76d0 0x558387bf9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.104+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa0d0 con 0x558387bf76d0 2024-08-19T00:45:55.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.104+0000 7f8326600640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558387bf76d0 0x558387bf9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.104+0000 7f8326600640 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558387bf76d0 0x558387bf9ac0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.106+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v105'91 uv90 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.106+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa4c0 con 0x558387bf76d0 2024-08-19T00:45:55.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.107+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v105'92 uv92 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.107+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bf76d0 2024-08-19T00:45:55.111 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:55.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.108+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v105'93 uv93 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.108+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bf76d0 2024-08-19T00:45:55.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.110+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v105'94 uv94 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.110+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bf76d0 2024-08-19T00:45:55.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.111+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v105'95 uv95 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.111+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387a9ab50 2024-08-19T00:45:55.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.112+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v105'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.112+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387a9ab50 2024-08-19T00:45:55.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.114+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v105'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.114+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387a9ab50 2024-08-19T00:45:55.117 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.115+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v105'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.115+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfb8c0 con 0x558387a9ab50 2024-08-19T00:45:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.116+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v105'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.116+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfb8c0 con 0x558387a9ab50 2024-08-19T00:45:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.118+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v105'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.118+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387a9ab50 2024-08-19T00:45:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.119+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v105'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387a9ab50 2024-08-19T00:45:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.119+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.120+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v105'182 uv176 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.120+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.122+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v105'183 uv183 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.122+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.126 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.124+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v105'184 uv184 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.124+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.125+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v105'185 uv185 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.125+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.126+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v105'186 uv186 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.126+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.128+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v105'187 uv181 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.128+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.129+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v105'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.129+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.133 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.130+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v105'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.130+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfa8b0 con 0x558387bec4a0 2024-08-19T00:45:55.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.132+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v105'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.132+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfd6c0 con 0x558387bec4a0 2024-08-19T00:45:55.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.133+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v105'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bec4a0 2024-08-19T00:45:55.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.133+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.135+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v105'83 uv81 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.135+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.136+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v105'84 uv84 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.136+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.140 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:55.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.137+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v105'85 uv85 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.138+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.139+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v105'86 uv86 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.139+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.141+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v105'111 uv110 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.141+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.142+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v105'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.142+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.146 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.143+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v105'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.144+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfbd70 con 0x558387bf1090 2024-08-19T00:45:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.145+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v105'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.145+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfbd70 con 0x558387bf1090 2024-08-19T00:45:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.146+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v105'115 uv115 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.146+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf1090 2024-08-19T00:45:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.148+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v105'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8320011b40 con 0x558387bf1090 2024-08-19T00:45:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.148+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.149+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v105'94 uv93 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.149+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.150+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v105'95 uv95 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.150+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.154 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:55.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.152+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v105'96 uv96 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.152+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.153+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v105'97 uv97 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.153+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.154+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v105'98 uv98 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.154+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.156+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v105'229 uv220 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.156+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.157+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v105'230 uv230 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.157+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.161 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:55.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.158+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v105'231 uv231 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.158+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.160+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v105'232 uv232 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.160+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.161+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v105'233 uv233 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.161+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.162+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v105'234 uv227 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.162+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.164+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v105'235 uv235 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.164+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.165+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v105'236 uv236 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.165+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfbd70 con 0x558387bf76d0 2024-08-19T00:45:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.166+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v105'237 uv237 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.166+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfbd70 con 0x558387bf76d0 2024-08-19T00:45:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.168+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v105'238 uv238 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.168+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfad60 con 0x558387bf76d0 2024-08-19T00:45:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.169+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v105'239 uv239 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.169+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x558387bfb2c0 con 0x558387bf76d0 2024-08-19T00:45:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8326600640 1 -- 172.21.15.7:0/2993785943 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v105'240 uv240 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f831400e040 con 0x558387bf76d0 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558387be7d00 msgr2=0x558387bea0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558387be7d00 0x558387bea0f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558387bf42c0 msgr2=0x558387bf46e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558387bf42c0 0x558387bf46e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558387bf76d0 msgr2=0x558387bf9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558387bf76d0 0x558387bf9ac0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558387bec4a0 msgr2=0x558387bee890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558387bec4a0 0x558387bee890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 reap_dead start 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558387a9ab50 msgr2=0x558387b39600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558387a9ab50 0x558387b39600 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558387bf1090 msgr2=0x558387bf3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.170+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558387bf1090 0x558387bf3480 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806a810 msgr2=0x7f830806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f830806a810 0x7f830806ccd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8318057000 tx=0x7f8318062040 comp rx=0 tx=0).stop 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e5b0 msgr2=0x558387b2d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 --2- 172.21.15.7:0/2993785943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558387a9e5b0 0x558387b2d850 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f831400df70 tx=0x7f831400b5b0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8327a00640 1 -- 172.21.15.7:0/2993785943 reap_dead start 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 shutdown_connections 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 >> 172.21.15.7:0/2993785943 conn(0x558387a9b4e0 msgr2=0x558387b34e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 shutdown_connections 2024-08-19T00:45:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.171+0000 7f8329ef6f40 1 -- 172.21.15.7:0/2993785943 wait complete. 2024-08-19T00:45:55.178 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds_snaptable - 2024-08-19T00:45:55.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 Processor -- start 2024-08-19T00:45:55.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 -- start start 2024-08-19T00:45:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cab650 0x560879d43590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac5b0 0x560879d49750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cac990 0x560879d49c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560879c20d00 con 0x560879cab650 2024-08-19T00:45:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560879c24d40 con 0x560879cac990 2024-08-19T00:45:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.294+0000 7f07f2b26f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560879d51dc0 con 0x560879cac5b0 2024-08-19T00:45:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cab650 0x560879d43590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cab650 0x560879d43590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60198/0 (socket says 172.21.15.7:60198) 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 -- 172.21.15.7:0/652856969 learned_addr learned my addr 172.21.15.7:0/652856969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07f0800640 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cac990 0x560879d49c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07ef400640 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac5b0 0x560879d49750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 -- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac5b0 msgr2=0x560879d49750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac5b0 0x560879d49750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 -- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cac990 msgr2=0x560879d49c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cac990 0x560879d49c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 -- 172.21.15.7:0/652856969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560879be2080 con 0x560879cab650 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.295+0000 7f07efe00640 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cab650 0x560879d43590 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f07e000b470 tx=0x7f07e000b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a237ef6483ae5423 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07ee000640 1 -- 172.21.15.7:0/652856969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0012070 con 0x560879cab650 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07ee000640 1 -- 172.21.15.7:0/652856969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e000d690 con 0x560879cab650 2024-08-19T00:45:55.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07ee000640 1 -- 172.21.15.7:0/652856969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e000da80 con 0x560879cab650 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 -- 172.21.15.7:0/652856969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cab650 msgr2=0x560879d43590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cab650 0x560879d43590 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f07e000b470 tx=0x7f07e000b930 comp rx=0 tx=0).stop 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 -- 172.21.15.7:0/652856969 shutdown_connections 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cac990 0x560879d49c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac5b0 0x560879d49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/652856969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cab650 0x560879d43590 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 -- 172.21.15.7:0/652856969 >> 172.21.15.7:0/652856969 conn(0x560879ca94e0 msgr2=0x560879c796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 -- 172.21.15.7:0/652856969 shutdown_connections 2024-08-19T00:45:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.296+0000 7f07f2b26f40 1 -- 172.21.15.7:0/652856969 wait complete. 2024-08-19T00:45:55.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.297+0000 7f07f2b26f40 1 Processor -- start 2024-08-19T00:45:55.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.297+0000 7f07f2b26f40 1 -- start start 2024-08-19T00:45:55.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07f2b26f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cab650 0x560879d4c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07f2b26f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cac5b0 0x560879d4c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07f2b26f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac990 0x560879deadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07f2b26f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560879d52810 con 0x560879cac5b0 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07f2b26f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560879d525c0 con 0x560879cab650 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07f2b26f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560879c7a090 con 0x560879cac990 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07ef400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cac5b0 0x560879d4c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07efe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cab650 0x560879d4c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07ef400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cac5b0 0x560879d4c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60208/0 (socket says 172.21.15.7:60208) 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.298+0000 7f07ef400640 1 -- 172.21.15.7:0/675028384 learned_addr learned my addr 172.21.15.7:0/675028384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07f0800640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac990 0x560879deadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ef400640 1 -- 172.21.15.7:0/675028384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac990 msgr2=0x560879deadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ef400640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560879cac990 0x560879deadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ef400640 1 -- 172.21.15.7:0/675028384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cab650 msgr2=0x560879d4c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ef400640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560879cab650 0x560879d4c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ef400640 1 -- 172.21.15.7:0/675028384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560879d43060 con 0x560879cac5b0 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ef400640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cac5b0 0x560879d4c790 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00df40 tx=0x7f07dc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ecc00640 1 -- 172.21.15.7:0/675028384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0032d0 con 0x560879cac5b0 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ecc00640 1 -- 172.21.15.7:0/675028384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc016070 con 0x560879cac5b0 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560879d459c0 con 0x560879cac5b0 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.299+0000 7f07ecc00640 1 -- 172.21.15.7:0/675028384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc001730 con 0x560879cac5b0 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.300+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560879d45f40 con 0x560879cac5b0 2024-08-19T00:45:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.301+0000 7f07ecc00640 1 -- 172.21.15.7:0/675028384 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07dc0018d0 con 0x560879cac5b0 2024-08-19T00:45:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.302+0000 7f07ecc00640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d006a810 0x7f07d006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.302+0000 7f07ecc00640 1 -- 172.21.15.7:0/675028384 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7343+0+0 (secure 0 0 0) 0x7f07dc089fe0 con 0x560879cac5b0 2024-08-19T00:45:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.302+0000 7f07efe00640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d006a810 0x7f07d006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.303+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560879d42bd0 0x560879d44880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.303+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.d 12:b50e409b:::mds_snaptable:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) -- 0x560879d499f0 con 0x560879d42bd0 2024-08-19T00:45:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.303+0000 7f07f0800640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560879d42bd0 0x560879d44880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.303+0000 7f07efe00640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d006a810 0x7f07d006ccd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f07e000b470 tx=0x7f07e000f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.303+0000 7f07f0800640 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560879d42bd0 0x560879d44880 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f0800640 1 -- 172.21.15.7:0/675028384 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~80] v105'96 uv96 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f07e8052850 con 0x560879d42bd0 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560879d42bd0 msgr2=0x560879d44880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560879d42bd0 0x560879d44880 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d006a810 msgr2=0x7f07d006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07d006a810 0x7f07d006ccd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f07e000b470 tx=0x7f07e000f000 comp rx=0 tx=0).stop 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cac5b0 msgr2=0x560879d4c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f2b26f40 1 --2- 172.21.15.7:0/675028384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560879cac5b0 0x560879d4c790 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00df40 tx=0x7f07dc00b5b0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.305+0000 7f07f0800640 1 -- 172.21.15.7:0/675028384 reap_dead start 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.306+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 shutdown_connections 2024-08-19T00:45:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.306+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 >> 172.21.15.7:0/675028384 conn(0x560879ca94e0 msgr2=0x560879ca8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.306+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 shutdown_connections 2024-08-19T00:45:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.306+0000 7f07f2b26f40 1 -- 172.21.15.7:0/675028384 wait complete. 2024-08-19T00:45:55.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.511+0000 7f6f16e00640 1 Processor -- start 2024-08-19T00:45:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.511+0000 7f6f16e00640 1 -- start start 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f16e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f100b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f16e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6f100b5130 0x7f6f100aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f16e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6f1015c390 0x7f6f100af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f16e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6f100af650 con 0x7f6f100b5130 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f16e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6f100ad790 con 0x7f6f1015c390 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f16e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f100acef0 con 0x7f6f1015bfb0 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f07400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6f100b5130 0x7f6f100aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f07400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6f100b5130 0x7f6f100aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60210/0 (socket says 172.21.15.7:60210) 2024-08-19T00:45:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.512+0000 7f6f07400640 1 -- 172.21.15.7:0/101710421 learned_addr learned my addr 172.21.15.7:0/101710421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.513+0000 7f6f0fe00640 1 --2- 172.21.15.7:0/101710421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f100b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.513+0000 7f6f14e00640 1 --2- 172.21.15.7:0/101710421 >> v2:172.21.15.162:3300/0 conn(0x7f6f1015c390 0x7f6f100af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.513+0000 7f6f07400640 1 -- 172.21.15.7:0/101710421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 msgr2=0x7f6f100b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.513+0000 7f6f07400640 1 --2- 172.21.15.7:0/101710421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f100b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.513+0000 7f6f07400640 1 -- 172.21.15.7:0/101710421 >> v2:172.21.15.162:3300/0 conn(0x7f6f1015c390 msgr2=0x7f6f100af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.513+0000 7f6f07400640 1 --2- 172.21.15.7:0/101710421 >> v2:172.21.15.162:3300/0 conn(0x7f6f1015c390 0x7f6f100af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.513+0000 7f6f07400640 1 -- 172.21.15.7:0/101710421 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f100ad1d0 con 0x7f6f100b5130 2024-08-19T00:45:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.514+0000 7f6f07400640 1 --2- 172.21.15.7:0/101710421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f100b5130 0x7f6f100aebd0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f6f100ae640 tx=0x7f6ef802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b42a7683d09845 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.514+0000 7f6f0f400640 1 -- 172.21.15.7:0/101710421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8037070 con 0x7f6f100b5130 2024-08-19T00:45:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.514+0000 7f6f0f400640 1 -- 172.21.15.7:0/101710421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8032440 con 0x7f6f100b5130 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.514+0000 7f6f0f400640 1 -- 172.21.15.7:0/101710421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8032810 con 0x7f6f100b5130 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.514+0000 7f6f16e00640 1 -- 172.21.15.7:0/101710421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f100b5130 msgr2=0x7f6f100aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.514+0000 7f6f16e00640 1 --2- 172.21.15.7:0/101710421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f100b5130 0x7f6f100aebd0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f6f100ae640 tx=0x7f6ef802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.515+0000 7f6f16e00640 1 -- 172.21.15.7:0/101710421 shutdown_connections 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.515+0000 7f6f16e00640 1 --2- 172.21.15.7:0/101710421 >> v2:172.21.15.162:3300/0 conn(0x7f6f1015c390 0x7f6f100af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.515+0000 7f6f16e00640 1 --2- 172.21.15.7:0/101710421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f100b5130 0x7f6f100aebd0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.515+0000 7f6f16e00640 1 --2- 172.21.15.7:0/101710421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f100b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.515+0000 7f6f16e00640 1 -- 172.21.15.7:0/101710421 >> 172.21.15.7:0/101710421 conn(0x7f6f100b2300 msgr2=0x7f6f1006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.515+0000 7f6f16e00640 1 -- 172.21.15.7:0/101710421 shutdown_connections 2024-08-19T00:45:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.515+0000 7f6f16e00640 1 -- 172.21.15.7:0/101710421 wait complete. 2024-08-19T00:45:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.516+0000 7f6f16e00640 1 Processor -- start 2024-08-19T00:45:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.516+0000 7f6f16e00640 1 -- start start 2024-08-19T00:45:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.517+0000 7f6f16e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f100b5130 0x7f6f101f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.517+0000 7f6f16e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f1014dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.517+0000 7f6f16e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1015c390 0x7f6f101f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.517+0000 7f6f16e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100b4340 con 0x7f6f1015c390 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.517+0000 7f6f16e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10071b20 con 0x7f6f100b5130 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.517+0000 7f6f16e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f100b44c0 con 0x7f6f1015bfb0 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1015c390 0x7f6f101f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1015c390 0x7f6f101f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60224/0 (socket says 172.21.15.7:60224) 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 -- 172.21.15.7:0/4024908897 learned_addr learned my addr 172.21.15.7:0/4024908897 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f0fe00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f100b5130 0x7f6f101f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f07400640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f1014dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 -- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 msgr2=0x7f6f1014dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f1014dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 -- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f100b5130 msgr2=0x7f6f101f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f100b5130 0x7f6f101f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 -- 172.21.15.7:0/4024908897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f10158380 con 0x7f6f1015c390 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.518+0000 7f6f14e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1015c390 0x7f6f101f5030 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009fd0 tx=0x7f6f0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.519+0000 7f6f0cc00640 1 -- 172.21.15.7:0/4024908897 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08014420 con 0x7f6f1015c390 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.519+0000 7f6f0cc00640 1 -- 172.21.15.7:0/4024908897 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f08019070 con 0x7f6f1015c390 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.519+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f101f44c0 con 0x7f6f1015c390 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.519+0000 7f6f0cc00640 1 -- 172.21.15.7:0/4024908897 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08014800 con 0x7f6f1015c390 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.519+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f101f4a80 con 0x7f6f1015c390 2024-08-19T00:45:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.520+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f100b3e00 con 0x7f6f1015c390 2024-08-19T00:45:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.521+0000 7f6f0cc00640 1 -- 172.21.15.7:0/4024908897 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f080149a0 con 0x7f6f1015c390 2024-08-19T00:45:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.522+0000 7f6f0cc00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6eec06be60 0x7f6eec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.522+0000 7f6f0cc00640 1 -- 172.21.15.7:0/4024908897 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 7343+0+0 (secure 0 0 0) 0x7f6f0808bb80 con 0x7f6f1015c390 2024-08-19T00:45:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.522+0000 7f6f0fe00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6eec06be60 0x7f6eec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.523+0000 7f6f0fe00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6eec06be60 0x7f6eec06e320 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6f00006fd0 tx=0x7f6f00008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:55.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.526+0000 7f6f0cc00640 1 -- 172.21.15.7:0/4024908897 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6f08059880 con 0x7f6f1015c390 2024-08-19T00:45:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:55.747+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f6f1015ee80 con 0x7f6f1015c390 2024-08-19T00:45:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.093+0000 7f6f0cc00640 1 -- 172.21.15.7:0/4024908897 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v202) ==== 162+0+0 (secure 0 0 0) 0x7f6f0805db80 con 0x7f6f1015c390 2024-08-19T00:45:56.096 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6eec06be60 msgr2=0x7f6eec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6eec06be60 0x7f6eec06e320 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6f00006fd0 tx=0x7f6f00008040 comp rx=0 tx=0).stop 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1015c390 msgr2=0x7f6f101f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1015c390 0x7f6f101f5030 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009fd0 tx=0x7f6f0800e4b0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 shutdown_connections 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6eec06be60 0x7f6eec06e320 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f1015c390 0x7f6f101f5030 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1015bfb0 0x7f6f1014dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 --2- 172.21.15.7:0/4024908897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f100b5130 0x7f6f101f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 >> 172.21.15.7:0/4024908897 conn(0x7f6f100b2300 msgr2=0x7f6f1015cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:56.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 shutdown_connections 2024-08-19T00:45:56.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.096+0000 7f6f16e00640 1 -- 172.21.15.7:0/4024908897 wait complete. 2024-08-19T00:45:56.105 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:45:56.102+0000 7f2403800640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': Decoder at 'virtual void SnapServer::decode_server_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=5 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:45:56.105 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:56.103+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:45:56.105 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:45:56.103+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:45:56.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:56.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.273+0000 7f5ff6200640 1 Processor -- start 2024-08-19T00:45:56.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.273+0000 7f5ff6200640 1 -- start start 2024-08-19T00:45:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.274+0000 7f5ff6200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5ff015e360 0x7f5ff015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.274+0000 7f5ff6200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 0x7f5ff00d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.274+0000 7f5ff6200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff00b3ab0 con 0x7f5ff015e740 2024-08-19T00:45:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.274+0000 7f5ff6200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff00d3490 con 0x7f5ff015e360 2024-08-19T00:45:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.274+0000 7f5ff6200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff015f460 con 0x7f5ff00d2af0 2024-08-19T00:45:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.274+0000 7f5ff5800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5ff015e740 0x7f5ff015ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57234/0 (socket says 172.21.15.7:57234) 2024-08-19T00:45:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5ff5800640 1 -- 172.21.15.7:0/2507268315 learned_addr learned my addr 172.21.15.7:0/2507268315 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fefe00640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 0x7f5ff00d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5ff4e00640 1 --2- 172.21.15.7:0/2507268315 >> v2:172.21.15.162:3300/0 conn(0x7f5ff015e360 0x7f5ff015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600106455 0 0) 0x7f5ff00b3ab0 con 0x7f5ff015e740 2024-08-19T00:45:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd8003520 con 0x7f5ff015e740 2024-08-19T00:45:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 869028270 0 0) 0x7f5fd8003520 con 0x7f5ff015e740 2024-08-19T00:45:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 msgr2=0x7f5ff00d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:56.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 0x7f5ff00d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 >> v2:172.21.15.162:3300/0 conn(0x7f5ff015e360 msgr2=0x7f5ff015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 --2- 172.21.15.7:0/2507268315 >> v2:172.21.15.162:3300/0 conn(0x7f5ff015e360 0x7f5ff015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff015f740 con 0x7f5ff015e740 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f5fe80019f0 con 0x7f5ff015e740 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 >> v1:172.21.15.7:6789/0 conn(0x7f5ff015e740 legacy=0x7f5ff015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 0x7f5fd80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fd8003f80 0x7f5fd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd8004d40 0x7f5fd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff015f460 con 0x7f5fd8003f80 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd800b9c0 con 0x7f5fd8004d40 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.275+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd800bb40 con 0x7f5ff00d2af0 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5fefe00640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fd8003f80 0x7f5fd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5ff5800640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd8004d40 0x7f5fd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5ff4e00640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 0x7f5fd80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5fefe00640 1 -- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 msgr2=0x7f5fd80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5fefe00640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff00d2af0 0x7f5fd80039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5fefe00640 1 -- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd8004d40 msgr2=0x7f5fd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5fefe00640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd8004d40 0x7f5fd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5fefe00640 1 -- 172.21.15.7:0/2507268315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd8003520 con 0x7f5fd8003f80 2024-08-19T00:45:56.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.276+0000 7f5ff5800640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd8004d40 0x7f5fd80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:56.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.277+0000 7f5fefe00640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fd8003f80 0x7f5fd8004800 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009ac0 tx=0x7f5fd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fe435677f6194f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:56.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.277+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc036070 con 0x7f5fd8003f80 2024-08-19T00:45:56.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.277+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc031400 con 0x7f5fd8003f80 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.277+0000 7f5fef400640 1 -- 172.21.15.7:0/2507268315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc009690 con 0x7f5fd8003f80 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.278+0000 7f5ff6200640 1 -- 172.21.15.7:0/2507268315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fd8003f80 msgr2=0x7f5fd8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.278+0000 7f5ff6200640 1 --2- 172.21.15.7:0/2507268315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fd8003f80 0x7f5fd8004800 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009ac0 tx=0x7f5fd8005830 comp rx=0 tx=0).stop 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.278+0000 7f5ff5800640 1 -- 172.21.15.7:0/2507268315 reap_dead start 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.278+0000 7f5ff6200640 1 -- 172.21.15.7:0/2507268315 shutdown_connections 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.278+0000 7f5ff6200640 1 -- 172.21.15.7:0/2507268315 >> 172.21.15.7:0/2507268315 conn(0x7f5ff008dbf0 msgr2=0x7f5ff009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.278+0000 7f5ff6200640 1 -- 172.21.15.7:0/2507268315 shutdown_connections 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.278+0000 7f5ff6200640 1 -- 172.21.15.7:0/2507268315 wait complete. 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.280+0000 7f5ff6200640 1 Processor -- start 2024-08-19T00:45:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.280+0000 7f5ff6200640 1 -- start start 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff6200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd8003f80 0x7f5ff00cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff00b1aa0 0x7f5ff0156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ff00cd820 0x7f5ff00d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff6200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00d2300 con 0x7f5ff00cd820 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff6200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00b4040 con 0x7f5ff00b1aa0 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff6200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff00d2f50 con 0x7f5fd8003f80 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ff00cd820 0x7f5ff00d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ff00cd820 0x7f5ff00d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60236/0 (socket says 172.21.15.7:60236) 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 -- 172.21.15.7:0/1445931928 learned_addr learned my addr 172.21.15.7:0/1445931928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff4e00640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd8003f80 0x7f5ff00cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 -- 172.21.15.7:0/1445931928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd8003f80 msgr2=0x7f5ff00cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd8003f80 0x7f5ff00cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 -- 172.21.15.7:0/1445931928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff00b1aa0 msgr2=0x7f5ff0156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff00b1aa0 0x7f5ff0156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.281+0000 7f5ff5800640 1 -- 172.21.15.7:0/1445931928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff00ce120 con 0x7f5ff00cd820 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.282+0000 7f5ff5800640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ff00cd820 0x7f5ff00d0050 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00cb230 tx=0x7f5fe800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.282+0000 7f5fecc00640 1 -- 172.21.15.7:0/1445931928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800eda0 con 0x7f5ff00cd820 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.282+0000 7f5fecc00640 1 -- 172.21.15.7:0/1445931928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8014430 con 0x7f5ff00cd820 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.282+0000 7f5fecc00640 1 -- 172.21.15.7:0/1445931928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8014820 con 0x7f5ff00cd820 2024-08-19T00:45:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.282+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff00b21f0 con 0x7f5ff00cd820 2024-08-19T00:45:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.282+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff00b27b0 con 0x7f5ff00cd820 2024-08-19T00:45:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.283+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff00b29b0 con 0x7f5ff00cd820 2024-08-19T00:45:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.284+0000 7f5fecc00640 1 -- 172.21.15.7:0/1445931928 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fe80149c0 con 0x7f5ff00cd820 2024-08-19T00:45:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.285+0000 7f5fecc00640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fd006be60 0x7f5fd006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.285+0000 7f5fecc00640 1 -- 172.21.15.7:0/1445931928 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7f5fe808b350 con 0x7f5ff00cd820 2024-08-19T00:45:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.285+0000 7f5ff4e00640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fd006be60 0x7f5fd006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.286+0000 7f5ff4e00640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fd006be60 0x7f5fd006e320 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009b40 tx=0x7f5fe4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:56.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.289+0000 7f5fecc00640 1 -- 172.21.15.7:0/1445931928 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5ff00b29b0 con 0x7f5ff00cd820 2024-08-19T00:45:56.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.510+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ff00d3380 con 0x7f5ff00cd820 2024-08-19T00:45:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.510+0000 7f5fecc00640 1 -- 172.21.15.7:0/1445931928 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 204 v204) ==== 95+0+4393 (secure 0 0 0) 0x7f5fe8058fe0 con 0x7f5ff00cd820 2024-08-19T00:45:56.513 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":204,"btime":"2024-08-19T00:45:56:105000+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2555026980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2555026980},{"type":"v1","addr":"172.21.15.7:6837","nonce":2555026980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":204,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:56.104919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 204 2024-08-19T00:45:56.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fd006be60 msgr2=0x7f5fd006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fd006be60 0x7f5fd006e320 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009b40 tx=0x7f5fe4008040 comp rx=0 tx=0).stop 2024-08-19T00:45:56.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ff00cd820 msgr2=0x7f5ff00d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ff00cd820 0x7f5ff00d0050 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00cb230 tx=0x7f5fe800e530 comp rx=0 tx=0).stop 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 shutdown_connections 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fd006be60 0x7f5fd006e320 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ff00cd820 0x7f5ff00d0050 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff00b1aa0 0x7f5ff0156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.512+0000 7f5ff6200640 1 --2- 172.21.15.7:0/1445931928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd8003f80 0x7f5ff00cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.513+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 >> 172.21.15.7:0/1445931928 conn(0x7f5ff008dbf0 msgr2=0x7f5ff006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.513+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 shutdown_connections 2024-08-19T00:45:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.513+0000 7f5ff6200640 1 -- 172.21.15.7:0/1445931928 wait complete. 2024-08-19T00:45:56.531 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:56.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.686+0000 7fee33200640 1 Processor -- start 2024-08-19T00:45:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.687+0000 7fee33200640 1 -- start start 2024-08-19T00:45:56.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee33200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee3415e470 0x7fee340d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee33200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 0x7fee340d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee33200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee340d10d0 con 0x7fee340d0c40 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee33200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fee3406d4e0 con 0x7fee3415e470 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee33200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee3406d7c0 con 0x7fee340b4750 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee31e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee3415e470 0x7fee340d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee31e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee3415e470 0x7fee340d01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60250/0 (socket says 172.21.15.7:60250) 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee31e00640 1 -- 172.21.15.7:0/1249112633 learned_addr learned my addr 172.21.15.7:0/1249112633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee32800640 1 --1- 172.21.15.7:0/1249112633 >> v1:172.21.15.7:6789/0 conn(0x7fee340d0c40 0x7fee3409aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57240/0 (socket says 172.21.15.7:57240) 2024-08-19T00:45:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee31e00640 1 -- 172.21.15.7:0/1249112633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 msgr2=0x7fee340d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee31e00640 1 --2- 172.21.15.7:0/1249112633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 0x7fee340d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee31e00640 1 -- 172.21.15.7:0/1249112633 >> v1:172.21.15.7:6789/0 conn(0x7fee340d0c40 legacy=0x7fee3409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.688+0000 7fee31e00640 1 -- 172.21.15.7:0/1249112633 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3406daa0 con 0x7fee3415e470 2024-08-19T00:45:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.689+0000 7fee31e00640 1 --2- 172.21.15.7:0/1249112633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee3415e470 0x7fee340d01c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fee24009870 tx=0x7fee2402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1db2af09079e3d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:56.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee30a00640 1 -- 172.21.15.7:0/1249112633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24037070 con 0x7fee3415e470 2024-08-19T00:45:56.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee30a00640 1 -- 172.21.15.7:0/1249112633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee24032440 con 0x7fee3415e470 2024-08-19T00:45:56.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee30a00640 1 -- 172.21.15.7:0/1249112633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24032810 con 0x7fee3415e470 2024-08-19T00:45:56.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 -- 172.21.15.7:0/1249112633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee3415e470 msgr2=0x7fee340d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 --2- 172.21.15.7:0/1249112633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee3415e470 0x7fee340d01c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fee24009870 tx=0x7fee2402a250 comp rx=0 tx=0).stop 2024-08-19T00:45:56.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 -- 172.21.15.7:0/1249112633 shutdown_connections 2024-08-19T00:45:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 --2- 172.21.15.7:0/1249112633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 0x7fee340d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 --2- 172.21.15.7:0/1249112633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee3415e470 0x7fee340d01c0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 -- 172.21.15.7:0/1249112633 >> 172.21.15.7:0/1249112633 conn(0x7fee340b3a70 msgr2=0x7fee340b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 -- 172.21.15.7:0/1249112633 shutdown_connections 2024-08-19T00:45:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.690+0000 7fee33200640 1 -- 172.21.15.7:0/1249112633 wait complete. 2024-08-19T00:45:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.692+0000 7fee33200640 1 Processor -- start 2024-08-19T00:45:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.692+0000 7fee33200640 1 -- start start 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee33200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 0x7fee341535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee33200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee340d0c40 0x7fee34160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee33200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee3415e470 0x7fee34153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee33200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee34071070 con 0x7fee340d0c40 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee33200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee3406d1d0 con 0x7fee3415e470 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee33200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee340711f0 con 0x7fee340b4750 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee31400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee340d0c40 0x7fee34160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee31400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee340d0c40 0x7fee34160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60262/0 (socket says 172.21.15.7:60262) 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.693+0000 7fee31400640 1 -- 172.21.15.7:0/3510097085 learned_addr learned my addr 172.21.15.7:0/3510097085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee32800640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee3415e470 0x7fee34153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee31400640 1 -- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 msgr2=0x7fee341535c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee31400640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 0x7fee341535c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee31400640 1 -- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee3415e470 msgr2=0x7fee34153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee31400640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee3415e470 0x7fee34153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee31400640 1 -- 172.21.15.7:0/3510097085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee340b5190 con 0x7fee340d0c40 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee32800640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee3415e470 0x7fee34153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee31400640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee340d0c40 0x7fee34160f70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fee2000b410 tx=0x7fee2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee2a000640 1 -- 172.21.15.7:0/3510097085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20015020 con 0x7fee340d0c40 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee2a000640 1 -- 172.21.15.7:0/3510097085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee20011850 con 0x7fee340d0c40 2024-08-19T00:45:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee2a000640 1 -- 172.21.15.7:0/3510097085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20011c40 con 0x7fee340d0c40 2024-08-19T00:45:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee340b5470 con 0x7fee340d0c40 2024-08-19T00:45:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.694+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee340b5a30 con 0x7fee340d0c40 2024-08-19T00:45:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.695+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee340d01c0 con 0x7fee340d0c40 2024-08-19T00:45:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.696+0000 7fee2a000640 1 -- 172.21.15.7:0/3510097085 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee20018020 con 0x7fee340d0c40 2024-08-19T00:45:56.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.698+0000 7fee2a000640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee1406be30 0x7fee1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:56.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.698+0000 7fee2a000640 1 -- 172.21.15.7:0/3510097085 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7fee2008b500 con 0x7fee340d0c40 2024-08-19T00:45:56.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.698+0000 7fee31e00640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee1406be30 0x7fee1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:56.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.699+0000 7fee31e00640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee1406be30 0x7fee1406e2f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fee24034000 tx=0x7fee2402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.702+0000 7fee2a000640 1 -- 172.21.15.7:0/3510097085 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fee2001f020 con 0x7fee340d0c40 2024-08-19T00:45:56.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.921+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee340b02f0 con 0x7fee340d0c40 2024-08-19T00:45:56.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.921+0000 7fee2a000640 1 -- 172.21.15.7:0/3510097085 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 204 v204) ==== 95+0+4393 (secure 0 0 0) 0x7fee200172c0 con 0x7fee340d0c40 2024-08-19T00:45:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:56.924 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":204,"btime":"2024-08-19T00:45:56:105000+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2555026980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2555026980},{"type":"v1","addr":"172.21.15.7:6837","nonce":2555026980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":204,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:56.104919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:56.924 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 204 2024-08-19T00:45:56.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee1406be30 msgr2=0x7fee1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee1406be30 0x7fee1406e2f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fee24034000 tx=0x7fee2402e000 comp rx=0 tx=0).stop 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee340d0c40 msgr2=0x7fee34160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee340d0c40 0x7fee34160f70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fee2000b410 tx=0x7fee2000b8d0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 shutdown_connections 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fee1406be30 0x7fee1406e2f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee3415e470 0x7fee34153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee340d0c40 0x7fee34160f70 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 --2- 172.21.15.7:0/3510097085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee340b4750 0x7fee341535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 >> 172.21.15.7:0/3510097085 conn(0x7fee340b3a70 msgr2=0x7fee34074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 shutdown_connections 2024-08-19T00:45:56.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:56.924+0000 7fee33200640 1 -- 172.21.15.7:0/3510097085 wait complete. 2024-08-19T00:45:56.942 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:45:56.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:45:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.096+0000 7f7516a00640 1 Processor -- start 2024-08-19T00:45:57.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.096+0000 7f7516a00640 1 -- start start 2024-08-19T00:45:57.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.097+0000 7f7516a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75100d3010 0x7f75100d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.097+0000 7f7516a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f75100b57e0 0x7f75100d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.097+0000 7f7516a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75100d1a20 con 0x7f751015e480 2024-08-19T00:45:57.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.097+0000 7f7516a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f75100cfde0 con 0x7f75100b57e0 2024-08-19T00:45:57.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.097+0000 7f7516a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75100d1460 con 0x7f75100d3010 2024-08-19T00:45:57.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7515600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f751015e480 0x7f75100d20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57244/0 (socket says 172.21.15.7:57244) 2024-08-19T00:45:57.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7515600640 1 -- 172.21.15.7:0/3389245548 learned_addr learned my addr 172.21.15.7:0/3389245548 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:57.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7516000640 1 --2- 172.21.15.7:0/3389245548 >> v2:172.21.15.7:3300/0 conn(0x7f75100b57e0 0x7f75100d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7514c00640 1 --2- 172.21.15.7:0/3389245548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75100d3010 0x7f75100d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7516000640 1 -- 172.21.15.7:0/3389245548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75100d3010 msgr2=0x7f75100d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:57.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7516000640 1 --2- 172.21.15.7:0/3389245548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75100d3010 0x7f75100d4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7516000640 1 -- 172.21.15.7:0/3389245548 >> v1:172.21.15.7:6789/0 conn(0x7f751015e480 legacy=0x7f75100d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f7516000640 1 -- 172.21.15.7:0/3389245548 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75100d1740 con 0x7f75100b57e0 2024-08-19T00:45:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.098+0000 7f750fe00640 1 -- 172.21.15.7:0/3389245548 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249712597 0 0) 0x7f75100d1a20 con 0x7f751015e480 2024-08-19T00:45:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.099+0000 7f7516000640 1 --2- 172.21.15.7:0/3389245548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100b57e0 0x7f75100d46b0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f7508009d90 tx=0x7f750802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de31c3e5b1a85e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.099+0000 7f750fe00640 1 -- 172.21.15.7:0/3389245548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508031600 con 0x7f75100b57e0 2024-08-19T00:45:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f750fe00640 1 -- 172.21.15.7:0/3389245548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75080317a0 con 0x7f75100b57e0 2024-08-19T00:45:57.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f750fe00640 1 -- 172.21.15.7:0/3389245548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508031b70 con 0x7f75100b57e0 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 -- 172.21.15.7:0/3389245548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100b57e0 msgr2=0x7f75100d46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 --2- 172.21.15.7:0/3389245548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100b57e0 0x7f75100d46b0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f7508009d90 tx=0x7f750802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 -- 172.21.15.7:0/3389245548 shutdown_connections 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 --2- 172.21.15.7:0/3389245548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100b57e0 0x7f75100d46b0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 --2- 172.21.15.7:0/3389245548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75100d3010 0x7f75100d4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 -- 172.21.15.7:0/3389245548 >> 172.21.15.7:0/3389245548 conn(0x7f751008dbf0 msgr2=0x7f751009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 -- 172.21.15.7:0/3389245548 shutdown_connections 2024-08-19T00:45:57.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.100+0000 7f7516a00640 1 -- 172.21.15.7:0/3389245548 wait complete. 2024-08-19T00:45:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.102+0000 7f7516a00640 1 Processor -- start 2024-08-19T00:45:57.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.102+0000 7f7516a00640 1 -- start start 2024-08-19T00:45:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7516a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75100b57e0 0x7f75100b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7516a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100d3010 0x7f75100c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7516a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f751015e480 0x7f75100c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7516a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f75100cef50 con 0x7f75100d3010 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7516a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75100cedd0 con 0x7f75100b57e0 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7516a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75100cf0d0 con 0x7f751015e480 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7514c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100d3010 0x7f75100c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7514c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100d3010 0x7f75100c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60292/0 (socket says 172.21.15.7:60292) 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7514c00640 1 -- 172.21.15.7:0/271112782 learned_addr learned my addr 172.21.15.7:0/271112782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7516000640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f751015e480 0x7f75100c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.103+0000 7f7515600640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75100b57e0 0x7f75100b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7514c00640 1 -- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f751015e480 msgr2=0x7f75100c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7514c00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f751015e480 0x7f75100c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7514c00640 1 -- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75100b57e0 msgr2=0x7f75100b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7514c00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75100b57e0 0x7f75100b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7514c00640 1 -- 172.21.15.7:0/271112782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75100c9cd0 con 0x7f75100d3010 2024-08-19T00:45:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7514c00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100d3010 0x7f75100c7d10 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00d7d0 tx=0x7f74fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:57.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f750d600640 1 -- 172.21.15.7:0/271112782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc004020 con 0x7f75100d3010 2024-08-19T00:45:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f750d600640 1 -- 172.21.15.7:0/271112782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc0041e0 con 0x7f75100d3010 2024-08-19T00:45:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f750d600640 1 -- 172.21.15.7:0/271112782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0043d0 con 0x7f75100d3010 2024-08-19T00:45:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75100c9fb0 con 0x7f75100d3010 2024-08-19T00:45:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.104+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75100ca570 con 0x7f75100d3010 2024-08-19T00:45:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.106+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75100d20e0 con 0x7f75100d3010 2024-08-19T00:45:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.106+0000 7f750d600640 1 -- 172.21.15.7:0/271112782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74fc01b020 con 0x7f75100d3010 2024-08-19T00:45:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.107+0000 7f750d600640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f006be30 0x7f74f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.107+0000 7f750d600640 1 -- 172.21.15.7:0/271112782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7f74fc08b360 con 0x7f75100d3010 2024-08-19T00:45:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.108+0000 7f7515600640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f006be30 0x7f74f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.108+0000 7f7515600640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f006be30 0x7f74f006e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.112+0000 7f750d600640 1 -- 172.21.15.7:0/271112782 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f74fc059650 con 0x7f75100d3010 2024-08-19T00:45:57.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.332+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75100a21e0 con 0x7f75100d3010 2024-08-19T00:45:57.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.333+0000 7f750d600640 1 -- 172.21.15.7:0/271112782 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 204 v204) ==== 95+0+4393 (secure 0 0 0) 0x7f74fc058f50 con 0x7f75100d3010 2024-08-19T00:45:57.335 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:45:57.336 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":204,"btime":"2024-08-19T00:45:56:105000+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2555026980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2555026980},{"type":"v1","addr":"172.21.15.7:6837","nonce":2555026980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":204,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:45:56.104919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:45:57.336 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 204 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f006be30 msgr2=0x7f74f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f006be30 0x7f74f006e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504007c00 comp rx=0 tx=0).stop 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100d3010 msgr2=0x7f75100c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100d3010 0x7f75100c7d10 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00d7d0 tx=0x7f74fc00dc90 comp rx=0 tx=0).stop 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 shutdown_connections 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f74f006be30 0x7f74f006e2f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f751015e480 0x7f75100c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75100d3010 0x7f75100c7d10 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 --2- 172.21.15.7:0/271112782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75100b57e0 0x7f75100b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 >> 172.21.15.7:0/271112782 conn(0x7f751008dbf0 msgr2=0x7f751006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:57.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 shutdown_connections 2024-08-19T00:45:57.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.335+0000 7f7516a00640 1 -- 172.21.15.7:0/271112782 wait complete. 2024-08-19T00:45:57.353 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt mds_snaptable' led to DAMAGED state 2024-08-19T00:45:57.353 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt mds0_inotable' 2024-08-19T00:45:57.353 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:45:57.354 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:45:57.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:45:57.389 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:45:57.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:45:57.389 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:45:57.464 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:45:57.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:45:57.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:45:57.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.660+0000 7f1ce7000640 1 Processor -- start 2024-08-19T00:45:57.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.660+0000 7f1ce7000640 1 -- start start 2024-08-19T00:45:57.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.661+0000 7f1ce7000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1ce015e380 0x7f1ce015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.661+0000 7f1ce7000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce015e760 con 0x7f1ce00d4b30 2024-08-19T00:45:57.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.661+0000 7f1ce7000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce00d2280 con 0x7f1ce00d10c0 2024-08-19T00:45:57.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.661+0000 7f1ce7000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce00d1b90 con 0x7f1ce015e380 2024-08-19T00:45:57.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.661+0000 7f1ce5200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1ce00d4b30 0x7f1ce00d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57252/0 (socket says 172.21.15.7:57252) 2024-08-19T00:45:57.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.661+0000 7f1ce5200640 1 -- 172.21.15.7:0/3186708786 learned_addr learned my addr 172.21.15.7:0/3186708786 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:45:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1ce5c00640 1 --2- 172.21.15.7:0/3186708786 >> v2:172.21.15.162:3300/0 conn(0x7f1ce015e380 0x7f1ce015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417803270 0 0) 0x7f1ce015e760 con 0x7f1ce00d4b30 2024-08-19T00:45:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cc8003520 con 0x7f1ce00d4b30 2024-08-19T00:45:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1677155329 0 0) 0x7f1cc8003520 con 0x7f1ce00d4b30 2024-08-19T00:45:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 >> v2:172.21.15.162:3300/0 conn(0x7f1ce015e380 msgr2=0x7f1ce015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 --2- 172.21.15.7:0/3186708786 >> v2:172.21.15.162:3300/0 conn(0x7f1ce015e380 0x7f1ce015f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 >> v1:172.21.15.162:6789/0 conn(0x7f1ce00d10c0 legacy=0x7f1ce00ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00d5010 con 0x7f1ce00d4b30 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f1ccc001670 con 0x7f1ce00d4b30 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 >> v1:172.21.15.7:6789/0 conn(0x7f1ce00d4b30 legacy=0x7f1ce00d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cc80039b0 0x7f1cc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc8004800 0x7f1cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80051c0 0x7f1cc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00d1b90 con 0x7f1cc80051c0 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc800c070 con 0x7f1cc80039b0 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.662+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc800c270 con 0x7f1cc8004800 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce6600640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80051c0 0x7f1cc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce5c00640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cc80039b0 0x7f1cc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce5200640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc8004800 0x7f1cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce6600640 1 -- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc8004800 msgr2=0x7f1cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:57.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce6600640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc8004800 0x7f1cc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce6600640 1 -- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cc80039b0 msgr2=0x7f1cc8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:57.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce6600640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cc80039b0 0x7f1cc8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce6600640 1 -- 172.21.15.7:0/3186708786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc8003520 con 0x7f1cc80051c0 2024-08-19T00:45:57.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.663+0000 7f1ce5c00640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cc80039b0 0x7f1cc8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:45:57.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.664+0000 7f1ce6600640 1 -- 172.21.15.7:0/3186708786 reap_dead start 2024-08-19T00:45:57.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.664+0000 7f1ce6600640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80051c0 0x7f1cc800b9c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8001e50 tx=0x7f1cc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd29f6d94775c8a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:57.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.664+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4009690 con 0x7f1cc80051c0 2024-08-19T00:45:57.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.664+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8003970 con 0x7f1cc80051c0 2024-08-19T00:45:57.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.664+0000 7f1cdfe00640 1 -- 172.21.15.7:0/3186708786 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8001a70 con 0x7f1cc80051c0 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.665+0000 7f1ce7000640 1 -- 172.21.15.7:0/3186708786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80051c0 msgr2=0x7f1cc800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.665+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80051c0 0x7f1cc800b9c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8001e50 tx=0x7f1cc8005830 comp rx=0 tx=0).stop 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.665+0000 7f1ce7000640 1 -- 172.21.15.7:0/3186708786 shutdown_connections 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.665+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3186708786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80051c0 0x7f1cc800b9c0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.665+0000 7f1ce7000640 1 -- 172.21.15.7:0/3186708786 >> 172.21.15.7:0/3186708786 conn(0x7f1ce009d4d0 msgr2=0x7f1ce00d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.665+0000 7f1ce7000640 1 -- 172.21.15.7:0/3186708786 shutdown_connections 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.665+0000 7f1ce7000640 1 -- 172.21.15.7:0/3186708786 wait complete. 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.667+0000 7f1ce7000640 1 Processor -- start 2024-08-19T00:45:57.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.667+0000 7f1ce7000640 1 -- start start 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce7000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc80051c0 0x7f1ce01532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce7000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce0153de0 0x7f1ce01627c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce7000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce0158730 0x7f1ce0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce7000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00d2800 con 0x7f1ce0153de0 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce7000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00d2b70 con 0x7f1ce0158730 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce7000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce00d3000 con 0x7f1cc80051c0 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce0153de0 0x7f1ce01627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce0153de0 0x7f1ce01627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60314/0 (socket says 172.21.15.7:60314) 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.668+0000 7f1ce5200640 1 -- 172.21.15.7:0/3646504406 learned_addr learned my addr 172.21.15.7:0/3646504406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:57.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce5200640 1 -- 172.21.15.7:0/3646504406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc80051c0 msgr2=0x7f1ce01532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce5200640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc80051c0 0x7f1ce01532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce5200640 1 -- 172.21.15.7:0/3646504406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce0158730 msgr2=0x7f1ce0158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce5200640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce0158730 0x7f1ce0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce5200640 1 -- 172.21.15.7:0/3646504406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce0153810 con 0x7f1ce0153de0 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce5200640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce0153de0 0x7f1ce01627c0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc007320 tx=0x7f1ccc0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1cdd600640 1 -- 172.21.15.7:0/3646504406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc01a070 con 0x7f1ce0153de0 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1cdd600640 1 -- 172.21.15.7:0/3646504406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00f920 con 0x7f1ce0153de0 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1cdd600640 1 -- 172.21.15.7:0/3646504406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00fcf0 con 0x7f1ce0153de0 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce0159500 con 0x7f1ce0153de0 2024-08-19T00:45:57.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.669+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce0159ac0 con 0x7f1ce0153de0 2024-08-19T00:45:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.670+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce00b7d30 con 0x7f1ce0153de0 2024-08-19T00:45:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.671+0000 7f1cdd600640 1 -- 172.21.15.7:0/3646504406 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ccc01d070 con 0x7f1ce0153de0 2024-08-19T00:45:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.672+0000 7f1cdd600640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1cc006be30 0x7f1cc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.672+0000 7f1cdd600640 1 -- 172.21.15.7:0/3646504406 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7f1ccc08af70 con 0x7f1ce0153de0 2024-08-19T00:45:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.672+0000 7f1ce5c00640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1cc006be30 0x7f1cc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.673+0000 7f1ce5c00640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1cc006be30 0x7f1cc006e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4006b10 tx=0x7f1cd4006aa0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:57.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.677+0000 7f1cdd600640 1 -- 172.21.15.7:0/3646504406 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1ce00b7d30 con 0x7f1ce0153de0 2024-08-19T00:45:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:57.895+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1ce00d4910 con 0x7f1ce0153de0 2024-08-19T00:45:58.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.103+0000 7f1cdd600640 1 -- 172.21.15.7:0/3646504406 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v205) ==== 161+0+0 (secure 0 0 0) 0x7f1ccc0591c0 con 0x7f1ce0153de0 2024-08-19T00:45:58.106 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1cc006be30 msgr2=0x7f1cc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1cc006be30 0x7f1cc006e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4006b10 tx=0x7f1cd4006aa0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce0153de0 msgr2=0x7f1ce01627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce0153de0 0x7f1ce01627c0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc007320 tx=0x7f1ccc0077e0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 shutdown_connections 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1cc006be30 0x7f1cc006e2f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce0158730 0x7f1ce0158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce0153de0 0x7f1ce01627c0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 --2- 172.21.15.7:0/3646504406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cc80051c0 0x7f1ce01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 >> 172.21.15.7:0/3646504406 conn(0x7f1ce009d4d0 msgr2=0x7f1ce00b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 shutdown_connections 2024-08-19T00:45:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.107+0000 7f1ce7000640 1 -- 172.21.15.7:0/3646504406 wait complete. 2024-08-19T00:45:58.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:45:58.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.283+0000 7f93ba800640 1 Processor -- start 2024-08-19T00:45:58.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.283+0000 7f93ba800640 1 -- start start 2024-08-19T00:45:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.284+0000 7f93ba800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93b4147b80 0x7f93b40b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.284+0000 7f93ba800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f93b40d2930 0x7f93b40b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.284+0000 7f93ba800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b40d2da0 con 0x7f93b40b4500 2024-08-19T00:45:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.284+0000 7f93ba800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f93b40b4950 con 0x7f93b4147b80 2024-08-19T00:45:58.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.284+0000 7f93ba800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f93b406ce30 con 0x7f93b40d2930 2024-08-19T00:45:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93b4147b80 0x7f93b40b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b9400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93b4147b80 0x7f93b40b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60318/0 (socket says 172.21.15.7:60318) 2024-08-19T00:45:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b9400640 1 -- 172.21.15.7:0/2171208003 learned_addr learned my addr 172.21.15.7:0/2171208003 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b8a00640 1 --2- 172.21.15.7:0/2171208003 >> v2:172.21.15.162:3300/0 conn(0x7f93b40d2930 0x7f93b40b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b9400640 1 -- 172.21.15.7:0/2171208003 >> v2:172.21.15.162:3300/0 conn(0x7f93b40d2930 msgr2=0x7f93b40b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b9400640 1 --2- 172.21.15.7:0/2171208003 >> v2:172.21.15.162:3300/0 conn(0x7f93b40d2930 0x7f93b40b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b9400640 1 -- 172.21.15.7:0/2171208003 >> v1:172.21.15.162:6789/0 conn(0x7f93b40b4500 legacy=0x7f93b40b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b9400640 1 -- 172.21.15.7:0/2171208003 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b406d110 con 0x7f93b4147b80 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.285+0000 7f93b8a00640 1 --2- 172.21.15.7:0/2171208003 >> v2:172.21.15.162:3300/0 conn(0x7f93b40d2930 0x7f93b40b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.286+0000 7f93b9400640 1 --2- 172.21.15.7:0/2171208003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b4147b80 0x7f93b40b15e0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f93b406e170 tx=0x7f93a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54921663b3b10241 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.286+0000 7f93b3e00640 1 -- 172.21.15.7:0/2171208003 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8037070 con 0x7f93b4147b80 2024-08-19T00:45:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.286+0000 7f93b3e00640 1 -- 172.21.15.7:0/2171208003 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a8032440 con 0x7f93b4147b80 2024-08-19T00:45:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.286+0000 7f93b3e00640 1 -- 172.21.15.7:0/2171208003 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8032810 con 0x7f93b4147b80 2024-08-19T00:45:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 -- 172.21.15.7:0/2171208003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b4147b80 msgr2=0x7f93b40b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 --2- 172.21.15.7:0/2171208003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b4147b80 0x7f93b40b15e0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f93b406e170 tx=0x7f93a802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 -- 172.21.15.7:0/2171208003 shutdown_connections 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 --2- 172.21.15.7:0/2171208003 >> v2:172.21.15.162:3300/0 conn(0x7f93b40d2930 0x7f93b40b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 --2- 172.21.15.7:0/2171208003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b4147b80 0x7f93b40b15e0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 -- 172.21.15.7:0/2171208003 >> 172.21.15.7:0/2171208003 conn(0x7f93b4062540 msgr2=0x7f93b4062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 -- 172.21.15.7:0/2171208003 shutdown_connections 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.287+0000 7f93ba800640 1 -- 172.21.15.7:0/2171208003 wait complete. 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.289+0000 7f93ba800640 1 Processor -- start 2024-08-19T00:45:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.289+0000 7f93ba800640 1 -- start start 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93ba800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93b40b4500 0x7f93b41f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93ba800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b40d2930 0x7f93b41e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93ba800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93b4147b80 0x7f93b41e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93ba800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f93b406d9b0 con 0x7f93b40d2930 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93ba800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93b406d6d0 con 0x7f93b40b4500 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93ba800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f93b4147f60 con 0x7f93b4147b80 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93b8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b40d2930 0x7f93b41e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93b8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b40d2930 0x7f93b41e7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60320/0 (socket says 172.21.15.7:60320) 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93b8a00640 1 -- 172.21.15.7:0/2942079266 learned_addr learned my addr 172.21.15.7:0/2942079266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93b9400640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93b40b4500 0x7f93b41f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.290+0000 7f93b9e00640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93b4147b80 0x7f93b41e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b8a00640 1 -- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93b4147b80 msgr2=0x7f93b41e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b8a00640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93b4147b80 0x7f93b41e8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b8a00640 1 -- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93b40b4500 msgr2=0x7f93b41f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b8a00640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93b40b4500 0x7f93b41f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b8a00640 1 -- 172.21.15.7:0/2942079266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b41f7bd0 con 0x7f93b40d2930 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b8a00640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b40d2930 0x7f93b41e7ce0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c7f0 tx=0x7f93a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b1600640 1 -- 172.21.15.7:0/2942079266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0015070 con 0x7f93b40d2930 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b1600640 1 -- 172.21.15.7:0/2942079266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a0007a30 con 0x7f93b40d2930 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93b1600640 1 -- 172.21.15.7:0/2942079266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0007e00 con 0x7f93b40d2930 2024-08-19T00:45:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b41f4ec0 con 0x7f93b40d2930 2024-08-19T00:45:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.291+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b41f54a0 con 0x7f93b40d2930 2024-08-19T00:45:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.292+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b40b3fc0 con 0x7f93b40d2930 2024-08-19T00:45:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.293+0000 7f93b1600640 1 -- 172.21.15.7:0/2942079266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93a0018070 con 0x7f93b40d2930 2024-08-19T00:45:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.294+0000 7f93b1600640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f939406be30 0x7f939406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.294+0000 7f93b1600640 1 -- 172.21.15.7:0/2942079266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7f93a008b4d0 con 0x7f93b40d2930 2024-08-19T00:45:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.294+0000 7f93b9400640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f939406be30 0x7f939406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.295+0000 7f93b9400640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f939406be30 0x7f939406e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f93a8034000 tx=0x7f93a802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.299+0000 7f93b1600640 1 -- 172.21.15.7:0/2942079266 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f93a00590d0 con 0x7f93b40d2930 2024-08-19T00:45:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:58.551+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f93b41e62d0 con 0x7f93b40d2930 2024-08-19T00:45:59.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.105+0000 7f93b1600640 1 -- 172.21.15.7:0/2942079266 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v206) ==== 101+0+0 (secure 0 0 0) 0x7f93a005d3d0 con 0x7f93b40d2930 2024-08-19T00:45:59.108 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f939406be30 msgr2=0x7f939406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f939406be30 0x7f939406e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f93a8034000 tx=0x7f93a802e000 comp rx=0 tx=0).stop 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b40d2930 msgr2=0x7f93b41e7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b40d2930 0x7f93b41e7ce0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c7f0 tx=0x7f93a000cbf0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 shutdown_connections 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f939406be30 0x7f939406e2f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93b4147b80 0x7f93b41e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93b40d2930 0x7f93b41e7ce0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 --2- 172.21.15.7:0/2942079266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93b40b4500 0x7f93b41f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 >> 172.21.15.7:0/2942079266 conn(0x7f93b4062540 msgr2=0x7f93b41e5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 shutdown_connections 2024-08-19T00:45:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.108+0000 7f93ba800640 1 -- 172.21.15.7:0/2942079266 wait complete. 2024-08-19T00:45:59.130 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:45:59.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 Processor -- start 2024-08-19T00:45:59.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 -- start start 2024-08-19T00:45:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d41650 0x5593a4de8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d425b0 0x5593a4dd93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d42990 0x5593a4ddf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593a4cb6d00 con 0x5593a4d41650 2024-08-19T00:45:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5593a4cbad40 con 0x5593a4d425b0 2024-08-19T00:45:59.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.207+0000 7f3f10fe6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5593a4de7dc0 con 0x5593a4d42990 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d41650 0x5593a4de8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d41650 0x5593a4de8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60328/0 (socket says 172.21.15.7:60328) 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 -- 172.21.15.7:0/3360281914 learned_addr learned my addr 172.21.15.7:0/3360281914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0d800640 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d425b0 0x5593a4dd93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0ec00640 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d42990 0x5593a4ddf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 -- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d42990 msgr2=0x5593a4ddf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d42990 0x5593a4ddf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 -- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d425b0 msgr2=0x5593a4dd93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d425b0 0x5593a4dd93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 -- 172.21.15.7:0/3360281914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a4c78080 con 0x5593a4d41650 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.208+0000 7f3f0e200640 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d41650 0x5593a4de8f70 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000b2e0 tx=0x7f3f0000b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7756705fbbf584 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f07e00640 1 -- 172.21.15.7:0/3360281914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00008070 con 0x5593a4d41650 2024-08-19T00:45:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f07e00640 1 -- 172.21.15.7:0/3360281914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0000d500 con 0x5593a4d41650 2024-08-19T00:45:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f07e00640 1 -- 172.21.15.7:0/3360281914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000d8f0 con 0x5593a4d41650 2024-08-19T00:45:59.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/3360281914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d41650 msgr2=0x5593a4de8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d41650 0x5593a4de8f70 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000b2e0 tx=0x7f3f0000b7a0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/3360281914 shutdown_connections 2024-08-19T00:45:59.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d42990 0x5593a4ddf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d425b0 0x5593a4dd93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/3360281914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d41650 0x5593a4de8f70 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/3360281914 >> 172.21.15.7:0/3360281914 conn(0x5593a4d3f4e0 msgr2=0x5593a4d0f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:59.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/3360281914 shutdown_connections 2024-08-19T00:45:59.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.209+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/3360281914 wait complete. 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.210+0000 7f3f10fe6f40 1 Processor -- start 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.210+0000 7f3f10fe6f40 1 -- start start 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f10fe6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d41650 0x5593a4de1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f10fe6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d425b0 0x5593a4de2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f10fe6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d42990 0x5593a4dd8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f10fe6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593a4d0fdb0 con 0x5593a4d42990 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f10fe6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5593a4d10090 con 0x5593a4d41650 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f10fe6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5593a4ddcc60 con 0x5593a4d425b0 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f0ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d42990 0x5593a4dd8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f0ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d42990 0x5593a4dd8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60344/0 (socket says 172.21.15.7:60344) 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.211+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 learned_addr learned my addr 172.21.15.7:0/2634638321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d41650 0x5593a4de1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d425b0 msgr2=0x5593a4de2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d425b0 0x5593a4de2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0ec00640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d425b0 0x5593a4de2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d41650 msgr2=0x5593a4de1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0ec00640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d41650 0x5593a4de1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a4ddc9c0 con 0x5593a4d42990 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593a4d41650 0x5593a4de1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5593a4d425b0 0x5593a4de2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f0ec00640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d42990 0x5593a4dd8340 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f3f08025a80 tx=0x7f3f08003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f06a00640 1 -- 172.21.15.7:0/2634638321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08069070 con 0x5593a4d42990 2024-08-19T00:45:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f06a00640 1 -- 172.21.15.7:0/2634638321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f08058400 con 0x5593a4d42990 2024-08-19T00:45:59.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f06a00640 1 -- 172.21.15.7:0/2634638321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080587f0 con 0x5593a4d42990 2024-08-19T00:45:59.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.212+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5593a4de1eb0 con 0x5593a4d42990 2024-08-19T00:45:59.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.213+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a4de2470 con 0x5593a4d42990 2024-08-19T00:45:59.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.214+0000 7f3f06a00640 1 -- 172.21.15.7:0/2634638321 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f08058990 con 0x5593a4d42990 2024-08-19T00:45:59.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.215+0000 7f3f06a00640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ef006a810 0x7f3ef006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.215+0000 7f3f06a00640 1 -- 172.21.15.7:0/2634638321 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7f3f080cdb70 con 0x5593a4d42990 2024-08-19T00:45:59.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.216+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ef006a810 0x7f3ef006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.222 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:45:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.216+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5593a4ddc4c0 0x5593a4de5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.216+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4de60e0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.216+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ef006a810 0x7f3ef006ccd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000b2e0 tx=0x7f3f00008000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.216+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5593a4ddc4c0 0x5593a4de5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.217+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5593a4ddc4c0 0x5593a4de5ba0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.219+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v106'598 uv572 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.219+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4de6510 con 0x5593a4ddc4c0 2024-08-19T00:45:59.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.221+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v106'599 uv599 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.221+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e89870 con 0x5593a4ddc4c0 2024-08-19T00:45:59.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.222+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v106'600 uv600 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.226 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:45:59.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.222+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8ac20 con 0x5593a4ddc4c0 2024-08-19T00:45:59.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.224+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v106'601 uv601 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.224+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8afc0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.226+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v106'602 uv602 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.226+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e89c10 con 0x5593a4ddc4c0 2024-08-19T00:45:59.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.227+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v106'603 uv603 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.227+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a000 con 0x5593a4ddc4c0 2024-08-19T00:45:59.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.229+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v106'604 uv578 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.229+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.231+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v106'605 uv605 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.231+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.234 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:45:59.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.232+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v106'606 uv606 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.232+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.233+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v106'607 uv607 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.234+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.235+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v106'608 uv608 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.235+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.236+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v106'609 uv609 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.236+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.238+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v106'610 uv585 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.238+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.239+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v106'611 uv611 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.239+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.243 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:45:59.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.241+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v106'612 uv612 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.241+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.242+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v106'613 uv613 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.242+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.244+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v106'614 uv614 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.244+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a3a0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.246+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v106'615 uv615 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.246+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a760 con 0x5593a4ddc4c0 2024-08-19T00:45:59.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.247+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v106'616 uv616 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.247+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.249+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v106'617 uv591 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.249+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.250+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v106'618 uv618 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.250+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.254 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:45:59.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.252+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v106'619 uv619 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.252+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.253+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v106'620 uv620 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.253+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.255+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v106'621 uv621 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.255+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.256+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v106'622 uv622 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.256+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.258+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v106'623 uv597 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.258+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.259+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v106'624 uv624 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.259+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.263 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:45:59.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.261+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v106'625 uv625 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.261+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.262+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v106'626 uv626 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.262+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.264+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v106'627 uv627 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.264+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4ddc4c0 2024-08-19T00:45:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.265+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v106'628 uv628 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.265+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5593a4e8b870 0x5593a4e8dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.265+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8a660 con 0x5593a4e8b870 2024-08-19T00:45:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.265+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5593a4e8b870 0x5593a4e8dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.266+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5593a4e8b870 0x5593a4e8dc60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.268+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v106'442 uv425 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.268+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8e1a0 con 0x5593a4e8b870 2024-08-19T00:45:59.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.269+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v106'443 uv443 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.269+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8e540 con 0x5593a4e8b870 2024-08-19T00:45:59.273 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:45:59.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.270+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v106'444 uv444 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.270+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4ddb550 con 0x5593a4e8b870 2024-08-19T00:45:59.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.272+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v106'445 uv445 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.272+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8ed90 con 0x5593a4e8b870 2024-08-19T00:45:59.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.273+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v106'446 uv446 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.274+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f1a0 con 0x5593a4e8b870 2024-08-19T00:45:59.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.275+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v106'447 uv430 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.275+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f590 con 0x5593a4e8b870 2024-08-19T00:45:59.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.276+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v106'448 uv448 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.276+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.280 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:45:59.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.278+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v106'449 uv449 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.278+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.280+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v106'450 uv450 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.280+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.281+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v106'451 uv451 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.281+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.282+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v106'452 uv435 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.282+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.284+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v106'453 uv453 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.284+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.287 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:45:59.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.285+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v106'454 uv454 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.285+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.287+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v106'455 uv455 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.287+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.288+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v106'456 uv456 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.288+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.290+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v106'457 uv441 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.290+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.291+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v106'458 uv458 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.291+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.295 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:45:59.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.292+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v106'459 uv459 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.292+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.294+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v106'460 uv460 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.294+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.295+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v106'461 uv461 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.295+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e8f930 con 0x5593a4e8b870 2024-08-19T00:45:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.297+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v106'462 uv462 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e8b870 2024-08-19T00:45:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.297+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5593a4e90230 0x5593a4e90670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.297+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e92d80 con 0x5593a4e90230 2024-08-19T00:45:59.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.297+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5593a4e90230 0x5593a4e90670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.298+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5593a4e90230 0x5593a4e90670 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.299+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v106'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.299+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e92d80 con 0x5593a4e90230 2024-08-19T00:45:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.301+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v106'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.301+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e92d80 con 0x5593a4e90230 2024-08-19T00:45:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.302+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v106'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.304 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:45:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.302+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e93e10 con 0x5593a4e90230 2024-08-19T00:45:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.303+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v106'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.303+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e93dd0 con 0x5593a4e90230 2024-08-19T00:45:59.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.304+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v106'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.304+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e93dd0 con 0x5593a4e90230 2024-08-19T00:45:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.306+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v106'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.306+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e93db0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.307+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v106'88 uv87 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.307+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e93dd0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.308+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v106'89 uv89 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.308+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e93dd0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.310+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v106'90 uv90 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.313 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:45:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.310+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e93dd0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.311+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v106'91 uv91 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.312+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5593a4e93540 0x5593a4e93980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.312+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e96220 con 0x5593a4e93540 2024-08-19T00:45:59.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.312+0000 7f3f0ec00640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5593a4e93540 0x5593a4e93980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.313+0000 7f3f0ec00640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5593a4e93540 0x5593a4e93980 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.314+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v106'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.314+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e965c0 con 0x5593a4e93540 2024-08-19T00:45:59.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.316+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v106'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.316+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e96960 con 0x5593a4e93540 2024-08-19T00:45:59.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.317+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v106'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.320 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:45:59.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.317+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e98210 con 0x5593a4e93540 2024-08-19T00:45:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.318+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v106'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.319+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e985b0 con 0x5593a4e93540 2024-08-19T00:45:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.320+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v106'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.320+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e97200 con 0x5593a4e93540 2024-08-19T00:45:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.321+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v106'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.321+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5593a4e97b00 0x5593a4e9a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.321+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9aea0 con 0x5593a4e97b00 2024-08-19T00:45:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.321+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5593a4e97b00 0x5593a4e9a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.322+0000 7f3f0e200640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5593a4e97b00 0x5593a4e9a960 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.324+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v106'216 uv210 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.324+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9aea0 con 0x5593a4e97b00 2024-08-19T00:45:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.325+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v106'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.325+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9aea0 con 0x5593a4e97b00 2024-08-19T00:45:59.329 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:45:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.326+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v106'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.327+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9c2a0 con 0x5593a4e97b00 2024-08-19T00:45:59.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.328+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v106'219 uv219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.328+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9c2a0 con 0x5593a4e97b00 2024-08-19T00:45:59.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.329+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v106'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.329+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9b290 con 0x5593a4e97b00 2024-08-19T00:45:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.331+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v106'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.331+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9b290 con 0x5593a4e97b00 2024-08-19T00:45:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.332+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v106'222 uv215 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.332+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9b290 con 0x5593a4e97b00 2024-08-19T00:45:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.334+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v106'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.334+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9b290 con 0x5593a4e97b00 2024-08-19T00:45:59.337 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:45:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.335+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v106'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.335+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9b290 con 0x5593a4e97b00 2024-08-19T00:45:59.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.336+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v106'225 uv225 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.336+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9b290 con 0x5593a4e97b00 2024-08-19T00:45:59.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.338+0000 7f3f0e200640 1 -- 172.21.15.7:0/2634638321 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v106'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f0000da50 con 0x5593a4e97b00 2024-08-19T00:45:59.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.338+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5593a4e9b7a0 0x5593a4e9db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.338+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e1f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.338+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5593a4e9b7a0 0x5593a4e9db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.339+0000 7f3f0d800640 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5593a4e9b7a0 0x5593a4e9db90 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.340+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v106'97 uv96 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.340+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e1f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.341+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v106'98 uv98 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.341+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e9b7a0 2024-08-19T00:45:59.345 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:45:59.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.342+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v106'99 uv99 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.342+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e9b7a0 2024-08-19T00:45:59.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.344+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v106'100 uv100 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.344+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e9b7a0 2024-08-19T00:45:59.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.345+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v106'101 uv101 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.345+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4ddc4c0 2024-08-19T00:45:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.346+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v106'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.346+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4ddc4c0 2024-08-19T00:45:59.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.348+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v106'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.348+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4ddc4c0 2024-08-19T00:45:59.352 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:45:59.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.349+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v106'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.349+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9f650 con 0x5593a4ddc4c0 2024-08-19T00:45:59.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.351+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v106'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.351+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9f650 con 0x5593a4ddc4c0 2024-08-19T00:45:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.352+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v106'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.353+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4ddc4c0 2024-08-19T00:45:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.354+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v106'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4ddc4c0 2024-08-19T00:45:59.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.354+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.355+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v106'192 uv186 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.356+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.357+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v106'193 uv193 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.357+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.361 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:45:59.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.358+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v106'194 uv194 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.358+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.360+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v106'195 uv195 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.360+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.361+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v106'196 uv196 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.361+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.364+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v106'197 uv191 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.364+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.365+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v106'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.365+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.368 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:45:59.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.365+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v106'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.366+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9e640 con 0x5593a4e90230 2024-08-19T00:45:59.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.367+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v106'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.367+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4ea1450 con 0x5593a4e90230 2024-08-19T00:45:59.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.369+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v106'201 uv201 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e90230 2024-08-19T00:45:59.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.369+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.370+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v106'87 uv86 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.370+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.372+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v106'88 uv88 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.372+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.375 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:45:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.373+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v106'89 uv89 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.373+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.375+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v106'90 uv90 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.375+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.376+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v106'117 uv116 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.376+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.378+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v106'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.378+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.382 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:45:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.379+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v106'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.379+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.381+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v106'120 uv120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.381+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.382+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v106'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.382+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e93540 2024-08-19T00:45:59.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.384+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v106'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3f08097dc0 con 0x5593a4e93540 2024-08-19T00:45:59.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.384+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.386+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v106'99 uv98 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.386+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.387+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v106'100 uv100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.387+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.390 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:45:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.388+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v106'101 uv101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.388+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.390+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v106'102 uv102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.390+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.391+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v106'103 uv103 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.391+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.393+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v106'241 uv233 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.393+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.394+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v106'242 uv242 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.394+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.398 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:45:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.395+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v106'243 uv243 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.395+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.397+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v106'244 uv244 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.397+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.398+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v106'245 uv245 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.398+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.399+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v106'246 uv240 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.399+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.401+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v106'247 uv247 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.401+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.404 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:45:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.402+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v106'248 uv248 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.402+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.404+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v106'249 uv249 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.404+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.405+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v106'250 uv250 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.405+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9eaf0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.406+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v106'251 uv251 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.406+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x5593a4e9f360 con 0x5593a4e9b7a0 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.407+0000 7f3f0d800640 1 -- 172.21.15.7:0/2634638321 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v106'252 uv252 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f3efc00e4f0 con 0x5593a4e9b7a0 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.407+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5593a4e8b870 msgr2=0x5593a4e8dc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x5593a4e8b870 0x5593a4e8dc60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5593a4e97b00 msgr2=0x5593a4e9a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x5593a4e97b00 0x5593a4e9a960 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5593a4e9b7a0 msgr2=0x5593a4e9db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5593a4e9b7a0 0x5593a4e9db90 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5593a4e90230 msgr2=0x5593a4e90670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5593a4e90230 0x5593a4e90670 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 reap_dead start 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5593a4ddc4c0 msgr2=0x5593a4de5ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5593a4ddc4c0 0x5593a4de5ba0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f0ec00640 1 -- 172.21.15.7:0/2634638321 reap_dead start 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5593a4e93540 msgr2=0x5593a4e93980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5593a4e93540 0x5593a4e93980 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ef006a810 msgr2=0x7f3ef006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ef006a810 0x7f3ef006ccd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000b2e0 tx=0x7f3f00008000 comp rx=0 tx=0).stop 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d42990 msgr2=0x5593a4dd8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d42990 0x5593a4dd8340 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f3f08025a80 tx=0x7f3f08003330 comp rx=0 tx=0).stop 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 shutdown_connections 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ef006a810 0x7f3ef006ccd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593a4d42990 0x5593a4dd8340 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 --2- 172.21.15.7:0/2634638321 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5593a4e93540 0x5593a4e93980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 >> 172.21.15.7:0/2634638321 conn(0x5593a4d3f4e0 msgr2=0x5593a4d0f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 shutdown_connections 2024-08-19T00:45:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.408+0000 7f3f10fe6f40 1 -- 172.21.15.7:0/2634638321 wait complete. 2024-08-19T00:45:59.415 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-08-19T00:45:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.529+0000 7f7903121f40 1 Processor -- start 2024-08-19T00:45:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.529+0000 7f7903121f40 1 -- start start 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7903121f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de779f40 0x55f0de749170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7903121f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de77b5b0 0x55f0de802aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7903121f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de802fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7903121f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f0de77a8f0 con 0x55f0de77b990 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7903121f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f0de6efd00 con 0x55f0de779f40 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7903121f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f0de820dc0 con 0x55f0de77b5b0 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7900e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de802fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7900e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de802fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60372/0 (socket says 172.21.15.7:60372) 2024-08-19T00:45:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.530+0000 7f7900e00640 1 -- 172.21.15.7:0/4006719279 learned_addr learned my addr 172.21.15.7:0/4006719279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900400640 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de779f40 0x55f0de749170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f78ffa00640 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de77b5b0 0x55f0de802aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900e00640 1 -- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de77b5b0 msgr2=0x55f0de802aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900e00640 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de77b5b0 0x55f0de802aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900e00640 1 -- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de779f40 msgr2=0x55f0de749170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900e00640 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de779f40 0x55f0de749170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900e00640 1 -- 172.21.15.7:0/4006719279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0de674b30 con 0x55f0de77b990 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900400640 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de779f40 0x55f0de749170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f78ffa00640 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de77b5b0 0x55f0de802aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:59.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.531+0000 7f7900e00640 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de802fe0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f78f80258e0 tx=0x7f78f8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ffb4f2f7845509 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f78fe600640 1 -- 172.21.15.7:0/4006719279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8056040 con 0x55f0de77b990 2024-08-19T00:45:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f78fe600640 1 -- 172.21.15.7:0/4006719279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80528a0 con 0x55f0de77b990 2024-08-19T00:45:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f78fe600640 1 -- 172.21.15.7:0/4006719279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8052c50 con 0x55f0de77b990 2024-08-19T00:45:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 -- 172.21.15.7:0/4006719279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 msgr2=0x55f0de802fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de802fe0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f78f80258e0 tx=0x7f78f8051000 comp rx=0 tx=0).stop 2024-08-19T00:45:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 -- 172.21.15.7:0/4006719279 shutdown_connections 2024-08-19T00:45:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de802fe0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de77b5b0 0x55f0de802aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 --2- 172.21.15.7:0/4006719279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de779f40 0x55f0de749170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 -- 172.21.15.7:0/4006719279 >> 172.21.15.7:0/4006719279 conn(0x55f0de7784e0 msgr2=0x55f0de7788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 -- 172.21.15.7:0/4006719279 shutdown_connections 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.532+0000 7f7903121f40 1 -- 172.21.15.7:0/4006719279 wait complete. 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.533+0000 7f7903121f40 1 Processor -- start 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.533+0000 7f7903121f40 1 -- start start 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7903121f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de779f40 0x55f0de81fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7903121f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de77b5b0 0x55f0de8021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7903121f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de8ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7903121f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f0de804ff0 con 0x55f0de77b990 2024-08-19T00:45:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7903121f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f0de819a30 con 0x55f0de77b5b0 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7903121f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f0de823750 con 0x55f0de779f40 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7900e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de8ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7900e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de8ab2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60378/0 (socket says 172.21.15.7:60378) 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7900e00640 1 -- 172.21.15.7:0/1045889535 learned_addr learned my addr 172.21.15.7:0/1045889535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f7900400640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de779f40 0x55f0de81fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.534+0000 7f78ffa00640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de77b5b0 0x55f0de8021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7900e00640 1 -- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de779f40 msgr2=0x55f0de81fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7900e00640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f0de779f40 0x55f0de81fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7900e00640 1 -- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de77b5b0 msgr2=0x55f0de8021c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7900e00640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0de77b5b0 0x55f0de8021c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7900e00640 1 -- 172.21.15.7:0/1045889535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0de6b1080 con 0x55f0de77b990 2024-08-19T00:45:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7900e00640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de8ab2f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a3f0 tx=0x7f78f8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f78fd200640 1 -- 172.21.15.7:0/1045889535 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8073030 con 0x55f0de77b990 2024-08-19T00:45:59.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f78fd200640 1 -- 172.21.15.7:0/1045889535 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f8066440 con 0x55f0de77b990 2024-08-19T00:45:59.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f78fd200640 1 -- 172.21.15.7:0/1045889535 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8056070 con 0x55f0de77b990 2024-08-19T00:45:59.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0de81eae0 con 0x55f0de77b990 2024-08-19T00:45:59.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.535+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0de81f0a0 con 0x55f0de77b990 2024-08-19T00:45:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.537+0000 7f78fd200640 1 -- 172.21.15.7:0/1045889535 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78f8076070 con 0x55f0de77b990 2024-08-19T00:45:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.538+0000 7f78fd200640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e006a840 0x7f78e006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.538+0000 7f78fd200640 1 -- 172.21.15.7:0/1045889535 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7f78f80cf730 con 0x55f0de77b990 2024-08-19T00:45:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.538+0000 7f7900400640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e006a840 0x7f78e006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.538+0000 7f7903121f40 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f0de81d020 0x55f0de81d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.538+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x55f0de81d940 con 0x55f0de81d020 2024-08-19T00:45:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.539+0000 7f78ffa00640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f0de81d020 0x55f0de81d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.539+0000 7f7900400640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e006a840 0x7f78e006cd00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f78f0000c00 tx=0x7f78f0001880 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.539+0000 7f78ffa00640 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f0de81d020 0x55f0de81d400 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f78ffa00640 1 -- 172.21.15.7:0/1045889535 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~80] v106'202 uv202 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f78ec0097f0 con 0x55f0de81d020 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f0de81d020 msgr2=0x55f0de81d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f0de81d020 0x55f0de81d400 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e006a840 msgr2=0x7f78e006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f78e006a840 0x7f78e006cd00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f78f0000c00 tx=0x7f78f0001880 comp rx=0 tx=0).stop 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 msgr2=0x55f0de8ab2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 --2- 172.21.15.7:0/1045889535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0de77b990 0x55f0de8ab2f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a3f0 tx=0x7f78f8003330 comp rx=0 tx=0).stop 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7900e00640 1 -- 172.21.15.7:0/1045889535 reap_dead start 2024-08-19T00:45:59.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 shutdown_connections 2024-08-19T00:45:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 >> 172.21.15.7:0/1045889535 conn(0x55f0de7784e0 msgr2=0x55f0de7788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 shutdown_connections 2024-08-19T00:45:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.541+0000 7f7903121f40 1 -- 172.21.15.7:0/1045889535 wait complete. 2024-08-19T00:45:59.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:45:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.745+0000 7f4504e00640 1 Processor -- start 2024-08-19T00:45:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.745+0000 7f4504e00640 1 -- start start 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.746+0000 7f4504e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f450015e3e0 0x7f45000b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.746+0000 7f4504e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f45000d27b0 0x7f45000d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.746+0000 7f4504e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45000b4df0 con 0x7f45000b4150 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.746+0000 7f4504e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f45000d3140 con 0x7f45000d27b0 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.746+0000 7f4504e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f45000b50d0 con 0x7f450015e3e0 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.746+0000 7f44fea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f45000d27b0 0x7f45000d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44fea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f45000d27b0 0x7f45000d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60392/0 (socket says 172.21.15.7:60392) 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44fea00640 1 -- 172.21.15.7:0/1063338209 learned_addr learned my addr 172.21.15.7:0/1063338209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44ff400640 1 --2- 172.21.15.7:0/1063338209 >> v2:172.21.15.162:3300/0 conn(0x7f450015e3e0 0x7f45000b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44fea00640 1 -- 172.21.15.7:0/1063338209 >> v2:172.21.15.162:3300/0 conn(0x7f450015e3e0 msgr2=0x7f45000b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44fea00640 1 --2- 172.21.15.7:0/1063338209 >> v2:172.21.15.162:3300/0 conn(0x7f450015e3e0 0x7f45000b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44fea00640 1 -- 172.21.15.7:0/1063338209 >> v1:172.21.15.162:6789/0 conn(0x7f45000b4150 legacy=0x7f45000b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:45:59.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44fea00640 1 -- 172.21.15.7:0/1063338209 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45000cf1e0 con 0x7f45000d27b0 2024-08-19T00:45:59.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.747+0000 7f44ff400640 1 --2- 172.21.15.7:0/1063338209 >> v2:172.21.15.162:3300/0 conn(0x7f450015e3e0 0x7f45000b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.748+0000 7f44fea00640 1 --2- 172.21.15.7:0/1063338209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f45000d2c00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009870 tx=0x7f44ec02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322d226499a61551 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.748+0000 7f44fe000640 1 -- 172.21.15.7:0/1063338209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec037070 con 0x7f45000d27b0 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.748+0000 7f44fe000640 1 -- 172.21.15.7:0/1063338209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec032440 con 0x7f45000d27b0 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.748+0000 7f44fe000640 1 -- 172.21.15.7:0/1063338209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec032810 con 0x7f45000d27b0 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 -- 172.21.15.7:0/1063338209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 msgr2=0x7f45000d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 --2- 172.21.15.7:0/1063338209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f45000d2c00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009870 tx=0x7f44ec02a250 comp rx=0 tx=0).stop 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 -- 172.21.15.7:0/1063338209 shutdown_connections 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 --2- 172.21.15.7:0/1063338209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f45000d2c00 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 --2- 172.21.15.7:0/1063338209 >> v2:172.21.15.162:3300/0 conn(0x7f450015e3e0 0x7f45000b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 -- 172.21.15.7:0/1063338209 >> 172.21.15.7:0/1063338209 conn(0x7f450008dbe0 msgr2=0x7f450009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:45:59.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 -- 172.21.15.7:0/1063338209 shutdown_connections 2024-08-19T00:45:59.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.749+0000 7f4504e00640 1 -- 172.21.15.7:0/1063338209 wait complete. 2024-08-19T00:45:59.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.751+0000 7f4504e00640 1 Processor -- start 2024-08-19T00:45:59.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.751+0000 7f4504e00640 1 -- start start 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f4504e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45000b4150 0x7f450015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f4504e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f450009e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f4504e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f450015e3e0 0x7f45000b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f4504e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f45000b13a0 con 0x7f45000d27b0 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f4504e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45000cee90 con 0x7f450015e3e0 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f4504e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45000cf9e0 con 0x7f45000b4150 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f450009e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f450009e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60396/0 (socket says 172.21.15.7:60396) 2024-08-19T00:45:59.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 -- 172.21.15.7:0/1819198665 learned_addr learned my addr 172.21.15.7:0/1819198665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:45:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44ff400640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45000b4150 0x7f450015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44ffe00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f450015e3e0 0x7f45000b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 -- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45000b4150 msgr2=0x7f450015b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45000b4150 0x7f450015b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 -- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f450015e3e0 msgr2=0x7f45000b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:45:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f450015e3e0 0x7f45000b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:45:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.752+0000 7f44fea00640 1 -- 172.21.15.7:0/1819198665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45000b7520 con 0x7f45000d27b0 2024-08-19T00:45:59.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.753+0000 7f44fea00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f450009e960 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009870 tx=0x7f44ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.753+0000 7f44f7400640 1 -- 172.21.15.7:0/1819198665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec037040 con 0x7f45000d27b0 2024-08-19T00:45:59.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.753+0000 7f44f7400640 1 -- 172.21.15.7:0/1819198665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec004230 con 0x7f45000d27b0 2024-08-19T00:45:59.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.753+0000 7f44f7400640 1 -- 172.21.15.7:0/1819198665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec030620 con 0x7f45000d27b0 2024-08-19T00:45:59.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.753+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45000b7800 con 0x7f45000d27b0 2024-08-19T00:45:59.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.753+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45000b7dc0 con 0x7f45000d27b0 2024-08-19T00:45:59.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.754+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450009d600 con 0x7f45000d27b0 2024-08-19T00:45:59.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.755+0000 7f44f7400640 1 -- 172.21.15.7:0/1819198665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44ec0307c0 con 0x7f45000d27b0 2024-08-19T00:45:59.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.756+0000 7f44f7400640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44e006be60 0x7f44e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:45:59.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.756+0000 7f44f7400640 1 -- 172.21.15.7:0/1819198665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 7429+0+0 (secure 0 0 0) 0x7f44ec0ac260 con 0x7f45000d27b0 2024-08-19T00:45:59.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.756+0000 7f44ff400640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44e006be60 0x7f44e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:45:59.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.757+0000 7f44ff400640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44e006be60 0x7f44e006e320 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f44f000aac0 tx=0x7f44f0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:45:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.760+0000 7f44f7400640 1 -- 172.21.15.7:0/1819198665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f450009d600 con 0x7f45000d27b0 2024-08-19T00:45:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:45:59.980+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f45000d2430 con 0x7f45000d27b0 2024-08-19T00:46:00.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.111+0000 7f44f7400640 1 -- 172.21.15.7:0/1819198665 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v207) ==== 162+0+0 (secure 0 0 0) 0x7f44ec079ef0 con 0x7f45000d27b0 2024-08-19T00:46:00.114 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44e006be60 msgr2=0x7f44e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44e006be60 0x7f44e006e320 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f44f000aac0 tx=0x7f44f0008040 comp rx=0 tx=0).stop 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 msgr2=0x7f450009e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f450009e960 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009870 tx=0x7f44ec0046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 shutdown_connections 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f44e006be60 0x7f44e006e320 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f450015e3e0 0x7f45000b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45000d27b0 0x7f450009e960 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 --2- 172.21.15.7:0/1819198665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45000b4150 0x7f450015b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 >> 172.21.15.7:0/1819198665 conn(0x7f450008dbe0 msgr2=0x7f45000b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 shutdown_connections 2024-08-19T00:46:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.114+0000 7f4504e00640 1 -- 172.21.15.7:0/1819198665 wait complete. 2024-08-19T00:46:00.124 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:00.122+0000 7f94cb400640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': Decoder at 'virtual void InoTable::decode_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=2 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:46:00.125 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:00.122+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:00.125 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:00.122+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:00.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.293+0000 7f798dc00640 1 Processor -- start 2024-08-19T00:46:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.293+0000 7f798dc00640 1 -- start start 2024-08-19T00:46:00.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.294+0000 7f798dc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7988159bf0 0x7f7988073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.294+0000 7f798dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798806f7f0 con 0x7f79880cec10 2024-08-19T00:46:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.294+0000 7f798dc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798806f510 con 0x7f79880739a0 2024-08-19T00:46:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.294+0000 7f798dc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7988072980 con 0x7f7988159bf0 2024-08-19T00:46:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.294+0000 7f7987400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f79880cec10 0x7f79880d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57272/0 (socket says 172.21.15.7:57272) 2024-08-19T00:46:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.294+0000 7f7987400640 1 -- 172.21.15.7:0/37111138 learned_addr learned my addr 172.21.15.7:0/37111138 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.294+0000 7f7986a00640 1 --2- 172.21.15.7:0/37111138 >> v2:172.21.15.162:3300/0 conn(0x7f7988159bf0 0x7f7988073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671556910 0 0) 0x7f798806f7f0 con 0x7f79880cec10 2024-08-19T00:46:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f796c003520 con 0x7f79880cec10 2024-08-19T00:46:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311277641 0 0) 0x7f798806f510 con 0x7f79880739a0 2024-08-19T00:46:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f798806f7f0 con 0x7f79880739a0 2024-08-19T00:46:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 443494858 0 0) 0x7f796c003520 con 0x7f79880cec10 2024-08-19T00:46:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986a00640 1 -- 172.21.15.7:0/37111138 >> v1:172.21.15.162:6789/0 conn(0x7f79880739a0 legacy=0x7f79880ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986a00640 1 -- 172.21.15.7:0/37111138 >> v1:172.21.15.7:6789/0 conn(0x7f79880cec10 legacy=0x7f79880d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.295+0000 7f7986a00640 1 -- 172.21.15.7:0/37111138 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7988072c60 con 0x7f7988159bf0 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.296+0000 7f7986a00640 1 --2- 172.21.15.7:0/37111138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f7988073460 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f79780097a0 tx=0x7f797802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d2d056a38ed35e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.296+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978037070 con 0x7f7988159bf0 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.296+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797802abc0 con 0x7f7988159bf0 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.296+0000 7f7986000640 1 -- 172.21.15.7:0/37111138 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79800019f0 con 0x7f7988159bf0 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.297+0000 7f798dc00640 1 -- 172.21.15.7:0/37111138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 msgr2=0x7f7988073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.297+0000 7f798dc00640 1 --2- 172.21.15.7:0/37111138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f7988073460 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f79780097a0 tx=0x7f797802a130 comp rx=0 tx=0).stop 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.297+0000 7f798dc00640 1 -- 172.21.15.7:0/37111138 shutdown_connections 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.297+0000 7f798dc00640 1 --2- 172.21.15.7:0/37111138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f7988073460 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.297+0000 7f798dc00640 1 -- 172.21.15.7:0/37111138 >> 172.21.15.7:0/37111138 conn(0x7f798806bc70 msgr2=0x7f798806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.297+0000 7f798dc00640 1 -- 172.21.15.7:0/37111138 shutdown_connections 2024-08-19T00:46:00.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.297+0000 7f798dc00640 1 -- 172.21.15.7:0/37111138 wait complete. 2024-08-19T00:46:00.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.299+0000 7f798dc00640 1 Processor -- start 2024-08-19T00:46:00.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.299+0000 7f798dc00640 1 -- start start 2024-08-19T00:46:00.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f798dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79880739a0 0x7f798809de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f798dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f79881528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f798dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7988152df0 0x7f7988153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f798dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f798815a150 con 0x7f7988152df0 2024-08-19T00:46:00.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f798dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7988159fd0 con 0x7f7988159bf0 2024-08-19T00:46:00.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f798dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79880d0ad0 con 0x7f79880739a0 2024-08-19T00:46:00.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7988152df0 0x7f7988153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7988152df0 0x7f7988153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60412/0 (socket says 172.21.15.7:60412) 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 -- 172.21.15.7:0/3928737848 learned_addr learned my addr 172.21.15.7:0/3928737848 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7986a00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79880739a0 0x7f798809de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f797fe00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f79881528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 -- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79880739a0 msgr2=0x7f798809de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79880739a0 0x7f798809de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 -- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 msgr2=0x7f79881528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f79881528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f7987400640 1 -- 172.21.15.7:0/3928737848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7988151b70 con 0x7f7988152df0 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.300+0000 7f797fe00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f79881528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:00.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.301+0000 7f7987400640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7988152df0 0x7f7988153360 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f798000cc70 tx=0x7f798000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:00.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.301+0000 7f797ea00640 1 -- 172.21.15.7:0/3928737848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980017070 con 0x7f7988152df0 2024-08-19T00:46:00.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.301+0000 7f797ea00640 1 -- 172.21.15.7:0/3928737848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798000ce20 con 0x7f7988152df0 2024-08-19T00:46:00.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.301+0000 7f797ea00640 1 -- 172.21.15.7:0/3928737848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980012640 con 0x7f7988152df0 2024-08-19T00:46:00.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.301+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7988151df0 con 0x7f7988152df0 2024-08-19T00:46:00.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.301+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79881f4d90 con 0x7f7988152df0 2024-08-19T00:46:00.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.302+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7988073460 con 0x7f7988152df0 2024-08-19T00:46:00.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.303+0000 7f797ea00640 1 -- 172.21.15.7:0/3928737848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f798001a070 con 0x7f7988152df0 2024-08-19T00:46:00.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.304+0000 7f797ea00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f796406be30 0x7f796406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.304+0000 7f797ea00640 1 -- 172.21.15.7:0/3928737848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7f798008b430 con 0x7f7988152df0 2024-08-19T00:46:00.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.304+0000 7f7986a00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f796406be30 0x7f796406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.305+0000 7f7986a00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f796406be30 0x7f796406e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7978034000 tx=0x7f797802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:00.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.308+0000 7f797ea00640 1 -- 172.21.15.7:0/3928737848 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7988151b70 con 0x7f7988152df0 2024-08-19T00:46:00.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.530+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f798806c2a0 con 0x7f7988152df0 2024-08-19T00:46:00.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.531+0000 7f797ea00640 1 -- 172.21.15.7:0/3928737848 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 209 v209) ==== 95+0+3570 (secure 0 0 0) 0x7f7980058fe0 con 0x7f7988152df0 2024-08-19T00:46:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:00.535 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":209,"btime":"2024-08-19T00:46:00:124318+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":209,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:00.124262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 209 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f796406be30 msgr2=0x7f796406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f796406be30 0x7f796406e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7978034000 tx=0x7f797802e000 comp rx=0 tx=0).stop 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7988152df0 msgr2=0x7f7988153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7988152df0 0x7f7988153360 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f798000cc70 tx=0x7f798000a430 comp rx=0 tx=0).stop 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 shutdown_connections 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f796406be30 0x7f796406e2f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7988152df0 0x7f7988153360 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7988159bf0 0x7f79881528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 --2- 172.21.15.7:0/3928737848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79880739a0 0x7f798809de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 >> 172.21.15.7:0/3928737848 conn(0x7f798806bc70 msgr2=0x7f798815d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 shutdown_connections 2024-08-19T00:46:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.533+0000 7f798dc00640 1 -- 172.21.15.7:0/3928737848 wait complete. 2024-08-19T00:46:00.551 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:00.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.707+0000 7f4281400640 1 Processor -- start 2024-08-19T00:46:00.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.707+0000 7f4281400640 1 -- start start 2024-08-19T00:46:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.708+0000 7f4281400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f427c15ee50 0x7f427c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.708+0000 7f4281400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427c0b3ab0 con 0x7f427c15e360 2024-08-19T00:46:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.708+0000 7f4281400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427c15f460 con 0x7f427c0d3200 2024-08-19T00:46:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.708+0000 7f4281400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f427c15f740 con 0x7f427c15ee50 2024-08-19T00:46:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.708+0000 7f427be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f427c15e360 0x7f427c0d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57286/0 (socket says 172.21.15.7:57286) 2024-08-19T00:46:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.708+0000 7f427be00640 1 -- 172.21.15.7:0/324986664 learned_addr learned my addr 172.21.15.7:0/324986664 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740964279 0 0) 0x7f427c0b3ab0 con 0x7f427c15e360 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4260003520 con 0x7f427c15e360 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527269168 0 0) 0x7f427c15f460 con 0x7f427c0d3200 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f427c0b3ab0 con 0x7f427c0d3200 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1644589957 0 0) 0x7f4260003520 con 0x7f427c15e360 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 >> v2:172.21.15.162:3300/0 conn(0x7f427c15ee50 msgr2=0x7f427c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 --2- 172.21.15.7:0/324986664 >> v2:172.21.15.162:3300/0 conn(0x7f427c15ee50 0x7f427c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 >> v1:172.21.15.162:6789/0 conn(0x7f427c0d3200 legacy=0x7f427c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c0b3d60 con 0x7f427c15e360 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f426c001670 con 0x7f427c15e360 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 >> v1:172.21.15.7:6789/0 conn(0x7f427c15e360 legacy=0x7f427c0d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4260003b90 0x7f4260003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260004800 0x7f4260004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42600052e0 0x7f426000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f427c15f740 con 0x7f4260004800 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f426000c230 con 0x7f42600052e0 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.709+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f426000c430 con 0x7f4260003b90 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f427be00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4260003b90 0x7f4260003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f4280a00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42600052e0 0x7f426000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f4273e00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260004800 0x7f4260004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f427be00640 1 -- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42600052e0 msgr2=0x7f426000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f427be00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42600052e0 0x7f426000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f427be00640 1 -- 172.21.15.7:0/324986664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260004800 msgr2=0x7f4260004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f427be00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260004800 0x7f4260004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f427be00640 1 -- 172.21.15.7:0/324986664 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4260003520 con 0x7f4260003b90 2024-08-19T00:46:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f4273e00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260004800 0x7f4260004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f4280a00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42600052e0 0x7f426000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:00.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.710+0000 7f4280a00640 1 -- 172.21.15.7:0/324986664 reap_dead start 2024-08-19T00:46:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.711+0000 7f427be00640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4260003b90 0x7f4260003f90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f426c007f90 tx=0x7f4260005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c804209c6de4e065 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c007be0 con 0x7f4260003b90 2024-08-19T00:46:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426c005af0 con 0x7f4260003b90 2024-08-19T00:46:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f427b400640 1 -- 172.21.15.7:0/324986664 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c007070 con 0x7f4260003b90 2024-08-19T00:46:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f4281400640 1 -- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4260003b90 msgr2=0x7f4260003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f4281400640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4260003b90 0x7f4260003f90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f426c007f90 tx=0x7f4260005830 comp rx=0 tx=0).stop 2024-08-19T00:46:00.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f4281400640 1 -- 172.21.15.7:0/324986664 shutdown_connections 2024-08-19T00:46:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f4281400640 1 --2- 172.21.15.7:0/324986664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4260003b90 0x7f4260003f90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f4281400640 1 -- 172.21.15.7:0/324986664 >> 172.21.15.7:0/324986664 conn(0x7f427c08dbf0 msgr2=0x7f427c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f4281400640 1 -- 172.21.15.7:0/324986664 shutdown_connections 2024-08-19T00:46:00.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.712+0000 7f4281400640 1 -- 172.21.15.7:0/324986664 wait complete. 2024-08-19T00:46:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.714+0000 7f4281400640 1 Processor -- start 2024-08-19T00:46:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.714+0000 7f4281400640 1 -- start start 2024-08-19T00:46:00.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f4281400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260003b90 0x7f427c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f4281400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0d1270 0x7f427c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f4281400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0d16f0 0x7f427c156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f4281400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f427c15fab0 con 0x7f4260003b90 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f4281400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f427c0d2300 con 0x7f427c0d16f0 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f4281400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f427c15fc30 con 0x7f427c0d1270 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f427be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260003b90 0x7f427c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f427be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260003b90 0x7f427c0b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60422/0 (socket says 172.21.15.7:60422) 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.715+0000 7f427be00640 1 -- 172.21.15.7:0/821057090 learned_addr learned my addr 172.21.15.7:0/821057090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4273e00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0d1270 0x7f427c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4280a00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0d16f0 0x7f427c156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f427be00640 1 -- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0d1270 msgr2=0x7f427c156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f427be00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0d1270 0x7f427c156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f427be00640 1 -- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0d16f0 msgr2=0x7f427c156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f427be00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0d16f0 0x7f427c156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f427be00640 1 -- 172.21.15.7:0/821057090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c1f8e80 con 0x7f4260003b90 2024-08-19T00:46:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4273e00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0d1270 0x7f427c156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4280a00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0d16f0 0x7f427c156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f427be00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260003b90 0x7f427c0b7030 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c1d0 tx=0x7f427c15f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4278c00640 1 -- 172.21.15.7:0/821057090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c037040 con 0x7f4260003b90 2024-08-19T00:46:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4278c00640 1 -- 172.21.15.7:0/821057090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426c041070 con 0x7f4260003b90 2024-08-19T00:46:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4278c00640 1 -- 172.21.15.7:0/821057090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c001670 con 0x7f4260003b90 2024-08-19T00:46:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.716+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c1f7f90 con 0x7f4260003b90 2024-08-19T00:46:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.717+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c1f8550 con 0x7f4260003b90 2024-08-19T00:46:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.718+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c15e740 con 0x7f4260003b90 2024-08-19T00:46:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.718+0000 7f4278c00640 1 -- 172.21.15.7:0/821057090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f426c0049e0 con 0x7f4260003b90 2024-08-19T00:46:00.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.719+0000 7f4278c00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f425806be30 0x7f425806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:00.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.719+0000 7f4278c00640 1 -- 172.21.15.7:0/821057090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7f426c0ab390 con 0x7f4260003b90 2024-08-19T00:46:00.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.720+0000 7f4273e00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f425806be30 0x7f425806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:00.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.720+0000 7f4273e00640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f425806be30 0x7f425806e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f427c1f7ef0 tx=0x7f4264009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:00.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.724+0000 7f4278c00640 1 -- 172.21.15.7:0/821057090 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f426c079590 con 0x7f4260003b90 2024-08-19T00:46:00.857 INFO:tasks.ceph.mds.c.smithi007.stderr: -44> 2024-08-19T00:45:56.102+0000 7f2403800640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': Decoder at 'virtual void SnapServer::decode_server_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=5 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:46:00.897 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:46:00.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.947+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f427c0d50d0 con 0x7f4260003b90 2024-08-19T00:46:00.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.948+0000 7f4278c00640 1 -- 172.21.15.7:0/821057090 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 209 v209) ==== 95+0+3570 (secure 0 0 0) 0x7f426c034e70 con 0x7f4260003b90 2024-08-19T00:46:00.951 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:00.951 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":209,"btime":"2024-08-19T00:46:00:124318+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":209,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:00.124262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 209 2024-08-19T00:46:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f425806be30 msgr2=0x7f425806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f425806be30 0x7f425806e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f427c1f7ef0 tx=0x7f4264009040 comp rx=0 tx=0).stop 2024-08-19T00:46:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260003b90 msgr2=0x7f427c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260003b90 0x7f427c0b7030 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c1d0 tx=0x7f427c15f630 comp rx=0 tx=0).stop 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 shutdown_connections 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f425806be30 0x7f425806e2f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0d16f0 0x7f427c156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0d1270 0x7f427c156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 --2- 172.21.15.7:0/821057090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4260003b90 0x7f427c0b7030 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 >> 172.21.15.7:0/821057090 conn(0x7f427c08dbf0 msgr2=0x7f427c161ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 shutdown_connections 2024-08-19T00:46:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:00.951+0000 7f4281400640 1 -- 172.21.15.7:0/821057090 wait complete. 2024-08-19T00:46:00.969 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:00.969 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:01.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.123+0000 7fcbd5e00640 1 Processor -- start 2024-08-19T00:46:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.123+0000 7fcbd5e00640 1 -- start start 2024-08-19T00:46:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcbd00d3200 0x7fcbd015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd5e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcbd015e740 0x7fcbd015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd5e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd00b3ab0 con 0x7fcbd015e360 2024-08-19T00:46:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd5e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcbd015f460 con 0x7fcbd015e740 2024-08-19T00:46:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd5e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcbd015f740 con 0x7fcbd00d3200 2024-08-19T00:46:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcbd015e740 0x7fcbd015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbcfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcbd00d3200 0x7fcbd015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd4a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcbd015e360 0x7fcbd00d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:50816/0 (socket says 172.21.15.7:50816) 2024-08-19T00:46:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.124+0000 7fcbd5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcbd015e740 0x7fcbd015eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60454/0 (socket says 172.21.15.7:60454) 2024-08-19T00:46:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.125+0000 7fcbd5400640 1 -- 172.21.15.7:0/2105909860 learned_addr learned my addr 172.21.15.7:0/2105909860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.125+0000 7fcbd5400640 1 -- 172.21.15.7:0/2105909860 >> v2:172.21.15.162:3300/0 conn(0x7fcbd00d3200 msgr2=0x7fcbd015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.125+0000 7fcbd5400640 1 --2- 172.21.15.7:0/2105909860 >> v2:172.21.15.162:3300/0 conn(0x7fcbd00d3200 0x7fcbd015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.125+0000 7fcbd5400640 1 -- 172.21.15.7:0/2105909860 >> v1:172.21.15.162:6789/0 conn(0x7fcbd015e360 legacy=0x7fcbd00d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.125+0000 7fcbd5400640 1 -- 172.21.15.7:0/2105909860 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd00b3d60 con 0x7fcbd015e740 2024-08-19T00:46:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.126+0000 7fcbd5400640 1 --2- 172.21.15.7:0/2105909860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd015eb70 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fcbd008db80 tx=0x7fcbc802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43a7d95a72f277c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.128+0000 7fcbcf400640 1 -- 172.21.15.7:0/2105909860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8036070 con 0x7fcbd015e740 2024-08-19T00:46:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.128+0000 7fcbcf400640 1 -- 172.21.15.7:0/2105909860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc8031600 con 0x7fcbd015e740 2024-08-19T00:46:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.128+0000 7fcbcf400640 1 -- 172.21.15.7:0/2105909860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80319d0 con 0x7fcbd015e740 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 -- 172.21.15.7:0/2105909860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 msgr2=0x7fcbd015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/2105909860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd015eb70 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fcbd008db80 tx=0x7fcbc802a730 comp rx=0 tx=0).stop 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 -- 172.21.15.7:0/2105909860 shutdown_connections 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/2105909860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd015eb70 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/2105909860 >> v2:172.21.15.162:3300/0 conn(0x7fcbd00d3200 0x7fcbd015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 -- 172.21.15.7:0/2105909860 >> 172.21.15.7:0/2105909860 conn(0x7fcbd008dbf0 msgr2=0x7fcbd009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 -- 172.21.15.7:0/2105909860 shutdown_connections 2024-08-19T00:46:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.129+0000 7fcbd5e00640 1 -- 172.21.15.7:0/2105909860 wait complete. 2024-08-19T00:46:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.132+0000 7fcbd5e00640 1 Processor -- start 2024-08-19T00:46:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.132+0000 7fcbd5e00640 1 -- start start 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd00d3200 0x7fcbd00b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd015e360 0x7fcbd00cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd0153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd015f0b0 con 0x7fcbd015e740 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd00d2300 con 0x7fcbd00d3200 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd00c7db0 con 0x7fcbd015e360 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd0153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd0153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60468/0 (socket says 172.21.15.7:60468) 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.133+0000 7fcbd5400640 1 -- 172.21.15.7:0/4176678505 learned_addr learned my addr 172.21.15.7:0/4176678505 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd4a00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd00d3200 0x7fcbd00b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbcfe00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd015e360 0x7fcbd00cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd5400640 1 -- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd015e360 msgr2=0x7fcbd00cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd5400640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd015e360 0x7fcbd00cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd5400640 1 -- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd00d3200 msgr2=0x7fcbd00b9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd5400640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd00d3200 0x7fcbd00b9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd5400640 1 -- 172.21.15.7:0/4176678505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd00c8020 con 0x7fcbd015e740 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd4a00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd00d3200 0x7fcbd00b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbcfe00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd015e360 0x7fcbd00cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:01.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd5400640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd0153800 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009f40 tx=0x7fcbc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:01.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbccc00640 1 -- 172.21.15.7:0/4176678505 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8036050 con 0x7fcbd015e740 2024-08-19T00:46:01.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbccc00640 1 -- 172.21.15.7:0/4176678505 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc8042070 con 0x7fcbd015e740 2024-08-19T00:46:01.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbccc00640 1 -- 172.21.15.7:0/4176678505 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8009510 con 0x7fcbd015e740 2024-08-19T00:46:01.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.134+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd00c8300 con 0x7fcbd015e740 2024-08-19T00:46:01.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.135+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd00b8250 con 0x7fcbd015e740 2024-08-19T00:46:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.136+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd015eb70 con 0x7fcbd015e740 2024-08-19T00:46:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.137+0000 7fcbccc00640 1 -- 172.21.15.7:0/4176678505 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbc8007bf0 con 0x7fcbd015e740 2024-08-19T00:46:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.137+0000 7fcbccc00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbb006be30 0x7fcbb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.138+0000 7fcbccc00640 1 -- 172.21.15.7:0/4176678505 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7fcbc80ac2d0 con 0x7fcbd015e740 2024-08-19T00:46:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.138+0000 7fcbd4a00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbb006be30 0x7fcbb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.138+0000 7fcbd4a00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbb006be30 0x7fcbb006e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4000f60 tx=0x7fcbc4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.142+0000 7fcbccc00640 1 -- 172.21.15.7:0/4176678505 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcbc8045360 con 0x7fcbd015e740 2024-08-19T00:46:01.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.364+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbd00d50d0 con 0x7fcbd015e740 2024-08-19T00:46:01.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.364+0000 7fcbccc00640 1 -- 172.21.15.7:0/4176678505 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) ==== 95+0+4393 (secure 0 0 0) 0x7fcbc807a560 con 0x7fcbd015e740 2024-08-19T00:46:01.367 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:01.367 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":210,"btime":"2024-08-19T00:46:01:125940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3307283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3307283757},{"type":"v1","addr":"172.21.15.7:6836","nonce":3307283757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":210}],"filesystems":[{"mdsmap":{"epoch":209,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:00.124262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:01.367 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 210 2024-08-19T00:46:01.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbb006be30 msgr2=0x7fcbb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbb006be30 0x7fcbb006e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4000f60 tx=0x7fcbc4009040 comp rx=0 tx=0).stop 2024-08-19T00:46:01.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 msgr2=0x7fcbd0153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd0153800 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009f40 tx=0x7fcbc8004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:01.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 shutdown_connections 2024-08-19T00:46:01.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbb006be30 0x7fcbb006e2f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbd015e740 0x7fcbd0153800 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd015e360 0x7fcbd00cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 --2- 172.21.15.7:0/4176678505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd00d3200 0x7fcbd00b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.366+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 >> 172.21.15.7:0/4176678505 conn(0x7fcbd008dbf0 msgr2=0x7fcbd0160610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:01.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.367+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 shutdown_connections 2024-08-19T00:46:01.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.367+0000 7fcbd5e00640 1 -- 172.21.15.7:0/4176678505 wait complete. 2024-08-19T00:46:01.386 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt mds0_inotable' led to DAMAGED state 2024-08-19T00:46:01.386 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 400.00000000' 2024-08-19T00:46:01.386 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:01.386 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:01.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:01.422 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:01.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:01.422 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:01.497 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:01.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:01.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.694+0000 7f3931000640 1 Processor -- start 2024-08-19T00:46:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.694+0000 7f3931000640 1 -- start start 2024-08-19T00:46:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.695+0000 7f3931000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f392c06e710 0x7f392c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.695+0000 7f3931000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f392c0b3750 0x7f392c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f3931000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c0cdfb0 con 0x7f392c0d03c0 2024-08-19T00:46:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f3931000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f392c0cebc0 con 0x7f392c0b3750 2024-08-19T00:46:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f3931000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f392c0ce290 con 0x7f392c06e710 2024-08-19T00:46:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f392a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f392c0b3750 0x7f392c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f3929e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f392c0d03c0 0x7f392c0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57300/0 (socket says 172.21.15.7:57300) 2024-08-19T00:46:01.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f3929e00640 1 -- 172.21.15.7:0/3521078137 learned_addr learned my addr 172.21.15.7:0/3521078137 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:01.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f3921400640 1 --2- 172.21.15.7:0/3521078137 >> v2:172.21.15.162:3300/0 conn(0x7f392c06e710 0x7f392c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f392a800640 1 -- 172.21.15.7:0/3521078137 >> v2:172.21.15.162:3300/0 conn(0x7f392c06e710 msgr2=0x7f392c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:01.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f392a800640 1 --2- 172.21.15.7:0/3521078137 >> v2:172.21.15.162:3300/0 conn(0x7f392c06e710 0x7f392c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f392a800640 1 -- 172.21.15.7:0/3521078137 >> v1:172.21.15.7:6789/0 conn(0x7f392c0d03c0 legacy=0x7f392c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.696+0000 7f392a800640 1 -- 172.21.15.7:0/3521078137 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0ce570 con 0x7f392c0b3750 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.697+0000 7f392a800640 1 --2- 172.21.15.7:0/3521078137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0b3750 0x7f392c0cf050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3924009d90 tx=0x7f392402a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4ff5ed2ff8be8b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3929400640 1 -- 172.21.15.7:0/3521078137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924007740 con 0x7f392c0b3750 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3929400640 1 -- 172.21.15.7:0/3521078137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39240078e0 con 0x7f392c0b3750 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3929400640 1 -- 172.21.15.7:0/3521078137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924007cb0 con 0x7f392c0b3750 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 -- 172.21.15.7:0/3521078137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0b3750 msgr2=0x7f392c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 --2- 172.21.15.7:0/3521078137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0b3750 0x7f392c0cf050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3924009d90 tx=0x7f392402a6b0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 -- 172.21.15.7:0/3521078137 shutdown_connections 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 --2- 172.21.15.7:0/3521078137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0b3750 0x7f392c0cf050 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 --2- 172.21.15.7:0/3521078137 >> v2:172.21.15.162:3300/0 conn(0x7f392c06e710 0x7f392c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 -- 172.21.15.7:0/3521078137 >> 172.21.15.7:0/3521078137 conn(0x7f392c06bc70 msgr2=0x7f392c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 -- 172.21.15.7:0/3521078137 shutdown_connections 2024-08-19T00:46:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.698+0000 7f3931000640 1 -- 172.21.15.7:0/3521078137 wait complete. 2024-08-19T00:46:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.700+0000 7f3931000640 1 Processor -- start 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.700+0000 7f3931000640 1 -- start start 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3931000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f392c06e710 0x7f392c1f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3931000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392c0b3750 0x7f392c09d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3931000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0d03c0 0x7f392c0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3931000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f392c073c60 con 0x7f392c0d03c0 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3931000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f392c073ae0 con 0x7f392c06e710 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3931000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0b3be0 con 0x7f392c0b3750 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f392a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0d03c0 0x7f392c0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f392a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0d03c0 0x7f392c0cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60486/0 (socket says 172.21.15.7:60486) 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f392a800640 1 -- 172.21.15.7:0/197755738 learned_addr learned my addr 172.21.15.7:0/197755738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3921400640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392c0b3750 0x7f392c09d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.701+0000 7f3929e00640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f392c06e710 0x7f392c1f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f392a800640 1 -- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392c0b3750 msgr2=0x7f392c09d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f392a800640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392c0b3750 0x7f392c09d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f392a800640 1 -- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f392c06e710 msgr2=0x7f392c1f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f392a800640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f392c06e710 0x7f392c1f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f392a800640 1 -- 172.21.15.7:0/197755738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0ca430 con 0x7f392c0d03c0 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f392a800640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0d03c0 0x7f392c0cca60 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3924009eb0 tx=0x7f3924004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f3922a00640 1 -- 172.21.15.7:0/197755738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924040070 con 0x7f392c0d03c0 2024-08-19T00:46:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f3922a00640 1 -- 172.21.15.7:0/197755738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3924031bc0 con 0x7f392c0d03c0 2024-08-19T00:46:01.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f3922a00640 1 -- 172.21.15.7:0/197755738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924045460 con 0x7f392c0d03c0 2024-08-19T00:46:01.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c0ca710 con 0x7f392c0d03c0 2024-08-19T00:46:01.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.702+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c0cafb0 con 0x7f392c0d03c0 2024-08-19T00:46:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.703+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c0af5b0 con 0x7f392c0d03c0 2024-08-19T00:46:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.704+0000 7f3922a00640 1 -- 172.21.15.7:0/197755738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3924039040 con 0x7f392c0d03c0 2024-08-19T00:46:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.706+0000 7f3922a00640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390806be30 0x7f390806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.706+0000 7f3922a00640 1 -- 172.21.15.7:0/197755738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7f39240acdb0 con 0x7f392c0d03c0 2024-08-19T00:46:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.706+0000 7f3929e00640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390806be30 0x7f390806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:01.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.706+0000 7f3929e00640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390806be30 0x7f390806e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f391c007fd0 tx=0x7f391c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:01.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.710+0000 7f3922a00640 1 -- 172.21.15.7:0/197755738 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f392c0af5b0 con 0x7f392c0d03c0 2024-08-19T00:46:01.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:01.930+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f392c071980 con 0x7f392c0d03c0 2024-08-19T00:46:02.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.131+0000 7f3922a00640 1 -- 172.21.15.7:0/197755738 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v211) ==== 161+0+0 (secure 0 0 0) 0x7f39240b1070 con 0x7f392c0d03c0 2024-08-19T00:46:02.134 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390806be30 msgr2=0x7f390806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390806be30 0x7f390806e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f391c007fd0 tx=0x7f391c007e80 comp rx=0 tx=0).stop 2024-08-19T00:46:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0d03c0 msgr2=0x7f392c0cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0d03c0 0x7f392c0cca60 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3924009eb0 tx=0x7f3924004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 shutdown_connections 2024-08-19T00:46:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f390806be30 0x7f390806e2f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f392c0d03c0 0x7f392c0cca60 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f392c0b3750 0x7f392c09d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 --2- 172.21.15.7:0/197755738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f392c06e710 0x7f392c1f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 >> 172.21.15.7:0/197755738 conn(0x7f392c06bc70 msgr2=0x7f392c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.133+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 shutdown_connections 2024-08-19T00:46:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.134+0000 7f3931000640 1 -- 172.21.15.7:0/197755738 wait complete. 2024-08-19T00:46:02.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:02.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.308+0000 7f2d53200640 1 Processor -- start 2024-08-19T00:46:02.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.308+0000 7f2d53200640 1 -- start start 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.309+0000 7f2d53200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d5415e3e0 0x7f2d540b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.309+0000 7f2d53200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2d540b4860 0x7f2d540d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.309+0000 7f2d53200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d540b4df0 con 0x7f2d540d27b0 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.309+0000 7f2d53200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2d540d3140 con 0x7f2d5415e3e0 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.309+0000 7f2d53200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2d540b50d0 con 0x7f2d540b4860 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d51e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d5415e3e0 0x7f2d540b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d51400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2d540d27b0 0x7f2d540b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57314/0 (socket says 172.21.15.7:57314) 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d51400640 1 -- 172.21.15.7:0/554868001 learned_addr learned my addr 172.21.15.7:0/554868001 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d52800640 1 --2- 172.21.15.7:0/554868001 >> v2:172.21.15.162:3300/0 conn(0x7f2d540b4860 0x7f2d540d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:02.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d51e00640 1 -- 172.21.15.7:0/554868001 >> v2:172.21.15.162:3300/0 conn(0x7f2d540b4860 msgr2=0x7f2d540d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:02.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d51e00640 1 --2- 172.21.15.7:0/554868001 >> v2:172.21.15.162:3300/0 conn(0x7f2d540b4860 0x7f2d540d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d51e00640 1 -- 172.21.15.7:0/554868001 >> v1:172.21.15.7:6789/0 conn(0x7f2d540d27b0 legacy=0x7f2d540b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:02.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.310+0000 7f2d51e00640 1 -- 172.21.15.7:0/554868001 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d540cf1e0 con 0x7f2d5415e3e0 2024-08-19T00:46:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.311+0000 7f2d51e00640 1 --2- 172.21.15.7:0/554868001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5415e3e0 0x7f2d540b0e60 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f2d440097a0 tx=0x7f2d4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bb6aeeb1e84cad server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.311+0000 7f2d50a00640 1 -- 172.21.15.7:0/554868001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44037070 con 0x7f2d5415e3e0 2024-08-19T00:46:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d50a00640 1 -- 172.21.15.7:0/554868001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44032440 con 0x7f2d5415e3e0 2024-08-19T00:46:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d50a00640 1 -- 172.21.15.7:0/554868001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44032810 con 0x7f2d5415e3e0 2024-08-19T00:46:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 -- 172.21.15.7:0/554868001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5415e3e0 msgr2=0x7f2d540b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 --2- 172.21.15.7:0/554868001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5415e3e0 0x7f2d540b0e60 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f2d440097a0 tx=0x7f2d4402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 -- 172.21.15.7:0/554868001 shutdown_connections 2024-08-19T00:46:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 --2- 172.21.15.7:0/554868001 >> v2:172.21.15.162:3300/0 conn(0x7f2d540b4860 0x7f2d540d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 --2- 172.21.15.7:0/554868001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d5415e3e0 0x7f2d540b0e60 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 -- 172.21.15.7:0/554868001 >> 172.21.15.7:0/554868001 conn(0x7f2d5408dbe0 msgr2=0x7f2d5409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 -- 172.21.15.7:0/554868001 shutdown_connections 2024-08-19T00:46:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.312+0000 7f2d53200640 1 -- 172.21.15.7:0/554868001 wait complete. 2024-08-19T00:46:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.314+0000 7f2d53200640 1 Processor -- start 2024-08-19T00:46:02.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.314+0000 7f2d53200640 1 -- start start 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d53200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d540b4860 0x7f2d540b9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d53200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d540d27b0 0x7f2d540cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d53200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d5415e3e0 0x7f2d540cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d53200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540b13a0 con 0x7f2d540b4860 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d53200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540cee90 con 0x7f2d540d27b0 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d53200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2d540cf9e0 con 0x7f2d5415e3e0 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d51e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d540b4860 0x7f2d540b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d51e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d540b4860 0x7f2d540b9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60516/0 (socket says 172.21.15.7:60516) 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d51e00640 1 -- 172.21.15.7:0/3969515795 learned_addr learned my addr 172.21.15.7:0/3969515795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:02.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d51e00640 1 -- 172.21.15.7:0/3969515795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d5415e3e0 msgr2=0x7f2d540cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.315+0000 7f2d51e00640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d5415e3e0 0x7f2d540cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d51e00640 1 -- 172.21.15.7:0/3969515795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d540d27b0 msgr2=0x7f2d540cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d51e00640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d540d27b0 0x7f2d540cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d51e00640 1 -- 172.21.15.7:0/3969515795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d540b81a0 con 0x7f2d540b4860 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d51e00640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d540b4860 0x7f2d540b9240 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f2d44035040 tx=0x7f2d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d4a000640 1 -- 172.21.15.7:0/3969515795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44037040 con 0x7f2d540b4860 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d4a000640 1 -- 172.21.15.7:0/3969515795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44030770 con 0x7f2d540b4860 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d4a000640 1 -- 172.21.15.7:0/3969515795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44030b80 con 0x7f2d540b4860 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d540b8480 con 0x7f2d540b4860 2024-08-19T00:46:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.316+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d540b8a40 con 0x7f2d540b4860 2024-08-19T00:46:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.318+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d540d2c00 con 0x7f2d540b4860 2024-08-19T00:46:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.318+0000 7f2d4a000640 1 -- 172.21.15.7:0/3969515795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d44044020 con 0x7f2d540b4860 2024-08-19T00:46:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.319+0000 7f2d4a000640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2d3406be60 0x7f2d3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.319+0000 7f2d4a000640 1 -- 172.21.15.7:0/3969515795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7f2d440aba20 con 0x7f2d540b4860 2024-08-19T00:46:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.320+0000 7f2d51400640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2d3406be60 0x7f2d3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.320+0000 7f2d51400640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2d3406be60 0x7f2d3406e320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2d40000f60 tx=0x7f2d40007a80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.323+0000 7f2d4a000640 1 -- 172.21.15.7:0/3969515795 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2d44032e20 con 0x7f2d540b4860 2024-08-19T00:46:02.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:02.581+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f2d540b4430 con 0x7f2d540b4860 2024-08-19T00:46:02.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:46:02.702 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:46:03.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.133+0000 7f2d4a000640 1 -- 172.21.15.7:0/3969515795 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v212) ==== 101+0+0 (secure 0 0 0) 0x7f2d44079cb0 con 0x7f2d540b4860 2024-08-19T00:46:03.136 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:03.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2d3406be60 msgr2=0x7f2d3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2d3406be60 0x7f2d3406e320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2d40000f60 tx=0x7f2d40007a80 comp rx=0 tx=0).stop 2024-08-19T00:46:03.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d540b4860 msgr2=0x7f2d540b9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d540b4860 0x7f2d540b9240 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f2d44035040 tx=0x7f2d440046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 shutdown_connections 2024-08-19T00:46:03.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2d3406be60 0x7f2d3406e320 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d5415e3e0 0x7f2d540cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d540d27b0 0x7f2d540cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 --2- 172.21.15.7:0/3969515795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d540b4860 0x7f2d540b9240 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 >> 172.21.15.7:0/3969515795 conn(0x7f2d5408dbe0 msgr2=0x7f2d541614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:03.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 shutdown_connections 2024-08-19T00:46:03.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.136+0000 7f2d53200640 1 -- 172.21.15.7:0/3969515795 wait complete. 2024-08-19T00:46:03.155 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.228+0000 7f12f80f4f40 1 Processor -- start 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.228+0000 7f12f80f4f40 1 -- start start 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f80f4f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5af40 0x55feddf02b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f80f4f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5c5b0 0x55feddf03080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f80f4f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c990 0x55feddef86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f80f4f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fedde5b8f0 con 0x55fedde5af40 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f80f4f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fedddd0d00 con 0x55fedde5c5b0 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f80f4f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55feddf01dc0 con 0x55fedde5c990 2024-08-19T00:46:03.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5af40 0x55feddf02b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5af40 0x55feddf02b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60536/0 (socket says 172.21.15.7:60536) 2024-08-19T00:46:03.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 -- 172.21.15.7:0/699802767 learned_addr learned my addr 172.21.15.7:0/699802767 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:03.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 -- 172.21.15.7:0/699802767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c990 msgr2=0x55feddef86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:03.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 --2- 172.21.15.7:0/699802767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c990 0x55feddef86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 -- 172.21.15.7:0/699802767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5c5b0 msgr2=0x55feddf03080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:03.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 --2- 172.21.15.7:0/699802767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5c5b0 0x55feddf03080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.229+0000 7f12f5200640 1 -- 172.21.15.7:0/699802767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feddd55b30 con 0x55fedde5af40 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f5200640 1 --2- 172.21.15.7:0/699802767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5af40 0x55feddf02b40 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f12e800a640 tx=0x7f12e8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b88d13ad8abd29 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12eea00640 1 -- 172.21.15.7:0/699802767 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8008ac0 con 0x55fedde5af40 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12eea00640 1 -- 172.21.15.7:0/699802767 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e8008c60 con 0x55fedde5af40 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12eea00640 1 -- 172.21.15.7:0/699802767 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8013660 con 0x55fedde5af40 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 -- 172.21.15.7:0/699802767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5af40 msgr2=0x55feddf02b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/699802767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5af40 0x55feddf02b40 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f12e800a640 tx=0x7f12e8005f90 comp rx=0 tx=0).stop 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 -- 172.21.15.7:0/699802767 shutdown_connections 2024-08-19T00:46:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/699802767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c990 0x55feddef86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/699802767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5c5b0 0x55feddf03080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/699802767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5af40 0x55feddf02b40 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 -- 172.21.15.7:0/699802767 >> 172.21.15.7:0/699802767 conn(0x55fedde594e0 msgr2=0x55fedde29f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:03.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 -- 172.21.15.7:0/699802767 shutdown_connections 2024-08-19T00:46:03.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.230+0000 7f12f80f4f40 1 -- 172.21.15.7:0/699802767 wait complete. 2024-08-19T00:46:03.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.231+0000 7f12f80f4f40 1 Processor -- start 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.231+0000 7f12f80f4f40 1 -- start start 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f80f4f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5af40 0x55feddf01180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f80f4f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c5b0 0x55feddee1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f80f4f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5c990 0x55feddefdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f80f4f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55feddefab60 con 0x55fedde5c990 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f80f4f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55feddefa2c0 con 0x55fedde5af40 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f80f4f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55fedde74c40 con 0x55fedde5c5b0 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5c990 0x55feddefdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5c990 0x55feddefdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60550/0 (socket says 172.21.15.7:60550) 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.232+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 learned_addr learned my addr 172.21.15.7:0/3550942074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c5b0 0x55feddee1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5af40 0x55feddf01180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c5b0 msgr2=0x55feddee1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5c00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c5b0 0x55feddee1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5af40 msgr2=0x55feddf01180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5c00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5af40 0x55feddf01180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feddd92080 con 0x55fedde5c990 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55fedde5c5b0 0x55feddee1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fedde5af40 0x55feddf01180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12f5c00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5c990 0x55feddefdbc0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f12f000a190 tx=0x7f12f0005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.233+0000 7f12ed600640 1 -- 172.21.15.7:0/3550942074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0068070 con 0x55fedde5c990 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.234+0000 7f12ed600640 1 -- 172.21.15.7:0/3550942074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f00504f0 con 0x55fedde5c990 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.234+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55feddf016c0 con 0x55fedde5c990 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.234+0000 7f12ed600640 1 -- 172.21.15.7:0/3550942074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0054040 con 0x55fedde5c990 2024-08-19T00:46:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.234+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feddf003c0 con 0x55fedde5c990 2024-08-19T00:46:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.235+0000 7f12ed600640 1 -- 172.21.15.7:0/3550942074 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12f006b070 con 0x55fedde5c990 2024-08-19T00:46:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.236+0000 7f12ed600640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12d406a810 0x7f12d406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.236+0000 7f12ed600640 1 -- 172.21.15.7:0/3550942074 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7f12f00cd930 con 0x55fedde5c990 2024-08-19T00:46:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.237+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12d406a810 0x7f12d406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.242 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.237+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55feddefcd70 0x55feddee3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.237+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddee44c0 con 0x55feddefcd70 2024-08-19T00:46:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.237+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12d406a810 0x7f12d406ccd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e8002000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.237+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55feddefcd70 0x55feddee3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.238+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55feddefcd70 0x55feddee3f80 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.240+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v107'629 uv603 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.240+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddee4890 con 0x55feddefcd70 2024-08-19T00:46:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.242+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v107'630 uv630 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.242+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa3db0 con 0x55feddefcd70 2024-08-19T00:46:03.246 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:03.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.244+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v107'631 uv631 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.244+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa5160 con 0x55feddefcd70 2024-08-19T00:46:03.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.245+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v107'632 uv632 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.245+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa5500 con 0x55feddefcd70 2024-08-19T00:46:03.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.248+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v107'633 uv633 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.248+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4150 con 0x55feddefcd70 2024-08-19T00:46:03.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.250+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v107'634 uv634 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.250+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4590 con 0x55feddefcd70 2024-08-19T00:46:03.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.252+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v107'635 uv609 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.252+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4980 con 0x55feddefcd70 2024-08-19T00:46:03.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.253+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v107'636 uv636 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.253+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4980 con 0x55feddefcd70 2024-08-19T00:46:03.257 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:03.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.255+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v107'637 uv637 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.255+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d70 con 0x55feddefcd70 2024-08-19T00:46:03.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.257+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v107'638 uv638 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.257+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.259+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v107'639 uv639 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.259+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.260+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v107'640 uv640 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.260+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.262+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v107'641 uv616 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.262+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.264+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v107'642 uv642 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.264+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.269 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.266+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v107'643 uv643 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.266+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.268+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v107'644 uv644 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.268+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.269+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v107'645 uv645 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.269+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4930 con 0x55feddefcd70 2024-08-19T00:46:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.271+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v107'646 uv646 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.271+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.273+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v107'647 uv647 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.273+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.274+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v107'648 uv622 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.274+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.276+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v107'649 uv649 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.276+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.279 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.277+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v107'650 uv650 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.277+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.278+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v107'651 uv651 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.278+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.280+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v107'652 uv652 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.280+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.282+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v107'653 uv653 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.282+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.283+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v107'654 uv628 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.283+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.284+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v107'655 uv655 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.285+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.288 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:03.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.286+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v107'656 uv656 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.286+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.287+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v107'657 uv657 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.287+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.289+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v107'658 uv658 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.289+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddefcd70 2024-08-19T00:46:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.290+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v107'659 uv659 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.290+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55feddfa5db0 0x55feddfa81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.290+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa4d00 con 0x55feddfa5db0 2024-08-19T00:46:03.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.291+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55feddfa5db0 0x55feddfa81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.291+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55feddfa5db0 0x55feddfa81a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.293+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v107'463 uv446 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.293+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa86e0 con 0x55feddfa5db0 2024-08-19T00:46:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.295+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v107'464 uv464 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.295+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa8a80 con 0x55feddfa5db0 2024-08-19T00:46:03.298 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:03.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.296+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v107'465 uv465 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.296+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa8e20 con 0x55feddfa5db0 2024-08-19T00:46:03.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.298+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v107'466 uv466 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.298+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa91c0 con 0x55feddfa5db0 2024-08-19T00:46:03.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.299+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v107'467 uv467 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.299+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9560 con 0x55feddfa5db0 2024-08-19T00:46:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.301+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v107'468 uv451 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.301+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9900 con 0x55feddfa5db0 2024-08-19T00:46:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.302+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v107'469 uv469 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.302+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.306 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.303+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v107'470 uv470 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.303+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.304+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v107'471 uv471 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.305+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.306+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v107'472 uv472 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.306+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.307+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v107'473 uv456 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.307+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.309+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v107'474 uv474 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.309+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.312 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:03.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.310+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v107'475 uv475 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.310+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfae390 con 0x55feddfa5db0 2024-08-19T00:46:03.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.312+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v107'476 uv476 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.312+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfae390 con 0x55feddfa5db0 2024-08-19T00:46:03.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.313+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v107'477 uv477 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.313+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.314+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v107'478 uv462 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.314+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.316+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v107'479 uv479 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.316+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.319 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.317+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v107'480 uv480 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.317+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfaacb0 con 0x55feddfa5db0 2024-08-19T00:46:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.318+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v107'481 uv481 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.318+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfaacb0 con 0x55feddfa5db0 2024-08-19T00:46:03.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.320+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v107'482 uv482 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.320+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfa9ca0 con 0x55feddfa5db0 2024-08-19T00:46:03.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.321+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v107'483 uv483 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfa5db0 2024-08-19T00:46:03.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.321+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55feddfaa320 0x55feddfac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.321+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfacc50 con 0x55feddfaa320 2024-08-19T00:46:03.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.322+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55feddfaa320 0x55feddfac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.322+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55feddfaa320 0x55feddfac710 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.324+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v107'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddfaa320 2024-08-19T00:46:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.324+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfacd10 con 0x55feddfaa320 2024-08-19T00:46:03.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.326+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v107'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddfaa320 2024-08-19T00:46:03.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.326+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfad100 con 0x55feddfaa320 2024-08-19T00:46:03.329 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.327+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v107'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddfaa320 2024-08-19T00:46:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.327+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfae110 con 0x55feddfaa320 2024-08-19T00:46:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.328+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v107'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddfaa320 2024-08-19T00:46:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.328+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfae110 con 0x55feddfaa320 2024-08-19T00:46:03.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.330+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v107'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddfaa320 2024-08-19T00:46:03.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.330+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfad100 con 0x55feddfaa320 2024-08-19T00:46:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.331+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v107'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddfaa320 2024-08-19T00:46:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.331+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfad100 con 0x55feddefcd70 2024-08-19T00:46:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.333+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v107'92 uv91 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.333+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfad100 con 0x55feddefcd70 2024-08-19T00:46:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.334+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v107'93 uv93 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.334+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfad100 con 0x55feddefcd70 2024-08-19T00:46:03.338 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.336+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v107'94 uv94 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.336+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfad100 con 0x55feddefcd70 2024-08-19T00:46:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.337+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v107'95 uv95 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f12e000a440 con 0x55feddefcd70 2024-08-19T00:46:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.337+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55feddfad780 0x55feddfafb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.337+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb00f0 con 0x55feddfad780 2024-08-19T00:46:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.338+0000 7f12f5c00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55feddfad780 0x55feddfafb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.338+0000 7f12f5c00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55feddfad780 0x55feddfafb70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.340+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v107'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.340+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb05e0 con 0x55feddfad780 2024-08-19T00:46:03.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.342+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v107'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.342+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb0ac0 con 0x55feddfad780 2024-08-19T00:46:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:03.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.343+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v107'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.343+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb2370 con 0x55feddfad780 2024-08-19T00:46:03.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.345+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v107'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.345+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb2710 con 0x55feddfad780 2024-08-19T00:46:03.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.346+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v107'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.346+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb1360 con 0x55feddfad780 2024-08-19T00:46:03.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.347+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v107'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.347+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55feddfb1c60 0x55feddfb4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.347+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5000 con 0x55feddfb1c60 2024-08-19T00:46:03.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.348+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55feddfb1c60 0x55feddfb4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.348+0000 7f12f5200640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55feddfb1c60 0x55feddfb4ac0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.350+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v107'227 uv221 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.350+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5000 con 0x55feddfb1c60 2024-08-19T00:46:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.351+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v107'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.351+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5080 con 0x55feddfb1c60 2024-08-19T00:46:03.355 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.353+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v107'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.353+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb6480 con 0x55feddfb1c60 2024-08-19T00:46:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.354+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v107'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.354+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb6480 con 0x55feddfb1c60 2024-08-19T00:46:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.355+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v107'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.355+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5470 con 0x55feddfb1c60 2024-08-19T00:46:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.357+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v107'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.357+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5470 con 0x55feddfb1c60 2024-08-19T00:46:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.358+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v107'233 uv226 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.358+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5470 con 0x55feddfb1c60 2024-08-19T00:46:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.360+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v107'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.360+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5470 con 0x55feddfb1c60 2024-08-19T00:46:03.364 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.361+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v107'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.361+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5470 con 0x55feddfb1c60 2024-08-19T00:46:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.363+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v107'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.363+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb5470 con 0x55feddfb1c60 2024-08-19T00:46:03.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.364+0000 7f12f5200640 1 -- 172.21.15.7:0/3550942074 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v107'237 uv237 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e80135e0 con 0x55feddfb1c60 2024-08-19T00:46:03.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.364+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55feddfb5980 0x55feddfb7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.364+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb83d0 con 0x55feddfb5980 2024-08-19T00:46:03.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.364+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55feddfb5980 0x55feddfb7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.365+0000 7f12efe00640 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55feddfb5980 0x55feddfb7d70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.366+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v107'102 uv101 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.366+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb83d0 con 0x55feddfb5980 2024-08-19T00:46:03.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.367+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v107'103 uv103 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.367+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddfb5980 2024-08-19T00:46:03.371 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:03.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.369+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v107'104 uv104 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.369+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddfb5980 2024-08-19T00:46:03.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.370+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v107'105 uv105 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.370+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddfb5980 2024-08-19T00:46:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.372+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v107'106 uv106 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.372+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddefcd70 2024-08-19T00:46:03.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.373+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v107'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddefcd70 2024-08-19T00:46:03.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.373+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddefcd70 2024-08-19T00:46:03.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.374+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v107'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddefcd70 2024-08-19T00:46:03.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.374+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddefcd70 2024-08-19T00:46:03.378 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:03.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.376+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v107'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddefcd70 2024-08-19T00:46:03.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.376+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb9800 con 0x55feddefcd70 2024-08-19T00:46:03.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.377+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v107'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddefcd70 2024-08-19T00:46:03.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.377+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb9800 con 0x55feddefcd70 2024-08-19T00:46:03.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.378+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v107'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddefcd70 2024-08-19T00:46:03.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.378+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddefcd70 2024-08-19T00:46:03.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.380+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v107'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddefcd70 2024-08-19T00:46:03.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.380+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddfaa320 2024-08-19T00:46:03.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.382+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v107'203 uv202 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.382+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddfaa320 2024-08-19T00:46:03.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.383+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v107'204 uv204 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.383+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb87f0 con 0x55feddfaa320 2024-08-19T00:46:03.387 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:03.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.385+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v107'205 uv205 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.385+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb0f50 con 0x55feddfaa320 2024-08-19T00:46:03.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.386+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v107'206 uv206 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.386+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb0f50 con 0x55feddfaa320 2024-08-19T00:46:03.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.388+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v107'207 uv207 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.388+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb0f50 con 0x55feddfaa320 2024-08-19T00:46:03.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.389+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v107'208 uv201 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.389+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb0f50 con 0x55feddfaa320 2024-08-19T00:46:03.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.391+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v107'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.391+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb0f50 con 0x55feddfaa320 2024-08-19T00:46:03.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.392+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v107'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.395 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:03.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.392+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb0f50 con 0x55feddfaa320 2024-08-19T00:46:03.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.394+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v107'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.394+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfbb600 con 0x55feddfaa320 2024-08-19T00:46:03.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.395+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v107'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfaa320 2024-08-19T00:46:03.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.395+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.397+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v107'91 uv90 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.397+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.398+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v107'92 uv92 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.398+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.400+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v107'93 uv93 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.402 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:03.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.400+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.401+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v107'94 uv94 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.401+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.403+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v107'123 uv122 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.403+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.405+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v107'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.405+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.409 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.406+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v107'125 uv125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.406+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb9cb0 con 0x55feddfad780 2024-08-19T00:46:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.408+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v107'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.408+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb9cb0 con 0x55feddfad780 2024-08-19T00:46:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.409+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v107'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.409+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfad780 2024-08-19T00:46:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.410+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v107'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12f006a030 con 0x55feddfad780 2024-08-19T00:46:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.410+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.412+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v107'104 uv103 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.412+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.413+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v107'105 uv105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.413+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.417 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.415+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v107'106 uv106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.415+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.416+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v107'107 uv107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.416+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.417+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v107'108 uv108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.417+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.419+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v107'253 uv245 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.419+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.420+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v107'254 uv254 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.420+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.424 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.422+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v107'255 uv255 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.422+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.423+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v107'256 uv256 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.423+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.425+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v107'257 uv257 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.425+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.426+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v107'258 uv252 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.426+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.427+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v107'259 uv259 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.427+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.431 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.428+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v107'260 uv260 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.428+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb9cb0 con 0x55feddfb5980 2024-08-19T00:46:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.430+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v107'261 uv261 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.430+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb9cb0 con 0x55feddfb5980 2024-08-19T00:46:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.431+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v107'262 uv262 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.431+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb8ca0 con 0x55feddfb5980 2024-08-19T00:46:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.433+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v107'263 uv263 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.433+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55feddfb9510 con 0x55feddfb5980 2024-08-19T00:46:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12efe00640 1 -- 172.21.15.7:0/3550942074 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v107'264 uv264 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f12e0023040 con 0x55feddfb5980 2024-08-19T00:46:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55feddfa5db0 msgr2=0x55feddfa81a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55feddfa5db0 0x55feddfa81a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55feddfb1c60 msgr2=0x55feddfb4ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55feddfb1c60 0x55feddfb4ac0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55feddfb5980 msgr2=0x55feddfb7d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55feddfb5980 0x55feddfb7d70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55feddfaa320 msgr2=0x55feddfac710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55feddfaa320 0x55feddfac710 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55feddefcd70 msgr2=0x55feddee3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55feddefcd70 0x55feddee3f80 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 reap_dead start 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55feddfad780 msgr2=0x55feddfafb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55feddfad780 0x55feddfafb70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f5c00640 1 -- 172.21.15.7:0/3550942074 reap_dead start 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12d406a810 msgr2=0x7f12d406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12d406a810 0x7f12d406ccd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e8002000 comp rx=0 tx=0).stop 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5c990 msgr2=0x55feddefdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5c990 0x55feddefdbc0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f12f000a190 tx=0x7f12f0005dc0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 shutdown_connections 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f12d406a810 0x7f12d406ccd0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 --2- 172.21.15.7:0/3550942074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fedde5c990 0x55feddefdbc0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.434+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 >> 172.21.15.7:0/3550942074 conn(0x55fedde594e0 msgr2=0x55feddf02b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:03.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.435+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 shutdown_connections 2024-08-19T00:46:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.435+0000 7f12f80f4f40 1 -- 172.21.15.7:0/3550942074 wait complete. 2024-08-19T00:46:03.442 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 400.00000000 - 2024-08-19T00:46:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.557+0000 7f3468c23f40 1 Processor -- start 2024-08-19T00:46:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.557+0000 7f3468c23f40 1 -- start start 2024-08-19T00:46:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3468c23f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b4d5b0 0x55f240be4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3468c23f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d990 0x55f240b48710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3468c23f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b658d0 0x55f240bf3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3468c23f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f240bf2dc0 con 0x55f240b4d990 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3468c23f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f240ac1d00 con 0x55f240b658d0 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3468c23f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f240bf30a0 con 0x55f240b4d5b0 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3465400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d990 0x55f240b48710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3465400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d990 0x55f240b48710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60556/0 (socket says 172.21.15.7:60556) 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3465400640 1 -- 172.21.15.7:0/4264743218 learned_addr learned my addr 172.21.15.7:0/4264743218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3465e00640 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b4d5b0 0x55f240be4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.558+0000 7f3466800640 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b658d0 0x55f240bf3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f3465400640 1 -- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b4d5b0 msgr2=0x55f240be4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f3465400640 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b4d5b0 0x55f240be4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f3465400640 1 -- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b658d0 msgr2=0x55f240bf3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f3465400640 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b658d0 0x55f240bf3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f3465400640 1 -- 172.21.15.7:0/4264743218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f240a46b30 con 0x55f240b4d990 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f3466800640 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b658d0 0x55f240bf3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f3465400640 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d990 0x55f240b48710 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f3454025bd0 tx=0x7f3454051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5065c401d0b907a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f345fe00640 1 -- 172.21.15.7:0/4264743218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454053b20 con 0x55f240b4d990 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f345fe00640 1 -- 172.21.15.7:0/4264743218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3454063070 con 0x55f240b4d990 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.559+0000 7f345fe00640 1 -- 172.21.15.7:0/4264743218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454068470 con 0x55f240b4d990 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 -- 172.21.15.7:0/4264743218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d990 msgr2=0x55f240b48710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d990 0x55f240b48710 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f3454025bd0 tx=0x7f3454051000 comp rx=0 tx=0).stop 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 -- 172.21.15.7:0/4264743218 shutdown_connections 2024-08-19T00:46:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b658d0 0x55f240bf3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d990 0x55f240b48710 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 --2- 172.21.15.7:0/4264743218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b4d5b0 0x55f240be4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 -- 172.21.15.7:0/4264743218 >> 172.21.15.7:0/4264743218 conn(0x55f240b4a4e0 msgr2=0x55f240b1aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 -- 172.21.15.7:0/4264743218 shutdown_connections 2024-08-19T00:46:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.560+0000 7f3468c23f40 1 -- 172.21.15.7:0/4264743218 wait complete. 2024-08-19T00:46:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 Processor -- start 2024-08-19T00:46:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 -- start start 2024-08-19T00:46:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d5b0 0x55f240be0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b4d990 0x55f240b49170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b658d0 0x55f240b496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f240be7f00 con 0x55f240b4d5b0 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f240b4ac30 con 0x55f240b4d990 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.561+0000 7f3468c23f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f240beba30 con 0x55f240b658d0 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d5b0 0x55f240be0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d5b0 0x55f240be0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60564/0 (socket says 172.21.15.7:60564) 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 -- 172.21.15.7:0/9264870 learned_addr learned my addr 172.21.15.7:0/9264870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465400640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b4d990 0x55f240b49170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3466800640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b658d0 0x55f240b496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 -- 172.21.15.7:0/9264870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b658d0 msgr2=0x55f240b496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f240b658d0 0x55f240b496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 -- 172.21.15.7:0/9264870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b4d990 msgr2=0x55f240b49170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f240b4d990 0x55f240b49170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 -- 172.21.15.7:0/9264870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f240a83080 con 0x55f240b4d5b0 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.562+0000 7f3465e00640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d5b0 0x55f240be0530 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f3458009fa0 tx=0x7f34580084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.563+0000 7f345ea00640 1 -- 172.21.15.7:0/9264870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345801b070 con 0x55f240b4d5b0 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.563+0000 7f345ea00640 1 -- 172.21.15.7:0/9264870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3458016680 con 0x55f240b4d5b0 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.563+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f240c8bb80 con 0x55f240b4d5b0 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.563+0000 7f345ea00640 1 -- 172.21.15.7:0/9264870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458016a30 con 0x55f240b4d5b0 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.563+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f240c8c140 con 0x55f240b4d5b0 2024-08-19T00:46:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.565+0000 7f345ea00640 1 -- 172.21.15.7:0/9264870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f345801e070 con 0x55f240b4d5b0 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.565+0000 7f345ea00640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f344806a810 0x7f344806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.566+0000 7f345ea00640 1 -- 172.21.15.7:0/9264870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7f3458089ab0 con 0x55f240b4d5b0 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.566+0000 7f3465400640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f344806a810 0x7f344806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.566+0000 7f3468c23f40 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f240be6d20 0x55f240be7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.566+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55f240be7640 con 0x55f240be6d20 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.566+0000 7f3466800640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f240be6d20 0x55f240be7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.566+0000 7f3465400640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f344806a810 0x7f344806ccd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3454045f30 tx=0x7f345406a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.567+0000 7f3466800640 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f240be6d20 0x55f240be7100 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3466800640 1 -- 172.21.15.7:0/9264870 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 400.00000000 [writefull 0~80] v107'109 uv109 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3460001610 con 0x55f240be6d20 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f240be6d20 msgr2=0x55f240be7100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55f240be6d20 0x55f240be7100 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f344806a810 msgr2=0x7f344806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f344806a810 0x7f344806ccd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3454045f30 tx=0x7f345406a040 comp rx=0 tx=0).stop 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d5b0 msgr2=0x55f240be0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 --2- 172.21.15.7:0/9264870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f240b4d5b0 0x55f240be0530 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f3458009fa0 tx=0x7f34580084c0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3466800640 1 -- 172.21.15.7:0/9264870 reap_dead start 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 shutdown_connections 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 >> 172.21.15.7:0/9264870 conn(0x55f240b4a4e0 msgr2=0x55f240be4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 shutdown_connections 2024-08-19T00:46:03.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.569+0000 7f3468c23f40 1 -- 172.21.15.7:0/9264870 wait complete. 2024-08-19T00:46:03.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.773+0000 7f783b000640 1 Processor -- start 2024-08-19T00:46:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.773+0000 7f783b000640 1 -- start start 2024-08-19T00:46:03.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.774+0000 7f783b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f783406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.774+0000 7f783b000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78340b5da0 0x7f78340b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.774+0000 7f783b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f78340b66e0 0x7f78340cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.774+0000 7f783b000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f783406e090 con 0x7f78340b5da0 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.774+0000 7f783b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f78340b6f70 con 0x7f78340b66e0 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.774+0000 7f783b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f78340b7250 con 0x7f783406d770 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78340b5da0 0x7f78340b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f783406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7839000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f78340b66e0 0x7f78340cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78340b5da0 0x7f78340b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60572/0 (socket says 172.21.15.7:60572) 2024-08-19T00:46:03.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 -- 172.21.15.7:0/2168488803 learned_addr learned my addr 172.21.15.7:0/2168488803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 -- 172.21.15.7:0/2168488803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 msgr2=0x7f783406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 --2- 172.21.15.7:0/2168488803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f783406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 -- 172.21.15.7:0/2168488803 >> v2:172.21.15.162:3300/0 conn(0x7f78340b66e0 msgr2=0x7f78340cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 --2- 172.21.15.7:0/2168488803 >> v2:172.21.15.162:3300/0 conn(0x7f78340b66e0 0x7f78340cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833400640 1 -- 172.21.15.7:0/2168488803 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78340cb430 con 0x7f78340b5da0 2024-08-19T00:46:03.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.775+0000 7f7833e00640 1 --2- 172.21.15.7:0/2168488803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f783406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.776+0000 7f7833400640 1 --2- 172.21.15.7:0/2168488803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b5da0 0x7f78340b61a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f783406f630 tx=0x7f782002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cbb82b38223781 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.776+0000 7f7832a00640 1 -- 172.21.15.7:0/2168488803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820037070 con 0x7f78340b5da0 2024-08-19T00:46:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f7832a00640 1 -- 172.21.15.7:0/2168488803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7820032440 con 0x7f78340b5da0 2024-08-19T00:46:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f7832a00640 1 -- 172.21.15.7:0/2168488803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820032810 con 0x7f78340b5da0 2024-08-19T00:46:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 -- 172.21.15.7:0/2168488803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b5da0 msgr2=0x7f78340b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 --2- 172.21.15.7:0/2168488803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b5da0 0x7f78340b61a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f783406f630 tx=0x7f782002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 -- 172.21.15.7:0/2168488803 shutdown_connections 2024-08-19T00:46:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 --2- 172.21.15.7:0/2168488803 >> v2:172.21.15.162:3300/0 conn(0x7f78340b66e0 0x7f78340cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 --2- 172.21.15.7:0/2168488803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b5da0 0x7f78340b61a0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 --2- 172.21.15.7:0/2168488803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f783406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 -- 172.21.15.7:0/2168488803 >> 172.21.15.7:0/2168488803 conn(0x7f78340d2180 msgr2=0x7f78340d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 -- 172.21.15.7:0/2168488803 shutdown_connections 2024-08-19T00:46:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.777+0000 7f783b000640 1 -- 172.21.15.7:0/2168488803 wait complete. 2024-08-19T00:46:03.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.779+0000 7f783b000640 1 Processor -- start 2024-08-19T00:46:03.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.779+0000 7f783b000640 1 -- start start 2024-08-19T00:46:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f783b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f7834155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f783b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78340b5da0 0x7f78340d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f783b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b66e0 0x7f78340ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f783b000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f783415ea10 con 0x7f78340b66e0 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f783b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f783406f9a0 con 0x7f78340b5da0 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f783b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f783406d370 con 0x7f783406d770 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f7839000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b66e0 0x7f78340ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f7833e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f7834155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f7833e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f7834155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:42556/0 (socket says 172.21.15.7:42556) 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f7833e00640 1 -- 172.21.15.7:0/2337884760 learned_addr learned my addr 172.21.15.7:0/2337884760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.780+0000 7f7833400640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78340b5da0 0x7f78340d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f7833e00640 1 -- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78340b5da0 msgr2=0x7f78340d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f7833e00640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78340b5da0 0x7f78340d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f7833e00640 1 -- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b66e0 msgr2=0x7f78340ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f7833e00640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b66e0 0x7f78340ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f7833e00640 1 -- 172.21.15.7:0/2337884760 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78340d0150 con 0x7f783406d770 2024-08-19T00:46:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f7839000640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b66e0 0x7f78340ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f7833e00640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f7834155660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f782400e8e0 tx=0x7f782400eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f782be00640 1 -- 172.21.15.7:0/2337884760 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824017070 con 0x7f783406d770 2024-08-19T00:46:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f782be00640 1 -- 172.21.15.7:0/2337884760 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782400c940 con 0x7f783406d770 2024-08-19T00:46:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f782be00640 1 -- 172.21.15.7:0/2337884760 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782400cd10 con 0x7f783406d770 2024-08-19T00:46:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.781+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78340cea40 con 0x7f783406d770 2024-08-19T00:46:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.782+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78340d06b0 con 0x7f783406d770 2024-08-19T00:46:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.783+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78340d2ca0 con 0x7f783406d770 2024-08-19T00:46:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.784+0000 7f782be00640 1 -- 172.21.15.7:0/2337884760 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f782401a070 con 0x7f783406d770 2024-08-19T00:46:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.785+0000 7f782be00640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f781406be30 0x7f781406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.785+0000 7f782be00640 1 -- 172.21.15.7:0/2337884760 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(107..107 src has 1..107) ==== 7515+0+0 (secure 0 0 0) 0x7f782408bc50 con 0x7f783406d770 2024-08-19T00:46:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.785+0000 7f7833400640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f781406be30 0x7f781406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.786+0000 7f7833400640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f781406be30 0x7f781406e2f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7820034000 tx=0x7f782002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:03.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:03.788+0000 7f782be00640 1 -- 172.21.15.7:0/2337884760 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f78340d0150 con 0x7f783406d770 2024-08-19T00:46:04.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.009+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f78340b3b90 con 0x7f783406d770 2024-08-19T00:46:04.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.147+0000 7f782be00640 1 -- 172.21.15.7:0/2337884760 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v213) ==== 162+0+0 (secure 0 0 0) 0x7f7824059880 con 0x7f783406d770 2024-08-19T00:46:04.150 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:04.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.150+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f781406be30 msgr2=0x7f781406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.150+0000 7f783b000640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f781406be30 0x7f781406e2f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7820034000 tx=0x7f782002e000 comp rx=0 tx=0).stop 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.150+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 msgr2=0x7f7834155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.150+0000 7f783b000640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f7834155660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f782400e8e0 tx=0x7f782400eda0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 shutdown_connections 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f781406be30 0x7f781406e2f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78340b66e0 0x7f78340ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78340b5da0 0x7f78340d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 --2- 172.21.15.7:0/2337884760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f783406d770 0x7f7834155660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 >> 172.21.15.7:0/2337884760 conn(0x7f78340d2180 msgr2=0x7f783406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:04.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 shutdown_connections 2024-08-19T00:46:04.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.151+0000 7f783b000640 1 -- 172.21.15.7:0/2337884760 wait complete. 2024-08-19T00:46:04.156 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:46:04.153+0000 7f2d07e00640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-08-19T00:46:04.156 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:04.154+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:04.156 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:04.154+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:04.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.325+0000 7fce4ea00640 1 Processor -- start 2024-08-19T00:46:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.326+0000 7fce4ea00640 1 -- start start 2024-08-19T00:46:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce4ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce48159bf0 0x7fce48073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce4ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce480cec10 0x7fce480d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce4ea00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4806f7f0 con 0x7fce480739a0 2024-08-19T00:46:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce4ea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fce4806f510 con 0x7fce48159bf0 2024-08-19T00:46:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce4ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fce48072980 con 0x7fce480cec10 2024-08-19T00:46:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce3fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fce480739a0 0x7fce480ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49810/0 (socket says 172.21.15.7:49810) 2024-08-19T00:46:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce3fe00640 1 -- 172.21.15.7:0/929507368 learned_addr learned my addr 172.21.15.7:0/929507368 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce4ca00640 1 --2- 172.21.15.7:0/929507368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce480cec10 0x7fce480d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce47e00640 1 --2- 172.21.15.7:0/929507368 >> v2:172.21.15.162:3300/0 conn(0x7fce48159bf0 0x7fce48073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.327+0000 7fce47400640 1 -- 172.21.15.7:0/929507368 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745660055 0 0) 0x7fce4806f7f0 con 0x7fce480739a0 2024-08-19T00:46:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.328+0000 7fce47400640 1 -- 172.21.15.7:0/929507368 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce2c003520 con 0x7fce480739a0 2024-08-19T00:46:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.328+0000 7fce4ca00640 1 -- 172.21.15.7:0/929507368 >> v2:172.21.15.162:3300/0 conn(0x7fce48159bf0 msgr2=0x7fce48073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.328+0000 7fce4ca00640 1 --2- 172.21.15.7:0/929507368 >> v2:172.21.15.162:3300/0 conn(0x7fce48159bf0 0x7fce48073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.328+0000 7fce4ca00640 1 -- 172.21.15.7:0/929507368 >> v1:172.21.15.7:6789/0 conn(0x7fce480739a0 legacy=0x7fce480ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.328+0000 7fce4ca00640 1 -- 172.21.15.7:0/929507368 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce48072c60 con 0x7fce480cec10 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.329+0000 7fce4ca00640 1 --2- 172.21.15.7:0/929507368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce480cec10 0x7fce480d03c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce40009d90 tx=0x7fce4002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5497123bc20156b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.329+0000 7fce47400640 1 -- 172.21.15.7:0/929507368 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40031600 con 0x7fce480cec10 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.329+0000 7fce47400640 1 -- 172.21.15.7:0/929507368 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce400317a0 con 0x7fce480cec10 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.329+0000 7fce47400640 1 -- 172.21.15.7:0/929507368 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40031b70 con 0x7fce480cec10 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 -- 172.21.15.7:0/929507368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce480cec10 msgr2=0x7fce480d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 --2- 172.21.15.7:0/929507368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce480cec10 0x7fce480d03c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce40009d90 tx=0x7fce4002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 -- 172.21.15.7:0/929507368 shutdown_connections 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 --2- 172.21.15.7:0/929507368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce480cec10 0x7fce480d03c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 --2- 172.21.15.7:0/929507368 >> v2:172.21.15.162:3300/0 conn(0x7fce48159bf0 0x7fce48073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 -- 172.21.15.7:0/929507368 >> 172.21.15.7:0/929507368 conn(0x7fce4806bc70 msgr2=0x7fce4806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 -- 172.21.15.7:0/929507368 shutdown_connections 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.330+0000 7fce4ea00640 1 -- 172.21.15.7:0/929507368 wait complete. 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.331+0000 7fce4ea00640 1 Processor -- start 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.332+0000 7fce4ea00640 1 -- start start 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.332+0000 7fce4ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce480739a0 0x7fce480cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.332+0000 7fce4ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48159bf0 0x7fce4809b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.332+0000 7fce4ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce480ccc00 0x7fce4809be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.332+0000 7fce4ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce4815a150 con 0x7fce480ccc00 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.332+0000 7fce4ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce48159fd0 con 0x7fce480739a0 2024-08-19T00:46:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.332+0000 7fce4ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fce480d0900 con 0x7fce48159bf0 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce480ccc00 0x7fce4809be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce480ccc00 0x7fce4809be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46818/0 (socket says 172.21.15.7:46818) 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 -- 172.21.15.7:0/1030468792 learned_addr learned my addr 172.21.15.7:0/1030468792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce47e00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce480739a0 0x7fce480cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce3fe00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48159bf0 0x7fce4809b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 -- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48159bf0 msgr2=0x7fce4809b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48159bf0 0x7fce4809b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 -- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce480739a0 msgr2=0x7fce480cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce480739a0 0x7fce480cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.333+0000 7fce4ca00640 1 -- 172.21.15.7:0/1030468792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce480cb660 con 0x7fce480ccc00 2024-08-19T00:46:04.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.334+0000 7fce4ca00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce480ccc00 0x7fce4809be20 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fce40009eb0 tx=0x7fce40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:04.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.334+0000 7fce44c00640 1 -- 172.21.15.7:0/1030468792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40040070 con 0x7fce480ccc00 2024-08-19T00:46:04.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.334+0000 7fce44c00640 1 -- 172.21.15.7:0/1030468792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4003c830 con 0x7fce480ccc00 2024-08-19T00:46:04.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.334+0000 7fce44c00640 1 -- 172.21.15.7:0/1030468792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4003cbe0 con 0x7fce480ccc00 2024-08-19T00:46:04.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.334+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce480cb900 con 0x7fce480ccc00 2024-08-19T00:46:04.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.334+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce480cbec0 con 0x7fce480ccc00 2024-08-19T00:46:04.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.335+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce48073540 con 0x7fce480ccc00 2024-08-19T00:46:04.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.336+0000 7fce44c00640 1 -- 172.21.15.7:0/1030468792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce40039040 con 0x7fce480ccc00 2024-08-19T00:46:04.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.337+0000 7fce44c00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2406be30 0x7fce2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.337+0000 7fce44c00640 1 -- 172.21.15.7:0/1030468792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7fce400ac9f0 con 0x7fce480ccc00 2024-08-19T00:46:04.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.337+0000 7fce47e00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2406be30 0x7fce2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.338+0000 7fce47e00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2406be30 0x7fce2406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fce38009b40 tx=0x7fce38009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:04.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.341+0000 7fce44c00640 1 -- 172.21.15.7:0/1030468792 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fce48073540 con 0x7fce480ccc00 2024-08-19T00:46:04.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.562+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce4806c4e0 con 0x7fce480ccc00 2024-08-19T00:46:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.563+0000 7fce44c00640 1 -- 172.21.15.7:0/1030468792 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 215 v215) ==== 95+0+3570 (secure 0 0 0) 0x7fce4806c4e0 con 0x7fce480ccc00 2024-08-19T00:46:04.566 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:04.566 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":215,"btime":"2024-08-19T00:46:04:155887+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":215,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:04.155815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 215 2024-08-19T00:46:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.565+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2406be30 msgr2=0x7fce2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.565+0000 7fce4ea00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2406be30 0x7fce2406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fce38009b40 tx=0x7fce38009190 comp rx=0 tx=0).stop 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.565+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce480ccc00 msgr2=0x7fce4809be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.565+0000 7fce4ea00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce480ccc00 0x7fce4809be20 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fce40009eb0 tx=0x7fce40004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 shutdown_connections 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fce2406be30 0x7fce2406e2f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce480ccc00 0x7fce4809be20 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48159bf0 0x7fce4809b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 --2- 172.21.15.7:0/1030468792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce480739a0 0x7fce480cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 >> 172.21.15.7:0/1030468792 conn(0x7fce4806bc70 msgr2=0x7fce4815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 shutdown_connections 2024-08-19T00:46:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.566+0000 7fce4ea00640 1 -- 172.21.15.7:0/1030468792 wait complete. 2024-08-19T00:46:04.584 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:04.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.738+0000 7f9916800640 1 Processor -- start 2024-08-19T00:46:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.738+0000 7f9916800640 1 -- start start 2024-08-19T00:46:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.739+0000 7f9916800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f991015e360 0x7f991015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.739+0000 7f9916800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.739+0000 7f9916800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99100b3ab0 con 0x7f991015e740 2024-08-19T00:46:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.739+0000 7f9916800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f99100d3490 con 0x7f991015e360 2024-08-19T00:46:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.739+0000 7f9916800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f991015f460 con 0x7f99100d2af0 2024-08-19T00:46:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.739+0000 7f9915e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f991015e740 0x7f991015ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49816/0 (socket says 172.21.15.7:49816) 2024-08-19T00:46:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.739+0000 7f9915e00640 1 -- 172.21.15.7:0/4275890361 learned_addr learned my addr 172.21.15.7:0/4275890361 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f9914a00640 1 --2- 172.21.15.7:0/4275890361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f9915400640 1 --2- 172.21.15.7:0/4275890361 >> v2:172.21.15.162:3300/0 conn(0x7f991015e360 0x7f991015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f990fe00640 1 -- 172.21.15.7:0/4275890361 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321444056 0 0) 0x7f99100b3ab0 con 0x7f991015e740 2024-08-19T00:46:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f990fe00640 1 -- 172.21.15.7:0/4275890361 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98f8003520 con 0x7f991015e740 2024-08-19T00:46:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f9914a00640 1 -- 172.21.15.7:0/4275890361 >> v2:172.21.15.162:3300/0 conn(0x7f991015e360 msgr2=0x7f991015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f9914a00640 1 --2- 172.21.15.7:0/4275890361 >> v2:172.21.15.162:3300/0 conn(0x7f991015e360 0x7f991015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f9914a00640 1 -- 172.21.15.7:0/4275890361 >> v1:172.21.15.7:6789/0 conn(0x7f991015e740 legacy=0x7f991015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.740+0000 7f9914a00640 1 -- 172.21.15.7:0/4275890361 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991015f740 con 0x7f99100d2af0 2024-08-19T00:46:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.741+0000 7f9914a00640 1 --2- 172.21.15.7:0/4275890361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100d2f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0097a0 tx=0x7f98fc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a1079e9d7281328 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.741+0000 7f990fe00640 1 -- 172.21.15.7:0/4275890361 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc037070 con 0x7f99100d2af0 2024-08-19T00:46:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.741+0000 7f990fe00640 1 -- 172.21.15.7:0/4275890361 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc032440 con 0x7f99100d2af0 2024-08-19T00:46:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.741+0000 7f990fe00640 1 -- 172.21.15.7:0/4275890361 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc032810 con 0x7f99100d2af0 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 -- 172.21.15.7:0/4275890361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 msgr2=0x7f99100d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 --2- 172.21.15.7:0/4275890361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100d2f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0097a0 tx=0x7f98fc02a180 comp rx=0 tx=0).stop 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 -- 172.21.15.7:0/4275890361 shutdown_connections 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 --2- 172.21.15.7:0/4275890361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100d2f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 --2- 172.21.15.7:0/4275890361 >> v2:172.21.15.162:3300/0 conn(0x7f991015e360 0x7f991015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 -- 172.21.15.7:0/4275890361 >> 172.21.15.7:0/4275890361 conn(0x7f991008dbf0 msgr2=0x7f991009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 -- 172.21.15.7:0/4275890361 shutdown_connections 2024-08-19T00:46:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.742+0000 7f9916800640 1 -- 172.21.15.7:0/4275890361 wait complete. 2024-08-19T00:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.744+0000 7f9916800640 1 Processor -- start 2024-08-19T00:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.744+0000 7f9916800640 1 -- start start 2024-08-19T00:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9916800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100b9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9916800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e360 0x7f99100b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9916800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f991015e740 0x7f99100b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9916800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f99100d2300 con 0x7f991015e740 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9916800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99100b4040 con 0x7f991015e360 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9916800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f99100b4560 con 0x7f99100d2af0 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9915e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f991015e740 0x7f99100b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9915e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f991015e740 0x7f99100b27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46824/0 (socket says 172.21.15.7:46824) 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9915e00640 1 -- 172.21.15.7:0/1298808176 learned_addr learned my addr 172.21.15.7:0/1298808176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9915400640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.745+0000 7f9914a00640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e360 0x7f99100b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9915e00640 1 -- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 msgr2=0x7f99100b9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9915e00640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100b9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9915e00640 1 -- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e360 msgr2=0x7f99100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9915e00640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e360 0x7f99100b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9915e00640 1 -- 172.21.15.7:0/1298808176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9910155710 con 0x7f991015e740 2024-08-19T00:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9915400640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100b9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9914a00640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e360 0x7f99100b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9915e00640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f991015e740 0x7f99100b27b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f990800caa0 tx=0x7f990800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f990d600640 1 -- 172.21.15.7:0/1298808176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908017070 con 0x7f991015e740 2024-08-19T00:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f990d600640 1 -- 172.21.15.7:0/1298808176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990800ac00 con 0x7f991015e740 2024-08-19T00:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f990d600640 1 -- 172.21.15.7:0/1298808176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908012400 con 0x7f991015e740 2024-08-19T00:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99100cf250 con 0x7f991015e740 2024-08-19T00:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.746+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99100cf810 con 0x7f991015e740 2024-08-19T00:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.747+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99100d2f50 con 0x7f991015e740 2024-08-19T00:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.749+0000 7f990d600640 1 -- 172.21.15.7:0/1298808176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f990801a070 con 0x7f991015e740 2024-08-19T00:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.749+0000 7f990d600640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f98f006be60 0x7f98f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.749+0000 7f990d600640 1 -- 172.21.15.7:0/1298808176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7f990808b400 con 0x7f991015e740 2024-08-19T00:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.750+0000 7f9915400640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f98f006be60 0x7f98f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.750+0000 7f9915400640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f98f006be60 0x7f98f006e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9904009b90 tx=0x7f9904008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.754+0000 7f990d600640 1 -- 172.21.15.7:0/1298808176 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f99080595a0 con 0x7f991015e740 2024-08-19T00:46:04.878 INFO:tasks.ceph.mds.a.smithi007.stderr: -48> 2024-08-19T00:46:00.122+0000 7f94cb400640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': Decoder at 'virtual void InoTable::decode_state(ceph::buffer::v15_2_0::list::const_iterator&)' v=2 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:46:04.917 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:46:04.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.979+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99100d1a00 con 0x7f991015e740 2024-08-19T00:46:04.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.980+0000 7f990d600640 1 -- 172.21.15.7:0/1298808176 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 215 v215) ==== 95+0+3570 (secure 0 0 0) 0x7f9908058ea0 con 0x7f991015e740 2024-08-19T00:46:04.983 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:04.983 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":215,"btime":"2024-08-19T00:46:04:155887+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":215,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:04.155815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:04.983 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 215 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f98f006be60 msgr2=0x7f98f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f98f006be60 0x7f98f006e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9904009b90 tx=0x7f9904008040 comp rx=0 tx=0).stop 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f991015e740 msgr2=0x7f99100b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f991015e740 0x7f99100b27b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f990800caa0 tx=0x7f990800cf60 comp rx=0 tx=0).stop 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 shutdown_connections 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f98f006be60 0x7f98f006e320 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f991015e740 0x7f99100b27b0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e360 0x7f99100b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 --2- 172.21.15.7:0/1298808176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99100d2af0 0x7f99100b9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 >> 172.21.15.7:0/1298808176 conn(0x7f991008dbf0 msgr2=0x7f99101604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:04.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 shutdown_connections 2024-08-19T00:46:04.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:04.982+0000 7f9916800640 1 -- 172.21.15.7:0/1298808176 wait complete. 2024-08-19T00:46:05.000 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:05.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:05.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.154+0000 7f6a9c400640 1 Processor -- start 2024-08-19T00:46:05.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.154+0000 7f6a9c400640 1 -- start start 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.155+0000 7f6a9c400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a940d03c0 0x7f6a94071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.155+0000 7f6a9c400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a940b3750 0x7f6a940cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.155+0000 7f6a9c400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a940cdfb0 con 0x7f6a9406e710 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a9c400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6a940cebc0 con 0x7f6a940d03c0 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a9c400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6a940ce290 con 0x7f6a940b3750 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a99a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a940d03c0 0x7f6a94071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a99a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a940d03c0 0x7f6a94071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46832/0 (socket says 172.21.15.7:46832) 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a99a00640 1 -- 172.21.15.7:0/111198841 learned_addr learned my addr 172.21.15.7:0/111198841 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a9a400640 1 --2- 172.21.15.7:0/111198841 >> v2:172.21.15.162:3300/0 conn(0x7f6a940b3750 0x7f6a940cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a99a00640 1 -- 172.21.15.7:0/111198841 >> v2:172.21.15.162:3300/0 conn(0x7f6a940b3750 msgr2=0x7f6a940cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a99a00640 1 --2- 172.21.15.7:0/111198841 >> v2:172.21.15.162:3300/0 conn(0x7f6a940b3750 0x7f6a940cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a99a00640 1 -- 172.21.15.7:0/111198841 >> v1:172.21.15.162:6789/0 conn(0x7f6a9406e710 legacy=0x7f6a940d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.156+0000 7f6a99a00640 1 -- 172.21.15.7:0/111198841 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a940ce570 con 0x7f6a940d03c0 2024-08-19T00:46:05.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.157+0000 7f6a99a00640 1 --2- 172.21.15.7:0/111198841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a94071980 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800bb10 tx=0x7f6a8802c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c03c3d9864f47c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:05.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.159+0000 7f6a93e00640 1 -- 172.21.15.7:0/111198841 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88036020 con 0x7f6a940d03c0 2024-08-19T00:46:05.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.160+0000 7f6a93e00640 1 -- 172.21.15.7:0/111198841 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a88032820 con 0x7f6a940d03c0 2024-08-19T00:46:05.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.160+0000 7f6a93e00640 1 -- 172.21.15.7:0/111198841 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88032bf0 con 0x7f6a940d03c0 2024-08-19T00:46:05.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.160+0000 7f6a9c400640 1 -- 172.21.15.7:0/111198841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 msgr2=0x7f6a94071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.160+0000 7f6a9c400640 1 --2- 172.21.15.7:0/111198841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a94071980 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800bb10 tx=0x7f6a8802c960 comp rx=0 tx=0).stop 2024-08-19T00:46:05.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.161+0000 7f6a9c400640 1 -- 172.21.15.7:0/111198841 shutdown_connections 2024-08-19T00:46:05.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.161+0000 7f6a9c400640 1 --2- 172.21.15.7:0/111198841 >> v2:172.21.15.162:3300/0 conn(0x7f6a940b3750 0x7f6a940cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.161+0000 7f6a9c400640 1 --2- 172.21.15.7:0/111198841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a94071980 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.161+0000 7f6a9c400640 1 -- 172.21.15.7:0/111198841 >> 172.21.15.7:0/111198841 conn(0x7f6a9406bc70 msgr2=0x7f6a9406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:05.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.161+0000 7f6a9c400640 1 -- 172.21.15.7:0/111198841 shutdown_connections 2024-08-19T00:46:05.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.161+0000 7f6a9c400640 1 -- 172.21.15.7:0/111198841 wait complete. 2024-08-19T00:46:05.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.162+0000 7f6a9c400640 1 Processor -- start 2024-08-19T00:46:05.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.163+0000 7f6a9c400640 1 -- start start 2024-08-19T00:46:05.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9c400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a9406e710 0x7f6a940ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9c400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a940b3750 0x7f6a941f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9c400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a9415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9c400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94073c60 con 0x7f6a940d03c0 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9c400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94073ae0 con 0x7f6a940b3750 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9c400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6a940b3be0 con 0x7f6a9406e710 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a9415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a9415de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46836/0 (socket says 172.21.15.7:46836) 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 -- 172.21.15.7:0/4284944310 learned_addr learned my addr 172.21.15.7:0/4284944310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a99000640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a940b3750 0x7f6a941f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a99a00640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a9406e710 0x7f6a940ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 -- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a9406e710 msgr2=0x7f6a940ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a9406e710 0x7f6a940ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 -- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a940b3750 msgr2=0x7f6a941f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a940b3750 0x7f6a941f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.164+0000 7f6a9a400640 1 -- 172.21.15.7:0/4284944310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a940c95a0 con 0x7f6a940d03c0 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.165+0000 7f6a9a400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a9415de90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007e40 tx=0x7f6a8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.165+0000 7f6a91600640 1 -- 172.21.15.7:0/4284944310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c014620 con 0x7f6a940d03c0 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.165+0000 7f6a91600640 1 -- 172.21.15.7:0/4284944310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c019070 con 0x7f6a940d03c0 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.165+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a940c9880 con 0x7f6a940d03c0 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.165+0000 7f6a91600640 1 -- 172.21.15.7:0/4284944310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c014a20 con 0x7f6a940d03c0 2024-08-19T00:46:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.165+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a940c9e40 con 0x7f6a940d03c0 2024-08-19T00:46:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.166+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a940ca040 con 0x7f6a940d03c0 2024-08-19T00:46:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.167+0000 7f6a91600640 1 -- 172.21.15.7:0/4284944310 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a8c014bc0 con 0x7f6a940d03c0 2024-08-19T00:46:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.168+0000 7f6a91600640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.168+0000 7f6a91600640 1 -- 172.21.15.7:0/4284944310 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7f6a8c08bf60 con 0x7f6a940d03c0 2024-08-19T00:46:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.168+0000 7f6a99a00640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.169+0000 7f6a99a00640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a7406be30 0x7f6a7406e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6a88037000 tx=0x7f6a88008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:05.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.172+0000 7f6a91600640 1 -- 172.21.15.7:0/4284944310 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6a940ca040 con 0x7f6a940d03c0 2024-08-19T00:46:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.395+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a94071980 con 0x7f6a940d03c0 2024-08-19T00:46:05.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.395+0000 7f6a91600640 1 -- 172.21.15.7:0/4284944310 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 216 v216) ==== 95+0+4393 (secure 0 0 0) 0x7f6a8c05a100 con 0x7f6a940d03c0 2024-08-19T00:46:05.399 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:05.400 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":216,"btime":"2024-08-19T00:46:05:157617+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4018426566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":4018426566},{"type":"v1","addr":"172.21.15.7:6837","nonce":4018426566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":216}],"filesystems":[{"mdsmap":{"epoch":215,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:04.155815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:05.400 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 216 2024-08-19T00:46:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a7406be30 msgr2=0x7f6a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a7406be30 0x7f6a7406e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6a88037000 tx=0x7f6a88008040 comp rx=0 tx=0).stop 2024-08-19T00:46:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 msgr2=0x7f6a9415de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a9415de90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007e40 tx=0x7f6a8c00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 shutdown_connections 2024-08-19T00:46:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a940d03c0 0x7f6a9415de90 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a940b3750 0x7f6a941f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 --2- 172.21.15.7:0/4284944310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a9406e710 0x7f6a940ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 >> 172.21.15.7:0/4284944310 conn(0x7f6a9406bc70 msgr2=0x7f6a940aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 shutdown_connections 2024-08-19T00:46:05.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.398+0000 7f6a9c400640 1 -- 172.21.15.7:0/4284944310 wait complete. 2024-08-19T00:46:05.416 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 400.00000000' led to DAMAGED state 2024-08-19T00:46:05.417 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 100.00000000.inode' 2024-08-19T00:46:05.417 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:05.417 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:05.452 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:05.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:05.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:05.453 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:05.527 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:05.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:05.528 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:05.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.722+0000 7fa53fe00640 1 Processor -- start 2024-08-19T00:46:05.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.722+0000 7fa53fe00640 1 -- start start 2024-08-19T00:46:05.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.723+0000 7fa53fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa53809b730 0x7fa53806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.723+0000 7fa53fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5380d0290 0x7fa5380d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.723+0000 7fa53fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa53815ec30 con 0x7fa53809aa70 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.723+0000 7fa53fe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa53815ef10 con 0x7fa5380d0290 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.723+0000 7fa53fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa53815f1f0 con 0x7fa53809b730 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5380d0290 0x7fa5380d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa5380d0290 0x7fa5380d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46838/0 (socket says 172.21.15.7:46838) 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53de00640 1 -- 172.21.15.7:0/3418822169 learned_addr learned my addr 172.21.15.7:0/3418822169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53ca00640 1 --2- 172.21.15.7:0/3418822169 >> v2:172.21.15.162:3300/0 conn(0x7fa53809b730 0x7fa53806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53de00640 1 -- 172.21.15.7:0/3418822169 >> v2:172.21.15.162:3300/0 conn(0x7fa53809b730 msgr2=0x7fa53806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53de00640 1 --2- 172.21.15.7:0/3418822169 >> v2:172.21.15.162:3300/0 conn(0x7fa53809b730 0x7fa53806fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53de00640 1 -- 172.21.15.7:0/3418822169 >> v1:172.21.15.162:6789/0 conn(0x7fa53809aa70 legacy=0x7fa53809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53de00640 1 -- 172.21.15.7:0/3418822169 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53815f4d0 con 0x7fa5380d0290 2024-08-19T00:46:05.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.724+0000 7fa53ca00640 1 --2- 172.21.15.7:0/3418822169 >> v2:172.21.15.162:3300/0 conn(0x7fa53809b730 0x7fa53806fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:05.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.725+0000 7fa53de00640 1 --2- 172.21.15.7:0/3418822169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5380d0290 0x7fa5380d0720 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fa538071bd0 tx=0x7fa53002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78da67cab2732ab server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.725+0000 7fa537e00640 1 -- 172.21.15.7:0/3418822169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530036070 con 0x7fa5380d0290 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.725+0000 7fa537e00640 1 -- 172.21.15.7:0/3418822169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa530031600 con 0x7fa5380d0290 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.725+0000 7fa537e00640 1 -- 172.21.15.7:0/3418822169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5300319d0 con 0x7fa5380d0290 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 -- 172.21.15.7:0/3418822169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5380d0290 msgr2=0x7fa5380d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 --2- 172.21.15.7:0/3418822169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5380d0290 0x7fa5380d0720 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fa538071bd0 tx=0x7fa53002a730 comp rx=0 tx=0).stop 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 -- 172.21.15.7:0/3418822169 shutdown_connections 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 --2- 172.21.15.7:0/3418822169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5380d0290 0x7fa5380d0720 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 --2- 172.21.15.7:0/3418822169 >> v2:172.21.15.162:3300/0 conn(0x7fa53809b730 0x7fa53806fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 -- 172.21.15.7:0/3418822169 >> 172.21.15.7:0/3418822169 conn(0x7fa5380d2190 msgr2=0x7fa5380d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:05.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 -- 172.21.15.7:0/3418822169 shutdown_connections 2024-08-19T00:46:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.726+0000 7fa53fe00640 1 -- 172.21.15.7:0/3418822169 wait complete. 2024-08-19T00:46:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.728+0000 7fa53fe00640 1 Processor -- start 2024-08-19T00:46:05.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.728+0000 7fa53fe00640 1 -- start start 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa53809aa70 0x7fa538153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa53809b730 0x7fa5380b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5380d0290 0x7fa5381e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa5380d0c60 con 0x7fa53809aa70 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa53815e8f0 con 0x7fa53809b730 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5380d0de0 con 0x7fa5380d0290 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa53809aa70 0x7fa538153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa53809aa70 0x7fa538153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46842/0 (socket says 172.21.15.7:46842) 2024-08-19T00:46:05.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53d400640 1 -- 172.21.15.7:0/527271840 learned_addr learned my addr 172.21.15.7:0/527271840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:05.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53de00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5380d0290 0x7fa5381e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.729+0000 7fa53ca00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa53809b730 0x7fa5380b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa53d400640 1 -- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5380d0290 msgr2=0x7fa5381e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa53d400640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5380d0290 0x7fa5381e90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa53d400640 1 -- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa53809b730 msgr2=0x7fa5380b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa53d400640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa53809b730 0x7fa5380b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa53d400640 1 -- 172.21.15.7:0/527271840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5381f57f0 con 0x7fa53809aa70 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa53d400640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa53809aa70 0x7fa538153840 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c400 tx=0x7fa52c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa535600640 1 -- 172.21.15.7:0/527271840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0052d0 con 0x7fa53809aa70 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa535600640 1 -- 172.21.15.7:0/527271840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c005490 con 0x7fa53809aa70 2024-08-19T00:46:05.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5381f4c70 con 0x7fa53809aa70 2024-08-19T00:46:05.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.730+0000 7fa535600640 1 -- 172.21.15.7:0/527271840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c007260 con 0x7fa53809aa70 2024-08-19T00:46:05.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.731+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381f5230 con 0x7fa53809aa70 2024-08-19T00:46:05.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.732+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53806fc30 con 0x7fa53809aa70 2024-08-19T00:46:05.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.733+0000 7fa535600640 1 -- 172.21.15.7:0/527271840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa52c007400 con 0x7fa53809aa70 2024-08-19T00:46:05.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.733+0000 7fa535600640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa51806be30 0x7fa51806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:05.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.734+0000 7fa535600640 1 -- 172.21.15.7:0/527271840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7fa52c08aac0 con 0x7fa53809aa70 2024-08-19T00:46:05.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.734+0000 7fa53ca00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa51806be30 0x7fa51806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:05.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.735+0000 7fa53ca00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa51806be30 0x7fa51806e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa538076150 tx=0x7fa524008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:05.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.738+0000 7fa535600640 1 -- 172.21.15.7:0/527271840 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa52c0586a0 con 0x7fa53809aa70 2024-08-19T00:46:05.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:05.960+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa5380d2cb0 con 0x7fa53809aa70 2024-08-19T00:46:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.164+0000 7fa535600640 1 -- 172.21.15.7:0/527271840 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v217) ==== 161+0+0 (secure 0 0 0) 0x7fa52c05c9a0 con 0x7fa53809aa70 2024-08-19T00:46:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa51806be30 msgr2=0x7fa51806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa51806be30 0x7fa51806e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa538076150 tx=0x7fa524008040 comp rx=0 tx=0).stop 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa53809aa70 msgr2=0x7fa538153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa53809aa70 0x7fa538153840 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c400 tx=0x7fa52c00c8c0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 shutdown_connections 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa51806be30 0x7fa51806e2f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5380d0290 0x7fa5381e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa53809b730 0x7fa5380b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 --2- 172.21.15.7:0/527271840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa53809aa70 0x7fa538153840 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 >> 172.21.15.7:0/527271840 conn(0x7fa5380d2190 msgr2=0x7fa5380d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 shutdown_connections 2024-08-19T00:46:06.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.167+0000 7fa53fe00640 1 -- 172.21.15.7:0/527271840 wait complete. 2024-08-19T00:46:06.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.343+0000 7f555d200640 1 Processor -- start 2024-08-19T00:46:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.343+0000 7f555d200640 1 -- start start 2024-08-19T00:46:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.344+0000 7f555d200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f555815e3e0 0x7f55580b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.344+0000 7f555d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 0x7f55580d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.344+0000 7f555d200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55580b4df0 con 0x7f55580d27b0 2024-08-19T00:46:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.344+0000 7f555d200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f55580d3140 con 0x7f555815e3e0 2024-08-19T00:46:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.344+0000 7f555d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55580b50d0 con 0x7f55580b4860 2024-08-19T00:46:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f554fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f55580d27b0 0x7f55580b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49818/0 (socket says 172.21.15.7:49818) 2024-08-19T00:46:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f554fe00640 1 -- 172.21.15.7:0/2578438932 learned_addr learned my addr 172.21.15.7:0/2578438932 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:06.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5557e00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 0x7f55580d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5557400640 1 --2- 172.21.15.7:0/2578438932 >> v2:172.21.15.162:3300/0 conn(0x7f555815e3e0 0x7f55580b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71476044 0 0) 0x7f55580b4df0 con 0x7f55580d27b0 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f553c003520 con 0x7f55580d27b0 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4016277665 0 0) 0x7f553c003520 con 0x7f55580d27b0 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 msgr2=0x7f55580d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 0x7f55580d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 >> v2:172.21.15.162:3300/0 conn(0x7f555815e3e0 msgr2=0x7f55580b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 --2- 172.21.15.7:0/2578438932 >> v2:172.21.15.162:3300/0 conn(0x7f555815e3e0 0x7f55580b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55580cf1e0 con 0x7f55580d27b0 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f5540001670 con 0x7f55580d27b0 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.345+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 >> v1:172.21.15.7:6789/0 conn(0x7f55580d27b0 legacy=0x7f55580b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5556a00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 0x7f553c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5556a00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c003f30 0x7f553c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5556a00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c004d40 0x7f553c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55580d3140 con 0x7f553c003f30 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55580b50d0 con 0x7f553c004d40 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f553c00b9c0 con 0x7f55580b4860 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f554fe00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c003f30 0x7f553c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5557400640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 0x7f553c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f5557e00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c004d40 0x7f553c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f554fe00640 1 -- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 msgr2=0x7f553c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f554fe00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55580b4860 0x7f553c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f554fe00640 1 -- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c004d40 msgr2=0x7f553c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f554fe00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c004d40 0x7f553c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.346+0000 7f554fe00640 1 -- 172.21.15.7:0/2578438932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c003520 con 0x7f553c003f30 2024-08-19T00:46:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.347+0000 7f554fe00640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c003f30 0x7f553c004800 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f554000c210 tx=0x7f553c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6d3297cc77280c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540007d30 con 0x7f553c003f30 2024-08-19T00:46:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5540005ad0 con 0x7f553c003f30 2024-08-19T00:46:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f5556a00640 1 -- 172.21.15.7:0/2578438932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540007070 con 0x7f553c003f30 2024-08-19T00:46:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f555d200640 1 -- 172.21.15.7:0/2578438932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c003f30 msgr2=0x7f553c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f555d200640 1 --2- 172.21.15.7:0/2578438932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f553c003f30 0x7f553c004800 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f554000c210 tx=0x7f553c005830 comp rx=0 tx=0).stop 2024-08-19T00:46:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f5557e00640 1 -- 172.21.15.7:0/2578438932 reap_dead start 2024-08-19T00:46:06.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f555d200640 1 -- 172.21.15.7:0/2578438932 shutdown_connections 2024-08-19T00:46:06.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f555d200640 1 -- 172.21.15.7:0/2578438932 >> 172.21.15.7:0/2578438932 conn(0x7f555808dbe0 msgr2=0x7f555809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:06.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f555d200640 1 -- 172.21.15.7:0/2578438932 shutdown_connections 2024-08-19T00:46:06.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.348+0000 7f555d200640 1 -- 172.21.15.7:0/2578438932 wait complete. 2024-08-19T00:46:06.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.350+0000 7f555d200640 1 Processor -- start 2024-08-19T00:46:06.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.350+0000 7f555d200640 1 -- start start 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f555d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c003f30 0x7f55580cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f555d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555814eb00 0x7f55580b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f555d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f555806c5c0 0x7f555806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f555d200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55580b13a0 con 0x7f555814eb00 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f555d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55580cee90 con 0x7f553c003f30 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f555d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55580d2c00 con 0x7f555806c5c0 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f554fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555814eb00 0x7f55580b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f554fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555814eb00 0x7f55580b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46846/0 (socket says 172.21.15.7:46846) 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.351+0000 7f554fe00640 1 -- 172.21.15.7:0/1374384256 learned_addr learned my addr 172.21.15.7:0/1374384256 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f5557400640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c003f30 0x7f55580cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f5557e00640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f555806c5c0 0x7f555806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554fe00640 1 -- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f555806c5c0 msgr2=0x7f555806ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554fe00640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f555806c5c0 0x7f555806ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554fe00640 1 -- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c003f30 msgr2=0x7f55580cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554fe00640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c003f30 0x7f55580cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554fe00640 1 -- 172.21.15.7:0/1374384256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555814c280 con 0x7f555814eb00 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f5557400640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c003f30 0x7f55580cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f5557e00640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f555806c5c0 0x7f555806ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554fe00640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555814eb00 0x7f55580b97f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f554002ae00 tx=0x7f5540001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554f400640 1 -- 172.21.15.7:0/1374384256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540038040 con 0x7f555814eb00 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554f400640 1 -- 172.21.15.7:0/1374384256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5540042070 con 0x7f555814eb00 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555814c560 con 0x7f555814eb00 2024-08-19T00:46:06.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.352+0000 7f554f400640 1 -- 172.21.15.7:0/1374384256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540004a20 con 0x7f555814eb00 2024-08-19T00:46:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.353+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555814cb20 con 0x7f555814eb00 2024-08-19T00:46:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.354+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55580b0e60 con 0x7f555814eb00 2024-08-19T00:46:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.355+0000 7f554f400640 1 -- 172.21.15.7:0/1374384256 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5540004bc0 con 0x7f555814eb00 2024-08-19T00:46:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.356+0000 7f554f400640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f553406be30 0x7f553406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.356+0000 7f554f400640 1 -- 172.21.15.7:0/1374384256 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7f55400ab0d0 con 0x7f555814eb00 2024-08-19T00:46:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.356+0000 7f5557400640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f553406be30 0x7f553406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.357+0000 7f5557400640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f553406be30 0x7f553406e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5548009ab0 tx=0x7f5548008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:06.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.360+0000 7f554f400640 1 -- 172.21.15.7:0/1374384256 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5540079270 con 0x7f555814eb00 2024-08-19T00:46:06.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:06.613+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f555809d650 con 0x7f555814eb00 2024-08-19T00:46:07.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.171+0000 7f554f400640 1 -- 172.21.15.7:0/1374384256 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v218) ==== 101+0+0 (secure 0 0 0) 0x7f5540078b70 con 0x7f555814eb00 2024-08-19T00:46:07.174 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f553406be30 msgr2=0x7f553406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f553406be30 0x7f553406e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5548009ab0 tx=0x7f5548008040 comp rx=0 tx=0).stop 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555814eb00 msgr2=0x7f55580b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555814eb00 0x7f55580b97f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f554002ae00 tx=0x7f5540001a40 comp rx=0 tx=0).stop 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 shutdown_connections 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f553406be30 0x7f553406e2f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f555806c5c0 0x7f555806ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555814eb00 0x7f55580b97f0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.173+0000 7f555d200640 1 --2- 172.21.15.7:0/1374384256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c003f30 0x7f55580cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.174+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 >> 172.21.15.7:0/1374384256 conn(0x7f555808dbe0 msgr2=0x7f55580b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.174+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 shutdown_connections 2024-08-19T00:46:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.174+0000 7f555d200640 1 -- 172.21.15.7:0/1374384256 wait complete. 2024-08-19T00:46:07.194 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.271+0000 7f7a2f9fcf40 1 Processor -- start 2024-08-19T00:46:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.271+0000 7f7a2f9fcf40 1 -- start start 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2f9fcf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d6128a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2f9fcf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b5b0 0x55ad3d548ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2f9fcf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b990 0x55ad3d549430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2f9fcf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ad3d57a8f0 con 0x55ad3d579f40 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2f9fcf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ad3d4efd00 con 0x55ad3d57b5b0 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2f9fcf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ad3d620dc0 con 0x55ad3d57b990 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d6128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d6128a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46854/0 (socket says 172.21.15.7:46854) 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2cc00640 1 -- 172.21.15.7:0/2146040334 learned_addr learned my addr 172.21.15.7:0/2146040334 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a27e00640 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b5b0 0x55ad3d548ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.272+0000 7f7a2d600640 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b990 0x55ad3d549430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a2cc00640 1 -- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b990 msgr2=0x55ad3d549430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b990 0x55ad3d549430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a2cc00640 1 -- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b5b0 msgr2=0x55ad3d548ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b5b0 0x55ad3d548ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a2cc00640 1 -- 172.21.15.7:0/2146040334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3d474b30 con 0x55ad3d579f40 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d6128a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f7a200098e0 tx=0x7f7a20005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7f4a60f3dd9129 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a26a00640 1 -- 172.21.15.7:0/2146040334 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20008950 con 0x55ad3d579f40 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a26a00640 1 -- 172.21.15.7:0/2146040334 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a20018070 con 0x55ad3d579f40 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.273+0000 7f7a26a00640 1 -- 172.21.15.7:0/2146040334 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20008d30 con 0x55ad3d579f40 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/2146040334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 msgr2=0x55ad3d6128a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d6128a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f7a200098e0 tx=0x7f7a20005a00 comp rx=0 tx=0).stop 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/2146040334 shutdown_connections 2024-08-19T00:46:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b990 0x55ad3d549430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b5b0 0x55ad3d548ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/2146040334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d6128a0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/2146040334 >> 172.21.15.7:0/2146040334 conn(0x55ad3d5784e0 msgr2=0x55ad3d5788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:07.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/2146040334 shutdown_connections 2024-08-19T00:46:07.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.274+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/2146040334 wait complete. 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.275+0000 7f7a2f9fcf40 1 Processor -- start 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.275+0000 7f7a2f9fcf40 1 -- start start 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2f9fcf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d60ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2f9fcf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b5b0 0x55ad3d60a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2f9fcf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b990 0x55ad3d60a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2f9fcf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ad3d576360 con 0x55ad3d579f40 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2f9fcf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ad3d596120 con 0x55ad3d57b990 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2f9fcf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ad3d595e40 con 0x55ad3d57b5b0 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d60ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d60ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46860/0 (socket says 172.21.15.7:46860) 2024-08-19T00:46:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 learned_addr learned my addr 172.21.15.7:0/1608015908 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b5b0 0x55ad3d60a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2d600640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b990 0x55ad3d60a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b5b0 msgr2=0x55ad3d60a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b5b0 0x55ad3d60a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b990 msgr2=0x55ad3d60a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad3d57b990 0x55ad3d60a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3d4b1080 con 0x55ad3d579f40 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.276+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ad3d57b5b0 0x55ad3d60a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.277+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d60ff50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x55ad3d6131d0 tx=0x7f7a20003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.277+0000 7f7a25600640 1 -- 172.21.15.7:0/1608015908 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20026630 con 0x55ad3d579f40 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.277+0000 7f7a25600640 1 -- 172.21.15.7:0/1608015908 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a200267f0 con 0x55ad3d579f40 2024-08-19T00:46:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.277+0000 7f7a25600640 1 -- 172.21.15.7:0/1608015908 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20026be0 con 0x55ad3d579f40 2024-08-19T00:46:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.277+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad3d6093e0 con 0x55ad3d579f40 2024-08-19T00:46:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.277+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3d5470a0 con 0x55ad3d579f40 2024-08-19T00:46:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.279+0000 7f7a25600640 1 -- 172.21.15.7:0/1608015908 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a20013420 con 0x55ad3d579f40 2024-08-19T00:46:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.280+0000 7f7a25600640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a0c06a810 0x7f7a0c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.280+0000 7f7a25600640 1 -- 172.21.15.7:0/1608015908 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7f7a2008c480 con 0x55ad3d579f40 2024-08-19T00:46:07.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.280+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a0c06a810 0x7f7a0c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.284 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:07.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.280+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ad3d6095f0 0x55ad3d60bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.280+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d577520 con 0x55ad3d6095f0 2024-08-19T00:46:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.281+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a0c06a810 0x7f7a0c06ccd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55ad3d576db0 tx=0x7f7a18001680 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.281+0000 7f7a2d600640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ad3d6095f0 0x55ad3d60bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.281+0000 7f7a2d600640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ad3d6095f0 0x55ad3d60bf10 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.283+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v108'660 uv634 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.283+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d610490 con 0x55ad3d6095f0 2024-08-19T00:46:07.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.285+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v108'661 uv661 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.285+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d60deb0 con 0x55ad3d6095f0 2024-08-19T00:46:07.289 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.286+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v108'662 uv662 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.286+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d60c450 con 0x55ad3d6095f0 2024-08-19T00:46:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.288+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v108'663 uv663 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.288+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c4250 con 0x55ad3d6095f0 2024-08-19T00:46:07.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.289+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v108'664 uv664 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.289+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c3240 con 0x55ad3d6095f0 2024-08-19T00:46:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.290+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v108'665 uv665 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.290+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c3630 con 0x55ad3d6095f0 2024-08-19T00:46:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.292+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v108'666 uv640 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.292+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c3a20 con 0x55ad3d6095f0 2024-08-19T00:46:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.293+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v108'667 uv667 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.293+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c3a20 con 0x55ad3d6095f0 2024-08-19T00:46:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.295+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v108'668 uv668 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.297 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:07.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.295+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.296+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v108'669 uv669 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.296+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.297+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v108'670 uv670 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.297+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.299+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v108'671 uv671 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.299+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.300+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v108'672 uv647 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.301+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.302+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v108'673 uv673 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.302+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.303+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v108'674 uv674 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.306 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.303+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.305+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v108'675 uv675 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.305+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.306+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v108'676 uv676 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.306+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.307+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v108'677 uv677 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.307+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.309+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v108'678 uv678 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.309+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.310+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v108'679 uv653 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.310+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.312+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v108'680 uv680 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.312+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.313+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v108'681 uv681 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.315 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.313+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.314+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v108'682 uv682 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.314+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.316+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v108'683 uv683 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.316+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.317+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v108'684 uv684 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.317+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.319+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v108'685 uv659 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.319+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.320+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v108'686 uv686 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.320+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.323 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.321+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v108'687 uv687 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.321+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.322+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v108'688 uv688 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.322+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.324+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v108'689 uv689 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.324+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c39d0 con 0x55ad3d6095f0 2024-08-19T00:46:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.325+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v108'690 uv690 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.325+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ad3d6c3dd0 0x55ad3d6c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.325+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c7050 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.326+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ad3d6c3dd0 0x55ad3d6c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.326+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ad3d6c3dd0 0x55ad3d6c6b10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.328+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v108'484 uv467 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.328+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c73f0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.329+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v108'485 uv485 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.329+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c7790 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.331+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v108'486 uv486 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.333 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.331+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c7b30 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.332+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v108'487 uv487 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.332+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c7ed0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.334+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v108'488 uv488 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.334+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c8270 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.336+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v108'489 uv472 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.336+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c8610 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.337+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v108'490 uv490 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.337+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.339+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v108'491 uv491 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.341 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:07.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.339+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.341+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v108'492 uv492 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.341+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.342+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v108'493 uv493 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.342+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.343+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v108'494 uv477 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.343+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.345+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v108'495 uv495 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.345+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.349 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.346+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v108'496 uv496 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.346+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6cd0a0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.348+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v108'497 uv497 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.348+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6cd0a0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.350+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v108'498 uv498 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.350+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.352+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v108'499 uv483 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.352+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.353+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v108'500 uv500 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.353+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.354+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v108'501 uv501 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.357 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.354+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c99c0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.356+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v108'502 uv502 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.356+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c99c0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.357+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v108'503 uv503 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.357+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6c89b0 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.359+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v108'504 uv504 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6c3dd0 2024-08-19T00:46:07.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.359+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55ad3d6c9030 0x55ad3d6cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.359+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6cb960 con 0x55ad3d6c9030 2024-08-19T00:46:07.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.359+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55ad3d6c9030 0x55ad3d6cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.360+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55ad3d6c9030 0x55ad3d6cb420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.361+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v108'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.361+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d60af20 con 0x55ad3d6c9030 2024-08-19T00:46:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.362+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v108'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.362+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6cc320 con 0x55ad3d6c9030 2024-08-19T00:46:07.366 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.364+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v108'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.364+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6cdc00 con 0x55ad3d6c9030 2024-08-19T00:46:07.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.365+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v108'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.365+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6cdfa0 con 0x55ad3d6c9030 2024-08-19T00:46:07.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.366+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v108'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.366+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6ccbf0 con 0x55ad3d6c9030 2024-08-19T00:46:07.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.367+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v108'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.367+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6ccfe0 con 0x55ad3d6095f0 2024-08-19T00:46:07.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.370+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v108'96 uv95 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.370+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6ccfe0 con 0x55ad3d6095f0 2024-08-19T00:46:07.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.372+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v108'97 uv97 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.372+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6ccfe0 con 0x55ad3d6095f0 2024-08-19T00:46:07.375 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.372+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v108'98 uv98 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.372+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6ccfe0 con 0x55ad3d6095f0 2024-08-19T00:46:07.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.375+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v108'99 uv99 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.375+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55ad3d6cd660 0x55ad3d6d0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.375+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d0890 con 0x55ad3d6cd660 2024-08-19T00:46:07.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.375+0000 7f7a2d600640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55ad3d6cd660 0x55ad3d6d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.375+0000 7f7a2d600640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55ad3d6cd660 0x55ad3d6d0350 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.376+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v108'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.376+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d0890 con 0x55ad3d6cd660 2024-08-19T00:46:07.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.377+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v108'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.377+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d0890 con 0x55ad3d6cd660 2024-08-19T00:46:07.381 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.379+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v108'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.379+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d1cc0 con 0x55ad3d6cd660 2024-08-19T00:46:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.380+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v108'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.380+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d1cc0 con 0x55ad3d6cd660 2024-08-19T00:46:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.382+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v108'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.382+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d0cb0 con 0x55ad3d6cd660 2024-08-19T00:46:07.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.383+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v108'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.383+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55ad3d6d1330 0x55ad3d6d3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.383+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d3c60 con 0x55ad3d6d1330 2024-08-19T00:46:07.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.383+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55ad3d6d1330 0x55ad3d6d3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.384+0000 7f7a2cc00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55ad3d6d1330 0x55ad3d6d3720 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.385+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v108'238 uv232 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.385+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.386+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v108'239 uv239 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.386+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.390 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:07.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.388+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v108'240 uv240 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.388+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d5040 con 0x55ad3d6d1330 2024-08-19T00:46:07.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.389+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v108'241 uv241 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.389+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d5040 con 0x55ad3d6d1330 2024-08-19T00:46:07.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.390+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v108'242 uv242 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.390+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.392+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v108'243 uv243 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.392+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.393+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v108'244 uv237 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.393+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.394+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v108'245 uv245 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.394+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.398 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:07.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.396+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v108'246 uv246 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.396+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.397+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v108'247 uv247 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.397+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d4030 con 0x55ad3d6d1330 2024-08-19T00:46:07.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.398+0000 7f7a2cc00640 1 -- 172.21.15.7:0/1608015908 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v108'248 uv248 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a2002c020 con 0x55ad3d6d1330 2024-08-19T00:46:07.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.399+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55ad3d6d46b0 0x55ad3d6d6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.399+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7160 con 0x55ad3d6d46b0 2024-08-19T00:46:07.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.399+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55ad3d6d46b0 0x55ad3d6d6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.399+0000 7f7a27e00640 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55ad3d6d46b0 0x55ad3d6d6aa0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.401+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v108'107 uv106 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.401+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7530 con 0x55ad3d6d46b0 2024-08-19T00:46:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.402+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v108'108 uv108 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.402+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6d46b0 2024-08-19T00:46:07.406 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:07.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.403+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v108'109 uv109 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.404+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6d46b0 2024-08-19T00:46:07.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.405+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v108'110 uv110 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.405+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6d46b0 2024-08-19T00:46:07.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.406+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v108'111 uv111 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.406+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6095f0 2024-08-19T00:46:07.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.408+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v108'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.408+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6095f0 2024-08-19T00:46:07.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.409+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v108'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.409+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6095f0 2024-08-19T00:46:07.413 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:07.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.411+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v108'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.411+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d8960 con 0x55ad3d6095f0 2024-08-19T00:46:07.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.412+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v108'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.412+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d8960 con 0x55ad3d6095f0 2024-08-19T00:46:07.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.413+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v108'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.413+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6095f0 2024-08-19T00:46:07.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.415+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v108'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6095f0 2024-08-19T00:46:07.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.415+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.416+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v108'213 uv207 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.416+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.418+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v108'214 uv214 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.418+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.421 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:07.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.420+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v108'215 uv215 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.420+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.421+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v108'216 uv216 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.421+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.422+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v108'217 uv217 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.422+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.423+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v108'218 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.423+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.425+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v108'219 uv219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.425+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.428 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.426+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v108'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.426+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7950 con 0x55ad3d6c9030 2024-08-19T00:46:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.428+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v108'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.428+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6da760 con 0x55ad3d6c9030 2024-08-19T00:46:07.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.430+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v108'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6c9030 2024-08-19T00:46:07.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.430+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.432+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v108'95 uv94 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.432+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.433+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v108'96 uv96 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.433+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.433+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v108'97 uv97 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.436 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.434+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.435+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v108'98 uv98 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.435+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.437+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v108'129 uv128 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.437+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.439+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v108'130 uv130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.439+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.440+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v108'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.442 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:07.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.440+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d8e10 con 0x55ad3d6cd660 2024-08-19T00:46:07.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.441+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v108'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.441+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d8e10 con 0x55ad3d6cd660 2024-08-19T00:46:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.443+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v108'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.443+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6cd660 2024-08-19T00:46:07.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.444+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v108'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a280518c0 con 0x55ad3d6cd660 2024-08-19T00:46:07.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.444+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.446+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v108'110 uv109 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.446+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.447+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v108'111 uv111 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.447+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.450 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.448+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v108'112 uv112 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.448+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.450+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v108'113 uv113 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.450+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.451+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v108'114 uv114 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.451+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.452+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v108'265 uv257 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.452+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.454+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v108'266 uv266 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.454+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.458 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.456+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v108'267 uv267 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.456+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.457+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v108'268 uv268 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.457+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.458+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v108'269 uv269 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.458+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.460+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v108'270 uv264 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.460+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.461+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v108'271 uv271 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.461+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.465 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:07.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.463+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v108'272 uv272 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.463+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.464+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v108'273 uv273 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.464+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.465+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v108'274 uv274 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.465+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d7e00 con 0x55ad3d6d46b0 2024-08-19T00:46:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.467+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v108'275 uv275 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.467+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55ad3d6d86a0 con 0x55ad3d6d46b0 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a27e00640 1 -- 172.21.15.7:0/1608015908 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v108'276 uv276 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7a1801a040 con 0x55ad3d6d46b0 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ad3d6c3dd0 msgr2=0x55ad3d6c6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ad3d6c3dd0 0x55ad3d6c6b10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55ad3d6d1330 msgr2=0x55ad3d6d3720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55ad3d6d1330 0x55ad3d6d3720 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55ad3d6d46b0 msgr2=0x55ad3d6d6aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55ad3d6d46b0 0x55ad3d6d6aa0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55ad3d6c9030 msgr2=0x55ad3d6cb420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55ad3d6c9030 0x55ad3d6cb420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ad3d6095f0 msgr2=0x55ad3d60bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55ad3d6095f0 0x55ad3d60bf10 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55ad3d6cd660 msgr2=0x55ad3d6d0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55ad3d6cd660 0x55ad3d6d0350 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 reap_dead start 2024-08-19T00:46:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 reap_dead start 2024-08-19T00:46:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2d600640 1 -- 172.21.15.7:0/1608015908 reap_dead start 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a0c06a810 msgr2=0x7f7a0c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.468+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a0c06a810 0x7f7a0c06ccd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55ad3d576db0 tx=0x7f7a18001680 comp rx=0 tx=0).stop 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 msgr2=0x55ad3d60ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d60ff50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x55ad3d6131d0 tx=0x7f7a20003020 comp rx=0 tx=0).stop 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 shutdown_connections 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7a0c06a810 0x7f7a0c06ccd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 --2- 172.21.15.7:0/1608015908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad3d579f40 0x55ad3d60ff50 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 >> 172.21.15.7:0/1608015908 conn(0x55ad3d5784e0 msgr2=0x55ad3d5795d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 shutdown_connections 2024-08-19T00:46:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.469+0000 7f7a2f9fcf40 1 -- 172.21.15.7:0/1608015908 wait complete. 2024-08-19T00:46:07.476 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 100.00000000.inode - 2024-08-19T00:46:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.552+0000 7f61e4628f40 1 Processor -- start 2024-08-19T00:46:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.552+0000 7f61e4628f40 1 -- start start 2024-08-19T00:46:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e4628f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 0x55e28246c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e4628f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2824898f0 0x55e282505440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e4628f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e28250c930 0x55e28250cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e4628f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e2823e3d00 con 0x55e28250c930 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e4628f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e2823e7d40 con 0x55e2824898f0 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e4628f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e282514dc0 con 0x7f61c8003630 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e28250c930 0x55e28250cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e28250c930 0x55e28250cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46880/0 (socket says 172.21.15.7:46880) 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e2200640 1 -- 172.21.15.7:0/839666733 learned_addr learned my addr 172.21.15.7:0/839666733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e0e00640 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2824898f0 0x55e282505440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.553+0000 7f61e1800640 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 0x55e28246c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61e2200640 1 -- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 msgr2=0x55e28246c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61e2200640 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 0x55e28246c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61e2200640 1 -- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2824898f0 msgr2=0x55e282505440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61e2200640 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2824898f0 0x55e282505440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61e2200640 1 -- 172.21.15.7:0/839666733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2823a5080 con 0x55e28250c930 2024-08-19T00:46:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61e2200640 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e28250c930 0x55e28250cde0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f61dc025e60 tx=0x7f61dc04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e1f75e72e890a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61db400640 1 -- 172.21.15.7:0/839666733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc01a440 con 0x55e28250c930 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61db400640 1 -- 172.21.15.7:0/839666733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61dc065070 con 0x55e28250c930 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.554+0000 7f61db400640 1 -- 172.21.15.7:0/839666733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc04dd70 con 0x55e28250c930 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 -- 172.21.15.7:0/839666733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e28250c930 msgr2=0x55e28250cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e28250c930 0x55e28250cde0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f61dc025e60 tx=0x7f61dc04f000 comp rx=0 tx=0).stop 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 -- 172.21.15.7:0/839666733 shutdown_connections 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e28250c930 0x55e28250cde0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2824898f0 0x55e282505440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 --2- 172.21.15.7:0/839666733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 0x55e28246c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 -- 172.21.15.7:0/839666733 >> 172.21.15.7:0/839666733 conn(0x55e28246c4e0 msgr2=0x55e28246a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 -- 172.21.15.7:0/839666733 shutdown_connections 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.555+0000 7f61e4628f40 1 -- 172.21.15.7:0/839666733 wait complete. 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.556+0000 7f61e4628f40 1 Processor -- start 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.556+0000 7f61e4628f40 1 -- start start 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e4628f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2824898f0 0x55e2824fdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e4628f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28250c930 0x55e282503ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e4628f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 0x55e282504430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e4628f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e28250d320 con 0x55e2824898f0 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e4628f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e28246be30 con 0x55e28250c930 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e4628f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e28250e480 con 0x7f61c8003630 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2824898f0 0x55e2824fdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2824898f0 0x55e2824fdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46884/0 (socket says 172.21.15.7:46884) 2024-08-19T00:46:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e1800640 1 -- 172.21.15.7:0/4063911742 learned_addr learned my addr 172.21.15.7:0/4063911742 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e2200640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 0x55e282504430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.557+0000 7f61e0e00640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28250c930 0x55e282503ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e1800640 1 -- 172.21.15.7:0/4063911742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 msgr2=0x55e282504430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e1800640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8003630 0x55e282504430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e1800640 1 -- 172.21.15.7:0/4063911742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28250c930 msgr2=0x55e282503ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e1800640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28250c930 0x55e282503ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e1800640 1 -- 172.21.15.7:0/4063911742 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e28246a300 con 0x55e2824898f0 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e0e00640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e28250c930 0x55e282503ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e1800640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2824898f0 0x55e2824fdf60 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f61d4002e30 tx=0x7f61d400c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61da000640 1 -- 172.21.15.7:0/4063911742 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4015020 con 0x55e2824898f0 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61da000640 1 -- 172.21.15.7:0/4063911742 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d4011450 con 0x55e2824898f0 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e282501b30 con 0x55e2824898f0 2024-08-19T00:46:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61da000640 1 -- 172.21.15.7:0/4063911742 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011820 con 0x55e2824898f0 2024-08-19T00:46:07.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.558+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e28250fd80 con 0x55e2824898f0 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.560+0000 7f61da000640 1 -- 172.21.15.7:0/4063911742 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61d4018020 con 0x55e2824898f0 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.561+0000 7f61da000640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61c406a810 0x7f61c406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.561+0000 7f61da000640 1 -- 172.21.15.7:0/4063911742 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7f61d408a520 con 0x55e2824898f0 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.561+0000 7f61e0e00640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61c406a810 0x7f61c406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.561+0000 7f61e4628f40 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e282501fe0 0x55e28250ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.561+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:fe07bba1:::100.00000000.inode:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55e28250f3b0 con 0x55e282501fe0 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.562+0000 7f61e2200640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e282501fe0 0x55e28250ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.562+0000 7f61e0e00640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61c406a810 0x7f61c406ccd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f61d0001ed0 tx=0x7f61d00019c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.562+0000 7f61e2200640 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e282501fe0 0x55e28250ee70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e2200640 1 -- 172.21.15.7:0/4063911742 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 100.00000000.inode [writefull 0~80] v108'277 uv277 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f61dc005040 con 0x55e282501fe0 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e282501fe0 msgr2=0x55e28250ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55e282501fe0 0x55e28250ee70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61c406a810 msgr2=0x7f61c406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61c406a810 0x7f61c406ccd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f61d0001ed0 tx=0x7f61d00019c0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2824898f0 msgr2=0x55e2824fdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 --2- 172.21.15.7:0/4063911742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2824898f0 0x55e2824fdf60 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f61d4002e30 tx=0x7f61d400c620 comp rx=0 tx=0).stop 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e2200640 1 -- 172.21.15.7:0/4063911742 reap_dead start 2024-08-19T00:46:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 shutdown_connections 2024-08-19T00:46:07.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 >> 172.21.15.7:0/4063911742 conn(0x55e28246c4e0 msgr2=0x55e28242b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:07.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 shutdown_connections 2024-08-19T00:46:07.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.565+0000 7f61e4628f40 1 -- 172.21.15.7:0/4063911742 wait complete. 2024-08-19T00:46:07.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:07.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.769+0000 7f092fa00640 1 Processor -- start 2024-08-19T00:46:07.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.770+0000 7f092fa00640 1 -- start start 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.771+0000 7f092fa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f09280731c0 0x7f09280add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.771+0000 7f092fa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09280aeae0 con 0x7f0928158cd0 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.771+0000 7f092fa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09280aedc0 con 0x7f09280ae2b0 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.771+0000 7f092fa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f09280af0a0 con 0x7f09280731c0 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.771+0000 7f092d000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0928158cd0 0x7f0928072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49856/0 (socket says 172.21.15.7:49856) 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.771+0000 7f092d000640 1 -- 172.21.15.7:0/431893837 learned_addr learned my addr 172.21.15.7:0/431893837 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.771+0000 7f0927e00640 1 --2- 172.21.15.7:0/431893837 >> v2:172.21.15.162:3300/0 conn(0x7f09280731c0 0x7f09280add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990067880 0 0) 0x7f09280aeae0 con 0x7f0928158cd0 2024-08-19T00:46:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0910003520 con 0x7f0928158cd0 2024-08-19T00:46:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3496871685 0 0) 0x7f0910003520 con 0x7f0928158cd0 2024-08-19T00:46:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 >> v2:172.21.15.162:3300/0 conn(0x7f09280731c0 msgr2=0x7f09280add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 --2- 172.21.15.7:0/431893837 >> v2:172.21.15.162:3300/0 conn(0x7f09280731c0 0x7f09280add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 >> v1:172.21.15.162:6789/0 conn(0x7f09280ae2b0 legacy=0x7f09280b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09280af380 con 0x7f0928158cd0 2024-08-19T00:46:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f091c001670 con 0x7f0928158cd0 2024-08-19T00:46:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 >> v1:172.21.15.7:6789/0 conn(0x7f0928158cd0 legacy=0x7f0928072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09100039b0 0x7f0910003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0910004800 0x7f0910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100051c0 0x7f091000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09280af0a0 con 0x7f09100039b0 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f091000c110 con 0x7f0910004800 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f091000c310 con 0x7f09100051c0 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f092d000640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09100039b0 0x7f0910003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f092da00640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100051c0 0x7f091000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.772+0000 7f0927e00640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0910004800 0x7f0910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.773+0000 7f092d000640 1 -- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100051c0 msgr2=0x7f091000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.773+0000 7f092d000640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100051c0 0x7f091000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.773+0000 7f092d000640 1 -- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0910004800 msgr2=0x7f0910004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.773+0000 7f092d000640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0910004800 0x7f0910004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.773+0000 7f092da00640 1 -- 172.21.15.7:0/431893837 reap_dead start 2024-08-19T00:46:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.773+0000 7f092d000640 1 -- 172.21.15.7:0/431893837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0910003520 con 0x7f09100039b0 2024-08-19T00:46:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.773+0000 7f0927e00640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0910004800 0x7f0910004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:07.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.774+0000 7f092d000640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09100039b0 0x7f0910003d90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f091c007fd0 tx=0x7f0910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298661db44ec0832 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.774+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c007ca0 con 0x7f09100039b0 2024-08-19T00:46:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.774+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c005af0 con 0x7f09100039b0 2024-08-19T00:46:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.774+0000 7f0927400640 1 -- 172.21.15.7:0/431893837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c007070 con 0x7f09100039b0 2024-08-19T00:46:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.774+0000 7f092fa00640 1 -- 172.21.15.7:0/431893837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09100039b0 msgr2=0x7f0910003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.774+0000 7f092fa00640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09100039b0 0x7f0910003d90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f091c007fd0 tx=0x7f0910005830 comp rx=0 tx=0).stop 2024-08-19T00:46:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.775+0000 7f092fa00640 1 -- 172.21.15.7:0/431893837 shutdown_connections 2024-08-19T00:46:07.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.775+0000 7f092fa00640 1 --2- 172.21.15.7:0/431893837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09100039b0 0x7f0910003d90 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.775+0000 7f092fa00640 1 -- 172.21.15.7:0/431893837 >> 172.21.15.7:0/431893837 conn(0x7f09280b2300 msgr2=0x7f092806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.775+0000 7f092fa00640 1 -- 172.21.15.7:0/431893837 shutdown_connections 2024-08-19T00:46:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.775+0000 7f092fa00640 1 -- 172.21.15.7:0/431893837 wait complete. 2024-08-19T00:46:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.776+0000 7f092fa00640 1 Processor -- start 2024-08-19T00:46:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.776+0000 7f092fa00640 1 -- start start 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.777+0000 7f092fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100039b0 0x7f0928148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.777+0000 7f092fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092809d8a0 0x7f0928153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.777+0000 7f092fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f092809dd00 0x7f0928154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.777+0000 7f092fa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09280add70 con 0x7f092809dd00 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.777+0000 7f092fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f09280ae760 con 0x7f092809d8a0 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.777+0000 7f092fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f09280adef0 con 0x7f09100039b0 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f092809dd00 0x7f0928154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f092809dd00 0x7f0928154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46904/0 (socket says 172.21.15.7:46904) 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 -- 172.21.15.7:0/2372601883 learned_addr learned my addr 172.21.15.7:0/2372601883 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092d000640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100039b0 0x7f0928148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f0927e00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092809d8a0 0x7f0928153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 -- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100039b0 msgr2=0x7f0928148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100039b0 0x7f0928148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 -- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092809d8a0 msgr2=0x7f0928153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092809d8a0 0x7f0928153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 -- 172.21.15.7:0/2372601883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09281552c0 con 0x7f092809dd00 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.778+0000 7f092da00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f092809dd00 0x7f0928154110 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f092000fae0 tx=0x7f0920002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.779+0000 7f0924c00640 1 -- 172.21.15.7:0/2372601883 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092001a070 con 0x7f092809dd00 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.779+0000 7f0924c00640 1 -- 172.21.15.7:0/2372601883 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0920006e20 con 0x7f092809dd00 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.779+0000 7f0924c00640 1 -- 172.21.15.7:0/2372601883 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920003bb0 con 0x7f092809dd00 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.779+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09281555a0 con 0x7f092809dd00 2024-08-19T00:46:07.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.779+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0928155b60 con 0x7f092809dd00 2024-08-19T00:46:07.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.780+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092806c520 con 0x7f092809dd00 2024-08-19T00:46:07.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.781+0000 7f0924c00640 1 -- 172.21.15.7:0/2372601883 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f092001d070 con 0x7f092809dd00 2024-08-19T00:46:07.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.782+0000 7f0924c00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f090806be30 0x7f090806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:07.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.782+0000 7f0924c00640 1 -- 172.21.15.7:0/2372601883 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 7601+0+0 (secure 0 0 0) 0x7f092008acc0 con 0x7f092809dd00 2024-08-19T00:46:07.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.782+0000 7f092d000640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f090806be30 0x7f090806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:07.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.783+0000 7f092d000640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f090806be30 0x7f090806e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f091c032000 tx=0x7f091c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:07.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:07.786+0000 7f0924c00640 1 -- 172.21.15.7:0/2372601883 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f092806c520 con 0x7f092809dd00 2024-08-19T00:46:08.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.011+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f092815ea90 con 0x7f092809dd00 2024-08-19T00:46:08.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.127+0000 7f0924c00640 1 -- 172.21.15.7:0/2372601883 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v219) ==== 162+0+0 (secure 0 0 0) 0x7f0920091080 con 0x7f092809dd00 2024-08-19T00:46:08.130 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.129+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f090806be30 msgr2=0x7f090806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.129+0000 7f092fa00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f090806be30 0x7f090806e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f091c032000 tx=0x7f091c009030 comp rx=0 tx=0).stop 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.129+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f092809dd00 msgr2=0x7f0928154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.129+0000 7f092fa00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f092809dd00 0x7f0928154110 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f092000fae0 tx=0x7f0920002100 comp rx=0 tx=0).stop 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 shutdown_connections 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f090806be30 0x7f090806e2f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f092809dd00 0x7f0928154110 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f092809d8a0 0x7f0928153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 --2- 172.21.15.7:0/2372601883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100039b0 0x7f0928148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 >> 172.21.15.7:0/2372601883 conn(0x7f09280b2300 msgr2=0x7f09280b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 shutdown_connections 2024-08-19T00:46:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.130+0000 7f092fa00640 1 -- 172.21.15.7:0/2372601883 wait complete. 2024-08-19T00:46:08.138 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:08.136+0000 7fa9ad600640 -1 mds.0.cache.ino(0x100) Corrupt inode 0x100: End of buffer [buffer:2] 2024-08-19T00:46:08.138 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:08.136+0000 7fa9ad600640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:46:08.139 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:08.137+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:08.139 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:08.137+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:08.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:08.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.308+0000 7f801b200640 1 Processor -- start 2024-08-19T00:46:08.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.308+0000 7f801b200640 1 -- start start 2024-08-19T00:46:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.309+0000 7f801b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f801c15ee50 0x7f801c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.309+0000 7f801b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801c0b3ab0 con 0x7f801c15e360 2024-08-19T00:46:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.309+0000 7f801b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801c15f460 con 0x7f801c0d3200 2024-08-19T00:46:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.309+0000 7f801b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f801c15f740 con 0x7f801c15ee50 2024-08-19T00:46:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.309+0000 7f8019e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f801c15e360 0x7f801c0d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49872/0 (socket says 172.21.15.7:49872) 2024-08-19T00:46:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.309+0000 7f8019e00640 1 -- 172.21.15.7:0/2328869654 learned_addr learned my addr 172.21.15.7:0/2328869654 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:08.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.309+0000 7f801a800640 1 --2- 172.21.15.7:0/2328869654 >> v2:172.21.15.7:3300/0 conn(0x7f801c15ee50 0x7f801c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.310+0000 7f8018a00640 1 -- 172.21.15.7:0/2328869654 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221314130 0 0) 0x7f801c0b3ab0 con 0x7f801c15e360 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.310+0000 7f8018a00640 1 -- 172.21.15.7:0/2328869654 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8000003520 con 0x7f801c15e360 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.310+0000 7f8018a00640 1 -- 172.21.15.7:0/2328869654 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136056125 0 0) 0x7f801c15f460 con 0x7f801c0d3200 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.310+0000 7f8018a00640 1 -- 172.21.15.7:0/2328869654 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f801c0b3ab0 con 0x7f801c0d3200 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.310+0000 7f801a800640 1 -- 172.21.15.7:0/2328869654 >> v1:172.21.15.162:6789/0 conn(0x7f801c0d3200 legacy=0x7f801c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.310+0000 7f801a800640 1 -- 172.21.15.7:0/2328869654 >> v1:172.21.15.7:6789/0 conn(0x7f801c15e360 legacy=0x7f801c0d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.310+0000 7f801a800640 1 -- 172.21.15.7:0/2328869654 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c0b3d60 con 0x7f801c15ee50 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.311+0000 7f801a800640 1 --2- 172.21.15.7:0/2328869654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15ee50 0x7f801c15fab0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c97180514f82112 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.311+0000 7f8018a00640 1 -- 172.21.15.7:0/2328869654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014007740 con 0x7f801c15ee50 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.311+0000 7f8018a00640 1 -- 172.21.15.7:0/2328869654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80140078e0 con 0x7f801c15ee50 2024-08-19T00:46:08.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.311+0000 7f8018a00640 1 -- 172.21.15.7:0/2328869654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014007cb0 con 0x7f801c15ee50 2024-08-19T00:46:08.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.312+0000 7f801b200640 1 -- 172.21.15.7:0/2328869654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15ee50 msgr2=0x7f801c15fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.312+0000 7f801b200640 1 --2- 172.21.15.7:0/2328869654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15ee50 0x7f801c15fab0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801402a6f0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.312+0000 7f801b200640 1 -- 172.21.15.7:0/2328869654 shutdown_connections 2024-08-19T00:46:08.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.312+0000 7f801b200640 1 --2- 172.21.15.7:0/2328869654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15ee50 0x7f801c15fab0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.312+0000 7f801b200640 1 -- 172.21.15.7:0/2328869654 >> 172.21.15.7:0/2328869654 conn(0x7f801c08dbf0 msgr2=0x7f801c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:08.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.312+0000 7f801b200640 1 -- 172.21.15.7:0/2328869654 shutdown_connections 2024-08-19T00:46:08.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.312+0000 7f801b200640 1 -- 172.21.15.7:0/2328869654 wait complete. 2024-08-19T00:46:08.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.314+0000 7f801b200640 1 Processor -- start 2024-08-19T00:46:08.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.314+0000 7f801b200640 1 -- start start 2024-08-19T00:46:08.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f801b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f801c0d3200 0x7f801c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f801b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15e360 0x7f801c0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f801b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f801c15ee50 0x7f801c14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f801b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f801c0b4560 con 0x7f801c15e360 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f801b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f801c0d2300 con 0x7f801c15ee50 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f801b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f801c0b46e0 con 0x7f801c0d3200 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15e360 0x7f801c0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15e360 0x7f801c0b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46924/0 (socket says 172.21.15.7:46924) 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 -- 172.21.15.7:0/1513658862 learned_addr learned my addr 172.21.15.7:0/1513658862 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f801a800640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f801c15ee50 0x7f801c14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019e00640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f801c0d3200 0x7f801c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 -- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f801c0d3200 msgr2=0x7f801c0b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f801c0d3200 0x7f801c0b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 -- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f801c15ee50 msgr2=0x7f801c14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f801c15ee50 0x7f801c14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.315+0000 7f8019400640 1 -- 172.21.15.7:0/1513658862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c0c80f0 con 0x7f801c15e360 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.316+0000 7f8019400640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15e360 0x7f801c0b2260 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f800800c500 tx=0x7f800800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.316+0000 7f8012000640 1 -- 172.21.15.7:0/1513658862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80080052d0 con 0x7f801c15e360 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.316+0000 7f8012000640 1 -- 172.21.15.7:0/1513658862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8008005490 con 0x7f801c15e360 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.316+0000 7f8012000640 1 -- 172.21.15.7:0/1513658862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008012870 con 0x7f801c15e360 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.316+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801c0c83d0 con 0x7f801c15e360 2024-08-19T00:46:08.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.316+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801c0c8990 con 0x7f801c15e360 2024-08-19T00:46:08.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.317+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f801c15fab0 con 0x7f801c15e360 2024-08-19T00:46:08.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.318+0000 7f8012000640 1 -- 172.21.15.7:0/1513658862 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8008012a10 con 0x7f801c15e360 2024-08-19T00:46:08.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.319+0000 7f8012000640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ffc06be30 0x7f7ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.319+0000 7f8012000640 1 -- 172.21.15.7:0/1513658862 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7f800808b250 con 0x7f801c15e360 2024-08-19T00:46:08.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.319+0000 7f8019e00640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ffc06be30 0x7f7ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.320+0000 7f8019e00640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ffc06be30 0x7f7ffc06e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f800c0011e0 tx=0x7f800c007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.323+0000 7f8012000640 1 -- 172.21.15.7:0/1513658862 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8008058d60 con 0x7f801c15e360 2024-08-19T00:46:08.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.544+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f801c0d50d0 con 0x7f801c15e360 2024-08-19T00:46:08.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.545+0000 7f8012000640 1 -- 172.21.15.7:0/1513658862 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 220 v220) ==== 95+0+3570 (secure 0 0 0) 0x7f800805d060 con 0x7f801c15e360 2024-08-19T00:46:08.548 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:08.548 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":220,"btime":"2024-08-19T00:46:08:138786+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":220,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:08.138707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:08.548 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 220 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ffc06be30 msgr2=0x7f7ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ffc06be30 0x7f7ffc06e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f800c0011e0 tx=0x7f800c007d30 comp rx=0 tx=0).stop 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15e360 msgr2=0x7f801c0b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15e360 0x7f801c0b2260 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f800800c500 tx=0x7f800800c9c0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 shutdown_connections 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7ffc06be30 0x7f7ffc06e2f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f801c15ee50 0x7f801c14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f801c15e360 0x7f801c0b2260 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 --2- 172.21.15.7:0/1513658862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f801c0d3200 0x7f801c0b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 >> 172.21.15.7:0/1513658862 conn(0x7f801c08dbf0 msgr2=0x7f801c0d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:08.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 shutdown_connections 2024-08-19T00:46:08.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.547+0000 7f801b200640 1 -- 172.21.15.7:0/1513658862 wait complete. 2024-08-19T00:46:08.566 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:08.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.720+0000 7f6198200640 1 Processor -- start 2024-08-19T00:46:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.720+0000 7f6198200640 1 -- start start 2024-08-19T00:46:08.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.721+0000 7f6198200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f619015f5b0 0x7f61900cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.721+0000 7f6198200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900cfaf0 con 0x7f61900b4a90 2024-08-19T00:46:08.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.721+0000 7f6198200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900b50b0 con 0x7f61900d03c0 2024-08-19T00:46:08.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.721+0000 7f6198200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f619015f990 con 0x7f619015f5b0 2024-08-19T00:46:08.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f6196200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f61900b4a90 0x7f619006e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49884/0 (socket says 172.21.15.7:49884) 2024-08-19T00:46:08.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f6196200640 1 -- 172.21.15.7:0/879719122 learned_addr learned my addr 172.21.15.7:0/879719122 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:08.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f6195800640 1 --2- 172.21.15.7:0/879719122 >> v2:172.21.15.162:3300/0 conn(0x7f619015f5b0 0x7f61900cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f618fe00640 1 -- 172.21.15.7:0/879719122 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254236147 0 0) 0x7f61900cfaf0 con 0x7f61900b4a90 2024-08-19T00:46:08.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f618fe00640 1 -- 172.21.15.7:0/879719122 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6178003520 con 0x7f61900b4a90 2024-08-19T00:46:08.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f618fe00640 1 -- 172.21.15.7:0/879719122 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743536495 0 0) 0x7f61900b50b0 con 0x7f61900d03c0 2024-08-19T00:46:08.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f618fe00640 1 -- 172.21.15.7:0/879719122 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61900cfaf0 con 0x7f61900d03c0 2024-08-19T00:46:08.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f6195800640 1 -- 172.21.15.7:0/879719122 >> v1:172.21.15.162:6789/0 conn(0x7f61900d03c0 legacy=0x7f61900b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f6195800640 1 -- 172.21.15.7:0/879719122 >> v1:172.21.15.7:6789/0 conn(0x7f61900b4a90 legacy=0x7f619006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.722+0000 7f6195800640 1 -- 172.21.15.7:0/879719122 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900cead0 con 0x7f619015f5b0 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.723+0000 7f6195800640 1 --2- 172.21.15.7:0/879719122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 0x7f61900cf5b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61840097a0 tx=0x7f618402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20681a1f23760e80 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f618fe00640 1 -- 172.21.15.7:0/879719122 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184037070 con 0x7f619015f5b0 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f618fe00640 1 -- 172.21.15.7:0/879719122 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6184032440 con 0x7f619015f5b0 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f618fe00640 1 -- 172.21.15.7:0/879719122 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184032810 con 0x7f619015f5b0 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f6198200640 1 -- 172.21.15.7:0/879719122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 msgr2=0x7f61900cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f6198200640 1 --2- 172.21.15.7:0/879719122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 0x7f61900cf5b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61840097a0 tx=0x7f618402a1a0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f6198200640 1 -- 172.21.15.7:0/879719122 shutdown_connections 2024-08-19T00:46:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f6198200640 1 --2- 172.21.15.7:0/879719122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 0x7f61900cf5b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f6198200640 1 -- 172.21.15.7:0/879719122 >> 172.21.15.7:0/879719122 conn(0x7f619006bc70 msgr2=0x7f619006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f6198200640 1 -- 172.21.15.7:0/879719122 shutdown_connections 2024-08-19T00:46:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.724+0000 7f6198200640 1 -- 172.21.15.7:0/879719122 wait complete. 2024-08-19T00:46:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.726+0000 7f6198200640 1 Processor -- start 2024-08-19T00:46:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.726+0000 7f6198200640 1 -- start start 2024-08-19T00:46:08.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6198200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61900b4a90 0x7f6190157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6198200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61900d03c0 0x7f619015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6198200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 0x7f61900ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6198200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61900d0820 con 0x7f61900d03c0 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6198200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61900cf120 con 0x7f619015f5b0 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6198200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61900d09a0 con 0x7f61900b4a90 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6194e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61900d03c0 0x7f619015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6194e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61900d03c0 0x7f619015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46932/0 (socket says 172.21.15.7:46932) 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6194e00640 1 -- 172.21.15.7:0/89050214 learned_addr learned my addr 172.21.15.7:0/89050214 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6196200640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 0x7f61900ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.727+0000 7f6195800640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61900b4a90 0x7f6190157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6194e00640 1 -- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61900b4a90 msgr2=0x7f6190157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6194e00640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61900b4a90 0x7f6190157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6194e00640 1 -- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 msgr2=0x7f61900ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6194e00640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 0x7f61900ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6194e00640 1 -- 172.21.15.7:0/89050214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900ad090 con 0x7f61900d03c0 2024-08-19T00:46:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6194e00640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61900d03c0 0x7f619015bdc0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c530 tx=0x7f617c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f618d600640 1 -- 172.21.15.7:0/89050214 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c0052d0 con 0x7f61900d03c0 2024-08-19T00:46:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f618d600640 1 -- 172.21.15.7:0/89050214 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c005490 con 0x7f61900d03c0 2024-08-19T00:46:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f618d600640 1 -- 172.21.15.7:0/89050214 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c012870 con 0x7f61900d03c0 2024-08-19T00:46:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61900ad370 con 0x7f61900d03c0 2024-08-19T00:46:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.728+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61900ad930 con 0x7f61900d03c0 2024-08-19T00:46:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.729+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6190068c00 con 0x7f61900d03c0 2024-08-19T00:46:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.730+0000 7f618d600640 1 -- 172.21.15.7:0/89050214 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f617c012a10 con 0x7f61900d03c0 2024-08-19T00:46:08.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.732+0000 7f618d600640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f617006be30 0x7f617006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:08.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.732+0000 7f618d600640 1 -- 172.21.15.7:0/89050214 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7f617c08b1a0 con 0x7f61900d03c0 2024-08-19T00:46:08.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.732+0000 7f6195800640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f617006be30 0x7f617006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:08.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.733+0000 7f6195800640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f617006be30 0x7f617006e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6184034000 tx=0x7f618402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:08.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.736+0000 7f618d600640 1 -- 172.21.15.7:0/89050214 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f617c058cb0 con 0x7f61900d03c0 2024-08-19T00:46:08.910 INFO:tasks.ceph.mds.c.smithi007.stderr: -48> 2024-08-19T00:46:04.153+0000 7f2d07e00640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-08-19T00:46:08.950 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:46:08.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.961+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61900d0cd0 con 0x7f61900d03c0 2024-08-19T00:46:08.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.961+0000 7f618d600640 1 -- 172.21.15.7:0/89050214 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 220 v220) ==== 95+0+3570 (secure 0 0 0) 0x7f617c05cfb0 con 0x7f61900d03c0 2024-08-19T00:46:08.964 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:08.964 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":220,"btime":"2024-08-19T00:46:08:138786+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":220,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:08.138707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:08.965 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 220 2024-08-19T00:46:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f617006be30 msgr2=0x7f617006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f617006be30 0x7f617006e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6184034000 tx=0x7f618402e000 comp rx=0 tx=0).stop 2024-08-19T00:46:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61900d03c0 msgr2=0x7f619015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61900d03c0 0x7f619015bdc0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c530 tx=0x7f617c00c9f0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 shutdown_connections 2024-08-19T00:46:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f617006be30 0x7f617006e2f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f619015f5b0 0x7f61900ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61900d03c0 0x7f619015bdc0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 --2- 172.21.15.7:0/89050214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61900b4a90 0x7f6190157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 >> 172.21.15.7:0/89050214 conn(0x7f619006bc70 msgr2=0x7f6190071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 shutdown_connections 2024-08-19T00:46:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:08.964+0000 7f6198200640 1 -- 172.21.15.7:0/89050214 wait complete. 2024-08-19T00:46:08.982 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:08.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.136+0000 7f962f400640 1 Processor -- start 2024-08-19T00:46:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.136+0000 7f962f400640 1 -- start start 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96280d03c0 0x7f9628071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96280b3750 0x7f96280cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962f400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96280cdfb0 con 0x7f962806e710 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962f400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f96280cebc0 con 0x7f96280d03c0 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962f400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f96280ce290 con 0x7f96280b3750 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96280d03c0 0x7f9628071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96280d03c0 0x7f9628071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46960/0 (socket says 172.21.15.7:46960) 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 -- 172.21.15.7:0/66412693 learned_addr learned my addr 172.21.15.7:0/66412693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962d400640 1 --2- 172.21.15.7:0/66412693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96280b3750 0x7f96280cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 -- 172.21.15.7:0/66412693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96280b3750 msgr2=0x7f96280cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 --2- 172.21.15.7:0/66412693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96280b3750 0x7f96280cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 -- 172.21.15.7:0/66412693 >> v1:172.21.15.162:6789/0 conn(0x7f962806e710 legacy=0x7f96280d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 -- 172.21.15.7:0/66412693 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96280ce570 con 0x7f96280d03c0 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.139+0000 7f962ca00640 1 --2- 172.21.15.7:0/66412693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f9628071980 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f961c0098a0 tx=0x7f961c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2aa51f94d7b82 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f9627400640 1 -- 172.21.15.7:0/66412693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c037070 con 0x7f96280d03c0 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f9627400640 1 -- 172.21.15.7:0/66412693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961c032440 con 0x7f96280d03c0 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f9627400640 1 -- 172.21.15.7:0/66412693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c032810 con 0x7f96280d03c0 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f962f400640 1 -- 172.21.15.7:0/66412693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 msgr2=0x7f9628071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f962f400640 1 --2- 172.21.15.7:0/66412693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f9628071980 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f961c0098a0 tx=0x7f961c02a290 comp rx=0 tx=0).stop 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f962f400640 1 -- 172.21.15.7:0/66412693 shutdown_connections 2024-08-19T00:46:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f962f400640 1 --2- 172.21.15.7:0/66412693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96280b3750 0x7f96280cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f962f400640 1 --2- 172.21.15.7:0/66412693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f9628071980 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.140+0000 7f962f400640 1 -- 172.21.15.7:0/66412693 >> 172.21.15.7:0/66412693 conn(0x7f962806bc70 msgr2=0x7f962806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:09.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.141+0000 7f962f400640 1 -- 172.21.15.7:0/66412693 shutdown_connections 2024-08-19T00:46:09.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.141+0000 7f962f400640 1 -- 172.21.15.7:0/66412693 wait complete. 2024-08-19T00:46:09.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.142+0000 7f962f400640 1 Processor -- start 2024-08-19T00:46:09.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.142+0000 7f962f400640 1 -- start start 2024-08-19T00:46:09.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f962806e710 0x7f962809da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96280b3750 0x7f96281f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f96281f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962f400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9628073c60 con 0x7f96280d03c0 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962f400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9628073ae0 con 0x7f96280b3750 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962f400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f96280b3be0 con 0x7f962806e710 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f96281f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f96281f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46966/0 (socket says 172.21.15.7:46966) 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962d400640 1 -- 172.21.15.7:0/3105143837 learned_addr learned my addr 172.21.15.7:0/3105143837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f9627e00640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96280b3750 0x7f96281f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.143+0000 7f962ca00640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f962806e710 0x7f962809da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f962d400640 1 -- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f962806e710 msgr2=0x7f962809da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f962d400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f962806e710 0x7f962809da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f962d400640 1 -- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96280b3750 msgr2=0x7f96281f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f962d400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96280b3750 0x7f96281f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f962d400640 1 -- 172.21.15.7:0/3105143837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96280cc200 con 0x7f96280d03c0 2024-08-19T00:46:09.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f962d400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f96281f8460 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f962000efc0 tx=0x7f962000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f9624c00640 1 -- 172.21.15.7:0/3105143837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620018020 con 0x7f96280d03c0 2024-08-19T00:46:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f9624c00640 1 -- 172.21.15.7:0/3105143837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9620014480 con 0x7f96280d03c0 2024-08-19T00:46:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96281f89a0 con 0x7f96280d03c0 2024-08-19T00:46:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.144+0000 7f9624c00640 1 -- 172.21.15.7:0/3105143837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620014870 con 0x7f96280d03c0 2024-08-19T00:46:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.145+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96280cb720 con 0x7f96280d03c0 2024-08-19T00:46:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.145+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96280729f0 con 0x7f96280d03c0 2024-08-19T00:46:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.148+0000 7f9624c00640 1 -- 172.21.15.7:0/3105143837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9620005d10 con 0x7f96280d03c0 2024-08-19T00:46:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.148+0000 7f9624c00640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.148+0000 7f9624c00640 1 -- 172.21.15.7:0/3105143837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7f962008c400 con 0x7f96280d03c0 2024-08-19T00:46:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.148+0000 7f962ca00640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.148+0000 7f962ca00640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f960806be30 0x7f960806e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f961c034000 tx=0x7f961c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.153+0000 7f9624c00640 1 -- 172.21.15.7:0/3105143837 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f96280729f0 con 0x7f96280d03c0 2024-08-19T00:46:09.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.375+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9628071980 con 0x7f96280d03c0 2024-08-19T00:46:09.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.375+0000 7f9624c00640 1 -- 172.21.15.7:0/3105143837 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 221 v221) ==== 95+0+4393 (secure 0 0 0) 0x7f9620022030 con 0x7f96280d03c0 2024-08-19T00:46:09.378 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:09.378 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":221,"btime":"2024-08-19T00:46:09:174634+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3804092925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3804092925},{"type":"v1","addr":"172.21.15.7:6836","nonce":3804092925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":221}],"filesystems":[{"mdsmap":{"epoch":220,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:08.138707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:09.379 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 221 2024-08-19T00:46:09.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f960806be30 msgr2=0x7f960806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f960806be30 0x7f960806e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f961c034000 tx=0x7f961c02e000 comp rx=0 tx=0).stop 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 msgr2=0x7f96281f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f96281f8460 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f962000efc0 tx=0x7f962000c490 comp rx=0 tx=0).stop 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 shutdown_connections 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96280d03c0 0x7f96281f8460 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96280b3750 0x7f96281f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 --2- 172.21.15.7:0/3105143837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f962806e710 0x7f962809da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 >> 172.21.15.7:0/3105143837 conn(0x7f962806bc70 msgr2=0x7f962806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 shutdown_connections 2024-08-19T00:46:09.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.378+0000 7f962f400640 1 -- 172.21.15.7:0/3105143837 wait complete. 2024-08-19T00:46:09.396 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 100.00000000.inode' led to DAMAGED state 2024-08-19T00:46:09.396 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 1.00000000.inode' 2024-08-19T00:46:09.396 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:09.396 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:09.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:09.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:09.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:09.433 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:09.507 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:09.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:09.508 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f9230c00640 1 Processor -- start 2024-08-19T00:46:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f9230c00640 1 -- start start 2024-08-19T00:46:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f9230c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 0x7f922c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f9230c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922c0b4df0 con 0x7f922c0d27b0 2024-08-19T00:46:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f9230c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922c0b50d0 con 0x7f922c0b4150 2024-08-19T00:46:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f9230c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f922c0cf1e0 con 0x7f922c15e3e0 2024-08-19T00:46:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f922aa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f922c0d27b0 0x7f922c0d2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49894/0 (socket says 172.21.15.7:49894) 2024-08-19T00:46:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.704+0000 7f922aa00640 1 -- 172.21.15.7:0/845892234 learned_addr learned my addr 172.21.15.7:0/845892234 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922b400640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 0x7f922c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385417441 0 0) 0x7f922c0b4df0 con 0x7f922c0d27b0 2024-08-19T00:46:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9210003520 con 0x7f922c0d27b0 2024-08-19T00:46:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788910549 0 0) 0x7f922c0b50d0 con 0x7f922c0b4150 2024-08-19T00:46:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f922c0b4df0 con 0x7f922c0b4150 2024-08-19T00:46:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3631804657 0 0) 0x7f9210003520 con 0x7f922c0d27b0 2024-08-19T00:46:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 msgr2=0x7f922c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 0x7f922c0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 >> v1:172.21.15.162:6789/0 conn(0x7f922c0b4150 legacy=0x7f922c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c0cf4c0 con 0x7f922c0d27b0 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f9218001670 con 0x7f922c0d27b0 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922b400640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 0x7f922c0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 >> v1:172.21.15.7:6789/0 conn(0x7f922c0d27b0 legacy=0x7f922c0d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210003b70 0x7f9210003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9210004800 0x7f9210004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 0x7f92100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f922c0cf1e0 con 0x7f9210004800 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f921000ba70 con 0x7f9210003b70 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.705+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f921000bc40 con 0x7f922c15e3e0 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922aa00640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9210004800 0x7f9210004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922b400640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210003b70 0x7f9210003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922be00640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 0x7f92100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922aa00640 1 -- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 msgr2=0x7f92100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922aa00640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c15e3e0 0x7f92100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922aa00640 1 -- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210003b70 msgr2=0x7f9210003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922aa00640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210003b70 0x7f9210003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.706+0000 7f922aa00640 1 -- 172.21.15.7:0/845892234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9210003520 con 0x7f9210004800 2024-08-19T00:46:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.707+0000 7f922aa00640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9210004800 0x7f9210004c80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f9218001eb0 tx=0x7f9210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2898e85e7b1c33c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.707+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218007c00 con 0x7f9210004800 2024-08-19T00:46:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.707+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9218005ad0 con 0x7f9210004800 2024-08-19T00:46:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.707+0000 7f922a000640 1 -- 172.21.15.7:0/845892234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218007070 con 0x7f9210004800 2024-08-19T00:46:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.708+0000 7f9230c00640 1 -- 172.21.15.7:0/845892234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9210004800 msgr2=0x7f9210004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.708+0000 7f9230c00640 1 --2- 172.21.15.7:0/845892234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9210004800 0x7f9210004c80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f9218001eb0 tx=0x7f9210005830 comp rx=0 tx=0).stop 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.708+0000 7f922be00640 1 -- 172.21.15.7:0/845892234 reap_dead start 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.708+0000 7f9230c00640 1 -- 172.21.15.7:0/845892234 shutdown_connections 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.708+0000 7f9230c00640 1 -- 172.21.15.7:0/845892234 >> 172.21.15.7:0/845892234 conn(0x7f922c08dbe0 msgr2=0x7f922c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.708+0000 7f9230c00640 1 -- 172.21.15.7:0/845892234 shutdown_connections 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.708+0000 7f9230c00640 1 -- 172.21.15.7:0/845892234 wait complete. 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.711+0000 7f9230c00640 1 Processor -- start 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.711+0000 7f9230c00640 1 -- start start 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210004800 0x7f922c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922c0a1ae0 0x7f922c0b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0cbc80 0x7f922c0b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f922c0b0fe0 con 0x7f922c0a1ae0 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f922c0b0e60 con 0x7f9210004800 2024-08-19T00:46:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f922c0b1160 con 0x7f922c0cbc80 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922c0a1ae0 0x7f922c0b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922c0a1ae0 0x7f922c0b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46994/0 (socket says 172.21.15.7:46994) 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 -- 172.21.15.7:0/1031252802 learned_addr learned my addr 172.21.15.7:0/1031252802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922b400640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210004800 0x7f922c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922be00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0cbc80 0x7f922c0b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 -- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0cbc80 msgr2=0x7f922c0b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0cbc80 0x7f922c0b90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 -- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210004800 msgr2=0x7f922c15aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210004800 0x7f922c15aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 -- 172.21.15.7:0/1031252802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c0a2050 con 0x7f922c0a1ae0 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f922aa00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922c0a1ae0 0x7f922c0b8ba0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f921800c1d0 tx=0x7f9218001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9223400640 1 -- 172.21.15.7:0/1031252802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218043070 con 0x7f922c0a1ae0 2024-08-19T00:46:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9223400640 1 -- 172.21.15.7:0/1031252802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9218038040 con 0x7f922c0a1ae0 2024-08-19T00:46:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9223400640 1 -- 172.21.15.7:0/1031252802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180072b0 con 0x7f922c0a1ae0 2024-08-19T00:46:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c15fa20 con 0x7f922c0a1ae0 2024-08-19T00:46:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.712+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c15ffe0 con 0x7f922c0a1ae0 2024-08-19T00:46:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.713+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c0b45e0 con 0x7f922c0a1ae0 2024-08-19T00:46:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.714+0000 7f9223400640 1 -- 172.21.15.7:0/1031252802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9218007450 con 0x7f922c0a1ae0 2024-08-19T00:46:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.715+0000 7f9223400640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920c06be60 0x7f920c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.715+0000 7f9223400640 1 -- 172.21.15.7:0/1031252802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7f92180ab2d0 con 0x7f922c0a1ae0 2024-08-19T00:46:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.715+0000 7f922b400640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920c06be60 0x7f920c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.716+0000 7f922b400640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920c06be60 0x7f920c06e320 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f922c1f77c0 tx=0x7f921c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:09.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.720+0000 7f9223400640 1 -- 172.21.15.7:0/1031252802 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9218078e60 con 0x7f922c0a1ae0 2024-08-19T00:46:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:09.938+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f922c0b3ba0 con 0x7f922c0a1ae0 2024-08-19T00:46:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.185+0000 7f9223400640 1 -- 172.21.15.7:0/1031252802 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v222) ==== 161+0+0 (secure 0 0 0) 0x7f921807d160 con 0x7f922c0a1ae0 2024-08-19T00:46:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920c06be60 msgr2=0x7f920c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920c06be60 0x7f920c06e320 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f922c1f77c0 tx=0x7f921c009190 comp rx=0 tx=0).stop 2024-08-19T00:46:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922c0a1ae0 msgr2=0x7f922c0b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:10.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922c0a1ae0 0x7f922c0b8ba0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f921800c1d0 tx=0x7f9218001970 comp rx=0 tx=0).stop 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 shutdown_connections 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f920c06be60 0x7f920c06e320 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0cbc80 0x7f922c0b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922c0a1ae0 0x7f922c0b8ba0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 --2- 172.21.15.7:0/1031252802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9210004800 0x7f922c15aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 >> 172.21.15.7:0/1031252802 conn(0x7f922c08dbe0 msgr2=0x7f922c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 shutdown_connections 2024-08-19T00:46:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.188+0000 7f9230c00640 1 -- 172.21.15.7:0/1031252802 wait complete. 2024-08-19T00:46:10.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.363+0000 7ff0bfe00640 1 Processor -- start 2024-08-19T00:46:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.364+0000 7ff0bfe00640 1 -- start start 2024-08-19T00:46:10.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0c006dce0 0x7ff0c00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:10.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bfe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0c00b5450 0x7ff0c015e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:10.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bfe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c00b58e0 con 0x7ff0c006fc10 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bfe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c0162d90 con 0x7ff0c00b5450 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c006d850 con 0x7ff0c006dce0 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0c006fc10 0x7ff0c006fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49896/0 (socket says 172.21.15.7:49896) 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bea00640 1 -- 172.21.15.7:0/980215263 learned_addr learned my addr 172.21.15.7:0/980215263 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0bf400640 1 --2- 172.21.15.7:0/980215263 >> v2:172.21.15.7:3300/0 conn(0x7ff0c00b5450 0x7ff0c015e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0b6000640 1 --2- 172.21.15.7:0/980215263 >> v2:172.21.15.162:3300/0 conn(0x7ff0c006dce0 0x7ff0c00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.365+0000 7ff0be000640 1 -- 172.21.15.7:0/980215263 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467119089 0 0) 0x7ff0b0001110 con 0x7ff0c006fc10 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.366+0000 7ff0be000640 1 -- 172.21.15.7:0/980215263 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0a4003520 con 0x7ff0c006fc10 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.366+0000 7ff0bf400640 1 -- 172.21.15.7:0/980215263 >> v2:172.21.15.162:3300/0 conn(0x7ff0c006dce0 msgr2=0x7ff0c00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.366+0000 7ff0bf400640 1 --2- 172.21.15.7:0/980215263 >> v2:172.21.15.162:3300/0 conn(0x7ff0c006dce0 0x7ff0c00b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.366+0000 7ff0bf400640 1 -- 172.21.15.7:0/980215263 >> v1:172.21.15.7:6789/0 conn(0x7ff0c006fc10 legacy=0x7ff0c006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.366+0000 7ff0bf400640 1 -- 172.21.15.7:0/980215263 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c006cf60 con 0x7ff0c00b5450 2024-08-19T00:46:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.367+0000 7ff0bf400640 1 --2- 172.21.15.7:0/980215263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c015e850 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0072550 tx=0x7ff0b802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8504a409d37e684 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.367+0000 7ff0be000640 1 -- 172.21.15.7:0/980215263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8007740 con 0x7ff0c00b5450 2024-08-19T00:46:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.367+0000 7ff0be000640 1 -- 172.21.15.7:0/980215263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b80078e0 con 0x7ff0c00b5450 2024-08-19T00:46:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.367+0000 7ff0be000640 1 -- 172.21.15.7:0/980215263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8007cb0 con 0x7ff0c00b5450 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.367+0000 7ff0bfe00640 1 -- 172.21.15.7:0/980215263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 msgr2=0x7ff0c015e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.367+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/980215263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c015e850 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0072550 tx=0x7ff0b802a5f0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.368+0000 7ff0bfe00640 1 -- 172.21.15.7:0/980215263 shutdown_connections 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.368+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/980215263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c015e850 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.368+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/980215263 >> v2:172.21.15.162:3300/0 conn(0x7ff0c006dce0 0x7ff0c00b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.368+0000 7ff0bfe00640 1 -- 172.21.15.7:0/980215263 >> 172.21.15.7:0/980215263 conn(0x7ff0c00d1fa0 msgr2=0x7ff0c00d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.368+0000 7ff0bfe00640 1 -- 172.21.15.7:0/980215263 shutdown_connections 2024-08-19T00:46:10.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.368+0000 7ff0bfe00640 1 -- 172.21.15.7:0/980215263 wait complete. 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.369+0000 7ff0bfe00640 1 Processor -- start 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.369+0000 7ff0bfe00640 1 -- start start 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.370+0000 7ff0bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c006dce0 0x7ff0c015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.370+0000 7ff0bfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c006fc10 0x7ff0c00b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.370+0000 7ff0bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c00d1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.370+0000 7ff0bfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c006e120 con 0x7ff0c00b5450 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.370+0000 7ff0bfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c006d4e0 con 0x7ff0c006dce0 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.370+0000 7ff0bfe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c00b5b60 con 0x7ff0c006fc10 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c00d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c00d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47018/0 (socket says 172.21.15.7:47018) 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 -- 172.21.15.7:0/4002907193 learned_addr learned my addr 172.21.15.7:0/4002907193 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bea00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c006dce0 0x7ff0c015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0b6000640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c006fc10 0x7ff0c00b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 -- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c006fc10 msgr2=0x7ff0c00b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c006fc10 0x7ff0c00b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 -- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c006dce0 msgr2=0x7ff0c015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c006dce0 0x7ff0c015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 -- 172.21.15.7:0/4002907193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c00cd310 con 0x7ff0c00b5450 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bea00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c006dce0 0x7ff0c015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0b6000640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c006fc10 0x7ff0c00b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.371+0000 7ff0bf400640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c00d1000 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009e50 tx=0x7ff0b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:10.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.372+0000 7ff0b7400640 1 -- 172.21.15.7:0/4002907193 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8040070 con 0x7ff0c00b5450 2024-08-19T00:46:10.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.372+0000 7ff0b7400640 1 -- 172.21.15.7:0/4002907193 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8031bf0 con 0x7ff0c00b5450 2024-08-19T00:46:10.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.372+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c00cd5f0 con 0x7ff0c00b5450 2024-08-19T00:46:10.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.372+0000 7ff0b7400640 1 -- 172.21.15.7:0/4002907193 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8009450 con 0x7ff0c00b5450 2024-08-19T00:46:10.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.372+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c00cdbb0 con 0x7ff0c00b5450 2024-08-19T00:46:10.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.373+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c0147ee0 con 0x7ff0c00b5450 2024-08-19T00:46:10.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.374+0000 7ff0b7400640 1 -- 172.21.15.7:0/4002907193 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0b8039040 con 0x7ff0c00b5450 2024-08-19T00:46:10.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.375+0000 7ff0b7400640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff09c06be30 0x7ff09c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:10.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.375+0000 7ff0b7400640 1 -- 172.21.15.7:0/4002907193 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7ff0b80acd70 con 0x7ff0c00b5450 2024-08-19T00:46:10.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.375+0000 7ff0bea00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff09c06be30 0x7ff09c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:10.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.376+0000 7ff0bea00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff09c06be30 0x7ff09c06e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0007fd0 tx=0x7ff0b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:10.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.379+0000 7ff0b7400640 1 -- 172.21.15.7:0/4002907193 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff0b807b080 con 0x7ff0c00b5450 2024-08-19T00:46:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:10.632+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7ff0c00b1810 con 0x7ff0c00b5450 2024-08-19T00:46:11.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.187+0000 7ff0b7400640 1 -- 172.21.15.7:0/4002907193 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v223) ==== 101+0+0 (secure 0 0 0) 0x7ff0b807a980 con 0x7ff0c00b5450 2024-08-19T00:46:11.189 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff09c06be30 msgr2=0x7ff09c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff09c06be30 0x7ff09c06e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0007fd0 tx=0x7ff0b0009040 comp rx=0 tx=0).stop 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 msgr2=0x7ff0c00d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c00d1000 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009e50 tx=0x7ff0b8004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 shutdown_connections 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff09c06be30 0x7ff09c06e2f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c00b5450 0x7ff0c00d1000 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c006fc10 0x7ff0c00b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 --2- 172.21.15.7:0/4002907193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c006dce0 0x7ff0c015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 >> 172.21.15.7:0/4002907193 conn(0x7ff0c00d1fa0 msgr2=0x7ff0c0071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 shutdown_connections 2024-08-19T00:46:11.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.190+0000 7ff0bfe00640 1 -- 172.21.15.7:0/4002907193 wait complete. 2024-08-19T00:46:11.209 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:11.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.285+0000 7fb7205c9f40 1 Processor -- start 2024-08-19T00:46:11.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.285+0000 7fb7205c9f40 1 -- start start 2024-08-19T00:46:11.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb7205c9f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f5f40 0x561c6d7f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb7205c9f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f75b0 0x561c6d7f2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb7205c9f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 0x561c6d7f2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb7205c9f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561c6d76bd00 con 0x561c6d7f75b0 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb7205c9f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561c6d76fd40 con 0x561c6d7f7990 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb7205c9f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561c6d89cdc0 con 0x561c6d7f5f40 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f75b0 0x561c6d7f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f75b0 0x561c6d7f2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47036/0 (socket says 172.21.15.7:47036) 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 -- 172.21.15.7:0/458679463 learned_addr learned my addr 172.21.15.7:0/458679463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71d800640 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f5f40 0x561c6d7f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71e200640 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 0x561c6d7f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 -- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f5f40 msgr2=0x561c6d7f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f5f40 0x561c6d7f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 -- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 msgr2=0x561c6d7f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 0x561c6d7f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.286+0000 7fb71ce00640 1 -- 172.21.15.7:0/458679463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6d72d080 con 0x561c6d7f75b0 2024-08-19T00:46:11.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb71ce00640 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f75b0 0x561c6d7f2230 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b240 tx=0x7fb70c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56c450d38a55a39 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb717400640 1 -- 172.21.15.7:0/458679463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c008070 con 0x561c6d7f75b0 2024-08-19T00:46:11.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb717400640 1 -- 172.21.15.7:0/458679463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c00d500 con 0x561c6d7f75b0 2024-08-19T00:46:11.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb717400640 1 -- 172.21.15.7:0/458679463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00d910 con 0x561c6d7f75b0 2024-08-19T00:46:11.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 -- 172.21.15.7:0/458679463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f75b0 msgr2=0x561c6d7f2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f75b0 0x561c6d7f2230 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b240 tx=0x7fb70c00b700 comp rx=0 tx=0).stop 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 -- 172.21.15.7:0/458679463 shutdown_connections 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 0x561c6d7f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f75b0 0x561c6d7f2230 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/458679463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f5f40 0x561c6d7f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 -- 172.21.15.7:0/458679463 >> 172.21.15.7:0/458679463 conn(0x561c6d7f44e0 msgr2=0x561c6d80f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.287+0000 7fb7205c9f40 1 -- 172.21.15.7:0/458679463 shutdown_connections 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.288+0000 7fb7205c9f40 1 -- 172.21.15.7:0/458679463 wait complete. 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.288+0000 7fb7205c9f40 1 Processor -- start 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.288+0000 7fb7205c9f40 1 -- start start 2024-08-19T00:46:11.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb7205c9f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f5f40 0x561c6d890f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb7205c9f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f75b0 0x561c6d8956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb7205c9f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 0x561c6d7f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb7205c9f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561c6d89f2b0 con 0x561c6d7f5f40 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb7205c9f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561c6d89efd0 con 0x561c6d7f7990 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb7205c9f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561c6d89d780 con 0x561c6d7f75b0 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb71d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f5f40 0x561c6d890f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb71d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f5f40 0x561c6d890f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47040/0 (socket says 172.21.15.7:47040) 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.289+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 learned_addr learned my addr 172.21.15.7:0/1960972940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71ce00640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f75b0 0x561c6d8956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f75b0 msgr2=0x561c6d8956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71d800640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561c6d7f75b0 0x561c6d8956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 msgr2=0x561c6d7f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71e200640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 0x561c6d7f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71d800640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c6d7f7990 0x561c6d7f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6d891690 con 0x561c6d7f5f40 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb71d800640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f5f40 0x561c6d890f80 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fb710025c20 tx=0x7fb710002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb716000640 1 -- 172.21.15.7:0/1960972940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710053500 con 0x561c6d7f5f40 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb716000640 1 -- 172.21.15.7:0/1960972940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7100536a0 con 0x561c6d7f5f40 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb716000640 1 -- 172.21.15.7:0/1960972940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710053a50 con 0x561c6d7f5f40 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.290+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c6d891970 con 0x561c6d7f5f40 2024-08-19T00:46:11.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.291+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c6d891f30 con 0x561c6d7f5f40 2024-08-19T00:46:11.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.292+0000 7fb716000640 1 -- 172.21.15.7:0/1960972940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb710053bf0 con 0x561c6d7f5f40 2024-08-19T00:46:11.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.293+0000 7fb716000640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb70006a840 0x7fb70006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.293+0000 7fb716000640 1 -- 172.21.15.7:0/1960972940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7fb7100ce610 con 0x561c6d7f5f40 2024-08-19T00:46:11.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.293+0000 7fb71ce00640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb70006a840 0x7fb70006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.296 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:11.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.294+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x561c6d892730 0x561c6d932610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.294+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d895bf0 con 0x561c6d892730 2024-08-19T00:46:11.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.294+0000 7fb71e200640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x561c6d892730 0x561c6d932610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.294+0000 7fb71ce00640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb70006a840 0x7fb70006cd00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b240 tx=0x7fb70c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.295+0000 7fb71e200640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x561c6d892730 0x561c6d932610 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.297+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v109'691 uv665 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.297+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d8934d0 con 0x561c6d892730 2024-08-19T00:46:11.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.298+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v109'692 uv692 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.298+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d932b50 con 0x561c6d892730 2024-08-19T00:46:11.301 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.300+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v109'693 uv693 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.300+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93f660 con 0x561c6d892730 2024-08-19T00:46:11.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.303+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v109'694 uv694 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.303+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fa00 con 0x561c6d892730 2024-08-19T00:46:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.305+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v109'695 uv695 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.305+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93e650 con 0x561c6d892730 2024-08-19T00:46:11.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.307+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v109'696 uv696 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.307+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93e9f0 con 0x561c6d892730 2024-08-19T00:46:11.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.309+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v109'697 uv671 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.309+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ede0 con 0x561c6d892730 2024-08-19T00:46:11.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.310+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v109'698 uv698 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.310+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ede0 con 0x561c6d892730 2024-08-19T00:46:11.313 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:11.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.312+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v109'699 uv699 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.312+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.313+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v109'700 uv700 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.313+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.315+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v109'701 uv701 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.315+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.316+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v109'702 uv702 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.317+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.318+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v109'703 uv678 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.318+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.319+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v109'704 uv704 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.319+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.322 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.321+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v109'705 uv705 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.321+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.322+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v109'706 uv706 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.322+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.323+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v109'707 uv707 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.323+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93ed90 con 0x561c6d892730 2024-08-19T00:46:11.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.325+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v109'708 uv708 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.325+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.326+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v109'709 uv709 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.326+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.327+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v109'710 uv684 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.327+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.329+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v109'711 uv711 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.329+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.331 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.330+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v109'712 uv712 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.330+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d940db0 con 0x561c6d892730 2024-08-19T00:46:11.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.331+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v109'713 uv713 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.331+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d940db0 con 0x561c6d892730 2024-08-19T00:46:11.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.333+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v109'714 uv714 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.333+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.334+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v109'715 uv715 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.334+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.335+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v109'716 uv690 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.335+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.337+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v109'717 uv717 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.337+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.340 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.338+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v109'718 uv718 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.338+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d940db0 con 0x561c6d892730 2024-08-19T00:46:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.340+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v109'719 uv719 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.340+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d940db0 con 0x561c6d892730 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.341+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v109'720 uv720 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.341+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d93fda0 con 0x561c6d892730 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.343+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v109'721 uv721 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.343+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x561c6d9402b0 0x561c6d9426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.343+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d942be0 con 0x561c6d9402b0 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.343+0000 7fb71d800640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x561c6d9402b0 0x561c6d9426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.343+0000 7fb71d800640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x561c6d9402b0 0x561c6d9426a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.345+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v109'505 uv488 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.345+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d942f80 con 0x561c6d9402b0 2024-08-19T00:46:11.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.347+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v109'506 uv506 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.347+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d943320 con 0x561c6d9402b0 2024-08-19T00:46:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.348+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v109'507 uv507 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.350 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:11.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.348+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d7f3d20 con 0x561c6d9402b0 2024-08-19T00:46:11.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.350+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v109'508 uv508 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.350+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d943b70 con 0x561c6d9402b0 2024-08-19T00:46:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.351+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v109'509 uv509 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.351+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d943f60 con 0x561c6d9402b0 2024-08-19T00:46:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.353+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v109'510 uv493 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.353+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.354+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v109'511 uv511 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.354+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.355+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v109'512 uv512 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.357 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.355+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.357+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v109'513 uv513 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.357+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.359+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v109'514 uv514 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.359+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.360+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v109'515 uv498 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.360+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.362+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v109'516 uv516 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.362+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.364 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:11.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.363+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v109'517 uv517 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.363+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.365+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v109'518 uv518 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.365+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.366+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v109'519 uv519 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.366+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.368+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v109'520 uv504 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.368+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.369+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v109'521 uv521 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.369+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.370+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v109'522 uv522 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.372 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.370+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.372+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v109'523 uv523 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.372+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d9402b0 2024-08-19T00:46:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.373+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v109'524 uv524 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.373+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944760 con 0x561c6d9402b0 2024-08-19T00:46:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.375+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v109'525 uv525 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d9402b0 2024-08-19T00:46:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.375+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x561c6d945060 0x561c6d947450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.375+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d944350 con 0x561c6d945060 2024-08-19T00:46:11.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.375+0000 7fb71ce00640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x561c6d945060 0x561c6d947450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.376+0000 7fb71ce00640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x561c6d945060 0x561c6d947450 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.377+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v109'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.377+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d9479f0 con 0x561c6d945060 2024-08-19T00:46:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.378+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v109'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.378+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d947ed0 con 0x561c6d945060 2024-08-19T00:46:11.381 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.379+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v109'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.380+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d949780 con 0x561c6d945060 2024-08-19T00:46:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.381+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v109'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.381+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d949b20 con 0x561c6d945060 2024-08-19T00:46:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.383+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v109'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.383+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948770 con 0x561c6d945060 2024-08-19T00:46:11.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.384+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v109'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.384+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948b80 con 0x561c6d892730 2024-08-19T00:46:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.385+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v109'100 uv99 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.385+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948b80 con 0x561c6d892730 2024-08-19T00:46:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.387+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v109'101 uv101 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.387+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948b80 con 0x561c6d892730 2024-08-19T00:46:11.389 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:11.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.388+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v109'102 uv102 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.388+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948b80 con 0x561c6d892730 2024-08-19T00:46:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.390+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v109'103 uv103 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.390+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x561c6d949ec0 0x561c6d94c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.390+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948b80 con 0x561c6d949ec0 2024-08-19T00:46:11.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.390+0000 7fb71e200640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x561c6d949ec0 0x561c6d94c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.391+0000 7fb71e200640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x561c6d949ec0 0x561c6d94c2b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.392+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v109'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.392+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948b80 con 0x561c6d949ec0 2024-08-19T00:46:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.393+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v109'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.393+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948b80 con 0x561c6d949ec0 2024-08-19T00:46:11.396 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.394+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v109'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.394+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94d800 con 0x561c6d949ec0 2024-08-19T00:46:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.395+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v109'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.395+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94d800 con 0x561c6d949ec0 2024-08-19T00:46:11.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.396+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v109'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.397+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94c7f0 con 0x561c6d949ec0 2024-08-19T00:46:11.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.398+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v109'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.398+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x561c6d94cd00 0x561c6d94f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.398+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94f710 con 0x561c6d94cd00 2024-08-19T00:46:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.398+0000 7fb71d800640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x561c6d94cd00 0x561c6d94f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.399+0000 7fb71d800640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x561c6d94cd00 0x561c6d94f0f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.400+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v109'249 uv243 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.400+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.401+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v109'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.401+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.404 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.403+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v109'251 uv251 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.403+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d950af0 con 0x561c6d94cd00 2024-08-19T00:46:11.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.404+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v109'252 uv252 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.404+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d950af0 con 0x561c6d94cd00 2024-08-19T00:46:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.406+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v109'253 uv253 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.406+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.407+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v109'254 uv254 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.407+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.408+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v109'255 uv248 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.408+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.410+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v109'256 uv256 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.410+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.411+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v109'257 uv257 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.413 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:11.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.411+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.412+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v109'258 uv258 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.412+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d94fae0 con 0x561c6d94cd00 2024-08-19T00:46:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.414+0000 7fb71d800640 1 -- 172.21.15.7:0/1960972940 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v109'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71006e020 con 0x561c6d94cd00 2024-08-19T00:46:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.414+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561c6d950160 0x561c6d952570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.414+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d952c30 con 0x561c6d950160 2024-08-19T00:46:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.414+0000 7fb71ce00640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561c6d950160 0x561c6d952570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.415+0000 7fb71ce00640 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561c6d950160 0x561c6d952570 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.416+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v109'112 uv111 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.416+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d952c30 con 0x561c6d950160 2024-08-19T00:46:11.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.417+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v109'113 uv113 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.417+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d950160 2024-08-19T00:46:11.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.419+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v109'114 uv114 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.420 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:11.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.419+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d950160 2024-08-19T00:46:11.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.420+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v109'115 uv115 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.420+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d950160 2024-08-19T00:46:11.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.421+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v109'116 uv116 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.421+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d892730 2024-08-19T00:46:11.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.422+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v109'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.422+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d892730 2024-08-19T00:46:11.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.424+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v109'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.424+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d892730 2024-08-19T00:46:11.427 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:11.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.426+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v109'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.426+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d954090 con 0x561c6d892730 2024-08-19T00:46:11.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.427+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v109'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.427+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d954090 con 0x561c6d892730 2024-08-19T00:46:11.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.429+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v109'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.429+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d892730 2024-08-19T00:46:11.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.430+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v109'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d892730 2024-08-19T00:46:11.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.430+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d945060 2024-08-19T00:46:11.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.431+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v109'223 uv217 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.432+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d945060 2024-08-19T00:46:11.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.433+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v109'224 uv224 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.433+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953080 con 0x561c6d945060 2024-08-19T00:46:11.436 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:11.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.435+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v109'225 uv225 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.435+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948360 con 0x561c6d945060 2024-08-19T00:46:11.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.436+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v109'226 uv226 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.436+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948360 con 0x561c6d945060 2024-08-19T00:46:11.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.438+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v109'227 uv227 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.438+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948360 con 0x561c6d945060 2024-08-19T00:46:11.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.439+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v109'228 uv222 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.439+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948360 con 0x561c6d945060 2024-08-19T00:46:11.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.441+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v109'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.441+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948360 con 0x561c6d945060 2024-08-19T00:46:11.444 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:11.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.442+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v109'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.442+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d948360 con 0x561c6d945060 2024-08-19T00:46:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.444+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v109'231 uv231 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.444+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d955ed0 con 0x561c6d945060 2024-08-19T00:46:11.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.446+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v109'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d945060 2024-08-19T00:46:11.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.446+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.449+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v109'99 uv98 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.449+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.451+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v109'100 uv100 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.451+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.454 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:11.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.453+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v109'101 uv101 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.453+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.454+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v109'102 uv102 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.454+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.457+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v109'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.457+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.458+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v109'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.458+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.459+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v109'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.461 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:11.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.459+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d954540 con 0x561c6d949ec0 2024-08-19T00:46:11.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.461+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v109'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.461+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d954540 con 0x561c6d949ec0 2024-08-19T00:46:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.462+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v109'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.462+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d949ec0 2024-08-19T00:46:11.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.464+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v109'140 uv140 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb71800e1d0 con 0x561c6d949ec0 2024-08-19T00:46:11.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.464+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.465+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v109'115 uv114 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.465+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.466+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v109'116 uv116 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.466+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.469 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.468+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v109'117 uv117 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.468+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.469+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v109'118 uv118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.469+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.470+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v109'119 uv119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.471+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.472+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v109'278 uv277 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.472+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.474+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v109'279 uv279 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.474+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.476 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.475+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v109'280 uv280 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.475+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.476+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v109'281 uv281 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.476+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.478+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v109'282 uv282 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.478+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.479+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v109'283 uv276 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.479+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.480+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v109'284 uv284 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.480+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.483 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.482+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v109'285 uv285 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.482+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.483+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v109'286 uv286 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.483+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d954540 con 0x561c6d950160 2024-08-19T00:46:11.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.484+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v109'287 uv287 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.484+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953530 con 0x561c6d950160 2024-08-19T00:46:11.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.486+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v109'288 uv288 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.486+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x561c6d953da0 con 0x561c6d950160 2024-08-19T00:46:11.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb71ce00640 1 -- 172.21.15.7:0/1960972940 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v109'289 uv289 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb70c00db70 con 0x561c6d950160 2024-08-19T00:46:11.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x561c6d9402b0 msgr2=0x561c6d9426a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x561c6d9402b0 0x561c6d9426a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x561c6d94cd00 msgr2=0x561c6d94f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x561c6d94cd00 0x561c6d94f0f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561c6d950160 msgr2=0x561c6d952570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561c6d950160 0x561c6d952570 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x561c6d945060 msgr2=0x561c6d947450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x561c6d945060 0x561c6d947450 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x561c6d892730 msgr2=0x561c6d932610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x561c6d892730 0x561c6d932610 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb71e200640 1 -- 172.21.15.7:0/1960972940 reap_dead start 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x561c6d949ec0 msgr2=0x561c6d94c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x561c6d949ec0 0x561c6d94c2b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb70006a840 msgr2=0x7fb70006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb70006a840 0x7fb70006cd00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b240 tx=0x7fb70c009000 comp rx=0 tx=0).stop 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f5f40 msgr2=0x561c6d890f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f5f40 0x561c6d890f80 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fb710025c20 tx=0x7fb710002fb0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 shutdown_connections 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x561c6d892730 0x561c6d932610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb70006a840 0x7fb70006cd00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x561c6d949ec0 0x561c6d94c2b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 --2- 172.21.15.7:0/1960972940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c6d7f5f40 0x561c6d890f80 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.487+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 >> 172.21.15.7:0/1960972940 conn(0x561c6d7f44e0 msgr2=0x561c6d80fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.488+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 shutdown_connections 2024-08-19T00:46:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.488+0000 7fb7205c9f40 1 -- 172.21.15.7:0/1960972940 wait complete. 2024-08-19T00:46:11.494 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 1.00000000.inode 0 2024-08-19T00:46:11.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.611+0000 7fcf29492f40 1 Processor -- start 2024-08-19T00:46:11.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.611+0000 7fcf29492f40 1 -- start start 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.611+0000 7fcf29492f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b7ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.611+0000 7fcf29492f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae3990 0x55ecf1ade890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf29492f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1afb8d0 0x55ecf1ae25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf29492f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1b890a0 con 0x55ecf1ae35b0 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf29492f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1b88dc0 con 0x55ecf1ae3990 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf29492f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ecf1b89380 con 0x55ecf1afb8d0 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b7ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b7ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47064/0 (socket says 172.21.15.7:47064) 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 -- 172.21.15.7:0/1215060752 learned_addr learned my addr 172.21.15.7:0/1215060752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf25c00640 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae3990 0x55ecf1ade890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf27000640 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1afb8d0 0x55ecf1ae25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 -- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1afb8d0 msgr2=0x55ecf1ae25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1afb8d0 0x55ecf1ae25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 -- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae3990 msgr2=0x55ecf1ade890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae3990 0x55ecf1ade890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 -- 172.21.15.7:0/1215060752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf19e6130 con 0x55ecf1ae35b0 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.612+0000 7fcf26600640 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b7ae10 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800a770 tx=0x7fcf1800a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b8cbb7a5aa7ed1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf1fe00640 1 -- 172.21.15.7:0/1215060752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18019070 con 0x55ecf1ae35b0 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf1fe00640 1 -- 172.21.15.7:0/1215060752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf18007600 con 0x55ecf1ae35b0 2024-08-19T00:46:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf1fe00640 1 -- 172.21.15.7:0/1215060752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf180079d0 con 0x55ecf1ae35b0 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 -- 172.21.15.7:0/1215060752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1ae35b0 msgr2=0x55ecf1b7ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b7ae10 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800a770 tx=0x7fcf1800a860 comp rx=0 tx=0).stop 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 -- 172.21.15.7:0/1215060752 shutdown_connections 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1afb8d0 0x55ecf1ae25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae3990 0x55ecf1ade890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 --2- 172.21.15.7:0/1215060752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b7ae10 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 -- 172.21.15.7:0/1215060752 >> 172.21.15.7:0/1215060752 conn(0x55ecf1ae04e0 msgr2=0x55ecf1ab1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 -- 172.21.15.7:0/1215060752 shutdown_connections 2024-08-19T00:46:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.613+0000 7fcf29492f40 1 -- 172.21.15.7:0/1215060752 wait complete. 2024-08-19T00:46:11.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.614+0000 7fcf29492f40 1 Processor -- start 2024-08-19T00:46:11.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.614+0000 7fcf29492f40 1 -- start start 2024-08-19T00:46:11.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf29492f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b88050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf29492f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1ae3990 0x55ecf1b7b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf29492f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1afb8d0 0x55ecf1b7ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf29492f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1b8b820 con 0x55ecf1afb8d0 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf29492f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ecf1b8aff0 con 0x55ecf1ae35b0 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf29492f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ecf1b8b260 con 0x55ecf1ae3990 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf27000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1afb8d0 0x55ecf1b7ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf27000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1afb8d0 0x55ecf1b7ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47080/0 (socket says 172.21.15.7:47080) 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf26600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b88050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf27000640 1 -- 172.21.15.7:0/3104071956 learned_addr learned my addr 172.21.15.7:0/3104071956 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.615+0000 7fcf25c00640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1ae3990 0x55ecf1b7b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf26600640 1 -- 172.21.15.7:0/3104071956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1ae3990 msgr2=0x55ecf1b7b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf26600640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ecf1ae3990 0x55ecf1b7b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf26600640 1 -- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1afb8d0 msgr2=0x55ecf1b7ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf26600640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf1afb8d0 0x55ecf1b7ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf26600640 1 -- 172.21.15.7:0/3104071956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf19dcb30 con 0x55ecf1ae35b0 2024-08-19T00:46:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf26600640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b88050 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800a770 tx=0x7fcf18003020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf1ea00640 1 -- 172.21.15.7:0/3104071956 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18019040 con 0x55ecf1ae35b0 2024-08-19T00:46:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf1ea00640 1 -- 172.21.15.7:0/3104071956 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf18014470 con 0x55ecf1ae35b0 2024-08-19T00:46:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf1ea00640 1 -- 172.21.15.7:0/3104071956 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18007e60 con 0x55ecf1ae35b0 2024-08-19T00:46:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.616+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecf1a19080 con 0x55ecf1ae35b0 2024-08-19T00:46:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.617+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf1adf7f0 con 0x55ecf1ae35b0 2024-08-19T00:46:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.619+0000 7fcf1ea00640 1 -- 172.21.15.7:0/3104071956 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf18014860 con 0x55ecf1ae35b0 2024-08-19T00:46:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.619+0000 7fcf1ea00640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf0806a810 0x7fcf0806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.619+0000 7fcf1ea00640 1 -- 172.21.15.7:0/3104071956 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7fcf1808b6e0 con 0x55ecf1ae35b0 2024-08-19T00:46:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.620+0000 7fcf25c00640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf0806a810 0x7fcf0806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.620+0000 7fcf29492f40 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ecf1b88590 0x55ecf1c22660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.620+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) -- 0x55ecf1ae2e00 con 0x55ecf1b88590 2024-08-19T00:46:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.620+0000 7fcf27000640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ecf1b88590 0x55ecf1c22660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.620+0000 7fcf25c00640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf0806a810 0x7fcf0806ccd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55ecf1b7a830 tx=0x7fcf14005b30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.621+0000 7fcf27000640 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ecf1b88590 0x55ecf1c22660 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf27000640 1 -- 172.21.15.7:0/3104071956 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 1.00000000.inode [truncate 0] v109'526 uv526 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcf20051800 con 0x55ecf1b88590 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ecf1b88590 msgr2=0x55ecf1c22660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55ecf1b88590 0x55ecf1c22660 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf0806a810 msgr2=0x7fcf0806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcf0806a810 0x7fcf0806ccd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55ecf1b7a830 tx=0x7fcf14005b30 comp rx=0 tx=0).stop 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae35b0 msgr2=0x55ecf1b88050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 --2- 172.21.15.7:0/3104071956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecf1ae35b0 0x55ecf1b88050 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800a770 tx=0x7fcf18003020 comp rx=0 tx=0).stop 2024-08-19T00:46:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf27000640 1 -- 172.21.15.7:0/3104071956 reap_dead start 2024-08-19T00:46:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 shutdown_connections 2024-08-19T00:46:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 >> 172.21.15.7:0/3104071956 conn(0x55ecf1ae04e0 msgr2=0x55ecf1ab1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 shutdown_connections 2024-08-19T00:46:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.622+0000 7fcf29492f40 1 -- 172.21.15.7:0/3104071956 wait complete. 2024-08-19T00:46:11.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.787+0000 7fbaaee00640 1 Processor -- start 2024-08-19T00:46:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.787+0000 7fbaaee00640 1 -- start start 2024-08-19T00:46:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.788+0000 7fbaaee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa815bfb0 0x7fbaa80b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.788+0000 7fbaaee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbaa815c390 0x7fbaa8072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.788+0000 7fbaaee00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa80acef0 con 0x7fbaa80b5130 2024-08-19T00:46:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.788+0000 7fbaaee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa80ad790 con 0x7fbaa815c390 2024-08-19T00:46:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.788+0000 7fbaaee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa80ad1d0 con 0x7fbaa815bfb0 2024-08-19T00:46:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.788+0000 7fba9fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbaa80b5130 0x7fbaa80aebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49906/0 (socket says 172.21.15.7:49906) 2024-08-19T00:46:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.788+0000 7fba9fe00640 1 -- 172.21.15.7:0/1806699478 learned_addr learned my addr 172.21.15.7:0/1806699478 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaace00640 1 --2- 172.21.15.7:0/1806699478 >> v2:172.21.15.162:3300/0 conn(0x7fbaa815c390 0x7fbaa8072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaa7e00640 1 --2- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa815bfb0 0x7fbaa80b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaa7400640 1 -- 172.21.15.7:0/1806699478 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873143555 0 0) 0x7fbaa80acef0 con 0x7fbaa80b5130 2024-08-19T00:46:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaa7400640 1 -- 172.21.15.7:0/1806699478 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba8c003520 con 0x7fbaa80b5130 2024-08-19T00:46:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaa7400640 1 -- 172.21.15.7:0/1806699478 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4095486350 0 0) 0x7fba8c003520 con 0x7fbaa80b5130 2024-08-19T00:46:11.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaace00640 1 -- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa815bfb0 msgr2=0x7fbaa80b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:11.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaace00640 1 --2- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa815bfb0 0x7fbaa80b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaace00640 1 -- 172.21.15.7:0/1806699478 >> v1:172.21.15.7:6789/0 conn(0x7fbaa80b5130 legacy=0x7fbaa80aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.789+0000 7fbaace00640 1 -- 172.21.15.7:0/1806699478 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa80ad4b0 con 0x7fbaa815c390 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.790+0000 7fbaace00640 1 --2- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815c390 0x7fbaa8072040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009d90 tx=0x7fbaa002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff31c7803da01e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.790+0000 7fbaa7400640 1 -- 172.21.15.7:0/1806699478 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90001670 con 0x7fbaa815c390 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.790+0000 7fbaa7400640 1 -- 172.21.15.7:0/1806699478 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0007540 con 0x7fbaa815c390 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.790+0000 7fbaa7400640 1 -- 172.21.15.7:0/1806699478 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0007910 con 0x7fbaa815c390 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 -- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815c390 msgr2=0x7fbaa8072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815c390 0x7fbaa8072040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009d90 tx=0x7fbaa002a5f0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 -- 172.21.15.7:0/1806699478 shutdown_connections 2024-08-19T00:46:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815c390 0x7fbaa8072040 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1806699478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa815bfb0 0x7fbaa80b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 -- 172.21.15.7:0/1806699478 >> 172.21.15.7:0/1806699478 conn(0x7fbaa80b2300 msgr2=0x7fbaa806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 -- 172.21.15.7:0/1806699478 shutdown_connections 2024-08-19T00:46:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.791+0000 7fbaaee00640 1 -- 172.21.15.7:0/1806699478 wait complete. 2024-08-19T00:46:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.793+0000 7fbaaee00640 1 Processor -- start 2024-08-19T00:46:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.793+0000 7fbaaee00640 1 -- start start 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaaee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa80b5130 0x7fbaa815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaaee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815bfb0 0x7fbaa806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaaee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaa815c390 0x7fbaa815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaaee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80b44c0 con 0x7fbaa815c390 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaaee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80b4340 con 0x7fbaa815bfb0 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaaee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa80af2e0 con 0x7fbaa80b5130 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaace00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaa815c390 0x7fbaa815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaace00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaa815c390 0x7fbaa815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47090/0 (socket says 172.21.15.7:47090) 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaace00640 1 -- 172.21.15.7:0/1921033841 learned_addr learned my addr 172.21.15.7:0/1921033841 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fbaa7e00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa80b5130 0x7fbaa815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.794+0000 7fba9fe00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815bfb0 0x7fbaa806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaace00640 1 -- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa80b5130 msgr2=0x7fbaa815e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaace00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa80b5130 0x7fbaa815e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaace00640 1 -- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815bfb0 msgr2=0x7fbaa806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaace00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815bfb0 0x7fbaa806d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaace00640 1 -- 172.21.15.7:0/1921033841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa806f200 con 0x7fbaa815c390 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaa7e00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa80b5130 0x7fbaa815e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaace00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaa815c390 0x7fbaa815f1a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009d90 tx=0x7fbaa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaa4c00640 1 -- 172.21.15.7:0/1921033841 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa003f070 con 0x7fbaa815c390 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaa4c00640 1 -- 172.21.15.7:0/1921033841 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0031b40 con 0x7fbaa815c390 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaa4c00640 1 -- 172.21.15.7:0/1921033841 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0009450 con 0x7fbaa815c390 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa806e160 con 0x7fbaa815c390 2024-08-19T00:46:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.795+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa806e720 con 0x7fbaa815c390 2024-08-19T00:46:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.796+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa80b3e00 con 0x7fbaa815c390 2024-08-19T00:46:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.797+0000 7fbaa4c00640 1 -- 172.21.15.7:0/1921033841 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaa003b410 con 0x7fbaa815c390 2024-08-19T00:46:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.798+0000 7fbaa4c00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406be30 0x7fba8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.798+0000 7fbaa4c00640 1 -- 172.21.15.7:0/1921033841 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 7687+0+0 (secure 0 0 0) 0x7fbaa00ac8c0 con 0x7fbaa815c390 2024-08-19T00:46:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.798+0000 7fbaa7e00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406be30 0x7fba8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.799+0000 7fbaa7e00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406be30 0x7fba8406e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fba98009f30 tx=0x7fba98009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:11.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:11.802+0000 7fbaa4c00640 1 -- 172.21.15.7:0/1921033841 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbaa007a3c0 con 0x7fbaa815c390 2024-08-19T00:46:12.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.022+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fbaa815b3e0 con 0x7fbaa815c390 2024-08-19T00:46:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.193+0000 7fbaa4c00640 1 -- 172.21.15.7:0/1921033841 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v224) ==== 162+0+0 (secure 0 0 0) 0x7fbaa007e6c0 con 0x7fbaa815c390 2024-08-19T00:46:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406be30 msgr2=0x7fba8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406be30 0x7fba8406e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fba98009f30 tx=0x7fba98009190 comp rx=0 tx=0).stop 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaa815c390 msgr2=0x7fbaa815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaa815c390 0x7fbaa815f1a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009d90 tx=0x7fbaa0004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 shutdown_connections 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406be30 0x7fba8406e2f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaa815c390 0x7fbaa815f1a0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa815bfb0 0x7fbaa806d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 --2- 172.21.15.7:0/1921033841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa80b5130 0x7fbaa815e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 >> 172.21.15.7:0/1921033841 conn(0x7fbaa80b2300 msgr2=0x7fbaa8156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 shutdown_connections 2024-08-19T00:46:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.197+0000 7fbaaee00640 1 -- 172.21.15.7:0/1921033841 wait complete. 2024-08-19T00:46:12.208 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:46:12.207+0000 7f8da6000640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-08-19T00:46:12.209 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:46:12.207+0000 7f8da6000640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:46:12.209 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:12.208+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:12.209 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:12.208+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:12.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:12.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.375+0000 7f5d23c00640 1 Processor -- start 2024-08-19T00:46:12.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.375+0000 7f5d23c00640 1 -- start start 2024-08-19T00:46:12.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.376+0000 7f5d23c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d1c159bf0 0x7f5d1c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.376+0000 7f5d23c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.376+0000 7f5d23c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d1c06f7f0 con 0x7f5d1c0cea40 2024-08-19T00:46:12.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.376+0000 7f5d23c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5d1c06f510 con 0x7f5d1c159bf0 2024-08-19T00:46:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.376+0000 7f5d23c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c072980 con 0x7f5d1c0739a0 2024-08-19T00:46:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d21c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5d1c0cea40 0x7f5d1c0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49912/0 (socket says 172.21.15.7:49912) 2024-08-19T00:46:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d21c00640 1 -- 172.21.15.7:0/360276243 learned_addr learned my addr 172.21.15.7:0/360276243 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d1be00640 1 --2- 172.21.15.7:0/360276243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d21200640 1 --2- 172.21.15.7:0/360276243 >> v2:172.21.15.162:3300/0 conn(0x7f5d1c159bf0 0x7f5d1c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d1b400640 1 -- 172.21.15.7:0/360276243 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760144136 0 0) 0x7f5d1c06f7f0 con 0x7f5d1c0cea40 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d1b400640 1 -- 172.21.15.7:0/360276243 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d04003520 con 0x7f5d1c0cea40 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d1be00640 1 -- 172.21.15.7:0/360276243 >> v2:172.21.15.162:3300/0 conn(0x7f5d1c159bf0 msgr2=0x7f5d1c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d1be00640 1 --2- 172.21.15.7:0/360276243 >> v2:172.21.15.162:3300/0 conn(0x7f5d1c159bf0 0x7f5d1c073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d1be00640 1 -- 172.21.15.7:0/360276243 >> v1:172.21.15.7:6789/0 conn(0x7f5d1c0cea40 legacy=0x7f5d1c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d1be00640 1 -- 172.21.15.7:0/360276243 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c072c60 con 0x7f5d1c0739a0 2024-08-19T00:46:12.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.377+0000 7f5d21200640 1 --2- 172.21.15.7:0/360276243 >> v2:172.21.15.162:3300/0 conn(0x7f5d1c159bf0 0x7f5d1c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.379+0000 7f5d1be00640 1 --2- 172.21.15.7:0/360276243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c0ce500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d080097a0 tx=0x7f5d0802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ac0c9af0325e64 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.379+0000 7f5d1b400640 1 -- 172.21.15.7:0/360276243 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08037070 con 0x7f5d1c0739a0 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.379+0000 7f5d1b400640 1 -- 172.21.15.7:0/360276243 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d0802ae50 con 0x7f5d1c0739a0 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.379+0000 7f5d1b400640 1 -- 172.21.15.7:0/360276243 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08032660 con 0x7f5d1c0739a0 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 -- 172.21.15.7:0/360276243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 msgr2=0x7f5d1c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 --2- 172.21.15.7:0/360276243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c0ce500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d080097a0 tx=0x7f5d0802a100 comp rx=0 tx=0).stop 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 -- 172.21.15.7:0/360276243 shutdown_connections 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 --2- 172.21.15.7:0/360276243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c0ce500 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 --2- 172.21.15.7:0/360276243 >> v2:172.21.15.162:3300/0 conn(0x7f5d1c159bf0 0x7f5d1c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 -- 172.21.15.7:0/360276243 >> 172.21.15.7:0/360276243 conn(0x7f5d1c06bc70 msgr2=0x7f5d1c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 -- 172.21.15.7:0/360276243 shutdown_connections 2024-08-19T00:46:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.380+0000 7f5d23c00640 1 -- 172.21.15.7:0/360276243 wait complete. 2024-08-19T00:46:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.382+0000 7f5d23c00640 1 Processor -- start 2024-08-19T00:46:12.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.382+0000 7f5d23c00640 1 -- start start 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d23c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d23c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c0cea40 0x7f5d1c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d23c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c159bf0 0x7f5d1c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d23c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c15a150 con 0x7f5d1c0cea40 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d23c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c159fd0 con 0x7f5d1c159bf0 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d23c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c0d0ad0 con 0x7f5d1c0739a0 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c0cea40 0x7f5d1c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c0cea40 0x7f5d1c15b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47100/0 (socket says 172.21.15.7:47100) 2024-08-19T00:46:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 -- 172.21.15.7:0/2442975582 learned_addr learned my addr 172.21.15.7:0/2442975582 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d21c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c159bf0 0x7f5d1c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d21200640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 -- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 msgr2=0x7f5d1c147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 -- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c159bf0 msgr2=0x7f5d1c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c159bf0 0x7f5d1c15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d1be00640 1 -- 172.21.15.7:0/2442975582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c1f6120 con 0x7f5d1c0cea40 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d21c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c159bf0 0x7f5d1c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:12.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.383+0000 7f5d21200640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.384+0000 7f5d1be00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c0cea40 0x7f5d1c15b4e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f5d080098c0 tx=0x7f5d080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.384+0000 7f5d18c00640 1 -- 172.21.15.7:0/2442975582 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08041030 con 0x7f5d1c0cea40 2024-08-19T00:46:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.384+0000 7f5d18c00640 1 -- 172.21.15.7:0/2442975582 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d0802ac50 con 0x7f5d1c0cea40 2024-08-19T00:46:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.384+0000 7f5d18c00640 1 -- 172.21.15.7:0/2442975582 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08037040 con 0x7f5d1c0cea40 2024-08-19T00:46:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.384+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1c09c640 con 0x7f5d1c0cea40 2024-08-19T00:46:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.384+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1c1f5e40 con 0x7f5d1c0cea40 2024-08-19T00:46:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.385+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d1c0ce500 con 0x7f5d1c0cea40 2024-08-19T00:46:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.386+0000 7f5d18c00640 1 -- 172.21.15.7:0/2442975582 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d08044070 con 0x7f5d1c0cea40 2024-08-19T00:46:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.387+0000 7f5d18c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.387+0000 7f5d18c00640 1 -- 172.21.15.7:0/2442975582 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7f5d080abc20 con 0x7f5d1c0cea40 2024-08-19T00:46:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.387+0000 7f5d21200640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.388+0000 7f5d21200640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009ba0 tx=0x7f5d10008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.391+0000 7f5d18c00640 1 -- 172.21.15.7:0/2442975582 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5d08044e40 con 0x7f5d1c0cea40 2024-08-19T00:46:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.610+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d1c159080 con 0x7f5d1c0cea40 2024-08-19T00:46:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.611+0000 7f5d18c00640 1 -- 172.21.15.7:0/2442975582 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 226 v226) ==== 95+0+3570 (secure 0 0 0) 0x7f5d08079db0 con 0x7f5d1c0cea40 2024-08-19T00:46:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:12.613 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":226,"btime":"2024-08-19T00:46:12:208617+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":226,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:12.208561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:12.613 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 226 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cfc06be30 msgr2=0x7f5cfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009ba0 tx=0x7f5d10008040 comp rx=0 tx=0).stop 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c0cea40 msgr2=0x7f5d1c15b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c0cea40 0x7f5d1c15b4e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f5d080098c0 tx=0x7f5d080046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 shutdown_connections 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1c159bf0 0x7f5d1c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d1c0cea40 0x7f5d1c15b4e0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 --2- 172.21.15.7:0/2442975582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d1c0739a0 0x7f5d1c147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 >> 172.21.15.7:0/2442975582 conn(0x7f5d1c06bc70 msgr2=0x7f5d1c1603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 shutdown_connections 2024-08-19T00:46:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.613+0000 7f5d23c00640 1 -- 172.21.15.7:0/2442975582 wait complete. 2024-08-19T00:46:12.630 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:12.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:12.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.785+0000 7fd799a00640 1 Processor -- start 2024-08-19T00:46:12.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.785+0000 7fd799a00640 1 -- start start 2024-08-19T00:46:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd799a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7940ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd799a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd7940d03c0 0x7fd7940d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd799a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79406f7f0 con 0x7fd794159bf0 2024-08-19T00:46:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd799a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd7940cee80 con 0x7fd7940d03c0 2024-08-19T00:46:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd799a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7940d0d70 con 0x7fd7940ce500 2024-08-19T00:46:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd792a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd794159bf0 0x7fd794073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:49916/0 (socket says 172.21.15.7:49916) 2024-08-19T00:46:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd792a00640 1 -- 172.21.15.7:0/3902620560 learned_addr learned my addr 172.21.15.7:0/3902620560 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:12.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd793400640 1 --2- 172.21.15.7:0/3902620560 >> v2:172.21.15.7:3300/0 conn(0x7fd7940d03c0 0x7fd7940d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd792000640 1 --2- 172.21.15.7:0/3902620560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7940ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd793400640 1 -- 172.21.15.7:0/3902620560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 msgr2=0x7fd7940ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:12.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd793400640 1 --2- 172.21.15.7:0/3902620560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7940ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd793400640 1 -- 172.21.15.7:0/3902620560 >> v1:172.21.15.7:6789/0 conn(0x7fd794159bf0 legacy=0x7fd794073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd793400640 1 -- 172.21.15.7:0/3902620560 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79406f510 con 0x7fd7940d03c0 2024-08-19T00:46:12.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.787+0000 7fd791600640 1 -- 172.21.15.7:0/3902620560 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801036503 0 0) 0x7fd79406f7f0 con 0x7fd794159bf0 2024-08-19T00:46:12.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.788+0000 7fd793400640 1 --2- 172.21.15.7:0/3902620560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd7940d0830 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009d90 tx=0x7fd78c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2feb1800273da473 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd791600640 1 -- 172.21.15.7:0/3902620560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c031600 con 0x7fd7940d03c0 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd791600640 1 -- 172.21.15.7:0/3902620560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c0317a0 con 0x7fd7940d03c0 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd791600640 1 -- 172.21.15.7:0/3902620560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c031b70 con 0x7fd7940d03c0 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 -- 172.21.15.7:0/3902620560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 msgr2=0x7fd7940d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 --2- 172.21.15.7:0/3902620560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd7940d0830 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009d90 tx=0x7fd78c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 -- 172.21.15.7:0/3902620560 shutdown_connections 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 --2- 172.21.15.7:0/3902620560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd7940d0830 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 --2- 172.21.15.7:0/3902620560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7940ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 -- 172.21.15.7:0/3902620560 >> 172.21.15.7:0/3902620560 conn(0x7fd79406bc70 msgr2=0x7fd79406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:12.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 -- 172.21.15.7:0/3902620560 shutdown_connections 2024-08-19T00:46:12.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.789+0000 7fd799a00640 1 -- 172.21.15.7:0/3902620560 wait complete. 2024-08-19T00:46:12.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.791+0000 7fd799a00640 1 Processor -- start 2024-08-19T00:46:12.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.791+0000 7fd799a00640 1 -- start start 2024-08-19T00:46:12.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd799a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7941546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd799a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd79409b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd799a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd794159bf0 0x7fd79409b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd799a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd794072f40 con 0x7fd7940d03c0 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd799a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd794072c60 con 0x7fd794159bf0 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd799a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd794073b70 con 0x7fd7940ce500 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd792000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd79409b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd792000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd79409b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47110/0 (socket says 172.21.15.7:47110) 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd792000640 1 -- 172.21.15.7:0/3481800536 learned_addr learned my addr 172.21.15.7:0/3481800536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd792a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7941546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.792+0000 7fd793400640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd794159bf0 0x7fd79409b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd792000640 1 -- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 msgr2=0x7fd7941546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd792000640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7941546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd792000640 1 -- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd794159bf0 msgr2=0x7fd79409b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd792000640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd794159bf0 0x7fd79409b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd792000640 1 -- 172.21.15.7:0/3481800536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7941f4030 con 0x7fd7940d03c0 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd792a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7941546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd792000640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd79409b290 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fd78000d5d0 tx=0x7fd78000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd78aa00640 1 -- 172.21.15.7:0/3481800536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780004240 con 0x7fd7940d03c0 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd78aa00640 1 -- 172.21.15.7:0/3481800536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7800043e0 con 0x7fd7940d03c0 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7941f4310 con 0x7fd7940d03c0 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd78aa00640 1 -- 172.21.15.7:0/3481800536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780003830 con 0x7fd7940d03c0 2024-08-19T00:46:12.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.793+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7941f48d0 con 0x7fd7940d03c0 2024-08-19T00:46:12.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.794+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd794159fd0 con 0x7fd7940d03c0 2024-08-19T00:46:12.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.795+0000 7fd78aa00640 1 -- 172.21.15.7:0/3481800536 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7800039d0 con 0x7fd7940d03c0 2024-08-19T00:46:12.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.796+0000 7fd78aa00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd77406be30 0x7fd77406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:12.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.796+0000 7fd78aa00640 1 -- 172.21.15.7:0/3481800536 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7fd78008ba20 con 0x7fd7940d03c0 2024-08-19T00:46:12.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.797+0000 7fd792a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd77406be30 0x7fd77406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:12.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.798+0000 7fd792a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd77406be30 0x7fd77406e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd784000f60 tx=0x7fd784007c30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:12.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:12.802+0000 7fd78aa00640 1 -- 172.21.15.7:0/3481800536 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd7800594d0 con 0x7fd7940d03c0 2024-08-19T00:46:12.891 INFO:tasks.ceph.mds.a.smithi007.stderr: -42> 2024-08-19T00:46:08.136+0000 7fa9ad600640 -1 mds.0.cache.ino(0x100) Corrupt inode 0x100: End of buffer [buffer:2] 2024-08-19T00:46:12.891 INFO:tasks.ceph.mds.a.smithi007.stderr: -33> 2024-08-19T00:46:08.136+0000 7fa9ad600640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:46:12.932 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:46:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.029+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd79406fb10 con 0x7fd7940d03c0 2024-08-19T00:46:13.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.030+0000 7fd78aa00640 1 -- 172.21.15.7:0/3481800536 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 226 v226) ==== 95+0+3570 (secure 0 0 0) 0x7fd78005d7d0 con 0x7fd7940d03c0 2024-08-19T00:46:13.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:13.032 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":226,"btime":"2024-08-19T00:46:12:208617+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":226,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:12.208561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:13.033 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 226 2024-08-19T00:46:13.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd77406be30 msgr2=0x7fd77406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd77406be30 0x7fd77406e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd784000f60 tx=0x7fd784007c30 comp rx=0 tx=0).stop 2024-08-19T00:46:13.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 msgr2=0x7fd79409b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd79409b290 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fd78000d5d0 tx=0x7fd78000da90 comp rx=0 tx=0).stop 2024-08-19T00:46:13.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 shutdown_connections 2024-08-19T00:46:13.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd77406be30 0x7fd77406e2f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd794159bf0 0x7fd79409b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7940d03c0 0x7fd79409b290 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 --2- 172.21.15.7:0/3481800536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7940ce500 0x7fd7941546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 >> 172.21.15.7:0/3481800536 conn(0x7fd79406bc70 msgr2=0x7fd7940b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:13.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 shutdown_connections 2024-08-19T00:46:13.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.032+0000 7fd799a00640 1 -- 172.21.15.7:0/3481800536 wait complete. 2024-08-19T00:46:13.050 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:13.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:13.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.205+0000 7f3e2ac00640 1 Processor -- start 2024-08-19T00:46:13.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.206+0000 7f3e2ac00640 1 -- start start 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e2ac00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3e2415e360 0x7f3e2415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e2ac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3e2415ee50 0x7f3e240d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e2ac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e240b3ab0 con 0x7f3e240d2af0 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e2ac00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2415f460 con 0x7f3e2415e360 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e2ac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2415f740 con 0x7f3e2415ee50 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e29800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3e2415e360 0x7f3e2415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e29800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3e2415e360 0x7f3e2415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47136/0 (socket says 172.21.15.7:47136) 2024-08-19T00:46:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e29800640 1 -- 172.21.15.7:0/1080782192 learned_addr learned my addr 172.21.15.7:0/1080782192 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e2a200640 1 --2- 172.21.15.7:0/1080782192 >> v2:172.21.15.162:3300/0 conn(0x7f3e2415ee50 0x7f3e240d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e29800640 1 -- 172.21.15.7:0/1080782192 >> v2:172.21.15.162:3300/0 conn(0x7f3e2415ee50 msgr2=0x7f3e240d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e29800640 1 --2- 172.21.15.7:0/1080782192 >> v2:172.21.15.162:3300/0 conn(0x7f3e2415ee50 0x7f3e240d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e29800640 1 -- 172.21.15.7:0/1080782192 >> v1:172.21.15.162:6789/0 conn(0x7f3e240d2af0 legacy=0x7f3e2415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.207+0000 7f3e29800640 1 -- 172.21.15.7:0/1080782192 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e240b3d60 con 0x7f3e2415e360 2024-08-19T00:46:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.208+0000 7f3e29800640 1 --2- 172.21.15.7:0/1080782192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e2415e360 0x7f3e2415fab0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3e240d1c20 tx=0x7f3e1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6e5087091b0cc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e23e00640 1 -- 172.21.15.7:0/1080782192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18037070 con 0x7f3e2415e360 2024-08-19T00:46:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e23e00640 1 -- 172.21.15.7:0/1080782192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e18032440 con 0x7f3e2415e360 2024-08-19T00:46:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e23e00640 1 -- 172.21.15.7:0/1080782192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18032810 con 0x7f3e2415e360 2024-08-19T00:46:13.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1080782192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e2415e360 msgr2=0x7f3e2415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1080782192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e2415e360 0x7f3e2415fab0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3e240d1c20 tx=0x7f3e1802a270 comp rx=0 tx=0).stop 2024-08-19T00:46:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1080782192 shutdown_connections 2024-08-19T00:46:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1080782192 >> v2:172.21.15.162:3300/0 conn(0x7f3e2415ee50 0x7f3e240d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1080782192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e2415e360 0x7f3e2415fab0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1080782192 >> 172.21.15.7:0/1080782192 conn(0x7f3e2408dbf0 msgr2=0x7f3e2409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1080782192 shutdown_connections 2024-08-19T00:46:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.209+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1080782192 wait complete. 2024-08-19T00:46:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.211+0000 7f3e2ac00640 1 Processor -- start 2024-08-19T00:46:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.211+0000 7f3e2ac00640 1 -- start start 2024-08-19T00:46:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.212+0000 7f3e2ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e240d2af0 0x7f3e240c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.212+0000 7f3e2ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2415e360 0x7f3e240c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.212+0000 7f3e2ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e2415ee50 0x7f3e24155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.212+0000 7f3e2ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e240b4560 con 0x7f3e240d2af0 2024-08-19T00:46:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.212+0000 7f3e2ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e240d2300 con 0x7f3e2415e360 2024-08-19T00:46:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.212+0000 7f3e2ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3e240b46e0 con 0x7f3e2415ee50 2024-08-19T00:46:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e240d2af0 0x7f3e240c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e240d2af0 0x7f3e240c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47148/0 (socket says 172.21.15.7:47148) 2024-08-19T00:46:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 -- 172.21.15.7:0/1783141046 learned_addr learned my addr 172.21.15.7:0/1783141046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e2a200640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e2415ee50 0x7f3e24155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e28e00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2415e360 0x7f3e240c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 -- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e2415ee50 msgr2=0x7f3e24155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e2415ee50 0x7f3e24155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 -- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2415e360 msgr2=0x7f3e240c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2415e360 0x7f3e240c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 -- 172.21.15.7:0/1783141046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e241598a0 con 0x7f3e240d2af0 2024-08-19T00:46:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.213+0000 7f3e29800640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e240d2af0 0x7f3e240c8740 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3e1802a2b0 tx=0x7f3e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:13.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.214+0000 7f3e21600640 1 -- 172.21.15.7:0/1783141046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18037040 con 0x7f3e240d2af0 2024-08-19T00:46:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.214+0000 7f3e21600640 1 -- 172.21.15.7:0/1783141046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e18042070 con 0x7f3e240d2af0 2024-08-19T00:46:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.214+0000 7f3e21600640 1 -- 172.21.15.7:0/1783141046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18030880 con 0x7f3e240d2af0 2024-08-19T00:46:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.214+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e24159b40 con 0x7f3e240d2af0 2024-08-19T00:46:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.214+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2415a100 con 0x7f3e240d2af0 2024-08-19T00:46:13.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.215+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2415a340 con 0x7f3e240d2af0 2024-08-19T00:46:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.216+0000 7f3e21600640 1 -- 172.21.15.7:0/1783141046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e18030a20 con 0x7f3e240d2af0 2024-08-19T00:46:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.217+0000 7f3e21600640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e0406be30 0x7f3e0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.218+0000 7f3e21600640 1 -- 172.21.15.7:0/1783141046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7f3e180abd80 con 0x7f3e240d2af0 2024-08-19T00:46:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.218+0000 7f3e28e00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e0406be30 0x7f3e0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.218+0000 7f3e28e00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e0406be30 0x7f3e0406e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3e24157030 tx=0x7f3e10009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:13.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.222+0000 7f3e21600640 1 -- 172.21.15.7:0/1783141046 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3e2415a340 con 0x7f3e240d2af0 2024-08-19T00:46:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.443+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e240d50d0 con 0x7f3e240d2af0 2024-08-19T00:46:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.443+0000 7f3e21600640 1 -- 172.21.15.7:0/1783141046 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 227 v227) ==== 95+0+4390 (secure 0 0 0) 0x7f3e18079960 con 0x7f3e240d2af0 2024-08-19T00:46:13.571 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:13.571 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":227,"btime":"2024-08-19T00:46:13:210292+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/613323192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":613323192},{"type":"v1","addr":"172.21.15.7:6837","nonce":613323192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":227}],"filesystems":[{"mdsmap":{"epoch":226,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:12.208561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 227 2024-08-19T00:46:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e0406be30 msgr2=0x7f3e0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e0406be30 0x7f3e0406e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3e24157030 tx=0x7f3e10009040 comp rx=0 tx=0).stop 2024-08-19T00:46:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e240d2af0 msgr2=0x7f3e240c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e240d2af0 0x7f3e240c8740 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3e1802a2b0 tx=0x7f3e180046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 shutdown_connections 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3e0406be30 0x7f3e0406e2f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e2415ee50 0x7f3e24155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2415e360 0x7f3e240c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 --2- 172.21.15.7:0/1783141046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e240d2af0 0x7f3e240c8740 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 >> 172.21.15.7:0/1783141046 conn(0x7f3e2408dbf0 msgr2=0x7f3e24160980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 shutdown_connections 2024-08-19T00:46:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.446+0000 7f3e2ac00640 1 -- 172.21.15.7:0/1783141046 wait complete. 2024-08-19T00:46:13.575 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 1.00000000.inode' led to DAMAGED state 2024-08-19T00:46:13.575 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 200.00000000' 2024-08-19T00:46:13.575 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:13.575 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:13.612 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:13.612 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:13.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:13.612 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:13.687 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:13.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:13.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:13.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.884+0000 7f92a8e00640 1 Processor -- start 2024-08-19T00:46:13.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.884+0000 7f92a8e00640 1 -- start start 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a8e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f92a40d10c0 0x7f92a415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a8e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a415e760 con 0x7f92a415e380 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a8e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f92a40d1b90 con 0x7f92a40d10c0 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92a415f8b0 con 0x7f92a40d4b30 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a3400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f92a415e380 0x7f92a40d09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48710/0 (socket says 172.21.15.7:48710) 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a3400640 1 -- 172.21.15.7:0/963219489 learned_addr learned my addr 172.21.15.7:0/963219489 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f929be00640 1 --2- 172.21.15.7:0/963219489 >> v2:172.21.15.7:3300/0 conn(0x7f92a40d10c0 0x7f92a415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a3e00640 1 --2- 172.21.15.7:0/963219489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a2a00640 1 -- 172.21.15.7:0/963219489 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198994525 0 0) 0x7f92a415e760 con 0x7f92a415e380 2024-08-19T00:46:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f929be00640 1 -- 172.21.15.7:0/963219489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 msgr2=0x7f92a40ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f929be00640 1 --2- 172.21.15.7:0/963219489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f929be00640 1 -- 172.21.15.7:0/963219489 >> v1:172.21.15.7:6789/0 conn(0x7f92a415e380 legacy=0x7f92a40d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f929be00640 1 -- 172.21.15.7:0/963219489 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a40d2280 con 0x7f92a40d10c0 2024-08-19T00:46:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.886+0000 7f92a3e00640 1 --2- 172.21.15.7:0/963219489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:13.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.887+0000 7f929be00640 1 --2- 172.21.15.7:0/963219489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a415f370 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f928c0097a0 tx=0x7f928c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6ca8331d7d1146 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:13.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a2a00640 1 -- 172.21.15.7:0/963219489 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c037070 con 0x7f92a40d10c0 2024-08-19T00:46:13.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a2a00640 1 -- 172.21.15.7:0/963219489 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c032440 con 0x7f92a40d10c0 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a2a00640 1 -- 172.21.15.7:0/963219489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c032810 con 0x7f92a40d10c0 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 -- 172.21.15.7:0/963219489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 msgr2=0x7f92a415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 --2- 172.21.15.7:0/963219489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a415f370 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f928c0097a0 tx=0x7f928c02a230 comp rx=0 tx=0).stop 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 -- 172.21.15.7:0/963219489 shutdown_connections 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 --2- 172.21.15.7:0/963219489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 --2- 172.21.15.7:0/963219489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a415f370 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 -- 172.21.15.7:0/963219489 >> 172.21.15.7:0/963219489 conn(0x7f92a409d4d0 msgr2=0x7f92a40d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 -- 172.21.15.7:0/963219489 shutdown_connections 2024-08-19T00:46:13.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.888+0000 7f92a8e00640 1 -- 172.21.15.7:0/963219489 wait complete. 2024-08-19T00:46:13.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.890+0000 7f92a8e00640 1 Processor -- start 2024-08-19T00:46:13.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.890+0000 7f92a8e00640 1 -- start start 2024-08-19T00:46:13.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.891+0000 7f92a8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.891+0000 7f92a8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.891+0000 7f92a8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92a415e380 0x7f92a40cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.891+0000 7f92a8e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40d2520 con 0x7f92a40d10c0 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.891+0000 7f92a8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40d2b70 con 0x7f92a415e380 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.891+0000 7f92a8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92a40d2800 con 0x7f92a40d4b30 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.891+0000 7f92a3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53478/0 (socket says 172.21.15.7:53478) 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 -- 172.21.15.7:0/3810338310 learned_addr learned my addr 172.21.15.7:0/3810338310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3e00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92a415e380 0x7f92a40cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f929be00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 -- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 msgr2=0x7f92a40cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 -- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92a415e380 msgr2=0x7f92a40cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:13.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92a415e380 0x7f92a40cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:13.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 -- 172.21.15.7:0/3810338310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a40ce170 con 0x7f92a40d10c0 2024-08-19T00:46:13.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f92a3400640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a41505f0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f929400c460 tx=0x7f929400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.892+0000 7f929b400640 1 -- 172.21.15.7:0/3810338310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294018070 con 0x7f92a40d10c0 2024-08-19T00:46:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.893+0000 7f929b400640 1 -- 172.21.15.7:0/3810338310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9294007500 con 0x7f92a40d10c0 2024-08-19T00:46:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.893+0000 7f929b400640 1 -- 172.21.15.7:0/3810338310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294004a20 con 0x7f92a40d10c0 2024-08-19T00:46:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.893+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a40b72a0 con 0x7f92a40d10c0 2024-08-19T00:46:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.893+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a4150b30 con 0x7f92a40d10c0 2024-08-19T00:46:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.894+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a40b70b0 con 0x7f92a40d10c0 2024-08-19T00:46:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.895+0000 7f929b400640 1 -- 172.21.15.7:0/3810338310 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f929401b070 con 0x7f92a40d10c0 2024-08-19T00:46:13.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.895+0000 7f929b400640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:13.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.896+0000 7f929b400640 1 -- 172.21.15.7:0/3810338310 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7f929408a950 con 0x7f92a40d10c0 2024-08-19T00:46:13.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.896+0000 7f929be00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:13.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.896+0000 7f929be00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f928c034000 tx=0x7f928c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:13.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:13.900+0000 7f929b400640 1 -- 172.21.15.7:0/3810338310 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9294058400 con 0x7f92a40d10c0 2024-08-19T00:46:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.120+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f92a40d31c0 con 0x7f92a40d10c0 2024-08-19T00:46:14.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.216+0000 7f929b400640 1 -- 172.21.15.7:0/3810338310 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v228) ==== 161+0+0 (secure 0 0 0) 0x7f929405c700 con 0x7f92a40d10c0 2024-08-19T00:46:14.218 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f928006be30 msgr2=0x7f928006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f928c034000 tx=0x7f928c02e000 comp rx=0 tx=0).stop 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 msgr2=0x7f92a41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a41505f0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f929400c460 tx=0x7f929400c920 comp rx=0 tx=0).stop 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 shutdown_connections 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92a415e380 0x7f92a40cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92a40d4b30 0x7f92a40cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 --2- 172.21.15.7:0/3810338310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92a40d10c0 0x7f92a41505f0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 >> 172.21.15.7:0/3810338310 conn(0x7f92a409d4d0 msgr2=0x7f92a40cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:14.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 shutdown_connections 2024-08-19T00:46:14.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.219+0000 7f92a8e00640 1 -- 172.21.15.7:0/3810338310 wait complete. 2024-08-19T00:46:14.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.394+0000 7f753c600640 1 Processor -- start 2024-08-19T00:46:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.394+0000 7f753c600640 1 -- start start 2024-08-19T00:46:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.395+0000 7f753c600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340d03c0 0x7f7534071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f753c600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75340cdfb0 con 0x7f753406e710 2024-08-19T00:46:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f753c600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75340ce290 con 0x7f75340b3750 2024-08-19T00:46:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f753c600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75340cebc0 con 0x7f75340d03c0 2024-08-19T00:46:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f7539200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f753406e710 0x7f75340d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48726/0 (socket says 172.21.15.7:48726) 2024-08-19T00:46:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f7539200640 1 -- 172.21.15.7:0/2375744388 learned_addr learned my addr 172.21.15.7:0/2375744388 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f7539c00640 1 --2- 172.21.15.7:0/2375744388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340d03c0 0x7f7534071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637577981 0 0) 0x7f75340cdfb0 con 0x7f753406e710 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.396+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f751c003520 con 0x7f753406e710 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.397+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758720556 0 0) 0x7f75340ce290 con 0x7f75340b3750 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.397+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75340cdfb0 con 0x7f75340b3750 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.397+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1957588665 0 0) 0x7f751c003520 con 0x7f753406e710 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.397+0000 7f7539c00640 1 -- 172.21.15.7:0/2375744388 >> v1:172.21.15.162:6789/0 conn(0x7f75340b3750 legacy=0x7f75340cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.397+0000 7f7539c00640 1 -- 172.21.15.7:0/2375744388 >> v1:172.21.15.7:6789/0 conn(0x7f753406e710 legacy=0x7f75340d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.397+0000 7f7539c00640 1 -- 172.21.15.7:0/2375744388 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75340ce570 con 0x7f75340d03c0 2024-08-19T00:46:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.398+0000 7f7539c00640 1 --2- 172.21.15.7:0/2375744388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340d03c0 0x7f7534071980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f75280097d0 tx=0x7f752802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=518291f0606d9b3a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.398+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528037070 con 0x7f75340d03c0 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.398+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752802ac30 con 0x7f75340d03c0 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.398+0000 7f7533e00640 1 -- 172.21.15.7:0/2375744388 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520001670 con 0x7f75340d03c0 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.398+0000 7f753c600640 1 -- 172.21.15.7:0/2375744388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340d03c0 msgr2=0x7f7534071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.398+0000 7f753c600640 1 --2- 172.21.15.7:0/2375744388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340d03c0 0x7f7534071980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f75280097d0 tx=0x7f752802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.399+0000 7f753c600640 1 -- 172.21.15.7:0/2375744388 shutdown_connections 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.399+0000 7f753c600640 1 --2- 172.21.15.7:0/2375744388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340d03c0 0x7f7534071980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.399+0000 7f753c600640 1 -- 172.21.15.7:0/2375744388 >> 172.21.15.7:0/2375744388 conn(0x7f753406bc70 msgr2=0x7f753406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.399+0000 7f753c600640 1 -- 172.21.15.7:0/2375744388 shutdown_connections 2024-08-19T00:46:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.399+0000 7f753c600640 1 -- 172.21.15.7:0/2375744388 wait complete. 2024-08-19T00:46:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.400+0000 7f753c600640 1 Processor -- start 2024-08-19T00:46:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.400+0000 7f753c600640 1 -- start start 2024-08-19T00:46:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.401+0000 7f753c600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406e710 0x7f7534099700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.401+0000 7f753c600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340b3750 0x7f753414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.401+0000 7f753c600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75340d03c0 0x7f753415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.401+0000 7f753c600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7534073c60 con 0x7f753406e710 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.401+0000 7f753c600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7534073ae0 con 0x7f75340d03c0 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.401+0000 7f753c600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75340b3be0 con 0x7f75340b3750 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.401+0000 7f7539c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406e710 0x7f7534099700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406e710 0x7f7534099700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53486/0 (socket says 172.21.15.7:53486) 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 -- 172.21.15.7:0/2559218136 learned_addr learned my addr 172.21.15.7:0/2559218136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539200640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340b3750 0x7f753414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f753a600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75340d03c0 0x7f753415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 -- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340b3750 msgr2=0x7f753414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340b3750 0x7f753414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 -- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75340d03c0 msgr2=0x7f753415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75340d03c0 0x7f753415cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 -- 172.21.15.7:0/2559218136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753414ac70 con 0x7f753406e710 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f753a600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75340d03c0 0x7f753415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7539c00640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406e710 0x7f7534099700 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7528035040 tx=0x7f75280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.402+0000 7f7531600640 1 -- 172.21.15.7:0/2559218136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528037050 con 0x7f753406e710 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.403+0000 7f7531600640 1 -- 172.21.15.7:0/2559218136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528043070 con 0x7f753406e710 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.403+0000 7f7531600640 1 -- 172.21.15.7:0/2559218136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528006e10 con 0x7f753406e710 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.403+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753414cfc0 con 0x7f753406e710 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.403+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7534151a00 con 0x7f753406e710 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.404+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75340ce290 con 0x7f753406e710 2024-08-19T00:46:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.405+0000 7f7531600640 1 -- 172.21.15.7:0/2559218136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f752803ca50 con 0x7f753406e710 2024-08-19T00:46:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.405+0000 7f7531600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.406+0000 7f7531600640 1 -- 172.21.15.7:0/2559218136 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7f75280ac280 con 0x7f753406e710 2024-08-19T00:46:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.406+0000 7f7539200640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.406+0000 7f7539200640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f751406be30 0x7f751406e2f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f75340cc8c0 tx=0x7f7520009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.410+0000 7f7531600640 1 -- 172.21.15.7:0/2559218136 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7528030e20 con 0x7f753406e710 2024-08-19T00:46:14.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:14.665+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f7534099ec0 con 0x7f753406e710 2024-08-19T00:46:15.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.223+0000 7f7531600640 1 -- 172.21.15.7:0/2559218136 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v229) ==== 101+0+0 (secure 0 0 0) 0x7f752807a5d0 con 0x7f753406e710 2024-08-19T00:46:15.225 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:15.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f751406be30 msgr2=0x7f751406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f751406be30 0x7f751406e2f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f75340cc8c0 tx=0x7f7520009040 comp rx=0 tx=0).stop 2024-08-19T00:46:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406e710 msgr2=0x7f7534099700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406e710 0x7f7534099700 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7528035040 tx=0x7f75280046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 shutdown_connections 2024-08-19T00:46:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75340d03c0 0x7f753415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75340b3750 0x7f753414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 --2- 172.21.15.7:0/2559218136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f753406e710 0x7f7534099700 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 >> 172.21.15.7:0/2559218136 conn(0x7f753406bc70 msgr2=0x7f7534074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 shutdown_connections 2024-08-19T00:46:15.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.226+0000 7f753c600640 1 -- 172.21.15.7:0/2559218136 wait complete. 2024-08-19T00:46:15.245 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.324+0000 7f85b5a7af40 1 Processor -- start 2024-08-19T00:46:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.324+0000 7f85b5a7af40 1 -- start start 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.325+0000 7f85b5a7af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33af380 0x557dd34682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.325+0000 7f85b5a7af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd33b0b90 0x557dd346af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.325+0000 7f85b5a7af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd346c500 0x557dd3513a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.325+0000 7f85b5a7af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557dd3354d00 con 0x557dd33b0b90 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.325+0000 7f85b5a7af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557dd3358d40 con 0x557dd33af380 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.325+0000 7f85b5a7af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557dd346c940 con 0x557dd346c500 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.325+0000 7f85b2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd33b0b90 0x557dd346af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd33b0b90 0x557dd346af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53500/0 (socket says 172.21.15.7:53500) 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 -- 172.21.15.7:0/3353652230 learned_addr learned my addr 172.21.15.7:0/3353652230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33af380 0x557dd34682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b3600640 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd346c500 0x557dd3513a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 -- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd346c500 msgr2=0x557dd3513a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd346c500 0x557dd3513a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 -- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33af380 msgr2=0x557dd34682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33af380 0x557dd34682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 -- 172.21.15.7:0/3353652230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dd3316080 con 0x557dd33b0b90 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b2200640 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd33b0b90 0x557dd346af20 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f85a0001e10 tx=0x7f85a000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf6832eb066cc26 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.326+0000 7f85b0e00640 1 -- 172.21.15.7:0/3353652230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a000bde0 con 0x557dd33b0b90 2024-08-19T00:46:15.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b0e00640 1 -- 172.21.15.7:0/3353652230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a000f400 con 0x557dd33b0b90 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b0e00640 1 -- 172.21.15.7:0/3353652230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a000f7f0 con 0x557dd33b0b90 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3353652230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd33b0b90 msgr2=0x557dd346af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd33b0b90 0x557dd346af20 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f85a0001e10 tx=0x7f85a000b670 comp rx=0 tx=0).stop 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3353652230 shutdown_connections 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd346c500 0x557dd3513a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd33b0b90 0x557dd346af20 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3353652230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33af380 0x557dd34682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3353652230 >> 172.21.15.7:0/3353652230 conn(0x557dd33db5d0 msgr2=0x557dd34697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3353652230 shutdown_connections 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.327+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3353652230 wait complete. 2024-08-19T00:46:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.328+0000 7f85b5a7af40 1 Processor -- start 2024-08-19T00:46:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.328+0000 7f85b5a7af40 1 -- start start 2024-08-19T00:46:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b5a7af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd33af380 0x557dd347c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b5a7af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33b0b90 0x557dd34667a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b5a7af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd346c500 0x557dd34682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b5a7af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557dd33dbd20 con 0x557dd346c500 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b5a7af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557dd346a390 con 0x557dd33b0b90 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b5a7af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557dd33de6e0 con 0x557dd33af380 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd346c500 0x557dd34682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd346c500 0x557dd34682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53516/0 (socket says 172.21.15.7:53516) 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 learned_addr learned my addr 172.21.15.7:0/3854599707 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd33af380 0x557dd347c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.329+0000 7f85b2200640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33b0b90 0x557dd34667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd33af380 msgr2=0x557dd347c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b3600640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dd33af380 0x557dd347c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33b0b90 msgr2=0x557dd34667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b3600640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dd33b0b90 0x557dd34667a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dd347cd50 con 0x557dd346c500 2024-08-19T00:46:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b3600640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd346c500 0x557dd34682c0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f85ac046170 tx=0x7f85ac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85ab400640 1 -- 172.21.15.7:0/3854599707 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac068020 con 0x557dd346c500 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85ab400640 1 -- 172.21.15.7:0/3854599707 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ac064440 con 0x557dd346c500 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557dd3467140 con 0x557dd346c500 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85ab400640 1 -- 172.21.15.7:0/3854599707 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac005a80 con 0x557dd346c500 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.330+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dd33f3d90 con 0x557dd346c500 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.332+0000 7f85ab400640 1 -- 172.21.15.7:0/3854599707 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85ac06b020 con 0x557dd346c500 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.333+0000 7f85ab400640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f859406a810 0x7f859406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.333+0000 7f85ab400640 1 -- 172.21.15.7:0/3854599707 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7f85ac0ce1c0 con 0x557dd346c500 2024-08-19T00:46:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.333+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f859406a810 0x7f859406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.339 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.333+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557dd3480a20 0x557dd3480e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.334+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3466ce0 con 0x557dd3480a20 2024-08-19T00:46:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.334+0000 7f85b2200640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557dd3480a20 0x557dd3480e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.334+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f859406a810 0x7f859406ccd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f85a4000c00 tx=0x7f85a4001710 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.335+0000 7f85b2200640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557dd3480a20 0x557dd3480e00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.337+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v110'722 uv696 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.337+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd3481340 con 0x557dd3480a20 2024-08-19T00:46:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.338+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v110'723 uv723 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.338+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35279b0 con 0x557dd3480a20 2024-08-19T00:46:15.341 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.340+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v110'724 uv724 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.340+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528d60 con 0x557dd3480a20 2024-08-19T00:46:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.341+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v110'725 uv725 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.341+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3529100 con 0x557dd3480a20 2024-08-19T00:46:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.343+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v110'726 uv726 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.343+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3527d50 con 0x557dd3480a20 2024-08-19T00:46:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.344+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v110'727 uv727 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.344+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528160 con 0x557dd3480a20 2024-08-19T00:46:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.346+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v110'728 uv702 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.346+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.347+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v110'729 uv729 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.347+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.350 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.349+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v110'730 uv730 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.349+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.350+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v110'731 uv731 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.350+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.351+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v110'732 uv732 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.352+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.353+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v110'733 uv733 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.353+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.354+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v110'734 uv709 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.355+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.356+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v110'735 uv735 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.356+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.359 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:15.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.358+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v110'736 uv736 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.358+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.359+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v110'737 uv737 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.359+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.360+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v110'738 uv738 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.361+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3528500 con 0x557dd3480a20 2024-08-19T00:46:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.362+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v110'739 uv739 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.362+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35288c0 con 0x557dd3480a20 2024-08-19T00:46:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.363+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v110'740 uv740 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.363+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35288c0 con 0x557dd3480a20 2024-08-19T00:46:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.365+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v110'741 uv715 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.365+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd35288c0 con 0x557dd3480a20 2024-08-19T00:46:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.366+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v110'742 uv742 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.366+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35288c0 con 0x557dd3480a20 2024-08-19T00:46:15.369 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:15.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.368+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v110'743 uv743 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.368+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35288c0 con 0x557dd3480a20 2024-08-19T00:46:15.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.369+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v110'744 uv744 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.369+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35288c0 con 0x557dd3480a20 2024-08-19T00:46:15.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.371+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v110'745 uv745 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.371+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35288c0 con 0x557dd3480a20 2024-08-19T00:46:15.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.372+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v110'746 uv746 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.372+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35287c0 con 0x557dd3480a20 2024-08-19T00:46:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.374+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v110'747 uv721 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.374+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd35287c0 con 0x557dd3480a20 2024-08-19T00:46:15.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.375+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v110'748 uv748 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.375+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35287c0 con 0x557dd3480a20 2024-08-19T00:46:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.377+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v110'749 uv749 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.378 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.377+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35287c0 con 0x557dd3480a20 2024-08-19T00:46:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.378+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v110'750 uv750 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.378+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35287c0 con 0x557dd3480a20 2024-08-19T00:46:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.379+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v110'751 uv751 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.379+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35287c0 con 0x557dd3480a20 2024-08-19T00:46:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.381+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v110'752 uv752 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.381+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dd35299b0 0x557dd352bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.381+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35287c0 con 0x557dd35299b0 2024-08-19T00:46:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.381+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dd35299b0 0x557dd352bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.382+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dd35299b0 0x557dd352bda0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.384+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v110'527 uv526 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.384+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd352c2e0 con 0x557dd35299b0 2024-08-19T00:46:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.385+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v110'528 uv528 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.386+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352c680 con 0x557dd35299b0 2024-08-19T00:46:15.388 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.387+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v110'529 uv529 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.387+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352ca20 con 0x557dd35299b0 2024-08-19T00:46:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.389+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v110'530 uv530 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.389+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352cdc0 con 0x557dd35299b0 2024-08-19T00:46:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.390+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v110'531 uv531 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.390+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d160 con 0x557dd35299b0 2024-08-19T00:46:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.392+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v110'532 uv514 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.392+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.393+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v110'533 uv533 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.393+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.396 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:15.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.395+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v110'534 uv534 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.395+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.396+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v110'535 uv535 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.396+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.398+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v110'536 uv536 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.398+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.399+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v110'537 uv519 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.399+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.401+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v110'538 uv538 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.401+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.403 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:15.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.402+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v110'539 uv539 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.402+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.404+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v110'540 uv540 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.404+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.406+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v110'541 uv541 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.406+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.407+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v110'542 uv525 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.407+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.409+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v110'543 uv543 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.409+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.411 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:15.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.410+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v110'544 uv544 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.410+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.412+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v110'545 uv545 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.412+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.413+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v110'546 uv546 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.413+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd352d500 con 0x557dd35299b0 2024-08-19T00:46:15.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.414+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v110'547 uv547 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd35299b0 2024-08-19T00:46:15.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.414+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557dd352de50 0x557dd352e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.414+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35309a0 con 0x557dd352de50 2024-08-19T00:46:15.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.415+0000 7f85b2200640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557dd352de50 0x557dd352e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.415+0000 7f85b2200640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557dd352de50 0x557dd352e230 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.416+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v110'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd352de50 2024-08-19T00:46:15.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.417+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd35309a0 con 0x557dd352de50 2024-08-19T00:46:15.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.418+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v110'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd352de50 2024-08-19T00:46:15.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.418+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35309a0 con 0x557dd352de50 2024-08-19T00:46:15.420 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:15.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.419+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v110'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd352de50 2024-08-19T00:46:15.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.419+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3468870 con 0x557dd352de50 2024-08-19T00:46:15.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.420+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v110'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd352de50 2024-08-19T00:46:15.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.420+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3531f50 con 0x557dd352de50 2024-08-19T00:46:15.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.422+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v110'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd352de50 2024-08-19T00:46:15.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.422+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3530ef0 con 0x557dd352de50 2024-08-19T00:46:15.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.423+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v110'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd352de50 2024-08-19T00:46:15.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.423+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3530ed0 con 0x557dd3480a20 2024-08-19T00:46:15.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.425+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v110'104 uv103 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.425+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd3530ed0 con 0x557dd3480a20 2024-08-19T00:46:15.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.426+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v110'105 uv105 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.426+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3530ed0 con 0x557dd3480a20 2024-08-19T00:46:15.430 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.428+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v110'106 uv106 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.428+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3530ed0 con 0x557dd3480a20 2024-08-19T00:46:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.429+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v110'107 uv107 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f85a000f5b0 con 0x557dd3480a20 2024-08-19T00:46:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.430+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557dd35317c0 0x557dd3533bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.430+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3530ed0 con 0x557dd35317c0 2024-08-19T00:46:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.430+0000 7f85b3600640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557dd35317c0 0x557dd3533bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.431+0000 7f85b3600640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557dd35317c0 0x557dd3533bb0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.432+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v110'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.432+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd35341b0 con 0x557dd35317c0 2024-08-19T00:46:15.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.433+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v110'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.433+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3534690 con 0x557dd35317c0 2024-08-19T00:46:15.436 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:15.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.434+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v110'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.434+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3535f40 con 0x557dd35317c0 2024-08-19T00:46:15.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.435+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v110'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.435+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd35362e0 con 0x557dd35317c0 2024-08-19T00:46:15.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.437+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v110'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.437+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3534f30 con 0x557dd35317c0 2024-08-19T00:46:15.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.438+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v110'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.438+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557dd3535830 0x557dd3538690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.438+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538bd0 con 0x557dd3535830 2024-08-19T00:46:15.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.438+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557dd3535830 0x557dd3538690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.439+0000 7f85b2c00640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557dd3535830 0x557dd3538690 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.440+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v110'260 uv254 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.441+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538bd0 con 0x557dd3535830 2024-08-19T00:46:15.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.442+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v110'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.442+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538bd0 con 0x557dd3535830 2024-08-19T00:46:15.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.443+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v110'262 uv262 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.445 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:15.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.443+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3539fd0 con 0x557dd3535830 2024-08-19T00:46:15.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.445+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v110'263 uv263 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.445+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3539fd0 con 0x557dd3535830 2024-08-19T00:46:15.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.446+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v110'264 uv264 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.446+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538fc0 con 0x557dd3535830 2024-08-19T00:46:15.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.448+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v110'265 uv265 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.448+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538fc0 con 0x557dd3535830 2024-08-19T00:46:15.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.449+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v110'266 uv259 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.449+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538fc0 con 0x557dd3535830 2024-08-19T00:46:15.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.451+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v110'267 uv267 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.451+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538fc0 con 0x557dd3535830 2024-08-19T00:46:15.454 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:15.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.452+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v110'268 uv268 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.453+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538fc0 con 0x557dd3535830 2024-08-19T00:46:15.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.454+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v110'269 uv269 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.454+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd3538fc0 con 0x557dd3535830 2024-08-19T00:46:15.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.456+0000 7f85b2c00640 1 -- 172.21.15.7:0/3854599707 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v110'270 uv270 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a4009040 con 0x557dd3535830 2024-08-19T00:46:15.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.456+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557dd35394d0 0x557dd353b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.456+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353bf20 con 0x557dd35394d0 2024-08-19T00:46:15.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.456+0000 7f85b2200640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557dd35394d0 0x557dd353b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.457+0000 7f85b2200640 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557dd35394d0 0x557dd353b8c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.458+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v110'117 uv116 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.458+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353bf20 con 0x557dd35394d0 2024-08-19T00:46:15.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.459+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v110'118 uv118 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.459+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd35394d0 2024-08-19T00:46:15.462 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:15.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.460+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v110'119 uv119 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.460+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd35394d0 2024-08-19T00:46:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.462+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v110'120 uv120 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.462+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd35394d0 2024-08-19T00:46:15.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.463+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v110'121 uv121 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.463+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd3480a20 2024-08-19T00:46:15.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.465+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v110'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd3480a20 2024-08-19T00:46:15.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.465+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd3480a20 2024-08-19T00:46:15.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.467+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v110'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd3480a20 2024-08-19T00:46:15.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.467+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd3480a20 2024-08-19T00:46:15.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.468+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v110'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd3480a20 2024-08-19T00:46:15.470 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:15.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.468+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353d380 con 0x557dd3480a20 2024-08-19T00:46:15.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.470+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v110'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd3480a20 2024-08-19T00:46:15.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.470+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353d380 con 0x557dd3480a20 2024-08-19T00:46:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.471+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v110'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd3480a20 2024-08-19T00:46:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.471+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd3480a20 2024-08-19T00:46:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.472+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v110'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd3480a20 2024-08-19T00:46:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.472+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.474+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v110'233 uv227 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.474+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.475+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v110'234 uv234 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.475+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.478 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.477+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v110'235 uv235 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.477+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.478+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v110'236 uv236 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.478+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.479+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v110'237 uv237 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.480+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.481+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v110'238 uv232 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.481+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.482+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v110'239 uv239 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.482+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.485 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:15.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.484+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v110'240 uv240 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.484+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c370 con 0x557dd352de50 2024-08-19T00:46:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.485+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v110'241 uv241 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.485+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353f180 con 0x557dd352de50 2024-08-19T00:46:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.487+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v110'242 uv242 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd352de50 2024-08-19T00:46:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.487+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353c820 con 0x557dd35317c0 2024-08-19T00:46:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.490+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v110'103 uv102 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.490+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.491+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v110'104 uv104 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.491+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.493+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v110'105 uv105 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.494 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:15.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.493+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.494+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v110'106 uv106 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.494+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.496+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v110'141 uv140 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.496+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.498+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v110'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.498+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.501 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:15.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.499+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v110'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.499+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.500+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v110'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.500+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353dbd0 con 0x557dd35317c0 2024-08-19T00:46:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.502+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v110'145 uv145 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.502+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35317c0 2024-08-19T00:46:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.503+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v110'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85ac098370 con 0x557dd35317c0 2024-08-19T00:46:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.503+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.505+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v110'120 uv119 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.505+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.506+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v110'121 uv121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.506+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.507+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v110'122 uv122 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.509 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:15.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.507+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.508+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v110'123 uv123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.508+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.510+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v110'124 uv124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.510+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.511+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v110'290 uv282 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.511+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.513+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v110'291 uv291 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.513+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.514+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v110'292 uv292 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.516 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:15.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.514+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.515+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v110'293 uv293 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.515+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.517+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v110'294 uv294 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.517+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.518+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v110'295 uv289 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.518+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.519+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v110'296 uv296 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.519+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.520+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v110'297 uv297 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.522 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.520+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353dbd0 con 0x557dd35394d0 2024-08-19T00:46:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.522+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v110'298 uv298 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.522+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353dbd0 con 0x557dd35394d0 2024-08-19T00:46:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.523+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v110'299 uv299 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.523+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353cbc0 con 0x557dd35394d0 2024-08-19T00:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.524+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v110'300 uv300 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.524+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x557dd353d320 con 0x557dd35394d0 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b2200640 1 -- 172.21.15.7:0/3854599707 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v110'301 uv301 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f85a002a040 con 0x557dd35394d0 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dd35299b0 msgr2=0x557dd352bda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dd35299b0 0x557dd352bda0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557dd3535830 msgr2=0x557dd3538690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x557dd3535830 0x557dd3538690 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557dd35394d0 msgr2=0x557dd353b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x557dd35394d0 0x557dd353b8c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557dd352de50 msgr2=0x557dd352e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x557dd352de50 0x557dd352e230 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557dd3480a20 msgr2=0x557dd3480e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557dd3480a20 0x557dd3480e00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 reap_dead start 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557dd35317c0 msgr2=0x557dd3533bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x557dd35317c0 0x557dd3533bb0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b3600640 1 -- 172.21.15.7:0/3854599707 reap_dead start 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f859406a810 msgr2=0x7f859406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f859406a810 0x7f859406ccd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f85a4000c00 tx=0x7f85a4001710 comp rx=0 tx=0).stop 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd346c500 msgr2=0x557dd34682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd346c500 0x557dd34682c0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f85ac046170 tx=0x7f85ac003330 comp rx=0 tx=0).stop 2024-08-19T00:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 shutdown_connections 2024-08-19T00:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f859406a810 0x7f859406ccd0 secure :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f85a4000c00 tx=0x7f85a4001710 comp rx=0 tx=0).stop 2024-08-19T00:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 --2- 172.21.15.7:0/3854599707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dd346c500 0x557dd34682c0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 >> 172.21.15.7:0/3854599707 conn(0x557dd33db5d0 msgr2=0x557dd33f4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 shutdown_connections 2024-08-19T00:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.526+0000 7f85b5a7af40 1 -- 172.21.15.7:0/3854599707 wait complete. 2024-08-19T00:46:15.533 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 200.00000000 0 2024-08-19T00:46:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.649+0000 7f2ffc4e9f40 1 Processor -- start 2024-08-19T00:46:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.649+0000 7f2ffc4e9f40 1 -- start start 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ffc4e9f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f057460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ffc4e9f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52f06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ffc4e9f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 0x55d52efca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ffc4e9f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d52efe6450 con 0x55d52ef9db90 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ffc4e9f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d52ef41d00 con 0x55d52ef9c380 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ffc4e9f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d52ef9d0b0 con 0x55d52f056ff0 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ff8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52f06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ff8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52f06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53522/0 (socket says 172.21.15.7:53522) 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ff8c00640 1 -- 172.21.15.7:0/3497864162 learned_addr learned my addr 172.21.15.7:0/3497864162 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ff9600640 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f057460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.650+0000 7f2ffa000640 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 0x55d52efca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff8c00640 1 -- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 msgr2=0x55d52efca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff8c00640 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 0x55d52efca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff8c00640 1 -- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 msgr2=0x55d52f057460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff8c00640 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f057460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff8c00640 1 -- 172.21.15.7:0/3497864162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52eec6b30 con 0x55d52ef9db90 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff8c00640 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52f06f700 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8045b60 tx=0x7f2fe8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8de02246b6db8d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff3400640 1 -- 172.21.15.7:0/3497864162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8055070 con 0x55d52ef9db90 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff3400640 1 -- 172.21.15.7:0/3497864162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8051730 con 0x55d52ef9db90 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.651+0000 7f2ff3400640 1 -- 172.21.15.7:0/3497864162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8051b00 con 0x55d52ef9db90 2024-08-19T00:46:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/3497864162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 msgr2=0x55d52f06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52f06f700 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8045b60 tx=0x7f2fe8051000 comp rx=0 tx=0).stop 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/3497864162 shutdown_connections 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 0x55d52efca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52f06f700 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/3497864162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f057460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/3497864162 >> 172.21.15.7:0/3497864162 conn(0x55d52efc85d0 msgr2=0x55d52efc7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/3497864162 shutdown_connections 2024-08-19T00:46:15.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.652+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/3497864162 wait complete. 2024-08-19T00:46:15.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.653+0000 7f2ffc4e9f40 1 Processor -- start 2024-08-19T00:46:15.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.653+0000 7f2ffc4e9f40 1 -- start start 2024-08-19T00:46:15.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.653+0000 7f2ffc4e9f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f04e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ffc4e9f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52efca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ffc4e9f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 0x55d52f071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ffc4e9f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d52efcc250 con 0x55d52ef9db90 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ffc4e9f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d52f06f3c0 con 0x55d52ef9c380 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ffc4e9f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d52f0579a0 con 0x55d52f056ff0 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52efca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52efca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53538/0 (socket says 172.21.15.7:53538) 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 -- 172.21.15.7:0/2266037707 learned_addr learned my addr 172.21.15.7:0/2266037707 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff9600640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f04e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ffa000640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 0x55d52f071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 -- 172.21.15.7:0/2266037707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 msgr2=0x55d52f071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d52f056ff0 0x55d52f071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 -- 172.21.15.7:0/2266037707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 msgr2=0x55d52f04e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f04e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff8c00640 1 -- 172.21.15.7:0/2266037707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52ef03080 con 0x55d52ef9db90 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.654+0000 7f2ff9600640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d52ef9c380 0x55d52f04e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.655+0000 7f2ff8c00640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52efca430 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8025d20 tx=0x7f2fe8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.655+0000 7f2ff2000640 1 -- 172.21.15.7:0/2266037707 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8055040 con 0x55d52ef9db90 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.655+0000 7f2ff2000640 1 -- 172.21.15.7:0/2266037707 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8051ba0 con 0x55d52ef9db90 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.655+0000 7f2ff2000640 1 -- 172.21.15.7:0/2266037707 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe806d450 con 0x55d52ef9db90 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.655+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d52ef9e180 con 0x55d52ef9db90 2024-08-19T00:46:15.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.655+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d52f06d370 con 0x55d52ef9db90 2024-08-19T00:46:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.657+0000 7f2ff2000640 1 -- 172.21.15.7:0/2266037707 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fe8058070 con 0x55d52ef9db90 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.658+0000 7f2ff2000640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fdc06a840 0x7f2fdc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.658+0000 7f2ff2000640 1 -- 172.21.15.7:0/2266037707 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7f2fe80cf1a0 con 0x55d52ef9db90 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.658+0000 7f2ff9600640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fdc06a840 0x7f2fdc06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.658+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d52efca970 0x55d52f0ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.658+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:292cf221:::200.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) -- 0x55d52f070400 con 0x55d52efca970 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.658+0000 7f2ffa000640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d52efca970 0x55d52f0ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.659+0000 7f2ff9600640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fdc06a840 0x7f2fdc06cd00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2fec005cf0 tx=0x7f2fec00c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.659+0000 7f2ffa000640 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d52efca970 0x55d52f0ff980 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.660+0000 7f2ffa000640 1 -- 172.21.15.7:0/2266037707 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000000 [truncate 0] v110'548 uv548 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f2ff4002630 con 0x55d52efca970 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d52efca970 msgr2=0x55d52f0ff980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55d52efca970 0x55d52f0ff980 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fdc06a840 msgr2=0x7f2fdc06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2fdc06a840 0x7f2fdc06cd00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2fec005cf0 tx=0x7f2fec00c040 comp rx=0 tx=0).stop 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 msgr2=0x55d52efca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 --2- 172.21.15.7:0/2266037707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d52ef9db90 0x55d52efca430 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8025d20 tx=0x7f2fe8002fb0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffa000640 1 -- 172.21.15.7:0/2266037707 reap_dead start 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 shutdown_connections 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 >> 172.21.15.7:0/2266037707 conn(0x55d52efc85d0 msgr2=0x55d52efc7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 shutdown_connections 2024-08-19T00:46:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.661+0000 7f2ffc4e9f40 1 -- 172.21.15.7:0/2266037707 wait complete. 2024-08-19T00:46:15.667 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.824+0000 7fc2bfc00640 1 Processor -- start 2024-08-19T00:46:15.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.825+0000 7fc2bfc00640 1 -- start start 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bfc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc2b8158cd0 0x7fc2b8072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bfc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b8072ff0 0x7fc2b80add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bfc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2b80ae2b0 0x7fc2b815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bfc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b8073460 con 0x7fc2b80ae2b0 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bfc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b80aeae0 con 0x7fc2b8158cd0 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bfc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b80aedc0 con 0x7fc2b8072ff0 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bdc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2b80ae2b0 0x7fc2b815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bdc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2b80ae2b0 0x7fc2b815ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53544/0 (socket says 172.21.15.7:53544) 2024-08-19T00:46:15.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bdc00640 1 -- 172.21.15.7:0/3422379838 learned_addr learned my addr 172.21.15.7:0/3422379838 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2afe00640 1 --2- 172.21.15.7:0/3422379838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b8072ff0 0x7fc2b80add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.826+0000 7fc2bd200640 1 --2- 172.21.15.7:0/3422379838 >> v2:172.21.15.162:3300/0 conn(0x7fc2b8158cd0 0x7fc2b8072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.827+0000 7fc2bdc00640 1 -- 172.21.15.7:0/3422379838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b8072ff0 msgr2=0x7fc2b80add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.827+0000 7fc2bdc00640 1 --2- 172.21.15.7:0/3422379838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b8072ff0 0x7fc2b80add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.827+0000 7fc2bdc00640 1 -- 172.21.15.7:0/3422379838 >> v2:172.21.15.162:3300/0 conn(0x7fc2b8158cd0 msgr2=0x7fc2b8072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.827+0000 7fc2bdc00640 1 --2- 172.21.15.7:0/3422379838 >> v2:172.21.15.162:3300/0 conn(0x7fc2b8158cd0 0x7fc2b8072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.827+0000 7fc2bdc00640 1 -- 172.21.15.7:0/3422379838 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b80af0a0 con 0x7fc2b80ae2b0 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.827+0000 7fc2afe00640 1 --2- 172.21.15.7:0/3422379838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b8072ff0 0x7fc2b80add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bdc00640 1 --2- 172.21.15.7:0/3422379838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b80ae2b0 0x7fc2b815ea90 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80b2ca0 tx=0x7fc2b002c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca075ac8a998372d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2b7e00640 1 -- 172.21.15.7:0/3422379838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0009600 con 0x7fc2b80ae2b0 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2b7e00640 1 -- 172.21.15.7:0/3422379838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00097a0 con 0x7fc2b80ae2b0 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2b7e00640 1 -- 172.21.15.7:0/3422379838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0009b70 con 0x7fc2b80ae2b0 2024-08-19T00:46:15.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bfc00640 1 -- 172.21.15.7:0/3422379838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b80ae2b0 msgr2=0x7fc2b815ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/3422379838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b80ae2b0 0x7fc2b815ea90 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80b2ca0 tx=0x7fc2b002c780 comp rx=0 tx=0).stop 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bfc00640 1 -- 172.21.15.7:0/3422379838 shutdown_connections 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/3422379838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b80ae2b0 0x7fc2b815ea90 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/3422379838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b8072ff0 0x7fc2b80add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/3422379838 >> v2:172.21.15.162:3300/0 conn(0x7fc2b8158cd0 0x7fc2b8072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.828+0000 7fc2bfc00640 1 -- 172.21.15.7:0/3422379838 >> 172.21.15.7:0/3422379838 conn(0x7fc2b80b2300 msgr2=0x7fc2b806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.829+0000 7fc2bfc00640 1 -- 172.21.15.7:0/3422379838 shutdown_connections 2024-08-19T00:46:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.829+0000 7fc2bfc00640 1 -- 172.21.15.7:0/3422379838 wait complete. 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.830+0000 7fc2bfc00640 1 Processor -- start 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.831+0000 7fc2bfc00640 1 -- start start 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.831+0000 7fc2bfc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b8072ff0 0x7fc2b80b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.831+0000 7fc2bfc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b80ae2b0 0x7fc2b8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.831+0000 7fc2bfc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b8159fc0 0x7fc2b814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.831+0000 7fc2bfc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b80ae6d0 con 0x7fc2b8159fc0 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.831+0000 7fc2bfc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b80af660 con 0x7fc2b8072ff0 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.831+0000 7fc2bfc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b80ae850 con 0x7fc2b80ae2b0 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b8159fc0 0x7fc2b814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b8159fc0 0x7fc2b814c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53546/0 (socket says 172.21.15.7:53546) 2024-08-19T00:46:15.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 -- 172.21.15.7:0/1930501170 learned_addr learned my addr 172.21.15.7:0/1930501170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bd200640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b8072ff0 0x7fc2b80b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2afe00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b80ae2b0 0x7fc2b8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 -- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b80ae2b0 msgr2=0x7fc2b8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b80ae2b0 0x7fc2b8159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 -- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b8072ff0 msgr2=0x7fc2b80b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b8072ff0 0x7fc2b80b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.832+0000 7fc2bdc00640 1 -- 172.21.15.7:0/1930501170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b815b180 con 0x7fc2b8159fc0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.833+0000 7fc2bdc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b8159fc0 0x7fc2b814c670 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000d240 tx=0x7fc2b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.833+0000 7fc2b5600640 1 -- 172.21.15.7:0/1930501170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0042020 con 0x7fc2b8159fc0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.833+0000 7fc2b5600640 1 -- 172.21.15.7:0/1930501170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b003d870 con 0x7fc2b8159fc0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.833+0000 7fc2b5600640 1 -- 172.21.15.7:0/1930501170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b003dc60 con 0x7fc2b8159fc0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.833+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b815a600 con 0x7fc2b8159fc0 2024-08-19T00:46:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.833+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b815abc0 con 0x7fc2b8159fc0 2024-08-19T00:46:15.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.834+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b80add70 con 0x7fc2b8159fc0 2024-08-19T00:46:15.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.835+0000 7fc2b5600640 1 -- 172.21.15.7:0/1930501170 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2b0005d10 con 0x7fc2b8159fc0 2024-08-19T00:46:15.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.836+0000 7fc2b5600640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc29406be30 0x7fc29406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:15.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.836+0000 7fc2b5600640 1 -- 172.21.15.7:0/1930501170 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 7773+0+0 (secure 0 0 0) 0x7fc2b00acb40 con 0x7fc2b8159fc0 2024-08-19T00:46:15.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.836+0000 7fc2bd200640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc29406be30 0x7fc29406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:15.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.837+0000 7fc2bd200640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc29406be30 0x7fc29406e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009ac0 tx=0x7fc2a8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:15.840+0000 7fc2b5600640 1 -- 172.21.15.7:0/1930501170 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc2b007a680 con 0x7fc2b8159fc0 2024-08-19T00:46:16.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.062+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fc2b80cfd30 con 0x7fc2b8159fc0 2024-08-19T00:46:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.226+0000 7fc2b5600640 1 -- 172.21.15.7:0/1930501170 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v230) ==== 162+0+0 (secure 0 0 0) 0x7fc2b007e980 con 0x7fc2b8159fc0 2024-08-19T00:46:16.228 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc29406be30 msgr2=0x7fc29406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc29406be30 0x7fc29406e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009ac0 tx=0x7fc2a8009190 comp rx=0 tx=0).stop 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b8159fc0 msgr2=0x7fc2b814c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b8159fc0 0x7fc2b814c670 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000d240 tx=0x7fc2b0004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 shutdown_connections 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc29406be30 0x7fc29406e2f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b8159fc0 0x7fc2b814c670 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b80ae2b0 0x7fc2b8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 --2- 172.21.15.7:0/1930501170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b8072ff0 0x7fc2b80b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 >> 172.21.15.7:0/1930501170 conn(0x7fc2b80b2300 msgr2=0x7fc2b8072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:16.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 shutdown_connections 2024-08-19T00:46:16.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.229+0000 7fc2bfc00640 1 -- 172.21.15.7:0/1930501170 wait complete. 2024-08-19T00:46:16.237 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:16.236+0000 7fb92c800640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:46:16.238 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:16.237+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:16.238 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:16.237+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:16.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:16.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.406+0000 7fe55d400640 1 Processor -- start 2024-08-19T00:46:16.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.406+0000 7fe55d400640 1 -- start start 2024-08-19T00:46:16.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.407+0000 7fe55d400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe558159bf0 0x7fe558073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.407+0000 7fe55d400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55806f7f0 con 0x7fe5580739a0 2024-08-19T00:46:16.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.407+0000 7fe55d400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55806f510 con 0x7fe5580cec10 2024-08-19T00:46:16.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.407+0000 7fe55d400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe558072980 con 0x7fe558159bf0 2024-08-19T00:46:16.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.407+0000 7fe556800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe558159bf0 0x7fe558073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.407+0000 7fe54fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe5580739a0 0x7fe5580ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48748/0 (socket says 172.21.15.7:48748) 2024-08-19T00:46:16.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.407+0000 7fe54fe00640 1 -- 172.21.15.7:0/710157435 learned_addr learned my addr 172.21.15.7:0/710157435 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.408+0000 7fe556800640 1 -- 172.21.15.7:0/710157435 >> v1:172.21.15.162:6789/0 conn(0x7fe5580cec10 legacy=0x7fe5580d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.408+0000 7fe556800640 1 -- 172.21.15.7:0/710157435 >> v1:172.21.15.7:6789/0 conn(0x7fe5580739a0 legacy=0x7fe5580ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.408+0000 7fe556800640 1 -- 172.21.15.7:0/710157435 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe558072c60 con 0x7fe558159bf0 2024-08-19T00:46:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.409+0000 7fe556800640 1 --2- 172.21.15.7:0/710157435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558073460 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe5480097a0 tx=0x7fe54802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83382887aafb5fcf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.409+0000 7fe555e00640 1 -- 172.21.15.7:0/710157435 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548037070 con 0x7fe558159bf0 2024-08-19T00:46:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.409+0000 7fe555e00640 1 -- 172.21.15.7:0/710157435 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe548032440 con 0x7fe558159bf0 2024-08-19T00:46:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.409+0000 7fe555e00640 1 -- 172.21.15.7:0/710157435 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548032810 con 0x7fe558159bf0 2024-08-19T00:46:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.409+0000 7fe55d400640 1 -- 172.21.15.7:0/710157435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 msgr2=0x7fe558073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.409+0000 7fe55d400640 1 --2- 172.21.15.7:0/710157435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558073460 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe5480097a0 tx=0x7fe54802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.410+0000 7fe55d400640 1 -- 172.21.15.7:0/710157435 shutdown_connections 2024-08-19T00:46:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.410+0000 7fe55d400640 1 --2- 172.21.15.7:0/710157435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558073460 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.410+0000 7fe55d400640 1 -- 172.21.15.7:0/710157435 >> 172.21.15.7:0/710157435 conn(0x7fe55806bc70 msgr2=0x7fe55806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.410+0000 7fe55d400640 1 -- 172.21.15.7:0/710157435 shutdown_connections 2024-08-19T00:46:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.410+0000 7fe55d400640 1 -- 172.21.15.7:0/710157435 wait complete. 2024-08-19T00:46:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.411+0000 7fe55d400640 1 Processor -- start 2024-08-19T00:46:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.411+0000 7fe55d400640 1 -- start start 2024-08-19T00:46:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe55d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5580739a0 0x7fe558146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe55d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe55d400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe558158d40 0x7fe55809ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe55d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe55815a150 con 0x7fe558159bf0 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe55d400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe558159fd0 con 0x7fe5580739a0 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe55d400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe5580d0ad0 con 0x7fe558158d40 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53570/0 (socket says 172.21.15.7:53570) 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.412+0000 7fe54fe00640 1 -- 172.21.15.7:0/1941108018 learned_addr learned my addr 172.21.15.7:0/1941108018 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe556800640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5580739a0 0x7fe558146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe557200640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe558158d40 0x7fe55809ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54fe00640 1 -- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe558158d40 msgr2=0x7fe55809ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54fe00640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe558158d40 0x7fe55809ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54fe00640 1 -- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5580739a0 msgr2=0x7fe558146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54fe00640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5580739a0 0x7fe558146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54fe00640 1 -- 172.21.15.7:0/1941108018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55809d790 con 0x7fe558159bf0 2024-08-19T00:46:16.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe556800640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5580739a0 0x7fe558146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:16.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54fe00640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558158800 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c480 tx=0x7fe54000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54ea00640 1 -- 172.21.15.7:0/1941108018 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540017070 con 0x7fe558159bf0 2024-08-19T00:46:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54ea00640 1 -- 172.21.15.7:0/1941108018 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe540005ce0 con 0x7fe558159bf0 2024-08-19T00:46:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe54ea00640 1 -- 172.21.15.7:0/1941108018 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5400072f0 con 0x7fe558159bf0 2024-08-19T00:46:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.413+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55809da70 con 0x7fe558159bf0 2024-08-19T00:46:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.414+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55809e030 con 0x7fe558159bf0 2024-08-19T00:46:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.415+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe558073460 con 0x7fe558159bf0 2024-08-19T00:46:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.416+0000 7fe54ea00640 1 -- 172.21.15.7:0/1941108018 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe54001a070 con 0x7fe558159bf0 2024-08-19T00:46:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.417+0000 7fe54ea00640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe53406be30 0x7fe53406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.417+0000 7fe54ea00640 1 -- 172.21.15.7:0/1941108018 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7fe54008a930 con 0x7fe558159bf0 2024-08-19T00:46:16.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.417+0000 7fe556800640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe53406be30 0x7fe53406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.418+0000 7fe556800640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe53406be30 0x7fe53406e2f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe548034000 tx=0x7fe54802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.421+0000 7fe54ea00640 1 -- 172.21.15.7:0/1941108018 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe5400584b0 con 0x7fe558159bf0 2024-08-19T00:46:16.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.643+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe55815fff0 con 0x7fe558159bf0 2024-08-19T00:46:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.643+0000 7fe54ea00640 1 -- 172.21.15.7:0/1941108018 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 232 v232) ==== 95+0+3570 (secure 0 0 0) 0x7fe54005c7b0 con 0x7fe558159bf0 2024-08-19T00:46:16.645 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:16.645 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":232,"btime":"2024-08-19T00:46:16:237637+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":232,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:16.237578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 232 2024-08-19T00:46:16.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe53406be30 msgr2=0x7fe53406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe53406be30 0x7fe53406e2f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe548034000 tx=0x7fe54802e000 comp rx=0 tx=0).stop 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 msgr2=0x7fe558158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558158800 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c480 tx=0x7fe54000c940 comp rx=0 tx=0).stop 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 shutdown_connections 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe53406be30 0x7fe53406e2f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe558158d40 0x7fe55809ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe558159bf0 0x7fe558158800 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 --2- 172.21.15.7:0/1941108018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5580739a0 0x7fe558146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 >> 172.21.15.7:0/1941108018 conn(0x7fe55806bc70 msgr2=0x7fe55815a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 shutdown_connections 2024-08-19T00:46:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.646+0000 7fe55d400640 1 -- 172.21.15.7:0/1941108018 wait complete. 2024-08-19T00:46:16.663 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:16.663 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:16.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.820+0000 7fc4f3200640 1 Processor -- start 2024-08-19T00:46:16.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.820+0000 7fc4f3200640 1 -- start start 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.821+0000 7fc4f3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4ec159bf0 0x7fc4ec073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4f3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0739a0 0x7fc4ec0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4f3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4ec06f7f0 con 0x7fc4ec0cea40 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4f3200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ec06f510 con 0x7fc4ec159bf0 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4f3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ec072980 con 0x7fc4ec0739a0 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4ebe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4ec159bf0 0x7fc4ec073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4ebe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4ec159bf0 0x7fc4ec073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53584/0 (socket says 172.21.15.7:53584) 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4ebe00640 1 -- 172.21.15.7:0/647528880 learned_addr learned my addr 172.21.15.7:0/647528880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/647528880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0739a0 0x7fc4ec0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4ebe00640 1 -- 172.21.15.7:0/647528880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0739a0 msgr2=0x7fc4ec0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4ebe00640 1 --2- 172.21.15.7:0/647528880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0739a0 0x7fc4ec0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4ebe00640 1 -- 172.21.15.7:0/647528880 >> v1:172.21.15.162:6789/0 conn(0x7fc4ec0cea40 legacy=0x7fc4ec0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.822+0000 7fc4ebe00640 1 -- 172.21.15.7:0/647528880 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec072c60 con 0x7fc4ec159bf0 2024-08-19T00:46:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.823+0000 7fc4ebe00640 1 --2- 172.21.15.7:0/647528880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec073460 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009870 tx=0x7fc4dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b977820fc76cf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4eb400640 1 -- 172.21.15.7:0/647528880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc037070 con 0x7fc4ec159bf0 2024-08-19T00:46:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4eb400640 1 -- 172.21.15.7:0/647528880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4dc032440 con 0x7fc4ec159bf0 2024-08-19T00:46:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4eb400640 1 -- 172.21.15.7:0/647528880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc032810 con 0x7fc4ec159bf0 2024-08-19T00:46:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 -- 172.21.15.7:0/647528880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 msgr2=0x7fc4ec073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 --2- 172.21.15.7:0/647528880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec073460 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009870 tx=0x7fc4dc02a1c0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 -- 172.21.15.7:0/647528880 shutdown_connections 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 --2- 172.21.15.7:0/647528880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0739a0 0x7fc4ec0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 --2- 172.21.15.7:0/647528880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec073460 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 -- 172.21.15.7:0/647528880 >> 172.21.15.7:0/647528880 conn(0x7fc4ec06bc70 msgr2=0x7fc4ec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 -- 172.21.15.7:0/647528880 shutdown_connections 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.824+0000 7fc4f3200640 1 -- 172.21.15.7:0/647528880 wait complete. 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.826+0000 7fc4f3200640 1 Processor -- start 2024-08-19T00:46:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.826+0000 7fc4f3200640 1 -- start start 2024-08-19T00:46:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec0739a0 0x7fc4ec1f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cea40 0x7fc4ec1f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec1f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec15a150 con 0x7fc4ec159bf0 2024-08-19T00:46:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec159fd0 con 0x7fc4ec0739a0 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ec0d0ad0 con 0x7fc4ec0cea40 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec1f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec1f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53600/0 (socket says 172.21.15.7:53600) 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4f1200640 1 -- 172.21.15.7:0/2630586728 learned_addr learned my addr 172.21.15.7:0/2630586728 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.827+0000 7fc4e3e00640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cea40 0x7fc4ec1f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4ebe00640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec0739a0 0x7fc4ec1f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4f1200640 1 -- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cea40 msgr2=0x7fc4ec1f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4f1200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cea40 0x7fc4ec1f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4f1200640 1 -- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec0739a0 msgr2=0x7fc4ec1f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4f1200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec0739a0 0x7fc4ec1f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4f1200640 1 -- 172.21.15.7:0/2630586728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec152af0 con 0x7fc4ec159bf0 2024-08-19T00:46:16.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4f1200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec1f4f90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c7a0 tx=0x7fc4e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:16.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4e8c00640 1 -- 172.21.15.7:0/2630586728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4003b70 con 0x7fc4ec159bf0 2024-08-19T00:46:16.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4e8c00640 1 -- 172.21.15.7:0/2630586728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4003d30 con 0x7fc4ec159bf0 2024-08-19T00:46:16.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4e8c00640 1 -- 172.21.15.7:0/2630586728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400aa90 con 0x7fc4ec159bf0 2024-08-19T00:46:16.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.828+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec1f4970 con 0x7fc4ec159bf0 2024-08-19T00:46:16.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.829+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec152d90 con 0x7fc4ec159bf0 2024-08-19T00:46:16.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.830+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec0ce500 con 0x7fc4ec159bf0 2024-08-19T00:46:16.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.830+0000 7fc4e8c00640 1 -- 172.21.15.7:0/2630586728 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4e400ac30 con 0x7fc4ec159bf0 2024-08-19T00:46:16.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.831+0000 7fc4e8c00640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c806be30 0x7fc4c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:16.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.831+0000 7fc4e8c00640 1 -- 172.21.15.7:0/2630586728 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7fc4e408b4f0 con 0x7fc4ec159bf0 2024-08-19T00:46:16.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.832+0000 7fc4ebe00640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c806be30 0x7fc4c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.832+0000 7fc4ebe00640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c806be30 0x7fc4c806e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc034000 tx=0x7fc4dc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:16.835+0000 7fc4e8c00640 1 -- 172.21.15.7:0/2630586728 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc4e4058fd0 con 0x7fc4ec159bf0 2024-08-19T00:46:16.961 INFO:tasks.ceph.mds.c.smithi007.stderr: -38> 2024-08-19T00:46:12.207+0000 7f8da6000640 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2024-08-19T00:46:16.961 INFO:tasks.ceph.mds.c.smithi007.stderr: -36> 2024-08-19T00:46:12.207+0000 7f8da6000640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:46:16.999 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:46:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.059+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4ec159070 con 0x7fc4ec159bf0 2024-08-19T00:46:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.060+0000 7fc4e8c00640 1 -- 172.21.15.7:0/2630586728 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 232 v232) ==== 95+0+3570 (secure 0 0 0) 0x7fc4e405d2d0 con 0x7fc4ec159bf0 2024-08-19T00:46:17.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:17.063 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":232,"btime":"2024-08-19T00:46:16:237637+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":232,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:16.237578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 232 2024-08-19T00:46:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c806be30 msgr2=0x7fc4c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c806be30 0x7fc4c806e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc034000 tx=0x7fc4dc02e000 comp rx=0 tx=0).stop 2024-08-19T00:46:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 msgr2=0x7fc4ec1f4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec1f4f90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c7a0 tx=0x7fc4e400cc60 comp rx=0 tx=0).stop 2024-08-19T00:46:17.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 shutdown_connections 2024-08-19T00:46:17.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc4c806be30 0x7fc4c806e2f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4ec159bf0 0x7fc4ec1f4f90 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cea40 0x7fc4ec1f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 --2- 172.21.15.7:0/2630586728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec0739a0 0x7fc4ec1f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 >> 172.21.15.7:0/2630586728 conn(0x7fc4ec06bc70 msgr2=0x7fc4ec074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:17.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 shutdown_connections 2024-08-19T00:46:17.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.062+0000 7fc4f3200640 1 -- 172.21.15.7:0/2630586728 wait complete. 2024-08-19T00:46:17.080 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:17.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.236+0000 7fade5400640 1 Processor -- start 2024-08-19T00:46:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.236+0000 7fade5400640 1 -- start start 2024-08-19T00:46:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7fade5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade00b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7fade5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fade00b5c00 0x7fade015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7fade5400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade00ae780 con 0x7fade006cad0 2024-08-19T00:46:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7fade5400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fade00aea00 con 0x7fade00b5c00 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7fade5400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fade00aece0 con 0x7fade006ceb0 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7faddf200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fade00b5c00 0x7fade015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7faddf200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fade00b5c00 0x7fade015dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53612/0 (socket says 172.21.15.7:53612) 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.237+0000 7faddf200640 1 -- 172.21.15.7:0/1019642137 learned_addr learned my addr 172.21.15.7:0/1019642137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.238+0000 7fadd7e00640 1 --2- 172.21.15.7:0/1019642137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade00b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.238+0000 7faddf200640 1 -- 172.21.15.7:0/1019642137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 msgr2=0x7fade00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.238+0000 7faddf200640 1 --2- 172.21.15.7:0/1019642137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade00b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.238+0000 7faddf200640 1 -- 172.21.15.7:0/1019642137 >> v1:172.21.15.162:6789/0 conn(0x7fade006cad0 legacy=0x7fade00af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.238+0000 7faddf200640 1 -- 172.21.15.7:0/1019642137 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade00aefc0 con 0x7fade00b5c00 2024-08-19T00:46:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.239+0000 7faddf200640 1 --2- 172.21.15.7:0/1019642137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade015dc30 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e50 tx=0x7fadd802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62951dbecd54c1ee server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.239+0000 7faddde00640 1 -- 172.21.15.7:0/1019642137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8036070 con 0x7fade00b5c00 2024-08-19T00:46:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.239+0000 7faddde00640 1 -- 172.21.15.7:0/1019642137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd8031600 con 0x7fade00b5c00 2024-08-19T00:46:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.239+0000 7faddde00640 1 -- 172.21.15.7:0/1019642137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd80319d0 con 0x7fade00b5c00 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 -- 172.21.15.7:0/1019642137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 msgr2=0x7fade015dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 --2- 172.21.15.7:0/1019642137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade015dc30 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e50 tx=0x7fadd802a680 comp rx=0 tx=0).stop 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 -- 172.21.15.7:0/1019642137 shutdown_connections 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 --2- 172.21.15.7:0/1019642137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade015dc30 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 --2- 172.21.15.7:0/1019642137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade00b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 -- 172.21.15.7:0/1019642137 >> 172.21.15.7:0/1019642137 conn(0x7fade00721b0 msgr2=0x7fade00725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 -- 172.21.15.7:0/1019642137 shutdown_connections 2024-08-19T00:46:17.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.240+0000 7fade5400640 1 -- 172.21.15.7:0/1019642137 wait complete. 2024-08-19T00:46:17.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.242+0000 7fade5400640 1 Processor -- start 2024-08-19T00:46:17.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.243+0000 7fade5400640 1 -- start start 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.243+0000 7fade5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade006cad0 0x7fade01515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.243+0000 7fade5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.243+0000 7fade5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade01533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.243+0000 7fade5400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fade00b4b80 con 0x7fade00b5c00 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.243+0000 7fade5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fade00b4a00 con 0x7fade006cad0 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.243+0000 7fade5400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fade015e170 con 0x7fade006ceb0 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade01533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade01533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53624/0 (socket says 172.21.15.7:53624) 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 -- 172.21.15.7:0/858356685 learned_addr learned my addr 172.21.15.7:0/858356685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7fadde800640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade006cad0 0x7fade01515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7fadd7e00640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 -- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 msgr2=0x7fade015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 -- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade006cad0 msgr2=0x7fade01515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade006cad0 0x7fade01515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.244+0000 7faddf200640 1 -- 172.21.15.7:0/858356685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade00b0020 con 0x7fade00b5c00 2024-08-19T00:46:17.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.245+0000 7faddf200640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade01533d0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fadd8034040 tx=0x7fadd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:17.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.245+0000 7fadd6a00640 1 -- 172.21.15.7:0/858356685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8036050 con 0x7fade00b5c00 2024-08-19T00:46:17.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.245+0000 7fadd6a00640 1 -- 172.21.15.7:0/858356685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd8042070 con 0x7fade00b5c00 2024-08-19T00:46:17.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.245+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade00b0300 con 0x7fade00b5c00 2024-08-19T00:46:17.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.245+0000 7fadd6a00640 1 -- 172.21.15.7:0/858356685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8009510 con 0x7fade00b5c00 2024-08-19T00:46:17.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.245+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade00b08c0 con 0x7fade00b5c00 2024-08-19T00:46:17.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.246+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade015e5a0 con 0x7fade00b5c00 2024-08-19T00:46:17.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.247+0000 7fadd6a00640 1 -- 172.21.15.7:0/858356685 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadd8007bd0 con 0x7fade00b5c00 2024-08-19T00:46:17.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.249+0000 7fadd6a00640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadbc06be30 0x7fadbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.249+0000 7fadd6a00640 1 -- 172.21.15.7:0/858356685 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7fadd80ac4e0 con 0x7fade00b5c00 2024-08-19T00:46:17.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.249+0000 7fadde800640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadbc06be30 0x7fadbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.249+0000 7fadde800640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadbc06be30 0x7fadbc06e2f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fade00b1f00 tx=0x7fadd0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.253+0000 7fadd6a00640 1 -- 172.21.15.7:0/858356685 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fadd8079eb0 con 0x7fade00b5c00 2024-08-19T00:46:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.473+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade015e970 con 0x7fade00b5c00 2024-08-19T00:46:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.474+0000 7fadd6a00640 1 -- 172.21.15.7:0/858356685 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 233 v233) ==== 95+0+4387 (secure 0 0 0) 0x7fadd807e1b0 con 0x7fade00b5c00 2024-08-19T00:46:17.476 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:17.477 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":233,"btime":"2024-08-19T00:46:17:239173+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/95446058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":95446058},{"type":"v1","addr":"172.21.15.7:6836","nonce":95446058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":233}],"filesystems":[{"mdsmap":{"epoch":232,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:16.237578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 233 2024-08-19T00:46:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadbc06be30 msgr2=0x7fadbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadbc06be30 0x7fadbc06e2f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fade00b1f00 tx=0x7fadd0009040 comp rx=0 tx=0).stop 2024-08-19T00:46:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 msgr2=0x7fade01533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade01533d0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fadd8034040 tx=0x7fadd8004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 shutdown_connections 2024-08-19T00:46:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadbc06be30 0x7fadbc06e2f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade00b5c00 0x7fade01533d0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade006ceb0 0x7fade015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 --2- 172.21.15.7:0/858356685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade006cad0 0x7fade01515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 >> 172.21.15.7:0/858356685 conn(0x7fade00721b0 msgr2=0x7fade00cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.476+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 shutdown_connections 2024-08-19T00:46:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.477+0000 7fade5400640 1 -- 172.21.15.7:0/858356685 wait complete. 2024-08-19T00:46:17.494 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 200.00000000' led to DAMAGED state 2024-08-19T00:46:17.494 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 200.00000001' 2024-08-19T00:46:17.494 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:17.494 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:17.530 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:17.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:17.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:17.530 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:17.605 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:17.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:17.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.801+0000 7fb330400640 1 Processor -- start 2024-08-19T00:46:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.801+0000 7fb330400640 1 -- start start 2024-08-19T00:46:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.802+0000 7fb330400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280ce500 0x7fb3280ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.802+0000 7fb330400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32806f7f0 con 0x7fb3280d03c0 2024-08-19T00:46:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb330400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32806f510 con 0x7fb328159bf0 2024-08-19T00:46:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb330400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb3280cee80 con 0x7fb3280ce500 2024-08-19T00:46:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb32e400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb3280d03c0 0x7fb32806e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48756/0 (socket says 172.21.15.7:48756) 2024-08-19T00:46:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb32e400640 1 -- 172.21.15.7:0/1298412246 learned_addr learned my addr 172.21.15.7:0/1298412246 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb32d000640 1 --2- 172.21.15.7:0/1298412246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280ce500 0x7fb3280ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb327e00640 1 -- 172.21.15.7:0/1298412246 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192475728 0 0) 0x7fb32806f7f0 con 0x7fb3280d03c0 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb327e00640 1 -- 172.21.15.7:0/1298412246 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb310003520 con 0x7fb3280d03c0 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.803+0000 7fb327e00640 1 -- 172.21.15.7:0/1298412246 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477051629 0 0) 0x7fb32806f510 con 0x7fb328159bf0 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.804+0000 7fb327e00640 1 -- 172.21.15.7:0/1298412246 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32806f7f0 con 0x7fb328159bf0 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.804+0000 7fb32d000640 1 -- 172.21.15.7:0/1298412246 >> v1:172.21.15.162:6789/0 conn(0x7fb328159bf0 legacy=0x7fb328073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.804+0000 7fb32d000640 1 -- 172.21.15.7:0/1298412246 >> v1:172.21.15.7:6789/0 conn(0x7fb3280d03c0 legacy=0x7fb32806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.804+0000 7fb32d000640 1 -- 172.21.15.7:0/1298412246 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb328072980 con 0x7fb3280ce500 2024-08-19T00:46:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.805+0000 7fb32d000640 1 --2- 172.21.15.7:0/1298412246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280ce500 0x7fb3280ce940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097d0 tx=0x7fb31402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd96e78f0628a41 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.805+0000 7fb327e00640 1 -- 172.21.15.7:0/1298412246 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037070 con 0x7fb3280ce500 2024-08-19T00:46:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.805+0000 7fb327e00640 1 -- 172.21.15.7:0/1298412246 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb314032440 con 0x7fb3280ce500 2024-08-19T00:46:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.805+0000 7fb327e00640 1 -- 172.21.15.7:0/1298412246 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314032810 con 0x7fb3280ce500 2024-08-19T00:46:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.805+0000 7fb330400640 1 -- 172.21.15.7:0/1298412246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280ce500 msgr2=0x7fb3280ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.805+0000 7fb330400640 1 --2- 172.21.15.7:0/1298412246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280ce500 0x7fb3280ce940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097d0 tx=0x7fb31402a180 comp rx=0 tx=0).stop 2024-08-19T00:46:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.806+0000 7fb330400640 1 -- 172.21.15.7:0/1298412246 shutdown_connections 2024-08-19T00:46:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.806+0000 7fb330400640 1 --2- 172.21.15.7:0/1298412246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280ce500 0x7fb3280ce940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.806+0000 7fb330400640 1 -- 172.21.15.7:0/1298412246 >> 172.21.15.7:0/1298412246 conn(0x7fb32806bc70 msgr2=0x7fb32806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.806+0000 7fb330400640 1 -- 172.21.15.7:0/1298412246 shutdown_connections 2024-08-19T00:46:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.806+0000 7fb330400640 1 -- 172.21.15.7:0/1298412246 wait complete. 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.807+0000 7fb330400640 1 Processor -- start 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.807+0000 7fb330400640 1 -- start start 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.808+0000 7fb330400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3280ce500 0x7fb328160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.808+0000 7fb330400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280d03c0 0x7fb328148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.808+0000 7fb330400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb328159bf0 0x7fb3281574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.808+0000 7fb330400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb328073b70 con 0x7fb3280ce500 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.808+0000 7fb330400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb328072f40 con 0x7fb328159bf0 2024-08-19T00:46:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.808+0000 7fb330400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb328159fd0 con 0x7fb3280d03c0 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.808+0000 7fb32da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3280ce500 0x7fb328160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3280ce500 0x7fb328160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53636/0 (socket says 172.21.15.7:53636) 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 -- 172.21.15.7:0/2034042416 learned_addr learned my addr 172.21.15.7:0/2034042416 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32d000640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280d03c0 0x7fb328148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32e400640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb328159bf0 0x7fb3281574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 -- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280d03c0 msgr2=0x7fb328148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280d03c0 0x7fb328148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 -- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb328159bf0 msgr2=0x7fb3281574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb328159bf0 0x7fb3281574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 -- 172.21.15.7:0/2034042416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3281f79d0 con 0x7fb3280ce500 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.809+0000 7fb32da00640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3280ce500 0x7fb328160560 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c500 tx=0x7fb31c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.810+0000 7fb325600640 1 -- 172.21.15.7:0/2034042416 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0052d0 con 0x7fb3280ce500 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.810+0000 7fb325600640 1 -- 172.21.15.7:0/2034042416 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c005490 con 0x7fb3280ce500 2024-08-19T00:46:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.810+0000 7fb325600640 1 -- 172.21.15.7:0/2034042416 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c012870 con 0x7fb3280ce500 2024-08-19T00:46:17.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.810+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3281f7cb0 con 0x7fb3280ce500 2024-08-19T00:46:17.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.810+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3281f8270 con 0x7fb3280ce500 2024-08-19T00:46:17.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.811+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3280ce940 con 0x7fb3280ce500 2024-08-19T00:46:17.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.812+0000 7fb325600640 1 -- 172.21.15.7:0/2034042416 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb31c012a10 con 0x7fb3280ce500 2024-08-19T00:46:17.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.813+0000 7fb325600640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb30806be30 0x7fb30806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:17.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.813+0000 7fb325600640 1 -- 172.21.15.7:0/2034042416 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7fb31c08b290 con 0x7fb3280ce500 2024-08-19T00:46:17.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.813+0000 7fb32d000640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb30806be30 0x7fb30806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:17.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.814+0000 7fb32d000640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb30806be30 0x7fb30806e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb314034000 tx=0x7fb31402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:17.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:17.818+0000 7fb325600640 1 -- 172.21.15.7:0/2034042416 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb31c058cf0 con 0x7fb3280ce500 2024-08-19T00:46:18.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.036+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb328160aa0 con 0x7fb3280ce500 2024-08-19T00:46:18.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.245+0000 7fb325600640 1 -- 172.21.15.7:0/2034042416 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v234) ==== 161+0+0 (secure 0 0 0) 0x7fb31c05cff0 con 0x7fb3280ce500 2024-08-19T00:46:18.247 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb30806be30 msgr2=0x7fb30806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb30806be30 0x7fb30806e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb314034000 tx=0x7fb31402e000 comp rx=0 tx=0).stop 2024-08-19T00:46:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3280ce500 msgr2=0x7fb328160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3280ce500 0x7fb328160560 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c500 tx=0x7fb31c00c9c0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 shutdown_connections 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb30806be30 0x7fb30806e2f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb328159bf0 0x7fb3281574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3280d03c0 0x7fb328148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 --2- 172.21.15.7:0/2034042416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3280ce500 0x7fb328160560 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.248+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 >> 172.21.15.7:0/2034042416 conn(0x7fb32806bc70 msgr2=0x7fb3280cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.249+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 shutdown_connections 2024-08-19T00:46:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.249+0000 7fb330400640 1 -- 172.21.15.7:0/2034042416 wait complete. 2024-08-19T00:46:18.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:18.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.422+0000 7ffbd3c00640 1 Processor -- start 2024-08-19T00:46:18.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.422+0000 7ffbd3c00640 1 -- start start 2024-08-19T00:46:18.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd3c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0d03c0 0x7ffbcc071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:18.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd3c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffbcc06e710 0x7ffbcc0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:18.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd3c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbcc0d0ce0 con 0x7ffbcc0b3750 2024-08-19T00:46:18.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd3c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc0cebc0 con 0x7ffbcc06e710 2024-08-19T00:46:18.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd3c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffbcc0cdfb0 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd1c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffbcc0b3750 0x7ffbcc0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48764/0 (socket says 172.21.15.7:48764) 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd1c00640 1 -- 172.21.15.7:0/2313378335 learned_addr learned my addr 172.21.15.7:0/2313378335 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbcbe00640 1 --2- 172.21.15.7:0/2313378335 >> v2:172.21.15.162:3300/0 conn(0x7ffbcc06e710 0x7ffbcc0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbd1200640 1 --2- 172.21.15.7:0/2313378335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0d03c0 0x7ffbcc071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbcb400640 1 -- 172.21.15.7:0/2313378335 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352366237 0 0) 0x7ffbcc0d0ce0 con 0x7ffbcc0b3750 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.424+0000 7ffbcb400640 1 -- 172.21.15.7:0/2313378335 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbb4003520 con 0x7ffbcc0b3750 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.425+0000 7ffbd1200640 1 -- 172.21.15.7:0/2313378335 >> v2:172.21.15.162:3300/0 conn(0x7ffbcc06e710 msgr2=0x7ffbcc0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.425+0000 7ffbd1200640 1 --2- 172.21.15.7:0/2313378335 >> v2:172.21.15.162:3300/0 conn(0x7ffbcc06e710 0x7ffbcc0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.425+0000 7ffbd1200640 1 -- 172.21.15.7:0/2313378335 >> v1:172.21.15.7:6789/0 conn(0x7ffbcc0b3750 legacy=0x7ffbcc0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.425+0000 7ffbd1200640 1 -- 172.21.15.7:0/2313378335 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc0ce290 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.425+0000 7ffbcbe00640 1 --2- 172.21.15.7:0/2313378335 >> v2:172.21.15.162:3300/0 conn(0x7ffbcc06e710 0x7ffbcc0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:18.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.426+0000 7ffbd1200640 1 --2- 172.21.15.7:0/2313378335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0d03c0 0x7ffbcc071980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00097a0 tx=0x7ffbc002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2146a148c2f35de3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.426+0000 7ffbcb400640 1 -- 172.21.15.7:0/2313378335 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0037070 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.426+0000 7ffbcb400640 1 -- 172.21.15.7:0/2313378335 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc0032440 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.426+0000 7ffbcb400640 1 -- 172.21.15.7:0/2313378335 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0032810 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 -- 172.21.15.7:0/2313378335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0d03c0 msgr2=0x7ffbcc071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/2313378335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0d03c0 0x7ffbcc071980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00097a0 tx=0x7ffbc002a180 comp rx=0 tx=0).stop 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 -- 172.21.15.7:0/2313378335 shutdown_connections 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/2313378335 >> v2:172.21.15.162:3300/0 conn(0x7ffbcc06e710 0x7ffbcc0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/2313378335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0d03c0 0x7ffbcc071980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 -- 172.21.15.7:0/2313378335 >> 172.21.15.7:0/2313378335 conn(0x7ffbcc06bc70 msgr2=0x7ffbcc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 -- 172.21.15.7:0/2313378335 shutdown_connections 2024-08-19T00:46:18.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.427+0000 7ffbd3c00640 1 -- 172.21.15.7:0/2313378335 wait complete. 2024-08-19T00:46:18.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.428+0000 7ffbd3c00640 1 Processor -- start 2024-08-19T00:46:18.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.429+0000 7ffbd3c00640 1 -- start start 2024-08-19T00:46:18.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.429+0000 7ffbd3c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbcc06e710 0x7ffbcc1f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:18.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.429+0000 7ffbd3c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0b3750 0x7ffbcc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:18.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.429+0000 7ffbd3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbcc0d03c0 0x7ffbcc06df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:18.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd3c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc073ae0 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd3c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc0ce850 con 0x7ffbcc06e710 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd3c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffbcc073c60 con 0x7ffbcc0b3750 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbcc0d03c0 0x7ffbcc06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbcc0d03c0 0x7ffbcc06df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53650/0 (socket says 172.21.15.7:53650) 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 -- 172.21.15.7:0/1429094255 learned_addr learned my addr 172.21.15.7:0/1429094255 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1200640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbcc06e710 0x7ffbcc1f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbcbe00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0b3750 0x7ffbcc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 -- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0b3750 msgr2=0x7ffbcc06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0b3750 0x7ffbcc06d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 -- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbcc06e710 msgr2=0x7ffbcc1f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbcc06e710 0x7ffbcc1f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.430+0000 7ffbd1c00640 1 -- 172.21.15.7:0/1429094255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc1efd50 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.431+0000 7ffbd1c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbcc0d03c0 0x7ffbcc06df20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400cb40 tx=0x7ffbc400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.431+0000 7ffbc8c00640 1 -- 172.21.15.7:0/1429094255 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4017070 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.431+0000 7ffbc8c00640 1 -- 172.21.15.7:0/1429094255 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc400aca0 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.431+0000 7ffbc8c00640 1 -- 172.21.15.7:0/1429094255 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4012620 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.431+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc1f0030 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.431+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc1f05f0 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.432+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc0b3be0 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.433+0000 7ffbc8c00640 1 -- 172.21.15.7:0/1429094255 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbc401a070 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.434+0000 7ffbc8c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffbac06be30 0x7ffbac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.434+0000 7ffbc8c00640 1 -- 172.21.15.7:0/1429094255 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7ffbc408b4a0 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.434+0000 7ffbd1200640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffbac06be30 0x7ffbac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.434+0000 7ffbd1200640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffbac06be30 0x7ffbac06e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0034000 tx=0x7ffbc002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.438+0000 7ffbc8c00640 1 -- 172.21.15.7:0/1429094255 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ffbc4058f80 con 0x7ffbcc0d03c0 2024-08-19T00:46:18.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:18.695+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7ffbcc0d07a0 con 0x7ffbcc0d03c0 2024-08-19T00:46:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.251+0000 7ffbc8c00640 1 -- 172.21.15.7:0/1429094255 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v235) ==== 101+0+0 (secure 0 0 0) 0x7ffbc405d280 con 0x7ffbcc0d03c0 2024-08-19T00:46:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffbac06be30 msgr2=0x7ffbac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffbac06be30 0x7ffbac06e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0034000 tx=0x7ffbc002e000 comp rx=0 tx=0).stop 2024-08-19T00:46:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbcc0d03c0 msgr2=0x7ffbcc06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbcc0d03c0 0x7ffbcc06df20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400cb40 tx=0x7ffbc400a060 comp rx=0 tx=0).stop 2024-08-19T00:46:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 shutdown_connections 2024-08-19T00:46:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffbac06be30 0x7ffbac06e2f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbcc0d03c0 0x7ffbcc06df20 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbcc0b3750 0x7ffbcc06d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 --2- 172.21.15.7:0/1429094255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbcc06e710 0x7ffbcc1f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 >> 172.21.15.7:0/1429094255 conn(0x7ffbcc06bc70 msgr2=0x7ffbcc0ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 shutdown_connections 2024-08-19T00:46:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.254+0000 7ffbd3c00640 1 -- 172.21.15.7:0/1429094255 wait complete. 2024-08-19T00:46:19.274 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:19.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.351+0000 7f7cf9af6f40 1 Processor -- start 2024-08-19T00:46:19.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.352+0000 7f7cf9af6f40 1 -- start start 2024-08-19T00:46:19.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.352+0000 7f7cf9af6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.352+0000 7f7cf9af6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d0dcb90 0x55b19d1943a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.352+0000 7f7cf9af6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d195ff0 0x55b19d2437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.352+0000 7f7cf9af6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b19d125450 con 0x55b19d0dcb90 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.352+0000 7f7cf9af6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b19d080d00 con 0x55b19d0db380 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.352+0000 7f7cf9af6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b19d0dc0b0 con 0x55b19d195ff0 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d0dcb90 0x55b19d1943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d0dcb90 0x55b19d1943a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53656/0 (socket says 172.21.15.7:53656) 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 -- 172.21.15.7:0/3089706571 learned_addr learned my addr 172.21.15.7:0/3089706571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf7600640 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d195ff0 0x55b19d2437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 -- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d195ff0 msgr2=0x55b19d2437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d195ff0 0x55b19d2437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 -- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 msgr2=0x55b19d1af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf6200640 1 -- 172.21.15.7:0/3089706571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19d005b30 con 0x55b19d0dcb90 2024-08-19T00:46:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.353+0000 7f7cf7600640 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d195ff0 0x55b19d2437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf6200640 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d0dcb90 0x55b19d1943a0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009920 tx=0x7f7ce4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1083321bec44ae server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf4e00640 1 -- 172.21.15.7:0/3089706571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40089b0 con 0x55b19d0dcb90 2024-08-19T00:46:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf4e00640 1 -- 172.21.15.7:0/3089706571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce4018070 con 0x55b19d0dcb90 2024-08-19T00:46:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf4e00640 1 -- 172.21.15.7:0/3089706571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4008d50 con 0x55b19d0dcb90 2024-08-19T00:46:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/3089706571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d0dcb90 msgr2=0x55b19d1943a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d0dcb90 0x55b19d1943a0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009920 tx=0x7f7ce4005a00 comp rx=0 tx=0).stop 2024-08-19T00:46:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/3089706571 shutdown_connections 2024-08-19T00:46:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d195ff0 0x55b19d2437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d0dcb90 0x55b19d1943a0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/3089706571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/3089706571 >> 172.21.15.7:0/3089706571 conn(0x55b19d1075d0 msgr2=0x55b19d193a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/3089706571 shutdown_connections 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.354+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/3089706571 wait complete. 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.355+0000 7f7cf9af6f40 1 Processor -- start 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.355+0000 7f7cf9af6f40 1 -- start start 2024-08-19T00:46:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf9af6f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf9af6f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d0dcb90 0x55b19d197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf9af6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d195ff0 0x55b19d1acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf9af6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b19d198510 con 0x55b19d195ff0 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf9af6f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b19d1967c0 con 0x55b19d0db380 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf9af6f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b19d190450 con 0x55b19d0dcb90 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d195ff0 0x55b19d1acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d195ff0 0x55b19d1acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53660/0 (socket says 172.21.15.7:53660) 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.356+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 learned_addr learned my addr 172.21.15.7:0/1721745748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf6200640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d0dcb90 0x55b19d197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d0dcb90 msgr2=0x55b19d197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf7600640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b19d0dcb90 0x55b19d197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 msgr2=0x55b19d1ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf7600640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19d042080 con 0x55b19d195ff0 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b19d0db380 0x55b19d1ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cf7600640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d195ff0 0x55b19d1acba0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0004e60 tx=0x7f7cf00018e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cef400640 1 -- 172.21.15.7:0/1721745748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0018070 con 0x55b19d195ff0 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cef400640 1 -- 172.21.15.7:0/1721745748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf0013480 con 0x55b19d195ff0 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.357+0000 7f7cef400640 1 -- 172.21.15.7:0/1721745748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0013830 con 0x55b19d195ff0 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.358+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b19d190730 con 0x55b19d195ff0 2024-08-19T00:46:19.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.358+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19d190cf0 con 0x55b19d195ff0 2024-08-19T00:46:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.360+0000 7f7cef400640 1 -- 172.21.15.7:0/1721745748 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cf001b070 con 0x55b19d195ff0 2024-08-19T00:46:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.360+0000 7f7cef400640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cd806a840 0x7f7cd806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.360+0000 7f7cef400640 1 -- 172.21.15.7:0/1721745748 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7f7cf0089aa0 con 0x55b19d195ff0 2024-08-19T00:46:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.361+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cd806a840 0x7f7cd806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.364 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:19.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.361+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b19d1ad8f0 0x55b19d120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.361+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d197f50 con 0x55b19d1ad8f0 2024-08-19T00:46:19.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.361+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cd806a840 0x7f7cd806cd00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8057000 tx=0x7f7ce8052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.361+0000 7f7cf6200640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b19d1ad8f0 0x55b19d120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.362+0000 7f7cf6200640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b19d1ad8f0 0x55b19d120580 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.364+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v111'753 uv727 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.364+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d120ac0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.366+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v111'754 uv754 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.366+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d120f20 con 0x55b19d1ad8f0 2024-08-19T00:46:19.369 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.367+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v111'755 uv755 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.367+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d254fc0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.369+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v111'756 uv756 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.369+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d255360 con 0x55b19d1ad8f0 2024-08-19T00:46:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.371+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v111'757 uv757 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.371+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d253fb0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.372+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v111'758 uv758 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.372+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d254350 con 0x55b19d1ad8f0 2024-08-19T00:46:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.374+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v111'759 uv733 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.374+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.375+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v111'760 uv760 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.375+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.377+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v111'761 uv761 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.378 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.377+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.378+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v111'762 uv762 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.378+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.380+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v111'763 uv763 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.380+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.381+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v111'764 uv764 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.381+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.383+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v111'765 uv740 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.383+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.385+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v111'766 uv766 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.385+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.386+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v111'767 uv767 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.388 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.386+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.387+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v111'768 uv768 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.388+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.389+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v111'769 uv769 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.389+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2546f0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.390+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v111'770 uv770 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.391+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d254af0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.392+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v111'771 uv771 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.392+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d254af0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.394+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v111'772 uv746 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.394+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d254af0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.395+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v111'773 uv773 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.395+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d254af0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.397+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v111'774 uv774 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.398 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.397+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.398+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v111'775 uv775 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.398+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.400+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v111'776 uv776 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.400+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.401+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v111'777 uv777 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.401+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.403+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v111'778 uv752 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.403+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.404+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v111'779 uv779 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.404+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.407 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:19.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.406+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v111'780 uv780 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.406+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.407+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v111'781 uv781 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.407+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.409+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v111'782 uv782 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.409+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.410+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v111'783 uv783 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.410+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b19d255c10 0x55b19d258000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.410+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2549b0 con 0x55b19d255c10 2024-08-19T00:46:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.411+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b19d255c10 0x55b19d258000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.411+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b19d255c10 0x55b19d258000 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.413+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v111'549 uv531 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.413+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d258540 con 0x55b19d255c10 2024-08-19T00:46:19.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.415+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v111'550 uv550 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.415+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2588e0 con 0x55b19d255c10 2024-08-19T00:46:19.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.416+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v111'551 uv551 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.418 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.416+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d259180 con 0x55b19d255c10 2024-08-19T00:46:19.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.418+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v111'552 uv552 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.418+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d259520 con 0x55b19d255c10 2024-08-19T00:46:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.420+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v111'553 uv553 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.420+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2598c0 con 0x55b19d255c10 2024-08-19T00:46:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.422+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v111'554 uv548 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.422+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d259c60 con 0x55b19d255c10 2024-08-19T00:46:19.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.423+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v111'555 uv555 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.423+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a050 con 0x55b19d255c10 2024-08-19T00:46:19.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.425+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v111'556 uv556 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.427 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:19.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.425+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a050 con 0x55b19d255c10 2024-08-19T00:46:19.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.427+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v111'557 uv557 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.427+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.428+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v111'558 uv558 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.429+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.430+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v111'559 uv541 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.430+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.432+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v111'560 uv560 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.432+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.435 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.434+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v111'561 uv561 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.434+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25e730 con 0x55b19d255c10 2024-08-19T00:46:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.436+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v111'562 uv562 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.436+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25e6f0 con 0x55b19d255c10 2024-08-19T00:46:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.437+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v111'563 uv563 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.437+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.439+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v111'564 uv547 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.439+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.441+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v111'565 uv565 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.441+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.443 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.442+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v111'566 uv566 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.442+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25b070 con 0x55b19d255c10 2024-08-19T00:46:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.443+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v111'567 uv567 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.443+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25b030 con 0x55b19d255c10 2024-08-19T00:46:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.445+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v111'568 uv568 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.445+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d255c10 2024-08-19T00:46:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.446+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v111'569 uv569 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d255c10 2024-08-19T00:46:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.446+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b19d25a8d0 0x55b19d25d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.446+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d25a8d0 2024-08-19T00:46:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.447+0000 7f7cf6200640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b19d25a8d0 0x55b19d25d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.448+0000 7f7cf6200640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b19d25a8d0 0x55b19d25d480 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.449+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v111'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.449+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d25a8d0 2024-08-19T00:46:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.451+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v111'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.451+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d25a8d0 2024-08-19T00:46:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.452+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v111'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.453 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.452+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d25a8d0 2024-08-19T00:46:19.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.453+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v111'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.453+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d25a8d0 2024-08-19T00:46:19.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.455+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v111'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.455+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d25a8d0 2024-08-19T00:46:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.456+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v111'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.456+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d1ad8f0 2024-08-19T00:46:19.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.458+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v111'108 uv107 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.458+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d1ad8f0 2024-08-19T00:46:19.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.459+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v111'109 uv109 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.459+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d1ad8f0 2024-08-19T00:46:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.461+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v111'110 uv110 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.462 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.461+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d25a000 con 0x55b19d1ad8f0 2024-08-19T00:46:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.462+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v111'111 uv111 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.462+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b19d25df90 0x55b19d260380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.462+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2608c0 con 0x55b19d25df90 2024-08-19T00:46:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.463+0000 7f7cf7600640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b19d25df90 0x55b19d260380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.463+0000 7f7cf7600640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b19d25df90 0x55b19d260380 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.465+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v111'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.465+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d260c60 con 0x55b19d25df90 2024-08-19T00:46:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.466+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v111'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.466+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d261100 con 0x55b19d25df90 2024-08-19T00:46:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.468+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v111'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.470 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.468+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2629b0 con 0x55b19d25df90 2024-08-19T00:46:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.470+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v111'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.470+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d262d50 con 0x55b19d25df90 2024-08-19T00:46:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.472+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v111'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.472+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2619a0 con 0x55b19d25df90 2024-08-19T00:46:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.473+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v111'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.474+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b19d2622c0 0x55b19d265100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.474+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265640 con 0x55b19d2622c0 2024-08-19T00:46:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.474+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b19d2622c0 0x55b19d265100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.474+0000 7f7cf6c00640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b19d2622c0 0x55b19d265100 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.476+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v111'271 uv265 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.476+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265640 con 0x55b19d2622c0 2024-08-19T00:46:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.477+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v111'272 uv272 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.477+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265680 con 0x55b19d2622c0 2024-08-19T00:46:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.478+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v111'273 uv273 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.480 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.478+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d266ab0 con 0x55b19d2622c0 2024-08-19T00:46:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.480+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v111'274 uv274 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.480+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d266ab0 con 0x55b19d2622c0 2024-08-19T00:46:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.481+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v111'275 uv275 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.482+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265aa0 con 0x55b19d2622c0 2024-08-19T00:46:19.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.483+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v111'276 uv276 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.483+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265aa0 con 0x55b19d2622c0 2024-08-19T00:46:19.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.484+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v111'277 uv270 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.484+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265aa0 con 0x55b19d2622c0 2024-08-19T00:46:19.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.486+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v111'278 uv278 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.486+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265aa0 con 0x55b19d2622c0 2024-08-19T00:46:19.489 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:19.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.487+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v111'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.487+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265aa0 con 0x55b19d2622c0 2024-08-19T00:46:19.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.488+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v111'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.489+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d265aa0 con 0x55b19d2622c0 2024-08-19T00:46:19.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.490+0000 7f7cf6c00640 1 -- 172.21.15.7:0/1721745748 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v111'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce8065070 con 0x55b19d2622c0 2024-08-19T00:46:19.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.490+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b19d265fb0 0x55b19d2683a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.490+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2689d0 con 0x55b19d265fb0 2024-08-19T00:46:19.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.491+0000 7f7cf6200640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b19d265fb0 0x55b19d2683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.491+0000 7f7cf6200640 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b19d265fb0 0x55b19d2683a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.493+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v111'122 uv121 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.493+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2689d0 con 0x55b19d265fb0 2024-08-19T00:46:19.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.494+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v111'123 uv123 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.494+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d265fb0 2024-08-19T00:46:19.497 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.495+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v111'124 uv124 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.495+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d265fb0 2024-08-19T00:46:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.497+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v111'125 uv125 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.497+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d265fb0 2024-08-19T00:46:19.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.498+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v111'126 uv126 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.498+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d1ad8f0 2024-08-19T00:46:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.501+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v111'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.501+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d1ad8f0 2024-08-19T00:46:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.502+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v111'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.502+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d1ad8f0 2024-08-19T00:46:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.505+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v111'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.507 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.505+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269e30 con 0x55b19d1ad8f0 2024-08-19T00:46:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.507+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v111'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.507+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269e30 con 0x55b19d1ad8f0 2024-08-19T00:46:19.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.508+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v111'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.508+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d1ad8f0 2024-08-19T00:46:19.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.509+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v111'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d1ad8f0 2024-08-19T00:46:19.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.509+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.511+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v111'243 uv237 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.511+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.512+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v111'244 uv244 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.512+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.515 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.514+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v111'245 uv245 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.514+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.516+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v111'246 uv246 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.516+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.517+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v111'247 uv247 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.517+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.519+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v111'248 uv242 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.519+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.520+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v111'249 uv249 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.521+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:19.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.522+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v111'250 uv250 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.522+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d268e20 con 0x55b19d25a8d0 2024-08-19T00:46:19.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.524+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v111'251 uv251 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.524+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d26bc30 con 0x55b19d25a8d0 2024-08-19T00:46:19.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.525+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v111'252 uv252 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d25a8d0 2024-08-19T00:46:19.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.525+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d2692d0 con 0x55b19d25df90 2024-08-19T00:46:19.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.527+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v111'107 uv106 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.527+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d25df90 2024-08-19T00:46:19.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.528+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v111'108 uv108 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.528+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d25df90 2024-08-19T00:46:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:19.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.530+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v111'109 uv109 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.530+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d25df90 2024-08-19T00:46:19.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.531+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v111'110 uv110 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.531+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d25df90 2024-08-19T00:46:19.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.533+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v111'147 uv146 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.533+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d25df90 2024-08-19T00:46:19.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.535+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v111'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.535+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d25df90 2024-08-19T00:46:19.537 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:19.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.536+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v111'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.536+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d26a680 con 0x55b19d25df90 2024-08-19T00:46:19.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.538+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v111'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.538+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d26a680 con 0x55b19d25df90 2024-08-19T00:46:19.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.540+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v111'151 uv151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.540+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d25df90 2024-08-19T00:46:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.541+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v111'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7cf001a030 con 0x55b19d25df90 2024-08-19T00:46:19.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.541+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.543+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v111'125 uv124 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.543+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.544+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v111'126 uv126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.544+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.547 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.545+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v111'127 uv127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.545+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.546+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v111'128 uv128 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.547+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.548+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v111'129 uv129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.548+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.550+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v111'302 uv294 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.550+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.551+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v111'303 uv303 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.551+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.552+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v111'304 uv304 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.554 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.552+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.554+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v111'305 uv305 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.554+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.555+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v111'306 uv306 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.555+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.557+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v111'307 uv301 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.557+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.558+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v111'308 uv308 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.558+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.559+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v111'309 uv309 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.561 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:19.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.559+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.561+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v111'310 uv310 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.561+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.562+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v111'311 uv311 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.562+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269670 con 0x55b19d265fb0 2024-08-19T00:46:19.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.564+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v111'312 uv312 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.564+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x55b19d269f10 con 0x55b19d265fb0 2024-08-19T00:46:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf6200640 1 -- 172.21.15.7:0/1721745748 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v111'313 uv313 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f7ce40087b0 con 0x55b19d265fb0 2024-08-19T00:46:19.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b19d255c10 msgr2=0x55b19d258000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b19d255c10 0x55b19d258000 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b19d2622c0 msgr2=0x55b19d265100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b19d2622c0 0x55b19d265100 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b19d265fb0 msgr2=0x55b19d2683a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b19d265fb0 0x55b19d2683a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b19d25a8d0 msgr2=0x55b19d25d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b19d25a8d0 0x55b19d25d480 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 reap_dead start 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b19d1ad8f0 msgr2=0x55b19d120580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b19d1ad8f0 0x55b19d120580 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf7600640 1 -- 172.21.15.7:0/1721745748 reap_dead start 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b19d25df90 msgr2=0x55b19d260380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.565+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b19d25df90 0x55b19d260380 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cd806a840 msgr2=0x7f7cd806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cd806a840 0x7f7cd806cd00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8057000 tx=0x7f7ce8052000 comp rx=0 tx=0).stop 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d195ff0 msgr2=0x55b19d1acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d195ff0 0x55b19d1acba0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0004e60 tx=0x7f7cf00018e0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 shutdown_connections 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7cd806a840 0x7f7cd806cd00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b19d195ff0 0x55b19d1acba0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 --2- 172.21.15.7:0/1721745748 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b19d25df90 0x55b19d260380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 >> 172.21.15.7:0/1721745748 conn(0x55b19d1075d0 msgr2=0x55b19d1943a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 shutdown_connections 2024-08-19T00:46:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.566+0000 7f7cf9af6f40 1 -- 172.21.15.7:0/1721745748 wait complete. 2024-08-19T00:46:19.572 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 200.00000001 0 2024-08-19T00:46:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.687+0000 7fc60a72af40 1 Processor -- start 2024-08-19T00:46:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.688+0000 7fc60a72af40 1 -- start start 2024-08-19T00:46:19.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.688+0000 7fc60a72af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330b650 0x557dc33a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.688+0000 7fc60a72af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c5b0 0x557dc33a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.688+0000 7fc60a72af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330c990 0x557dc3307230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.688+0000 7fc60a72af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557dc3280d00 con 0x557dc330c990 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.688+0000 7fc60a72af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557dc3284d40 con 0x557dc330c5b0 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.688+0000 7fc60a72af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557dc33b1dc0 con 0x557dc330b650 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330c990 0x557dc3307230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330c990 0x557dc3307230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53674/0 (socket says 172.21.15.7:53674) 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 -- 172.21.15.7:0/1619696262 learned_addr learned my addr 172.21.15.7:0/1619696262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc606400640 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c5b0 0x557dc33a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc606e00640 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330b650 0x557dc33a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 -- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330b650 msgr2=0x557dc33a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330b650 0x557dc33a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 -- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c5b0 msgr2=0x557dc33a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c5b0 0x557dc33a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc607800640 1 -- 172.21.15.7:0/1619696262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc3242080 con 0x557dc330c990 2024-08-19T00:46:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.689+0000 7fc606400640 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c5b0 0x557dc33a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc607800640 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330c990 0x557dc3307230 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc600058040 tx=0x7fc600051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b58800d91443ae server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc605000640 1 -- 172.21.15.7:0/1619696262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600056b70 con 0x557dc330c990 2024-08-19T00:46:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc605000640 1 -- 172.21.15.7:0/1619696262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600056d10 con 0x557dc330c990 2024-08-19T00:46:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc605000640 1 -- 172.21.15.7:0/1619696262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600060670 con 0x557dc330c990 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc60a72af40 1 -- 172.21.15.7:0/1619696262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330c990 msgr2=0x557dc3307230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc60a72af40 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330c990 0x557dc3307230 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc600058040 tx=0x7fc600051000 comp rx=0 tx=0).stop 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc60a72af40 1 -- 172.21.15.7:0/1619696262 shutdown_connections 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc60a72af40 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330c990 0x557dc3307230 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc60a72af40 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c5b0 0x557dc33a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc60a72af40 1 --2- 172.21.15.7:0/1619696262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330b650 0x557dc33a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.690+0000 7fc60a72af40 1 -- 172.21.15.7:0/1619696262 >> 172.21.15.7:0/1619696262 conn(0x557dc33094e0 msgr2=0x557dc32d96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.691+0000 7fc60a72af40 1 -- 172.21.15.7:0/1619696262 shutdown_connections 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.691+0000 7fc60a72af40 1 -- 172.21.15.7:0/1619696262 wait complete. 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.691+0000 7fc60a72af40 1 Processor -- start 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.692+0000 7fc60a72af40 1 -- start start 2024-08-19T00:46:19.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.692+0000 7fc60a72af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330b650 0x557dc339f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.692+0000 7fc60a72af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330c5b0 0x557dc33adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.692+0000 7fc60a72af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c990 0x557dc33a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.692+0000 7fc60a72af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557dc33b2ef0 con 0x557dc330b650 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.692+0000 7fc60a72af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557dc33b26f0 con 0x557dc330c990 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.692+0000 7fc60a72af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557dc32da710 con 0x557dc330c5b0 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330b650 0x557dc339f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330b650 0x557dc339f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53688/0 (socket says 172.21.15.7:53688) 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 -- 172.21.15.7:0/704646175 learned_addr learned my addr 172.21.15.7:0/704646175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc607800640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c990 0x557dc33a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606400640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330c5b0 0x557dc33adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 -- 172.21.15.7:0/704646175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330c5b0 msgr2=0x557dc33adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557dc330c5b0 0x557dc33adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 -- 172.21.15.7:0/704646175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c990 msgr2=0x557dc33a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c990 0x557dc33a2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 -- 172.21.15.7:0/704646175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc33abf80 con 0x557dc330b650 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc607800640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dc330c990 0x557dc33a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.693+0000 7fc606e00640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330b650 0x557dc339f430 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800df70 tx=0x7fc5f800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.694+0000 7fc5ff400640 1 -- 172.21.15.7:0/704646175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80032d0 con 0x557dc330b650 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.694+0000 7fc5ff400640 1 -- 172.21.15.7:0/704646175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f8016070 con 0x557dc330b650 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.694+0000 7fc5ff400640 1 -- 172.21.15.7:0/704646175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80016f0 con 0x557dc330b650 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.694+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557dc33ac260 con 0x557dc330b650 2024-08-19T00:46:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.694+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc33b3b60 con 0x557dc330b650 2024-08-19T00:46:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.696+0000 7fc5ff400640 1 -- 172.21.15.7:0/704646175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5f8001890 con 0x557dc330b650 2024-08-19T00:46:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.697+0000 7fc5ff400640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5e806a810 0x7fc5e806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.697+0000 7fc5ff400640 1 -- 172.21.15.7:0/704646175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7fc5f808a350 con 0x557dc330b650 2024-08-19T00:46:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.697+0000 7fc606400640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5e806a810 0x7fc5e806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.697+0000 7fc60a72af40 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dc33a0be0 0x557dc33a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.697+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:1 12.14 12:2e2fa760:::200.00000001:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) -- 0x557dc33a1500 con 0x557dc33a0be0 2024-08-19T00:46:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.697+0000 7fc607800640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dc33a0be0 0x557dc33a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.698+0000 7fc606400640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5e806a810 0x7fc5e806ccd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x557dc3326980 tx=0x7fc5f4001770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.698+0000 7fc607800640 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dc33a0be0 0x557dc33a0fc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.699+0000 7fc607800640 1 -- 172.21.15.7:0/704646175 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(1 200.00000001 [truncate 0] v111'570 uv570 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc600068070 con 0x557dc33a0be0 2024-08-19T00:46:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dc33a0be0 msgr2=0x557dc33a0fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x557dc33a0be0 0x557dc33a0fc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5e806a810 msgr2=0x7fc5e806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc5e806a810 0x7fc5e806ccd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x557dc3326980 tx=0x7fc5f4001770 comp rx=0 tx=0).stop 2024-08-19T00:46:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330b650 msgr2=0x557dc339f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 --2- 172.21.15.7:0/704646175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dc330b650 0x557dc339f430 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800df70 tx=0x7fc5f800b5b0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc607800640 1 -- 172.21.15.7:0/704646175 reap_dead start 2024-08-19T00:46:19.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 shutdown_connections 2024-08-19T00:46:19.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 >> 172.21.15.7:0/704646175 conn(0x557dc33094e0 msgr2=0x557dc33a3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:19.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 shutdown_connections 2024-08-19T00:46:19.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.700+0000 7fc60a72af40 1 -- 172.21.15.7:0/704646175 wait complete. 2024-08-19T00:46:19.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.864+0000 7f567cc00640 1 Processor -- start 2024-08-19T00:46:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.864+0000 7f567cc00640 1 -- start start 2024-08-19T00:46:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.865+0000 7f567cc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56780b5130 0x7f56780aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.865+0000 7f567cc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56780acef0 con 0x7f567815c390 2024-08-19T00:46:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.865+0000 7f567cc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56780ad1d0 con 0x7f567815bfb0 2024-08-19T00:46:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.865+0000 7f567cc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f56780ad790 con 0x7f56780b5130 2024-08-19T00:46:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5676800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f567815c390 0x7f5678072040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48788/0 (socket says 172.21.15.7:48788) 2024-08-19T00:46:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5676800640 1 -- 172.21.15.7:0/2936912848 learned_addr learned my addr 172.21.15.7:0/2936912848 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5675400640 1 --2- 172.21.15.7:0/2936912848 >> v2:172.21.15.162:3300/0 conn(0x7f56780b5130 0x7f56780aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5674a00640 1 -- 172.21.15.7:0/2936912848 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726325547 0 0) 0x7f56780acef0 con 0x7f567815c390 2024-08-19T00:46:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5674a00640 1 -- 172.21.15.7:0/2936912848 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f565c003520 con 0x7f567815c390 2024-08-19T00:46:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5674a00640 1 -- 172.21.15.7:0/2936912848 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563906295 0 0) 0x7f56780ad1d0 con 0x7f567815bfb0 2024-08-19T00:46:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5674a00640 1 -- 172.21.15.7:0/2936912848 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56780acef0 con 0x7f567815bfb0 2024-08-19T00:46:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5675400640 1 -- 172.21.15.7:0/2936912848 >> v1:172.21.15.162:6789/0 conn(0x7f567815bfb0 legacy=0x7f56780b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5675400640 1 -- 172.21.15.7:0/2936912848 >> v1:172.21.15.7:6789/0 conn(0x7f567815c390 legacy=0x7f5678072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.866+0000 7f5675400640 1 -- 172.21.15.7:0/2936912848 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56780ad4b0 con 0x7f56780b5130 2024-08-19T00:46:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f5675400640 1 --2- 172.21.15.7:0/2936912848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 0x7f56780aebd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f56640097a0 tx=0x7f566402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da58185a31f0ca1e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f5674a00640 1 -- 172.21.15.7:0/2936912848 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664037070 con 0x7f56780b5130 2024-08-19T00:46:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f5674a00640 1 -- 172.21.15.7:0/2936912848 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5664032440 con 0x7f56780b5130 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f5674a00640 1 -- 172.21.15.7:0/2936912848 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56640327f0 con 0x7f56780b5130 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f567cc00640 1 -- 172.21.15.7:0/2936912848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 msgr2=0x7f56780aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f567cc00640 1 --2- 172.21.15.7:0/2936912848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 0x7f56780aebd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f56640097a0 tx=0x7f566402a230 comp rx=0 tx=0).stop 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f567cc00640 1 -- 172.21.15.7:0/2936912848 shutdown_connections 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f567cc00640 1 --2- 172.21.15.7:0/2936912848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 0x7f56780aebd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.868+0000 7f567cc00640 1 -- 172.21.15.7:0/2936912848 >> 172.21.15.7:0/2936912848 conn(0x7f56780b2300 msgr2=0x7f567806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.869+0000 7f567cc00640 1 -- 172.21.15.7:0/2936912848 shutdown_connections 2024-08-19T00:46:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.869+0000 7f567cc00640 1 -- 172.21.15.7:0/2936912848 wait complete. 2024-08-19T00:46:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.870+0000 7f567cc00640 1 Processor -- start 2024-08-19T00:46:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.870+0000 7f567cc00640 1 -- start start 2024-08-19T00:46:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.871+0000 7f567cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 0x7f567815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.871+0000 7f567cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f567815bfb0 0x7f567815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.871+0000 7f567cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567815c390 0x7f56781f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.871+0000 7f567cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56780af290 con 0x7f567815c390 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.871+0000 7f567cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56780af110 con 0x7f56780b5130 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.871+0000 7f567cc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56780af410 con 0x7f567815bfb0 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.871+0000 7f5676800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567815c390 0x7f56781f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567815c390 0x7f56781f77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53700/0 (socket says 172.21.15.7:53700) 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 -- 172.21.15.7:0/1760711952 learned_addr learned my addr 172.21.15.7:0/1760711952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5675400640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f567815bfb0 0x7f567815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5675e00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 0x7f567815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 -- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f567815bfb0 msgr2=0x7f567815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f567815bfb0 0x7f567815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 -- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 msgr2=0x7f567815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 0x7f567815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 -- 172.21.15.7:0/1760711952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567815f7f0 con 0x7f567815c390 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.872+0000 7f5676800640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567815c390 0x7f56781f77e0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f567000caf0 tx=0x7f567000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.873+0000 7f566e000640 1 -- 172.21.15.7:0/1760711952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670017070 con 0x7f567815c390 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.873+0000 7f566e000640 1 -- 172.21.15.7:0/1760711952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567000aca0 con 0x7f567815c390 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.873+0000 7f566e000640 1 -- 172.21.15.7:0/1760711952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670012620 con 0x7f567815c390 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.873+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567815cb10 con 0x7f567815c390 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.873+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567815d0d0 con 0x7f567815c390 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.874+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56781581e0 con 0x7f567815c390 2024-08-19T00:46:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.875+0000 7f566e000640 1 -- 172.21.15.7:0/1760711952 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f567001a070 con 0x7f567815c390 2024-08-19T00:46:19.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.876+0000 7f566e000640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f565806be30 0x7f565806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:19.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.876+0000 7f566e000640 1 -- 172.21.15.7:0/1760711952 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 7859+0+0 (secure 0 0 0) 0x7f567008b3d0 con 0x7f567815c390 2024-08-19T00:46:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.876+0000 7f5675e00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f565806be30 0x7f565806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.877+0000 7f5675e00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f565806be30 0x7f565806e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5668007fd0 tx=0x7f5668009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:19.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:19.880+0000 7f566e000640 1 -- 172.21.15.7:0/1760711952 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5670058eb0 con 0x7f567815c390 2024-08-19T00:46:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.103+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f5678157a30 con 0x7f567815c390 2024-08-19T00:46:20.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.259+0000 7f566e000640 1 -- 172.21.15.7:0/1760711952 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v236) ==== 162+0+0 (secure 0 0 0) 0x7f567005d1b0 con 0x7f567815c390 2024-08-19T00:46:20.261 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.261+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f565806be30 msgr2=0x7f565806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.261+0000 7f567cc00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f565806be30 0x7f565806e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5668007fd0 tx=0x7f5668009040 comp rx=0 tx=0).stop 2024-08-19T00:46:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.261+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567815c390 msgr2=0x7f56781f77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.261+0000 7f567cc00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567815c390 0x7f56781f77e0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f567000caf0 tx=0x7f567000a060 comp rx=0 tx=0).stop 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 shutdown_connections 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f565806be30 0x7f565806e2f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567815c390 0x7f56781f77e0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f567815bfb0 0x7f567815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 --2- 172.21.15.7:0/1760711952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56780b5130 0x7f567815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 >> 172.21.15.7:0/1760711952 conn(0x7f56780b2300 msgr2=0x7f5678157320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 shutdown_connections 2024-08-19T00:46:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.262+0000 7f567cc00640 1 -- 172.21.15.7:0/1760711952 wait complete. 2024-08-19T00:46:20.274 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:46:20.273+0000 7fe10e400640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:46:20.275 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:20.274+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:20.275 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:20.274+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:20.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.439+0000 7fb499c00640 1 Processor -- start 2024-08-19T00:46:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.439+0000 7fb499c00640 1 -- start start 2024-08-19T00:46:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.440+0000 7fb499c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4940cd710 0x7fb49406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.440+0000 7fb499c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb4940cdb80 0x7fb49406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.440+0000 7fb499c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4940cfea0 con 0x7fb49415c070 2024-08-19T00:46:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.440+0000 7fb499c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb4940cd280 con 0x7fb4940cdb80 2024-08-19T00:46:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.440+0000 7fb499c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb4940ccc30 con 0x7fb4940cd710 2024-08-19T00:46:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb493e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb49415c070 0x7fb49409b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48790/0 (socket says 172.21.15.7:48790) 2024-08-19T00:46:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb493e00640 1 -- 172.21.15.7:0/2809491052 learned_addr learned my addr 172.21.15.7:0/2809491052 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb499200640 1 --2- 172.21.15.7:0/2809491052 >> v2:172.21.15.7:3300/0 conn(0x7fb4940cdb80 0x7fb49406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb48be00640 1 --2- 172.21.15.7:0/2809491052 >> v2:172.21.15.162:3300/0 conn(0x7fb4940cd710 0x7fb49406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb493400640 1 -- 172.21.15.7:0/2809491052 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983112345 0 0) 0x7fb4940cfea0 con 0x7fb49415c070 2024-08-19T00:46:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb499200640 1 -- 172.21.15.7:0/2809491052 >> v2:172.21.15.162:3300/0 conn(0x7fb4940cd710 msgr2=0x7fb49406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb499200640 1 --2- 172.21.15.7:0/2809491052 >> v2:172.21.15.162:3300/0 conn(0x7fb4940cd710 0x7fb49406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb499200640 1 -- 172.21.15.7:0/2809491052 >> v1:172.21.15.7:6789/0 conn(0x7fb49415c070 legacy=0x7fb49409b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.441+0000 7fb499200640 1 -- 172.21.15.7:0/2809491052 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4940ccf10 con 0x7fb4940cdb80 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.442+0000 7fb499200640 1 --2- 172.21.15.7:0/2809491052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb49406fee0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb4940c5600 tx=0x7fb48c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e11fd23a5bd5b60 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.442+0000 7fb493400640 1 -- 172.21.15.7:0/2809491052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c007740 con 0x7fb4940cdb80 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.442+0000 7fb493400640 1 -- 172.21.15.7:0/2809491052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c0078e0 con 0x7fb4940cdb80 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.442+0000 7fb493400640 1 -- 172.21.15.7:0/2809491052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c007cb0 con 0x7fb4940cdb80 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 -- 172.21.15.7:0/2809491052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 msgr2=0x7fb49406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 --2- 172.21.15.7:0/2809491052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb49406fee0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb4940c5600 tx=0x7fb48c02a680 comp rx=0 tx=0).stop 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 -- 172.21.15.7:0/2809491052 shutdown_connections 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 --2- 172.21.15.7:0/2809491052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb49406fee0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 --2- 172.21.15.7:0/2809491052 >> v2:172.21.15.162:3300/0 conn(0x7fb4940cd710 0x7fb49406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 -- 172.21.15.7:0/2809491052 >> 172.21.15.7:0/2809491052 conn(0x7fb4940b3a70 msgr2=0x7fb4940b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 -- 172.21.15.7:0/2809491052 shutdown_connections 2024-08-19T00:46:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.443+0000 7fb499c00640 1 -- 172.21.15.7:0/2809491052 wait complete. 2024-08-19T00:46:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.445+0000 7fb499c00640 1 Processor -- start 2024-08-19T00:46:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.445+0000 7fb499c00640 1 -- start start 2024-08-19T00:46:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb499c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4940cd710 0x7fb4940b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb499c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb494155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb499c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb49415c070 0x7fb494157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb499c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb49415c5d0 con 0x7fb4940cdb80 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb499c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb49415c450 con 0x7fb4940cd710 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb499c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4940b4750 con 0x7fb49415c070 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb48be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb494155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb48be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb494155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53708/0 (socket says 172.21.15.7:53708) 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb48be00640 1 -- 172.21.15.7:0/2668709263 learned_addr learned my addr 172.21.15.7:0/2668709263 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb493e00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4940cd710 0x7fb4940b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.446+0000 7fb499200640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb49415c070 0x7fb494157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb48be00640 1 -- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb49415c070 msgr2=0x7fb494157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb48be00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb49415c070 0x7fb494157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb48be00640 1 -- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4940cd710 msgr2=0x7fb4940b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb48be00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4940cd710 0x7fb4940b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb48be00640 1 -- 172.21.15.7:0/2668709263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb494155540 con 0x7fb4940cdb80 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb48be00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb494155000 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00d5f0 tx=0x7fb47c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb490c00640 1 -- 172.21.15.7:0/2668709263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0125f0 con 0x7fb4940cdb80 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb490c00640 1 -- 172.21.15.7:0/2668709263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb47c019070 con 0x7fb4940cdb80 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb490c00640 1 -- 172.21.15.7:0/2668709263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0129d0 con 0x7fb4940cdb80 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4940b5420 con 0x7fb4940cdb80 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.447+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4940b59e0 con 0x7fb4940cdb80 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.449+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4940cfea0 con 0x7fb4940cdb80 2024-08-19T00:46:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.449+0000 7fb490c00640 1 -- 172.21.15.7:0/2668709263 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb47c012b70 con 0x7fb4940cdb80 2024-08-19T00:46:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.450+0000 7fb490c00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb47006be30 0x7fb47006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.451+0000 7fb490c00640 1 -- 172.21.15.7:0/2668709263 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7fb47c08ba30 con 0x7fb4940cdb80 2024-08-19T00:46:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.451+0000 7fb493e00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb47006be30 0x7fb47006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.451+0000 7fb493e00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb47006be30 0x7fb47006e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb484007fd0 tx=0x7fb484007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.455+0000 7fb490c00640 1 -- 172.21.15.7:0/2668709263 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb47c0594c0 con 0x7fb4940cdb80 2024-08-19T00:46:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.676+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb494073f10 con 0x7fb4940cdb80 2024-08-19T00:46:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.676+0000 7fb490c00640 1 -- 172.21.15.7:0/2668709263 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 238 v238) ==== 95+0+3570 (secure 0 0 0) 0x7fb47c05d7c0 con 0x7fb4940cdb80 2024-08-19T00:46:20.678 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:20.678 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":238,"btime":"2024-08-19T00:46:20:274577+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":238,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:20.274519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 238 2024-08-19T00:46:20.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.678+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb47006be30 msgr2=0x7fb47006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.678+0000 7fb499c00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb47006be30 0x7fb47006e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb484007fd0 tx=0x7fb484007de0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.678+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 msgr2=0x7fb494155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.678+0000 7fb499c00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb494155000 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00d5f0 tx=0x7fb47c00dab0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 shutdown_connections 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb47006be30 0x7fb47006e2f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb49415c070 0x7fb494157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4940cdb80 0x7fb494155000 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 --2- 172.21.15.7:0/2668709263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4940cd710 0x7fb4940b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 >> 172.21.15.7:0/2668709263 conn(0x7fb4940b3a70 msgr2=0x7fb49406e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 shutdown_connections 2024-08-19T00:46:20.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.679+0000 7fb499c00640 1 -- 172.21.15.7:0/2668709263 wait complete. 2024-08-19T00:46:20.695 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:20.696 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.850+0000 7fd696a00640 1 Processor -- start 2024-08-19T00:46:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.850+0000 7fd696a00640 1 -- start start 2024-08-19T00:46:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.851+0000 7fd696a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd690161a30 0x7fd6900b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.851+0000 7fd696a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69006c480 0x7fd6900b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.851+0000 7fd696a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6900b4640 con 0x7fd69006b850 2024-08-19T00:46:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.851+0000 7fd696a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd6900d0320 con 0x7fd690161a30 2024-08-19T00:46:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.851+0000 7fd696a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6900b0cf0 con 0x7fd69006c480 2024-08-19T00:46:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69006c480 0x7fd6900b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd690161a30 0x7fd6900b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69006c480 0x7fd6900b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:39228/0 (socket says 172.21.15.7:39228) 2024-08-19T00:46:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68f400640 1 -- 172.21.15.7:0/3852956536 learned_addr learned my addr 172.21.15.7:0/3852956536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:20.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68f400640 1 -- 172.21.15.7:0/3852956536 >> v2:172.21.15.162:3300/0 conn(0x7fd690161a30 msgr2=0x7fd6900b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68f400640 1 --2- 172.21.15.7:0/3852956536 >> v2:172.21.15.162:3300/0 conn(0x7fd690161a30 0x7fd6900b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68f400640 1 -- 172.21.15.7:0/3852956536 >> v1:172.21.15.162:6789/0 conn(0x7fd69006b850 legacy=0x7fd6900b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68f400640 1 -- 172.21.15.7:0/3852956536 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6900b3cf0 con 0x7fd69006c480 2024-08-19T00:46:20.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.852+0000 7fd68fe00640 1 --2- 172.21.15.7:0/3852956536 >> v2:172.21.15.162:3300/0 conn(0x7fd690161a30 0x7fd6900b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.853+0000 7fd68f400640 1 --2- 172.21.15.7:0/3852956536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69006c480 0x7fd6900b37b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0098a0 tx=0x7fd67c02a320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac4a899d71fa1df2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd68ea00640 1 -- 172.21.15.7:0/3852956536 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c037070 con 0x7fd69006c480 2024-08-19T00:46:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd68ea00640 1 -- 172.21.15.7:0/3852956536 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67c032640 con 0x7fd69006c480 2024-08-19T00:46:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd68ea00640 1 -- 172.21.15.7:0/3852956536 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c032a10 con 0x7fd69006c480 2024-08-19T00:46:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd696a00640 1 -- 172.21.15.7:0/3852956536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69006c480 msgr2=0x7fd6900b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd696a00640 1 --2- 172.21.15.7:0/3852956536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69006c480 0x7fd6900b37b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0098a0 tx=0x7fd67c02a320 comp rx=0 tx=0).stop 2024-08-19T00:46:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd696a00640 1 -- 172.21.15.7:0/3852956536 shutdown_connections 2024-08-19T00:46:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd696a00640 1 --2- 172.21.15.7:0/3852956536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69006c480 0x7fd6900b37b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd696a00640 1 --2- 172.21.15.7:0/3852956536 >> v2:172.21.15.162:3300/0 conn(0x7fd690161a30 0x7fd6900b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.854+0000 7fd696a00640 1 -- 172.21.15.7:0/3852956536 >> 172.21.15.7:0/3852956536 conn(0x7fd6900b6840 msgr2=0x7fd6900b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.855+0000 7fd696a00640 1 -- 172.21.15.7:0/3852956536 shutdown_connections 2024-08-19T00:46:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.855+0000 7fd696a00640 1 -- 172.21.15.7:0/3852956536 wait complete. 2024-08-19T00:46:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.856+0000 7fd696a00640 1 Processor -- start 2024-08-19T00:46:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.856+0000 7fd696a00640 1 -- start start 2024-08-19T00:46:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd696a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69006b850 0x7fd69015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd696a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69006c480 0x7fd6901565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd696a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd690161a30 0x7fd6901f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd696a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900b0f90 con 0x7fd69006c480 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd696a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900d08a0 con 0x7fd69006b850 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd696a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6900d0b80 con 0x7fd690161a30 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd68f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69006c480 0x7fd6901565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd68fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69006b850 0x7fd69015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd68f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69006c480 0x7fd6901565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53714/0 (socket says 172.21.15.7:53714) 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.857+0000 7fd68f400640 1 -- 172.21.15.7:0/1022375299 learned_addr learned my addr 172.21.15.7:0/1022375299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd694a00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd690161a30 0x7fd6901f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd68f400640 1 -- 172.21.15.7:0/1022375299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd690161a30 msgr2=0x7fd6901f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd68f400640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd690161a30 0x7fd6901f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd68f400640 1 -- 172.21.15.7:0/1022375299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69006b850 msgr2=0x7fd69015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd68f400640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69006b850 0x7fd69015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd68f400640 1 -- 172.21.15.7:0/1022375299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69015b780 con 0x7fd69006c480 2024-08-19T00:46:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd68f400640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69006c480 0x7fd6901565a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd67c000c00 tx=0x7fd67c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.858+0000 7fd687e00640 1 -- 172.21.15.7:0/1022375299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c037040 con 0x7fd69006c480 2024-08-19T00:46:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.859+0000 7fd687e00640 1 -- 172.21.15.7:0/1022375299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67c042070 con 0x7fd69006c480 2024-08-19T00:46:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.859+0000 7fd687e00640 1 -- 172.21.15.7:0/1022375299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c030990 con 0x7fd69006c480 2024-08-19T00:46:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.859+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6900cd2c0 con 0x7fd69006c480 2024-08-19T00:46:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.859+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6900ae3c0 con 0x7fd69006c480 2024-08-19T00:46:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.860+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd690161e10 con 0x7fd69006c480 2024-08-19T00:46:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.861+0000 7fd687e00640 1 -- 172.21.15.7:0/1022375299 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd67c030b30 con 0x7fd69006c480 2024-08-19T00:46:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.862+0000 7fd687e00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67006be30 0x7fd67006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.862+0000 7fd687e00640 1 -- 172.21.15.7:0/1022375299 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7fd67c0abea0 con 0x7fd69006c480 2024-08-19T00:46:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.862+0000 7fd68fe00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67006be30 0x7fd67006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.863+0000 7fd68fe00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67006be30 0x7fd67006e2f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd680009560 tx=0x7fd680009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:20.866+0000 7fd687e00640 1 -- 172.21.15.7:0/1022375299 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd67c030e20 con 0x7fd69006c480 2024-08-19T00:46:20.990 INFO:tasks.ceph.mds.a.smithi007.stderr: -36> 2024-08-19T00:46:16.236+0000 7fb92c800640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:46:21.030 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:46:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.093+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6901595b0 con 0x7fd69006c480 2024-08-19T00:46:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.094+0000 7fd687e00640 1 -- 172.21.15.7:0/1022375299 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 238 v238) ==== 95+0+3570 (secure 0 0 0) 0x7fd67c0ae000 con 0x7fd69006c480 2024-08-19T00:46:21.096 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:21.096 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":238,"btime":"2024-08-19T00:46:20:274577+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":238,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:20.274519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 238 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67006be30 msgr2=0x7fd67006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67006be30 0x7fd67006e2f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd680009560 tx=0x7fd680009190 comp rx=0 tx=0).stop 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69006c480 msgr2=0x7fd6901565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69006c480 0x7fd6901565a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd67c000c00 tx=0x7fd67c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 shutdown_connections 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd67006be30 0x7fd67006e2f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd690161a30 0x7fd6901f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd69006c480 0x7fd6901565a0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 --2- 172.21.15.7:0/1022375299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69006b850 0x7fd69015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 >> 172.21.15.7:0/1022375299 conn(0x7fd6900b6840 msgr2=0x7fd6900b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 shutdown_connections 2024-08-19T00:46:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.096+0000 7fd696a00640 1 -- 172.21.15.7:0/1022375299 wait complete. 2024-08-19T00:46:21.114 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:21.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.271+0000 7fd7dd200640 1 Processor -- start 2024-08-19T00:46:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.271+0000 7fd7dd200640 1 -- start start 2024-08-19T00:46:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7dd200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7dd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd7d80d03c0 0x7fd7d80d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7dd200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d806f7f0 con 0x7fd7d8159bf0 2024-08-19T00:46:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7dd200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd7d80cee80 con 0x7fd7d80d03c0 2024-08-19T00:46:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7dd200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d80d0d70 con 0x7fd7d80ce500 2024-08-19T00:46:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7d6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd7d80d03c0 0x7fd7d80d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7d6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd7d80d03c0 0x7fd7d80d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53742/0 (socket says 172.21.15.7:53742) 2024-08-19T00:46:21.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7d6800640 1 -- 172.21.15.7:0/2930144132 learned_addr learned my addr 172.21.15.7:0/2930144132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:21.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.272+0000 7fd7cd400640 1 --2- 172.21.15.7:0/2930144132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.273+0000 7fd7d6800640 1 -- 172.21.15.7:0/2930144132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 msgr2=0x7fd7d80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:21.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.273+0000 7fd7d6800640 1 --2- 172.21.15.7:0/2930144132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.273+0000 7fd7d6800640 1 -- 172.21.15.7:0/2930144132 >> v1:172.21.15.162:6789/0 conn(0x7fd7d8159bf0 legacy=0x7fd7d8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.273+0000 7fd7d6800640 1 -- 172.21.15.7:0/2930144132 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d806f510 con 0x7fd7d80d03c0 2024-08-19T00:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.274+0000 7fd7d6800640 1 --2- 172.21.15.7:0/2930144132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d80d0830 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009e50 tx=0x7fd7d002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7038a8c372b401 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.274+0000 7fd7d5400640 1 -- 172.21.15.7:0/2930144132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0036070 con 0x7fd7d80d03c0 2024-08-19T00:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.274+0000 7fd7d5400640 1 -- 172.21.15.7:0/2930144132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d0031600 con 0x7fd7d80d03c0 2024-08-19T00:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.274+0000 7fd7d5400640 1 -- 172.21.15.7:0/2930144132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00319d0 con 0x7fd7d80d03c0 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.274+0000 7fd7dd200640 1 -- 172.21.15.7:0/2930144132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 msgr2=0x7fd7d80d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.274+0000 7fd7dd200640 1 --2- 172.21.15.7:0/2930144132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d80d0830 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009e50 tx=0x7fd7d002a680 comp rx=0 tx=0).stop 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.274+0000 7fd7dd200640 1 -- 172.21.15.7:0/2930144132 shutdown_connections 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.275+0000 7fd7dd200640 1 --2- 172.21.15.7:0/2930144132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d80d0830 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.275+0000 7fd7dd200640 1 --2- 172.21.15.7:0/2930144132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d80ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.275+0000 7fd7dd200640 1 -- 172.21.15.7:0/2930144132 >> 172.21.15.7:0/2930144132 conn(0x7fd7d806bc70 msgr2=0x7fd7d806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.275+0000 7fd7dd200640 1 -- 172.21.15.7:0/2930144132 shutdown_connections 2024-08-19T00:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.275+0000 7fd7dd200640 1 -- 172.21.15.7:0/2930144132 wait complete. 2024-08-19T00:46:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.276+0000 7fd7dd200640 1 Processor -- start 2024-08-19T00:46:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.276+0000 7fd7dd200640 1 -- start start 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.277+0000 7fd7dd200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d8148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.277+0000 7fd7dd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.277+0000 7fd7dd200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7d8159bf0 0x7fd7d809b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.277+0000 7fd7dd200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d8072f40 con 0x7fd7d80d03c0 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.277+0000 7fd7dd200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d8072c60 con 0x7fd7d8159bf0 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.277+0000 7fd7dd200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d8073b70 con 0x7fd7d80ce500 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d815f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53744/0 (socket says 172.21.15.7:53744) 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 -- 172.21.15.7:0/1775575556 learned_addr learned my addr 172.21.15.7:0/1775575556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7d5e00640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d8148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7d6800640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7d8159bf0 0x7fd7d809b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 -- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 msgr2=0x7fd7d8148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d8148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 -- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7d8159bf0 msgr2=0x7fd7d809b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7d8159bf0 0x7fd7d809b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 -- 172.21.15.7:0/1775575556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d815fb50 con 0x7fd7d80d03c0 2024-08-19T00:46:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.278+0000 7fd7cd400640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d815f610 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000d5d0 tx=0x7fd7c000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.280+0000 7fd7cea00640 1 -- 172.21.15.7:0/1775575556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0004240 con 0x7fd7d80d03c0 2024-08-19T00:46:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.280+0000 7fd7cea00640 1 -- 172.21.15.7:0/1775575556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c00043e0 con 0x7fd7d80d03c0 2024-08-19T00:46:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.280+0000 7fd7cea00640 1 -- 172.21.15.7:0/1775575556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0003830 con 0x7fd7d80d03c0 2024-08-19T00:46:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.280+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d809de60 con 0x7fd7d80d03c0 2024-08-19T00:46:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.280+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d809ad70 con 0x7fd7d80d03c0 2024-08-19T00:46:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.281+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d8159fd0 con 0x7fd7d80d03c0 2024-08-19T00:46:21.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.282+0000 7fd7cea00640 1 -- 172.21.15.7:0/1775575556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7c00039d0 con 0x7fd7d80d03c0 2024-08-19T00:46:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.283+0000 7fd7cea00640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7b406be80 0x7fd7b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.284+0000 7fd7cea00640 1 -- 172.21.15.7:0/1775575556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7fd7c008b830 con 0x7fd7d80d03c0 2024-08-19T00:46:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.284+0000 7fd7d5e00640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7b406be80 0x7fd7b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.284+0000 7fd7d5e00640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7b406be80 0x7fd7b406e340 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8001780 tx=0x7fd7c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.288+0000 7fd7cea00640 1 -- 172.21.15.7:0/1775575556 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd7c00592b0 con 0x7fd7d80d03c0 2024-08-19T00:46:21.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.510+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7d8160c00 con 0x7fd7d80d03c0 2024-08-19T00:46:21.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.510+0000 7fd7cea00640 1 -- 172.21.15.7:0/1775575556 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 239 v239) ==== 95+0+4393 (secure 0 0 0) 0x7fd7c005d5b0 con 0x7fd7d80d03c0 2024-08-19T00:46:21.512 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:21.513 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":239,"btime":"2024-08-19T00:46:21:276130+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1141791797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1141791797},{"type":"v1","addr":"172.21.15.7:6837","nonce":1141791797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":239}],"filesystems":[{"mdsmap":{"epoch":238,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:20.274519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:21.513 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 239 2024-08-19T00:46:21.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7b406be80 msgr2=0x7fd7b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7b406be80 0x7fd7b406e340 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8001780 tx=0x7fd7c8009040 comp rx=0 tx=0).stop 2024-08-19T00:46:21.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 msgr2=0x7fd7d815f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d815f610 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000d5d0 tx=0x7fd7c000da90 comp rx=0 tx=0).stop 2024-08-19T00:46:21.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 shutdown_connections 2024-08-19T00:46:21.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd7b406be80 0x7fd7b406e340 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7d8159bf0 0x7fd7d809b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7d80d03c0 0x7fd7d815f610 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 --2- 172.21.15.7:0/1775575556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7d80ce500 0x7fd7d8148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 >> 172.21.15.7:0/1775575556 conn(0x7fd7d806bc70 msgr2=0x7fd7d8074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:21.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 shutdown_connections 2024-08-19T00:46:21.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.513+0000 7fd7dd200640 1 -- 172.21.15.7:0/1775575556 wait complete. 2024-08-19T00:46:21.531 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 200.00000001' led to DAMAGED state 2024-08-19T00:46:21.531 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 500.00000000' 2024-08-19T00:46:21.531 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:21.531 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:21.567 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:21.567 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:21.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:21.567 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:21.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:21.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:21.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.840+0000 7f3ca7e00640 1 Processor -- start 2024-08-19T00:46:21.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.840+0000 7f3ca7e00640 1 -- start start 2024-08-19T00:46:21.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.841+0000 7f3ca7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ca006e710 0x7f3ca0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.841+0000 7f3ca7e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca00cdfb0 con 0x7f3ca00b3750 2024-08-19T00:46:21.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.841+0000 7f3ca7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca00ce290 con 0x7f3ca00d03c0 2024-08-19T00:46:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.841+0000 7f3ca7e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca00cebc0 con 0x7f3ca006e710 2024-08-19T00:46:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.842+0000 7f3ca4a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ca006e710 0x7f3ca0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.842+0000 7f3ca5e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3ca00b3750 0x7f3ca00cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48802/0 (socket says 172.21.15.7:48802) 2024-08-19T00:46:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.842+0000 7f3ca5e00640 1 -- 172.21.15.7:0/1552787042 learned_addr learned my addr 172.21.15.7:0/1552787042 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.842+0000 7f3ca4a00640 1 -- 172.21.15.7:0/1552787042 >> v1:172.21.15.162:6789/0 conn(0x7f3ca00d03c0 legacy=0x7f3ca00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.842+0000 7f3ca4a00640 1 -- 172.21.15.7:0/1552787042 >> v1:172.21.15.7:6789/0 conn(0x7f3ca00b3750 legacy=0x7f3ca00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.842+0000 7f3ca4a00640 1 -- 172.21.15.7:0/1552787042 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca00ce570 con 0x7f3ca006e710 2024-08-19T00:46:21.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.842+0000 7f3c9fe00640 1 -- 172.21.15.7:0/1552787042 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958905824 0 0) 0x7f3ca00cdfb0 con 0x7f3ca00b3750 2024-08-19T00:46:21.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.843+0000 7f3ca4a00640 1 --2- 172.21.15.7:0/1552787042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca006e710 0x7f3ca0071980 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0097d0 tx=0x7f3c8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9eef9ce4920e33 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.843+0000 7f3c9fe00640 1 -- 172.21.15.7:0/1552787042 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c037070 con 0x7f3ca006e710 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.843+0000 7f3c9fe00640 1 -- 172.21.15.7:0/1552787042 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8c032440 con 0x7f3ca006e710 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.843+0000 7f3c9fe00640 1 -- 172.21.15.7:0/1552787042 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c032810 con 0x7f3ca006e710 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.844+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1552787042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca006e710 msgr2=0x7f3ca0071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.844+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1552787042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca006e710 0x7f3ca0071980 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0097d0 tx=0x7f3c8c02a270 comp rx=0 tx=0).stop 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.844+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1552787042 shutdown_connections 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.844+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1552787042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca006e710 0x7f3ca0071980 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.844+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1552787042 >> 172.21.15.7:0/1552787042 conn(0x7f3ca006bc70 msgr2=0x7f3ca006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:21.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.844+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1552787042 shutdown_connections 2024-08-19T00:46:21.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.844+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1552787042 wait complete. 2024-08-19T00:46:21.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.846+0000 7f3ca7e00640 1 Processor -- start 2024-08-19T00:46:21.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.846+0000 7f3ca7e00640 1 -- start start 2024-08-19T00:46:21.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ca006e710 0x7f3ca00c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca00b3750 0x7f3ca00cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca00d03c0 0x7f3ca014c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0073c60 con 0x7f3ca00d03c0 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0073ae0 con 0x7f3ca00b3750 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca7e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca00b3be0 con 0x7f3ca006e710 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca00d03c0 0x7f3ca014c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca00d03c0 0x7f3ca014c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53764/0 (socket says 172.21.15.7:53764) 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 -- 172.21.15.7:0/1426456186 learned_addr learned my addr 172.21.15.7:0/1426456186 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca4a00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca00b3750 0x7f3ca00cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5400640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ca006e710 0x7f3ca00c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 -- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ca006e710 msgr2=0x7f3ca00c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ca006e710 0x7f3ca00c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 -- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca00b3750 msgr2=0x7f3ca00cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca00b3750 0x7f3ca00cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.847+0000 7f3ca5e00640 1 -- 172.21.15.7:0/1426456186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca00ca510 con 0x7f3ca00d03c0 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.848+0000 7f3ca5e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca00d03c0 0x7f3ca014c430 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800c7d0 tx=0x7f3c9800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.848+0000 7f3c9d600640 1 -- 172.21.15.7:0/1426456186 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98018070 con 0x7f3ca00d03c0 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.848+0000 7f3c9d600640 1 -- 172.21.15.7:0/1426456186 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c9800a5e0 con 0x7f3ca00d03c0 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.848+0000 7f3c9d600640 1 -- 172.21.15.7:0/1426456186 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9800aa10 con 0x7f3ca00d03c0 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.848+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca00ca7f0 con 0x7f3ca00d03c0 2024-08-19T00:46:21.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.848+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca00cadb0 con 0x7f3ca00d03c0 2024-08-19T00:46:21.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.849+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca0071980 con 0x7f3ca00d03c0 2024-08-19T00:46:21.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.850+0000 7f3c9d600640 1 -- 172.21.15.7:0/1426456186 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c9801b070 con 0x7f3ca00d03c0 2024-08-19T00:46:21.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.851+0000 7f3c9d600640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c8006be30 0x7f3c8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:21.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.851+0000 7f3c9d600640 1 -- 172.21.15.7:0/1426456186 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7f3c9808ad20 con 0x7f3ca00d03c0 2024-08-19T00:46:21.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.851+0000 7f3ca5400640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c8006be30 0x7f3c8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:21.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.852+0000 7f3ca5400640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c8006be30 0x7f3c8006e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000f60 tx=0x7f3c94009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:21.855+0000 7f3c9d600640 1 -- 172.21.15.7:0/1426456186 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3c98058720 con 0x7f3ca00d03c0 2024-08-19T00:46:22.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.077+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3ca0073740 con 0x7f3ca00d03c0 2024-08-19T00:46:22.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.282+0000 7f3c9d600640 1 -- 172.21.15.7:0/1426456186 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v240) ==== 161+0+0 (secure 0 0 0) 0x7f3c9805ca20 con 0x7f3ca00d03c0 2024-08-19T00:46:22.284 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c8006be30 msgr2=0x7f3c8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c8006be30 0x7f3c8006e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000f60 tx=0x7f3c94009040 comp rx=0 tx=0).stop 2024-08-19T00:46:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca00d03c0 msgr2=0x7f3ca014c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca00d03c0 0x7f3ca014c430 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800c7d0 tx=0x7f3c9800cc90 comp rx=0 tx=0).stop 2024-08-19T00:46:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 shutdown_connections 2024-08-19T00:46:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3c8006be30 0x7f3c8006e2f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca00d03c0 0x7f3ca014c430 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca00b3750 0x7f3ca00cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 --2- 172.21.15.7:0/1426456186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ca006e710 0x7f3ca00c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 >> 172.21.15.7:0/1426456186 conn(0x7f3ca006bc70 msgr2=0x7f3ca015a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 shutdown_connections 2024-08-19T00:46:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.284+0000 7f3ca7e00640 1 -- 172.21.15.7:0/1426456186 wait complete. 2024-08-19T00:46:22.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.459+0000 7f6087800640 1 Processor -- start 2024-08-19T00:46:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.459+0000 7f6087800640 1 -- start start 2024-08-19T00:46:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.460+0000 7f6087800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60800b4a90 0x7f60800d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f6087800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60800b50b0 con 0x7f608015f5b0 2024-08-19T00:46:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f6087800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60800cead0 con 0x7f60800d03c0 2024-08-19T00:46:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f6087800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f608015f990 con 0x7f60800b4a90 2024-08-19T00:46:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f6084e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f608015f5b0 0x7f60800cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48814/0 (socket says 172.21.15.7:48814) 2024-08-19T00:46:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f6084e00640 1 -- 172.21.15.7:0/742539891 learned_addr learned my addr 172.21.15.7:0/742539891 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f6085800640 1 --2- 172.21.15.7:0/742539891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60800b4a90 0x7f60800d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f607f400640 1 -- 172.21.15.7:0/742539891 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645714643 0 0) 0x7f60800b50b0 con 0x7f608015f5b0 2024-08-19T00:46:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f607f400640 1 -- 172.21.15.7:0/742539891 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6068003520 con 0x7f608015f5b0 2024-08-19T00:46:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f607f400640 1 -- 172.21.15.7:0/742539891 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195642235 0 0) 0x7f60800cead0 con 0x7f60800d03c0 2024-08-19T00:46:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.461+0000 7f607f400640 1 -- 172.21.15.7:0/742539891 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60800b50b0 con 0x7f60800d03c0 2024-08-19T00:46:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.462+0000 7f6085800640 1 -- 172.21.15.7:0/742539891 >> v1:172.21.15.162:6789/0 conn(0x7f60800d03c0 legacy=0x7f60800b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.462+0000 7f6085800640 1 -- 172.21.15.7:0/742539891 >> v1:172.21.15.7:6789/0 conn(0x7f608015f5b0 legacy=0x7f60800cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.462+0000 7f6085800640 1 -- 172.21.15.7:0/742539891 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800cedb0 con 0x7f60800b4a90 2024-08-19T00:46:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.463+0000 7f6085800640 1 --2- 172.21.15.7:0/742539891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60800b4a90 0x7f60800d0800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6078009dc0 tx=0x7f607802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c808a6623fa79c00 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.463+0000 7f607f400640 1 -- 172.21.15.7:0/742539891 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607802ae60 con 0x7f60800b4a90 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.463+0000 7f607f400640 1 -- 172.21.15.7:0/742539891 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6078007740 con 0x7f60800b4a90 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.463+0000 7f607f400640 1 -- 172.21.15.7:0/742539891 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078007b10 con 0x7f60800b4a90 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.463+0000 7f6087800640 1 -- 172.21.15.7:0/742539891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60800b4a90 msgr2=0x7f60800d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.463+0000 7f6087800640 1 --2- 172.21.15.7:0/742539891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60800b4a90 0x7f60800d0800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6078009dc0 tx=0x7f607802a640 comp rx=0 tx=0).stop 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.464+0000 7f6087800640 1 -- 172.21.15.7:0/742539891 shutdown_connections 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.464+0000 7f6087800640 1 --2- 172.21.15.7:0/742539891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60800b4a90 0x7f60800d0800 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.464+0000 7f6087800640 1 -- 172.21.15.7:0/742539891 >> 172.21.15.7:0/742539891 conn(0x7f608006bc70 msgr2=0x7f608006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.464+0000 7f6087800640 1 -- 172.21.15.7:0/742539891 shutdown_connections 2024-08-19T00:46:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.464+0000 7f6087800640 1 -- 172.21.15.7:0/742539891 wait complete. 2024-08-19T00:46:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.465+0000 7f6087800640 1 Processor -- start 2024-08-19T00:46:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.465+0000 7f6087800640 1 -- start start 2024-08-19T00:46:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.466+0000 7f6087800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60800b4a90 0x7f60801452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.466+0000 7f6087800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800d03c0 0x7f608015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.466+0000 7f6087800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608015f5b0 0x7f608015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.466+0000 7f6087800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f608006ea70 con 0x7f60800b4a90 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.466+0000 7f6087800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f608006e8f0 con 0x7f60800d03c0 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.466+0000 7f6087800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f608006ebf0 con 0x7f608015f5b0 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.466+0000 7f6084e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60800b4a90 0x7f60801452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60800b4a90 0x7f60801452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53776/0 (socket says 172.21.15.7:53776) 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 -- 172.21.15.7:0/2154452982 learned_addr learned my addr 172.21.15.7:0/2154452982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f607fe00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800d03c0 0x7f608015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6085800640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608015f5b0 0x7f608015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 -- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608015f5b0 msgr2=0x7f608015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608015f5b0 0x7f608015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 -- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800d03c0 msgr2=0x7f608015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800d03c0 0x7f608015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 -- 172.21.15.7:0/2154452982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800acff0 con 0x7f60800b4a90 2024-08-19T00:46:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f607fe00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800d03c0 0x7f608015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.467+0000 7f6084e00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60800b4a90 0x7f60801452b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f607400c410 tx=0x7f607400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.468+0000 7f607cc00640 1 -- 172.21.15.7:0/2154452982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074017070 con 0x7f60800b4a90 2024-08-19T00:46:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.468+0000 7f607cc00640 1 -- 172.21.15.7:0/2154452982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6074005ce0 con 0x7f60800b4a90 2024-08-19T00:46:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.468+0000 7f607cc00640 1 -- 172.21.15.7:0/2154452982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60740072f0 con 0x7f60800b4a90 2024-08-19T00:46:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.468+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60801eab40 con 0x7f60800b4a90 2024-08-19T00:46:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.468+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60800ad590 con 0x7f60800b4a90 2024-08-19T00:46:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.469+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608006f090 con 0x7f60800b4a90 2024-08-19T00:46:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.470+0000 7f607cc00640 1 -- 172.21.15.7:0/2154452982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f607401a070 con 0x7f60800b4a90 2024-08-19T00:46:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.471+0000 7f607cc00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606006be30 0x7f606006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.471+0000 7f607cc00640 1 -- 172.21.15.7:0/2154452982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7f607408ab70 con 0x7f60800b4a90 2024-08-19T00:46:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.471+0000 7f607fe00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606006be30 0x7f606006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.471+0000 7f607fe00640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606006be30 0x7f606006e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f606c007fd0 tx=0x7f606c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.475+0000 7f607cc00640 1 -- 172.21.15.7:0/2154452982 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6074058630 con 0x7f60800b4a90 2024-08-19T00:46:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:22.731+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f60800cd870 con 0x7f60800b4a90 2024-08-19T00:46:23.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.287+0000 7f607cc00640 1 -- 172.21.15.7:0/2154452982 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v241) ==== 101+0+0 (secure 0 0 0) 0x7f607405c930 con 0x7f60800b4a90 2024-08-19T00:46:23.289 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606006be30 msgr2=0x7f606006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606006be30 0x7f606006e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f606c007fd0 tx=0x7f606c009040 comp rx=0 tx=0).stop 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60800b4a90 msgr2=0x7f60801452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60800b4a90 0x7f60801452b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f607400c410 tx=0x7f607400c8d0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 shutdown_connections 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f606006be30 0x7f606006e2f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f608015f5b0 0x7f608015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800d03c0 0x7f608015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 --2- 172.21.15.7:0/2154452982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60800b4a90 0x7f60801452b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 >> 172.21.15.7:0/2154452982 conn(0x7f608006bc70 msgr2=0x7f608015dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 shutdown_connections 2024-08-19T00:46:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.290+0000 7f6087800640 1 -- 172.21.15.7:0/2154452982 wait complete. 2024-08-19T00:46:23.309 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:23.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.385+0000 7f814a98af40 1 Processor -- start 2024-08-19T00:46:23.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.385+0000 7f814a98af40 1 -- start start 2024-08-19T00:46:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.386+0000 7f814a98af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569adf40 0x560f56a38ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.386+0000 7f814a98af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569af5b0 0x560f56ae3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.386+0000 7f814a98af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af990 0x560f569aa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.386+0000 7f814a98af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560f56923d00 con 0x560f569af5b0 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.386+0000 7f814a98af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560f56927d40 con 0x560f569af990 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.386+0000 7f814a98af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560f56a54dc0 con 0x560f569adf40 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569af5b0 0x560f56ae3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569af5b0 0x560f56ae3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53792/0 (socket says 172.21.15.7:53792) 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 -- 172.21.15.7:0/657939587 learned_addr learned my addr 172.21.15.7:0/657939587 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147c00640 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569adf40 0x560f56a38ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8148600640 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af990 0x560f569aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 -- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569adf40 msgr2=0x560f56a38ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569adf40 0x560f56a38ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 -- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af990 msgr2=0x560f569aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af990 0x560f569aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 -- 172.21.15.7:0/657939587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f568e5080 con 0x560f569af5b0 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8148600640 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af990 0x560f569aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8147200640 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569af5b0 0x560f56ae3df0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f8134001d60 tx=0x7f813400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f91965d033385 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.387+0000 7f8145e00640 1 -- 172.21.15.7:0/657939587 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813400bd80 con 0x560f569af5b0 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f8145e00640 1 -- 172.21.15.7:0/657939587 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813400f400 con 0x560f569af5b0 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f8145e00640 1 -- 172.21.15.7:0/657939587 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813400f7d0 con 0x560f569af5b0 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 -- 172.21.15.7:0/657939587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569af5b0 msgr2=0x560f56ae3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569af5b0 0x560f56ae3df0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f8134001d60 tx=0x7f813400b5b0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 -- 172.21.15.7:0/657939587 shutdown_connections 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af990 0x560f569aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569af5b0 0x560f56ae3df0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 --2- 172.21.15.7:0/657939587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569adf40 0x560f56a38ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 -- 172.21.15.7:0/657939587 >> 172.21.15.7:0/657939587 conn(0x560f569ac4e0 msgr2=0x560f5697d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 -- 172.21.15.7:0/657939587 shutdown_connections 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.388+0000 7f814a98af40 1 -- 172.21.15.7:0/657939587 wait complete. 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.389+0000 7f814a98af40 1 Processor -- start 2024-08-19T00:46:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.389+0000 7f814a98af40 1 -- start start 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f814a98af40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569adf40 0x560f56a559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f814a98af40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af5b0 0x560f56a4bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f814a98af40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569af990 0x560f56a4c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f814a98af40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560f569ab890 con 0x560f569adf40 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f814a98af40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560f569ab5c0 con 0x560f569af5b0 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f814a98af40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560f569abb70 con 0x560f569af990 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f8147c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569adf40 0x560f56a559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f8147c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569adf40 0x560f56a559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53800/0 (socket says 172.21.15.7:53800) 2024-08-19T00:46:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 learned_addr learned my addr 172.21.15.7:0/4003761593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f8148600640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569af990 0x560f56a4c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af5b0 0x560f56a4bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.390+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569af990 msgr2=0x560f56a4c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8147c00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569af990 0x560f56a4c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af5b0 msgr2=0x560f56a4bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8147c00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af5b0 0x560f56a4bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f56a4adb0 con 0x560f569adf40 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8148600640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560f569af990 0x560f56a4c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560f569af5b0 0x560f56a4bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8147c00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569adf40 0x560f56a559f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f8138057040 tx=0x7f8138002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8144a00640 1 -- 172.21.15.7:0/4003761593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138066070 con 0x560f569adf40 2024-08-19T00:46:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8144a00640 1 -- 172.21.15.7:0/4003761593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81380549b0 con 0x560f569adf40 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f56a4b090 con 0x560f569adf40 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f8144a00640 1 -- 172.21.15.7:0/4003761593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138059040 con 0x560f569adf40 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.391+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f56a4a1f0 con 0x560f569adf40 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.393+0000 7f8144a00640 1 -- 172.21.15.7:0/4003761593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8138069070 con 0x560f569adf40 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.394+0000 7f8144a00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f812806a810 0x7f812806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.394+0000 7f8144a00640 1 -- 172.21.15.7:0/4003761593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7f81380ce130 con 0x560f569adf40 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.394+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f812806a810 0x7f812806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.398 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.394+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560f56a55f30 0x560f56aedf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.394+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56a49a80 con 0x560f56a55f30 2024-08-19T00:46:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.395+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f812806a810 0x7f812806ccd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x560f56a56350 tx=0x7f8134009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.395+0000 7f8148600640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560f56a55f30 0x560f56aedf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.396+0000 7f8148600640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560f56a55f30 0x560f56aedf70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.398+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v112'784 uv758 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.398+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f569ac090 con 0x560f56a55f30 2024-08-19T00:46:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.400+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v112'785 uv785 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.400+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56a53170 con 0x560f56a55f30 2024-08-19T00:46:23.403 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.401+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v112'786 uv786 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.401+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56aee4b0 con 0x560f56a55f30 2024-08-19T00:46:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.402+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v112'787 uv787 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.402+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56aee8b0 con 0x560f56a55f30 2024-08-19T00:46:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.404+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v112'788 uv788 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.404+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7240 con 0x560f56a55f30 2024-08-19T00:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.405+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v112'789 uv789 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.405+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af75e0 con 0x560f56a55f30 2024-08-19T00:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.407+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v112'790 uv764 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.407+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7980 con 0x560f56a55f30 2024-08-19T00:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.409+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v112'791 uv791 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.409+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7d20 con 0x560f56a55f30 2024-08-19T00:46:23.411 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:23.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.410+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v112'792 uv792 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.410+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8d30 con 0x560f56a55f30 2024-08-19T00:46:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.412+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v112'793 uv793 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.412+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8d30 con 0x560f56a55f30 2024-08-19T00:46:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.413+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v112'794 uv794 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.413+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7d20 con 0x560f56a55f30 2024-08-19T00:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.415+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v112'795 uv795 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.415+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7d20 con 0x560f56a55f30 2024-08-19T00:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.416+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v112'796 uv771 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.417+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7d20 con 0x560f56a55f30 2024-08-19T00:46:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.418+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v112'797 uv797 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.418+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7d20 con 0x560f56a55f30 2024-08-19T00:46:23.421 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.420+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v112'798 uv798 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.420+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8d30 con 0x560f56a55f30 2024-08-19T00:46:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.421+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v112'799 uv799 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.421+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8d30 con 0x560f56a55f30 2024-08-19T00:46:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.423+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v112'800 uv800 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.423+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af7d20 con 0x560f56a55f30 2024-08-19T00:46:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.424+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v112'801 uv801 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.424+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.426+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v112'802 uv802 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.426+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.427+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v112'803 uv777 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.427+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.428+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v112'804 uv804 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.429+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.431 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.430+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v112'805 uv805 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.430+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af94a0 con 0x560f56a55f30 2024-08-19T00:46:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.431+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v112'806 uv806 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.431+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af94a0 con 0x560f56a55f30 2024-08-19T00:46:23.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.433+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v112'807 uv807 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.433+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.434+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v112'808 uv808 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.434+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.436+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v112'809 uv783 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.436+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.437+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v112'810 uv810 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.437+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.440 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.439+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v112'811 uv811 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.439+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af94a0 con 0x560f56a55f30 2024-08-19T00:46:23.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.440+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v112'812 uv812 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.440+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af94a0 con 0x560f56a55f30 2024-08-19T00:46:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.441+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v112'813 uv813 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.442+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af8490 con 0x560f56a55f30 2024-08-19T00:46:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.443+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v112'814 uv814 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.443+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560f56af89a0 0x560f56afad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.443+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afb2d0 con 0x560f56af89a0 2024-08-19T00:46:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.443+0000 7f8147c00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560f56af89a0 0x560f56afad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.444+0000 7f8147c00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560f56af89a0 0x560f56afad90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.445+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v112'571 uv553 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.445+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56afb670 con 0x560f56af89a0 2024-08-19T00:46:23.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.447+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v112'572 uv572 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.447+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afba10 con 0x560f56af89a0 2024-08-19T00:46:23.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.449+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v112'573 uv573 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:23.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.449+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afbdb0 con 0x560f56af89a0 2024-08-19T00:46:23.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.450+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v112'574 uv574 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.450+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afc1c0 con 0x560f56af89a0 2024-08-19T00:46:23.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.452+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v112'575 uv575 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.452+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afc560 con 0x560f56af89a0 2024-08-19T00:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.453+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v112'576 uv558 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.453+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56afc950 con 0x560f56af89a0 2024-08-19T00:46:23.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.455+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v112'577 uv577 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.455+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afcd40 con 0x560f56af89a0 2024-08-19T00:46:23.457 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:23.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.456+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v112'578 uv578 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.456+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afcd40 con 0x560f56af89a0 2024-08-19T00:46:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.457+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v112'579 uv579 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.457+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.459+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v112'580 uv580 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.459+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.460+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v112'581 uv570 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.460+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.462+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v112'582 uv582 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.462+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.465 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.463+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v112'583 uv583 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.463+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.465+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v112'584 uv584 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.465+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.466+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v112'585 uv585 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.467+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.468+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v112'586 uv569 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.468+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.470+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v112'587 uv587 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.470+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afccf0 con 0x560f56af89a0 2024-08-19T00:46:23.472 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.471+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v112'588 uv588 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.471+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afcd10 con 0x560f56af89a0 2024-08-19T00:46:23.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.473+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v112'589 uv589 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.473+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afdd20 con 0x560f56af89a0 2024-08-19T00:46:23.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.474+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v112'590 uv590 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.474+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56afcd10 con 0x560f56af89a0 2024-08-19T00:46:23.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.476+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v112'591 uv591 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56af89a0 2024-08-19T00:46:23.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.476+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560f56afd3e0 0x560f56afd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.476+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b00190 con 0x560f56afd3e0 2024-08-19T00:46:23.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.476+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560f56afd3e0 0x560f56afd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.477+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560f56afd3e0 0x560f56afd7e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.478+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v112'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.478+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b00530 con 0x560f56afd3e0 2024-08-19T00:46:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.479+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v112'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.479+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b008d0 con 0x560f56afd3e0 2024-08-19T00:46:23.482 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.481+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v112'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.481+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56af80e0 con 0x560f56afd3e0 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.482+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v112'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.482+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b02210 con 0x560f56afd3e0 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.483+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v112'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.483+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b01120 con 0x560f56afd3e0 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.484+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v112'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.485+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b01540 con 0x560f56a55f30 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.486+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v112'112 uv111 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.486+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b01540 con 0x560f56a55f30 2024-08-19T00:46:23.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.487+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v112'113 uv113 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.487+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b01510 con 0x560f56a55f30 2024-08-19T00:46:23.490 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.489+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v112'114 uv114 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.489+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b01510 con 0x560f56a55f30 2024-08-19T00:46:23.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.490+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v112'115 uv115 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.490+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560f56b02620 0x560f56b04a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.490+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b04f50 con 0x560f56b02620 2024-08-19T00:46:23.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.490+0000 7f8148600640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560f56b02620 0x560f56b04a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.491+0000 7f8148600640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560f56b02620 0x560f56b04a10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.492+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v112'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.492+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b04f50 con 0x560f56b02620 2024-08-19T00:46:23.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.493+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v112'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.493+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b04f50 con 0x560f56b02620 2024-08-19T00:46:23.496 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:23.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.495+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v112'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.495+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b05f60 con 0x560f56b02620 2024-08-19T00:46:23.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.496+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v112'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.496+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b05f60 con 0x560f56b02620 2024-08-19T00:46:23.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.497+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v112'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.497+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b04f50 con 0x560f56b02620 2024-08-19T00:46:23.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.498+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v112'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.498+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560f56b055d0 0x560f56b059b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.498+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.499+0000 7f8147c00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560f56b055d0 0x560f56b059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.499+0000 7f8147c00640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560f56b055d0 0x560f56b059b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.500+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v112'282 uv276 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.500+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.502+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v112'283 uv283 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.502+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.504 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:23.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.503+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v112'284 uv284 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.503+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b093b0 con 0x560f56b055d0 2024-08-19T00:46:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.504+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v112'285 uv285 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.504+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b09370 con 0x560f56b055d0 2024-08-19T00:46:23.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.506+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v112'286 uv286 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.506+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.507+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v112'287 uv287 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.507+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.508+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v112'288 uv281 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.508+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.511+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v112'289 uv289 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.511+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.514 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.512+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v112'290 uv290 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.512+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.514+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v112'291 uv291 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.514+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b08360 con 0x560f56b055d0 2024-08-19T00:46:23.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.515+0000 7f8147c00640 1 -- 172.21.15.7:0/4003761593 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v112'292 uv292 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8138072070 con 0x560f56b055d0 2024-08-19T00:46:23.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.515+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560f56b08cb0 0x560f56b090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.515+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0b740 con 0x560f56b08cb0 2024-08-19T00:46:23.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.515+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560f56b08cb0 0x560f56b090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.516+0000 7f8147200640 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560f56b08cb0 0x560f56b090f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.517+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v112'127 uv126 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.517+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0bae0 con 0x560f56b08cb0 2024-08-19T00:46:23.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.519+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v112'128 uv128 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.519+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0be80 con 0x560f56b08cb0 2024-08-19T00:46:23.522 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:23.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.520+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v112'129 uv129 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.520+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56b08cb0 2024-08-19T00:46:23.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.522+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v112'130 uv130 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.522+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56b08cb0 2024-08-19T00:46:23.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.523+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v112'131 uv131 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.523+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56a55f30 2024-08-19T00:46:23.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.525+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v112'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.525+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56a55f30 2024-08-19T00:46:23.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.526+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v112'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.526+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56a55f30 2024-08-19T00:46:23.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.527+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v112'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.530 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:23.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.528+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0d280 con 0x560f56a55f30 2024-08-19T00:46:23.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.529+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v112'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.529+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0d280 con 0x560f56a55f30 2024-08-19T00:46:23.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.531+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v112'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.531+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56a55f30 2024-08-19T00:46:23.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.533+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v112'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56a55f30 2024-08-19T00:46:23.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.533+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.535+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v112'253 uv247 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.535+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.536+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v112'254 uv254 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.536+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.540 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.538+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v112'255 uv255 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.538+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.539+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v112'256 uv256 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.539+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.541+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v112'257 uv257 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.541+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.542+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v112'258 uv252 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.542+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.544+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v112'259 uv259 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.544+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.545+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v112'260 uv260 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.549 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:23.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.545+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c270 con 0x560f56afd3e0 2024-08-19T00:46:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.547+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v112'261 uv261 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.547+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0f080 con 0x560f56afd3e0 2024-08-19T00:46:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.548+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v112'262 uv262 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56afd3e0 2024-08-19T00:46:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.548+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.550+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v112'111 uv110 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.550+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.551+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v112'112 uv112 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.551+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.554 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:23.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.553+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v112'113 uv113 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.553+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.554+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v112'114 uv114 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.555+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.556+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v112'153 uv152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.556+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.558+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v112'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.558+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.562 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:23.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.559+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v112'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.559+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0d730 con 0x560f56b02620 2024-08-19T00:46:23.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.560+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v112'156 uv156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.560+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0d730 con 0x560f56b02620 2024-08-19T00:46:23.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.562+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v112'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.562+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b02620 2024-08-19T00:46:23.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.563+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v112'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f81400056b0 con 0x560f56b02620 2024-08-19T00:46:23.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.563+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.564+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v112'130 uv129 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.565+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.566+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v112'131 uv131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.566+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.569 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:23.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.567+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v112'132 uv132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.567+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.568+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v112'133 uv133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.568+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.570+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v112'134 uv134 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.570+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.571+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v112'314 uv306 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.571+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.572+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v112'315 uv315 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.572+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.575 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:23.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.574+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v112'316 uv316 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.574+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.575+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v112'317 uv317 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.575+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.577+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v112'318 uv318 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.577+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.578+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v112'319 uv313 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.578+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.580+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v112'320 uv320 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.580+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.583 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:23.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.581+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v112'321 uv321 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.581+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0d730 con 0x560f56b08cb0 2024-08-19T00:46:23.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.582+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v112'322 uv322 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.583+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0d730 con 0x560f56b08cb0 2024-08-19T00:46:23.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.584+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v112'323 uv323 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.584+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0c720 con 0x560f56b08cb0 2024-08-19T00:46:23.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.585+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v112'324 uv324 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.585+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x560f56b0cc80 con 0x560f56b08cb0 2024-08-19T00:46:23.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.586+0000 7f8147200640 1 -- 172.21.15.7:0/4003761593 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v112'325 uv325 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f813400f8d0 con 0x560f56b08cb0 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560f56af89a0 msgr2=0x560f56afad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x560f56af89a0 0x560f56afad90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560f56b055d0 msgr2=0x560f56b059b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x560f56b055d0 0x560f56b059b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560f56b08cb0 msgr2=0x560f56b090f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x560f56b08cb0 0x560f56b090f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560f56afd3e0 msgr2=0x560f56afd7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x560f56afd3e0 0x560f56afd7e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560f56a55f30 msgr2=0x560f56aedf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f8148600640 1 -- 172.21.15.7:0/4003761593 reap_dead start 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560f56a55f30 0x560f56aedf70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560f56b02620 msgr2=0x560f56b04a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560f56b02620 0x560f56b04a10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f812806a810 msgr2=0x7f812806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f812806a810 0x7f812806ccd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x560f56a56350 tx=0x7f8134009000 comp rx=0 tx=0).stop 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569adf40 msgr2=0x560f56a559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569adf40 0x560f56a559f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f8138057040 tx=0x7f8138002fb0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 shutdown_connections 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x560f56a55f30 0x560f56aedf70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f812806a810 0x7f812806ccd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x560f56b02620 0x560f56b04a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 --2- 172.21.15.7:0/4003761593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560f569adf40 0x560f56a559f0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 >> 172.21.15.7:0/4003761593 conn(0x560f569ac4e0 msgr2=0x560f56ae55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 shutdown_connections 2024-08-19T00:46:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.587+0000 7f814a98af40 1 -- 172.21.15.7:0/4003761593 wait complete. 2024-08-19T00:46:23.593 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 500.00000000 0 2024-08-19T00:46:23.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 Processor -- start 2024-08-19T00:46:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 -- start start 2024-08-19T00:46:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd0865b0 0x55a6cd11dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd086990 0x55a6cd11e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd1222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd12bdc0 con 0x55a6cd086990 2024-08-19T00:46:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a6ccffad00 con 0x55a6cd09e8d0 2024-08-19T00:46:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.713+0000 7fa41b061f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a6cd12c0a0 con 0x55a6cd0865b0 2024-08-19T00:46:23.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa417800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd086990 0x55a6cd11e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa417800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd086990 0x55a6cd11e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53802/0 (socket says 172.21.15.7:53802) 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa417800640 1 -- 172.21.15.7:0/2641087180 learned_addr learned my addr 172.21.15.7:0/2641087180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa418200640 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd0865b0 0x55a6cd11dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa418c00640 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd1222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa418200640 1 -- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 msgr2=0x55a6cd1222e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa418200640 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd1222e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa418200640 1 -- 172.21.15.7:0/2641087180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd086990 msgr2=0x55a6cd11e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa418200640 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd086990 0x55a6cd11e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.714+0000 7fa418200640 1 -- 172.21.15.7:0/2641087180 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ccf7fb30 con 0x55a6cd0865b0 2024-08-19T00:46:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa418200640 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd0865b0 0x55a6cd11dd10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa408009820 tx=0x7fa408005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1848a4a033dc68 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa416400640 1 -- 172.21.15.7:0/2641087180 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408008870 con 0x55a6cd0865b0 2024-08-19T00:46:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa416400640 1 -- 172.21.15.7:0/2641087180 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408018070 con 0x55a6cd0865b0 2024-08-19T00:46:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa416400640 1 -- 172.21.15.7:0/2641087180 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408008c30 con 0x55a6cd0865b0 2024-08-19T00:46:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 -- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd0865b0 msgr2=0x55a6cd11dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd0865b0 0x55a6cd11dd10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa408009820 tx=0x7fa408005a00 comp rx=0 tx=0).stop 2024-08-19T00:46:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 -- 172.21.15.7:0/2641087180 shutdown_connections 2024-08-19T00:46:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd1222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd086990 0x55a6cd11e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 --2- 172.21.15.7:0/2641087180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd0865b0 0x55a6cd11dd10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 -- 172.21.15.7:0/2641087180 >> 172.21.15.7:0/2641087180 conn(0x55a6cd0834e0 msgr2=0x55a6cd053ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.715+0000 7fa41b061f40 1 -- 172.21.15.7:0/2641087180 shutdown_connections 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.716+0000 7fa41b061f40 1 -- 172.21.15.7:0/2641087180 wait complete. 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.716+0000 7fa41b061f40 1 Processor -- start 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.716+0000 7fa41b061f40 1 -- start start 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.717+0000 7fa41b061f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd0865b0 0x55a6cd084fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.717+0000 7fa41b061f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd086990 0x55a6cd11f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.717+0000 7fa41b061f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd11f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.717+0000 7fa41b061f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd1210b0 con 0x55a6cd0865b0 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.717+0000 7fa41b061f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd1248e0 con 0x55a6cd09e8d0 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.717+0000 7fa41b061f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a6cd124570 con 0x55a6cd086990 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.717+0000 7fa418200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd0865b0 0x55a6cd084fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd0865b0 0x55a6cd084fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53810/0 (socket says 172.21.15.7:53810) 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418200640 1 -- 172.21.15.7:0/3128224572 learned_addr learned my addr 172.21.15.7:0/3128224572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418c00640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd11f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa417800640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd086990 0x55a6cd11f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418c00640 1 -- 172.21.15.7:0/3128224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd086990 msgr2=0x55a6cd11f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418c00640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a6cd086990 0x55a6cd11f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418c00640 1 -- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd0865b0 msgr2=0x55a6cd084fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418c00640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd0865b0 0x55a6cd084fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418c00640 1 -- 172.21.15.7:0/3128224572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ccfbc080 con 0x55a6cd09e8d0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418200640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cd0865b0 0x55a6cd084fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.718+0000 7fa418c00640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd11f870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa41000ef60 tx=0x7fa41000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.719+0000 7fa415000640 1 -- 172.21.15.7:0/3128224572 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4100060d0 con 0x55a6cd09e8d0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.719+0000 7fa415000640 1 -- 172.21.15.7:0/3128224572 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa410017070 con 0x55a6cd09e8d0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.719+0000 7fa415000640 1 -- 172.21.15.7:0/3128224572 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410004520 con 0x55a6cd09e8d0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.719+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6cd1263a0 con 0x55a6cd09e8d0 2024-08-19T00:46:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.719+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cd123950 con 0x55a6cd09e8d0 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.721+0000 7fa415000640 1 -- 172.21.15.7:0/3128224572 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4100046c0 con 0x55a6cd09e8d0 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.722+0000 7fa415000640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3f806a840 0x7fa3f806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.722+0000 7fa415000640 1 -- 172.21.15.7:0/3128224572 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7fa410089ec0 con 0x55a6cd09e8d0 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.722+0000 7fa418200640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3f806a840 0x7fa3f806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.722+0000 7fa41b061f40 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55a6cd052c60 0x55a6cd1c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.722+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:1 12.15 12:aa448500:::500.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) -- 0x55a6cd0854e0 con 0x55a6cd052c60 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.722+0000 7fa417800640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55a6cd052c60 0x55a6cd1c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.723+0000 7fa418200640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3f806a840 0x7fa3f806cd00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa408000c00 tx=0x7fa408012000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.723+0000 7fa417800640 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55a6cd052c60 0x55a6cd1c4fe0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.724+0000 7fa417800640 1 -- 172.21.15.7:0/3128224572 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(1 500.00000000 [truncate 0] v112'293 uv293 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa404054990 con 0x55a6cd052c60 2024-08-19T00:46:23.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55a6cd052c60 msgr2=0x55a6cd1c4fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55a6cd052c60 0x55a6cd1c4fe0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3f806a840 msgr2=0x7fa3f806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa3f806a840 0x7fa3f806cd00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa408000c00 tx=0x7fa408012000 comp rx=0 tx=0).stop 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 msgr2=0x55a6cd11f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 --2- 172.21.15.7:0/3128224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6cd09e8d0 0x55a6cd11f870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa41000ef60 tx=0x7fa41000ef90 comp rx=0 tx=0).stop 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa418c00640 1 -- 172.21.15.7:0/3128224572 reap_dead start 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 shutdown_connections 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 >> 172.21.15.7:0/3128224572 conn(0x55a6cd0834e0 msgr2=0x55a6cd0536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 shutdown_connections 2024-08-19T00:46:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.725+0000 7fa41b061f40 1 -- 172.21.15.7:0/3128224572 wait complete. 2024-08-19T00:46:23.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.888+0000 7f08c6600640 1 Processor -- start 2024-08-19T00:46:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.889+0000 7f08c6600640 1 -- start start 2024-08-19T00:46:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.890+0000 7f08c6600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f08c00731c0 0x7f08c00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.890+0000 7f08c6600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c00aeae0 con 0x7f08c00ae2b0 2024-08-19T00:46:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.890+0000 7f08c6600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c00aedc0 con 0x7f08c0158cd0 2024-08-19T00:46:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.890+0000 7f08c6600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f08c00af0a0 con 0x7f08c00731c0 2024-08-19T00:46:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.890+0000 7f08bfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f08c00ae2b0 0x7f08c00b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52648/0 (socket says 172.21.15.7:52648) 2024-08-19T00:46:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.890+0000 7f08bfe00640 1 -- 172.21.15.7:0/583888739 learned_addr learned my addr 172.21.15.7:0/583888739 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.890+0000 7f08b7e00640 1 --2- 172.21.15.7:0/583888739 >> v2:172.21.15.162:3300/0 conn(0x7f08c00731c0 0x7f08c00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.891+0000 7f08bea00640 1 -- 172.21.15.7:0/583888739 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525116901 0 0) 0x7f08c00aeae0 con 0x7f08c00ae2b0 2024-08-19T00:46:23.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.891+0000 7f08bea00640 1 -- 172.21.15.7:0/583888739 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08a4005730 con 0x7f08c00ae2b0 2024-08-19T00:46:23.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.891+0000 7f08bea00640 1 -- 172.21.15.7:0/583888739 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315669608 0 0) 0x7f08c00aedc0 con 0x7f08c0158cd0 2024-08-19T00:46:23.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.891+0000 7f08b7e00640 1 -- 172.21.15.7:0/583888739 >> v1:172.21.15.162:6789/0 conn(0x7f08c0158cd0 legacy=0x7f08c0072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.891+0000 7f08b7e00640 1 -- 172.21.15.7:0/583888739 >> v1:172.21.15.7:6789/0 conn(0x7f08c00ae2b0 legacy=0x7f08c00b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.891+0000 7f08b7e00640 1 -- 172.21.15.7:0/583888739 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c00af380 con 0x7f08c00731c0 2024-08-19T00:46:23.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.892+0000 7f08b7e00640 1 --2- 172.21.15.7:0/583888739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c00731c0 0x7f08c00add70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f08a80097a0 tx=0x7f08a802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e928423e7f8ce2dd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.892+0000 7f08bea00640 1 -- 172.21.15.7:0/583888739 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8037070 con 0x7f08c00731c0 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.892+0000 7f08bea00640 1 -- 172.21.15.7:0/583888739 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a8032440 con 0x7f08c00731c0 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.892+0000 7f08bea00640 1 -- 172.21.15.7:0/583888739 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a802ae60 con 0x7f08c00731c0 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.892+0000 7f08c6600640 1 -- 172.21.15.7:0/583888739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c00731c0 msgr2=0x7f08c00add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.893+0000 7f08c6600640 1 --2- 172.21.15.7:0/583888739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c00731c0 0x7f08c00add70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f08a80097a0 tx=0x7f08a802a110 comp rx=0 tx=0).stop 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.893+0000 7f08c6600640 1 -- 172.21.15.7:0/583888739 shutdown_connections 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.893+0000 7f08c6600640 1 --2- 172.21.15.7:0/583888739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c00731c0 0x7f08c00add70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.893+0000 7f08c6600640 1 -- 172.21.15.7:0/583888739 >> 172.21.15.7:0/583888739 conn(0x7f08c00b2300 msgr2=0x7f08c006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.893+0000 7f08c6600640 1 -- 172.21.15.7:0/583888739 shutdown_connections 2024-08-19T00:46:23.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.893+0000 7f08c6600640 1 -- 172.21.15.7:0/583888739 wait complete. 2024-08-19T00:46:23.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.894+0000 7f08c6600640 1 Processor -- start 2024-08-19T00:46:23.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.894+0000 7f08c6600640 1 -- start start 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.895+0000 7f08c6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08c00731c0 0x7f08c01f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.895+0000 7f08c6600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08c00ae2b0 0x7f08c01f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.895+0000 7f08c6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c015c7f0 0x7f08c01ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.895+0000 7f08c6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08c00b3860 con 0x7f08c00731c0 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.895+0000 7f08c6600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08c00ae760 con 0x7f08c015c7f0 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.895+0000 7f08c6600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08c00b39e0 con 0x7f08c00ae2b0 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08c00731c0 0x7f08c01f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08c00731c0 0x7f08c01f76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46012/0 (socket says 172.21.15.7:46012) 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 -- 172.21.15.7:0/2629625364 learned_addr learned my addr 172.21.15.7:0/2629625364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bfe00640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c015c7f0 0x7f08c01ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08b7e00640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08c00ae2b0 0x7f08c01f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 -- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08c00ae2b0 msgr2=0x7f08c01f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08c00ae2b0 0x7f08c01f7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 -- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c015c7f0 msgr2=0x7f08c01ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:23.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c015c7f0 0x7f08c01ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:23.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 -- 172.21.15.7:0/2629625364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c015cc90 con 0x7f08c00731c0 2024-08-19T00:46:23.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bfe00640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c015c7f0 0x7f08c01ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.896+0000 7f08bf400640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08c00731c0 0x7f08c01f76b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f08b000c3c0 tx=0x7f08b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.897+0000 7f08b7400640 1 -- 172.21.15.7:0/2629625364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0017070 con 0x7f08c00731c0 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.897+0000 7f08b7400640 1 -- 172.21.15.7:0/2629625364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b00035f0 con 0x7f08c00731c0 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.897+0000 7f08b7400640 1 -- 172.21.15.7:0/2629625364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b00039e0 con 0x7f08c00731c0 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.897+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c015cf70 con 0x7f08c00731c0 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.897+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c015d530 con 0x7f08c00731c0 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.898+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c00add70 con 0x7f08c00731c0 2024-08-19T00:46:23.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.899+0000 7f08b7400640 1 -- 172.21.15.7:0/2629625364 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08b001a070 con 0x7f08c00731c0 2024-08-19T00:46:23.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.900+0000 7f08b7400640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f089c06be60 0x7f089c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:23.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.900+0000 7f08b7400640 1 -- 172.21.15.7:0/2629625364 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7f08b008aad0 con 0x7f08c00731c0 2024-08-19T00:46:23.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.900+0000 7f08b7e00640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f089c06be60 0x7f089c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:23.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.901+0000 7f08b7e00640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f089c06be60 0x7f089c06e320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f08a8034000 tx=0x7f08a802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:23.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:23.904+0000 7f08b7400640 1 -- 172.21.15.7:0/2629625364 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f08b00584d0 con 0x7f08c00731c0 2024-08-19T00:46:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.127+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f08c015d950 con 0x7f08c00731c0 2024-08-19T00:46:24.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.289+0000 7f08b7400640 1 -- 172.21.15.7:0/2629625364 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v242) ==== 162+0+0 (secure 0 0 0) 0x7f08b005c7d0 con 0x7f08c00731c0 2024-08-19T00:46:24.291 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f089c06be60 msgr2=0x7f089c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f089c06be60 0x7f089c06e320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f08a8034000 tx=0x7f08a802e000 comp rx=0 tx=0).stop 2024-08-19T00:46:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08c00731c0 msgr2=0x7f08c01f76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08c00731c0 0x7f08c01f76b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f08b000c3c0 tx=0x7f08b000c880 comp rx=0 tx=0).stop 2024-08-19T00:46:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 shutdown_connections 2024-08-19T00:46:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f089c06be60 0x7f089c06e320 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08c015c7f0 0x7f08c01ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08c00ae2b0 0x7f08c01f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 --2- 172.21.15.7:0/2629625364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08c00731c0 0x7f08c01f76b0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 >> 172.21.15.7:0/2629625364 conn(0x7f08c00b2300 msgr2=0x7f08c00b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 shutdown_connections 2024-08-19T00:46:24.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.291+0000 7f08c6600640 1 -- 172.21.15.7:0/2629625364 wait complete. 2024-08-19T00:46:24.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:24.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.875+0000 7fdb1fe00640 1 Processor -- start 2024-08-19T00:46:24.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.875+0000 7fdb1fe00640 1 -- start start 2024-08-19T00:46:24.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.876+0000 7fdb1fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdb180b38a0 0x7fdb18162db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.876+0000 7fdb1fe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb1815b6b0 con 0x7fdb180cda20 2024-08-19T00:46:24.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.876+0000 7fdb1fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb180d0a40 con 0x7fdb181632f0 2024-08-19T00:46:24.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.876+0000 7fdb1fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdb180b3d00 con 0x7fdb180b38a0 2024-08-19T00:46:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb1d400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdb180cda20 0x7fdb180cde00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52658/0 (socket says 172.21.15.7:52658) 2024-08-19T00:46:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb1d400640 1 -- 172.21.15.7:0/2301348550 learned_addr learned my addr 172.21.15.7:0/2301348550 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb1ca00640 1 --2- 172.21.15.7:0/2301348550 >> v2:172.21.15.162:3300/0 conn(0x7fdb180b38a0 0x7fdb18162db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678597654 0 0) 0x7fdb0c001110 con 0x7fdb180cda20 2024-08-19T00:46:24.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb00005730 con 0x7fdb180cda20 2024-08-19T00:46:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233795539 0 0) 0x7fdb180d0a40 con 0x7fdb181632f0 2024-08-19T00:46:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb0c001110 con 0x7fdb181632f0 2024-08-19T00:46:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 864306209 0 0) 0x7fdb00005730 con 0x7fdb180cda20 2024-08-19T00:46:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 >> v2:172.21.15.162:3300/0 conn(0x7fdb180b38a0 msgr2=0x7fdb18162db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 --2- 172.21.15.7:0/2301348550 >> v2:172.21.15.162:3300/0 conn(0x7fdb180b38a0 0x7fdb18162db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 >> v1:172.21.15.162:6789/0 conn(0x7fdb181632f0 legacy=0x7fdb181656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb180d0d20 con 0x7fdb180cda20 2024-08-19T00:46:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.877+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fdb0c001840 con 0x7fdb180cda20 2024-08-19T00:46:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 >> v1:172.21.15.7:6789/0 conn(0x7fdb180cda20 legacy=0x7fdb180cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb17e00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb000061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb17e00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb00006a10 0x7fdb00006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb17e00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb000073d0 0x7fdb0000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb180b3d00 con 0x7fdb00005da0 2024-08-19T00:46:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0000e2a0 con 0x7fdb000073d0 2024-08-19T00:46:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0000e4a0 con 0x7fdb00006a10 2024-08-19T00:46:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1d400640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb000061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1ca00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb00006a10 0x7fdb00006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1de00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb000073d0 0x7fdb0000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1d400640 1 -- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb00006a10 msgr2=0x7fdb00006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1d400640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb00006a10 0x7fdb00006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1d400640 1 -- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb000073d0 msgr2=0x7fdb0000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1d400640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb000073d0 0x7fdb0000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1d400640 1 -- 172.21.15.7:0/2301348550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00005730 con 0x7fdb00005da0 2024-08-19T00:46:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1de00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb000073d0 0x7fdb0000dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.878+0000 7fdb1de00640 1 -- 172.21.15.7:0/2301348550 reap_dead start 2024-08-19T00:46:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.879+0000 7fdb1d400640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb000061a0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c320 tx=0x7fdb00007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629e8dea2475710b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c036070 con 0x7fdb00005da0 2024-08-19T00:46:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c005af0 con 0x7fdb00005da0 2024-08-19T00:46:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb17e00640 1 -- 172.21.15.7:0/2301348550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c007dd0 con 0x7fdb00005da0 2024-08-19T00:46:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb1fe00640 1 -- 172.21.15.7:0/2301348550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 msgr2=0x7fdb000061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb000061a0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c320 tx=0x7fdb00007a40 comp rx=0 tx=0).stop 2024-08-19T00:46:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb1fe00640 1 -- 172.21.15.7:0/2301348550 shutdown_connections 2024-08-19T00:46:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/2301348550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb000061a0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb1fe00640 1 -- 172.21.15.7:0/2301348550 >> 172.21.15.7:0/2301348550 conn(0x7fdb180b6840 msgr2=0x7fdb180b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb1fe00640 1 -- 172.21.15.7:0/2301348550 shutdown_connections 2024-08-19T00:46:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.880+0000 7fdb1fe00640 1 -- 172.21.15.7:0/2301348550 wait complete. 2024-08-19T00:46:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.882+0000 7fdb1fe00640 1 Processor -- start 2024-08-19T00:46:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.882+0000 7fdb1fe00640 1 -- start start 2024-08-19T00:46:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb1814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb180ae0e0 0x7fdb1815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb1815a0a0 0x7fdb1815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1809aa70 con 0x7fdb00005da0 2024-08-19T00:46:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1809ae30 con 0x7fdb1815a0a0 2024-08-19T00:46:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb1809abf0 con 0x7fdb180ae0e0 2024-08-19T00:46:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb1814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb1814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46024/0 (socket says 172.21.15.7:46024) 2024-08-19T00:46:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1d400640 1 -- 172.21.15.7:0/728011076 learned_addr learned my addr 172.21.15.7:0/728011076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1ca00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb180ae0e0 0x7fdb1815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.883+0000 7fdb1de00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb1815a0a0 0x7fdb1815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb1d400640 1 -- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb180ae0e0 msgr2=0x7fdb1815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb1d400640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb180ae0e0 0x7fdb1815c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb1d400640 1 -- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb1815a0a0 msgr2=0x7fdb1815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb1d400640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb1815a0a0 0x7fdb1815a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb1d400640 1 -- 172.21.15.7:0/728011076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb180ae660 con 0x7fdb00005da0 2024-08-19T00:46:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb1d400640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb1814bd00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c440 tx=0x7fdb180d0c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb15600640 1 -- 172.21.15.7:0/728011076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c041020 con 0x7fdb00005da0 2024-08-19T00:46:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb15600640 1 -- 172.21.15.7:0/728011076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c007070 con 0x7fdb00005da0 2024-08-19T00:46:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb15600640 1 -- 172.21.15.7:0/728011076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c036030 con 0x7fdb00005da0 2024-08-19T00:46:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.884+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb180ae940 con 0x7fdb00005da0 2024-08-19T00:46:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.885+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb180aef00 con 0x7fdb00005da0 2024-08-19T00:46:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.886+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb180b21e0 con 0x7fdb00005da0 2024-08-19T00:46:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.886+0000 7fdb15600640 1 -- 172.21.15.7:0/728011076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb0c044020 con 0x7fdb00005da0 2024-08-19T00:46:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.887+0000 7fdb15600640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdaf806be30 0x7fdaf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:24.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.887+0000 7fdb15600640 1 -- 172.21.15.7:0/728011076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7fdb0c0ab7e0 con 0x7fdb00005da0 2024-08-19T00:46:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.888+0000 7fdb1ca00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdaf806be30 0x7fdaf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.888+0000 7fdb1ca00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdaf806be30 0x7fdaf806e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdb1814fe90 tx=0x7fdb04009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:24.891+0000 7fdb15600640 1 -- 172.21.15.7:0/728011076 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdb0c04b030 con 0x7fdb00005da0 2024-08-19T00:46:25.027 INFO:tasks.ceph.mds.c.smithi007.stderr: -36> 2024-08-19T00:46:20.273+0000 7fe10e400640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2024-08-19T00:46:25.066 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:46:25.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.113+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb180b1f00 con 0x7fdb00005da0 2024-08-19T00:46:25.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.114+0000 7fdb15600640 1 -- 172.21.15.7:0/728011076 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 243 v243) ==== 95+0+4402 (secure 0 0 0) 0x7fdb1815b6b0 con 0x7fdb00005da0 2024-08-19T00:46:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:25.116 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":243,"btime":"2024-08-19T00:46:24:291631+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":243,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:24.291620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9192":{"gid":9192,"name":"a","rank":0,"incarnation":243,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/1141791797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1141791797},{"type":"v1","addr":"172.21.15.7:6837","nonce":1141791797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:25.116 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 243 2024-08-19T00:46:25.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdaf806be30 msgr2=0x7fdaf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:25.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdaf806be30 0x7fdaf806e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdb1814fe90 tx=0x7fdb04009190 comp rx=0 tx=0).stop 2024-08-19T00:46:25.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 msgr2=0x7fdb1814bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb1814bd00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c440 tx=0x7fdb180d0c10 comp rx=0 tx=0).stop 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 shutdown_connections 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdaf806be30 0x7fdaf806e2f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb1815a0a0 0x7fdb1815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb180ae0e0 0x7fdb1815c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 --2- 172.21.15.7:0/728011076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb00005da0 0x7fdb1814bd00 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.116+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 >> 172.21.15.7:0/728011076 conn(0x7fdb180b6840 msgr2=0x7fdb181504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.117+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 shutdown_connections 2024-08-19T00:46:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:25.117+0000 7fdb1fe00640 1 -- 172.21.15.7:0/728011076 wait complete. 2024-08-19T00:46:25.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 243, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:46:24.291620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 112, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9192}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9192': {'gid': 9192, 'name': 'a', 'rank': 0, 'incarnation': 243, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/1141791797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1141791797}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1141791797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:46:25.135 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9192:up:replay 2024-08-19T00:46:25.135 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:46:30.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:30.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.707+0000 7f56e5000640 1 Processor -- start 2024-08-19T00:46:30.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.707+0000 7f56e5000640 1 -- start start 2024-08-19T00:46:30.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56e5000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56e006e710 0x7f56e0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56e5000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56e00b3750 0x7f56e00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56e5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e00cdfb0 con 0x7f56e00d03c0 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56e5000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f56e00cebc0 con 0x7f56e006e710 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56e5000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f56e00ce290 con 0x7f56e00b3750 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56d7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56e006e710 0x7f56e0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56d7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56e006e710 0x7f56e0071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46048/0 (socket says 172.21.15.7:46048) 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.708+0000 7f56d7e00640 1 -- 172.21.15.7:0/4136777106 learned_addr learned my addr 172.21.15.7:0/4136777106 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.709+0000 7f56de800640 1 --2- 172.21.15.7:0/4136777106 >> v2:172.21.15.162:3300/0 conn(0x7f56e00b3750 0x7f56e00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.709+0000 7f56d7e00640 1 -- 172.21.15.7:0/4136777106 >> v2:172.21.15.162:3300/0 conn(0x7f56e00b3750 msgr2=0x7f56e00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:30.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.709+0000 7f56d7e00640 1 --2- 172.21.15.7:0/4136777106 >> v2:172.21.15.162:3300/0 conn(0x7f56e00b3750 0x7f56e00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.709+0000 7f56d7e00640 1 -- 172.21.15.7:0/4136777106 >> v1:172.21.15.162:6789/0 conn(0x7f56e00d03c0 legacy=0x7f56e00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:30.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.709+0000 7f56d7e00640 1 -- 172.21.15.7:0/4136777106 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e00ce570 con 0x7f56e006e710 2024-08-19T00:46:30.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.709+0000 7f56de800640 1 --2- 172.21.15.7:0/4136777106 >> v2:172.21.15.162:3300/0 conn(0x7f56e00b3750 0x7f56e00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.710+0000 7f56d7e00640 1 --2- 172.21.15.7:0/4136777106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e006e710 0x7f56e0071980 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f56c800bb10 tx=0x7f56c802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ab332e2cb11e4c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.710+0000 7f56dd400640 1 -- 172.21.15.7:0/4136777106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c802f070 con 0x7f56e006e710 2024-08-19T00:46:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.710+0000 7f56dd400640 1 -- 172.21.15.7:0/4136777106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8038070 con 0x7f56e006e710 2024-08-19T00:46:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.710+0000 7f56dd400640 1 -- 172.21.15.7:0/4136777106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8032a00 con 0x7f56e006e710 2024-08-19T00:46:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 -- 172.21.15.7:0/4136777106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e006e710 msgr2=0x7f56e0071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:30.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 --2- 172.21.15.7:0/4136777106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e006e710 0x7f56e0071980 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f56c800bb10 tx=0x7f56c802c920 comp rx=0 tx=0).stop 2024-08-19T00:46:30.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 -- 172.21.15.7:0/4136777106 shutdown_connections 2024-08-19T00:46:30.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 --2- 172.21.15.7:0/4136777106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e006e710 0x7f56e0071980 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 --2- 172.21.15.7:0/4136777106 >> v2:172.21.15.162:3300/0 conn(0x7f56e00b3750 0x7f56e00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 -- 172.21.15.7:0/4136777106 >> 172.21.15.7:0/4136777106 conn(0x7f56e006bc70 msgr2=0x7f56e006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:30.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 -- 172.21.15.7:0/4136777106 shutdown_connections 2024-08-19T00:46:30.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.711+0000 7f56e5000640 1 -- 172.21.15.7:0/4136777106 wait complete. 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.712+0000 7f56e5000640 1 Processor -- start 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.713+0000 7f56e5000640 1 -- start start 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.713+0000 7f56e5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e006e710 0x7f56e0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.713+0000 7f56e5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e00b3750 0x7f56e00ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56e5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e00d03c0 0x7f56e00cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56e5000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0073c60 con 0x7f56e00b3750 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56e5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0073ae0 con 0x7f56e006e710 2024-08-19T00:46:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56e5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56e00b3be0 con 0x7f56e00d03c0 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e00b3750 0x7f56e00ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e00b3750 0x7f56e00ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46050/0 (socket says 172.21.15.7:46050) 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 -- 172.21.15.7:0/3686174107 learned_addr learned my addr 172.21.15.7:0/3686174107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56dde00640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e006e710 0x7f56e0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56de800640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e00d03c0 0x7f56e00cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 -- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e00d03c0 msgr2=0x7f56e00cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e00d03c0 0x7f56e00cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 -- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e006e710 msgr2=0x7f56e0153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e006e710 0x7f56e0153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 -- 172.21.15.7:0/3686174107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e0154490 con 0x7f56e00b3750 2024-08-19T00:46:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.714+0000 7f56d7e00640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e00b3750 0x7f56e00ae9c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000c00 tx=0x7f56c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.715+0000 7f56d6000640 1 -- 172.21.15.7:0/3686174107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8033cb0 con 0x7f56e00b3750 2024-08-19T00:46:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.715+0000 7f56d6000640 1 -- 172.21.15.7:0/3686174107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8033e50 con 0x7f56e00b3750 2024-08-19T00:46:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.715+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e015d4e0 con 0x7f56e00b3750 2024-08-19T00:46:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.715+0000 7f56d6000640 1 -- 172.21.15.7:0/3686174107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8004260 con 0x7f56e00b3750 2024-08-19T00:46:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.715+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e0153750 con 0x7f56e00b3750 2024-08-19T00:46:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.716+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e0071980 con 0x7f56e00b3750 2024-08-19T00:46:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.717+0000 7f56d6000640 1 -- 172.21.15.7:0/3686174107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56c8003610 con 0x7f56e00b3750 2024-08-19T00:46:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.718+0000 7f56d6000640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56bc06be30 0x7f56bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.718+0000 7f56d6000640 1 -- 172.21.15.7:0/3686174107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7f56c80ac430 con 0x7f56e00b3750 2024-08-19T00:46:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.718+0000 7f56dde00640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56bc06be30 0x7f56bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.719+0000 7f56dde00640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56bc06be30 0x7f56bc06e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f56d0004f60 tx=0x7f56d0007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:30.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.722+0000 7f56d6000640 1 -- 172.21.15.7:0/3686174107 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f56c804c030 con 0x7f56e00b3750 2024-08-19T00:46:30.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.942+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56e006c980 con 0x7f56e00b3750 2024-08-19T00:46:30.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.943+0000 7f56d6000640 1 -- 172.21.15.7:0/3686174107 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 246 v246) ==== 95+0+5232 (secure 0 0 0) 0x7f56c8043030 con 0x7f56e00b3750 2024-08-19T00:46:30.945 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:30.946 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":246,"btime":"2024-08-19T00:46:27:303604+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/4168746347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":4168746347},{"type":"v1","addr":"172.21.15.7:6836","nonce":4168746347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":244}],"filesystems":[{"mdsmap":{"epoch":246,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:27.303591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9192":{"gid":9192,"name":"a","rank":0,"incarnation":243,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1141791797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1141791797},{"type":"v1","addr":"172.21.15.7:6837","nonce":1141791797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9192,"qdb_cluster":[9192]},"id":6}]} 2024-08-19T00:46:30.947 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 246 2024-08-19T00:46:30.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56bc06be30 msgr2=0x7f56bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:30.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56bc06be30 0x7f56bc06e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f56d0004f60 tx=0x7f56d0007e30 comp rx=0 tx=0).stop 2024-08-19T00:46:30.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e00b3750 msgr2=0x7f56e00ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e00b3750 0x7f56e00ae9c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000c00 tx=0x7f56c8004730 comp rx=0 tx=0).stop 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 shutdown_connections 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56bc06be30 0x7f56bc06e2f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56e00d03c0 0x7f56e00cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e00b3750 0x7f56e00ae9c0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 --2- 172.21.15.7:0/3686174107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e006e710 0x7f56e0153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 >> 172.21.15.7:0/3686174107 conn(0x7f56e006bc70 msgr2=0x7f56e00b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 shutdown_connections 2024-08-19T00:46:30.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:30.945+0000 7f56e5000640 1 -- 172.21.15.7:0/3686174107 wait complete. 2024-08-19T00:46:30.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 246, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:46:27.303591+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 112, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9192}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9192': {'gid': 9192, 'name': 'a', 'rank': 0, 'incarnation': 243, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/1141791797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1141791797}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1141791797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9192, 'qdb_cluster': [9192]} 2024-08-19T00:46:30.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:46:30.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:46:31.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.119+0000 7ff71ce00640 1 Processor -- start 2024-08-19T00:46:31.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.119+0000 7ff71ce00640 1 -- start start 2024-08-19T00:46:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff71ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff71815e3e0 0x7ff7180b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff71ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7180b4860 0x7ff7180d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff71ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7180b4df0 con 0x7ff7180d27b0 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff71ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff7180d3140 con 0x7ff7180b4860 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff71ce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff7180b50d0 con 0x7ff71815e3e0 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff717e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7180b4860 0x7ff7180d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff717e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7180b4860 0x7ff7180d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46056/0 (socket says 172.21.15.7:46056) 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.120+0000 7ff717e00640 1 -- 172.21.15.7:0/436192463 learned_addr learned my addr 172.21.15.7:0/436192463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.121+0000 7ff717400640 1 --2- 172.21.15.7:0/436192463 >> v2:172.21.15.162:3300/0 conn(0x7ff71815e3e0 0x7ff7180b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.121+0000 7ff717e00640 1 -- 172.21.15.7:0/436192463 >> v2:172.21.15.162:3300/0 conn(0x7ff71815e3e0 msgr2=0x7ff7180b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.121+0000 7ff717e00640 1 --2- 172.21.15.7:0/436192463 >> v2:172.21.15.162:3300/0 conn(0x7ff71815e3e0 0x7ff7180b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.121+0000 7ff717e00640 1 -- 172.21.15.7:0/436192463 >> v1:172.21.15.162:6789/0 conn(0x7ff7180d27b0 legacy=0x7ff7180b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.121+0000 7ff717e00640 1 -- 172.21.15.7:0/436192463 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7180cf1e0 con 0x7ff7180b4860 2024-08-19T00:46:31.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.121+0000 7ff717400640 1 --2- 172.21.15.7:0/436192463 >> v2:172.21.15.162:3300/0 conn(0x7ff71815e3e0 0x7ff7180b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.122+0000 7ff717e00640 1 --2- 172.21.15.7:0/436192463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180b4860 0x7ff7180d2c00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7ff710009e50 tx=0x7ff71002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d674e275cdaf4494 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.122+0000 7ff716000640 1 -- 172.21.15.7:0/436192463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710036070 con 0x7ff7180b4860 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.122+0000 7ff716000640 1 -- 172.21.15.7:0/436192463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff710031600 con 0x7ff7180b4860 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.122+0000 7ff716000640 1 -- 172.21.15.7:0/436192463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100319d0 con 0x7ff7180b4860 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.122+0000 7ff71ce00640 1 -- 172.21.15.7:0/436192463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180b4860 msgr2=0x7ff7180d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.122+0000 7ff71ce00640 1 --2- 172.21.15.7:0/436192463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180b4860 0x7ff7180d2c00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7ff710009e50 tx=0x7ff71002a730 comp rx=0 tx=0).stop 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.123+0000 7ff71ce00640 1 -- 172.21.15.7:0/436192463 shutdown_connections 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.123+0000 7ff71ce00640 1 --2- 172.21.15.7:0/436192463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180b4860 0x7ff7180d2c00 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.123+0000 7ff71ce00640 1 --2- 172.21.15.7:0/436192463 >> v2:172.21.15.162:3300/0 conn(0x7ff71815e3e0 0x7ff7180b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.123+0000 7ff71ce00640 1 -- 172.21.15.7:0/436192463 >> 172.21.15.7:0/436192463 conn(0x7ff71808dbe0 msgr2=0x7ff71809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.123+0000 7ff71ce00640 1 -- 172.21.15.7:0/436192463 shutdown_connections 2024-08-19T00:46:31.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.123+0000 7ff71ce00640 1 -- 172.21.15.7:0/436192463 wait complete. 2024-08-19T00:46:31.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.124+0000 7ff71ce00640 1 Processor -- start 2024-08-19T00:46:31.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.124+0000 7ff71ce00640 1 -- start start 2024-08-19T00:46:31.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.125+0000 7ff71ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b4860 0x7ff71815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.125+0000 7ff71ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180d27b0 0x7ff7180b9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.125+0000 7ff71ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff71815e3e0 0x7ff7180b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.125+0000 7ff71ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180b13a0 con 0x7ff7180d27b0 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.125+0000 7ff71ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180cee90 con 0x7ff7180b4860 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.125+0000 7ff71ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7180cf9e0 con 0x7ff71815e3e0 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.125+0000 7ff716a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180d27b0 0x7ff7180b9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180d27b0 0x7ff7180b9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46072/0 (socket says 172.21.15.7:46072) 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 -- 172.21.15.7:0/3744593460 learned_addr learned my addr 172.21.15.7:0/3744593460 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff717400640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b4860 0x7ff71815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff717e00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff71815e3e0 0x7ff7180b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 -- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff71815e3e0 msgr2=0x7ff7180b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff71815e3e0 0x7ff7180b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 -- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b4860 msgr2=0x7ff71815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b4860 0x7ff71815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 -- 172.21.15.7:0/3744593460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71815a7d0 con 0x7ff7180d27b0 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.126+0000 7ff716a00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180d27b0 0x7ff7180b9730 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c430 tx=0x7ff70400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.127+0000 7ff70f400640 1 -- 172.21.15.7:0/3744593460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704011790 con 0x7ff7180d27b0 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.127+0000 7ff70f400640 1 -- 172.21.15.7:0/3744593460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff704017070 con 0x7ff7180d27b0 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.127+0000 7ff70f400640 1 -- 172.21.15.7:0/3744593460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704011bb0 con 0x7ff7180d27b0 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.127+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71815aab0 con 0x7ff7180d27b0 2024-08-19T00:46:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.127+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71815b070 con 0x7ff7180d27b0 2024-08-19T00:46:31.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.130+0000 7ff70f400640 1 -- 172.21.15.7:0/3744593460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff70401c460 con 0x7ff7180d27b0 2024-08-19T00:46:31.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.131+0000 7ff70f400640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6f806be30 0x7ff6f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.131+0000 7ff70f400640 1 -- 172.21.15.7:0/3744593460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7ff70408b560 con 0x7ff7180d27b0 2024-08-19T00:46:31.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.131+0000 7ff7212a2740 1 Processor -- start 2024-08-19T00:46:31.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.131+0000 7ff717400640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6f806be30 0x7ff6f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.131+0000 7ff7212a2740 1 -- start start 2024-08-19T00:46:31.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff717400640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6f806be30 0x7ff6f806e2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff71815d320 tx=0x7ff708008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eeb944f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eebb7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebacfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff7212a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625eeaccba0 con 0x5625eeb94110 2024-08-19T00:46:31.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5625eea65230 con 0x5625eebb7f90 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5625eeac8b60 con 0x5625eebb7630 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff717400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eeb944f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff717400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eeb944f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46084/0 (socket says 172.21.15.7:46084) 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.132+0000 7ff717400640 1 -- 172.21.15.7:0/3666809331 learned_addr learned my addr 172.21.15.7:0/3666809331 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff716a00640 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eebb7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717e00640 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebacfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717400640 1 -- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 msgr2=0x5625eebb7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717400640 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eebb7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717400640 1 -- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 msgr2=0x5625eebacfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717400640 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebacfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717400640 1 -- 172.21.15.7:0/3666809331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625eea96bb0 con 0x5625eeb94110 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717e00640 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebacfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:31.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff717400640 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eeb944f0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff70800fd20 tx=0x7ff708012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabe4c593c175fa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff703e00640 1 -- 172.21.15.7:0/3666809331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708023070 con 0x5625eeb94110 2024-08-19T00:46:31.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff703e00640 1 -- 172.21.15.7:0/3666809331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708019070 con 0x5625eeb94110 2024-08-19T00:46:31.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.133+0000 7ff703e00640 1 -- 172.21.15.7:0/3666809331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708013820 con 0x5625eeb94110 2024-08-19T00:46:31.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 -- 172.21.15.7:0/3666809331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 msgr2=0x5625eeb944f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eeb944f0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff70800fd20 tx=0x7ff708012000 comp rx=0 tx=0).stop 2024-08-19T00:46:31.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 -- 172.21.15.7:0/3666809331 shutdown_connections 2024-08-19T00:46:31.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebacfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eebb7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3666809331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eeb944f0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 -- 172.21.15.7:0/3666809331 >> 172.21.15.7:0/3666809331 conn(0x5625eeb31110 msgr2=0x5625eebaef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 -- 172.21.15.7:0/3666809331 shutdown_connections 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.134+0000 7ff7212a2740 1 -- 172.21.15.7:0/3666809331 wait complete. 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.135+0000 7ff7212a2740 1 -- start start 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.135+0000 7ff7212a2740 1 Processor -- start 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eebc2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eeb8b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eeb90dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff7212a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625eebb1060 con 0x5625eeb94110 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5625eea88250 con 0x5625eebb7f90 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5625eebb0770 con 0x5625eebb7630 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff7212a2740 10 client.0 _ll_register_callbacks cb 0x5625eea8c740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff717400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eebc2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff717400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eebc2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46088/0 (socket says 172.21.15.7:46088) 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff717400640 1 -- 172.21.15.7:0/4199593147 learned_addr learned my addr 172.21.15.7:0/4199593147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.136+0000 7ff716a00640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eeb8b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717e00640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eeb90dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717400640 1 -- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 msgr2=0x5625eeb8b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717400640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eeb8b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717400640 1 -- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 msgr2=0x5625eeb90dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717400640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eeb90dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717400640 1 -- 172.21.15.7:0/4199593147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625ee7e02d0 con 0x5625eeb94110 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717e00640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eeb90dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff717400640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eebc2cf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7ff70800afd0 tx=0x7ff708004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88637e57566b6197 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff700c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff700c00640 1 -- 172.21.15.7:0/4199593147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708023040 con 0x5625eeb94110 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff708019070 con 0x5625eeb94110 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.137+0000 7ff700c00640 1 -- 172.21.15.7:0/4199593147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7ff708013830 con 0x5625eeb94110 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff700c00640 1 -- 172.21.15.7:0/4199593147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=246) ==== 24+0+0 (secure 0 0 0) 0x7ff70800f980 con 0x5625eeb94110 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 10 client.9264 fetch_fsmap learned FSMap version 246 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=246,monmap=2+}) -- 0x5625ee8aa6b0 con 0x5625eeb94110 2024-08-19T00:46:31.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff700c00640 1 -- 172.21.15.7:0/4199593147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708019070 con 0x5625eeb94110 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff700c00640 1 -- 172.21.15.7:0/4199593147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 246) ==== 3502+0+0 (secure 0 0 0) 0x7ff70802f070 con 0x5625eeb94110 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 10 client.9264 fetch_fsmap finished waiting for FSMap version 246 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 10 client.9264 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 20 client.9264 populate_metadata read hostname 'smithi007' 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8ca40 0x5625eeb63920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 4 client.9264 mds_command: new command op to 9192 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 --> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625eeada2d0 con 0x5625eeb8ca40 2024-08-19T00:46:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.138+0000 7ff716a00640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8ca40 0x5625eeb63920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.139+0000 7ff716a00640 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8ca40 0x5625eeb63920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0b867b072600cfb server_cookie=6919957af8e4da9b in_seq=0 out_seq=0 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.139+0000 7ff700c00640 10 client.9264 ms_handle_connect on v2:172.21.15.7:6835/1141791797 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff700c00640 1 -- 172.21.15.7:0/4199593147 <== mds.0 v2:172.21.15.7:6835/1141791797 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625eeada2d0 con 0x5625eeb8ca40 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff700c00640 10 client.9264 handle_command_reply: tid=0 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 client.9264 shutdown 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 msgr2=0x5625eebc2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eebc2cf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7ff70800afd0 tx=0x7ff708004730 comp rx=0 tx=0).stop 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 shutdown_connections 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8ca40 0x5625eeb63920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eeb90dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eebb7630 0x5625eeb8b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 --2- 172.21.15.7:0/4199593147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eeb94110 0x5625eebc2cf0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 >> 172.21.15.7:0/4199593147 conn(0x5625eeb31110 msgr2=0x5625eebb2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff700c00640 0 client.9264 ms_handle_reset on v2:172.21.15.7:6835/1141791797 2024-08-19T00:46:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 shutdown_connections 2024-08-19T00:46:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 1 -- 172.21.15.7:0/4199593147 wait complete. 2024-08-19T00:46:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.140+0000 7ff7212a2740 20 client.9264 trim_cache size 0 max 16384 2024-08-19T00:46:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.159+0000 7ff7212a2740 1 Processor -- start 2024-08-19T00:46:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.159+0000 7ff7212a2740 1 -- start start 2024-08-19T00:46:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeb8ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebabea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff7212a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff718200b90 con 0x5625eebb7630 2024-08-19T00:46:31.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181ffef0 con 0x5625eebb7f90 2024-08-19T00:46:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff718200540 con 0x5625eeb94110 2024-08-19T00:46:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff716a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff716a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46098/0 (socket says 172.21.15.7:46098) 2024-08-19T00:46:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff716a00640 1 -- 172.21.15.7:0/1417709809 learned_addr learned my addr 172.21.15.7:0/1417709809 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff717400640 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeb8ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.160+0000 7ff717e00640 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebabea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff716a00640 1 -- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 msgr2=0x5625eeb8ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff716a00640 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeb8ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff716a00640 1 -- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 msgr2=0x5625eebabea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff716a00640 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebabea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff716a00640 1 -- 172.21.15.7:0/1417709809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625eeb691f0 con 0x5625eebb7630 2024-08-19T00:46:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff717e00640 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebabea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff716a00640 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebab960 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c400 tx=0x7ff70401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20adaf305316da7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff703400640 1 -- 172.21.15.7:0/1417709809 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704073070 con 0x5625eebb7630 2024-08-19T00:46:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff703400640 1 -- 172.21.15.7:0/1417709809 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff704057260 con 0x5625eebb7630 2024-08-19T00:46:31.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.161+0000 7ff703400640 1 -- 172.21.15.7:0/1417709809 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7040555d0 con 0x5625eebb7630 2024-08-19T00:46:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 -- 172.21.15.7:0/1417709809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 msgr2=0x5625eebab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebab960 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c400 tx=0x7ff70401e040 comp rx=0 tx=0).stop 2024-08-19T00:46:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 -- 172.21.15.7:0/1417709809 shutdown_connections 2024-08-19T00:46:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebabea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebab960 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 --2- 172.21.15.7:0/1417709809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeb8ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 -- 172.21.15.7:0/1417709809 >> 172.21.15.7:0/1417709809 conn(0x5625eeb31110 msgr2=0x5625eeb688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 -- 172.21.15.7:0/1417709809 shutdown_connections 2024-08-19T00:46:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.162+0000 7ff7212a2740 1 -- 172.21.15.7:0/1417709809 wait complete. 2024-08-19T00:46:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.163+0000 7ff7212a2740 1 -- start start 2024-08-19T00:46:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.163+0000 7ff7212a2740 1 Processor -- start 2024-08-19T00:46:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeba4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebc0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff7212a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebc8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff7212a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625eeb91360 con 0x5625eebb7630 2024-08-19T00:46:31.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5625eebb1060 con 0x5625eebb7f90 2024-08-19T00:46:31.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff7212a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5625eeb8c4b0 con 0x5625eeb94110 2024-08-19T00:46:31.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff7212a2740 10 client.0 _ll_register_callbacks cb 0x7ff70800fbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebc0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebc0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46114/0 (socket says 172.21.15.7:46114) 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 -- 172.21.15.7:0/3692097268 learned_addr learned my addr 172.21.15.7:0/3692097268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 -- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 msgr2=0x5625eeba4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff717400640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeba4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff717e00640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebc8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeba4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 -- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 msgr2=0x5625eebc8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebc8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff716a00640 1 -- 172.21.15.7:0/3692097268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625eebc90e0 con 0x5625eebb7630 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.164+0000 7ff717400640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeba4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff716a00640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebc0fb0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff704078100 tx=0x7ff708014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc5053ed8a425f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff700c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff700c00640 1 -- 172.21.15.7:0/3692097268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704073040 con 0x5625eebb7630 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff700c00640 1 -- 172.21.15.7:0/3692097268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7ff7040555d0 con 0x5625eebb7630 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff704057260 con 0x5625eebb7630 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff700c00640 1 -- 172.21.15.7:0/3692097268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=246) ==== 24+0+0 (secure 0 0 0) 0x7ff704069050 con 0x5625eebb7630 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 10 client.9270 fetch_fsmap learned FSMap version 246 2024-08-19T00:46:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=246,monmap=2+}) -- 0x5625eeb8ab00 con 0x5625eebb7630 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff700c00640 1 -- 172.21.15.7:0/3692097268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff704057260 con 0x5625eebb7630 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff700c00640 1 -- 172.21.15.7:0/3692097268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 246) ==== 3502+0+0 (secure 0 0 0) 0x7ff704061ce0 con 0x5625eebb7630 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 10 client.9270 fetch_fsmap finished waiting for FSMap version 246 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 10 client.9270 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 20 client.9270 populate_metadata read hostname 'smithi007' 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8fb30 0x5625eebd1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 4 client.9270 mds_command: new command op to 9192 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.165+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 --> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] -- command(tid 0: {"prefix": "status"}) -- 0x5625eead4620 con 0x5625eeb8fb30 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff717400640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8fb30 0x5625eebd1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff717400640 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8fb30 0x5625eebd1790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814fd91c3d306647 server_cookie=834089fbf7462905 in_seq=0 out_seq=0 2024-08-19T00:46:31.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff700c00640 10 client.9270 ms_handle_connect on v2:172.21.15.7:6835/1141791797 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff700c00640 1 -- 172.21.15.7:0/3692097268 <== mds.0 v2:172.21.15.7:6835/1141791797 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x5625eead4620 con 0x5625eeb8fb30 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff700c00640 10 client.9270 handle_command_reply: tid=0 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff7212a2740 1 client.9270 shutdown 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 msgr2=0x5625eebc0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.166+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebc0fb0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff704078100 tx=0x7ff708014000 comp rx=0 tx=0).stop 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 shutdown_connections 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:6835/1141791797,v1:172.21.15.7:6837/1141791797] conn(0x5625eeb8fb30 0x5625eebd1790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5625eebb7f90 0x5625eebc8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625eebb7630 0x5625eebc0fb0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff700c00640 0 client.9270 ms_handle_reset on v2:172.21.15.7:6835/1141791797 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 --2- 172.21.15.7:0/3692097268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5625eeb94110 0x5625eeba4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 >> 172.21.15.7:0/3692097268 conn(0x5625eeb31110 msgr2=0x5625eeb90960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 shutdown_connections 2024-08-19T00:46:31.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 1 -- 172.21.15.7:0/3692097268 wait complete. 2024-08-19T00:46:31.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff7212a2740 20 client.9270 trim_cache size 0 max 16384 2024-08-19T00:46:31.183 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:46:31.183 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:46:31.183 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:46:31.183 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9192, 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8710212220000004, 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 246, 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 112, 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 112, 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.132287324 2024-08-19T00:46:31.184 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:46:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6f806be30 msgr2=0x7ff6f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff71ce00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6f806be30 0x7ff6f806e2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff71815d320 tx=0x7ff708008040 comp rx=0 tx=0).stop 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180d27b0 msgr2=0x7ff7180b9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.167+0000 7ff71ce00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180d27b0 0x7ff7180b9730 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c430 tx=0x7ff70400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 shutdown_connections 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff6f806be30 0x7ff6f806e2f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff71815e3e0 0x7ff7180b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7180d27b0 0x7ff7180b9730 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 --2- 172.21.15.7:0/3744593460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b4860 0x7ff71815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 >> 172.21.15.7:0/3744593460 conn(0x7ff71808dbe0 msgr2=0x7ff71809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 shutdown_connections 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.168+0000 7ff71ce00640 1 -- 172.21.15.7:0/3744593460 wait complete. 2024-08-19T00:46:31.187 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:46:31.187 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Truncate 500.00000000', proceeding to ls 2024-08-19T00:46:31.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:46:31.287 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:31.285+0000 7fb4a7a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:46:31.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.347+0000 7ff06ba00640 1 Processor -- start 2024-08-19T00:46:31.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.347+0000 7ff06ba00640 1 -- start start 2024-08-19T00:46:31.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.348+0000 7ff06ba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.348+0000 7ff06ba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0640b3110 0x7ff0640d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff06ba00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0640d5240 con 0x7ff0640d4b30 2024-08-19T00:46:31.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff06ba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff0640b39c0 con 0x7ff0640b3110 2024-08-19T00:46:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff06ba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0640b36e0 con 0x7ff064161ba0 2024-08-19T00:46:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff063e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0640d4b30 0x7ff06406c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52690/0 (socket says 172.21.15.7:52690) 2024-08-19T00:46:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff063e00640 1 -- 172.21.15.7:0/2827897389 learned_addr learned my addr 172.21.15.7:0/2827897389 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff069a00640 1 --2- 172.21.15.7:0/2827897389 >> v2:172.21.15.162:3300/0 conn(0x7ff0640b3110 0x7ff0640d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff069000640 1 --2- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff063400640 1 -- 172.21.15.7:0/2827897389 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210110989 0 0) 0x7ff0640d5240 con 0x7ff0640d4b30 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.349+0000 7ff063400640 1 -- 172.21.15.7:0/2827897389 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04c003520 con 0x7ff0640d4b30 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.350+0000 7ff063400640 1 -- 172.21.15.7:0/2827897389 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1838962759 0 0) 0x7ff04c003520 con 0x7ff0640d4b30 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.350+0000 7ff069a00640 1 -- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 msgr2=0x7ff0640d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.350+0000 7ff069a00640 1 --2- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.350+0000 7ff069a00640 1 -- 172.21.15.7:0/2827897389 >> v1:172.21.15.7:6789/0 conn(0x7ff0640d4b30 legacy=0x7ff06406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.350+0000 7ff069a00640 1 -- 172.21.15.7:0/2827897389 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06406e3a0 con 0x7ff0640b3110 2024-08-19T00:46:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.350+0000 7ff069000640 1 --2- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.351+0000 7ff069a00640 1 --2- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640b3110 0x7ff0640d29d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009d90 tx=0x7ff05c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ff074e8a77fa86 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.351+0000 7ff063400640 1 -- 172.21.15.7:0/2827897389 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050001670 con 0x7ff0640b3110 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.351+0000 7ff063400640 1 -- 172.21.15.7:0/2827897389 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c007540 con 0x7ff0640b3110 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.351+0000 7ff063400640 1 -- 172.21.15.7:0/2827897389 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c007910 con 0x7ff0640b3110 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 -- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640b3110 msgr2=0x7ff0640d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 --2- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640b3110 0x7ff0640d29d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009d90 tx=0x7ff05c02a5f0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 -- 172.21.15.7:0/2827897389 shutdown_connections 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 --2- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640b3110 0x7ff0640d29d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 --2- 172.21.15.7:0/2827897389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 -- 172.21.15.7:0/2827897389 >> 172.21.15.7:0/2827897389 conn(0x7ff06408c000 msgr2=0x7ff0640d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 -- 172.21.15.7:0/2827897389 shutdown_connections 2024-08-19T00:46:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.352+0000 7ff06ba00640 1 -- 172.21.15.7:0/2827897389 wait complete. 2024-08-19T00:46:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.353+0000 7ff06ba00640 1 Processor -- start 2024-08-19T00:46:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.353+0000 7ff06ba00640 1 -- start start 2024-08-19T00:46:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.354+0000 7ff06ba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0640b3110 0x7ff0640cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.354+0000 7ff06ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640d4b30 0x7ff0640b9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.354+0000 7ff06ba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.354+0000 7ff06ba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff064161f80 con 0x7ff0640b3110 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.354+0000 7ff06ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0640b1be0 con 0x7ff0640d4b30 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.354+0000 7ff06ba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff064162100 con 0x7ff064161ba0 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0640b3110 0x7ff0640cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0640b3110 0x7ff0640cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46122/0 (socket says 172.21.15.7:46122) 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 -- 172.21.15.7:0/3136616676 learned_addr learned my addr 172.21.15.7:0/3136616676 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff063e00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640d4b30 0x7ff0640b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069a00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 -- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 msgr2=0x7ff0640b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 -- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640d4b30 msgr2=0x7ff0640b9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640d4b30 0x7ff0640b9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 -- 172.21.15.7:0/3136616676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0640cbfa0 con 0x7ff0640b3110 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.355+0000 7ff069000640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0640b3110 0x7ff0640cca10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7ff05800e960 tx=0x7ff05800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.356+0000 7ff060c00640 1 -- 172.21.15.7:0/3136616676 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058017070 con 0x7ff0640b3110 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.356+0000 7ff060c00640 1 -- 172.21.15.7:0/3136616676 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05800ca00 con 0x7ff0640b3110 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.356+0000 7ff060c00640 1 -- 172.21.15.7:0/3136616676 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05800cdd0 con 0x7ff0640b3110 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.356+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0640ce190 con 0x7ff0640b3110 2024-08-19T00:46:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.356+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0640cc4f0 con 0x7ff0640b3110 2024-08-19T00:46:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.357+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0640d2490 con 0x7ff0640b3110 2024-08-19T00:46:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.358+0000 7ff060c00640 1 -- 172.21.15.7:0/3136616676 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff05801a070 con 0x7ff0640b3110 2024-08-19T00:46:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.359+0000 7ff060c00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff04406be30 0x7ff04406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.359+0000 7ff060c00640 1 -- 172.21.15.7:0/3136616676 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7ff05808b5c0 con 0x7ff0640b3110 2024-08-19T00:46:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.359+0000 7ff063e00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff04406be30 0x7ff04406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.360+0000 7ff063e00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff04406be30 0x7ff04406e2f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff064072f50 tx=0x7ff050001690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.363+0000 7ff060c00640 1 -- 172.21.15.7:0/3136616676 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff058058fc0 con 0x7ff0640b3110 2024-08-19T00:46:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.584+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff0640ba2a0 con 0x7ff0640b3110 2024-08-19T00:46:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.585+0000 7ff060c00640 1 -- 172.21.15.7:0/3136616676 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v246) ==== 53+0+73 (secure 0 0 0) 0x7ff05805d2c0 con 0x7ff0640b3110 2024-08-19T00:46:31.586 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff04406be30 msgr2=0x7ff04406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff04406be30 0x7ff04406e2f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff064072f50 tx=0x7ff050001690 comp rx=0 tx=0).stop 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0640b3110 msgr2=0x7ff0640cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0640b3110 0x7ff0640cca10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7ff05800e960 tx=0x7ff05800ee20 comp rx=0 tx=0).stop 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 shutdown_connections 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff04406be30 0x7ff04406e2f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff064161ba0 0x7ff0640b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0640d4b30 0x7ff0640b9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 --2- 172.21.15.7:0/3136616676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0640b3110 0x7ff0640cca10 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 >> 172.21.15.7:0/3136616676 conn(0x7ff06408c000 msgr2=0x7ff06406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 shutdown_connections 2024-08-19T00:46:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31.587+0000 7ff06ba00640 1 -- 172.21.15.7:0/3136616676 wait complete. 2024-08-19T00:46:31.607 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:46:31.607 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:46:31.607 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:46:31.608 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:46:31.608 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:46:31.608 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:46:31.608 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:46:31.608 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:46:31.608 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:46:31.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:31.609 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:46:31.646 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:46:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:46:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:46:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:46:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42270sec preferred_lft 42270sec 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:46:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:46:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:46:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:31.650 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:46:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:46:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:46:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:31.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:31.651 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:46:31.740 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:46:31.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:31.743 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:46:31.779 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:46:31.779 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:46:31.779 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:46:31.780 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:46:31.780 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:46:31.780 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:46:31.780 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:46:31.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:46:31.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:46:31.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:46:31.780 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:46:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:46:31.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:46:31.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:31.978 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:46:32.016 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:46:32.016 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:46:32.016 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:46:32.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:32.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:46:32.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:46:32.113 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:46:32.148 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:46:32.148 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:46:32.148 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:46:32.223 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:46:32.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:32.223 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:46:32.354 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:46:32.354 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:46:32.354 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:46:32.370 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:46:32.370 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:46:32.370 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:46:32.370 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:46:32.370 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:46:32.393 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:46:32.393 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:46:32.393 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:46:32.393 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:46:32.393 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:46:32.393 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:46:32.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:46:32.394 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:46:32.396 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:46:32.396 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:46:32.396 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:46:32.396 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:46:32.396 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:46:32.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:46:32.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:32.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:46:32.455 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:46:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:46:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:46:32.546 INFO:teuthology.orchestra.run.smithi007.stdout:client8575 2024-08-19T00:46:32.546 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:32.546 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:32.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:32.581 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:46:32.626 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:46:32.660 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:46:32.660 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:46:32.660 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:32.660 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:46:32.660 INFO:teuthology.orchestra.run.smithi007.stdout:sixmegs 2024-08-19T00:46:32.661 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 500.00000000' did not caused DAMAGED state 2024-08-19T00:46:32.661 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate mds_snaptable' 2024-08-19T00:46:32.661 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:32.661 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:32.737 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:32.737 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:32.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:46:32.814 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:46:32.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:46:33.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.013+0000 7f444f000640 1 Processor -- start 2024-08-19T00:46:33.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.013+0000 7f444f000640 1 -- start start 2024-08-19T00:46:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.014+0000 7f444f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 0x7f4448169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.014+0000 7f444f000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444815ec30 con 0x7f444809aa70 2024-08-19T00:46:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.014+0000 7f444f000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444815ef10 con 0x7f444809b730 2024-08-19T00:46:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.014+0000 7f444f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f444815f1f0 con 0x7f44480d12a0 2024-08-19T00:46:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.014+0000 7f4447e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f444809aa70 0x7f444809ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52694/0 (socket says 172.21.15.7:52694) 2024-08-19T00:46:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.014+0000 7f4447e00640 1 -- 172.21.15.7:0/862949589 learned_addr learned my addr 172.21.15.7:0/862949589 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f444d000640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 0x7f4448169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383020596 0 0) 0x7f444815ec30 con 0x7f444809aa70 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f442c003520 con 0x7f444809aa70 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785189630 0 0) 0x7f444815ef10 con 0x7f444809b730 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f444815ec30 con 0x7f444809b730 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 719626066 0 0) 0x7f442c003520 con 0x7f444809aa70 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 msgr2=0x7f4448169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 0x7f4448169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 >> v1:172.21.15.162:6789/0 conn(0x7f444809b730 legacy=0x7f444806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444815f4d0 con 0x7f444809aa70 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f4438001670 con 0x7f444809aa70 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 >> v1:172.21.15.7:6789/0 conn(0x7f444809aa70 legacy=0x7f444809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f442c003b70 0x7f442c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 0x7f442c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c004d40 0x7f442c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f444815f1f0 con 0x7f442c003b70 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f442c00ba70 con 0x7f442c004d40 2024-08-19T00:46:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.015+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f442c00bc70 con 0x7f44480d12a0 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f4447e00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f442c003b70 0x7f442c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f4447400640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 0x7f442c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f444d000640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c004d40 0x7f442c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f4447e00640 1 -- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 msgr2=0x7f442c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f4447e00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44480d12a0 0x7f442c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f4447e00640 1 -- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c004d40 msgr2=0x7f442c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f4447e00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c004d40 0x7f442c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.016+0000 7f4447e00640 1 -- 172.21.15.7:0/862949589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c003520 con 0x7f442c003b70 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.017+0000 7f4447e00640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f442c003b70 0x7f442c003f70 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f443800c1c0 tx=0x7f442c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c65d2222ff778ca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.017+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438007cc0 con 0x7f442c003b70 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.017+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4438005ad0 con 0x7f442c003b70 2024-08-19T00:46:33.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.017+0000 7f4446a00640 1 -- 172.21.15.7:0/862949589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438007070 con 0x7f442c003b70 2024-08-19T00:46:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.018+0000 7f444f000640 1 -- 172.21.15.7:0/862949589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f442c003b70 msgr2=0x7f442c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.018+0000 7f444f000640 1 --2- 172.21.15.7:0/862949589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f442c003b70 0x7f442c003f70 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f443800c1c0 tx=0x7f442c005830 comp rx=0 tx=0).stop 2024-08-19T00:46:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.018+0000 7f444d000640 1 -- 172.21.15.7:0/862949589 reap_dead start 2024-08-19T00:46:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.018+0000 7f444f000640 1 -- 172.21.15.7:0/862949589 shutdown_connections 2024-08-19T00:46:33.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.018+0000 7f444f000640 1 -- 172.21.15.7:0/862949589 >> 172.21.15.7:0/862949589 conn(0x7f44480d2190 msgr2=0x7f44480d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.018+0000 7f444f000640 1 -- 172.21.15.7:0/862949589 shutdown_connections 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.018+0000 7f444f000640 1 -- 172.21.15.7:0/862949589 wait complete. 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.020+0000 7f444f000640 1 Processor -- start 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.020+0000 7f444f000640 1 -- start start 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c003b70 0x7f444815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44481610b0 0x7f4448161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806d660 0x7f444806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4448167400 con 0x7f444806d660 2024-08-19T00:46:33.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4448167280 con 0x7f442c003b70 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4448167580 con 0x7f44481610b0 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806d660 0x7f444806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806d660 0x7f444806dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46134/0 (socket says 172.21.15.7:46134) 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f444d000640 1 -- 172.21.15.7:0/3079424129 learned_addr learned my addr 172.21.15.7:0/3079424129 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f4447400640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44481610b0 0x7f4448161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.021+0000 7f4447e00640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c003b70 0x7f444815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444d000640 1 -- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44481610b0 msgr2=0x7f4448161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444d000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44481610b0 0x7f4448161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444d000640 1 -- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c003b70 msgr2=0x7f444815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444d000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c003b70 0x7f444815a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444d000640 1 -- 172.21.15.7:0/3079424129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4448161b50 con 0x7f444806d660 2024-08-19T00:46:33.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f4447400640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44481610b0 0x7f4448161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444d000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806d660 0x7f444806dae0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f44480d1680 tx=0x7f444000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f443fe00640 1 -- 172.21.15.7:0/3079424129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444000fd80 con 0x7f444806d660 2024-08-19T00:46:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f443fe00640 1 -- 172.21.15.7:0/3079424129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4440015430 con 0x7f444806d660 2024-08-19T00:46:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f443fe00640 1 -- 172.21.15.7:0/3079424129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440015820 con 0x7f444806d660 2024-08-19T00:46:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44480af150 con 0x7f444806d660 2024-08-19T00:46:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.022+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44480af710 con 0x7f444806d660 2024-08-19T00:46:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.023+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44480d2cb0 con 0x7f444806d660 2024-08-19T00:46:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.024+0000 7f443fe00640 1 -- 172.21.15.7:0/3079424129 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44400159c0 con 0x7f444806d660 2024-08-19T00:46:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.025+0000 7f443fe00640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f442806be60 0x7f442806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.025+0000 7f443fe00640 1 -- 172.21.15.7:0/3079424129 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7f444008c1f0 con 0x7f444806d660 2024-08-19T00:46:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.025+0000 7f4447e00640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f442806be60 0x7f442806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.026+0000 7f4447e00640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f442806be60 0x7f442806e320 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4438032000 tx=0x7f4438009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.030+0000 7f443fe00640 1 -- 172.21.15.7:0/3079424129 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4440024030 con 0x7f444806d660 2024-08-19T00:46:33.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.227+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4448063150 con 0x7f444806d660 2024-08-19T00:46:33.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.228+0000 7f443fe00640 1 -- 172.21.15.7:0/3079424129 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 52 entries v112) ==== 81+0+3118 (secure 0 0 0) 0x7f4440019030 con 0x7f444806d660 2024-08-19T00:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:46:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:listed 52 entries 2024-08-19T00:46:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f442806be60 msgr2=0x7f442806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f442806be60 0x7f442806e320 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4438032000 tx=0x7f4438009030 comp rx=0 tx=0).stop 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806d660 msgr2=0x7f444806dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806d660 0x7f444806dae0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f44480d1680 tx=0x7f444000f580 comp rx=0 tx=0).stop 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 shutdown_connections 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f442806be60 0x7f442806e320 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f444806d660 0x7f444806dae0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44481610b0 0x7f4448161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 --2- 172.21.15.7:0/3079424129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c003b70 0x7f444815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 >> 172.21.15.7:0/3079424129 conn(0x7f44480d2190 msgr2=0x7f4448070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 shutdown_connections 2024-08-19T00:46:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.230+0000 7f444f000640 1 -- 172.21.15.7:0/3079424129 wait complete. 2024-08-19T00:46:33.248 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:46:33.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:33.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:46:33.317 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:33.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:33.318 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:33.354 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.551+0000 7fd30f200640 1 Processor -- start 2024-08-19T00:46:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.551+0000 7fd30f200640 1 -- start start 2024-08-19T00:46:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd30f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd3080cc9f0 0x7fd3080cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd30f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd30806dcc0 0x7fd30806e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd30f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30815b290 con 0x7fd3081585c0 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd30f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd3080cd370 con 0x7fd3080cc9f0 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd30f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd30815b570 con 0x7fd30806dcc0 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd307e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd3081585c0 0x7fd30806f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52706/0 (socket says 172.21.15.7:52706) 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd307e00640 1 -- 172.21.15.7:0/1270463986 learned_addr learned my addr 172.21.15.7:0/1270463986 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd2ff400640 1 --2- 172.21.15.7:0/1270463986 >> v2:172.21.15.7:3300/0 conn(0x7fd3080cc9f0 0x7fd3080cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.552+0000 7fd30d200640 1 --2- 172.21.15.7:0/1270463986 >> v2:172.21.15.162:3300/0 conn(0x7fd30806dcc0 0x7fd30806e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.553+0000 7fd2ff400640 1 -- 172.21.15.7:0/1270463986 >> v2:172.21.15.162:3300/0 conn(0x7fd30806dcc0 msgr2=0x7fd30806e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.553+0000 7fd2ff400640 1 --2- 172.21.15.7:0/1270463986 >> v2:172.21.15.162:3300/0 conn(0x7fd30806dcc0 0x7fd30806e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.553+0000 7fd2ff400640 1 -- 172.21.15.7:0/1270463986 >> v1:172.21.15.7:6789/0 conn(0x7fd3081585c0 legacy=0x7fd30806f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.553+0000 7fd2ff400640 1 -- 172.21.15.7:0/1270463986 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30815b850 con 0x7fd3080cc9f0 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.553+0000 7fd30d200640 1 --2- 172.21.15.7:0/1270463986 >> v2:172.21.15.162:3300/0 conn(0x7fd30806dcc0 0x7fd30806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.553+0000 7fd307400640 1 -- 172.21.15.7:0/1270463986 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342203664 0 0) 0x7fd30815b290 con 0x7fd3081585c0 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.554+0000 7fd2ff400640 1 --2- 172.21.15.7:0/1270463986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3080cc9f0 0x7fd3080cce30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fd3080b54c0 tx=0x7fd2f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b10ca89ca82cc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.554+0000 7fd307400640 1 -- 172.21.15.7:0/1270463986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0037070 con 0x7fd3080cc9f0 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.554+0000 7fd307400640 1 -- 172.21.15.7:0/1270463986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f0032440 con 0x7fd3080cc9f0 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.554+0000 7fd307400640 1 -- 172.21.15.7:0/1270463986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0032810 con 0x7fd3080cc9f0 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 -- 172.21.15.7:0/1270463986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3080cc9f0 msgr2=0x7fd3080cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 --2- 172.21.15.7:0/1270463986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3080cc9f0 0x7fd3080cce30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fd3080b54c0 tx=0x7fd2f002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 -- 172.21.15.7:0/1270463986 shutdown_connections 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 --2- 172.21.15.7:0/1270463986 >> v2:172.21.15.162:3300/0 conn(0x7fd30806dcc0 0x7fd30806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 --2- 172.21.15.7:0/1270463986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3080cc9f0 0x7fd3080cce30 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 -- 172.21.15.7:0/1270463986 >> 172.21.15.7:0/1270463986 conn(0x7fd30806bc70 msgr2=0x7fd30806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 -- 172.21.15.7:0/1270463986 shutdown_connections 2024-08-19T00:46:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.555+0000 7fd30f200640 1 -- 172.21.15.7:0/1270463986 wait complete. 2024-08-19T00:46:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.556+0000 7fd30f200640 1 Processor -- start 2024-08-19T00:46:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.557+0000 7fd30f200640 1 -- start start 2024-08-19T00:46:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.557+0000 7fd30f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd30806dcc0 0x7fd30809a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3080cc9f0 0x7fd3080ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3081585c0 0x7fd30814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd30806f7b0 con 0x7fd3081585c0 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd30815be10 con 0x7fd3080cc9f0 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd308071980 con 0x7fd30806dcc0 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3081585c0 0x7fd30814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3081585c0 0x7fd30814c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46142/0 (socket says 172.21.15.7:46142) 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 -- 172.21.15.7:0/358753554 learned_addr learned my addr 172.21.15.7:0/358753554 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 -- 172.21.15.7:0/358753554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd30806dcc0 msgr2=0x7fd30809a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd30806dcc0 0x7fd30809a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 -- 172.21.15.7:0/358753554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3080cc9f0 msgr2=0x7fd3080ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3080cc9f0 0x7fd3080ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 -- 172.21.15.7:0/358753554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3080ad390 con 0x7fd3081585c0 2024-08-19T00:46:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.558+0000 7fd30d200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3081585c0 0x7fd30814c4e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fd300007ef0 tx=0x7fd30000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.559+0000 7fd304c00640 1 -- 172.21.15.7:0/358753554 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30001a070 con 0x7fd3081585c0 2024-08-19T00:46:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.559+0000 7fd304c00640 1 -- 172.21.15.7:0/358753554 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd300003b90 con 0x7fd3081585c0 2024-08-19T00:46:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.559+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3080ad670 con 0x7fd3081585c0 2024-08-19T00:46:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.559+0000 7fd304c00640 1 -- 172.21.15.7:0/358753554 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300004030 con 0x7fd3081585c0 2024-08-19T00:46:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.559+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3080adc30 con 0x7fd3081585c0 2024-08-19T00:46:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.560+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30815ae60 con 0x7fd3081585c0 2024-08-19T00:46:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.561+0000 7fd304c00640 1 -- 172.21.15.7:0/358753554 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd30001d070 con 0x7fd3081585c0 2024-08-19T00:46:33.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.562+0000 7fd304c00640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2e406be60 0x7fd2e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.562+0000 7fd304c00640 1 -- 172.21.15.7:0/358753554 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 7945+0+0 (secure 0 0 0) 0x7fd30008b990 con 0x7fd3081585c0 2024-08-19T00:46:33.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.562+0000 7fd307e00640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2e406be60 0x7fd2e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.563+0000 7fd307e00640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2e406be60 0x7fd2e406e320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8007fd0 tx=0x7fd2f8007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.567+0000 7fd304c00640 1 -- 172.21.15.7:0/358753554 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd300010070 con 0x7fd3081585c0 2024-08-19T00:46:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.787+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd30806f4b0 con 0x7fd3081585c0 2024-08-19T00:46:33.790 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:33.788+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.790+0000 7fd304c00640 1 -- 172.21.15.7:0/358753554 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v247) ==== 161+0+0 (secure 0 0 0) 0x7fd300059390 con 0x7fd3081585c0 2024-08-19T00:46:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2e406be60 msgr2=0x7fd2e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2e406be60 0x7fd2e406e320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8007fd0 tx=0x7fd2f8007960 comp rx=0 tx=0).stop 2024-08-19T00:46:33.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3081585c0 msgr2=0x7fd30814c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3081585c0 0x7fd30814c4e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fd300007ef0 tx=0x7fd30000d4a0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 shutdown_connections 2024-08-19T00:46:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd2e406be60 0x7fd2e406e320 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3081585c0 0x7fd30814c4e0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3080cc9f0 0x7fd3080ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 --2- 172.21.15.7:0/358753554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd30806dcc0 0x7fd30809a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.794+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 >> 172.21.15.7:0/358753554 conn(0x7fd30806bc70 msgr2=0x7fd308071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.795+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 shutdown_connections 2024-08-19T00:46:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.795+0000 7fd30f200640 1 -- 172.21.15.7:0/358753554 wait complete. 2024-08-19T00:46:33.800 INFO:tasks.ceph.mds.a.smithi007.stderr: -552> 2024-08-19T00:46:31.285+0000 7fb4a7a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:46:33.813 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:33.843 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:46:33.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.972+0000 7f23a2400640 1 Processor -- start 2024-08-19T00:46:33.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.972+0000 7f23a2400640 1 -- start start 2024-08-19T00:46:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.973+0000 7f23a2400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f239c15c8f0 0x7f239c15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.973+0000 7f23a2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15d490 0x7f239c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.973+0000 7f23a2400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239c0ccd40 con 0x7f239c15c510 2024-08-19T00:46:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.973+0000 7f23a2400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f239c15d210 con 0x7f239c15c8f0 2024-08-19T00:46:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.973+0000 7f23a2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f239c09b370 con 0x7f239c15d490 2024-08-19T00:46:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15d490 0x7f239c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15d490 0x7f239c0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:59680/0 (socket says 172.21.15.7:59680) 2024-08-19T00:46:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239be00640 1 -- 172.21.15.7:0/1904352633 learned_addr learned my addr 172.21.15.7:0/1904352633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239b400640 1 --2- 172.21.15.7:0/1904352633 >> v2:172.21.15.162:3300/0 conn(0x7f239c15c8f0 0x7f239c15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239be00640 1 -- 172.21.15.7:0/1904352633 >> v2:172.21.15.162:3300/0 conn(0x7f239c15c8f0 msgr2=0x7f239c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239be00640 1 --2- 172.21.15.7:0/1904352633 >> v2:172.21.15.162:3300/0 conn(0x7f239c15c8f0 0x7f239c15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239be00640 1 -- 172.21.15.7:0/1904352633 >> v1:172.21.15.162:6789/0 conn(0x7f239c15c510 legacy=0x7f239c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239be00640 1 -- 172.21.15.7:0/1904352633 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c09b650 con 0x7f239c15d490 2024-08-19T00:46:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.974+0000 7f239a000640 1 -- 172.21.15.7:0/1904352633 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984591450 0 0) 0x7f239c0ccd40 con 0x7f239c15c510 2024-08-19T00:46:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.975+0000 7f239be00640 1 --2- 172.21.15.7:0/1904352633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15d490 0x7f239c0cd220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2394009e50 tx=0x7f239402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b896c0f68054b549 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f239a000640 1 -- 172.21.15.7:0/1904352633 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394036070 con 0x7f239c15d490 2024-08-19T00:46:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f239a000640 1 -- 172.21.15.7:0/1904352633 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2394031600 con 0x7f239c15d490 2024-08-19T00:46:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f239a000640 1 -- 172.21.15.7:0/1904352633 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23940319d0 con 0x7f239c15d490 2024-08-19T00:46:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 -- 172.21.15.7:0/1904352633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15d490 msgr2=0x7f239c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 --2- 172.21.15.7:0/1904352633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15d490 0x7f239c0cd220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2394009e50 tx=0x7f239402a710 comp rx=0 tx=0).stop 2024-08-19T00:46:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 -- 172.21.15.7:0/1904352633 shutdown_connections 2024-08-19T00:46:33.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 --2- 172.21.15.7:0/1904352633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15d490 0x7f239c0cd220 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 --2- 172.21.15.7:0/1904352633 >> v2:172.21.15.162:3300/0 conn(0x7f239c15c8f0 0x7f239c15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 -- 172.21.15.7:0/1904352633 >> 172.21.15.7:0/1904352633 conn(0x7f239c0d2190 msgr2=0x7f239c0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 -- 172.21.15.7:0/1904352633 shutdown_connections 2024-08-19T00:46:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.976+0000 7f23a2400640 1 -- 172.21.15.7:0/1904352633 wait complete. 2024-08-19T00:46:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.978+0000 7f23a2400640 1 Processor -- start 2024-08-19T00:46:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.978+0000 7f23a2400640 1 -- start start 2024-08-19T00:46:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f23a2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15c510 0x7f239c0b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f23a2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c15c8f0 0x7f239c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f23a2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c15d490 0x7f239c0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f23a2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f239c0cd760 con 0x7f239c15d490 2024-08-19T00:46:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f23a2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f239c09bc10 con 0x7f239c15c8f0 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f23a2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f239c0cd8e0 con 0x7f239c15c510 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f239be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c15d490 0x7f239c0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f239be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c15d490 0x7f239c0cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57868/0 (socket says 172.21.15.7:57868) 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f239be00640 1 -- 172.21.15.7:0/542133011 learned_addr learned my addr 172.21.15.7:0/542133011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f239b400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15c510 0x7f239c0b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.979+0000 7f239aa00640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c15c8f0 0x7f239c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f239be00640 1 -- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15c510 msgr2=0x7f239c0b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f239be00640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15c510 0x7f239c0b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f239be00640 1 -- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c15c8f0 msgr2=0x7f239c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f239be00640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c15c8f0 0x7f239c0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f239be00640 1 -- 172.21.15.7:0/542133011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c1f78f0 con 0x7f239c15d490 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f239be00640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c15d490 0x7f239c0cba80 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f2394009e50 tx=0x7f2394004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f2393400640 1 -- 172.21.15.7:0/542133011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394036050 con 0x7f239c15d490 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f2393400640 1 -- 172.21.15.7:0/542133011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2394042070 con 0x7f239c15d490 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239c1f7bd0 con 0x7f239c15d490 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f2393400640 1 -- 172.21.15.7:0/542133011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394009510 con 0x7f239c15d490 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.980+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239c1f8190 con 0x7f239c15d490 2024-08-19T00:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.981+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f239c15ccd0 con 0x7f239c15d490 2024-08-19T00:46:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.982+0000 7f2393400640 1 -- 172.21.15.7:0/542133011 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2394007bf0 con 0x7f239c15d490 2024-08-19T00:46:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.983+0000 7f2393400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f237c06be30 0x7f237c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.983+0000 7f2393400640 1 -- 172.21.15.7:0/542133011 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8031+0+0 (secure 0 0 0) 0x7f23940ac4e0 con 0x7f239c15d490 2024-08-19T00:46:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.983+0000 7f239b400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f237c06be30 0x7f237c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.984+0000 7f239b400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f237c06be30 0x7f237c06e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f238c009b40 tx=0x7f238c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:33.988+0000 7f2393400640 1 -- 172.21.15.7:0/542133011 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2394079e90 con 0x7f239c15d490 2024-08-19T00:46:34.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.240+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f239c0cc070 con 0x7f239c15d490 2024-08-19T00:46:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.792+0000 7f2393400640 1 -- 172.21.15.7:0/542133011 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v248) ==== 107+0+0 (secure 0 0 0) 0x7f239407e190 con 0x7f239c15d490 2024-08-19T00:46:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f237c06be30 msgr2=0x7f237c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f237c06be30 0x7f237c06e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f238c009b40 tx=0x7f238c009190 comp rx=0 tx=0).stop 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c15d490 msgr2=0x7f239c0cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c15d490 0x7f239c0cba80 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f2394009e50 tx=0x7f2394004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 shutdown_connections 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f237c06be30 0x7f237c06e2f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c15d490 0x7f239c0cba80 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c15c8f0 0x7f239c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 --2- 172.21.15.7:0/542133011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f239c15c510 0x7f239c0b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 >> 172.21.15.7:0/542133011 conn(0x7f239c0d2190 msgr2=0x7f239c0d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 shutdown_connections 2024-08-19T00:46:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.795+0000 7f23a2400640 1 -- 172.21.15.7:0/542133011 wait complete. 2024-08-19T00:46:34.816 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:34.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.935+0000 7f9663d1ef40 1 Processor -- start 2024-08-19T00:46:34.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.935+0000 7f9663d1ef40 1 -- start start 2024-08-19T00:46:34.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9663d1ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a035b0 0x562384a02be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9663d1ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a03990 0x5623849fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9663d1ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a1b8d0 0x562384a9ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9663d1ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562384aa90a0 con 0x562384a03990 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9663d1ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562384aa8dc0 con 0x562384a035b0 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9663d1ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562384aa9380 con 0x562384a1b8d0 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a03990 0x5623849fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9660400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a035b0 0x562384a02be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a03990 0x5623849fe8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57880/0 (socket says 172.21.15.7:57880) 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 -- 172.21.15.7:0/229812373 learned_addr learned my addr 172.21.15.7:0/229812373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f9660e00640 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a1b8d0 0x562384a9ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 -- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a1b8d0 msgr2=0x562384a9ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a1b8d0 0x562384a9ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 -- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a035b0 msgr2=0x562384a02be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a035b0 0x562384a02be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.936+0000 7f965fa00640 1 -- 172.21.15.7:0/229812373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562384906130 con 0x562384a03990 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.937+0000 7f9660400640 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a035b0 0x562384a02be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.937+0000 7f965fa00640 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a03990 0x5623849fe8a0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f964c009860 tx=0x7f964c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695313f3f53b54d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.937+0000 7f965e600640 1 -- 172.21.15.7:0/229812373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c008870 con 0x562384a03990 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.937+0000 7f965e600640 1 -- 172.21.15.7:0/229812373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964c018070 con 0x562384a03990 2024-08-19T00:46:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.937+0000 7f965e600640 1 -- 172.21.15.7:0/229812373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c008c50 con 0x562384a03990 2024-08-19T00:46:34.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 -- 172.21.15.7:0/229812373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a03990 msgr2=0x5623849fe8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a03990 0x5623849fe8a0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f964c009860 tx=0x7f964c005a00 comp rx=0 tx=0).stop 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 -- 172.21.15.7:0/229812373 shutdown_connections 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a1b8d0 0x562384a9ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a03990 0x5623849fe8a0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/229812373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a035b0 0x562384a02be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 -- 172.21.15.7:0/229812373 >> 172.21.15.7:0/229812373 conn(0x562384a004e0 msgr2=0x5623849d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 -- 172.21.15.7:0/229812373 shutdown_connections 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 -- 172.21.15.7:0/229812373 wait complete. 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.938+0000 7f9663d1ef40 1 Processor -- start 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.939+0000 7f9663d1ef40 1 -- start start 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.939+0000 7f9663d1ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a035b0 0x562384a89920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.939+0000 7f9663d1ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a03990 0x562384b3f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.939+0000 7f9663d1ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a1b8d0 0x562384a1c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.939+0000 7f9663d1ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562384a1dcd0 con 0x562384a1b8d0 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.939+0000 7f9663d1ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562384a8be80 con 0x562384a03990 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.939+0000 7f9663d1ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562384a8a5b0 con 0x562384a035b0 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a1b8d0 0x562384a1c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a035b0 0x562384a89920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a1b8d0 0x562384a1c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57886/0 (socket says 172.21.15.7:57886) 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 learned_addr learned my addr 172.21.15.7:0/2983853016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f965fa00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a03990 0x562384b3f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a035b0 msgr2=0x562384a89920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562384a035b0 0x562384a89920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a03990 msgr2=0x562384b3f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562384a03990 0x562384b3f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.940+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623848fcb30 con 0x562384a1b8d0 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.941+0000 7f9660e00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a1b8d0 0x562384a1c940 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f96580106b0 tx=0x7f9658010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.941+0000 7f965d200640 1 -- 172.21.15.7:0/2983853016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658018070 con 0x562384a1b8d0 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.941+0000 7f965d200640 1 -- 172.21.15.7:0/2983853016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965800d790 con 0x562384a1b8d0 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.941+0000 7f965d200640 1 -- 172.21.15.7:0/2983853016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965800db80 con 0x562384a1b8d0 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.941+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562384939080 con 0x562384a1b8d0 2024-08-19T00:46:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.941+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562384b3f880 con 0x562384a1b8d0 2024-08-19T00:46:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.943+0000 7f965d200640 1 -- 172.21.15.7:0/2983853016 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f965801b070 con 0x562384a1b8d0 2024-08-19T00:46:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.944+0000 7f965d200640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f964006a810 0x7f964006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.944+0000 7f965d200640 1 -- 172.21.15.7:0/2983853016 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8031+0+0 (secure 0 0 0) 0x7f965808a880 con 0x562384a1b8d0 2024-08-19T00:46:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.944+0000 7f9660400640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f964006a810 0x7f964006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.946 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.944+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5623849cee50 0x562384b4a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.944+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4a940 con 0x5623849cee50 2024-08-19T00:46:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.945+0000 7f965fa00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5623849cee50 0x562384b4a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.945+0000 7f9660400640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f964006a810 0x7f964006ccd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9650057000 tx=0x7f9650052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.945+0000 7f965fa00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5623849cee50 0x562384b4a400 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:34.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.950+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v113'815 uv789 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.950+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b4ace0 con 0x5623849cee50 2024-08-19T00:46:34.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.951+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v113'816 uv816 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.951+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4b080 con 0x5623849cee50 2024-08-19T00:46:34.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.952+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v113'817 uv817 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.954 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:34.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.952+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4c430 con 0x5623849cee50 2024-08-19T00:46:34.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.954+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v113'818 uv818 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.954+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4c7d0 con 0x5623849cee50 2024-08-19T00:46:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.955+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v113'819 uv819 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.955+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4b420 con 0x5623849cee50 2024-08-19T00:46:34.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.956+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v113'820 uv820 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.957+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4b810 con 0x5623849cee50 2024-08-19T00:46:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.958+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v113'821 uv795 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.958+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bc00 con 0x5623849cee50 2024-08-19T00:46:34.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.959+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v113'822 uv822 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.959+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bc00 con 0x5623849cee50 2024-08-19T00:46:34.962 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:34.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.961+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v113'823 uv823 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.961+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.962+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v113'824 uv824 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.962+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.964+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v113'825 uv825 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.964+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.965+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v113'826 uv826 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.965+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.967+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v113'827 uv802 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.967+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.968+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v113'828 uv828 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.968+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.971 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:34.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.970+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v113'829 uv829 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.970+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.971+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v113'830 uv830 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.971+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.972+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v113'831 uv831 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.972+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4bbb0 con 0x5623849cee50 2024-08-19T00:46:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.974+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v113'832 uv832 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.974+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.975+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v113'833 uv833 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.975+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.977+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v113'834 uv808 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.977+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.978+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v113'835 uv835 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.978+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.980+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v113'836 uv836 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.981 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:34.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.980+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.981+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v113'837 uv837 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.981+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.982+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v113'838 uv838 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.982+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.984+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v113'839 uv839 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.984+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.985+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v113'840 uv814 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.985+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.987+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v113'841 uv841 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.987+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.988+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v113'842 uv842 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.990 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:34.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.988+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.990+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v113'843 uv843 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.990+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.991+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v113'844 uv844 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.991+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x5623849cee50 2024-08-19T00:46:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.993+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v113'845 uv845 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.993+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562384b4d080 0x562384b4f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.993+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384a1ce80 con 0x562384b4d080 2024-08-19T00:46:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.993+0000 7f9660400640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562384b4d080 0x562384b4f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:34.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.994+0000 7f9660400640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562384b4d080 0x562384b4f470 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.996+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v113'596 uv575 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.996+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b4f9b0 con 0x562384b4d080 2024-08-19T00:46:34.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.998+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v113'597 uv597 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:34.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.998+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b4fd50 con 0x562384b4d080 2024-08-19T00:46:35.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.999+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v113'598 uv598 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.000 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:35.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:34.999+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b500f0 con 0x562384b4d080 2024-08-19T00:46:35.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.000+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v113'599 uv599 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.000+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50490 con 0x562384b4d080 2024-08-19T00:46:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.002+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v113'600 uv600 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.002+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50830 con 0x562384b4d080 2024-08-19T00:46:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.003+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v113'601 uv594 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.003+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b50bd0 con 0x562384b4d080 2024-08-19T00:46:35.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.005+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v113'602 uv602 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.005+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.007 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:35.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.006+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v113'603 uv603 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.006+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.007+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v113'604 uv604 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.008+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.009+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v113'605 uv605 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.009+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.010+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v113'606 uv595 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.010+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.011+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v113'607 uv607 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.011+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.014 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:35.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.013+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v113'608 uv608 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.013+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b55660 con 0x562384b4d080 2024-08-19T00:46:35.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.015+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v113'609 uv609 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.015+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b55660 con 0x562384b4d080 2024-08-19T00:46:35.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.016+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v113'610 uv610 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.016+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.017+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v113'611 uv591 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.017+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.019+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v113'612 uv612 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.019+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.020+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v113'613 uv613 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.022 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.020+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b51f80 con 0x562384b4d080 2024-08-19T00:46:35.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.022+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v113'614 uv614 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.022+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b51f80 con 0x562384b4d080 2024-08-19T00:46:35.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.023+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v113'615 uv615 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.023+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b50f70 con 0x562384b4d080 2024-08-19T00:46:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.024+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v113'616 uv616 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b4d080 2024-08-19T00:46:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.024+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562384b51480 0x562384b53870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.024+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b53db0 con 0x562384b51480 2024-08-19T00:46:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.025+0000 7f965fa00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562384b51480 0x562384b53870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.025+0000 7f965fa00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562384b51480 0x562384b53870 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.027+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v113'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.027+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b54180 con 0x562384b51480 2024-08-19T00:46:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.028+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v113'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.028+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b54180 con 0x562384b51480 2024-08-19T00:46:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.029+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v113'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.031 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.029+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b55190 con 0x562384b51480 2024-08-19T00:46:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.031+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v113'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.031+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b55190 con 0x562384b51480 2024-08-19T00:46:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.032+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v113'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.032+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b54180 con 0x562384b51480 2024-08-19T00:46:35.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.033+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v113'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.033+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b54180 con 0x5623849cee50 2024-08-19T00:46:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.035+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v113'118 uv117 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.035+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b54180 con 0x5623849cee50 2024-08-19T00:46:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.036+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v113'119 uv119 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.036+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b54180 con 0x5623849cee50 2024-08-19T00:46:35.039 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.038+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v113'120 uv120 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.038+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b54180 con 0x5623849cee50 2024-08-19T00:46:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.039+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v113'121 uv121 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.039+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562384b54b70 0x562384b56f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.039+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b574a0 con 0x562384b54b70 2024-08-19T00:46:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.040+0000 7f9660e00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562384b54b70 0x562384b56f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.041+0000 7f9660e00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562384b54b70 0x562384b56f60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.042+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v113'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.042+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b57840 con 0x562384b54b70 2024-08-19T00:46:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.043+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v113'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.043+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b57ce0 con 0x562384b54b70 2024-08-19T00:46:35.046 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.044+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v113'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.045+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b59590 con 0x562384b54b70 2024-08-19T00:46:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.046+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v113'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.046+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b59930 con 0x562384b54b70 2024-08-19T00:46:35.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.047+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v113'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.047+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b58580 con 0x562384b54b70 2024-08-19T00:46:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.048+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v113'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.048+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562384b58ea0 0x562384b5bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.048+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c220 con 0x562384b58ea0 2024-08-19T00:46:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.048+0000 7f9660400640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562384b58ea0 0x562384b5bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.049+0000 7f9660400640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562384b58ea0 0x562384b5bce0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.053+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v113'294 uv287 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.053+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c220 con 0x562384b58ea0 2024-08-19T00:46:35.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.054+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v113'295 uv295 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.054+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c260 con 0x562384b58ea0 2024-08-19T00:46:35.057 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:35.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.055+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v113'296 uv296 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.055+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5d660 con 0x562384b58ea0 2024-08-19T00:46:35.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.057+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v113'297 uv297 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.057+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5d660 con 0x562384b58ea0 2024-08-19T00:46:35.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.058+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v113'298 uv298 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.058+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c650 con 0x562384b58ea0 2024-08-19T00:46:35.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.059+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v113'299 uv299 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.059+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c650 con 0x562384b58ea0 2024-08-19T00:46:35.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.061+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v113'300 uv293 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.061+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c650 con 0x562384b58ea0 2024-08-19T00:46:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.062+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v113'301 uv301 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.062+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c650 con 0x562384b58ea0 2024-08-19T00:46:35.065 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.064+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v113'302 uv302 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.064+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c650 con 0x562384b58ea0 2024-08-19T00:46:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.065+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v113'303 uv303 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.065+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5c650 con 0x562384b58ea0 2024-08-19T00:46:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.066+0000 7f9660400640 1 -- 172.21.15.7:0/2983853016 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v113'304 uv304 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f965005d040 con 0x562384b58ea0 2024-08-19T00:46:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.066+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562384b5cb60 0x562384b5ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.066+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5f680 con 0x562384b5cb60 2024-08-19T00:46:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.067+0000 7f965fa00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562384b5cb60 0x562384b5ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.067+0000 7f965fa00640 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562384b5cb60 0x562384b5ef50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.068+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v113'132 uv131 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.068+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b5f680 con 0x562384b5cb60 2024-08-19T00:46:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.070+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v113'133 uv133 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.070+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x562384b5cb60 2024-08-19T00:46:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.071+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v113'134 uv134 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.073 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.071+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x562384b5cb60 2024-08-19T00:46:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.072+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v113'135 uv135 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.072+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x562384b5cb60 2024-08-19T00:46:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.073+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v113'136 uv136 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.073+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x5623849cee50 2024-08-19T00:46:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.075+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v113'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.075+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x5623849cee50 2024-08-19T00:46:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.077+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v113'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.077+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x5623849cee50 2024-08-19T00:46:35.079 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.078+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v113'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.078+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60b00 con 0x5623849cee50 2024-08-19T00:46:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.079+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v113'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.079+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60b00 con 0x5623849cee50 2024-08-19T00:46:35.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.081+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v113'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.081+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x5623849cee50 2024-08-19T00:46:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.082+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v113'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x5623849cee50 2024-08-19T00:46:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.082+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x562384b51480 2024-08-19T00:46:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.084+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v113'263 uv257 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.084+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x562384b51480 2024-08-19T00:46:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.085+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v113'264 uv264 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.085+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5faf0 con 0x562384b51480 2024-08-19T00:46:35.088 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.087+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v113'265 uv265 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.087+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b58170 con 0x562384b51480 2024-08-19T00:46:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.089+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v113'266 uv266 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.089+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b58170 con 0x562384b51480 2024-08-19T00:46:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.090+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v113'267 uv267 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.090+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b58170 con 0x562384b51480 2024-08-19T00:46:35.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.091+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v113'268 uv262 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.092+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b58170 con 0x562384b51480 2024-08-19T00:46:35.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.093+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v113'269 uv269 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.093+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b58170 con 0x562384b51480 2024-08-19T00:46:35.096 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:35.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.094+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v113'270 uv270 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.094+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b58170 con 0x562384b51480 2024-08-19T00:46:35.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.096+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v113'271 uv271 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.096+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b62900 con 0x562384b51480 2024-08-19T00:46:35.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.097+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v113'272 uv272 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b51480 2024-08-19T00:46:35.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.097+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b5ffa0 con 0x562384b54b70 2024-08-19T00:46:35.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.099+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v113'116 uv114 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.099+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b60390 con 0x562384b54b70 2024-08-19T00:46:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.100+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v113'117 uv117 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.100+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60390 con 0x562384b54b70 2024-08-19T00:46:35.103 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:35.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.102+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v113'118 uv118 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.102+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b54b70 2024-08-19T00:46:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.103+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v113'119 uv119 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.103+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b54b70 2024-08-19T00:46:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.105+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v113'159 uv158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.105+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b54b70 2024-08-19T00:46:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.106+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v113'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.106+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b54b70 2024-08-19T00:46:35.109 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:35.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.108+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v113'161 uv161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.108+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b54b70 2024-08-19T00:46:35.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.109+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v113'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.109+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b61350 con 0x562384b54b70 2024-08-19T00:46:35.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.110+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v113'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.110+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b54b70 2024-08-19T00:46:35.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.111+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v113'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f9658024070 con 0x562384b54b70 2024-08-19T00:46:35.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.111+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.113+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v113'135 uv134 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.113+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.114+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v113'136 uv136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.114+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.117 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:35.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.115+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v113'137 uv137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.115+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.116+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v113'138 uv138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.116+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.118+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v113'139 uv139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.118+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.119+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v113'327 uv318 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.119+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.121+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v113'328 uv328 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.121+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.123 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:35.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.122+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v113'329 uv329 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.122+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.124+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v113'330 uv330 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.124+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.125+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v113'331 uv331 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.125+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.126+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v113'332 uv325 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.126+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.128+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v113'333 uv333 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.128+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.130 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.129+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v113'334 uv334 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.129+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b61350 con 0x562384b5cb60 2024-08-19T00:46:35.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.130+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v113'335 uv335 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.130+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b61350 con 0x562384b5cb60 2024-08-19T00:46:35.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.132+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v113'336 uv336 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.132+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60340 con 0x562384b5cb60 2024-08-19T00:46:35.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.133+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v113'337 uv337 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.133+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x562384b60aa0 con 0x562384b5cb60 2024-08-19T00:46:35.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f965fa00640 1 -- 172.21.15.7:0/2983853016 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v113'338 uv338 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f964c0086f0 con 0x562384b5cb60 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562384b4d080 msgr2=0x562384b4f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x562384b4d080 0x562384b4f470 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562384b58ea0 msgr2=0x562384b5bce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x562384b58ea0 0x562384b5bce0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562384b5cb60 msgr2=0x562384b5ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562384b5cb60 0x562384b5ef50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562384b51480 msgr2=0x562384b53870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x562384b51480 0x562384b53870 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5623849cee50 msgr2=0x562384b4a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5623849cee50 0x562384b4a400 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 reap_dead start 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562384b54b70 msgr2=0x562384b56f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x562384b54b70 0x562384b56f60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.134+0000 7f9660e00640 1 -- 172.21.15.7:0/2983853016 reap_dead start 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f964006a810 msgr2=0x7f964006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f964006a810 0x7f964006ccd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9650057000 tx=0x7f9650052000 comp rx=0 tx=0).stop 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a1b8d0 msgr2=0x562384a1c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a1b8d0 0x562384a1c940 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f96580106b0 tx=0x7f9658010b70 comp rx=0 tx=0).stop 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 shutdown_connections 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f964006a810 0x7f964006ccd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 --2- 172.21.15.7:0/2983853016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384a1b8d0 0x562384a1c940 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 >> 172.21.15.7:0/2983853016 conn(0x562384a004e0 msgr2=0x562384a008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 shutdown_connections 2024-08-19T00:46:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.135+0000 7f9663d1ef40 1 -- 172.21.15.7:0/2983853016 wait complete. 2024-08-19T00:46:35.141 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate mds_snaptable 0 2024-08-19T00:46:35.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.257+0000 7f71381c0f40 1 Processor -- start 2024-08-19T00:46:35.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.257+0000 7f71381c0f40 1 -- start start 2024-08-19T00:46:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f71381c0f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d55b0 0x561a8a3731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f71381c0f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d5990 0x561a8a2a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f71381c0f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a2a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f71381c0f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561a8a37b0a0 con 0x561a8a2ed8d0 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f71381c0f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561a8a37adc0 con 0x561a8a2d55b0 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f71381c0f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561a8a37b380 con 0x561a8a2d5990 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a2a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a2a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57910/0 (socket says 172.21.15.7:57910) 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 -- 172.21.15.7:0/3619881048 learned_addr learned my addr 172.21.15.7:0/3619881048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7134a00640 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d5990 0x561a8a2a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135400640 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d55b0 0x561a8a3731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 -- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d5990 msgr2=0x561a8a2a2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d5990 0x561a8a2a2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 -- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d55b0 msgr2=0x561a8a3731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d55b0 0x561a8a3731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.258+0000 7f7135e00640 1 -- 172.21.15.7:0/3619881048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8a1d8130 con 0x561a8a2ed8d0 2024-08-19T00:46:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f7135e00640 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a2a3430 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f713000c4a0 tx=0x7f713000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3341f7c492dbe42d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f712f400640 1 -- 172.21.15.7:0/3619881048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71300116b0 con 0x561a8a2ed8d0 2024-08-19T00:46:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f712f400640 1 -- 172.21.15.7:0/3619881048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7130017070 con 0x561a8a2ed8d0 2024-08-19T00:46:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f712f400640 1 -- 172.21.15.7:0/3619881048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130011ab0 con 0x561a8a2ed8d0 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 -- 172.21.15.7:0/3619881048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 msgr2=0x561a8a2a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a2a3430 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f713000c4a0 tx=0x7f713000c960 comp rx=0 tx=0).stop 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 -- 172.21.15.7:0/3619881048 shutdown_connections 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a2a3430 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d5990 0x561a8a2a2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3619881048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d55b0 0x561a8a3731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 -- 172.21.15.7:0/3619881048 >> 172.21.15.7:0/3619881048 conn(0x561a8a2d24e0 msgr2=0x561a8a2ed120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 -- 172.21.15.7:0/3619881048 shutdown_connections 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.259+0000 7f71381c0f40 1 -- 172.21.15.7:0/3619881048 wait complete. 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.260+0000 7f71381c0f40 1 Processor -- start 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.260+0000 7f71381c0f40 1 -- start start 2024-08-19T00:46:35.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f71381c0f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d55b0 0x561a8a409be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f71381c0f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d5990 0x561a8a35b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f71381c0f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a35bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f71381c0f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561a8a2d0b40 con 0x561a8a2ed8d0 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f71381c0f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561a8a2d0860 con 0x561a8a2d5990 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f71381c0f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x561a8a2d0e20 con 0x561a8a2d55b0 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f7135400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d55b0 0x561a8a409be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f7135e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a35bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f7135400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d55b0 0x561a8a409be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:59726/0 (socket says 172.21.15.7:59726) 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f7135400640 1 -- 172.21.15.7:0/3204151667 learned_addr learned my addr 172.21.15.7:0/3204151667 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.261+0000 7f7134a00640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d5990 0x561a8a35b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7135400640 1 -- 172.21.15.7:0/3204151667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d5990 msgr2=0x561a8a35b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7135400640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d5990 0x561a8a35b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7135400640 1 -- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 msgr2=0x561a8a35bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7135400640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a35bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7135400640 1 -- 172.21.15.7:0/3204151667 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8a1ceb30 con 0x561a8a2d55b0 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7135e00640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a8a2ed8d0 0x561a8a35bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7134a00640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a8a2d5990 0x561a8a35b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f7135400640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d55b0 0x561a8a409be0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7128058040 tx=0x7f7128002fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f712e000640 1 -- 172.21.15.7:0/3204151667 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712805a040 con 0x561a8a2d55b0 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f712e000640 1 -- 172.21.15.7:0/3204151667 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712805b040 con 0x561a8a2d55b0 2024-08-19T00:46:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f712e000640 1 -- 172.21.15.7:0/3204151667 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128055d90 con 0x561a8a2d55b0 2024-08-19T00:46:35.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.262+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a8a20b080 con 0x561a8a2d55b0 2024-08-19T00:46:35.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.263+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x561a8a40a120 con 0x561a8a2d55b0 2024-08-19T00:46:35.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.265+0000 7f712e000640 1 -- 172.21.15.7:0/3204151667 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71280603f0 con 0x561a8a2d55b0 2024-08-19T00:46:35.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.265+0000 7f712e000640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f711806a810 0x7f711806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.266+0000 7f712e000640 1 -- 172.21.15.7:0/3204151667 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(113..113 src has 1..113) ==== 8031+0+0 (secure 0 0 0) 0x7f71280ce0f0 con 0x561a8a2d55b0 2024-08-19T00:46:35.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.266+0000 7f7134a00640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f711806a810 0x7f711806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.266+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561a8a35c490 0x561a8a36de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.266+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.d 12:b50e409b:::mds_snaptable:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) -- 0x561a8a36e3d0 con 0x561a8a35c490 2024-08-19T00:46:35.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.266+0000 7f7135e00640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561a8a35c490 0x561a8a36de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.266+0000 7f7134a00640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f711806a810 0x7f711806ccd0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x561a8a35cbf0 tx=0x7f7124005af0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.267+0000 7f7135e00640 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561a8a35c490 0x561a8a36de90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f7135e00640 1 -- 172.21.15.7:0/3204151667 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 mds_snaptable [truncate 0] v113'137 uv137 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f7130011a60 con 0x561a8a35c490 2024-08-19T00:46:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561a8a35c490 msgr2=0x561a8a36de90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x561a8a35c490 0x561a8a36de90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f711806a810 msgr2=0x7f711806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f711806a810 0x7f711806ccd0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x561a8a35cbf0 tx=0x7f7124005af0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d55b0 msgr2=0x561a8a409be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 --2- 172.21.15.7:0/3204151667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561a8a2d55b0 0x561a8a409be0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7128058040 tx=0x7f7128002fb0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f7135e00640 1 -- 172.21.15.7:0/3204151667 reap_dead start 2024-08-19T00:46:35.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 shutdown_connections 2024-08-19T00:46:35.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 >> 172.21.15.7:0/3204151667 conn(0x561a8a2d24e0 msgr2=0x561a8a2d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:35.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 shutdown_connections 2024-08-19T00:46:35.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.268+0000 7f71381c0f40 1 -- 172.21.15.7:0/3204151667 wait complete. 2024-08-19T00:46:35.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.436+0000 7fcc4ce00640 1 Processor -- start 2024-08-19T00:46:35.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.436+0000 7fcc4ce00640 1 -- start start 2024-08-19T00:46:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc4ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc4815bfb0 0x7fcc480b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc4ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcc480b5130 0x7fcc480aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc4ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc480acef0 con 0x7fcc4815c390 2024-08-19T00:46:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc4ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcc480ad790 con 0x7fcc4815bfb0 2024-08-19T00:46:35.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc4ce00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcc480ad1d0 con 0x7fcc480b5130 2024-08-19T00:46:35.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc45e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc4815bfb0 0x7fcc480b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc45e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc4815bfb0 0x7fcc480b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57924/0 (socket says 172.21.15.7:57924) 2024-08-19T00:46:35.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.437+0000 7fcc45e00640 1 -- 172.21.15.7:0/4252863365 learned_addr learned my addr 172.21.15.7:0/4252863365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:35.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.438+0000 7fcc3d400640 1 --2- 172.21.15.7:0/4252863365 >> v2:172.21.15.162:3300/0 conn(0x7fcc480b5130 0x7fcc480aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.438+0000 7fcc45e00640 1 -- 172.21.15.7:0/4252863365 >> v2:172.21.15.162:3300/0 conn(0x7fcc480b5130 msgr2=0x7fcc480aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.438+0000 7fcc45e00640 1 --2- 172.21.15.7:0/4252863365 >> v2:172.21.15.162:3300/0 conn(0x7fcc480b5130 0x7fcc480aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.438+0000 7fcc45e00640 1 -- 172.21.15.7:0/4252863365 >> v1:172.21.15.162:6789/0 conn(0x7fcc4815c390 legacy=0x7fcc4815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.438+0000 7fcc45e00640 1 -- 172.21.15.7:0/4252863365 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc480ad4b0 con 0x7fcc4815bfb0 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.439+0000 7fcc45e00640 1 --2- 172.21.15.7:0/4252863365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815bfb0 0x7fcc480b3e00 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fcc480b4710 tx=0x7fcc3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df63a59490a6369 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.439+0000 7fcc45400640 1 -- 172.21.15.7:0/4252863365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38037070 con 0x7fcc4815bfb0 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.439+0000 7fcc45400640 1 -- 172.21.15.7:0/4252863365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc38032440 con 0x7fcc4815bfb0 2024-08-19T00:46:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.439+0000 7fcc45400640 1 -- 172.21.15.7:0/4252863365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38032810 con 0x7fcc4815bfb0 2024-08-19T00:46:35.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 -- 172.21.15.7:0/4252863365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815bfb0 msgr2=0x7fcc480b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/4252863365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815bfb0 0x7fcc480b3e00 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fcc480b4710 tx=0x7fcc3802a270 comp rx=0 tx=0).stop 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 -- 172.21.15.7:0/4252863365 shutdown_connections 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/4252863365 >> v2:172.21.15.162:3300/0 conn(0x7fcc480b5130 0x7fcc480aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/4252863365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815bfb0 0x7fcc480b3e00 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 -- 172.21.15.7:0/4252863365 >> 172.21.15.7:0/4252863365 conn(0x7fcc480b2300 msgr2=0x7fcc4806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 -- 172.21.15.7:0/4252863365 shutdown_connections 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.440+0000 7fcc4ce00640 1 -- 172.21.15.7:0/4252863365 wait complete. 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.442+0000 7fcc4ce00640 1 Processor -- start 2024-08-19T00:46:35.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.442+0000 7fcc4ce00640 1 -- start start 2024-08-19T00:46:35.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc4ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc480b5130 0x7fcc48150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc4ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc4815bfb0 0x7fcc48154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815c390 0x7fcc48151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc4ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480b44c0 con 0x7fcc4815c390 2024-08-19T00:46:35.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc4ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480b4340 con 0x7fcc480b5130 2024-08-19T00:46:35.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc4ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc48073050 con 0x7fcc4815bfb0 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc480b5130 0x7fcc48150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc480b5130 0x7fcc48150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:34686/0 (socket says 172.21.15.7:34686) 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc46800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815c390 0x7fcc48151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 -- 172.21.15.7:0/2351525371 learned_addr learned my addr 172.21.15.7:0/2351525371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc3d400640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc4815bfb0 0x7fcc48154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 -- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc4815bfb0 msgr2=0x7fcc48154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc4815bfb0 0x7fcc48154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 -- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815c390 msgr2=0x7fcc48151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815c390 0x7fcc48151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.443+0000 7fcc45e00640 1 -- 172.21.15.7:0/2351525371 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc48158400 con 0x7fcc480b5130 2024-08-19T00:46:35.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.444+0000 7fcc45e00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc480b5130 0x7fcc48150460 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcc3802a2b0 tx=0x7fcc380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.444+0000 7fcc3ea00640 1 -- 172.21.15.7:0/2351525371 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38037040 con 0x7fcc480b5130 2024-08-19T00:46:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.444+0000 7fcc3ea00640 1 -- 172.21.15.7:0/2351525371 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc38042070 con 0x7fcc480b5130 2024-08-19T00:46:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.444+0000 7fcc3ea00640 1 -- 172.21.15.7:0/2351525371 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38030880 con 0x7fcc480b5130 2024-08-19T00:46:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.444+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4806ee50 con 0x7fcc480b5130 2024-08-19T00:46:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.444+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4809c060 con 0x7fcc480b5130 2024-08-19T00:46:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.445+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc480b3e00 con 0x7fcc480b5130 2024-08-19T00:46:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.446+0000 7fcc3ea00640 1 -- 172.21.15.7:0/2351525371 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc38030a20 con 0x7fcc480b5130 2024-08-19T00:46:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.447+0000 7fcc3ea00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc2406be30 0x7fcc2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.447+0000 7fcc3ea00640 1 -- 172.21.15.7:0/2351525371 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8031+0+0 (secure 0 0 0) 0x7fcc380abf70 con 0x7fcc480b5130 2024-08-19T00:46:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.447+0000 7fcc3d400640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc2406be30 0x7fcc2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.448+0000 7fcc3d400640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc2406be30 0x7fcc2406e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcc480cc7b0 tx=0x7fcc30009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.452+0000 7fcc3ea00640 1 -- 172.21.15.7:0/2351525371 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcc38079920 con 0x7fcc480b5130 2024-08-19T00:46:35.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:35.672+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fcc4815dd40 con 0x7fcc480b5130 2024-08-19T00:46:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.335+0000 7fcc3ea00640 1 -- 172.21.15.7:0/2351525371 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v249) ==== 162+0+0 (secure 0 0 0) 0x7fcc3807dc20 con 0x7fcc480b5130 2024-08-19T00:46:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.339+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc2406be30 msgr2=0x7fcc2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.339+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc2406be30 0x7fcc2406e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcc480cc7b0 tx=0x7fcc30009190 comp rx=0 tx=0).stop 2024-08-19T00:46:36.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.339+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc480b5130 msgr2=0x7fcc48150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.339+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc480b5130 0x7fcc48150460 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcc3802a2b0 tx=0x7fcc380046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.339+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 shutdown_connections 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.339+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcc2406be30 0x7fcc2406e2f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.340+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc4815c390 0x7fcc48151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.340+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc4815bfb0 0x7fcc48154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.340+0000 7fcc4ce00640 1 --2- 172.21.15.7:0/2351525371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc480b5130 0x7fcc48150460 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.340+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 >> 172.21.15.7:0/2351525371 conn(0x7fcc480b2300 msgr2=0x7fcc48074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.340+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 shutdown_connections 2024-08-19T00:46:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.340+0000 7fcc4ce00640 1 -- 172.21.15.7:0/2351525371 wait complete. 2024-08-19T00:46:36.347 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:36.345+0000 7f339ac00640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': End of buffer [buffer:2] 2024-08-19T00:46:36.348 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:36.346+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:36.348 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:36.346+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:36.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:36.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.522+0000 7f19f0a00640 1 Processor -- start 2024-08-19T00:46:36.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.522+0000 7f19f0a00640 1 -- start start 2024-08-19T00:46:36.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.523+0000 7f19f0a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19ec06e710 0x7f19ec071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.523+0000 7f19f0a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ec0cdfb0 con 0x7f19ec0b3750 2024-08-19T00:46:36.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19f0a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ec0ce290 con 0x7f19ec0d03c0 2024-08-19T00:46:36.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19f0a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f19ec0cebc0 con 0x7f19ec06e710 2024-08-19T00:46:36.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19e3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19ec06e710 0x7f19ec071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19e3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19ec06e710 0x7f19ec071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57942/0 (socket says 172.21.15.7:57942) 2024-08-19T00:46:36.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19ea800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f19ec0b3750 0x7f19ec0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35870/0 (socket says 172.21.15.7:35870) 2024-08-19T00:46:36.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19e3e00640 1 -- 172.21.15.7:0/1628264194 learned_addr learned my addr 172.21.15.7:0/1628264194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:36.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19e3e00640 1 -- 172.21.15.7:0/1628264194 >> v1:172.21.15.162:6789/0 conn(0x7f19ec0d03c0 legacy=0x7f19ec0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19e3e00640 1 -- 172.21.15.7:0/1628264194 >> v1:172.21.15.7:6789/0 conn(0x7f19ec0b3750 legacy=0x7f19ec0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19e3e00640 1 -- 172.21.15.7:0/1628264194 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec0ce570 con 0x7f19ec06e710 2024-08-19T00:46:36.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.524+0000 7f19e9400640 1 -- 172.21.15.7:0/1628264194 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471377946 0 0) 0x7f19ec0cdfb0 con 0x7f19ec0b3750 2024-08-19T00:46:36.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.525+0000 7f19e3e00640 1 --2- 172.21.15.7:0/1628264194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec06e710 0x7f19ec071980 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f19d40098a0 tx=0x7f19d402a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d181ace5ecc107 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19e9400640 1 -- 172.21.15.7:0/1628264194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4037070 con 0x7f19ec06e710 2024-08-19T00:46:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19e9400640 1 -- 172.21.15.7:0/1628264194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d4032640 con 0x7f19ec06e710 2024-08-19T00:46:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19e9400640 1 -- 172.21.15.7:0/1628264194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4032a10 con 0x7f19ec06e710 2024-08-19T00:46:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19f0a00640 1 -- 172.21.15.7:0/1628264194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec06e710 msgr2=0x7f19ec071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19f0a00640 1 --2- 172.21.15.7:0/1628264194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec06e710 0x7f19ec071980 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f19d40098a0 tx=0x7f19d402a320 comp rx=0 tx=0).stop 2024-08-19T00:46:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19f0a00640 1 -- 172.21.15.7:0/1628264194 shutdown_connections 2024-08-19T00:46:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19f0a00640 1 --2- 172.21.15.7:0/1628264194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec06e710 0x7f19ec071980 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19f0a00640 1 -- 172.21.15.7:0/1628264194 >> 172.21.15.7:0/1628264194 conn(0x7f19ec06bc70 msgr2=0x7f19ec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:36.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19f0a00640 1 -- 172.21.15.7:0/1628264194 shutdown_connections 2024-08-19T00:46:36.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.526+0000 7f19f0a00640 1 -- 172.21.15.7:0/1628264194 wait complete. 2024-08-19T00:46:36.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.528+0000 7f19f0a00640 1 Processor -- start 2024-08-19T00:46:36.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.528+0000 7f19f0a00640 1 -- start start 2024-08-19T00:46:36.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19f0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19ec06e710 0x7f19ec09db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19f0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0b3750 0x7f19ec0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19f0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19ec0d03c0 0x7f19ec0c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19f0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec073c60 con 0x7f19ec0b3750 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19f0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec073ae0 con 0x7f19ec0d03c0 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19f0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec0b3ba0 con 0x7f19ec06e710 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0b3750 0x7f19ec0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0b3750 0x7f19ec0c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57950/0 (socket says 172.21.15.7:57950) 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19e3e00640 1 -- 172.21.15.7:0/18104042 learned_addr learned my addr 172.21.15.7:0/18104042 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19ea800640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19ec0d03c0 0x7f19ec0c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.529+0000 7f19e9e00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19ec06e710 0x7f19ec09db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e3e00640 1 -- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19ec06e710 msgr2=0x7f19ec09db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e3e00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19ec06e710 0x7f19ec09db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e3e00640 1 -- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19ec0d03c0 msgr2=0x7f19ec0c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e3e00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19ec0d03c0 0x7f19ec0c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e3e00640 1 -- 172.21.15.7:0/18104042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec0ae6b0 con 0x7f19ec0b3750 2024-08-19T00:46:36.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e3e00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0b3750 0x7f19ec0c9390 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f19d40090b0 tx=0x7f19d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:36.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e2000640 1 -- 172.21.15.7:0/18104042 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4037040 con 0x7f19ec0b3750 2024-08-19T00:46:36.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e2000640 1 -- 172.21.15.7:0/18104042 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d4004230 con 0x7f19ec0b3750 2024-08-19T00:46:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec0ae3d0 con 0x7f19ec0b3750 2024-08-19T00:46:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19e2000640 1 -- 172.21.15.7:0/18104042 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d40306f0 con 0x7f19ec0b3750 2024-08-19T00:46:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.530+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec0ca240 con 0x7f19ec0b3750 2024-08-19T00:46:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.532+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ec0cdfb0 con 0x7f19ec0b3750 2024-08-19T00:46:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.533+0000 7f19e2000640 1 -- 172.21.15.7:0/18104042 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19d4032500 con 0x7f19ec0b3750 2024-08-19T00:46:36.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.534+0000 7f19e2000640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f19c806be30 0x7f19c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.534+0000 7f19e2000640 1 -- 172.21.15.7:0/18104042 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7f19d40ac690 con 0x7f19ec0b3750 2024-08-19T00:46:36.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.534+0000 7f19e9e00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f19c806be30 0x7f19c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.535+0000 7f19e9e00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f19c806be30 0x7f19c806e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f19dc000f60 tx=0x7f19dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.538+0000 7f19e2000640 1 -- 172.21.15.7:0/18104042 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f19d407a110 con 0x7f19ec0b3750 2024-08-19T00:46:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.762+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19ec09e0d0 con 0x7f19ec0b3750 2024-08-19T00:46:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.762+0000 7f19e2000640 1 -- 172.21.15.7:0/18104042 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 251 v251) ==== 95+0+4393 (secure 0 0 0) 0x7f19d407e410 con 0x7f19ec0b3750 2024-08-19T00:46:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:36.764 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":251,"btime":"2024-08-19T00:46:36:347177+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/4168746347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":4168746347},{"type":"v1","addr":"172.21.15.7:6836","nonce":4168746347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":244}],"filesystems":[{"mdsmap":{"epoch":251,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:36.347047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 251 2024-08-19T00:46:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.764+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f19c806be30 msgr2=0x7f19c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f19c806be30 0x7f19c806e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f19dc000f60 tx=0x7f19dc009040 comp rx=0 tx=0).stop 2024-08-19T00:46:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0b3750 msgr2=0x7f19ec0c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0b3750 0x7f19ec0c9390 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f19d40090b0 tx=0x7f19d40046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 shutdown_connections 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f19c806be30 0x7f19c806e2f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19ec0d03c0 0x7f19ec0c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0b3750 0x7f19ec0c9390 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 --2- 172.21.15.7:0/18104042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19ec06e710 0x7f19ec09db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 >> 172.21.15.7:0/18104042 conn(0x7f19ec06bc70 msgr2=0x7f19ec157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 shutdown_connections 2024-08-19T00:46:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.765+0000 7f19f0a00640 1 -- 172.21.15.7:0/18104042 wait complete. 2024-08-19T00:46:36.782 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:36.783 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:36.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.937+0000 7fa971200640 1 Processor -- start 2024-08-19T00:46:36.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.937+0000 7fa971200640 1 -- start start 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.938+0000 7fa971200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa96c09aa70 0x7fa96c09ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.938+0000 7fa971200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa96c09b730 0x7fa96c06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.938+0000 7fa971200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96c09b390 con 0x7fa96c161f20 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.938+0000 7fa971200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa96c15ec30 con 0x7fa96c09aa70 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.938+0000 7fa971200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa96c15ef10 con 0x7fa96c09b730 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.938+0000 7fa969e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa96c09aa70 0x7fa96c09ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa969e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa96c09aa70 0x7fa96c09ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57966/0 (socket says 172.21.15.7:57966) 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa96a800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa96c161f20 0x7fa96c1623b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35884/0 (socket says 172.21.15.7:35884) 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa969e00640 1 -- 172.21.15.7:0/384613633 learned_addr learned my addr 172.21.15.7:0/384613633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa969400640 1 --2- 172.21.15.7:0/384613633 >> v2:172.21.15.162:3300/0 conn(0x7fa96c09b730 0x7fa96c06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa969e00640 1 -- 172.21.15.7:0/384613633 >> v2:172.21.15.162:3300/0 conn(0x7fa96c09b730 msgr2=0x7fa96c06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:36.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa969e00640 1 --2- 172.21.15.7:0/384613633 >> v2:172.21.15.162:3300/0 conn(0x7fa96c09b730 0x7fa96c06fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa969e00640 1 -- 172.21.15.7:0/384613633 >> v1:172.21.15.7:6789/0 conn(0x7fa96c161f20 legacy=0x7fa96c1623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.939+0000 7fa969e00640 1 -- 172.21.15.7:0/384613633 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c15f1f0 con 0x7fa96c09aa70 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.940+0000 7fa969e00640 1 --2- 172.21.15.7:0/384613633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c09aa70 0x7fa96c09ae50 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fa96c071bd0 tx=0x7fa95c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2ed31f9b93cc68 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.940+0000 7fa968a00640 1 -- 172.21.15.7:0/384613633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c037070 con 0x7fa96c09aa70 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.940+0000 7fa968a00640 1 -- 172.21.15.7:0/384613633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c02ae10 con 0x7fa96c09aa70 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.940+0000 7fa968a00640 1 -- 172.21.15.7:0/384613633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c032660 con 0x7fa96c09aa70 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 -- 172.21.15.7:0/384613633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c09aa70 msgr2=0x7fa96c09ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 --2- 172.21.15.7:0/384613633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c09aa70 0x7fa96c09ae50 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fa96c071bd0 tx=0x7fa95c02a180 comp rx=0 tx=0).stop 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 -- 172.21.15.7:0/384613633 shutdown_connections 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 --2- 172.21.15.7:0/384613633 >> v2:172.21.15.162:3300/0 conn(0x7fa96c09b730 0x7fa96c06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 --2- 172.21.15.7:0/384613633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c09aa70 0x7fa96c09ae50 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 -- 172.21.15.7:0/384613633 >> 172.21.15.7:0/384613633 conn(0x7fa96c0d2190 msgr2=0x7fa96c0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:36.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 -- 172.21.15.7:0/384613633 shutdown_connections 2024-08-19T00:46:36.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.941+0000 7fa971200640 1 -- 172.21.15.7:0/384613633 wait complete. 2024-08-19T00:46:36.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.943+0000 7fa971200640 1 Processor -- start 2024-08-19T00:46:36.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.943+0000 7fa971200640 1 -- start start 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa971200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96c09aa70 0x7fa96c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa971200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa96c09b730 0x7fa96c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa971200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c161f20 0x7fa96c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa971200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c15e8f0 con 0x7fa96c161f20 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa971200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c070170 con 0x7fa96c09aa70 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa971200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa96c162ac0 con 0x7fa96c09b730 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c161f20 0x7fa96c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c161f20 0x7fa96c157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57968/0 (socket says 172.21.15.7:57968) 2024-08-19T00:46:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 -- 172.21.15.7:0/2851776565 learned_addr learned my addr 172.21.15.7:0/2851776565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa969400640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa96c09b730 0x7fa96c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa969e00640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96c09aa70 0x7fa96c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 -- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa96c09b730 msgr2=0x7fa96c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa96c09b730 0x7fa96c0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 -- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96c09aa70 msgr2=0x7fa96c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96c09aa70 0x7fa96c156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.944+0000 7fa96a800640 1 -- 172.21.15.7:0/2851776565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c1572e0 con 0x7fa96c161f20 2024-08-19T00:46:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.945+0000 7fa96a800640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c161f20 0x7fa96c157b40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fa96400c8d0 tx=0x7fa96400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.945+0000 7fa962000640 1 -- 172.21.15.7:0/2851776565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964018070 con 0x7fa96c161f20 2024-08-19T00:46:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.945+0000 7fa962000640 1 -- 172.21.15.7:0/2851776565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96400a640 con 0x7fa96c161f20 2024-08-19T00:46:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.945+0000 7fa962000640 1 -- 172.21.15.7:0/2851776565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96400aa70 con 0x7fa96c161f20 2024-08-19T00:46:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.945+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c154ed0 con 0x7fa96c161f20 2024-08-19T00:46:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.945+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c155490 con 0x7fa96c161f20 2024-08-19T00:46:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.946+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c09ae50 con 0x7fa96c161f20 2024-08-19T00:46:36.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.947+0000 7fa962000640 1 -- 172.21.15.7:0/2851776565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa96401b070 con 0x7fa96c161f20 2024-08-19T00:46:36.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.948+0000 7fa962000640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa94c06be30 0x7fa94c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:36.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.948+0000 7fa962000640 1 -- 172.21.15.7:0/2851776565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7fa96408ade0 con 0x7fa96c161f20 2024-08-19T00:46:36.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.948+0000 7fa969e00640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa94c06be30 0x7fa94c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:36.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.949+0000 7fa969e00640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa94c06be30 0x7fa94c06e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa95c034000 tx=0x7fa95c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:36.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:36.952+0000 7fa962000640 1 -- 172.21.15.7:0/2851776565 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa964058860 con 0x7fa96c161f20 2024-08-19T00:46:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.173+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa96c063150 con 0x7fa96c161f20 2024-08-19T00:46:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.174+0000 7fa962000640 1 -- 172.21.15.7:0/2851776565 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 251 v251) ==== 95+0+4393 (secure 0 0 0) 0x7fa96405f080 con 0x7fa96c161f20 2024-08-19T00:46:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":251,"btime":"2024-08-19T00:46:36:347177+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/4168746347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":4168746347},{"type":"v1","addr":"172.21.15.7:6836","nonce":4168746347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":244}],"filesystems":[{"mdsmap":{"epoch":251,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:36.347047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 251 2024-08-19T00:46:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa94c06be30 msgr2=0x7fa94c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa94c06be30 0x7fa94c06e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa95c034000 tx=0x7fa95c02e000 comp rx=0 tx=0).stop 2024-08-19T00:46:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c161f20 msgr2=0x7fa96c157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c161f20 0x7fa96c157b40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fa96400c8d0 tx=0x7fa96400cd90 comp rx=0 tx=0).stop 2024-08-19T00:46:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 shutdown_connections 2024-08-19T00:46:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa94c06be30 0x7fa94c06e2f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa96c161f20 0x7fa96c157b40 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa96c09b730 0x7fa96c0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 --2- 172.21.15.7:0/2851776565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96c09aa70 0x7fa96c156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 >> 172.21.15.7:0/2851776565 conn(0x7fa96c0d2190 msgr2=0x7fa96c06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.176+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 shutdown_connections 2024-08-19T00:46:37.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.177+0000 7fa971200640 1 -- 172.21.15.7:0/2851776565 wait complete. 2024-08-19T00:46:37.194 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:37.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.349+0000 7fc395c00640 1 Processor -- start 2024-08-19T00:46:37.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.349+0000 7fc395c00640 1 -- start start 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.350+0000 7fc395c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc390159bf0 0x7fc390073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.350+0000 7fc395c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.350+0000 7fc395c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3900cea40 0x7fc3900d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.350+0000 7fc395c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc39006f7f0 con 0x7fc390159bf0 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.350+0000 7fc395c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc39006f510 con 0x7fc3900cea40 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.350+0000 7fc395c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc390072980 con 0x7fc3900739a0 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc390159bf0 0x7fc390073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc390159bf0 0x7fc390073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57972/0 (socket says 172.21.15.7:57972) 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 -- 172.21.15.7:0/551507678 learned_addr learned my addr 172.21.15.7:0/551507678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38e000640 1 --2- 172.21.15.7:0/551507678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38f400640 1 --2- 172.21.15.7:0/551507678 >> v2:172.21.15.162:3300/0 conn(0x7fc3900cea40 0x7fc3900d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 -- 172.21.15.7:0/551507678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 msgr2=0x7fc3900ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:37.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 --2- 172.21.15.7:0/551507678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 -- 172.21.15.7:0/551507678 >> v2:172.21.15.162:3300/0 conn(0x7fc3900cea40 msgr2=0x7fc3900d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:37.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 --2- 172.21.15.7:0/551507678 >> v2:172.21.15.162:3300/0 conn(0x7fc3900cea40 0x7fc3900d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38ea00640 1 -- 172.21.15.7:0/551507678 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc390072c60 con 0x7fc390159bf0 2024-08-19T00:46:37.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38e000640 1 --2- 172.21.15.7:0/551507678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:37.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.351+0000 7fc38f400640 1 --2- 172.21.15.7:0/551507678 >> v2:172.21.15.162:3300/0 conn(0x7fc3900cea40 0x7fc3900d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:37.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.352+0000 7fc38ea00640 1 --2- 172.21.15.7:0/551507678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc390159bf0 0x7fc390073460 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fc3900cdd20 tx=0x7fc38002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc78d34ccf2592a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.352+0000 7fc38d600640 1 -- 172.21.15.7:0/551507678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380037070 con 0x7fc390159bf0 2024-08-19T00:46:37.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.352+0000 7fc38d600640 1 -- 172.21.15.7:0/551507678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc380032440 con 0x7fc390159bf0 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.352+0000 7fc38d600640 1 -- 172.21.15.7:0/551507678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380032810 con 0x7fc390159bf0 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 -- 172.21.15.7:0/551507678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc390159bf0 msgr2=0x7fc390073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 --2- 172.21.15.7:0/551507678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc390159bf0 0x7fc390073460 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fc3900cdd20 tx=0x7fc38002a140 comp rx=0 tx=0).stop 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 -- 172.21.15.7:0/551507678 shutdown_connections 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 --2- 172.21.15.7:0/551507678 >> v2:172.21.15.162:3300/0 conn(0x7fc3900cea40 0x7fc3900d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 --2- 172.21.15.7:0/551507678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 --2- 172.21.15.7:0/551507678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc390159bf0 0x7fc390073460 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 -- 172.21.15.7:0/551507678 >> 172.21.15.7:0/551507678 conn(0x7fc39006bc70 msgr2=0x7fc39006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 -- 172.21.15.7:0/551507678 shutdown_connections 2024-08-19T00:46:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.353+0000 7fc395c00640 1 -- 172.21.15.7:0/551507678 wait complete. 2024-08-19T00:46:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.355+0000 7fc395c00640 1 Processor -- start 2024-08-19T00:46:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.355+0000 7fc395c00640 1 -- start start 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc395c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc395c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3900cea40 0x7fc3901f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc395c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390159bf0 0x7fc39014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc395c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc39015a150 con 0x7fc3900cea40 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc395c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc390159fd0 con 0x7fc390159bf0 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc395c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3900d0900 con 0x7fc3900739a0 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3900cea40 0x7fc3901f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3900cea40 0x7fc3901f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57978/0 (socket says 172.21.15.7:57978) 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 -- 172.21.15.7:0/1944236029 learned_addr learned my addr 172.21.15.7:0/1944236029 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38f400640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390159bf0 0x7fc39014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38ea00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 -- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 msgr2=0x7fc3900b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 -- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390159bf0 msgr2=0x7fc39014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390159bf0 0x7fc39014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.356+0000 7fc38e000640 1 -- 172.21.15.7:0/1944236029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc390152af0 con 0x7fc3900cea40 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.357+0000 7fc38e000640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3900cea40 0x7fc3901f1c30 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c820 tx=0x7fc37c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.357+0000 7fc386a00640 1 -- 172.21.15.7:0/1944236029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c015070 con 0x7fc3900cea40 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.357+0000 7fc386a00640 1 -- 172.21.15.7:0/1944236029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37c007a30 con 0x7fc3900cea40 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.357+0000 7fc386a00640 1 -- 172.21.15.7:0/1944236029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c007e20 con 0x7fc3900cea40 2024-08-19T00:46:37.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.357+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3901f24f0 con 0x7fc3900cea40 2024-08-19T00:46:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.357+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901f2ab0 con 0x7fc3900cea40 2024-08-19T00:46:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.358+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3900d03c0 con 0x7fc3900cea40 2024-08-19T00:46:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.359+0000 7fc386a00640 1 -- 172.21.15.7:0/1944236029 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc37c018070 con 0x7fc3900cea40 2024-08-19T00:46:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.360+0000 7fc386a00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc37006be30 0x7fc37006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.360+0000 7fc386a00640 1 -- 172.21.15.7:0/1944236029 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7fc37c08b3c0 con 0x7fc3900cea40 2024-08-19T00:46:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.360+0000 7fc38ea00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc37006be30 0x7fc37006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.361+0000 7fc38ea00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc37006be30 0x7fc37006e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc380034000 tx=0x7fc38002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.364+0000 7fc386a00640 1 -- 172.21.15.7:0/1944236029 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc37c059360 con 0x7fc3900cea40 2024-08-19T00:46:37.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.585+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc390152eb0 con 0x7fc3900cea40 2024-08-19T00:46:37.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.586+0000 7fc386a00640 1 -- 172.21.15.7:0/1944236029 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 251 v251) ==== 95+0+4393 (secure 0 0 0) 0x7fc37c058c60 con 0x7fc3900cea40 2024-08-19T00:46:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:37.589 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":251,"btime":"2024-08-19T00:46:36:347177+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/4168746347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":4168746347},{"type":"v1","addr":"172.21.15.7:6836","nonce":4168746347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":244}],"filesystems":[{"mdsmap":{"epoch":251,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:36.347047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 251 2024-08-19T00:46:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc37006be30 msgr2=0x7fc37006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc37006be30 0x7fc37006e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc380034000 tx=0x7fc38002e000 comp rx=0 tx=0).stop 2024-08-19T00:46:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3900cea40 msgr2=0x7fc3901f1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3900cea40 0x7fc3901f1c30 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c820 tx=0x7fc37c00cce0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 shutdown_connections 2024-08-19T00:46:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc37006be30 0x7fc37006e2f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc390159bf0 0x7fc39014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3900cea40 0x7fc3901f1c30 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 --2- 172.21.15.7:0/1944236029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3900739a0 0x7fc3900b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 >> 172.21.15.7:0/1944236029 conn(0x7fc39006bc70 msgr2=0x7fc390074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:37.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 shutdown_connections 2024-08-19T00:46:37.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.588+0000 7fc395c00640 1 -- 172.21.15.7:0/1944236029 wait complete. 2024-08-19T00:46:37.605 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate mds_snaptable' led to DAMAGED state 2024-08-19T00:46:37.605 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate mds0_inotable' 2024-08-19T00:46:37.605 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:37.605 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:37.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:37.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:37.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:37.641 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:37.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:37.717 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:37.718 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.913+0000 7f3137a00640 1 Processor -- start 2024-08-19T00:46:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.913+0000 7f3137a00640 1 -- start start 2024-08-19T00:46:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.914+0000 7f3137a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f313006e710 0x7f3130071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.914+0000 7f3137a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300b3750 0x7f31300cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.914+0000 7f3137a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31300cdfb0 con 0x7f31300d03c0 2024-08-19T00:46:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.914+0000 7f3137a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f31300cebc0 con 0x7f313006e710 2024-08-19T00:46:37.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.914+0000 7f3137a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f31300ce290 con 0x7f31300b3750 2024-08-19T00:46:37.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.915+0000 7f312fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f313006e710 0x7f3130071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.915+0000 7f3135000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f31300d03c0 0x7f31300d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35886/0 (socket says 172.21.15.7:35886) 2024-08-19T00:46:37.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.915+0000 7f3135000640 1 -- 172.21.15.7:0/3535668220 learned_addr learned my addr 172.21.15.7:0/3535668220 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:37.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.915+0000 7f312fe00640 1 -- 172.21.15.7:0/3535668220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300b3750 msgr2=0x7f31300cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:37.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.915+0000 7f312fe00640 1 --2- 172.21.15.7:0/3535668220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300b3750 0x7f31300cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.915+0000 7f312fe00640 1 -- 172.21.15.7:0/3535668220 >> v1:172.21.15.7:6789/0 conn(0x7f31300d03c0 legacy=0x7f31300d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.915+0000 7f312fe00640 1 -- 172.21.15.7:0/3535668220 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31300ce570 con 0x7f313006e710 2024-08-19T00:46:37.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.916+0000 7f312fe00640 1 --2- 172.21.15.7:0/3535668220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f3130071980 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f311c0097d0 tx=0x7f311c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61f6b69b910193d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f312f400640 1 -- 172.21.15.7:0/3535668220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c037070 con 0x7f313006e710 2024-08-19T00:46:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f312f400640 1 -- 172.21.15.7:0/3535668220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311c032440 con 0x7f313006e710 2024-08-19T00:46:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f312f400640 1 -- 172.21.15.7:0/3535668220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c032810 con 0x7f313006e710 2024-08-19T00:46:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 -- 172.21.15.7:0/3535668220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 msgr2=0x7f3130071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 --2- 172.21.15.7:0/3535668220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f3130071980 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f311c0097d0 tx=0x7f311c02a1c0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 -- 172.21.15.7:0/3535668220 shutdown_connections 2024-08-19T00:46:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 --2- 172.21.15.7:0/3535668220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300b3750 0x7f31300cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 --2- 172.21.15.7:0/3535668220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f3130071980 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 -- 172.21.15.7:0/3535668220 >> 172.21.15.7:0/3535668220 conn(0x7f313006bc70 msgr2=0x7f313006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 -- 172.21.15.7:0/3535668220 shutdown_connections 2024-08-19T00:46:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.917+0000 7f3137a00640 1 -- 172.21.15.7:0/3535668220 wait complete. 2024-08-19T00:46:37.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.919+0000 7f3137a00640 1 Processor -- start 2024-08-19T00:46:37.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.919+0000 7f3137a00640 1 -- start start 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3137a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f31300b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3137a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31300b3750 0x7f3130156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3137a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300d03c0 0x7f3130156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3137a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3130073c60 con 0x7f313006e710 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3137a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3130073ae0 con 0x7f31300b3750 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3137a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f31300b3be0 con 0x7f31300d03c0 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3135000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f31300b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3135000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f31300b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58002/0 (socket says 172.21.15.7:58002) 2024-08-19T00:46:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3135000640 1 -- 172.21.15.7:0/3275810935 learned_addr learned my addr 172.21.15.7:0/3275810935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f312fe00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31300b3750 0x7f3130156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3135a00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300d03c0 0x7f3130156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.920+0000 7f3135000640 1 -- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300d03c0 msgr2=0x7f3130156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f3135000640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300d03c0 0x7f3130156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f3135000640 1 -- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31300b3750 msgr2=0x7f3130156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f3135000640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31300b3750 0x7f3130156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f3135000640 1 -- 172.21.15.7:0/3275810935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313009ac40 con 0x7f313006e710 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f3135000640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f31300b1900 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f312400c400 tx=0x7f312400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f312cc00640 1 -- 172.21.15.7:0/3275810935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124017070 con 0x7f313006e710 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f312cc00640 1 -- 172.21.15.7:0/3275810935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3124005ce0 con 0x7f313006e710 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f312cc00640 1 -- 172.21.15.7:0/3275810935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31240072f0 con 0x7f313006e710 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313009af20 con 0x7f313006e710 2024-08-19T00:46:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.921+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313009cc30 con 0x7f313006e710 2024-08-19T00:46:37.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.922+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31300af4e0 con 0x7f313006e710 2024-08-19T00:46:37.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.923+0000 7f312cc00640 1 -- 172.21.15.7:0/3275810935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f312401a070 con 0x7f313006e710 2024-08-19T00:46:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.924+0000 7f312cc00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f311006be60 0x7f311006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.924+0000 7f312cc00640 1 -- 172.21.15.7:0/3275810935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7f312408ac00 con 0x7f313006e710 2024-08-19T00:46:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.924+0000 7f312fe00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f311006be60 0x7f311006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.925+0000 7f312fe00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f311006be60 0x7f311006e320 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f311c034000 tx=0x7f311c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:37.928+0000 7f312cc00640 1 -- 172.21.15.7:0/3275810935 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3124058550 con 0x7f313006e710 2024-08-19T00:46:38.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.146+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f31300d0b90 con 0x7f313006e710 2024-08-19T00:46:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.346+0000 7f312cc00640 1 -- 172.21.15.7:0/3275810935 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v252) ==== 161+0+0 (secure 0 0 0) 0x7f312405c850 con 0x7f313006e710 2024-08-19T00:46:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f311006be60 msgr2=0x7f311006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f311006be60 0x7f311006e320 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f311c034000 tx=0x7f311c02e000 comp rx=0 tx=0).stop 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 msgr2=0x7f31300b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f31300b1900 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f312400c400 tx=0x7f312400c8c0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 shutdown_connections 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f311006be60 0x7f311006e320 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31300d03c0 0x7f3130156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31300b3750 0x7f3130156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 --2- 172.21.15.7:0/3275810935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313006e710 0x7f31300b1900 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.348+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 >> 172.21.15.7:0/3275810935 conn(0x7f313006bc70 msgr2=0x7f31300cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.349+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 shutdown_connections 2024-08-19T00:46:38.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.349+0000 7f3137a00640 1 -- 172.21.15.7:0/3275810935 wait complete. 2024-08-19T00:46:38.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:38.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.522+0000 7f2a79600640 1 Processor -- start 2024-08-19T00:46:38.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.522+0000 7f2a79600640 1 -- start start 2024-08-19T00:46:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.523+0000 7f2a79600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a740d0ad0 0x7f2a740ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.523+0000 7f2a79600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7406f7f0 con 0x7f2a740ce500 2024-08-19T00:46:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.523+0000 7f2a79600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7406f510 con 0x7f2a74159bf0 2024-08-19T00:46:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.523+0000 7f2a79600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2a74072980 con 0x7f2a740d0ad0 2024-08-19T00:46:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.524+0000 7f2a73400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a740d0ad0 0x7f2a740ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.524+0000 7f2a73400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a740d0ad0 0x7f2a740ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58010/0 (socket says 172.21.15.7:58010) 2024-08-19T00:46:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.524+0000 7f2a73400640 1 -- 172.21.15.7:0/4289402872 learned_addr learned my addr 172.21.15.7:0/4289402872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.524+0000 7f2a73400640 1 -- 172.21.15.7:0/4289402872 >> v1:172.21.15.162:6789/0 conn(0x7f2a74159bf0 legacy=0x7f2a74073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.524+0000 7f2a73400640 1 -- 172.21.15.7:0/4289402872 >> v1:172.21.15.7:6789/0 conn(0x7f2a740ce500 legacy=0x7f2a740d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.524+0000 7f2a73400640 1 -- 172.21.15.7:0/4289402872 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a74072c60 con 0x7f2a740d0ad0 2024-08-19T00:46:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.525+0000 7f2a73400640 1 --2- 172.21.15.7:0/4289402872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a740ce970 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009e50 tx=0x7f2a6c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2de856ef29cd1b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.525+0000 7f2a72000640 1 -- 172.21.15.7:0/4289402872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c036070 con 0x7f2a740d0ad0 2024-08-19T00:46:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.525+0000 7f2a72000640 1 -- 172.21.15.7:0/4289402872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6c031600 con 0x7f2a740d0ad0 2024-08-19T00:46:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.525+0000 7f2a72000640 1 -- 172.21.15.7:0/4289402872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0319d0 con 0x7f2a740d0ad0 2024-08-19T00:46:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.526+0000 7f2a79600640 1 -- 172.21.15.7:0/4289402872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 msgr2=0x7f2a740ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.526+0000 7f2a79600640 1 --2- 172.21.15.7:0/4289402872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a740ce970 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009e50 tx=0x7f2a6c02a730 comp rx=0 tx=0).stop 2024-08-19T00:46:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.526+0000 7f2a79600640 1 -- 172.21.15.7:0/4289402872 shutdown_connections 2024-08-19T00:46:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.526+0000 7f2a79600640 1 --2- 172.21.15.7:0/4289402872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a740ce970 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.526+0000 7f2a79600640 1 -- 172.21.15.7:0/4289402872 >> 172.21.15.7:0/4289402872 conn(0x7f2a7406bc70 msgr2=0x7f2a7406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.526+0000 7f2a79600640 1 -- 172.21.15.7:0/4289402872 shutdown_connections 2024-08-19T00:46:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.526+0000 7f2a79600640 1 -- 172.21.15.7:0/4289402872 wait complete. 2024-08-19T00:46:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.528+0000 7f2a79600640 1 Processor -- start 2024-08-19T00:46:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.528+0000 7f2a79600640 1 -- start start 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a79600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740ce500 0x7f2a7414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a79600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a7414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a79600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74159bf0 0x7f2a740b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a79600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74159fd0 con 0x7f2a740d0ad0 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a79600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74073b70 con 0x7f2a740ce500 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a79600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7415a150 con 0x7f2a74159bf0 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a6be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a7414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a6be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a7414f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58020/0 (socket says 172.21.15.7:58020) 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a6be00640 1 -- 172.21.15.7:0/4015918245 learned_addr learned my addr 172.21.15.7:0/4015918245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a72a00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740ce500 0x7f2a7414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.529+0000 7f2a73400640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74159bf0 0x7f2a740b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6be00640 1 -- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74159bf0 msgr2=0x7f2a740b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6be00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74159bf0 0x7f2a740b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6be00640 1 -- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740ce500 msgr2=0x7f2a7414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6be00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740ce500 0x7f2a7414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6be00640 1 -- 172.21.15.7:0/4015918245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7414fa20 con 0x7f2a740d0ad0 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a72a00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740ce500 0x7f2a7414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6be00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a7414f4e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c400 tx=0x7f2a5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6aa00640 1 -- 172.21.15.7:0/4015918245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c017070 con 0x7f2a740d0ad0 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6aa00640 1 -- 172.21.15.7:0/4015918245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0052d0 con 0x7f2a740d0ad0 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a6aa00640 1 -- 172.21.15.7:0/4015918245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c003830 con 0x7f2a740d0ad0 2024-08-19T00:46:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7414fcc0 con 0x7f2a740d0ad0 2024-08-19T00:46:38.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.530+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a74150280 con 0x7f2a740d0ad0 2024-08-19T00:46:38.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.531+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a740ce970 con 0x7f2a740d0ad0 2024-08-19T00:46:38.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.532+0000 7f2a6aa00640 1 -- 172.21.15.7:0/4015918245 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a5c01a070 con 0x7f2a740d0ad0 2024-08-19T00:46:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.533+0000 7f2a6aa00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a5006be30 0x7f2a5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.533+0000 7f2a6aa00640 1 -- 172.21.15.7:0/4015918245 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7f2a5c08ab30 con 0x7f2a740d0ad0 2024-08-19T00:46:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.533+0000 7f2a72a00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a5006be30 0x7f2a5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.534+0000 7f2a72a00640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a5006be30 0x7f2a5006e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007fd0 tx=0x7f2a64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.538+0000 7f2a6aa00640 1 -- 172.21.15.7:0/4015918245 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2a5c058b70 con 0x7f2a740d0ad0 2024-08-19T00:46:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:38.790+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f2a74158b90 con 0x7f2a740d0ad0 2024-08-19T00:46:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.355+0000 7f2a6aa00640 1 -- 172.21.15.7:0/4015918245 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v253) ==== 101+0+0 (secure 0 0 0) 0x7f2a5c058470 con 0x7f2a740d0ad0 2024-08-19T00:46:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.357+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a5006be30 msgr2=0x7f2a5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.357+0000 7f2a79600640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a5006be30 0x7f2a5006e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007fd0 tx=0x7f2a64009040 comp rx=0 tx=0).stop 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.357+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 msgr2=0x7f2a7414f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.357+0000 7f2a79600640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a7414f4e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c400 tx=0x7f2a5c00c8c0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 shutdown_connections 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a5006be30 0x7f2a5006e2f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74159bf0 0x7f2a740b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a740d0ad0 0x7f2a7414f4e0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 --2- 172.21.15.7:0/4015918245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740ce500 0x7f2a7414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 >> 172.21.15.7:0/4015918245 conn(0x7f2a7406bc70 msgr2=0x7f2a74074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 shutdown_connections 2024-08-19T00:46:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.358+0000 7f2a79600640 1 -- 172.21.15.7:0/4015918245 wait complete. 2024-08-19T00:46:39.377 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:39.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.455+0000 7f8ccb20ef40 1 Processor -- start 2024-08-19T00:46:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.455+0000 7f8ccb20ef40 1 -- start start 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8ccb20ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 0x55b52ad90670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8ccb20ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf95b0 0x55b52acf4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8ccb20ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf9990 0x55b52ada0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8ccb20ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b52acf88f0 con 0x55b52acf95b0 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8ccb20ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b52ac6dd00 con 0x55b52acf7f40 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8ccb20ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b52ad9edc0 con 0x55b52acf9990 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cbfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf95b0 0x55b52acf4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cbfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf95b0 0x55b52acf4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58038/0 (socket says 172.21.15.7:58038) 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cbfe00640 1 -- 172.21.15.7:0/1964541462 learned_addr learned my addr 172.21.15.7:0/1964541462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cc7800640 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 0x55b52ad90670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cc8200640 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf9990 0x55b52ada0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cbfe00640 1 -- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf9990 msgr2=0x55b52ada0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf9990 0x55b52ada0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cbfe00640 1 -- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 msgr2=0x55b52ad90670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.456+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 0x55b52ad90670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.457+0000 7f8cbfe00640 1 -- 172.21.15.7:0/1964541462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52abf2b30 con 0x55b52acf95b0 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.457+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf95b0 0x55b52acf4750 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000b240 tx=0x7f8cb000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafee70bfdedc110 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.457+0000 7f8cc6400640 1 -- 172.21.15.7:0/1964541462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0008070 con 0x55b52acf95b0 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.457+0000 7f8cc6400640 1 -- 172.21.15.7:0/1964541462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb000d500 con 0x55b52acf95b0 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.457+0000 7f8cc6400640 1 -- 172.21.15.7:0/1964541462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb000d8b0 con 0x55b52acf95b0 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/1964541462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf95b0 msgr2=0x55b52acf4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf95b0 0x55b52acf4750 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000b240 tx=0x7f8cb000b700 comp rx=0 tx=0).stop 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/1964541462 shutdown_connections 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf9990 0x55b52ada0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf95b0 0x55b52acf4750 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/1964541462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 0x55b52ad90670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/1964541462 >> 172.21.15.7:0/1964541462 conn(0x55b52acf64e0 msgr2=0x55b52ada0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/1964541462 shutdown_connections 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/1964541462 wait complete. 2024-08-19T00:46:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.458+0000 7f8ccb20ef40 1 Processor -- start 2024-08-19T00:46:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.459+0000 7f8ccb20ef40 1 -- start start 2024-08-19T00:46:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8ccb20ef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 0x55b52ae37370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8ccb20ef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf95b0 0x55b52ad971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8ccb20ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf9990 0x55b52ad8f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8ccb20ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b52ad9faf0 con 0x55b52acf9990 2024-08-19T00:46:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8ccb20ef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b52ad9f810 con 0x55b52acf7f40 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8ccb20ef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b52ad9fdd0 con 0x55b52acf95b0 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf9990 0x55b52ad8f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf9990 0x55b52ad8f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58052/0 (socket says 172.21.15.7:58052) 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 learned_addr learned my addr 172.21.15.7:0/3221000976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc7800640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 0x55b52ae37370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf95b0 0x55b52ad971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf95b0 msgr2=0x55b52ad971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b52acf95b0 0x55b52ad971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 msgr2=0x55b52ae37370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b52acf7f40 0x55b52ae37370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.460+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52ac2f080 con 0x55b52acf9990 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.461+0000 7f8cc8200640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf9990 0x55b52ad8f120 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000f690 tx=0x7f8cc000fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.461+0000 7f8cc5000640 1 -- 172.21.15.7:0/3221000976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0019020 con 0x55b52acf9990 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.461+0000 7f8cc5000640 1 -- 172.21.15.7:0/3221000976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc000d730 con 0x55b52acf9990 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.461+0000 7f8cc5000640 1 -- 172.21.15.7:0/3221000976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000db20 con 0x55b52acf9990 2024-08-19T00:46:39.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.461+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b52ad969d0 con 0x55b52acf9990 2024-08-19T00:46:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.461+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52ad96380 con 0x55b52acf9990 2024-08-19T00:46:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.463+0000 7f8cc5000640 1 -- 172.21.15.7:0/3221000976 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cc001c020 con 0x55b52acf9990 2024-08-19T00:46:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.464+0000 7f8cc5000640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ca406a810 0x7f8ca406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.464+0000 7f8cc5000640 1 -- 172.21.15.7:0/3221000976 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7f8cc008aae0 con 0x55b52acf9990 2024-08-19T00:46:39.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.464+0000 7f8cc7800640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ca406a810 0x7f8ca406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.469 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.464+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52ae34cf0 0x55b52ae350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.464+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae28cc0 con 0x55b52ae34cf0 2024-08-19T00:46:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.465+0000 7f8cc7800640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ca406a810 0x7f8ca406ccd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8057000 tx=0x7f8cb8062040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.465+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52ae34cf0 0x55b52ae350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.466+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52ae34cf0 0x55b52ae350d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.468+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v114'846 uv820 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.468+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae35610 con 0x55b52ae34cf0 2024-08-19T00:46:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.470+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v114'847 uv847 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.470+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae40a50 con 0x55b52ae34cf0 2024-08-19T00:46:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.471+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v114'848 uv848 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.473 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.471+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41e00 con 0x55b52ae34cf0 2024-08-19T00:46:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.473+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v114'849 uv849 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.473+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae421a0 con 0x55b52ae34cf0 2024-08-19T00:46:39.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.474+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v114'850 uv850 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.474+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae40df0 con 0x55b52ae34cf0 2024-08-19T00:46:39.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.476+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v114'851 uv851 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.476+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41190 con 0x55b52ae34cf0 2024-08-19T00:46:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.477+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v114'852 uv826 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.478+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.479+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v114'853 uv853 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.479+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.482 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.481+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v114'854 uv854 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.481+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.482+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v114'855 uv855 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.482+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.483+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v114'856 uv856 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.483+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.485+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v114'857 uv857 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.485+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.487+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v114'858 uv833 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.487+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.488+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v114'859 uv859 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.488+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.491 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:39.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.490+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v114'860 uv860 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.490+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.491+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v114'861 uv861 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.491+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.493+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v114'862 uv862 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.493+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae41530 con 0x55b52ae34cf0 2024-08-19T00:46:39.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.494+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v114'863 uv863 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.494+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.495+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v114'864 uv864 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.496+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.497+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v114'865 uv839 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.497+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.498+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v114'866 uv866 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.498+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.500+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v114'867 uv867 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.502 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:39.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.500+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae43550 con 0x55b52ae34cf0 2024-08-19T00:46:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.502+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v114'868 uv868 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.502+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae43550 con 0x55b52ae34cf0 2024-08-19T00:46:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.503+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v114'869 uv869 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.503+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.504+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v114'870 uv870 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.504+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.506+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v114'871 uv845 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.506+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.508+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v114'872 uv872 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.508+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.509+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v114'873 uv873 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.511 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:39.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.509+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae43550 con 0x55b52ae34cf0 2024-08-19T00:46:39.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.510+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v114'874 uv874 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.510+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae43550 con 0x55b52ae34cf0 2024-08-19T00:46:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.512+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v114'875 uv875 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.512+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae42540 con 0x55b52ae34cf0 2024-08-19T00:46:39.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.514+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v114'876 uv876 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.514+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52ae42a50 0x55b52ae44e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.514+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae45380 con 0x55b52ae42a50 2024-08-19T00:46:39.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.514+0000 7f8cc7800640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52ae42a50 0x55b52ae44e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.515+0000 7f8cc7800640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52ae42a50 0x55b52ae44e40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.516+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v114'617 uv600 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.517+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae45720 con 0x55b52ae42a50 2024-08-19T00:46:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.518+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v114'618 uv618 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.518+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae45ac0 con 0x55b52ae42a50 2024-08-19T00:46:39.521 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.519+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v114'619 uv619 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.519+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae45e60 con 0x55b52ae42a50 2024-08-19T00:46:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.521+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v114'620 uv620 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.521+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46200 con 0x55b52ae42a50 2024-08-19T00:46:39.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.523+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v114'621 uv621 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.523+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae465a0 con 0x55b52ae42a50 2024-08-19T00:46:39.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.524+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v114'622 uv605 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.524+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46940 con 0x55b52ae42a50 2024-08-19T00:46:39.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.525+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v114'623 uv623 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.525+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.528 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:39.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.527+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v114'624 uv624 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.527+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.528+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v114'625 uv625 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.528+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.530+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v114'626 uv626 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.530+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.531+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v114'627 uv610 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.531+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.533+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v114'628 uv628 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.533+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.535 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:39.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.534+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v114'629 uv629 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.534+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4b3d0 con 0x55b52ae42a50 2024-08-19T00:46:39.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.536+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v114'630 uv630 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.536+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4b3d0 con 0x55b52ae42a50 2024-08-19T00:46:39.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.537+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v114'631 uv631 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.537+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.539+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v114'632 uv616 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.539+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.540+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v114'633 uv633 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.540+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.542 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.541+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v114'634 uv634 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.541+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae47cf0 con 0x55b52ae42a50 2024-08-19T00:46:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.543+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v114'635 uv635 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.543+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae47cf0 con 0x55b52ae42a50 2024-08-19T00:46:39.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.544+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v114'636 uv636 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.544+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae46ce0 con 0x55b52ae42a50 2024-08-19T00:46:39.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.545+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v114'637 uv637 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae42a50 2024-08-19T00:46:39.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.545+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52ae471f0 0x55b52ae495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.545+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae49b20 con 0x55b52ae471f0 2024-08-19T00:46:39.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.546+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52ae471f0 0x55b52ae495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.547+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52ae471f0 0x55b52ae495e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.548+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v114'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae471f0 2024-08-19T00:46:39.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.548+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae49b20 con 0x55b52ae471f0 2024-08-19T00:46:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.549+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v114'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae471f0 2024-08-19T00:46:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.549+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae49b20 con 0x55b52ae471f0 2024-08-19T00:46:39.552 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.551+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v114'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae471f0 2024-08-19T00:46:39.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.551+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4abd0 con 0x55b52ae471f0 2024-08-19T00:46:39.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.552+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v114'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae471f0 2024-08-19T00:46:39.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.552+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4ab90 con 0x55b52ae471f0 2024-08-19T00:46:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.553+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v114'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae471f0 2024-08-19T00:46:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.553+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4ab90 con 0x55b52ae471f0 2024-08-19T00:46:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.555+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v114'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae471f0 2024-08-19T00:46:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.555+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4ab90 con 0x55b52ae34cf0 2024-08-19T00:46:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.556+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v114'122 uv121 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.556+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4ab90 con 0x55b52ae34cf0 2024-08-19T00:46:39.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.557+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v114'123 uv123 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.558+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae49bc0 con 0x55b52ae34cf0 2024-08-19T00:46:39.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.559+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v114'124 uv124 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.561 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:39.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.559+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae49bc0 con 0x55b52ae34cf0 2024-08-19T00:46:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.560+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v114'125 uv125 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8cb000d730 con 0x55b52ae34cf0 2024-08-19T00:46:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.560+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b52ae4a520 0x55b52ae4a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.561+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4cfe0 con 0x55b52ae4a520 2024-08-19T00:46:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.561+0000 7f8cc8200640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b52ae4a520 0x55b52ae4a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.561+0000 7f8cc8200640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b52ae4a520 0x55b52ae4a940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.563+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v114'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.563+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4d380 con 0x55b52ae4a520 2024-08-19T00:46:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.564+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v114'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.564+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4d760 con 0x55b52ae4a520 2024-08-19T00:46:39.566 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.565+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v114'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.565+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ad8f760 con 0x55b52ae4a520 2024-08-19T00:46:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.566+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v114'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.566+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4f0f0 con 0x55b52ae4a520 2024-08-19T00:46:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.567+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v114'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.567+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae4e000 con 0x55b52ae4a520 2024-08-19T00:46:39.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.569+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v114'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.569+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b52ae4ea70 0x55b52ae51550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.569+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ad0 con 0x55b52ae4ea70 2024-08-19T00:46:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.569+0000 7f8cc7800640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b52ae4ea70 0x55b52ae51550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.569+0000 7f8cc7800640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b52ae4ea70 0x55b52ae51550 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.571+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v114'305 uv299 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.571+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.572+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v114'306 uv306 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.573+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.575 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:39.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.574+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v114'307 uv307 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.574+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae52eb0 con 0x55b52ae4ea70 2024-08-19T00:46:39.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.575+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v114'308 uv308 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.575+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae52eb0 con 0x55b52ae4ea70 2024-08-19T00:46:39.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.577+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v114'309 uv309 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.577+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.578+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v114'310 uv310 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.578+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.579+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v114'311 uv304 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.579+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.581+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v114'312 uv312 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.581+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.582+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v114'313 uv313 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.582+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.583+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v114'314 uv314 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.583+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae51ea0 con 0x55b52ae4ea70 2024-08-19T00:46:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.585+0000 7f8cc7800640 1 -- 172.21.15.7:0/3221000976 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v114'315 uv315 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb805fb80 con 0x55b52ae4ea70 2024-08-19T00:46:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.585+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52ae52520 0x55b52ae54930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.585+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55050 con 0x55b52ae52520 2024-08-19T00:46:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.585+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52ae52520 0x55b52ae54930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.586+0000 7f8cbfe00640 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52ae52520 0x55b52ae54930 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.587+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v114'138 uv137 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.587+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55050 con 0x55b52ae52520 2024-08-19T00:46:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.589+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v114'139 uv139 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.589+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae52520 2024-08-19T00:46:39.591 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.590+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v114'140 uv140 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.590+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae52520 2024-08-19T00:46:39.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.591+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v114'141 uv141 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.591+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae52520 2024-08-19T00:46:39.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.592+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v114'142 uv142 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.592+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae34cf0 2024-08-19T00:46:39.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.594+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v114'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae34cf0 2024-08-19T00:46:39.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.594+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae34cf0 2024-08-19T00:46:39.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.596+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v114'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae34cf0 2024-08-19T00:46:39.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.596+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae34cf0 2024-08-19T00:46:39.598 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:39.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.597+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v114'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae34cf0 2024-08-19T00:46:39.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.597+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56480 con 0x55b52ae34cf0 2024-08-19T00:46:39.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.599+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v114'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae34cf0 2024-08-19T00:46:39.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.599+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56480 con 0x55b52ae34cf0 2024-08-19T00:46:39.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.600+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v114'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae34cf0 2024-08-19T00:46:39.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.600+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae34cf0 2024-08-19T00:46:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.601+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v114'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae34cf0 2024-08-19T00:46:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.601+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.603+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v114'273 uv267 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.603+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.604+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v114'274 uv274 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.605+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.607 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:39.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.606+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v114'275 uv275 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.606+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.607+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v114'276 uv276 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.607+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.609+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v114'277 uv277 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.609+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.610+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v114'278 uv272 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.610+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.612+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v114'279 uv279 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.612+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.614 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:39.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.613+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v114'280 uv280 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.613+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55470 con 0x55b52ae471f0 2024-08-19T00:46:39.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.615+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v114'281 uv281 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.615+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae58280 con 0x55b52ae471f0 2024-08-19T00:46:39.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.616+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v114'282 uv282 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae471f0 2024-08-19T00:46:39.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.616+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55920 con 0x55b52ae4a520 2024-08-19T00:46:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.617+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v114'120 uv119 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.618+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae55cc0 con 0x55b52ae4a520 2024-08-19T00:46:39.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.619+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v114'121 uv121 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.619+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae4a520 2024-08-19T00:46:39.622 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:39.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.620+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v114'122 uv122 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.620+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae4a520 2024-08-19T00:46:39.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.622+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v114'123 uv123 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.622+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae4a520 2024-08-19T00:46:39.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.624+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v114'165 uv164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.624+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae4a520 2024-08-19T00:46:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.625+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v114'166 uv166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.625+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae4a520 2024-08-19T00:46:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.627+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v114'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.629 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:39.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.627+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae57070 con 0x55b52ae4a520 2024-08-19T00:46:39.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.628+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v114'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.628+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae57070 con 0x55b52ae4a520 2024-08-19T00:46:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.630+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v114'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.630+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae4a520 2024-08-19T00:46:39.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.631+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v114'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cc0054b30 con 0x55b52ae4a520 2024-08-19T00:46:39.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.631+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.633+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v114'140 uv139 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.633+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.634+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v114'141 uv141 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.634+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.637 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:39.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.635+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v114'142 uv142 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.635+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.636+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v114'143 uv143 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.636+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.637+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v114'144 uv144 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.638+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.639+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v114'339 uv331 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.639+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.641+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v114'340 uv340 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.641+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.643 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.642+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v114'341 uv341 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.642+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.643+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v114'342 uv342 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.643+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.645+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v114'343 uv343 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.645+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.646+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v114'344 uv338 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.646+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.647+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v114'345 uv345 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.647+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.650 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.649+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v114'346 uv346 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.649+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.650+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v114'347 uv347 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.650+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae57070 con 0x55b52ae52520 2024-08-19T00:46:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.651+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v114'348 uv348 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.651+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56060 con 0x55b52ae52520 2024-08-19T00:46:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.653+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v114'349 uv349 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.653+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55b52ae56920 con 0x55b52ae52520 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8cbfe00640 1 -- 172.21.15.7:0/3221000976 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v114'350 uv350 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8cb002a040 con 0x55b52ae52520 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52ae42a50 msgr2=0x55b52ae44e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52ae42a50 0x55b52ae44e40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b52ae4ea70 msgr2=0x55b52ae51550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b52ae4ea70 0x55b52ae51550 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52ae52520 msgr2=0x55b52ae54930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52ae52520 0x55b52ae54930 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52ae471f0 msgr2=0x55b52ae495e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52ae471f0 0x55b52ae495e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52ae34cf0 msgr2=0x55b52ae350d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52ae34cf0 0x55b52ae350d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 reap_dead start 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b52ae4a520 msgr2=0x55b52ae4a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b52ae4a520 0x55b52ae4a940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8cc8200640 1 -- 172.21.15.7:0/3221000976 reap_dead start 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.654+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ca406a810 msgr2=0x7f8ca406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ca406a810 0x7f8ca406ccd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8057000 tx=0x7f8cb8062040 comp rx=0 tx=0).stop 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf9990 msgr2=0x55b52ad8f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf9990 0x55b52ad8f120 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000f690 tx=0x7f8cc000fb50 comp rx=0 tx=0).stop 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 shutdown_connections 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8ca406a810 0x7f8ca406ccd0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 --2- 172.21.15.7:0/3221000976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52acf9990 0x55b52ad8f120 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 >> 172.21.15.7:0/3221000976 conn(0x55b52acf64e0 msgr2=0x55b52ad97dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 shutdown_connections 2024-08-19T00:46:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.655+0000 7f8ccb20ef40 1 -- 172.21.15.7:0/3221000976 wait complete. 2024-08-19T00:46:39.661 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate mds0_inotable 0 2024-08-19T00:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.736+0000 7fdba4bedf40 1 Processor -- start 2024-08-19T00:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.736+0000 7fdba4bedf40 1 -- start start 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba4bedf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 0x55c6aa52a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba4bedf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa539b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba4bedf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa528fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba4bedf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c6aa4918f0 con 0x55c6aa4925b0 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba4bedf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c6aa406d00 con 0x55c6aa490f40 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba4bedf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c6aa537dc0 con 0x55c6aa492990 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa539b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa539b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58062/0 (socket says 172.21.15.7:58062) 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdb9be00640 1 -- 172.21.15.7:0/1645744055 learned_addr learned my addr 172.21.15.7:0/1645744055 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba2800640 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa528fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.737+0000 7fdba1e00640 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 0x55c6aa52a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdb9be00640 1 -- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 msgr2=0x55c6aa528fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdb9be00640 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa528fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdb9be00640 1 -- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 msgr2=0x55c6aa52a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdb9be00640 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 0x55c6aa52a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdb9be00640 1 -- 172.21.15.7:0/1645744055 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6aa38bb30 con 0x55c6aa4925b0 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdba2800640 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa528fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdb9be00640 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa539b20 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c001d90 tx=0x7fdb8c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ae2a8e06225fa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdba0a00640 1 -- 172.21.15.7:0/1645744055 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c012020 con 0x55c6aa4925b0 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdba0a00640 1 -- 172.21.15.7:0/1645744055 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8c00e670 con 0x55c6aa4925b0 2024-08-19T00:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.738+0000 7fdba0a00640 1 -- 172.21.15.7:0/1645744055 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00ea80 con 0x55c6aa4925b0 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1645744055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 msgr2=0x55c6aa539b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa539b20 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c001d90 tx=0x7fdb8c00b6c0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1645744055 shutdown_connections 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa528fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa539b20 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1645744055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 0x55c6aa52a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1645744055 >> 172.21.15.7:0/1645744055 conn(0x55c6aa48f4e0 msgr2=0x55c6aa4aa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1645744055 shutdown_connections 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.739+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1645744055 wait complete. 2024-08-19T00:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.740+0000 7fdba4bedf40 1 Processor -- start 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.740+0000 7fdba4bedf40 1 -- start start 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba4bedf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 0x55c6aa529540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba4bedf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa530120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba4bedf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa5363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba4bedf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c6aa48f960 con 0x55c6aa4925b0 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba4bedf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c6aa52a700 con 0x55c6aa490f40 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba4bedf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c6aa48fc40 con 0x55c6aa492990 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa530120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa530120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58078/0 (socket says 172.21.15.7:58078) 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 -- 172.21.15.7:0/1277228046 learned_addr learned my addr 172.21.15.7:0/1277228046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba2800640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa5363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdba1e00640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 0x55c6aa529540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 -- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 msgr2=0x55c6aa5363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c6aa492990 0x55c6aa5363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 -- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 msgr2=0x55c6aa529540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6aa490f40 0x55c6aa529540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.741+0000 7fdb9be00640 1 -- 172.21.15.7:0/1277228046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6aa3c8080 con 0x55c6aa4925b0 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.742+0000 7fdb9be00640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa530120 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c004170 tx=0x7fdb8c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.742+0000 7fdb9aa00640 1 -- 172.21.15.7:0/1277228046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00be90 con 0x55c6aa4925b0 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.742+0000 7fdb9aa00640 1 -- 172.21.15.7:0/1277228046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8c00e470 con 0x55c6aa4925b0 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.742+0000 7fdb9aa00640 1 -- 172.21.15.7:0/1277228046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c017870 con 0x55c6aa4925b0 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.742+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6aa531570 con 0x55c6aa4925b0 2024-08-19T00:46:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.742+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6aa5358e0 con 0x55c6aa4925b0 2024-08-19T00:46:39.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.744+0000 7fdb9aa00640 1 -- 172.21.15.7:0/1277228046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb8c015020 con 0x55c6aa4925b0 2024-08-19T00:46:39.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.745+0000 7fdb9aa00640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb8006a9b0 0x7fdb8006ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.745+0000 7fdb9aa00640 1 -- 172.21.15.7:0/1277228046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7fdb8c08bac0 con 0x55c6aa4925b0 2024-08-19T00:46:39.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.745+0000 7fdba1e00640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb8006a9b0 0x7fdb8006ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.745+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c6aa530660 0x55c6aa526520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.745+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x55c6aa536900 con 0x55c6aa530660 2024-08-19T00:46:39.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.746+0000 7fdba1e00640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb8006a9b0 0x7fdb8006ce70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55c6aa4ad1c0 tx=0x7fdb9400c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.746+0000 7fdba2800640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c6aa530660 0x55c6aa526520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.747+0000 7fdba2800640 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c6aa530660 0x55c6aa526520 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba2800640 1 -- 172.21.15.7:0/1277228046 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 mds0_inotable [truncate 0] v114'283 uv283 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdb9c052970 con 0x55c6aa530660 2024-08-19T00:46:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c6aa530660 msgr2=0x55c6aa526520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c6aa530660 0x55c6aa526520 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb8006a9b0 msgr2=0x7fdb8006ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdb8006a9b0 0x7fdb8006ce70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55c6aa4ad1c0 tx=0x7fdb9400c040 comp rx=0 tx=0).stop 2024-08-19T00:46:39.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 msgr2=0x55c6aa530120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 --2- 172.21.15.7:0/1277228046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6aa4925b0 0x55c6aa530120 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c004170 tx=0x7fdb8c000bc0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba2800640 1 -- 172.21.15.7:0/1277228046 reap_dead start 2024-08-19T00:46:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 shutdown_connections 2024-08-19T00:46:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 >> 172.21.15.7:0/1277228046 conn(0x55c6aa48f4e0 msgr2=0x55c6aa4905d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 shutdown_connections 2024-08-19T00:46:39.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.748+0000 7fdba4bedf40 1 -- 172.21.15.7:0/1277228046 wait complete. 2024-08-19T00:46:39.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.912+0000 7f1509600640 1 Processor -- start 2024-08-19T00:46:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.913+0000 7f1509600640 1 -- start start 2024-08-19T00:46:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f1509600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15040aed00 0x7f150406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f1509600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f150415e720 con 0x7f150406f720 2024-08-19T00:46:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f1509600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15040b3c00 con 0x7f15040b3620 2024-08-19T00:46:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f1509600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1504072450 con 0x7f15040aed00 2024-08-19T00:46:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f1502a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f15040aed00 0x7f150406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f14fa000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f150406f720 0x7f15040b2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35926/0 (socket says 172.21.15.7:35926) 2024-08-19T00:46:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f14fa000640 1 -- 172.21.15.7:0/763016619 learned_addr learned my addr 172.21.15.7:0/763016619 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.914+0000 7f1502a00640 1 -- 172.21.15.7:0/763016619 >> v1:172.21.15.162:6789/0 conn(0x7f15040b3620 legacy=0x7f15040acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.915+0000 7f1502a00640 1 -- 172.21.15.7:0/763016619 >> v1:172.21.15.7:6789/0 conn(0x7f150406f720 legacy=0x7f15040b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.915+0000 7f1502a00640 1 -- 172.21.15.7:0/763016619 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1504072730 con 0x7f15040aed00 2024-08-19T00:46:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.915+0000 7f1502000640 1 -- 172.21.15.7:0/763016619 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136156971 0 0) 0x7f14ec001110 con 0x7f150406f720 2024-08-19T00:46:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1502a00640 1 --2- 172.21.15.7:0/763016619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15040aed00 0x7f150406f0d0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097a0 tx=0x7f14f402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2b6f685c94752c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1502000640 1 -- 172.21.15.7:0/763016619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4037070 con 0x7f15040aed00 2024-08-19T00:46:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1502000640 1 -- 172.21.15.7:0/763016619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f402adc0 con 0x7f15040aed00 2024-08-19T00:46:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1502000640 1 -- 172.21.15.7:0/763016619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4032660 con 0x7f15040aed00 2024-08-19T00:46:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1509600640 1 -- 172.21.15.7:0/763016619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15040aed00 msgr2=0x7f150406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1509600640 1 --2- 172.21.15.7:0/763016619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15040aed00 0x7f150406f0d0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097a0 tx=0x7f14f402a0b0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1509600640 1 -- 172.21.15.7:0/763016619 shutdown_connections 2024-08-19T00:46:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1509600640 1 --2- 172.21.15.7:0/763016619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15040aed00 0x7f150406f0d0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.916+0000 7f1509600640 1 -- 172.21.15.7:0/763016619 >> 172.21.15.7:0/763016619 conn(0x7f15040b2300 msgr2=0x7f150406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.917+0000 7f1509600640 1 -- 172.21.15.7:0/763016619 shutdown_connections 2024-08-19T00:46:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.917+0000 7f1509600640 1 -- 172.21.15.7:0/763016619 wait complete. 2024-08-19T00:46:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.918+0000 7f1509600640 1 Processor -- start 2024-08-19T00:46:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.918+0000 7f1509600640 1 -- start start 2024-08-19T00:46:39.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1509600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f150406f720 0x7f15041f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1509600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040aed00 0x7f1504156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1509600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15040b3620 0x7f150415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1509600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15040ad600 con 0x7f150406f720 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1509600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1504072cf0 con 0x7f15040aed00 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1509600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15040ad780 con 0x7f15040b3620 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1502a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f150406f720 0x7f15041f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1502a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f150406f720 0x7f15041f83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58088/0 (socket says 172.21.15.7:58088) 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.919+0000 7f1502a00640 1 -- 172.21.15.7:0/4188500775 learned_addr learned my addr 172.21.15.7:0/4188500775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f14fa000640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040aed00 0x7f1504156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1503400640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15040b3620 0x7f150415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1502a00640 1 -- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15040b3620 msgr2=0x7f150415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1502a00640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15040b3620 0x7f150415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1502a00640 1 -- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040aed00 msgr2=0x7f1504156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1502a00640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040aed00 0x7f1504156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1502a00640 1 -- 172.21.15.7:0/4188500775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150415d6d0 con 0x7f150406f720 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f14fa000640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040aed00 0x7f1504156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1503400640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15040b3620 0x7f150415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1502a00640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f150406f720 0x7f15041f83f0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097a0 tx=0x7f14f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f14fb400640 1 -- 172.21.15.7:0/4188500775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4037040 con 0x7f150406f720 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f14fb400640 1 -- 172.21.15.7:0/4188500775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f4004250 con 0x7f150406f720 2024-08-19T00:46:39.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f14fb400640 1 -- 172.21.15.7:0/4188500775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4003610 con 0x7f150406f720 2024-08-19T00:46:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.920+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1504158e50 con 0x7f150406f720 2024-08-19T00:46:39.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.921+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15041f44f0 con 0x7f150406f720 2024-08-19T00:46:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.922+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15041f42f0 con 0x7f150406f720 2024-08-19T00:46:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.922+0000 7f14fb400640 1 -- 172.21.15.7:0/4188500775 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14f402ac40 con 0x7f150406f720 2024-08-19T00:46:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.923+0000 7f14fb400640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14e006be30 0x7f14e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.924+0000 7f14fb400640 1 -- 172.21.15.7:0/4188500775 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8117+0+0 (secure 0 0 0) 0x7f14f40ac730 con 0x7f150406f720 2024-08-19T00:46:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.924+0000 7f14fa000640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14e006be30 0x7f14e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:39.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.924+0000 7f14fa000640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14e006be30 0x7f14e006e2f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f15040b0770 tx=0x7f14ec007a10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:39.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:39.928+0000 7f14fb400640 1 -- 172.21.15.7:0/4188500775 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f14f407a6d0 con 0x7f150406f720 2024-08-19T00:46:40.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.152+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f150406f0d0 con 0x7f150406f720 2024-08-19T00:46:40.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.358+0000 7f14fb400640 1 -- 172.21.15.7:0/4188500775 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v254) ==== 162+0+0 (secure 0 0 0) 0x7f14f4079fd0 con 0x7f150406f720 2024-08-19T00:46:40.360 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.360+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14e006be30 msgr2=0x7f14e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.360+0000 7f1509600640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14e006be30 0x7f14e006e2f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f15040b0770 tx=0x7f14ec007a10 comp rx=0 tx=0).stop 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.360+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f150406f720 msgr2=0x7f15041f83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.360+0000 7f1509600640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f150406f720 0x7f15041f83f0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097a0 tx=0x7f14f40046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 shutdown_connections 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f14e006be30 0x7f14e006e2f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15040b3620 0x7f150415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040aed00 0x7f1504156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 --2- 172.21.15.7:0/4188500775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f150406f720 0x7f15041f83f0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 >> 172.21.15.7:0/4188500775 conn(0x7f15040b2300 msgr2=0x7f15040cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 shutdown_connections 2024-08-19T00:46:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.361+0000 7f1509600640 1 -- 172.21.15.7:0/4188500775 wait complete. 2024-08-19T00:46:40.368 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:46:40.367+0000 7fc84be00640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': End of buffer [buffer:2] 2024-08-19T00:46:40.369 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:40.367+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:40.369 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:40.367+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:40.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.538+0000 7f1c67200640 1 Processor -- start 2024-08-19T00:46:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.538+0000 7f1c67200640 1 -- start start 2024-08-19T00:46:40.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c67200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c60159830 0x7f1c6015cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c67200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1c6006cf70 0x7f1c600afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c67200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6015c420 con 0x7f1c600afa40 2024-08-19T00:46:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c67200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1c60072e80 con 0x7f1c60159830 2024-08-19T00:46:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c67200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1c60073160 con 0x7f1c6006cf70 2024-08-19T00:46:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c65e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c60159830 0x7f1c6015cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c65e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c60159830 0x7f1c6015cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58096/0 (socket says 172.21.15.7:58096) 2024-08-19T00:46:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c65e00640 1 -- 172.21.15.7:0/2322201536 learned_addr learned my addr 172.21.15.7:0/2322201536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c66800640 1 --2- 172.21.15.7:0/2322201536 >> v2:172.21.15.162:3300/0 conn(0x7f1c6006cf70 0x7f1c600afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c65e00640 1 -- 172.21.15.7:0/2322201536 >> v2:172.21.15.162:3300/0 conn(0x7f1c6006cf70 msgr2=0x7f1c600afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c65e00640 1 --2- 172.21.15.7:0/2322201536 >> v2:172.21.15.162:3300/0 conn(0x7f1c6006cf70 0x7f1c600afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c65e00640 1 -- 172.21.15.7:0/2322201536 >> v1:172.21.15.162:6789/0 conn(0x7f1c600afa40 legacy=0x7f1c6006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.540+0000 7f1c65e00640 1 -- 172.21.15.7:0/2322201536 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6015c6a0 con 0x7f1c60159830 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.541+0000 7f1c66800640 1 --2- 172.21.15.7:0/2322201536 >> v2:172.21.15.162:3300/0 conn(0x7f1c6006cf70 0x7f1c600afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c65e00640 1 --2- 172.21.15.7:0/2322201536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c60159830 0x7f1c6015cea0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f1c600ce8e0 tx=0x7f1c5402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352cb554bfb7a36a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c64a00640 1 -- 172.21.15.7:0/2322201536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c54037070 con 0x7f1c60159830 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c64a00640 1 -- 172.21.15.7:0/2322201536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c54032440 con 0x7f1c60159830 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c64a00640 1 -- 172.21.15.7:0/2322201536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c54032810 con 0x7f1c60159830 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c67200640 1 -- 172.21.15.7:0/2322201536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c60159830 msgr2=0x7f1c6015cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c67200640 1 --2- 172.21.15.7:0/2322201536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c60159830 0x7f1c6015cea0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f1c600ce8e0 tx=0x7f1c5402a230 comp rx=0 tx=0).stop 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c67200640 1 -- 172.21.15.7:0/2322201536 shutdown_connections 2024-08-19T00:46:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c67200640 1 --2- 172.21.15.7:0/2322201536 >> v2:172.21.15.162:3300/0 conn(0x7f1c6006cf70 0x7f1c600afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c67200640 1 --2- 172.21.15.7:0/2322201536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c60159830 0x7f1c6015cea0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.542+0000 7f1c67200640 1 -- 172.21.15.7:0/2322201536 >> 172.21.15.7:0/2322201536 conn(0x7f1c60072020 msgr2=0x7f1c60072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.543+0000 7f1c67200640 1 -- 172.21.15.7:0/2322201536 shutdown_connections 2024-08-19T00:46:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.543+0000 7f1c67200640 1 -- 172.21.15.7:0/2322201536 wait complete. 2024-08-19T00:46:40.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.544+0000 7f1c67200640 1 Processor -- start 2024-08-19T00:46:40.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.544+0000 7f1c67200640 1 -- start start 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c67200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c6006cf70 0x7f1c601490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c67200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c600afa40 0x7f1c600b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c67200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c60159830 0x7f1c601566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c67200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60159c10 con 0x7f1c600afa40 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c67200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60072b10 con 0x7f1c60159830 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c67200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1c60159d90 con 0x7f1c6006cf70 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c65400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c600afa40 0x7f1c600b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c65e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c6006cf70 0x7f1c601490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c65400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c600afa40 0x7f1c600b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58110/0 (socket says 172.21.15.7:58110) 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.545+0000 7f1c65400640 1 -- 172.21.15.7:0/3268134678 learned_addr learned my addr 172.21.15.7:0/3268134678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c66800640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c60159830 0x7f1c601566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c65400640 1 -- 172.21.15.7:0/3268134678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c6006cf70 msgr2=0x7f1c601490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c65400640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c6006cf70 0x7f1c601490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c65400640 1 -- 172.21.15.7:0/3268134678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c60159830 msgr2=0x7f1c601566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c65400640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c60159830 0x7f1c601566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c65400640 1 -- 172.21.15.7:0/3268134678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c600b5150 con 0x7f1c600afa40 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c65400640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c600afa40 0x7f1c600b47e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c430 tx=0x7f1c5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c5a000640 1 -- 172.21.15.7:0/3268134678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50011790 con 0x7f1c600afa40 2024-08-19T00:46:40.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c5a000640 1 -- 172.21.15.7:0/3268134678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c50017070 con 0x7f1c600afa40 2024-08-19T00:46:40.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.546+0000 7f1c5a000640 1 -- 172.21.15.7:0/3268134678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50011bb0 con 0x7f1c600afa40 2024-08-19T00:46:40.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.547+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c600b5430 con 0x7f1c600afa40 2024-08-19T00:46:40.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.547+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6015d080 con 0x7f1c600afa40 2024-08-19T00:46:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.548+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c600afeb0 con 0x7f1c600afa40 2024-08-19T00:46:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.549+0000 7f1c5a000640 1 -- 172.21.15.7:0/3268134678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c5001c460 con 0x7f1c600afa40 2024-08-19T00:46:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.550+0000 7f1c5a000640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1c4406be30 0x7f1c4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.550+0000 7f1c5a000640 1 -- 172.21.15.7:0/3268134678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7f1c5008b670 con 0x7f1c600afa40 2024-08-19T00:46:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.550+0000 7f1c65e00640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1c4406be30 0x7f1c4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.551+0000 7f1c65e00640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1c4406be30 0x7f1c4406e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1c54034000 tx=0x7f1c5402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.554+0000 7f1c5a000640 1 -- 172.21.15.7:0/3268134678 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1c50058f60 con 0x7f1c600afa40 2024-08-19T00:46:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.772+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c600709e0 con 0x7f1c600afa40 2024-08-19T00:46:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.773+0000 7f1c5a000640 1 -- 172.21.15.7:0/3268134678 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 256 v256) ==== 95+0+3570 (secure 0 0 0) 0x7f1c5005d260 con 0x7f1c600afa40 2024-08-19T00:46:40.775 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:40.775 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":256,"btime":"2024-08-19T00:46:40:368319+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":256,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:40.368260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 256 2024-08-19T00:46:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1c4406be30 msgr2=0x7f1c4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1c4406be30 0x7f1c4406e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1c54034000 tx=0x7f1c5402e000 comp rx=0 tx=0).stop 2024-08-19T00:46:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c600afa40 msgr2=0x7f1c600b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c600afa40 0x7f1c600b47e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c430 tx=0x7f1c5000c8f0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 shutdown_connections 2024-08-19T00:46:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1c4406be30 0x7f1c4406e2f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c60159830 0x7f1c601566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c600afa40 0x7f1c600b47e0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 --2- 172.21.15.7:0/3268134678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c6006cf70 0x7f1c601490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 >> 172.21.15.7:0/3268134678 conn(0x7f1c60072020 msgr2=0x7f1c600aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 shutdown_connections 2024-08-19T00:46:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.775+0000 7f1c67200640 1 -- 172.21.15.7:0/3268134678 wait complete. 2024-08-19T00:46:40.793 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:40.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.949+0000 7f66e0400640 1 Processor -- start 2024-08-19T00:46:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.949+0000 7f66e0400640 1 -- start start 2024-08-19T00:46:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.951+0000 7f66e0400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d8071980 0x7f66d80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.951+0000 7f66e0400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d80cdfb0 con 0x7f66d806e710 2024-08-19T00:46:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.951+0000 7f66e0400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d80ce290 con 0x7f66d80d03c0 2024-08-19T00:46:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.951+0000 7f66e0400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66d80cebc0 con 0x7f66d8071980 2024-08-19T00:46:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.952+0000 7f66dda00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f66d80d03c0 0x7f66d80d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:60992/0 (socket says 172.21.15.7:60992) 2024-08-19T00:46:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.952+0000 7f66dda00640 1 -- 172.21.15.7:0/311002272 learned_addr learned my addr 172.21.15.7:0/311002272 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.952+0000 7f66de400640 1 --2- 172.21.15.7:0/311002272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d8071980 0x7f66d80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.952+0000 7f66d7e00640 1 -- 172.21.15.7:0/311002272 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438979113 0 0) 0x7f66d80ce290 con 0x7f66d80d03c0 2024-08-19T00:46:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.952+0000 7f66de400640 1 -- 172.21.15.7:0/311002272 >> v1:172.21.15.162:6789/0 conn(0x7f66d80d03c0 legacy=0x7f66d80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.952+0000 7f66de400640 1 -- 172.21.15.7:0/311002272 >> v1:172.21.15.7:6789/0 conn(0x7f66d806e710 legacy=0x7f66d80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.952+0000 7f66de400640 1 -- 172.21.15.7:0/311002272 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d80ce570 con 0x7f66d8071980 2024-08-19T00:46:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.954+0000 7f66de400640 1 --2- 172.21.15.7:0/311002272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d8071980 0x7f66d80cf050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009df0 tx=0x7f66d002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dde15f4276f8b00 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.954+0000 7f66d7e00640 1 -- 172.21.15.7:0/311002272 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0007740 con 0x7f66d8071980 2024-08-19T00:46:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.954+0000 7f66d7e00640 1 -- 172.21.15.7:0/311002272 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d00078e0 con 0x7f66d8071980 2024-08-19T00:46:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.954+0000 7f66d7e00640 1 -- 172.21.15.7:0/311002272 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0007cb0 con 0x7f66d8071980 2024-08-19T00:46:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.955+0000 7f66e0400640 1 -- 172.21.15.7:0/311002272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d8071980 msgr2=0x7f66d80cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.955+0000 7f66e0400640 1 --2- 172.21.15.7:0/311002272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d8071980 0x7f66d80cf050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009df0 tx=0x7f66d002a710 comp rx=0 tx=0).stop 2024-08-19T00:46:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.955+0000 7f66e0400640 1 -- 172.21.15.7:0/311002272 shutdown_connections 2024-08-19T00:46:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.955+0000 7f66e0400640 1 --2- 172.21.15.7:0/311002272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d8071980 0x7f66d80cf050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.955+0000 7f66e0400640 1 -- 172.21.15.7:0/311002272 >> 172.21.15.7:0/311002272 conn(0x7f66d806bc70 msgr2=0x7f66d806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.955+0000 7f66e0400640 1 -- 172.21.15.7:0/311002272 shutdown_connections 2024-08-19T00:46:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.955+0000 7f66e0400640 1 -- 172.21.15.7:0/311002272 wait complete. 2024-08-19T00:46:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.957+0000 7f66e0400640 1 Processor -- start 2024-08-19T00:46:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.957+0000 7f66e0400640 1 -- start start 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66e0400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d806e710 0x7f66d8099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66e0400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d8071980 0x7f66d814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66e0400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66d80d03c0 0x7f66d814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66e0400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66d8073c60 con 0x7f66d8071980 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66e0400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66d8073ae0 con 0x7f66d80d03c0 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66e0400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66d80cf590 con 0x7f66d806e710 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d8071980 0x7f66d814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d8071980 0x7f66d814fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58112/0 (socket says 172.21.15.7:58112) 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 -- 172.21.15.7:0/3492428643 learned_addr learned my addr 172.21.15.7:0/3492428643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dda00640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d806e710 0x7f66d8099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66de400640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66d80d03c0 0x7f66d814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 -- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d806e710 msgr2=0x7f66d8099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d806e710 0x7f66d8099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 -- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66d80d03c0 msgr2=0x7f66d814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66d80d03c0 0x7f66d814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.958+0000 7f66dd000640 1 -- 172.21.15.7:0/3492428643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d814eae0 con 0x7f66d8071980 2024-08-19T00:46:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.959+0000 7f66dd000640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d8071980 0x7f66d814fbc0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c400 tx=0x7f66c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.959+0000 7f66d5600640 1 -- 172.21.15.7:0/3492428643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4017070 con 0x7f66d8071980 2024-08-19T00:46:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.959+0000 7f66d5600640 1 -- 172.21.15.7:0/3492428643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c40052d0 con 0x7f66d8071980 2024-08-19T00:46:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.959+0000 7f66d5600640 1 -- 172.21.15.7:0/3492428643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4003830 con 0x7f66d8071980 2024-08-19T00:46:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.959+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d815e5c0 con 0x7f66d8071980 2024-08-19T00:46:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.959+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d815dae0 con 0x7f66d8071980 2024-08-19T00:46:40.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.960+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d80af910 con 0x7f66d8071980 2024-08-19T00:46:40.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.961+0000 7f66d5600640 1 -- 172.21.15.7:0/3492428643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66c401a070 con 0x7f66d8071980 2024-08-19T00:46:40.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.962+0000 7f66d5600640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.962+0000 7f66d5600640 1 -- 172.21.15.7:0/3492428643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7f66c408ab30 con 0x7f66d8071980 2024-08-19T00:46:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.962+0000 7f66dda00640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.963+0000 7f66dda00640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66b806be30 0x7f66b806e2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f66cc007f70 tx=0x7f66cc007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:40.967+0000 7f66d5600640 1 -- 172.21.15.7:0/3492428643 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f66d80af910 con 0x7f66d8071980 2024-08-19T00:46:41.101 INFO:tasks.ceph.mds.a.smithi007.stderr: -46> 2024-08-19T00:46:36.345+0000 7f339ac00640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': End of buffer [buffer:2] 2024-08-19T00:46:41.140 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:46:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.193+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66d80cf030 con 0x7f66d8071980 2024-08-19T00:46:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.193+0000 7f66d5600640 1 -- 172.21.15.7:0/3492428643 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 256 v256) ==== 95+0+3570 (secure 0 0 0) 0x7f66c40584b0 con 0x7f66d8071980 2024-08-19T00:46:41.195 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:41.196 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":256,"btime":"2024-08-19T00:46:40:368319+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":256,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:40.368260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 256 2024-08-19T00:46:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66b806be30 msgr2=0x7f66b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66b806be30 0x7f66b806e2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f66cc007f70 tx=0x7f66cc007f00 comp rx=0 tx=0).stop 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d8071980 msgr2=0x7f66d814fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d8071980 0x7f66d814fbc0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c400 tx=0x7f66c400c8c0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 shutdown_connections 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66d80d03c0 0x7f66d814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d8071980 0x7f66d814fbc0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 --2- 172.21.15.7:0/3492428643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66d806e710 0x7f66d8099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.195+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 >> 172.21.15.7:0/3492428643 conn(0x7f66d806bc70 msgr2=0x7f66d80b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.196+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 shutdown_connections 2024-08-19T00:46:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.196+0000 7f66e0400640 1 -- 172.21.15.7:0/3492428643 wait complete. 2024-08-19T00:46:41.213 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:41.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.371+0000 7f6c28e00640 1 Processor -- start 2024-08-19T00:46:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.371+0000 7f6c28e00640 1 -- start start 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.372+0000 7f6c28e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c24161960 0x7f6c240ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.372+0000 7f6c28e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c240cf2b0 0x7f6c240cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.372+0000 7f6c28e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c240d0910 0x7f6c240d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.372+0000 7f6c28e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6c240b7150 con 0x7f6c240d0910 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.372+0000 7f6c28e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6c240d28c0 con 0x7f6c24161960 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.372+0000 7f6c28e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c240d2ba0 con 0x7f6c240cf2b0 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c240d0910 0x7f6c240d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c240d0910 0x7f6c240d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58138/0 (socket says 172.21.15.7:58138) 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 -- 172.21.15.7:0/2789127892 learned_addr learned my addr 172.21.15.7:0/2789127892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c22a00640 1 --2- 172.21.15.7:0/2789127892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c240cf2b0 0x7f6c240cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23400640 1 --2- 172.21.15.7:0/2789127892 >> v2:172.21.15.162:3300/0 conn(0x7f6c24161960 0x7f6c240ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 -- 172.21.15.7:0/2789127892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c240cf2b0 msgr2=0x7f6c240cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 --2- 172.21.15.7:0/2789127892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c240cf2b0 0x7f6c240cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 -- 172.21.15.7:0/2789127892 >> v2:172.21.15.162:3300/0 conn(0x7f6c24161960 msgr2=0x7f6c240ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 --2- 172.21.15.7:0/2789127892 >> v2:172.21.15.162:3300/0 conn(0x7f6c24161960 0x7f6c240ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.373+0000 7f6c23e00640 1 -- 172.21.15.7:0/2789127892 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c240d2e80 con 0x7f6c240d0910 2024-08-19T00:46:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.374+0000 7f6c23e00640 1 --2- 172.21.15.7:0/2789127892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240d0dc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f6c2408de50 tx=0x7f6c1c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde94c1ac765a764 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c22000640 1 -- 172.21.15.7:0/2789127892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c036070 con 0x7f6c240d0910 2024-08-19T00:46:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c22000640 1 -- 172.21.15.7:0/2789127892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1c031600 con 0x7f6c240d0910 2024-08-19T00:46:41.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c22000640 1 -- 172.21.15.7:0/2789127892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0319d0 con 0x7f6c240d0910 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c28e00640 1 -- 172.21.15.7:0/2789127892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 msgr2=0x7f6c240d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c28e00640 1 --2- 172.21.15.7:0/2789127892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240d0dc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f6c2408de50 tx=0x7f6c1c02a730 comp rx=0 tx=0).stop 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c28e00640 1 -- 172.21.15.7:0/2789127892 shutdown_connections 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c28e00640 1 --2- 172.21.15.7:0/2789127892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240d0dc0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c28e00640 1 --2- 172.21.15.7:0/2789127892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c240cf2b0 0x7f6c240cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c28e00640 1 --2- 172.21.15.7:0/2789127892 >> v2:172.21.15.162:3300/0 conn(0x7f6c24161960 0x7f6c240ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.375+0000 7f6c28e00640 1 -- 172.21.15.7:0/2789127892 >> 172.21.15.7:0/2789127892 conn(0x7f6c2409d500 msgr2=0x7f6c240d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.376+0000 7f6c28e00640 1 -- 172.21.15.7:0/2789127892 shutdown_connections 2024-08-19T00:46:41.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.376+0000 7f6c28e00640 1 -- 172.21.15.7:0/2789127892 wait complete. 2024-08-19T00:46:41.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.378+0000 7f6c28e00640 1 Processor -- start 2024-08-19T00:46:41.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.378+0000 7f6c28e00640 1 -- start start 2024-08-19T00:46:41.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c28e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c240cf2b0 0x7f6c240a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c28e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c28e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c24161960 0x7f6c240cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c28e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240d4cb0 con 0x7f6c240d0910 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c28e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240d3160 con 0x7f6c240cf2b0 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c28e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c240d4e30 con 0x7f6c24161960 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58154/0 (socket says 172.21.15.7:58154) 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 -- 172.21.15.7:0/404965136 learned_addr learned my addr 172.21.15.7:0/404965136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c23400640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c240cf2b0 0x7f6c240a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c23e00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c24161960 0x7f6c240cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 -- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c24161960 msgr2=0x7f6c240cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c24161960 0x7f6c240cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 -- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c240cf2b0 msgr2=0x7f6c240a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c240cf2b0 0x7f6c240a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c22a00640 1 -- 172.21.15.7:0/404965136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2409e0a0 con 0x7f6c240d0910 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.379+0000 7f6c23400640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c240cf2b0 0x7f6c240a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.380+0000 7f6c22a00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240cb2a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e890 tx=0x7f6c1000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.380+0000 7f6c1b400640 1 -- 172.21.15.7:0/404965136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10017070 con 0x7f6c240d0910 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.380+0000 7f6c1b400640 1 -- 172.21.15.7:0/404965136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1000c940 con 0x7f6c240d0910 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.380+0000 7f6c1b400640 1 -- 172.21.15.7:0/404965136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000cd10 con 0x7f6c240d0910 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.380+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2409e380 con 0x7f6c240d0910 2024-08-19T00:46:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.380+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2409e940 con 0x7f6c240d0910 2024-08-19T00:46:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.381+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c24161d40 con 0x7f6c240d0910 2024-08-19T00:46:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.382+0000 7f6c1b400640 1 -- 172.21.15.7:0/404965136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c1001a070 con 0x7f6c240d0910 2024-08-19T00:46:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.383+0000 7f6c1b400640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c0406be30 0x7f6c0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.383+0000 7f6c1b400640 1 -- 172.21.15.7:0/404965136 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7f6c1008bb70 con 0x7f6c240d0910 2024-08-19T00:46:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.383+0000 7f6c23400640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c0406be30 0x7f6c0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.384+0000 7f6c23400640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c0406be30 0x7f6c0406e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009af0 tx=0x7f6c14008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.387+0000 7f6c1b400640 1 -- 172.21.15.7:0/404965136 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6c10059b40 con 0x7f6c240d0910 2024-08-19T00:46:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.607+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c240b9cd0 con 0x7f6c240d0910 2024-08-19T00:46:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.608+0000 7f6c1b400640 1 -- 172.21.15.7:0/404965136 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 257 v257) ==== 95+0+4390 (secure 0 0 0) 0x7f6c10059440 con 0x7f6c240d0910 2024-08-19T00:46:41.610 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:41.610 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":257,"btime":"2024-08-19T00:46:41:369962+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/300508336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":300508336},{"type":"v1","addr":"172.21.15.7:6837","nonce":300508336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":257}],"filesystems":[{"mdsmap":{"epoch":256,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:40.368260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:41.610 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 257 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c0406be30 msgr2=0x7f6c0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c0406be30 0x7f6c0406e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009af0 tx=0x7f6c14008040 comp rx=0 tx=0).stop 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 msgr2=0x7f6c240cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240cb2a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e890 tx=0x7f6c1000ed50 comp rx=0 tx=0).stop 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 shutdown_connections 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c0406be30 0x7f6c0406e2f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c24161960 0x7f6c240cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c240d0910 0x7f6c240cb2a0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 --2- 172.21.15.7:0/404965136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c240cf2b0 0x7f6c240a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 >> 172.21.15.7:0/404965136 conn(0x7f6c2409d500 msgr2=0x7f6c240b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:41.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 shutdown_connections 2024-08-19T00:46:41.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.610+0000 7f6c28e00640 1 -- 172.21.15.7:0/404965136 wait complete. 2024-08-19T00:46:41.629 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate mds0_inotable' led to DAMAGED state 2024-08-19T00:46:41.629 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 400.00000000' 2024-08-19T00:46:41.629 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:41.629 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:41.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:41.665 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:41.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:41.665 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:41.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:41.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.938+0000 7f332d800640 1 Processor -- start 2024-08-19T00:46:41.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.938+0000 7f332d800640 1 -- start start 2024-08-19T00:46:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.939+0000 7f332d800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f332806e710 0x7f3328071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.939+0000 7f332d800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33280cdfb0 con 0x7f33280b3750 2024-08-19T00:46:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.939+0000 7f332d800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33280ce290 con 0x7f33280d03c0 2024-08-19T00:46:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.939+0000 7f332d800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f33280cebc0 con 0x7f332806e710 2024-08-19T00:46:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.939+0000 7f331fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f332806e710 0x7f3328071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.939+0000 7f331fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f332806e710 0x7f3328071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58166/0 (socket says 172.21.15.7:58166) 2024-08-19T00:46:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.940+0000 7f331fe00640 1 -- 172.21.15.7:0/1435794449 learned_addr learned my addr 172.21.15.7:0/1435794449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.940+0000 7f331fe00640 1 -- 172.21.15.7:0/1435794449 >> v1:172.21.15.162:6789/0 conn(0x7f33280d03c0 legacy=0x7f33280d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.940+0000 7f331fe00640 1 -- 172.21.15.7:0/1435794449 >> v1:172.21.15.7:6789/0 conn(0x7f33280b3750 legacy=0x7f33280cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.940+0000 7f331fe00640 1 -- 172.21.15.7:0/1435794449 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33280ce570 con 0x7f332806e710 2024-08-19T00:46:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.941+0000 7f331fe00640 1 --2- 172.21.15.7:0/1435794449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332806e710 0x7f3328071980 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f33100098a0 tx=0x7f331002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665b6f9e608d8d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.941+0000 7f3326000640 1 -- 172.21.15.7:0/1435794449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310037070 con 0x7f332806e710 2024-08-19T00:46:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.941+0000 7f3326000640 1 -- 172.21.15.7:0/1435794449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3310032640 con 0x7f332806e710 2024-08-19T00:46:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.941+0000 7f3326000640 1 -- 172.21.15.7:0/1435794449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310032a10 con 0x7f332806e710 2024-08-19T00:46:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.942+0000 7f332d800640 1 -- 172.21.15.7:0/1435794449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332806e710 msgr2=0x7f3328071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.942+0000 7f332d800640 1 --2- 172.21.15.7:0/1435794449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332806e710 0x7f3328071980 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f33100098a0 tx=0x7f331002a330 comp rx=0 tx=0).stop 2024-08-19T00:46:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.942+0000 7f332d800640 1 -- 172.21.15.7:0/1435794449 shutdown_connections 2024-08-19T00:46:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.942+0000 7f332d800640 1 --2- 172.21.15.7:0/1435794449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332806e710 0x7f3328071980 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.942+0000 7f332d800640 1 -- 172.21.15.7:0/1435794449 >> 172.21.15.7:0/1435794449 conn(0x7f332806bc70 msgr2=0x7f332806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.942+0000 7f332d800640 1 -- 172.21.15.7:0/1435794449 shutdown_connections 2024-08-19T00:46:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.942+0000 7f332d800640 1 -- 172.21.15.7:0/1435794449 wait complete. 2024-08-19T00:46:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.944+0000 7f332d800640 1 Processor -- start 2024-08-19T00:46:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.944+0000 7f332d800640 1 -- start start 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f332d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f332806e710 0x7f3328153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f332d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33280b3750 0x7f33280c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f332d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33280d03c0 0x7f33280b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f332d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3328073c60 con 0x7f33280d03c0 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f332d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3328073ae0 con 0x7f33280b3750 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f332d800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33280b3be0 con 0x7f332806e710 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33280d03c0 0x7f33280b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33280d03c0 0x7f33280b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58180/0 (socket says 172.21.15.7:58180) 2024-08-19T00:46:41.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 -- 172.21.15.7:0/3669734460 learned_addr learned my addr 172.21.15.7:0/3669734460 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f331fe00640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33280b3750 0x7f33280c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3326a00640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f332806e710 0x7f3328153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 -- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f332806e710 msgr2=0x7f3328153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f332806e710 0x7f3328153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 -- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33280b3750 msgr2=0x7f33280c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33280b3750 0x7f33280c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.945+0000 7f3327400640 1 -- 172.21.15.7:0/3669734460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33280ad4b0 con 0x7f33280d03c0 2024-08-19T00:46:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.946+0000 7f3327400640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33280d03c0 0x7f33280b1e70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f332000c7a0 tx=0x7f332000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.946+0000 7f331ea00640 1 -- 172.21.15.7:0/3669734460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320003b70 con 0x7f33280d03c0 2024-08-19T00:46:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.946+0000 7f331ea00640 1 -- 172.21.15.7:0/3669734460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320003d30 con 0x7f33280d03c0 2024-08-19T00:46:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.946+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33280ad790 con 0x7f33280d03c0 2024-08-19T00:46:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.946+0000 7f331ea00640 1 -- 172.21.15.7:0/3669734460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332000aa90 con 0x7f33280d03c0 2024-08-19T00:46:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.946+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33280add50 con 0x7f33280d03c0 2024-08-19T00:46:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.947+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332806ef90 con 0x7f33280d03c0 2024-08-19T00:46:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.948+0000 7f331ea00640 1 -- 172.21.15.7:0/3669734460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f332000ac30 con 0x7f33280d03c0 2024-08-19T00:46:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.949+0000 7f331ea00640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f330406be30 0x7f330406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.949+0000 7f331ea00640 1 -- 172.21.15.7:0/3669734460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7f332008b790 con 0x7f33280d03c0 2024-08-19T00:46:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.949+0000 7f3326a00640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f330406be30 0x7f330406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.950+0000 7f3326a00640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f330406be30 0x7f330406e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3318000f60 tx=0x7f3318009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:41.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:41.953+0000 7f331ea00640 1 -- 172.21.15.7:0/3669734460 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f332806ef90 con 0x7f33280d03c0 2024-08-19T00:46:42.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.172+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f332815a7e0 con 0x7f33280d03c0 2024-08-19T00:46:42.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.376+0000 7f331ea00640 1 -- 172.21.15.7:0/3669734460 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v258) ==== 161+0+0 (secure 0 0 0) 0x7f33200596d0 con 0x7f33280d03c0 2024-08-19T00:46:42.378 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f330406be30 msgr2=0x7f330406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f330406be30 0x7f330406e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3318000f60 tx=0x7f3318009040 comp rx=0 tx=0).stop 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33280d03c0 msgr2=0x7f33280b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33280d03c0 0x7f33280b1e70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f332000c7a0 tx=0x7f332000cc60 comp rx=0 tx=0).stop 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 shutdown_connections 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f330406be30 0x7f330406e2f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33280d03c0 0x7f33280b1e70 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33280b3750 0x7f33280c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 --2- 172.21.15.7:0/3669734460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f332806e710 0x7f3328153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 >> 172.21.15.7:0/3669734460 conn(0x7f332806bc70 msgr2=0x7f33280af400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 shutdown_connections 2024-08-19T00:46:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.379+0000 7f332d800640 1 -- 172.21.15.7:0/3669734460 wait complete. 2024-08-19T00:46:42.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:42.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.554+0000 7f5ddc800640 1 Processor -- start 2024-08-19T00:46:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.554+0000 7f5ddc800640 1 -- start start 2024-08-19T00:46:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5ddc800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5dd4159bf0 0x7f5dd4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5ddc800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd40739a0 0x7f5dd40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5ddc800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd406f7f0 con 0x7f5dd40cea40 2024-08-19T00:46:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5ddc800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd406f510 con 0x7f5dd4159bf0 2024-08-19T00:46:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5ddc800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd4072980 con 0x7f5dd40739a0 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5dd9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5dd4159bf0 0x7f5dd4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5dd9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5dd4159bf0 0x7f5dd4073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58190/0 (socket says 172.21.15.7:58190) 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5dd9e00640 1 -- 172.21.15.7:0/2594900812 learned_addr learned my addr 172.21.15.7:0/2594900812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5dd9400640 1 --2- 172.21.15.7:0/2594900812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd40739a0 0x7f5dd40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5dd9e00640 1 -- 172.21.15.7:0/2594900812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd40739a0 msgr2=0x7f5dd40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5dd9e00640 1 --2- 172.21.15.7:0/2594900812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd40739a0 0x7f5dd40ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.555+0000 7f5dd9e00640 1 -- 172.21.15.7:0/2594900812 >> v1:172.21.15.162:6789/0 conn(0x7f5dd40cea40 legacy=0x7f5dd40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.556+0000 7f5dd9e00640 1 -- 172.21.15.7:0/2594900812 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd4072c60 con 0x7f5dd4159bf0 2024-08-19T00:46:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.556+0000 7f5dd9400640 1 --2- 172.21.15.7:0/2594900812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd40739a0 0x7f5dd40ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5dd9e00640 1 --2- 172.21.15.7:0/2594900812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd4159bf0 0x7f5dd4073460 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009870 tx=0x7f5dc802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52d1590b114da12 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5dd8a00640 1 -- 172.21.15.7:0/2594900812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8037070 con 0x7f5dd4159bf0 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5dd8a00640 1 -- 172.21.15.7:0/2594900812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc8032440 con 0x7f5dd4159bf0 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5dd8a00640 1 -- 172.21.15.7:0/2594900812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8032810 con 0x7f5dd4159bf0 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5ddc800640 1 -- 172.21.15.7:0/2594900812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd4159bf0 msgr2=0x7f5dd4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5ddc800640 1 --2- 172.21.15.7:0/2594900812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd4159bf0 0x7f5dd4073460 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009870 tx=0x7f5dc802a180 comp rx=0 tx=0).stop 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5ddc800640 1 -- 172.21.15.7:0/2594900812 shutdown_connections 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5ddc800640 1 --2- 172.21.15.7:0/2594900812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd40739a0 0x7f5dd40ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5ddc800640 1 --2- 172.21.15.7:0/2594900812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd4159bf0 0x7f5dd4073460 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.557+0000 7f5ddc800640 1 -- 172.21.15.7:0/2594900812 >> 172.21.15.7:0/2594900812 conn(0x7f5dd406bc70 msgr2=0x7f5dd406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.558+0000 7f5ddc800640 1 -- 172.21.15.7:0/2594900812 shutdown_connections 2024-08-19T00:46:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.558+0000 7f5ddc800640 1 -- 172.21.15.7:0/2594900812 wait complete. 2024-08-19T00:46:42.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.559+0000 7f5ddc800640 1 Processor -- start 2024-08-19T00:46:42.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.559+0000 7f5ddc800640 1 -- start start 2024-08-19T00:46:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5ddc800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd40739a0 0x7f5dd41f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5ddc800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dd40cea40 0x7f5dd409c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5ddc800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd4159bf0 0x7f5dd40b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5ddc800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd415a150 con 0x7f5dd40739a0 2024-08-19T00:46:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5ddc800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4159fd0 con 0x7f5dd40cea40 2024-08-19T00:46:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5ddc800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd40d0ad0 con 0x7f5dd4159bf0 2024-08-19T00:46:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5dd9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd40739a0 0x7f5dd41f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5dd9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd40739a0 0x7f5dd41f6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58202/0 (socket says 172.21.15.7:58202) 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.560+0000 7f5dd9e00640 1 -- 172.21.15.7:0/3300551026 learned_addr learned my addr 172.21.15.7:0/3300551026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dd9400640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dd40cea40 0x7f5dd409c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dda800640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd4159bf0 0x7f5dd40b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dd9e00640 1 -- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd4159bf0 msgr2=0x7f5dd40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dd9e00640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd4159bf0 0x7f5dd40b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dd9e00640 1 -- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dd40cea40 msgr2=0x7f5dd409c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dd9e00640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dd40cea40 0x7f5dd409c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dd9e00640 1 -- 172.21.15.7:0/3300551026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd409ccc0 con 0x7f5dd40739a0 2024-08-19T00:46:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dd9e00640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd40739a0 0x7f5dd41f6430 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8000c00 tx=0x7f5dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dce000640 1 -- 172.21.15.7:0/3300551026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8037040 con 0x7f5dd40739a0 2024-08-19T00:46:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dce000640 1 -- 172.21.15.7:0/3300551026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc8042070 con 0x7f5dd40739a0 2024-08-19T00:46:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5dce000640 1 -- 172.21.15.7:0/3300551026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8030bb0 con 0x7f5dd40739a0 2024-08-19T00:46:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.561+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd409cf60 con 0x7f5dd40739a0 2024-08-19T00:46:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.562+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd409d520 con 0x7f5dd40739a0 2024-08-19T00:46:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.563+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd40ce500 con 0x7f5dd40739a0 2024-08-19T00:46:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.564+0000 7f5dce000640 1 -- 172.21.15.7:0/3300551026 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dc8047460 con 0x7f5dd40739a0 2024-08-19T00:46:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.564+0000 7f5dce000640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.565+0000 7f5dce000640 1 -- 172.21.15.7:0/3300551026 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7f5dc80ac4d0 con 0x7f5dd40739a0 2024-08-19T00:46:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.565+0000 7f5dd9400640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.565+0000 7f5dd9400640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5db806be30 0x7f5db806e2f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5dd415c890 tx=0x7f5dc4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:42.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.569+0000 7f5dce000640 1 -- 172.21.15.7:0/3300551026 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5dc807a470 con 0x7f5dd40739a0 2024-08-19T00:46:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:42.826+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f5dd4160b60 con 0x7f5dd40739a0 2024-08-19T00:46:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.382+0000 7f5dce000640 1 -- 172.21.15.7:0/3300551026 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v259) ==== 101+0+0 (secure 0 0 0) 0x7f5dc8079d70 con 0x7f5dd40739a0 2024-08-19T00:46:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5db806be30 msgr2=0x7f5db806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5db806be30 0x7f5db806e2f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5dd415c890 tx=0x7f5dc4008040 comp rx=0 tx=0).stop 2024-08-19T00:46:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd40739a0 msgr2=0x7f5dd41f6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd40739a0 0x7f5dd41f6430 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8000c00 tx=0x7f5dc80046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 shutdown_connections 2024-08-19T00:46:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd4159bf0 0x7f5dd40b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dd40cea40 0x7f5dd409c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 --2- 172.21.15.7:0/3300551026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dd40739a0 0x7f5dd41f6430 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 >> 172.21.15.7:0/3300551026 conn(0x7f5dd406bc70 msgr2=0x7f5dd40cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 shutdown_connections 2024-08-19T00:46:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.385+0000 7f5ddc800640 1 -- 172.21.15.7:0/3300551026 wait complete. 2024-08-19T00:46:43.406 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.484+0000 7f605fd54f40 1 Processor -- start 2024-08-19T00:46:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.484+0000 7f605fd54f40 1 -- start start 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.484+0000 7f605fd54f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6044003630 0x55b852f51bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605fd54f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852f05b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605fd54f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b852f06070 0x55b85306f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605fd54f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b852f378c0 con 0x7f6044003630 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605fd54f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b852eacd00 con 0x55b852f056d0 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605fd54f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b852fdddc0 con 0x55b852f06070 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6044003630 0x55b852f51bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6044003630 0x55b852f51bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58212/0 (socket says 172.21.15.7:58212) 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 -- 172.21.15.7:0/892552508 learned_addr learned my addr 172.21.15.7:0/892552508 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f6057e00640 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852f05b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605da00640 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b852f06070 0x55b85306f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 -- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b852f06070 msgr2=0x55b85306f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b852f06070 0x55b85306f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 -- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 msgr2=0x55b852f05b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852f05b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 -- 172.21.15.7:0/892552508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b852e31b30 con 0x7f6044003630 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f6057e00640 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852f05b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.485+0000 7f605d000640 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6044003630 0x55b852f51bc0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6050009750 tx=0x7f6050009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ac4c1166bb55c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f6056a00640 1 -- 172.21.15.7:0/892552508 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050009e60 con 0x7f6044003630 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f6056a00640 1 -- 172.21.15.7:0/892552508 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6050013030 con 0x7f6044003630 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f6056a00640 1 -- 172.21.15.7:0/892552508 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605000ed80 con 0x7f6044003630 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 -- 172.21.15.7:0/892552508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6044003630 msgr2=0x55b852f51bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6044003630 0x55b852f51bc0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6050009750 tx=0x7f6050009c10 comp rx=0 tx=0).stop 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 -- 172.21.15.7:0/892552508 shutdown_connections 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b852f06070 0x55b85306f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852f05b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 --2- 172.21.15.7:0/892552508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6044003630 0x55b852f51bc0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 -- 172.21.15.7:0/892552508 >> 172.21.15.7:0/892552508 conn(0x55b852f354e0 msgr2=0x55b852f50650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 -- 172.21.15.7:0/892552508 shutdown_connections 2024-08-19T00:46:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.486+0000 7f605fd54f40 1 -- 172.21.15.7:0/892552508 wait complete. 2024-08-19T00:46:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.487+0000 7f605fd54f40 1 Processor -- start 2024-08-19T00:46:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.487+0000 7f605fd54f40 1 -- start start 2024-08-19T00:46:43.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605fd54f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852fdf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605fd54f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b852f06070 0x55b853069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605fd54f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6044003630 0x55b8530768b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605fd54f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b852f336f0 con 0x55b852f06070 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605fd54f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b852f06520 con 0x55b852f056d0 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605fd54f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b852f34fe0 con 0x7f6044003630 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f6057e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b852f06070 0x55b853069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f6057e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b852f06070 0x55b853069dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58222/0 (socket says 172.21.15.7:58222) 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 learned_addr learned my addr 172.21.15.7:0/3447351982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605d000640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852fdf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.488+0000 7f605da00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6044003630 0x55b8530768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6044003630 msgr2=0x55b8530768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6057e00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6044003630 0x55b8530768b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 msgr2=0x55b852fdf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6057e00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b852f056d0 0x55b852fdf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b852e6e080 con 0x55b852f06070 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f605da00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6044003630 0x55b8530768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6057e00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b852f06070 0x55b853069dc0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6048009ed0 tx=0x7f6048005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6055600640 1 -- 172.21.15.7:0/3447351982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604801a020 con 0x55b852f06070 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6055600640 1 -- 172.21.15.7:0/3447351982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6048016450 con 0x55b852f06070 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8530689c0 con 0x55b852f06070 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f6055600640 1 -- 172.21.15.7:0/3447351982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048016820 con 0x55b852f06070 2024-08-19T00:46:43.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.489+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b853068f80 con 0x55b852f06070 2024-08-19T00:46:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.491+0000 7f6055600640 1 -- 172.21.15.7:0/3447351982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f604801d020 con 0x55b852f06070 2024-08-19T00:46:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.492+0000 7f6055600640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f603c06a840 0x7f603c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.492+0000 7f6055600640 1 -- 172.21.15.7:0/3447351982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7f604808ab90 con 0x55b852f06070 2024-08-19T00:46:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.492+0000 7f605d000640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f603c06a840 0x7f603c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.496 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.493+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b852fdfb50 0x55b8530748e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.493+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85306a300 con 0x55b852fdfb50 2024-08-19T00:46:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.493+0000 7f605da00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b852fdfb50 0x55b8530748e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.493+0000 7f605d000640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f603c06a840 0x7f603c06cd00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6050001970 tx=0x7f605001c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.494+0000 7f605da00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b852fdfb50 0x55b8530748e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.496+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v115'877 uv851 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.496+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853074e20 con 0x55b852fdfb50 2024-08-19T00:46:43.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.498+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v115'878 uv878 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.498+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853076df0 con 0x55b852fdfb50 2024-08-19T00:46:43.501 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:43.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.499+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v115'879 uv879 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.499+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530815e0 con 0x55b852fdfb50 2024-08-19T00:46:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.500+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v115'880 uv880 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.500+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853081980 con 0x55b852fdfb50 2024-08-19T00:46:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.502+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v115'881 uv881 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.502+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530805d0 con 0x55b852fdfb50 2024-08-19T00:46:43.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.504+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v115'882 uv882 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.504+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530809e0 con 0x55b852fdfb50 2024-08-19T00:46:43.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.506+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v115'883 uv857 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.506+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.507+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v115'884 uv884 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.507+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.510 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:43.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.509+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v115'885 uv885 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.509+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.510+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v115'886 uv886 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.510+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.512+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v115'887 uv887 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.512+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.513+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v115'888 uv888 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.513+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.515+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v115'889 uv864 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.515+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.516+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v115'890 uv890 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.516+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.519 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:43.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.518+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v115'891 uv891 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.518+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.519+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v115'892 uv892 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.519+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.521+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v115'893 uv893 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.521+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.523+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v115'894 uv894 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.523+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.524+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v115'895 uv895 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.524+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.526+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v115'896 uv870 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.526+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.528+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v115'897 uv897 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.528+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.531 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:43.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.529+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v115'898 uv898 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.529+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.531+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v115'899 uv899 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.531+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.532+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v115'900 uv900 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.532+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.534+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v115'901 uv901 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.534+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.536+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v115'902 uv876 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.536+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.537+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v115'903 uv903 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.537+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.539+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v115'904 uv904 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.539+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.540+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v115'905 uv905 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.540+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.541+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v115'906 uv906 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.541+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b852fdfb50 2024-08-19T00:46:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.543+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v115'907 uv907 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.543+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b853081160 0x55b853084240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.543+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853080d80 con 0x55b853081160 2024-08-19T00:46:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.543+0000 7f605d000640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b853081160 0x55b853084240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.544+0000 7f605d000640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b853081160 0x55b853084240 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.545+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v115'638 uv621 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.545+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853084780 con 0x55b853081160 2024-08-19T00:46:43.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.547+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v115'639 uv639 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.547+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853084b20 con 0x55b853081160 2024-08-19T00:46:43.550 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.549+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v115'640 uv640 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.549+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853084ec0 con 0x55b853081160 2024-08-19T00:46:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.550+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v115'641 uv641 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.551+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085260 con 0x55b853081160 2024-08-19T00:46:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.552+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v115'642 uv642 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.552+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085600 con 0x55b853081160 2024-08-19T00:46:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.554+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v115'643 uv626 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.554+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b8530859a0 con 0x55b853081160 2024-08-19T00:46:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.555+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v115'644 uv644 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.555+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d90 con 0x55b853081160 2024-08-19T00:46:43.558 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.557+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v115'645 uv645 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.557+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d90 con 0x55b853081160 2024-08-19T00:46:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.558+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v115'646 uv646 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.558+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.560+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v115'647 uv647 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.560+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.562+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v115'648 uv631 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.562+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.564+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v115'649 uv649 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.564+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.566 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.565+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v115'650 uv650 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.565+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.567+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v115'651 uv651 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.567+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.569+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v115'652 uv652 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.569+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.570+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v115'653 uv637 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.570+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.572+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v115'654 uv654 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.572+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d40 con 0x55b853081160 2024-08-19T00:46:43.575 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:43.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.573+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v115'655 uv655 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.573+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853085d80 con 0x55b853081160 2024-08-19T00:46:43.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.575+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v115'656 uv656 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.575+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853087290 con 0x55b853081160 2024-08-19T00:46:43.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.576+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v115'657 uv657 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.576+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853086180 con 0x55b853081160 2024-08-19T00:46:43.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.577+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v115'658 uv658 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b853081160 2024-08-19T00:46:43.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.578+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b853086bf0 0x55b853089250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.578+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853089790 con 0x55b853086bf0 2024-08-19T00:46:43.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.578+0000 7f6057e00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b853086bf0 0x55b853089250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.578+0000 7f6057e00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b853086bf0 0x55b853089250 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.580+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v115'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.580+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853089b30 con 0x55b853086bf0 2024-08-19T00:46:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.582+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v115'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.582+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853089ed0 con 0x55b853086bf0 2024-08-19T00:46:43.584 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:43.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.583+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v115'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.583+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308b280 con 0x55b853086bf0 2024-08-19T00:46:43.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.584+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v115'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.584+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308b6b0 con 0x55b853086bf0 2024-08-19T00:46:43.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.586+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v115'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.586+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308a270 con 0x55b853086bf0 2024-08-19T00:46:43.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.587+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v115'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.587+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308a660 con 0x55b852fdfb50 2024-08-19T00:46:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.589+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v115'126 uv125 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.589+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b85308a660 con 0x55b852fdfb50 2024-08-19T00:46:43.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.590+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v115'127 uv127 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.590+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308a660 con 0x55b852fdfb50 2024-08-19T00:46:43.593 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:43.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.592+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v115'128 uv128 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.592+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308a6c0 con 0x55b852fdfb50 2024-08-19T00:46:43.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.593+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v115'129 uv129 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.593+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b85308bb00 0x55b85308def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.593+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308e430 con 0x55b85308bb00 2024-08-19T00:46:43.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.594+0000 7f605da00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b85308bb00 0x55b85308def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.594+0000 7f605da00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b85308bb00 0x55b85308def0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.596+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v115'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.596+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b85308e430 con 0x55b85308bb00 2024-08-19T00:46:43.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.597+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v115'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.597+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308e430 con 0x55b85308bb00 2024-08-19T00:46:43.600 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:43.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.598+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v115'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.598+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308f440 con 0x55b85308bb00 2024-08-19T00:46:43.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.599+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v115'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.599+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308f440 con 0x55b85308bb00 2024-08-19T00:46:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.601+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v115'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.601+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b85308e430 con 0x55b85308bb00 2024-08-19T00:46:43.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.602+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v115'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.602+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b85308eab0 0x55b853090ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.602+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853091500 con 0x55b85308eab0 2024-08-19T00:46:43.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.602+0000 7f605d000640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b85308eab0 0x55b853090ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.603+0000 7f605d000640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b85308eab0 0x55b853090ea0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.604+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v115'316 uv310 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.604+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.606+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v115'317 uv317 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.606+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.608 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:43.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.607+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v115'318 uv318 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.607+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530928e0 con 0x55b85308eab0 2024-08-19T00:46:43.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.608+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v115'319 uv319 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.608+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530928e0 con 0x55b85308eab0 2024-08-19T00:46:43.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.610+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v115'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.610+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.611+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v115'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.611+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.613+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v115'322 uv315 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.613+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.614+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v115'323 uv323 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.614+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.617 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:43.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.615+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v115'324 uv324 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.615+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.617+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v115'325 uv325 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.617+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530918d0 con 0x55b85308eab0 2024-08-19T00:46:43.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.618+0000 7f605d000640 1 -- 172.21.15.7:0/3447351982 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v115'326 uv326 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6050019430 con 0x55b85308eab0 2024-08-19T00:46:43.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.618+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b853091f50 0x55b853094360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.618+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853094a60 con 0x55b853091f50 2024-08-19T00:46:43.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.618+0000 7f6057e00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b853091f50 0x55b853094360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.619+0000 7f6057e00640 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b853091f50 0x55b853094360 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.620+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v115'143 uv142 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.620+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853094e30 con 0x55b853091f50 2024-08-19T00:46:43.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.622+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v115'144 uv144 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.622+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853091f50 2024-08-19T00:46:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.623+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v115'145 uv145 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.625 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.623+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853091f50 2024-08-19T00:46:43.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.624+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v115'146 uv146 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.624+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853091f50 2024-08-19T00:46:43.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.626+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v115'147 uv147 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.626+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b852fdfb50 2024-08-19T00:46:43.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.627+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v115'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.627+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b852fdfb50 2024-08-19T00:46:43.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.628+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v115'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.628+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b852fdfb50 2024-08-19T00:46:43.631 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:43.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.630+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v115'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.630+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853096260 con 0x55b852fdfb50 2024-08-19T00:46:43.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.631+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v115'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.631+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853096260 con 0x55b852fdfb50 2024-08-19T00:46:43.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.632+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v115'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.632+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b852fdfb50 2024-08-19T00:46:43.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.634+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v115'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b852fdfb50 2024-08-19T00:46:43.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.634+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.635+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v115'284 uv283 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.635+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.636+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v115'285 uv285 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.636+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.638+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v115'286 uv286 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.639 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.638+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.639+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v115'287 uv287 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.639+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.641+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v115'288 uv288 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.641+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.642+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v115'289 uv282 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.642+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.643+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v115'290 uv290 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.644+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.645+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v115'291 uv291 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.647 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.645+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095250 con 0x55b853086bf0 2024-08-19T00:46:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.647+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v115'292 uv292 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.647+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075340 con 0x55b853086bf0 2024-08-19T00:46:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.648+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v115'293 uv293 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853086bf0 2024-08-19T00:46:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.649+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.651+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v115'124 uv123 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.651+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.654+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v115'125 uv125 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.654+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.657 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.655+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v115'126 uv126 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.656+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.657+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v115'127 uv127 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.657+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.659+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v115'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.659+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.660+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v115'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.660+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.663 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:43.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.662+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v115'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.662+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075300 con 0x55b85308bb00 2024-08-19T00:46:43.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.663+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v115'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.663+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752e0 con 0x55b85308bb00 2024-08-19T00:46:43.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.665+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v115'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.665+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752c0 con 0x55b85308bb00 2024-08-19T00:46:43.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.666+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v115'176 uv176 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6058005040 con 0x55b85308bb00 2024-08-19T00:46:43.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.666+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752c0 con 0x55b853091f50 2024-08-19T00:46:43.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.667+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v115'145 uv144 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.667+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752c0 con 0x55b853091f50 2024-08-19T00:46:43.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.669+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v115'146 uv146 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.669+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752c0 con 0x55b853091f50 2024-08-19T00:46:43.671 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.670+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v115'147 uv147 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.670+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752c0 con 0x55b853091f50 2024-08-19T00:46:43.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.671+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v115'148 uv148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.671+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752c0 con 0x55b853091f50 2024-08-19T00:46:43.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.672+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v115'149 uv149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.672+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.674+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v115'351 uv343 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.674+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.675+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v115'352 uv352 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.675+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.678 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.677+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v115'353 uv353 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.677+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.678+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v115'354 uv354 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.678+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.679+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v115'355 uv355 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.680+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.681+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v115'356 uv350 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.681+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.682+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v115'357 uv357 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.682+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b8530752a0 con 0x55b853091f50 2024-08-19T00:46:43.685 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:43.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.684+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v115'358 uv358 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.684+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075270 con 0x55b853091f50 2024-08-19T00:46:43.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.685+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v115'359 uv359 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.685+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075270 con 0x55b853091f50 2024-08-19T00:46:43.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.686+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v115'360 uv360 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.686+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853075270 con 0x55b853091f50 2024-08-19T00:46:43.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.688+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v115'361 uv361 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.688+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55b853095d10 con 0x55b853091f50 2024-08-19T00:46:43.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f6057e00640 1 -- 172.21.15.7:0/3447351982 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v115'362 uv362 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6048054ad0 con 0x55b853091f50 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b853081160 msgr2=0x55b853084240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b853081160 0x55b853084240 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b85308eab0 msgr2=0x55b853090ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b85308eab0 0x55b853090ea0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b853091f50 msgr2=0x55b853094360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b853091f50 0x55b853094360 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b853086bf0 msgr2=0x55b853089250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b853086bf0 0x55b853089250 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 reap_dead start 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b852fdfb50 msgr2=0x55b8530748e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b852fdfb50 0x55b8530748e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b85308bb00 msgr2=0x55b85308def0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b85308bb00 0x55b85308def0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f603c06a840 msgr2=0x7f603c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f603c06a840 0x7f603c06cd00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6050001970 tx=0x7f605001c040 comp rx=0 tx=0).stop 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b852f06070 msgr2=0x55b853069dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605fd54f40 1 --2- 172.21.15.7:0/3447351982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b852f06070 0x55b853069dc0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6048009ed0 tx=0x7f6048005810 comp rx=0 tx=0).stop 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.689+0000 7f605da00640 1 -- 172.21.15.7:0/3447351982 reap_dead start 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.690+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 shutdown_connections 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.690+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 >> 172.21.15.7:0/3447351982 conn(0x55b852f354e0 msgr2=0x55b85306dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.690+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 shutdown_connections 2024-08-19T00:46:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.690+0000 7f605fd54f40 1 -- 172.21.15.7:0/3447351982 wait complete. 2024-08-19T00:46:43.696 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 400.00000000 0 2024-08-19T00:46:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.812+0000 7f3726e92f40 1 Processor -- start 2024-08-19T00:46:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.812+0000 7f3726e92f40 1 -- start start 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.812+0000 7f3726e92f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 0x55aba487cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3726e92f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 0x55aba4882910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3726e92f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba4882e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3726e92f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aba47e48f0 con 0x55aba47e5990 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3726e92f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55aba4759d00 con 0x55aba47e55b0 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3726e92f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55aba488adc0 con 0x55aba47e3f40 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba4882e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba4882e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35492/0 (socket says 172.21.15.7:35492) 2024-08-19T00:46:43.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 -- 172.21.15.7:0/1797882538 learned_addr learned my addr 172.21.15.7:0/1797882538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3723600640 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 0x55aba4882910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724000640 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 0x55aba487cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 -- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 msgr2=0x55aba487cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 0x55aba487cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 -- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 msgr2=0x55aba4882910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 0x55aba4882910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.813+0000 7f3724a00640 1 -- 172.21.15.7:0/1797882538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba46deb30 con 0x55aba47e5990 2024-08-19T00:46:43.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3724a00640 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba4882e50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f371c002850 tx=0x7f371c002d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28137af38d8cd14b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3722200640 1 -- 172.21.15.7:0/1797882538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c016020 con 0x55aba47e5990 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3722200640 1 -- 172.21.15.7:0/1797882538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c00d9c0 con 0x55aba47e5990 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3722200640 1 -- 172.21.15.7:0/1797882538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00ddb0 con 0x55aba47e5990 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 -- 172.21.15.7:0/1797882538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 msgr2=0x55aba4882e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba4882e50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f371c002850 tx=0x7f371c002d10 comp rx=0 tx=0).stop 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 -- 172.21.15.7:0/1797882538 shutdown_connections 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba4882e50 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 0x55aba4882910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 --2- 172.21.15.7:0/1797882538 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 0x55aba487cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 -- 172.21.15.7:0/1797882538 >> 172.21.15.7:0/1797882538 conn(0x55aba47e24e0 msgr2=0x55aba47fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.814+0000 7f3726e92f40 1 -- 172.21.15.7:0/1797882538 shutdown_connections 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.815+0000 7f3726e92f40 1 -- 172.21.15.7:0/1797882538 wait complete. 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.815+0000 7f3726e92f40 1 Processor -- start 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.815+0000 7f3726e92f40 1 -- start start 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3726e92f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 0x55aba488bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3726e92f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 0x55aba4923f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3726e92f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba49244b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3726e92f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aba48835e0 con 0x55aba47e5990 2024-08-19T00:46:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3726e92f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55aba47e1420 con 0x55aba47e55b0 2024-08-19T00:46:43.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3726e92f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55aba47ff1f0 con 0x55aba47e3f40 2024-08-19T00:46:43.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3724a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba49244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3724a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba49244b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35504/0 (socket says 172.21.15.7:35504) 2024-08-19T00:46:43.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3724a00640 1 -- 172.21.15.7:0/2324985048 learned_addr learned my addr 172.21.15.7:0/2324985048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:43.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3723600640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 0x55aba4923f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.816+0000 7f3724000640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 0x55aba488bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3724a00640 1 -- 172.21.15.7:0/2324985048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 msgr2=0x55aba488bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3724a00640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55aba47e3f40 0x55aba488bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3724a00640 1 -- 172.21.15.7:0/2324985048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 msgr2=0x55aba4923f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3724a00640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aba47e55b0 0x55aba4923f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3724a00640 1 -- 172.21.15.7:0/2324985048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba471b080 con 0x55aba47e5990 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3724a00640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba49244b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x55aba47e19a0 tx=0x7f371c0033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3720e00640 1 -- 172.21.15.7:0/2324985048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c016030 con 0x55aba47e5990 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3720e00640 1 -- 172.21.15.7:0/2324985048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c012d20 con 0x55aba47e5990 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3720e00640 1 -- 172.21.15.7:0/2324985048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0246b0 con 0x55aba47e5990 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.817+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aba4881400 con 0x55aba47e5990 2024-08-19T00:46:43.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.818+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba4881980 con 0x55aba47e5990 2024-08-19T00:46:43.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.819+0000 7f3720e00640 1 -- 172.21.15.7:0/2324985048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f371c019020 con 0x55aba47e5990 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.820+0000 7f3720e00640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370406a840 0x7f370406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.820+0000 7f3720e00640 1 -- 172.21.15.7:0/2324985048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7f371c08bdf0 con 0x55aba47e5990 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.820+0000 7f3724000640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370406a840 0x7f370406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.820+0000 7f3726e92f40 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55aba488c160 0x55aba4882180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.821+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55aba4887810 con 0x55aba488c160 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.821+0000 7f3723600640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55aba488c160 0x55aba4882180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.821+0000 7f3724000640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370406a840 0x7f370406cd00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3714057000 tx=0x7f3714061040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.821+0000 7f3723600640 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55aba488c160 0x55aba4882180 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:43.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3723600640 1 -- 172.21.15.7:0/2324985048 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 400.00000000 [truncate 0] v115'150 uv150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f37100115f0 con 0x55aba488c160 2024-08-19T00:46:43.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55aba488c160 msgr2=0x55aba4882180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55aba488c160 0x55aba4882180 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370406a840 msgr2=0x7f370406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f370406a840 0x7f370406cd00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3714057000 tx=0x7f3714061040 comp rx=0 tx=0).stop 2024-08-19T00:46:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 msgr2=0x55aba49244b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 --2- 172.21.15.7:0/2324985048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aba47e5990 0x55aba49244b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x55aba47e19a0 tx=0x7f371c0033a0 comp rx=0 tx=0).stop 2024-08-19T00:46:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3724a00640 1 -- 172.21.15.7:0/2324985048 reap_dead start 2024-08-19T00:46:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 shutdown_connections 2024-08-19T00:46:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 >> 172.21.15.7:0/2324985048 conn(0x55aba47e24e0 msgr2=0x55aba47b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 shutdown_connections 2024-08-19T00:46:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.823+0000 7f3726e92f40 1 -- 172.21.15.7:0/2324985048 wait complete. 2024-08-19T00:46:43.829 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.988+0000 7fbc77800640 1 Processor -- start 2024-08-19T00:46:44.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.989+0000 7fbc77800640 1 -- start start 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc77800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc700731c0 0x7fbc700add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc77800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700ae2b0 0x7fbc700b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc77800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc700aeae0 con 0x7fbc70158cd0 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc77800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbc700aedc0 con 0x7fbc700731c0 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc77800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc700af0a0 con 0x7fbc700ae2b0 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc6fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc700731c0 0x7fbc700add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc6fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc700731c0 0x7fbc700add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35508/0 (socket says 172.21.15.7:35508) 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc6fe00640 1 -- 172.21.15.7:0/1973628390 learned_addr learned my addr 172.21.15.7:0/1973628390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc75800640 1 --2- 172.21.15.7:0/1973628390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700ae2b0 0x7fbc700b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc6fe00640 1 -- 172.21.15.7:0/1973628390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700ae2b0 msgr2=0x7fbc700b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc6fe00640 1 --2- 172.21.15.7:0/1973628390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700ae2b0 0x7fbc700b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc6fe00640 1 -- 172.21.15.7:0/1973628390 >> v1:172.21.15.162:6789/0 conn(0x7fbc70158cd0 legacy=0x7fbc70072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.990+0000 7fbc6fe00640 1 -- 172.21.15.7:0/1973628390 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc700af380 con 0x7fbc700731c0 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.991+0000 7fbc6fe00640 1 --2- 172.21.15.7:0/1973628390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700731c0 0x7fbc700add70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009870 tx=0x7fbc5c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb91bfc44d5a4dd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc6f400640 1 -- 172.21.15.7:0/1973628390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c037070 con 0x7fbc700731c0 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc6f400640 1 -- 172.21.15.7:0/1973628390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c032440 con 0x7fbc700731c0 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc6f400640 1 -- 172.21.15.7:0/1973628390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c032810 con 0x7fbc700731c0 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 -- 172.21.15.7:0/1973628390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700731c0 msgr2=0x7fbc700add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 --2- 172.21.15.7:0/1973628390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700731c0 0x7fbc700add70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009870 tx=0x7fbc5c02a130 comp rx=0 tx=0).stop 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 -- 172.21.15.7:0/1973628390 shutdown_connections 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 --2- 172.21.15.7:0/1973628390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700ae2b0 0x7fbc700b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 --2- 172.21.15.7:0/1973628390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700731c0 0x7fbc700add70 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 -- 172.21.15.7:0/1973628390 >> 172.21.15.7:0/1973628390 conn(0x7fbc700b2300 msgr2=0x7fbc7006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 -- 172.21.15.7:0/1973628390 shutdown_connections 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.992+0000 7fbc77800640 1 -- 172.21.15.7:0/1973628390 wait complete. 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.994+0000 7fbc77800640 1 Processor -- start 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.994+0000 7fbc77800640 1 -- start start 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.995+0000 7fbc77800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc700731c0 0x7fbc700cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.995+0000 7fbc77800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700ae2b0 0x7fbc701538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.995+0000 7fbc77800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700b02a0 0x7fbc7014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.995+0000 7fbc77800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc700b3690 con 0x7fbc700ae2b0 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.995+0000 7fbc77800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc700ae760 con 0x7fbc700731c0 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.995+0000 7fbc77800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc700b3810 con 0x7fbc700b02a0 2024-08-19T00:46:44.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.995+0000 7fbc6fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700ae2b0 0x7fbc701538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700ae2b0 0x7fbc701538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35510/0 (socket says 172.21.15.7:35510) 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 -- 172.21.15.7:0/493872803 learned_addr learned my addr 172.21.15.7:0/493872803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc74e00640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc700731c0 0x7fbc700cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc75800640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700b02a0 0x7fbc7014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 -- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700b02a0 msgr2=0x7fbc7014da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700b02a0 0x7fbc7014da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 -- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc700731c0 msgr2=0x7fbc700cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc700731c0 0x7fbc700cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 -- 172.21.15.7:0/493872803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc70154c10 con 0x7fbc700ae2b0 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.996+0000 7fbc6fe00640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700ae2b0 0x7fbc701538a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c000c00 tx=0x7fbc5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.997+0000 7fbc6cc00640 1 -- 172.21.15.7:0/493872803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c041020 con 0x7fbc700ae2b0 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.997+0000 7fbc6cc00640 1 -- 172.21.15.7:0/493872803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c030640 con 0x7fbc700ae2b0 2024-08-19T00:46:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.997+0000 7fbc6cc00640 1 -- 172.21.15.7:0/493872803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c037040 con 0x7fbc700ae2b0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.997+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc70154ef0 con 0x7fbc700ae2b0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.997+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc701530c0 con 0x7fbc700ae2b0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.998+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc700add70 con 0x7fbc700ae2b0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:43.999+0000 7fbc6cc00640 1 -- 172.21.15.7:0/493872803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc5c044020 con 0x7fbc700ae2b0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.000+0000 7fbc6cc00640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc5006be30 0x7fbc5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.000+0000 7fbc6cc00640 1 -- 172.21.15.7:0/493872803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8203+0+0 (secure 0 0 0) 0x7fbc5c0abf70 con 0x7fbc700ae2b0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.000+0000 7fbc74e00640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc5006be30 0x7fbc5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.001+0000 7fbc74e00640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc5006be30 0x7fbc5006e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000f60 tx=0x7fbc64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.005+0000 7fbc6cc00640 1 -- 172.21.15.7:0/493872803 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbc5c04b030 con 0x7fbc700ae2b0 2024-08-19T00:46:44.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.224+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fbc70152b00 con 0x7fbc700ae2b0 2024-08-19T00:46:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.385+0000 7fbc6cc00640 1 -- 172.21.15.7:0/493872803 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v260) ==== 162+0+0 (secure 0 0 0) 0x7fbc5c079870 con 0x7fbc700ae2b0 2024-08-19T00:46:44.387 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc5006be30 msgr2=0x7fbc5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc5006be30 0x7fbc5006e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000f60 tx=0x7fbc64009040 comp rx=0 tx=0).stop 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700ae2b0 msgr2=0x7fbc701538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700ae2b0 0x7fbc701538a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c000c00 tx=0x7fbc5c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 shutdown_connections 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbc5006be30 0x7fbc5006e2f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc700b02a0 0x7fbc7014da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc700ae2b0 0x7fbc701538a0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 --2- 172.21.15.7:0/493872803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc700731c0 0x7fbc700cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 >> 172.21.15.7:0/493872803 conn(0x7fbc700b2300 msgr2=0x7fbc70071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:44.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 shutdown_connections 2024-08-19T00:46:44.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.389+0000 7fbc77800640 1 -- 172.21.15.7:0/493872803 wait complete. 2024-08-19T00:46:44.396 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:44.395+0000 7f59d0200640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-08-19T00:46:44.397 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:44.395+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:44.397 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:44.395+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:44.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.566+0000 7f6b99200640 1 Processor -- start 2024-08-19T00:46:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.566+0000 7f6b99200640 1 -- start start 2024-08-19T00:46:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b99200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6b9415e360 0x7f6b9415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b99200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b940d2af0 0x7f6b940d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b99200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b9415e740 0x7f6b9415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b99200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6b940b3ab0 con 0x7f6b940d2af0 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b99200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9415f460 con 0x7f6b9415e360 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b99200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9415f740 con 0x7f6b9415e740 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b92a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b940d2af0 0x7f6b940d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b92a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b940d2af0 0x7f6b940d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35518/0 (socket says 172.21.15.7:35518) 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.567+0000 7f6b92a00640 1 -- 172.21.15.7:0/1113015115 learned_addr learned my addr 172.21.15.7:0/1113015115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.568+0000 7f6b93e00640 1 --2- 172.21.15.7:0/1113015115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b9415e740 0x7f6b9415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.568+0000 7f6b93400640 1 --2- 172.21.15.7:0/1113015115 >> v2:172.21.15.162:3300/0 conn(0x7f6b9415e360 0x7f6b9415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.568+0000 7f6b92a00640 1 -- 172.21.15.7:0/1113015115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b9415e740 msgr2=0x7f6b9415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.568+0000 7f6b92a00640 1 --2- 172.21.15.7:0/1113015115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b9415e740 0x7f6b9415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.568+0000 7f6b92a00640 1 -- 172.21.15.7:0/1113015115 >> v2:172.21.15.162:3300/0 conn(0x7f6b9415e360 msgr2=0x7f6b9415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.568+0000 7f6b92a00640 1 --2- 172.21.15.7:0/1113015115 >> v2:172.21.15.162:3300/0 conn(0x7f6b9415e360 0x7f6b9415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.568+0000 7f6b92a00640 1 -- 172.21.15.7:0/1113015115 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b940b3d60 con 0x7f6b940d2af0 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.569+0000 7f6b92a00640 1 --2- 172.21.15.7:0/1113015115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b940d2af0 0x7f6b940d2f80 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6b9408e8a0 tx=0x7f6b8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c50fbb96039714a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.569+0000 7f6b92000640 1 -- 172.21.15.7:0/1113015115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80037070 con 0x7f6b940d2af0 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.569+0000 7f6b92000640 1 -- 172.21.15.7:0/1113015115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b80032440 con 0x7f6b940d2af0 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.569+0000 7f6b92000640 1 -- 172.21.15.7:0/1113015115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80032810 con 0x7f6b940d2af0 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 -- 172.21.15.7:0/1113015115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b940d2af0 msgr2=0x7f6b940d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 --2- 172.21.15.7:0/1113015115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b940d2af0 0x7f6b940d2f80 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6b9408e8a0 tx=0x7f6b8002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 -- 172.21.15.7:0/1113015115 shutdown_connections 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 --2- 172.21.15.7:0/1113015115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b9415e740 0x7f6b9415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 --2- 172.21.15.7:0/1113015115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b940d2af0 0x7f6b940d2f80 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 --2- 172.21.15.7:0/1113015115 >> v2:172.21.15.162:3300/0 conn(0x7f6b9415e360 0x7f6b9415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 -- 172.21.15.7:0/1113015115 >> 172.21.15.7:0/1113015115 conn(0x7f6b9408dbf0 msgr2=0x7f6b9409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 -- 172.21.15.7:0/1113015115 shutdown_connections 2024-08-19T00:46:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.570+0000 7f6b99200640 1 -- 172.21.15.7:0/1113015115 wait complete. 2024-08-19T00:46:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.571+0000 7f6b99200640 1 Processor -- start 2024-08-19T00:46:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.572+0000 7f6b99200640 1 -- start start 2024-08-19T00:46:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.572+0000 7f6b99200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b940d2af0 0x7f6b940c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.572+0000 7f6b99200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b9415e360 0x7f6b94157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.572+0000 7f6b99200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b9415e740 0x7f6b940d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.572+0000 7f6b99200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9415f0f0 con 0x7f6b9415e360 2024-08-19T00:46:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.572+0000 7f6b99200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b940d2300 con 0x7f6b9415e740 2024-08-19T00:46:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b99200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b940b4560 con 0x7f6b940d2af0 2024-08-19T00:46:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b9415e360 0x7f6b94157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b9415e360 0x7f6b94157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35528/0 (socket says 172.21.15.7:35528) 2024-08-19T00:46:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 -- 172.21.15.7:0/142391729 learned_addr learned my addr 172.21.15.7:0/142391729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b93400640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b940d2af0 0x7f6b940c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b93e00640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b9415e740 0x7f6b940d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 -- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b940d2af0 msgr2=0x7f6b940c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b940d2af0 0x7f6b940c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 -- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b9415e740 msgr2=0x7f6b940d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b9415e740 0x7f6b940d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.573+0000 7f6b92a00640 1 -- 172.21.15.7:0/142391729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b940c8c60 con 0x7f6b9415e360 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.574+0000 7f6b92a00640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b9415e360 0x7f6b94157740 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f6b80000c00 tx=0x7f6b800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.574+0000 7f6b8b400640 1 -- 172.21.15.7:0/142391729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80041020 con 0x7f6b9415e360 2024-08-19T00:46:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.574+0000 7f6b8b400640 1 -- 172.21.15.7:0/142391729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b800306c0 con 0x7f6b9415e360 2024-08-19T00:46:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.574+0000 7f6b8b400640 1 -- 172.21.15.7:0/142391729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80037040 con 0x7f6b9415e360 2024-08-19T00:46:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.574+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b940c93c0 con 0x7f6b9415e360 2024-08-19T00:46:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.574+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b940c9980 con 0x7f6b9415e360 2024-08-19T00:46:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.575+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9415ebb0 con 0x7f6b9415e360 2024-08-19T00:46:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.576+0000 7f6b8b400640 1 -- 172.21.15.7:0/142391729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b80044020 con 0x7f6b9415e360 2024-08-19T00:46:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.577+0000 7f6b8b400640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b7406be60 0x7f6b7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.577+0000 7f6b8b400640 1 -- 172.21.15.7:0/142391729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7f6b800abf60 con 0x7f6b9415e360 2024-08-19T00:46:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.577+0000 7f6b93400640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b7406be60 0x7f6b7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.578+0000 7f6b93400640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b7406be60 0x7f6b7406e320 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006fd0 tx=0x7f6b84008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.581+0000 7f6b8b400640 1 -- 172.21.15.7:0/142391729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6b8004b030 con 0x7f6b9415e360 2024-08-19T00:46:44.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.803+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b94162330 con 0x7f6b9415e360 2024-08-19T00:46:44.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.804+0000 7f6b8b400640 1 -- 172.21.15.7:0/142391729 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 262 v262) ==== 95+0+3570 (secure 0 0 0) 0x7f6b940c8c60 con 0x7f6b9415e360 2024-08-19T00:46:44.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:44.806 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":262,"btime":"2024-08-19T00:46:44:396326+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":262,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:44.396278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 262 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b7406be60 msgr2=0x7f6b7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b7406be60 0x7f6b7406e320 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006fd0 tx=0x7f6b84008040 comp rx=0 tx=0).stop 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b9415e360 msgr2=0x7f6b94157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b9415e360 0x7f6b94157740 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f6b80000c00 tx=0x7f6b800046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 shutdown_connections 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6b7406be60 0x7f6b7406e320 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b9415e740 0x7f6b940d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b9415e360 0x7f6b94157740 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 --2- 172.21.15.7:0/142391729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b940d2af0 0x7f6b940c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 >> 172.21.15.7:0/142391729 conn(0x7f6b9408dbf0 msgr2=0x7f6b9415fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 shutdown_connections 2024-08-19T00:46:44.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.806+0000 7f6b99200640 1 -- 172.21.15.7:0/142391729 wait complete. 2024-08-19T00:46:44.823 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:44.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:44.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.979+0000 7f56ff000640 1 Processor -- start 2024-08-19T00:46:44.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.979+0000 7f56ff000640 1 -- start start 2024-08-19T00:46:44.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.980+0000 7f56ff000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56f80cc9f0 0x7f56f80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.980+0000 7f56ff000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56ff000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f815b290 con 0x7f56f81585c0 2024-08-19T00:46:44.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56ff000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f56f80cd370 con 0x7f56f80cc9f0 2024-08-19T00:46:44.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56ff000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56f815b570 con 0x7f56f806dcc0 2024-08-19T00:46:44.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56efe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56f80cc9f0 0x7f56f80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56efe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56f80cc9f0 0x7f56f80cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35532/0 (socket says 172.21.15.7:35532) 2024-08-19T00:46:44.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56efe00640 1 -- 172.21.15.7:0/2594700595 learned_addr learned my addr 172.21.15.7:0/2594700595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:44.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56fd000640 1 --2- 172.21.15.7:0/2594700595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56efe00640 1 -- 172.21.15.7:0/2594700595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 msgr2=0x7f56f806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:44.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56efe00640 1 --2- 172.21.15.7:0/2594700595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56efe00640 1 -- 172.21.15.7:0/2594700595 >> v1:172.21.15.162:6789/0 conn(0x7f56f81585c0 legacy=0x7f56f806f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56efe00640 1 -- 172.21.15.7:0/2594700595 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f815b850 con 0x7f56f80cc9f0 2024-08-19T00:46:44.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.981+0000 7f56f7400640 1 -- 172.21.15.7:0/2594700595 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682167467 0 0) 0x7f56f815b290 con 0x7f56f81585c0 2024-08-19T00:46:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.982+0000 7f56efe00640 1 --2- 172.21.15.7:0/2594700595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f80cce30 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f56e000bb00 tx=0x7f56e002c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ea204ec2368184 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56f7400640 1 -- 172.21.15.7:0/2594700595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e003a070 con 0x7f56f80cc9f0 2024-08-19T00:46:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56f7400640 1 -- 172.21.15.7:0/2594700595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0032480 con 0x7f56f80cc9f0 2024-08-19T00:46:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56f7400640 1 -- 172.21.15.7:0/2594700595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0032850 con 0x7f56f80cc9f0 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 -- 172.21.15.7:0/2594700595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 msgr2=0x7f56f80cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 --2- 172.21.15.7:0/2594700595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f80cce30 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f56e000bb00 tx=0x7f56e002c6e0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 -- 172.21.15.7:0/2594700595 shutdown_connections 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 --2- 172.21.15.7:0/2594700595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 --2- 172.21.15.7:0/2594700595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f80cce30 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 -- 172.21.15.7:0/2594700595 >> 172.21.15.7:0/2594700595 conn(0x7f56f806bc70 msgr2=0x7f56f806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 -- 172.21.15.7:0/2594700595 shutdown_connections 2024-08-19T00:46:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.983+0000 7f56ff000640 1 -- 172.21.15.7:0/2594700595 wait complete. 2024-08-19T00:46:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.985+0000 7f56ff000640 1 Processor -- start 2024-08-19T00:46:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.985+0000 7f56ff000640 1 -- start start 2024-08-19T00:46:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56ff000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f8159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56ff000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f8150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56ff000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f81585c0 0x7f56f8152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56ff000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56f806f7b0 con 0x7f56f80cc9f0 2024-08-19T00:46:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56ff000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56f815be10 con 0x7f56f81585c0 2024-08-19T00:46:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56ff000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56f8071980 con 0x7f56f806dcc0 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f8150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f8150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35534/0 (socket says 172.21.15.7:35534) 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56efe00640 1 -- 172.21.15.7:0/1813178991 learned_addr learned my addr 172.21.15.7:0/1813178991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56f7e00640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f8159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.986+0000 7f56fd000640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f81585c0 0x7f56f8152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56efe00640 1 -- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 msgr2=0x7f56f8159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56efe00640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f8159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56efe00640 1 -- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f81585c0 msgr2=0x7f56f8152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56efe00640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f81585c0 0x7f56f8152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56efe00640 1 -- 172.21.15.7:0/1813178991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f80cbf20 con 0x7f56f80cc9f0 2024-08-19T00:46:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56efe00640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f8150540 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f56e0038040 tx=0x7f56e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56f4c00640 1 -- 172.21.15.7:0/1813178991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e003a070 con 0x7f56f80cc9f0 2024-08-19T00:46:44.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56f4c00640 1 -- 172.21.15.7:0/1813178991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0035860 con 0x7f56f80cc9f0 2024-08-19T00:46:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56f4c00640 1 -- 172.21.15.7:0/1813178991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0035c50 con 0x7f56f80cc9f0 2024-08-19T00:46:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.987+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f8158d80 con 0x7f56f80cc9f0 2024-08-19T00:46:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.988+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f8159340 con 0x7f56f80cc9f0 2024-08-19T00:46:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.988+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f815ae60 con 0x7f56f80cc9f0 2024-08-19T00:46:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.989+0000 7f56f4c00640 1 -- 172.21.15.7:0/1813178991 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56e0047060 con 0x7f56f80cc9f0 2024-08-19T00:46:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.990+0000 7f56f4c00640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56d406be30 0x7f56d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.990+0000 7f56f4c00640 1 -- 172.21.15.7:0/1813178991 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7f56e00abcd0 con 0x7f56f80cc9f0 2024-08-19T00:46:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.990+0000 7f56f7e00640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56d406be30 0x7f56d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.991+0000 7f56f7e00640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56d406be30 0x7f56d406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000f60 tx=0x7f56e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:44.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:44.995+0000 7f56f4c00640 1 -- 172.21.15.7:0/1813178991 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f56e00795f0 con 0x7f56f80cc9f0 2024-08-19T00:46:45.121 INFO:tasks.ceph.mds.c.smithi007.stderr: -39> 2024-08-19T00:46:40.367+0000 7fc84be00640 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': End of buffer [buffer:2] 2024-08-19T00:46:45.160 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:46:45.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.216+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56f8157d00 con 0x7f56f80cc9f0 2024-08-19T00:46:45.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.216+0000 7f56f4c00640 1 -- 172.21.15.7:0/1813178991 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 262 v262) ==== 95+0+3570 (secure 0 0 0) 0x7f56e007d8f0 con 0x7f56f80cc9f0 2024-08-19T00:46:45.218 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:45.218 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":262,"btime":"2024-08-19T00:46:44:396326+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":262,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:44.396278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:45.218 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 262 2024-08-19T00:46:45.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56d406be30 msgr2=0x7f56d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56d406be30 0x7f56d406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000f60 tx=0x7f56e8009040 comp rx=0 tx=0).stop 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 msgr2=0x7f56f8150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f8150540 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f56e0038040 tx=0x7f56e00046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 shutdown_connections 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f56d406be30 0x7f56d406e2f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56f81585c0 0x7f56f8152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56f80cc9f0 0x7f56f8150540 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 --2- 172.21.15.7:0/1813178991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56f806dcc0 0x7f56f8159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 >> 172.21.15.7:0/1813178991 conn(0x7f56f806bc70 msgr2=0x7f56f8072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 shutdown_connections 2024-08-19T00:46:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.219+0000 7f56ff000640 1 -- 172.21.15.7:0/1813178991 wait complete. 2024-08-19T00:46:45.236 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:45.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:45.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.393+0000 7f03db800640 1 Processor -- start 2024-08-19T00:46:45.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.393+0000 7f03db800640 1 -- start start 2024-08-19T00:46:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.394+0000 7f03db800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03d40d12a0 0x7f03d4169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.394+0000 7f03db800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d415ec30 con 0x7f03d409aa70 2024-08-19T00:46:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.394+0000 7f03db800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d415ef10 con 0x7f03d409b730 2024-08-19T00:46:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.394+0000 7f03db800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f03d415f1f0 con 0x7f03d40d12a0 2024-08-19T00:46:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.394+0000 7f03d8e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f03d409aa70 0x7f03d409ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36724/0 (socket says 172.21.15.7:36724) 2024-08-19T00:46:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.394+0000 7f03d8e00640 1 -- 172.21.15.7:0/3451476583 learned_addr learned my addr 172.21.15.7:0/3451476583 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:45.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.394+0000 7f03d9800640 1 --2- 172.21.15.7:0/3451476583 >> v2:172.21.15.162:3300/0 conn(0x7f03d40d12a0 0x7f03d4169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.395+0000 7f03d3400640 1 -- 172.21.15.7:0/3451476583 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19644046 0 0) 0x7f03d415ec30 con 0x7f03d409aa70 2024-08-19T00:46:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.395+0000 7f03d3400640 1 -- 172.21.15.7:0/3451476583 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03bc003520 con 0x7f03d409aa70 2024-08-19T00:46:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.395+0000 7f03d9800640 1 -- 172.21.15.7:0/3451476583 >> v1:172.21.15.162:6789/0 conn(0x7f03d409b730 legacy=0x7f03d406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.395+0000 7f03d9800640 1 -- 172.21.15.7:0/3451476583 >> v1:172.21.15.7:6789/0 conn(0x7f03d409aa70 legacy=0x7f03d409ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.395+0000 7f03d9800640 1 -- 172.21.15.7:0/3451476583 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d415f4d0 con 0x7f03d40d12a0 2024-08-19T00:46:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.396+0000 7f03d9800640 1 --2- 172.21.15.7:0/3451476583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d40d12a0 0x7f03d4169290 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009d90 tx=0x7f03cc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7997955c37414735 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.396+0000 7f03d3400640 1 -- 172.21.15.7:0/3451476583 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc007740 con 0x7f03d40d12a0 2024-08-19T00:46:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.396+0000 7f03d3400640 1 -- 172.21.15.7:0/3451476583 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03cc0078e0 con 0x7f03d40d12a0 2024-08-19T00:46:45.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.396+0000 7f03d3400640 1 -- 172.21.15.7:0/3451476583 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc007cb0 con 0x7f03d40d12a0 2024-08-19T00:46:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.397+0000 7f03db800640 1 -- 172.21.15.7:0/3451476583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d40d12a0 msgr2=0x7f03d4169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.397+0000 7f03db800640 1 --2- 172.21.15.7:0/3451476583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d40d12a0 0x7f03d4169290 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009d90 tx=0x7f03cc02a6f0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.397+0000 7f03db800640 1 -- 172.21.15.7:0/3451476583 shutdown_connections 2024-08-19T00:46:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.397+0000 7f03db800640 1 --2- 172.21.15.7:0/3451476583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d40d12a0 0x7f03d4169290 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.397+0000 7f03db800640 1 -- 172.21.15.7:0/3451476583 >> 172.21.15.7:0/3451476583 conn(0x7f03d40d2190 msgr2=0x7f03d40d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.397+0000 7f03db800640 1 -- 172.21.15.7:0/3451476583 shutdown_connections 2024-08-19T00:46:45.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.397+0000 7f03db800640 1 -- 172.21.15.7:0/3451476583 wait complete. 2024-08-19T00:46:45.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.399+0000 7f03db800640 1 Processor -- start 2024-08-19T00:46:45.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.399+0000 7f03db800640 1 -- start start 2024-08-19T00:46:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.400+0000 7f03db800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d409aa70 0x7f03d414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.400+0000 7f03db800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03d409b730 0x7f03d40c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.400+0000 7f03db800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03d40d12a0 0x7f03d40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.400+0000 7f03db800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4169950 con 0x7f03d409b730 2024-08-19T00:46:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.400+0000 7f03db800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03d41697d0 con 0x7f03d409aa70 2024-08-19T00:46:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.400+0000 7f03db800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03d4169ad0 con 0x7f03d40d12a0 2024-08-19T00:46:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d409aa70 0x7f03d414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03d409b730 0x7f03d40c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d409aa70 0x7f03d414b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:43690/0 (socket says 172.21.15.7:43690) 2024-08-19T00:46:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 -- 172.21.15.7:0/2603281709 learned_addr learned my addr 172.21.15.7:0/2603281709 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d9800640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03d40d12a0 0x7f03d40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 -- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03d40d12a0 msgr2=0x7f03d40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03d40d12a0 0x7f03d40b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 -- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03d409b730 msgr2=0x7f03d40c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03d409b730 0x7f03d40c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 -- 172.21.15.7:0/2603281709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d40b79c0 con 0x7f03d409aa70 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d3e00640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03d409b730 0x7f03d40c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.401+0000 7f03d8e00640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d409aa70 0x7f03d414b120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f03c800c410 tx=0x7f03c800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.402+0000 7f03d0c00640 1 -- 172.21.15.7:0/2603281709 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8017070 con 0x7f03d409aa70 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.402+0000 7f03d0c00640 1 -- 172.21.15.7:0/2603281709 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c8005ce0 con 0x7f03d409aa70 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.402+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d40b7ca0 con 0x7f03d409aa70 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.402+0000 7f03d0c00640 1 -- 172.21.15.7:0/2603281709 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c80072f0 con 0x7f03d409aa70 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.403+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d40b3500 con 0x7f03d409aa70 2024-08-19T00:46:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.404+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d4068a90 con 0x7f03d409aa70 2024-08-19T00:46:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.405+0000 7f03d0c00640 1 -- 172.21.15.7:0/2603281709 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03c801a070 con 0x7f03d409aa70 2024-08-19T00:46:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.406+0000 7f03d0c00640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f03b406be60 0x7f03b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.406+0000 7f03d0c00640 1 -- 172.21.15.7:0/2603281709 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7f03c808ac30 con 0x7f03d409aa70 2024-08-19T00:46:45.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.406+0000 7f03d3e00640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f03b406be60 0x7f03b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.407+0000 7f03d3e00640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f03b406be60 0x7f03b406e320 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f03d40a0370 tx=0x7f03c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.410+0000 7f03d0c00640 1 -- 172.21.15.7:0/2603281709 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f03d4068a90 con 0x7f03d409aa70 2024-08-19T00:46:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.631+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03d40b7e70 con 0x7f03d409aa70 2024-08-19T00:46:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.632+0000 7f03d0c00640 1 -- 172.21.15.7:0/2603281709 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 263 v263) ==== 95+0+4387 (secure 0 0 0) 0x7f03c8058610 con 0x7f03d409aa70 2024-08-19T00:46:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:45.634 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":263,"btime":"2024-08-19T00:46:45:397816+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/23553373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":23553373},{"type":"v1","addr":"172.21.15.7:6836","nonce":23553373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":263}],"filesystems":[{"mdsmap":{"epoch":262,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:44.396278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 263 2024-08-19T00:46:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f03b406be60 msgr2=0x7f03b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f03b406be60 0x7f03b406e320 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f03d40a0370 tx=0x7f03c0009040 comp rx=0 tx=0).stop 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d409aa70 msgr2=0x7f03d414b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d409aa70 0x7f03d414b120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f03c800c410 tx=0x7f03c800c8d0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 shutdown_connections 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f03b406be60 0x7f03b406e320 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03d40d12a0 0x7f03d40b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03d409b730 0x7f03d40c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 --2- 172.21.15.7:0/2603281709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d409aa70 0x7f03d414b120 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 >> 172.21.15.7:0/2603281709 conn(0x7f03d40d2190 msgr2=0x7f03d4154870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 shutdown_connections 2024-08-19T00:46:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.634+0000 7f03db800640 1 -- 172.21.15.7:0/2603281709 wait complete. 2024-08-19T00:46:45.651 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 400.00000000' led to DAMAGED state 2024-08-19T00:46:45.651 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 100.00000000.inode' 2024-08-19T00:46:45.651 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:45.651 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:45.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:45.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:45.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:45.687 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:45.762 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:45.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:45.763 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:45.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.959+0000 7f1b51400640 1 Processor -- start 2024-08-19T00:46:45.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.960+0000 7f1b51400640 1 -- start start 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b51400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1b4c0d03c0 0x7f1b4c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b51400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b4c06e710 0x7f1b4c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b51400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c0d0ce0 con 0x7f1b4c0b3750 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b51400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c0cebc0 con 0x7f1b4c06e710 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b51400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c0cdfb0 con 0x7f1b4c0d03c0 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b43e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b4c06e710 0x7f1b4c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b43e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1b4c06e710 0x7f1b4c0d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35564/0 (socket says 172.21.15.7:35564) 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b43e00640 1 -- 172.21.15.7:0/1713538709 learned_addr learned my addr 172.21.15.7:0/1713538709 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.961+0000 7f1b4a800640 1 --2- 172.21.15.7:0/1713538709 >> v2:172.21.15.162:3300/0 conn(0x7f1b4c0d03c0 0x7f1b4c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.962+0000 7f1b43e00640 1 -- 172.21.15.7:0/1713538709 >> v2:172.21.15.162:3300/0 conn(0x7f1b4c0d03c0 msgr2=0x7f1b4c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.962+0000 7f1b43e00640 1 --2- 172.21.15.7:0/1713538709 >> v2:172.21.15.162:3300/0 conn(0x7f1b4c0d03c0 0x7f1b4c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.962+0000 7f1b43e00640 1 -- 172.21.15.7:0/1713538709 >> v1:172.21.15.162:6789/0 conn(0x7f1b4c0b3750 legacy=0x7f1b4c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.962+0000 7f1b43e00640 1 -- 172.21.15.7:0/1713538709 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c0ce290 con 0x7f1b4c06e710 2024-08-19T00:46:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.963+0000 7f1b43e00640 1 --2- 172.21.15.7:0/1713538709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c0d07a0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009870 tx=0x7f1b3402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452800e6f607c54f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:45.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.963+0000 7f1b49e00640 1 -- 172.21.15.7:0/1713538709 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34037070 con 0x7f1b4c06e710 2024-08-19T00:46:45.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.963+0000 7f1b49e00640 1 -- 172.21.15.7:0/1713538709 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b34032440 con 0x7f1b4c06e710 2024-08-19T00:46:45.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.963+0000 7f1b49e00640 1 -- 172.21.15.7:0/1713538709 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34032810 con 0x7f1b4c06e710 2024-08-19T00:46:45.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.963+0000 7f1b51400640 1 -- 172.21.15.7:0/1713538709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 msgr2=0x7f1b4c0d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.963+0000 7f1b51400640 1 --2- 172.21.15.7:0/1713538709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c0d07a0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009870 tx=0x7f1b3402a2a0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.964+0000 7f1b51400640 1 -- 172.21.15.7:0/1713538709 shutdown_connections 2024-08-19T00:46:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.964+0000 7f1b51400640 1 --2- 172.21.15.7:0/1713538709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c0d07a0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.964+0000 7f1b51400640 1 --2- 172.21.15.7:0/1713538709 >> v2:172.21.15.162:3300/0 conn(0x7f1b4c0d03c0 0x7f1b4c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.964+0000 7f1b51400640 1 -- 172.21.15.7:0/1713538709 >> 172.21.15.7:0/1713538709 conn(0x7f1b4c06bc70 msgr2=0x7f1b4c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.964+0000 7f1b51400640 1 -- 172.21.15.7:0/1713538709 shutdown_connections 2024-08-19T00:46:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.964+0000 7f1b51400640 1 -- 172.21.15.7:0/1713538709 wait complete. 2024-08-19T00:46:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.965+0000 7f1b51400640 1 Processor -- start 2024-08-19T00:46:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.965+0000 7f1b51400640 1 -- start start 2024-08-19T00:46:45.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.966+0000 7f1b51400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.966+0000 7f1b51400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b4c0b3750 0x7f1b4c1f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.966+0000 7f1b51400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4c0d03c0 0x7f1b4c1f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.966+0000 7f1b51400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c073ae0 con 0x7f1b4c06e710 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.966+0000 7f1b51400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c0ce850 con 0x7f1b4c0d03c0 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.966+0000 7f1b51400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c073c60 con 0x7f1b4c0b3750 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c15a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35566/0 (socket says 172.21.15.7:35566) 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 -- 172.21.15.7:0/3713282210 learned_addr learned my addr 172.21.15.7:0/3713282210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b43e00640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b4c0b3750 0x7f1b4c1f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4b200640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4c0d03c0 0x7f1b4c1f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 -- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b4c0b3750 msgr2=0x7f1b4c1f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b4c0b3750 0x7f1b4c1f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 -- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4c0d03c0 msgr2=0x7f1b4c1f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4c0d03c0 0x7f1b4c1f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 -- 172.21.15.7:0/3713282210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c1f79f0 con 0x7f1b4c06e710 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4b200640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4c0d03c0 0x7f1b4c1f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.967+0000 7f1b4a800640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c15a880 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00e9b0 tx=0x7f1b3c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.968+0000 7f1b42a00640 1 -- 172.21.15.7:0/3713282210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c017070 con 0x7f1b4c06e710 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.968+0000 7f1b42a00640 1 -- 172.21.15.7:0/3713282210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c00c9a0 con 0x7f1b4c06e710 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.968+0000 7f1b42a00640 1 -- 172.21.15.7:0/3713282210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00cd90 con 0x7f1b4c06e710 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.968+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c09a7b0 con 0x7f1b4c06e710 2024-08-19T00:46:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.968+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c09aff0 con 0x7f1b4c06e710 2024-08-19T00:46:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.969+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c0b3b60 con 0x7f1b4c06e710 2024-08-19T00:46:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.970+0000 7f1b42a00640 1 -- 172.21.15.7:0/3713282210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b3c01a070 con 0x7f1b4c06e710 2024-08-19T00:46:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.971+0000 7f1b42a00640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b2806be30 0x7f1b2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.971+0000 7f1b42a00640 1 -- 172.21.15.7:0/3713282210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7f1b3c08b970 con 0x7f1b4c06e710 2024-08-19T00:46:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.971+0000 7f1b43e00640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b2806be30 0x7f1b2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.972+0000 7f1b43e00640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b2806be30 0x7f1b2806e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1b34034000 tx=0x7f1b3402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:45.975+0000 7f1b42a00640 1 -- 172.21.15.7:0/3713282210 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1b4c09a7b0 con 0x7f1b4c06e710 2024-08-19T00:46:46.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.196+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1b4c0adfc0 con 0x7f1b4c06e710 2024-08-19T00:46:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.403+0000 7f1b42a00640 1 -- 172.21.15.7:0/3713282210 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v264) ==== 161+0+0 (secure 0 0 0) 0x7f1b3c059200 con 0x7f1b4c06e710 2024-08-19T00:46:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b2806be30 msgr2=0x7f1b2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b2806be30 0x7f1b2806e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1b34034000 tx=0x7f1b3402e000 comp rx=0 tx=0).stop 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 msgr2=0x7f1b4c15a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c15a880 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00e9b0 tx=0x7f1b3c00ee70 comp rx=0 tx=0).stop 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 shutdown_connections 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1b2806be30 0x7f1b2806e2f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4c0d03c0 0x7f1b4c1f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b4c0b3750 0x7f1b4c1f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 --2- 172.21.15.7:0/3713282210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b4c06e710 0x7f1b4c15a880 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.405+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 >> 172.21.15.7:0/3713282210 conn(0x7f1b4c06bc70 msgr2=0x7f1b4c0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.406+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 shutdown_connections 2024-08-19T00:46:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.406+0000 7f1b51400640 1 -- 172.21.15.7:0/3713282210 wait complete. 2024-08-19T00:46:46.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:46.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.579+0000 7fc579000640 1 Processor -- start 2024-08-19T00:46:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.579+0000 7fc579000640 1 -- start start 2024-08-19T00:46:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.580+0000 7fc579000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc57415bd70 0x7fc574072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.580+0000 7fc579000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57406dd10 0x7fc57415cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.580+0000 7fc579000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5740733f0 con 0x7fc574072f70 2024-08-19T00:46:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.580+0000 7fc579000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc5740736d0 con 0x7fc57415bd70 2024-08-19T00:46:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.580+0000 7fc579000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5740739b0 con 0x7fc57406dd10 2024-08-19T00:46:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.580+0000 7fc572a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc574072f70 0x7fc57406d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36734/0 (socket says 172.21.15.7:36734) 2024-08-19T00:46:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.580+0000 7fc572a00640 1 -- 172.21.15.7:0/2793945154 learned_addr learned my addr 172.21.15.7:0/2793945154 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:46.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc573400640 1 --2- 172.21.15.7:0/2793945154 >> v2:172.21.15.162:3300/0 conn(0x7fc57415bd70 0x7fc574072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:46.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc573e00640 1 --2- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57406dd10 0x7fc57415cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:46.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc572000640 1 -- 172.21.15.7:0/2793945154 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504985613 0 0) 0x7fc5740733f0 con 0x7fc574072f70 2024-08-19T00:46:46.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc572000640 1 -- 172.21.15.7:0/2793945154 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc558003520 con 0x7fc574072f70 2024-08-19T00:46:46.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc573400640 1 -- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57406dd10 msgr2=0x7fc57415cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:46.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc573400640 1 --2- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57406dd10 0x7fc57415cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc573400640 1 -- 172.21.15.7:0/2793945154 >> v1:172.21.15.7:6789/0 conn(0x7fc574072f70 legacy=0x7fc57406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:46.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.581+0000 7fc573400640 1 -- 172.21.15.7:0/2793945154 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57415c4a0 con 0x7fc57415bd70 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.582+0000 7fc573400640 1 --2- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57415bd70 0x7fc574072a30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc5640097a0 tx=0x7fc56402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8900df6d0ccdd07 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.582+0000 7fc572000640 1 -- 172.21.15.7:0/2793945154 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564037070 con 0x7fc57415bd70 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc572000640 1 -- 172.21.15.7:0/2793945154 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc564032440 con 0x7fc57415bd70 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc572000640 1 -- 172.21.15.7:0/2793945154 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5640327f0 con 0x7fc57415bd70 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 -- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57415bd70 msgr2=0x7fc574072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 --2- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57415bd70 0x7fc574072a30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc5640097a0 tx=0x7fc56402a180 comp rx=0 tx=0).stop 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 -- 172.21.15.7:0/2793945154 shutdown_connections 2024-08-19T00:46:46.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 --2- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57406dd10 0x7fc57415cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 --2- 172.21.15.7:0/2793945154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57415bd70 0x7fc574072a30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 -- 172.21.15.7:0/2793945154 >> 172.21.15.7:0/2793945154 conn(0x7fc57406b850 msgr2=0x7fc57406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:46.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 -- 172.21.15.7:0/2793945154 shutdown_connections 2024-08-19T00:46:46.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.583+0000 7fc579000640 1 -- 172.21.15.7:0/2793945154 wait complete. 2024-08-19T00:46:46.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.585+0000 7fc579000640 1 Processor -- start 2024-08-19T00:46:46.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.585+0000 7fc579000640 1 -- start start 2024-08-19T00:46:46.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc579000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57406dd10 0x7fc574155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc579000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc574072f70 0x7fc57415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc579000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57415bd70 0x7fc5741453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc579000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc57406e3a0 con 0x7fc574072f70 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc579000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc57415c150 con 0x7fc57406dd10 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc579000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc57406e520 con 0x7fc57415bd70 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc574072f70 0x7fc57415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc574072f70 0x7fc57415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35578/0 (socket says 172.21.15.7:35578) 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 -- 172.21.15.7:0/2038696206 learned_addr learned my addr 172.21.15.7:0/2038696206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc573e00640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57415bd70 0x7fc5741453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc573400640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57406dd10 0x7fc574155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 -- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57415bd70 msgr2=0x7fc5741453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57415bd70 0x7fc5741453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 -- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57406dd10 msgr2=0x7fc574155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57406dd10 0x7fc574155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.586+0000 7fc572a00640 1 -- 172.21.15.7:0/2038696206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc574154090 con 0x7fc574072f70 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.587+0000 7fc572a00640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc574072f70 0x7fc57415a600 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fc56000c430 tx=0x7fc56000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.587+0000 7fc56b400640 1 -- 172.21.15.7:0/2038696206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560017070 con 0x7fc574072f70 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.587+0000 7fc56b400640 1 -- 172.21.15.7:0/2038696206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560005ce0 con 0x7fc574072f70 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.587+0000 7fc56b400640 1 -- 172.21.15.7:0/2038696206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5600072f0 con 0x7fc574072f70 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.587+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc574154370 con 0x7fc574072f70 2024-08-19T00:46:46.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.587+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc574154930 con 0x7fc574072f70 2024-08-19T00:46:46.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.588+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57415cca0 con 0x7fc574072f70 2024-08-19T00:46:46.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.589+0000 7fc56b400640 1 -- 172.21.15.7:0/2038696206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc56001a070 con 0x7fc574072f70 2024-08-19T00:46:46.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.590+0000 7fc56b400640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be60 0x7fc55406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:46.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.590+0000 7fc56b400640 1 -- 172.21.15.7:0/2038696206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7fc56008ad50 con 0x7fc574072f70 2024-08-19T00:46:46.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.590+0000 7fc573400640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be60 0x7fc55406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:46.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.591+0000 7fc573400640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be60 0x7fc55406e320 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc564034000 tx=0x7fc56402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:46.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.595+0000 7fc56b400640 1 -- 172.21.15.7:0/2038696206 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc560058c30 con 0x7fc574072f70 2024-08-19T00:46:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:46.849+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fc574155c40 con 0x7fc574072f70 2024-08-19T00:46:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.408+0000 7fc56b400640 1 -- 172.21.15.7:0/2038696206 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v265) ==== 101+0+0 (secure 0 0 0) 0x7fc560058530 con 0x7fc574072f70 2024-08-19T00:46:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:47.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.410+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be60 msgr2=0x7fc55406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.410+0000 7fc579000640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be60 0x7fc55406e320 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc564034000 tx=0x7fc56402e000 comp rx=0 tx=0).stop 2024-08-19T00:46:47.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.410+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc574072f70 msgr2=0x7fc57415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.410+0000 7fc579000640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc574072f70 0x7fc57415a600 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fc56000c430 tx=0x7fc56000c8f0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 shutdown_connections 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be60 0x7fc55406e320 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc57415bd70 0x7fc5741453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc574072f70 0x7fc57415a600 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 --2- 172.21.15.7:0/2038696206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57406dd10 0x7fc574155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 >> 172.21.15.7:0/2038696206 conn(0x7fc57406b850 msgr2=0x7fc5740b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 shutdown_connections 2024-08-19T00:46:47.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.411+0000 7fc579000640 1 -- 172.21.15.7:0/2038696206 wait complete. 2024-08-19T00:46:47.430 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:47.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.506+0000 7fed1db67f40 1 Processor -- start 2024-08-19T00:46:47.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.506+0000 7fed1db67f40 1 -- start start 2024-08-19T00:46:47.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.507+0000 7fed1db67f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbf2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.507+0000 7fed1db67f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c5b0 0x558dddb1a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.507+0000 7fed1db67f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c990 0x558dddbe38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.507+0000 7fed1db67f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558dddb4b8f0 con 0x558dddb4c990 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.507+0000 7fed1db67f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558dddac0d00 con 0x558dddb4af40 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.507+0000 7fed1db67f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558dddbf1dc0 con 0x558dddb4c5b0 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.507+0000 7fed1b800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c990 0x558dddbe38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c990 0x558dddbe38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35588/0 (socket says 172.21.15.7:35588) 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 -- 172.21.15.7:0/1123109336 learned_addr learned my addr 172.21.15.7:0/1123109336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 -- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c5b0 msgr2=0x558dddb1a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c5b0 0x558dddb1a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 -- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 msgr2=0x558dddbf2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1ae00640 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbf2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbf2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 -- 172.21.15.7:0/1123109336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ddda45b30 con 0x558dddb4c990 2024-08-19T00:46:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1ae00640 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbf2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed1b800640 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c990 0x558dddbe38d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fed14054040 tx=0x7fed14050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc97177714ec980 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.508+0000 7fed19000640 1 -- 172.21.15.7:0/1123109336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14051ae0 con 0x558dddb4c990 2024-08-19T00:46:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed19000640 1 -- 172.21.15.7:0/1123109336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1404e040 con 0x558dddb4c990 2024-08-19T00:46:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed19000640 1 -- 172.21.15.7:0/1123109336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14066480 con 0x558dddb4c990 2024-08-19T00:46:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 -- 172.21.15.7:0/1123109336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c990 msgr2=0x558dddbe38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c990 0x558dddbe38d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fed14054040 tx=0x7fed14050000 comp rx=0 tx=0).stop 2024-08-19T00:46:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 -- 172.21.15.7:0/1123109336 shutdown_connections 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c990 0x558dddbe38d0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c5b0 0x558dddb1a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 --2- 172.21.15.7:0/1123109336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbf2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 -- 172.21.15.7:0/1123109336 >> 172.21.15.7:0/1123109336 conn(0x558dddb494e0 msgr2=0x558dddb498c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 -- 172.21.15.7:0/1123109336 shutdown_connections 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.509+0000 7fed1db67f40 1 -- 172.21.15.7:0/1123109336 wait complete. 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.510+0000 7fed1db67f40 1 Processor -- start 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.510+0000 7fed1db67f40 1 -- start start 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1db67f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbdb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1db67f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c5b0 0x558dddbdd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1db67f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c990 0x558dddbe36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1db67f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558dddbe6270 con 0x558dddb4c5b0 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1db67f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558dddbe5fd0 con 0x558dddb4af40 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1db67f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558dddbe6550 con 0x558dddb4c990 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c5b0 0x558dddbdd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c5b0 0x558dddbdd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35602/0 (socket says 172.21.15.7:35602) 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 learned_addr learned my addr 172.21.15.7:0/761175574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1ae00640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbdb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.511+0000 7fed1b800640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c990 0x558dddbe36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c990 msgr2=0x558dddbe36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1a400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c990 0x558dddbe36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 msgr2=0x558dddbdb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1a400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dddb4af40 0x558dddbdb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ddda82080 con 0x558dddb4c5b0 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1b800640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558dddb4c990 0x558dddbe36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1a400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c5b0 0x558dddbdd9f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fed0800ab50 tx=0x7fed080086d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed13400640 1 -- 172.21.15.7:0/761175574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08014670 con 0x558dddb4c5b0 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed13400640 1 -- 172.21.15.7:0/761175574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0800f070 con 0x558dddb4c5b0 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed13400640 1 -- 172.21.15.7:0/761175574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08014a50 con 0x558dddb4c5b0 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dddbddf30 con 0x558dddb4c5b0 2024-08-19T00:46:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.512+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dddbdcbe0 con 0x558dddb4c5b0 2024-08-19T00:46:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.514+0000 7fed13400640 1 -- 172.21.15.7:0/761175574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed0800b3f0 con 0x558dddb4c5b0 2024-08-19T00:46:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.515+0000 7fed13400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecfc06a840 0x7fecfc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.515+0000 7fed13400640 1 -- 172.21.15.7:0/761175574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7fed0808a400 con 0x558dddb4c5b0 2024-08-19T00:46:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.515+0000 7fed1ae00640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecfc06a840 0x7fecfc06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.518 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.516+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558dddb66dc0 0x558dddbe9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.516+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddbe5c00 con 0x558dddb66dc0 2024-08-19T00:46:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.516+0000 7fed1ae00640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecfc06a840 0x7fecfc06cd00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00b840 tx=0x7fed0c00d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.516+0000 7fed1b800640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558dddb66dc0 0x558dddbe9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.517+0000 7fed1b800640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558dddb66dc0 0x558dddbe9d00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.519+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v116'908 uv882 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.519+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddbe0bd0 con 0x558dddb66dc0 2024-08-19T00:46:47.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.521+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v116'909 uv909 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.521+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddbea240 con 0x558dddb66dc0 2024-08-19T00:46:47.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.522+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v116'910 uv910 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.524 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:47.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.522+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94ce0 con 0x558dddb66dc0 2024-08-19T00:46:47.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.524+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v116'911 uv911 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.524+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95080 con 0x558dddb66dc0 2024-08-19T00:46:47.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.525+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v116'912 uv912 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.525+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc93cd0 con 0x558dddb66dc0 2024-08-19T00:46:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.527+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v116'913 uv913 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.527+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94070 con 0x558dddb66dc0 2024-08-19T00:46:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.528+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v116'914 uv888 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.528+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.530+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v116'915 uv915 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.530+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.531+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v116'916 uv916 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.533 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.531+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.533+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v116'917 uv917 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.533+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.534+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v116'918 uv918 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.534+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.536+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v116'919 uv919 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.536+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.537+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v116'920 uv895 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.537+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.539+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v116'921 uv921 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.539+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.540+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v116'922 uv922 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.542 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.540+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.542+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v116'923 uv923 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.542+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.543+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v116'924 uv924 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.543+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc94410 con 0x558dddb66dc0 2024-08-19T00:46:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.545+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v116'925 uv925 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.545+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.546+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v116'926 uv926 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.546+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.548+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v116'927 uv901 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.548+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.550+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v116'928 uv928 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.550+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.553 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.551+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v116'929 uv929 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.551+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc96430 con 0x558dddb66dc0 2024-08-19T00:46:47.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.552+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v116'930 uv930 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.552+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc96430 con 0x558dddb66dc0 2024-08-19T00:46:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.554+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v116'931 uv931 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.554+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.556+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v116'932 uv932 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.556+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.557+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v116'933 uv907 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.557+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.559+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v116'934 uv934 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.559+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.561 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:47.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.560+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v116'935 uv935 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.560+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc96430 con 0x558dddb66dc0 2024-08-19T00:46:47.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.561+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v116'936 uv936 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.561+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc96430 con 0x558dddb66dc0 2024-08-19T00:46:47.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.563+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v116'937 uv937 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.563+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc95420 con 0x558dddb66dc0 2024-08-19T00:46:47.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.564+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v116'938 uv938 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.564+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558dddc95930 0x558dddc97d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.565+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc98260 con 0x558dddc95930 2024-08-19T00:46:47.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.565+0000 7fed1ae00640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558dddc95930 0x558dddc97d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.565+0000 7fed1ae00640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558dddc95930 0x558dddc97d20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.568+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v116'659 uv642 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.568+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc98600 con 0x558dddc95930 2024-08-19T00:46:47.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.569+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v116'660 uv660 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.569+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc989a0 con 0x558dddc95930 2024-08-19T00:46:47.572 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:47.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.571+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v116'661 uv661 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.571+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc98d40 con 0x558dddc95930 2024-08-19T00:46:47.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.573+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v116'662 uv662 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.573+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc990e0 con 0x558dddc95930 2024-08-19T00:46:47.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.574+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v116'663 uv663 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.575+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99480 con 0x558dddc95930 2024-08-19T00:46:47.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.576+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v116'664 uv647 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.576+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99820 con 0x558dddc95930 2024-08-19T00:46:47.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.578+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v116'665 uv665 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.578+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.581 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:47.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.579+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v116'666 uv666 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.579+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.581+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v116'667 uv667 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.581+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.583+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v116'668 uv668 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.583+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.584+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v116'669 uv652 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.584+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.586+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v116'670 uv670 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.586+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.589 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.588+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v116'671 uv671 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.588+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9e2b0 con 0x558dddc95930 2024-08-19T00:46:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.590+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v116'672 uv672 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.590+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9e2b0 con 0x558dddc95930 2024-08-19T00:46:47.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.591+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v116'673 uv673 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.591+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.593+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v116'674 uv658 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.593+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.594+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v116'675 uv675 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.594+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.597 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.596+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v116'676 uv676 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.596+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9abd0 con 0x558dddc95930 2024-08-19T00:46:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.597+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v116'677 uv677 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.597+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9abd0 con 0x558dddc95930 2024-08-19T00:46:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.599+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v116'678 uv678 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.599+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc99bc0 con 0x558dddc95930 2024-08-19T00:46:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.600+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v116'679 uv679 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddc95930 2024-08-19T00:46:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.600+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558dddc9a0d0 0x558dddc9c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.600+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9ca00 con 0x558dddc9a0d0 2024-08-19T00:46:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.601+0000 7fed1a400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558dddc9a0d0 0x558dddc9c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.601+0000 7fed1a400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558dddc9a0d0 0x558dddc9c4c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.603+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v116'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.603+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9cea0 con 0x558dddc9a0d0 2024-08-19T00:46:47.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.604+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v116'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.604+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9d380 con 0x558dddc9a0d0 2024-08-19T00:46:47.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.605+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v116'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.607 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:47.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.605+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9ec30 con 0x558dddc9a0d0 2024-08-19T00:46:47.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.607+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v116'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.607+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9efd0 con 0x558dddc9a0d0 2024-08-19T00:46:47.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.608+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v116'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.608+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9dc20 con 0x558dddc9a0d0 2024-08-19T00:46:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.609+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v116'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.609+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9e010 con 0x558dddb66dc0 2024-08-19T00:46:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.611+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v116'130 uv129 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.611+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9e010 con 0x558dddb66dc0 2024-08-19T00:46:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.612+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v116'131 uv131 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.612+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9e010 con 0x558dddb66dc0 2024-08-19T00:46:47.615 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:47.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.614+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v116'132 uv132 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.614+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddc9e010 con 0x558dddb66dc0 2024-08-19T00:46:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.615+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v116'133 uv133 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.616+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558dddc9e690 0x558dddca1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.616+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca18c0 con 0x558dddc9e690 2024-08-19T00:46:47.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.616+0000 7fed1b800640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558dddc9e690 0x558dddca1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.617+0000 7fed1b800640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558dddc9e690 0x558dddca1380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.618+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v116'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.618+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca18c0 con 0x558dddc9e690 2024-08-19T00:46:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.619+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v116'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.619+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca1940 con 0x558dddc9e690 2024-08-19T00:46:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.621+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v116'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.622 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.621+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca2d70 con 0x558dddc9e690 2024-08-19T00:46:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.622+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v116'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.622+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca2d70 con 0x558dddc9e690 2024-08-19T00:46:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.623+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v116'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.623+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca1d60 con 0x558dddc9e690 2024-08-19T00:46:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.624+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v116'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.624+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558dddca2270 0x558dddca4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.624+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca4c90 con 0x558dddca2270 2024-08-19T00:46:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.625+0000 7fed1ae00640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558dddca2270 0x558dddca4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.625+0000 7fed1ae00640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558dddca2270 0x558dddca4660 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.627+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v116'327 uv321 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.627+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.628+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v116'328 uv328 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.628+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.631 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.630+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v116'329 uv329 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.630+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca6070 con 0x558dddca2270 2024-08-19T00:46:47.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.631+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v116'330 uv330 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.631+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca6070 con 0x558dddca2270 2024-08-19T00:46:47.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.633+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v116'331 uv331 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.633+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.634+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v116'332 uv332 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.634+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.636+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v116'333 uv326 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.636+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.637+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v116'334 uv334 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.637+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.640 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:47.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.639+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v116'335 uv335 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.639+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.640+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v116'336 uv336 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.640+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca5060 con 0x558dddca2270 2024-08-19T00:46:47.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.641+0000 7fed1ae00640 1 -- 172.21.15.7:0/761175574 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v116'337 uv337 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed0c007870 con 0x558dddca2270 2024-08-19T00:46:47.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.641+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558dddca5960 0x558dddca7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.641+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8290 con 0x558dddca5960 2024-08-19T00:46:47.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.642+0000 7fed1a400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558dddca5960 0x558dddca7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.642+0000 7fed1a400640 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558dddca5960 0x558dddca7d50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.643+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v116'148 uv147 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.643+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8290 con 0x558dddca5960 2024-08-19T00:46:47.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.645+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v116'149 uv149 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.645+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddca5960 2024-08-19T00:46:47.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.646+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v116'150 uv150 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.647 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:47.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.646+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddca5960 2024-08-19T00:46:47.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.647+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v116'151 uv151 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.647+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddca5960 2024-08-19T00:46:47.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.649+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v116'152 uv152 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.649+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddb66dc0 2024-08-19T00:46:47.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.651+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v116'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.651+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddb66dc0 2024-08-19T00:46:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.652+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v116'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.652+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddb66dc0 2024-08-19T00:46:47.655 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.654+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v116'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.654+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca96f0 con 0x558dddb66dc0 2024-08-19T00:46:47.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.655+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v116'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.655+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca96f0 con 0x558dddb66dc0 2024-08-19T00:46:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.656+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v116'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.656+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddb66dc0 2024-08-19T00:46:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.657+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v116'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddb66dc0 2024-08-19T00:46:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.658+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.659+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v116'294 uv288 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.659+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.660+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v116'295 uv295 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.660+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.662+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v116'296 uv296 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.663 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:47.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.662+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.663+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v116'297 uv297 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.663+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.665+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v116'298 uv298 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.665+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.666+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v116'299 uv293 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.666+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.668+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v116'300 uv300 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.668+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.670 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.669+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v116'301 uv301 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.669+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca86e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.671+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v116'302 uv302 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.671+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddcab4f0 con 0x558dddc9a0d0 2024-08-19T00:46:47.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.672+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v116'303 uv303 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddc9a0d0 2024-08-19T00:46:47.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.673+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.676+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v116'128 uv127 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.676+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.677+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v116'129 uv129 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.677+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.680 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:47.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.678+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v116'130 uv130 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.678+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.680+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v116'131 uv131 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.680+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.681+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v116'177 uv176 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.681+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.682+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v116'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.682+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.684+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v116'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.686 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.684+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.686+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v116'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.686+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca9ba0 con 0x558dddc9e690 2024-08-19T00:46:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.687+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v116'181 uv181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.687+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddc9e690 2024-08-19T00:46:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.689+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v116'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed14051ae0 con 0x558dddc9e690 2024-08-19T00:46:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.689+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.691+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v116'151 uv150 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.691+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.692+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v116'152 uv152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.692+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.694 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.693+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v116'153 uv153 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.693+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.694+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v116'154 uv154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.694+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.695+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v116'155 uv155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.695+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.697+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v116'363 uv355 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.697+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.698+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v116'364 uv364 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.699+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.700+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v116'365 uv365 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.701 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.700+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.701+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v116'366 uv366 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.701+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.703+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v116'367 uv367 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.703+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.704+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v116'368 uv362 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.704+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.706+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v116'369 uv369 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.706+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.709 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.707+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v116'370 uv370 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.707+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca9ba0 con 0x558dddca5960 2024-08-19T00:46:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.709+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v116'371 uv371 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.709+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca9ba0 con 0x558dddca5960 2024-08-19T00:46:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.710+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v116'372 uv372 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.710+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca8b90 con 0x558dddca5960 2024-08-19T00:46:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.712+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v116'373 uv373 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.712+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x558dddca90f0 con 0x558dddca5960 2024-08-19T00:46:47.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1a400640 1 -- 172.21.15.7:0/761175574 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v116'374 uv374 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed080542e0 con 0x558dddca5960 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558dddc95930 msgr2=0x558dddc97d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x558dddc95930 0x558dddc97d20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558dddca2270 msgr2=0x558dddca4660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x558dddca2270 0x558dddca4660 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558dddca5960 msgr2=0x558dddca7d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x558dddca5960 0x558dddca7d50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558dddc9a0d0 msgr2=0x558dddc9c4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x558dddc9a0d0 0x558dddc9c4c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558dddb66dc0 msgr2=0x558dddbe9d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558dddb66dc0 0x558dddbe9d00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1b800640 1 -- 172.21.15.7:0/761175574 reap_dead start 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558dddc9e690 msgr2=0x558dddca1380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558dddc9e690 0x558dddca1380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecfc06a840 msgr2=0x7fecfc06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecfc06a840 0x7fecfc06cd00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00b840 tx=0x7fed0c00d040 comp rx=0 tx=0).stop 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c5b0 msgr2=0x558dddbdd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c5b0 0x558dddbdd9f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fed0800ab50 tx=0x7fed080086d0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 shutdown_connections 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x558dddb66dc0 0x558dddbe9d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fecfc06a840 0x7fecfc06cd00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558dddb4c5b0 0x558dddbdd9f0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 --2- 172.21.15.7:0/761175574 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x558dddc9e690 0x558dddca1380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 >> 172.21.15.7:0/761175574 conn(0x558dddb494e0 msgr2=0x558dddb498c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.713+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 shutdown_connections 2024-08-19T00:46:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.714+0000 7fed1db67f40 1 -- 172.21.15.7:0/761175574 wait complete. 2024-08-19T00:46:47.719 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 100.00000000.inode 0 2024-08-19T00:46:47.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.834+0000 7faa8b6cff40 1 Processor -- start 2024-08-19T00:46:47.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.835+0000 7faa8b6cff40 1 -- start start 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.835+0000 7faa8b6cff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd0d0380 0x563bcd0fb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.835+0000 7faa8b6cff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.835+0000 7faa8b6cff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd18aff0 0x563bcd0ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.835+0000 7faa8b6cff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563bcd11a450 con 0x563bcd0d1b90 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.835+0000 7faa8b6cff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563bcd075d00 con 0x563bcd0d0380 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.835+0000 7faa8b6cff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563bcd0d10b0 con 0x563bcd18aff0 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd0ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35614/0 (socket says 172.21.15.7:35614) 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 -- 172.21.15.7:0/1893510365 learned_addr learned my addr 172.21.15.7:0/1893510365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:47.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa88800640 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd0d0380 0x563bcd0fb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa89200640 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd18aff0 0x563bcd0ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 -- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd18aff0 msgr2=0x563bcd0ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd18aff0 0x563bcd0ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 -- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd0d0380 msgr2=0x563bcd0fb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd0d0380 0x563bcd0fb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 -- 172.21.15.7:0/1893510365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bccffab30 con 0x563bcd0d1b90 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa89200640 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd18aff0 0x563bcd0ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:47.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.836+0000 7faa87e00640 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd0ce170 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7faa7400a440 tx=0x7faa74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cbebb9469485bb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa86a00640 1 -- 172.21.15.7:0/1893510365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74056930 con 0x563bcd0d1b90 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa86a00640 1 -- 172.21.15.7:0/1893510365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa74056ad0 con 0x563bcd0d1b90 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa86a00640 1 -- 172.21.15.7:0/1893510365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74054440 con 0x563bcd0d1b90 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 -- 172.21.15.7:0/1893510365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 msgr2=0x563bcd0ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd0ce170 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7faa7400a440 tx=0x7faa74051000 comp rx=0 tx=0).stop 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 -- 172.21.15.7:0/1893510365 shutdown_connections 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd18aff0 0x563bcd0ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd0ce170 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/1893510365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd0d0380 0x563bcd0fb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 -- 172.21.15.7:0/1893510365 >> 172.21.15.7:0/1893510365 conn(0x563bcd0fc5d0 msgr2=0x563bcd1a3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 -- 172.21.15.7:0/1893510365 shutdown_connections 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.837+0000 7faa8b6cff40 1 -- 172.21.15.7:0/1893510365 wait complete. 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.838+0000 7faa8b6cff40 1 Processor -- start 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.838+0000 7faa8b6cff40 1 -- start start 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa8b6cff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd0d0380 0x563bcd0f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa8b6cff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd189970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa8b6cff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd18aff0 0x563bcd1a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa8b6cff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563bcd0fe490 con 0x563bcd0d1b90 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa8b6cff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563bcd18d470 con 0x563bcd18aff0 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa8b6cff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563bcd1a3210 con 0x563bcd0d0380 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa87e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd189970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa87e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd189970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35616/0 (socket says 172.21.15.7:35616) 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa87e00640 1 -- 172.21.15.7:0/3966371072 learned_addr learned my addr 172.21.15.7:0/3966371072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa88800640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd0d0380 0x563bcd0f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.839+0000 7faa89200640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd18aff0 0x563bcd1a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa87e00640 1 -- 172.21.15.7:0/3966371072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd0d0380 msgr2=0x563bcd0f9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa87e00640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563bcd0d0380 0x563bcd0f9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa87e00640 1 -- 172.21.15.7:0/3966371072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd18aff0 msgr2=0x563bcd1a2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa87e00640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563bcd18aff0 0x563bcd1a2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa87e00640 1 -- 172.21.15.7:0/3966371072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bcd037080 con 0x563bcd0d1b90 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa87e00640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd189970 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7faa74056040 tx=0x7faa74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa85600640 1 -- 172.21.15.7:0/3966371072 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74056c80 con 0x563bcd0d1b90 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa85600640 1 -- 172.21.15.7:0/3966371072 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa74056e20 con 0x563bcd0d1b90 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa85600640 1 -- 172.21.15.7:0/3966371072 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7400a270 con 0x563bcd0d1b90 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bcd1888d0 con 0x563bcd0d1b90 2024-08-19T00:46:47.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.840+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bcd188e90 con 0x563bcd0d1b90 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.842+0000 7faa85600640 1 -- 172.21.15.7:0/3966371072 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa74054440 con 0x563bcd0d1b90 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.843+0000 7faa85600640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa6806a840 0x7faa6806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.843+0000 7faa85600640 1 -- 172.21.15.7:0/3966371072 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7faa740d00f0 con 0x563bcd0d1b90 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.843+0000 7faa88800640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa6806a840 0x7faa6806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.843+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563bcd0ff700 0x563bcd113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.843+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:fe07bba1:::100.00000000.inode:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x563bcd114140 con 0x563bcd0ff700 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.844+0000 7faa89200640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563bcd0ff700 0x563bcd113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.844+0000 7faa88800640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa6806a840 0x7faa6806cd00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009880 tx=0x7faa7c00e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.844+0000 7faa89200640 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563bcd0ff700 0x563bcd113c00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa89200640 1 -- 172.21.15.7:0/3966371072 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 100.00000000.inode [truncate 0] v116'375 uv375 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7faa80001950 con 0x563bcd0ff700 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563bcd0ff700 msgr2=0x563bcd113c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563bcd0ff700 0x563bcd113c00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa6806a840 msgr2=0x7faa6806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7faa6806a840 0x7faa6806cd00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009880 tx=0x7faa7c00e040 comp rx=0 tx=0).stop 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 msgr2=0x563bcd189970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 --2- 172.21.15.7:0/3966371072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bcd0d1b90 0x563bcd189970 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7faa74056040 tx=0x7faa74002fb0 comp rx=0 tx=0).stop 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa89200640 1 -- 172.21.15.7:0/3966371072 reap_dead start 2024-08-19T00:46:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 shutdown_connections 2024-08-19T00:46:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 >> 172.21.15.7:0/3966371072 conn(0x563bcd0fc5d0 msgr2=0x563bcd0d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 shutdown_connections 2024-08-19T00:46:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:47.846+0000 7faa8b6cff40 1 -- 172.21.15.7:0/3966371072 wait complete. 2024-08-19T00:46:47.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:48.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.010+0000 7f050ce00640 1 Processor -- start 2024-08-19T00:46:48.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.010+0000 7f050ce00640 1 -- start start 2024-08-19T00:46:48.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f050ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05080b5130 0x7f05080aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f050ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f05080af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f050ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080acef0 con 0x7f050815bfb0 2024-08-19T00:46:48.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f050ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f05080af650 con 0x7f05080b5130 2024-08-19T00:46:48.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f050ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05080ad790 con 0x7f050815c390 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f0505e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f050815bfb0 0x7f05080b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:34696/0 (socket says 172.21.15.7:34696) 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f04fd400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05080b5130 0x7f05080aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f0505e00640 1 -- 172.21.15.7:0/843381377 learned_addr learned my addr 172.21.15.7:0/843381377 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.011+0000 7f0506800640 1 --2- 172.21.15.7:0/843381377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f05080af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.012+0000 7f0505400640 1 -- 172.21.15.7:0/843381377 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37998651 0 0) 0x7f05080acef0 con 0x7f050815bfb0 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.012+0000 7f0505400640 1 -- 172.21.15.7:0/843381377 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04ec003520 con 0x7f050815bfb0 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.012+0000 7f0506800640 1 -- 172.21.15.7:0/843381377 >> v2:172.21.15.7:3300/0 conn(0x7f05080b5130 msgr2=0x7f05080aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.012+0000 7f0506800640 1 --2- 172.21.15.7:0/843381377 >> v2:172.21.15.7:3300/0 conn(0x7f05080b5130 0x7f05080aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.012+0000 7f0506800640 1 -- 172.21.15.7:0/843381377 >> v1:172.21.15.162:6789/0 conn(0x7f050815bfb0 legacy=0x7f05080b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.012+0000 7f0506800640 1 -- 172.21.15.7:0/843381377 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080ad1d0 con 0x7f050815c390 2024-08-19T00:46:48.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.012+0000 7f04fd400640 1 --2- 172.21.15.7:0/843381377 >> v2:172.21.15.7:3300/0 conn(0x7f05080b5130 0x7f05080aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:48.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.013+0000 7f0506800640 1 --2- 172.21.15.7:0/843381377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f05080af110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d90 tx=0x7f050002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4e6464aa0b2326 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:48.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.013+0000 7f0505400640 1 -- 172.21.15.7:0/843381377 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500007740 con 0x7f050815c390 2024-08-19T00:46:48.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.013+0000 7f0505400640 1 -- 172.21.15.7:0/843381377 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05000078e0 con 0x7f050815c390 2024-08-19T00:46:48.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.013+0000 7f0505400640 1 -- 172.21.15.7:0/843381377 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500007cb0 con 0x7f050815c390 2024-08-19T00:46:48.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 -- 172.21.15.7:0/843381377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 msgr2=0x7f05080af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 --2- 172.21.15.7:0/843381377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f05080af110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d90 tx=0x7f050002a660 comp rx=0 tx=0).stop 2024-08-19T00:46:48.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 -- 172.21.15.7:0/843381377 shutdown_connections 2024-08-19T00:46:48.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 --2- 172.21.15.7:0/843381377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f05080af110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 --2- 172.21.15.7:0/843381377 >> v2:172.21.15.7:3300/0 conn(0x7f05080b5130 0x7f05080aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 -- 172.21.15.7:0/843381377 >> 172.21.15.7:0/843381377 conn(0x7f05080b2300 msgr2=0x7f050806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:48.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 -- 172.21.15.7:0/843381377 shutdown_connections 2024-08-19T00:46:48.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.014+0000 7f050ce00640 1 -- 172.21.15.7:0/843381377 wait complete. 2024-08-19T00:46:48.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.016+0000 7f050ce00640 1 Processor -- start 2024-08-19T00:46:48.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.016+0000 7f050ce00640 1 -- start start 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f050ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080b5130 0x7f050809c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f050ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050815bfb0 0x7f0508153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f050ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f050809ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f050ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0508072040 con 0x7f050815bfb0 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f050ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0508071b20 con 0x7f05080b5130 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f050ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05080721c0 con 0x7f050815c390 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050815bfb0 0x7f0508153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050815bfb0 0x7f0508153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35638/0 (socket says 172.21.15.7:35638) 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 -- 172.21.15.7:0/241715983 learned_addr learned my addr 172.21.15.7:0/241715983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f0506800640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f050809ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f0505e00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080b5130 0x7f050809c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 -- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 msgr2=0x7f050809ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f050809ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 -- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080b5130 msgr2=0x7f050809c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080b5130 0x7f050809c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.017+0000 7f04fd400640 1 -- 172.21.15.7:0/241715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050809d7e0 con 0x7f050815bfb0 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.018+0000 7f04fd400640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050815bfb0 0x7f0508153750 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f04f000ebe0 tx=0x7f04f000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.018+0000 7f04fea00640 1 -- 172.21.15.7:0/241715983 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0017070 con 0x7f050815bfb0 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.018+0000 7f04fea00640 1 -- 172.21.15.7:0/241715983 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f000cc30 con 0x7f050815bfb0 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.018+0000 7f04fea00640 1 -- 172.21.15.7:0/241715983 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0013470 con 0x7f050815bfb0 2024-08-19T00:46:48.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.018+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050809dac0 con 0x7f050815bfb0 2024-08-19T00:46:48.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.018+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050809be40 con 0x7f050815bfb0 2024-08-19T00:46:48.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.019+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05080b3e00 con 0x7f050815bfb0 2024-08-19T00:46:48.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.020+0000 7f04fea00640 1 -- 172.21.15.7:0/241715983 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04f001a070 con 0x7f050815bfb0 2024-08-19T00:46:48.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.022+0000 7f04fea00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f04e406be30 0x7f04e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.022+0000 7f04fea00640 1 -- 172.21.15.7:0/241715983 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8289+0+0 (secure 0 0 0) 0x7f04f008bad0 con 0x7f050815bfb0 2024-08-19T00:46:48.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.022+0000 7f0505e00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f04e406be30 0x7f04e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.023+0000 7f0505e00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f04e406be30 0x7f04e406e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005880 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:48.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.026+0000 7f04fea00640 1 -- 172.21.15.7:0/241715983 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f04f00593f0 con 0x7f050815bfb0 2024-08-19T00:46:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.246+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f050806c980 con 0x7f050815bfb0 2024-08-19T00:46:48.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.410+0000 7f04fea00640 1 -- 172.21.15.7:0/241715983 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v266) ==== 162+0+0 (secure 0 0 0) 0x7f04f005d6f0 con 0x7f050815bfb0 2024-08-19T00:46:48.412 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f04e406be30 msgr2=0x7f04e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f04e406be30 0x7f04e406e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005880 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050815bfb0 msgr2=0x7f0508153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050815bfb0 0x7f0508153750 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f04f000ebe0 tx=0x7f04f000c520 comp rx=0 tx=0).stop 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 shutdown_connections 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f04e406be30 0x7f04e406e2f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f050815c390 0x7f050809ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050815bfb0 0x7f0508153750 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 --2- 172.21.15.7:0/241715983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080b5130 0x7f050809c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 >> 172.21.15.7:0/241715983 conn(0x7f05080b2300 msgr2=0x7f0508074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 shutdown_connections 2024-08-19T00:46:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.412+0000 7f050ce00640 1 -- 172.21.15.7:0/241715983 wait complete. 2024-08-19T00:46:48.423 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:46:48.422+0000 7f269c400640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-08-19T00:46:48.423 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:46:48.422+0000 7f269c400640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:46:48.424 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:48.422+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:46:48.424 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:46:48.422+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:46:48.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:48.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.589+0000 7f6bfcc00640 1 Processor -- start 2024-08-19T00:46:48.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.589+0000 7f6bfcc00640 1 -- start start 2024-08-19T00:46:48.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bfcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf806e710 0x7f6bf8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bfcc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6bf80b3750 0x7f6bf80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bfcc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf80cdfb0 con 0x7f6bf80d03c0 2024-08-19T00:46:48.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bfcc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf80cebc0 con 0x7f6bf80b3750 2024-08-19T00:46:48.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bfcc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf80ce290 con 0x7f6bf806e710 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6befe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf806e710 0x7f6bf8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bf5e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6bf80d03c0 0x7f6bf80d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:34702/0 (socket says 172.21.15.7:34702) 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bf5e00640 1 -- 172.21.15.7:0/2416646331 learned_addr learned my addr 172.21.15.7:0/2416646331 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.590+0000 7f6bf6800640 1 --2- 172.21.15.7:0/2416646331 >> v2:172.21.15.162:3300/0 conn(0x7f6bf80b3750 0x7f6bf80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.591+0000 7f6befe00640 1 -- 172.21.15.7:0/2416646331 >> v2:172.21.15.162:3300/0 conn(0x7f6bf80b3750 msgr2=0x7f6bf80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.591+0000 7f6befe00640 1 --2- 172.21.15.7:0/2416646331 >> v2:172.21.15.162:3300/0 conn(0x7f6bf80b3750 0x7f6bf80cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.591+0000 7f6bf5400640 1 -- 172.21.15.7:0/2416646331 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329546025 0 0) 0x7f6bf80cdfb0 con 0x7f6bf80d03c0 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.591+0000 7f6befe00640 1 -- 172.21.15.7:0/2416646331 >> v1:172.21.15.162:6789/0 conn(0x7f6bf80d03c0 legacy=0x7f6bf80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.591+0000 7f6befe00640 1 -- 172.21.15.7:0/2416646331 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf80ce570 con 0x7f6bf806e710 2024-08-19T00:46:48.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.591+0000 7f6bf6800640 1 --2- 172.21.15.7:0/2416646331 >> v2:172.21.15.162:3300/0 conn(0x7f6bf80b3750 0x7f6bf80cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:48.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.592+0000 7f6befe00640 1 --2- 172.21.15.7:0/2416646331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf806e710 0x7f6bf8071980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b567ada7fdd7f1d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:48.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.592+0000 7f6bf5400640 1 -- 172.21.15.7:0/2416646331 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0037070 con 0x7f6bf806e710 2024-08-19T00:46:48.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.592+0000 7f6bf5400640 1 -- 172.21.15.7:0/2416646331 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be0032440 con 0x7f6bf806e710 2024-08-19T00:46:48.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.592+0000 7f6bf5400640 1 -- 172.21.15.7:0/2416646331 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0032810 con 0x7f6bf806e710 2024-08-19T00:46:48.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 -- 172.21.15.7:0/2416646331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf806e710 msgr2=0x7f6bf8071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/2416646331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf806e710 0x7f6bf8071980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be002a180 comp rx=0 tx=0).stop 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 -- 172.21.15.7:0/2416646331 shutdown_connections 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/2416646331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf806e710 0x7f6bf8071980 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/2416646331 >> v2:172.21.15.162:3300/0 conn(0x7f6bf80b3750 0x7f6bf80cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 -- 172.21.15.7:0/2416646331 >> 172.21.15.7:0/2416646331 conn(0x7f6bf806bc70 msgr2=0x7f6bf806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 -- 172.21.15.7:0/2416646331 shutdown_connections 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.593+0000 7f6bfcc00640 1 -- 172.21.15.7:0/2416646331 wait complete. 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.595+0000 7f6bfcc00640 1 Processor -- start 2024-08-19T00:46:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.595+0000 7f6bfcc00640 1 -- start start 2024-08-19T00:46:48.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bfcc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf806e710 0x7f6bf8152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bfcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bf80b3750 0x7f6bf815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bfcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf80d03c0 0x7f6bf815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bfcc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf8073c60 con 0x7f6bf80b3750 2024-08-19T00:46:48.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bfcc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf8073ae0 con 0x7f6bf806e710 2024-08-19T00:46:48.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bfcc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf80b3be0 con 0x7f6bf80d03c0 2024-08-19T00:46:48.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6befe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bf80b3750 0x7f6bf815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6befe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bf80b3750 0x7f6bf815b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35642/0 (socket says 172.21.15.7:35642) 2024-08-19T00:46:48.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6befe00640 1 -- 172.21.15.7:0/643995880 learned_addr learned my addr 172.21.15.7:0/643995880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bf6800640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf80d03c0 0x7f6bf815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6bf5e00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf806e710 0x7f6bf8152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6befe00640 1 -- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf80d03c0 msgr2=0x7f6bf815bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.596+0000 7f6befe00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf80d03c0 0x7f6bf815bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6befe00640 1 -- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf806e710 msgr2=0x7f6bf8152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6befe00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf806e710 0x7f6bf8152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6befe00640 1 -- 172.21.15.7:0/643995880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf8156ec0 con 0x7f6bf80b3750 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6befe00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bf80b3750 0x7f6bf815b6d0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6bee000640 1 -- 172.21.15.7:0/643995880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0041070 con 0x7f6bf80b3750 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6bee000640 1 -- 172.21.15.7:0/643995880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be003c870 con 0x7f6bf80b3750 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6bee000640 1 -- 172.21.15.7:0/643995880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0037040 con 0x7f6bf80b3750 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf8157180 con 0x7f6bf80b3750 2024-08-19T00:46:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.597+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf8157740 con 0x7f6bf80b3750 2024-08-19T00:46:48.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.598+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf8068c00 con 0x7f6bf80b3750 2024-08-19T00:46:48.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.599+0000 7f6bee000640 1 -- 172.21.15.7:0/643995880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6be0044070 con 0x7f6bf80b3750 2024-08-19T00:46:48.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.600+0000 7f6bee000640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bd406be30 0x7f6bd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:48.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.600+0000 7f6bee000640 1 -- 172.21.15.7:0/643995880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f6be00ac4f0 con 0x7f6bf80b3750 2024-08-19T00:46:48.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.600+0000 7f6bf5e00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bd406be30 0x7f6bd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:48.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.601+0000 7f6bf5e00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bd406be30 0x7f6bd406e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6be8000f60 tx=0x7f6be8007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:48.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.605+0000 7f6bee000640 1 -- 172.21.15.7:0/643995880 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6bf8068c00 con 0x7f6bf80b3750 2024-08-19T00:46:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.824+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bf8071980 con 0x7f6bf80b3750 2024-08-19T00:46:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.825+0000 7f6bee000640 1 -- 172.21.15.7:0/643995880 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 268 v268) ==== 95+0+3570 (secure 0 0 0) 0x7f6be0079e50 con 0x7f6bf80b3750 2024-08-19T00:46:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:48.827 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":268,"btime":"2024-08-19T00:46:48:423411+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":268,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:48.423351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:48.827 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 268 2024-08-19T00:46:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bd406be30 msgr2=0x7f6bd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bd406be30 0x7f6bd406e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6be8000f60 tx=0x7f6be8007d50 comp rx=0 tx=0).stop 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bf80b3750 msgr2=0x7f6bf815b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bf80b3750 0x7f6bf815b6d0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be00046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 shutdown_connections 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6bd406be30 0x7f6bd406e2f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf80d03c0 0x7f6bf815bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bf80b3750 0x7f6bf815b6d0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 --2- 172.21.15.7:0/643995880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf806e710 0x7f6bf8152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 >> 172.21.15.7:0/643995880 conn(0x7f6bf806bc70 msgr2=0x7f6bf8071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 shutdown_connections 2024-08-19T00:46:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.827+0000 7f6bfcc00640 1 -- 172.21.15.7:0/643995880 wait complete. 2024-08-19T00:46:48.844 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:48.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.999+0000 7f73a6e00640 1 Processor -- start 2024-08-19T00:46:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:48.999+0000 7f73a6e00640 1 -- start start 2024-08-19T00:46:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.000+0000 7f73a6e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f73a009aa70 0x7f73a009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.000+0000 7f73a6e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.000+0000 7f73a6e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a009b390 con 0x7f73a009b730 2024-08-19T00:46:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.000+0000 7f73a6e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f73a015ec30 con 0x7f73a009aa70 2024-08-19T00:46:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.000+0000 7f73a6e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73a015ef10 con 0x7f73a00d0290 2024-08-19T00:46:49.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f73a4e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f739fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f73a009aa70 0x7f73a009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f739f400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f73a009b730 0x7f73a006fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:34714/0 (socket says 172.21.15.7:34714) 2024-08-19T00:46:49.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f739f400640 1 -- 172.21.15.7:0/3248611739 learned_addr learned my addr 172.21.15.7:0/3248611739 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:49.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f73a4e00640 1 --2- 172.21.15.7:0/3248611739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:32792/0 (socket says 172.21.15.7:32792) 2024-08-19T00:46:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f73a4e00640 1 -- 172.21.15.7:0/3248611739 >> v2:172.21.15.162:3300/0 conn(0x7f73a009aa70 msgr2=0x7f73a009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f73a4e00640 1 --2- 172.21.15.7:0/3248611739 >> v2:172.21.15.162:3300/0 conn(0x7f73a009aa70 0x7f73a009ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f73a4e00640 1 -- 172.21.15.7:0/3248611739 >> v1:172.21.15.162:6789/0 conn(0x7f73a009b730 legacy=0x7f73a006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f73a4e00640 1 -- 172.21.15.7:0/3248611739 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a015f1f0 con 0x7f73a00d0290 2024-08-19T00:46:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f739fe00640 1 --2- 172.21.15.7:0/3248611739 >> v2:172.21.15.162:3300/0 conn(0x7f73a009aa70 0x7f73a009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:46:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.001+0000 7f739ea00640 1 -- 172.21.15.7:0/3248611739 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 115833043 0 0) 0x7f73a009b390 con 0x7f73a009b730 2024-08-19T00:46:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.002+0000 7f73a4e00640 1 --2- 172.21.15.7:0/3248611739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00d0720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f739802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28db9141aacd2ea4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f739ea00640 1 -- 172.21.15.7:0/3248611739 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398007740 con 0x7f73a00d0290 2024-08-19T00:46:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f739ea00640 1 -- 172.21.15.7:0/3248611739 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73980078e0 con 0x7f73a00d0290 2024-08-19T00:46:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f739ea00640 1 -- 172.21.15.7:0/3248611739 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398007cb0 con 0x7f73a00d0290 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 -- 172.21.15.7:0/3248611739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 msgr2=0x7f73a00d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 --2- 172.21.15.7:0/3248611739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00d0720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f739802a660 comp rx=0 tx=0).stop 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 -- 172.21.15.7:0/3248611739 shutdown_connections 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 --2- 172.21.15.7:0/3248611739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00d0720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 --2- 172.21.15.7:0/3248611739 >> v2:172.21.15.162:3300/0 conn(0x7f73a009aa70 0x7f73a009ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 -- 172.21.15.7:0/3248611739 >> 172.21.15.7:0/3248611739 conn(0x7f73a00d2190 msgr2=0x7f73a00d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 -- 172.21.15.7:0/3248611739 shutdown_connections 2024-08-19T00:46:49.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.003+0000 7f73a6e00640 1 -- 172.21.15.7:0/3248611739 wait complete. 2024-08-19T00:46:49.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.005+0000 7f73a6e00640 1 Processor -- start 2024-08-19T00:46:49.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.005+0000 7f73a6e00640 1 -- start start 2024-08-19T00:46:49.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f73a6e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73a009aa70 0x7f73a006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f73a6e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a009b730 0x7f73a00b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f73a6e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f73a6e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73a00d0c60 con 0x7f73a009aa70 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f73a6e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73a015e8f0 con 0x7f73a009b730 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f73a6e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73a00d0de0 con 0x7f73a00d0290 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f739fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73a009aa70 0x7f73a006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f739fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73a009aa70 0x7f73a006d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35656/0 (socket says 172.21.15.7:35656) 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.006+0000 7f739fe00640 1 -- 172.21.15.7:0/1332007562 learned_addr learned my addr 172.21.15.7:0/1332007562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f73a4e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f739f400640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a009b730 0x7f73a00b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f739fe00640 1 -- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 msgr2=0x7f73a00b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f739fe00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f739fe00640 1 -- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a009b730 msgr2=0x7f73a00b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f739fe00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a009b730 0x7f73a00b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f739fe00640 1 -- 172.21.15.7:0/1332007562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a00ca7a0 con 0x7f73a009aa70 2024-08-19T00:46:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f739fe00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73a009aa70 0x7f73a006d450 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f739000ebe0 tx=0x7f739000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f7397e00640 1 -- 172.21.15.7:0/1332007562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390017070 con 0x7f73a009aa70 2024-08-19T00:46:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f7397e00640 1 -- 172.21.15.7:0/1332007562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739000cc30 con 0x7f73a009aa70 2024-08-19T00:46:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a00caa80 con 0x7f73a009aa70 2024-08-19T00:46:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.007+0000 7f7397e00640 1 -- 172.21.15.7:0/1332007562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390013470 con 0x7f73a009aa70 2024-08-19T00:46:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.008+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a00cb320 con 0x7f73a009aa70 2024-08-19T00:46:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.009+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a00d0720 con 0x7f73a009aa70 2024-08-19T00:46:49.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.010+0000 7f7397e00640 1 -- 172.21.15.7:0/1332007562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f739001a070 con 0x7f73a009aa70 2024-08-19T00:46:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.010+0000 7f7397e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f738006be30 0x7f738006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.011+0000 7f7397e00640 1 -- 172.21.15.7:0/1332007562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f739008bc70 con 0x7f73a009aa70 2024-08-19T00:46:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.011+0000 7f739f400640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f738006be30 0x7f738006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.011+0000 7f739f400640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f738006be30 0x7f738006e2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f73a0159e90 tx=0x7f738c007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.015+0000 7f7397e00640 1 -- 172.21.15.7:0/1332007562 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7390059b00 con 0x7f73a009aa70 2024-08-19T00:46:49.152 INFO:tasks.ceph.mds.a.smithi007.stderr: -46> 2024-08-19T00:46:44.395+0000 7f59d0200640 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2024-08-19T00:46:49.188 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:46:49.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.242+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73a00d2cb0 con 0x7f73a009aa70 2024-08-19T00:46:49.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.242+0000 7f7397e00640 1 -- 172.21.15.7:0/1332007562 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 268 v268) ==== 95+0+3570 (secure 0 0 0) 0x7f7390059400 con 0x7f73a009aa70 2024-08-19T00:46:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":268,"btime":"2024-08-19T00:46:48:423411+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":268,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:48.423351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:49.245 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 268 2024-08-19T00:46:49.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.244+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f738006be30 msgr2=0x7f738006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.244+0000 7f73a6e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f738006be30 0x7f738006e2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f73a0159e90 tx=0x7f738c007b70 comp rx=0 tx=0).stop 2024-08-19T00:46:49.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.244+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73a009aa70 msgr2=0x7f73a006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.244+0000 7f73a6e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73a009aa70 0x7f73a006d450 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f739000ebe0 tx=0x7f739000c520 comp rx=0 tx=0).stop 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 shutdown_connections 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f738006be30 0x7f738006e2f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a00d0290 0x7f73a00b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a009b730 0x7f73a00b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 --2- 172.21.15.7:0/1332007562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73a009aa70 0x7f73a006d450 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 >> 172.21.15.7:0/1332007562 conn(0x7f73a00d2190 msgr2=0x7f73a015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 shutdown_connections 2024-08-19T00:46:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.245+0000 7f73a6e00640 1 -- 172.21.15.7:0/1332007562 wait complete. 2024-08-19T00:46:49.262 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:46:49.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:49.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.426+0000 7fb956a00640 1 Processor -- start 2024-08-19T00:46:49.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.426+0000 7fb956a00640 1 -- start start 2024-08-19T00:46:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb956a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb950161ba0 0x7fb9500d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb956a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9500d4b30 0x7fb9500d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb956a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb95006c950 0x7fb95006ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb956a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb9500d5240 con 0x7fb950161ba0 2024-08-19T00:46:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb956a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb9500b39c0 con 0x7fb95006c950 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb956a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500b36e0 con 0x7fb9500d4b30 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb94fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb950161ba0 0x7fb9500d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb94fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb950161ba0 0x7fb9500d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35688/0 (socket says 172.21.15.7:35688) 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb94fe00640 1 -- 172.21.15.7:0/3754494442 learned_addr learned my addr 172.21.15.7:0/3754494442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb954a00640 1 --2- 172.21.15.7:0/3754494442 >> v2:172.21.15.162:3300/0 conn(0x7fb95006c950 0x7fb95006ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.427+0000 7fb94f400640 1 --2- 172.21.15.7:0/3754494442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9500d4b30 0x7fb9500d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.428+0000 7fb94fe00640 1 -- 172.21.15.7:0/3754494442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9500d4b30 msgr2=0x7fb9500d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.428+0000 7fb94fe00640 1 --2- 172.21.15.7:0/3754494442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9500d4b30 0x7fb9500d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.428+0000 7fb94fe00640 1 -- 172.21.15.7:0/3754494442 >> v2:172.21.15.162:3300/0 conn(0x7fb95006c950 msgr2=0x7fb95006ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.428+0000 7fb94fe00640 1 --2- 172.21.15.7:0/3754494442 >> v2:172.21.15.162:3300/0 conn(0x7fb95006c950 0x7fb95006ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.428+0000 7fb94fe00640 1 -- 172.21.15.7:0/3754494442 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95006e3a0 con 0x7fb950161ba0 2024-08-19T00:46:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.428+0000 7fb954a00640 1 --2- 172.21.15.7:0/3754494442 >> v2:172.21.15.162:3300/0 conn(0x7fb95006c950 0x7fb95006ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.429+0000 7fb94fe00640 1 --2- 172.21.15.7:0/3754494442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb950161ba0 0x7fb9500d2490 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fb9500b3e30 tx=0x7fb94002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605f778735c44d1f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.429+0000 7fb94ea00640 1 -- 172.21.15.7:0/3754494442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940037070 con 0x7fb950161ba0 2024-08-19T00:46:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.429+0000 7fb94ea00640 1 -- 172.21.15.7:0/3754494442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb940032440 con 0x7fb950161ba0 2024-08-19T00:46:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.429+0000 7fb94ea00640 1 -- 172.21.15.7:0/3754494442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940032810 con 0x7fb950161ba0 2024-08-19T00:46:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 -- 172.21.15.7:0/3754494442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb950161ba0 msgr2=0x7fb9500d2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 --2- 172.21.15.7:0/3754494442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb950161ba0 0x7fb9500d2490 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fb9500b3e30 tx=0x7fb94002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 -- 172.21.15.7:0/3754494442 shutdown_connections 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 --2- 172.21.15.7:0/3754494442 >> v2:172.21.15.162:3300/0 conn(0x7fb95006c950 0x7fb95006ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 --2- 172.21.15.7:0/3754494442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9500d4b30 0x7fb9500d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 --2- 172.21.15.7:0/3754494442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb950161ba0 0x7fb9500d2490 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 -- 172.21.15.7:0/3754494442 >> 172.21.15.7:0/3754494442 conn(0x7fb95008c000 msgr2=0x7fb9500d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 -- 172.21.15.7:0/3754494442 shutdown_connections 2024-08-19T00:46:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.430+0000 7fb956a00640 1 -- 172.21.15.7:0/3754494442 wait complete. 2024-08-19T00:46:49.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.433+0000 7fb956a00640 1 Processor -- start 2024-08-19T00:46:49.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.433+0000 7fb956a00640 1 -- start start 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb956a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95006c950 0x7fb9500b8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb956a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9500d4b30 0x7fb9501f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb956a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb950161ba0 0x7fb9500b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb956a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb950161f80 con 0x7fb9500d4b30 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb956a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500b1be0 con 0x7fb95006c950 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb956a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb950162100 con 0x7fb950161ba0 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb94f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9500d4b30 0x7fb9501f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb94f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9500d4b30 0x7fb9501f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35692/0 (socket says 172.21.15.7:35692) 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb94f400640 1 -- 172.21.15.7:0/3134483517 learned_addr learned my addr 172.21.15.7:0/3134483517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb94fe00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95006c950 0x7fb9500b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.434+0000 7fb954a00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb950161ba0 0x7fb9500b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb94f400640 1 -- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb950161ba0 msgr2=0x7fb9500b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb94f400640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb950161ba0 0x7fb9500b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb94f400640 1 -- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95006c950 msgr2=0x7fb9500b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb94f400640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95006c950 0x7fb9500b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb94f400640 1 -- 172.21.15.7:0/3134483517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950155ff0 con 0x7fb9500d4b30 2024-08-19T00:46:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb94f400640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9500d4b30 0x7fb9501f3860 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d7d0 tx=0x7fb93c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb947e00640 1 -- 172.21.15.7:0/3134483517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c004020 con 0x7fb9500d4b30 2024-08-19T00:46:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb947e00640 1 -- 172.21.15.7:0/3134483517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93c0041e0 con 0x7fb9500d4b30 2024-08-19T00:46:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb947e00640 1 -- 172.21.15.7:0/3134483517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0043d0 con 0x7fb9500d4b30 2024-08-19T00:46:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.435+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9500b8dc0 con 0x7fb9500d4b30 2024-08-19T00:46:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.436+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9500b9380 con 0x7fb9500d4b30 2024-08-19T00:46:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.437+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9500d2490 con 0x7fb9500d4b30 2024-08-19T00:46:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.438+0000 7fb947e00640 1 -- 172.21.15.7:0/3134483517 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb93c01b020 con 0x7fb9500d4b30 2024-08-19T00:46:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.439+0000 7fb947e00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb93006be30 0x7fb93006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.439+0000 7fb947e00640 1 -- 172.21.15.7:0/3134483517 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7fb93c08b5d0 con 0x7fb9500d4b30 2024-08-19T00:46:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.439+0000 7fb94fe00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb93006be30 0x7fb93006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.440+0000 7fb94fe00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb93006be30 0x7fb93006e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb940034000 tx=0x7fb94002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.443+0000 7fb947e00640 1 -- 172.21.15.7:0/3134483517 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb93c058ea0 con 0x7fb9500d4b30 2024-08-19T00:46:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.662+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9500b2dd0 con 0x7fb9500d4b30 2024-08-19T00:46:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.663+0000 7fb947e00640 1 -- 172.21.15.7:0/3134483517 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 269 v269) ==== 95+0+4390 (secure 0 0 0) 0x7fb93c05d1a0 con 0x7fb9500d4b30 2024-08-19T00:46:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:49.665 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":269,"btime":"2024-08-19T00:46:49:424967+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9537,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/564246395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":564246395},{"type":"v1","addr":"172.21.15.7:6837","nonce":564246395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":269}],"filesystems":[{"mdsmap":{"epoch":268,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:48.423351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 269 2024-08-19T00:46:49.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb93006be30 msgr2=0x7fb93006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb93006be30 0x7fb93006e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb940034000 tx=0x7fb94002e000 comp rx=0 tx=0).stop 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9500d4b30 msgr2=0x7fb9501f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9500d4b30 0x7fb9501f3860 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d7d0 tx=0x7fb93c00dc90 comp rx=0 tx=0).stop 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 shutdown_connections 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb93006be30 0x7fb93006e2f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb950161ba0 0x7fb9500b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9500d4b30 0x7fb9501f3860 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 --2- 172.21.15.7:0/3134483517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95006c950 0x7fb9500b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.665+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 >> 172.21.15.7:0/3134483517 conn(0x7fb95008c000 msgr2=0x7fb9500d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.666+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 shutdown_connections 2024-08-19T00:46:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.666+0000 7fb956a00640 1 -- 172.21.15.7:0/3134483517 wait complete. 2024-08-19T00:46:49.683 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 100.00000000.inode' led to DAMAGED state 2024-08-19T00:46:49.683 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 10000000000.00000000:sixmegs_head' 2024-08-19T00:46:49.683 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:46:49.683 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:46:49.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:46:49.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:46:49.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:49.719 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:46:49.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:46:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:46:49.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:46:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.992+0000 7f21e2800640 1 Processor -- start 2024-08-19T00:46:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.992+0000 7f21e2800640 1 -- start start 2024-08-19T00:46:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21e2800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f21dc0d03c0 0x7f21dc0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21e2800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21dc0b50b0 con 0x7f21dc0b4380 2024-08-19T00:46:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21e2800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21dc0cead0 con 0x7f21dc15f5b0 2024-08-19T00:46:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21e2800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f21dc15f990 con 0x7f21dc0d03c0 2024-08-19T00:46:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21dbe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f21dc0b4380 0x7f21dc0b47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36762/0 (socket says 172.21.15.7:36762) 2024-08-19T00:46:49.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21dbe00640 1 -- 172.21.15.7:0/2135693620 learned_addr learned my addr 172.21.15.7:0/2135693620 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21d3e00640 1 --2- 172.21.15.7:0/2135693620 >> v2:172.21.15.162:3300/0 conn(0x7f21dc0d03c0 0x7f21dc0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21daa00640 1 -- 172.21.15.7:0/2135693620 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126724339 0 0) 0x7f21dc0b50b0 con 0x7f21dc0b4380 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.994+0000 7f21daa00640 1 -- 172.21.15.7:0/2135693620 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21c0003520 con 0x7f21dc0b4380 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.995+0000 7f21daa00640 1 -- 172.21.15.7:0/2135693620 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149136707 0 0) 0x7f21dc0cead0 con 0x7f21dc15f5b0 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.995+0000 7f21daa00640 1 -- 172.21.15.7:0/2135693620 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21dc0b50b0 con 0x7f21dc15f5b0 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.995+0000 7f21d3e00640 1 -- 172.21.15.7:0/2135693620 >> v1:172.21.15.162:6789/0 conn(0x7f21dc15f5b0 legacy=0x7f21dc0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.995+0000 7f21d3e00640 1 -- 172.21.15.7:0/2135693620 >> v1:172.21.15.7:6789/0 conn(0x7f21dc0b4380 legacy=0x7f21dc0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.995+0000 7f21d3e00640 1 -- 172.21.15.7:0/2135693620 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21dc0cedb0 con 0x7f21dc0d03c0 2024-08-19T00:46:49.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.996+0000 7f21d3e00640 1 --2- 172.21.15.7:0/2135693620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 0x7f21dc0d0800 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f21c40097a0 tx=0x7f21c402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6effdeb884f084ef server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.996+0000 7f21daa00640 1 -- 172.21.15.7:0/2135693620 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4037070 con 0x7f21dc0d03c0 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.996+0000 7f21daa00640 1 -- 172.21.15.7:0/2135693620 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c4032440 con 0x7f21dc0d03c0 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.996+0000 7f21daa00640 1 -- 172.21.15.7:0/2135693620 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c40327f0 con 0x7f21dc0d03c0 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.997+0000 7f21e2800640 1 -- 172.21.15.7:0/2135693620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 msgr2=0x7f21dc0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.997+0000 7f21e2800640 1 --2- 172.21.15.7:0/2135693620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 0x7f21dc0d0800 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f21c40097a0 tx=0x7f21c402a1a0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.997+0000 7f21e2800640 1 -- 172.21.15.7:0/2135693620 shutdown_connections 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.997+0000 7f21e2800640 1 --2- 172.21.15.7:0/2135693620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 0x7f21dc0d0800 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.997+0000 7f21e2800640 1 -- 172.21.15.7:0/2135693620 >> 172.21.15.7:0/2135693620 conn(0x7f21dc06bc70 msgr2=0x7f21dc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.997+0000 7f21e2800640 1 -- 172.21.15.7:0/2135693620 shutdown_connections 2024-08-19T00:46:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.997+0000 7f21e2800640 1 -- 172.21.15.7:0/2135693620 wait complete. 2024-08-19T00:46:50.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.998+0000 7f21e2800640 1 Processor -- start 2024-08-19T00:46:50.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.999+0000 7f21e2800640 1 -- start start 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.999+0000 7f21e2800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0b4380 0x7f21dc162530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.999+0000 7f21e2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 0x7f21dc158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.999+0000 7f21e2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc15f5b0 0x7f21dc0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.999+0000 7f21e2800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc06ea30 con 0x7f21dc15f5b0 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.999+0000 7f21e2800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc06e8b0 con 0x7f21dc0d03c0 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:49.999+0000 7f21e2800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21dc06ebb0 con 0x7f21dc0b4380 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc15f5b0 0x7f21dc0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc15f5b0 0x7f21dc0b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35698/0 (socket says 172.21.15.7:35698) 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 -- 172.21.15.7:0/1252328487 learned_addr learned my addr 172.21.15.7:0/1252328487 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:50.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21d3e00640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 0x7f21dc158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21db400640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0b4380 0x7f21dc162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 -- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0b4380 msgr2=0x7f21dc162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0b4380 0x7f21dc162530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 -- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 msgr2=0x7f21dc158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 0x7f21dc158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 -- 172.21.15.7:0/1252328487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21dc159a10 con 0x7f21dc15f5b0 2024-08-19T00:46:50.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.000+0000 7f21dbe00640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc15f5b0 0x7f21dc0b09f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f21d400cba0 tx=0x7f21d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.001+0000 7f21d3400640 1 -- 172.21.15.7:0/1252328487 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4017070 con 0x7f21dc15f5b0 2024-08-19T00:46:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.001+0000 7f21d3400640 1 -- 172.21.15.7:0/1252328487 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d400ace0 con 0x7f21dc15f5b0 2024-08-19T00:46:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.001+0000 7f21d3400640 1 -- 172.21.15.7:0/1252328487 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4012620 con 0x7f21dc15f5b0 2024-08-19T00:46:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.001+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21dc15bb00 con 0x7f21dc15f5b0 2024-08-19T00:46:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.001+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21dc15c080 con 0x7f21dc15f5b0 2024-08-19T00:46:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.002+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21dc06efa0 con 0x7f21dc15f5b0 2024-08-19T00:46:50.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.003+0000 7f21d3400640 1 -- 172.21.15.7:0/1252328487 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21d401a070 con 0x7f21dc15f5b0 2024-08-19T00:46:50.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.004+0000 7f21d3400640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.004+0000 7f21d3400640 1 -- 172.21.15.7:0/1252328487 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f21d408b670 con 0x7f21dc15f5b0 2024-08-19T00:46:50.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.004+0000 7f21db400640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.005+0000 7f21db400640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21b806be30 0x7f21b806e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f21cc0011e0 tx=0x7f21cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.008+0000 7f21d3400640 1 -- 172.21.15.7:0/1252328487 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f21dc159a10 con 0x7f21dc15f5b0 2024-08-19T00:46:50.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.230+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f21dc06f490 con 0x7f21dc15f5b0 2024-08-19T00:46:50.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.434+0000 7f21d3400640 1 -- 172.21.15.7:0/1252328487 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v270) ==== 161+0+0 (secure 0 0 0) 0x7f21d4058fa0 con 0x7f21dc15f5b0 2024-08-19T00:46:50.436 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:46:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21b806be30 msgr2=0x7f21b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21b806be30 0x7f21b806e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f21cc0011e0 tx=0x7f21cc009040 comp rx=0 tx=0).stop 2024-08-19T00:46:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc15f5b0 msgr2=0x7f21dc0b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc15f5b0 0x7f21dc0b09f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f21d400cba0 tx=0x7f21d400a430 comp rx=0 tx=0).stop 2024-08-19T00:46:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 shutdown_connections 2024-08-19T00:46:50.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21dc15f5b0 0x7f21dc0b09f0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc0d03c0 0x7f21dc158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 --2- 172.21.15.7:0/1252328487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21dc0b4380 0x7f21dc162530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 >> 172.21.15.7:0/1252328487 conn(0x7f21dc06bc70 msgr2=0x7f21dc15d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 shutdown_connections 2024-08-19T00:46:50.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.437+0000 7f21e2800640 1 -- 172.21.15.7:0/1252328487 wait complete. 2024-08-19T00:46:50.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:46:50.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.612+0000 7fdca6800640 1 Processor -- start 2024-08-19T00:46:50.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.612+0000 7fdca6800640 1 -- start start 2024-08-19T00:46:50.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca6800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdca015e3e0 0x7fdca00b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdca00d27b0 0x7fdca00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca6800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00b4150 0x7fdca00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca6800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fdca00d3140 con 0x7fdca00d27b0 2024-08-19T00:46:50.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca6800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdca00b4b20 con 0x7fdca015e3e0 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca6800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdca00b4df0 con 0x7fdca00b4150 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca4a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdca00d27b0 0x7fdca00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca4a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdca00d27b0 0x7fdca00d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35706/0 (socket says 172.21.15.7:35706) 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca4a00640 1 -- 172.21.15.7:0/3299414258 learned_addr learned my addr 172.21.15.7:0/3299414258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.613+0000 7fdca5400640 1 --2- 172.21.15.7:0/3299414258 >> v2:172.21.15.162:3300/0 conn(0x7fdca015e3e0 0x7fdca00b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.614+0000 7fdca5e00640 1 --2- 172.21.15.7:0/3299414258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00b4150 0x7fdca00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.614+0000 7fdca4a00640 1 -- 172.21.15.7:0/3299414258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00b4150 msgr2=0x7fdca00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.614+0000 7fdca4a00640 1 --2- 172.21.15.7:0/3299414258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00b4150 0x7fdca00b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.614+0000 7fdca4a00640 1 -- 172.21.15.7:0/3299414258 >> v2:172.21.15.162:3300/0 conn(0x7fdca015e3e0 msgr2=0x7fdca00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.614+0000 7fdca4a00640 1 --2- 172.21.15.7:0/3299414258 >> v2:172.21.15.162:3300/0 conn(0x7fdca015e3e0 0x7fdca00b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.614+0000 7fdca4a00640 1 -- 172.21.15.7:0/3299414258 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca00b50d0 con 0x7fdca00d27b0 2024-08-19T00:46:50.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.615+0000 7fdca4a00640 1 --2- 172.21.15.7:0/3299414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00d27b0 0x7fdca00d2c00 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009870 tx=0x7fdc8c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f91426cf51270f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.615+0000 7fdc9fe00640 1 -- 172.21.15.7:0/3299414258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c037070 con 0x7fdca00d27b0 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.615+0000 7fdc9fe00640 1 -- 172.21.15.7:0/3299414258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c032440 con 0x7fdca00d27b0 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.615+0000 7fdc9fe00640 1 -- 172.21.15.7:0/3299414258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c032810 con 0x7fdca00d27b0 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.615+0000 7fdca6800640 1 -- 172.21.15.7:0/3299414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00d27b0 msgr2=0x7fdca00d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 --2- 172.21.15.7:0/3299414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00d27b0 0x7fdca00d2c00 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009870 tx=0x7fdc8c02a210 comp rx=0 tx=0).stop 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 -- 172.21.15.7:0/3299414258 shutdown_connections 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 --2- 172.21.15.7:0/3299414258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00b4150 0x7fdca00b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 --2- 172.21.15.7:0/3299414258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00d27b0 0x7fdca00d2c00 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 --2- 172.21.15.7:0/3299414258 >> v2:172.21.15.162:3300/0 conn(0x7fdca015e3e0 0x7fdca00b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 -- 172.21.15.7:0/3299414258 >> 172.21.15.7:0/3299414258 conn(0x7fdca008dbe0 msgr2=0x7fdca009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:50.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 -- 172.21.15.7:0/3299414258 shutdown_connections 2024-08-19T00:46:50.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.616+0000 7fdca6800640 1 -- 172.21.15.7:0/3299414258 wait complete. 2024-08-19T00:46:50.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.617+0000 7fdca6800640 1 Processor -- start 2024-08-19T00:46:50.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.618+0000 7fdca6800640 1 -- start start 2024-08-19T00:46:50.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.618+0000 7fdca6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00b4150 0x7fdca0153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.618+0000 7fdca6800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00d27b0 0x7fdca00b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdca015e3e0 0x7fdca0158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdca00cee90 con 0x7fdca00b4150 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca6800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdca00cf4c0 con 0x7fdca015e3e0 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca6800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdca00b13a0 con 0x7fdca00d27b0 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00b4150 0x7fdca0153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00b4150 0x7fdca0153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35722/0 (socket says 172.21.15.7:35722) 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 -- 172.21.15.7:0/4064117060 learned_addr learned my addr 172.21.15.7:0/4064117060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5e00640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdca015e3e0 0x7fdca0158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca4a00640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00d27b0 0x7fdca00b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 -- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00d27b0 msgr2=0x7fdca00b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:50.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00d27b0 0x7fdca00b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 -- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdca015e3e0 msgr2=0x7fdca0158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:50.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdca015e3e0 0x7fdca0158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:50.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.619+0000 7fdca5400640 1 -- 172.21.15.7:0/4064117060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca00b92d0 con 0x7fdca00b4150 2024-08-19T00:46:50.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.620+0000 7fdca5400640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00b4150 0x7fdca0153b40 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400d5f0 tx=0x7fdc9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:50.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.620+0000 7fdc9d600640 1 -- 172.21.15.7:0/4064117060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc940125f0 con 0x7fdca00b4150 2024-08-19T00:46:50.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.620+0000 7fdc9d600640 1 -- 172.21.15.7:0/4064117060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc94019070 con 0x7fdca00b4150 2024-08-19T00:46:50.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.620+0000 7fdc9d600640 1 -- 172.21.15.7:0/4064117060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc940129d0 con 0x7fdca00b4150 2024-08-19T00:46:50.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.620+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca00b95b0 con 0x7fdca00b4150 2024-08-19T00:46:50.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.620+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca00cc270 con 0x7fdca00b4150 2024-08-19T00:46:50.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.621+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca00cc060 con 0x7fdca00b4150 2024-08-19T00:46:50.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.622+0000 7fdc9d600640 1 -- 172.21.15.7:0/4064117060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc94012b70 con 0x7fdca00b4150 2024-08-19T00:46:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.623+0000 7fdc9d600640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.623+0000 7fdc9d600640 1 -- 172.21.15.7:0/4064117060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7fdc9408bb70 con 0x7fdca00b4150 2024-08-19T00:46:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.623+0000 7fdca4a00640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.624+0000 7fdca4a00640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c034000 tx=0x7fdc8c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:50.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.627+0000 7fdc9d600640 1 -- 172.21.15.7:0/4064117060 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdc940593b0 con 0x7fdca00b4150 2024-08-19T00:46:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:50.881+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fdca00d2c00 con 0x7fdca00b4150 2024-08-19T00:46:51.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.439+0000 7fdc9d600640 1 -- 172.21.15.7:0/4064117060 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v271) ==== 101+0+0 (secure 0 0 0) 0x7fdc9405d6b0 con 0x7fdca00b4150 2024-08-19T00:46:51.441 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:46:51.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdc8006be30 msgr2=0x7fdc8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c034000 tx=0x7fdc8c02e000 comp rx=0 tx=0).stop 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00b4150 msgr2=0x7fdca0153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00b4150 0x7fdca0153b40 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400d5f0 tx=0x7fdc9400dab0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 shutdown_connections 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdca015e3e0 0x7fdca0158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdca00d27b0 0x7fdca00b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 --2- 172.21.15.7:0/4064117060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca00b4150 0x7fdca0153b40 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 >> 172.21.15.7:0/4064117060 conn(0x7fdca008dbe0 msgr2=0x7fdca00d14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 shutdown_connections 2024-08-19T00:46:51.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.443+0000 7fdca6800640 1 -- 172.21.15.7:0/4064117060 wait complete. 2024-08-19T00:46:51.463 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:46:51.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.541+0000 7fc86220ff40 1 Processor -- start 2024-08-19T00:46:51.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.541+0000 7fc86220ff40 1 -- start start 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc86220ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc844002460 0x56430746af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc86220ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430744c710 0x56430744cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc86220ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643074654d0 0x564307465980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc86220ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564307337d00 con 0x56430744c710 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc86220ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56430733bd40 con 0x5643074654d0 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc86220ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564307468dc0 con 0x7fc844002460 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc85de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430744c710 0x56430744cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc85de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430744c710 0x56430744cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35734/0 (socket says 172.21.15.7:35734) 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc85de00640 1 -- 172.21.15.7:0/2459030363 learned_addr learned my addr 172.21.15.7:0/2459030363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.542+0000 7fc85f200640 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643074654d0 0x564307465980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85e800640 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc844002460 0x56430746af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85de00640 1 -- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc844002460 msgr2=0x56430746af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85de00640 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc844002460 0x56430746af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85de00640 1 -- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643074654d0 msgr2=0x564307465980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85de00640 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643074654d0 0x564307465980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85de00640 1 -- 172.21.15.7:0/2459030363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643072f9080 con 0x56430744c710 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85e800640 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc844002460 0x56430746af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85de00640 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430744c710 0x56430744cb70 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0095b0 tx=0x7fc84c009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515469c2b48673be server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85ca00640 1 -- 172.21.15.7:0/2459030363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00e7a0 con 0x56430744c710 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85ca00640 1 -- 172.21.15.7:0/2459030363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c013030 con 0x56430744c710 2024-08-19T00:46:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.543+0000 7fc85ca00640 1 -- 172.21.15.7:0/2459030363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00eba0 con 0x56430744c710 2024-08-19T00:46:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 -- 172.21.15.7:0/2459030363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430744c710 msgr2=0x56430744cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430744c710 0x56430744cb70 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0095b0 tx=0x7fc84c009a70 comp rx=0 tx=0).stop 2024-08-19T00:46:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 -- 172.21.15.7:0/2459030363 shutdown_connections 2024-08-19T00:46:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643074654d0 0x564307465980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430744c710 0x56430744cb70 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 --2- 172.21.15.7:0/2459030363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc844002460 0x56430746af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 -- 172.21.15.7:0/2459030363 >> 172.21.15.7:0/2459030363 conn(0x5643073c04e0 msgr2=0x5643073db8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 -- 172.21.15.7:0/2459030363 shutdown_connections 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.544+0000 7fc86220ff40 1 -- 172.21.15.7:0/2459030363 wait complete. 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.545+0000 7fc86220ff40 1 Processor -- start 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.545+0000 7fc86220ff40 1 -- start start 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc86220ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56430744c710 0x5643074f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc86220ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643074654d0 0x5643073908c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc86220ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc844002460 0x564307448d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc86220ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564307391550 con 0x5643074654d0 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc86220ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5643074620c0 con 0x7fc844002460 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc86220ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56430746a760 con 0x56430744c710 2024-08-19T00:46:51.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643074654d0 0x5643073908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643074654d0 0x5643073908c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35740/0 (socket says 172.21.15.7:35740) 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 learned_addr learned my addr 172.21.15.7:0/3028651962 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85e800640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56430744c710 0x5643074f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85f200640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc844002460 0x564307448d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56430744c710 msgr2=0x5643074f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56430744c710 0x5643074f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc844002460 msgr2=0x564307448d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc844002460 0x564307448d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.546+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643074f1650 con 0x5643074654d0 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.547+0000 7fc85de00640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643074654d0 0x5643073908c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fc84c001ed0 tx=0x7fc84c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.547+0000 7fc857400640 1 -- 172.21.15.7:0/3028651962 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00f450 con 0x5643074654d0 2024-08-19T00:46:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.547+0000 7fc857400640 1 -- 172.21.15.7:0/3028651962 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c00f5f0 con 0x5643074654d0 2024-08-19T00:46:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.547+0000 7fc857400640 1 -- 172.21.15.7:0/3028651962 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00f9e0 con 0x5643074654d0 2024-08-19T00:46:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.547+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643074f1930 con 0x5643074654d0 2024-08-19T00:46:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.547+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643074f1ef0 con 0x5643074654d0 2024-08-19T00:46:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.549+0000 7fc857400640 1 -- 172.21.15.7:0/3028651962 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc84c023070 con 0x5643074654d0 2024-08-19T00:46:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.550+0000 7fc857400640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc84006a810 0x7fc84006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.550+0000 7fc857400640 1 -- 172.21.15.7:0/3028651962 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7fc84c08c730 con 0x5643074654d0 2024-08-19T00:46:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.550+0000 7fc85e800640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc84006a810 0x7fc84006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.553 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:46:51.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.550+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5643074f0ea0 0x564307451d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.550+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643074522d0 con 0x5643074f0ea0 2024-08-19T00:46:51.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.550+0000 7fc85f200640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5643074f0ea0 0x564307451d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.551+0000 7fc85e800640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc84006a810 0x7fc84006ccd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc850055000 tx=0x7fc850053000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.551+0000 7fc85f200640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5643074f0ea0 0x564307451d90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.554+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v117'939 uv913 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.554+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x5643074526a0 con 0x5643074f0ea0 2024-08-19T00:46:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.556+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v117'940 uv940 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.556+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750b3f0 con 0x5643074f0ea0 2024-08-19T00:46:51.559 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:46:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.557+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v117'941 uv941 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.558+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750c7a0 con 0x5643074f0ea0 2024-08-19T00:46:51.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.559+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v117'942 uv942 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.559+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750cb40 con 0x5643074f0ea0 2024-08-19T00:46:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.561+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v117'943 uv943 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.561+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750b790 con 0x5643074f0ea0 2024-08-19T00:46:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.562+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v117'944 uv944 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.562+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bba0 con 0x5643074f0ea0 2024-08-19T00:46:51.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.564+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v117'945 uv919 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.564+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf90 con 0x5643074f0ea0 2024-08-19T00:46:51.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.566+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v117'946 uv946 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.566+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf90 con 0x5643074f0ea0 2024-08-19T00:46:51.569 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:46:51.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.567+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v117'947 uv947 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.567+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.568+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v117'948 uv948 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.569+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750c3c0 con 0x5643074f0ea0 2024-08-19T00:46:51.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.570+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v117'949 uv949 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.570+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750c3c0 con 0x5643074f0ea0 2024-08-19T00:46:51.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.572+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v117'950 uv950 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.572+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.573+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v117'951 uv926 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.573+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.574+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v117'952 uv952 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.574+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.577 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:46:51.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.576+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v117'953 uv953 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.576+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.577+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v117'954 uv954 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.577+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.579+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v117'955 uv955 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.579+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.580+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v117'956 uv956 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.580+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.582+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v117'957 uv957 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.582+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.583+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v117'958 uv932 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.583+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.585+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v117'959 uv959 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.585+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.587 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:46:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.586+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v117'960 uv960 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.586+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.588+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v117'961 uv961 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.588+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.589+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v117'962 uv962 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.589+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.591+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v117'963 uv963 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.591+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.592+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v117'964 uv938 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.592+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.593+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v117'965 uv965 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.593+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.596 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:46:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.595+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v117'966 uv966 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.595+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.596+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v117'967 uv967 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.596+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.598+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v117'968 uv968 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.598+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750bf40 con 0x5643074f0ea0 2024-08-19T00:46:51.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.599+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v117'969 uv969 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.599+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56430750c340 0x56430750f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.599+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430750f940 con 0x56430750c340 2024-08-19T00:46:51.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.599+0000 7fc85e800640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56430750c340 0x56430750f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.600+0000 7fc85e800640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56430750c340 0x56430750f400 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.602+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v117'680 uv663 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.602+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430750fce0 con 0x56430750c340 2024-08-19T00:46:51.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.603+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v117'681 uv681 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.604+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510080 con 0x56430750c340 2024-08-19T00:46:51.606 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:46:51.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.605+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v117'682 uv682 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.605+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510420 con 0x56430750c340 2024-08-19T00:46:51.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.606+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v117'683 uv683 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.606+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075107c0 con 0x56430750c340 2024-08-19T00:46:51.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.608+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v117'684 uv684 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.608+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510b60 con 0x56430750c340 2024-08-19T00:46:51.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.610+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v117'685 uv668 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.610+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.611+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v117'686 uv686 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.611+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.614 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:46:51.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.613+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v117'687 uv687 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.613+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.614+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v117'688 uv688 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.614+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.616+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v117'689 uv689 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.616+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.617+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v117'690 uv673 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.617+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.619+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v117'691 uv691 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.619+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.622 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:46:51.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.620+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v117'692 uv692 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.620+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075155f0 con 0x56430750c340 2024-08-19T00:46:51.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.622+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v117'693 uv693 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.622+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075155f0 con 0x56430750c340 2024-08-19T00:46:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.624+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v117'694 uv694 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.624+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.625+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v117'695 uv679 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.625+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.627+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v117'696 uv696 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.627+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.630 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:46:51.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.628+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v117'697 uv697 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.628+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307511f10 con 0x56430750c340 2024-08-19T00:46:51.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.630+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v117'698 uv698 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.630+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307511f10 con 0x56430750c340 2024-08-19T00:46:51.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.631+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v117'699 uv699 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.631+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307510f00 con 0x56430750c340 2024-08-19T00:46:51.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.633+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v117'700 uv700 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x56430750c340 2024-08-19T00:46:51.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.633+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564307511410 0x564307513800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.633+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307513d40 con 0x564307511410 2024-08-19T00:46:51.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.633+0000 7fc85de00640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564307511410 0x564307513800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.634+0000 7fc85de00640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564307511410 0x564307513800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.635+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v117'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.635+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x5643075140e0 con 0x564307511410 2024-08-19T00:46:51.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.637+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v117'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.637+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514590 con 0x564307511410 2024-08-19T00:46:51.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.638+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v117'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.640 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:46:51.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.638+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307515e40 con 0x564307511410 2024-08-19T00:46:51.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.639+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v117'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.639+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075161e0 con 0x564307511410 2024-08-19T00:46:51.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.641+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v117'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.641+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514e30 con 0x564307511410 2024-08-19T00:46:51.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.642+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v117'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.642+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307515220 con 0x5643074f0ea0 2024-08-19T00:46:51.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.644+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v117'134 uv133 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.644+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x564307515220 con 0x5643074f0ea0 2024-08-19T00:46:51.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.645+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v117'135 uv135 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.645+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307515220 con 0x5643074f0ea0 2024-08-19T00:46:51.649 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:46:51.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.647+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v117'136 uv136 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.647+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307515220 con 0x5643074f0ea0 2024-08-19T00:46:51.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.648+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v117'137 uv137 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.648+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5643075158a0 0x564307518590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.648+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307518ad0 con 0x5643075158a0 2024-08-19T00:46:51.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.649+0000 7fc85f200640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5643075158a0 0x564307518590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.649+0000 7fc85f200640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5643075158a0 0x564307518590 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.651+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v117'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.651+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x564307518ad0 con 0x5643075158a0 2024-08-19T00:46:51.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.652+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v117'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.652+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307518b10 con 0x5643075158a0 2024-08-19T00:46:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.653+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v117'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.655 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:46:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.653+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307519f40 con 0x5643075158a0 2024-08-19T00:46:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.654+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v117'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.654+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307519f40 con 0x5643075158a0 2024-08-19T00:46:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.655+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v117'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.656+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307518f30 con 0x5643075158a0 2024-08-19T00:46:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.657+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v117'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.657+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564307519440 0x56430751b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.657+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751be50 con 0x564307519440 2024-08-19T00:46:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.657+0000 7fc85e800640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564307519440 0x56430751b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.658+0000 7fc85e800640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564307519440 0x56430751b830 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.659+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v117'338 uv332 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.659+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430751bf10 con 0x564307519440 2024-08-19T00:46:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.661+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v117'339 uv339 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.661+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751c330 con 0x564307519440 2024-08-19T00:46:51.663 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:46:51.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.662+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v117'340 uv340 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.662+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751d340 con 0x564307519440 2024-08-19T00:46:51.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.663+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v117'341 uv341 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.663+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751d340 con 0x564307519440 2024-08-19T00:46:51.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.665+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v117'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.665+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751c330 con 0x564307519440 2024-08-19T00:46:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.667+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v117'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.667+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751c330 con 0x564307519440 2024-08-19T00:46:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.668+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v117'344 uv337 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.668+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430751c330 con 0x564307519440 2024-08-19T00:46:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.669+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v117'345 uv345 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.670+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751c330 con 0x564307519440 2024-08-19T00:46:51.672 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:46:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.671+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v117'346 uv346 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.671+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751c330 con 0x564307519440 2024-08-19T00:46:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.672+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v117'347 uv347 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.672+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751c330 con 0x564307519440 2024-08-19T00:46:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.674+0000 7fc85e800640 1 -- 172.21.15.7:0/3028651962 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v117'348 uv348 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc8500528b0 con 0x564307519440 2024-08-19T00:46:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.674+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56430751c840 0x56430751ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.674+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751f360 con 0x56430751c840 2024-08-19T00:46:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.674+0000 7fc85de00640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56430751c840 0x56430751ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.675+0000 7fc85de00640 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56430751c840 0x56430751ec30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.676+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v117'153 uv152 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.676+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430751f730 con 0x56430751c840 2024-08-19T00:46:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.677+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v117'154 uv154 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.677+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x56430751c840 2024-08-19T00:46:51.680 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:46:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.679+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v117'155 uv155 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.679+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x56430751c840 2024-08-19T00:46:51.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.680+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v117'156 uv156 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.680+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x56430751c840 2024-08-19T00:46:51.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.681+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v117'157 uv157 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.681+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x5643074f0ea0 2024-08-19T00:46:51.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.683+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v117'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.683+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x5643074f0ea0 2024-08-19T00:46:51.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.685+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v117'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.685+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x5643074f0ea0 2024-08-19T00:46:51.688 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:46:51.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.687+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v117'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.687+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307520b60 con 0x5643074f0ea0 2024-08-19T00:46:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.688+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v117'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.688+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307520b60 con 0x5643074f0ea0 2024-08-19T00:46:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.689+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v117'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.689+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x5643074f0ea0 2024-08-19T00:46:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.691+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v117'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643074f0ea0 2024-08-19T00:46:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.691+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x564307511410 2024-08-19T00:46:51.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.692+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v117'304 uv298 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.692+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x564307511410 2024-08-19T00:46:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.694+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v117'305 uv305 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.694+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751fb50 con 0x564307511410 2024-08-19T00:46:51.697 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:46:51.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.696+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v117'306 uv306 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.696+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751ff10 con 0x564307511410 2024-08-19T00:46:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.697+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v117'307 uv307 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.697+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751ff10 con 0x564307511410 2024-08-19T00:46:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.699+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v117'308 uv308 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.699+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751ff10 con 0x564307511410 2024-08-19T00:46:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.700+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v117'309 uv303 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.700+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x56430751ff10 con 0x564307511410 2024-08-19T00:46:51.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.702+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v117'310 uv310 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.702+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751ff10 con 0x564307511410 2024-08-19T00:46:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.703+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v117'311 uv311 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.705 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:46:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.703+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x56430751ff10 con 0x564307511410 2024-08-19T00:46:51.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.705+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v117'312 uv312 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.705+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514a50 con 0x564307511410 2024-08-19T00:46:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.706+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v117'313 uv313 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x564307511410 2024-08-19T00:46:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.706+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.708+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v117'132 uv131 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.708+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.709+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v117'133 uv133 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.709+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.712 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:46:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.711+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v117'134 uv134 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.711+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.712+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v117'135 uv135 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.712+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.714+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v117'183 uv182 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.714+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.715+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v117'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.715+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.718 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:46:51.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.717+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v117'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.717+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514a10 con 0x5643075158a0 2024-08-19T00:46:51.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.718+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v117'186 uv186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.718+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x5643075158a0 2024-08-19T00:46:51.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.720+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v117'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.720+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x5643075158a0 2024-08-19T00:46:51.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.721+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v117'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc858010860 con 0x5643075158a0 2024-08-19T00:46:51.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.721+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.722+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v117'156 uv155 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.722+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.723+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v117'157 uv157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.723+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.726 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:46:51.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.725+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v117'158 uv158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.725+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.726+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v117'159 uv159 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.726+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.727+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v117'160 uv160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.727+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.729+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v117'376 uv375 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.729+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.730+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v117'377 uv377 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.730+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.733 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:46:51.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.731+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v117'378 uv378 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.731+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.733+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v117'379 uv379 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.733+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.734+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v117'380 uv380 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.734+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.735+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v117'381 uv374 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.735+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.736+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v117'382 uv382 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.736+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.739 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:46:51.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.737+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v117'383 uv383 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.737+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5643075149d0 con 0x56430751c840 2024-08-19T00:46:51.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.739+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v117'384 uv384 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.739+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514980 con 0x56430751c840 2024-08-19T00:46:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.740+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v117'385 uv385 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.740+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307514980 con 0x56430751c840 2024-08-19T00:46:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.741+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v117'386 uv386 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.741+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564307520670 con 0x56430751c840 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.742+0000 7fc85de00640 1 -- 172.21.15.7:0/3028651962 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v117'387 uv387 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fc84c02b020 con 0x56430751c840 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56430750c340 msgr2=0x56430750f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56430750c340 0x56430750f400 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564307519440 msgr2=0x56430751b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564307519440 0x56430751b830 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56430751c840 msgr2=0x56430751ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56430751c840 0x56430751ec30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564307511410 msgr2=0x564307513800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564307511410 0x564307513800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5643074f0ea0 msgr2=0x564307451d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5643074f0ea0 0x564307451d90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5643075158a0 msgr2=0x564307518590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x5643075158a0 0x564307518590 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 reap_dead start 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 reap_dead start 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc85f200640 1 -- 172.21.15.7:0/3028651962 reap_dead start 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc84006a810 msgr2=0x7fc84006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc84006a810 0x7fc84006ccd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc850055000 tx=0x7fc850053000 comp rx=0 tx=0).stop 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643074654d0 msgr2=0x5643073908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643074654d0 0x5643073908c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fc84c001ed0 tx=0x7fc84c001970 comp rx=0 tx=0).stop 2024-08-19T00:46:51.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 shutdown_connections 2024-08-19T00:46:51.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc84006a810 0x7fc84006ccd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 --2- 172.21.15.7:0/3028651962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643074654d0 0x5643073908c0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 >> 172.21.15.7:0/3028651962 conn(0x5643073c04e0 msgr2=0x56430746aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:51.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 shutdown_connections 2024-08-19T00:46:51.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.743+0000 7fc86220ff40 1 -- 172.21.15.7:0/3028651962 wait complete. 2024-08-19T00:46:51.750 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 sixmegs_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:46:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.867+0000 7f9e5658ff40 1 Processor -- start 2024-08-19T00:46:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.867+0000 7f9e5658ff40 1 -- start start 2024-08-19T00:46:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e5658ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x55907691c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e5658ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e5b0 0x5590769d5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e5658ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e990 0x5590769d5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e5658ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55907694d8f0 con 0x55907694cf40 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e5658ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5590768c2d00 con 0x55907694e5b0 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e5658ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5590769f3dc0 con 0x55907694e990 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e53800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x55907691c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e53800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x55907691c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35766/0 (socket says 172.21.15.7:35766) 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.868+0000 7f9e53800640 1 -- 172.21.15.7:0/3652377090 learned_addr learned my addr 172.21.15.7:0/3652377090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e53800640 1 -- 172.21.15.7:0/3652377090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e990 msgr2=0x5590769d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e53800640 1 --2- 172.21.15.7:0/3652377090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e990 0x5590769d5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e53800640 1 -- 172.21.15.7:0/3652377090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e5b0 msgr2=0x5590769d5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e53800640 1 --2- 172.21.15.7:0/3652377090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e5b0 0x5590769d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e53800640 1 -- 172.21.15.7:0/3652377090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559076847b30 con 0x55907694cf40 2024-08-19T00:46:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e53800640 1 --2- 172.21.15.7:0/3652377090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x55907691c170 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400b2e0 tx=0x7f9e4400b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93e5b0b34a0a327 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e51a00640 1 -- 172.21.15.7:0/3652377090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44008070 con 0x55907694cf40 2024-08-19T00:46:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e51a00640 1 -- 172.21.15.7:0/3652377090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4400d500 con 0x55907694cf40 2024-08-19T00:46:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.869+0000 7f9e51a00640 1 -- 172.21.15.7:0/3652377090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400d8f0 con 0x55907694cf40 2024-08-19T00:46:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 -- 172.21.15.7:0/3652377090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 msgr2=0x55907691c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/3652377090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x55907691c170 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400b2e0 tx=0x7f9e4400b7a0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 -- 172.21.15.7:0/3652377090 shutdown_connections 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/3652377090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e990 0x5590769d5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/3652377090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e5b0 0x5590769d5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/3652377090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x55907691c170 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 -- 172.21.15.7:0/3652377090 >> 172.21.15.7:0/3652377090 conn(0x55907694b4e0 msgr2=0x55907694b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 -- 172.21.15.7:0/3652377090 shutdown_connections 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.870+0000 7f9e5658ff40 1 -- 172.21.15.7:0/3652377090 wait complete. 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.871+0000 7f9e5658ff40 1 Processor -- start 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.871+0000 7f9e5658ff40 1 -- start start 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.871+0000 7f9e5658ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x5590769d5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.871+0000 7f9e5658ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e5b0 0x5590769f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e5658ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e990 0x5590769f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e5658ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5590769d7ff0 con 0x55907694cf40 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e5658ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5590769eca30 con 0x55907694e990 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e5658ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5590769f6750 con 0x55907694e5b0 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x5590769d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x5590769d5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35780/0 (socket says 172.21.15.7:35780) 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 -- 172.21.15.7:0/1068216548 learned_addr learned my addr 172.21.15.7:0/1068216548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e54200640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e990 0x5590769f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e52e00640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e5b0 0x5590769f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 -- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e5b0 msgr2=0x5590769f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e5b0 0x5590769f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 -- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e990 msgr2=0x5590769f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e990 0x5590769f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 -- 172.21.15.7:0/1068216548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559076884080 con 0x55907694cf40 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e54200640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55907694e990 0x5590769f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e52e00640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55907694e5b0 0x5590769f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.872+0000 7f9e53800640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x5590769d5250 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x559076949d40 tx=0x7f9e44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.873+0000 7f9e4be00640 1 -- 172.21.15.7:0/1068216548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44021030 con 0x55907694cf40 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.873+0000 7f9e4be00640 1 -- 172.21.15.7:0/1068216548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4401c650 con 0x55907694cf40 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.873+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559076966e20 con 0x55907694cf40 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.873+0000 7f9e4be00640 1 -- 172.21.15.7:0/1068216548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4401c880 con 0x55907694cf40 2024-08-19T00:46:51.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.873+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590769f2ed0 con 0x55907694cf40 2024-08-19T00:46:51.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.875+0000 7f9e4be00640 1 -- 172.21.15.7:0/1068216548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e44024070 con 0x55907694cf40 2024-08-19T00:46:51.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.876+0000 7f9e4be00640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e3406a810 0x7f9e3406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.876+0000 7f9e4be00640 1 -- 172.21.15.7:0/1068216548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f9e4408ba80 con 0x55907694cf40 2024-08-19T00:46:51.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.876+0000 7f9e52e00640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e3406a810 0x7f9e3406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.876+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5590769f4f30 0x559076a94e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:51.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.876+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=104b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5590769ef2b0 con 0x5590769f4f30 2024-08-19T00:46:51.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.876+0000 7f9e52e00640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e3406a810 0x7f9e3406ccd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9e40005fd0 tx=0x7f9e40003040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.877+0000 7f9e54200640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5590769f4f30 0x559076a94e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:51.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.877+0000 7f9e54200640 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5590769f4f30 0x559076a94e90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:51.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e54200640 1 -- 172.21.15.7:0/1068216548 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v117'970 uv970 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9e4c0518c0 con 0x5590769f4f30 2024-08-19T00:46:51.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5590769f4f30 msgr2=0x559076a94e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5590769f4f30 0x559076a94e90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e3406a810 msgr2=0x7f9e3406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9e3406a810 0x7f9e3406ccd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9e40005fd0 tx=0x7f9e40003040 comp rx=0 tx=0).stop 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 msgr2=0x5590769d5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 --2- 172.21.15.7:0/1068216548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55907694cf40 0x5590769d5250 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x559076949d40 tx=0x7f9e44000ed0 comp rx=0 tx=0).stop 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e54200640 1 -- 172.21.15.7:0/1068216548 reap_dead start 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 shutdown_connections 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.879+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 >> 172.21.15.7:0/1068216548 conn(0x55907694b4e0 msgr2=0x5590769f5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.880+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 shutdown_connections 2024-08-19T00:46:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:51.880+0000 7f9e5658ff40 1 -- 172.21.15.7:0/1068216548 wait complete. 2024-08-19T00:46:51.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:46:52.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.045+0000 7fd415800640 1 Processor -- start 2024-08-19T00:46:52.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.045+0000 7fd415800640 1 -- start start 2024-08-19T00:46:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.046+0000 7fd415800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd41015c390 0x7fd410166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.046+0000 7fd415800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4100acef0 con 0x7fd4100b5130 2024-08-19T00:46:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.046+0000 7fd415800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4100ad1d0 con 0x7fd41015bfb0 2024-08-19T00:46:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.046+0000 7fd415800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4100ad790 con 0x7fd41015c390 2024-08-19T00:46:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.046+0000 7fd40e000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd4100b5130 0x7fd4100aebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36794/0 (socket says 172.21.15.7:36794) 2024-08-19T00:46:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.046+0000 7fd40e000640 1 -- 172.21.15.7:0/97570016 learned_addr learned my addr 172.21.15.7:0/97570016 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:46:52.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40f400640 1 --2- 172.21.15.7:0/97570016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd41015c390 0x7fd410166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:52.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40d600640 1 -- 172.21.15.7:0/97570016 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572551369 0 0) 0x7fd4100acef0 con 0x7fd4100b5130 2024-08-19T00:46:52.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40d600640 1 -- 172.21.15.7:0/97570016 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f4003520 con 0x7fd4100b5130 2024-08-19T00:46:52.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40d600640 1 -- 172.21.15.7:0/97570016 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634055877 0 0) 0x7fd4100ad1d0 con 0x7fd41015bfb0 2024-08-19T00:46:52.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40d600640 1 -- 172.21.15.7:0/97570016 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4100acef0 con 0x7fd41015bfb0 2024-08-19T00:46:52.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40f400640 1 -- 172.21.15.7:0/97570016 >> v1:172.21.15.162:6789/0 conn(0x7fd41015bfb0 legacy=0x7fd4100b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:52.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40f400640 1 -- 172.21.15.7:0/97570016 >> v1:172.21.15.7:6789/0 conn(0x7fd4100b5130 legacy=0x7fd4100aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:52.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.047+0000 7fd40f400640 1 -- 172.21.15.7:0/97570016 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4100ad4b0 con 0x7fd41015c390 2024-08-19T00:46:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.048+0000 7fd40f400640 1 --2- 172.21.15.7:0/97570016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd41015c390 0x7fd410166dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd408009dc0 tx=0x7fd40802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330c6a289bea20de server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd40d600640 1 -- 172.21.15.7:0/97570016 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408007740 con 0x7fd41015c390 2024-08-19T00:46:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd40d600640 1 -- 172.21.15.7:0/97570016 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4080078e0 con 0x7fd41015c390 2024-08-19T00:46:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd40d600640 1 -- 172.21.15.7:0/97570016 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408007cb0 con 0x7fd41015c390 2024-08-19T00:46:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd415800640 1 -- 172.21.15.7:0/97570016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd41015c390 msgr2=0x7fd410166dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd415800640 1 --2- 172.21.15.7:0/97570016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd41015c390 0x7fd410166dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd408009dc0 tx=0x7fd40802a6d0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd415800640 1 -- 172.21.15.7:0/97570016 shutdown_connections 2024-08-19T00:46:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd415800640 1 --2- 172.21.15.7:0/97570016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd41015c390 0x7fd410166dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd415800640 1 -- 172.21.15.7:0/97570016 >> 172.21.15.7:0/97570016 conn(0x7fd4100b2300 msgr2=0x7fd41006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd415800640 1 -- 172.21.15.7:0/97570016 shutdown_connections 2024-08-19T00:46:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.049+0000 7fd415800640 1 -- 172.21.15.7:0/97570016 wait complete. 2024-08-19T00:46:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.051+0000 7fd415800640 1 Processor -- start 2024-08-19T00:46:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.051+0000 7fd415800640 1 -- start start 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd415800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4100b5130 0x7fd410153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd415800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd41015bfb0 0x7fd4100cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd415800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41015c390 0x7fd4100cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd415800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4100731d0 con 0x7fd41015c390 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd415800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd410073050 con 0x7fd41015bfb0 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd415800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4100af2e0 con 0x7fd4100b5130 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd40f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41015c390 0x7fd4100cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd40f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41015c390 0x7fd4100cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35786/0 (socket says 172.21.15.7:35786) 2024-08-19T00:46:52.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.052+0000 7fd40f400640 1 -- 172.21.15.7:0/3292864950 learned_addr learned my addr 172.21.15.7:0/3292864950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40e000640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd41015bfb0 0x7fd4100cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40ea00640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4100b5130 0x7fd410153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40f400640 1 -- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4100b5130 msgr2=0x7fd410153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40f400640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4100b5130 0x7fd410153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40f400640 1 -- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd41015bfb0 msgr2=0x7fd4100cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40f400640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd41015bfb0 0x7fd4100cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40f400640 1 -- 172.21.15.7:0/3292864950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4100cbc70 con 0x7fd41015c390 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd40f400640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41015c390 0x7fd4100cb640 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fd40802acc0 tx=0x7fd408004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd406a00640 1 -- 172.21.15.7:0/3292864950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40803f070 con 0x7fd41015c390 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd406a00640 1 -- 172.21.15.7:0/3292864950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd408031bc0 con 0x7fd41015c390 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd406a00640 1 -- 172.21.15.7:0/3292864950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408009450 con 0x7fd41015c390 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4100caa70 con 0x7fd41015c390 2024-08-19T00:46:52.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.053+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41006dd50 con 0x7fd41015c390 2024-08-19T00:46:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.055+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4100aebd0 con 0x7fd41015c390 2024-08-19T00:46:52.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.055+0000 7fd406a00640 1 -- 172.21.15.7:0/3292864950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd40803b410 con 0x7fd41015c390 2024-08-19T00:46:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.056+0000 7fd406a00640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3f006be30 0x7fd3f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.056+0000 7fd406a00640 1 -- 172.21.15.7:0/3292864950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7fd4080acee0 con 0x7fd41015c390 2024-08-19T00:46:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.056+0000 7fd40ea00640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3f006be30 0x7fd3f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:52.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.057+0000 7fd40ea00640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3f006be30 0x7fd3f006e2f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd4000011e0 tx=0x7fd400009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.061+0000 7fd406a00640 1 -- 172.21.15.7:0/3292864950 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd40807ae00 con 0x7fd41015c390 2024-08-19T00:46:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.282+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fd410158540 con 0x7fd41015c390 2024-08-19T00:46:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.441+0000 7fd406a00640 1 -- 172.21.15.7:0/3292864950 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v272) ==== 162+0+0 (secure 0 0 0) 0x7fd40807a700 con 0x7fd41015c390 2024-08-19T00:46:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:46:52.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3f006be30 msgr2=0x7fd3f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:52.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3f006be30 0x7fd3f006e2f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd4000011e0 tx=0x7fd400009040 comp rx=0 tx=0).stop 2024-08-19T00:46:52.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41015c390 msgr2=0x7fd4100cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:52.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41015c390 0x7fd4100cb640 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fd40802acc0 tx=0x7fd408004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:52.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 shutdown_connections 2024-08-19T00:46:52.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd3f006be30 0x7fd3f006e2f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41015c390 0x7fd4100cb640 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd41015bfb0 0x7fd4100cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 --2- 172.21.15.7:0/3292864950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4100b5130 0x7fd410153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 >> 172.21.15.7:0/3292864950 conn(0x7fd4100b2300 msgr2=0x7fd410158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 shutdown_connections 2024-08-19T00:46:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:52.443+0000 7fd415800640 1 -- 172.21.15.7:0/3292864950 wait complete. 2024-08-19T00:46:52.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:53.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.025+0000 7f3033400640 1 Processor -- start 2024-08-19T00:46:53.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.025+0000 7f3033400640 1 -- start start 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.026+0000 7f3033400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f302c159bf0 0x7f302c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.026+0000 7f3033400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.026+0000 7f3033400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f302c0cea40 0x7f302c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.026+0000 7f3033400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f302c06f7f0 con 0x7f302c0cea40 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.026+0000 7f3033400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f302c06f510 con 0x7f302c159bf0 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.026+0000 7f3033400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f302c072980 con 0x7f302c0739a0 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f302c0cea40 0x7f302c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f302c0cea40 0x7f302c0d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35802/0 (socket says 172.21.15.7:35802) 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 -- 172.21.15.7:0/3868535695 learned_addr learned my addr 172.21.15.7:0/3868535695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f302be00640 1 --2- 172.21.15.7:0/3868535695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3030a00640 1 --2- 172.21.15.7:0/3868535695 >> v2:172.21.15.162:3300/0 conn(0x7f302c159bf0 0x7f302c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 -- 172.21.15.7:0/3868535695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 msgr2=0x7f302c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 --2- 172.21.15.7:0/3868535695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 -- 172.21.15.7:0/3868535695 >> v2:172.21.15.162:3300/0 conn(0x7f302c159bf0 msgr2=0x7f302c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 --2- 172.21.15.7:0/3868535695 >> v2:172.21.15.162:3300/0 conn(0x7f302c159bf0 0x7f302c073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.027+0000 7f3031400640 1 -- 172.21.15.7:0/3868535695 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c072c60 con 0x7f302c0cea40 2024-08-19T00:46:53.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.028+0000 7f3031400640 1 --2- 172.21.15.7:0/3868535695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c0cea40 0x7f302c0d03c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f302c06d280 tx=0x7f302402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52e48dd6ead1f27 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:53.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f302b400640 1 -- 172.21.15.7:0/3868535695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024036070 con 0x7f302c0cea40 2024-08-19T00:46:53.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f302b400640 1 -- 172.21.15.7:0/3868535695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3024031600 con 0x7f302c0cea40 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f302b400640 1 -- 172.21.15.7:0/3868535695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30240319d0 con 0x7f302c0cea40 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 -- 172.21.15.7:0/3868535695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c0cea40 msgr2=0x7f302c0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 --2- 172.21.15.7:0/3868535695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c0cea40 0x7f302c0d03c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f302c06d280 tx=0x7f302402a610 comp rx=0 tx=0).stop 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 -- 172.21.15.7:0/3868535695 shutdown_connections 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 --2- 172.21.15.7:0/3868535695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c0cea40 0x7f302c0d03c0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 --2- 172.21.15.7:0/3868535695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 --2- 172.21.15.7:0/3868535695 >> v2:172.21.15.162:3300/0 conn(0x7f302c159bf0 0x7f302c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 -- 172.21.15.7:0/3868535695 >> 172.21.15.7:0/3868535695 conn(0x7f302c06bc70 msgr2=0x7f302c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 -- 172.21.15.7:0/3868535695 shutdown_connections 2024-08-19T00:46:53.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.029+0000 7f3033400640 1 -- 172.21.15.7:0/3868535695 wait complete. 2024-08-19T00:46:53.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.031+0000 7f3033400640 1 Processor -- start 2024-08-19T00:46:53.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.031+0000 7f3033400640 1 -- start start 2024-08-19T00:46:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3033400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c09dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3033400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f302c0cea40 0x7f302c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3033400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c159bf0 0x7f302c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3033400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f302c15a150 con 0x7f302c159bf0 2024-08-19T00:46:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3033400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f302c159fd0 con 0x7f302c0cea40 2024-08-19T00:46:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3033400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f302c0d0900 con 0x7f302c0739a0 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3031400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c159bf0 0x7f302c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3031400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c159bf0 0x7f302c1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35814/0 (socket says 172.21.15.7:35814) 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.032+0000 7f3031400640 1 -- 172.21.15.7:0/4244814595 learned_addr learned my addr 172.21.15.7:0/4244814595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3030a00640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c09dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f302be00640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f302c0cea40 0x7f302c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3031400640 1 -- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 msgr2=0x7f302c09dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3031400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c09dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3031400640 1 -- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f302c0cea40 msgr2=0x7f302c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3031400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f302c0cea40 0x7f302c15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3031400640 1 -- 172.21.15.7:0/4244814595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c15f480 con 0x7f302c159bf0 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3031400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c159bf0 0x7f302c1550a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f302402ac00 tx=0x7f3024004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.033+0000 7f3028c00640 1 -- 172.21.15.7:0/4244814595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302403f020 con 0x7f302c159bf0 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.034+0000 7f3028c00640 1 -- 172.21.15.7:0/4244814595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3024037040 con 0x7f302c159bf0 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.034+0000 7f3028c00640 1 -- 172.21.15.7:0/4244814595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024036070 con 0x7f302c159bf0 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.034+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c15f760 con 0x7f302c159bf0 2024-08-19T00:46:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.034+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c15fd20 con 0x7f302c159bf0 2024-08-19T00:46:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.035+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c0d03c0 con 0x7f302c159bf0 2024-08-19T00:46:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.036+0000 7f3028c00640 1 -- 172.21.15.7:0/4244814595 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3024042020 con 0x7f302c159bf0 2024-08-19T00:46:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.037+0000 7f3028c00640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f300c06be60 0x7f300c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.037+0000 7f3028c00640 1 -- 172.21.15.7:0/4244814595 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f30240abdf0 con 0x7f302c159bf0 2024-08-19T00:46:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.037+0000 7f3030a00640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f300c06be60 0x7f300c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.037+0000 7f3030a00640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f300c06be60 0x7f300c06e320 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3020009ac0 tx=0x7f3020009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.041+0000 7f3028c00640 1 -- 172.21.15.7:0/4244814595 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3024049020 con 0x7f302c159bf0 2024-08-19T00:46:53.176 INFO:tasks.ceph.mds.c.smithi007.stderr: -46> 2024-08-19T00:46:48.422+0000 7f269c400640 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2024-08-19T00:46:53.176 INFO:tasks.ceph.mds.c.smithi007.stderr: -36> 2024-08-19T00:46:48.422+0000 7f269c400640 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2024-08-19T00:46:53.216 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:46:53.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.269+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f302c06c980 con 0x7f302c159bf0 2024-08-19T00:46:53.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.269+0000 7f3028c00640 1 -- 172.21.15.7:0/4244814595 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 273 v273) ==== 95+0+4399 (secure 0 0 0) 0x7f3024079720 con 0x7f302c159bf0 2024-08-19T00:46:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:53.272 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":273,"btime":"2024-08-19T00:46:52:443878+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":273,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:52.443868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"a","rank":0,"incarnation":273,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/564246395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":564246395},{"type":"v1","addr":"172.21.15.7:6837","nonce":564246395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:46:53.272 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 273 2024-08-19T00:46:53.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.271+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f300c06be60 msgr2=0x7f300c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.271+0000 7f3033400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f300c06be60 0x7f300c06e320 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3020009ac0 tx=0x7f3020009190 comp rx=0 tx=0).stop 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.271+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c159bf0 msgr2=0x7f302c1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.271+0000 7f3033400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c159bf0 0x7f302c1550a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f302402ac00 tx=0x7f3024004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 shutdown_connections 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f300c06be60 0x7f300c06e320 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302c159bf0 0x7f302c1550a0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f302c0cea40 0x7f302c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 --2- 172.21.15.7:0/4244814595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f302c0739a0 0x7f302c09dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 >> 172.21.15.7:0/4244814595 conn(0x7f302c06bc70 msgr2=0x7f302c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:53.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 shutdown_connections 2024-08-19T00:46:53.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:53.272+0000 7f3033400640 1 -- 172.21.15.7:0/4244814595 wait complete. 2024-08-19T00:46:53.289 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 273, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:46:52.443868+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9537}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9537': {'gid': 9537, 'name': 'a', 'rank': 0, 'incarnation': 273, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/564246395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 564246395}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 564246395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:46:53.290 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9537:up:replay 2024-08-19T00:46:53.290 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:46:58.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:46:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.861+0000 7f53c7600640 1 Processor -- start 2024-08-19T00:46:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.861+0000 7f53c7600640 1 -- start start 2024-08-19T00:46:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c7600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53c0161a30 0x7f53c00b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c7600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f53c006c480 0x7f53c00b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c7600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f53c00b4640 con 0x7f53c006c480 2024-08-19T00:46:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c7600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f53c00d0320 con 0x7f53c0161a30 2024-08-19T00:46:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f53c00b0cf0 con 0x7f53c006b850 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f53c006c480 0x7f53c00b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f53c006c480 0x7f53c00b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35606/0 (socket says 172.21.15.7:35606) 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 -- 172.21.15.7:0/3239858649 learned_addr learned my addr 172.21.15.7:0/3239858649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c4c00640 1 --2- 172.21.15.7:0/3239858649 >> v2:172.21.15.162:3300/0 conn(0x7f53c0161a30 0x7f53c00b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53c5600640 1 --2- 172.21.15.7:0/3239858649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 -- 172.21.15.7:0/3239858649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 msgr2=0x7f53c006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 --2- 172.21.15.7:0/3239858649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 -- 172.21.15.7:0/3239858649 >> v2:172.21.15.162:3300/0 conn(0x7f53c0161a30 msgr2=0x7f53c00b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 --2- 172.21.15.7:0/3239858649 >> v2:172.21.15.162:3300/0 conn(0x7f53c0161a30 0x7f53c00b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.863+0000 7f53bfe00640 1 -- 172.21.15.7:0/3239858649 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00b3cf0 con 0x7f53c006c480 2024-08-19T00:46:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.864+0000 7f53bfe00640 1 --2- 172.21.15.7:0/3239858649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c00b37b0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f53c00d2160 tx=0x7f53ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8928655c518db8d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53bf400640 1 -- 172.21.15.7:0/3239858649 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac037070 con 0x7f53c006c480 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53bf400640 1 -- 172.21.15.7:0/3239858649 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ac032440 con 0x7f53c006c480 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53bf400640 1 -- 172.21.15.7:0/3239858649 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac032810 con 0x7f53c006c480 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 -- 172.21.15.7:0/3239858649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 msgr2=0x7f53c00b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 --2- 172.21.15.7:0/3239858649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c00b37b0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f53c00d2160 tx=0x7f53ac02a270 comp rx=0 tx=0).stop 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 -- 172.21.15.7:0/3239858649 shutdown_connections 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 --2- 172.21.15.7:0/3239858649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 --2- 172.21.15.7:0/3239858649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c00b37b0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 --2- 172.21.15.7:0/3239858649 >> v2:172.21.15.162:3300/0 conn(0x7f53c0161a30 0x7f53c00b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 -- 172.21.15.7:0/3239858649 >> 172.21.15.7:0/3239858649 conn(0x7f53c00b6840 msgr2=0x7f53c00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.865+0000 7f53c7600640 1 -- 172.21.15.7:0/3239858649 shutdown_connections 2024-08-19T00:46:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.866+0000 7f53c7600640 1 -- 172.21.15.7:0/3239858649 wait complete. 2024-08-19T00:46:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.867+0000 7f53c7600640 1 Processor -- start 2024-08-19T00:46:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.867+0000 7f53c7600640 1 -- start start 2024-08-19T00:46:58.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53c7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c00ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:58.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53c7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c0157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53c7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53c0161a30 0x7f53c0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53c7600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00b0f90 con 0x7f53c006c480 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53c7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00d08a0 con 0x7f53c0161a30 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53c7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f53c00d0b80 con 0x7f53c006b850 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c0157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.868+0000 7f53bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c0157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35618/0 (socket says 172.21.15.7:35618) 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53c5600640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53c0161a30 0x7f53c0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53bfe00640 1 -- 172.21.15.7:0/2800924624 learned_addr learned my addr 172.21.15.7:0/2800924624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53c4c00640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c00ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53bfe00640 1 -- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 msgr2=0x7f53c00ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53bfe00640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c00ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53bfe00640 1 -- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53c0161a30 msgr2=0x7f53c0157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53bfe00640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53c0161a30 0x7f53c0157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:58.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53bfe00640 1 -- 172.21.15.7:0/2800924624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c01f8750 con 0x7f53c006c480 2024-08-19T00:46:58.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.869+0000 7f53bfe00640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c0157420 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f53ac02a2b0 tx=0x7f53ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:58.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.870+0000 7f53bcc00640 1 -- 172.21.15.7:0/2800924624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac037040 con 0x7f53c006c480 2024-08-19T00:46:58.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.870+0000 7f53bcc00640 1 -- 172.21.15.7:0/2800924624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ac042070 con 0x7f53c006c480 2024-08-19T00:46:58.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.870+0000 7f53bcc00640 1 -- 172.21.15.7:0/2800924624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac030880 con 0x7f53c006c480 2024-08-19T00:46:58.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.870+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c01f89f0 con 0x7f53c006c480 2024-08-19T00:46:58.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.870+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c00ca900 con 0x7f53c006c480 2024-08-19T00:46:58.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.871+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c00b5f00 con 0x7f53c006c480 2024-08-19T00:46:58.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.872+0000 7f53bcc00640 1 -- 172.21.15.7:0/2800924624 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53ac030a20 con 0x7f53c006c480 2024-08-19T00:46:58.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.873+0000 7f53bcc00640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53a006be30 0x7f53a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:58.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.873+0000 7f53bcc00640 1 -- 172.21.15.7:0/2800924624 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f53ac0ac090 con 0x7f53c006c480 2024-08-19T00:46:58.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.873+0000 7f53c4c00640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53a006be30 0x7f53a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:58.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.874+0000 7f53c4c00640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53a006be30 0x7f53a006e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f53c01f7c00 tx=0x7f53b4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:58.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:58.878+0000 7f53bcc00640 1 -- 172.21.15.7:0/2800924624 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f53c00b5f00 con 0x7f53c006c480 2024-08-19T00:46:59.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.104+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53c0161e10 con 0x7f53c006c480 2024-08-19T00:46:59.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.105+0000 7f53bcc00640 1 -- 172.21.15.7:0/2800924624 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 276 v276) ==== 95+0+5229 (secure 0 0 0) 0x7f53ac079960 con 0x7f53c006c480 2024-08-19T00:46:59.108 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:46:59.108 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":276,"btime":"2024-08-19T00:46:55:460584+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":276,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:46:55.460576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"a","rank":0,"incarnation":273,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/564246395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":564246395},{"type":"v1","addr":"172.21.15.7:6837","nonce":564246395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9537,"qdb_cluster":[9537]},"id":6}]} 2024-08-19T00:46:59.108 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 276 2024-08-19T00:46:59.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53a006be30 msgr2=0x7f53a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53a006be30 0x7f53a006e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f53c01f7c00 tx=0x7f53b4009190 comp rx=0 tx=0).stop 2024-08-19T00:46:59.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 msgr2=0x7f53c0157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c0157420 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f53ac02a2b0 tx=0x7f53ac0046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 shutdown_connections 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f53a006be30 0x7f53a006e2f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53c0161a30 0x7f53c0157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53c006c480 0x7f53c0157420 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 --2- 172.21.15.7:0/2800924624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53c006b850 0x7f53c00ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.107+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 >> 172.21.15.7:0/2800924624 conn(0x7f53c00b6840 msgr2=0x7f53c00b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.108+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 shutdown_connections 2024-08-19T00:46:59.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.108+0000 7f53c7600640 1 -- 172.21.15.7:0/2800924624 wait complete. 2024-08-19T00:46:59.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 276, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:46:55.460576+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9537}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9537': {'gid': 9537, 'name': 'a', 'rank': 0, 'incarnation': 273, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/564246395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 564246395}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 564246395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9537, 'qdb_cluster': [9537]} 2024-08-19T00:46:59.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:46:59.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:46:59.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.281+0000 7f64f1200640 1 Processor -- start 2024-08-19T00:46:59.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.281+0000 7f64f1200640 1 -- start start 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.282+0000 7f64f1200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64ec0d28c0 0x7f64ec1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.282+0000 7f64f1200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64ec1439c0 0x7f64ec0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.282+0000 7f64f1200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec0b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.282+0000 7f64f1200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f64ec161d30 con 0x7f64ec0d28c0 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.282+0000 7f64f1200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f64ec162b90 con 0x7f64ec1439c0 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.282+0000 7f64f1200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec161f80 con 0x7f64ec0b4440 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64ec0d28c0 0x7f64ec1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64ec0d28c0 0x7f64ec1441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35630/0 (socket says 172.21.15.7:35630) 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 -- 172.21.15.7:0/3855251963 learned_addr learned my addr 172.21.15.7:0/3855251963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64e3e00640 1 --2- 172.21.15.7:0/3855251963 >> v2:172.21.15.162:3300/0 conn(0x7f64ec1439c0 0x7f64ec0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64ebe00640 1 --2- 172.21.15.7:0/3855251963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec0b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 -- 172.21.15.7:0/3855251963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 msgr2=0x7f64ec0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 --2- 172.21.15.7:0/3855251963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec0b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 -- 172.21.15.7:0/3855251963 >> v2:172.21.15.162:3300/0 conn(0x7f64ec1439c0 msgr2=0x7f64ec0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 --2- 172.21.15.7:0/3855251963 >> v2:172.21.15.162:3300/0 conn(0x7f64ec1439c0 0x7f64ec0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64eb400640 1 -- 172.21.15.7:0/3855251963 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec162260 con 0x7f64ec0d28c0 2024-08-19T00:46:59.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.283+0000 7f64ebe00640 1 --2- 172.21.15.7:0/3855251963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:59.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.284+0000 7f64eb400640 1 --2- 172.21.15.7:0/3855251963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0d28c0 0x7f64ec1441e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f64ec155830 tx=0x7f64dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7367933b5c49c052 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64eaa00640 1 -- 172.21.15.7:0/3855251963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc037070 con 0x7f64ec0d28c0 2024-08-19T00:46:59.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64eaa00640 1 -- 172.21.15.7:0/3855251963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc032440 con 0x7f64ec0d28c0 2024-08-19T00:46:59.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64eaa00640 1 -- 172.21.15.7:0/3855251963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc032810 con 0x7f64ec0d28c0 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 -- 172.21.15.7:0/3855251963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0d28c0 msgr2=0x7f64ec1441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 --2- 172.21.15.7:0/3855251963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0d28c0 0x7f64ec1441e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f64ec155830 tx=0x7f64dc02a1e0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 -- 172.21.15.7:0/3855251963 shutdown_connections 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 --2- 172.21.15.7:0/3855251963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 --2- 172.21.15.7:0/3855251963 >> v2:172.21.15.162:3300/0 conn(0x7f64ec1439c0 0x7f64ec0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 --2- 172.21.15.7:0/3855251963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec0d28c0 0x7f64ec1441e0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 -- 172.21.15.7:0/3855251963 >> 172.21.15.7:0/3855251963 conn(0x7f64ec062540 msgr2=0x7f64ec062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 -- 172.21.15.7:0/3855251963 shutdown_connections 2024-08-19T00:46:59.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.285+0000 7f64f1200640 1 -- 172.21.15.7:0/3855251963 wait complete. 2024-08-19T00:46:59.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.287+0000 7f64f1200640 1 Processor -- start 2024-08-19T00:46:59.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.287+0000 7f64f1200640 1 -- start start 2024-08-19T00:46:59.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.288+0000 7f64f1200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.288+0000 7f64f1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64ec0d28c0 0x7f64ec15d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.288+0000 7f64f1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec1439c0 0x7f64ec15da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.288+0000 7f64f1200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec144720 con 0x7f64ec1439c0 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.288+0000 7f64f1200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec162820 con 0x7f64ec0d28c0 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.288+0000 7f64f1200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec0d2ca0 con 0x7f64ec0b4440 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.288+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec1439c0 0x7f64ec15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64ec0d28c0 0x7f64ec15d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64eb400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec1439c0 0x7f64ec15da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35632/0 (socket says 172.21.15.7:35632) 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 -- 172.21.15.7:0/1242073313 learned_addr learned my addr 172.21.15.7:0/1242073313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 -- 172.21.15.7:0/1242073313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 msgr2=0x7f64ec15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 -- 172.21.15.7:0/1242073313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64ec0d28c0 msgr2=0x7f64ec15d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64ec0d28c0 0x7f64ec15d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 -- 172.21.15.7:0/1242073313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec15c050 con 0x7f64ec1439c0 2024-08-19T00:46:59.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64ebe00640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec1439c0 0x7f64ec15da40 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f64e4007ea0 tx=0x7f64e4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64e3400640 1 -- 172.21.15.7:0/1242073313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e401a070 con 0x7f64ec1439c0 2024-08-19T00:46:59.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64e3400640 1 -- 172.21.15.7:0/1242073313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4003bb0 con 0x7f64ec1439c0 2024-08-19T00:46:59.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.289+0000 7f64e3400640 1 -- 172.21.15.7:0/1242073313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e400de70 con 0x7f64ec1439c0 2024-08-19T00:46:59.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.290+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec15b290 con 0x7f64ec1439c0 2024-08-19T00:46:59.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.290+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec15b850 con 0x7f64ec1439c0 2024-08-19T00:46:59.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.292+0000 7f64e3400640 1 -- 172.21.15.7:0/1242073313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64e401d070 con 0x7f64ec1439c0 2024-08-19T00:46:59.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.293+0000 7f64e3400640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f64c806be30 0x7f64c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.293+0000 7f64e3400640 1 -- 172.21.15.7:0/1242073313 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f64e408bb60 con 0x7f64ec1439c0 2024-08-19T00:46:59.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.293+0000 7f64eb400640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f64c806be30 0x7f64c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.293+0000 7f64f5887740 1 Processor -- start 2024-08-19T00:46:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.293+0000 7f64f5887740 1 -- start start 2024-08-19T00:46:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64eb400640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f64c806be30 0x7f64c806e2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f64dc034000 tx=0x7f64dc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64f5887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461bc110 0x55a7461bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a7461dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461dff90 0x55a7461d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64f5887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a7460f4ba0 con 0x55a7461bc110 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a74608d230 con 0x55a7461dff90 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a7460f0b60 con 0x55a7461df630 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461bc110 0x55a7461bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461bc110 0x55a7461bc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35640/0 (socket says 172.21.15.7:35640) 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.294+0000 7f64eb400640 1 -- 172.21.15.7:0/2994077430 learned_addr learned my addr 172.21.15.7:0/2994077430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461dff90 0x55a7461d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64e3e00640 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a7461dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64eb400640 1 -- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 msgr2=0x55a7461dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64eb400640 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a7461dfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64eb400640 1 -- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461dff90 msgr2=0x55a7461d4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64eb400640 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461dff90 0x55a7461d4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64eb400640 1 -- 172.21.15.7:0/2994077430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7460bebb0 con 0x55a7461bc110 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461dff90 0x55a7461d4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64eb400640 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461bc110 0x55a7461bc4f0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f64dc02a7d0 tx=0x7f64dc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6824289e9b6a24a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64dbe00640 1 -- 172.21.15.7:0/2994077430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc04e070 con 0x55a7461bc110 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64dbe00640 1 -- 172.21.15.7:0/2994077430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc032a90 con 0x55a7461bc110 2024-08-19T00:46:59.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.295+0000 7f64dbe00640 1 -- 172.21.15.7:0/2994077430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc037040 con 0x55a7461bc110 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 -- 172.21.15.7:0/2994077430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461bc110 msgr2=0x55a7461bc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461bc110 0x55a7461bc4f0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f64dc02a7d0 tx=0x7f64dc02c000 comp rx=0 tx=0).stop 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 -- 172.21.15.7:0/2994077430 shutdown_connections 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461dff90 0x55a7461d4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a7461dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 --2- 172.21.15.7:0/2994077430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461bc110 0x55a7461bc4f0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 -- 172.21.15.7:0/2994077430 >> 172.21.15.7:0/2994077430 conn(0x55a746159110 msgr2=0x55a7461d6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 -- 172.21.15.7:0/2994077430 shutdown_connections 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.296+0000 7f64f5887740 1 -- 172.21.15.7:0/2994077430 wait complete. 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.297+0000 7f64f5887740 1 -- start start 2024-08-19T00:46:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.297+0000 7f64f5887740 1 Processor -- start 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a746191f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64f5887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461dff90 0x55a746192440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64f5887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a7461d9060 con 0x55a7461dff90 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a7460b0250 con 0x55a7461bc110 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a7461d8770 con 0x55a7461df630 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64f5887740 10 client.0 _ll_register_callbacks cb 0x55a7460b4740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461dff90 0x55a746192440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461dff90 0x55a746192440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35650/0 (socket says 172.21.15.7:35650) 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.298+0000 7f64ebe00640 1 -- 172.21.15.7:0/3995110938 learned_addr learned my addr 172.21.15.7:0/3995110938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64ebe00640 1 -- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 msgr2=0x55a746191f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64e3e00640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a746191f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64eb400640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64ebe00640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a746191f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64ebe00640 1 -- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 msgr2=0x55a7461b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64ebe00640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64ebe00640 1 -- 172.21.15.7:0/3995110938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a745e082d0 con 0x55a7461dff90 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64eb400640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64ebe00640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461dff90 0x55a746192440 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f64e40619a0 tx=0x7f64e4061ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775025e3809020e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64d8c00640 1 -- 172.21.15.7:0/3995110938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e40711c0 con 0x55a7461dff90 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64d8c00640 1 -- 172.21.15.7:0/3995110938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f64e4061a40 con 0x55a7461dff90 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64dc032a90 con 0x55a7461dff90 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64d8c00640 1 -- 172.21.15.7:0/3995110938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=276) ==== 24+0+0 (secure 0 0 0) 0x7f64e4061c40 con 0x55a7461dff90 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64f5887740 10 client.9609 fetch_fsmap learned FSMap version 276 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=276,monmap=2+}) -- 0x55a745ed26b0 con 0x55a7461dff90 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.299+0000 7f64d8c00640 1 -- 172.21.15.7:0/3995110938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc032a90 con 0x55a7461dff90 2024-08-19T00:46:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64d8c00640 1 -- 172.21.15.7:0/3995110938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 276) ==== 3502+0+0 (secure 0 0 0) 0x7f64e405d170 con 0x55a7461dff90 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64f5887740 10 client.9609 fetch_fsmap finished waiting for FSMap version 276 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64f5887740 10 client.9609 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64f5887740 20 client.9609 populate_metadata read hostname 'smithi007' 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64f5887740 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461cf770 0x55a7461f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64f5887740 4 client.9609 mds_command: new command op to 9537 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 --> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7461022d0 con 0x55a7461cf770 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64eb400640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461cf770 0x55a7461f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64eb400640 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461cf770 0x55a7461f44a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d68b68f25b03da28 server_cookie=dffecbd321f79be4 in_seq=0 out_seq=0 2024-08-19T00:46:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.300+0000 7f64d8c00640 10 client.9609 ms_handle_connect on v2:172.21.15.7:6835/564246395 2024-08-19T00:46:59.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.301+0000 7f64d8c00640 1 -- 172.21.15.7:0/3995110938 <== mds.0 v2:172.21.15.7:6835/564246395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7461022d0 con 0x55a7461cf770 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.301+0000 7f64d8c00640 10 client.9609 handle_command_reply: tid=0 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.301+0000 7f64f5887740 1 client.9609 shutdown 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461dff90 msgr2=0x55a746192440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461dff90 0x55a746192440 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f64e40619a0 tx=0x7f64e4061ed0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 shutdown_connections 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461cf770 0x55a7461f44a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461dff90 0x55a746192440 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461df630 0x55a746191f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 --2- 172.21.15.7:0/3995110938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 >> 172.21.15.7:0/3995110938 conn(0x55a746159110 msgr2=0x55a7461d7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64d8c00640 0 client.9609 ms_handle_reset on v2:172.21.15.7:6835/564246395 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 shutdown_connections 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 1 -- 172.21.15.7:0/3995110938 wait complete. 2024-08-19T00:46:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.302+0000 7f64f5887740 20 client.9609 trim_cache size 0 max 16384 2024-08-19T00:46:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.321+0000 7f64f5887740 1 Processor -- start 2024-08-19T00:46:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.321+0000 7f64f5887740 1 -- start start 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a746159110 0x55a74618d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461bc110 0x55a74624df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64f5887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64f5887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec201210 con 0x55a7461df630 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec2006c0 con 0x55a746159110 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec200bc0 con 0x55a7461bc110 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35660/0 (socket says 172.21.15.7:35660) 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64ebe00640 1 -- 172.21.15.7:0/2858863739 learned_addr learned my addr 172.21.15.7:0/2858863739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64eb400640 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a746159110 0x55a74618d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64e3e00640 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461bc110 0x55a74624df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.322+0000 7f64ebe00640 1 -- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461bc110 msgr2=0x55a74624df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461bc110 0x55a74624df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64ebe00640 1 -- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a746159110 msgr2=0x55a74618d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a746159110 0x55a74618d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64ebe00640 1 -- 172.21.15.7:0/2858863739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7461e9ca0 con 0x55a7461df630 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64eb400640 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a746159110 0x55a74618d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64e3e00640 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461bc110 0x55a74624df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d15e0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f64e4057650 tx=0x7f64e408a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e98085e443b3843 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64db400640 1 -- 172.21.15.7:0/2858863739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4059810 con 0x55a7461df630 2024-08-19T00:46:59.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64db400640 1 -- 172.21.15.7:0/2858863739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4087030 con 0x55a7461df630 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.323+0000 7f64db400640 1 -- 172.21.15.7:0/2858863739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e40587f0 con 0x55a7461df630 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 -- 172.21.15.7:0/2858863739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 msgr2=0x55a7461d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d15e0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f64e4057650 tx=0x7f64e408a000 comp rx=0 tx=0).stop 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 -- 172.21.15.7:0/2858863739 shutdown_connections 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d15e0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a7461bc110 0x55a74624df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 --2- 172.21.15.7:0/2858863739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a746159110 0x55a74618d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 -- 172.21.15.7:0/2858863739 >> 172.21.15.7:0/2858863739 conn(0x55a7461d0e30 msgr2=0x55a7461ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 -- 172.21.15.7:0/2858863739 shutdown_connections 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 -- 172.21.15.7:0/2858863739 wait complete. 2024-08-19T00:46:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.324+0000 7f64f5887740 1 -- start start 2024-08-19T00:46:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.325+0000 7f64f5887740 1 Processor -- start 2024-08-19T00:46:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.325+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a746159110 0x55a74624a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.325+0000 7f64f5887740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.325+0000 7f64f5887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.325+0000 7f64f5887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a7461cf5f0 con 0x55a7461df630 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a7461d0730 con 0x55a7461bc110 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64f5887740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a7461d0260 con 0x55a746159110 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64f5887740 10 client.0 _ll_register_callbacks cb 0x7f64dc035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35668/0 (socket says 172.21.15.7:35668) 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 -- 172.21.15.7:0/2903347251 learned_addr learned my addr 172.21.15.7:0/2903347251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64e3e00640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64eb400640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a746159110 0x55a74624a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 -- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a746159110 msgr2=0x55a74624a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a746159110 0x55a74624a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 -- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 msgr2=0x55a7461d5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461d5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 -- 172.21.15.7:0/2903347251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7461d6d30 con 0x55a7461df630 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64eb400640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a746159110 0x55a74624a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64ebe00640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d6480 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f64e40590a0 tx=0x7f64e4017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5530cf1c9b0db8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.326+0000 7f64d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64d8c00640 1 -- 172.21.15.7:0/2903347251 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e407c020 con 0x55a7461df630 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64e4087030 con 0x55a7461df630 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64d8c00640 1 -- 172.21.15.7:0/2903347251 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f64e40587f0 con 0x55a7461df630 2024-08-19T00:46:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64d8c00640 1 -- 172.21.15.7:0/2903347251 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=276) ==== 24+0+0 (secure 0 0 0) 0x7f64e4064050 con 0x55a7461df630 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 10 client.9615 fetch_fsmap learned FSMap version 276 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=276,monmap=2+}) -- 0x55a7461bc5d0 con 0x55a7461df630 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64d8c00640 1 -- 172.21.15.7:0/2903347251 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4087030 con 0x55a7461df630 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64d8c00640 1 -- 172.21.15.7:0/2903347251 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 276) ==== 3502+0+0 (secure 0 0 0) 0x7f64e40550f0 con 0x55a7461df630 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 10 client.9615 fetch_fsmap finished waiting for FSMap version 276 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 10 client.9615 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 20 client.9615 populate_metadata read hostname 'smithi007' 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461dff90 0x55a7461ea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 4 client.9615 mds_command: new command op to 9537 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.327+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 --> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] -- command(tid 0: {"prefix": "status"}) -- 0x55a7460fc620 con 0x55a7461dff90 2024-08-19T00:46:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64eb400640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461dff90 0x55a7461ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64d8c00640 10 client.9615 ms_handle_connect on v2:172.21.15.7:6835/564246395 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64eb400640 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461dff90 0x55a7461ea400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81bb2f8949712937 server_cookie=a0f446248683a657 in_seq=0 out_seq=0 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64d8c00640 1 -- 172.21.15.7:0/2903347251 <== mds.0 v2:172.21.15.7:6835/564246395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55a7460fc620 con 0x55a7461dff90 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64d8c00640 10 client.9615 handle_command_reply: tid=0 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64f5887740 1 client.9615 shutdown 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 msgr2=0x55a7461d6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.328+0000 7f64f5887740 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d6480 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f64e40590a0 tx=0x7f64e4017070 comp rx=0 tx=0).stop 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 shutdown_connections 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x55a7461dff90 0x55a7461ea400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7461df630 0x55a7461d6480 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7461bc110 0x55a7461d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 --2- 172.21.15.7:0/2903347251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a746159110 0x55a74624a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64d8c00640 0 client.9615 ms_handle_reset on v2:172.21.15.7:6835/564246395 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 >> 172.21.15.7:0/2903347251 conn(0x55a7461d0e30 msgr2=0x55a74624df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 shutdown_connections 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 1 -- 172.21.15.7:0/2903347251 wait complete. 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f5887740 20 client.9615 trim_cache size 0 max 16384 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:46:59.338 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9537, 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8842691169999997, 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 276, 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 117, 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 117, 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.137503683 2024-08-19T00:46:59.339 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:46:59.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f64c806be30 msgr2=0x7f64c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f1200640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f64c806be30 0x7f64c806e2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f64dc034000 tx=0x7f64dc02e000 comp rx=0 tx=0).stop 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec1439c0 msgr2=0x7f64ec15da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.329+0000 7f64f1200640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec1439c0 0x7f64ec15da40 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f64e4007ea0 tx=0x7f64e4007f90 comp rx=0 tx=0).stop 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 shutdown_connections 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f64c806be30 0x7f64c806e2f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64ec1439c0 0x7f64ec15da40 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64ec0d28c0 0x7f64ec15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 --2- 172.21.15.7:0/1242073313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64ec0b4440 0x7f64ec15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 >> 172.21.15.7:0/1242073313 conn(0x7f64ec062540 msgr2=0x7f64ec06c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 shutdown_connections 2024-08-19T00:46:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.330+0000 7f64f1200640 1 -- 172.21.15.7:0/1242073313 wait complete. 2024-08-19T00:46:59.347 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:46:59.347 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap key 10000000000.00000000:sixmegs_head', proceeding to ls 2024-08-19T00:46:59.348 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:46:59.436 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:46:59.434+0000 7fa46ce00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:46:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.503+0000 7f423f000640 1 Processor -- start 2024-08-19T00:46:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.504+0000 7f423f000640 1 -- start start 2024-08-19T00:46:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f4238071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423f000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42380b3750 0x7f42380cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423f000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42380cdfb0 con 0x7f42380d03c0 2024-08-19T00:46:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423f000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f42380cebc0 con 0x7f42380b3750 2024-08-19T00:46:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42380ce290 con 0x7f423806e710 2024-08-19T00:46:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42380b3750 0x7f42380cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423d000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f42380b3750 0x7f42380cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35682/0 (socket says 172.21.15.7:35682) 2024-08-19T00:46:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f423d000640 1 -- 172.21.15.7:0/1188717664 learned_addr learned my addr 172.21.15.7:0/1188717664 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.505+0000 7f422fe00640 1 --2- 172.21.15.7:0/1188717664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f4238071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.506+0000 7f423d000640 1 -- 172.21.15.7:0/1188717664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 msgr2=0x7f4238071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:46:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.506+0000 7f423d000640 1 --2- 172.21.15.7:0/1188717664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f4238071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.506+0000 7f423d000640 1 -- 172.21.15.7:0/1188717664 >> v1:172.21.15.162:6789/0 conn(0x7f42380d03c0 legacy=0x7f42380d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.506+0000 7f423d000640 1 -- 172.21.15.7:0/1188717664 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42380ce570 con 0x7f42380b3750 2024-08-19T00:46:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423d000640 1 --2- 172.21.15.7:0/1188717664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f42380cf050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f4230009e50 tx=0x7f423002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9041253d88e59bca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f4237400640 1 -- 172.21.15.7:0/1188717664 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230036070 con 0x7f42380b3750 2024-08-19T00:46:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f4237400640 1 -- 172.21.15.7:0/1188717664 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4230031600 con 0x7f42380b3750 2024-08-19T00:46:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f4237400640 1 -- 172.21.15.7:0/1188717664 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300319d0 con 0x7f42380b3750 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423f000640 1 -- 172.21.15.7:0/1188717664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 msgr2=0x7f42380cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423f000640 1 --2- 172.21.15.7:0/1188717664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f42380cf050 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f4230009e50 tx=0x7f423002a710 comp rx=0 tx=0).stop 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423f000640 1 -- 172.21.15.7:0/1188717664 shutdown_connections 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423f000640 1 --2- 172.21.15.7:0/1188717664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f42380cf050 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423f000640 1 --2- 172.21.15.7:0/1188717664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f4238071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423f000640 1 -- 172.21.15.7:0/1188717664 >> 172.21.15.7:0/1188717664 conn(0x7f423806bc70 msgr2=0x7f423806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.507+0000 7f423f000640 1 -- 172.21.15.7:0/1188717664 shutdown_connections 2024-08-19T00:46:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.508+0000 7f423f000640 1 -- 172.21.15.7:0/1188717664 wait complete. 2024-08-19T00:46:59.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.509+0000 7f423f000640 1 Processor -- start 2024-08-19T00:46:59.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.509+0000 7f423f000640 1 -- start start 2024-08-19T00:46:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f423f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f423809c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f423f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f423809a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f423f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d03c0 0x7f423809a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f423f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4238073c60 con 0x7f42380b3750 2024-08-19T00:46:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f423f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4238073ae0 con 0x7f42380d03c0 2024-08-19T00:46:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f423f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42380b3be0 con 0x7f423806e710 2024-08-19T00:46:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f422fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f423809a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f422fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f423809a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35694/0 (socket says 172.21.15.7:35694) 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.510+0000 7f422fe00640 1 -- 172.21.15.7:0/4186721298 learned_addr learned my addr 172.21.15.7:0/4186721298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f4237e00640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f423809c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f423d000640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d03c0 0x7f423809a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f422fe00640 1 -- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 msgr2=0x7f423809c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f422fe00640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f423809c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f422fe00640 1 -- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d03c0 msgr2=0x7f423809a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f422fe00640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d03c0 0x7f423809a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f422fe00640 1 -- 172.21.15.7:0/4186721298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423809ca20 con 0x7f42380b3750 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f422fe00640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f423809a1e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f422000e870 tx=0x7f422000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f4234c00640 1 -- 172.21.15.7:0/4186721298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220017070 con 0x7f42380b3750 2024-08-19T00:46:59.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.511+0000 7f4234c00640 1 -- 172.21.15.7:0/4186721298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f422000c940 con 0x7f42380b3750 2024-08-19T00:46:59.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.512+0000 7f4234c00640 1 -- 172.21.15.7:0/4186721298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422000cd30 con 0x7f42380b3750 2024-08-19T00:46:59.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.512+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423809cd60 con 0x7f42380b3750 2024-08-19T00:46:59.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.512+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423809d5a0 con 0x7f42380b3750 2024-08-19T00:46:59.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.513+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423815a440 con 0x7f42380b3750 2024-08-19T00:46:59.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.514+0000 7f4234c00640 1 -- 172.21.15.7:0/4186721298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f422001a070 con 0x7f42380b3750 2024-08-19T00:46:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.514+0000 7f4234c00640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421406be30 0x7f421406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.515+0000 7f4234c00640 1 -- 172.21.15.7:0/4186721298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f422008b750 con 0x7f42380b3750 2024-08-19T00:46:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.515+0000 7f4237e00640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421406be30 0x7f421406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:59.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.515+0000 7f4237e00640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421406be30 0x7f421406e2f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4228001780 tx=0x7f4228009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:59.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.519+0000 7f4234c00640 1 -- 172.21.15.7:0/4186721298 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f423815a440 con 0x7f42380b3750 2024-08-19T00:46:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.738+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4238071980 con 0x7f42380b3750 2024-08-19T00:46:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.739+0000 7f4234c00640 1 -- 172.21.15.7:0/4186721298 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v276) ==== 53+0+73 (secure 0 0 0) 0x7f423809cd60 con 0x7f42380b3750 2024-08-19T00:46:59.742 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421406be30 msgr2=0x7f421406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421406be30 0x7f421406e2f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4228001780 tx=0x7f4228009040 comp rx=0 tx=0).stop 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 msgr2=0x7f423809a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f423809a1e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f422000e870 tx=0x7f422000ed30 comp rx=0 tx=0).stop 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 shutdown_connections 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421406be30 0x7f421406e2f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d03c0 0x7f423809a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380b3750 0x7f423809a1e0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 --2- 172.21.15.7:0/4186721298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f423806e710 0x7f423809c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 >> 172.21.15.7:0/4186721298 conn(0x7f423806bc70 msgr2=0x7f4238159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 shutdown_connections 2024-08-19T00:46:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:46:59.741+0000 7f423f000640 1 -- 172.21.15.7:0/4186721298 wait complete. 2024-08-19T00:46:59.759 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:46:59.760 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:46:59.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:59.760 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:46:59.795 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:46:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42242sec preferred_lft 42242sec 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:59.797 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:46:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:46:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:46:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:59.798 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:46:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:46:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:46:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:46:59.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:59.799 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:46:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:46:59.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:46:59.896 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:46:59.932 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:46:59.932 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:46:59.932 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:46:59.932 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:46:59.932 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:46:59.932 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:46:59.933 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:46:59.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:46:59.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:46:59.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:46:59.933 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:47:00.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:47:00.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:47:00.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:00.131 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:47:00.166 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:47:00.166 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:47:00.166 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:00.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:00.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:47:00.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:47:00.263 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:00.299 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:00.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:47:00.299 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:00.375 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:47:00.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:00.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:00.505 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:00.506 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:00.506 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:00.521 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:00.521 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:00.521 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:00.521 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:47:00.521 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:47:00.544 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:47:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:47:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:47:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:47:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:47:00.547 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:47:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:47:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:47:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:47:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:47:00.550 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:47:00.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:00.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:00.606 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:47:00.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:47:00.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:47:00.696 INFO:teuthology.orchestra.run.smithi007.stdout:client7808 2024-08-19T00:47:00.697 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:00.697 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:00.732 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> import json 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/./subdir/sixmegs'"'"') 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(e.errno) 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> print(json.dumps( 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-19T00:47:00.733 DEBUG:teuthology.orchestra.run.smithi007:> indent=2)) 2024-08-19T00:47:00.734 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:47:00.776 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:47:00.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:00 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-08-19T00:47:02.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:47:02.919 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:47:06.489 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:06.486+0000 7fcb40400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-19T00:47:06.878 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-08-19T00:47:06.878 INFO:tasks.cephfs.test_damage:Result: EIO on client 2024-08-19T00:47:06.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:07.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.043+0000 7f3f84a00640 1 Processor -- start 2024-08-19T00:47:07.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.043+0000 7f3f84a00640 1 -- start start 2024-08-19T00:47:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.044+0000 7f3f84a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f8015f5b0 0x7f3f800cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.044+0000 7f3f84a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f800b4a90 0x7f3f800d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.044+0000 7f3f84a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f800cfaf0 con 0x7f3f800d03c0 2024-08-19T00:47:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.044+0000 7f3f84a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3f800d0d60 con 0x7f3f8015f5b0 2024-08-19T00:47:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.044+0000 7f3f84a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8015f990 con 0x7f3f800b4a90 2024-08-19T00:47:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f8015f5b0 0x7f3f800cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f8015f5b0 0x7f3f800cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47118/0 (socket says 172.21.15.7:47118) 2024-08-19T00:47:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7de00640 1 -- 172.21.15.7:0/3401443118 learned_addr learned my addr 172.21.15.7:0/3401443118 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7e800640 1 --2- 172.21.15.7:0/3401443118 >> v2:172.21.15.162:3300/0 conn(0x7f3f800b4a90 0x7f3f800d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7de00640 1 -- 172.21.15.7:0/3401443118 >> v2:172.21.15.162:3300/0 conn(0x7f3f800b4a90 msgr2=0x7f3f800d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7de00640 1 --2- 172.21.15.7:0/3401443118 >> v2:172.21.15.162:3300/0 conn(0x7f3f800b4a90 0x7f3f800d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7de00640 1 -- 172.21.15.7:0/3401443118 >> v1:172.21.15.162:6789/0 conn(0x7f3f800d03c0 legacy=0x7f3f800b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.045+0000 7f3f7de00640 1 -- 172.21.15.7:0/3401443118 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f800b50b0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.046+0000 7f3f7de00640 1 --2- 172.21.15.7:0/3401443118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f800cf5b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f3f8006f9f0 tx=0x7f3f7002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb18f7d25c43922 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.046+0000 7f3f7ca00640 1 -- 172.21.15.7:0/3401443118 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70037070 con 0x7f3f8015f5b0 2024-08-19T00:47:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f7ca00640 1 -- 172.21.15.7:0/3401443118 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f70032440 con 0x7f3f8015f5b0 2024-08-19T00:47:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f7ca00640 1 -- 172.21.15.7:0/3401443118 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70032810 con 0x7f3f8015f5b0 2024-08-19T00:47:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 -- 172.21.15.7:0/3401443118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 msgr2=0x7f3f800cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3401443118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f800cf5b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f3f8006f9f0 tx=0x7f3f7002a210 comp rx=0 tx=0).stop 2024-08-19T00:47:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 -- 172.21.15.7:0/3401443118 shutdown_connections 2024-08-19T00:47:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3401443118 >> v2:172.21.15.162:3300/0 conn(0x7f3f800b4a90 0x7f3f800d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3401443118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f800cf5b0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 -- 172.21.15.7:0/3401443118 >> 172.21.15.7:0/3401443118 conn(0x7f3f8006bc70 msgr2=0x7f3f8006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 -- 172.21.15.7:0/3401443118 shutdown_connections 2024-08-19T00:47:07.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.047+0000 7f3f84a00640 1 -- 172.21.15.7:0/3401443118 wait complete. 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.049+0000 7f3f84a00640 1 Processor -- start 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.049+0000 7f3f84a00640 1 -- start start 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f84a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f800b4a90 0x7f3f80156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f84a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f800d03c0 0x7f3f801f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f84a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f801f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f84a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f800cedb0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f84a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3f800cf120 con 0x7f3f800d03c0 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f84a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8006e660 con 0x7f3f800b4a90 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f801f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f801f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47132/0 (socket says 172.21.15.7:47132) 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 -- 172.21.15.7:0/3898179259 learned_addr learned my addr 172.21.15.7:0/3898179259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7de00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f800b4a90 0x7f3f80156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7d400640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f800d03c0 0x7f3f801f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 -- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f800b4a90 msgr2=0x7f3f80156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f800b4a90 0x7f3f80156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 -- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f800d03c0 msgr2=0x7f3f801f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f800d03c0 0x7f3f801f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.050+0000 7f3f7e800640 1 -- 172.21.15.7:0/3898179259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f801f8cd0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.051+0000 7f3f7e800640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f801f56f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f3f78007e70 tx=0x7f3f7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.051+0000 7f3f76000640 1 -- 172.21.15.7:0/3898179259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78014620 con 0x7f3f8015f5b0 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.051+0000 7f3f76000640 1 -- 172.21.15.7:0/3898179259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f78019070 con 0x7f3f8015f5b0 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.051+0000 7f3f76000640 1 -- 172.21.15.7:0/3898179259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78014a20 con 0x7f3f8015f5b0 2024-08-19T00:47:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.051+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f801f8fb0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.051+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f801f4ef0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.052+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8015e4f0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.053+0000 7f3f76000640 1 -- 172.21.15.7:0/3898179259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f78014bc0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.054+0000 7f3f76000640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f6006be60 0x7f3f6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.054+0000 7f3f76000640 1 -- 172.21.15.7:0/3898179259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f3f7808c100 con 0x7f3f8015f5b0 2024-08-19T00:47:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.054+0000 7f3f7de00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f6006be60 0x7f3f6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.055+0000 7f3f7de00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f6006be60 0x7f3f6006e320 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3f70034000 tx=0x7f3f7002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.059+0000 7f3f76000640 1 -- 172.21.15.7:0/3898179259 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3f8015e4f0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.279+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f800d0820 con 0x7f3f8015f5b0 2024-08-19T00:47:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.280+0000 7f3f76000640 1 -- 172.21.15.7:0/3898179259 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 277 v277) ==== 95+0+5229 (secure 0 0 0) 0x7f3f780598b0 con 0x7f3f8015f5b0 2024-08-19T00:47:07.283 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:07.283 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":277,"btime":"2024-08-19T00:47:06:487908+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":277,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:06.462596+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"a","rank":0,"incarnation":273,"state":"up:active","state_seq":7,"addr":"172.21.15.7:6837/564246395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":564246395},{"type":"v1","addr":"172.21.15.7:6837","nonce":564246395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9537,"qdb_cluster":[9537]},"id":6}]} 2024-08-19T00:47:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 277 2024-08-19T00:47:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f6006be60 msgr2=0x7f3f6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f6006be60 0x7f3f6006e320 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3f70034000 tx=0x7f3f7002e000 comp rx=0 tx=0).stop 2024-08-19T00:47:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 msgr2=0x7f3f801f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f801f56f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f3f78007e70 tx=0x7f3f7800e4b0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 shutdown_connections 2024-08-19T00:47:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3f6006be60 0x7f3f6006e320 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f8015f5b0 0x7f3f801f56f0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f800d03c0 0x7f3f801f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 --2- 172.21.15.7:0/3898179259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f800b4a90 0x7f3f80156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 >> 172.21.15.7:0/3898179259 conn(0x7f3f8006bc70 msgr2=0x7f3f8006c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 shutdown_connections 2024-08-19T00:47:07.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.282+0000 7f3f84a00640 1 -- 172.21.15.7:0/3898179259 wait complete. 2024-08-19T00:47:07.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-08-19T00:47:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.457+0000 7ff40a000640 1 Processor -- start 2024-08-19T00:47:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.457+0000 7ff40a000640 1 -- start start 2024-08-19T00:47:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.458+0000 7ff40a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff40415bfb0 0x7ff4040b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.458+0000 7ff40a000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4040acef0 con 0x7ff40415c390 2024-08-19T00:47:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.458+0000 7ff40a000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4040ad1d0 con 0x7ff4040b5130 2024-08-19T00:47:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.458+0000 7ff40a000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff4040ad790 con 0x7ff40415bfb0 2024-08-19T00:47:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.458+0000 7ff403400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff40415bfb0 0x7ff4040b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.458+0000 7ff403400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff40415bfb0 0x7ff4040b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47144/0 (socket says 172.21.15.7:47144) 2024-08-19T00:47:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.458+0000 7ff403400640 1 -- 172.21.15.7:0/2379711801 learned_addr learned my addr 172.21.15.7:0/2379711801 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.459+0000 7ff403400640 1 -- 172.21.15.7:0/2379711801 >> v1:172.21.15.162:6789/0 conn(0x7ff4040b5130 legacy=0x7ff4040aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.459+0000 7ff403400640 1 -- 172.21.15.7:0/2379711801 >> v1:172.21.15.7:6789/0 conn(0x7ff40415c390 legacy=0x7ff404072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.459+0000 7ff403400640 1 -- 172.21.15.7:0/2379711801 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4040ad4b0 con 0x7ff40415bfb0 2024-08-19T00:47:07.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.460+0000 7ff403400640 1 --2- 172.21.15.7:0/2379711801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff40415bfb0 0x7ff4040b3e00 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009870 tx=0x7ff3f402a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126e471a424371b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.460+0000 7ff402a00640 1 -- 172.21.15.7:0/2379711801 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4037070 con 0x7ff40415bfb0 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.460+0000 7ff402a00640 1 -- 172.21.15.7:0/2379711801 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4032640 con 0x7ff40415bfb0 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.460+0000 7ff402a00640 1 -- 172.21.15.7:0/2379711801 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4032a10 con 0x7ff40415bfb0 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.461+0000 7ff40a000640 1 -- 172.21.15.7:0/2379711801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff40415bfb0 msgr2=0x7ff4040b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.461+0000 7ff40a000640 1 --2- 172.21.15.7:0/2379711801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff40415bfb0 0x7ff4040b3e00 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009870 tx=0x7ff3f402a2f0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.461+0000 7ff40a000640 1 -- 172.21.15.7:0/2379711801 shutdown_connections 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.461+0000 7ff40a000640 1 --2- 172.21.15.7:0/2379711801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff40415bfb0 0x7ff4040b3e00 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.461+0000 7ff40a000640 1 -- 172.21.15.7:0/2379711801 >> 172.21.15.7:0/2379711801 conn(0x7ff4040b2300 msgr2=0x7ff40406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.461+0000 7ff40a000640 1 -- 172.21.15.7:0/2379711801 shutdown_connections 2024-08-19T00:47:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.461+0000 7ff40a000640 1 -- 172.21.15.7:0/2379711801 wait complete. 2024-08-19T00:47:07.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.462+0000 7ff40a000640 1 Processor -- start 2024-08-19T00:47:07.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.463+0000 7ff40a000640 1 -- start start 2024-08-19T00:47:07.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.463+0000 7ff40a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4040b5130 0x7ff40415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.463+0000 7ff40a000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff40415bfb0 0x7ff4041580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.463+0000 7ff40a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415c390 0x7ff4041585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.463+0000 7ff40a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff4040b44c0 con 0x7ff4040b5130 2024-08-19T00:47:07.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.463+0000 7ff40a000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4040b4340 con 0x7ff40415c390 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.463+0000 7ff40a000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4040af2e0 con 0x7ff40415bfb0 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4040b5130 0x7ff40415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4040b5130 0x7ff40415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47150/0 (socket says 172.21.15.7:47150) 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 -- 172.21.15.7:0/1951380641 learned_addr learned my addr 172.21.15.7:0/1951380641 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff40415bfb0 0x7ff4041580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403e00640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415c390 0x7ff4041585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 -- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff40415bfb0 msgr2=0x7ff4041580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff40415bfb0 0x7ff4041580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 -- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415c390 msgr2=0x7ff4041585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415c390 0x7ff4041585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 -- 172.21.15.7:0/1951380641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40415f120 con 0x7ff4040b5130 2024-08-19T00:47:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.464+0000 7ff403400640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4040b5130 0x7ff40415ebe0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4000c00 tx=0x7ff3f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.465+0000 7ff3fb400640 1 -- 172.21.15.7:0/1951380641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4037040 con 0x7ff4040b5130 2024-08-19T00:47:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.465+0000 7ff3fb400640 1 -- 172.21.15.7:0/1951380641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4042070 con 0x7ff4040b5130 2024-08-19T00:47:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.465+0000 7ff3fb400640 1 -- 172.21.15.7:0/1951380641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4030bd0 con 0x7ff4040b5130 2024-08-19T00:47:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.465+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40415db40 con 0x7ff4040b5130 2024-08-19T00:47:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.465+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40415e100 con 0x7ff4040b5130 2024-08-19T00:47:07.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.467+0000 7ff3fb400640 1 -- 172.21.15.7:0/1951380641 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3f4032500 con 0x7ff4040b5130 2024-08-19T00:47:07.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.468+0000 7ff3fb400640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3e006be30 0x7ff3e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.468+0000 7ff3fb400640 1 -- 172.21.15.7:0/1951380641 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7ff3f40ac390 con 0x7ff4040b5130 2024-08-19T00:47:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.468+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3e006be30 0x7ff3e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.468+0000 7ff40cec1740 1 Processor -- start 2024-08-19T00:47:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.468+0000 7ff40cec1740 1 -- start start 2024-08-19T00:47:07.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.469+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3e006be30 0x7ff3e006e2f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff4040cc640 tx=0x7ff3ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.469+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c804920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.469+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c84fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.469+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c850060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.469+0000 7ff40cec1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d0c76cef0 con 0x560d0c804540 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.469+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560d0c714d10 con 0x560d0c804e60 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.469+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560d0c768eb0 con 0x560d0c84e1c0 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c804920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c804920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47156/0 (socket says 172.21.15.7:47156) 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 -- 172.21.15.7:0/2728298321 learned_addr learned my addr 172.21.15.7:0/2728298321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c84fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403e00640 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c850060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 -- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 msgr2=0x560d0c850060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c850060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 -- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 msgr2=0x560d0c84fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c84fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 -- 172.21.15.7:0/2728298321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0c54c7c0 con 0x560d0c804540 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c84fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff403400640 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c804920 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4035040 tx=0x7ff3f4075f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76e826a72b1f1d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff3f3400640 1 -- 172.21.15.7:0/2728298321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f407df60 con 0x560d0c804540 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff3f3400640 1 -- 172.21.15.7:0/2728298321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4082790 con 0x560d0c804540 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.470+0000 7ff3f3400640 1 -- 172.21.15.7:0/2728298321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4030d70 con 0x560d0c804540 2024-08-19T00:47:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 -- 172.21.15.7:0/2728298321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 msgr2=0x560d0c804920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c804920 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4035040 tx=0x7ff3f4075f80 comp rx=0 tx=0).stop 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 -- 172.21.15.7:0/2728298321 shutdown_connections 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c850060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c84fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 --2- 172.21.15.7:0/2728298321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c804920 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 -- 172.21.15.7:0/2728298321 >> 172.21.15.7:0/2728298321 conn(0x560d0c7d0d00 msgr2=0x560d0c84e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 -- 172.21.15.7:0/2728298321 shutdown_connections 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.471+0000 7ff40cec1740 1 -- 172.21.15.7:0/2728298321 wait complete. 2024-08-19T00:47:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.472+0000 7ff40cec1740 1 -- start start 2024-08-19T00:47:07.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.472+0000 7ff40cec1740 1 Processor -- start 2024-08-19T00:47:07.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804540 0x560d0c849d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804e60 0x560d0c8340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c820200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff40cec1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d0c80a7d0 con 0x560d0c804e60 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560d0c7288d0 con 0x560d0c804540 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560d0c84df50 con 0x560d0c84e1c0 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff40cec1740 10 client.0 _ll_register_callbacks cb 0x560d0c47fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff3fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804e60 0x560d0c8340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff403400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804540 0x560d0c849d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff3fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804e60 0x560d0c8340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47160/0 (socket says 172.21.15.7:47160) 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff3fbe00640 1 -- 172.21.15.7:0/695615293 learned_addr learned my addr 172.21.15.7:0/695615293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff403400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804540 0x560d0c849d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:32842/0 (socket says 172.21.15.7:32842) 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.473+0000 7ff403e00640 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c820200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3fbe00640 1 -- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 msgr2=0x560d0c820200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c820200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3fbe00640 1 -- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804540 msgr2=0x560d0c849d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804540 0x560d0c849d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3fbe00640 1 -- 172.21.15.7:0/695615293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0c5acf50 con 0x560d0c804e60 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff403400640 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804540 0x560d0c849d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804e60 0x560d0c8340f0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec003920 tx=0x7ff3ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1468e7ad98e2d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3e7e00640 1 -- 172.21.15.7:0/695615293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec027060 con 0x560d0c804e60 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3f4082790 con 0x560d0c804e60 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.474+0000 7ff3e7e00640 1 -- 172.21.15.7:0/695615293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7ff3ec010040 con 0x560d0c804e60 2024-08-19T00:47:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff3e7e00640 1 -- 172.21.15.7:0/695615293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=277) ==== 24+0+0 (secure 0 0 0) 0x7ff3ec00ea80 con 0x560d0c804e60 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 10 client.9642 fetch_fsmap learned FSMap version 277 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=277,monmap=2+}) -- 0x560d0c4400b0 con 0x560d0c804e60 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff3e7e00640 1 -- 172.21.15.7:0/695615293 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4082790 con 0x560d0c804e60 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff3e7e00640 1 -- 172.21.15.7:0/695615293 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 277) ==== 3502+0+0 (secure 0 0 0) 0x7ff3ec022430 con 0x560d0c804e60 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 10 client.9642 fetch_fsmap finished waiting for FSMap version 277 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 10 client.9642 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 20 client.9642 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c84aa90 0x560d0c8320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 4 client.9642 mds_command: new command op to 9537 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 --> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d0c77a620 con 0x560d0c84aa90 2024-08-19T00:47:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.475+0000 7ff403400640 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c84aa90 0x560d0c8320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.476+0000 7ff403400640 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c84aa90 0x560d0c8320c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d87b8899caa663f server_cookie=8c734f3d1ae37a3e in_seq=0 out_seq=0 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.476+0000 7ff3e7e00640 10 client.9642 ms_handle_connect on v2:172.21.15.7:6835/564246395 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff3e7e00640 1 -- 172.21.15.7:0/695615293 <== mds.0 v2:172.21.15.7:6835/564246395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d0c77a620 con 0x560d0c84aa90 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff3e7e00640 10 client.9642 handle_command_reply: tid=0 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 client.9642 shutdown 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804e60 msgr2=0x560d0c8340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804e60 0x560d0c8340f0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec003920 tx=0x7ff3ec000bc0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 shutdown_connections 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c84aa90 0x560d0c8320c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c820200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804e60 0x560d0c8340f0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 --2- 172.21.15.7:0/695615293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804540 0x560d0c849d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 >> 172.21.15.7:0/695615293 conn(0x560d0c7d0d00 msgr2=0x560d0c809ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff3e7e00640 0 client.9642 ms_handle_reset on v2:172.21.15.7:6835/564246395 2024-08-19T00:47:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 shutdown_connections 2024-08-19T00:47:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 1 -- 172.21.15.7:0/695615293 wait complete. 2024-08-19T00:47:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.477+0000 7ff40cec1740 20 client.9642 trim_cache size 0 max 16384 2024-08-19T00:47:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.491+0000 7ff40cec1740 1 Processor -- start 2024-08-19T00:47:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.491+0000 7ff40cec1740 1 -- start start 2024-08-19T00:47:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c872320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c804e60 0x560d0c84e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c84e1c0 0x560d0c84ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff40cec1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff404201570 con 0x560d0c804540 2024-08-19T00:47:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4042008d0 con 0x560d0c84e1c0 2024-08-19T00:47:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff404200f20 con 0x560d0c804e60 2024-08-19T00:47:07.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c872320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c872320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47170/0 (socket says 172.21.15.7:47170) 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff403400640 1 -- 172.21.15.7:0/1343453493 learned_addr learned my addr 172.21.15.7:0/1343453493 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff403400640 1 -- 172.21.15.7:0/1343453493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c804e60 msgr2=0x560d0c84e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff403400640 1 --2- 172.21.15.7:0/1343453493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c804e60 0x560d0c84e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.492+0000 7ff403400640 1 -- 172.21.15.7:0/1343453493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c84e1c0 msgr2=0x560d0c84ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff403400640 1 --2- 172.21.15.7:0/1343453493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c84e1c0 0x560d0c84ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff403400640 1 -- 172.21.15.7:0/1343453493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0c848ca0 con 0x560d0c804540 2024-08-19T00:47:07.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff403400640 1 --2- 172.21.15.7:0/1343453493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c872320 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4079b40 tx=0x7ff3f4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68653dbdfbddc640 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff3f2a00640 1 -- 172.21.15.7:0/1343453493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4082790 con 0x560d0c804540 2024-08-19T00:47:07.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff3f2a00640 1 -- 172.21.15.7:0/1343453493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4096070 con 0x560d0c804540 2024-08-19T00:47:07.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff3f2a00640 1 -- 172.21.15.7:0/1343453493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f407df60 con 0x560d0c804540 2024-08-19T00:47:07.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff40cec1740 1 -- 172.21.15.7:0/1343453493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 msgr2=0x560d0c872320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.493+0000 7ff40cec1740 1 --2- 172.21.15.7:0/1343453493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c872320 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4079b40 tx=0x7ff3f4007000 comp rx=0 tx=0).stop 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 -- 172.21.15.7:0/1343453493 shutdown_connections 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 --2- 172.21.15.7:0/1343453493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c84e1c0 0x560d0c84ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 --2- 172.21.15.7:0/1343453493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c804e60 0x560d0c84e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 --2- 172.21.15.7:0/1343453493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c872320 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 -- 172.21.15.7:0/1343453493 >> 172.21.15.7:0/1343453493 conn(0x560d0c7d0d00 msgr2=0x560d0c8309e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 -- 172.21.15.7:0/1343453493 shutdown_connections 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 -- 172.21.15.7:0/1343453493 wait complete. 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 -- start start 2024-08-19T00:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.494+0000 7ff40cec1740 1 Processor -- start 2024-08-19T00:47:07.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.495+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c832a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.495+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c823540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff40cec1740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c809cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff40cec1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d0c8347a0 con 0x560d0c804540 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560d0c84a3b0 con 0x560d0c804e60 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff40cec1740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x560d0c8622b0 con 0x560d0c84e1c0 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff40cec1740 10 client.0 _ll_register_callbacks cb 0x7ff3ec0013a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c832a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c832a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47180/0 (socket says 172.21.15.7:47180) 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 -- 172.21.15.7:0/307241699 learned_addr learned my addr 172.21.15.7:0/307241699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403e00640 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c809cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c823540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 -- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 msgr2=0x560d0c809cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c809cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 -- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 msgr2=0x560d0c823540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c823540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.496+0000 7ff403400640 1 -- 172.21.15.7:0/307241699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0c84f450 con 0x560d0c804540 2024-08-19T00:47:07.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.497+0000 7ff403400640 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c832a70 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4006da0 tx=0x7ff3f4032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0ce812007db13f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.497+0000 7ff3e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:07.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.499+0000 7ff3e7e00640 1 -- 172.21.15.7:0/307241699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f407df60 con 0x560d0c804540 2024-08-19T00:47:07.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.499+0000 7ff3e7e00640 1 -- 172.21.15.7:0/307241699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7ff3f4030d70 con 0x560d0c804540 2024-08-19T00:47:07.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.499+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3f4096070 con 0x560d0c804540 2024-08-19T00:47:07.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.499+0000 7ff3e7e00640 1 -- 172.21.15.7:0/307241699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=277) ==== 24+0+0 (secure 0 0 0) 0x7ff3f40a3420 con 0x560d0c804540 2024-08-19T00:47:07.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.499+0000 7ff40cec1740 10 client.9648 fetch_fsmap learned FSMap version 277 2024-08-19T00:47:07.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.499+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=277,monmap=2+}) -- 0x560d0c832fb0 con 0x560d0c804540 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff3e7e00640 1 -- 172.21.15.7:0/307241699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4096070 con 0x560d0c804540 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff3e7e00640 1 -- 172.21.15.7:0/307241699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 277) ==== 3502+0+0 (secure 0 0 0) 0x7ff3f403a070 con 0x560d0c804540 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff40cec1740 10 client.9648 fetch_fsmap finished waiting for FSMap version 277 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff40cec1740 10 client.9648 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff40cec1740 20 client.9648 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff40cec1740 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c8ceb40 0x560d0c8cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff40cec1740 4 client.9648 mds_command: new command op to 9537 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 --> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x560d0c774970 con 0x560d0c8ceb40 2024-08-19T00:47:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.500+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c8ceb40 0x560d0c8cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff3fbe00640 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c8ceb40 0x560d0c8cef20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50b75870274239c4 server_cookie=c839099b906ab751 in_seq=0 out_seq=0 2024-08-19T00:47:07.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff3e7e00640 10 client.9648 ms_handle_connect on v2:172.21.15.7:6835/564246395 2024-08-19T00:47:07.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff3e7e00640 1 -- 172.21.15.7:0/307241699 <== mds.0 v2:172.21.15.7:6835/564246395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+215 (crc 0 0 0) 0x560d0c774970 con 0x560d0c8ceb40 2024-08-19T00:47:07.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff3e7e00640 10 client.9648 handle_command_reply: tid=0 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 client.9648 shutdown 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 msgr2=0x560d0c832a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c832a70 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4006da0 tx=0x7ff3f4032f90 comp rx=0 tx=0).stop 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 shutdown_connections 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:6835/564246395,v1:172.21.15.7:6837/564246395] conn(0x560d0c8ceb40 0x560d0c8cef20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560d0c84e1c0 0x560d0c809cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d0c804e60 0x560d0c823540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff3e7e00640 0 client.9648 ms_handle_reset on v2:172.21.15.7:6835/564246395 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 --2- 172.21.15.7:0/307241699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d0c804540 0x560d0c832a70 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 >> 172.21.15.7:0/307241699 conn(0x560d0c7d0d00 msgr2=0x560d0c834920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.501+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 shutdown_connections 2024-08-19T00:47:07.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40cec1740 1 -- 172.21.15.7:0/307241699 wait complete. 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40cec1740 20 client.9648 trim_cache size 0 max 16384 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "dentry", 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4175389491, 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627776, 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: "frag": "*", 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "sixmegs", 2024-08-19T00:47:07.507 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_id": "head", 2024-08-19T00:47:07.508 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/subdir/sixmegs" 2024-08-19T00:47:07.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:47:07.508 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3e006be30 msgr2=0x7ff3e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3e006be30 0x7ff3e006e2f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff4040cc640 tx=0x7ff3ec009040 comp rx=0 tx=0).stop 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4040b5130 msgr2=0x7ff40415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4040b5130 0x7ff40415ebe0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4000c00 tx=0x7ff3f40046c0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 shutdown_connections 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff3e006be30 0x7ff3e006e2f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415c390 0x7ff4041585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff40415bfb0 0x7ff4041580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 --2- 172.21.15.7:0/1951380641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4040b5130 0x7ff40415ebe0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.502+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 >> 172.21.15.7:0/1951380641 conn(0x7ff4040b2300 msgr2=0x7ff4040ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.503+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 shutdown_connections 2024-08-19T00:47:07.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.503+0000 7ff40a000640 1 -- 172.21.15.7:0/1951380641 wait complete. 2024-08-19T00:47:07.521 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 100.00000000:stray0_head' 2024-08-19T00:47:07.521 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:07.521 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:07.557 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:07.557 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:07.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:47:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.829+0000 7f5cdbc00640 1 Processor -- start 2024-08-19T00:47:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.830+0000 7f5cdbc00640 1 -- start start 2024-08-19T00:47:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cdbc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5cd40ce500 0x7f5cd40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cdbc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5cd40d03c0 0x7f5cd40d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cdbc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd406f7f0 con 0x7f5cd4159bf0 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cdbc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd40d0d50 con 0x7f5cd40d03c0 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cdbc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd406f510 con 0x7f5cd40ce500 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cd9c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5cd40d03c0 0x7f5cd40d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cd9c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5cd40d03c0 0x7f5cd40d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47186/0 (socket says 172.21.15.7:47186) 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cd9c00640 1 -- 172.21.15.7:0/3312975748 learned_addr learned my addr 172.21.15.7:0/3312975748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5ccbe00640 1 --2- 172.21.15.7:0/3312975748 >> v2:172.21.15.162:3300/0 conn(0x7f5cd40ce500 0x7f5cd40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cd9c00640 1 -- 172.21.15.7:0/3312975748 >> v2:172.21.15.162:3300/0 conn(0x7f5cd40ce500 msgr2=0x7f5cd40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cd9c00640 1 --2- 172.21.15.7:0/3312975748 >> v2:172.21.15.162:3300/0 conn(0x7f5cd40ce500 0x7f5cd40ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cd9c00640 1 -- 172.21.15.7:0/3312975748 >> v1:172.21.15.162:6789/0 conn(0x7f5cd4159bf0 legacy=0x7f5cd4073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:07.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.831+0000 7f5cd9c00640 1 -- 172.21.15.7:0/3312975748 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd4072980 con 0x7f5cd40d03c0 2024-08-19T00:47:07.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.832+0000 7f5cd9c00640 1 --2- 172.21.15.7:0/3312975748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40d03c0 0x7f5cd40d0810 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40b1cc0 tx=0x7f5ccc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87d39bbc8c1634f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cd3e00640 1 -- 172.21.15.7:0/3312975748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc036070 con 0x7f5cd40d03c0 2024-08-19T00:47:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cd3e00640 1 -- 172.21.15.7:0/3312975748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc031600 con 0x7f5cd40d03c0 2024-08-19T00:47:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cd3e00640 1 -- 172.21.15.7:0/3312975748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0319d0 con 0x7f5cd40d03c0 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cdbc00640 1 -- 172.21.15.7:0/3312975748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40d03c0 msgr2=0x7f5cd40d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/3312975748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40d03c0 0x7f5cd40d0810 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40b1cc0 tx=0x7f5ccc02a6a0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cdbc00640 1 -- 172.21.15.7:0/3312975748 shutdown_connections 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/3312975748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40d03c0 0x7f5cd40d0810 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/3312975748 >> v2:172.21.15.162:3300/0 conn(0x7f5cd40ce500 0x7f5cd40ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cdbc00640 1 -- 172.21.15.7:0/3312975748 >> 172.21.15.7:0/3312975748 conn(0x7f5cd406bc70 msgr2=0x7f5cd406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.833+0000 7f5cdbc00640 1 -- 172.21.15.7:0/3312975748 shutdown_connections 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.834+0000 7f5cdbc00640 1 -- 172.21.15.7:0/3312975748 wait complete. 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.835+0000 7f5cdbc00640 1 Processor -- start 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.835+0000 7f5cdbc00640 1 -- start start 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cdbc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40ce500 0x7f5cd40999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cdbc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd40d03c0 0x7f5cd40b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cdbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cd4159bf0 0x7f5cd41574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cdbc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd4073b70 con 0x7f5cd40ce500 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cdbc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd4072f40 con 0x7f5cd40d03c0 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cdbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd4159fd0 con 0x7f5cd4159bf0 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cd9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40ce500 0x7f5cd40999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cd9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40ce500 0x7f5cd40999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47190/0 (socket says 172.21.15.7:47190) 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cd9200640 1 -- 172.21.15.7:0/2057803182 learned_addr learned my addr 172.21.15.7:0/2057803182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5ccbe00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd40d03c0 0x7f5cd40b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.836+0000 7f5cd9c00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cd4159bf0 0x7f5cd41574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd9200640 1 -- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cd4159bf0 msgr2=0x7f5cd41574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd9200640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cd4159bf0 0x7f5cd41574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd9200640 1 -- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd40d03c0 msgr2=0x7f5cd40b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd9200640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd40d03c0 0x7f5cd40b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd9200640 1 -- 172.21.15.7:0/2057803182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd4099f00 con 0x7f5cd40ce500 2024-08-19T00:47:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd9200640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40ce500 0x7f5cd40999c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400c400 tx=0x7f5cc400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd1600640 1 -- 172.21.15.7:0/2057803182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40052d0 con 0x7f5cd40ce500 2024-08-19T00:47:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd1600640 1 -- 172.21.15.7:0/2057803182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc4005490 con 0x7f5cd40ce500 2024-08-19T00:47:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cd1600640 1 -- 172.21.15.7:0/2057803182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4007260 con 0x7f5cd40ce500 2024-08-19T00:47:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.837+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd4152f20 con 0x7f5cd40ce500 2024-08-19T00:47:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.838+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd41f53e0 con 0x7f5cd40ce500 2024-08-19T00:47:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.839+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd40d0810 con 0x7f5cd40ce500 2024-08-19T00:47:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.840+0000 7f5cd1600640 1 -- 172.21.15.7:0/2057803182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cc4007400 con 0x7f5cd40ce500 2024-08-19T00:47:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.840+0000 7f5cd1600640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cb006be30 0x7f5cb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.841+0000 7f5cd1600640 1 -- 172.21.15.7:0/2057803182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7f5cc408ae10 con 0x7f5cd40ce500 2024-08-19T00:47:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.841+0000 7f5ccbe00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cb006be30 0x7f5cb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.841+0000 7f5ccbe00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cb006be30 0x7f5cb006e2f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5cd41567c0 tx=0x7f5cbc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:07.845+0000 7f5cd1600640 1 -- 172.21.15.7:0/2057803182 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5cc408e030 con 0x7f5cd40ce500 2024-08-19T00:47:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.040+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5cd41567f0 con 0x7f5cd40ce500 2024-08-19T00:47:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.040+0000 7f5cd1600640 1 -- 172.21.15.7:0/2057803182 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 62 entries v117) ==== 81+0+3712 (secure 0 0 0) 0x7f5cd4099f00 con 0x7f5cd40ce500 2024-08-19T00:47:08.043 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:47:08.043 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:47:08.043 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:47:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:47:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:47:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:47:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:47:08.048 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:47:08.048 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:47:08.048 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:47:08.048 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:47:08.048 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:47:08.048 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:listed 62 entries 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.042+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cb006be30 msgr2=0x7f5cb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.042+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cb006be30 0x7f5cb006e2f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5cd41567c0 tx=0x7f5cbc008040 comp rx=0 tx=0).stop 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.042+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40ce500 msgr2=0x7f5cd40999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.042+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40ce500 0x7f5cd40999c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400c400 tx=0x7f5cc400c8c0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 shutdown_connections 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5cb006be30 0x7f5cb006e2f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cd4159bf0 0x7f5cd41574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd40d03c0 0x7f5cd40b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 --2- 172.21.15.7:0/2057803182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cd40ce500 0x7f5cd40999c0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 >> 172.21.15.7:0/2057803182 conn(0x7f5cd406bc70 msgr2=0x7f5cd40ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:08.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 shutdown_connections 2024-08-19T00:47:08.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.043+0000 7f5cdbc00640 1 -- 172.21.15.7:0/2057803182 wait complete. 2024-08-19T00:47:08.061 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:47:08.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:08.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:47:08.122 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:47:08.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:08.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:47:08.159 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:47:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.355+0000 7fe82e000640 1 Processor -- start 2024-08-19T00:47:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.355+0000 7fe82e000640 1 -- start start 2024-08-19T00:47:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.356+0000 7fe82e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe82815e3e0 0x7fe8280b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.356+0000 7fe82e000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8280b4df0 con 0x7fe8280b4150 2024-08-19T00:47:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.356+0000 7fe82e000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8280b50d0 con 0x7fe8280d27b0 2024-08-19T00:47:08.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.356+0000 7fe82e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8280cf1e0 con 0x7fe82815e3e0 2024-08-19T00:47:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.356+0000 7fe82d600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe8280b4150 0x7fe8280b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48166/0 (socket says 172.21.15.7:48166) 2024-08-19T00:47:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.356+0000 7fe82d600640 1 -- 172.21.15.7:0/698684470 learned_addr learned my addr 172.21.15.7:0/698684470 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.356+0000 7fe82cc00640 1 --2- 172.21.15.7:0/698684470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe82815e3e0 0x7fe8280b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.357+0000 7fe82cc00640 1 -- 172.21.15.7:0/698684470 >> v1:172.21.15.162:6789/0 conn(0x7fe8280d27b0 legacy=0x7fe8280d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.357+0000 7fe82cc00640 1 -- 172.21.15.7:0/698684470 >> v1:172.21.15.7:6789/0 conn(0x7fe8280b4150 legacy=0x7fe8280b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.357+0000 7fe827400640 1 -- 172.21.15.7:0/698684470 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815677682 0 0) 0x7fe8280b50d0 con 0x7fe8280d27b0 2024-08-19T00:47:08.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.357+0000 7fe82cc00640 1 -- 172.21.15.7:0/698684470 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280cf4c0 con 0x7fe82815e3e0 2024-08-19T00:47:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.358+0000 7fe82cc00640 1 --2- 172.21.15.7:0/698684470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe82815e3e0 0x7fe8280b0e60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0097d0 tx=0x7fe81c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=143b263e9dab5ff8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.358+0000 7fe827400640 1 -- 172.21.15.7:0/698684470 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c037070 con 0x7fe82815e3e0 2024-08-19T00:47:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.358+0000 7fe827400640 1 -- 172.21.15.7:0/698684470 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c02ad90 con 0x7fe82815e3e0 2024-08-19T00:47:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.358+0000 7fe827400640 1 -- 172.21.15.7:0/698684470 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c032660 con 0x7fe82815e3e0 2024-08-19T00:47:08.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.359+0000 7fe82e000640 1 -- 172.21.15.7:0/698684470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe82815e3e0 msgr2=0x7fe8280b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.359+0000 7fe82e000640 1 --2- 172.21.15.7:0/698684470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe82815e3e0 0x7fe8280b0e60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0097d0 tx=0x7fe81c02a100 comp rx=0 tx=0).stop 2024-08-19T00:47:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.359+0000 7fe82e000640 1 -- 172.21.15.7:0/698684470 shutdown_connections 2024-08-19T00:47:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.359+0000 7fe82e000640 1 --2- 172.21.15.7:0/698684470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe82815e3e0 0x7fe8280b0e60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.359+0000 7fe82e000640 1 -- 172.21.15.7:0/698684470 >> 172.21.15.7:0/698684470 conn(0x7fe82808dbe0 msgr2=0x7fe82809d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.359+0000 7fe82e000640 1 -- 172.21.15.7:0/698684470 shutdown_connections 2024-08-19T00:47:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.359+0000 7fe82e000640 1 -- 172.21.15.7:0/698684470 wait complete. 2024-08-19T00:47:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.361+0000 7fe82e000640 1 Processor -- start 2024-08-19T00:47:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.361+0000 7fe82e000640 1 -- start start 2024-08-19T00:47:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8280b4150 0x7fe828158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8280d27b0 0x7fe8280cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815e3e0 0x7fe8280cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82e000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8280cf9e0 con 0x7fe82815e3e0 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8280b13a0 con 0x7fe8280b4150 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8280cfb60 con 0x7fe8280d27b0 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815e3e0 0x7fe8280cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815e3e0 0x7fe8280cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47194/0 (socket says 172.21.15.7:47194) 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82d600640 1 -- 172.21.15.7:0/3292917269 learned_addr learned my addr 172.21.15.7:0/3292917269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:08.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe82cc00640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8280b4150 0x7fe828158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.362+0000 7fe827e00640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8280d27b0 0x7fe8280cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82d600640 1 -- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8280d27b0 msgr2=0x7fe8280cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82d600640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8280d27b0 0x7fe8280cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82d600640 1 -- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8280b4150 msgr2=0x7fe828158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82d600640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8280b4150 0x7fe828158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82d600640 1 -- 172.21.15.7:0/3292917269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280c95b0 con 0x7fe82815e3e0 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82cc00640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8280b4150 0x7fe828158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82d600640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815e3e0 0x7fe8280cdf60 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fe82000caf0 tx=0x7fe8200020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe824c00640 1 -- 172.21.15.7:0/3292917269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820018070 con 0x7fe82815e3e0 2024-08-19T00:47:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe824c00640 1 -- 172.21.15.7:0/3292917269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe82000a6e0 con 0x7fe82815e3e0 2024-08-19T00:47:08.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe824c00640 1 -- 172.21.15.7:0/3292917269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82000ab10 con 0x7fe82815e3e0 2024-08-19T00:47:08.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8280c9890 con 0x7fe82815e3e0 2024-08-19T00:47:08.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.363+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe828158e80 con 0x7fe82815e3e0 2024-08-19T00:47:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.364+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8280c9a60 con 0x7fe82815e3e0 2024-08-19T00:47:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.365+0000 7fe824c00640 1 -- 172.21.15.7:0/3292917269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe82000acb0 con 0x7fe82815e3e0 2024-08-19T00:47:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.366+0000 7fe824c00640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.366+0000 7fe824c00640 1 -- 172.21.15.7:0/3292917269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8375+0+0 (secure 0 0 0) 0x7fe82008aff0 con 0x7fe82815e3e0 2024-08-19T00:47:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.367+0000 7fe82cc00640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.367+0000 7fe82cc00640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe81c034000 tx=0x7fe81c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:08.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.371+0000 7fe824c00640 1 -- 172.21.15.7:0/3292917269 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe820058920 con 0x7fe82815e3e0 2024-08-19T00:47:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.594+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe8280b0e60 con 0x7fe82815e3e0 2024-08-19T00:47:08.597 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:08.594+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:47:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.596+0000 7fe824c00640 1 -- 172.21.15.7:0/3292917269 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v278) ==== 161+0+0 (secure 0 0 0) 0x7fe82005cc20 con 0x7fe82815e3e0 2024-08-19T00:47:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:47:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.600+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe80806be30 msgr2=0x7fe80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.600+0000 7fe82e000640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe80806be30 0x7fe80806e2f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe81c034000 tx=0x7fe81c02e000 comp rx=0 tx=0).stop 2024-08-19T00:47:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.600+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815e3e0 msgr2=0x7fe8280cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.600+0000 7fe82e000640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815e3e0 0x7fe8280cdf60 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fe82000caf0 tx=0x7fe8200020b0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 shutdown_connections 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe80806be30 0x7fe80806e2f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82815e3e0 0x7fe8280cdf60 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8280d27b0 0x7fe8280cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 --2- 172.21.15.7:0/3292917269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8280b4150 0x7fe828158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 >> 172.21.15.7:0/3292917269 conn(0x7fe82808dbe0 msgr2=0x7fe82806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 shutdown_connections 2024-08-19T00:47:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.601+0000 7fe82e000640 1 -- 172.21.15.7:0/3292917269 wait complete. 2024-08-19T00:47:08.608 INFO:tasks.ceph.mds.a.smithi007.stderr: -860> 2024-08-19T00:46:59.434+0000 7fa46ce00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:08.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:47:08.654 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:47:08.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.778+0000 7f1689600640 1 Processor -- start 2024-08-19T00:47:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.778+0000 7f1689600640 1 -- start start 2024-08-19T00:47:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.779+0000 7f1689600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.779+0000 7f1689600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16840cdfb0 con 0x7f16840d03c0 2024-08-19T00:47:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.779+0000 7f1689600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16840ce290 con 0x7f16840b3750 2024-08-19T00:47:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.779+0000 7f1689600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16840cebc0 con 0x7f168406e710 2024-08-19T00:47:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.779+0000 7f1682a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f16840d03c0 0x7f16840d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48178/0 (socket says 172.21.15.7:48178) 2024-08-19T00:47:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.779+0000 7f1682a00640 1 -- 172.21.15.7:0/2181078583 learned_addr learned my addr 172.21.15.7:0/2181078583 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.779+0000 7f167be00640 1 --2- 172.21.15.7:0/2181078583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.780+0000 7f1682000640 1 -- 172.21.15.7:0/2181078583 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517367095 0 0) 0x7f16840cdfb0 con 0x7f16840d03c0 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.780+0000 7f1682000640 1 -- 172.21.15.7:0/2181078583 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1668003520 con 0x7f16840d03c0 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.780+0000 7f1682000640 1 -- 172.21.15.7:0/2181078583 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981745623 0 0) 0x7f16840ce290 con 0x7f16840b3750 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.780+0000 7f1682000640 1 -- 172.21.15.7:0/2181078583 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16840cdfb0 con 0x7f16840b3750 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.780+0000 7f167be00640 1 -- 172.21.15.7:0/2181078583 >> v1:172.21.15.162:6789/0 conn(0x7f16840b3750 legacy=0x7f16840cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.780+0000 7f167be00640 1 -- 172.21.15.7:0/2181078583 >> v1:172.21.15.7:6789/0 conn(0x7f16840d03c0 legacy=0x7f16840d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.780+0000 7f167be00640 1 -- 172.21.15.7:0/2181078583 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16840ce570 con 0x7f168406e710 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.781+0000 7f167be00640 1 --2- 172.21.15.7:0/2181078583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684071980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097d0 tx=0x7f166c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a13c84b7136ab47a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.781+0000 7f1682000640 1 -- 172.21.15.7:0/2181078583 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c037070 con 0x7f168406e710 2024-08-19T00:47:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.781+0000 7f1682000640 1 -- 172.21.15.7:0/2181078583 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166c032440 con 0x7f168406e710 2024-08-19T00:47:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.781+0000 7f1682000640 1 -- 172.21.15.7:0/2181078583 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c032810 con 0x7f168406e710 2024-08-19T00:47:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.782+0000 7f1689600640 1 -- 172.21.15.7:0/2181078583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 msgr2=0x7f1684071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.782+0000 7f1689600640 1 --2- 172.21.15.7:0/2181078583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684071980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097d0 tx=0x7f166c02a210 comp rx=0 tx=0).stop 2024-08-19T00:47:08.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.782+0000 7f1689600640 1 -- 172.21.15.7:0/2181078583 shutdown_connections 2024-08-19T00:47:08.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.782+0000 7f1689600640 1 --2- 172.21.15.7:0/2181078583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684071980 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.782+0000 7f1689600640 1 -- 172.21.15.7:0/2181078583 >> 172.21.15.7:0/2181078583 conn(0x7f168406bc70 msgr2=0x7f168406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:08.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.782+0000 7f1689600640 1 -- 172.21.15.7:0/2181078583 shutdown_connections 2024-08-19T00:47:08.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.782+0000 7f1689600640 1 -- 172.21.15.7:0/2181078583 wait complete. 2024-08-19T00:47:08.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.784+0000 7f1689600640 1 Processor -- start 2024-08-19T00:47:08.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.784+0000 7f1689600640 1 -- start start 2024-08-19T00:47:08.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1689600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1689600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16840b3750 0x7f16840c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1689600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16840d03c0 0x7f168415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1689600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1684073c60 con 0x7f16840b3750 2024-08-19T00:47:08.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1689600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1684073ae0 con 0x7f16840d03c0 2024-08-19T00:47:08.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1689600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16840b3be0 con 0x7f168406e710 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16840b3750 0x7f16840c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16840b3750 0x7f16840c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47214/0 (socket says 172.21.15.7:47214) 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 -- 172.21.15.7:0/1899123512 learned_addr learned my addr 172.21.15.7:0/1899123512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1682a00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 -- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 msgr2=0x7f1684153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1683400640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16840d03c0 0x7f168415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 -- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16840d03c0 msgr2=0x7f168415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16840d03c0 0x7f168415dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f167be00640 1 -- 172.21.15.7:0/1899123512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1684157230 con 0x7f16840b3750 2024-08-19T00:47:08.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1683400640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16840d03c0 0x7f168415dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:08.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.785+0000 7f1682a00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:08.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.786+0000 7f167be00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16840b3750 0x7f16840c9390 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f166c0098f0 tx=0x7f166c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:08.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.786+0000 7f167aa00640 1 -- 172.21.15.7:0/1899123512 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c041020 con 0x7f16840b3750 2024-08-19T00:47:08.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.786+0000 7f167aa00640 1 -- 172.21.15.7:0/1899123512 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166c03d6e0 con 0x7f16840b3750 2024-08-19T00:47:08.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.786+0000 7f167aa00640 1 -- 172.21.15.7:0/1899123512 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c037040 con 0x7f16840b3750 2024-08-19T00:47:08.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.786+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1684155310 con 0x7f16840b3750 2024-08-19T00:47:08.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.786+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16840c98d0 con 0x7f16840b3750 2024-08-19T00:47:08.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.787+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16840ce290 con 0x7f16840b3750 2024-08-19T00:47:08.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.788+0000 7f167aa00640 1 -- 172.21.15.7:0/1899123512 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f166c044020 con 0x7f16840b3750 2024-08-19T00:47:08.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.789+0000 7f167aa00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:08.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.789+0000 7f167aa00640 1 -- 172.21.15.7:0/1899123512 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8461+0+0 (secure 0 0 0) 0x7f166c0ac090 con 0x7f16840b3750 2024-08-19T00:47:08.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.789+0000 7f1682a00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:08.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.790+0000 7f1682a00640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:08.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:08.793+0000 7f167aa00640 1 -- 172.21.15.7:0/1899123512 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f166c04b030 con 0x7f16840b3750 2024-08-19T00:47:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.046+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f16840722c0 con 0x7f16840b3750 2024-08-19T00:47:09.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.601+0000 7f167aa00640 1 -- 172.21.15.7:0/1899123512 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v279) ==== 107+0+0 (secure 0 0 0) 0x7f166c079ee0 con 0x7f16840b3750 2024-08-19T00:47:09.604 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:47:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 msgr2=0x7f166006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674009040 comp rx=0 tx=0).stop 2024-08-19T00:47:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16840b3750 msgr2=0x7f16840c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16840b3750 0x7f16840c9390 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f166c0098f0 tx=0x7f166c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 shutdown_connections 2024-08-19T00:47:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f166006be60 0x7f166006e320 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16840d03c0 0x7f168415dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16840b3750 0x7f16840c9390 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 --2- 172.21.15.7:0/1899123512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f168406e710 0x7f1684153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 >> 172.21.15.7:0/1899123512 conn(0x7f168406bc70 msgr2=0x7f16840aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 shutdown_connections 2024-08-19T00:47:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.605+0000 7f1689600640 1 -- 172.21.15.7:0/1899123512 wait complete. 2024-08-19T00:47:09.629 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:47:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.745+0000 7f373fb52f40 1 Processor -- start 2024-08-19T00:47:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.745+0000 7f373fb52f40 1 -- start start 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373fb52f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb555b0 0x56541fbecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373fb52f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb55990 0x56541fbf0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373fb52f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb6d8d0 0x56541fb22ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373fb52f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56541fbfadc0 con 0x56541fb555b0 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373fb52f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56541fac9d00 con 0x56541fb6d8d0 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373fb52f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56541fbfb0a0 con 0x56541fb55990 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb555b0 0x56541fbecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb555b0 0x56541fbecd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47228/0 (socket says 172.21.15.7:47228) 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.746+0000 7f373ce00640 1 -- 172.21.15.7:0/3277056655 learned_addr learned my addr 172.21.15.7:0/3277056655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373ce00640 1 -- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb55990 msgr2=0x56541fbf0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:09.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f3737e00640 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb55990 0x56541fbf0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373d800640 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb6d8d0 0x56541fb22ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373ce00640 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb55990 0x56541fbf0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373ce00640 1 -- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb6d8d0 msgr2=0x56541fb22ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373ce00640 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb6d8d0 0x56541fb22ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373ce00640 1 -- 172.21.15.7:0/3277056655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56541fa4eb30 con 0x56541fb555b0 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f3737e00640 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb55990 0x56541fbf0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373d800640 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb6d8d0 0x56541fb22ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f373ce00640 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb555b0 0x56541fbecd10 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f3730025c00 tx=0x7f3730051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb9e4566197a90b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f3736a00640 1 -- 172.21.15.7:0/3277056655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730053af0 con 0x56541fb555b0 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f3736a00640 1 -- 172.21.15.7:0/3277056655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3730063070 con 0x56541fb555b0 2024-08-19T00:47:09.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.747+0000 7f3736a00640 1 -- 172.21.15.7:0/3277056655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730068470 con 0x56541fb555b0 2024-08-19T00:47:09.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 -- 172.21.15.7:0/3277056655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb555b0 msgr2=0x56541fbecd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb555b0 0x56541fbecd10 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f3730025c00 tx=0x7f3730051000 comp rx=0 tx=0).stop 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 -- 172.21.15.7:0/3277056655 shutdown_connections 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb6d8d0 0x56541fb22ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb55990 0x56541fbf0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3277056655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb555b0 0x56541fbecd10 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 -- 172.21.15.7:0/3277056655 >> 172.21.15.7:0/3277056655 conn(0x56541fb524e0 msgr2=0x56541fb6d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 -- 172.21.15.7:0/3277056655 shutdown_connections 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.748+0000 7f373fb52f40 1 -- 172.21.15.7:0/3277056655 wait complete. 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.749+0000 7f373fb52f40 1 Processor -- start 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.749+0000 7f373fb52f40 1 -- start start 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373fb52f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb555b0 0x56541fbf4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373fb52f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb55990 0x56541fb6eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373fb52f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb6d8d0 0x56541fbf13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373fb52f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56541fbeed30 con 0x56541fb55990 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373fb52f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56541fb51cc0 con 0x56541fb555b0 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373fb52f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56541fbee770 con 0x56541fb6d8d0 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb55990 0x56541fb6eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb55990 0x56541fb6eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47240/0 (socket says 172.21.15.7:47240) 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 learned_addr learned my addr 172.21.15.7:0/3404596922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373d800640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb6d8d0 0x56541fbf13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb555b0 0x56541fbf4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb6d8d0 msgr2=0x56541fbf13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb6d8d0 0x56541fbf13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb555b0 msgr2=0x56541fbf4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb555b0 0x56541fbf4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56541fa8b080 con 0x56541fb55990 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373d800640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56541fb6d8d0 0x56541fbf13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.750+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56541fb555b0 0x56541fbf4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.751+0000 7f3737e00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb55990 0x56541fb6eb30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f372800bf40 tx=0x7f37280074b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.751+0000 7f3735600640 1 -- 172.21.15.7:0/3404596922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728019070 con 0x56541fb55990 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.751+0000 7f3735600640 1 -- 172.21.15.7:0/3404596922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728007c00 con 0x56541fb55990 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.751+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56541fbe92c0 con 0x56541fb55990 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.751+0000 7f3735600640 1 -- 172.21.15.7:0/3404596922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728014410 con 0x56541fb55990 2024-08-19T00:47:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.751+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56541fbf0be0 con 0x56541fb55990 2024-08-19T00:47:09.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.753+0000 7f3735600640 1 -- 172.21.15.7:0/3404596922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f372801c070 con 0x56541fb55990 2024-08-19T00:47:09.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.754+0000 7f3735600640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f371c06a840 0x7f371c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.754+0000 7f3735600640 1 -- 172.21.15.7:0/3404596922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8461+0+0 (secure 0 0 0) 0x7f3728089710 con 0x56541fb55990 2024-08-19T00:47:09.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.754+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f371c06a840 0x7f371c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.760 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:47:09.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.754+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56541fb6f070 0x56541fc941c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.754+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fb6d340 con 0x56541fb6f070 2024-08-19T00:47:09.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.755+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f371c06a840 0x7f371c06cd00 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f373000a4f0 tx=0x7f3730053000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.755+0000 7f373d800640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56541fb6f070 0x56541fc941c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.756+0000 7f373d800640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56541fb6f070 0x56541fc941c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.758+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v118'971 uv944 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.758+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fc94700 con 0x56541fb6f070 2024-08-19T00:47:09.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.760+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v118'972 uv972 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.760+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc94aa0 con 0x56541fb6f070 2024-08-19T00:47:09.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.761+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v118'973 uv973 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.764 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:47:09.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.762+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9e4a0 con 0x56541fb6f070 2024-08-19T00:47:09.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.763+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v118'974 uv974 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.763+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9e840 con 0x56541fb6f070 2024-08-19T00:47:09.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.765+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v118'975 uv975 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.765+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9d490 con 0x56541fb6f070 2024-08-19T00:47:09.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.767+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v118'976 uv976 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.767+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9d860 con 0x56541fb6f070 2024-08-19T00:47:09.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.769+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v118'977 uv950 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.769+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc50 con 0x56541fb6f070 2024-08-19T00:47:09.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.770+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v118'978 uv978 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.770+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc50 con 0x56541fb6f070 2024-08-19T00:47:09.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.772+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v118'979 uv979 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.775 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:47:09.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.772+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.774+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v118'980 uv980 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.774+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.775+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v118'981 uv981 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.775+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.777+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v118'982 uv982 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.777+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.778+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v118'983 uv970 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.778+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.780+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v118'984 uv984 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.780+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.781+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v118'985 uv985 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.784 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:47:09.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.781+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.783+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v118'986 uv986 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.783+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.784+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v118'987 uv987 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.784+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.786+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v118'988 uv988 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.786+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.787+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v118'989 uv989 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.788+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.789+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v118'990 uv963 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.789+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.791+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v118'991 uv991 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.791+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.792+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v118'992 uv992 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.795 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:47:09.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.792+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.793+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v118'993 uv993 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.793+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.795+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v118'994 uv994 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.795+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.796+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v118'995 uv995 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.796+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.798+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v118'996 uv969 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.798+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.799+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v118'997 uv997 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.799+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.803 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:47:09.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.801+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v118'998 uv998 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.801+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.802+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v118'999 uv999 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.802+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.804+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v118'1000 uv1000 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.804+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9dc00 con 0x56541fb6f070 2024-08-19T00:47:09.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.805+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v118'1001 uv1001 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.805+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56541fc9dc00 0x56541fca1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.805+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fc9e000 con 0x56541fc9dc00 2024-08-19T00:47:09.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.806+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56541fc9dc00 0x56541fca1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.806+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56541fc9dc00 0x56541fca1100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.810+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v118'705 uv684 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.810+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fca1640 con 0x56541fc9dc00 2024-08-19T00:47:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.812+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v118'706 uv706 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.812+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca19e0 con 0x56541fc9dc00 2024-08-19T00:47:09.816 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:47:09.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.813+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v118'707 uv707 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.813+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2230 con 0x56541fc9dc00 2024-08-19T00:47:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.815+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v118'708 uv708 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.815+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca25d0 con 0x56541fc9dc00 2024-08-19T00:47:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.816+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v118'709 uv709 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.816+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.818+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v118'710 uv703 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.818+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.819+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v118'711 uv711 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.819+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.823 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:47:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.821+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v118'712 uv712 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.821+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.823+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v118'713 uv713 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.823+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.824+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v118'714 uv714 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.824+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.826+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v118'715 uv704 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.826+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.827+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v118'716 uv716 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.827+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.831 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:47:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.829+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v118'717 uv717 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.829+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca7060 con 0x56541fc9dc00 2024-08-19T00:47:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.831+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v118'718 uv718 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.831+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca7060 con 0x56541fc9dc00 2024-08-19T00:47:09.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.832+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v118'719 uv719 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.832+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.834+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v118'720 uv700 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.834+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.835+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v118'721 uv721 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.835+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.839 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:47:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.837+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v118'722 uv722 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.837+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca3980 con 0x56541fc9dc00 2024-08-19T00:47:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.838+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v118'723 uv723 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.838+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca3980 con 0x56541fc9dc00 2024-08-19T00:47:09.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.840+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v118'724 uv724 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.840+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca2970 con 0x56541fc9dc00 2024-08-19T00:47:09.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.841+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v118'725 uv725 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fc9dc00 2024-08-19T00:47:09.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.841+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56541fca2e80 0x56541fca5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.841+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca58d0 con 0x56541fca2e80 2024-08-19T00:47:09.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.842+0000 7f3737e00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56541fca2e80 0x56541fca5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.842+0000 7f3737e00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56541fca2e80 0x56541fca5270 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.844+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v118'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.844+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fca5d50 con 0x56541fca2e80 2024-08-19T00:47:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.845+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v118'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.845+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6230 con 0x56541fca2e80 2024-08-19T00:47:09.849 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:47:09.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.846+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v118'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.846+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca7ae0 con 0x56541fca2e80 2024-08-19T00:47:09.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.848+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v118'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.848+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca7e80 con 0x56541fca2e80 2024-08-19T00:47:09.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.849+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v118'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.849+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6ad0 con 0x56541fca2e80 2024-08-19T00:47:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.850+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v118'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.850+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6ec0 con 0x56541fb6f070 2024-08-19T00:47:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.852+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v118'141 uv140 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.852+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6ec0 con 0x56541fb6f070 2024-08-19T00:47:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.855+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v118'142 uv142 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.855+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6ec0 con 0x56541fb6f070 2024-08-19T00:47:09.859 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:47:09.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.856+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v118'143 uv143 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.856+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6ec0 con 0x56541fb6f070 2024-08-19T00:47:09.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.858+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v118'144 uv144 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.858+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56541fca6ec0 0x56541fcaa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.858+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa770 con 0x56541fca6ec0 2024-08-19T00:47:09.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.858+0000 7f373d800640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56541fca6ec0 0x56541fcaa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.859+0000 7f373d800640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56541fca6ec0 0x56541fcaa230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.862+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v118'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.862+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa770 con 0x56541fca6ec0 2024-08-19T00:47:09.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.864+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v118'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.864+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa770 con 0x56541fca6ec0 2024-08-19T00:47:09.867 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:47:09.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.865+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v118'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.865+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca66d0 con 0x56541fca6ec0 2024-08-19T00:47:09.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.866+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v118'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.866+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6690 con 0x56541fca6ec0 2024-08-19T00:47:09.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.868+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v118'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.868+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fca6690 con 0x56541fca6ec0 2024-08-19T00:47:09.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.869+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v118'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.869+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56541fcab130 0x56541fcad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.869+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcada60 con 0x56541fcab130 2024-08-19T00:47:09.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.869+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56541fcab130 0x56541fcad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.870+0000 7f373ce00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56541fcab130 0x56541fcad520 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.872+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v118'349 uv343 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.872+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadb20 con 0x56541fcab130 2024-08-19T00:47:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.873+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v118'350 uv350 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.873+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadf40 con 0x56541fcab130 2024-08-19T00:47:09.877 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:47:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.875+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v118'351 uv351 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.875+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaef50 con 0x56541fcab130 2024-08-19T00:47:09.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.876+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v118'352 uv352 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.876+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaef50 con 0x56541fcab130 2024-08-19T00:47:09.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.878+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v118'353 uv353 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.878+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadf40 con 0x56541fcab130 2024-08-19T00:47:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.879+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v118'354 uv354 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.879+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadf40 con 0x56541fcab130 2024-08-19T00:47:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.881+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v118'355 uv348 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.881+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadf40 con 0x56541fcab130 2024-08-19T00:47:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.882+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v118'356 uv356 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.882+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadf40 con 0x56541fcab130 2024-08-19T00:47:09.886 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:47:09.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.884+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v118'357 uv357 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.884+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadf40 con 0x56541fcab130 2024-08-19T00:47:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.886+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v118'358 uv358 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.886+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcadf40 con 0x56541fcab130 2024-08-19T00:47:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.887+0000 7f373ce00640 1 -- 172.21.15.7:0/3404596922 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v118'359 uv359 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3730053c60 con 0x56541fcab130 2024-08-19T00:47:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.887+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56541fcae450 0x56541fcb0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.887+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb0fa0 con 0x56541fcae450 2024-08-19T00:47:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.887+0000 7f3737e00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56541fcae450 0x56541fcb0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.888+0000 7f3737e00640 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56541fcae450 0x56541fcb0880 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:09.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.889+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v118'158 uv157 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.889+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb0fa0 con 0x56541fcae450 2024-08-19T00:47:09.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.891+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v118'159 uv159 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.891+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fcae450 2024-08-19T00:47:09.894 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:47:09.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.892+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v118'160 uv160 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.892+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fcae450 2024-08-19T00:47:09.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.894+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v118'161 uv161 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.894+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fcae450 2024-08-19T00:47:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.895+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v118'162 uv162 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.895+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fb6f070 2024-08-19T00:47:09.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.897+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v118'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.897+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fb6f070 2024-08-19T00:47:09.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.898+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v118'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.898+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fb6f070 2024-08-19T00:47:09.902 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:47:09.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.899+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v118'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.899+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb2400 con 0x56541fb6f070 2024-08-19T00:47:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.901+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v118'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.901+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb2400 con 0x56541fb6f070 2024-08-19T00:47:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.902+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v118'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.902+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fb6f070 2024-08-19T00:47:09.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.904+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v118'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fb6f070 2024-08-19T00:47:09.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.904+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fca2e80 2024-08-19T00:47:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.905+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v118'314 uv308 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.905+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fca2e80 2024-08-19T00:47:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.907+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v118'315 uv315 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.907+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb13f0 con 0x56541fca2e80 2024-08-19T00:47:09.910 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:47:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.908+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v118'316 uv316 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.908+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa810 con 0x56541fca2e80 2024-08-19T00:47:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.910+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v118'317 uv317 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.910+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa810 con 0x56541fca2e80 2024-08-19T00:47:09.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.911+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v118'318 uv318 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.911+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa810 con 0x56541fca2e80 2024-08-19T00:47:09.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.913+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v118'319 uv313 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.913+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa810 con 0x56541fca2e80 2024-08-19T00:47:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.914+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v118'320 uv320 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.914+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa810 con 0x56541fca2e80 2024-08-19T00:47:09.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.916+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v118'321 uv321 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.918 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:47:09.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.916+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcaa810 con 0x56541fca2e80 2024-08-19T00:47:09.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.917+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v118'322 uv322 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.918+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb4200 con 0x56541fca2e80 2024-08-19T00:47:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.919+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v118'323 uv323 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fca2e80 2024-08-19T00:47:09.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.919+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.922+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v118'137 uv135 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.922+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.923+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v118'138 uv138 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.923+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.927 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:47:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.924+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v118'139 uv139 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.925+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.926+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v118'140 uv140 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.926+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.928+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v118'189 uv188 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.928+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.929+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v118'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.929+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.933 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:47:09.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.931+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v118'191 uv191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.931+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.932+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v118'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.932+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb28b0 con 0x56541fca6ec0 2024-08-19T00:47:09.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.934+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v118'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.934+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fca6ec0 2024-08-19T00:47:09.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.935+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v118'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f373800d490 con 0x56541fca6ec0 2024-08-19T00:47:09.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.935+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.937+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v118'161 uv160 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.937+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.938+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v118'162 uv162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.938+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.941 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:47:09.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.939+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v118'163 uv163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.939+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.941+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v118'164 uv164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.941+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.942+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v118'165 uv165 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.942+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.943+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v118'389 uv380 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.943+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.944+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v118'390 uv390 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.944+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.948 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:47:09.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.946+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v118'391 uv391 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.946+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.947+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v118'392 uv392 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.947+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.949+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v118'393 uv393 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.949+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.950+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v118'394 uv387 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.950+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.951+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v118'395 uv395 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.951+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.954 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:47:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.952+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v118'396 uv396 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.952+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.953+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v118'397 uv397 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.953+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.955+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v118'398 uv398 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.955+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb18a0 con 0x56541fcae450 2024-08-19T00:47:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.956+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v118'399 uv399 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.956+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x56541fcb1e00 con 0x56541fcae450 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f3737e00640 1 -- 172.21.15.7:0/3404596922 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v118'400 uv400 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f372801b030 con 0x56541fcae450 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56541fc9dc00 msgr2=0x56541fca1100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x56541fc9dc00 0x56541fca1100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56541fcab130 msgr2=0x56541fcad520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56541fcab130 0x56541fcad520 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56541fcae450 msgr2=0x56541fcb0880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56541fcae450 0x56541fcb0880 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56541fca2e80 msgr2=0x56541fca5270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x56541fca2e80 0x56541fca5270 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56541fb6f070 msgr2=0x56541fc941c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56541fb6f070 0x56541fc941c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373d800640 1 -- 172.21.15.7:0/3404596922 reap_dead start 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56541fca6ec0 msgr2=0x56541fcaa230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.957+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56541fca6ec0 0x56541fcaa230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f371c06a840 msgr2=0x7f371c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f371c06a840 0x7f371c06cd00 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f373000a4f0 tx=0x7f3730053000 comp rx=0 tx=0).stop 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb55990 msgr2=0x56541fb6eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb55990 0x56541fb6eb30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f372800bf40 tx=0x7f37280074b0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 shutdown_connections 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56541fb6f070 0x56541fc941c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f371c06a840 0x7f371c06cd00 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56541fb55990 0x56541fb6eb30 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 --2- 172.21.15.7:0/3404596922 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x56541fca6ec0 0x56541fcaa230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 >> 172.21.15.7:0/3404596922 conn(0x56541fb524e0 msgr2=0x56541fb54b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 shutdown_connections 2024-08-19T00:47:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:09.958+0000 7f373fb52f40 1 -- 172.21.15.7:0/3404596922 wait complete. 2024-08-19T00:47:09.965 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 100.00000000 stray0_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:47:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.041+0000 7f1abfecff40 1 Processor -- start 2024-08-19T00:47:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.041+0000 7f1abfecff40 1 -- start start 2024-08-19T00:47:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abfecff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e1650 0x555957279a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abfecff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e25b0 0x55595727f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abfecff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e2990 0x55595727fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abfecff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555957156d00 con 0x5559571e1650 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abfecff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55595715ad40 con 0x5559571e2990 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abfecff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x555957287dc0 con 0x5559571e25b0 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e1650 0x555957279a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e1650 0x555957279a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47258/0 (socket says 172.21.15.7:47258) 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.042+0000 7f1abd000640 1 -- 172.21.15.7:0/1956473417 learned_addr learned my addr 172.21.15.7:0/1956473417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1ab7e00640 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e25b0 0x55595727f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1abda00640 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e2990 0x55595727fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1abd000640 1 -- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e25b0 msgr2=0x55595727f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1abd000640 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e25b0 0x55595727f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1abd000640 1 -- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e2990 msgr2=0x55595727fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1abd000640 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e2990 0x55595727fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1abd000640 1 -- 172.21.15.7:0/1956473417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555957118080 con 0x5559571e1650 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1ab7e00640 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e25b0 0x55595727f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1abd000640 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e1650 0x555957279a50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000b450 tx=0x7f1ab000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b358bd64c094335a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1ab6a00640 1 -- 172.21.15.7:0/1956473417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0008070 con 0x5559571e1650 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1ab6a00640 1 -- 172.21.15.7:0/1956473417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab000d7c0 con 0x5559571e1650 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.043+0000 7f1ab6a00640 1 -- 172.21.15.7:0/1956473417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000dbb0 con 0x5559571e1650 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 -- 172.21.15.7:0/1956473417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e1650 msgr2=0x555957279a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e1650 0x555957279a50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000b450 tx=0x7f1ab000b910 comp rx=0 tx=0).stop 2024-08-19T00:47:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 -- 172.21.15.7:0/1956473417 shutdown_connections 2024-08-19T00:47:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e2990 0x55595727fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e25b0 0x55595727f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 --2- 172.21.15.7:0/1956473417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e1650 0x555957279a50 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 -- 172.21.15.7:0/1956473417 >> 172.21.15.7:0/1956473417 conn(0x5559571df4e0 msgr2=0x5559571af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 -- 172.21.15.7:0/1956473417 shutdown_connections 2024-08-19T00:47:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.044+0000 7f1abfecff40 1 -- 172.21.15.7:0/1956473417 wait complete. 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.045+0000 7f1abfecff40 1 Processor -- start 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.045+0000 7f1abfecff40 1 -- start start 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abfecff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e1650 0x55595727fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abfecff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e25b0 0x555957276290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abfecff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e2990 0x5559572885c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abfecff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5559571b06a0 con 0x5559571e25b0 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abfecff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555957279f90 con 0x5559571e1650 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abfecff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5559571de470 con 0x5559571e2990 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e25b0 0x555957276290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e25b0 0x555957276290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47262/0 (socket says 172.21.15.7:47262) 2024-08-19T00:47:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 -- 172.21.15.7:0/2125073934 learned_addr learned my addr 172.21.15.7:0/2125073934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abda00640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e2990 0x5559572885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abd000640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e1650 0x55595727fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 -- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e2990 msgr2=0x5559572885c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e2990 0x5559572885c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 -- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e1650 msgr2=0x55595727fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e1650 0x55595727fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1ab7e00640 1 -- 172.21.15.7:0/2125073934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555957281310 con 0x5559571e25b0 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.046+0000 7f1abda00640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5559571e2990 0x5559572885c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.047+0000 7f1abd000640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559571e1650 0x55595727fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.047+0000 7f1ab7e00640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e25b0 0x555957276290 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80011e0 tx=0x7f1aa800b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.047+0000 7f1ab5600640 1 -- 172.21.15.7:0/2125073934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8011460 con 0x5559571e25b0 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.047+0000 7f1ab5600640 1 -- 172.21.15.7:0/2125073934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa8016070 con 0x5559571e25b0 2024-08-19T00:47:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.047+0000 7f1ab5600640 1 -- 172.21.15.7:0/2125073934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8011860 con 0x5559571e25b0 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.047+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555957280230 con 0x5559571e25b0 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.047+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595727ef30 con 0x5559571e25b0 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.049+0000 7f1ab5600640 1 -- 172.21.15.7:0/2125073934 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1aa8011a00 con 0x5559571e25b0 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.050+0000 7f1ab5600640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a9c06a810 0x7f1a9c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.050+0000 7f1ab5600640 1 -- 172.21.15.7:0/2125073934 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8461+0+0 (secure 0 0 0) 0x7f1aa808a620 con 0x5559571e25b0 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.050+0000 7f1abd000640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a9c06a810 0x7f1a9c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.050+0000 7f1abfecff40 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55595727e580 0x55595726aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.050+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=103b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x55595726af40 con 0x55595727e580 2024-08-19T00:47:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.051+0000 7f1abd000640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a9c06a810 0x7f1a9c06ccd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000b450 tx=0x7f1ab0008000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.051+0000 7f1abda00640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55595727e580 0x55595726aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.051+0000 7f1abda00640 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55595727e580 0x55595726aa00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abda00640 1 -- 172.21.15.7:0/2125073934 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 100.00000000 [omap-set-vals] v118'324 uv324 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x55595727e580 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55595727e580 msgr2=0x55595726aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55595727e580 0x55595726aa00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a9c06a810 msgr2=0x7f1a9c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1a9c06a810 0x7f1a9c06ccd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000b450 tx=0x7f1ab0008000 comp rx=0 tx=0).stop 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e25b0 msgr2=0x555957276290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 --2- 172.21.15.7:0/2125073934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5559571e25b0 0x555957276290 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80011e0 tx=0x7f1aa800b590 comp rx=0 tx=0).stop 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abda00640 1 -- 172.21.15.7:0/2125073934 reap_dead start 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 shutdown_connections 2024-08-19T00:47:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 >> 172.21.15.7:0/2125073934 conn(0x5559571df4e0 msgr2=0x55595727c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:10.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 shutdown_connections 2024-08-19T00:47:10.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.053+0000 7f1abfecff40 1 -- 172.21.15.7:0/2125073934 wait complete. 2024-08-19T00:47:10.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:47:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.217+0000 7f9b8d600640 1 Processor -- start 2024-08-19T00:47:10.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.217+0000 7f9b8d600640 1 -- start start 2024-08-19T00:47:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.218+0000 7f9b8d600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9b88161c90 0x7f9b880cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.218+0000 7f9b8d600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b8806e750 con 0x7f9b880d2c10 2024-08-19T00:47:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.218+0000 7f9b8d600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b880cf500 con 0x7f9b8806e330 2024-08-19T00:47:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.218+0000 7f9b8d600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9b880d0110 con 0x7f9b88161c90 2024-08-19T00:47:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.218+0000 7f9b87400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9b880d2c10 0x7f9b8806ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48206/0 (socket says 172.21.15.7:48206) 2024-08-19T00:47:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.218+0000 7f9b87400640 1 -- 172.21.15.7:0/4054465613 learned_addr learned my addr 172.21.15.7:0/4054465613 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.218+0000 7f9b86a00640 1 --2- 172.21.15.7:0/4054465613 >> v2:172.21.15.162:3300/0 conn(0x7f9b88161c90 0x7f9b880cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.219+0000 7f9b85600640 1 -- 172.21.15.7:0/4054465613 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964718005 0 0) 0x7f9b8806e750 con 0x7f9b880d2c10 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.219+0000 7f9b85600640 1 -- 172.21.15.7:0/4054465613 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b6c003520 con 0x7f9b880d2c10 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.219+0000 7f9b85600640 1 -- 172.21.15.7:0/4054465613 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648764710 0 0) 0x7f9b880cf500 con 0x7f9b8806e330 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.219+0000 7f9b85600640 1 -- 172.21.15.7:0/4054465613 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b8806e750 con 0x7f9b8806e330 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.219+0000 7f9b86a00640 1 -- 172.21.15.7:0/4054465613 >> v1:172.21.15.162:6789/0 conn(0x7f9b8806e330 legacy=0x7f9b880d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.219+0000 7f9b86a00640 1 -- 172.21.15.7:0/4054465613 >> v1:172.21.15.7:6789/0 conn(0x7f9b880d2c10 legacy=0x7f9b8806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.219+0000 7f9b86a00640 1 -- 172.21.15.7:0/4054465613 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b880cf7e0 con 0x7f9b88161c90 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.220+0000 7f9b86a00640 1 --2- 172.21.15.7:0/4054465613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b88161c90 0x7f9b880cef00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9b780097a0 tx=0x7f9b7802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f9097a09d639992 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.220+0000 7f9b85600640 1 -- 172.21.15.7:0/4054465613 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78037070 con 0x7f9b88161c90 2024-08-19T00:47:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.220+0000 7f9b85600640 1 -- 172.21.15.7:0/4054465613 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b78032440 con 0x7f9b88161c90 2024-08-19T00:47:10.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.220+0000 7f9b85600640 1 -- 172.21.15.7:0/4054465613 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78032810 con 0x7f9b88161c90 2024-08-19T00:47:10.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.221+0000 7f9b8d600640 1 -- 172.21.15.7:0/4054465613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b88161c90 msgr2=0x7f9b880cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.221+0000 7f9b8d600640 1 --2- 172.21.15.7:0/4054465613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b88161c90 0x7f9b880cef00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9b780097a0 tx=0x7f9b7802a230 comp rx=0 tx=0).stop 2024-08-19T00:47:10.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.221+0000 7f9b8d600640 1 -- 172.21.15.7:0/4054465613 shutdown_connections 2024-08-19T00:47:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.221+0000 7f9b8d600640 1 --2- 172.21.15.7:0/4054465613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b88161c90 0x7f9b880cef00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.221+0000 7f9b8d600640 1 -- 172.21.15.7:0/4054465613 >> 172.21.15.7:0/4054465613 conn(0x7f9b8808c000 msgr2=0x7f9b880d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.221+0000 7f9b8d600640 1 -- 172.21.15.7:0/4054465613 shutdown_connections 2024-08-19T00:47:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.221+0000 7f9b8d600640 1 -- 172.21.15.7:0/4054465613 wait complete. 2024-08-19T00:47:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.222+0000 7f9b8d600640 1 Processor -- start 2024-08-19T00:47:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.223+0000 7f9b8d600640 1 -- start start 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.223+0000 7f9b8d600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b8806e330 0x7f9b88156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.223+0000 7f9b8d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b880d2c10 0x7f9b880cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b8d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88161c90 0x7f9b880cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b8d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88162070 con 0x7f9b88161c90 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b8d600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b880cfda0 con 0x7f9b880d2c10 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b8d600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9b881621f0 con 0x7f9b8806e330 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88161c90 0x7f9b880cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88161c90 0x7f9b880cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47278/0 (socket says 172.21.15.7:47278) 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 -- 172.21.15.7:0/1181783111 learned_addr learned my addr 172.21.15.7:0/1181783111 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b86a00640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b8806e330 0x7f9b88156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b86000640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b880d2c10 0x7f9b880cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 -- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b8806e330 msgr2=0x7f9b88156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b8806e330 0x7f9b88156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 -- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b880d2c10 msgr2=0x7f9b880cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b880d2c10 0x7f9b880cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.224+0000 7f9b87400640 1 -- 172.21.15.7:0/1181783111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b881f8650 con 0x7f9b88161c90 2024-08-19T00:47:10.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.225+0000 7f9b87400640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88161c90 0x7f9b880cddf0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000cb10 tx=0x7f9b8000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.225+0000 7f9b7ea00640 1 -- 172.21.15.7:0/1181783111 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80017070 con 0x7f9b88161c90 2024-08-19T00:47:10.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.225+0000 7f9b7ea00640 1 -- 172.21.15.7:0/1181783111 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8000ac70 con 0x7f9b88161c90 2024-08-19T00:47:10.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.225+0000 7f9b7ea00640 1 -- 172.21.15.7:0/1181783111 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80012620 con 0x7f9b88161c90 2024-08-19T00:47:10.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.225+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b880b7370 con 0x7f9b88161c90 2024-08-19T00:47:10.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.225+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b880b7930 con 0x7f9b88161c90 2024-08-19T00:47:10.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.226+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b880d3300 con 0x7f9b88161c90 2024-08-19T00:47:10.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.227+0000 7f9b7ea00640 1 -- 172.21.15.7:0/1181783111 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b8001a070 con 0x7f9b88161c90 2024-08-19T00:47:10.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.228+0000 7f9b7ea00640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b6806be30 0x7f9b6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.228+0000 7f9b7ea00640 1 -- 172.21.15.7:0/1181783111 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8461+0+0 (secure 0 0 0) 0x7f9b8008b680 con 0x7f9b88161c90 2024-08-19T00:47:10.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.228+0000 7f9b86a00640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b6806be30 0x7f9b6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.229+0000 7f9b86a00640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b6806be30 0x7f9b6806e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9b78034000 tx=0x7f9b7802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.233+0000 7f9b7ea00640 1 -- 172.21.15.7:0/1181783111 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9b8000ae20 con 0x7f9b88161c90 2024-08-19T00:47:10.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.456+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f9b8806d220 con 0x7f9b88161c90 2024-08-19T00:47:10.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.603+0000 7f9b7ea00640 1 -- 172.21.15.7:0/1181783111 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v280) ==== 162+0+0 (secure 0 0 0) 0x7f9b80058f00 con 0x7f9b88161c90 2024-08-19T00:47:10.606 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:47:10.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b6806be30 msgr2=0x7f9b6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b6806be30 0x7f9b6806e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9b78034000 tx=0x7f9b7802e000 comp rx=0 tx=0).stop 2024-08-19T00:47:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88161c90 msgr2=0x7f9b880cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88161c90 0x7f9b880cddf0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000cb10 tx=0x7f9b8000a060 comp rx=0 tx=0).stop 2024-08-19T00:47:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 shutdown_connections 2024-08-19T00:47:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9b6806be30 0x7f9b6806e2f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b88161c90 0x7f9b880cddf0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b880d2c10 0x7f9b880cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 --2- 172.21.15.7:0/1181783111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b8806e330 0x7f9b88156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 >> 172.21.15.7:0/1181783111 conn(0x7f9b8808c000 msgr2=0x7f9b880b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:10.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 shutdown_connections 2024-08-19T00:47:10.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.606+0000 7f9b8d600640 1 -- 172.21.15.7:0/1181783111 wait complete. 2024-08-19T00:47:10.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.783+0000 7f72a3000640 1 Processor -- start 2024-08-19T00:47:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.783+0000 7f72a3000640 1 -- start start 2024-08-19T00:47:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.784+0000 7f72a3000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f729c0d03c0 0x7f729c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.784+0000 7f72a3000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c0b3750 0x7f729c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.784+0000 7f72a3000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c0cdfb0 con 0x7f729c06e710 2024-08-19T00:47:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.784+0000 7f72a3000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f729c0cebc0 con 0x7f729c0d03c0 2024-08-19T00:47:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.784+0000 7f72a3000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f729c0ce290 con 0x7f729c0b3750 2024-08-19T00:47:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f729be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f729c0d03c0 0x7f729c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f729be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f729c0d03c0 0x7f729c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47290/0 (socket says 172.21.15.7:47290) 2024-08-19T00:47:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f729be00640 1 -- 172.21.15.7:0/172928970 learned_addr learned my addr 172.21.15.7:0/172928970 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f72a1000640 1 --2- 172.21.15.7:0/172928970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c0b3750 0x7f729c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f729be00640 1 -- 172.21.15.7:0/172928970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c0b3750 msgr2=0x7f729c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f729be00640 1 --2- 172.21.15.7:0/172928970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c0b3750 0x7f729c0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f729be00640 1 -- 172.21.15.7:0/172928970 >> v1:172.21.15.7:6789/0 conn(0x7f729c06e710 legacy=0x7f729c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.785+0000 7f729be00640 1 -- 172.21.15.7:0/172928970 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c0ce570 con 0x7f729c0d03c0 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.786+0000 7f729be00640 1 --2- 172.21.15.7:0/172928970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c071980 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f728c0098a0 tx=0x7f728c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e728f186c72f98 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.786+0000 7f729b400640 1 -- 172.21.15.7:0/172928970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c037070 con 0x7f729c0d03c0 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.786+0000 7f729b400640 1 -- 172.21.15.7:0/172928970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c032440 con 0x7f729c0d03c0 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.786+0000 7f729b400640 1 -- 172.21.15.7:0/172928970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c032810 con 0x7f729c0d03c0 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 -- 172.21.15.7:0/172928970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 msgr2=0x7f729c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 --2- 172.21.15.7:0/172928970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c071980 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f728c0098a0 tx=0x7f728c02a2a0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 -- 172.21.15.7:0/172928970 shutdown_connections 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 --2- 172.21.15.7:0/172928970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c0b3750 0x7f729c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 --2- 172.21.15.7:0/172928970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c071980 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 -- 172.21.15.7:0/172928970 >> 172.21.15.7:0/172928970 conn(0x7f729c06bc70 msgr2=0x7f729c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 -- 172.21.15.7:0/172928970 shutdown_connections 2024-08-19T00:47:10.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.787+0000 7f72a3000640 1 -- 172.21.15.7:0/172928970 wait complete. 2024-08-19T00:47:10.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.789+0000 7f72a3000640 1 Processor -- start 2024-08-19T00:47:10.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.789+0000 7f72a3000640 1 -- start start 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a3000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c06e710 0x7f729c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a3000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f729c0b3750 0x7f729c15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f729c073c60 con 0x7f729c0d03c0 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a3000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f729c073ae0 con 0x7f729c0b3750 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a3000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f729c0b3be0 con 0x7f729c06e710 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47304/0 (socket says 172.21.15.7:47304) 2024-08-19T00:47:10.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 -- 172.21.15.7:0/581615991 learned_addr learned my addr 172.21.15.7:0/581615991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:10.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f729be00640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c06e710 0x7f729c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f7293e00640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f729c0b3750 0x7f729c15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 -- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c06e710 msgr2=0x7f729c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c06e710 0x7f729c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 -- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f729c0b3750 msgr2=0x7f729c15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f729c0b3750 0x7f729c15aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.790+0000 7f72a1000640 1 -- 172.21.15.7:0/581615991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c15db60 con 0x7f729c0d03c0 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.791+0000 7f7293e00640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f729c0b3750 0x7f729c15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.791+0000 7f72a1000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c153fa0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f7294009dd0 tx=0x7f729400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.791+0000 7f7298c00640 1 -- 172.21.15.7:0/581615991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294018020 con 0x7f729c0d03c0 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.791+0000 7f7298c00640 1 -- 172.21.15.7:0/581615991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7294014480 con 0x7f729c0d03c0 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.791+0000 7f7298c00640 1 -- 172.21.15.7:0/581615991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294014870 con 0x7f729c0d03c0 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.791+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729c15de40 con 0x7f729c0d03c0 2024-08-19T00:47:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.791+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729c15b020 con 0x7f729c0d03c0 2024-08-19T00:47:10.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.792+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f729c071980 con 0x7f729c0d03c0 2024-08-19T00:47:10.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.793+0000 7f7298c00640 1 -- 172.21.15.7:0/581615991 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7294005d10 con 0x7f729c0d03c0 2024-08-19T00:47:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.794+0000 7f7298c00640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f727806be30 0x7f727806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.794+0000 7f7298c00640 1 -- 172.21.15.7:0/581615991 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8461+0+0 (secure 0 0 0) 0x7f729408c4c0 con 0x7f729c0d03c0 2024-08-19T00:47:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.795+0000 7f729be00640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f727806be30 0x7f727806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.795+0000 7f729be00640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f727806be30 0x7f727806e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f728c034000 tx=0x7f728c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:10.798+0000 7f7298c00640 1 -- 172.21.15.7:0/581615991 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7294022070 con 0x7f729c0d03c0 2024-08-19T00:47:11.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.016+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f729c151800 con 0x7f729c0d03c0 2024-08-19T00:47:11.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.016+0000 7f7298c00640 1 -- 172.21.15.7:0/581615991 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 281 v281) ==== 95+0+5225 (secure 0 0 0) 0x7f7294010040 con 0x7f729c0d03c0 2024-08-19T00:47:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:11.020 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":281,"btime":"2024-08-19T00:47:10:607680+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":281,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:10.607662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9669":{"gid":9669,"name":"a","rank":0,"incarnation":281,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/2697833470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2697833470},{"type":"v1","addr":"172.21.15.7:6837","nonce":2697833470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:11.020 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 281 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.018+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f727806be30 msgr2=0x7f727806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.018+0000 7f72a3000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f727806be30 0x7f727806e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f728c034000 tx=0x7f728c02e000 comp rx=0 tx=0).stop 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.018+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 msgr2=0x7f729c153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.018+0000 7f72a3000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c153fa0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f7294009dd0 tx=0x7f729400c490 comp rx=0 tx=0).stop 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 shutdown_connections 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f727806be30 0x7f727806e2f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f729c0d03c0 0x7f729c153fa0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f729c0b3750 0x7f729c15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 --2- 172.21.15.7:0/581615991 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f729c06e710 0x7f729c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 >> 172.21.15.7:0/581615991 conn(0x7f729c06bc70 msgr2=0x7f729c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:11.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 shutdown_connections 2024-08-19T00:47:11.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:11.019+0000 7f72a3000640 1 -- 172.21.15.7:0/581615991 wait complete. 2024-08-19T00:47:11.037 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:47:13.631 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:13.628+0000 7f0b1ca00640 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x100is fatal because it is a system directory for this rank 2024-08-19T00:47:13.632 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:13.630+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:47:13.632 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:13.630+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:47:14.614 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:14.612+0000 7f0b21a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:16.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:16.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.204+0000 7f0306600640 1 Processor -- start 2024-08-19T00:47:16.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.204+0000 7f0306600640 1 -- start start 2024-08-19T00:47:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.204+0000 7f0306600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f030006e710 0x7f0300071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.204+0000 7f0306600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03000cdfb0 con 0x7f03000d03c0 2024-08-19T00:47:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.204+0000 7f0306600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03000ce290 con 0x7f03000b3750 2024-08-19T00:47:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.204+0000 7f0306600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03000cebc0 con 0x7f030006e710 2024-08-19T00:47:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02ff400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f03000d03c0 0x7f03000d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39176/0 (socket says 172.21.15.7:39176) 2024-08-19T00:47:16.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02ff400640 1 -- 172.21.15.7:0/1814145389 learned_addr learned my addr 172.21.15.7:0/1814145389 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fea00640 1 --2- 172.21.15.7:0/1814145389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f030006e710 0x7f0300071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fe000640 1 -- 172.21.15.7:0/1814145389 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061287531 0 0) 0x7f03000cdfb0 con 0x7f03000d03c0 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fe000640 1 -- 172.21.15.7:0/1814145389 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e4003520 con 0x7f03000d03c0 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fe000640 1 -- 172.21.15.7:0/1814145389 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479942488 0 0) 0x7f03000ce290 con 0x7f03000b3750 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fe000640 1 -- 172.21.15.7:0/1814145389 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03000cdfb0 con 0x7f03000b3750 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fea00640 1 -- 172.21.15.7:0/1814145389 >> v1:172.21.15.162:6789/0 conn(0x7f03000b3750 legacy=0x7f03000cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fea00640 1 -- 172.21.15.7:0/1814145389 >> v1:172.21.15.7:6789/0 conn(0x7f03000d03c0 legacy=0x7f03000d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.205+0000 7f02fea00640 1 -- 172.21.15.7:0/1814145389 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03000ce570 con 0x7f030006e710 2024-08-19T00:47:16.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.206+0000 7f02fea00640 1 --2- 172.21.15.7:0/1814145389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f030006e710 0x7f0300071980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0097d0 tx=0x7f02ec02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=606bd70b0e387554 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f02fe000640 1 -- 172.21.15.7:0/1814145389 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec037070 con 0x7f030006e710 2024-08-19T00:47:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f02fe000640 1 -- 172.21.15.7:0/1814145389 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec032440 con 0x7f030006e710 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f02fe000640 1 -- 172.21.15.7:0/1814145389 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec032810 con 0x7f030006e710 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f0306600640 1 -- 172.21.15.7:0/1814145389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f030006e710 msgr2=0x7f0300071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f0306600640 1 --2- 172.21.15.7:0/1814145389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f030006e710 0x7f0300071980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0097d0 tx=0x7f02ec02a210 comp rx=0 tx=0).stop 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f0306600640 1 -- 172.21.15.7:0/1814145389 shutdown_connections 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f0306600640 1 --2- 172.21.15.7:0/1814145389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f030006e710 0x7f0300071980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f0306600640 1 -- 172.21.15.7:0/1814145389 >> 172.21.15.7:0/1814145389 conn(0x7f030006bc70 msgr2=0x7f030006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f0306600640 1 -- 172.21.15.7:0/1814145389 shutdown_connections 2024-08-19T00:47:16.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.207+0000 7f0306600640 1 -- 172.21.15.7:0/1814145389 wait complete. 2024-08-19T00:47:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.209+0000 7f0306600640 1 Processor -- start 2024-08-19T00:47:16.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.209+0000 7f0306600640 1 -- start start 2024-08-19T00:47:16.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f0306600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030006e710 0x7f030015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f0306600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03000b3750 0x7f030015f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f0306600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03000d03c0 0x7f0300154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f0306600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0300073c60 con 0x7f030006e710 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f0306600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0300073ae0 con 0x7f03000d03c0 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f0306600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03000b3be0 con 0x7f03000b3750 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f02ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030006e710 0x7f030015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f02ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030006e710 0x7f030015ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46828/0 (socket says 172.21.15.7:46828) 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.210+0000 7f02ff400640 1 -- 172.21.15.7:0/3977827658 learned_addr learned my addr 172.21.15.7:0/3977827658 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02fea00640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03000b3750 0x7f030015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02ffe00640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03000d03c0 0x7f0300154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02ff400640 1 -- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03000b3750 msgr2=0x7f030015f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02ff400640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03000b3750 0x7f030015f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02ff400640 1 -- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03000d03c0 msgr2=0x7f0300154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02ff400640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03000d03c0 0x7f0300154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02ff400640 1 -- 172.21.15.7:0/3977827658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030015c180 con 0x7f030006e710 2024-08-19T00:47:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02ff400640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030006e710 0x7f030015ebf0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f02f000c410 tx=0x7f02f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.211+0000 7f02f7400640 1 -- 172.21.15.7:0/3977827658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0017070 con 0x7f030006e710 2024-08-19T00:47:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.212+0000 7f02f7400640 1 -- 172.21.15.7:0/3977827658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f0005ce0 con 0x7f030006e710 2024-08-19T00:47:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.212+0000 7f02f7400640 1 -- 172.21.15.7:0/3977827658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f00072d0 con 0x7f030006e710 2024-08-19T00:47:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.212+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030015c460 con 0x7f030006e710 2024-08-19T00:47:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.212+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0300154640 con 0x7f030006e710 2024-08-19T00:47:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.213+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030015c630 con 0x7f030006e710 2024-08-19T00:47:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.214+0000 7f02f7400640 1 -- 172.21.15.7:0/3977827658 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02f001a070 con 0x7f030006e710 2024-08-19T00:47:16.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.215+0000 7f02f7400640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02e006be30 0x7f02e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.215+0000 7f02f7400640 1 -- 172.21.15.7:0/3977827658 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7f02f008acd0 con 0x7f030006e710 2024-08-19T00:47:16.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.215+0000 7f02fea00640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02e006be30 0x7f02e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.216+0000 7f02fea00640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02e006be30 0x7f02e006e2f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f02ec034000 tx=0x7f02ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.220+0000 7f02f7400640 1 -- 172.21.15.7:0/3977827658 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f02f00584f0 con 0x7f030006e710 2024-08-19T00:47:16.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.440+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03000ce290 con 0x7f030006e710 2024-08-19T00:47:16.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.441+0000 7f02f7400640 1 -- 172.21.15.7:0/3977827658 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 285 v285) ==== 95+0+4393 (secure 0 0 0) 0x7f02f005c7f0 con 0x7f030006e710 2024-08-19T00:47:16.444 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:16.444 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":285,"btime":"2024-08-19T00:47:13:632004+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":285,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:13.632002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:16.444 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 285 2024-08-19T00:47:16.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.443+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02e006be30 msgr2=0x7f02e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.443+0000 7f0306600640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02e006be30 0x7f02e006e2f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f02ec034000 tx=0x7f02ec02e000 comp rx=0 tx=0).stop 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.443+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030006e710 msgr2=0x7f030015ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.443+0000 7f0306600640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030006e710 0x7f030015ebf0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f02f000c410 tx=0x7f02f000c8d0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 shutdown_connections 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f02e006be30 0x7f02e006e2f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03000d03c0 0x7f0300154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03000b3750 0x7f030015f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 --2- 172.21.15.7:0/3977827658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030006e710 0x7f030015ebf0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 >> 172.21.15.7:0/3977827658 conn(0x7f030006bc70 msgr2=0x7f03000b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 shutdown_connections 2024-08-19T00:47:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.444+0000 7f0306600640 1 -- 172.21.15.7:0/3977827658 wait complete. 2024-08-19T00:47:16.462 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:47:16.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.617+0000 7fe69e800640 1 Processor -- start 2024-08-19T00:47:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.617+0000 7fe69e800640 1 -- start start 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.618+0000 7fe69e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe698159bf0 0x7fe698073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.618+0000 7fe69e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6980739a0 0x7fe6980ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.618+0000 7fe69e800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe69806f7f0 con 0x7fe6980cea40 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.618+0000 7fe69e800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe6980cee80 con 0x7fe6980739a0 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.618+0000 7fe69e800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe69806f510 con 0x7fe698159bf0 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe68fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6980739a0 0x7fe6980ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe68fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6980739a0 0x7fe6980ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46844/0 (socket says 172.21.15.7:46844) 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe68fe00640 1 -- 172.21.15.7:0/634054807 learned_addr learned my addr 172.21.15.7:0/634054807 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe697400640 1 --2- 172.21.15.7:0/634054807 >> v2:172.21.15.162:3300/0 conn(0x7fe698159bf0 0x7fe698073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe68fe00640 1 -- 172.21.15.7:0/634054807 >> v2:172.21.15.162:3300/0 conn(0x7fe698159bf0 msgr2=0x7fe698073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:16.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe68fe00640 1 --2- 172.21.15.7:0/634054807 >> v2:172.21.15.162:3300/0 conn(0x7fe698159bf0 0x7fe698073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe68fe00640 1 -- 172.21.15.7:0/634054807 >> v1:172.21.15.162:6789/0 conn(0x7fe6980cea40 legacy=0x7fe6980d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.619+0000 7fe68fe00640 1 -- 172.21.15.7:0/634054807 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe698072980 con 0x7fe6980739a0 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.620+0000 7fe68fe00640 1 --2- 172.21.15.7:0/634054807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6980739a0 0x7fe6980ce500 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fe69806d280 tx=0x7fe68002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57615f70163196f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe696a00640 1 -- 172.21.15.7:0/634054807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680037070 con 0x7fe6980739a0 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe696a00640 1 -- 172.21.15.7:0/634054807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680032440 con 0x7fe6980739a0 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe696a00640 1 -- 172.21.15.7:0/634054807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680032810 con 0x7fe6980739a0 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 -- 172.21.15.7:0/634054807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6980739a0 msgr2=0x7fe6980ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 --2- 172.21.15.7:0/634054807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6980739a0 0x7fe6980ce500 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fe69806d280 tx=0x7fe68002a1e0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 -- 172.21.15.7:0/634054807 shutdown_connections 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 --2- 172.21.15.7:0/634054807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6980739a0 0x7fe6980ce500 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 --2- 172.21.15.7:0/634054807 >> v2:172.21.15.162:3300/0 conn(0x7fe698159bf0 0x7fe698073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 -- 172.21.15.7:0/634054807 >> 172.21.15.7:0/634054807 conn(0x7fe69806bc70 msgr2=0x7fe69806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:16.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 -- 172.21.15.7:0/634054807 shutdown_connections 2024-08-19T00:47:16.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.621+0000 7fe69e800640 1 -- 172.21.15.7:0/634054807 wait complete. 2024-08-19T00:47:16.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.623+0000 7fe69e800640 1 Processor -- start 2024-08-19T00:47:16.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.623+0000 7fe69e800640 1 -- start start 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe69e800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6980739a0 0x7fe6981579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe69e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6980cea40 0x7fe69809cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe69e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe698159bf0 0x7fe6981f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe69e800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe698159fd0 con 0x7fe698159bf0 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe69e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe698072f40 con 0x7fe6980cea40 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe69e800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe69815a150 con 0x7fe6980739a0 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe698159bf0 0x7fe6981f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe698159bf0 0x7fe6981f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46846/0 (socket says 172.21.15.7:46846) 2024-08-19T00:47:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 -- 172.21.15.7:0/2526496026 learned_addr learned my addr 172.21.15.7:0/2526496026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe68fe00640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6980cea40 0x7fe69809cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697400640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6980739a0 0x7fe6981579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 -- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6980739a0 msgr2=0x7fe6981579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6980739a0 0x7fe6981579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 -- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6980cea40 msgr2=0x7fe69809cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6980cea40 0x7fe69809cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 -- 172.21.15.7:0/2526496026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe698158060 con 0x7fe698159bf0 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe68fe00640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6980cea40 0x7fe69809cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe697e00640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe698159bf0 0x7fe6981f4380 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c7a0 tx=0x7fe69000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe68f400640 1 -- 172.21.15.7:0/2526496026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690003b70 con 0x7fe698159bf0 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe68f400640 1 -- 172.21.15.7:0/2526496026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe690003d30 con 0x7fe698159bf0 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe68f400640 1 -- 172.21.15.7:0/2526496026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69000aa90 con 0x7fe698159bf0 2024-08-19T00:47:16.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.625+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe698158340 con 0x7fe698159bf0 2024-08-19T00:47:16.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.626+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe698158900 con 0x7fe698159bf0 2024-08-19T00:47:16.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.626+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6980ce500 con 0x7fe698159bf0 2024-08-19T00:47:16.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.627+0000 7fe68f400640 1 -- 172.21.15.7:0/2526496026 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe69000ac30 con 0x7fe698159bf0 2024-08-19T00:47:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.628+0000 7fe68f400640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe67406be30 0x7fe67406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.628+0000 7fe68f400640 1 -- 172.21.15.7:0/2526496026 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fe69008b930 con 0x7fe698159bf0 2024-08-19T00:47:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.628+0000 7fe697400640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe67406be30 0x7fe67406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.629+0000 7fe697400640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe67406be30 0x7fe67406e2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe688006fd0 tx=0x7fe688008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.633+0000 7fe68f400640 1 -- 172.21.15.7:0/2526496026 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe6900597a0 con 0x7fe698159bf0 2024-08-19T00:47:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.855+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe69815a360 con 0x7fe698159bf0 2024-08-19T00:47:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.856+0000 7fe68f400640 1 -- 172.21.15.7:0/2526496026 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 285 v285) ==== 95+0+4393 (secure 0 0 0) 0x7fe6900590a0 con 0x7fe698159bf0 2024-08-19T00:47:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:16.859 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":285,"btime":"2024-08-19T00:47:13:632004+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":285,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:13.632002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 285 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe67406be30 msgr2=0x7fe67406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe67406be30 0x7fe67406e2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe688006fd0 tx=0x7fe688008040 comp rx=0 tx=0).stop 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe698159bf0 msgr2=0x7fe6981f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe698159bf0 0x7fe6981f4380 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c7a0 tx=0x7fe69000cc60 comp rx=0 tx=0).stop 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 shutdown_connections 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe67406be30 0x7fe67406e2f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe698159bf0 0x7fe6981f4380 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6980cea40 0x7fe69809cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 --2- 172.21.15.7:0/2526496026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6980739a0 0x7fe6981579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 >> 172.21.15.7:0/2526496026 conn(0x7fe69806bc70 msgr2=0x7fe698160520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 shutdown_connections 2024-08-19T00:47:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:16.858+0000 7fe69e800640 1 -- 172.21.15.7:0/2526496026 wait complete. 2024-08-19T00:47:16.877 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:47:16.877 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.031+0000 7f13b3a00640 1 Processor -- start 2024-08-19T00:47:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.031+0000 7f13b3a00640 1 -- start start 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13b3a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac159bf0 0x7f13ac073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13b3a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13ac0739a0 0x7f13ac0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13b3a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13ac06f7f0 con 0x7f13ac0cea40 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13b3a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f13ac06f510 con 0x7f13ac0739a0 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13b3a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13ac072980 con 0x7f13ac159bf0 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13ac0739a0 0x7f13ac0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f13ac0739a0 0x7f13ac0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46850/0 (socket says 172.21.15.7:46850) 2024-08-19T00:47:17.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 -- 172.21.15.7:0/3003663421 learned_addr learned my addr 172.21.15.7:0/3003663421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13b1a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f13ac0cea40 0x7f13ac0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39188/0 (socket says 172.21.15.7:39188) 2024-08-19T00:47:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13b1000640 1 --2- 172.21.15.7:0/3003663421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac159bf0 0x7f13ac073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 -- 172.21.15.7:0/3003663421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac159bf0 msgr2=0x7f13ac073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 --2- 172.21.15.7:0/3003663421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac159bf0 0x7f13ac073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 -- 172.21.15.7:0/3003663421 >> v1:172.21.15.7:6789/0 conn(0x7f13ac0cea40 legacy=0x7f13ac0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 -- 172.21.15.7:0/3003663421 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac072c60 con 0x7f13ac0739a0 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.033+0000 7f13abe00640 1 --2- 172.21.15.7:0/3003663421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac0739a0 0x7f13ac0ce500 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f1398009870 tx=0x7f139802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5495e9b1a9ecbf2b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13ab400640 1 -- 172.21.15.7:0/3003663421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1398037070 con 0x7f13ac0739a0 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13ab400640 1 -- 172.21.15.7:0/3003663421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1398032440 con 0x7f13ac0739a0 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13ab400640 1 -- 172.21.15.7:0/3003663421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1398032810 con 0x7f13ac0739a0 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13b3a00640 1 -- 172.21.15.7:0/3003663421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac0739a0 msgr2=0x7f13ac0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13b3a00640 1 --2- 172.21.15.7:0/3003663421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac0739a0 0x7f13ac0ce500 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f1398009870 tx=0x7f139802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13b3a00640 1 -- 172.21.15.7:0/3003663421 shutdown_connections 2024-08-19T00:47:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13b3a00640 1 --2- 172.21.15.7:0/3003663421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac0739a0 0x7f13ac0ce500 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13b3a00640 1 --2- 172.21.15.7:0/3003663421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac159bf0 0x7f13ac073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13b3a00640 1 -- 172.21.15.7:0/3003663421 >> 172.21.15.7:0/3003663421 conn(0x7f13ac06bc70 msgr2=0x7f13ac06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.034+0000 7f13b3a00640 1 -- 172.21.15.7:0/3003663421 shutdown_connections 2024-08-19T00:47:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.035+0000 7f13b3a00640 1 -- 172.21.15.7:0/3003663421 wait complete. 2024-08-19T00:47:17.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.036+0000 7f13b3a00640 1 Processor -- start 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.036+0000 7f13b3a00640 1 -- start start 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.037+0000 7f13b3a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13ac0739a0 0x7f13ac1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.037+0000 7f13b3a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac0cea40 0x7f13ac0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.037+0000 7f13b3a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac159bf0 0x7f13ac15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.037+0000 7f13b3a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac15a150 con 0x7f13ac159bf0 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.037+0000 7f13b3a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac159fd0 con 0x7f13ac0739a0 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.037+0000 7f13b3a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13ac0d0ad0 con 0x7f13ac0cea40 2024-08-19T00:47:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac159bf0 0x7f13ac15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13ac0739a0 0x7f13ac1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13abe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac0cea40 0x7f13ac0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac159bf0 0x7f13ac15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46866/0 (socket says 172.21.15.7:46866) 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13ac0739a0 0x7f13ac1f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:46550/0 (socket says 172.21.15.7:46550) 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13abe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac0cea40 0x7f13ac0b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:44980/0 (socket says 172.21.15.7:44980) 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 -- 172.21.15.7:0/932195832 learned_addr learned my addr 172.21.15.7:0/932195832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 -- 172.21.15.7:0/932195832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac0cea40 msgr2=0x7f13ac0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac0cea40 0x7f13ac0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 -- 172.21.15.7:0/932195832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13ac0739a0 msgr2=0x7f13ac1f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13ac0739a0 0x7f13ac1f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 -- 172.21.15.7:0/932195832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac1f2d00 con 0x7f13ac159bf0 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.038+0000 7f13b1a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac159bf0 0x7f13ac15b290 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c780 tx=0x7f13a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.039+0000 7f13a8c00640 1 -- 172.21.15.7:0/932195832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4017070 con 0x7f13ac159bf0 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.039+0000 7f13a8c00640 1 -- 172.21.15.7:0/932195832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a400a640 con 0x7f13ac159bf0 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.039+0000 7f13a8c00640 1 -- 172.21.15.7:0/932195832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a400aa30 con 0x7f13ac159bf0 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.039+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ac0b0880 con 0x7f13ac159bf0 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.039+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ac0b0e40 con 0x7f13ac159bf0 2024-08-19T00:47:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.040+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ac0b1210 con 0x7f13ac159bf0 2024-08-19T00:47:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.041+0000 7f13a8c00640 1 -- 172.21.15.7:0/932195832 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13a401a070 con 0x7f13ac159bf0 2024-08-19T00:47:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.042+0000 7f13a8c00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f138c06be30 0x7f138c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.042+0000 7f13a8c00640 1 -- 172.21.15.7:0/932195832 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7f13a408af40 con 0x7f13ac159bf0 2024-08-19T00:47:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.042+0000 7f13b1000640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f138c06be30 0x7f138c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.043+0000 7f13b1000640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f138c06be30 0x7f138c06e2f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f13a0006fd0 tx=0x7f13a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.046+0000 7f13a8c00640 1 -- 172.21.15.7:0/932195832 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f13ac1f2d00 con 0x7f13ac159bf0 2024-08-19T00:47:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.266+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13ac15a6e0 con 0x7f13ac159bf0 2024-08-19T00:47:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.266+0000 7f13a8c00640 1 -- 172.21.15.7:0/932195832 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 285 v285) ==== 95+0+4393 (secure 0 0 0) 0x7f13a40586d0 con 0x7f13ac159bf0 2024-08-19T00:47:17.268 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:17.269 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":285,"btime":"2024-08-19T00:47:13:632004+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":285,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:13.632002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:17.269 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 285 2024-08-19T00:47:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f138c06be30 msgr2=0x7f138c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f138c06be30 0x7f138c06e2f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f13a0006fd0 tx=0x7f13a0008040 comp rx=0 tx=0).stop 2024-08-19T00:47:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac159bf0 msgr2=0x7f13ac15b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac159bf0 0x7f13ac15b290 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c780 tx=0x7f13a400cc40 comp rx=0 tx=0).stop 2024-08-19T00:47:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 shutdown_connections 2024-08-19T00:47:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f138c06be30 0x7f138c06e2f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13ac159bf0 0x7f13ac15b290 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13ac0cea40 0x7f13ac0b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 --2- 172.21.15.7:0/932195832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13ac0739a0 0x7f13ac1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 >> 172.21.15.7:0/932195832 conn(0x7f13ac06bc70 msgr2=0x7f13ac0751a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:17.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 shutdown_connections 2024-08-19T00:47:17.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.268+0000 7f13b3a00640 1 -- 172.21.15.7:0/932195832 wait complete. 2024-08-19T00:47:17.287 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap key 100.00000000:stray0_head' led to DAMAGED state 2024-08-19T00:47:17.287 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 1.00000000:subdir_head' 2024-08-19T00:47:17.287 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:17.287 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:17.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:47:17.323 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:47:17.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:17.324 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:47:17.399 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:47:17.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:47:17.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:47:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.597+0000 7febaf000640 1 Processor -- start 2024-08-19T00:47:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.597+0000 7febaf000640 1 -- start start 2024-08-19T00:47:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.598+0000 7febaf000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80ce500 0x7feba80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7febaf000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba806f7f0 con 0x7feba80d03c0 2024-08-19T00:47:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7febaf000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba806f510 con 0x7feba8159bf0 2024-08-19T00:47:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7febaf000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feba80cee80 con 0x7feba80ce500 2024-08-19T00:47:17.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7febad000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feba80d03c0 0x7feba806e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39192/0 (socket says 172.21.15.7:39192) 2024-08-19T00:47:17.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7febad000640 1 -- 172.21.15.7:0/1223584276 learned_addr learned my addr 172.21.15.7:0/1223584276 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7feba7400640 1 --2- 172.21.15.7:0/1223584276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80ce500 0x7feba80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605429007 0 0) 0x7feba806f7f0 con 0x7feba80d03c0 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb8c003520 con 0x7feba80d03c0 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.599+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707038319 0 0) 0x7feba806f510 con 0x7feba8159bf0 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.600+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feba806f7f0 con 0x7feba8159bf0 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.600+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3870979635 0 0) 0x7feb8c003520 con 0x7feba80d03c0 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.600+0000 7feba7400640 1 -- 172.21.15.7:0/1223584276 >> v1:172.21.15.162:6789/0 conn(0x7feba8159bf0 legacy=0x7feba8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.600+0000 7feba7400640 1 -- 172.21.15.7:0/1223584276 >> v1:172.21.15.7:6789/0 conn(0x7feba80d03c0 legacy=0x7feba806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.600+0000 7feba7400640 1 -- 172.21.15.7:0/1223584276 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba8072980 con 0x7feba80ce500 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.601+0000 7feba7400640 1 --2- 172.21.15.7:0/1223584276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80ce500 0x7feba80ce940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb940097d0 tx=0x7feb9402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b090bbe119fd3457 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.601+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94037070 con 0x7feba80ce500 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.601+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9402ab90 con 0x7feba80ce500 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.601+0000 7feba6a00640 1 -- 172.21.15.7:0/1223584276 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba00019f0 con 0x7feba80ce500 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.602+0000 7febaf000640 1 -- 172.21.15.7:0/1223584276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80ce500 msgr2=0x7feba80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.602+0000 7febaf000640 1 --2- 172.21.15.7:0/1223584276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80ce500 0x7feba80ce940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb940097d0 tx=0x7feb9402a100 comp rx=0 tx=0).stop 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.602+0000 7febaf000640 1 -- 172.21.15.7:0/1223584276 shutdown_connections 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.602+0000 7febaf000640 1 --2- 172.21.15.7:0/1223584276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80ce500 0x7feba80ce940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.602+0000 7febaf000640 1 -- 172.21.15.7:0/1223584276 >> 172.21.15.7:0/1223584276 conn(0x7feba806bc70 msgr2=0x7feba806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.602+0000 7febaf000640 1 -- 172.21.15.7:0/1223584276 shutdown_connections 2024-08-19T00:47:17.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.602+0000 7febaf000640 1 -- 172.21.15.7:0/1223584276 wait complete. 2024-08-19T00:47:17.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.603+0000 7febaf000640 1 Processor -- start 2024-08-19T00:47:17.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.604+0000 7febaf000640 1 -- start start 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.604+0000 7febaf000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80ce500 0x7feba81578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.604+0000 7febaf000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80d03c0 0x7feba80c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7febaf000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba8159bf0 0x7feba80c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7febaf000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feba8073b70 con 0x7feba80ce500 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7febaf000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feba8072f40 con 0x7feba8159bf0 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7febaf000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feba8159fd0 con 0x7feba80d03c0 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80ce500 0x7feba81578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80ce500 0x7feba81578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46868/0 (socket says 172.21.15.7:46868) 2024-08-19T00:47:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 -- 172.21.15.7:0/3266928119 learned_addr learned my addr 172.21.15.7:0/3266928119 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7febad000640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba8159bf0 0x7feba80c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7400640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80d03c0 0x7feba80c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 -- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80d03c0 msgr2=0x7feba80c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80d03c0 0x7feba80c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 -- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba8159bf0 msgr2=0x7feba80c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba8159bf0 0x7feba80c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.605+0000 7feba7e00640 1 -- 172.21.15.7:0/3266928119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba809e240 con 0x7feba80ce500 2024-08-19T00:47:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.606+0000 7feba7e00640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80ce500 0x7feba81578b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c490 tx=0x7feb9800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.606+0000 7feb9fe00640 1 -- 172.21.15.7:0/3266928119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb980052d0 con 0x7feba80ce500 2024-08-19T00:47:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.606+0000 7feb9fe00640 1 -- 172.21.15.7:0/3266928119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb98005470 con 0x7feba80ce500 2024-08-19T00:47:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.606+0000 7feb9fe00640 1 -- 172.21.15.7:0/3266928119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98012850 con 0x7feba80ce500 2024-08-19T00:47:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.606+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba809a430 con 0x7feba80ce500 2024-08-19T00:47:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.606+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba809a9f0 con 0x7feba80ce500 2024-08-19T00:47:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.607+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba80ce940 con 0x7feba80ce500 2024-08-19T00:47:17.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.608+0000 7feb9fe00640 1 -- 172.21.15.7:0/3266928119 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb980129f0 con 0x7feba80ce500 2024-08-19T00:47:17.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.609+0000 7feb9fe00640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb8806be30 0x7feb8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.609+0000 7feb9fe00640 1 -- 172.21.15.7:0/3266928119 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7feb9808b500 con 0x7feba80ce500 2024-08-19T00:47:17.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.609+0000 7feba7400640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb8806be30 0x7feb8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.610+0000 7feba7400640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb8806be30 0x7feb8806e2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7feb94034000 tx=0x7feb9402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.613+0000 7feb9fe00640 1 -- 172.21.15.7:0/3266928119 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feb98058d20 con 0x7feba80ce500 2024-08-19T00:47:17.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:17.834+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feba80b1400 con 0x7feba80ce500 2024-08-19T00:47:18.385 INFO:tasks.ceph.mds.a.smithi007.stderr: -48> 2024-08-19T00:47:13.628+0000 7f0b1ca00640 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x100is fatal because it is a system directory for this rank 2024-08-19T00:47:18.385 INFO:tasks.ceph.mds.a.smithi007.stderr: -30> 2024-08-19T00:47:14.612+0000 7f0b21a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:18.425 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:47:18.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.647+0000 7feb9fe00640 1 -- 172.21.15.7:0/3266928119 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v286) ==== 161+0+0 (secure 0 0 0) 0x7feb9805f020 con 0x7feba80ce500 2024-08-19T00:47:18.649 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb8806be30 msgr2=0x7feb8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb8806be30 0x7feb8806e2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7feb94034000 tx=0x7feb9402e000 comp rx=0 tx=0).stop 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80ce500 msgr2=0x7feba81578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80ce500 0x7feba81578b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c490 tx=0x7feb9800c950 comp rx=0 tx=0).stop 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 shutdown_connections 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feb8806be30 0x7feb8806e2f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba8159bf0 0x7feba80c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba80d03c0 0x7feba80c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 --2- 172.21.15.7:0/3266928119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feba80ce500 0x7feba81578b0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 >> 172.21.15.7:0/3266928119 conn(0x7feba806bc70 msgr2=0x7feba815b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:18.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 shutdown_connections 2024-08-19T00:47:18.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.651+0000 7febaf000640 1 -- 172.21.15.7:0/3266928119 wait complete. 2024-08-19T00:47:18.671 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:47:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.829+0000 7f4f33200640 1 Processor -- start 2024-08-19T00:47:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.829+0000 7f4f33200640 1 -- start start 2024-08-19T00:47:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.830+0000 7f4f33200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4f2c15e3e0 0x7f4f2c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.830+0000 7f4f33200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 0x7f4f2c0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.830+0000 7f4f33200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f2c0b4df0 con 0x7f4f2c0d27b0 2024-08-19T00:47:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.830+0000 7f4f33200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2c0d3140 con 0x7f4f2c15e3e0 2024-08-19T00:47:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.830+0000 7f4f33200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2c0b50d0 con 0x7f4f2c0b4860 2024-08-19T00:47:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.830+0000 7f4f31400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4f2c0d27b0 0x7f4f2c0b4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39210/0 (socket says 172.21.15.7:39210) 2024-08-19T00:47:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.830+0000 7f4f31400640 1 -- 172.21.15.7:0/1746097435 learned_addr learned my addr 172.21.15.7:0/1746097435 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f31e00640 1 --2- 172.21.15.7:0/1746097435 >> v2:172.21.15.162:3300/0 conn(0x7f4f2c15e3e0 0x7f4f2c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f32800640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 0x7f4f2c0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555049577 0 0) 0x7f4f2c0b4df0 con 0x7f4f2c0d27b0 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f14003520 con 0x7f4f2c0d27b0 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2880655385 0 0) 0x7f4f14003520 con 0x7f4f2c0d27b0 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 msgr2=0x7f4f2c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 0x7f4f2c0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 >> v2:172.21.15.162:3300/0 conn(0x7f4f2c15e3e0 msgr2=0x7f4f2c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 --2- 172.21.15.7:0/1746097435 >> v2:172.21.15.162:3300/0 conn(0x7f4f2c15e3e0 0x7f4f2c0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c0cf1e0 con 0x7f4f2c0d27b0 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f4f1c001670 con 0x7f4f2c0d27b0 2024-08-19T00:47:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 >> v1:172.21.15.7:6789/0 conn(0x7f4f2c0d27b0 legacy=0x7f4f2c0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f140039b0 0x7f4f14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f14004800 0x7f4f14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 0x7f4f140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0d3140 con 0x7f4f14004800 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0b50d0 con 0x7f4f140039b0 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.831+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1400b9c0 con 0x7f4f2c0b4860 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f31400640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f14004800 0x7f4f14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f31e00640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f140039b0 0x7f4f14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f32800640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 0x7f4f140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f31400640 1 -- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 msgr2=0x7f4f140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f31400640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 0x7f4f140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f31400640 1 -- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f140039b0 msgr2=0x7f4f14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f31400640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f140039b0 0x7f4f14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f31400640 1 -- 172.21.15.7:0/1746097435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f14003520 con 0x7f4f14004800 2024-08-19T00:47:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.832+0000 7f4f32800640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f2c0b4860 0x7f4f140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.833+0000 7f4f31400640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f14004800 0x7f4f14004c80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c190 tx=0x7f4f14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce66bc103bfaa8e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.833+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c007c60 con 0x7f4f14004800 2024-08-19T00:47:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.833+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c005af0 con 0x7f4f14004800 2024-08-19T00:47:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.833+0000 7f4f30a00640 1 -- 172.21.15.7:0/1746097435 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c007070 con 0x7f4f14004800 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.834+0000 7f4f33200640 1 -- 172.21.15.7:0/1746097435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f14004800 msgr2=0x7f4f14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.834+0000 7f4f33200640 1 --2- 172.21.15.7:0/1746097435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f14004800 0x7f4f14004c80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c190 tx=0x7f4f14005830 comp rx=0 tx=0).stop 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.834+0000 7f4f32800640 1 -- 172.21.15.7:0/1746097435 reap_dead start 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.834+0000 7f4f33200640 1 -- 172.21.15.7:0/1746097435 shutdown_connections 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.834+0000 7f4f33200640 1 -- 172.21.15.7:0/1746097435 >> 172.21.15.7:0/1746097435 conn(0x7f4f2c08dbe0 msgr2=0x7f4f2c09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.834+0000 7f4f33200640 1 -- 172.21.15.7:0/1746097435 shutdown_connections 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.834+0000 7f4f33200640 1 -- 172.21.15.7:0/1746097435 wait complete. 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.836+0000 7f4f33200640 1 Processor -- start 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.836+0000 7f4f33200640 1 -- start start 2024-08-19T00:47:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f33200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f14004800 0x7f4f2c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f33200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2c15ed50 0x7f4f2c15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f33200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f2c09f7c0 0x7f4f2c09fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f33200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0b13a0 con 0x7f4f2c15ed50 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f33200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0cee90 con 0x7f4f2c09f7c0 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f33200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2c0d2c00 con 0x7f4f14004800 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2c15ed50 0x7f4f2c15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2c15ed50 0x7f4f2c15f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46900/0 (socket says 172.21.15.7:46900) 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 -- 172.21.15.7:0/957531708 learned_addr learned my addr 172.21.15.7:0/957531708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f32800640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f2c09f7c0 0x7f4f2c09fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31e00640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f14004800 0x7f4f2c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 -- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f14004800 msgr2=0x7f4f2c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f14004800 0x7f4f2c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 -- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f2c09f7c0 msgr2=0x7f4f2c09fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f2c09f7c0 0x7f4f2c09fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.837+0000 7f4f31400640 1 -- 172.21.15.7:0/957531708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c15fac0 con 0x7f4f2c15ed50 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.838+0000 7f4f31400640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2c15ed50 0x7f4f2c15f1d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c2b0 tx=0x7f4f1c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.838+0000 7f4f26000640 1 -- 172.21.15.7:0/957531708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c001570 con 0x7f4f2c15ed50 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.838+0000 7f4f26000640 1 -- 172.21.15.7:0/957531708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c042070 con 0x7f4f2c15ed50 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.838+0000 7f4f26000640 1 -- 172.21.15.7:0/957531708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c007290 con 0x7f4f2c15ed50 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.838+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c15fda0 con 0x7f4f2c15ed50 2024-08-19T00:47:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.838+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c160360 con 0x7f4f2c15ed50 2024-08-19T00:47:18.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.839+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2c0b0e60 con 0x7f4f2c15ed50 2024-08-19T00:47:18.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.840+0000 7f4f26000640 1 -- 172.21.15.7:0/957531708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f1c007430 con 0x7f4f2c15ed50 2024-08-19T00:47:18.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.841+0000 7f4f26000640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f1006be60 0x7f4f1006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.841+0000 7f4f26000640 1 -- 172.21.15.7:0/957531708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7f4f1c0aba30 con 0x7f4f2c15ed50 2024-08-19T00:47:18.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.841+0000 7f4f31e00640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f1006be60 0x7f4f1006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.842+0000 7f4f31e00640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f1006be60 0x7f4f1006e320 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0a22f0 tx=0x7f4f20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:18.846+0000 7f4f26000640 1 -- 172.21.15.7:0/957531708 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4f1c079810 con 0x7f4f2c15ed50 2024-08-19T00:47:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.101+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f4f2c0b24b0 con 0x7f4f2c15ed50 2024-08-19T00:47:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.656+0000 7f4f26000640 1 -- 172.21.15.7:0/957531708 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v287) ==== 101+0+0 (secure 0 0 0) 0x7f4f1c079110 con 0x7f4f2c15ed50 2024-08-19T00:47:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:47:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f1006be60 msgr2=0x7f4f1006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f1006be60 0x7f4f1006e320 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0a22f0 tx=0x7f4f20008040 comp rx=0 tx=0).stop 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2c15ed50 msgr2=0x7f4f2c15f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2c15ed50 0x7f4f2c15f1d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c2b0 tx=0x7f4f1c001970 comp rx=0 tx=0).stop 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 shutdown_connections 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4f1006be60 0x7f4f1006e320 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f2c09f7c0 0x7f4f2c09fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2c15ed50 0x7f4f2c15f1d0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 --2- 172.21.15.7:0/957531708 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f14004800 0x7f4f2c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 >> 172.21.15.7:0/957531708 conn(0x7f4f2c08dbe0 msgr2=0x7f4f2c0d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 shutdown_connections 2024-08-19T00:47:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.659+0000 7f4f33200640 1 -- 172.21.15.7:0/957531708 wait complete. 2024-08-19T00:47:19.679 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:47:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.756+0000 7f13f172ff40 1 Processor -- start 2024-08-19T00:47:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.756+0000 7f13f172ff40 1 -- start start 2024-08-19T00:47:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13f172ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089e8e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13f172ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089eac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13f172ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 0x565089eacc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13f172ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x565089d79d00 con 0x565089e055b0 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13f172ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565089d7dd40 con 0x565089e03f40 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13f172ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x565089eaadc0 con 0x565089e05990 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089eac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089eac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46906/0 (socket says 172.21.15.7:46906) 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13ed400640 1 -- 172.21.15.7:0/4098637014 learned_addr learned my addr 172.21.15.7:0/4098637014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13ede00640 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089e8e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.757+0000 7f13ee800640 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 0x565089eacc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13ed400640 1 -- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 msgr2=0x565089eacc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13ed400640 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 0x565089eacc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13ed400640 1 -- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 msgr2=0x565089e8e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13ed400640 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089e8e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13ed400640 1 -- 172.21.15.7:0/4098637014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565089d3b080 con 0x565089e055b0 2024-08-19T00:47:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13ede00640 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089e8e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13ed400640 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089eac730 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00a520 tx=0x7f13dc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2978106870e899 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13e7e00640 1 -- 172.21.15.7:0/4098637014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc059040 con 0x565089e055b0 2024-08-19T00:47:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13e7e00640 1 -- 172.21.15.7:0/4098637014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13dc064070 con 0x565089e055b0 2024-08-19T00:47:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.758+0000 7f13e7e00640 1 -- 172.21.15.7:0/4098637014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0547f0 con 0x565089e055b0 2024-08-19T00:47:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 -- 172.21.15.7:0/4098637014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 msgr2=0x565089eac730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089eac730 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00a520 tx=0x7f13dc04e000 comp rx=0 tx=0).stop 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 -- 172.21.15.7:0/4098637014 shutdown_connections 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 0x565089eacc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089eac730 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 --2- 172.21.15.7:0/4098637014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089e8e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 -- 172.21.15.7:0/4098637014 >> 172.21.15.7:0/4098637014 conn(0x565089e024e0 msgr2=0x565089e1ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 -- 172.21.15.7:0/4098637014 shutdown_connections 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.759+0000 7f13f172ff40 1 -- 172.21.15.7:0/4098637014 wait complete. 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.760+0000 7f13f172ff40 1 Processor -- start 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.760+0000 7f13f172ff40 1 -- start start 2024-08-19T00:47:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13f172ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089ea2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13f172ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089ea9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13f172ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 0x565089eaa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13f172ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x565089e8ec90 con 0x565089e055b0 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13f172ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565089e8f1e0 con 0x565089e03f40 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13f172ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x565089e1d540 con 0x565089e05990 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089ea9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089ea9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46910/0 (socket says 172.21.15.7:46910) 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 learned_addr learned my addr 172.21.15.7:0/552210283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ee800640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 0x565089eaa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ede00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089ea2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 msgr2=0x565089eaa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565089e05990 0x565089eaa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 msgr2=0x565089ea2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565089e03f40 0x565089ea2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.761+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565089ea3620 con 0x565089e055b0 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.762+0000 7f13ed400640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089ea9c20 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f13dc061040 tx=0x7f13dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.762+0000 7f13e6a00640 1 -- 172.21.15.7:0/552210283 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc059040 con 0x565089e055b0 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.762+0000 7f13e6a00640 1 -- 172.21.15.7:0/552210283 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13dc0547f0 con 0x565089e055b0 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.762+0000 7f13e6a00640 1 -- 172.21.15.7:0/552210283 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc054ba0 con 0x565089e055b0 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.762+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565089e02020 con 0x565089e055b0 2024-08-19T00:47:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.762+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565089e01d40 con 0x565089e055b0 2024-08-19T00:47:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.764+0000 7f13e6a00640 1 -- 172.21.15.7:0/552210283 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13dc05f470 con 0x565089e055b0 2024-08-19T00:47:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.765+0000 7f13e6a00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13d006a810 0x7f13d006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.765+0000 7f13e6a00640 1 -- 172.21.15.7:0/552210283 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7f13dc0cf900 con 0x565089e055b0 2024-08-19T00:47:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.765+0000 7f13ede00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13d006a810 0x7f13d006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.769 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:47:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.765+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x565089f40270 0x565089f40680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.765+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f40bc0 con 0x565089f40270 2024-08-19T00:47:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.766+0000 7f13ede00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13d006a810 0x7f13d006ccd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f13e0003c20 tx=0x7f13e0003090 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.766+0000 7f13ee800640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x565089f40270 0x565089f40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.767+0000 7f13ee800640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x565089f40270 0x565089f40680 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.769+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v119'1002 uv976 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.769+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f40f90 con 0x565089f40270 2024-08-19T00:47:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.771+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v119'1003 uv1003 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.771+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4c870 con 0x565089f40270 2024-08-19T00:47:19.774 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:47:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.773+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v119'1004 uv1004 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.773+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4dc20 con 0x565089f40270 2024-08-19T00:47:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.774+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v119'1005 uv1005 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.774+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4dfc0 con 0x565089f40270 2024-08-19T00:47:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.776+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v119'1006 uv1006 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.776+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4cc10 con 0x565089f40270 2024-08-19T00:47:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.778+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v119'1007 uv1007 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.778+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d000 con 0x565089f40270 2024-08-19T00:47:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.779+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v119'1008 uv982 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.779+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3f0 con 0x565089f40270 2024-08-19T00:47:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.781+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v119'1009 uv1009 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.781+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3f0 con 0x565089f40270 2024-08-19T00:47:19.784 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:47:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.782+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v119'1010 uv1010 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.782+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.784+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v119'1011 uv1011 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.784+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.785+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v119'1012 uv1012 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.785+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.787+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v119'1013 uv1013 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.787+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.789+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v119'1014 uv989 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.789+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.790+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v119'1015 uv1015 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.790+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.793 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:47:19.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.792+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v119'1016 uv1016 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.792+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.793+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v119'1017 uv1017 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.793+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.795+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v119'1018 uv1018 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.795+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.796+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v119'1019 uv1019 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.797+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.798+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v119'1020 uv1020 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.798+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.800+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v119'1021 uv995 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.800+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.801+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v119'1022 uv1022 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.801+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.804 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:47:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.803+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v119'1023 uv1023 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.803+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.805+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v119'1024 uv1024 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.805+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.806+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v119'1025 uv1025 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.806+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.808+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v119'1026 uv1026 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.808+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.809+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v119'1027 uv1001 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.809+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.811+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v119'1028 uv1028 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.811+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.814 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:47:19.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.812+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v119'1029 uv1029 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.812+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.814+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v119'1030 uv1030 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.814+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.815+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v119'1031 uv1031 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.815+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f40270 2024-08-19T00:47:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.817+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v119'1032 uv1032 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.817+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x565089f4d780 0x565089f50880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.817+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f4d3a0 con 0x565089f4d780 2024-08-19T00:47:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.817+0000 7f13ede00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x565089f4d780 0x565089f50880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.818+0000 7f13ede00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x565089f4d780 0x565089f50880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.820+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v119'727 uv709 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.820+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f50dc0 con 0x565089f4d780 2024-08-19T00:47:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.821+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v119'728 uv728 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.821+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f51160 con 0x565089f4d780 2024-08-19T00:47:19.824 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:47:19.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.823+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v119'729 uv729 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.823+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f51a30 con 0x565089f4d780 2024-08-19T00:47:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.824+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v119'730 uv730 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.824+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f51dd0 con 0x565089f4d780 2024-08-19T00:47:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.826+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v119'731 uv731 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.826+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f521c0 con 0x565089f4d780 2024-08-19T00:47:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.828+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v119'732 uv714 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.828+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f52560 con 0x565089f4d780 2024-08-19T00:47:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.829+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v119'733 uv733 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.829+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.832 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:47:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.831+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v119'734 uv734 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.831+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.832+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v119'735 uv735 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.832+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.834+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v119'736 uv736 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.834+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.835+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v119'737 uv719 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.835+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.837+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v119'738 uv738 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.837+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.840 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:47:19.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.839+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v119'739 uv739 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.839+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f56ff0 con 0x565089f4d780 2024-08-19T00:47:19.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.841+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v119'740 uv740 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.841+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f56ff0 con 0x565089f4d780 2024-08-19T00:47:19.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.842+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v119'741 uv741 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.842+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.844+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v119'742 uv725 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.844+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.845+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v119'743 uv743 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.845+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.848 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:47:19.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.846+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v119'744 uv744 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.846+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f53910 con 0x565089f4d780 2024-08-19T00:47:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.848+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v119'745 uv745 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.848+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f53910 con 0x565089f4d780 2024-08-19T00:47:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.850+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v119'746 uv746 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.850+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f52900 con 0x565089f4d780 2024-08-19T00:47:19.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.851+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v119'747 uv747 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f4d780 2024-08-19T00:47:19.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.851+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x565089f52f80 0x565089f55370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.851+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f55900 con 0x565089f52f80 2024-08-19T00:47:19.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.852+0000 7f13ed400640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x565089f52f80 0x565089f55370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.852+0000 7f13ed400640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x565089f52f80 0x565089f55370 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.854+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v119'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.854+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f55df0 con 0x565089f52f80 2024-08-19T00:47:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.855+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v119'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.855+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f562d0 con 0x565089f52f80 2024-08-19T00:47:19.858 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:47:19.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.856+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v119'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.856+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f57b80 con 0x565089f52f80 2024-08-19T00:47:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.857+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v119'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.857+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f57f20 con 0x565089f52f80 2024-08-19T00:47:19.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.858+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v119'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.858+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f56b70 con 0x565089f52f80 2024-08-19T00:47:19.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.859+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v119'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.860+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f56f60 con 0x565089f40270 2024-08-19T00:47:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.861+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v119'145 uv144 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.861+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f56f60 con 0x565089f40270 2024-08-19T00:47:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.863+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v119'146 uv146 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.863+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f56f60 con 0x565089f40270 2024-08-19T00:47:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.864+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v119'147 uv147 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.866 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:47:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.864+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f56f60 con 0x565089f40270 2024-08-19T00:47:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.866+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v119'148 uv148 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.866+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x565089f582c0 0x565089f5a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.866+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5abf0 con 0x565089f582c0 2024-08-19T00:47:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.866+0000 7f13ee800640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x565089f582c0 0x565089f5a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.867+0000 7f13ee800640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x565089f582c0 0x565089f5a6b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.868+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v119'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.868+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f5abf0 con 0x565089f582c0 2024-08-19T00:47:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.870+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v119'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.870+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5abf0 con 0x565089f582c0 2024-08-19T00:47:19.872 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:47:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.871+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v119'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.871+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5bc00 con 0x565089f582c0 2024-08-19T00:47:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.872+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v119'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.872+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5bc00 con 0x565089f582c0 2024-08-19T00:47:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.873+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v119'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.873+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5abf0 con 0x565089f582c0 2024-08-19T00:47:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.875+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v119'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.875+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x565089f5b100 0x565089f5d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.875+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5db00 con 0x565089f5b100 2024-08-19T00:47:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.875+0000 7f13ede00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x565089f5b100 0x565089f5d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.875+0000 7f13ede00640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x565089f5b100 0x565089f5d4f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.877+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v119'360 uv354 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.877+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.879+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v119'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.879+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.881 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:47:19.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.880+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v119'362 uv362 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.880+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5eee0 con 0x565089f5b100 2024-08-19T00:47:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.881+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v119'363 uv363 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.881+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5eee0 con 0x565089f5b100 2024-08-19T00:47:19.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.883+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v119'364 uv364 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.883+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.884+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v119'365 uv365 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.884+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.885+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v119'366 uv359 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.885+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.886+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v119'367 uv367 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.886+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.889 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:47:19.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.888+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v119'368 uv368 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.888+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.889+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v119'369 uv369 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.889+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f5ded0 con 0x565089f5b100 2024-08-19T00:47:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.891+0000 7f13ede00640 1 -- 172.21.15.7:0/552210283 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v119'370 uv370 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e000e040 con 0x565089f5b100 2024-08-19T00:47:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.891+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x565089f5e7f0 0x565089f60be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.891+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61120 con 0x565089f5e7f0 2024-08-19T00:47:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.891+0000 7f13ed400640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x565089f5e7f0 0x565089f60be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:19.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.891+0000 7f13ed400640 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x565089f5e7f0 0x565089f60be0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:19.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.893+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v119'163 uv162 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.893+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61120 con 0x565089f5e7f0 2024-08-19T00:47:19.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.894+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v119'164 uv164 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.894+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f5e7f0 2024-08-19T00:47:19.897 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:47:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.895+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v119'165 uv165 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.895+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f5e7f0 2024-08-19T00:47:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.897+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v119'166 uv166 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.897+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f5e7f0 2024-08-19T00:47:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.898+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v119'167 uv167 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.898+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f40270 2024-08-19T00:47:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.900+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v119'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.900+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f40270 2024-08-19T00:47:19.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.901+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v119'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.901+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f40270 2024-08-19T00:47:19.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.902+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v119'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.904 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:47:19.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.902+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f62580 con 0x565089f40270 2024-08-19T00:47:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.903+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v119'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.903+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f62580 con 0x565089f40270 2024-08-19T00:47:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.904+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v119'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.904+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f40270 2024-08-19T00:47:19.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.906+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v119'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f40270 2024-08-19T00:47:19.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.906+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.907+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v119'325 uv318 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.907+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.909+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v119'326 uv326 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.909+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.910+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v119'327 uv327 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.912 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:47:19.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.910+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.912+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v119'328 uv328 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.912+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.913+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v119'329 uv329 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.913+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.915+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v119'330 uv324 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.915+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.916+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v119'331 uv331 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.916+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.919 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:47:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.917+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v119'332 uv332 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.918+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61570 con 0x565089f52f80 2024-08-19T00:47:19.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.919+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v119'333 uv333 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.919+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f64380 con 0x565089f52f80 2024-08-19T00:47:19.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.921+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v119'334 uv334 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f52f80 2024-08-19T00:47:19.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.921+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.923+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v119'142 uv140 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.924+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.925+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v119'143 uv143 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.925+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.931 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:47:19.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.926+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v119'144 uv144 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.926+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.927+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v119'145 uv145 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.928+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.929+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v119'195 uv194 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.929+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.931+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v119'196 uv196 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.931+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.934 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:47:19.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.933+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v119'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.933+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f62a30 con 0x565089f582c0 2024-08-19T00:47:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.934+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v119'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.934+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f62a30 con 0x565089f582c0 2024-08-19T00:47:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.936+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v119'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.936+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f582c0 2024-08-19T00:47:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.937+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v119'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13e8005870 con 0x565089f582c0 2024-08-19T00:47:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.937+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.939+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v119'166 uv165 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.939+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.940+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v119'167 uv167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.940+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.942 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:47:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.941+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v119'168 uv168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.941+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.943+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v119'169 uv169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.943+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.944+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v119'170 uv170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.944+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.945+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v119'402 uv393 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.945+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.947+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v119'403 uv403 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.947+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:47:19.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.948+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v119'404 uv404 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.948+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.949+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v119'405 uv405 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.949+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.951+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v119'406 uv406 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.951+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.952+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v119'407 uv400 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.952+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.953+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v119'408 uv408 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.953+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.956 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:47:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.955+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v119'409 uv409 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.955+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f62a30 con 0x565089f5e7f0 2024-08-19T00:47:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.956+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v119'410 uv410 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.956+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f62a30 con 0x565089f5e7f0 2024-08-19T00:47:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.957+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v119'411 uv411 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.958+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61a20 con 0x565089f5e7f0 2024-08-19T00:47:19.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.959+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v119'412 uv412 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.959+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x565089f61f80 con 0x565089f5e7f0 2024-08-19T00:47:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13ed400640 1 -- 172.21.15.7:0/552210283 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v119'413 uv413 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f13dc05c040 con 0x565089f5e7f0 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x565089f4d780 msgr2=0x565089f50880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x565089f4d780 0x565089f50880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x565089f5b100 msgr2=0x565089f5d4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x565089f5b100 0x565089f5d4f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x565089f5e7f0 msgr2=0x565089f60be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x565089f5e7f0 0x565089f60be0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x565089f52f80 msgr2=0x565089f55370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x565089f52f80 0x565089f55370 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 reap_dead start 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x565089f40270 msgr2=0x565089f40680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x565089f40270 0x565089f40680 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13ee800640 1 -- 172.21.15.7:0/552210283 reap_dead start 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x565089f582c0 msgr2=0x565089f5a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.960+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x565089f582c0 0x565089f5a6b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13d006a810 msgr2=0x7f13d006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13d006a810 0x7f13d006ccd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f13e0003c20 tx=0x7f13e0003090 comp rx=0 tx=0).stop 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 msgr2=0x565089ea9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089ea9c20 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f13dc061040 tx=0x7f13dc002fb0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 shutdown_connections 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13d006a810 0x7f13d006ccd0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565089e055b0 0x565089ea9c20 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 --2- 172.21.15.7:0/552210283 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x565089f582c0 0x565089f5a6b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 >> 172.21.15.7:0/552210283 conn(0x565089e024e0 msgr2=0x565089e1ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 shutdown_connections 2024-08-19T00:47:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:19.961+0000 7f13f172ff40 1 -- 172.21.15.7:0/552210283 wait complete. 2024-08-19T00:47:19.967 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 1.00000000 subdir_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:47:20.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.044+0000 7f59ac60bf40 1 Processor -- start 2024-08-19T00:47:20.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.044+0000 7f59ac60bf40 1 -- start start 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59ac60bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071bf40 0x5556e07c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59ac60bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d5b0 0x5556e0853da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59ac60bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071d990 0x5556e08542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59ac60bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5556e0691d00 con 0x5556e071d990 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59ac60bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5556e0695d40 con 0x5556e071d5b0 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59ac60bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5556e07c2dc0 con 0x5556e071bf40 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59a9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071d990 0x5556e08542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59a9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071d990 0x5556e08542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46920/0 (socket says 172.21.15.7:46920) 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59a9600640 1 -- 172.21.15.7:0/3475436042 learned_addr learned my addr 172.21.15.7:0/3475436042 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59a3e00640 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d5b0 0x5556e0853da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.045+0000 7f59a8c00640 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071bf40 0x5556e07c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a9600640 1 -- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071bf40 msgr2=0x5556e07c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a9600640 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071bf40 0x5556e07c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a9600640 1 -- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d5b0 msgr2=0x5556e0853da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a9600640 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d5b0 0x5556e0853da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a9600640 1 -- 172.21.15.7:0/3475436042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e0653080 con 0x5556e071d990 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a9600640 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071d990 0x5556e08542e0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f59a4001620 tx=0x7f59a4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cb93486139783a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a2a00640 1 -- 172.21.15.7:0/3475436042 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4017070 con 0x5556e071d990 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a2a00640 1 -- 172.21.15.7:0/3475436042 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a400f710 con 0x5556e071d990 2024-08-19T00:47:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.046+0000 7f59a2a00640 1 -- 172.21.15.7:0/3475436042 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a400fb40 con 0x5556e071d990 2024-08-19T00:47:20.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 -- 172.21.15.7:0/3475436042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071d990 msgr2=0x5556e08542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071d990 0x5556e08542e0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f59a4001620 tx=0x7f59a4001ae0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 -- 172.21.15.7:0/3475436042 shutdown_connections 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071d990 0x5556e08542e0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d5b0 0x5556e0853da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/3475436042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071bf40 0x5556e07c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 -- 172.21.15.7:0/3475436042 >> 172.21.15.7:0/3475436042 conn(0x5556e071a4e0 msgr2=0x5556e06ea6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 -- 172.21.15.7:0/3475436042 shutdown_connections 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.047+0000 7f59ac60bf40 1 -- 172.21.15.7:0/3475436042 wait complete. 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.048+0000 7f59ac60bf40 1 Processor -- start 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.048+0000 7f59ac60bf40 1 -- start start 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59ac60bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071bf40 0x5556e07b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59ac60bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071d5b0 0x5556e085bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59ac60bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d990 0x5556e085c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59ac60bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5556e06eb530 con 0x5556e071bf40 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59ac60bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5556e06eb180 con 0x5556e071d990 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59ac60bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5556e071ab20 con 0x5556e071d5b0 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071bf40 0x5556e07b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071bf40 0x5556e07b84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46928/0 (socket says 172.21.15.7:46928) 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 -- 172.21.15.7:0/2039167156 learned_addr learned my addr 172.21.15.7:0/2039167156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a3e00640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071d5b0 0x5556e085bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a9600640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d990 0x5556e085c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 -- 172.21.15.7:0/2039167156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071d5b0 msgr2=0x5556e085bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5556e071d5b0 0x5556e085bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 -- 172.21.15.7:0/2039167156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d990 msgr2=0x5556e085c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556e071d990 0x5556e085c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.049+0000 7f59a8c00640 1 -- 172.21.15.7:0/2039167156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e07bc790 con 0x5556e071bf40 2024-08-19T00:47:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.050+0000 7f59a8c00640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071bf40 0x5556e07b84c0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f599c00df50 tx=0x7f599c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.050+0000 7f59a1600640 1 -- 172.21.15.7:0/2039167156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c014020 con 0x5556e071bf40 2024-08-19T00:47:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.050+0000 7f59a1600640 1 -- 172.21.15.7:0/2039167156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c00be50 con 0x5556e071bf40 2024-08-19T00:47:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.050+0000 7f59a1600640 1 -- 172.21.15.7:0/2039167156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c008030 con 0x5556e071bf40 2024-08-19T00:47:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.050+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556e07ad7f0 con 0x5556e071bf40 2024-08-19T00:47:20.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.050+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e07ae260 con 0x5556e071bf40 2024-08-19T00:47:20.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.052+0000 7f59a1600640 1 -- 172.21.15.7:0/2039167156 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f599c017020 con 0x5556e071bf40 2024-08-19T00:47:20.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.053+0000 7f59a1600640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f598806a810 0x7f598806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.053+0000 7f59a1600640 1 -- 172.21.15.7:0/2039167156 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7f599c08a5e0 con 0x5556e071bf40 2024-08-19T00:47:20.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.053+0000 7f59a3e00640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f598806a810 0x7f598806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.053+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5556e07b8a00 0x5556e07ba210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.053+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=103b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x5556e07adca0 con 0x5556e07b8a00 2024-08-19T00:47:20.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.053+0000 7f59a9600640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5556e07b8a00 0x5556e07ba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.054+0000 7f59a3e00640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f598806a810 0x7f598806ccd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5994057000 tx=0x7f5994062040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.054+0000 7f59a9600640 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5556e07b8a00 0x5556e07ba210 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59a9600640 1 -- 172.21.15.7:0/2039167156 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 1.00000000 [omap-set-vals] v119'414 uv414 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f59a4003030 con 0x5556e07b8a00 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5556e07b8a00 msgr2=0x5556e07ba210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x5556e07b8a00 0x5556e07ba210 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f598806a810 msgr2=0x7f598806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f598806a810 0x7f598806ccd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5994057000 tx=0x7f5994062040 comp rx=0 tx=0).stop 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071bf40 msgr2=0x5556e07b84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 --2- 172.21.15.7:0/2039167156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5556e071bf40 0x5556e07b84c0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f599c00df50 tx=0x7f599c00b6a0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59a9600640 1 -- 172.21.15.7:0/2039167156 reap_dead start 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 shutdown_connections 2024-08-19T00:47:20.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 >> 172.21.15.7:0/2039167156 conn(0x5556e071a4e0 msgr2=0x5556e06ea6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:20.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 shutdown_connections 2024-08-19T00:47:20.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.056+0000 7f59ac60bf40 1 -- 172.21.15.7:0/2039167156 wait complete. 2024-08-19T00:47:20.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:47:20.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.220+0000 7f89d9600640 1 Processor -- start 2024-08-19T00:47:20.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.221+0000 7f89d9600640 1 -- start start 2024-08-19T00:47:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89d9600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89d415bfb0 0x7f89d40b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89d9600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d40acef0 con 0x7f89d40b5130 2024-08-19T00:47:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89d9600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d40ad1d0 con 0x7f89d415c390 2024-08-19T00:47:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89d9600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f89d40ad790 con 0x7f89d415bfb0 2024-08-19T00:47:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89ca000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f89d40b5130 0x7f89d40aebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39246/0 (socket says 172.21.15.7:39246) 2024-08-19T00:47:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89ca000640 1 -- 172.21.15.7:0/310065303 learned_addr learned my addr 172.21.15.7:0/310065303 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89d2a00640 1 --2- 172.21.15.7:0/310065303 >> v2:172.21.15.162:3300/0 conn(0x7f89d415bfb0 0x7f89d40b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.222+0000 7f89d2000640 1 -- 172.21.15.7:0/310065303 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559732250 0 0) 0x7f89d40acef0 con 0x7f89d40b5130 2024-08-19T00:47:20.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.223+0000 7f89d2000640 1 -- 172.21.15.7:0/310065303 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b8003520 con 0x7f89d40b5130 2024-08-19T00:47:20.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.223+0000 7f89d2000640 1 -- 172.21.15.7:0/310065303 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835546804 0 0) 0x7f89d40ad1d0 con 0x7f89d415c390 2024-08-19T00:47:20.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.223+0000 7f89d2000640 1 -- 172.21.15.7:0/310065303 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d40acef0 con 0x7f89d415c390 2024-08-19T00:47:20.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.223+0000 7f89d2a00640 1 -- 172.21.15.7:0/310065303 >> v1:172.21.15.162:6789/0 conn(0x7f89d415c390 legacy=0x7f89d4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.223+0000 7f89d2a00640 1 -- 172.21.15.7:0/310065303 >> v1:172.21.15.7:6789/0 conn(0x7f89d40b5130 legacy=0x7f89d40aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.223+0000 7f89d2a00640 1 -- 172.21.15.7:0/310065303 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40ad4b0 con 0x7f89d415bfb0 2024-08-19T00:47:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.224+0000 7f89d2a00640 1 --2- 172.21.15.7:0/310065303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415bfb0 0x7f89d40b3e00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f89c40097a0 tx=0x7f89c402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1403ca45b9d1c2e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.224+0000 7f89d2000640 1 -- 172.21.15.7:0/310065303 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4037070 con 0x7f89d415bfb0 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.224+0000 7f89d2000640 1 -- 172.21.15.7:0/310065303 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c4032440 con 0x7f89d415bfb0 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.224+0000 7f89d2000640 1 -- 172.21.15.7:0/310065303 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4032810 con 0x7f89d415bfb0 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.225+0000 7f89d9600640 1 -- 172.21.15.7:0/310065303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415bfb0 msgr2=0x7f89d40b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.225+0000 7f89d9600640 1 --2- 172.21.15.7:0/310065303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415bfb0 0x7f89d40b3e00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f89c40097a0 tx=0x7f89c402a230 comp rx=0 tx=0).stop 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.225+0000 7f89d9600640 1 -- 172.21.15.7:0/310065303 shutdown_connections 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.225+0000 7f89d9600640 1 --2- 172.21.15.7:0/310065303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415bfb0 0x7f89d40b3e00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.225+0000 7f89d9600640 1 -- 172.21.15.7:0/310065303 >> 172.21.15.7:0/310065303 conn(0x7f89d40b2300 msgr2=0x7f89d406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.225+0000 7f89d9600640 1 -- 172.21.15.7:0/310065303 shutdown_connections 2024-08-19T00:47:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.225+0000 7f89d9600640 1 -- 172.21.15.7:0/310065303 wait complete. 2024-08-19T00:47:20.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.226+0000 7f89d9600640 1 Processor -- start 2024-08-19T00:47:20.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.227+0000 7f89d9600640 1 -- start start 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89d40b5130 0x7f89d4152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d9600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89d415bfb0 0x7f89d40cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415c390 0x7f89d40ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d9600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40b44c0 con 0x7f89d40b5130 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d9600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40b4340 con 0x7f89d415c390 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d9600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40af2e0 con 0x7f89d415bfb0 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89d40b5130 0x7f89d4152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89d40b5130 0x7f89d4152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46934/0 (socket says 172.21.15.7:46934) 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 -- 172.21.15.7:0/3476265753 learned_addr learned my addr 172.21.15.7:0/3476265753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d3400640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415c390 0x7f89d40ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89ca000640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89d415bfb0 0x7f89d40cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 -- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89d415bfb0 msgr2=0x7f89d40cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89d415bfb0 0x7f89d40cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 -- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415c390 msgr2=0x7f89d40ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415c390 0x7f89d40ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.228+0000 7f89d2a00640 1 -- 172.21.15.7:0/3476265753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40cab00 con 0x7f89d40b5130 2024-08-19T00:47:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.229+0000 7f89d2a00640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89d40b5130 0x7f89d4152920 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f89c40098c0 tx=0x7f89c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.229+0000 7f89cb400640 1 -- 172.21.15.7:0/3476265753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4041030 con 0x7f89d40b5130 2024-08-19T00:47:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.229+0000 7f89cb400640 1 -- 172.21.15.7:0/3476265753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c403d4e0 con 0x7f89d40b5130 2024-08-19T00:47:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.229+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d4152e60 con 0x7f89d40b5130 2024-08-19T00:47:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.229+0000 7f89cb400640 1 -- 172.21.15.7:0/3476265753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4037040 con 0x7f89d40b5130 2024-08-19T00:47:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.229+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d40cd9b0 con 0x7f89d40b5130 2024-08-19T00:47:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.230+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d406c450 con 0x7f89d40b5130 2024-08-19T00:47:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.231+0000 7f89cb400640 1 -- 172.21.15.7:0/3476265753 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89c4044070 con 0x7f89d40b5130 2024-08-19T00:47:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.232+0000 7f89cb400640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89b006be30 0x7f89b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.232+0000 7f89cb400640 1 -- 172.21.15.7:0/3476265753 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7f89c40ac0d0 con 0x7f89d40b5130 2024-08-19T00:47:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.233+0000 7f89ca000640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89b006be30 0x7f89b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.233+0000 7f89ca000640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89b006be30 0x7f89b006e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f89d41f7b70 tx=0x7f89bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.237+0000 7f89cb400640 1 -- 172.21.15.7:0/3476265753 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f89d406c450 con 0x7f89d40b5130 2024-08-19T00:47:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.462+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f89d4068c10 con 0x7f89d40b5130 2024-08-19T00:47:20.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.657+0000 7f89cb400640 1 -- 172.21.15.7:0/3476265753 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v288) ==== 162+0+0 (secure 0 0 0) 0x7f89d4068c10 con 0x7f89d40b5130 2024-08-19T00:47:20.659 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89b006be30 msgr2=0x7f89b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89b006be30 0x7f89b006e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f89d41f7b70 tx=0x7f89bc009040 comp rx=0 tx=0).stop 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89d40b5130 msgr2=0x7f89d4152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89d40b5130 0x7f89d4152920 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f89c40098c0 tx=0x7f89c40046c0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 shutdown_connections 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89b006be30 0x7f89b006e2f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89d415c390 0x7f89d40ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89d415bfb0 0x7f89d40cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 --2- 172.21.15.7:0/3476265753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89d40b5130 0x7f89d4152920 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 >> 172.21.15.7:0/3476265753 conn(0x7f89d40b2300 msgr2=0x7f89d406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:20.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 shutdown_connections 2024-08-19T00:47:20.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:20.660+0000 7f89d9600640 1 -- 172.21.15.7:0/3476265753 wait complete. 2024-08-19T00:47:21.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.242+0000 7fb183e00640 1 Processor -- start 2024-08-19T00:47:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.242+0000 7fb183e00640 1 -- start start 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb184073c30 0x7fb1840b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb18415e430 0x7fb184073070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1840b5270 con 0x7fb18415e050 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb1840ad980 con 0x7fb18415e430 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1840b1dd0 con 0x7fb184073c30 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb18415e430 0x7fb184073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb18415e430 0x7fb184073070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46938/0 (socket says 172.21.15.7:46938) 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb183400640 1 -- 172.21.15.7:0/3086406010 learned_addr learned my addr 172.21.15.7:0/3086406010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.243+0000 7fb17be00640 1 --2- 172.21.15.7:0/3086406010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb184073c30 0x7fb1840b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.244+0000 7fb183400640 1 -- 172.21.15.7:0/3086406010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb184073c30 msgr2=0x7fb1840b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.244+0000 7fb183400640 1 --2- 172.21.15.7:0/3086406010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb184073c30 0x7fb1840b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.244+0000 7fb183400640 1 -- 172.21.15.7:0/3086406010 >> v1:172.21.15.162:6789/0 conn(0x7fb18415e050 legacy=0x7fb1840ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.244+0000 7fb183400640 1 -- 172.21.15.7:0/3086406010 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1840b5550 con 0x7fb18415e430 2024-08-19T00:47:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.245+0000 7fb183400640 1 --2- 172.21.15.7:0/3086406010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb18415e430 0x7fb184073070 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009e50 tx=0x7fb17c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0a58bd8467a4e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.245+0000 7fb182000640 1 -- 172.21.15.7:0/3086406010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c036070 con 0x7fb18415e430 2024-08-19T00:47:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.245+0000 7fb182000640 1 -- 172.21.15.7:0/3086406010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c031600 con 0x7fb18415e430 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.245+0000 7fb182000640 1 -- 172.21.15.7:0/3086406010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0319d0 con 0x7fb18415e430 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.245+0000 7fb183e00640 1 -- 172.21.15.7:0/3086406010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb18415e430 msgr2=0x7fb184073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.245+0000 7fb183e00640 1 --2- 172.21.15.7:0/3086406010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb18415e430 0x7fb184073070 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009e50 tx=0x7fb17c02a710 comp rx=0 tx=0).stop 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.246+0000 7fb183e00640 1 -- 172.21.15.7:0/3086406010 shutdown_connections 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.246+0000 7fb183e00640 1 --2- 172.21.15.7:0/3086406010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb18415e430 0x7fb184073070 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.246+0000 7fb183e00640 1 --2- 172.21.15.7:0/3086406010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb184073c30 0x7fb1840b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.246+0000 7fb183e00640 1 -- 172.21.15.7:0/3086406010 >> 172.21.15.7:0/3086406010 conn(0x7fb1840b57b0 msgr2=0x7fb1840b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.246+0000 7fb183e00640 1 -- 172.21.15.7:0/3086406010 shutdown_connections 2024-08-19T00:47:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.246+0000 7fb183e00640 1 -- 172.21.15.7:0/3086406010 wait complete. 2024-08-19T00:47:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.247+0000 7fb183e00640 1 Processor -- start 2024-08-19T00:47:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.247+0000 7fb183e00640 1 -- start start 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.248+0000 7fb183e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb184073c30 0x7fb18415f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.248+0000 7fb183e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb18415e050 0x7fb18415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.248+0000 7fb183e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb18415e430 0x7fb1841502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.248+0000 7fb183e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1840b38f0 con 0x7fb184073c30 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.248+0000 7fb183e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1840b3390 con 0x7fb18415e050 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.248+0000 7fb183e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1840b4f20 con 0x7fb18415e430 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.248+0000 7fb182a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb184073c30 0x7fb18415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb184073c30 0x7fb18415f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46940/0 (socket says 172.21.15.7:46940) 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 -- 172.21.15.7:0/2361214752 learned_addr learned my addr 172.21.15.7:0/2361214752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb183400640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb18415e430 0x7fb1841502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb17be00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb18415e050 0x7fb18415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 -- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb18415e430 msgr2=0x7fb1841502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb18415e430 0x7fb1841502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 -- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb18415e050 msgr2=0x7fb18415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb18415e050 0x7fb18415f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 -- 172.21.15.7:0/2361214752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb184159920 con 0x7fb184073c30 2024-08-19T00:47:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.249+0000 7fb182a00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb184073c30 0x7fb18415f480 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c450 tx=0x7fb17400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:21.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.250+0000 7fb17aa00640 1 -- 172.21.15.7:0/2361214752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1740052d0 con 0x7fb184073c30 2024-08-19T00:47:21.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.250+0000 7fb17aa00640 1 -- 172.21.15.7:0/2361214752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb174005470 con 0x7fb184073c30 2024-08-19T00:47:21.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.250+0000 7fb17aa00640 1 -- 172.21.15.7:0/2361214752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174012870 con 0x7fb184073c30 2024-08-19T00:47:21.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.250+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb184155970 con 0x7fb184073c30 2024-08-19T00:47:21.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.250+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb184155660 con 0x7fb184073c30 2024-08-19T00:47:21.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.251+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1840b1890 con 0x7fb184073c30 2024-08-19T00:47:21.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.252+0000 7fb17aa00640 1 -- 172.21.15.7:0/2361214752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb174012a10 con 0x7fb184073c30 2024-08-19T00:47:21.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.253+0000 7fb17aa00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb16006be30 0x7fb16006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:21.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.253+0000 7fb17aa00640 1 -- 172.21.15.7:0/2361214752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fb17408b4b0 con 0x7fb184073c30 2024-08-19T00:47:21.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.253+0000 7fb17be00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb16006be30 0x7fb16006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:21.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.253+0000 7fb17be00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb16006be30 0x7fb16006e2f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb18409e7d0 tx=0x7fb16c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:21.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.257+0000 7fb17aa00640 1 -- 172.21.15.7:0/2361214752 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb174058cd0 con 0x7fb184073c30 2024-08-19T00:47:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.478+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1840aff90 con 0x7fb184073c30 2024-08-19T00:47:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.479+0000 7fb17aa00640 1 -- 172.21.15.7:0/2361214752 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 289 v289) ==== 95+0+5222 (secure 0 0 0) 0x7fb17405cfd0 con 0x7fb184073c30 2024-08-19T00:47:21.481 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:21.481 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":289,"btime":"2024-08-19T00:47:20:660745+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":289,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:20.660735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9747":{"gid":9747,"name":"a","rank":0,"incarnation":289,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/767746356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":767746356},{"type":"v1","addr":"172.21.15.7:6837","nonce":767746356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:21.481 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 289 2024-08-19T00:47:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb16006be30 msgr2=0x7fb16006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb16006be30 0x7fb16006e2f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb18409e7d0 tx=0x7fb16c009190 comp rx=0 tx=0).stop 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb184073c30 msgr2=0x7fb18415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb184073c30 0x7fb18415f480 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c450 tx=0x7fb17400c910 comp rx=0 tx=0).stop 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 shutdown_connections 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb16006be30 0x7fb16006e2f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb18415e430 0x7fb1841502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb18415e050 0x7fb18415f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 --2- 172.21.15.7:0/2361214752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb184073c30 0x7fb18415f480 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:21.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 >> 172.21.15.7:0/2361214752 conn(0x7fb1840b57b0 msgr2=0x7fb1840ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:21.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 shutdown_connections 2024-08-19T00:47:21.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:21.481+0000 7fb183e00640 1 -- 172.21.15.7:0/2361214752 wait complete. 2024-08-19T00:47:21.498 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 289, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:47:20.660735+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9747}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9747': {'gid': 9747, 'name': 'a', 'rank': 0, 'incarnation': 289, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/767746356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 767746356}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 767746356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:47:21.499 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9747:up:replay 2024-08-19T00:47:21.499 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:47:26.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.070+0000 7fea02a00640 1 Processor -- start 2024-08-19T00:47:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.071+0000 7fea02a00640 1 -- start start 2024-08-19T00:47:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fea02a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9fc159bf0 0x7fe9fc073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fea02a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe9fc0739a0 0x7fe9fc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fea02a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc06f7f0 con 0x7fe9fc0cea40 2024-08-19T00:47:27.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fea02a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0cee80 con 0x7fe9fc159bf0 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fea02a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc06f510 con 0x7fe9fc0739a0 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9fbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9fc159bf0 0x7fe9fc073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9fbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9fc159bf0 0x7fe9fc073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54322/0 (socket says 172.21.15.7:54322) 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9fbe00640 1 -- 172.21.15.7:0/100797845 learned_addr learned my addr 172.21.15.7:0/100797845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9fbe00640 1 -- 172.21.15.7:0/100797845 >> v2:172.21.15.162:3300/0 conn(0x7fe9fc0739a0 msgr2=0x7fe9fc0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9f3400640 1 --2- 172.21.15.7:0/100797845 >> v2:172.21.15.162:3300/0 conn(0x7fe9fc0739a0 0x7fe9fc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9fbe00640 1 --2- 172.21.15.7:0/100797845 >> v2:172.21.15.162:3300/0 conn(0x7fe9fc0739a0 0x7fe9fc0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9fbe00640 1 -- 172.21.15.7:0/100797845 >> v1:172.21.15.162:6789/0 conn(0x7fe9fc0cea40 legacy=0x7fe9fc0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9fbe00640 1 -- 172.21.15.7:0/100797845 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc072980 con 0x7fe9fc159bf0 2024-08-19T00:47:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.072+0000 7fe9f3400640 1 --2- 172.21.15.7:0/100797845 >> v2:172.21.15.162:3300/0 conn(0x7fe9fc0739a0 0x7fe9fc0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.073+0000 7fe9fbe00640 1 --2- 172.21.15.7:0/100797845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc159bf0 0x7fe9fc073460 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0b1cc0 tx=0x7fe9ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c047c1964f8e28 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fe9fb400640 1 -- 172.21.15.7:0/100797845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec037070 con 0x7fe9fc159bf0 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fe9fb400640 1 -- 172.21.15.7:0/100797845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec032440 con 0x7fe9fc159bf0 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fe9fb400640 1 -- 172.21.15.7:0/100797845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec032810 con 0x7fe9fc159bf0 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 -- 172.21.15.7:0/100797845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc159bf0 msgr2=0x7fe9fc073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 --2- 172.21.15.7:0/100797845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc159bf0 0x7fe9fc073460 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0b1cc0 tx=0x7fe9ec02a1a0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 -- 172.21.15.7:0/100797845 shutdown_connections 2024-08-19T00:47:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 --2- 172.21.15.7:0/100797845 >> v2:172.21.15.162:3300/0 conn(0x7fe9fc0739a0 0x7fe9fc0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 --2- 172.21.15.7:0/100797845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc159bf0 0x7fe9fc073460 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 -- 172.21.15.7:0/100797845 >> 172.21.15.7:0/100797845 conn(0x7fe9fc06bc70 msgr2=0x7fe9fc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 -- 172.21.15.7:0/100797845 shutdown_connections 2024-08-19T00:47:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.074+0000 7fea02a00640 1 -- 172.21.15.7:0/100797845 wait complete. 2024-08-19T00:47:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.076+0000 7fea02a00640 1 Processor -- start 2024-08-19T00:47:27.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.076+0000 7fea02a00640 1 -- start start 2024-08-19T00:47:27.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fea02a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9fc0739a0 0x7fe9fc1f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fea02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc0cea40 0x7fe9fc1f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fea02a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9fc159bf0 0x7fe9fc147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fea02a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc159fd0 con 0x7fe9fc0cea40 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fea02a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc072f40 con 0x7fe9fc0739a0 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fea02a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc15a150 con 0x7fe9fc159bf0 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc0cea40 0x7fe9fc1f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc0cea40 0x7fe9fc1f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54338/0 (socket says 172.21.15.7:54338) 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fe9f3400640 1 -- 172.21.15.7:0/1318894452 learned_addr learned my addr 172.21.15.7:0/1318894452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.077+0000 7fe9fbe00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9fc0739a0 0x7fe9fc1f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fea00a00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9fc159bf0 0x7fe9fc147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f3400640 1 -- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9fc159bf0 msgr2=0x7fe9fc147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f3400640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9fc159bf0 0x7fe9fc147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f3400640 1 -- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9fc0739a0 msgr2=0x7fe9fc1f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f3400640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9fc0739a0 0x7fe9fc1f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f3400640 1 -- 172.21.15.7:0/1318894452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc155530 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9fbe00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9fc0739a0 0x7fe9fc1f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f3400640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc0cea40 0x7fe9fc1f5de0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c7f0 tx=0x7fe9e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f8c00640 1 -- 172.21.15.7:0/1318894452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4015070 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f8c00640 1 -- 172.21.15.7:0/1318894452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e4007820 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fe9f8c00640 1 -- 172.21.15.7:0/1318894452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4007bd0 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc142440 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.078+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc142a00 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.079+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9fc0ce500 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.080+0000 7fe9f8c00640 1 -- 172.21.15.7:0/1318894452 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9e4018070 con 0x7fe9fc0cea40 2024-08-19T00:47:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.082+0000 7fe9f8c00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9d806be30 0x7fe9d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.082+0000 7fe9f8c00640 1 -- 172.21.15.7:0/1318894452 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fe9e408bba0 con 0x7fe9fc0cea40 2024-08-19T00:47:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.082+0000 7fe9fbe00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9d806be30 0x7fe9d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.083+0000 7fe9fbe00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9d806be30 0x7fe9d806e2f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec034000 tx=0x7fe9ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.087+0000 7fe9f8c00640 1 -- 172.21.15.7:0/1318894452 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe9e4059980 con 0x7fe9fc0cea40 2024-08-19T00:47:27.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.315+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9fc15c8d0 con 0x7fe9fc0cea40 2024-08-19T00:47:27.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.315+0000 7fe9f8c00640 1 -- 172.21.15.7:0/1318894452 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 292 v292) ==== 95+0+5229 (secure 0 0 0) 0x7fe9e4059280 con 0x7fe9fc0cea40 2024-08-19T00:47:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:27.317 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":292,"btime":"2024-08-19T00:47:23:679853+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":292,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:23.679845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9747":{"gid":9747,"name":"a","rank":0,"incarnation":289,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/767746356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":767746356},{"type":"v1","addr":"172.21.15.7:6837","nonce":767746356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9747,"qdb_cluster":[9747]},"id":6}]} 2024-08-19T00:47:27.318 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 292 2024-08-19T00:47:27.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9d806be30 msgr2=0x7fe9d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9d806be30 0x7fe9d806e2f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec034000 tx=0x7fe9ec02e000 comp rx=0 tx=0).stop 2024-08-19T00:47:27.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc0cea40 msgr2=0x7fe9fc1f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc0cea40 0x7fe9fc1f5de0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c7f0 tx=0x7fe9e400ccb0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 shutdown_connections 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe9d806be30 0x7fe9d806e2f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9fc159bf0 0x7fe9fc147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9fc0cea40 0x7fe9fc1f5de0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.317+0000 7fea02a00640 1 --2- 172.21.15.7:0/1318894452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9fc0739a0 0x7fe9fc1f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.318+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 >> 172.21.15.7:0/1318894452 conn(0x7fe9fc06bc70 msgr2=0x7fe9fc160570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.318+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 shutdown_connections 2024-08-19T00:47:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.318+0000 7fea02a00640 1 -- 172.21.15.7:0/1318894452 wait complete. 2024-08-19T00:47:27.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 292, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:47:23.679845+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9747}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9747': {'gid': 9747, 'name': 'a', 'rank': 0, 'incarnation': 289, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/767746356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 767746356}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 767746356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9747, 'qdb_cluster': [9747]} 2024-08-19T00:47:27.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:47:27.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:47:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.492+0000 7fb30c800640 1 Processor -- start 2024-08-19T00:47:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.492+0000 7fb30c800640 1 -- start start 2024-08-19T00:47:27.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.493+0000 7fb30c800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb30415e300 0x7fb3040ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.493+0000 7fb30c800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb304162b80 con 0x7fb304071db0 2024-08-19T00:47:27.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.493+0000 7fb30c800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3040ada10 con 0x7fb304162680 2024-08-19T00:47:27.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.493+0000 7fb30c800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb304162e60 con 0x7fb30415e300 2024-08-19T00:47:27.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.493+0000 7fb309400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb304071db0 0x7fb304161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46472/0 (socket says 172.21.15.7:46472) 2024-08-19T00:47:27.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.493+0000 7fb309400640 1 -- 172.21.15.7:0/1843411171 learned_addr learned my addr 172.21.15.7:0/1843411171 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:27.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.494+0000 7fb309e00640 1 --2- 172.21.15.7:0/1843411171 >> v2:172.21.15.162:3300/0 conn(0x7fb30415e300 0x7fb3040ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.494+0000 7fb308a00640 1 -- 172.21.15.7:0/1843411171 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555033951 0 0) 0x7fb304162b80 con 0x7fb304071db0 2024-08-19T00:47:27.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.494+0000 7fb308a00640 1 -- 172.21.15.7:0/1843411171 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2ec003520 con 0x7fb304071db0 2024-08-19T00:47:27.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.494+0000 7fb309e00640 1 -- 172.21.15.7:0/1843411171 >> v1:172.21.15.162:6789/0 conn(0x7fb304162680 legacy=0x7fb3040b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.494+0000 7fb309e00640 1 -- 172.21.15.7:0/1843411171 >> v1:172.21.15.7:6789/0 conn(0x7fb304071db0 legacy=0x7fb304161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.494+0000 7fb309e00640 1 -- 172.21.15.7:0/1843411171 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3040adcf0 con 0x7fb30415e300 2024-08-19T00:47:27.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.495+0000 7fb309e00640 1 --2- 172.21.15.7:0/1843411171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 0x7fb3040ae4f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80097a0 tx=0x7fb2f802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29fe2372af9a84f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.495+0000 7fb308a00640 1 -- 172.21.15.7:0/1843411171 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8037070 con 0x7fb30415e300 2024-08-19T00:47:27.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.495+0000 7fb308a00640 1 -- 172.21.15.7:0/1843411171 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f8032440 con 0x7fb30415e300 2024-08-19T00:47:27.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.495+0000 7fb308a00640 1 -- 172.21.15.7:0/1843411171 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8032810 con 0x7fb30415e300 2024-08-19T00:47:27.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.496+0000 7fb30c800640 1 -- 172.21.15.7:0/1843411171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 msgr2=0x7fb3040ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.496+0000 7fb30c800640 1 --2- 172.21.15.7:0/1843411171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 0x7fb3040ae4f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80097a0 tx=0x7fb2f802a1a0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.496+0000 7fb30c800640 1 -- 172.21.15.7:0/1843411171 shutdown_connections 2024-08-19T00:47:27.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.496+0000 7fb30c800640 1 --2- 172.21.15.7:0/1843411171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 0x7fb3040ae4f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.496+0000 7fb30c800640 1 -- 172.21.15.7:0/1843411171 >> 172.21.15.7:0/1843411171 conn(0x7fb304070060 msgr2=0x7fb30406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.496+0000 7fb30c800640 1 -- 172.21.15.7:0/1843411171 shutdown_connections 2024-08-19T00:47:27.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.496+0000 7fb30c800640 1 -- 172.21.15.7:0/1843411171 wait complete. 2024-08-19T00:47:27.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.498+0000 7fb30c800640 1 Processor -- start 2024-08-19T00:47:27.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.498+0000 7fb30c800640 1 -- start start 2024-08-19T00:47:27.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb304071db0 0x7fb30415f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 0x7fb3040afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30c800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb304162680 0x7fb3040aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30c800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3040af880 con 0x7fb304162680 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3040ae060 con 0x7fb30415e300 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb3040721f0 con 0x7fb304071db0 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb304162680 0x7fb3040aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb304162680 0x7fb3040aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54346/0 (socket says 172.21.15.7:54346) 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 -- 172.21.15.7:0/2626166308 learned_addr learned my addr 172.21.15.7:0/2626166308 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb309400640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 0x7fb3040afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb309e00640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb304071db0 0x7fb30415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 -- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb304071db0 msgr2=0x7fb30415f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb304071db0 0x7fb30415f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 -- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 msgr2=0x7fb3040afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 0x7fb3040afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.499+0000 7fb30a800640 1 -- 172.21.15.7:0/2626166308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3041612e0 con 0x7fb304162680 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.500+0000 7fb30a800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb304162680 0x7fb3040aff40 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fb30000c680 tx=0x7fb30000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.500+0000 7fb2fe000640 1 -- 172.21.15.7:0/2626166308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300003b70 con 0x7fb304162680 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.500+0000 7fb2fe000640 1 -- 172.21.15.7:0/2626166308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb300003d10 con 0x7fb304162680 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.500+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3041615c0 con 0x7fb304162680 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.500+0000 7fb2fe000640 1 -- 172.21.15.7:0/2626166308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300005310 con 0x7fb304162680 2024-08-19T00:47:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.500+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3040b44f0 con 0x7fb304162680 2024-08-19T00:47:27.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.502+0000 7fb2fe000640 1 -- 172.21.15.7:0/2626166308 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3000054b0 con 0x7fb304162680 2024-08-19T00:47:27.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.503+0000 7fb2fe000640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb2e806be30 0x7fb2e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.503+0000 7fb2fe000640 1 -- 172.21.15.7:0/2626166308 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fb30008b8b0 con 0x7fb304162680 2024-08-19T00:47:27.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.503+0000 7fb309e00640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb2e806be30 0x7fb2e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.504+0000 7fb30f6db740 1 Processor -- start 2024-08-19T00:47:27.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.504+0000 7fb30f6db740 1 -- start start 2024-08-19T00:47:27.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.504+0000 7fb309e00640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb2e806be30 0x7fb2e806e2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8034000 tx=0x7fb2f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x559968485330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x5599684a8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996849ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30f6db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599683bdba0 con 0x559968484f50 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559968356230 con 0x5599684a8dd0 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5599683b9b60 con 0x5599684a8470 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x559968485330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x559968485330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54358/0 (socket says 172.21.15.7:54358) 2024-08-19T00:47:27.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 -- 172.21.15.7:0/115046278 learned_addr learned my addr 172.21.15.7:0/115046278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30a800640 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996849ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309400640 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x5599684a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 -- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 msgr2=0x5599684a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x5599684a8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 -- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 msgr2=0x55996849ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996849ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309e00640 1 -- 172.21.15.7:0/115046278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559968387bb0 con 0x559968484f50 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb30a800640 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996849ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:27.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.505+0000 7fb309400640 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x5599684a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:27.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.506+0000 7fb309e00640 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x559968485330 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009890 tx=0x7fb2f802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79399fda0776879b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.506+0000 7fb2f2600640 1 -- 172.21.15.7:0/115046278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8037040 con 0x559968484f50 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.506+0000 7fb2f2600640 1 -- 172.21.15.7:0/115046278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f8032dd0 con 0x559968484f50 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.506+0000 7fb2f2600640 1 -- 172.21.15.7:0/115046278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f803e660 con 0x559968484f50 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 -- 172.21.15.7:0/115046278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 msgr2=0x559968485330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x559968485330 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009890 tx=0x7fb2f802c000 comp rx=0 tx=0).stop 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 -- 172.21.15.7:0/115046278 shutdown_connections 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996849ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x5599684a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 --2- 172.21.15.7:0/115046278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x559968485330 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 -- 172.21.15.7:0/115046278 >> 172.21.15.7:0/115046278 conn(0x559968422110 msgr2=0x55996849fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 -- 172.21.15.7:0/115046278 shutdown_connections 2024-08-19T00:47:27.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.507+0000 7fb30f6db740 1 -- 172.21.15.7:0/115046278 wait complete. 2024-08-19T00:47:27.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.508+0000 7fb30f6db740 1 -- start start 2024-08-19T00:47:27.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.508+0000 7fb30f6db740 1 Processor -- start 2024-08-19T00:47:27.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599684598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996845ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996846e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30f6db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599684a1ea0 con 0x559968484f50 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559968379250 con 0x5599684a8dd0 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5599684a15b0 con 0x5599684a8470 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30f6db740 10 client.0 _ll_register_callbacks cb 0x55996837d740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb309e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599684598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb309e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599684598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54370/0 (socket says 172.21.15.7:54370) 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb309e00640 1 -- 172.21.15.7:0/87566300 learned_addr learned my addr 172.21.15.7:0/87566300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb309400640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996845ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.509+0000 7fb30a800640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996846e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb309e00640 1 -- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 msgr2=0x55996845ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb309e00640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996845ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb309e00640 1 -- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 msgr2=0x55996846e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb309e00640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996846e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb309e00640 1 -- 172.21.15.7:0/87566300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599680d12d0 con 0x559968484f50 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb30a800640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996846e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb309e00640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599684598d0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb2f804a040 tx=0x7fb2f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedcc21ba32847a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb2e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb2e6a00640 1 -- 172.21.15.7:0/87566300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8057060 con 0x559968484f50 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2f8032dd0 con 0x559968484f50 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.510+0000 7fb2e6a00640 1 -- 172.21.15.7:0/87566300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fb2f8045040 con 0x559968484f50 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb2e6a00640 1 -- 172.21.15.7:0/87566300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=292) ==== 24+0+0 (secure 0 0 0) 0x7fb2f8037070 con 0x559968484f50 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 10 client.9804 fetch_fsmap learned FSMap version 292 2024-08-19T00:47:27.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=292,monmap=2+}) -- 0x55996819b6b0 con 0x559968484f50 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb2e6a00640 1 -- 172.21.15.7:0/87566300 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f8032dd0 con 0x559968484f50 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb2e6a00640 1 -- 172.21.15.7:0/87566300 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 292) ==== 3502+0+0 (secure 0 0 0) 0x7fb2f80488e0 con 0x559968484f50 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 10 client.9804 fetch_fsmap finished waiting for FSMap version 292 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 10 client.9804 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 20 client.9804 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x55996849ad30 0x55996849b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 4 client.9804 mds_command: new command op to 9747 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 --> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599683cb2d0 con 0x55996849ad30 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.511+0000 7fb309400640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x55996849ad30 0x55996849b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.512+0000 7fb309400640 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x55996849ad30 0x55996849b110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17543ba558df47ec server_cookie=d24abbb387aa8495 in_seq=0 out_seq=0 2024-08-19T00:47:27.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.512+0000 7fb2e6a00640 10 client.9804 ms_handle_connect on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:27.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb2e6a00640 1 -- 172.21.15.7:0/87566300 <== mds.0 v2:172.21.15.7:6835/767746356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599683cb2d0 con 0x55996849ad30 2024-08-19T00:47:27.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb2e6a00640 10 client.9804 handle_command_reply: tid=0 2024-08-19T00:47:27.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 client.9804 shutdown 2024-08-19T00:47:27.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 msgr2=0x5599684598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599684598d0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb2f804a040 tx=0x7fb2f8004730 comp rx=0 tx=0).stop 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 shutdown_connections 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x55996846e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996845ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x55996849ad30 0x55996849b110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 --2- 172.21.15.7:0/87566300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599684598d0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 >> 172.21.15.7:0/87566300 conn(0x559968422110 msgr2=0x5599684a2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb2e6a00640 0 client.9804 ms_handle_reset on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 shutdown_connections 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 1 -- 172.21.15.7:0/87566300 wait complete. 2024-08-19T00:47:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.513+0000 7fb30f6db740 20 client.9804 trim_cache size 0 max 16384 2024-08-19T00:47:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.532+0000 7fb30f6db740 1 Processor -- start 2024-08-19T00:47:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.532+0000 7fb30f6db740 1 -- start start 2024-08-19T00:47:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559968484f50 0x55996849ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996849b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599684a8dd0 0x55996849b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30f6db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb304201470 con 0x5599684a8dd0 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb304200800 con 0x559968484f50 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb304200e50 con 0x5599684a8470 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599684a8dd0 0x55996849b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599684a8dd0 0x55996849b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54378/0 (socket says 172.21.15.7:54378) 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.533+0000 7fb30a800640 1 -- 172.21.15.7:0/1174459519 learned_addr learned my addr 172.21.15.7:0/1174459519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb309e00640 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559968484f50 0x55996849ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb309400640 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996849b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb30a800640 1 -- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 msgr2=0x55996849b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb30a800640 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996849b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb30a800640 1 -- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559968484f50 msgr2=0x55996849ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb30a800640 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559968484f50 0x55996849ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb30a800640 1 -- 172.21.15.7:0/1174459519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599684a3e90 con 0x5599684a8dd0 2024-08-19T00:47:27.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb309e00640 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559968484f50 0x55996849ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:27.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb30a800640 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599684a8dd0 0x55996849b650 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fb30000a430 tx=0x7fb300001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896764c720774f02 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb2f1c00640 1 -- 172.21.15.7:0/1174459519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300087070 con 0x5599684a8dd0 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb2f1c00640 1 -- 172.21.15.7:0/1174459519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb300057030 con 0x5599684a8dd0 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.534+0000 7fb2f1c00640 1 -- 172.21.15.7:0/1174459519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300055600 con 0x5599684a8dd0 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 -- 172.21.15.7:0/1174459519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599684a8dd0 msgr2=0x55996849b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599684a8dd0 0x55996849b650 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fb30000a430 tx=0x7fb300001400 comp rx=0 tx=0).stop 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 -- 172.21.15.7:0/1174459519 shutdown_connections 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599684a8dd0 0x55996849b650 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996849b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 --2- 172.21.15.7:0/1174459519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559968484f50 0x55996849ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 -- 172.21.15.7:0/1174459519 >> 172.21.15.7:0/1174459519 conn(0x559968422110 msgr2=0x55996849bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 -- 172.21.15.7:0/1174459519 shutdown_connections 2024-08-19T00:47:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.535+0000 7fb30f6db740 1 -- 172.21.15.7:0/1174459519 wait complete. 2024-08-19T00:47:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.536+0000 7fb30f6db740 1 -- start start 2024-08-19T00:47:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.536+0000 7fb30f6db740 1 Processor -- start 2024-08-19T00:47:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599685212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996846d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb30f6db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x559968496120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb30f6db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55996849cbb0 con 0x559968484f50 2024-08-19T00:47:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55996849be70 con 0x5599684a8dd0 2024-08-19T00:47:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb30f6db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5599684b30c0 con 0x5599684a8470 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb30f6db740 10 client.0 _ll_register_callbacks cb 0x7fb2ec0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb309e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599685212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb309e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599685212a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54392/0 (socket says 172.21.15.7:54392) 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.537+0000 7fb309e00640 1 -- 172.21.15.7:0/3657090626 learned_addr learned my addr 172.21.15.7:0/3657090626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb309e00640 1 -- 172.21.15.7:0/3657090626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 msgr2=0x55996846d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb309e00640 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996846d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb309e00640 1 -- 172.21.15.7:0/3657090626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 msgr2=0x559968496120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb309e00640 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x559968496120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb309e00640 1 -- 172.21.15.7:0/3657090626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55996846de00 con 0x559968484f50 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb309e00640 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599685212a0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006f00 tx=0x7fb2f8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99cb9f1da786821 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb2e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb2e6a00640 1 -- 172.21.15.7:0/3657090626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8057030 con 0x559968484f50 2024-08-19T00:47:27.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb2e6a00640 1 -- 172.21.15.7:0/3657090626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fb2f805b690 con 0x559968484f50 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb300057030 con 0x559968484f50 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb2e6a00640 1 -- 172.21.15.7:0/3657090626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=292) ==== 24+0+0 (secure 0 0 0) 0x7fb2f805b890 con 0x559968484f50 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb30f6db740 10 client.9810 fetch_fsmap learned FSMap version 292 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.538+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=292,monmap=2+}) -- 0x5599684ff730 con 0x559968484f50 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb2e6a00640 1 -- 172.21.15.7:0/3657090626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb300057030 con 0x559968484f50 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb2e6a00640 1 -- 172.21.15.7:0/3657090626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 292) ==== 3502+0+0 (secure 0 0 0) 0x7fb2f805ba30 con 0x559968484f50 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb30f6db740 10 client.9810 fetch_fsmap finished waiting for FSMap version 292 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb30f6db740 10 client.9810 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb30f6db740 20 client.9810 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb30f6db740 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x5599684a3300 0x5599684c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb30f6db740 4 client.9810 mds_command: new command op to 9747 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 --> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] -- command(tid 0: {"prefix": "status"}) -- 0x5599683c5620 con 0x5599684a3300 2024-08-19T00:47:27.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.539+0000 7fb309400640 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x5599684a3300 0x5599684c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb309400640 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x5599684a3300 0x5599684c2a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c4be5fe44a7dae server_cookie=d67e18fd87405e48 in_seq=0 out_seq=0 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb2e6a00640 10 client.9810 ms_handle_connect on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb2e6a00640 1 -- 172.21.15.7:0/3657090626 <== mds.0 v2:172.21.15.7:6835/767746356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5599683c5620 con 0x5599684a3300 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb2e6a00640 10 client.9810 handle_command_reply: tid=0 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 client.9810 shutdown 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 msgr2=0x5599685212a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599685212a0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006f00 tx=0x7fb2f8008030 comp rx=0 tx=0).stop 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 shutdown_connections 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599684a8dd0 0x559968496120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5599684a8470 0x55996846d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x5599684a3300 0x5599684c2a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 --2- 172.21.15.7:0/3657090626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559968484f50 0x5599685212a0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 >> 172.21.15.7:0/3657090626 conn(0x559968422110 msgr2=0x559968450e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb2e6a00640 0 client.9810 ms_handle_reset on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 shutdown_connections 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 1 -- 172.21.15.7:0/3657090626 wait complete. 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.540+0000 7fb30f6db740 20 client.9810 trim_cache size 0 max 16384 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9747, 2024-08-19T00:47:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8777300590000001, 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 292, 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 119, 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 119, 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 9.1122685899999993 2024-08-19T00:47:27.547 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb2e806be30 msgr2=0x7fb2e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb2e806be30 0x7fb2e806e2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8034000 tx=0x7fb2f802e000 comp rx=0 tx=0).stop 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb304162680 msgr2=0x7fb3040aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb304162680 0x7fb3040aff40 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fb30000c680 tx=0x7fb30000cb40 comp rx=0 tx=0).stop 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 shutdown_connections 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb2e806be30 0x7fb2e806e2f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb304162680 0x7fb3040aff40 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30415e300 0x7fb3040afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 --2- 172.21.15.7:0/2626166308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb304071db0 0x7fb30415f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 >> 172.21.15.7:0/2626166308 conn(0x7fb304070060 msgr2=0x7fb3040cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 shutdown_connections 2024-08-19T00:47:27.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.541+0000 7fb30c800640 1 -- 172.21.15.7:0/2626166308 wait complete. 2024-08-19T00:47:27.558 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:47:27.558 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap key 1.00000000:subdir_head', proceeding to ls 2024-08-19T00:47:27.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:47:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.714+0000 7fdc0b000640 1 Processor -- start 2024-08-19T00:47:27.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.714+0000 7fdc0b000640 1 -- start start 2024-08-19T00:47:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.715+0000 7fdc0b000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdc04159bf0 0x7fdc04073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.715+0000 7fdc0b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc040ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.715+0000 7fdc0b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc040cea40 0x7fdc040d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.715+0000 7fdc0b000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0406f7f0 con 0x7fdc04159bf0 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.715+0000 7fdc0b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0406f510 con 0x7fdc040cea40 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.715+0000 7fdc0b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc04072980 con 0x7fdc040739a0 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.715+0000 7fdc03e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdc04159bf0 0x7fdc04073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc03e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdc04159bf0 0x7fdc04073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54400/0 (socket says 172.21.15.7:54400) 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc03e00640 1 -- 172.21.15.7:0/3859696016 learned_addr learned my addr 172.21.15.7:0/3859696016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdbfbe00640 1 --2- 172.21.15.7:0/3859696016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc040ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc09000640 1 --2- 172.21.15.7:0/3859696016 >> v2:172.21.15.162:3300/0 conn(0x7fdc040cea40 0x7fdc040d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc03e00640 1 -- 172.21.15.7:0/3859696016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 msgr2=0x7fdc040ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc03e00640 1 --2- 172.21.15.7:0/3859696016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc040ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc03e00640 1 -- 172.21.15.7:0/3859696016 >> v2:172.21.15.162:3300/0 conn(0x7fdc040cea40 msgr2=0x7fdc040d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:27.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc03e00640 1 --2- 172.21.15.7:0/3859696016 >> v2:172.21.15.162:3300/0 conn(0x7fdc040cea40 0x7fdc040d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.716+0000 7fdc03e00640 1 -- 172.21.15.7:0/3859696016 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc04072c60 con 0x7fdc04159bf0 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.717+0000 7fdc03e00640 1 --2- 172.21.15.7:0/3859696016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc04073460 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fdc040cdd20 tx=0x7fdbf402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811f7d67704844c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.717+0000 7fdc03400640 1 -- 172.21.15.7:0/3859696016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4037070 con 0x7fdc04159bf0 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.717+0000 7fdc03400640 1 -- 172.21.15.7:0/3859696016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf4032440 con 0x7fdc04159bf0 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.717+0000 7fdc03400640 1 -- 172.21.15.7:0/3859696016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4032810 con 0x7fdc04159bf0 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 -- 172.21.15.7:0/3859696016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 msgr2=0x7fdc04073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3859696016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc04073460 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fdc040cdd20 tx=0x7fdbf402a140 comp rx=0 tx=0).stop 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 -- 172.21.15.7:0/3859696016 shutdown_connections 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3859696016 >> v2:172.21.15.162:3300/0 conn(0x7fdc040cea40 0x7fdc040d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3859696016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc040ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3859696016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc04073460 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 -- 172.21.15.7:0/3859696016 >> 172.21.15.7:0/3859696016 conn(0x7fdc0406bc70 msgr2=0x7fdc0406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 -- 172.21.15.7:0/3859696016 shutdown_connections 2024-08-19T00:47:27.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.718+0000 7fdc0b000640 1 -- 172.21.15.7:0/3859696016 wait complete. 2024-08-19T00:47:27.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.719+0000 7fdc0b000640 1 Processor -- start 2024-08-19T00:47:27.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.720+0000 7fdc0b000640 1 -- start start 2024-08-19T00:47:27.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.720+0000 7fdc0b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc0414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.720+0000 7fdc0b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc040cea40 0x7fdc04150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.720+0000 7fdc0b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc041576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.720+0000 7fdc0b000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0415a150 con 0x7fdc04159bf0 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.720+0000 7fdc0b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04159fd0 con 0x7fdc040cea40 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.720+0000 7fdc0b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc040d0900 con 0x7fdc040739a0 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc041576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc041576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54406/0 (socket says 172.21.15.7:54406) 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 -- 172.21.15.7:0/3125294952 learned_addr learned my addr 172.21.15.7:0/3125294952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdbfbe00640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc040cea40 0x7fdc04150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc03e00640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc0414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 -- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 msgr2=0x7fdc0414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc0414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 -- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc040cea40 msgr2=0x7fdc04150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc040cea40 0x7fdc04150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 -- 172.21.15.7:0/3125294952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc04160c00 con 0x7fdc04159bf0 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc03e00640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc0414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.721+0000 7fdc09000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc041576e0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc007e70 tx=0x7fdbfc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.722+0000 7fdc00c00640 1 -- 172.21.15.7:0/3125294952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc014620 con 0x7fdc04159bf0 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.722+0000 7fdc00c00640 1 -- 172.21.15.7:0/3125294952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc019070 con 0x7fdc04159bf0 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.722+0000 7fdc00c00640 1 -- 172.21.15.7:0/3125294952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc014a20 con 0x7fdc04159bf0 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.722+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc04160640 con 0x7fdc04159bf0 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.722+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc040b3240 con 0x7fdc04159bf0 2024-08-19T00:47:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.723+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc040d03c0 con 0x7fdc04159bf0 2024-08-19T00:47:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.724+0000 7fdc00c00640 1 -- 172.21.15.7:0/3125294952 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbfc014bc0 con 0x7fdc04159bf0 2024-08-19T00:47:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.725+0000 7fdc00c00640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdbe006be30 0x7fdbe006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.725+0000 7fdc00c00640 1 -- 172.21.15.7:0/3125294952 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fdbfc08c180 con 0x7fdc04159bf0 2024-08-19T00:47:27.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.725+0000 7fdc03e00640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdbe006be30 0x7fdbe006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.726+0000 7fdc03e00640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdbe006be30 0x7fdbe006e2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4034000 tx=0x7fdbf402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.729+0000 7fdc00c00640 1 -- 172.21.15.7:0/3125294952 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdbfc059ff0 con 0x7fdc04159bf0 2024-08-19T00:47:27.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.951+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdc04150bc0 con 0x7fdc04159bf0 2024-08-19T00:47:27.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.951+0000 7fdc00c00640 1 -- 172.21.15.7:0/3125294952 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v292) ==== 53+0+73 (secure 0 0 0) 0x7fdbfc0598f0 con 0x7fdc04159bf0 2024-08-19T00:47:27.953 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:47:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdbe006be30 msgr2=0x7fdbe006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdbe006be30 0x7fdbe006e2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4034000 tx=0x7fdbf402e000 comp rx=0 tx=0).stop 2024-08-19T00:47:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 msgr2=0x7fdc041576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc041576e0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc007e70 tx=0x7fdbfc00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 shutdown_connections 2024-08-19T00:47:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdbe006be30 0x7fdbe006e2f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc04159bf0 0x7fdc041576e0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc040cea40 0x7fdc04150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 --2- 172.21.15.7:0/3125294952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc040739a0 0x7fdc0414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 >> 172.21.15.7:0/3125294952 conn(0x7fdc0406bc70 msgr2=0x7fdc04074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 shutdown_connections 2024-08-19T00:47:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:27.953+0000 7fdc0b000640 1 -- 172.21.15.7:0/3125294952 wait complete. 2024-08-19T00:47:27.971 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:47:27.971 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:47:27.972 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:47:27.972 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:47:27.972 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:27.972 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:47:27.972 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:47:27.972 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:47:27.972 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:27.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:27.973 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:47:28.010 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:47:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:47:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:47:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:47:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:28.010 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42214sec preferred_lft 42214sec 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:28.011 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:47:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:47:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:47:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:28.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:28.013 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:47:28.104 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:47:28.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:28.107 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:47:28.144 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:47:28.144 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:47:28.144 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:47:28.144 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:47:28.144 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:47:28.144 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:47:28.145 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:47:28.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:47:28.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:47:28.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:47:28.145 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:47:28.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:47:28.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:47:28.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:28.342 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:47:28.378 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:47:28.379 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:47:28.379 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:28.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:28.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:47:28.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:47:28.475 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:28.510 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:28.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:47:28.511 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:28.585 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:47:28.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:28.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:28.658 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:28.656+0000 7f23d6600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:28.715 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:28.715 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:28.715 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:28.731 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:28.731 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:28.731 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:28.731 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:47:28.731 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:47:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:47:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:47:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:47:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:47:28.754 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:47:28.754 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:47:28.755 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:47:28.755 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:47:28.755 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:47:28.755 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:47:28.758 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:47:28.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:28.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:28.855 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:47:28.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:47:28.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:47:28.944 INFO:teuthology.orchestra.run.smithi007.stdout:client9819 2024-08-19T00:47:28.945 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:28.945 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> import json 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/./subdir'"'"') 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(e.errno) 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:47:28.981 DEBUG:teuthology.orchestra.run.smithi007:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-19T00:47:28.982 DEBUG:teuthology.orchestra.run.smithi007:> print(json.dumps( 2024-08-19T00:47:28.982 DEBUG:teuthology.orchestra.run.smithi007:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-19T00:47:28.982 DEBUG:teuthology.orchestra.run.smithi007:> indent=2)) 2024-08-19T00:47:28.982 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:47:29.025 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:47:29.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:29 stdin-killer INFO: command exited with status 5: exiting normally with same code! 2024-08-19T00:47:30.696 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:30.695+0000 7fcb40400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-19T00:47:33.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:47:33.014 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:47:35.127 DEBUG:teuthology.orchestra.run:got remote process result: 5 2024-08-19T00:47:35.127 INFO:tasks.cephfs.test_damage:Result: EIO on client 2024-08-19T00:47:35.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:35.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.295+0000 7fc57ca00640 1 Processor -- start 2024-08-19T00:47:35.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.295+0000 7fc57ca00640 1 -- start start 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.296+0000 7fc57ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780d0ad0 0x7fc5780ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.296+0000 7fc57ca00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57806f7f0 con 0x7fc578159bf0 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc57ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57806f510 con 0x7fc5780ce500 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc57ca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc578072980 con 0x7fc5780d0ad0 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc575e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc578159bf0 0x7fc578073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35110/0 (socket says 172.21.15.7:35110) 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc575e00640 1 -- 172.21.15.7:0/628156208 learned_addr learned my addr 172.21.15.7:0/628156208 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc576800640 1 --2- 172.21.15.7:0/628156208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780d0ad0 0x7fc5780ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026618196 0 0) 0x7fc57806f7f0 con 0x7fc578159bf0 2024-08-19T00:47:35.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc55c003520 con 0x7fc578159bf0 2024-08-19T00:47:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.297+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920688381 0 0) 0x7fc57806f510 con 0x7fc5780ce500 2024-08-19T00:47:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.298+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc57806f7f0 con 0x7fc5780ce500 2024-08-19T00:47:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.298+0000 7fc576800640 1 -- 172.21.15.7:0/628156208 >> v1:172.21.15.162:6789/0 conn(0x7fc5780ce500 legacy=0x7fc5780d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.298+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 513731581 0 0) 0x7fc55c003520 con 0x7fc578159bf0 2024-08-19T00:47:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.298+0000 7fc576800640 1 -- 172.21.15.7:0/628156208 >> v1:172.21.15.7:6789/0 conn(0x7fc578159bf0 legacy=0x7fc578073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.298+0000 7fc576800640 1 -- 172.21.15.7:0/628156208 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc578072c60 con 0x7fc5780d0ad0 2024-08-19T00:47:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.299+0000 7fc576800640 1 --2- 172.21.15.7:0/628156208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780d0ad0 0x7fc5780ce970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc570009dc0 tx=0x7fc57002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5445400dcc15e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.299+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568001670 con 0x7fc5780d0ad0 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.299+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570007540 con 0x7fc5780d0ad0 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.299+0000 7fc575400640 1 -- 172.21.15.7:0/628156208 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570007910 con 0x7fc5780d0ad0 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.300+0000 7fc57ca00640 1 -- 172.21.15.7:0/628156208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780d0ad0 msgr2=0x7fc5780ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.300+0000 7fc57ca00640 1 --2- 172.21.15.7:0/628156208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780d0ad0 0x7fc5780ce970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc570009dc0 tx=0x7fc57002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.300+0000 7fc57ca00640 1 -- 172.21.15.7:0/628156208 shutdown_connections 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.300+0000 7fc57ca00640 1 --2- 172.21.15.7:0/628156208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780d0ad0 0x7fc5780ce970 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.300+0000 7fc57ca00640 1 -- 172.21.15.7:0/628156208 >> 172.21.15.7:0/628156208 conn(0x7fc57806bc70 msgr2=0x7fc57806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.300+0000 7fc57ca00640 1 -- 172.21.15.7:0/628156208 shutdown_connections 2024-08-19T00:47:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.300+0000 7fc57ca00640 1 -- 172.21.15.7:0/628156208 wait complete. 2024-08-19T00:47:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.301+0000 7fc57ca00640 1 Processor -- start 2024-08-19T00:47:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.302+0000 7fc57ca00640 1 -- start start 2024-08-19T00:47:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc57ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780ce500 0x7fc57809bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc57ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5780d0ad0 0x7fc5780b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc57ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc578159bf0 0x7fc57815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc57ca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc578159fd0 con 0x7fc578159bf0 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc57ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc578073b70 con 0x7fc5780d0ad0 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc57ca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc57815a150 con 0x7fc5780ce500 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc578159bf0 0x7fc57815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc575e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780ce500 0x7fc57809bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc578159bf0 0x7fc57815b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36262/0 (socket says 172.21.15.7:36262) 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 -- 172.21.15.7:0/3593792129 learned_addr learned my addr 172.21.15.7:0/3593792129 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc56d400640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5780d0ad0 0x7fc5780b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 -- 172.21.15.7:0/3593792129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780ce500 msgr2=0x7fc57809bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780ce500 0x7fc57809bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 -- 172.21.15.7:0/3593792129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5780d0ad0 msgr2=0x7fc5780b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5780d0ad0 0x7fc5780b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.303+0000 7fc576800640 1 -- 172.21.15.7:0/3593792129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57809c2b0 con 0x7fc578159bf0 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.304+0000 7fc576800640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc578159bf0 0x7fc57815b830 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fc570009ee0 tx=0x7fc570004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.304+0000 7fc56ea00640 1 -- 172.21.15.7:0/3593792129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570040070 con 0x7fc578159bf0 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.304+0000 7fc56ea00640 1 -- 172.21.15.7:0/3593792129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570031bc0 con 0x7fc578159bf0 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.304+0000 7fc56ea00640 1 -- 172.21.15.7:0/3593792129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570009450 con 0x7fc578159bf0 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.304+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57809c590 con 0x7fc578159bf0 2024-08-19T00:47:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.304+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57809cb50 con 0x7fc578159bf0 2024-08-19T00:47:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.305+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5780ce970 con 0x7fc578159bf0 2024-08-19T00:47:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.306+0000 7fc56ea00640 1 -- 172.21.15.7:0/3593792129 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc570039040 con 0x7fc578159bf0 2024-08-19T00:47:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.307+0000 7fc56ea00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be30 0x7fc55406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.307+0000 7fc56ea00640 1 -- 172.21.15.7:0/3593792129 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fc5700acf80 con 0x7fc578159bf0 2024-08-19T00:47:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.307+0000 7fc575e00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be30 0x7fc55406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.308+0000 7fc575e00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be30 0x7fc55406e2f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc5680017e0 tx=0x7fc568001610 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.312+0000 7fc56ea00640 1 -- 172.21.15.7:0/3593792129 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc57007a7a0 con 0x7fc578159bf0 2024-08-19T00:47:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.532+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc57815a590 con 0x7fc578159bf0 2024-08-19T00:47:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.533+0000 7fc56ea00640 1 -- 172.21.15.7:0/3593792129 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 293 v293) ==== 95+0+5229 (secure 0 0 0) 0x7fc57007eaa0 con 0x7fc578159bf0 2024-08-19T00:47:35.535 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:35.535 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":293,"btime":"2024-08-19T00:47:30:695689+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":293,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:30.680681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9747":{"gid":9747,"name":"a","rank":0,"incarnation":289,"state":"up:active","state_seq":6,"addr":"172.21.15.7:6837/767746356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":767746356},{"type":"v1","addr":"172.21.15.7:6837","nonce":767746356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9747,"qdb_cluster":[9747]},"id":6}]} 2024-08-19T00:47:35.535 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 293 2024-08-19T00:47:35.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be30 msgr2=0x7fc55406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be30 0x7fc55406e2f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc5680017e0 tx=0x7fc568001610 comp rx=0 tx=0).stop 2024-08-19T00:47:35.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc578159bf0 msgr2=0x7fc57815b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc578159bf0 0x7fc57815b830 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fc570009ee0 tx=0x7fc570004a40 comp rx=0 tx=0).stop 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 shutdown_connections 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55406be30 0x7fc55406e2f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc578159bf0 0x7fc57815b830 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5780d0ad0 0x7fc5780b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 --2- 172.21.15.7:0/3593792129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5780ce500 0x7fc57809bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 >> 172.21.15.7:0/3593792129 conn(0x7fc57806bc70 msgr2=0x7fc578160420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 shutdown_connections 2024-08-19T00:47:35.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.535+0000 7fc57ca00640 1 -- 172.21.15.7:0/3593792129 wait complete. 2024-08-19T00:47:35.554 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-08-19T00:47:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.712+0000 7fe976200640 1 Processor -- start 2024-08-19T00:47:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.712+0000 7fe976200640 1 -- start start 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe976200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe97015bfb0 0x7fe9700b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe976200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe9700aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe976200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe97015c390 0x7fe9700af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe976200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe9700af650 con 0x7fe97015c390 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe976200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe9700ad790 con 0x7fe97015bfb0 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe976200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9700acef0 con 0x7fe9700b5130 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe96fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe97015c390 0x7fe9700af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe96fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe97015c390 0x7fe9700af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36274/0 (socket says 172.21.15.7:36274) 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe96fe00640 1 -- 172.21.15.7:0/3952568108 learned_addr learned my addr 172.21.15.7:0/3952568108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe96f400640 1 --2- 172.21.15.7:0/3952568108 >> v2:172.21.15.162:3300/0 conn(0x7fe97015bfb0 0x7fe9700b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.714+0000 7fe967e00640 1 --2- 172.21.15.7:0/3952568108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe9700aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.715+0000 7fe96fe00640 1 -- 172.21.15.7:0/3952568108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 msgr2=0x7fe9700aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.715+0000 7fe96fe00640 1 --2- 172.21.15.7:0/3952568108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe9700aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.715+0000 7fe96fe00640 1 -- 172.21.15.7:0/3952568108 >> v2:172.21.15.162:3300/0 conn(0x7fe97015bfb0 msgr2=0x7fe9700b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.715+0000 7fe96fe00640 1 --2- 172.21.15.7:0/3952568108 >> v2:172.21.15.162:3300/0 conn(0x7fe97015bfb0 0x7fe9700b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.715+0000 7fe96fe00640 1 -- 172.21.15.7:0/3952568108 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9700ad1d0 con 0x7fe97015c390 2024-08-19T00:47:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.715+0000 7fe96f400640 1 --2- 172.21.15.7:0/3952568108 >> v2:172.21.15.162:3300/0 conn(0x7fe97015bfb0 0x7fe9700b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.715+0000 7fe967e00640 1 --2- 172.21.15.7:0/3952568108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe9700aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:35.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.716+0000 7fe96fe00640 1 --2- 172.21.15.7:0/3952568108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015c390 0x7fe9700af110 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fe9700b2ca0 tx=0x7fe96802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927433a8cc08cb9f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe96ea00640 1 -- 172.21.15.7:0/3952568108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968036070 con 0x7fe97015c390 2024-08-19T00:47:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe96ea00640 1 -- 172.21.15.7:0/3952568108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe968031600 con 0x7fe97015c390 2024-08-19T00:47:35.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe96ea00640 1 -- 172.21.15.7:0/3952568108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9680319d0 con 0x7fe97015c390 2024-08-19T00:47:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 -- 172.21.15.7:0/3952568108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015c390 msgr2=0x7fe9700af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 --2- 172.21.15.7:0/3952568108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015c390 0x7fe9700af110 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fe9700b2ca0 tx=0x7fe96802a6a0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 -- 172.21.15.7:0/3952568108 shutdown_connections 2024-08-19T00:47:35.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 --2- 172.21.15.7:0/3952568108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015c390 0x7fe9700af110 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 --2- 172.21.15.7:0/3952568108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe9700aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 --2- 172.21.15.7:0/3952568108 >> v2:172.21.15.162:3300/0 conn(0x7fe97015bfb0 0x7fe9700b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 -- 172.21.15.7:0/3952568108 >> 172.21.15.7:0/3952568108 conn(0x7fe9700b2300 msgr2=0x7fe97006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.718+0000 7fe976200640 1 -- 172.21.15.7:0/3952568108 shutdown_connections 2024-08-19T00:47:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.719+0000 7fe976200640 1 -- 172.21.15.7:0/3952568108 wait complete. 2024-08-19T00:47:35.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.720+0000 7fe976200640 1 Processor -- start 2024-08-19T00:47:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.720+0000 7fe976200640 1 -- start start 2024-08-19T00:47:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe976200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe97015e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe976200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015bfb0 0x7fe97009c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe976200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97015c390 0x7fe97015ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe976200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9700b4340 con 0x7fe97015bfb0 2024-08-19T00:47:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe976200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe970071b20 con 0x7fe97015c390 2024-08-19T00:47:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe976200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9700b44c0 con 0x7fe9700b5130 2024-08-19T00:47:35.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015bfb0 0x7fe97009c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015bfb0 0x7fe97009c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36288/0 (socket says 172.21.15.7:36288) 2024-08-19T00:47:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.721+0000 7fe967e00640 1 -- 172.21.15.7:0/3979789395 learned_addr learned my addr 172.21.15.7:0/3979789395 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe96fe00640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97015c390 0x7fe97015ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe96f400640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe97015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967e00640 1 -- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 msgr2=0x7fe97015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967e00640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe97015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967e00640 1 -- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97015c390 msgr2=0x7fe97015ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967e00640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97015c390 0x7fe97015ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967e00640 1 -- 172.21.15.7:0/3979789395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97015e580 con 0x7fe97015bfb0 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe96f400640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe97015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967e00640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015bfb0 0x7fe97009c5a0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fe95800e840 tx=0x7fe95800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967400640 1 -- 172.21.15.7:0/3979789395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95800f040 con 0x7fe97015bfb0 2024-08-19T00:47:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.722+0000 7fe967400640 1 -- 172.21.15.7:0/3979789395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe958004030 con 0x7fe97015bfb0 2024-08-19T00:47:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.723+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97009d060 con 0x7fe97015bfb0 2024-08-19T00:47:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.723+0000 7fe967400640 1 -- 172.21.15.7:0/3979789395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe958004400 con 0x7fe97015bfb0 2024-08-19T00:47:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.723+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97009ad50 con 0x7fe97015bfb0 2024-08-19T00:47:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.725+0000 7fe967400640 1 -- 172.21.15.7:0/3979789395 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe95800c6d0 con 0x7fe97015bfb0 2024-08-19T00:47:35.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.725+0000 7fe967400640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe94c06be30 0x7fe94c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.725+0000 7fe967400640 1 -- 172.21.15.7:0/3979789395 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fe95808b650 con 0x7fe97015bfb0 2024-08-19T00:47:35.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.726+0000 7fe96f400640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe94c06be30 0x7fe94c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.726+0000 7fe97922b740 1 Processor -- start 2024-08-19T00:47:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.726+0000 7fe97922b740 1 -- start start 2024-08-19T00:47:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.726+0000 7fe96f400640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe94c06be30 0x7fe94c06e2f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe970157fd0 tx=0x7fe960008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e6a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e677920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe97922b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e6bf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe97922b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56481e5dfef0 con 0x56481e677e60 2024-08-19T00:47:35.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56481e587d10 con 0x56481e678950 2024-08-19T00:47:35.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56481e5dbeb0 con 0x56481e677540 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe96f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e6a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.727+0000 7fe96fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e6bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe967e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e677920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e6a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:56974/0 (socket says 172.21.15.7:56974) 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96f400640 1 -- 172.21.15.7:0/894365858 learned_addr learned my addr 172.21.15.7:0/894365858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e6bf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36292/0 (socket says 172.21.15.7:36292) 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96fe00640 1 -- 172.21.15.7:0/894365858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 msgr2=0x56481e6a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96fe00640 1 --2- 172.21.15.7:0/894365858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e6a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96fe00640 1 -- 172.21.15.7:0/894365858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 msgr2=0x56481e677920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96fe00640 1 --2- 172.21.15.7:0/894365858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e677920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96fe00640 1 -- 172.21.15.7:0/894365858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481e3bf7c0 con 0x56481e677e60 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe96fe00640 1 --2- 172.21.15.7:0/894365858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e6bf610 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fe97006fbf0 tx=0x7fe96802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12a70be4df98a05 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.728+0000 7fe95f400640 1 -- 172.21.15.7:0/894365858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968042070 con 0x56481e677e60 2024-08-19T00:47:35.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe95f400640 1 -- 172.21.15.7:0/894365858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe968037040 con 0x56481e677e60 2024-08-19T00:47:35.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe95f400640 1 -- 172.21.15.7:0/894365858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968036040 con 0x56481e677e60 2024-08-19T00:47:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 -- 172.21.15.7:0/894365858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 msgr2=0x56481e6bf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 --2- 172.21.15.7:0/894365858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e6bf610 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fe97006fbf0 tx=0x7fe96802e000 comp rx=0 tx=0).stop 2024-08-19T00:47:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 -- 172.21.15.7:0/894365858 shutdown_connections 2024-08-19T00:47:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 --2- 172.21.15.7:0/894365858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e6bf610 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 --2- 172.21.15.7:0/894365858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e677920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 --2- 172.21.15.7:0/894365858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e6a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 -- 172.21.15.7:0/894365858 >> 172.21.15.7:0/894365858 conn(0x56481e643d00 msgr2=0x56481e6c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 -- 172.21.15.7:0/894365858 shutdown_connections 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.729+0000 7fe97922b740 1 -- 172.21.15.7:0/894365858 wait complete. 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.730+0000 7fe97922b740 1 -- start start 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.730+0000 7fe97922b740 1 Processor -- start 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.731+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e691440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.731+0000 7fe97922b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e67baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.731+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e6b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.731+0000 7fe97922b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56481e6a6de0 con 0x56481e677e60 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.731+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56481e59b8d0 con 0x56481e678950 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.731+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56481e6a4210 con 0x56481e677540 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.731+0000 7fe97922b740 10 client.0 _ll_register_callbacks cb 0x56481e2f2ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e67baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e67baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36304/0 (socket says 172.21.15.7:36304) 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 -- 172.21.15.7:0/1585431596 learned_addr learned my addr 172.21.15.7:0/1585431596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe96f400640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e691440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe96fe00640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e6b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 -- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 msgr2=0x56481e691440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e691440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 -- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 msgr2=0x56481e6b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e6b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 -- 172.21.15.7:0/1585431596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481e41ff50 con 0x56481e677e60 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe96f400640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e691440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe96fe00640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e6b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe967e00640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e67baa0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fe958058d70 tx=0x7fe958058ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f969cf613dd9ff0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe953e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe953e00640 1 -- 172.21.15.7:0/1585431596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe958087060 con 0x56481e677e60 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe953e00640 1 -- 172.21.15.7:0/1585431596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fe95808b270 con 0x56481e677e60 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.732+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe968037040 con 0x56481e677e60 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe953e00640 1 -- 172.21.15.7:0/1585431596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=293) ==== 24+0+0 (secure 0 0 0) 0x7fe958020040 con 0x56481e677e60 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 10 client.9837 fetch_fsmap learned FSMap version 293 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=293,monmap=2+}) -- 0x56481e2b30b0 con 0x56481e677e60 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe953e00640 1 -- 172.21.15.7:0/1585431596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe968037040 con 0x56481e677e60 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe953e00640 1 -- 172.21.15.7:0/1585431596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 293) ==== 3502+0+0 (secure 0 0 0) 0x7fe958012050 con 0x56481e677e60 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 10 client.9837 fetch_fsmap finished waiting for FSMap version 293 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 10 client.9837 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 20 client.9837 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6b9100 0x56481e6a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 4 client.9837 mds_command: new command op to 9747 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 --> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56481e5ed620 con 0x56481e6b9100 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.733+0000 7fe96f400640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6b9100 0x56481e6a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.734+0000 7fe96f400640 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6b9100 0x56481e6a98d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bacbc0aac27fff3a server_cookie=232ea6f30aeb42a1 in_seq=0 out_seq=0 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.734+0000 7fe953e00640 10 client.9837 ms_handle_connect on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe953e00640 1 -- 172.21.15.7:0/1585431596 <== mds.0 v2:172.21.15.7:6835/767746356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56481e5ed620 con 0x56481e6b9100 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe953e00640 10 client.9837 handle_command_reply: tid=0 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 client.9837 shutdown 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 msgr2=0x56481e67baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e67baa0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fe958058d70 tx=0x7fe958058ea0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 shutdown_connections 2024-08-19T00:47:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e6b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6b9100 0x56481e6a98d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e67baa0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 --2- 172.21.15.7:0/1585431596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677540 0x56481e691440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 >> 172.21.15.7:0/1585431596 conn(0x56481e643d00 msgr2=0x56481e6c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe953e00640 0 client.9837 ms_handle_reset on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 shutdown_connections 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 1 -- 172.21.15.7:0/1585431596 wait complete. 2024-08-19T00:47:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.735+0000 7fe97922b740 20 client.9837 trim_cache size 0 max 16384 2024-08-19T00:47:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.749+0000 7fe97922b740 1 Processor -- start 2024-08-19T00:47:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.749+0000 7fe97922b740 1 -- start start 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.750+0000 7fe97922b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677540 0x56481e6a7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.750+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677e60 0x56481e6e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.750+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e67acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.750+0000 7fe97922b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701fd0a0 con 0x56481e677540 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.750+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9701fc580 con 0x56481e678950 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.750+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9701fca80 con 0x56481e677e60 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.750+0000 7fe96f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677540 0x56481e6a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677540 0x56481e6a7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36320/0 (socket says 172.21.15.7:36320) 2024-08-19T00:47:35.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 -- 172.21.15.7:0/384859104 learned_addr learned my addr 172.21.15.7:0/384859104 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:35.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 -- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677e60 msgr2=0x56481e6e9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe967e00640 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677e60 0x56481e6e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677e60 0x56481e6e9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96fe00640 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e67acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 -- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 msgr2=0x56481e67acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e67acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 -- 172.21.15.7:0/384859104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481e677c90 con 0x56481e677540 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96fe00640 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e67acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe96f400640 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677540 0x56481e6a7380 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fe960009750 tx=0x7fe960016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24421b204f0176e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.751+0000 7fe95ea00640 1 -- 172.21.15.7:0/384859104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96001c040 con 0x56481e677540 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe95ea00640 1 -- 172.21.15.7:0/384859104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96001d040 con 0x56481e677540 2024-08-19T00:47:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe95ea00640 1 -- 172.21.15.7:0/384859104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96000f040 con 0x56481e677540 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 -- 172.21.15.7:0/384859104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677540 msgr2=0x56481e6a7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677540 0x56481e6a7380 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fe960009750 tx=0x7fe960016000 comp rx=0 tx=0).stop 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 -- 172.21.15.7:0/384859104 shutdown_connections 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e678950 0x56481e67acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e677e60 0x56481e6e9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 --2- 172.21.15.7:0/384859104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677540 0x56481e6a7380 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 -- 172.21.15.7:0/384859104 >> 172.21.15.7:0/384859104 conn(0x56481e643d00 msgr2=0x56481e67e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 -- 172.21.15.7:0/384859104 shutdown_connections 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.752+0000 7fe97922b740 1 -- 172.21.15.7:0/384859104 wait complete. 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.753+0000 7fe97922b740 1 -- start start 2024-08-19T00:47:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.753+0000 7fe97922b740 1 Processor -- start 2024-08-19T00:47:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e677540 0x56481e6d76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe97922b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e7445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe97922b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e678950 0x56481e6c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe97922b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56481e6b8f80 con 0x56481e677e60 2024-08-19T00:47:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56481e691980 con 0x56481e677540 2024-08-19T00:47:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe97922b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56481e6a2bd0 con 0x56481e678950 2024-08-19T00:47:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe97922b740 10 client.0 _ll_register_callbacks cb 0x7fe958009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e7445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e7445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36322/0 (socket says 172.21.15.7:36322) 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe967e00640 1 -- 172.21.15.7:0/3745168261 learned_addr learned my addr 172.21.15.7:0/3745168261 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe96fe00640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e678950 0x56481e6c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.754+0000 7fe96f400640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e677540 0x56481e6d76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe967e00640 1 -- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e678950 msgr2=0x56481e6c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe967e00640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e678950 0x56481e6c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe967e00640 1 -- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e677540 msgr2=0x56481e6d76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe967e00640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e677540 0x56481e6d76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe967e00640 1 -- 172.21.15.7:0/3745168261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481e67afe0 con 0x56481e677e60 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe96fe00640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e678950 0x56481e6c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe96f400640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e677540 0x56481e6d76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:35.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe967e00640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e7445a0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fe958055760 tx=0x7fe95805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a0bcb8ab0c5310 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe953e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe953e00640 1 -- 172.21.15.7:0/3745168261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe958087070 con 0x56481e677e60 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe953e00640 1 -- 172.21.15.7:0/3745168261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fe958057ca0 con 0x56481e677e60 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe96001d040 con 0x56481e677e60 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.755+0000 7fe953e00640 1 -- 172.21.15.7:0/3745168261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=293) ==== 24+0+0 (secure 0 0 0) 0x7fe958058440 con 0x56481e677e60 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 10 client.9843 fetch_fsmap learned FSMap version 293 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=293,monmap=2+}) -- 0x56481e744ae0 con 0x56481e677e60 2024-08-19T00:47:35.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe953e00640 1 -- 172.21.15.7:0/3745168261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95807a030 con 0x56481e677e60 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe953e00640 1 -- 172.21.15.7:0/3745168261 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 293) ==== 3502+0+0 (secure 0 0 0) 0x7fe958012070 con 0x56481e677e60 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 10 client.9843 fetch_fsmap finished waiting for FSMap version 293 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 10 client.9843 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 20 client.9843 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6c36b0 0x56481e745160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 4 client.9843 mds_command: new command op to 9747 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 --> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x56481e6ab110 con 0x56481e6c36b0 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.756+0000 7fe96f400640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6c36b0 0x56481e745160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe96f400640 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6c36b0 0x56481e745160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bab45806412f9215 server_cookie=1db8ee3f395fbcff in_seq=0 out_seq=0 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe953e00640 10 client.9843 ms_handle_connect on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe953e00640 1 -- 172.21.15.7:0/3745168261 <== mds.0 v2:172.21.15.7:6835/767746356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+194 (crc 0 0 0) 0x56481e6ab110 con 0x56481e6c36b0 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe953e00640 10 client.9843 handle_command_reply: tid=0 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 client.9843 shutdown 2024-08-19T00:47:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 msgr2=0x56481e7445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e7445a0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fe958055760 tx=0x7fe95805c000 comp rx=0 tx=0).stop 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 shutdown_connections 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56481e678950 0x56481e6c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:6835/767746356,v1:172.21.15.7:6837/767746356] conn(0x56481e6c36b0 0x56481e745160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56481e677e60 0x56481e7445a0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 --2- 172.21.15.7:0/3745168261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56481e677540 0x56481e6d76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 >> 172.21.15.7:0/3745168261 conn(0x56481e643d00 msgr2=0x56481e6a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe953e00640 0 client.9843 ms_handle_reset on v2:172.21.15.7:6835/767746356 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 shutdown_connections 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.757+0000 7fe97922b740 1 -- 172.21.15.7:0/3745168261 wait complete. 2024-08-19T00:47:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe97922b740 20 client.9843 trim_cache size 0 max 16384 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "dentry", 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4019582256, 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1, 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "frag": "*", 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "subdir", 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_id": "head", 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/subdir" 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:47:35.765 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:47:35.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe94c06be30 msgr2=0x7fe94c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe94c06be30 0x7fe94c06e2f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe970157fd0 tx=0x7fe960008040 comp rx=0 tx=0).stop 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015bfb0 msgr2=0x7fe97009c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015bfb0 0x7fe97009c5a0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fe95800e840 tx=0x7fe95800ed00 comp rx=0 tx=0).stop 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 shutdown_connections 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe94c06be30 0x7fe94c06e2f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97015c390 0x7fe97015ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe97015bfb0 0x7fe97009c5a0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 --2- 172.21.15.7:0/3979789395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9700b5130 0x7fe97015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 >> 172.21.15.7:0/3979789395 conn(0x7fe9700b2300 msgr2=0x7fe970156bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 shutdown_connections 2024-08-19T00:47:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:35.758+0000 7fe976200640 1 -- 172.21.15.7:0/3979789395 wait complete. 2024-08-19T00:47:35.775 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 10000000000.00000000' 2024-08-19T00:47:35.776 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:35.776 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:35.811 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:35.811 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:35.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.085+0000 7f1416e00640 1 Processor -- start 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.085+0000 7f1416e00640 1 -- start start 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1416e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f14100d03c0 0x7f1410071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1416e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f141006e710 0x7f14100d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1416e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14100d0ce0 con 0x7f14100b3750 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1416e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f14100cebc0 con 0x7f141006e710 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1416e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f14100cdfb0 con 0x7f14100d03c0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1407400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f141006e710 0x7f14100d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1407400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f141006e710 0x7f14100d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36324/0 (socket says 172.21.15.7:36324) 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.086+0000 7f1407400640 1 -- 172.21.15.7:0/3288037089 learned_addr learned my addr 172.21.15.7:0/3288037089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.087+0000 7f140fe00640 1 --2- 172.21.15.7:0/3288037089 >> v2:172.21.15.162:3300/0 conn(0x7f14100d03c0 0x7f1410071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.087+0000 7f1407400640 1 -- 172.21.15.7:0/3288037089 >> v2:172.21.15.162:3300/0 conn(0x7f14100d03c0 msgr2=0x7f1410071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.087+0000 7f1407400640 1 --2- 172.21.15.7:0/3288037089 >> v2:172.21.15.162:3300/0 conn(0x7f14100d03c0 0x7f1410071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.087+0000 7f1407400640 1 -- 172.21.15.7:0/3288037089 >> v1:172.21.15.7:6789/0 conn(0x7f14100b3750 legacy=0x7f14100cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.087+0000 7f1407400640 1 -- 172.21.15.7:0/3288037089 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14100ce290 con 0x7f141006e710 2024-08-19T00:47:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.087+0000 7f140f400640 1 -- 172.21.15.7:0/3288037089 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977711917 0 0) 0x7f14100d0ce0 con 0x7f14100b3750 2024-08-19T00:47:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.087+0000 7f140fe00640 1 --2- 172.21.15.7:0/3288037089 >> v2:172.21.15.162:3300/0 conn(0x7f14100d03c0 0x7f1410071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.088+0000 7f1407400640 1 --2- 172.21.15.7:0/3288037089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f14100d07a0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009870 tx=0x7f13f802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2b54ca8eeb79d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.088+0000 7f140f400640 1 -- 172.21.15.7:0/3288037089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8037070 con 0x7f141006e710 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.088+0000 7f140f400640 1 -- 172.21.15.7:0/3288037089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f8032440 con 0x7f141006e710 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.088+0000 7f140f400640 1 -- 172.21.15.7:0/3288037089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8032810 con 0x7f141006e710 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 -- 172.21.15.7:0/3288037089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 msgr2=0x7f14100d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 --2- 172.21.15.7:0/3288037089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f14100d07a0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009870 tx=0x7f13f802a2a0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 -- 172.21.15.7:0/3288037089 shutdown_connections 2024-08-19T00:47:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 --2- 172.21.15.7:0/3288037089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f14100d07a0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 --2- 172.21.15.7:0/3288037089 >> v2:172.21.15.162:3300/0 conn(0x7f14100d03c0 0x7f1410071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 -- 172.21.15.7:0/3288037089 >> 172.21.15.7:0/3288037089 conn(0x7f141006bc70 msgr2=0x7f141006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:36.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 -- 172.21.15.7:0/3288037089 shutdown_connections 2024-08-19T00:47:36.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.089+0000 7f1416e00640 1 -- 172.21.15.7:0/3288037089 wait complete. 2024-08-19T00:47:36.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.091+0000 7f1416e00640 1 Processor -- start 2024-08-19T00:47:36.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.091+0000 7f1416e00640 1 -- start start 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1416e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f141009b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1416e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14100b3750 0x7f141015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1416e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14100d03c0 0x7f141014d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1416e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1410073ae0 con 0x7f141006e710 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1416e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14100ce850 con 0x7f14100b3750 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1416e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1410073c60 con 0x7f14100d03c0 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f140fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f141009b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f140fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f141009b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36332/0 (socket says 172.21.15.7:36332) 2024-08-19T00:47:36.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f140fe00640 1 -- 172.21.15.7:0/1002898328 learned_addr learned my addr 172.21.15.7:0/1002898328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1407400640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14100b3750 0x7f141015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f1414e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14100d03c0 0x7f141014d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f140fe00640 1 -- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14100d03c0 msgr2=0x7f141014d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f140fe00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14100d03c0 0x7f141014d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f140fe00640 1 -- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14100b3750 msgr2=0x7f141015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.092+0000 7f140fe00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14100b3750 0x7f141015b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f140fe00640 1 -- 172.21.15.7:0/1002898328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141015bdd0 con 0x7f141006e710 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f1414e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14100d03c0 0x7f141014d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f140fe00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f141009b0d0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1400009fc0 tx=0x7f140000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f140cc00640 1 -- 172.21.15.7:0/1002898328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140001a070 con 0x7f141006e710 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f140cc00640 1 -- 172.21.15.7:0/1002898328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1400003bb0 con 0x7f141006e710 2024-08-19T00:47:36.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141015c0b0 con 0x7f141006e710 2024-08-19T00:47:36.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f140cc00640 1 -- 172.21.15.7:0/1002898328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400004030 con 0x7f141006e710 2024-08-19T00:47:36.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.093+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141015c670 con 0x7f141006e710 2024-08-19T00:47:36.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.094+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14100cd430 con 0x7f141006e710 2024-08-19T00:47:36.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.095+0000 7f140cc00640 1 -- 172.21.15.7:0/1002898328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f140001d070 con 0x7f141006e710 2024-08-19T00:47:36.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.096+0000 7f140cc00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13ec06be60 0x7f13ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.096+0000 7f140cc00640 1 -- 172.21.15.7:0/1002898328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7f140008bcb0 con 0x7f141006e710 2024-08-19T00:47:36.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.097+0000 7f1407400640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13ec06be60 0x7f13ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.097+0000 7f1407400640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13ec06be60 0x7f13ec06e320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.101+0000 7f140cc00640 1 -- 172.21.15.7:0/1002898328 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1400010070 con 0x7f141006e710 2024-08-19T00:47:36.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.296+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14100b3bc0 con 0x7f141006e710 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.297+0000 7f140cc00640 1 -- 172.21.15.7:0/1002898328 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 66 entries v119) ==== 81+0+3950 (secure 0 0 0) 0x7f1400059440 con 0x7f141006e710 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2697833470 2024-08-20T00:47:13.631762+0000 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2697833470 2024-08-20T00:47:13.631762+0000 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/564246395 2024-08-20T00:47:08.596064+0000 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/564246395 2024-08-20T00:47:08.596064+0000 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:47:36.299 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:47:36.300 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:47:36.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:47:36.302 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:47:36.303 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:47:36.304 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:47:36.304 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:47:36.304 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:47:36.304 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:47:36.304 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:47:36.304 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:listed 66 entries 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13ec06be60 msgr2=0x7f13ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13ec06be60 0x7f13ec06e320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802e000 comp rx=0 tx=0).stop 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 msgr2=0x7f141009b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f141009b0d0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1400009fc0 tx=0x7f140000d560 comp rx=0 tx=0).stop 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 shutdown_connections 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f13ec06be60 0x7f13ec06e320 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14100d03c0 0x7f141014d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14100b3750 0x7f141015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 --2- 172.21.15.7:0/1002898328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141006e710 0x7f141009b0d0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 >> 172.21.15.7:0/1002898328 conn(0x7f141006bc70 msgr2=0x7f14100afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:36.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.299+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 shutdown_connections 2024-08-19T00:47:36.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.300+0000 7f1416e00640 1 -- 172.21.15.7:0/1002898328 wait complete. 2024-08-19T00:47:36.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:47:36.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:36.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:47:36.376 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:47:36.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:36.377 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:47:36.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:47:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.609+0000 7fadecc00640 1 Processor -- start 2024-08-19T00:47:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.609+0000 7fadecc00640 1 -- start start 2024-08-19T00:47:36.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.610+0000 7fadecc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 0x7fade80b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.610+0000 7fadecc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade80d2d70 con 0x7fade80d2930 2024-08-19T00:47:36.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.610+0000 7fadecc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade806ce30 con 0x7fade80b46d0 2024-08-19T00:47:36.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.610+0000 7fadecc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fade806d110 con 0x7fade8147b80 2024-08-19T00:47:36.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.610+0000 7faddfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fade80d2930 0x7fade80b3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35130/0 (socket says 172.21.15.7:35130) 2024-08-19T00:47:36.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.610+0000 7faddfe00640 1 -- 172.21.15.7:0/2708643201 learned_addr learned my addr 172.21.15.7:0/2708643201 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626269876 0 0) 0x7fade80d2d70 con 0x7fade80d2930 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadcc003520 con 0x7fade80d2930 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade7400640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 0x7fade80b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2091653023 0 0) 0x7fadcc003520 con 0x7fade80d2930 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 msgr2=0x7fade80b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 0x7fade80b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 >> v1:172.21.15.162:6789/0 conn(0x7fade80b46d0 legacy=0x7fade815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade806d3f0 con 0x7fade80d2930 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fadd0001670 con 0x7fade80d2930 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 >> v1:172.21.15.7:6789/0 conn(0x7fade80d2930 legacy=0x7fade80b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 0x7fadcc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc003ff0 0x7fadcc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadcc004d40 0x7fadcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fade806d110 con 0x7fadcc004d40 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc00bbd0 con 0x7fadcc003ff0 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc00bdd0 con 0x7fade8147b80 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade7e00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadcc004d40 0x7fadcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.611+0000 7fade7400640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 0x7fadcc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.612+0000 7faddfe00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc003ff0 0x7fadcc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.612+0000 7fade7e00640 1 -- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 msgr2=0x7fadcc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.612+0000 7fade7e00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade8147b80 0x7fadcc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.612+0000 7fade7e00640 1 -- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc003ff0 msgr2=0x7fadcc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.612+0000 7fade7e00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadcc003ff0 0x7fadcc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.612+0000 7fade7e00640 1 -- 172.21.15.7:0/2708643201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc003520 con 0x7fadcc004d40 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.613+0000 7fade7e00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadcc004d40 0x7fadcc0051c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fade00044b0 tx=0x7fadcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526d7545d6a81362 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.613+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0037070 con 0x7fadcc004d40 2024-08-19T00:47:36.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.613+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade002ad80 con 0x7fadcc004d40 2024-08-19T00:47:36.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.613+0000 7fade6a00640 1 -- 172.21.15.7:0/2708643201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0004080 con 0x7fadcc004d40 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.614+0000 7fadecc00640 1 -- 172.21.15.7:0/2708643201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadcc004d40 msgr2=0x7fadcc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.614+0000 7fadecc00640 1 --2- 172.21.15.7:0/2708643201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadcc004d40 0x7fadcc0051c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fade00044b0 tx=0x7fadcc005830 comp rx=0 tx=0).stop 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.614+0000 7fade7e00640 1 -- 172.21.15.7:0/2708643201 reap_dead start 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.614+0000 7fadecc00640 1 -- 172.21.15.7:0/2708643201 shutdown_connections 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.614+0000 7fadecc00640 1 -- 172.21.15.7:0/2708643201 >> 172.21.15.7:0/2708643201 conn(0x7fade8062540 msgr2=0x7fade8062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.614+0000 7fadecc00640 1 -- 172.21.15.7:0/2708643201 shutdown_connections 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.614+0000 7fadecc00640 1 -- 172.21.15.7:0/2708643201 wait complete. 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.615+0000 7fadecc00640 1 Processor -- start 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.616+0000 7fadecc00640 1 -- start start 2024-08-19T00:47:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.616+0000 7fadecc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade815dc90 0x7fade81e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.616+0000 7fadecc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade81e60f0 0x7fade80b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.616+0000 7fadecc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade80b2c70 0x7fade81e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.616+0000 7fadecc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fade8147f60 con 0x7fade81e60f0 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.616+0000 7fadecc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fade806d9b0 con 0x7fade815dc90 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.616+0000 7fadecc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fade80b15e0 con 0x7fade80b2c70 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade81e60f0 0x7fade80b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade81e60f0 0x7fade80b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36348/0 (socket says 172.21.15.7:36348) 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 -- 172.21.15.7:0/2869414352 learned_addr learned my addr 172.21.15.7:0/2869414352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7fade7e00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade80b2c70 0x7fade81e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7fade7400640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade815dc90 0x7fade81e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 -- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade80b2c70 msgr2=0x7fade81e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade80b2c70 0x7fade81e7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 -- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade815dc90 msgr2=0x7fade81e5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade815dc90 0x7fade81e5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 -- 172.21.15.7:0/2869414352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade81e6650 con 0x7fade81e60f0 2024-08-19T00:47:36.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.617+0000 7faddfe00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade81e60f0 0x7fade80b2730 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fadd0007290 tx=0x7fadd0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.618+0000 7faddf400640 1 -- 172.21.15.7:0/2869414352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd000f9c0 con 0x7fade81e60f0 2024-08-19T00:47:36.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.618+0000 7faddf400640 1 -- 172.21.15.7:0/2869414352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd0018070 con 0x7fade81e60f0 2024-08-19T00:47:36.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.618+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade81e3580 con 0x7fade81e60f0 2024-08-19T00:47:36.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.618+0000 7faddf400640 1 -- 172.21.15.7:0/2869414352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd000fdc0 con 0x7fade81e60f0 2024-08-19T00:47:36.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.618+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade81e6930 con 0x7fade81e60f0 2024-08-19T00:47:36.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.619+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade80b19b0 con 0x7fade81e60f0 2024-08-19T00:47:36.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.620+0000 7faddf400640 1 -- 172.21.15.7:0/2869414352 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadd001d460 con 0x7fade81e60f0 2024-08-19T00:47:36.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.621+0000 7faddf400640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadc406be60 0x7fadc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.621+0000 7faddf400640 1 -- 172.21.15.7:0/2869414352 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 8547+0+0 (secure 0 0 0) 0x7fadd008bb30 con 0x7fade81e60f0 2024-08-19T00:47:36.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.621+0000 7fade7400640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadc406be60 0x7fadc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.621+0000 7fade7400640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadc406be60 0x7fadc406e320 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fade806efb0 tx=0x7fadd8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.625+0000 7faddf400640 1 -- 172.21.15.7:0/2869414352 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fadd00599a0 con 0x7fade81e60f0 2024-08-19T00:47:36.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.847+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fade80b3080 con 0x7fade81e60f0 2024-08-19T00:47:36.849 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:36.847+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:47:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.850+0000 7faddf400640 1 -- 172.21.15.7:0/2869414352 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v294) ==== 161+0+0 (secure 0 0 0) 0x7fadd00592a0 con 0x7fade81e60f0 2024-08-19T00:47:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:47:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadc406be60 msgr2=0x7fadc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadc406be60 0x7fadc406e320 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fade806efb0 tx=0x7fadd8008040 comp rx=0 tx=0).stop 2024-08-19T00:47:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade81e60f0 msgr2=0x7fade80b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade81e60f0 0x7fade80b2730 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fadd0007290 tx=0x7fadd0007750 comp rx=0 tx=0).stop 2024-08-19T00:47:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 shutdown_connections 2024-08-19T00:47:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fadc406be60 0x7fadc406e320 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fade80b2c70 0x7fade81e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade81e60f0 0x7fade80b2730 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 --2- 172.21.15.7:0/2869414352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade815dc90 0x7fade81e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.853+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 >> 172.21.15.7:0/2869414352 conn(0x7fade8062540 msgr2=0x7fade81e96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.854+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 shutdown_connections 2024-08-19T00:47:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:36.854+0000 7fadecc00640 1 -- 172.21.15.7:0/2869414352 wait complete. 2024-08-19T00:47:36.859 INFO:tasks.ceph.mds.a.smithi007.stderr: -676> 2024-08-19T00:47:28.656+0000 7f23d6600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:36.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:47:36.901 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:47:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.029+0000 7f65f8800640 1 Processor -- start 2024-08-19T00:47:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.029+0000 7f65f8800640 1 -- start start 2024-08-19T00:47:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.030+0000 7f65f8800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f65f00d03c0 0x7f65f00d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.030+0000 7f65f8800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00b50b0 con 0x7f65f015f5b0 2024-08-19T00:47:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.030+0000 7f65f8800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00cead0 con 0x7f65f00b4380 2024-08-19T00:47:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.030+0000 7f65f8800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f65f015f990 con 0x7f65f00d03c0 2024-08-19T00:47:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f5e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f65f015f5b0 0x7f65f00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35142/0 (socket says 172.21.15.7:35142) 2024-08-19T00:47:37.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f5e00640 1 -- 172.21.15.7:0/63856712 learned_addr learned my addr 172.21.15.7:0/63856712 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f5400640 1 --2- 172.21.15.7:0/63856712 >> v2:172.21.15.162:3300/0 conn(0x7f65f00d03c0 0x7f65f00d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893858689 0 0) 0x7f65f00b50b0 con 0x7f65f015f5b0 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65d8003520 con 0x7f65f015f5b0 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979803796 0 0) 0x7f65f00cead0 con 0x7f65f00b4380 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65f00b50b0 con 0x7f65f00b4380 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f5400640 1 -- 172.21.15.7:0/63856712 >> v1:172.21.15.162:6789/0 conn(0x7f65f00b4380 legacy=0x7f65f00b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1743484901 0 0) 0x7f65d8003520 con 0x7f65f015f5b0 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.031+0000 7f65f5400640 1 -- 172.21.15.7:0/63856712 >> v1:172.21.15.7:6789/0 conn(0x7f65f015f5b0 legacy=0x7f65f00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.032+0000 7f65f5400640 1 -- 172.21.15.7:0/63856712 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f00cedb0 con 0x7f65f00d03c0 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f5400640 1 --2- 172.21.15.7:0/63856712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00d03c0 0x7f65f00d0800 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2319598c1e272dc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0037070 con 0x7f65f00d03c0 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e002abc0 con 0x7f65f00d03c0 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f4a00640 1 -- 172.21.15.7:0/63856712 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4001670 con 0x7f65f00d03c0 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f8800640 1 -- 172.21.15.7:0/63856712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00d03c0 msgr2=0x7f65f00d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f8800640 1 --2- 172.21.15.7:0/63856712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00d03c0 0x7f65f00d0800 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002a130 comp rx=0 tx=0).stop 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f8800640 1 -- 172.21.15.7:0/63856712 shutdown_connections 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.033+0000 7f65f8800640 1 --2- 172.21.15.7:0/63856712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00d03c0 0x7f65f00d0800 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.034+0000 7f65f8800640 1 -- 172.21.15.7:0/63856712 >> 172.21.15.7:0/63856712 conn(0x7f65f006bc70 msgr2=0x7f65f006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.034+0000 7f65f8800640 1 -- 172.21.15.7:0/63856712 shutdown_connections 2024-08-19T00:47:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.034+0000 7f65f8800640 1 -- 172.21.15.7:0/63856712 wait complete. 2024-08-19T00:47:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.035+0000 7f65f8800640 1 Processor -- start 2024-08-19T00:47:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.035+0000 7f65f8800640 1 -- start start 2024-08-19T00:47:37.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.036+0000 7f65f8800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00b4380 0x7f65f0159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.036+0000 7f65f8800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f00d03c0 0x7f65f014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.036+0000 7f65f8800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65f015f5b0 0x7f65f00ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.036+0000 7f65f8800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65f006ea30 con 0x7f65f00d03c0 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.036+0000 7f65f8800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65f006e8b0 con 0x7f65f00b4380 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.036+0000 7f65f8800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65f006ebb0 con 0x7f65f015f5b0 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f00d03c0 0x7f65f014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00b4380 0x7f65f0159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f00d03c0 0x7f65f014b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36386/0 (socket says 172.21.15.7:36386) 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5400640 1 -- 172.21.15.7:0/3483661422 learned_addr learned my addr 172.21.15.7:0/3483661422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f6800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65f015f5b0 0x7f65f00ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5e00640 1 -- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65f015f5b0 msgr2=0x7f65f00ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5e00640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65f015f5b0 0x7f65f00ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5e00640 1 -- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f00d03c0 msgr2=0x7f65f014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5e00640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f00d03c0 0x7f65f014b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5e00640 1 -- 172.21.15.7:0/3483661422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f015be50 con 0x7f65f00b4380 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5400640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f00d03c0 0x7f65f014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f6800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65f015f5b0 0x7f65f00ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.037+0000 7f65f5e00640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00b4380 0x7f65f0159030 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f65e4000fd0 tx=0x7f65e400c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.038+0000 7f65ea000640 1 -- 172.21.15.7:0/3483661422 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4017070 con 0x7f65f00b4380 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.038+0000 7f65ea000640 1 -- 172.21.15.7:0/3483661422 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e4005ce0 con 0x7f65f00b4380 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.038+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f01e7e10 con 0x7f65f00b4380 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.038+0000 7f65ea000640 1 -- 172.21.15.7:0/3483661422 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4007290 con 0x7f65f00b4380 2024-08-19T00:47:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.038+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f01e83d0 con 0x7f65f00b4380 2024-08-19T00:47:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.039+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f006efa0 con 0x7f65f00b4380 2024-08-19T00:47:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.040+0000 7f65ea000640 1 -- 172.21.15.7:0/3483661422 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65e401a070 con 0x7f65f00b4380 2024-08-19T00:47:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.041+0000 7f65ea000640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65d406be30 0x7f65d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.041+0000 7f65ea000640 1 -- 172.21.15.7:0/3483661422 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f65e408ae00 con 0x7f65f00b4380 2024-08-19T00:47:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.041+0000 7f65f5400640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65d406be30 0x7f65d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.042+0000 7f65f5400640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65d406be30 0x7f65d406e2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:37.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.046+0000 7f65ea000640 1 -- 172.21.15.7:0/3483661422 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f65e40584b0 con 0x7f65f00b4380 2024-08-19T00:47:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.304+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f65f015d0d0 con 0x7f65f00b4380 2024-08-19T00:47:37.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.857+0000 7f65ea000640 1 -- 172.21.15.7:0/3483661422 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v295) ==== 107+0+0 (secure 0 0 0) 0x7f65e405c7b0 con 0x7f65f00b4380 2024-08-19T00:47:37.859 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:47:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65d406be30 msgr2=0x7f65d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65d406be30 0x7f65d406e2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002e000 comp rx=0 tx=0).stop 2024-08-19T00:47:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00b4380 msgr2=0x7f65f0159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00b4380 0x7f65f0159030 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f65e4000fd0 tx=0x7f65e400c9b0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 shutdown_connections 2024-08-19T00:47:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65d406be30 0x7f65d406e2f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65f015f5b0 0x7f65f00ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f00d03c0 0x7f65f014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 --2- 172.21.15.7:0/3483661422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65f00b4380 0x7f65f0159030 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 >> 172.21.15.7:0/3483661422 conn(0x7f65f006bc70 msgr2=0x7f65f0074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 shutdown_connections 2024-08-19T00:47:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.860+0000 7f65f8800640 1 -- 172.21.15.7:0/3483661422 wait complete. 2024-08-19T00:47:37.880 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:47:37.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.997+0000 7ffa39e19f40 1 Processor -- start 2024-08-19T00:47:37.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.997+0000 7ffa39e19f40 1 -- start start 2024-08-19T00:47:38.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa39e19f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1c003630 0x55b52207b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa39e19f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b522082710 0x55b521fdd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa39e19f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b521fdd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa39e19f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b521f55d00 con 0x55b522082b90 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa39e19f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b521f59d40 con 0x7ffa1c003630 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa39e19f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b522086dc0 con 0x55b522082710 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b521fdd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b521fdd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36414/0 (socket says 172.21.15.7:36414) 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37a00640 1 -- 172.21.15.7:0/3309052509 learned_addr learned my addr 172.21.15.7:0/3309052509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37000640 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1c003630 0x55b52207b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa36600640 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b522082710 0x55b521fdd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37a00640 1 -- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b522082710 msgr2=0x55b521fdd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37a00640 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b522082710 0x55b521fdd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37a00640 1 -- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1c003630 msgr2=0x55b52207b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.998+0000 7ffa37a00640 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1c003630 0x55b52207b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.999+0000 7ffa37a00640 1 -- 172.21.15.7:0/3309052509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b521f17080 con 0x55b522082b90 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.999+0000 7ffa37000640 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1c003630 0x55b52207b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.999+0000 7ffa36600640 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b522082710 0x55b521fdd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.999+0000 7ffa37a00640 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b521fdd980 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7ffa30059040 tx=0x7ffa3004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b7476b3289ce8f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.999+0000 7ffa35200640 1 -- 172.21.15.7:0/3309052509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3001a420 con 0x55b522082b90 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.999+0000 7ffa35200640 1 -- 172.21.15.7:0/3309052509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa30065070 con 0x55b522082b90 2024-08-19T00:47:38.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:37.999+0000 7ffa35200640 1 -- 172.21.15.7:0/3309052509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30005430 con 0x55b522082b90 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 -- 172.21.15.7:0/3309052509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 msgr2=0x55b521fdd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b521fdd980 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7ffa30059040 tx=0x7ffa3004f000 comp rx=0 tx=0).stop 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 -- 172.21.15.7:0/3309052509 shutdown_connections 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b521fdd980 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b522082710 0x55b521fdd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/3309052509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1c003630 0x55b52207b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 -- 172.21.15.7:0/3309052509 >> 172.21.15.7:0/3309052509 conn(0x55b521fde4e0 msgr2=0x55b521fdc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 -- 172.21.15.7:0/3309052509 shutdown_connections 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 -- 172.21.15.7:0/3309052509 wait complete. 2024-08-19T00:47:38.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.000+0000 7ffa39e19f40 1 Processor -- start 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.001+0000 7ffa39e19f40 1 -- start start 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.001+0000 7ffa39e19f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b522082710 0x55b52207aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.001+0000 7ffa39e19f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b5220783c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.001+0000 7ffa39e19f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa1c003630 0x55b521faec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.001+0000 7ffa39e19f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b5220804e0 con 0x55b522082b90 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.001+0000 7ffa39e19f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b52207fcd0 con 0x55b522082710 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.001+0000 7ffa39e19f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b521ffb9e0 con 0x7ffa1c003630 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b5220783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b5220783c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36422/0 (socket says 172.21.15.7:36422) 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 learned_addr learned my addr 172.21.15.7:0/1909431339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:38.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa37000640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b522082710 0x55b52207aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa37a00640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa1c003630 0x55b521faec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa1c003630 msgr2=0x55b521faec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa1c003630 0x55b521faec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b522082710 msgr2=0x55b52207aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b522082710 0x55b52207aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b522089830 con 0x55b522082b90 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.002+0000 7ffa36600640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b5220783c0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e580 tx=0x7ffa2400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.003+0000 7ffa2f400640 1 -- 172.21.15.7:0/1909431339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24016070 con 0x55b522082b90 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.003+0000 7ffa2f400640 1 -- 172.21.15.7:0/1909431339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa240127c0 con 0x55b522082b90 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.003+0000 7ffa2f400640 1 -- 172.21.15.7:0/1909431339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24012b70 con 0x55b522082b90 2024-08-19T00:47:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.003+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b522088790 con 0x55b522082b90 2024-08-19T00:47:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.003+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b522088d50 con 0x55b522082b90 2024-08-19T00:47:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.005+0000 7ffa2f400640 1 -- 172.21.15.7:0/1909431339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa24019070 con 0x55b522082b90 2024-08-19T00:47:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.005+0000 7ffa2f400640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa1806a810 0x7ffa1806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.006+0000 7ffa2f400640 1 -- 172.21.15.7:0/1909431339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7ffa2408aff0 con 0x55b522082b90 2024-08-19T00:47:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.006+0000 7ffa37000640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa1806a810 0x7ffa1806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.009 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:47:38.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.006+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52207cdf0 0x55b52207d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.006+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52207d710 con 0x55b52207cdf0 2024-08-19T00:47:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.006+0000 7ffa37000640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa1806a810 0x7ffa1806ccd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ffa28000c00 tx=0x7ffa28001e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.006+0000 7ffa37a00640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52207cdf0 0x55b52207d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.007+0000 7ffa37a00640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52207cdf0 0x55b52207d1d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.009+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v120'1033 uv1007 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.009+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52207dae0 con 0x55b52207cdf0 2024-08-19T00:47:38.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.011+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v120'1034 uv1034 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.011+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221290b0 con 0x55b52207cdf0 2024-08-19T00:47:38.015 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:47:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.013+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v120'1035 uv1035 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.013+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212a460 con 0x55b52207cdf0 2024-08-19T00:47:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.014+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v120'1036 uv1036 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.014+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212a800 con 0x55b52207cdf0 2024-08-19T00:47:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.016+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v120'1037 uv1037 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.016+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129450 con 0x55b52207cdf0 2024-08-19T00:47:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.018+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v120'1038 uv1038 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.018+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221297f0 con 0x55b52207cdf0 2024-08-19T00:47:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.019+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v120'1039 uv1013 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.019+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b522129be0 con 0x55b52207cdf0 2024-08-19T00:47:38.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.021+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v120'1040 uv1040 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.021+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129be0 con 0x55b52207cdf0 2024-08-19T00:47:38.024 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:47:38.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.022+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v120'1041 uv1041 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.022+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.024+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v120'1042 uv1042 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.024+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.026+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v120'1043 uv1043 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.026+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.027+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v120'1044 uv1044 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.027+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.029+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v120'1045 uv1020 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.029+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.031+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v120'1046 uv1046 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.031+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.033 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:47:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.032+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v120'1047 uv1047 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.032+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.034+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v120'1048 uv1048 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.034+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.035+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v120'1049 uv1049 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.036+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522129b90 con 0x55b52207cdf0 2024-08-19T00:47:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.037+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v120'1050 uv1050 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.037+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.038+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v120'1051 uv1051 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.038+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.040+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v120'1052 uv1026 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.040+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.042+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v120'1053 uv1053 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.042+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:47:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.043+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v120'1054 uv1054 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.043+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212bbb0 con 0x55b52207cdf0 2024-08-19T00:47:38.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.045+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v120'1055 uv1055 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.045+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212bbb0 con 0x55b52207cdf0 2024-08-19T00:47:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.046+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v120'1056 uv1056 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.046+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.048+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v120'1057 uv1057 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.048+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.049+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v120'1058 uv1032 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.049+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.051+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v120'1059 uv1059 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.051+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.054 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:47:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.052+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v120'1060 uv1060 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.052+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212bbb0 con 0x55b52207cdf0 2024-08-19T00:47:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.054+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v120'1061 uv1061 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.054+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212bbb0 con 0x55b52207cdf0 2024-08-19T00:47:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.055+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v120'1062 uv1062 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.055+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212aba0 con 0x55b52207cdf0 2024-08-19T00:47:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.057+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v120'1063 uv1063 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.057+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52212b0b0 0x55b52212d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.057+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212d9e0 con 0x55b52212b0b0 2024-08-19T00:47:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.057+0000 7ffa37000640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52212b0b0 0x55b52212d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.058+0000 7ffa37000640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52212b0b0 0x55b52212d4a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.060+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v120'752 uv731 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.060+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52212dd80 con 0x55b52212b0b0 2024-08-19T00:47:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.061+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v120'753 uv753 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.061+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212e120 con 0x55b52212b0b0 2024-08-19T00:47:38.064 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:47:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.063+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v120'754 uv754 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.063+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212e4c0 con 0x55b52212b0b0 2024-08-19T00:47:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.064+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v120'755 uv755 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.064+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212e860 con 0x55b52212b0b0 2024-08-19T00:47:38.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.066+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v120'756 uv756 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.066+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212ec00 con 0x55b52212b0b0 2024-08-19T00:47:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.067+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v120'757 uv750 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.067+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52212efa0 con 0x55b52212b0b0 2024-08-19T00:47:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.069+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v120'758 uv758 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.069+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.072 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:47:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.070+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v120'759 uv759 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.070+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.072+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v120'760 uv760 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.072+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.074+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v120'761 uv761 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.074+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.075+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v120'762 uv751 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.075+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.077+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v120'763 uv763 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.077+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.079 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:47:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.078+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v120'764 uv764 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.078+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133a30 con 0x55b52212b0b0 2024-08-19T00:47:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.080+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v120'765 uv765 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.080+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133a30 con 0x55b52212b0b0 2024-08-19T00:47:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.081+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v120'766 uv766 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.081+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.083+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v120'767 uv747 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.083+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.084+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v120'768 uv768 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.084+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.087 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:47:38.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.086+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v120'769 uv769 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.086+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522130350 con 0x55b52212b0b0 2024-08-19T00:47:38.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.087+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v120'770 uv770 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.087+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522130350 con 0x55b52212b0b0 2024-08-19T00:47:38.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.088+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v120'771 uv771 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.089+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52212f340 con 0x55b52212b0b0 2024-08-19T00:47:38.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.090+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v120'772 uv772 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b52212b0b0 2024-08-19T00:47:38.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.090+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52212f850 0x55b522131c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.090+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221321c0 con 0x55b52212f850 2024-08-19T00:47:38.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.090+0000 7ffa36600640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52212f850 0x55b522131c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.091+0000 7ffa36600640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52212f850 0x55b522131c40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.092+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v120'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.092+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b5221326b0 con 0x55b52212f850 2024-08-19T00:47:38.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.093+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v120'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.093+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522132b90 con 0x55b52212f850 2024-08-19T00:47:38.096 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:47:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.095+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v120'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.095+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522134440 con 0x55b52212f850 2024-08-19T00:47:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.096+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v120'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.096+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221347e0 con 0x55b52212f850 2024-08-19T00:47:38.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.097+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v120'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.097+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133430 con 0x55b52212f850 2024-08-19T00:47:38.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.099+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v120'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.099+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133820 con 0x55b52207cdf0 2024-08-19T00:47:38.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.100+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v120'150 uv149 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.100+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b522133820 con 0x55b52207cdf0 2024-08-19T00:47:38.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.102+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v120'151 uv151 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.102+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133820 con 0x55b52207cdf0 2024-08-19T00:47:38.105 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:47:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.104+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v120'152 uv152 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.104+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133820 con 0x55b52207cdf0 2024-08-19T00:47:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.105+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v120'153 uv153 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.105+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b522134b80 0x55b522136f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.105+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221374b0 con 0x55b522134b80 2024-08-19T00:47:38.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.106+0000 7ffa37a00640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b522134b80 0x55b522136f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.106+0000 7ffa37a00640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b522134b80 0x55b522136f70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.108+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v120'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.108+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b5221374b0 con 0x55b522134b80 2024-08-19T00:47:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.109+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v120'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.109+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221374b0 con 0x55b522134b80 2024-08-19T00:47:38.112 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:47:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.111+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v120'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.111+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221384c0 con 0x55b522134b80 2024-08-19T00:47:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.112+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v120'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.112+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221384c0 con 0x55b522134b80 2024-08-19T00:47:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.114+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v120'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.114+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b5221374b0 con 0x55b522134b80 2024-08-19T00:47:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.115+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v120'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.115+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b522137b30 0x55b522139f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.115+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a460 con 0x55b522137b30 2024-08-19T00:47:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.115+0000 7ffa37000640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b522137b30 0x55b522139f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.116+0000 7ffa37000640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b522137b30 0x55b522139f20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.117+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v120'371 uv365 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.117+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a520 con 0x55b522137b30 2024-08-19T00:47:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.119+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v120'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.119+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a910 con 0x55b522137b30 2024-08-19T00:47:38.121 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:47:38.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.120+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v120'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.120+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213b920 con 0x55b522137b30 2024-08-19T00:47:38.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.121+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v120'374 uv374 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.122+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213b920 con 0x55b522137b30 2024-08-19T00:47:38.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.123+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v120'375 uv375 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.123+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a910 con 0x55b522137b30 2024-08-19T00:47:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.124+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v120'376 uv376 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.124+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a910 con 0x55b522137b30 2024-08-19T00:47:38.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.125+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v120'377 uv370 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.125+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a910 con 0x55b522137b30 2024-08-19T00:47:38.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.127+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v120'378 uv378 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.127+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a910 con 0x55b522137b30 2024-08-19T00:47:38.129 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:47:38.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.128+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v120'379 uv379 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.128+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a910 con 0x55b522137b30 2024-08-19T00:47:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.129+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v120'380 uv380 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.129+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213a910 con 0x55b522137b30 2024-08-19T00:47:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.131+0000 7ffa37000640 1 -- 172.21.15.7:0/1909431339 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v120'381 uv381 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa280119f0 con 0x55b522137b30 2024-08-19T00:47:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.131+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52213af90 0x55b52213d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.131+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213da00 con 0x55b52213af90 2024-08-19T00:47:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.131+0000 7ffa36600640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52213af90 0x55b52213d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.132+0000 7ffa36600640 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52213af90 0x55b52213d380 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.133+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v120'168 uv167 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.133+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213da00 con 0x55b52213af90 2024-08-19T00:47:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.134+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v120'169 uv169 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.134+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52213af90 2024-08-19T00:47:38.137 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:47:38.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.136+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v120'170 uv170 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.136+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52213af90 2024-08-19T00:47:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.137+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v120'171 uv171 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.137+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52213af90 2024-08-19T00:47:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.139+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v120'172 uv172 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.139+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52207cdf0 2024-08-19T00:47:38.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.140+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v120'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.140+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52207cdf0 2024-08-19T00:47:38.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.141+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v120'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.141+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52207cdf0 2024-08-19T00:47:38.144 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:47:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.142+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v120'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.143+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213ee30 con 0x55b52207cdf0 2024-08-19T00:47:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.144+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v120'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.144+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213ee30 con 0x55b52207cdf0 2024-08-19T00:47:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.145+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v120'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.145+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52207cdf0 2024-08-19T00:47:38.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.146+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v120'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b52207cdf0 2024-08-19T00:47:38.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.146+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52212f850 2024-08-19T00:47:38.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.148+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v120'335 uv329 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.148+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52212f850 2024-08-19T00:47:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.149+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v120'336 uv336 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.149+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213de20 con 0x55b52212f850 2024-08-19T00:47:38.152 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:47:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.150+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v120'337 uv337 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.150+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133020 con 0x55b52212f850 2024-08-19T00:47:38.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.152+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v120'338 uv338 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.152+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133020 con 0x55b52212f850 2024-08-19T00:47:38.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.154+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v120'339 uv339 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.154+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133020 con 0x55b52212f850 2024-08-19T00:47:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.155+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v120'340 uv334 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.155+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b522133020 con 0x55b52212f850 2024-08-19T00:47:38.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.156+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v120'341 uv341 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.156+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133020 con 0x55b52212f850 2024-08-19T00:47:38.159 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:47:38.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.158+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v120'342 uv342 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.158+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522133020 con 0x55b52212f850 2024-08-19T00:47:38.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.159+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v120'343 uv343 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.160+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b522140c30 con 0x55b52212f850 2024-08-19T00:47:38.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.161+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v120'344 uv344 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52212f850 2024-08-19T00:47:38.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.161+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.163+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v120'147 uv145 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.164+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.166+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v120'148 uv148 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.166+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.169 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:47:38.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.168+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v120'149 uv149 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.168+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.169+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v120'150 uv150 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.169+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.170+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v120'201 uv200 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.170+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.172+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v120'202 uv202 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.172+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.174 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:47:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.173+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v120'203 uv203 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.173+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213f2e0 con 0x55b522134b80 2024-08-19T00:47:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.175+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v120'204 uv204 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.175+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213f2e0 con 0x55b522134b80 2024-08-19T00:47:38.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.176+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v120'205 uv205 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.176+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b522134b80 2024-08-19T00:47:38.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.177+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v120'206 uv206 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa30005040 con 0x55b522134b80 2024-08-19T00:47:38.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.177+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.179+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v120'171 uv170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.179+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.180+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v120'172 uv172 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.180+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.183 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:47:38.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.181+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v120'173 uv173 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.181+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.182+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v120'174 uv174 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.183+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.184+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v120'175 uv175 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.184+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.186+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v120'416 uv406 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.186+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.187+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v120'417 uv417 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.187+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.189 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:47:38.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.188+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v120'418 uv418 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.188+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.190+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v120'419 uv419 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.190+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.191+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v120'420 uv420 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.191+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.192+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v120'421 uv414 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.192+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.193+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v120'422 uv422 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.194+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.196 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:47:38.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.195+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v120'423 uv423 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.195+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213f2e0 con 0x55b52213af90 2024-08-19T00:47:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.196+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v120'424 uv424 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.196+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213f2e0 con 0x55b52213af90 2024-08-19T00:47:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.197+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v120'425 uv425 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.197+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e2d0 con 0x55b52213af90 2024-08-19T00:47:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.198+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v120'426 uv426 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.199+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x55b52213e830 con 0x55b52213af90 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa36600640 1 -- 172.21.15.7:0/1909431339 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v120'427 uv427 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7ffa24022070 con 0x55b52213af90 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52212b0b0 msgr2=0x55b52212d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55b52212b0b0 0x55b52212d4a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b522137b30 msgr2=0x55b522139f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55b522137b30 0x55b522139f20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52213af90 msgr2=0x55b52213d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55b52213af90 0x55b52213d380 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52212f850 msgr2=0x55b522131c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55b52212f850 0x55b522131c40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 reap_dead start 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52207cdf0 msgr2=0x55b52207d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55b52207cdf0 0x55b52207d1d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa37a00640 1 -- 172.21.15.7:0/1909431339 reap_dead start 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b522134b80 msgr2=0x55b522136f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b522134b80 0x55b522136f70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa1806a810 msgr2=0x7ffa1806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa1806a810 0x7ffa1806ccd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ffa28000c00 tx=0x7ffa28001e40 comp rx=0 tx=0).stop 2024-08-19T00:47:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 msgr2=0x55b5220783c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b5220783c0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e580 tx=0x7ffa2400ea40 comp rx=0 tx=0).stop 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 shutdown_connections 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ffa1806a810 0x7ffa1806ccd0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b522082b90 0x55b5220783c0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 --2- 172.21.15.7:0/1909431339 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55b522134b80 0x55b522136f70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 >> 172.21.15.7:0/1909431339 conn(0x55b521fde4e0 msgr2=0x55b522080c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 shutdown_connections 2024-08-19T00:47:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.200+0000 7ffa39e19f40 1 -- 172.21.15.7:0/1909431339 wait complete. 2024-08-19T00:47:38.207 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 10000000000.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:47:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.323+0000 7f850eb97f40 1 Processor -- start 2024-08-19T00:47:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.323+0000 7f850eb97f40 1 -- start start 2024-08-19T00:47:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850eb97f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dcfd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850eb97f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd005b0 0x56232dcfb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850eb97f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd00990 0x56232dd9d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850eb97f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56232dc74d00 con 0x56232dd00990 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850eb97f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56232dc78d40 con 0x56232dcfef40 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850eb97f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56232dda5dc0 con 0x56232dd005b0 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850c800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd00990 0x56232dd9d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850c800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd00990 0x56232dd9d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36438/0 (socket says 172.21.15.7:36438) 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850c800640 1 -- 172.21.15.7:0/53961970 learned_addr learned my addr 172.21.15.7:0/53961970 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850b400640 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd005b0 0x56232dcfb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.324+0000 7f850be00640 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dcfd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850c800640 1 -- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd005b0 msgr2=0x56232dcfb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850c800640 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd005b0 0x56232dcfb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850c800640 1 -- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 msgr2=0x56232dcfd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850c800640 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dcfd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850c800640 1 -- 172.21.15.7:0/53961970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232dc36080 con 0x56232dd00990 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850b400640 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd005b0 0x56232dcfb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850be00640 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dcfd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850c800640 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd00990 0x56232dd9d9d0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f85040016a0 tx=0x7f8504001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2cc2eff6b1db03 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850a000640 1 -- 172.21.15.7:0/53961970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504003650 con 0x56232dd00990 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850a000640 1 -- 172.21.15.7:0/53961970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85040037f0 con 0x56232dd00990 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.325+0000 7f850a000640 1 -- 172.21.15.7:0/53961970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504003ba0 con 0x56232dd00990 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 -- 172.21.15.7:0/53961970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd00990 msgr2=0x56232dd9d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd00990 0x56232dd9d9d0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f85040016a0 tx=0x7f8504001b60 comp rx=0 tx=0).stop 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 -- 172.21.15.7:0/53961970 shutdown_connections 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd00990 0x56232dd9d9d0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd005b0 0x56232dcfb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 --2- 172.21.15.7:0/53961970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dcfd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 -- 172.21.15.7:0/53961970 >> 172.21.15.7:0/53961970 conn(0x56232dcfd4e0 msgr2=0x56232dd1aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 -- 172.21.15.7:0/53961970 shutdown_connections 2024-08-19T00:47:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 -- 172.21.15.7:0/53961970 wait complete. 2024-08-19T00:47:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.326+0000 7f850eb97f40 1 Processor -- start 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.327+0000 7f850eb97f40 1 -- start start 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.327+0000 7f850eb97f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dd95df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.327+0000 7f850eb97f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd005b0 0x56232dd9fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.327+0000 7f850eb97f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd00990 0x56232dda4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.327+0000 7f850eb97f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56232dd9e670 con 0x56232dd005b0 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.327+0000 7f850eb97f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56232dd9b0a0 con 0x56232dcfef40 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.327+0000 7f850eb97f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56232dda6be0 con 0x56232dd00990 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd005b0 0x56232dd9fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd005b0 0x56232dd9fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36452/0 (socket says 172.21.15.7:36452) 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 -- 172.21.15.7:0/479913272 learned_addr learned my addr 172.21.15.7:0/479913272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850be00640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dd95df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850c800640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd00990 0x56232dda4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 -- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd00990 msgr2=0x56232dda4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56232dd00990 0x56232dda4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 -- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 msgr2=0x56232dd95df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56232dcfef40 0x56232dd95df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 -- 172.21.15.7:0/479913272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232dd999f0 con 0x56232dd005b0 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.328+0000 7f850b400640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd005b0 0x56232dd9fe50 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f84f8000c00 tx=0x7f84f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.329+0000 7f8508c00640 1 -- 172.21.15.7:0/479913272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f806b070 con 0x56232dd005b0 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.329+0000 7f8508c00640 1 -- 172.21.15.7:0/479913272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f8051bf0 con 0x56232dd005b0 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.329+0000 7f8508c00640 1 -- 172.21.15.7:0/479913272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f805a450 con 0x56232dd005b0 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.329+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56232dd99cd0 con 0x56232dd005b0 2024-08-19T00:47:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.329+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56232dd98510 con 0x56232dd005b0 2024-08-19T00:47:38.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.331+0000 7f8508c00640 1 -- 172.21.15.7:0/479913272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84f806e070 con 0x56232dd005b0 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.331+0000 7f8508c00640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84ec06a840 0x7f84ec06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.332+0000 7f8508c00640 1 -- 172.21.15.7:0/479913272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f84f80ce540 con 0x56232dd005b0 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.332+0000 7f850be00640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84ec06a840 0x7f84ec06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.332+0000 7f850eb97f40 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56232dda51b0 0x56232dd98a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.332+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x56232dd98f70 con 0x56232dda51b0 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.332+0000 7f850c800640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56232dda51b0 0x56232dd98a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.332+0000 7f850be00640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84ec06a840 0x7f84ec06cd00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x56232dcfb450 tx=0x7f84fc003870 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.333+0000 7f850c800640 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56232dda51b0 0x56232dd98a30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850c800640 1 -- 172.21.15.7:0/479913272 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-header] v120'1064 uv1064 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f850400f070 con 0x56232dda51b0 2024-08-19T00:47:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56232dda51b0 msgr2=0x56232dd98a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56232dda51b0 0x56232dd98a30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84ec06a840 msgr2=0x7f84ec06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f84ec06a840 0x7f84ec06cd00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x56232dcfb450 tx=0x7f84fc003870 comp rx=0 tx=0).stop 2024-08-19T00:47:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd005b0 msgr2=0x56232dd9fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 --2- 172.21.15.7:0/479913272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56232dd005b0 0x56232dd9fe50 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f84f8000c00 tx=0x7f84f8002fb0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850c800640 1 -- 172.21.15.7:0/479913272 reap_dead start 2024-08-19T00:47:38.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 shutdown_connections 2024-08-19T00:47:38.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 >> 172.21.15.7:0/479913272 conn(0x56232dcfd4e0 msgr2=0x56232dda6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 shutdown_connections 2024-08-19T00:47:38.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.335+0000 7f850eb97f40 1 -- 172.21.15.7:0/479913272 wait complete. 2024-08-19T00:47:38.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:47:38.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.500+0000 7f610a800640 1 Processor -- start 2024-08-19T00:47:38.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.500+0000 7f610a800640 1 -- start start 2024-08-19T00:47:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.501+0000 7f610a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6104147d40 0x7f610406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.501+0000 7f610a800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610406d8b0 con 0x7f61040b55e0 2024-08-19T00:47:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.501+0000 7f610a800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610406db90 con 0x7f6104070320 2024-08-19T00:47:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.501+0000 7f610a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f610406e150 con 0x7f6104147d40 2024-08-19T00:47:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.501+0000 7f6108a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f61040b55e0 0x7f610406fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35164/0 (socket says 172.21.15.7:35164) 2024-08-19T00:47:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.501+0000 7f6108a00640 1 -- 172.21.15.7:0/2502554333 learned_addr learned my addr 172.21.15.7:0/2502554333 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.502+0000 7f6109400640 1 --2- 172.21.15.7:0/2502554333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6104147d40 0x7f610406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.502+0000 7f6103e00640 1 -- 172.21.15.7:0/2502554333 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587978922 0 0) 0x7f610406d8b0 con 0x7f61040b55e0 2024-08-19T00:47:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.502+0000 7f6103e00640 1 -- 172.21.15.7:0/2502554333 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60ec003520 con 0x7f61040b55e0 2024-08-19T00:47:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.502+0000 7f6103e00640 1 -- 172.21.15.7:0/2502554333 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830613390 0 0) 0x7f610406db90 con 0x7f6104070320 2024-08-19T00:47:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.502+0000 7f6109400640 1 -- 172.21.15.7:0/2502554333 >> v1:172.21.15.162:6789/0 conn(0x7f6104070320 legacy=0x7f610415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.502+0000 7f6109400640 1 -- 172.21.15.7:0/2502554333 >> v1:172.21.15.7:6789/0 conn(0x7f61040b55e0 legacy=0x7f610406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.502+0000 7f6109400640 1 -- 172.21.15.7:0/2502554333 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610406de70 con 0x7f6104147d40 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.503+0000 7f6109400640 1 --2- 172.21.15.7:0/2502554333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6104147d40 0x7f610406d240 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f60f80097d0 tx=0x7f60f802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb276719c330588 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f6103e00640 1 -- 172.21.15.7:0/2502554333 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8037070 con 0x7f6104147d40 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f6103e00640 1 -- 172.21.15.7:0/2502554333 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8032440 con 0x7f6104147d40 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f6103e00640 1 -- 172.21.15.7:0/2502554333 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8032810 con 0x7f6104147d40 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f610a800640 1 -- 172.21.15.7:0/2502554333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6104147d40 msgr2=0x7f610406d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f610a800640 1 --2- 172.21.15.7:0/2502554333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6104147d40 0x7f610406d240 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f60f80097d0 tx=0x7f60f802a180 comp rx=0 tx=0).stop 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f610a800640 1 -- 172.21.15.7:0/2502554333 shutdown_connections 2024-08-19T00:47:38.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f610a800640 1 --2- 172.21.15.7:0/2502554333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6104147d40 0x7f610406d240 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f610a800640 1 -- 172.21.15.7:0/2502554333 >> 172.21.15.7:0/2502554333 conn(0x7f61040d1fa0 msgr2=0x7f61040d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f610a800640 1 -- 172.21.15.7:0/2502554333 shutdown_connections 2024-08-19T00:47:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.504+0000 7f610a800640 1 -- 172.21.15.7:0/2502554333 wait complete. 2024-08-19T00:47:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.506+0000 7f610a800640 1 Processor -- start 2024-08-19T00:47:38.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.506+0000 7f610a800640 1 -- start start 2024-08-19T00:47:38.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f610a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6104070320 0x7f6104140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f610a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61040b55e0 0x7f61041f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f610a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6104147d40 0x7f61041f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f610a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61040b5b80 con 0x7f6104070320 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f610a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61040b5a00 con 0x7f6104147d40 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f610a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f610415f670 con 0x7f61040b55e0 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f6109400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6104070320 0x7f6104140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f6109400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6104070320 0x7f6104140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36464/0 (socket says 172.21.15.7:36464) 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f6109400640 1 -- 172.21.15.7:0/3261097727 learned_addr learned my addr 172.21.15.7:0/3261097727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f6108a00640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61040b55e0 0x7f61041f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.507+0000 7f6109e00640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6104147d40 0x7f61041f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6109400640 1 -- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61040b55e0 msgr2=0x7f61041f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6109400640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61040b55e0 0x7f61041f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6109400640 1 -- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6104147d40 msgr2=0x7f61041f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6109400640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6104147d40 0x7f61041f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6109400640 1 -- 172.21.15.7:0/3261097727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61041f5d70 con 0x7f6104070320 2024-08-19T00:47:38.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6109400640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6104070320 0x7f6104140990 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6101600640 1 -- 172.21.15.7:0/3261097727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8037050 con 0x7f6104070320 2024-08-19T00:47:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6101600640 1 -- 172.21.15.7:0/3261097727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8043070 con 0x7f6104070320 2024-08-19T00:47:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f6101600640 1 -- 172.21.15.7:0/3261097727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f803cb10 con 0x7f6104070320 2024-08-19T00:47:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.508+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61041f6050 con 0x7f6104070320 2024-08-19T00:47:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.509+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61041f6610 con 0x7f6104070320 2024-08-19T00:47:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.510+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610406d240 con 0x7f6104070320 2024-08-19T00:47:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.511+0000 7f6101600640 1 -- 172.21.15.7:0/3261097727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60f803ccb0 con 0x7f6104070320 2024-08-19T00:47:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.511+0000 7f6101600640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60e406be30 0x7f60e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.511+0000 7f6101600640 1 -- 172.21.15.7:0/3261097727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f60f80ac530 con 0x7f6104070320 2024-08-19T00:47:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.512+0000 7f6108a00640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60e406be30 0x7f60e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.512+0000 7f6108a00640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60e406be30 0x7f60e406e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f60f0005880 tx=0x7f60f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.516+0000 7f6101600640 1 -- 172.21.15.7:0/3261097727 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f60f8079df0 con 0x7f6104070320 2024-08-19T00:47:38.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.735+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f61041f5a80 con 0x7f6104070320 2024-08-19T00:47:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.863+0000 7f6101600640 1 -- 172.21.15.7:0/3261097727 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v296) ==== 162+0+0 (secure 0 0 0) 0x7f60f807e0f0 con 0x7f6104070320 2024-08-19T00:47:38.865 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:47:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60e406be30 msgr2=0x7f60e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60e406be30 0x7f60e406e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f60f0005880 tx=0x7f60f0009040 comp rx=0 tx=0).stop 2024-08-19T00:47:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6104070320 msgr2=0x7f6104140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6104070320 0x7f6104140990 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f80046c0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 shutdown_connections 2024-08-19T00:47:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60e406be30 0x7f60e406e2f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6104147d40 0x7f61041f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61040b55e0 0x7f61041f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 --2- 172.21.15.7:0/3261097727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6104070320 0x7f6104140990 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 >> 172.21.15.7:0/3261097727 conn(0x7f61040d1fa0 msgr2=0x7f61040b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 shutdown_connections 2024-08-19T00:47:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:38.865+0000 7f610a800640 1 -- 172.21.15.7:0/3261097727 wait complete. 2024-08-19T00:47:39.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:39.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.448+0000 7f06e5800640 1 Processor -- start 2024-08-19T00:47:39.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.448+0000 7f06e5800640 1 -- start start 2024-08-19T00:47:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.449+0000 7f06e5800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 0x7f06e0165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.449+0000 7f06e5800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e015e930 con 0x7f06e0140640 2024-08-19T00:47:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.449+0000 7f06e5800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e015ec10 con 0x7f06e013dc30 2024-08-19T00:47:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.449+0000 7f06e5800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06e01413f0 con 0x7f06e006dd10 2024-08-19T00:47:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.449+0000 7f06df400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f06e0140640 0x7f06e006d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35166/0 (socket says 172.21.15.7:35166) 2024-08-19T00:47:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.449+0000 7f06df400640 1 -- 172.21.15.7:0/3135732302 learned_addr learned my addr 172.21.15.7:0/3135732302 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06e4e00640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 0x7f06e0165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995273044 0 0) 0x7f06e015e930 con 0x7f06e0140640 2024-08-19T00:47:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c4003520 con 0x7f06e0140640 2024-08-19T00:47:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2442509418 0 0) 0x7f06c4003520 con 0x7f06e0140640 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 msgr2=0x7f06e0165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 0x7f06e0165cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 >> v1:172.21.15.162:6789/0 conn(0x7f06e013dc30 legacy=0x7f06e0140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e015eef0 con 0x7f06e0140640 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f06cc001670 con 0x7f06e0140640 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 >> v1:172.21.15.7:6789/0 conn(0x7f06e0140640 legacy=0x7f06e006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 0x7f06c40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c4003f60 0x7f06c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4004d40 0x7f06c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01413f0 con 0x7f06c4003f60 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06c400dcb0 con 0x7f06c4004d40 2024-08-19T00:47:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.450+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06c400deb0 con 0x7f06e006dd10 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06df400640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c4003f60 0x7f06c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06e4e00640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4004d40 0x7f06c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06dfe00640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 0x7f06c40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06df400640 1 -- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 msgr2=0x7f06c40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06df400640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e006dd10 0x7f06c40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06df400640 1 -- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4004d40 msgr2=0x7f06c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06df400640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4004d40 0x7f06c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.451+0000 7f06df400640 1 -- 172.21.15.7:0/3135732302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c4003520 con 0x7f06c4003f60 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.452+0000 7f06df400640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c4003f60 0x7f06c4004800 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c210 tx=0x7f06c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93dda37028b5f197 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.452+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc007d10 con 0x7f06c4003f60 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.452+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0058d0 con 0x7f06c4003f60 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.452+0000 7f06dea00640 1 -- 172.21.15.7:0/3135732302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc005d20 con 0x7f06c4003f60 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.453+0000 7f06e5800640 1 -- 172.21.15.7:0/3135732302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c4003f60 msgr2=0x7f06c4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.453+0000 7f06e5800640 1 --2- 172.21.15.7:0/3135732302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c4003f60 0x7f06c4004800 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c210 tx=0x7f06c4005830 comp rx=0 tx=0).stop 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.453+0000 7f06e4e00640 1 -- 172.21.15.7:0/3135732302 reap_dead start 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.453+0000 7f06e5800640 1 -- 172.21.15.7:0/3135732302 shutdown_connections 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.453+0000 7f06e5800640 1 -- 172.21.15.7:0/3135732302 >> 172.21.15.7:0/3135732302 conn(0x7f06e006b850 msgr2=0x7f06e006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.453+0000 7f06e5800640 1 -- 172.21.15.7:0/3135732302 shutdown_connections 2024-08-19T00:47:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.453+0000 7f06e5800640 1 -- 172.21.15.7:0/3135732302 wait complete. 2024-08-19T00:47:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.455+0000 7f06e5800640 1 Processor -- start 2024-08-19T00:47:39.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.455+0000 7f06e5800640 1 -- start start 2024-08-19T00:47:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4003f60 0x7f06e01539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e5800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b4c70 0x7f06e013b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e01540a0 0x7f06e00b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e5800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06e013e010 con 0x7f06e01540a0 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e5800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06e015f260 con 0x7f06c4003f60 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e5800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06e013e190 con 0x7f06e00b4c70 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e01540a0 0x7f06e00b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e01540a0 0x7f06e00b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36484/0 (socket says 172.21.15.7:36484) 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 -- 172.21.15.7:0/2300537500 learned_addr learned my addr 172.21.15.7:0/2300537500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06dfe00640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4003f60 0x7f06e01539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06df400640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b4c70 0x7f06e013b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 -- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b4c70 msgr2=0x7f06e013b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b4c70 0x7f06e013b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 -- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4003f60 msgr2=0x7f06e01539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4003f60 0x7f06e01539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.456+0000 7f06e4e00640 1 -- 172.21.15.7:0/2300537500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e01e6930 con 0x7f06e01540a0 2024-08-19T00:47:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.457+0000 7f06e4e00640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e01540a0 0x7f06e00b37e0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f06e00afb80 tx=0x7f06d800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.457+0000 7f06d7e00640 1 -- 172.21.15.7:0/2300537500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d800fde0 con 0x7f06e01540a0 2024-08-19T00:47:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.457+0000 7f06d7e00640 1 -- 172.21.15.7:0/2300537500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d801d070 con 0x7f06e01540a0 2024-08-19T00:47:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.457+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e01e6c10 con 0x7f06e01540a0 2024-08-19T00:47:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.457+0000 7f06d7e00640 1 -- 172.21.15.7:0/2300537500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8015670 con 0x7f06e01540a0 2024-08-19T00:47:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.457+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e01e6450 con 0x7f06e01540a0 2024-08-19T00:47:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.458+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e00cfa30 con 0x7f06e01540a0 2024-08-19T00:47:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.459+0000 7f06d7e00640 1 -- 172.21.15.7:0/2300537500 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06d8015810 con 0x7f06e01540a0 2024-08-19T00:47:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.460+0000 7f06d7e00640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.460+0000 7f06d7e00640 1 -- 172.21.15.7:0/2300537500 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f06d808c420 con 0x7f06e01540a0 2024-08-19T00:47:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.460+0000 7f06dfe00640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.461+0000 7f06dfe00640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06c006be30 0x7f06c006e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f06d00035f0 tx=0x7f06d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.464+0000 7f06d7e00640 1 -- 172.21.15.7:0/2300537500 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f06d8010040 con 0x7f06e01540a0 2024-08-19T00:47:39.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.683+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06e006e520 con 0x7f06e01540a0 2024-08-19T00:47:39.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.684+0000 7f06d7e00640 1 -- 172.21.15.7:0/2300537500 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 297 v297) ==== 95+0+5222 (secure 0 0 0) 0x7f06d805a210 con 0x7f06e01540a0 2024-08-19T00:47:39.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:39.686 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":297,"btime":"2024-08-19T00:47:38:865697+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":297,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:38.865686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":297,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/978981940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":978981940},{"type":"v1","addr":"172.21.15.7:6837","nonce":978981940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:39.686 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 297 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06c006be30 msgr2=0x7f06c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06c006be30 0x7f06c006e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f06d00035f0 tx=0x7f06d0009040 comp rx=0 tx=0).stop 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e01540a0 msgr2=0x7f06e00b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e01540a0 0x7f06e00b37e0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f06e00afb80 tx=0x7f06d800f580 comp rx=0 tx=0).stop 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 shutdown_connections 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06e01540a0 0x7f06e00b37e0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e00b4c70 0x7f06e013b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 --2- 172.21.15.7:0/2300537500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06c4003f60 0x7f06e01539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 >> 172.21.15.7:0/2300537500 conn(0x7f06e006b850 msgr2=0x7f06e0159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 shutdown_connections 2024-08-19T00:47:39.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:39.686+0000 7f06e5800640 1 -- 172.21.15.7:0/2300537500 wait complete. 2024-08-19T00:47:39.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 297, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:47:38.865686+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9864}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9864': {'gid': 9864, 'name': 'a', 'rank': 0, 'incarnation': 297, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/978981940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 978981940}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 978981940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:47:39.703 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9864:up:replay 2024-08-19T00:47:39.704 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:47:42.864 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:42.862+0000 7f881b800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:45.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.274+0000 7f2fbac00640 1 Processor -- start 2024-08-19T00:47:45.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.275+0000 7f2fbac00640 1 -- start start 2024-08-19T00:47:45.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fbac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb40d03c0 0x7f2fb4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fbac00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fb406e710 0x7f2fb40d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fbac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb40d0ce0 con 0x7f2fb40b3750 2024-08-19T00:47:45.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fbac00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb40cebc0 con 0x7f2fb406e710 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fbac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb40cdfb0 con 0x7f2fb40d03c0 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fab400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fb406e710 0x7f2fb40d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fab400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fb406e710 0x7f2fb40d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49270/0 (socket says 172.21.15.7:49270) 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fab400640 1 -- 172.21.15.7:0/3561325942 learned_addr learned my addr 172.21.15.7:0/3561325942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.276+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3561325942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb40d03c0 0x7f2fb4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.277+0000 7f2fab400640 1 -- 172.21.15.7:0/3561325942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb40d03c0 msgr2=0x7f2fb4071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.277+0000 7f2fab400640 1 --2- 172.21.15.7:0/3561325942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb40d03c0 0x7f2fb4071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.277+0000 7f2fab400640 1 -- 172.21.15.7:0/3561325942 >> v1:172.21.15.162:6789/0 conn(0x7f2fb40b3750 legacy=0x7f2fb40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.277+0000 7f2fab400640 1 -- 172.21.15.7:0/3561325942 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb40ce290 con 0x7f2fb406e710 2024-08-19T00:47:45.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.278+0000 7f2fab400640 1 --2- 172.21.15.7:0/3561325942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb406e710 0x7f2fb40d07a0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009870 tx=0x7f2f9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69549b39bde4ff68 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.278+0000 7f2fb3400640 1 -- 172.21.15.7:0/3561325942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c037070 con 0x7f2fb406e710 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.278+0000 7f2fb3400640 1 -- 172.21.15.7:0/3561325942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c032440 con 0x7f2fb406e710 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.278+0000 7f2fb3400640 1 -- 172.21.15.7:0/3561325942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c032810 con 0x7f2fb406e710 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 -- 172.21.15.7:0/3561325942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb406e710 msgr2=0x7f2fb40d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3561325942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb406e710 0x7f2fb40d07a0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009870 tx=0x7f2f9c02a270 comp rx=0 tx=0).stop 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 -- 172.21.15.7:0/3561325942 shutdown_connections 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3561325942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb406e710 0x7f2fb40d07a0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3561325942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb40d03c0 0x7f2fb4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 -- 172.21.15.7:0/3561325942 >> 172.21.15.7:0/3561325942 conn(0x7f2fb406bc70 msgr2=0x7f2fb406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 -- 172.21.15.7:0/3561325942 shutdown_connections 2024-08-19T00:47:45.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.279+0000 7f2fbac00640 1 -- 172.21.15.7:0/3561325942 wait complete. 2024-08-19T00:47:45.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.280+0000 7f2fbac00640 1 Processor -- start 2024-08-19T00:47:45.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.281+0000 7f2fbac00640 1 -- start start 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.281+0000 7f2fbac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406e710 0x7f2fb4144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.281+0000 7f2fbac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40b3750 0x7f2fb40ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.281+0000 7f2fbac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d03c0 0x7f2fb415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.281+0000 7f2fbac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb4073ae0 con 0x7f2fb40d03c0 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.281+0000 7f2fbac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb40ce850 con 0x7f2fb40b3750 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.281+0000 7f2fbac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb4073c60 con 0x7f2fb406e710 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d03c0 0x7f2fb415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d03c0 0x7f2fb415a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49278/0 (socket says 172.21.15.7:49278) 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 -- 172.21.15.7:0/3820752131 learned_addr learned my addr 172.21.15.7:0/3820752131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406e710 0x7f2fb4144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fab400640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40b3750 0x7f2fb40ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 -- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406e710 msgr2=0x7f2fb4144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406e710 0x7f2fb4144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 -- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40b3750 msgr2=0x7f2fb40ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40b3750 0x7f2fb40ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.282+0000 7f2fb8c00640 1 -- 172.21.15.7:0/3820752131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb41f7f60 con 0x7f2fb40d03c0 2024-08-19T00:47:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.283+0000 7f2fb8c00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d03c0 0x7f2fb415a7e0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c7a0 tx=0x7f2fac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.283+0000 7f2fb0c00640 1 -- 172.21.15.7:0/3820752131 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac003b70 con 0x7f2fb40d03c0 2024-08-19T00:47:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.283+0000 7f2fb0c00640 1 -- 172.21.15.7:0/3820752131 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fac003d30 con 0x7f2fb40d03c0 2024-08-19T00:47:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.283+0000 7f2fb0c00640 1 -- 172.21.15.7:0/3820752131 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00aa90 con 0x7f2fb40d03c0 2024-08-19T00:47:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.283+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb41f8240 con 0x7f2fb40d03c0 2024-08-19T00:47:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.283+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb41f8800 con 0x7f2fb40d03c0 2024-08-19T00:47:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.284+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb40b3be0 con 0x7f2fb40d03c0 2024-08-19T00:47:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.285+0000 7f2fb0c00640 1 -- 172.21.15.7:0/3820752131 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fac00ac30 con 0x7f2fb40d03c0 2024-08-19T00:47:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.286+0000 7f2fb0c00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9006be30 0x7f2f9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.286+0000 7f2fb0c00640 1 -- 172.21.15.7:0/3820752131 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f2fac08b820 con 0x7f2fb40d03c0 2024-08-19T00:47:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.286+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9006be30 0x7f2f9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.287+0000 7f2fb3e00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9006be30 0x7f2f9006e2f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009b40 tx=0x7f2fa4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.290+0000 7f2fb0c00640 1 -- 172.21.15.7:0/3820752131 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2fac058ff0 con 0x7f2fb40d03c0 2024-08-19T00:47:45.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.512+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fb4152980 con 0x7f2fb40d03c0 2024-08-19T00:47:45.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.512+0000 7f2fb0c00640 1 -- 172.21.15.7:0/3820752131 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 300 v300) ==== 95+0+5229 (secure 0 0 0) 0x7f2fac05d2f0 con 0x7f2fb40d03c0 2024-08-19T00:47:45.514 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:45.515 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":300,"btime":"2024-08-19T00:47:41:881178+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":300,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:41.881171+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9864":{"gid":9864,"name":"a","rank":0,"incarnation":297,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/978981940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":978981940},{"type":"v1","addr":"172.21.15.7:6837","nonce":978981940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9864,"qdb_cluster":[9864]},"id":6}]} 2024-08-19T00:47:45.515 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 300 2024-08-19T00:47:45.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.514+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9006be30 msgr2=0x7f2f9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.514+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9006be30 0x7f2f9006e2f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009b40 tx=0x7f2fa4009190 comp rx=0 tx=0).stop 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.514+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d03c0 msgr2=0x7f2fb415a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.514+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d03c0 0x7f2fb415a7e0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c7a0 tx=0x7f2fac00cc60 comp rx=0 tx=0).stop 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 shutdown_connections 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2f9006be30 0x7f2f9006e2f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fb40d03c0 0x7f2fb415a7e0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40b3750 0x7f2fb40ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 --2- 172.21.15.7:0/3820752131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406e710 0x7f2fb4144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 >> 172.21.15.7:0/3820752131 conn(0x7f2fb406bc70 msgr2=0x7f2fb40b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 shutdown_connections 2024-08-19T00:47:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.515+0000 7f2fbac00640 1 -- 172.21.15.7:0/3820752131 wait complete. 2024-08-19T00:47:45.533 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 300, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:47:41.881171+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9864}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9864': {'gid': 9864, 'name': 'a', 'rank': 0, 'incarnation': 297, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/978981940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 978981940}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 978981940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9864, 'qdb_cluster': [9864]} 2024-08-19T00:47:45.533 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:47:45.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:47:45.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.689+0000 7f4024200640 1 Processor -- start 2024-08-19T00:47:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.690+0000 7f4024200640 1 -- start start 2024-08-19T00:47:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4024200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0d03c0 0x7f401c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4024200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f401c06e710 0x7f401c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4024200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f401c0d0ce0 con 0x7f401c0b3750 2024-08-19T00:47:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4024200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f401c0cebc0 con 0x7f401c06e710 2024-08-19T00:47:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4024200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f401c0cdfb0 con 0x7f401c0d03c0 2024-08-19T00:47:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4022200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f401c0b3750 0x7f401c0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35124/0 (socket says 172.21.15.7:35124) 2024-08-19T00:47:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4022200640 1 -- 172.21.15.7:0/1739746440 learned_addr learned my addr 172.21.15.7:0/1739746440 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4020e00640 1 --2- 172.21.15.7:0/1739746440 >> v2:172.21.15.162:3300/0 conn(0x7f401c06e710 0x7f401c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.691+0000 7f4021800640 1 --2- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0d03c0 0x7f401c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.692+0000 7f401be00640 1 -- 172.21.15.7:0/1739746440 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158044950 0 0) 0x7f401c0d0ce0 con 0x7f401c0b3750 2024-08-19T00:47:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.692+0000 7f401be00640 1 -- 172.21.15.7:0/1739746440 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4004003520 con 0x7f401c0b3750 2024-08-19T00:47:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.692+0000 7f4020e00640 1 -- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0d03c0 msgr2=0x7f401c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.692+0000 7f4020e00640 1 --2- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0d03c0 0x7f401c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.692+0000 7f4020e00640 1 -- 172.21.15.7:0/1739746440 >> v1:172.21.15.7:6789/0 conn(0x7f401c0b3750 legacy=0x7f401c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.692+0000 7f401be00640 1 -- 172.21.15.7:0/1739746440 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1523414097 0 0) 0x7f4004003520 con 0x7f401c0b3750 2024-08-19T00:47:45.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.692+0000 7f4020e00640 1 -- 172.21.15.7:0/1739746440 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401c0ce290 con 0x7f401c06e710 2024-08-19T00:47:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.693+0000 7f4020e00640 1 --2- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c06e710 0x7f401c0d07a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f40080097a0 tx=0x7f400802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44efdcb2ab467068 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.693+0000 7f401be00640 1 -- 172.21.15.7:0/1739746440 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008037070 con 0x7f401c06e710 2024-08-19T00:47:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.693+0000 7f401be00640 1 -- 172.21.15.7:0/1739746440 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400802aba0 con 0x7f401c06e710 2024-08-19T00:47:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.693+0000 7f401be00640 1 -- 172.21.15.7:0/1739746440 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40140019f0 con 0x7f401c06e710 2024-08-19T00:47:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 -- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c06e710 msgr2=0x7f401c0d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 --2- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c06e710 0x7f401c0d07a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f40080097a0 tx=0x7f400802a110 comp rx=0 tx=0).stop 2024-08-19T00:47:45.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 -- 172.21.15.7:0/1739746440 shutdown_connections 2024-08-19T00:47:45.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 --2- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c06e710 0x7f401c0d07a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 --2- 172.21.15.7:0/1739746440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0d03c0 0x7f401c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 -- 172.21.15.7:0/1739746440 >> 172.21.15.7:0/1739746440 conn(0x7f401c06bc70 msgr2=0x7f401c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 -- 172.21.15.7:0/1739746440 shutdown_connections 2024-08-19T00:47:45.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.694+0000 7f4024200640 1 -- 172.21.15.7:0/1739746440 wait complete. 2024-08-19T00:47:45.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.696+0000 7f4024200640 1 Processor -- start 2024-08-19T00:47:45.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.696+0000 7f4024200640 1 -- start start 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4024200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c06e710 0x7f401c099ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4024200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0b3750 0x7f401c154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4024200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c0d03c0 0x7f401c154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4024200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f401c073ae0 con 0x7f401c06e710 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4024200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f401c0ce850 con 0x7f401c0d03c0 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4024200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f401c073c60 con 0x7f401c0b3750 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4021800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c06e710 0x7f401c099ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4021800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c06e710 0x7f401c099ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49282/0 (socket says 172.21.15.7:49282) 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4021800640 1 -- 172.21.15.7:0/3865964736 learned_addr learned my addr 172.21.15.7:0/3865964736 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4022200640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c0d03c0 0x7f401c154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4020e00640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0b3750 0x7f401c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4021800640 1 -- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0b3750 msgr2=0x7f401c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4021800640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0b3750 0x7f401c154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4021800640 1 -- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c0d03c0 msgr2=0x7f401c154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.697+0000 7f4021800640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c0d03c0 0x7f401c154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.698+0000 7f4021800640 1 -- 172.21.15.7:0/3865964736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401c09da50 con 0x7f401c06e710 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.698+0000 7f4021800640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c06e710 0x7f401c099ae0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f401000e9e0 tx=0x7f401000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.698+0000 7f4019600640 1 -- 172.21.15.7:0/3865964736 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010017070 con 0x7f401c06e710 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.698+0000 7f4019600640 1 -- 172.21.15.7:0/3865964736 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401000c9d0 con 0x7f401c06e710 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.698+0000 7f4019600640 1 -- 172.21.15.7:0/3865964736 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401000cdc0 con 0x7f401c06e710 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.698+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401c09dd30 con 0x7f401c06e710 2024-08-19T00:47:45.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.698+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401c15c720 con 0x7f401c06e710 2024-08-19T00:47:45.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.700+0000 7f4019600640 1 -- 172.21.15.7:0/3865964736 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f401001a070 con 0x7f401c06e710 2024-08-19T00:47:45.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.701+0000 7f4019600640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.701+0000 7f4019600640 1 -- 172.21.15.7:0/3865964736 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f401008bee0 con 0x7f401c06e710 2024-08-19T00:47:45.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.701+0000 7f4020e00640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.702+0000 7f4027092740 1 Processor -- start 2024-08-19T00:47:45.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.702+0000 7f4027092740 1 -- start start 2024-08-19T00:47:45.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.702+0000 7f4020e00640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4008034000 tx=0x7f400802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4027092740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e834258330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427b470 0x55e83427b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427bdd0 0x55e834270df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4027092740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e834190ba0 con 0x55e834257f50 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e834129230 con 0x55e83427b470 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e83418cb60 con 0x55e83427bdd0 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4021800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e834258330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4021800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e834258330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49286/0 (socket says 172.21.15.7:49286) 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4021800640 1 -- 172.21.15.7:0/2948041798 learned_addr learned my addr 172.21.15.7:0/2948041798 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4020e00640 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427b470 0x55e83427b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.703+0000 7f4022200640 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427bdd0 0x55e834270df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f4021800640 1 -- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427bdd0 msgr2=0x55e834270df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f4021800640 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427bdd0 0x55e834270df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f4021800640 1 -- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427b470 msgr2=0x55e83427b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f4021800640 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427b470 0x55e83427b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f4021800640 1 -- 172.21.15.7:0/2948041798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83415abb0 con 0x55e834257f50 2024-08-19T00:47:45.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f4021800640 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e834258330 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f4010055940 tx=0x7f4010059d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8accb5936019510e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f400e000640 1 -- 172.21.15.7:0/2948041798 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010021050 con 0x55e834257f50 2024-08-19T00:47:45.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f400e000640 1 -- 172.21.15.7:0/2948041798 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010062150 con 0x55e834257f50 2024-08-19T00:47:45.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.704+0000 7f400e000640 1 -- 172.21.15.7:0/2948041798 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010055b50 con 0x55e834257f50 2024-08-19T00:47:45.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 -- 172.21.15.7:0/2948041798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 msgr2=0x55e834258330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e834258330 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f4010055940 tx=0x7f4010059d20 comp rx=0 tx=0).stop 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 -- 172.21.15.7:0/2948041798 shutdown_connections 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427bdd0 0x55e834270df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427b470 0x55e83427b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 --2- 172.21.15.7:0/2948041798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e834258330 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 -- 172.21.15.7:0/2948041798 >> 172.21.15.7:0/2948041798 conn(0x55e8341f5110 msgr2=0x55e834272d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 -- 172.21.15.7:0/2948041798 shutdown_connections 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.705+0000 7f4027092740 1 -- 172.21.15.7:0/2948041798 wait complete. 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.706+0000 7f4027092740 1 -- start start 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.706+0000 7f4027092740 1 Processor -- start 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4027092740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e83423f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83422bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4027092740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e834274ea0 con 0x55e834257f50 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e83414c250 con 0x55e83427bdd0 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e8342745b0 con 0x55e83427b470 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4027092740 10 client.0 _ll_register_callbacks cb 0x55e834150740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e83423f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e83423f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49302/0 (socket says 172.21.15.7:49302) 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 -- 172.21.15.7:0/142081478 learned_addr learned my addr 172.21.15.7:0/142081478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4020e00640 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4022200640 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83422bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 -- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 msgr2=0x55e8342277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342277a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 -- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 msgr2=0x55e83422bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83422bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.707+0000 7f4021800640 1 -- 172.21.15.7:0/142081478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e833ea42d0 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4021800640 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e83423f040 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f401008b010 tx=0x7f4010000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cb61e577e37337 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4002a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4002a00640 1 -- 172.21.15.7:0/142081478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40100578a0 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4002a00640 1 -- 172.21.15.7:0/142081478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f40100891e0 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4010062150 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4002a00640 1 -- 172.21.15.7:0/142081478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=300) ==== 24+0+0 (secure 0 0 0) 0x7f4010021020 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4027092740 10 client.9921 fetch_fsmap learned FSMap version 300 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=300,monmap=2+}) -- 0x55e833f6e6b0 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4002a00640 1 -- 172.21.15.7:0/142081478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010062150 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4002a00640 1 -- 172.21.15.7:0/142081478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 300) ==== 3502+0+0 (secure 0 0 0) 0x7f4010055230 con 0x55e834257f50 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4027092740 10 client.9921 fetch_fsmap finished waiting for FSMap version 300 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4027092740 10 client.9921 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:45.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.708+0000 7f4027092740 20 client.9921 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:45.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.709+0000 7f4027092740 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e83422eb20 0x55e83423c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.709+0000 7f4027092740 4 client.9921 mds_command: new command op to 9864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:47:45.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.709+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 --> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e83419e2d0 con 0x55e83422eb20 2024-08-19T00:47:45.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.709+0000 7f4020e00640 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e83422eb20 0x55e83423c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.709+0000 7f4020e00640 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e83422eb20 0x55e83423c730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56a94b5b2e80fa71 server_cookie=308148d32da3bb0b in_seq=0 out_seq=0 2024-08-19T00:47:45.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.709+0000 7f4002a00640 10 client.9921 ms_handle_connect on v2:172.21.15.7:6835/978981940 2024-08-19T00:47:45.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.710+0000 7f4002a00640 1 -- 172.21.15.7:0/142081478 <== mds.0 v2:172.21.15.7:6835/978981940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e83419e2d0 con 0x55e83422eb20 2024-08-19T00:47:45.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.710+0000 7f4002a00640 10 client.9921 handle_command_reply: tid=0 2024-08-19T00:47:45.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 client.9921 shutdown 2024-08-19T00:47:45.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 msgr2=0x55e83423f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e83423f040 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f401008b010 tx=0x7f4010000bc0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 shutdown_connections 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e83422eb20 0x55e83423c730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83422bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342277a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4002a00640 0 client.9921 ms_handle_reset on v2:172.21.15.7:6835/978981940 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 --2- 172.21.15.7:0/142081478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e834257f50 0x55e83423f040 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 >> 172.21.15.7:0/142081478 conn(0x55e8341f5110 msgr2=0x55e834276a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 shutdown_connections 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 1 -- 172.21.15.7:0/142081478 wait complete. 2024-08-19T00:47:45.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.711+0000 7f4027092740 20 client.9921 trim_cache size 0 max 16384 2024-08-19T00:47:45.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.730+0000 7f4027092740 1 Processor -- start 2024-08-19T00:47:45.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.730+0000 7f4027092740 1 -- start start 2024-08-19T00:47:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e834257f50 0x55e834251e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4027092740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427b470 0x55e8342523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83423c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4027092740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f401c2014f0 con 0x55e83427b470 2024-08-19T00:47:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f401c200880 con 0x55e83427bdd0 2024-08-19T00:47:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f401c200ed0 con 0x55e834257f50 2024-08-19T00:47:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4020e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427b470 0x55e8342523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4020e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427b470 0x55e8342523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49308/0 (socket says 172.21.15.7:49308) 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4020e00640 1 -- 172.21.15.7:0/2494707329 learned_addr learned my addr 172.21.15.7:0/2494707329 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.731+0000 7f4022200640 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83423c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4021800640 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e834257f50 0x55e834251e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4020e00640 1 -- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e834257f50 msgr2=0x55e834251e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4020e00640 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e834257f50 0x55e834251e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4020e00640 1 -- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 msgr2=0x55e83423c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4020e00640 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83423c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4020e00640 1 -- 172.21.15.7:0/2494707329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8342283f0 con 0x55e83427b470 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4021800640 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e834257f50 0x55e834251e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f4020e00640 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427b470 0x55e8342523b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c00 tx=0x7f400802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57f90fcde14798f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f400d600640 1 -- 172.21.15.7:0/2494707329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008059070 con 0x55e83427b470 2024-08-19T00:47:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f400d600640 1 -- 172.21.15.7:0/2494707329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400803cae0 con 0x55e83427b470 2024-08-19T00:47:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.732+0000 7f400d600640 1 -- 172.21.15.7:0/2494707329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008037040 con 0x55e83427b470 2024-08-19T00:47:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 -- 172.21.15.7:0/2494707329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427b470 msgr2=0x55e8342523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427b470 0x55e8342523b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c00 tx=0x7f400802c000 comp rx=0 tx=0).stop 2024-08-19T00:47:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 -- 172.21.15.7:0/2494707329 shutdown_connections 2024-08-19T00:47:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e83427bdd0 0x55e83423c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427b470 0x55e8342523b0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 --2- 172.21.15.7:0/2494707329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e834257f50 0x55e834251e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 -- 172.21.15.7:0/2494707329 >> 172.21.15.7:0/2494707329 conn(0x55e8341f5110 msgr2=0x55e8342966d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 -- 172.21.15.7:0/2494707329 shutdown_connections 2024-08-19T00:47:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 -- 172.21.15.7:0/2494707329 wait complete. 2024-08-19T00:47:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.733+0000 7f4027092740 1 -- start start 2024-08-19T00:47:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.734+0000 7f4027092740 1 Processor -- start 2024-08-19T00:47:45.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e834257f50 0x55e83426c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4027092740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342f0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4027092740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427bdd0 0x55e83423cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4027092740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e834274ea0 con 0x55e83427bdd0 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e8342745b0 con 0x55e834257f50 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4027092740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e83414c250 con 0x55e83427b470 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4027092740 10 client.0 _ll_register_callbacks cb 0x7f4010058ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427bdd0 0x55e83423cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427bdd0 0x55e83423cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49320/0 (socket says 172.21.15.7:49320) 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 -- 172.21.15.7:0/1813635407 learned_addr learned my addr 172.21.15.7:0/1813635407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4021800640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e834257f50 0x55e83426c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 -- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 msgr2=0x55e8342f0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4020e00640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342f0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 -- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e834257f50 msgr2=0x55e83426c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e834257f50 0x55e83426c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4022200640 1 -- 172.21.15.7:0/1813635407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8342523a0 con 0x55e83427bdd0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4021800640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e834257f50 0x55e83426c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.735+0000 7f4020e00640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342f0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4022200640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427bdd0 0x55e83423cab0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f4014007940 tx=0x7f4014015720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7087b155f6fa0088 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4002a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4002a00640 1 -- 172.21.15.7:0/1813635407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014017430 con 0x55e83427bdd0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4002a00640 1 -- 172.21.15.7:0/1813635407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7f40140175d0 con 0x55e83427bdd0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400803cae0 con 0x55e83427bdd0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4002a00640 1 -- 172.21.15.7:0/1813635407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=300) ==== 24+0+0 (secure 0 0 0) 0x7f40140177d0 con 0x55e83427bdd0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4027092740 10 client.9927 fetch_fsmap learned FSMap version 300 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.736+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=300,monmap=2+}) -- 0x55e83426c130 con 0x55e83427bdd0 2024-08-19T00:47:45.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4002a00640 1 -- 172.21.15.7:0/1813635407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400803cae0 con 0x55e83427bdd0 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4002a00640 1 -- 172.21.15.7:0/1813635407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 300) ==== 3502+0+0 (secure 0 0 0) 0x7f4014017970 con 0x55e83427bdd0 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4027092740 10 client.9927 fetch_fsmap finished waiting for FSMap version 300 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4027092740 10 client.9927 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4027092740 20 client.9927 populate_metadata read hostname 'smithi007' 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4027092740 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e834285120 0x55e83428bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4027092740 4 client.9927 mds_command: new command op to 9864 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 --> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] -- command(tid 0: {"prefix": "status"}) -- 0x55e834198620 con 0x55e834285120 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.737+0000 7f4021800640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e834285120 0x55e83428bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4021800640 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e834285120 0x55e83428bb50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c0a79149725b26 server_cookie=aeb7bca406a733d0 in_seq=0 out_seq=0 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4002a00640 10 client.9927 ms_handle_connect on v2:172.21.15.7:6835/978981940 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4002a00640 1 -- 172.21.15.7:0/1813635407 <== mds.0 v2:172.21.15.7:6835/978981940 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55e834198620 con 0x55e834285120 2024-08-19T00:47:45.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4002a00640 10 client.9927 handle_command_reply: tid=0 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 client.9927 shutdown 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427bdd0 msgr2=0x55e83423cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427bdd0 0x55e83423cab0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f4014007940 tx=0x7f4014015720 comp rx=0 tx=0).stop 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 shutdown_connections 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:6835/978981940,v1:172.21.15.7:6837/978981940] conn(0x55e834285120 0x55e83428bb50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e83427bdd0 0x55e83423cab0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e83427b470 0x55e8342f0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 --2- 172.21.15.7:0/1813635407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e834257f50 0x55e83426c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 >> 172.21.15.7:0/1813635407 conn(0x55e8341f5110 msgr2=0x55e834276840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4002a00640 0 client.9927 ms_handle_reset on v2:172.21.15.7:6835/978981940 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 shutdown_connections 2024-08-19T00:47:45.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 1 -- 172.21.15.7:0/1813635407 wait complete. 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.738+0000 7f4027092740 20 client.9927 trim_cache size 0 max 16384 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9864, 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:47:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8693502899999999, 2024-08-19T00:47:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 300, 2024-08-19T00:47:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 120, 2024-08-19T00:47:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 120, 2024-08-19T00:47:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 8.8344723480000003 2024-08-19T00:47:45.748 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ffc06be30 msgr2=0x7f3ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4008034000 tx=0x7f400802e000 comp rx=0 tx=0).stop 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c06e710 msgr2=0x7f401c099ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c06e710 0x7f401c099ae0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f401000e9e0 tx=0x7f401000eea0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 shutdown_connections 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c0d03c0 0x7f401c154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401c0b3750 0x7f401c154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 --2- 172.21.15.7:0/3865964736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c06e710 0x7f401c099ae0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 >> 172.21.15.7:0/3865964736 conn(0x7f401c06bc70 msgr2=0x7f401c0ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 shutdown_connections 2024-08-19T00:47:45.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.739+0000 7f4024200640 1 -- 172.21.15.7:0/3865964736 wait complete. 2024-08-19T00:47:45.756 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:47:45.756 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap header on 10000000000.00000000', proceeding to ls 2024-08-19T00:47:45.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:47:45.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.912+0000 7fda98000640 1 Processor -- start 2024-08-19T00:47:45.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.912+0000 7fda98000640 1 -- start start 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.913+0000 7fda98000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda90159bf0 0x7fda90073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.913+0000 7fda98000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda900ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.913+0000 7fda98000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9006f7f0 con 0x7fda900cea40 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.913+0000 7fda98000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fda9006f510 con 0x7fda90159bf0 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.913+0000 7fda98000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda90072980 con 0x7fda900739a0 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda95600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda90159bf0 0x7fda90073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda95600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fda90159bf0 0x7fda90073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49330/0 (socket says 172.21.15.7:49330) 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda95600640 1 -- 172.21.15.7:0/2660738242 learned_addr learned my addr 172.21.15.7:0/2660738242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda96000640 1 --1- 172.21.15.7:0/2660738242 >> v1:172.21.15.7:6789/0 conn(0x7fda900cea40 0x7fda900d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35126/0 (socket says 172.21.15.7:35126) 2024-08-19T00:47:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda94c00640 1 --2- 172.21.15.7:0/2660738242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda900ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda95600640 1 -- 172.21.15.7:0/2660738242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 msgr2=0x7fda900ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda95600640 1 --2- 172.21.15.7:0/2660738242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda900ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda95600640 1 -- 172.21.15.7:0/2660738242 >> v1:172.21.15.7:6789/0 conn(0x7fda900cea40 legacy=0x7fda900d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda95600640 1 -- 172.21.15.7:0/2660738242 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda90072c60 con 0x7fda90159bf0 2024-08-19T00:47:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.914+0000 7fda8fe00640 1 -- 172.21.15.7:0/2660738242 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284542701 0 0) 0x7fda9006f7f0 con 0x7fda900cea40 2024-08-19T00:47:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.915+0000 7fda95600640 1 --2- 172.21.15.7:0/2660738242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda90073460 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fda84009870 tx=0x7fda8402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7915cab7273558f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.915+0000 7fda8fe00640 1 -- 172.21.15.7:0/2660738242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84037070 con 0x7fda90159bf0 2024-08-19T00:47:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda8fe00640 1 -- 172.21.15.7:0/2660738242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda84032440 con 0x7fda90159bf0 2024-08-19T00:47:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda8fe00640 1 -- 172.21.15.7:0/2660738242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84032810 con 0x7fda90159bf0 2024-08-19T00:47:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 -- 172.21.15.7:0/2660738242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 msgr2=0x7fda90073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 --2- 172.21.15.7:0/2660738242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda90073460 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fda84009870 tx=0x7fda8402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 -- 172.21.15.7:0/2660738242 shutdown_connections 2024-08-19T00:47:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 --2- 172.21.15.7:0/2660738242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda900ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 --2- 172.21.15.7:0/2660738242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda90073460 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 -- 172.21.15.7:0/2660738242 >> 172.21.15.7:0/2660738242 conn(0x7fda9006bc70 msgr2=0x7fda9006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 -- 172.21.15.7:0/2660738242 shutdown_connections 2024-08-19T00:47:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.916+0000 7fda98000640 1 -- 172.21.15.7:0/2660738242 wait complete. 2024-08-19T00:47:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.918+0000 7fda98000640 1 Processor -- start 2024-08-19T00:47:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.918+0000 7fda98000640 1 -- start start 2024-08-19T00:47:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda98000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda9014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda98000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda900cea40 0x7fda9015fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda98000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda901f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda98000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda9015a150 con 0x7fda90159bf0 2024-08-19T00:47:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda98000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda90159fd0 con 0x7fda900cea40 2024-08-19T00:47:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda98000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda900d0ad0 con 0x7fda900739a0 2024-08-19T00:47:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda96000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda901f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda96000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda901f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49332/0 (socket says 172.21.15.7:49332) 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda96000640 1 -- 172.21.15.7:0/2816205228 learned_addr learned my addr 172.21.15.7:0/2816205228 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda95600640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda9014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.919+0000 7fda94c00640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda900cea40 0x7fda9015fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda96000640 1 -- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 msgr2=0x7fda9014e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda96000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda9014e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda96000640 1 -- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda900cea40 msgr2=0x7fda9015fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda96000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda900cea40 0x7fda9015fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda96000640 1 -- 172.21.15.7:0/2816205228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda90150380 con 0x7fda90159bf0 2024-08-19T00:47:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda96000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda901f1d00 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c7a0 tx=0x7fda8800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda8d600640 1 -- 172.21.15.7:0/2816205228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88018070 con 0x7fda90159bf0 2024-08-19T00:47:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda8d600640 1 -- 172.21.15.7:0/2816205228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8800a640 con 0x7fda90159bf0 2024-08-19T00:47:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda90150660 con 0x7fda90159bf0 2024-08-19T00:47:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda8d600640 1 -- 172.21.15.7:0/2816205228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8800aab0 con 0x7fda90159bf0 2024-08-19T00:47:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.920+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda90150c20 con 0x7fda90159bf0 2024-08-19T00:47:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.921+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda900ce500 con 0x7fda90159bf0 2024-08-19T00:47:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.922+0000 7fda8d600640 1 -- 172.21.15.7:0/2816205228 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda8801b070 con 0x7fda90159bf0 2024-08-19T00:47:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.923+0000 7fda8d600640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda7006be30 0x7fda7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.923+0000 7fda8d600640 1 -- 172.21.15.7:0/2816205228 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7fda8808afb0 con 0x7fda90159bf0 2024-08-19T00:47:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.923+0000 7fda95600640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda7006be30 0x7fda7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.924+0000 7fda95600640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda7006be30 0x7fda7006e2f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fda84034000 tx=0x7fda8402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:45.928+0000 7fda8d600640 1 -- 172.21.15.7:0/2816205228 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fda88058750 con 0x7fda90159bf0 2024-08-19T00:47:46.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.147+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda9015a490 con 0x7fda90159bf0 2024-08-19T00:47:46.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.147+0000 7fda8d600640 1 -- 172.21.15.7:0/2816205228 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v300) ==== 53+0+73 (secure 0 0 0) 0x7fda8805ca50 con 0x7fda90159bf0 2024-08-19T00:47:46.301 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:47:46.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.149+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda7006be30 msgr2=0x7fda7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:46.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.149+0000 7fda98000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda7006be30 0x7fda7006e2f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fda84034000 tx=0x7fda8402e000 comp rx=0 tx=0).stop 2024-08-19T00:47:46.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.149+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 msgr2=0x7fda901f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:46.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.149+0000 7fda98000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda901f1d00 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c7a0 tx=0x7fda8800cc60 comp rx=0 tx=0).stop 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 shutdown_connections 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda7006be30 0x7fda7006e2f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda90159bf0 0x7fda901f1d00 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda900cea40 0x7fda9015fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 --2- 172.21.15.7:0/2816205228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda900739a0 0x7fda9014e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 >> 172.21.15.7:0/2816205228 conn(0x7fda9006bc70 msgr2=0x7fda9015a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 shutdown_connections 2024-08-19T00:47:46.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46.150+0000 7fda98000640 1 -- 172.21.15.7:0/2816205228 wait complete. 2024-08-19T00:47:46.303 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:47:46.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:47:46.303 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:47:46.303 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:47:46.304 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:46.304 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:47:46.304 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:47:46.304 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:47:46.304 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:46.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:46.304 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:47:46.340 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:47:46.340 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:47:46.340 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:46.341 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42195sec preferred_lft 42195sec 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:47:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:47:46.343 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:47:46.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:46.344 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:47:46.434 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:47:46.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:46.437 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:47:46.473 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:47:46.473 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:47:46.474 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:47:46.474 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:47:46.474 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:47:46.475 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:47:46.475 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:47:46.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:47:46.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:47:46.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:47:46.475 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:47:46.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:47:46.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:47:46.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:46.671 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:47:46.710 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:47:46.710 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:47:46.710 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:46.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:46.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:47:46.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:47:46.807 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:46.842 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:47:46.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:47:46.842 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:46.918 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:47:46.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:46.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:47.046 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:47.046 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:47.046 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:47.062 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:47.062 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:47.062 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:47.062 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:47:47.062 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:47:47.087 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:47:47.087 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:47:47.087 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:47:47.087 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:47:47.087 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:47:47.087 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:47:47.088 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:47:47.088 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:47:47.090 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:47:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:47:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:47:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:47:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:47:47.093 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:47:47.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:47.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:47:47.149 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:47:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:47:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:47:47.240 INFO:teuthology.orchestra.run.smithi007.stdout:client9139 2024-08-19T00:47:47.240 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:47.240 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:47.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:47.276 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:47:47.320 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:47:47.353 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:47.352+0000 7f8816800640 -1 mds.0.cache.dir(0x10000000000) Corrupt fnode in dirfrag 0x10000000000: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:47:47.353 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:47:47.354 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:47:47.354 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:47.354 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:47:47.355 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 10000000000.00000000' did not caused DAMAGED state 2024-08-19T00:47:47.355 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 600.00000000' 2024-08-19T00:47:47.355 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:47.355 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:47.431 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:47.431 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:47.507 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:47:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.703+0000 7fba91800640 1 Processor -- start 2024-08-19T00:47:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.703+0000 7fba91800640 1 -- start start 2024-08-19T00:47:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba91800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c143ea0 0x7fba8c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba91800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba8c144280 0x7fba8c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba91800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fba8c0b44e0 0x7fba8c0d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba91800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fba8c15f700 con 0x7fba8c144280 2024-08-19T00:47:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba91800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fba8c161d30 con 0x7fba8c0b44e0 2024-08-19T00:47:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba91800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba8c161fd0 con 0x7fba8c143ea0 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba83400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba8c144280 0x7fba8c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba83400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba8c144280 0x7fba8c0b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49342/0 (socket says 172.21.15.7:49342) 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.704+0000 7fba83400640 1 -- 172.21.15.7:0/2681691375 learned_addr learned my addr 172.21.15.7:0/2681691375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba8be00640 1 --2- 172.21.15.7:0/2681691375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c143ea0 0x7fba8c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba90e00640 1 --2- 172.21.15.7:0/2681691375 >> v2:172.21.15.162:3300/0 conn(0x7fba8c0b44e0 0x7fba8c0d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba83400640 1 -- 172.21.15.7:0/2681691375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c143ea0 msgr2=0x7fba8c15f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba83400640 1 --2- 172.21.15.7:0/2681691375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c143ea0 0x7fba8c15f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba83400640 1 -- 172.21.15.7:0/2681691375 >> v2:172.21.15.162:3300/0 conn(0x7fba8c0b44e0 msgr2=0x7fba8c0d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba83400640 1 --2- 172.21.15.7:0/2681691375 >> v2:172.21.15.162:3300/0 conn(0x7fba8c0b44e0 0x7fba8c0d23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba83400640 1 -- 172.21.15.7:0/2681691375 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c1622b0 con 0x7fba8c144280 2024-08-19T00:47:47.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba8be00640 1 --2- 172.21.15.7:0/2681691375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c143ea0 0x7fba8c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:47.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.705+0000 7fba90e00640 1 --2- 172.21.15.7:0/2681691375 >> v2:172.21.15.162:3300/0 conn(0x7fba8c0b44e0 0x7fba8c0d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.706+0000 7fba83400640 1 --2- 172.21.15.7:0/2681691375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0b3fa0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fba8c161c90 tx=0x7fba7402a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a319430b1352bc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.706+0000 7fba8b400640 1 -- 172.21.15.7:0/2681691375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74037070 con 0x7fba8c144280 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.706+0000 7fba8b400640 1 -- 172.21.15.7:0/2681691375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba74032440 con 0x7fba8c144280 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.706+0000 7fba8b400640 1 -- 172.21.15.7:0/2681691375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74032810 con 0x7fba8c144280 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 -- 172.21.15.7:0/2681691375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 msgr2=0x7fba8c0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 --2- 172.21.15.7:0/2681691375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0b3fa0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fba8c161c90 tx=0x7fba7402a1d0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 -- 172.21.15.7:0/2681691375 shutdown_connections 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 --2- 172.21.15.7:0/2681691375 >> v2:172.21.15.162:3300/0 conn(0x7fba8c0b44e0 0x7fba8c0d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 --2- 172.21.15.7:0/2681691375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0b3fa0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 --2- 172.21.15.7:0/2681691375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c143ea0 0x7fba8c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 -- 172.21.15.7:0/2681691375 >> 172.21.15.7:0/2681691375 conn(0x7fba8c062540 msgr2=0x7fba8c062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 -- 172.21.15.7:0/2681691375 shutdown_connections 2024-08-19T00:47:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.707+0000 7fba91800640 1 -- 172.21.15.7:0/2681691375 wait complete. 2024-08-19T00:47:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.709+0000 7fba91800640 1 Processor -- start 2024-08-19T00:47:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.709+0000 7fba91800640 1 -- start start 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.709+0000 7fba91800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c0b44e0 0x7fba8c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.709+0000 7fba91800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba8c143ea0 0x7fba8c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba91800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba91800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c162b50 con 0x7fba8c144280 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba91800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c162870 con 0x7fba8c143ea0 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba91800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba8c1446e0 con 0x7fba8c0b44e0 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49358/0 (socket says 172.21.15.7:49358) 2024-08-19T00:47:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 -- 172.21.15.7:0/3978191582 learned_addr learned my addr 172.21.15.7:0/3978191582 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba83400640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba8c143ea0 0x7fba8c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba8be00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c0b44e0 0x7fba8c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 -- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c0b44e0 msgr2=0x7fba8c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c0b44e0 0x7fba8c0cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 -- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba8c143ea0 msgr2=0x7fba8c15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba8c143ea0 0x7fba8c15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba90e00640 1 -- 172.21.15.7:0/3978191582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c0cc750 con 0x7fba8c144280 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.710+0000 7fba8be00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c0b44e0 0x7fba8c0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.711+0000 7fba90e00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0cdff0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fba84007e70 tx=0x7fba8400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.711+0000 7fba88c00640 1 -- 172.21.15.7:0/3978191582 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8401a070 con 0x7fba8c144280 2024-08-19T00:47:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.711+0000 7fba88c00640 1 -- 172.21.15.7:0/3978191582 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba84003bb0 con 0x7fba8c144280 2024-08-19T00:47:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.711+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8c0cca30 con 0x7fba8c144280 2024-08-19T00:47:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.711+0000 7fba88c00640 1 -- 172.21.15.7:0/3978191582 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84004030 con 0x7fba8c144280 2024-08-19T00:47:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.711+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8c0ccff0 con 0x7fba8c144280 2024-08-19T00:47:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.712+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8c0b6130 con 0x7fba8c144280 2024-08-19T00:47:47.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.713+0000 7fba88c00640 1 -- 172.21.15.7:0/3978191582 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba8401d070 con 0x7fba8c144280 2024-08-19T00:47:47.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.714+0000 7fba88c00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba6806be30 0x7fba6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:47.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.714+0000 7fba88c00640 1 -- 172.21.15.7:0/3978191582 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7fba8408bcd0 con 0x7fba8c144280 2024-08-19T00:47:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.714+0000 7fba8be00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba6806be30 0x7fba6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.715+0000 7fba8be00640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba6806be30 0x7fba6806e2f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:47.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.718+0000 7fba88c00640 1 -- 172.21.15.7:0/3978191582 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fba8c0b6130 con 0x7fba8c144280 2024-08-19T00:47:47.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.914+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba8c1439e0 con 0x7fba8c144280 2024-08-19T00:47:47.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.914+0000 7fba88c00640 1 -- 172.21.15.7:0/3978191582 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 68 entries v120) ==== 81+0+4068 (secure 0 0 0) 0x7fba84010070 con 0x7fba8c144280 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/767746356 2024-08-20T00:47:36.848235+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2697833470 2024-08-20T00:47:13.631762+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2697833470 2024-08-20T00:47:13.631762+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/564246395 2024-08-20T00:47:08.596064+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/564246395 2024-08-20T00:47:08.596064+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:47:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:47:47.918 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:47:47.919 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:47:47.920 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/767746356 2024-08-20T00:47:36.848235+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:47:47.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:47:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:47:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:47:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:47:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:47:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:47:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:47:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:listed 68 entries 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba6806be30 msgr2=0x7fba6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba6806be30 0x7fba6806e2f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).stop 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 msgr2=0x7fba8c0cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0cdff0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fba84007e70 tx=0x7fba8400d4a0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 shutdown_connections 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba6806be30 0x7fba6806e2f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba8c144280 0x7fba8c0cdff0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba8c143ea0 0x7fba8c15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 --2- 172.21.15.7:0/3978191582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba8c0b44e0 0x7fba8c0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 >> 172.21.15.7:0/3978191582 conn(0x7fba8c062540 msgr2=0x7fba8c0b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 shutdown_connections 2024-08-19T00:47:47.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:47.917+0000 7fba91800640 1 -- 172.21.15.7:0/3978191582 wait complete. 2024-08-19T00:47:47.933 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:47:47.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:47.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:47:48.003 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:47:48.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:48.004 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:47:48.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:47:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.235+0000 7fcaebc00640 1 Processor -- start 2024-08-19T00:47:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.235+0000 7fcaebc00640 1 -- start start 2024-08-19T00:47:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcaebc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae406e710 0x7fcae4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcaebc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcae40b3750 0x7fcae40cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcaebc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcae40cdfb0 con 0x7fcae40d03c0 2024-08-19T00:47:48.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcaebc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcae40cebc0 con 0x7fcae40b3750 2024-08-19T00:47:48.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcaebc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcae40ce290 con 0x7fcae406e710 2024-08-19T00:47:48.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcae9200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcae40d03c0 0x7fcae40d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35136/0 (socket says 172.21.15.7:35136) 2024-08-19T00:47:48.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcae9200640 1 -- 172.21.15.7:0/3897901141 learned_addr learned my addr 172.21.15.7:0/3897901141 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcae9c00640 1 --2- 172.21.15.7:0/3897901141 >> v2:172.21.15.162:3300/0 conn(0x7fcae40b3750 0x7fcae40cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcae3e00640 1 --2- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae406e710 0x7fcae4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.237+0000 7fcae3400640 1 -- 172.21.15.7:0/3897901141 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898740584 0 0) 0x7fcae40cdfb0 con 0x7fcae40d03c0 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.238+0000 7fcae3400640 1 -- 172.21.15.7:0/3897901141 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcacc003520 con 0x7fcae40d03c0 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.238+0000 7fcae9c00640 1 -- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae406e710 msgr2=0x7fcae4071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.238+0000 7fcae9c00640 1 --2- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae406e710 0x7fcae4071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.238+0000 7fcae9c00640 1 -- 172.21.15.7:0/3897901141 >> v1:172.21.15.7:6789/0 conn(0x7fcae40d03c0 legacy=0x7fcae40d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.238+0000 7fcae9c00640 1 -- 172.21.15.7:0/3897901141 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae40ce570 con 0x7fcae40b3750 2024-08-19T00:47:48.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.239+0000 7fcae9c00640 1 --2- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae40b3750 0x7fcae40cf050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009d90 tx=0x7fcadc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a8fb21e55c4ce8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.239+0000 7fcae3400640 1 -- 172.21.15.7:0/3897901141 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc007740 con 0x7fcae40b3750 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.239+0000 7fcae3400640 1 -- 172.21.15.7:0/3897901141 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc0078e0 con 0x7fcae40b3750 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.239+0000 7fcae3400640 1 -- 172.21.15.7:0/3897901141 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc007cb0 con 0x7fcae40b3750 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 -- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae40b3750 msgr2=0x7fcae40cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 --2- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae40b3750 0x7fcae40cf050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009d90 tx=0x7fcadc02a660 comp rx=0 tx=0).stop 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 -- 172.21.15.7:0/3897901141 shutdown_connections 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 --2- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae40b3750 0x7fcae40cf050 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 --2- 172.21.15.7:0/3897901141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae406e710 0x7fcae4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 -- 172.21.15.7:0/3897901141 >> 172.21.15.7:0/3897901141 conn(0x7fcae406bc70 msgr2=0x7fcae406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 -- 172.21.15.7:0/3897901141 shutdown_connections 2024-08-19T00:47:48.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.240+0000 7fcaebc00640 1 -- 172.21.15.7:0/3897901141 wait complete. 2024-08-19T00:47:48.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.241+0000 7fcaebc00640 1 Processor -- start 2024-08-19T00:47:48.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.242+0000 7fcaebc00640 1 -- start start 2024-08-19T00:47:48.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.242+0000 7fcaebc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae406e710 0x7fcae4099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcaebc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae40b3750 0x7fcae409d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcaebc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae40d03c0 0x7fcae406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcaebc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4073c60 con 0x7fcae40d03c0 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcaebc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4073ae0 con 0x7fcae406e710 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcaebc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcae40b3be0 con 0x7fcae40b3750 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae40d03c0 0x7fcae406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae40d03c0 0x7fcae406d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49370/0 (socket says 172.21.15.7:49370) 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 -- 172.21.15.7:0/2712007014 learned_addr learned my addr 172.21.15.7:0/2712007014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9200640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae406e710 0x7fcae4099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae3e00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae40b3750 0x7fcae409d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 -- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae40b3750 msgr2=0x7fcae409d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae40b3750 0x7fcae409d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 -- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae406e710 msgr2=0x7fcae4099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae406e710 0x7fcae4099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.243+0000 7fcae9c00640 1 -- 172.21.15.7:0/2712007014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae409dc80 con 0x7fcae40d03c0 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.244+0000 7fcae3e00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae40b3750 0x7fcae409d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.244+0000 7fcae9c00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae40d03c0 0x7fcae406d9e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009eb0 tx=0x7fcadc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.244+0000 7fcae0c00640 1 -- 172.21.15.7:0/2712007014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc040070 con 0x7fcae40d03c0 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.244+0000 7fcae0c00640 1 -- 172.21.15.7:0/2712007014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc031bc0 con 0x7fcae40d03c0 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.244+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae409df40 con 0x7fcae40d03c0 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.244+0000 7fcae0c00640 1 -- 172.21.15.7:0/2712007014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc009450 con 0x7fcae40d03c0 2024-08-19T00:47:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.244+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae415ba50 con 0x7fcae40d03c0 2024-08-19T00:47:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.245+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae4071980 con 0x7fcae40d03c0 2024-08-19T00:47:48.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.246+0000 7fcae0c00640 1 -- 172.21.15.7:0/2712007014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcadc039040 con 0x7fcae40d03c0 2024-08-19T00:47:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.248+0000 7fcae0c00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcac406be30 0x7fcac406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.248+0000 7fcae0c00640 1 -- 172.21.15.7:0/2712007014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 8633+0+0 (secure 0 0 0) 0x7fcadc0ad1a0 con 0x7fcae40d03c0 2024-08-19T00:47:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.248+0000 7fcae9200640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcac406be30 0x7fcac406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.248+0000 7fcae9200640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcac406be30 0x7fcac406e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005880 tx=0x7fcad8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.252+0000 7fcae0c00640 1 -- 172.21.15.7:0/2712007014 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcadc07a8e0 con 0x7fcae40d03c0 2024-08-19T00:47:48.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.473+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcae40728c0 con 0x7fcae40d03c0 2024-08-19T00:47:48.475 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:48.474+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:47:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.476+0000 7fcae0c00640 1 -- 172.21.15.7:0/2712007014 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v301) ==== 161+0+0 (secure 0 0 0) 0x7fcadc07ebe0 con 0x7fcae40d03c0 2024-08-19T00:47:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:47:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.480+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcac406be30 msgr2=0x7fcac406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.480+0000 7fcaebc00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcac406be30 0x7fcac406e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005880 tx=0x7fcad8009040 comp rx=0 tx=0).stop 2024-08-19T00:47:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.480+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae40d03c0 msgr2=0x7fcae406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.480+0000 7fcaebc00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae40d03c0 0x7fcae406d9e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009eb0 tx=0x7fcadc004a40 comp rx=0 tx=0).stop 2024-08-19T00:47:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.480+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 shutdown_connections 2024-08-19T00:47:48.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.481+0000 7fcaebc00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcac406be30 0x7fcac406e2f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.481+0000 7fcaebc00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae40d03c0 0x7fcae406d9e0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.481+0000 7fcaebc00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcae40b3750 0x7fcae409d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.481+0000 7fcaebc00640 1 --2- 172.21.15.7:0/2712007014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae406e710 0x7fcae4099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.481+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 >> 172.21.15.7:0/2712007014 conn(0x7fcae406bc70 msgr2=0x7fcae40acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.481+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 shutdown_connections 2024-08-19T00:47:48.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.481+0000 7fcaebc00640 1 -- 172.21.15.7:0/2712007014 wait complete. 2024-08-19T00:47:48.487 INFO:tasks.ceph.mds.a.smithi007.stderr: -673> 2024-08-19T00:47:42.862+0000 7f881b800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:48.489 INFO:tasks.ceph.mds.a.smithi007.stderr: -137> 2024-08-19T00:47:47.352+0000 7f8816800640 -1 mds.0.cache.dir(0x10000000000) Corrupt fnode in dirfrag 0x10000000000: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:47:48.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:47:48.532 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:47:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.658+0000 7f1e46e00640 1 Processor -- start 2024-08-19T00:47:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.658+0000 7f1e46e00640 1 -- start start 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e46e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e40159bf0 0x7f1e40073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e46e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e400739a0 0x7f1e400ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e46e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e46e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4006f7f0 con 0x7f1e40159bf0 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e46e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4006f510 con 0x7f1e400739a0 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e46e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e40072980 con 0x7f1e400cea40 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e40159bf0 0x7f1e40073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1e40159bf0 0x7f1e40073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49402/0 (socket says 172.21.15.7:49402) 2024-08-19T00:47:48.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 -- 172.21.15.7:0/1884949480 learned_addr learned my addr 172.21.15.7:0/1884949480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e44e00640 1 --2- 172.21.15.7:0/1884949480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e37e00640 1 --2- 172.21.15.7:0/1884949480 >> v2:172.21.15.162:3300/0 conn(0x7f1e400739a0 0x7f1e400ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 -- 172.21.15.7:0/1884949480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 msgr2=0x7f1e400d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 --2- 172.21.15.7:0/1884949480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 -- 172.21.15.7:0/1884949480 >> v2:172.21.15.162:3300/0 conn(0x7f1e400739a0 msgr2=0x7f1e400ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 --2- 172.21.15.7:0/1884949480 >> v2:172.21.15.162:3300/0 conn(0x7f1e400739a0 0x7f1e400ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.660+0000 7f1e3fe00640 1 -- 172.21.15.7:0/1884949480 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e40072c60 con 0x7f1e40159bf0 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.661+0000 7f1e3fe00640 1 --2- 172.21.15.7:0/1884949480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e40159bf0 0x7f1e40073460 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f1e400b1cc0 tx=0x7f1e3002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a898a71a59a555a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e3f400640 1 -- 172.21.15.7:0/1884949480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30037070 con 0x7f1e40159bf0 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e3f400640 1 -- 172.21.15.7:0/1884949480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e30032440 con 0x7f1e40159bf0 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e3f400640 1 -- 172.21.15.7:0/1884949480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30032810 con 0x7f1e40159bf0 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 -- 172.21.15.7:0/1884949480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e40159bf0 msgr2=0x7f1e40073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 --2- 172.21.15.7:0/1884949480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e40159bf0 0x7f1e40073460 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f1e400b1cc0 tx=0x7f1e3002a140 comp rx=0 tx=0).stop 2024-08-19T00:47:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 -- 172.21.15.7:0/1884949480 shutdown_connections 2024-08-19T00:47:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 --2- 172.21.15.7:0/1884949480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 --2- 172.21.15.7:0/1884949480 >> v2:172.21.15.162:3300/0 conn(0x7f1e400739a0 0x7f1e400ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 --2- 172.21.15.7:0/1884949480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e40159bf0 0x7f1e40073460 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 -- 172.21.15.7:0/1884949480 >> 172.21.15.7:0/1884949480 conn(0x7f1e4006bc70 msgr2=0x7f1e4006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 -- 172.21.15.7:0/1884949480 shutdown_connections 2024-08-19T00:47:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.662+0000 7f1e46e00640 1 -- 172.21.15.7:0/1884949480 wait complete. 2024-08-19T00:47:48.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.664+0000 7f1e46e00640 1 Processor -- start 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.664+0000 7f1e46e00640 1 -- start start 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e46e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e400739a0 0x7f1e40150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e46e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e46e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e40159bf0 0x7f1e400b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e46e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4015a150 con 0x7f1e400739a0 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e46e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40159fd0 con 0x7f1e40159bf0 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e46e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e400d0900 con 0x7f1e400cea40 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e3fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e400739a0 0x7f1e40150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e3fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e400739a0 0x7f1e40150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49416/0 (socket says 172.21.15.7:49416) 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.665+0000 7f1e3fe00640 1 -- 172.21.15.7:0/2905125357 learned_addr learned my addr 172.21.15.7:0/2905125357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e37e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e44e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e40159bf0 0x7f1e400b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e3fe00640 1 -- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 msgr2=0x7f1e400b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e3fe00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e3fe00640 1 -- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e40159bf0 msgr2=0x7f1e400b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e3fe00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e40159bf0 0x7f1e400b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e3fe00640 1 -- 172.21.15.7:0/2905125357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e400c5d60 con 0x7f1e400739a0 2024-08-19T00:47:48.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e3fe00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e400739a0 0x7f1e40150340 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000c00 tx=0x7f1e300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.666+0000 7f1e3cc00640 1 -- 172.21.15.7:0/2905125357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30041020 con 0x7f1e400739a0 2024-08-19T00:47:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.667+0000 7f1e3cc00640 1 -- 172.21.15.7:0/2905125357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3003d620 con 0x7f1e400739a0 2024-08-19T00:47:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.667+0000 7f1e3cc00640 1 -- 172.21.15.7:0/2905125357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30037040 con 0x7f1e400739a0 2024-08-19T00:47:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.667+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e400c6040 con 0x7f1e400739a0 2024-08-19T00:47:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.667+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e400c6600 con 0x7f1e400739a0 2024-08-19T00:47:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.668+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e400d03c0 con 0x7f1e400739a0 2024-08-19T00:47:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.669+0000 7f1e3cc00640 1 -- 172.21.15.7:0/2905125357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e30044020 con 0x7f1e400739a0 2024-08-19T00:47:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.670+0000 7f1e3cc00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.670+0000 7f1e3cc00640 1 -- 172.21.15.7:0/2905125357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8719+0+0 (secure 0 0 0) 0x7f1e300ac060 con 0x7f1e400739a0 2024-08-19T00:47:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.670+0000 7f1e37e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.670+0000 7f1e37e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1e4015fed0 tx=0x7f1e28009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.674+0000 7f1e3cc00640 1 -- 172.21.15.7:0/2905125357 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1e3004b030 con 0x7f1e400739a0 2024-08-19T00:47:48.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:48.930+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f1e4015fb40 con 0x7f1e400739a0 2024-08-19T00:47:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.478+0000 7f1e3cc00640 1 -- 172.21.15.7:0/2905125357 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v302) ==== 107+0+0 (secure 0 0 0) 0x7f1e30079750 con 0x7f1e400739a0 2024-08-19T00:47:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:47:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e1c06be30 msgr2=0x7f1e1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1e4015fed0 tx=0x7f1e28009190 comp rx=0 tx=0).stop 2024-08-19T00:47:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e400739a0 msgr2=0x7f1e40150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e400739a0 0x7f1e40150340 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000c00 tx=0x7f1e300046c0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 shutdown_connections 2024-08-19T00:47:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e40159bf0 0x7f1e400b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e400cea40 0x7f1e400b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 --2- 172.21.15.7:0/2905125357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e400739a0 0x7f1e40150340 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 >> 172.21.15.7:0/2905125357 conn(0x7f1e4006bc70 msgr2=0x7f1e4015b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 shutdown_connections 2024-08-19T00:47:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.481+0000 7f1e46e00640 1 -- 172.21.15.7:0/2905125357 wait complete. 2024-08-19T00:47:49.501 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:47:49.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.621+0000 7f5de6b21f40 1 Processor -- start 2024-08-19T00:47:49.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.621+0000 7f5de6b21f40 1 -- start start 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.622+0000 7f5de6b21f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dc80022a0 0x564196921270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.622+0000 7f5de6b21f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969217b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.622+0000 7f5de6b21f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641968f2720 0x5641968f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.622+0000 7f5de6b21f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564196899d00 con 0x56419693f0e0 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.622+0000 7f5de6b21f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56419689dd40 con 0x5641968f2720 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.622+0000 7f5de6b21f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5641969cadc0 con 0x7f5dc80022a0 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969217b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49428/0 (socket says 172.21.15.7:49428) 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 -- 172.21.15.7:0/945912218 learned_addr learned my addr 172.21.15.7:0/945912218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3e00640 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dc80022a0 0x564196921270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de4800640 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641968f2720 0x5641968f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 -- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dc80022a0 msgr2=0x564196921270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:49.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dc80022a0 0x564196921270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 -- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641968f2720 msgr2=0x5641968f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:49.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641968f2720 0x5641968f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 -- 172.21.15.7:0/945912218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419685b080 con 0x56419693f0e0 2024-08-19T00:47:49.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.623+0000 7f5de3400640 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969217b0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00016a0 tx=0x7f5dd00099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f767b87017607049 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de2000640 1 -- 172.21.15.7:0/945912218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000e720 con 0x56419693f0e0 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de2000640 1 -- 172.21.15.7:0/945912218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd0013030 con 0x56419693f0e0 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de2000640 1 -- 172.21.15.7:0/945912218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000eb00 con 0x56419693f0e0 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 -- 172.21.15.7:0/945912218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 msgr2=0x5641969217b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969217b0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00016a0 tx=0x7f5dd00099f0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 -- 172.21.15.7:0/945912218 shutdown_connections 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641968f2720 0x5641968f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969217b0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/945912218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dc80022a0 0x564196921270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 -- 172.21.15.7:0/945912218 >> 172.21.15.7:0/945912218 conn(0x5641969224e0 msgr2=0x56419693e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:49.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 -- 172.21.15.7:0/945912218 shutdown_connections 2024-08-19T00:47:49.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.624+0000 7f5de6b21f40 1 -- 172.21.15.7:0/945912218 wait complete. 2024-08-19T00:47:49.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.625+0000 7f5de6b21f40 1 Processor -- start 2024-08-19T00:47:49.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.625+0000 7f5de6b21f40 1 -- start start 2024-08-19T00:47:49.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de6b21f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5641968f2720 0x5641969b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de6b21f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de6b21f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dc80022a0 0x5641969c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de6b21f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5641969c4640 con 0x56419693f0e0 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de6b21f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564196940000 con 0x7f5dc80022a0 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de6b21f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56419693fd20 con 0x5641968f2720 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49440/0 (socket says 172.21.15.7:49440) 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 learned_addr learned my addr 172.21.15.7:0/917489455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de4800640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dc80022a0 0x5641969c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.626+0000 7f5de3e00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5641968f2720 0x5641969b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5641968f2720 msgr2=0x5641969b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de3400640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5641968f2720 0x5641969b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dc80022a0 msgr2=0x5641969c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de3400640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dc80022a0 0x5641969c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641969b7210 con 0x56419693f0e0 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de3400640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969c7d50 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0000be0 tx=0x7f5dd0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de0c00640 1 -- 172.21.15.7:0/917489455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0025450 con 0x56419693f0e0 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de0c00640 1 -- 172.21.15.7:0/917489455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd00255f0 con 0x56419693f0e0 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de0c00640 1 -- 172.21.15.7:0/917489455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00259c0 con 0x56419693f0e0 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.627+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641969b74f0 con 0x56419693f0e0 2024-08-19T00:47:49.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.628+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641969b7ab0 con 0x56419693f0e0 2024-08-19T00:47:49.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.629+0000 7f5de0c00640 1 -- 172.21.15.7:0/917489455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dd000f450 con 0x56419693f0e0 2024-08-19T00:47:49.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.630+0000 7f5de0c00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5dc406a810 0x7f5dc406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.630+0000 7f5de0c00640 1 -- 172.21.15.7:0/917489455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8719+0+0 (secure 0 0 0) 0x7f5dd008c5c0 con 0x56419693f0e0 2024-08-19T00:47:49.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.630+0000 7f5de3e00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5dc406a810 0x7f5dc406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.632 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:47:49.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.631+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5641969c8290 0x5641969b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.631+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969b8a20 con 0x5641969c8290 2024-08-19T00:47:49.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.631+0000 7f5de3e00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5dc406a810 0x7f5dc406ccd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4057000 tx=0x7f5dd4053000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.631+0000 7f5de4800640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5641969c8290 0x5641969b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.632+0000 7f5de4800640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5641969c8290 0x5641969b84e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.635+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v121'1065 uv1038 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.635+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5641969b8df0 con 0x5641969c8290 2024-08-19T00:47:49.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.636+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v121'1066 uv1066 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.636+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6ccd0 con 0x5641969c8290 2024-08-19T00:47:49.639 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:47:49.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.638+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v121'1067 uv1067 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.638+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6e080 con 0x5641969c8290 2024-08-19T00:47:49.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.640+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v121'1068 uv1068 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.640+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6e420 con 0x5641969c8290 2024-08-19T00:47:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.641+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v121'1069 uv1069 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.641+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d070 con 0x5641969c8290 2024-08-19T00:47:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.643+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v121'1070 uv1070 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.643+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d460 con 0x5641969c8290 2024-08-19T00:47:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.645+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v121'1071 uv1044 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.645+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.647+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v121'1072 uv1072 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.647+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.650 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:47:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.648+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v121'1073 uv1073 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.648+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.650+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v121'1074 uv1074 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.650+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.652+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v121'1075 uv1075 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.652+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.653+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v121'1076 uv1076 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.653+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.655+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v121'1077 uv1064 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.655+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.657+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v121'1078 uv1078 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.657+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.660 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:47:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.658+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v121'1079 uv1079 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.658+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.660+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v121'1080 uv1080 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.660+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.661+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v121'1081 uv1081 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.661+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a6d800 con 0x5641969c8290 2024-08-19T00:47:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.663+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v121'1082 uv1082 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.663+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.664+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v121'1083 uv1083 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.664+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.666+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v121'1084 uv1057 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.666+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.668+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v121'1085 uv1085 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.668+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.671 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:47:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.669+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v121'1086 uv1086 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.669+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.671+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v121'1087 uv1087 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.671+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.672+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v121'1088 uv1088 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.672+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.674+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v121'1089 uv1089 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.674+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.675+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v121'1090 uv1063 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.676+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.677+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v121'1091 uv1091 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.677+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.680 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:47:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.679+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v121'1092 uv1092 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.679+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.680+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v121'1093 uv1093 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.680+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.681+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v121'1094 uv1094 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.681+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x5641969c8290 2024-08-19T00:47:49.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.683+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v121'1095 uv1095 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.683+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564196a6ecd0 0x564196a710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.683+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5641969c5500 con 0x564196a6ecd0 2024-08-19T00:47:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.683+0000 7f5de3e00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564196a6ecd0 0x564196a710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.684+0000 7f5de3e00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564196a6ecd0 0x564196a710c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.686+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v121'777 uv756 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.686+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a71600 con 0x564196a6ecd0 2024-08-19T00:47:49.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.687+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v121'778 uv778 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.687+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a719a0 con 0x564196a6ecd0 2024-08-19T00:47:49.690 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:47:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.689+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v121'779 uv779 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.689+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a71d40 con 0x564196a6ecd0 2024-08-19T00:47:49.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.690+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v121'780 uv780 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.690+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a720e0 con 0x564196a6ecd0 2024-08-19T00:47:49.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.692+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v121'781 uv781 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.692+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72480 con 0x564196a6ecd0 2024-08-19T00:47:49.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.693+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v121'782 uv775 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.693+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.695+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v121'783 uv783 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.695+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.697 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:47:49.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.696+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v121'784 uv784 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.696+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.698+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v121'785 uv785 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.698+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.699+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v121'786 uv786 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.699+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.701+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v121'787 uv776 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.701+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.702+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v121'788 uv788 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.703+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.705 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:47:49.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.704+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v121'789 uv789 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.704+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a76f10 con 0x564196a6ecd0 2024-08-19T00:47:49.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.706+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v121'790 uv790 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.706+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a76f10 con 0x564196a6ecd0 2024-08-19T00:47:49.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.707+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v121'791 uv791 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.707+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.709+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v121'792 uv772 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.709+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.710+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v121'793 uv793 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.710+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.713 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:47:49.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.712+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v121'794 uv794 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.712+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a73830 con 0x564196a6ecd0 2024-08-19T00:47:49.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.713+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v121'795 uv795 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.713+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a73830 con 0x564196a6ecd0 2024-08-19T00:47:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.715+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v121'796 uv796 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.715+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a72820 con 0x564196a6ecd0 2024-08-19T00:47:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.716+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v121'797 uv797 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a6ecd0 2024-08-19T00:47:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.716+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564196a72ea0 0x564196a75290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.716+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a757d0 con 0x564196a72ea0 2024-08-19T00:47:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.717+0000 7f5de3400640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564196a72ea0 0x564196a75290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.718+0000 7f5de3400640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564196a72ea0 0x564196a75290 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.719+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v121'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.719+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a75ca0 con 0x564196a72ea0 2024-08-19T00:47:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.721+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v121'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.721+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a76180 con 0x564196a72ea0 2024-08-19T00:47:49.723 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:47:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.722+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v121'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.722+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a77a30 con 0x564196a72ea0 2024-08-19T00:47:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.723+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v121'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.723+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a77dd0 con 0x564196a72ea0 2024-08-19T00:47:49.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.725+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v121'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.725+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a76a20 con 0x564196a72ea0 2024-08-19T00:47:49.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.726+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v121'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.726+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a76e10 con 0x5641969c8290 2024-08-19T00:47:49.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.727+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v121'156 uv155 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.728+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a76e10 con 0x5641969c8290 2024-08-19T00:47:49.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.729+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v121'157 uv157 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.729+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a76e10 con 0x5641969c8290 2024-08-19T00:47:49.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.730+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v121'158 uv158 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.732 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:47:49.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.730+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a76e10 con 0x5641969c8290 2024-08-19T00:47:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.732+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v121'159 uv159 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.732+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564196a77490 0x564196a7a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.732+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7a6c0 con 0x564196a77490 2024-08-19T00:47:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.732+0000 7f5de4800640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564196a77490 0x564196a7a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.733+0000 7f5de4800640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564196a77490 0x564196a7a180 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.734+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v121'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.734+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a7a6c0 con 0x564196a77490 2024-08-19T00:47:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.735+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v121'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.736+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7a6c0 con 0x564196a77490 2024-08-19T00:47:49.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.737+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v121'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.738 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:47:49.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.737+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7bac0 con 0x564196a77490 2024-08-19T00:47:49.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.738+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v121'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.738+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7bac0 con 0x564196a77490 2024-08-19T00:47:49.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.739+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v121'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.739+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7aab0 con 0x564196a77490 2024-08-19T00:47:49.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.741+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v121'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.741+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564196a7afc0 0x564196a7d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.741+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7da00 con 0x564196a7afc0 2024-08-19T00:47:49.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.741+0000 7f5de3e00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564196a7afc0 0x564196a7d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.741+0000 7f5de3e00640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564196a7afc0 0x564196a7d3b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.743+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v121'382 uv376 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.743+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.745+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v121'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.745+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.746+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v121'384 uv384 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.748 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:47:49.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.746+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ede0 con 0x564196a7afc0 2024-08-19T00:47:49.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.748+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v121'385 uv385 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.748+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ede0 con 0x564196a7afc0 2024-08-19T00:47:49.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.749+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v121'386 uv386 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.749+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.750+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v121'387 uv387 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.750+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.752+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v121'388 uv381 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.752+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.754+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v121'389 uv389 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.754+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.755+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v121'390 uv390 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.757 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:47:49.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.755+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.756+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v121'391 uv391 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.757+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a7ddd0 con 0x564196a7afc0 2024-08-19T00:47:49.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.758+0000 7f5de3e00640 1 -- 172.21.15.7:0/917489455 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v121'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd4053620 con 0x564196a7afc0 2024-08-19T00:47:49.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.758+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564196a7e6f0 0x564196a7eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.758+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a811d0 con 0x564196a7e6f0 2024-08-19T00:47:49.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.758+0000 7f5de3400640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564196a7e6f0 0x564196a7eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.759+0000 7f5de3400640 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564196a7e6f0 0x564196a7eb10 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.761+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v121'173 uv172 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.761+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x564196a7e6f0 2024-08-19T00:47:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.762+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v121'174 uv174 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.762+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x564196a7e6f0 2024-08-19T00:47:49.764 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:47:49.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.763+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v121'175 uv175 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.763+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a815b0 con 0x564196a7e6f0 2024-08-19T00:47:49.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.764+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v121'176 uv176 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.764+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x564196a7e6f0 2024-08-19T00:47:49.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.766+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v121'177 uv177 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.766+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x5641969c8290 2024-08-19T00:47:49.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.767+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v121'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.767+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x5641969c8290 2024-08-19T00:47:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.768+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v121'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.768+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x5641969c8290 2024-08-19T00:47:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.770+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v121'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.771 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:47:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.770+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a815b0 con 0x5641969c8290 2024-08-19T00:47:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.771+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v121'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.771+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x5641969c8290 2024-08-19T00:47:49.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.772+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v121'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.772+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x5641969c8290 2024-08-19T00:47:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.773+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v121'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x5641969c8290 2024-08-19T00:47:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.774+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x564196a72ea0 2024-08-19T00:47:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.775+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v121'345 uv339 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.775+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x564196a72ea0 2024-08-19T00:47:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.776+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v121'346 uv346 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.776+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81570 con 0x564196a72ea0 2024-08-19T00:47:49.779 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:47:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.778+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v121'347 uv347 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.778+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a819d0 con 0x564196a72ea0 2024-08-19T00:47:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.779+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v121'348 uv348 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.780+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a819d0 con 0x564196a72ea0 2024-08-19T00:47:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.781+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v121'349 uv349 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.781+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a819d0 con 0x564196a72ea0 2024-08-19T00:47:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.782+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v121'350 uv344 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.782+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a819d0 con 0x564196a72ea0 2024-08-19T00:47:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.784+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v121'351 uv351 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.784+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a819d0 con 0x564196a72ea0 2024-08-19T00:47:49.786 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:47:49.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.785+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v121'352 uv352 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.785+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a819d0 con 0x564196a72ea0 2024-08-19T00:47:49.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.787+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v121'353 uv353 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.787+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a847e0 con 0x564196a72ea0 2024-08-19T00:47:49.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.790+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v121'354 uv354 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a72ea0 2024-08-19T00:47:49.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.790+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.791+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v121'152 uv150 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.791+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.793+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v121'153 uv153 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.793+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.796 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:47:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.794+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v121'154 uv154 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.794+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.796+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v121'155 uv155 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.796+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.798+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v121'207 uv206 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.798+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.799+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v121'208 uv208 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.799+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.801+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v121'209 uv209 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.803 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:47:49.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.801+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a82e90 con 0x564196a77490 2024-08-19T00:47:49.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.802+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v121'210 uv210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.802+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a82e90 con 0x564196a77490 2024-08-19T00:47:49.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.804+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v121'211 uv211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.804+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a77490 2024-08-19T00:47:49.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.806+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v121'212 uv212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5ddc00a9c0 con 0x564196a77490 2024-08-19T00:47:49.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.806+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.807+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v121'176 uv175 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.807+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.808+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v121'177 uv177 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.809+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.811 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:47:49.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.810+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v121'178 uv178 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.810+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.811+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v121'179 uv179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.811+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.812+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v121'180 uv180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.812+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.814+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v121'429 uv420 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.814+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.815+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v121'430 uv430 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.815+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.818 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:47:49.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.817+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v121'431 uv431 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.817+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.819+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v121'432 uv432 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.819+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.820+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v121'433 uv433 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.820+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.821+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v121'434 uv427 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.821+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.823+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v121'435 uv435 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.823+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.826 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:47:49.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.824+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v121'436 uv436 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.824+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.826+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v121'437 uv437 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.826+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.827+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v121'438 uv438 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.827+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a81e80 con 0x564196a7e6f0 2024-08-19T00:47:49.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.828+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v121'439 uv439 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.828+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564196a82290 con 0x564196a7e6f0 2024-08-19T00:47:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de3400640 1 -- 172.21.15.7:0/917489455 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v121'440 uv440 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f5dd0022070 con 0x564196a7e6f0 2024-08-19T00:47:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564196a6ecd0 msgr2=0x564196a710c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564196a6ecd0 0x564196a710c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564196a7afc0 msgr2=0x564196a7d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564196a7afc0 0x564196a7d3b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564196a7e6f0 msgr2=0x564196a7eb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564196a7e6f0 0x564196a7eb10 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564196a72ea0 msgr2=0x564196a75290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564196a72ea0 0x564196a75290 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5641969c8290 msgr2=0x5641969b84e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5641969c8290 0x5641969b84e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de4800640 1 -- 172.21.15.7:0/917489455 reap_dead start 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564196a77490 msgr2=0x564196a7a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564196a77490 0x564196a7a180 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5dc406a810 msgr2=0x7f5dc406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5dc406a810 0x7f5dc406ccd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4057000 tx=0x7f5dd4053000 comp rx=0 tx=0).stop 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 msgr2=0x5641969c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969c7d50 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0000be0 tx=0x7f5dd0001a40 comp rx=0 tx=0).stop 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 shutdown_connections 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x5641969c8290 0x5641969b84e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5dc406a810 0x7f5dc406ccd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564196a77490 0x564196a7a180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 --2- 172.21.15.7:0/917489455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56419693f0e0 0x5641969c7d50 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 >> 172.21.15.7:0/917489455 conn(0x5641969224e0 msgr2=0x5641968f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 shutdown_connections 2024-08-19T00:47:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.830+0000 7f5de6b21f40 1 -- 172.21.15.7:0/917489455 wait complete. 2024-08-19T00:47:49.837 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 600.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:47:49.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.914+0000 7f3a04b08f40 1 Processor -- start 2024-08-19T00:47:49.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.914+0000 7f3a04b08f40 1 -- start start 2024-08-19T00:47:49.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a04b08f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a5897c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a04b08f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f5b0 0x557a58a07db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a04b08f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f990 0x557a58a1cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a04b08f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a5897e8f0 con 0x557a5897df40 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a04b08f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a588f3d00 con 0x557a5897f5b0 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a04b08f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557a58a24dc0 con 0x557a5897f990 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a5897c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a5897c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49448/0 (socket says 172.21.15.7:49448) 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 -- 172.21.15.7:0/712092322 learned_addr learned my addr 172.21.15.7:0/712092322 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a02800640 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f990 0x557a58a1cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01400640 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f5b0 0x557a58a07db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 -- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f990 msgr2=0x557a58a1cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f990 0x557a58a1cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 -- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f5b0 msgr2=0x557a58a07db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:49.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f5b0 0x557a58a07db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.915+0000 7f3a01e00640 1 -- 172.21.15.7:0/712092322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a58878b30 con 0x557a5897df40 2024-08-19T00:47:49.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a01e00640 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a5897c8c0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f39f4001e00 tx=0x7f39f400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac116280a2a5070 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f39fbe00640 1 -- 172.21.15.7:0/712092322 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4012020 con 0x557a5897df40 2024-08-19T00:47:49.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f39fbe00640 1 -- 172.21.15.7:0/712092322 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f400e670 con 0x557a5897df40 2024-08-19T00:47:49.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f39fbe00640 1 -- 172.21.15.7:0/712092322 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f400eae0 con 0x557a5897df40 2024-08-19T00:47:49.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a04b08f40 1 -- 172.21.15.7:0/712092322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 msgr2=0x557a5897c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a5897c8c0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f39f4001e00 tx=0x7f39f400b780 comp rx=0 tx=0).stop 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a04b08f40 1 -- 172.21.15.7:0/712092322 shutdown_connections 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f990 0x557a58a1cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f5b0 0x557a58a07db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/712092322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a5897c8c0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.916+0000 7f3a04b08f40 1 -- 172.21.15.7:0/712092322 >> 172.21.15.7:0/712092322 conn(0x557a5897c4e0 msgr2=0x557a5894cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.917+0000 7f3a04b08f40 1 -- 172.21.15.7:0/712092322 shutdown_connections 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.917+0000 7f3a04b08f40 1 -- 172.21.15.7:0/712092322 wait complete. 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.917+0000 7f3a04b08f40 1 Processor -- start 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.917+0000 7f3a04b08f40 1 -- start start 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.918+0000 7f3a04b08f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a58a20390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.918+0000 7f3a04b08f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f5b0 0x557a58a196b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.918+0000 7f3a04b08f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f990 0x557a58ab3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.918+0000 7f3a04b08f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a5897ce00 con 0x557a5897df40 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.918+0000 7f3a04b08f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a58a1a190 con 0x557a5897f990 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.918+0000 7f3a04b08f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557a58a1a470 con 0x557a5897f5b0 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.918+0000 7f3a01e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a58a20390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a58a20390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49462/0 (socket says 172.21.15.7:49462) 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 -- 172.21.15.7:0/3381320729 learned_addr learned my addr 172.21.15.7:0/3381320729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a02800640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f990 0x557a58ab3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01400640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f5b0 0x557a58a196b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 -- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f5b0 msgr2=0x557a58a196b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557a5897f5b0 0x557a58a196b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 -- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f990 msgr2=0x557a58ab3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f990 0x557a58ab3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 -- 172.21.15.7:0/3381320729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a588b5080 con 0x557a5897df40 2024-08-19T00:47:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a02800640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a5897f990 0x557a58ab3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:47:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.919+0000 7f3a01e00640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a58a20390 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f39f400b7c0 tx=0x7f39f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.920+0000 7f39faa00640 1 -- 172.21.15.7:0/3381320729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4012030 con 0x557a5897df40 2024-08-19T00:47:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.920+0000 7f39faa00640 1 -- 172.21.15.7:0/3381320729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f400e470 con 0x557a5897df40 2024-08-19T00:47:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.920+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a58a06dd0 con 0x557a5897df40 2024-08-19T00:47:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.920+0000 7f39faa00640 1 -- 172.21.15.7:0/3381320729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4017850 con 0x557a5897df40 2024-08-19T00:47:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.920+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a58a06ad0 con 0x557a5897df40 2024-08-19T00:47:49.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.922+0000 7f39faa00640 1 -- 172.21.15.7:0/3381320729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39f4029060 con 0x557a5897df40 2024-08-19T00:47:49.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.922+0000 7f39faa00640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39e406a840 0x7f39e406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.923+0000 7f39faa00640 1 -- 172.21.15.7:0/3381320729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8719+0+0 (secure 0 0 0) 0x7f39f408ba60 con 0x557a5897df40 2024-08-19T00:47:49.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.923+0000 7f3a01400640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39e406a840 0x7f39e406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.923+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a58a07040 0x557a58abe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:49.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.923+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x557a58a19bf0 con 0x557a58a07040 2024-08-19T00:47:49.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.923+0000 7f3a02800640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a58a07040 0x557a58abe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:49.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.923+0000 7f3a01400640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39e406a840 0x7f39e406cd00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f39f0056000 tx=0x7f39f0050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.924+0000 7f3a02800640 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a58a07040 0x557a58abe5f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:49.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a02800640 1 -- 172.21.15.7:0/3381320729 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 600.00000000 [omap-set-header] v121'1096 uv1096 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f39fc014420 con 0x557a58a07040 2024-08-19T00:47:49.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a58a07040 msgr2=0x557a58abe5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x557a58a07040 0x557a58abe5f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39e406a840 msgr2=0x7f39e406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f39e406a840 0x7f39e406cd00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f39f0056000 tx=0x7f39f0050000 comp rx=0 tx=0).stop 2024-08-19T00:47:49.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 msgr2=0x557a58a20390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:49.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 --2- 172.21.15.7:0/3381320729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a5897df40 0x557a58a20390 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f39f400b7c0 tx=0x7f39f4000bc0 comp rx=0 tx=0).stop 2024-08-19T00:47:49.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a02800640 1 -- 172.21.15.7:0/3381320729 reap_dead start 2024-08-19T00:47:49.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 shutdown_connections 2024-08-19T00:47:49.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 >> 172.21.15.7:0/3381320729 conn(0x557a5897c4e0 msgr2=0x557a58a271b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:49.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 shutdown_connections 2024-08-19T00:47:49.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:49.926+0000 7f3a04b08f40 1 -- 172.21.15.7:0/3381320729 wait complete. 2024-08-19T00:47:49.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:47:50.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.091+0000 7f86c4c00640 1 Processor -- start 2024-08-19T00:47:50.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.091+0000 7f86c4c00640 1 -- start start 2024-08-19T00:47:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.092+0000 7f86c4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86c00d27b0 0x7f86c00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.092+0000 7f86c4c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c00b4df0 con 0x7f86c015e3e0 2024-08-19T00:47:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.092+0000 7f86c4c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c00b50d0 con 0x7f86c00b4150 2024-08-19T00:47:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.092+0000 7f86c4c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f86c00d3140 con 0x7f86c00d27b0 2024-08-19T00:47:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.092+0000 7f86b6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86c00d27b0 0x7f86c00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.092+0000 7f86bf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f86c015e3e0 0x7f86c00b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35156/0 (socket says 172.21.15.7:35156) 2024-08-19T00:47:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.092+0000 7f86bf400640 1 -- 172.21.15.7:0/1984159091 learned_addr learned my addr 172.21.15.7:0/1984159091 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:50.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.093+0000 7f86b6a00640 1 -- 172.21.15.7:0/1984159091 >> v1:172.21.15.162:6789/0 conn(0x7f86c00b4150 legacy=0x7f86c00b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:50.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.093+0000 7f86b6a00640 1 -- 172.21.15.7:0/1984159091 >> v1:172.21.15.7:6789/0 conn(0x7f86c015e3e0 legacy=0x7f86c00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:50.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.093+0000 7f86b6a00640 1 -- 172.21.15.7:0/1984159091 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00cf1e0 con 0x7f86c00d27b0 2024-08-19T00:47:50.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.094+0000 7f86b6a00640 1 --2- 172.21.15.7:0/1984159091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00d27b0 0x7f86c00d2c00 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f86a80097d0 tx=0x7f86a802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8d8236e88b2119 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:50.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.094+0000 7f86bea00640 1 -- 172.21.15.7:0/1984159091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8037070 con 0x7f86c00d27b0 2024-08-19T00:47:50.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.094+0000 7f86bea00640 1 -- 172.21.15.7:0/1984159091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a8032440 con 0x7f86c00d27b0 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.094+0000 7f86bea00640 1 -- 172.21.15.7:0/1984159091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8032810 con 0x7f86c00d27b0 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.095+0000 7f86c4c00640 1 -- 172.21.15.7:0/1984159091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00d27b0 msgr2=0x7f86c00d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.095+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1984159091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00d27b0 0x7f86c00d2c00 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f86a80097d0 tx=0x7f86a802a250 comp rx=0 tx=0).stop 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.095+0000 7f86c4c00640 1 -- 172.21.15.7:0/1984159091 shutdown_connections 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.095+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1984159091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00d27b0 0x7f86c00d2c00 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.095+0000 7f86c4c00640 1 -- 172.21.15.7:0/1984159091 >> 172.21.15.7:0/1984159091 conn(0x7f86c008dbe0 msgr2=0x7f86c009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.095+0000 7f86c4c00640 1 -- 172.21.15.7:0/1984159091 shutdown_connections 2024-08-19T00:47:50.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.095+0000 7f86c4c00640 1 -- 172.21.15.7:0/1984159091 wait complete. 2024-08-19T00:47:50.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.096+0000 7f86c4c00640 1 Processor -- start 2024-08-19T00:47:50.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.097+0000 7f86c4c00640 1 -- start start 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.097+0000 7f86c4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00b4150 0x7f86c00cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86c4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86c00d27b0 0x7f86c01f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86c4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86c015e3e0 0x7f86c0160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86c4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86c00cf9e0 con 0x7f86c00b4150 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86c4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86c00cee90 con 0x7f86c015e3e0 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86c4c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f86c00cfb60 con 0x7f86c00d27b0 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00b4150 0x7f86c00cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00b4150 0x7f86c00cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49474/0 (socket says 172.21.15.7:49474) 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 -- 172.21.15.7:0/1471468749 learned_addr learned my addr 172.21.15.7:0/1471468749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86b6a00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86c00d27b0 0x7f86c01f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bfe00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86c015e3e0 0x7f86c0160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:50.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 -- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86c00d27b0 msgr2=0x7f86c01f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:50.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86c00d27b0 0x7f86c01f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:50.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 -- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86c015e3e0 msgr2=0x7f86c0160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:50.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86c015e3e0 0x7f86c0160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:50.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.098+0000 7f86bf400640 1 -- 172.21.15.7:0/1471468749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c01f4d70 con 0x7f86c00b4150 2024-08-19T00:47:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.099+0000 7f86bf400640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00b4150 0x7f86c00cc9a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c4b0 tx=0x7f86b000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.099+0000 7f86b7e00640 1 -- 172.21.15.7:0/1471468749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0017070 con 0x7f86c00b4150 2024-08-19T00:47:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.099+0000 7f86b7e00640 1 -- 172.21.15.7:0/1471468749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b0005ce0 con 0x7f86c00b4150 2024-08-19T00:47:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.099+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c00cc510 con 0x7f86c00b4150 2024-08-19T00:47:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.099+0000 7f86b7e00640 1 -- 172.21.15.7:0/1471468749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0007270 con 0x7f86c00b4150 2024-08-19T00:47:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.099+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c00b87c0 con 0x7f86c00b4150 2024-08-19T00:47:50.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.100+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c00b8310 con 0x7f86c00b4150 2024-08-19T00:47:50.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.101+0000 7f86b7e00640 1 -- 172.21.15.7:0/1471468749 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86b001a070 con 0x7f86c00b4150 2024-08-19T00:47:50.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.102+0000 7f86b7e00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f869c06be30 0x7f869c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:50.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.102+0000 7f86b7e00640 1 -- 172.21.15.7:0/1471468749 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8719+0+0 (secure 0 0 0) 0x7f86b008ac40 con 0x7f86c00b4150 2024-08-19T00:47:50.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.102+0000 7f86b6a00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f869c06be30 0x7f869c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:50.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.103+0000 7f86b6a00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f869c06be30 0x7f869c06e2f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f86a8034000 tx=0x7f86a802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:50.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.106+0000 7f86b7e00640 1 -- 172.21.15.7:0/1471468749 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f86c01f4d70 con 0x7f86c00b4150 2024-08-19T00:47:50.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.329+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f86c00d2c00 con 0x7f86c00b4150 2024-08-19T00:47:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.912+0000 7f86b7e00640 1 -- 172.21.15.7:0/1471468749 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v303) ==== 162+0+0 (secure 0 0 0) 0x7f86b00583c0 con 0x7f86c00b4150 2024-08-19T00:47:50.914 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:47:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.914+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f869c06be30 msgr2=0x7f869c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.914+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f869c06be30 0x7f869c06e2f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f86a8034000 tx=0x7f86a802e000 comp rx=0 tx=0).stop 2024-08-19T00:47:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.914+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00b4150 msgr2=0x7f86c00cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.914+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00b4150 0x7f86c00cc9a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c4b0 tx=0x7f86b000c970 comp rx=0 tx=0).stop 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 shutdown_connections 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f869c06be30 0x7f869c06e2f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86c015e3e0 0x7f86c0160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86c00d27b0 0x7f86c01f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 --2- 172.21.15.7:0/1471468749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86c00b4150 0x7f86c00cc9a0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 >> 172.21.15.7:0/1471468749 conn(0x7f86c008dbe0 msgr2=0x7f86c00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 shutdown_connections 2024-08-19T00:47:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:50.915+0000 7f86c4c00640 1 -- 172.21.15.7:0/1471468749 wait complete. 2024-08-19T00:47:50.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.095+0000 7f0a74600640 1 Processor -- start 2024-08-19T00:47:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.095+0000 7f0a74600640 1 -- start start 2024-08-19T00:47:51.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.096+0000 7f0a74600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:51.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a74600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a6c0739a0 0x7f0a6c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:51.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a74600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a6c0cea40 0x7f0a6c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:51.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a74600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0a6c06f7f0 con 0x7f0a6c0739a0 2024-08-19T00:47:51.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a74600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0a6c06f510 con 0x7f0a6c0cea40 2024-08-19T00:47:51.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a74600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6c072980 con 0x7f0a6c159bf0 2024-08-19T00:47:51.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a6c0739a0 0x7f0a6c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a6c0739a0 0x7f0a6c0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49484/0 (socket says 172.21.15.7:49484) 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 -- 172.21.15.7:0/3721609451 learned_addr learned my addr 172.21.15.7:0/3721609451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71c00640 1 --2- 172.21.15.7:0/3721609451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a72600640 1 --2- 172.21.15.7:0/3721609451 >> v2:172.21.15.162:3300/0 conn(0x7f0a6c0cea40 0x7f0a6c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 -- 172.21.15.7:0/3721609451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 msgr2=0x7f0a6c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 --2- 172.21.15.7:0/3721609451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 -- 172.21.15.7:0/3721609451 >> v2:172.21.15.162:3300/0 conn(0x7f0a6c0cea40 msgr2=0x7f0a6c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 --2- 172.21.15.7:0/3721609451 >> v2:172.21.15.162:3300/0 conn(0x7f0a6c0cea40 0x7f0a6c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71200640 1 -- 172.21.15.7:0/3721609451 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c072c60 con 0x7f0a6c0739a0 2024-08-19T00:47:51.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.097+0000 7f0a71c00640 1 --2- 172.21.15.7:0/3721609451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:51.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.098+0000 7f0a71200640 1 --2- 172.21.15.7:0/3721609451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c0ce500 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0cdd20 tx=0x7f0a5802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851ec8be3ba19503 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:51.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a6be00640 1 -- 172.21.15.7:0/3721609451 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58037070 con 0x7f0a6c0739a0 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a6be00640 1 -- 172.21.15.7:0/3721609451 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a58032440 con 0x7f0a6c0739a0 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a6be00640 1 -- 172.21.15.7:0/3721609451 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58032810 con 0x7f0a6c0739a0 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 -- 172.21.15.7:0/3721609451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 msgr2=0x7f0a6c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 --2- 172.21.15.7:0/3721609451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c0ce500 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0cdd20 tx=0x7f0a5802a140 comp rx=0 tx=0).stop 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 -- 172.21.15.7:0/3721609451 shutdown_connections 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 --2- 172.21.15.7:0/3721609451 >> v2:172.21.15.162:3300/0 conn(0x7f0a6c0cea40 0x7f0a6c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 --2- 172.21.15.7:0/3721609451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c0ce500 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 --2- 172.21.15.7:0/3721609451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 -- 172.21.15.7:0/3721609451 >> 172.21.15.7:0/3721609451 conn(0x7f0a6c06bc70 msgr2=0x7f0a6c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 -- 172.21.15.7:0/3721609451 shutdown_connections 2024-08-19T00:47:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.099+0000 7f0a74600640 1 -- 172.21.15.7:0/3721609451 wait complete. 2024-08-19T00:47:51.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.101+0000 7f0a74600640 1 Processor -- start 2024-08-19T00:47:51.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.101+0000 7f0a74600640 1 -- start start 2024-08-19T00:47:51.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a74600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:51.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a74600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0cea40 0x7f0a6c0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a74600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a74600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c15a150 con 0x7f0a6c0739a0 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a74600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c159fd0 con 0x7f0a6c0cea40 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a74600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6c0d0900 con 0x7f0a6c159bf0 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a71c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a71c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49498/0 (socket says 172.21.15.7:49498) 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.102+0000 7f0a71c00640 1 -- 172.21.15.7:0/2137341469 learned_addr learned my addr 172.21.15.7:0/2137341469 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a71200640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0cea40 0x7f0a6c0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a72600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a71c00640 1 -- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 msgr2=0x7f0a6c0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a71c00640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c0b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a71c00640 1 -- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0cea40 msgr2=0x7f0a6c0b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:51.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a71c00640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0cea40 0x7f0a6c0b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a71c00640 1 -- 172.21.15.7:0/2137341469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c0b1530 con 0x7f0a6c0739a0 2024-08-19T00:47:51.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a71c00640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c155400 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e730 tx=0x7f0a6000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:51.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a69600640 1 -- 172.21.15.7:0/2137341469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000f040 con 0x7f0a6c0739a0 2024-08-19T00:47:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a69600640 1 -- 172.21.15.7:0/2137341469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a60004230 con 0x7f0a6c0739a0 2024-08-19T00:47:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a69600640 1 -- 172.21.15.7:0/2137341469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000ee40 con 0x7f0a6c0739a0 2024-08-19T00:47:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.103+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6c0b1810 con 0x7f0a6c0739a0 2024-08-19T00:47:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.104+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6c0ad120 con 0x7f0a6c0739a0 2024-08-19T00:47:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.105+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6c0d03c0 con 0x7f0a6c0739a0 2024-08-19T00:47:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.105+0000 7f0a69600640 1 -- 172.21.15.7:0/2137341469 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a6000c6d0 con 0x7f0a6c0739a0 2024-08-19T00:47:51.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.106+0000 7f0a69600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:51.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.106+0000 7f0a69600640 1 -- 172.21.15.7:0/2137341469 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8719+0+0 (secure 0 0 0) 0x7f0a6008b720 con 0x7f0a6c0739a0 2024-08-19T00:47:51.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.107+0000 7f0a71200640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:51.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.107+0000 7f0a71200640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0a58034000 tx=0x7f0a5802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.110+0000 7f0a69600640 1 -- 172.21.15.7:0/2137341469 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0a60017020 con 0x7f0a6c0739a0 2024-08-19T00:47:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.337+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a6c15a450 con 0x7f0a6c0739a0 2024-08-19T00:47:51.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.337+0000 7f0a69600640 1 -- 172.21.15.7:0/2137341469 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 304 v304) ==== 95+0+5225 (secure 0 0 0) 0x7f0a60058ea0 con 0x7f0a6c0739a0 2024-08-19T00:47:51.339 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:51.340 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":304,"btime":"2024-08-19T00:47:50:914927+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":304,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:50.914907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9954":{"gid":9954,"name":"a","rank":0,"incarnation":304,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/3239344481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3239344481},{"type":"v1","addr":"172.21.15.7:6837","nonce":3239344481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 304 2024-08-19T00:47:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a4c06be30 msgr2=0x7f0a4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:51.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0a58034000 tx=0x7f0a5802e000 comp rx=0 tx=0).stop 2024-08-19T00:47:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 msgr2=0x7f0a6c155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c155400 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e730 tx=0x7f0a6000ebf0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 shutdown_connections 2024-08-19T00:47:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0a4c06be30 0x7f0a4c06e2f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a6c159bf0 0x7f0a6c0b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0cea40 0x7f0a6c0b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 --2- 172.21.15.7:0/2137341469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a6c0739a0 0x7f0a6c155400 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.339+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 >> 172.21.15.7:0/2137341469 conn(0x7f0a6c06bc70 msgr2=0x7f0a6c160150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.340+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 shutdown_connections 2024-08-19T00:47:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:51.340+0000 7f0a74600640 1 -- 172.21.15.7:0/2137341469 wait complete. 2024-08-19T00:47:51.358 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:47:53.940 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:53.938+0000 7f6fe3200640 -1 mds.0.cache.dir(0x600) Corrupt fnode in dirfrag 0x600: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:47:53.940 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:53.938+0000 7f6fe3200640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-08-19T00:47:53.941 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:53.939+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:47:53.941 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:47:53.939+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:47:54.489 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:47:54.487+0000 7f6fe8200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:56.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.525+0000 7f4b59000640 1 Processor -- start 2024-08-19T00:47:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.525+0000 7f4b59000640 1 -- start start 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b59000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b540ce500 0x7f4b540ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b59000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5406f7f0 con 0x7f4b540d03c0 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b59000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5406f510 con 0x7f4b54159bf0 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b59000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4b54072980 con 0x7f4b540ce500 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b51400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b540ce500 0x7f4b540ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b52800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4b540d03c0 0x7f4b5406e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47828/0 (socket says 172.21.15.7:47828) 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b52800640 1 -- 172.21.15.7:0/1996467117 learned_addr learned my addr 172.21.15.7:0/1996467117 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.526+0000 7f4b51400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b540ce500 0x7f4b540ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40492/0 (socket says 172.21.15.7:40492) 2024-08-19T00:47:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.527+0000 7f4b51400640 1 -- 172.21.15.7:0/1996467117 >> v1:172.21.15.162:6789/0 conn(0x7f4b54159bf0 legacy=0x7f4b54073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.527+0000 7f4b51400640 1 -- 172.21.15.7:0/1996467117 >> v1:172.21.15.7:6789/0 conn(0x7f4b540d03c0 legacy=0x7f4b5406e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.527+0000 7f4b51400640 1 -- 172.21.15.7:0/1996467117 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b54072c60 con 0x7f4b540ce500 2024-08-19T00:47:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.528+0000 7f4b51400640 1 --2- 172.21.15.7:0/1996467117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b540ce500 0x7f4b540ce970 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097a0 tx=0x7f4b4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5c9a8353d8531c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.528+0000 7f4b50a00640 1 -- 172.21.15.7:0/1996467117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40037070 con 0x7f4b540ce500 2024-08-19T00:47:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.528+0000 7f4b50a00640 1 -- 172.21.15.7:0/1996467117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b40032440 con 0x7f4b540ce500 2024-08-19T00:47:56.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.528+0000 7f4b50a00640 1 -- 172.21.15.7:0/1996467117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40032810 con 0x7f4b540ce500 2024-08-19T00:47:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.529+0000 7f4b59000640 1 -- 172.21.15.7:0/1996467117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b540ce500 msgr2=0x7f4b540ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.529+0000 7f4b59000640 1 --2- 172.21.15.7:0/1996467117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b540ce500 0x7f4b540ce970 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097a0 tx=0x7f4b4002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.529+0000 7f4b59000640 1 -- 172.21.15.7:0/1996467117 shutdown_connections 2024-08-19T00:47:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.529+0000 7f4b59000640 1 --2- 172.21.15.7:0/1996467117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b540ce500 0x7f4b540ce970 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.529+0000 7f4b59000640 1 -- 172.21.15.7:0/1996467117 >> 172.21.15.7:0/1996467117 conn(0x7f4b5406bc70 msgr2=0x7f4b5406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.529+0000 7f4b59000640 1 -- 172.21.15.7:0/1996467117 shutdown_connections 2024-08-19T00:47:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.529+0000 7f4b59000640 1 -- 172.21.15.7:0/1996467117 wait complete. 2024-08-19T00:47:56.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.530+0000 7f4b59000640 1 Processor -- start 2024-08-19T00:47:56.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.531+0000 7f4b59000640 1 -- start start 2024-08-19T00:47:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.531+0000 7f4b59000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540ce500 0x7f4b541f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.531+0000 7f4b59000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b540d03c0 0x7f4b540b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.531+0000 7f4b59000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b54159bf0 0x7f4b540b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.531+0000 7f4b59000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b54159fd0 con 0x7f4b54159bf0 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.531+0000 7f4b59000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b54073b70 con 0x7f4b540d03c0 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.531+0000 7f4b59000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5415a150 con 0x7f4b540ce500 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b54159bf0 0x7f4b540b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b54159bf0 0x7f4b540b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40502/0 (socket says 172.21.15.7:40502) 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 -- 172.21.15.7:0/3562551179 learned_addr learned my addr 172.21.15.7:0/3562551179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b51400640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b540d03c0 0x7f4b540b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b51e00640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540ce500 0x7f4b541f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 -- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540ce500 msgr2=0x7f4b541f3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540ce500 0x7f4b541f3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 -- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b540d03c0 msgr2=0x7f4b540b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b540d03c0 0x7f4b540b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 -- 172.21.15.7:0/3562551179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b54145d90 con 0x7f4b54159bf0 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b51400640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b540d03c0 0x7f4b540b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b51e00640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540ce500 0x7f4b541f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.532+0000 7f4b52800640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b54159bf0 0x7f4b540b1a40 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00cbc0 tx=0x7f4b4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.533+0000 7f4b4a000640 1 -- 172.21.15.7:0/3562551179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c017070 con 0x7f4b54159bf0 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.533+0000 7f4b4a000640 1 -- 172.21.15.7:0/3562551179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c00ad40 con 0x7f4b54159bf0 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.533+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b54146070 con 0x7f4b54159bf0 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.533+0000 7f4b4a000640 1 -- 172.21.15.7:0/3562551179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c012600 con 0x7f4b54159bf0 2024-08-19T00:47:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.533+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b541f4280 con 0x7f4b54159bf0 2024-08-19T00:47:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.534+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b540ce970 con 0x7f4b54159bf0 2024-08-19T00:47:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.535+0000 7f4b4a000640 1 -- 172.21.15.7:0/3562551179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b4c01a070 con 0x7f4b54159bf0 2024-08-19T00:47:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.536+0000 7f4b4a000640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4b3406be60 0x7f4b3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.536+0000 7f4b4a000640 1 -- 172.21.15.7:0/3562551179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f4b4c08b710 con 0x7f4b54159bf0 2024-08-19T00:47:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.536+0000 7f4b51e00640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4b3406be60 0x7f4b3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.537+0000 7f4b51e00640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4b3406be60 0x7f4b3406e320 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000f60 tx=0x7f4b44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:56.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.541+0000 7f4b4a000640 1 -- 172.21.15.7:0/3562551179 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4b4c058e30 con 0x7f4b54159bf0 2024-08-19T00:47:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.761+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b540cf5c0 con 0x7f4b54159bf0 2024-08-19T00:47:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.762+0000 7f4b4a000640 1 -- 172.21.15.7:0/3562551179 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 308 v308) ==== 95+0+4393 (secure 0 0 0) 0x7f4b4c05d130 con 0x7f4b54159bf0 2024-08-19T00:47:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:56.764 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":308,"btime":"2024-08-19T00:47:53:940075+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":308,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:53.940070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:56.764 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 308 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4b3406be60 msgr2=0x7f4b3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4b3406be60 0x7f4b3406e320 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000f60 tx=0x7f4b44009040 comp rx=0 tx=0).stop 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b54159bf0 msgr2=0x7f4b540b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b54159bf0 0x7f4b540b1a40 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00cbc0 tx=0x7f4b4c00a430 comp rx=0 tx=0).stop 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 shutdown_connections 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4b3406be60 0x7f4b3406e320 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b54159bf0 0x7f4b540b1a40 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b540d03c0 0x7f4b540b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 --2- 172.21.15.7:0/3562551179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540ce500 0x7f4b541f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 >> 172.21.15.7:0/3562551179 conn(0x7f4b5406bc70 msgr2=0x7f4b5415b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:56.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 shutdown_connections 2024-08-19T00:47:56.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.764+0000 7f4b59000640 1 -- 172.21.15.7:0/3562551179 wait complete. 2024-08-19T00:47:56.781 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:47:56.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:56.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.937+0000 7fd88ce00640 1 Processor -- start 2024-08-19T00:47:56.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.937+0000 7fd88ce00640 1 -- start start 2024-08-19T00:47:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd88ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888159bf0 0x7fd888073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd88ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd8880cec10 0x7fd8880d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd88ce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88806f7f0 con 0x7fd8880739a0 2024-08-19T00:47:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd88ce00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd88806f510 con 0x7fd8880cec10 2024-08-19T00:47:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd88ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd888072980 con 0x7fd888159bf0 2024-08-19T00:47:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd886800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd8880cec10 0x7fd8880d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd885400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd8880739a0 0x7fd8880ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47840/0 (socket says 172.21.15.7:47840) 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd886800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd8880cec10 0x7fd8880d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40506/0 (socket says 172.21.15.7:40506) 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd885400640 1 -- 172.21.15.7:0/1726840382 learned_addr learned my addr 172.21.15.7:0/1726840382 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd885e00640 1 --2- 172.21.15.7:0/1726840382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888159bf0 0x7fd888073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd886800640 1 -- 172.21.15.7:0/1726840382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888159bf0 msgr2=0x7fd888073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd886800640 1 --2- 172.21.15.7:0/1726840382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888159bf0 0x7fd888073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd886800640 1 -- 172.21.15.7:0/1726840382 >> v1:172.21.15.7:6789/0 conn(0x7fd8880739a0 legacy=0x7fd8880ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd886800640 1 -- 172.21.15.7:0/1726840382 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd888072c60 con 0x7fd8880cec10 2024-08-19T00:47:56.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.939+0000 7fd884a00640 1 -- 172.21.15.7:0/1726840382 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624254847 0 0) 0x7fd88806f7f0 con 0x7fd8880739a0 2024-08-19T00:47:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.940+0000 7fd886800640 1 --2- 172.21.15.7:0/1726840382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880cec10 0x7fd8880d03c0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fd880009d90 tx=0x7fd88002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5931f22fd75ff3f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd884a00640 1 -- 172.21.15.7:0/1726840382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880031600 con 0x7fd8880cec10 2024-08-19T00:47:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd884a00640 1 -- 172.21.15.7:0/1726840382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8800317a0 con 0x7fd8880cec10 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd884a00640 1 -- 172.21.15.7:0/1726840382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880031b70 con 0x7fd8880cec10 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd88ce00640 1 -- 172.21.15.7:0/1726840382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880cec10 msgr2=0x7fd8880d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1726840382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880cec10 0x7fd8880d03c0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fd880009d90 tx=0x7fd88002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd88ce00640 1 -- 172.21.15.7:0/1726840382 shutdown_connections 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1726840382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880cec10 0x7fd8880d03c0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1726840382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888159bf0 0x7fd888073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd88ce00640 1 -- 172.21.15.7:0/1726840382 >> 172.21.15.7:0/1726840382 conn(0x7fd88806bc70 msgr2=0x7fd88806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.941+0000 7fd88ce00640 1 -- 172.21.15.7:0/1726840382 shutdown_connections 2024-08-19T00:47:56.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.942+0000 7fd88ce00640 1 -- 172.21.15.7:0/1726840382 wait complete. 2024-08-19T00:47:56.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.943+0000 7fd88ce00640 1 Processor -- start 2024-08-19T00:47:56.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.943+0000 7fd88ce00640 1 -- start start 2024-08-19T00:47:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd88ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880739a0 0x7fd888148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd88ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888159bf0 0x7fd88815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd88ce00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88815ee90 0x7fd88809c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd88ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd88815a150 con 0x7fd8880739a0 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd88ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd888159fd0 con 0x7fd888159bf0 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd88ce00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd8880d0900 con 0x7fd88815ee90 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd885e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880739a0 0x7fd888148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd885e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880739a0 0x7fd888148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40522/0 (socket says 172.21.15.7:40522) 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd885e00640 1 -- 172.21.15.7:0/1378748382 learned_addr learned my addr 172.21.15.7:0/1378748382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd886800640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88815ee90 0x7fd88809c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.944+0000 7fd885400640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888159bf0 0x7fd88815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd885e00640 1 -- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88815ee90 msgr2=0x7fd88809c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd885e00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88815ee90 0x7fd88809c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd885e00640 1 -- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888159bf0 msgr2=0x7fd88815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd885e00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888159bf0 0x7fd88815e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd885e00640 1 -- 172.21.15.7:0/1378748382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88809d7e0 con 0x7fd8880739a0 2024-08-19T00:47:56.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd885e00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880739a0 0x7fd888148350 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fd87800e9b0 tx=0x7fd87800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:56.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd87e000640 1 -- 172.21.15.7:0/1378748382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878017070 con 0x7fd8880739a0 2024-08-19T00:47:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd87e000640 1 -- 172.21.15.7:0/1378748382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87800c9a0 con 0x7fd8880739a0 2024-08-19T00:47:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd87e000640 1 -- 172.21.15.7:0/1378748382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87800cd90 con 0x7fd8880739a0 2024-08-19T00:47:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.945+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88809dac0 con 0x7fd8880739a0 2024-08-19T00:47:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.946+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd888148890 con 0x7fd8880739a0 2024-08-19T00:47:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.947+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd88815f2a0 con 0x7fd8880739a0 2024-08-19T00:47:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.948+0000 7fd87e000640 1 -- 172.21.15.7:0/1378748382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd87801a070 con 0x7fd8880739a0 2024-08-19T00:47:56.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.948+0000 7fd87e000640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd86806be30 0x7fd86806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:56.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.949+0000 7fd87e000640 1 -- 172.21.15.7:0/1378748382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7fd87808bd10 con 0x7fd8880739a0 2024-08-19T00:47:56.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.949+0000 7fd885400640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd86806be30 0x7fd86806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:56.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.949+0000 7fd885400640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd86806be30 0x7fd86806e2f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd888157f90 tx=0x7fd874007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:56.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:56.953+0000 7fd87e000640 1 -- 172.21.15.7:0/1378748382 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd88815f2a0 con 0x7fd8880739a0 2024-08-19T00:47:57.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.172+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd88815b0a0 con 0x7fd8880739a0 2024-08-19T00:47:57.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.173+0000 7fd87e000640 1 -- 172.21.15.7:0/1378748382 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 308 v308) ==== 95+0+4393 (secure 0 0 0) 0x7fd878059490 con 0x7fd8880739a0 2024-08-19T00:47:57.175 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:57.175 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":308,"btime":"2024-08-19T00:47:53:940075+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":308,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:53.940070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:57.175 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 308 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd86806be30 msgr2=0x7fd86806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd86806be30 0x7fd86806e2f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd888157f90 tx=0x7fd874007de0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880739a0 msgr2=0x7fd888148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880739a0 0x7fd888148350 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fd87800e9b0 tx=0x7fd87800ee70 comp rx=0 tx=0).stop 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 shutdown_connections 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd86806be30 0x7fd86806e2f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88815ee90 0x7fd88809c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888159bf0 0x7fd88815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 --2- 172.21.15.7:0/1378748382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8880739a0 0x7fd888148350 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 >> 172.21.15.7:0/1378748382 conn(0x7fd88806bc70 msgr2=0x7fd8880ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:57.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 shutdown_connections 2024-08-19T00:47:57.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.175+0000 7fd88ce00640 1 -- 172.21.15.7:0/1378748382 wait complete. 2024-08-19T00:47:57.193 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:47:57.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:47:57.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.349+0000 7f1809c00640 1 Processor -- start 2024-08-19T00:47:57.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.349+0000 7f1809c00640 1 -- start start 2024-08-19T00:47:57.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.350+0000 7f1809c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1804159bf0 0x7f1804073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.350+0000 7f1809c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18040cec10 0x7f18040d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.350+0000 7f1809c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f180406f7f0 con 0x7f18040739a0 2024-08-19T00:47:57.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.350+0000 7f1809c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f180406f510 con 0x7f18040cec10 2024-08-19T00:47:57.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.350+0000 7f1809c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1804072980 con 0x7f1804159bf0 2024-08-19T00:47:57.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1803400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18040cec10 0x7f18040d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1803400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18040cec10 0x7f18040d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40538/0 (socket says 172.21.15.7:40538) 2024-08-19T00:47:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1803400640 1 -- 172.21.15.7:0/257459967 learned_addr learned my addr 172.21.15.7:0/257459967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1802a00640 1 --2- 172.21.15.7:0/257459967 >> v2:172.21.15.162:3300/0 conn(0x7f1804159bf0 0x7f1804073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1803400640 1 -- 172.21.15.7:0/257459967 >> v2:172.21.15.162:3300/0 conn(0x7f1804159bf0 msgr2=0x7f1804073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1803400640 1 --2- 172.21.15.7:0/257459967 >> v2:172.21.15.162:3300/0 conn(0x7f1804159bf0 0x7f1804073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1803400640 1 -- 172.21.15.7:0/257459967 >> v1:172.21.15.162:6789/0 conn(0x7f18040739a0 legacy=0x7f18040ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.351+0000 7f1803400640 1 -- 172.21.15.7:0/257459967 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1804072c60 con 0x7f18040cec10 2024-08-19T00:47:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.352+0000 7f1803400640 1 --2- 172.21.15.7:0/257459967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18040cec10 0x7f18040d03c0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f180406d280 tx=0x7f17fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be51a3d6ca8c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.352+0000 7f1801600640 1 -- 172.21.15.7:0/257459967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc036070 con 0x7f18040cec10 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.352+0000 7f1801600640 1 -- 172.21.15.7:0/257459967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc031600 con 0x7f18040cec10 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.352+0000 7f1801600640 1 -- 172.21.15.7:0/257459967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0319d0 con 0x7f18040cec10 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 -- 172.21.15.7:0/257459967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18040cec10 msgr2=0x7f18040d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 --2- 172.21.15.7:0/257459967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18040cec10 0x7f18040d03c0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f180406d280 tx=0x7f17fc02a6a0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 -- 172.21.15.7:0/257459967 shutdown_connections 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 --2- 172.21.15.7:0/257459967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18040cec10 0x7f18040d03c0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 --2- 172.21.15.7:0/257459967 >> v2:172.21.15.162:3300/0 conn(0x7f1804159bf0 0x7f1804073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 -- 172.21.15.7:0/257459967 >> 172.21.15.7:0/257459967 conn(0x7f180406bc70 msgr2=0x7f180406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 -- 172.21.15.7:0/257459967 shutdown_connections 2024-08-19T00:47:57.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.353+0000 7f1809c00640 1 -- 172.21.15.7:0/257459967 wait complete. 2024-08-19T00:47:57.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.355+0000 7f1809c00640 1 Processor -- start 2024-08-19T00:47:57.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.355+0000 7f1809c00640 1 -- start start 2024-08-19T00:47:57.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1809c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18040739a0 0x7f180414c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1809c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1804159bf0 0x7f180409a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1809c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f180409ded0 0x7f180409bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1809c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f180415a150 con 0x7f180409ded0 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1809c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1804159fd0 con 0x7f1804159bf0 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1809c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f18040d0900 con 0x7f18040739a0 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f180409ded0 0x7f180409bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f180409ded0 0x7f180409bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40550/0 (socket says 172.21.15.7:40550) 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 -- 172.21.15.7:0/1061905836 learned_addr learned my addr 172.21.15.7:0/1061905836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1802a00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18040739a0 0x7f180414c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1802000640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1804159bf0 0x7f180409a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 -- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18040739a0 msgr2=0x7f180414c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18040739a0 0x7f180414c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 -- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1804159bf0 msgr2=0x7f180409a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1804159bf0 0x7f180409a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.356+0000 7f1803400640 1 -- 172.21.15.7:0/1061905836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180414ca20 con 0x7f180409ded0 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.357+0000 7f1803400640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f180409ded0 0x7f180409bbf0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f17fc02ac90 tx=0x7f17fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.357+0000 7f17faa00640 1 -- 172.21.15.7:0/1061905836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc03f020 con 0x7f180409ded0 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.357+0000 7f17faa00640 1 -- 172.21.15.7:0/1061905836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc037040 con 0x7f180409ded0 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.357+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180409ab50 con 0x7f180409ded0 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.357+0000 7f17faa00640 1 -- 172.21.15.7:0/1061905836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc036070 con 0x7f180409ded0 2024-08-19T00:47:57.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.357+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180409b110 con 0x7f180409ded0 2024-08-19T00:47:57.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.358+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18040d0c90 con 0x7f180409ded0 2024-08-19T00:47:57.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.359+0000 7f17faa00640 1 -- 172.21.15.7:0/1061905836 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17fc042020 con 0x7f180409ded0 2024-08-19T00:47:57.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.360+0000 7f17faa00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f17e406be30 0x7f17e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.360+0000 7f17faa00640 1 -- 172.21.15.7:0/1061905836 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f17fc0ac370 con 0x7f180409ded0 2024-08-19T00:47:57.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.360+0000 7f1802a00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f17e406be30 0x7f17e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.361+0000 7f1802a00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f17e406be30 0x7f17e406e2f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009ad0 tx=0x7f17f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:57.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.364+0000 7f17faa00640 1 -- 172.21.15.7:0/1061905836 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f17fc049020 con 0x7f180409ded0 2024-08-19T00:47:57.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.585+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f180406c3a0 con 0x7f180409ded0 2024-08-19T00:47:57.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.586+0000 7f17faa00640 1 -- 172.21.15.7:0/1061905836 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 308 v308) ==== 95+0+4393 (secure 0 0 0) 0x7f17fc079fd0 con 0x7f180409ded0 2024-08-19T00:47:57.588 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:47:57.588 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":308,"btime":"2024-08-19T00:47:53:940075+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":308,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:47:53.940070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:47:57.588 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 308 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f17e406be30 msgr2=0x7f17e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f17e406be30 0x7f17e406e2f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009ad0 tx=0x7f17f4008040 comp rx=0 tx=0).stop 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f180409ded0 msgr2=0x7f180409bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f180409ded0 0x7f180409bbf0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f17fc02ac90 tx=0x7f17fc004a40 comp rx=0 tx=0).stop 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 shutdown_connections 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f17e406be30 0x7f17e406e2f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f180409ded0 0x7f180409bbf0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1804159bf0 0x7f180409a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 --2- 172.21.15.7:0/1061905836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18040739a0 0x7f180414c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 >> 172.21.15.7:0/1061905836 conn(0x7f180406bc70 msgr2=0x7f1804160230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 shutdown_connections 2024-08-19T00:47:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.588+0000 7f1809c00640 1 -- 172.21.15.7:0/1061905836 wait complete. 2024-08-19T00:47:57.606 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 600.00000000' led to DAMAGED state 2024-08-19T00:47:57.606 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on mds0_openfiles.0' 2024-08-19T00:47:57.606 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:47:57.606 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:47:57.642 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:47:57.642 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:47:57.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:47:57.642 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:47:57.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:47:57.718 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:47:57.719 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:47:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.914+0000 7f29c6800640 1 Processor -- start 2024-08-19T00:47:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.914+0000 7f29c6800640 1 -- start start 2024-08-19T00:47:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.915+0000 7f29c6800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c0143ea0 0x7f29c015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.915+0000 7f29c6800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29c00b46b0 0x7f29c00d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.915+0000 7f29c6800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c015f700 con 0x7f29c0144280 2024-08-19T00:47:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.915+0000 7f29c6800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f29c0161d30 con 0x7f29c00b46b0 2024-08-19T00:47:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.915+0000 7f29c6800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f29c0161fd0 con 0x7f29c0143ea0 2024-08-19T00:47:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c0143ea0 0x7f29c015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c0143ea0 0x7f29c015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:53894/0 (socket says 172.21.15.7:53894) 2024-08-19T00:47:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5400640 1 -- 172.21.15.7:0/3525525342 learned_addr learned my addr 172.21.15.7:0/3525525342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5e00640 1 --2- 172.21.15.7:0/3525525342 >> v2:172.21.15.162:3300/0 conn(0x7f29c00b46b0 0x7f29c00d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5400640 1 -- 172.21.15.7:0/3525525342 >> v2:172.21.15.162:3300/0 conn(0x7f29c00b46b0 msgr2=0x7f29c00d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:47:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5400640 1 --2- 172.21.15.7:0/3525525342 >> v2:172.21.15.162:3300/0 conn(0x7f29c00b46b0 0x7f29c00d23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5400640 1 -- 172.21.15.7:0/3525525342 >> v1:172.21.15.162:6789/0 conn(0x7f29c0144280 legacy=0x7f29c00b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.916+0000 7f29c5400640 1 -- 172.21.15.7:0/3525525342 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01622b0 con 0x7f29c0143ea0 2024-08-19T00:47:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.917+0000 7f29c5400640 1 --2- 172.21.15.7:0/3525525342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c0143ea0 0x7f29c015f1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098a0 tx=0x7f29b402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe6b789e89d6053 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.918+0000 7f29bfe00640 1 -- 172.21.15.7:0/3525525342 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4037070 con 0x7f29c0143ea0 2024-08-19T00:47:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.918+0000 7f29bfe00640 1 -- 172.21.15.7:0/3525525342 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b4032440 con 0x7f29c0143ea0 2024-08-19T00:47:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.918+0000 7f29bfe00640 1 -- 172.21.15.7:0/3525525342 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4032810 con 0x7f29c0143ea0 2024-08-19T00:47:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.918+0000 7f29c6800640 1 -- 172.21.15.7:0/3525525342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c0143ea0 msgr2=0x7f29c015f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.919+0000 7f29c6800640 1 --2- 172.21.15.7:0/3525525342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c0143ea0 0x7f29c015f1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098a0 tx=0x7f29b402a290 comp rx=0 tx=0).stop 2024-08-19T00:47:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.919+0000 7f29c6800640 1 -- 172.21.15.7:0/3525525342 shutdown_connections 2024-08-19T00:47:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.919+0000 7f29c6800640 1 --2- 172.21.15.7:0/3525525342 >> v2:172.21.15.162:3300/0 conn(0x7f29c00b46b0 0x7f29c00d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.919+0000 7f29c6800640 1 --2- 172.21.15.7:0/3525525342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c0143ea0 0x7f29c015f1c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.919+0000 7f29c6800640 1 -- 172.21.15.7:0/3525525342 >> 172.21.15.7:0/3525525342 conn(0x7f29c0062540 msgr2=0x7f29c0062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.919+0000 7f29c6800640 1 -- 172.21.15.7:0/3525525342 shutdown_connections 2024-08-19T00:47:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.919+0000 7f29c6800640 1 -- 172.21.15.7:0/3525525342 wait complete. 2024-08-19T00:47:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.920+0000 7f29c6800640 1 Processor -- start 2024-08-19T00:47:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.921+0000 7f29c6800640 1 -- start start 2024-08-19T00:47:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.921+0000 7f29c6800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c00b46b0 0x7f29c0159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.921+0000 7f29c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29c0143ea0 0x7f29c0157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.921+0000 7f29c6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c0144280 0x7f29c01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.921+0000 7f29c6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0162b50 con 0x7f29c0143ea0 2024-08-19T00:47:57.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.921+0000 7f29c6800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0162870 con 0x7f29c0144280 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.921+0000 7f29c6800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f29c01446e0 con 0x7f29c00b46b0 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29c0143ea0 0x7f29c0157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29c0143ea0 0x7f29c0157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40552/0 (socket says 172.21.15.7:40552) 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 -- 172.21.15.7:0/1844644555 learned_addr learned my addr 172.21.15.7:0/1844644555 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c00b46b0 0x7f29c0159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c5e00640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c0144280 0x7f29c01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 -- 172.21.15.7:0/1844644555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c00b46b0 msgr2=0x7f29c0159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c00b46b0 0x7f29c0159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 -- 172.21.15.7:0/1844644555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c0144280 msgr2=0x7f29c01581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c0144280 0x7f29c01581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.922+0000 7f29c4a00640 1 -- 172.21.15.7:0/1844644555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01f41b0 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.923+0000 7f29c4a00640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29c0143ea0 0x7f29c0157c90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00c440 tx=0x7f29ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.923+0000 7f29bd600640 1 -- 172.21.15.7:0/1844644555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0052d0 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.923+0000 7f29bd600640 1 -- 172.21.15.7:0/1844644555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac005470 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.923+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c01f4490 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.923+0000 7f29bd600640 1 -- 172.21.15.7:0/1844644555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac007240 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.923+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c01f4a50 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.924+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c01439e0 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.925+0000 7f29bd600640 1 -- 172.21.15.7:0/1844644555 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29ac0073e0 con 0x7f29c0143ea0 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.926+0000 7f29bd600640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29a006be30 0x7f29a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.926+0000 7f29bd600640 1 -- 172.21.15.7:0/1844644555 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f29ac08ae80 con 0x7f29c0143ea0 2024-08-19T00:47:57.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.926+0000 7f29c5400640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29a006be30 0x7f29a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:57.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.927+0000 7f29c5400640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29a006be30 0x7f29a006e2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f29b4034000 tx=0x7f29b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:57.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:57.930+0000 7f29bd600640 1 -- 172.21.15.7:0/1844644555 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f29c015f700 con 0x7f29c0143ea0 2024-08-19T00:47:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.152+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f29c0072230 con 0x7f29c0143ea0 2024-08-19T00:47:58.694 INFO:tasks.ceph.mds.a.smithi007.stderr: -49> 2024-08-19T00:47:53.938+0000 7f6fe3200640 -1 mds.0.cache.dir(0x600) Corrupt fnode in dirfrag 0x600: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:47:58.694 INFO:tasks.ceph.mds.a.smithi007.stderr: -46> 2024-08-19T00:47:53.938+0000 7f6fe3200640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2024-08-19T00:47:58.694 INFO:tasks.ceph.mds.a.smithi007.stderr: -34> 2024-08-19T00:47:54.487+0000 7f6fe8200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:47:58.734 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:47:58.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.948+0000 7f29bd600640 1 -- 172.21.15.7:0/1844644555 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v309) ==== 161+0+0 (secure 0 0 0) 0x7f29ac0585a0 con 0x7f29c0143ea0 2024-08-19T00:47:58.950 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:47:58.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29a006be30 msgr2=0x7f29a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:58.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29a006be30 0x7f29a006e2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f29b4034000 tx=0x7f29b402e000 comp rx=0 tx=0).stop 2024-08-19T00:47:58.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29c0143ea0 msgr2=0x7f29c0157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:58.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29c0143ea0 0x7f29c0157c90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00c440 tx=0x7f29ac001e70 comp rx=0 tx=0).stop 2024-08-19T00:47:58.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 shutdown_connections 2024-08-19T00:47:58.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f29a006be30 0x7f29a006e2f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c0144280 0x7f29c01581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29c0143ea0 0x7f29c0157c90 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 --2- 172.21.15.7:0/1844644555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29c00b46b0 0x7f29c0159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 >> 172.21.15.7:0/1844644555 conn(0x7f29c0062540 msgr2=0x7f29c0160e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 shutdown_connections 2024-08-19T00:47:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:58.951+0000 7f29c6800640 1 -- 172.21.15.7:0/1844644555 wait complete. 2024-08-19T00:47:58.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:47:59.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.129+0000 7f6637200640 1 Processor -- start 2024-08-19T00:47:59.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.130+0000 7f6637200640 1 -- start start 2024-08-19T00:47:59.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f6637200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6630159bf0 0x7f6630073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:59.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f6637200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663006f7f0 con 0x7f66300cec10 2024-08-19T00:47:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f6637200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663006f510 con 0x7f66300739a0 2024-08-19T00:47:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f6637200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6630072980 con 0x7f6630159bf0 2024-08-19T00:47:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f662fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6630159bf0 0x7f6630073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f662fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6630159bf0 0x7f6630073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40590/0 (socket says 172.21.15.7:40590) 2024-08-19T00:47:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f662fe00640 1 -- 172.21.15.7:0/4065401409 learned_addr learned my addr 172.21.15.7:0/4065401409 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f662fe00640 1 -- 172.21.15.7:0/4065401409 >> v1:172.21.15.162:6789/0 conn(0x7f66300739a0 legacy=0x7f66300ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f662fe00640 1 -- 172.21.15.7:0/4065401409 >> v1:172.21.15.7:6789/0 conn(0x7f66300cec10 legacy=0x7f66300d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.131+0000 7f662fe00640 1 -- 172.21.15.7:0/4065401409 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6630072c60 con 0x7f6630159bf0 2024-08-19T00:47:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.132+0000 7f662fe00640 1 --2- 172.21.15.7:0/4065401409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6630159bf0 0x7f6630073460 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f6620009870 tx=0x7f662002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7859dea4c9e807 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f662f400640 1 -- 172.21.15.7:0/4065401409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620037070 con 0x7f6630159bf0 2024-08-19T00:47:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f662f400640 1 -- 172.21.15.7:0/4065401409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6620032440 con 0x7f6630159bf0 2024-08-19T00:47:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f662f400640 1 -- 172.21.15.7:0/4065401409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620032810 con 0x7f6630159bf0 2024-08-19T00:47:59.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f6637200640 1 -- 172.21.15.7:0/4065401409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6630159bf0 msgr2=0x7f6630073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f6637200640 1 --2- 172.21.15.7:0/4065401409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6630159bf0 0x7f6630073460 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f6620009870 tx=0x7f662002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:59.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f6637200640 1 -- 172.21.15.7:0/4065401409 shutdown_connections 2024-08-19T00:47:59.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f6637200640 1 --2- 172.21.15.7:0/4065401409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6630159bf0 0x7f6630073460 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f6637200640 1 -- 172.21.15.7:0/4065401409 >> 172.21.15.7:0/4065401409 conn(0x7f663006bc70 msgr2=0x7f663006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f6637200640 1 -- 172.21.15.7:0/4065401409 shutdown_connections 2024-08-19T00:47:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.133+0000 7f6637200640 1 -- 172.21.15.7:0/4065401409 wait complete. 2024-08-19T00:47:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.135+0000 7f6637200640 1 Processor -- start 2024-08-19T00:47:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.135+0000 7f6637200640 1 -- start start 2024-08-19T00:47:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f6637200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66300739a0 0x7f6630153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f6637200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6630159bf0 0x7f663009a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f6637200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6630145260 0x7f663009bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f6637200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f663015a150 con 0x7f66300739a0 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f6637200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6630159fd0 con 0x7f6630145260 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f6637200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66300d0ad0 con 0x7f6630159bf0 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f662fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66300739a0 0x7f6630153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f662fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66300739a0 0x7f6630153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40592/0 (socket says 172.21.15.7:40592) 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f662fe00640 1 -- 172.21.15.7:0/451722756 learned_addr learned my addr 172.21.15.7:0/451722756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.136+0000 7f6635200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6630145260 0x7f663009bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f6627e00640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6630159bf0 0x7f663009a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662fe00640 1 -- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6630159bf0 msgr2=0x7f663009a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662fe00640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6630159bf0 0x7f663009a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662fe00640 1 -- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6630145260 msgr2=0x7f663009bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662fe00640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6630145260 0x7f663009bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662fe00640 1 -- 172.21.15.7:0/451722756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663009a950 con 0x7f66300739a0 2024-08-19T00:47:59.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f6635200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6630145260 0x7f663009bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:47:59.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662fe00640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66300739a0 0x7f6630153da0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f662002a2b0 tx=0x7f66200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662cc00640 1 -- 172.21.15.7:0/451722756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620037040 con 0x7f66300739a0 2024-08-19T00:47:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662cc00640 1 -- 172.21.15.7:0/451722756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6620042070 con 0x7f66300739a0 2024-08-19T00:47:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6630154460 con 0x7f66300739a0 2024-08-19T00:47:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.137+0000 7f662cc00640 1 -- 172.21.15.7:0/451722756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620030bd0 con 0x7f66300739a0 2024-08-19T00:47:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.138+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6630154a20 con 0x7f66300739a0 2024-08-19T00:47:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.139+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6630073460 con 0x7f66300739a0 2024-08-19T00:47:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.140+0000 7f662cc00640 1 -- 172.21.15.7:0/451722756 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6620047460 con 0x7f66300739a0 2024-08-19T00:47:59.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.140+0000 7f662cc00640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f660c06be30 0x7f660c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:59.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.141+0000 7f662cc00640 1 -- 172.21.15.7:0/451722756 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f66200ac680 con 0x7f66300739a0 2024-08-19T00:47:59.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.141+0000 7f6627e00640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f660c06be30 0x7f660c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:59.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.141+0000 7f6627e00640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f660c06be30 0x7f660c06e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f66300cd1d0 tx=0x7f6618009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:59.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.145+0000 7f662cc00640 1 -- 172.21.15.7:0/451722756 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6620045360 con 0x7f66300739a0 2024-08-19T00:47:59.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.403+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f6630156190 con 0x7f66300739a0 2024-08-19T00:47:59.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.955+0000 7f662cc00640 1 -- 172.21.15.7:0/451722756 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v310) ==== 101+0+0 (secure 0 0 0) 0x7f662007a3f0 con 0x7f66300739a0 2024-08-19T00:47:59.957 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:47:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f660c06be30 msgr2=0x7f660c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f660c06be30 0x7f660c06e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f66300cd1d0 tx=0x7f6618009040 comp rx=0 tx=0).stop 2024-08-19T00:47:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66300739a0 msgr2=0x7f6630153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66300739a0 0x7f6630153da0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f662002a2b0 tx=0x7f66200046c0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 shutdown_connections 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f660c06be30 0x7f660c06e2f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6630145260 0x7f663009bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6630159bf0 0x7f663009a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 --2- 172.21.15.7:0/451722756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66300739a0 0x7f6630153da0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.958+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 >> 172.21.15.7:0/451722756 conn(0x7f663006bc70 msgr2=0x7f66301605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.959+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 shutdown_connections 2024-08-19T00:47:59.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:47:59.959+0000 7f6637200640 1 -- 172.21.15.7:0/451722756 wait complete. 2024-08-19T00:47:59.979 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:48:00.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.057+0000 7f8316423f40 1 Processor -- start 2024-08-19T00:48:00.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.057+0000 7f8316423f40 1 -- start start 2024-08-19T00:48:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8316423f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb6adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8316423f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 0x55604cae54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8316423f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 0x55604cb642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8316423f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55604ca41d00 con 0x7f82f8003630 2024-08-19T00:48:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8316423f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55604ca45d40 con 0x55604cac9e30 2024-08-19T00:48:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8316423f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55604cb72dc0 con 0x55604cb755d0 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb6adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb6adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40612/0 (socket says 172.21.15.7:40612) 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 -- 172.21.15.7:0/3902771632 learned_addr learned my addr 172.21.15.7:0/3902771632 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 -- 172.21.15.7:0/3902771632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 msgr2=0x55604cb642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 --2- 172.21.15.7:0/3902771632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 0x55604cb642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 -- 172.21.15.7:0/3902771632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 msgr2=0x55604cae54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 --2- 172.21.15.7:0/3902771632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 0x55604cae54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.058+0000 7f8313600640 1 -- 172.21.15.7:0/3902771632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55604ca03080 con 0x7f82f8003630 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8313600640 1 --2- 172.21.15.7:0/3902771632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb6adb0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f8304009930 tx=0x7f8304005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cf0dd32defde8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8311800640 1 -- 172.21.15.7:0/3902771632 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304019030 con 0x7f82f8003630 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8311800640 1 -- 172.21.15.7:0/3902771632 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83040087f0 con 0x7f82f8003630 2024-08-19T00:48:00.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8311800640 1 -- 172.21.15.7:0/3902771632 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304008ba0 con 0x7f82f8003630 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8316423f40 1 -- 172.21.15.7:0/3902771632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 msgr2=0x55604cb6adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8316423f40 1 --2- 172.21.15.7:0/3902771632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb6adb0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f8304009930 tx=0x7f8304005a00 comp rx=0 tx=0).stop 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8316423f40 1 -- 172.21.15.7:0/3902771632 shutdown_connections 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8316423f40 1 --2- 172.21.15.7:0/3902771632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 0x55604cb642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8316423f40 1 --2- 172.21.15.7:0/3902771632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 0x55604cae54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8316423f40 1 --2- 172.21.15.7:0/3902771632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb6adb0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.059+0000 7f8316423f40 1 -- 172.21.15.7:0/3902771632 >> 172.21.15.7:0/3902771632 conn(0x55604caca4e0 msgr2=0x55604cac8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.060+0000 7f8316423f40 1 -- 172.21.15.7:0/3902771632 shutdown_connections 2024-08-19T00:48:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.060+0000 7f8316423f40 1 -- 172.21.15.7:0/3902771632 wait complete. 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.060+0000 7f8316423f40 1 Processor -- start 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.060+0000 7f8316423f40 1 -- start start 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.061+0000 7f8316423f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 0x55604ca9b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.061+0000 7f8316423f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 0x55604cb632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.061+0000 7f8316423f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb67550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.061+0000 7f8316423f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55604cae5040 con 0x7f82f8003630 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.061+0000 7f8316423f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55604cb66c00 con 0x55604cac9e30 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.061+0000 7f8316423f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55604cb66ee0 con 0x55604cb755d0 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb67550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb67550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40626/0 (socket says 172.21.15.7:40626) 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 learned_addr learned my addr 172.21.15.7:0/4084197076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 0x55604ca9b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8312c00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 0x55604cb632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 msgr2=0x55604cb632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55604cb755d0 0x55604cb632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 msgr2=0x55604ca9b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 0x55604ca9b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55604cb68f70 con 0x7f82f8003630 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55604cac9e30 0x55604ca9b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.062+0000 7f8314000640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb67550 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f830c0259f0 tx=0x7f830c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.063+0000 7f830be00640 1 -- 172.21.15.7:0/4084197076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83000096d0 con 0x7f82f8003630 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.063+0000 7f830be00640 1 -- 172.21.15.7:0/4084197076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c0507d0 con 0x7f82f8003630 2024-08-19T00:48:00.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.063+0000 7f830be00640 1 -- 172.21.15.7:0/4084197076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304009410 con 0x7f82f8003630 2024-08-19T00:48:00.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.063+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55604cb69250 con 0x7f82f8003630 2024-08-19T00:48:00.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.063+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55604cb69810 con 0x7f82f8003630 2024-08-19T00:48:00.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.065+0000 7f830be00640 1 -- 172.21.15.7:0/4084197076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f830c063070 con 0x7f82f8003630 2024-08-19T00:48:00.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.066+0000 7f830be00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82f406a840 0x7f82f406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.066+0000 7f830be00640 1 -- 172.21.15.7:0/4084197076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f830c0cd190 con 0x7f82f8003630 2024-08-19T00:48:00.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.066+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82f406a840 0x7f82f406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.068 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:48:00.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.066+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55604cb63820 0x55604cb67a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.066+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cb67fd0 con 0x55604cb63820 2024-08-19T00:48:00.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.066+0000 7f8312c00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55604cb63820 0x55604cb67a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.066+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82f406a840 0x7f82f406cd00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f83040098d0 tx=0x7f8304015000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.067+0000 7f8312c00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55604cb63820 0x55604cb67a90 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.070+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v122'1097 uv1070 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.070+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc090c0 con 0x55604cb63820 2024-08-19T00:48:00.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.072+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v122'1098 uv1098 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.072+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc09520 con 0x55604cb63820 2024-08-19T00:48:00.075 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:48:00.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.073+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v122'1099 uv1099 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.073+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc098c0 con 0x55604cb63820 2024-08-19T00:48:00.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.075+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v122'1100 uv1100 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.075+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc09cc0 con 0x55604cb63820 2024-08-19T00:48:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.076+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v122'1101 uv1101 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.076+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc15a40 con 0x55604cb63820 2024-08-19T00:48:00.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.078+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v122'1102 uv1102 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.078+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc15de0 con 0x55604cb63820 2024-08-19T00:48:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.080+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v122'1103 uv1076 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.080+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc16180 con 0x55604cb63820 2024-08-19T00:48:00.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.081+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v122'1104 uv1104 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.081+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc16180 con 0x55604cb63820 2024-08-19T00:48:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.083+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v122'1105 uv1105 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.084 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:48:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.083+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17190 con 0x55604cb63820 2024-08-19T00:48:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.084+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v122'1106 uv1106 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.084+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17190 con 0x55604cb63820 2024-08-19T00:48:00.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.086+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v122'1107 uv1107 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.086+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc16180 con 0x55604cb63820 2024-08-19T00:48:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.087+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v122'1108 uv1108 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.088+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc16180 con 0x55604cb63820 2024-08-19T00:48:00.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.089+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v122'1109 uv1083 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.089+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc16180 con 0x55604cb63820 2024-08-19T00:48:00.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.091+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v122'1110 uv1110 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.091+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc16180 con 0x55604cb63820 2024-08-19T00:48:00.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.092+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v122'1111 uv1111 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.094 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:48:00.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.092+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17190 con 0x55604cb63820 2024-08-19T00:48:00.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.094+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v122'1112 uv1112 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.094+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17190 con 0x55604cb63820 2024-08-19T00:48:00.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.096+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v122'1113 uv1113 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.096+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc16180 con 0x55604cb63820 2024-08-19T00:48:00.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.097+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v122'1114 uv1114 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.097+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.099+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v122'1115 uv1115 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.099+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.100+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v122'1116 uv1096 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.100+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.102+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v122'1117 uv1117 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.102+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.103+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v122'1118 uv1118 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.105 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:48:00.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.103+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17900 con 0x55604cb63820 2024-08-19T00:48:00.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.105+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v122'1119 uv1119 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.105+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17900 con 0x55604cb63820 2024-08-19T00:48:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.106+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v122'1120 uv1120 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.106+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.108+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v122'1121 uv1121 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.108+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.109+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v122'1122 uv1095 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.109+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.111+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v122'1123 uv1123 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.111+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.112+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v122'1124 uv1124 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.114 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:48:00.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.112+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17900 con 0x55604cb63820 2024-08-19T00:48:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.113+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v122'1125 uv1125 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.114+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc17900 con 0x55604cb63820 2024-08-19T00:48:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.115+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v122'1126 uv1126 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.115+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc168f0 con 0x55604cb63820 2024-08-19T00:48:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.117+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v122'1127 uv1127 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.117+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55604cc16e00 0x55604cc191f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.117+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc19730 con 0x55604cc16e00 2024-08-19T00:48:00.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.117+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55604cc16e00 0x55604cc191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.117+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55604cc16e00 0x55604cc191f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.120+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v122'799 uv781 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.120+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc19ad0 con 0x55604cc16e00 2024-08-19T00:48:00.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.121+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v122'800 uv800 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.121+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc19e70 con 0x55604cc16e00 2024-08-19T00:48:00.124 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:48:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.123+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v122'801 uv801 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.123+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc164c0 con 0x55604cc16e00 2024-08-19T00:48:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.125+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v122'802 uv802 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.125+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1a6c0 con 0x55604cc16e00 2024-08-19T00:48:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.126+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v122'803 uv803 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.126+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1aa60 con 0x55604cc16e00 2024-08-19T00:48:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.128+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v122'804 uv786 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.128+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1ae00 con 0x55604cc16e00 2024-08-19T00:48:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.130+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v122'805 uv805 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.130+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1f0 con 0x55604cc16e00 2024-08-19T00:48:00.133 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:48:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.131+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v122'806 uv806 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.131+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1f0 con 0x55604cc16e00 2024-08-19T00:48:00.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.133+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v122'807 uv807 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.133+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1a0 con 0x55604cc16e00 2024-08-19T00:48:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.135+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v122'808 uv808 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.135+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1a0 con 0x55604cc16e00 2024-08-19T00:48:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.136+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v122'809 uv791 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.136+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1a0 con 0x55604cc16e00 2024-08-19T00:48:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.138+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v122'810 uv810 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.138+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1a0 con 0x55604cc16e00 2024-08-19T00:48:00.141 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:48:00.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.140+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v122'811 uv811 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.140+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1fc80 con 0x55604cc16e00 2024-08-19T00:48:00.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.142+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v122'812 uv812 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.142+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1fc80 con 0x55604cc16e00 2024-08-19T00:48:00.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.144+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v122'813 uv813 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.144+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b230 con 0x55604cc16e00 2024-08-19T00:48:00.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.146+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v122'814 uv797 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.146+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1e0 con 0x55604cc16e00 2024-08-19T00:48:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.148+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v122'815 uv815 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.148+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1e0 con 0x55604cc16e00 2024-08-19T00:48:00.151 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:48:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.149+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v122'816 uv816 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.149+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1e0 con 0x55604cc16e00 2024-08-19T00:48:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.151+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v122'817 uv817 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.151+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1c1d0 con 0x55604cc16e00 2024-08-19T00:48:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.153+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v122'818 uv818 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.153+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1b1c0 con 0x55604cc16e00 2024-08-19T00:48:00.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.154+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v122'819 uv819 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc16e00 2024-08-19T00:48:00.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.154+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55604cc1b840 0x55604cc1bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.154+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cc1b840 2024-08-19T00:48:00.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.155+0000 7f8312c00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55604cc1b840 0x55604cc1bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.155+0000 7f8312c00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55604cc1b840 0x55604cc1bc20 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.157+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v122'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.157+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cc1b840 2024-08-19T00:48:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.158+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v122'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.158+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cc1b840 2024-08-19T00:48:00.161 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:48:00.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.160+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v122'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.160+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1f6b0 con 0x55604cc1b840 2024-08-19T00:48:00.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.161+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v122'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.161+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1f670 con 0x55604cc1b840 2024-08-19T00:48:00.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.162+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v122'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.162+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cc1b840 2024-08-19T00:48:00.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.164+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v122'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.164+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cb63820 2024-08-19T00:48:00.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.165+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v122'160 uv159 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.165+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cb63820 2024-08-19T00:48:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.167+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v122'161 uv161 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.167+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cb63820 2024-08-19T00:48:00.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.168+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v122'162 uv162 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.170 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:48:00.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.168+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1e660 con 0x55604cb63820 2024-08-19T00:48:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.170+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v122'163 uv163 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.170+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55604cc1f090 0x55604cc21a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.170+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc1f4f0 con 0x55604cc1f090 2024-08-19T00:48:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.171+0000 7f8314000640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55604cc1f090 0x55604cc21a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.171+0000 7f8314000640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55604cc1f090 0x55604cc21a40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.172+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v122'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.172+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc21f80 con 0x55604cc1f090 2024-08-19T00:48:00.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.174+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v122'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.174+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc22320 con 0x55604cc1f090 2024-08-19T00:48:00.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.175+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v122'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.177 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:48:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.175+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc23750 con 0x55604cc1f090 2024-08-19T00:48:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.177+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v122'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.177+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc23bd0 con 0x55604cc1f090 2024-08-19T00:48:00.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.178+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v122'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.178+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc226c0 con 0x55604cc1f090 2024-08-19T00:48:00.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.180+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v122'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.180+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55604cc23180 0x55604cc26010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.180+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc265a0 con 0x55604cc23180 2024-08-19T00:48:00.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.180+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55604cc23180 0x55604cc26010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.180+0000 7f8313600640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55604cc23180 0x55604cc26010 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.182+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v122'393 uv387 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.182+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26620 con 0x55604cc23180 2024-08-19T00:48:00.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.184+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v122'394 uv394 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.184+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26a40 con 0x55604cc23180 2024-08-19T00:48:00.186 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:48:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.185+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v122'395 uv395 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.185+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc27a50 con 0x55604cc23180 2024-08-19T00:48:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.186+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v122'396 uv396 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.186+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc27a50 con 0x55604cc23180 2024-08-19T00:48:00.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.188+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v122'397 uv397 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.188+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26a40 con 0x55604cc23180 2024-08-19T00:48:00.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.189+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v122'398 uv398 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.189+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26a40 con 0x55604cc23180 2024-08-19T00:48:00.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.191+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v122'399 uv392 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.191+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26a40 con 0x55604cc23180 2024-08-19T00:48:00.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.192+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v122'400 uv400 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.192+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26a40 con 0x55604cc23180 2024-08-19T00:48:00.195 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:48:00.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.194+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v122'401 uv401 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.194+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26a40 con 0x55604cc23180 2024-08-19T00:48:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.195+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v122'402 uv402 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.195+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc26a40 con 0x55604cc23180 2024-08-19T00:48:00.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.197+0000 7f8313600640 1 -- 172.21.15.7:0/4084197076 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v122'403 uv403 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8304015570 con 0x55604cc23180 2024-08-19T00:48:00.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.197+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55604cc26f50 0x55604cc29360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.197+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29ab0 con 0x55604cc26f50 2024-08-19T00:48:00.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.197+0000 7f8312c00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55604cc26f50 0x55604cc29360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.198+0000 7f8312c00640 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55604cc26f50 0x55604cc29360 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.199+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v122'178 uv177 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.199+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29ab0 con 0x55604cc26f50 2024-08-19T00:48:00.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.201+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v122'179 uv179 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.201+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc26f50 2024-08-19T00:48:00.203 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:48:00.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.202+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v122'180 uv180 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.202+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc26f50 2024-08-19T00:48:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.203+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v122'181 uv181 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.203+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc26f50 2024-08-19T00:48:00.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.205+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v122'182 uv182 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.205+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cb63820 2024-08-19T00:48:00.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.206+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v122'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.206+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cb63820 2024-08-19T00:48:00.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.207+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v122'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.207+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cb63820 2024-08-19T00:48:00.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.208+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v122'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.210 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:48:00.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.209+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2af10 con 0x55604cb63820 2024-08-19T00:48:00.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.210+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v122'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.210+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2af10 con 0x55604cb63820 2024-08-19T00:48:00.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.211+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v122'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.211+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cb63820 2024-08-19T00:48:00.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.213+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v122'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cb63820 2024-08-19T00:48:00.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.213+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.214+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v122'355 uv349 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.215+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.216+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v122'356 uv356 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.216+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.217+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v122'357 uv357 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.219 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:48:00.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.218+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.219+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v122'358 uv358 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.219+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.221+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v122'359 uv359 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.221+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.222+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v122'360 uv354 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.222+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.223+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v122'361 uv361 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.224+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.227 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:48:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.225+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v122'362 uv362 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.225+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc29f00 con 0x55604cc1b840 2024-08-19T00:48:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.227+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v122'363 uv363 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.227+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2cd10 con 0x55604cc1b840 2024-08-19T00:48:00.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.229+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v122'364 uv364 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc1b840 2024-08-19T00:48:00.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.229+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a3b0 con 0x55604cc1f090 2024-08-19T00:48:00.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.230+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v122'157 uv155 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.230+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a7a0 con 0x55604cc1f090 2024-08-19T00:48:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.231+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v122'158 uv158 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.232+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a7a0 con 0x55604cc1f090 2024-08-19T00:48:00.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.233+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v122'159 uv159 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.235 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:48:00.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.233+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc1f090 2024-08-19T00:48:00.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.234+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v122'160 uv160 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.234+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc1f090 2024-08-19T00:48:00.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.236+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v122'213 uv212 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.236+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc1f090 2024-08-19T00:48:00.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.238+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v122'214 uv214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.238+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc1f090 2024-08-19T00:48:00.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.239+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v122'215 uv215 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.241 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:48:00.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.239+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc1f090 2024-08-19T00:48:00.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.240+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v122'216 uv216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.240+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc1f090 2024-08-19T00:48:00.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.242+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v122'217 uv217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.242+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc1f090 2024-08-19T00:48:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.243+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v122'218 uv218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f830c062030 con 0x55604cc1f090 2024-08-19T00:48:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.243+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.245+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v122'181 uv180 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.245+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.246+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v122'182 uv182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.246+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.247+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v122'183 uv183 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.249 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:48:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.247+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.249+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v122'184 uv184 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.249+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.250+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v122'185 uv185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.250+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.252+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v122'442 uv433 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.252+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.253+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v122'443 uv443 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.253+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.256 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:48:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.254+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v122'444 uv444 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.254+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.256+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v122'445 uv445 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.256+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.257+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v122'446 uv446 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.257+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.258+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v122'447 uv440 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.258+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.260+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v122'448 uv448 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.260+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.262 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:48:00.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.261+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v122'449 uv449 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.261+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.262+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v122'450 uv450 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.262+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.264+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v122'451 uv451 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.264+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2a750 con 0x55604cc26f50 2024-08-19T00:48:00.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.265+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v122'452 uv452 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.265+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55604cc2aff0 con 0x55604cc26f50 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.266+0000 7f8312c00640 1 -- 172.21.15.7:0/4084197076 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v122'453 uv453 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f8300009870 con 0x55604cc26f50 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55604cc16e00 msgr2=0x55604cc191f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55604cc16e00 0x55604cc191f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55604cc23180 msgr2=0x55604cc26010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55604cc23180 0x55604cc26010 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55604cc26f50 msgr2=0x55604cc29360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55604cc26f50 0x55604cc29360 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55604cc1b840 msgr2=0x55604cc1bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55604cc1b840 0x55604cc1bc20 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55604cb63820 msgr2=0x55604cb67a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55604cb63820 0x55604cb67a90 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 reap_dead start 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55604cc1f090 msgr2=0x55604cc21a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55604cc1f090 0x55604cc21a40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8314000640 1 -- 172.21.15.7:0/4084197076 reap_dead start 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82f406a840 msgr2=0x7f82f406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82f406a840 0x7f82f406cd00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f83040098d0 tx=0x7f8304015000 comp rx=0 tx=0).stop 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 msgr2=0x55604cb67550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb67550 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f830c0259f0 tx=0x7f830c0014d0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 shutdown_connections 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f82f406a840 0x7f82f406cd00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 --2- 172.21.15.7:0/4084197076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f8003630 0x55604cb67550 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 >> 172.21.15.7:0/4084197076 conn(0x55604caca4e0 msgr2=0x55604cac9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:00.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 shutdown_connections 2024-08-19T00:48:00.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.267+0000 7f8316423f40 1 -- 172.21.15.7:0/4084197076 wait complete. 2024-08-19T00:48:00.273 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader mds0_openfiles.0 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:48:00.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.389+0000 7fbaa783bf40 1 Processor -- start 2024-08-19T00:48:00.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.390+0000 7fbaa783bf40 1 -- start start 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.390+0000 7fbaa783bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd77650 0x55d07fe13800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.390+0000 7fbaa783bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd785b0 0x55d07fe1e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.390+0000 7fbaa783bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fe1eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.390+0000 7fbaa783bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d07fcecd00 con 0x55d07fd78990 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.390+0000 7fbaa783bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d07fcf0d40 con 0x55d07fd77650 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.390+0000 7fbaa783bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d07fe1ddc0 con 0x55d07fd785b0 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fe1eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fe1eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40628/0 (socket says 172.21.15.7:40628) 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 -- 172.21.15.7:0/351679642 learned_addr learned my addr 172.21.15.7:0/351679642 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fba9fe00640 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd785b0 0x55d07fe1e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa4a00640 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd77650 0x55d07fe13800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 -- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd785b0 msgr2=0x55d07fe1e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:00.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd785b0 0x55d07fe1e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 -- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd77650 msgr2=0x55d07fe13800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:00.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd77650 0x55d07fe13800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 -- 172.21.15.7:0/351679642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07fcae080 con 0x55d07fd78990 2024-08-19T00:48:00.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.391+0000 7fbaa5400640 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fe1eb00 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0046100 tx=0x7fbaa0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcebb8a1bbb8ed2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fba9ea00640 1 -- 172.21.15.7:0/351679642 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0050960 con 0x55d07fd78990 2024-08-19T00:48:00.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fba9ea00640 1 -- 172.21.15.7:0/351679642 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0067070 con 0x55d07fd78990 2024-08-19T00:48:00.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fba9ea00640 1 -- 172.21.15.7:0/351679642 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0050d20 con 0x55d07fd78990 2024-08-19T00:48:00.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 -- 172.21.15.7:0/351679642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 msgr2=0x55d07fe1eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fe1eb00 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0046100 tx=0x7fbaa0051000 comp rx=0 tx=0).stop 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 -- 172.21.15.7:0/351679642 shutdown_connections 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fe1eb00 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd785b0 0x55d07fe1e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/351679642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd77650 0x55d07fe13800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 -- 172.21.15.7:0/351679642 >> 172.21.15.7:0/351679642 conn(0x55d07fd754e0 msgr2=0x55d07fd456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 -- 172.21.15.7:0/351679642 shutdown_connections 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.392+0000 7fbaa783bf40 1 -- 172.21.15.7:0/351679642 wait complete. 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.393+0000 7fbaa783bf40 1 Processor -- start 2024-08-19T00:48:00.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.393+0000 7fbaa783bf40 1 -- start start 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa783bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd77650 0x55d07fe0fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa783bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd785b0 0x55d07fe157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa783bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fd74260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa783bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d07fe16660 con 0x55d07fd78990 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa783bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d07fd461f0 con 0x55d07fd785b0 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa783bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d07fe16360 con 0x55d07fd77650 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fd74260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fd74260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40638/0 (socket says 172.21.15.7:40638) 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa5400640 1 -- 172.21.15.7:0/864138928 learned_addr learned my addr 172.21.15.7:0/864138928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fba9fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd785b0 0x55d07fe157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.394+0000 7fbaa4a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd77650 0x55d07fe0fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.395+0000 7fbaa5400640 1 -- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd77650 msgr2=0x55d07fe0fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.395+0000 7fbaa5400640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d07fd77650 0x55d07fe0fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.395+0000 7fbaa5400640 1 -- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd785b0 msgr2=0x55d07fe157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.395+0000 7fbaa5400640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d07fd785b0 0x55d07fe157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.395+0000 7fbaa5400640 1 -- 172.21.15.7:0/864138928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07fe1a280 con 0x55d07fd78990 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.395+0000 7fbaa5400640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fd74260 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x55d07fe165d0 tx=0x7fbaa0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.395+0000 7fba9d600640 1 -- 172.21.15.7:0/864138928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0075410 con 0x55d07fd78990 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.396+0000 7fba9d600640 1 -- 172.21.15.7:0/864138928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa00755b0 con 0x55d07fd78990 2024-08-19T00:48:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.396+0000 7fba9d600640 1 -- 172.21.15.7:0/864138928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00759a0 con 0x55d07fd78990 2024-08-19T00:48:00.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.396+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d07fd74eb0 con 0x55d07fd78990 2024-08-19T00:48:00.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.396+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07fe12ab0 con 0x55d07fd78990 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.398+0000 7fba9d600640 1 -- 172.21.15.7:0/864138928 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaa0073020 con 0x55d07fd78990 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.398+0000 7fba9d600640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406a810 0x7fba8406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.398+0000 7fba9d600640 1 -- 172.21.15.7:0/864138928 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7fbaa00d00d0 con 0x55d07fd78990 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.399+0000 7fbaa4a00640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406a810 0x7fba8406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.399+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d07fd747a0 0x55d07feb6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.399+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) -- 0x55d07fe111b0 con 0x55d07fd747a0 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.399+0000 7fba9fe00640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d07fd747a0 0x55d07feb6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.399+0000 7fbaa4a00640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406a810 0x7fba8406ccd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fba98011560 tx=0x7fba980017b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.400+0000 7fba9fe00640 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d07fd747a0 0x55d07feb6e40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.401+0000 7fba9fe00640 1 -- 172.21.15.7:0/864138928 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-set-header] v122'164 uv164 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fba90009040 con 0x55d07fd747a0 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.401+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d07fd747a0 msgr2=0x55d07feb6e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.401+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55d07fd747a0 0x55d07feb6e40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.401+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406a810 msgr2=0x7fba8406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fba8406a810 0x7fba8406ccd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fba98011560 tx=0x7fba980017b0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 msgr2=0x55d07fd74260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa783bf40 1 --2- 172.21.15.7:0/864138928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d07fd78990 0x55d07fd74260 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x55d07fe165d0 tx=0x7fbaa0003330 comp rx=0 tx=0).stop 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa5400640 1 -- 172.21.15.7:0/864138928 reap_dead start 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 shutdown_connections 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 >> 172.21.15.7:0/864138928 conn(0x55d07fd754e0 msgr2=0x55d07fe1cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 shutdown_connections 2024-08-19T00:48:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.402+0000 7fbaa783bf40 1 -- 172.21.15.7:0/864138928 wait complete. 2024-08-19T00:48:00.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:48:00.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.566+0000 7f1d56c00640 1 Processor -- start 2024-08-19T00:48:00.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.566+0000 7f1d56c00640 1 -- start start 2024-08-19T00:48:00.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.567+0000 7f1d56c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d500b5130 0x7f1d500aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.567+0000 7f1d56c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d500acef0 con 0x7f1d5015bfb0 2024-08-19T00:48:00.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.567+0000 7f1d56c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d500ad1d0 con 0x7f1d5015c390 2024-08-19T00:48:00.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.567+0000 7f1d56c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1d500ad790 con 0x7f1d500b5130 2024-08-19T00:48:00.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.567+0000 7f1d47400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d500b5130 0x7f1d500aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.567+0000 7f1d4fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1d5015bfb0 0x7f1d500b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47894/0 (socket says 172.21.15.7:47894) 2024-08-19T00:48:00.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.567+0000 7f1d4fe00640 1 -- 172.21.15.7:0/4186510817 learned_addr learned my addr 172.21.15.7:0/4186510817 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.568+0000 7f1d47400640 1 -- 172.21.15.7:0/4186510817 >> v1:172.21.15.162:6789/0 conn(0x7f1d5015c390 legacy=0x7f1d50072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.568+0000 7f1d47400640 1 -- 172.21.15.7:0/4186510817 >> v1:172.21.15.7:6789/0 conn(0x7f1d5015bfb0 legacy=0x7f1d500b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.568+0000 7f1d47400640 1 -- 172.21.15.7:0/4186510817 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d500ad4b0 con 0x7f1d500b5130 2024-08-19T00:48:00.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.568+0000 7f1d4f400640 1 -- 172.21.15.7:0/4186510817 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987752480 0 0) 0x7f1d500acef0 con 0x7f1d5015bfb0 2024-08-19T00:48:00.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.569+0000 7f1d47400640 1 --2- 172.21.15.7:0/4186510817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d500aebd0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f1d380097a0 tx=0x7f1d3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea0e8b6b19b5828 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.569+0000 7f1d4f400640 1 -- 172.21.15.7:0/4186510817 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38037070 con 0x7f1d500b5130 2024-08-19T00:48:00.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.569+0000 7f1d4f400640 1 -- 172.21.15.7:0/4186510817 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d38032440 con 0x7f1d500b5130 2024-08-19T00:48:00.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.569+0000 7f1d4f400640 1 -- 172.21.15.7:0/4186510817 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38032810 con 0x7f1d500b5130 2024-08-19T00:48:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.570+0000 7f1d56c00640 1 -- 172.21.15.7:0/4186510817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 msgr2=0x7f1d500aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.570+0000 7f1d56c00640 1 --2- 172.21.15.7:0/4186510817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d500aebd0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f1d380097a0 tx=0x7f1d3802a230 comp rx=0 tx=0).stop 2024-08-19T00:48:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.570+0000 7f1d56c00640 1 -- 172.21.15.7:0/4186510817 shutdown_connections 2024-08-19T00:48:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.570+0000 7f1d56c00640 1 --2- 172.21.15.7:0/4186510817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d500aebd0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.570+0000 7f1d56c00640 1 -- 172.21.15.7:0/4186510817 >> 172.21.15.7:0/4186510817 conn(0x7f1d500b2300 msgr2=0x7f1d5006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.570+0000 7f1d56c00640 1 -- 172.21.15.7:0/4186510817 shutdown_connections 2024-08-19T00:48:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.570+0000 7f1d56c00640 1 -- 172.21.15.7:0/4186510817 wait complete. 2024-08-19T00:48:00.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.571+0000 7f1d56c00640 1 Processor -- start 2024-08-19T00:48:00.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.572+0000 7f1d56c00640 1 -- start start 2024-08-19T00:48:00.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.572+0000 7f1d56c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d501539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.572+0000 7f1d56c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d5015bfb0 0x7f1d500c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.572+0000 7f1d56c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d5015c390 0x7f1d500ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.572+0000 7f1d56c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1d500af290 con 0x7f1d500b5130 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.572+0000 7f1d56c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d500af110 con 0x7f1d5015bfb0 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d56c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d500af410 con 0x7f1d5015c390 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d501539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d501539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40654/0 (socket says 172.21.15.7:40654) 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 -- 172.21.15.7:0/994369833 learned_addr learned my addr 172.21.15.7:0/994369833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d47400640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d5015bfb0 0x7f1d500c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d54c00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d5015c390 0x7f1d500ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 -- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d5015c390 msgr2=0x7f1d500ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d5015c390 0x7f1d500ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 -- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d5015bfb0 msgr2=0x7f1d500c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d5015bfb0 0x7f1d500c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 -- 172.21.15.7:0/994369833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5015de60 con 0x7f1d500b5130 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.573+0000 7f1d4fe00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d501539e0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000c4a0 tx=0x7f1d4000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.574+0000 7f1d4cc00640 1 -- 172.21.15.7:0/994369833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40018070 con 0x7f1d500b5130 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.574+0000 7f1d4cc00640 1 -- 172.21.15.7:0/994369833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d400074e0 con 0x7f1d500b5130 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.574+0000 7f1d4cc00640 1 -- 172.21.15.7:0/994369833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40004a20 con 0x7f1d500b5130 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.574+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5015e1a0 con 0x7f1d500b5130 2024-08-19T00:48:00.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.574+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5015e9e0 con 0x7f1d500b5130 2024-08-19T00:48:00.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.575+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d500aebd0 con 0x7f1d500b5130 2024-08-19T00:48:00.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.576+0000 7f1d4cc00640 1 -- 172.21.15.7:0/994369833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d40004bc0 con 0x7f1d500b5130 2024-08-19T00:48:00.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.577+0000 7f1d4cc00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1d2c06be60 0x7f1d2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:00.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.577+0000 7f1d4cc00640 1 -- 172.21.15.7:0/994369833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f1d4008adb0 con 0x7f1d500b5130 2024-08-19T00:48:00.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.577+0000 7f1d47400640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1d2c06be60 0x7f1d2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:00.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.578+0000 7f1d47400640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1d2c06be60 0x7f1d2c06e320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1d38034000 tx=0x7f1d3802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:00.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.581+0000 7f1d4cc00640 1 -- 172.21.15.7:0/994369833 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1d4008f070 con 0x7f1d500b5130 2024-08-19T00:48:00.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.802+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f1d50160b60 con 0x7f1d500b5130 2024-08-19T00:48:00.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.956+0000 7f1d4cc00640 1 -- 172.21.15.7:0/994369833 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v311) ==== 162+0+0 (secure 0 0 0) 0x7f1d5015e1a0 con 0x7f1d500b5130 2024-08-19T00:48:00.959 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:48:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1d2c06be60 msgr2=0x7f1d2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1d2c06be60 0x7f1d2c06e320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1d38034000 tx=0x7f1d3802e000 comp rx=0 tx=0).stop 2024-08-19T00:48:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 msgr2=0x7f1d501539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d501539e0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000c4a0 tx=0x7f1d4000c960 comp rx=0 tx=0).stop 2024-08-19T00:48:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 shutdown_connections 2024-08-19T00:48:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1d2c06be60 0x7f1d2c06e320 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d5015c390 0x7f1d500ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d5015bfb0 0x7f1d500c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 --2- 172.21.15.7:0/994369833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d500b5130 0x7f1d501539e0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:00.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 >> 172.21.15.7:0/994369833 conn(0x7f1d500b2300 msgr2=0x7f1d500b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:00.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 shutdown_connections 2024-08-19T00:48:00.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:00.959+0000 7f1d56c00640 1 -- 172.21.15.7:0/994369833 wait complete. 2024-08-19T00:48:00.969 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:48:00.966+0000 7effa4400640 -1 mds.0.openfiles _load_finish: corrupted header/values: End of buffer [buffer:2] 2024-08-19T00:48:01.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.542+0000 7f8d5bc00640 1 Processor -- start 2024-08-19T00:48:01.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.543+0000 7f8d5bc00640 1 -- start start 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d5bc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d540ce500 0x7f8d540ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d5bc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d540d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d5bc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5406f7f0 con 0x7f8d54159bf0 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d5bc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8d540d0d50 con 0x7f8d540ce500 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d5bc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5406f510 con 0x7f8d540d03c0 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d53e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d540ce500 0x7f8d540ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d53e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d540ce500 0x7f8d540ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40666/0 (socket says 172.21.15.7:40666) 2024-08-19T00:48:01.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d53e00640 1 -- 172.21.15.7:0/3632533220 learned_addr learned my addr 172.21.15.7:0/3632533220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:01.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d59200640 1 --1- 172.21.15.7:0/3632533220 >> v1:172.21.15.7:6789/0 conn(0x7f8d54159bf0 0x7f8d54073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47896/0 (socket says 172.21.15.7:47896) 2024-08-19T00:48:01.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d59c00640 1 --2- 172.21.15.7:0/3632533220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d540d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:01.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d53e00640 1 -- 172.21.15.7:0/3632533220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 msgr2=0x7f8d540d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:01.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d53e00640 1 --2- 172.21.15.7:0/3632533220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d540d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d53e00640 1 -- 172.21.15.7:0/3632533220 >> v1:172.21.15.7:6789/0 conn(0x7f8d54159bf0 legacy=0x7f8d54073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:01.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.544+0000 7f8d53e00640 1 -- 172.21.15.7:0/3632533220 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d54072980 con 0x7f8d540ce500 2024-08-19T00:48:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.545+0000 7f8d53e00640 1 --2- 172.21.15.7:0/3632533220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d540ce500 0x7f8d540ce970 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009870 tx=0x7f8d4002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a179877b5d77cd60 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d53400640 1 -- 172.21.15.7:0/3632533220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40037070 con 0x7f8d540ce500 2024-08-19T00:48:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d53400640 1 -- 172.21.15.7:0/3632533220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d40032440 con 0x7f8d540ce500 2024-08-19T00:48:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d53400640 1 -- 172.21.15.7:0/3632533220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40032810 con 0x7f8d540ce500 2024-08-19T00:48:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 -- 172.21.15.7:0/3632533220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d540ce500 msgr2=0x7f8d540ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/3632533220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d540ce500 0x7f8d540ce970 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009870 tx=0x7f8d4002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 -- 172.21.15.7:0/3632533220 shutdown_connections 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/3632533220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d540d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/3632533220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d540ce500 0x7f8d540ce970 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 -- 172.21.15.7:0/3632533220 >> 172.21.15.7:0/3632533220 conn(0x7f8d5406bc70 msgr2=0x7f8d5406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 -- 172.21.15.7:0/3632533220 shutdown_connections 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.546+0000 7f8d5bc00640 1 -- 172.21.15.7:0/3632533220 wait complete. 2024-08-19T00:48:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.548+0000 7f8d5bc00640 1 Processor -- start 2024-08-19T00:48:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.548+0000 7f8d5bc00640 1 -- start start 2024-08-19T00:48:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d5bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d540ce500 0x7f8d540b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d5bc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d5414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d5bc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d54159bf0 0x7f8d5415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d5bc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d54073b70 con 0x7f8d54159bf0 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d5bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d54072f40 con 0x7f8d540ce500 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d5bc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8d54159fd0 con 0x7f8d540d03c0 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d59c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d54159bf0 0x7f8d5415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d59c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d54159bf0 0x7f8d5415fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40678/0 (socket says 172.21.15.7:40678) 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d59c00640 1 -- 172.21.15.7:0/2275989569 learned_addr learned my addr 172.21.15.7:0/2275989569 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d59200640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d540ce500 0x7f8d540b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.549+0000 7f8d53e00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d5414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d59c00640 1 -- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 msgr2=0x7f8d5414f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d59c00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d5414f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d59c00640 1 -- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d540ce500 msgr2=0x7f8d540b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d59c00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d540ce500 0x7f8d540b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d59c00640 1 -- 172.21.15.7:0/2275989569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d540b3ed0 con 0x7f8d54159bf0 2024-08-19T00:48:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d59c00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d54159bf0 0x7f8d5415fff0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c007e70 tx=0x7f8d4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d50c00640 1 -- 172.21.15.7:0/2275989569 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c014420 con 0x7f8d54159bf0 2024-08-19T00:48:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d50c00640 1 -- 172.21.15.7:0/2275989569 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c019070 con 0x7f8d54159bf0 2024-08-19T00:48:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d540b41b0 con 0x7f8d54159bf0 2024-08-19T00:48:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.550+0000 7f8d50c00640 1 -- 172.21.15.7:0/2275989569 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c014820 con 0x7f8d54159bf0 2024-08-19T00:48:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.551+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d540b4770 con 0x7f8d54159bf0 2024-08-19T00:48:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.552+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d540d0810 con 0x7f8d54159bf0 2024-08-19T00:48:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.553+0000 7f8d50c00640 1 -- 172.21.15.7:0/2275989569 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d4c0149c0 con 0x7f8d54159bf0 2024-08-19T00:48:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.553+0000 7f8d50c00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d3406be30 0x7f8d3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.554+0000 7f8d50c00640 1 -- 172.21.15.7:0/2275989569 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f8d4c08c280 con 0x7f8d54159bf0 2024-08-19T00:48:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.554+0000 7f8d59200640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d3406be30 0x7f8d3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:01.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.554+0000 7f8d59200640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d3406be30 0x7f8d3406e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007fd0 tx=0x7f8d48007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.558+0000 7f8d50c00640 1 -- 172.21.15.7:0/2275989569 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8d4c059910 con 0x7f8d54159bf0 2024-08-19T00:48:01.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.777+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d54159370 con 0x7f8d54159bf0 2024-08-19T00:48:01.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.778+0000 7f8d50c00640 1 -- 172.21.15.7:0/2275989569 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 312 v312) ==== 95+0+5228 (secure 0 0 0) 0x7f8d4c05dc10 con 0x7f8d54159bf0 2024-08-19T00:48:01.781 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:01.781 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":312,"btime":"2024-08-19T00:48:00:960605+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":312,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:00.960592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10026},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10026":{"gid":10026,"name":"a","rank":0,"incarnation":312,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/2241506175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2241506175},{"type":"v1","addr":"172.21.15.7:6837","nonce":2241506175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:01.781 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 312 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d3406be30 msgr2=0x7f8d3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d3406be30 0x7f8d3406e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007fd0 tx=0x7f8d48007e80 comp rx=0 tx=0).stop 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d54159bf0 msgr2=0x7f8d5415fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d54159bf0 0x7f8d5415fff0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c007e70 tx=0x7f8d4c00e4b0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 shutdown_connections 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8d3406be30 0x7f8d3406e2f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d54159bf0 0x7f8d5415fff0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d540d03c0 0x7f8d5414f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 --2- 172.21.15.7:0/2275989569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d540ce500 0x7f8d540b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 >> 172.21.15.7:0/2275989569 conn(0x7f8d5406bc70 msgr2=0x7f8d5415da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 shutdown_connections 2024-08-19T00:48:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:01.781+0000 7f8d5bc00640 1 -- 172.21.15.7:0/2275989569 wait complete. 2024-08-19T00:48:01.802 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 312, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:48:00.960592+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 122, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10026}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10026': {'gid': 10026, 'name': 'a', 'rank': 0, 'incarnation': 312, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/2241506175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 2241506175}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 2241506175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:48:01.802 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10026:up:replay 2024-08-19T00:48:01.802 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:48:03.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:48:03.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:48:07.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.376+0000 7f387f800640 1 Processor -- start 2024-08-19T00:48:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.376+0000 7f387f800640 1 -- start start 2024-08-19T00:48:07.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.377+0000 7f387f800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3878159bf0 0x7f3878073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.377+0000 7f387f800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387806f7f0 con 0x7f38780cec10 2024-08-19T00:48:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387f800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387806f510 con 0x7f38780739a0 2024-08-19T00:48:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387f800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3878072980 con 0x7f3878159bf0 2024-08-19T00:48:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3878159bf0 0x7f3878073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3878159bf0 0x7f3878073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46584/0 (socket says 172.21.15.7:46584) 2024-08-19T00:48:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387ce00640 1 -- 172.21.15.7:0/1350214611 learned_addr learned my addr 172.21.15.7:0/1350214611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387d800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f38780cec10 0x7f38780d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36050/0 (socket says 172.21.15.7:36050) 2024-08-19T00:48:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387ce00640 1 -- 172.21.15.7:0/1350214611 >> v1:172.21.15.162:6789/0 conn(0x7f38780739a0 legacy=0x7f38780ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387ce00640 1 -- 172.21.15.7:0/1350214611 >> v1:172.21.15.7:6789/0 conn(0x7f38780cec10 legacy=0x7f38780d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f387ce00640 1 -- 172.21.15.7:0/1350214611 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3878072c60 con 0x7f3878159bf0 2024-08-19T00:48:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.378+0000 7f3877400640 1 -- 172.21.15.7:0/1350214611 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813761659 0 0) 0x7f387806f7f0 con 0x7f38780cec10 2024-08-19T00:48:07.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.379+0000 7f387ce00640 1 --2- 172.21.15.7:0/1350214611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3878159bf0 0x7f3878073460 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f386c009870 tx=0x7f386c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55eb83c45aaac29 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f3877400640 1 -- 172.21.15.7:0/1350214611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c037070 con 0x7f3878159bf0 2024-08-19T00:48:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f3877400640 1 -- 172.21.15.7:0/1350214611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c032440 con 0x7f3878159bf0 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f3877400640 1 -- 172.21.15.7:0/1350214611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c032810 con 0x7f3878159bf0 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f387f800640 1 -- 172.21.15.7:0/1350214611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3878159bf0 msgr2=0x7f3878073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f387f800640 1 --2- 172.21.15.7:0/1350214611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3878159bf0 0x7f3878073460 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f386c009870 tx=0x7f386c02a270 comp rx=0 tx=0).stop 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f387f800640 1 -- 172.21.15.7:0/1350214611 shutdown_connections 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f387f800640 1 --2- 172.21.15.7:0/1350214611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3878159bf0 0x7f3878073460 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f387f800640 1 -- 172.21.15.7:0/1350214611 >> 172.21.15.7:0/1350214611 conn(0x7f387806bc70 msgr2=0x7f387806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f387f800640 1 -- 172.21.15.7:0/1350214611 shutdown_connections 2024-08-19T00:48:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.380+0000 7f387f800640 1 -- 172.21.15.7:0/1350214611 wait complete. 2024-08-19T00:48:07.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.382+0000 7f387f800640 1 Processor -- start 2024-08-19T00:48:07.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.382+0000 7f387f800640 1 -- start start 2024-08-19T00:48:07.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.383+0000 7f387f800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38780739a0 0x7f3878150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.383+0000 7f387f800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3878159bf0 0x7f3878157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.383+0000 7f387f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38781551d0 0x7f387809b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.383+0000 7f387f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f387815a150 con 0x7f38781551d0 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.383+0000 7f387f800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3878159fd0 con 0x7f3878159bf0 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.383+0000 7f387f800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38780d0ad0 con 0x7f38780739a0 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.383+0000 7f387d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38781551d0 0x7f387809b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38781551d0 0x7f387809b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46596/0 (socket says 172.21.15.7:46596) 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 -- 172.21.15.7:0/323158146 learned_addr learned my addr 172.21.15.7:0/323158146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387ce00640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38780739a0 0x7f3878150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f3877e00640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3878159bf0 0x7f3878157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 -- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38780739a0 msgr2=0x7f3878150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38780739a0 0x7f3878150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 -- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3878159bf0 msgr2=0x7f3878157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3878159bf0 0x7f3878157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 -- 172.21.15.7:0/323158146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3878155660 con 0x7f38781551d0 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f387d800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38781551d0 0x7f387809b160 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f387000c780 tx=0x7f387000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.384+0000 7f3874c00640 1 -- 172.21.15.7:0/323158146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870018070 con 0x7f38781551d0 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.385+0000 7f3874c00640 1 -- 172.21.15.7:0/323158146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387000a640 con 0x7f38781551d0 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.385+0000 7f3874c00640 1 -- 172.21.15.7:0/323158146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387000aab0 con 0x7f38781551d0 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.385+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387809b6a0 con 0x7f38781551d0 2024-08-19T00:48:07.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.385+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3878155c00 con 0x7f38781551d0 2024-08-19T00:48:07.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.386+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3878073460 con 0x7f38781551d0 2024-08-19T00:48:07.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.387+0000 7f3874c00640 1 -- 172.21.15.7:0/323158146 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f387000ac50 con 0x7f38781551d0 2024-08-19T00:48:07.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.387+0000 7f3874c00640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f385806be30 0x7f385806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.388+0000 7f3874c00640 1 -- 172.21.15.7:0/323158146 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f387008b110 con 0x7f38781551d0 2024-08-19T00:48:07.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.388+0000 7f387ce00640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f385806be30 0x7f385806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.389+0000 7f387ce00640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f385806be30 0x7f385806e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f386c034000 tx=0x7f386c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.392+0000 7f3874c00640 1 -- 172.21.15.7:0/323158146 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f38700587a0 con 0x7f38781551d0 2024-08-19T00:48:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.612+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f387815bd50 con 0x7f38781551d0 2024-08-19T00:48:07.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.613+0000 7f3874c00640 1 -- 172.21.15.7:0/323158146 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 315 v315) ==== 95+0+5237 (secure 0 0 0) 0x7f387005caa0 con 0x7f38781551d0 2024-08-19T00:48:07.616 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:07.616 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":315,"btime":"2024-08-19T00:48:03:975816+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":315,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:03.975809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10026},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10026":{"gid":10026,"name":"a","rank":0,"incarnation":312,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/2241506175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2241506175},{"type":"v1","addr":"172.21.15.7:6837","nonce":2241506175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10026,"qdb_cluster":[10026]},"id":6}]} 2024-08-19T00:48:07.616 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 315 2024-08-19T00:48:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f385806be30 msgr2=0x7f385806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f385806be30 0x7f385806e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f386c034000 tx=0x7f386c02e000 comp rx=0 tx=0).stop 2024-08-19T00:48:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38781551d0 msgr2=0x7f387809b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38781551d0 0x7f387809b160 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f387000c780 tx=0x7f387000cc40 comp rx=0 tx=0).stop 2024-08-19T00:48:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 shutdown_connections 2024-08-19T00:48:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f385806be30 0x7f385806e2f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38781551d0 0x7f387809b160 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3878159bf0 0x7f3878157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 --2- 172.21.15.7:0/323158146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38780739a0 0x7f3878150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 >> 172.21.15.7:0/323158146 conn(0x7f387806bc70 msgr2=0x7f387815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 shutdown_connections 2024-08-19T00:48:07.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.615+0000 7f387f800640 1 -- 172.21.15.7:0/323158146 wait complete. 2024-08-19T00:48:07.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 315, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:43:26.670581+0000', 'modified': '2024-08-19T00:48:03.975809+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 122, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10026}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10026': {'gid': 10026, 'name': 'a', 'rank': 0, 'incarnation': 312, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/2241506175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 2241506175}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 2241506175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10026, 'qdb_cluster': [10026]} 2024-08-19T00:48:07.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:48:07.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-19T00:48:07.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.789+0000 7f3c25c00640 1 Processor -- start 2024-08-19T00:48:07.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.790+0000 7f3c25c00640 1 -- start start 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c25c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200ce500 0x7f3c200ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c25c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c200d03c0 0x7f3c200d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c25c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2006f7f0 con 0x7f3c20159bf0 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c25c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3c200cee80 con 0x7f3c200d03c0 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c25c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c200d0d70 con 0x7f3c200ce500 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c200d03c0 0x7f3c200d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1ea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3c20159bf0 0x7f3c20073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36062/0 (socket says 172.21.15.7:36062) 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1ea00640 1 -- 172.21.15.7:0/3392363616 learned_addr learned my addr 172.21.15.7:0/3392363616 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c17e00640 1 --2- 172.21.15.7:0/3392363616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200ce500 0x7f3c200ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1f400640 1 -- 172.21.15.7:0/3392363616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200ce500 msgr2=0x7f3c200ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1f400640 1 --2- 172.21.15.7:0/3392363616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200ce500 0x7f3c200ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1f400640 1 -- 172.21.15.7:0/3392363616 >> v1:172.21.15.7:6789/0 conn(0x7f3c20159bf0 legacy=0x7f3c20073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1f400640 1 -- 172.21.15.7:0/3392363616 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2006f510 con 0x7f3c200d03c0 2024-08-19T00:48:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.791+0000 7f3c1e000640 1 -- 172.21.15.7:0/3392363616 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221665384 0 0) 0x7f3c2006f7f0 con 0x7f3c20159bf0 2024-08-19T00:48:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.792+0000 7f3c1f400640 1 --2- 172.21.15.7:0/3392363616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c200d0830 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009d90 tx=0x7f3c1802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9d95949f1bedd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c1e000640 1 -- 172.21.15.7:0/3392363616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18031600 con 0x7f3c200d03c0 2024-08-19T00:48:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c1e000640 1 -- 172.21.15.7:0/3392363616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c180317a0 con 0x7f3c200d03c0 2024-08-19T00:48:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c1e000640 1 -- 172.21.15.7:0/3392363616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18031b70 con 0x7f3c200d03c0 2024-08-19T00:48:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 -- 172.21.15.7:0/3392363616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 msgr2=0x7f3c200d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 --2- 172.21.15.7:0/3392363616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c200d0830 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009d90 tx=0x7f3c1802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 -- 172.21.15.7:0/3392363616 shutdown_connections 2024-08-19T00:48:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 --2- 172.21.15.7:0/3392363616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c200d03c0 0x7f3c200d0830 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 --2- 172.21.15.7:0/3392363616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200ce500 0x7f3c200ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 -- 172.21.15.7:0/3392363616 >> 172.21.15.7:0/3392363616 conn(0x7f3c2006bc70 msgr2=0x7f3c2006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 -- 172.21.15.7:0/3392363616 shutdown_connections 2024-08-19T00:48:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.793+0000 7f3c25c00640 1 -- 172.21.15.7:0/3392363616 wait complete. 2024-08-19T00:48:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.795+0000 7f3c25c00640 1 Processor -- start 2024-08-19T00:48:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.795+0000 7f3c25c00640 1 -- start start 2024-08-19T00:48:07.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c25c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c200ce500 0x7f3c20160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c25c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200d03c0 0x7f3c2014e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c25c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c20159bf0 0x7f3c2014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c25c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20072f40 con 0x7f3c20159bf0 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c25c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20072c60 con 0x7f3c200ce500 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c25c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c20073b70 con 0x7f3c200d03c0 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c1f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c20159bf0 0x7f3c2014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.796+0000 7f3c1f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c20159bf0 0x7f3c2014e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46610/0 (socket says 172.21.15.7:46610) 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1f400640 1 -- 172.21.15.7:0/1571397466 learned_addr learned my addr 172.21.15.7:0/1571397466 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c200ce500 0x7f3c20160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c17e00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200d03c0 0x7f3c2014e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1f400640 1 -- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200d03c0 msgr2=0x7f3c2014e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1f400640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200d03c0 0x7f3c2014e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1f400640 1 -- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c200ce500 msgr2=0x7f3c20160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1f400640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c200ce500 0x7f3c20160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1f400640 1 -- 172.21.15.7:0/1571397466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c200b31b0 con 0x7f3c20159bf0 2024-08-19T00:48:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c1f400640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c20159bf0 0x7f3c2014e5c0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009eb0 tx=0x7f3c18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c16a00640 1 -- 172.21.15.7:0/1571397466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18040070 con 0x7f3c20159bf0 2024-08-19T00:48:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.797+0000 7f3c16a00640 1 -- 172.21.15.7:0/1571397466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c18030b60 con 0x7f3c20159bf0 2024-08-19T00:48:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.798+0000 7f3c16a00640 1 -- 172.21.15.7:0/1571397466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18009450 con 0x7f3c20159bf0 2024-08-19T00:48:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.798+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c200b3420 con 0x7f3c20159bf0 2024-08-19T00:48:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.798+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c200b39e0 con 0x7f3c20159bf0 2024-08-19T00:48:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.800+0000 7f3c16a00640 1 -- 172.21.15.7:0/1571397466 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c18039040 con 0x7f3c20159bf0 2024-08-19T00:48:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.801+0000 7f3c16a00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.801+0000 7f3c16a00640 1 -- 172.21.15.7:0/1571397466 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f3c180ad060 con 0x7f3c20159bf0 2024-08-19T00:48:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.801+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.801+0000 7f3c28bf8740 1 Processor -- start 2024-08-19T00:48:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.801+0000 7f3c28bf8740 1 -- start start 2024-08-19T00:48:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000f60 tx=0x7f3c10007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b16a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18ddd0 0x55e26b182df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e26b0a2ba0 con 0x55e26b169f50 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e26b03b230 con 0x55e26b18ddd0 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e26b09eb60 con 0x55e26b18d470 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c1ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b16a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c1ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b16a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46626/0 (socket says 172.21.15.7:46626) 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.802+0000 7f3c1ea00640 1 -- 172.21.15.7:0/2674055567 learned_addr learned my addr 172.21.15.7:0/2674055567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c1f400640 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18ddd0 0x55e26b182df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c17e00640 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c1ea00640 1 -- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 msgr2=0x55e26b18d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c1ea00640 1 -- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18ddd0 msgr2=0x55e26b182df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18ddd0 0x55e26b182df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c1ea00640 1 -- 172.21.15.7:0/2674055567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e26b06cbb0 con 0x55e26b169f50 2024-08-19T00:48:07.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b16a330 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f3c10001950 tx=0x7f3c10013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c5ece71f7157c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c0f400640 1 -- 172.21.15.7:0/2674055567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10026070 con 0x55e26b169f50 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c0f400640 1 -- 172.21.15.7:0/2674055567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10013b80 con 0x55e26b169f50 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.803+0000 7f3c0f400640 1 -- 172.21.15.7:0/2674055567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10012350 con 0x55e26b169f50 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 -- 172.21.15.7:0/2674055567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 msgr2=0x55e26b16a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b16a330 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f3c10001950 tx=0x7f3c10013000 comp rx=0 tx=0).stop 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 -- 172.21.15.7:0/2674055567 shutdown_connections 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18ddd0 0x55e26b182df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/2674055567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b16a330 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 -- 172.21.15.7:0/2674055567 >> 172.21.15.7:0/2674055567 conn(0x55e26b107110 msgr2=0x55e26b184d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 -- 172.21.15.7:0/2674055567 shutdown_connections 2024-08-19T00:48:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.804+0000 7f3c28bf8740 1 -- 172.21.15.7:0/2674055567 wait complete. 2024-08-19T00:48:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.805+0000 7f3c28bf8740 1 -- start start 2024-08-19T00:48:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.805+0000 7f3c28bf8740 1 Processor -- start 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b198020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b184240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b1645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e26b186ea0 con 0x55e26b169f50 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e26b05e250 con 0x55e26b18d470 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e26b1865b0 con 0x55e26b18ddd0 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c28bf8740 10 client.0 _ll_register_callbacks cb 0x55e26b062740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c1ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c1ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46632/0 (socket says 172.21.15.7:46632) 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c1ea00640 1 -- 172.21.15.7:0/3561559669 learned_addr learned my addr 172.21.15.7:0/3561559669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c17e00640 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b184240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.806+0000 7f3c1f400640 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b1645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c1ea00640 1 -- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 msgr2=0x55e26b1645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b1645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c1ea00640 1 -- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 msgr2=0x55e26b184240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b184240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c1ea00640 1 -- 172.21.15.7:0/3561559669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e26adb62d0 con 0x55e26b169f50 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b198020 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f3c10024040 tx=0x7f3c10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a3db7746af6318 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c03e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c03e00640 1 -- 172.21.15.7:0/3561559669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10026040 con 0x55e26b169f50 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c03e00640 1 -- 172.21.15.7:0/3561559669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f3c10013d30 con 0x55e26b169f50 2024-08-19T00:48:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.807+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c10013b80 con 0x55e26b169f50 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c03e00640 1 -- 172.21.15.7:0/3561559669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=315) ==== 24+0+0 (secure 0 0 0) 0x7f3c10039050 con 0x55e26b169f50 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 10 client.10095 fetch_fsmap learned FSMap version 315 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=315,monmap=2+}) -- 0x55e26ae806b0 con 0x55e26b169f50 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c03e00640 1 -- 172.21.15.7:0/3561559669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10013b80 con 0x55e26b169f50 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c03e00640 1 -- 172.21.15.7:0/3561559669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 315) ==== 3502+0+0 (secure 0 0 0) 0x7f3c10022070 con 0x55e26b169f50 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 10 client.10095 fetch_fsmap finished waiting for FSMap version 315 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 10 client.10095 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 20 client.10095 populate_metadata read hostname 'smithi007' 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b13e790 0x55e26b13eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 4 client.10095 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 --> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e26b0b02d0 con 0x55e26b13e790 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.808+0000 7f3c17e00640 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b13e790 0x55e26b13eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.809+0000 7f3c17e00640 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b13e790 0x55e26b13eb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6fcf2d97566dbf9 server_cookie=e7301da773190832 in_seq=0 out_seq=0 2024-08-19T00:48:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.809+0000 7f3c03e00640 10 client.10095 ms_handle_connect on v2:172.21.15.7:6835/2241506175 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c03e00640 1 -- 172.21.15.7:0/3561559669 <== mds.0 v2:172.21.15.7:6835/2241506175 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e26b0b02d0 con 0x55e26b13e790 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c03e00640 10 client.10095 handle_command_reply: tid=0 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 client.10095 shutdown 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 msgr2=0x55e26b198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b198020 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f3c10024040 tx=0x7f3c10000ed0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 shutdown_connections 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b13e790 0x55e26b13eb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b1645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b184240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/3561559669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b198020 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c03e00640 0 client.10095 ms_handle_reset on v2:172.21.15.7:6835/2241506175 2024-08-19T00:48:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 >> 172.21.15.7:0/3561559669 conn(0x55e26b107110 msgr2=0x55e26b184c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 shutdown_connections 2024-08-19T00:48:07.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.810+0000 7f3c28bf8740 1 -- 172.21.15.7:0/3561559669 wait complete. 2024-08-19T00:48:07.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.811+0000 7f3c28bf8740 20 client.10095 trim_cache size 0 max 16384 2024-08-19T00:48:07.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.829+0000 7f3c28bf8740 1 Processor -- start 2024-08-19T00:48:07.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.829+0000 7f3c28bf8740 1 -- start start 2024-08-19T00:48:07.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.830+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b169f50 0x55e26b17b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.830+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.830+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b18ddd0 0x55e26b18c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.830+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20201600 con 0x55e26b18ddd0 2024-08-19T00:48:07.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.830+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20200960 con 0x55e26b169f50 2024-08-19T00:48:07.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.830+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c20200fb0 con 0x55e26b18d470 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.830+0000 7f3c1f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b18ddd0 0x55e26b18c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b18ddd0 0x55e26b18c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46638/0 (socket says 172.21.15.7:46638) 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 -- 172.21.15.7:0/1884419189 learned_addr learned my addr 172.21.15.7:0/1884419189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c17e00640 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b169f50 0x55e26b17b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 -- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 msgr2=0x55e26b18c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 -- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b169f50 msgr2=0x55e26b17b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b169f50 0x55e26b17b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 -- 172.21.15.7:0/1884419189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e26b0b0a00 con 0x55e26b18ddd0 2024-08-19T00:48:07.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b169f50 0x55e26b17b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c1f400640 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b18ddd0 0x55e26b18c6c0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f3c18076be0 tx=0x7f3c18081040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a42bb435d1f6141 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c0ea00640 1 -- 172.21.15.7:0/1884419189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1804a040 con 0x55e26b18ddd0 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c0ea00640 1 -- 172.21.15.7:0/1884419189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c180aa9d0 con 0x55e26b18ddd0 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.831+0000 7f3c0ea00640 1 -- 172.21.15.7:0/1884419189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18076df0 con 0x55e26b18ddd0 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1884419189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b18ddd0 msgr2=0x55e26b18c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b18ddd0 0x55e26b18c6c0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f3c18076be0 tx=0x7f3c18081040 comp rx=0 tx=0).stop 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1884419189 shutdown_connections 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b18ddd0 0x55e26b18c6c0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18d470 0x55e26b18c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1884419189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b169f50 0x55e26b17b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1884419189 >> 172.21.15.7:0/1884419189 conn(0x55e26b107110 msgr2=0x55e26b184b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1884419189 shutdown_connections 2024-08-19T00:48:07.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.832+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1884419189 wait complete. 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.833+0000 7f3c28bf8740 1 -- start start 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.833+0000 7f3c28bf8740 1 Processor -- start 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b17f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b202e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c28bf8740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b18c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e26b140bb0 con 0x55e26b169f50 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e26b17d4a0 con 0x55e26b18d470 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c28bf8740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e26b1805d0 con 0x55e26b18ddd0 2024-08-19T00:48:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c28bf8740 10 client.0 _ll_register_callbacks cb 0x7f3c10024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b17f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b17f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46646/0 (socket says 172.21.15.7:46646) 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1ea00640 1 -- 172.21.15.7:0/1930147553 learned_addr learned my addr 172.21.15.7:0/1930147553 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1f400640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b18c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c17e00640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b202e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1ea00640 1 -- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 msgr2=0x55e26b18c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b18c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1ea00640 1 -- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 msgr2=0x55e26b202e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.834+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b202e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c1ea00640 1 -- 172.21.15.7:0/1930147553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e26b1981d0 con 0x55e26b169f50 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c17e00640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b202e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c1ea00640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b17f420 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f3c10007380 tx=0x7f3c10009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6732cfc6d50454fa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c03e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c03e00640 1 -- 172.21.15.7:0/1930147553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10026040 con 0x55e26b169f50 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c03e00640 1 -- 172.21.15.7:0/1930147553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f3c10013b80 con 0x55e26b169f50 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c180aa9d0 con 0x55e26b169f50 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c03e00640 1 -- 172.21.15.7:0/1930147553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=315) ==== 24+0+0 (secure 0 0 0) 0x7f3c1004b050 con 0x55e26b169f50 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c28bf8740 10 client.10101 fetch_fsmap learned FSMap version 315 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.835+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=315,monmap=2+}) -- 0x55e26b167c80 con 0x55e26b169f50 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c03e00640 1 -- 172.21.15.7:0/1930147553 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c180aa9d0 con 0x55e26b169f50 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c03e00640 1 -- 172.21.15.7:0/1930147553 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 315) ==== 3502+0+0 (secure 0 0 0) 0x7f3c10020420 con 0x55e26b169f50 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c28bf8740 10 client.10101 fetch_fsmap finished waiting for FSMap version 315 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c28bf8740 10 client.10101 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c28bf8740 20 client.10101 populate_metadata read hostname 'smithi007' 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b183db0 0x55e26b20ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c28bf8740 4 client.10101 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 --> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] -- command(tid 0: {"prefix": "status"}) -- 0x55e26b0aa620 con 0x55e26b183db0 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.836+0000 7f3c17e00640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b183db0 0x55e26b20ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c17e00640 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b183db0 0x55e26b20ecc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3001d14eced3def server_cookie=111438e248f4ac25 in_seq=0 out_seq=0 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c03e00640 10 client.10101 ms_handle_connect on v2:172.21.15.7:6835/2241506175 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c03e00640 1 -- 172.21.15.7:0/1930147553 <== mds.0 v2:172.21.15.7:6835/2241506175 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55e26b0aa620 con 0x55e26b183db0 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c03e00640 10 client.10101 handle_command_reply: tid=0 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 client.10101 shutdown 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 msgr2=0x55e26b17f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b17f420 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f3c10007380 tx=0x7f3c10009030 comp rx=0 tx=0).stop 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 shutdown_connections 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:6835/2241506175,v1:172.21.15.7:6837/2241506175] conn(0x55e26b183db0 0x55e26b20ecc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e26b18ddd0 0x55e26b18c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e26b18d470 0x55e26b202e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 --2- 172.21.15.7:0/1930147553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e26b169f50 0x55e26b17f420 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c03e00640 0 client.10101 ms_handle_reset on v2:172.21.15.7:6835/2241506175 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 >> 172.21.15.7:0/1930147553 conn(0x55e26b107110 msgr2=0x55e26b1978f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 shutdown_connections 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 1 -- 172.21.15.7:0/1930147553 wait complete. 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.837+0000 7f3c28bf8740 20 client.10101 trim_cache size 0 max 16384 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:48:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 10026, 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.8759015430000003, 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 315, 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 122, 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 122, 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 9.1004027779999994 2024-08-19T00:48:07.845 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:48:07.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 msgr2=0x7f3bfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000f60 tx=0x7f3c10007d50 comp rx=0 tx=0).stop 2024-08-19T00:48:07.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c20159bf0 msgr2=0x7f3c2014e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:07.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c20159bf0 0x7f3c2014e5c0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009eb0 tx=0x7f3c18004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:07.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 shutdown_connections 2024-08-19T00:48:07.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3bfc06be30 0x7f3bfc06e2f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c20159bf0 0x7f3c2014e5c0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c200d03c0 0x7f3c2014e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 --2- 172.21.15.7:0/1571397466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c200ce500 0x7f3c20160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 >> 172.21.15.7:0/1571397466 conn(0x7f3c2006bc70 msgr2=0x7f3c2015e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 shutdown_connections 2024-08-19T00:48:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:07.838+0000 7f3c25c00640 1 -- 172.21.15.7:0/1571397466 wait complete. 2024-08-19T00:48:07.856 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:48:07.856 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap header on mds0_openfiles.0', proceeding to ls 2024-08-19T00:48:07.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:48:08.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.011+0000 7fb5f4000640 1 Processor -- start 2024-08-19T00:48:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.011+0000 7fb5f4000640 1 -- start start 2024-08-19T00:48:08.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f4000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5ec0ce500 0x7fb5ec0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f4000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb5ec0d03c0 0x7fb5ec0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f4000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5ec06f7f0 con 0x7fb5ec159bf0 2024-08-19T00:48:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f4000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb5ec0d0d50 con 0x7fb5ec0ce500 2024-08-19T00:48:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f4000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb5ec06f510 con 0x7fb5ec0d03c0 2024-08-19T00:48:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5ec0ce500 0x7fb5ec0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5ec0ce500 0x7fb5ec0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46658/0 (socket says 172.21.15.7:46658) 2024-08-19T00:48:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f0c00640 1 -- 172.21.15.7:0/3327466903 learned_addr learned my addr 172.21.15.7:0/3327466903 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f2000640 1 --2- 172.21.15.7:0/3327466903 >> v2:172.21.15.162:3300/0 conn(0x7fb5ec0d03c0 0x7fb5ec0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f0c00640 1 -- 172.21.15.7:0/3327466903 >> v2:172.21.15.162:3300/0 conn(0x7fb5ec0d03c0 msgr2=0x7fb5ec0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f0c00640 1 --2- 172.21.15.7:0/3327466903 >> v2:172.21.15.162:3300/0 conn(0x7fb5ec0d03c0 0x7fb5ec0d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f0c00640 1 -- 172.21.15.7:0/3327466903 >> v1:172.21.15.7:6789/0 conn(0x7fb5ec159bf0 legacy=0x7fb5ec073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f0c00640 1 -- 172.21.15.7:0/3327466903 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec072980 con 0x7fb5ec0ce500 2024-08-19T00:48:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5f2000640 1 --2- 172.21.15.7:0/3327466903 >> v2:172.21.15.162:3300/0 conn(0x7fb5ec0d03c0 0x7fb5ec0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.013+0000 7fb5ebe00640 1 -- 172.21.15.7:0/3327466903 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226943875 0 0) 0x7fb5ec06f7f0 con 0x7fb5ec159bf0 2024-08-19T00:48:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.014+0000 7fb5f0c00640 1 --2- 172.21.15.7:0/3327466903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec0ce970 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0d0fb0 tx=0x7fb5d802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c7a86f36ec93a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5ebe00640 1 -- 172.21.15.7:0/3327466903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8037070 con 0x7fb5ec0ce500 2024-08-19T00:48:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5ebe00640 1 -- 172.21.15.7:0/3327466903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d8032440 con 0x7fb5ec0ce500 2024-08-19T00:48:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5ebe00640 1 -- 172.21.15.7:0/3327466903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8032810 con 0x7fb5ec0ce500 2024-08-19T00:48:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 -- 172.21.15.7:0/3327466903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 msgr2=0x7fb5ec0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 --2- 172.21.15.7:0/3327466903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec0ce970 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0d0fb0 tx=0x7fb5d802a200 comp rx=0 tx=0).stop 2024-08-19T00:48:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 -- 172.21.15.7:0/3327466903 shutdown_connections 2024-08-19T00:48:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 --2- 172.21.15.7:0/3327466903 >> v2:172.21.15.162:3300/0 conn(0x7fb5ec0d03c0 0x7fb5ec0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 --2- 172.21.15.7:0/3327466903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec0ce970 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 -- 172.21.15.7:0/3327466903 >> 172.21.15.7:0/3327466903 conn(0x7fb5ec06bc70 msgr2=0x7fb5ec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 -- 172.21.15.7:0/3327466903 shutdown_connections 2024-08-19T00:48:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.015+0000 7fb5f4000640 1 -- 172.21.15.7:0/3327466903 wait complete. 2024-08-19T00:48:08.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.017+0000 7fb5f4000640 1 Processor -- start 2024-08-19T00:48:08.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.017+0000 7fb5f4000640 1 -- start start 2024-08-19T00:48:08.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f4000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f4000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5ec0d03c0 0x7fb5ec09dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f4000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec159bf0 0x7fb5ec0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f4000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec073b70 con 0x7fb5ec0ce500 2024-08-19T00:48:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f4000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec072f40 con 0x7fb5ec159bf0 2024-08-19T00:48:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f4000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ec159fd0 con 0x7fb5ec0d03c0 2024-08-19T00:48:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46670/0 (socket says 172.21.15.7:46670) 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f1600640 1 -- 172.21.15.7:0/2196802406 learned_addr learned my addr 172.21.15.7:0/2196802406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f0c00640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5ec0d03c0 0x7fb5ec09dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.018+0000 7fb5f2000640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec159bf0 0x7fb5ec0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f1600640 1 -- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5ec0d03c0 msgr2=0x7fb5ec09dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f1600640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5ec0d03c0 0x7fb5ec09dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f1600640 1 -- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec159bf0 msgr2=0x7fb5ec0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f1600640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec159bf0 0x7fb5ec0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f1600640 1 -- 172.21.15.7:0/2196802406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec09cc20 con 0x7fb5ec0ce500 2024-08-19T00:48:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f0c00640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5ec0d03c0 0x7fb5ec09dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f1600640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec14b4f0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c4e0 tx=0x7fb5e000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5e9600640 1 -- 172.21.15.7:0/2196802406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0017070 con 0x7fb5ec0ce500 2024-08-19T00:48:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5e9600640 1 -- 172.21.15.7:0/2196802406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e00035f0 con 0x7fb5ec0ce500 2024-08-19T00:48:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5e9600640 1 -- 172.21.15.7:0/2196802406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00039e0 con 0x7fb5ec0ce500 2024-08-19T00:48:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ec09cec0 con 0x7fb5ec0ce500 2024-08-19T00:48:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.019+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ec09d480 con 0x7fb5ec0ce500 2024-08-19T00:48:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.020+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ec15d660 con 0x7fb5ec0ce500 2024-08-19T00:48:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.021+0000 7fb5e9600640 1 -- 172.21.15.7:0/2196802406 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5e001a070 con 0x7fb5ec0ce500 2024-08-19T00:48:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.022+0000 7fb5e9600640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5cc06be60 0x7fb5cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.022+0000 7fb5e9600640 1 -- 172.21.15.7:0/2196802406 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7fb5e008ad40 con 0x7fb5ec0ce500 2024-08-19T00:48:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.022+0000 7fb5f0c00640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5cc06be60 0x7fb5cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:08.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.023+0000 7fb5f0c00640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5cc06be60 0x7fb5cc06e320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8034000 tx=0x7fb5d802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.026+0000 7fb5e9600640 1 -- 172.21.15.7:0/2196802406 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb5ec15d660 con 0x7fb5ec0ce500 2024-08-19T00:48:08.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.246+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb5ec0d0810 con 0x7fb5ec0ce500 2024-08-19T00:48:08.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.246+0000 7fb5e9600640 1 -- 172.21.15.7:0/2196802406 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v315) ==== 53+0+73 (secure 0 0 0) 0x7fb5e0058460 con 0x7fb5ec0ce500 2024-08-19T00:48:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:48:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.248+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5cc06be60 msgr2=0x7fb5cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.248+0000 7fb5f4000640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5cc06be60 0x7fb5cc06e320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8034000 tx=0x7fb5d802e000 comp rx=0 tx=0).stop 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.248+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 msgr2=0x7fb5ec14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.248+0000 7fb5f4000640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec14b4f0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c4e0 tx=0x7fb5e000c9a0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 shutdown_connections 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5cc06be60 0x7fb5cc06e320 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec159bf0 0x7fb5ec0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5ec0d03c0 0x7fb5ec09dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 --2- 172.21.15.7:0/2196802406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec0ce500 0x7fb5ec14b4f0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:08.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 >> 172.21.15.7:0/2196802406 conn(0x7fb5ec06bc70 msgr2=0x7fb5ec0b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:08.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 shutdown_connections 2024-08-19T00:48:08.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08.249+0000 7fb5f4000640 1 -- 172.21.15.7:0/2196802406 wait complete. 2024-08-19T00:48:08.268 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:48:08.268 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:48:08.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:48:08.268 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:48:08.268 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:08.268 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:48:08.268 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:48:08.269 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:48:08.269 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:48:08.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:08.269 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:48:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:48:08.305 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:48:08.305 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:08.306 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42173sec preferred_lft 42173sec 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:48:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:08.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:08.309 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:48:08.400 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:48:08.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:08.403 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:48:08.439 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:48:08.440 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:48:08.440 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:48:08.440 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:48:08.440 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:48:08.440 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:48:08.440 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:48:08.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:48:08.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:48:08.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:48:08.441 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:48:08.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:48:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:48:08.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:08.638 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:48:08.673 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:48:08.673 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:48:08.674 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:48:08.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:08.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:48:08.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:48:08.771 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:08.806 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:48:08.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:48:08.807 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:08.881 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:48:08.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:08.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:08.959 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:48:08.957+0000 7effa9400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:09.010 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:09.010 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:48:09.010 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:48:09.025 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:09.026 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:48:09.026 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:48:09.026 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:48:09.026 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:48:09.048 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:09.048 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:48:09.048 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:48:09.048 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:48:09.048 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:48:09.048 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:48:09.049 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:48:09.049 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:48:09.049 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:48:09.050 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:48:09.050 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:48:09.050 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:48:09.050 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:48:09.052 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:48:09.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:09.053 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:09.151 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:48:09.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:48:09.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:48:09.241 INFO:teuthology.orchestra.run.smithi007.stdout:client9289 2024-08-19T00:48:09.241 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:09.242 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:09.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:09.277 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2024-08-19T00:48:09.321 INFO:teuthology.orchestra.run:waiting for 20 2024-08-19T00:48:09.355 INFO:teuthology.orchestra.run.smithi007.stdout:.: 2024-08-19T00:48:09.355 INFO:teuthology.orchestra.run.smithi007.stdout:subdir 2024-08-19T00:48:09.355 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:09.355 INFO:teuthology.orchestra.run.smithi007.stdout:./subdir: 2024-08-19T00:48:09.355 INFO:teuthology.orchestra.run.smithi007.stdout:sixmegs 2024-08-19T00:48:09.356 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on mds0_openfiles.0' did not caused DAMAGED state 2024-08-19T00:48:09.356 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 100.00000000' 2024-08-19T00:48:09.356 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:09.356 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:09.433 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:09.433 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:09.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:48:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.703+0000 7fda6da00640 1 Processor -- start 2024-08-19T00:48:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.703+0000 7fda6da00640 1 -- start start 2024-08-19T00:48:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.704+0000 7fda6da00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fda68159bf0 0x7fda68073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.704+0000 7fda6da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda680cec10 0x7fda680d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.704+0000 7fda6da00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6806f7f0 con 0x7fda680739a0 2024-08-19T00:48:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.704+0000 7fda6da00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fda6806f510 con 0x7fda68159bf0 2024-08-19T00:48:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.704+0000 7fda6da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda68072980 con 0x7fda680cec10 2024-08-19T00:48:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.705+0000 7fda67400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda680cec10 0x7fda680d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.705+0000 7fda66a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fda68159bf0 0x7fda68073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.705+0000 7fda5fe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fda680739a0 0x7fda680ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:43166/0 (socket says 172.21.15.7:43166) 2024-08-19T00:48:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.705+0000 7fda5fe00640 1 -- 172.21.15.7:0/3544842136 learned_addr learned my addr 172.21.15.7:0/3544842136 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.706+0000 7fda67400640 1 -- 172.21.15.7:0/3544842136 >> v2:172.21.15.162:3300/0 conn(0x7fda68159bf0 msgr2=0x7fda68073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.706+0000 7fda67400640 1 --2- 172.21.15.7:0/3544842136 >> v2:172.21.15.162:3300/0 conn(0x7fda68159bf0 0x7fda68073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.706+0000 7fda67400640 1 -- 172.21.15.7:0/3544842136 >> v1:172.21.15.162:6789/0 conn(0x7fda680739a0 legacy=0x7fda680ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.706+0000 7fda67400640 1 -- 172.21.15.7:0/3544842136 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68072c60 con 0x7fda680cec10 2024-08-19T00:48:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.706+0000 7fda66a00640 1 --2- 172.21.15.7:0/3544842136 >> v2:172.21.15.162:3300/0 conn(0x7fda68159bf0 0x7fda68073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.707+0000 7fda67400640 1 --2- 172.21.15.7:0/3544842136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda680cec10 0x7fda680d03c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda60009d90 tx=0x7fda6002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98b748f06f508f36 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.707+0000 7fda66000640 1 -- 172.21.15.7:0/3544842136 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60031600 con 0x7fda680cec10 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.707+0000 7fda66000640 1 -- 172.21.15.7:0/3544842136 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda600317a0 con 0x7fda680cec10 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.707+0000 7fda66000640 1 -- 172.21.15.7:0/3544842136 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60031b70 con 0x7fda680cec10 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.707+0000 7fda6da00640 1 -- 172.21.15.7:0/3544842136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda680cec10 msgr2=0x7fda680d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.707+0000 7fda6da00640 1 --2- 172.21.15.7:0/3544842136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda680cec10 0x7fda680d03c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda60009d90 tx=0x7fda6002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.708+0000 7fda6da00640 1 -- 172.21.15.7:0/3544842136 shutdown_connections 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.708+0000 7fda6da00640 1 --2- 172.21.15.7:0/3544842136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda680cec10 0x7fda680d03c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.708+0000 7fda6da00640 1 --2- 172.21.15.7:0/3544842136 >> v2:172.21.15.162:3300/0 conn(0x7fda68159bf0 0x7fda68073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.708+0000 7fda6da00640 1 -- 172.21.15.7:0/3544842136 >> 172.21.15.7:0/3544842136 conn(0x7fda6806bc70 msgr2=0x7fda6806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.708+0000 7fda6da00640 1 -- 172.21.15.7:0/3544842136 shutdown_connections 2024-08-19T00:48:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.708+0000 7fda6da00640 1 -- 172.21.15.7:0/3544842136 wait complete. 2024-08-19T00:48:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.709+0000 7fda6da00640 1 Processor -- start 2024-08-19T00:48:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.709+0000 7fda6da00640 1 -- start start 2024-08-19T00:48:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.710+0000 7fda6da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda680739a0 0x7fda6809dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.710+0000 7fda6da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda68159bf0 0x7fda68158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.710+0000 7fda6da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda68158970 0x7fda681507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.710+0000 7fda6da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda6815a150 con 0x7fda680739a0 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.710+0000 7fda6da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda68159fd0 con 0x7fda68159bf0 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.710+0000 7fda6da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda680d0900 con 0x7fda68158970 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda680739a0 0x7fda6809dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda680739a0 0x7fda6809dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46680/0 (socket says 172.21.15.7:46680) 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 -- 172.21.15.7:0/3751131177 learned_addr learned my addr 172.21.15.7:0/3751131177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda5fe00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda68159bf0 0x7fda68158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda67400640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda68158970 0x7fda681507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 -- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda68158970 msgr2=0x7fda681507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda68158970 0x7fda681507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 -- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda68159bf0 msgr2=0x7fda68158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda68159bf0 0x7fda68158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 -- 172.21.15.7:0/3751131177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68151550 con 0x7fda680739a0 2024-08-19T00:48:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.711+0000 7fda66a00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda680739a0 0x7fda6809dcb0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fda5800ebe0 tx=0x7fda5800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.712+0000 7fda5ea00640 1 -- 172.21.15.7:0/3751131177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda58017070 con 0x7fda680739a0 2024-08-19T00:48:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.712+0000 7fda5ea00640 1 -- 172.21.15.7:0/3751131177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5800cbd0 con 0x7fda680739a0 2024-08-19T00:48:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.712+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda68151830 con 0x7fda680739a0 2024-08-19T00:48:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.712+0000 7fda5ea00640 1 -- 172.21.15.7:0/3751131177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda58013470 con 0x7fda680739a0 2024-08-19T00:48:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.712+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda68151df0 con 0x7fda680739a0 2024-08-19T00:48:09.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.713+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda680d0c80 con 0x7fda680739a0 2024-08-19T00:48:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.714+0000 7fda5ea00640 1 -- 172.21.15.7:0/3751131177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda5801a070 con 0x7fda680739a0 2024-08-19T00:48:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.715+0000 7fda5ea00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda4406be30 0x7fda4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.715+0000 7fda5ea00640 1 -- 172.21.15.7:0/3751131177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7fda5808b980 con 0x7fda680739a0 2024-08-19T00:48:09.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.715+0000 7fda5fe00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda4406be30 0x7fda4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.716+0000 7fda5fe00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda4406be30 0x7fda4406e2f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fda681f7820 tx=0x7fda50007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:09.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.720+0000 7fda5ea00640 1 -- 172.21.15.7:0/3751131177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fda580590a0 con 0x7fda680739a0 2024-08-19T00:48:09.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.918+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fda680b1610 con 0x7fda680739a0 2024-08-19T00:48:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.918+0000 7fda5ea00640 1 -- 172.21.15.7:0/3751131177 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 72 entries v122) ==== 81+0+4306 (secure 0 0 0) 0x7fda5805d3a0 con 0x7fda680739a0 2024-08-19T00:48:09.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/767746356 2024-08-20T00:47:36.848235+0000 2024-08-19T00:48:09.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2697833470 2024-08-20T00:47:13.631762+0000 2024-08-19T00:48:09.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2697833470 2024-08-20T00:47:13.631762+0000 2024-08-19T00:48:09.921 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/564246395 2024-08-20T00:47:08.596064+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/564246395 2024-08-20T00:47:08.596064+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/23553373 2024-08-20T00:46:48.423172+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2764430344 2024-08-20T00:45:15.874510+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:48:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3239344481 2024-08-20T00:47:53.939814+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2555026980 2024-08-20T00:46:00.124037+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/918472079 2024-08-20T00:44:39.648889+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3239344481 2024-08-20T00:47:53.939814+0000 2024-08-19T00:48:09.923 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/978981940 2024-08-20T00:47:48.474571+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6832/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1092992076 2024-08-20T00:45:13.853614+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2458713155 2024-08-20T00:44:06.188927+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1582667547 2024-08-20T00:44:10.208810+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3482025847 2024-08-20T00:44:53.272372+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1524598451 2024-08-20T00:45:00.316452+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/978981940 2024-08-20T00:47:48.474571+0000 2024-08-19T00:48:09.924 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3804092925 2024-08-20T00:46:12.208398+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6834/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3482189423 2024-08-20T00:43:53.541123+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2121313657 2024-08-20T00:45:23.908167+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/95446058 2024-08-20T00:46:20.274334+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/232072615 2024-08-20T00:45:30.946343+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3471482572 2024-08-20T00:46:36.346761+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3784682490 2024-08-20T00:44:27.595559+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/835453535 2024-08-20T00:45:34.977428+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/877185885 2024-08-20T00:44:46.224779+0000 2024-08-19T00:48:09.925 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3619862411 2024-08-20T00:45:39.018072+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/767746356 2024-08-20T00:47:36.848235+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1850770580 2024-08-20T00:44:14.242517+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/1067237290 2024-08-20T00:45:56.104621+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3307283757 2024-08-20T00:46:04.155541+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3427152926 2024-08-20T00:44:42.202799+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/4018426566 2024-08-20T00:46:08.138498+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/613323192 2024-08-20T00:46:16.237393+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/1141791797 2024-08-20T00:46:33.788770+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:48:09.926 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6833/3169517259 2024-08-20T00:43:59.140007+0000 2024-08-19T00:48:09.927 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.162:6835/2295549448 2024-08-20T00:43:37.028725+0000 2024-08-19T00:48:09.927 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/4168746347 2024-08-20T00:46:40.368064+0000 2024-08-19T00:48:09.927 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3399848835 2024-08-20T00:45:53.817587+0000 2024-08-19T00:48:09.927 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/300508336 2024-08-20T00:46:44.396111+0000 2024-08-19T00:48:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:listed 72 entries 2024-08-19T00:48:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda4406be30 msgr2=0x7fda4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda4406be30 0x7fda4406e2f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fda681f7820 tx=0x7fda50007e80 comp rx=0 tx=0).stop 2024-08-19T00:48:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda680739a0 msgr2=0x7fda6809dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda680739a0 0x7fda6809dcb0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fda5800ebe0 tx=0x7fda5800c520 comp rx=0 tx=0).stop 2024-08-19T00:48:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 shutdown_connections 2024-08-19T00:48:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fda4406be30 0x7fda4406e2f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda68158970 0x7fda681507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda68159bf0 0x7fda68158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 --2- 172.21.15.7:0/3751131177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda680739a0 0x7fda6809dcb0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.920+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 >> 172.21.15.7:0/3751131177 conn(0x7fda6806bc70 msgr2=0x7fda6815b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.921+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 shutdown_connections 2024-08-19T00:48:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:09.921+0000 7fda6da00640 1 -- 172.21.15.7:0/3751131177 wait complete. 2024-08-19T00:48:09.939 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:48:09.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:09.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-19T00:48:10.021 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:48:10.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:10.021 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:48:10.057 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:48:10.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.253+0000 7f08d5000640 1 Processor -- start 2024-08-19T00:48:10.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.253+0000 7f08d5000640 1 -- start start 2024-08-19T00:48:10.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.254+0000 7f08d5000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f08d00b4860 0x7f08d00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.254+0000 7f08d5000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d00b4df0 con 0x7f08d015e3e0 2024-08-19T00:48:10.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.254+0000 7f08d5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d00b50d0 con 0x7f08d00d27b0 2024-08-19T00:48:10.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.254+0000 7f08d5000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f08d00d3140 con 0x7f08d00b4860 2024-08-19T00:48:10.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.254+0000 7f08cf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f08d015e3e0 0x7f08d00b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36086/0 (socket says 172.21.15.7:36086) 2024-08-19T00:48:10.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.254+0000 7f08cf400640 1 -- 172.21.15.7:0/1617998253 learned_addr learned my addr 172.21.15.7:0/1617998253 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:10.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.255+0000 7f08cfe00640 1 --2- 172.21.15.7:0/1617998253 >> v2:172.21.15.162:3300/0 conn(0x7f08d00b4860 0x7f08d00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.255+0000 7f08ce000640 1 -- 172.21.15.7:0/1617998253 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476156372 0 0) 0x7f08d00b4df0 con 0x7f08d015e3e0 2024-08-19T00:48:10.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.255+0000 7f08ce000640 1 -- 172.21.15.7:0/1617998253 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b4003520 con 0x7f08d015e3e0 2024-08-19T00:48:10.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.255+0000 7f08cfe00640 1 -- 172.21.15.7:0/1617998253 >> v1:172.21.15.162:6789/0 conn(0x7f08d00d27b0 legacy=0x7f08d00b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.255+0000 7f08cfe00640 1 -- 172.21.15.7:0/1617998253 >> v1:172.21.15.7:6789/0 conn(0x7f08d015e3e0 legacy=0x7f08d00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.255+0000 7f08cfe00640 1 -- 172.21.15.7:0/1617998253 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d00cf1e0 con 0x7f08d00b4860 2024-08-19T00:48:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.256+0000 7f08cfe00640 1 --2- 172.21.15.7:0/1617998253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00b4860 0x7f08d00d2c00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009dc0 tx=0x7f08c802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afe2e853f49db8f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08ce000640 1 -- 172.21.15.7:0/1617998253 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8007740 con 0x7f08d00b4860 2024-08-19T00:48:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08ce000640 1 -- 172.21.15.7:0/1617998253 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c80078e0 con 0x7f08d00b4860 2024-08-19T00:48:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08ce000640 1 -- 172.21.15.7:0/1617998253 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8007cb0 con 0x7f08d00b4860 2024-08-19T00:48:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08d5000640 1 -- 172.21.15.7:0/1617998253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00b4860 msgr2=0x7f08d00d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08d5000640 1 --2- 172.21.15.7:0/1617998253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00b4860 0x7f08d00d2c00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009dc0 tx=0x7f08c802a730 comp rx=0 tx=0).stop 2024-08-19T00:48:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08d5000640 1 -- 172.21.15.7:0/1617998253 shutdown_connections 2024-08-19T00:48:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08d5000640 1 --2- 172.21.15.7:0/1617998253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00b4860 0x7f08d00d2c00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08d5000640 1 -- 172.21.15.7:0/1617998253 >> 172.21.15.7:0/1617998253 conn(0x7f08d008dbe0 msgr2=0x7f08d009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08d5000640 1 -- 172.21.15.7:0/1617998253 shutdown_connections 2024-08-19T00:48:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.257+0000 7f08d5000640 1 -- 172.21.15.7:0/1617998253 wait complete. 2024-08-19T00:48:10.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.259+0000 7f08d5000640 1 Processor -- start 2024-08-19T00:48:10.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.259+0000 7f08d5000640 1 -- start start 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08d5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08d00b4860 0x7f08d01f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08d5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00d27b0 0x7f08d00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08d5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08d015e3e0 0x7f08d00b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08d5000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08d00cf9e0 con 0x7f08d00b4860 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08d5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08d00cee90 con 0x7f08d00d27b0 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08d5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08d00cfb60 con 0x7f08d015e3e0 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08d00b4860 0x7f08d01f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08d00b4860 0x7f08d01f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46694/0 (socket says 172.21.15.7:46694) 2024-08-19T00:48:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08cf400640 1 -- 172.21.15.7:0/1531183049 learned_addr learned my addr 172.21.15.7:0/1531183049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08cea00640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00d27b0 0x7f08d00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.260+0000 7f08cfe00640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08d015e3e0 0x7f08d00b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08cf400640 1 -- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08d015e3e0 msgr2=0x7f08d00b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08cf400640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08d015e3e0 0x7f08d00b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08cf400640 1 -- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00d27b0 msgr2=0x7f08d00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08cf400640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00d27b0 0x7f08d00c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08cf400640 1 -- 172.21.15.7:0/1531183049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d00c80e0 con 0x7f08d00b4860 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08cf400640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08d00b4860 0x7f08d01f6780 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c410 tx=0x7f08c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08c7400640 1 -- 172.21.15.7:0/1531183049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0017070 con 0x7f08d00b4860 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08c7400640 1 -- 172.21.15.7:0/1531183049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c0005ce0 con 0x7f08d00b4860 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08c7400640 1 -- 172.21.15.7:0/1531183049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c00072f0 con 0x7f08d00b4860 2024-08-19T00:48:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d00c83c0 con 0x7f08d00b4860 2024-08-19T00:48:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.261+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d00c8980 con 0x7f08d00b4860 2024-08-19T00:48:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.263+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d00d2c00 con 0x7f08d00b4860 2024-08-19T00:48:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.263+0000 7f08c7400640 1 -- 172.21.15.7:0/1531183049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08c001a070 con 0x7f08d00b4860 2024-08-19T00:48:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.265+0000 7f08c7400640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08b006be30 0x7f08b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.265+0000 7f08c7400640 1 -- 172.21.15.7:0/1531183049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 8805+0+0 (secure 0 0 0) 0x7f08c008afe0 con 0x7f08d00b4860 2024-08-19T00:48:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.265+0000 7f08cea00640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08b006be30 0x7f08b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.266+0000 7f08cea00640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08b006be30 0x7f08b006e2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f08d015c5b0 tx=0x7f08bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.269+0000 7f08c7400640 1 -- 172.21.15.7:0/1531183049 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f08c0058d80 con 0x7f08d00b4860 2024-08-19T00:48:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.489+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f08d0063140 con 0x7f08d00b4860 2024-08-19T00:48:10.493 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:10.490+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:48:10.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.492+0000 7f08c7400640 1 -- 172.21.15.7:0/1531183049 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v316) ==== 161+0+0 (secure 0 0 0) 0x7f08c0058680 con 0x7f08d00b4860 2024-08-19T00:48:10.495 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:48:10.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08b006be30 msgr2=0x7f08b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08b006be30 0x7f08b006e2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f08d015c5b0 tx=0x7f08bc009040 comp rx=0 tx=0).stop 2024-08-19T00:48:10.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08d00b4860 msgr2=0x7f08d01f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08d00b4860 0x7f08d01f6780 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c410 tx=0x7f08c000c8d0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 shutdown_connections 2024-08-19T00:48:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f08b006be30 0x7f08b006e2f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08d015e3e0 0x7f08d00b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08d00d27b0 0x7f08d00c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 --2- 172.21.15.7:0/1531183049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08d00b4860 0x7f08d01f6780 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.496+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 >> 172.21.15.7:0/1531183049 conn(0x7f08d008dbe0 msgr2=0x7f08d00b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.497+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 shutdown_connections 2024-08-19T00:48:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.497+0000 7f08d5000640 1 -- 172.21.15.7:0/1531183049 wait complete. 2024-08-19T00:48:10.502 INFO:tasks.ceph.mds.a.smithi007.stderr: -1781> 2024-08-19T00:48:00.966+0000 7effa4400640 -1 mds.0.openfiles _load_finish: corrupted header/values: End of buffer [buffer:2] 2024-08-19T00:48:10.504 INFO:tasks.ceph.mds.a.smithi007.stderr: -526> 2024-08-19T00:48:08.957+0000 7effa9400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:10.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:48:10.546 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:48:10.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.673+0000 7f8a6e600640 1 Processor -- start 2024-08-19T00:48:10.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.673+0000 7f8a6e600640 1 -- start start 2024-08-19T00:48:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.674+0000 7f8a6e600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8a680d12a0 0x7f8a68169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.674+0000 7f8a6e600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6815ec30 con 0x7f8a6809b730 2024-08-19T00:48:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.674+0000 7f8a6e600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6815ef10 con 0x7f8a6809aa70 2024-08-19T00:48:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.674+0000 7f8a6e600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6815f1f0 con 0x7f8a680d12a0 2024-08-19T00:48:10.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.675+0000 7f8a67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8a680d12a0 0x7f8a68169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.675+0000 7f8a67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8a680d12a0 0x7f8a68169290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46722/0 (socket says 172.21.15.7:46722) 2024-08-19T00:48:10.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.675+0000 7f8a67e00640 1 -- 172.21.15.7:0/3182105303 learned_addr learned my addr 172.21.15.7:0/3182105303 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.675+0000 7f8a67e00640 1 -- 172.21.15.7:0/3182105303 >> v1:172.21.15.162:6789/0 conn(0x7f8a6809aa70 legacy=0x7f8a6809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.675+0000 7f8a67e00640 1 -- 172.21.15.7:0/3182105303 >> v1:172.21.15.7:6789/0 conn(0x7f8a6809b730 legacy=0x7f8a6806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.675+0000 7f8a67e00640 1 -- 172.21.15.7:0/3182105303 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6815f4d0 con 0x7f8a680d12a0 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.675+0000 7f8a66000640 1 -- 172.21.15.7:0/3182105303 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623959078 0 0) 0x7f8a6815ec30 con 0x7f8a6809b730 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.676+0000 7f8a67e00640 1 --2- 172.21.15.7:0/3182105303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a680d12a0 0x7f8a68169290 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009e50 tx=0x7f8a6002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4969de09653a5d26 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.676+0000 7f8a66000640 1 -- 172.21.15.7:0/3182105303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60036070 con 0x7f8a680d12a0 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.676+0000 7f8a66000640 1 -- 172.21.15.7:0/3182105303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a60031600 con 0x7f8a680d12a0 2024-08-19T00:48:10.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a66000640 1 -- 172.21.15.7:0/3182105303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a600319f0 con 0x7f8a680d12a0 2024-08-19T00:48:10.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a6e600640 1 -- 172.21.15.7:0/3182105303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a680d12a0 msgr2=0x7f8a68169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a6e600640 1 --2- 172.21.15.7:0/3182105303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a680d12a0 0x7f8a68169290 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009e50 tx=0x7f8a6002a7c0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a6e600640 1 -- 172.21.15.7:0/3182105303 shutdown_connections 2024-08-19T00:48:10.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a6e600640 1 --2- 172.21.15.7:0/3182105303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a680d12a0 0x7f8a68169290 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a6e600640 1 -- 172.21.15.7:0/3182105303 >> 172.21.15.7:0/3182105303 conn(0x7f8a680d2190 msgr2=0x7f8a680d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a6e600640 1 -- 172.21.15.7:0/3182105303 shutdown_connections 2024-08-19T00:48:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.677+0000 7f8a6e600640 1 -- 172.21.15.7:0/3182105303 wait complete. 2024-08-19T00:48:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.679+0000 7f8a6e600640 1 Processor -- start 2024-08-19T00:48:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.679+0000 7f8a6e600640 1 -- start start 2024-08-19T00:48:10.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a6e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a6809aa70 0x7f8a680c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a6e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a6809b730 0x7f8a680b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a6e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a680d12a0 0x7f8a680ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a6e600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68169950 con 0x7f8a6809b730 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a6e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681697d0 con 0x7f8a6809aa70 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a6e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a68169ad0 con 0x7f8a680d12a0 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a6809b730 0x7f8a680b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a6809b730 0x7f8a680b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46726/0 (socket says 172.21.15.7:46726) 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a66a00640 1 -- 172.21.15.7:0/950479655 learned_addr learned my addr 172.21.15.7:0/950479655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a67400640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a6809aa70 0x7f8a680c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.680+0000 7f8a67e00640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a680d12a0 0x7f8a680ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a66a00640 1 -- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a680d12a0 msgr2=0x7f8a680ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a66a00640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a680d12a0 0x7f8a680ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a66a00640 1 -- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a6809aa70 msgr2=0x7f8a680c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a66a00640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a6809aa70 0x7f8a680c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:10.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a66a00640 1 -- 172.21.15.7:0/950479655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a68151860 con 0x7f8a6809b730 2024-08-19T00:48:10.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a66a00640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a6809b730 0x7f8a680b5810 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c3c0 tx=0x7f8a5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:10.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a5f400640 1 -- 172.21.15.7:0/950479655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54017070 con 0x7f8a6809b730 2024-08-19T00:48:10.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a5f400640 1 -- 172.21.15.7:0/950479655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a540035f0 con 0x7f8a6809b730 2024-08-19T00:48:10.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a680b73d0 con 0x7f8a6809b730 2024-08-19T00:48:10.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a5f400640 1 -- 172.21.15.7:0/950479655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540039e0 con 0x7f8a6809b730 2024-08-19T00:48:10.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.681+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a680b7990 con 0x7f8a6809b730 2024-08-19T00:48:10.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.683+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6809ae50 con 0x7f8a6809b730 2024-08-19T00:48:10.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.683+0000 7f8a5f400640 1 -- 172.21.15.7:0/950479655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a5401a070 con 0x7f8a6809b730 2024-08-19T00:48:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.684+0000 7f8a5f400640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4806be30 0x7f8a4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.684+0000 7f8a5f400640 1 -- 172.21.15.7:0/950479655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8891+0+0 (secure 0 0 0) 0x7f8a5408ada0 con 0x7f8a6809b730 2024-08-19T00:48:10.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.685+0000 7f8a67400640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4806be30 0x7f8a4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:10.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.685+0000 7f8a67400640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4806be30 0x7f8a4806e2f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000f60 tx=0x7f8a58009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:10.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.689+0000 7f8a5f400640 1 -- 172.21.15.7:0/950479655 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8a68151860 con 0x7f8a6809b730 2024-08-19T00:48:10.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:10.941+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f8a68063150 con 0x7f8a6809b730 2024-08-19T00:48:11.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.494+0000 7f8a5f400640 1 -- 172.21.15.7:0/950479655 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v317) ==== 107+0+0 (secure 0 0 0) 0x7f8a540584d0 con 0x7f8a6809b730 2024-08-19T00:48:11.497 INFO:teuthology.orchestra.run.smithi007.stderr:nothing to do: rank is not damaged 2024-08-19T00:48:11.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4806be30 msgr2=0x7f8a4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4806be30 0x7f8a4806e2f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000f60 tx=0x7f8a58009040 comp rx=0 tx=0).stop 2024-08-19T00:48:11.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a6809b730 msgr2=0x7f8a680b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a6809b730 0x7f8a680b5810 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c3c0 tx=0x7f8a5400c880 comp rx=0 tx=0).stop 2024-08-19T00:48:11.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 shutdown_connections 2024-08-19T00:48:11.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f8a4806be30 0x7f8a4806e2f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a680d12a0 0x7f8a680ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a6809b730 0x7f8a680b5810 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 --2- 172.21.15.7:0/950479655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a6809aa70 0x7f8a680c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 >> 172.21.15.7:0/950479655 conn(0x7f8a680d2190 msgr2=0x7f8a6806dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:11.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.497+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 shutdown_connections 2024-08-19T00:48:11.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.498+0000 7f8a6e600640 1 -- 172.21.15.7:0/950479655 wait complete. 2024-08-19T00:48:11.519 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:48:11.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.635+0000 7fcdeb91bf40 1 Processor -- start 2024-08-19T00:48:11.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.635+0000 7fcdeb91bf40 1 -- start start 2024-08-19T00:48:11.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcdeb91bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a5b0 0x563f58856e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcdeb91bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f5885a990 0x563f588e4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcdeb91bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f588728d0 0x563f58901b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcdeb91bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f589000a0 con 0x563f5885a990 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcdeb91bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563f588ffdc0 con 0x563f588728d0 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcdeb91bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563f58900380 con 0x563f5885a5b0 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcde7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f5885a990 0x563f588e4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcde7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f5885a990 0x563f588e4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46744/0 (socket says 172.21.15.7:46744) 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcde7600640 1 -- 172.21.15.7:0/1980786856 learned_addr learned my addr 172.21.15.7:0/1980786856 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcde8000640 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a5b0 0x563f58856e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.636+0000 7fcde8a00640 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f588728d0 0x563f58901b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde7600640 1 -- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a5b0 msgr2=0x563f58856e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:11.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde7600640 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a5b0 0x563f58856e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde7600640 1 -- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f588728d0 msgr2=0x563f58901b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:11.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde7600640 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f588728d0 0x563f58901b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde7600640 1 -- 172.21.15.7:0/1980786856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5875d130 con 0x563f5885a990 2024-08-19T00:48:11.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde8a00640 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f588728d0 0x563f58901b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde7600640 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f5885a990 0x563f588e4280 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4045b60 tx=0x7fcdd4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1100ab3045143d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde6200640 1 -- 172.21.15.7:0/1980786856 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40517e0 con 0x563f5885a990 2024-08-19T00:48:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde6200640 1 -- 172.21.15.7:0/1980786856 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4051980 con 0x563f5885a990 2024-08-19T00:48:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.637+0000 7fcde6200640 1 -- 172.21.15.7:0/1980786856 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4051d50 con 0x563f5885a990 2024-08-19T00:48:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/1980786856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f5885a990 msgr2=0x563f588e4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f5885a990 0x563f588e4280 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4045b60 tx=0x7fcdd4051000 comp rx=0 tx=0).stop 2024-08-19T00:48:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/1980786856 shutdown_connections 2024-08-19T00:48:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f588728d0 0x563f58901b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f5885a990 0x563f588e4280 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/1980786856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a5b0 0x563f58856e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/1980786856 >> 172.21.15.7:0/1980786856 conn(0x563f588574e0 msgr2=0x563f58827e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/1980786856 shutdown_connections 2024-08-19T00:48:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.638+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/1980786856 wait complete. 2024-08-19T00:48:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.639+0000 7fcdeb91bf40 1 Processor -- start 2024-08-19T00:48:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.639+0000 7fcdeb91bf40 1 -- start start 2024-08-19T00:48:11.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcdeb91bf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5885a5b0 0x563f588fe350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcdeb91bf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a990 0x563f5886cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcdeb91bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f588728d0 0x563f588fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcdeb91bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f588fe900 con 0x563f588728d0 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcdeb91bf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563f588fee00 con 0x563f5885a5b0 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcdeb91bf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x563f588554e0 con 0x563f5885a990 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f588728d0 0x563f588fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f588728d0 0x563f588fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46750/0 (socket says 172.21.15.7:46750) 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 learned_addr learned my addr 172.21.15.7:0/511808995 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde7600640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a990 0x563f5886cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8000640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5885a5b0 0x563f588fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a990 msgr2=0x563f5886cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5885a990 0x563f5886cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5885a5b0 msgr2=0x563f588fe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5885a5b0 0x563f588fe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.640+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f58753b30 con 0x563f588728d0 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.641+0000 7fcde8a00640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f588728d0 0x563f588fd100 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fcde000b4b0 tx=0x7fcde000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.641+0000 7fcde4e00640 1 -- 172.21.15.7:0/511808995 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0016020 con 0x563f588728d0 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.641+0000 7fcde4e00640 1 -- 172.21.15.7:0/511808995 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde0012720 con 0x563f588728d0 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.641+0000 7fcde4e00640 1 -- 172.21.15.7:0/511808995 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0012af0 con 0x563f588728d0 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.641+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f58790080 con 0x563f588728d0 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.641+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f58858a20 con 0x563f588728d0 2024-08-19T00:48:11.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.643+0000 7fcde4e00640 1 -- 172.21.15.7:0/511808995 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcde0019020 con 0x563f588728d0 2024-08-19T00:48:11.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.644+0000 7fcde4e00640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcdc806a810 0x7fcdc806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.644+0000 7fcde4e00640 1 -- 172.21.15.7:0/511808995 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8891+0+0 (secure 0 0 0) 0x7fcde008ac10 con 0x563f588728d0 2024-08-19T00:48:11.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.644+0000 7fcde8000640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcdc806a810 0x7fcdc806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.651 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:48:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.644+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563f5886d4f0 0x563f588fdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.644+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f5886eee0 con 0x563f5886d4f0 2024-08-19T00:48:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.645+0000 7fcde8000640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcdc806a810 0x7fcdc806ccd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8005fd0 tx=0x7fcdd800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.645+0000 7fcde7600640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563f5886d4f0 0x563f588fdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.646+0000 7fcde7600640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563f5886d4f0 0x563f588fdb50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.648+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v123'1128 uv1102 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.648+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f5886ba70 con 0x563f5886d4f0 2024-08-19T00:48:11.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.650+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v123'1129 uv1129 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.650+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f5886bed0 con 0x563f5886d4f0 2024-08-19T00:48:11.655 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:48:11.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.652+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v123'1130 uv1130 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.652+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f5886c270 con 0x563f5886d4f0 2024-08-19T00:48:11.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.653+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v123'1131 uv1131 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.653+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f5886c670 con 0x563f5886d4f0 2024-08-19T00:48:11.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.655+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v123'1132 uv1132 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.655+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2390 con 0x563f5886d4f0 2024-08-19T00:48:11.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.657+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v123'1133 uv1133 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.657+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.658+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v123'1134 uv1108 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.658+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.660+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v123'1135 uv1135 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.660+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.664 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:48:11.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.662+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v123'1136 uv1136 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.662+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3740 con 0x563f5886d4f0 2024-08-19T00:48:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.663+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v123'1137 uv1137 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.663+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3740 con 0x563f5886d4f0 2024-08-19T00:48:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.665+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v123'1138 uv1138 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.665+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.666+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v123'1139 uv1139 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.667+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.668+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v123'1140 uv1115 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.668+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.670+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v123'1141 uv1141 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.670+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.672+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v123'1142 uv1142 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.675 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:48:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.672+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3740 con 0x563f5886d4f0 2024-08-19T00:48:11.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.673+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v123'1143 uv1143 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.673+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3740 con 0x563f5886d4f0 2024-08-19T00:48:11.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.675+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v123'1144 uv1144 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.675+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2730 con 0x563f5886d4f0 2024-08-19T00:48:11.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.676+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v123'1145 uv1145 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.676+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.678+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v123'1146 uv1146 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.678+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.680+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v123'1147 uv1121 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.680+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.681+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v123'1148 uv1148 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.681+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.683+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v123'1149 uv1149 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.686 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:48:11.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.683+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3eb0 con 0x563f5886d4f0 2024-08-19T00:48:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.685+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v123'1150 uv1150 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.685+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3eb0 con 0x563f5886d4f0 2024-08-19T00:48:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.686+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v123'1151 uv1151 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.686+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.688+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v123'1152 uv1152 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.688+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.690+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v123'1153 uv1127 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.690+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.691+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v123'1154 uv1154 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.691+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.693+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v123'1155 uv1155 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.696 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:48:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.693+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3eb0 con 0x563f5886d4f0 2024-08-19T00:48:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.695+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v123'1156 uv1156 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.695+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a3eb0 con 0x563f5886d4f0 2024-08-19T00:48:11.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.696+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v123'1157 uv1157 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.696+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a2ea0 con 0x563f5886d4f0 2024-08-19T00:48:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.698+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v123'1158 uv1158 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.698+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563f589a33b0 0x563f589a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.698+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a5ce0 con 0x563f589a33b0 2024-08-19T00:48:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.698+0000 7fcde8000640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563f589a33b0 0x563f589a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.699+0000 7fcde8000640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563f589a33b0 0x563f589a57a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.701+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v123'824 uv803 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.701+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a6080 con 0x563f589a33b0 2024-08-19T00:48:11.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.702+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v123'825 uv825 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.702+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a6420 con 0x563f589a33b0 2024-08-19T00:48:11.706 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:48:11.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.704+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v123'826 uv826 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.704+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a67c0 con 0x563f589a33b0 2024-08-19T00:48:11.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.705+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v123'827 uv827 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.705+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a6b60 con 0x563f589a33b0 2024-08-19T00:48:11.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.707+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v123'828 uv828 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.707+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a6f00 con 0x563f589a33b0 2024-08-19T00:48:11.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.708+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v123'829 uv822 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.708+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a72a0 con 0x563f589a33b0 2024-08-19T00:48:11.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.710+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v123'830 uv830 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.710+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.713 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:48:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.711+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v123'831 uv831 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.711+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.713+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v123'832 uv832 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.713+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.714+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v123'833 uv833 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.714+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.716+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v123'834 uv823 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.716+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.717+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v123'835 uv835 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.717+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.721 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:48:11.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.719+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v123'836 uv836 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.719+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589abd30 con 0x563f589a33b0 2024-08-19T00:48:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.721+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v123'837 uv837 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.721+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589abd30 con 0x563f589a33b0 2024-08-19T00:48:11.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.722+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v123'838 uv838 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.722+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.724+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v123'839 uv819 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.724+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.725+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v123'840 uv840 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.725+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.729 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:48:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.727+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v123'841 uv841 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.727+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a8650 con 0x563f589a33b0 2024-08-19T00:48:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.728+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v123'842 uv842 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.728+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a8650 con 0x563f589a33b0 2024-08-19T00:48:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.730+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v123'843 uv843 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.730+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589a7640 con 0x563f589a33b0 2024-08-19T00:48:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.731+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v123'844 uv844 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589a33b0 2024-08-19T00:48:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.731+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563f589a7cc0 0x563f589aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.731+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589aa5f0 con 0x563f589a7cc0 2024-08-19T00:48:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.732+0000 7fcde7600640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563f589a7cc0 0x563f589aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.732+0000 7fcde7600640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563f589a7cc0 0x563f589aa0b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.734+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v123'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.734+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589aa6b0 con 0x563f589a7cc0 2024-08-19T00:48:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.735+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v123'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.735+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589aaaa0 con 0x563f589a7cc0 2024-08-19T00:48:11.739 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:48:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.736+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v123'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.736+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589abab0 con 0x563f589a7cc0 2024-08-19T00:48:11.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.737+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v123'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.737+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589abab0 con 0x563f589a7cc0 2024-08-19T00:48:11.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.739+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v123'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.739+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589aaaa0 con 0x563f589a7cc0 2024-08-19T00:48:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.740+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v123'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.740+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589aaaa0 con 0x563f5886d4f0 2024-08-19T00:48:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.742+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v123'167 uv166 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.742+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589aaaa0 con 0x563f5886d4f0 2024-08-19T00:48:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.744+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v123'168 uv168 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.744+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589aaaa0 con 0x563f5886d4f0 2024-08-19T00:48:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.745+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v123'169 uv169 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.748 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:48:11.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.745+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589aaaa0 con 0x563f5886d4f0 2024-08-19T00:48:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.747+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v123'170 uv170 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.747+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563f589ab120 0x563f589ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.747+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589adb20 con 0x563f589ab120 2024-08-19T00:48:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.747+0000 7fcde8a00640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563f589ab120 0x563f589ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.748+0000 7fcde8a00640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563f589ab120 0x563f589ad510 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.749+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v123'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.749+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589adfa0 con 0x563f589ab120 2024-08-19T00:48:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.751+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v123'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.751+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589ae450 con 0x563f589ab120 2024-08-19T00:48:11.754 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:48:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.752+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v123'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.752+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589afd00 con 0x563f589ab120 2024-08-19T00:48:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.753+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v123'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.753+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b00a0 con 0x563f589ab120 2024-08-19T00:48:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.755+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v123'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.755+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589aecf0 con 0x563f589ab120 2024-08-19T00:48:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.756+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v123'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.756+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563f589af5f0 0x563f589b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.756+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2990 con 0x563f589af5f0 2024-08-19T00:48:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.756+0000 7fcde8000640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563f589af5f0 0x563f589b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.757+0000 7fcde8000640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563f589af5f0 0x563f589b2450 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.759+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v123'404 uv398 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.759+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2990 con 0x563f589af5f0 2024-08-19T00:48:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.760+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v123'405 uv405 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.760+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2a10 con 0x563f589af5f0 2024-08-19T00:48:11.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.762+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v123'406 uv406 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.764 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:48:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.762+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b3e40 con 0x563f589af5f0 2024-08-19T00:48:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.763+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v123'407 uv407 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.763+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b3e40 con 0x563f589af5f0 2024-08-19T00:48:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.765+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v123'408 uv408 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.765+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2e30 con 0x563f589af5f0 2024-08-19T00:48:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.766+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v123'409 uv409 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.766+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2e30 con 0x563f589af5f0 2024-08-19T00:48:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.768+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v123'410 uv403 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.768+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2e30 con 0x563f589af5f0 2024-08-19T00:48:11.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.769+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v123'411 uv411 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.769+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2e30 con 0x563f589af5f0 2024-08-19T00:48:11.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.770+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v123'412 uv412 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.773 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:48:11.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.771+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2e30 con 0x563f589af5f0 2024-08-19T00:48:11.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.772+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v123'413 uv413 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.772+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b2e30 con 0x563f589af5f0 2024-08-19T00:48:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.774+0000 7fcde8000640 1 -- 172.21.15.7:0/511808995 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v123'414 uv414 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd8006a00 con 0x563f589af5f0 2024-08-19T00:48:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.774+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563f589b3340 0x563f589b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.774+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b5d90 con 0x563f589b3340 2024-08-19T00:48:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.774+0000 7fcde7600640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563f589b3340 0x563f589b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.774+0000 7fcde7600640 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563f589b3340 0x563f589b5730 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:11.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.776+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v123'183 uv182 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.776+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b5d90 con 0x563f589b3340 2024-08-19T00:48:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.777+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v123'184 uv184 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.777+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589b3340 2024-08-19T00:48:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.778+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v123'185 uv185 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.781 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:48:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.779+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589b3340 2024-08-19T00:48:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.780+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v123'186 uv186 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.780+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589b3340 2024-08-19T00:48:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.781+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v123'187 uv187 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.781+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f5886d4f0 2024-08-19T00:48:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.783+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v123'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.783+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f5886d4f0 2024-08-19T00:48:11.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.784+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v123'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.784+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f5886d4f0 2024-08-19T00:48:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.785+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v123'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.788 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:48:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.785+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b7210 con 0x563f5886d4f0 2024-08-19T00:48:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.786+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v123'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.786+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b7210 con 0x563f5886d4f0 2024-08-19T00:48:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.787+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v123'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.787+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f5886d4f0 2024-08-19T00:48:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.789+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v123'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f5886d4f0 2024-08-19T00:48:11.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.789+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.790+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v123'365 uv359 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.791+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.792+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v123'366 uv366 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.792+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.793+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v123'367 uv367 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.797 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:48:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.794+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.795+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v123'368 uv368 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.795+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.796+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v123'369 uv369 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.796+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.798+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v123'370 uv364 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.798+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.799+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v123'371 uv371 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.799+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.801+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v123'372 uv372 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.804 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:48:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.801+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6200 con 0x563f589a7cc0 2024-08-19T00:48:11.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.802+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v123'373 uv373 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.803+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b9010 con 0x563f589a7cc0 2024-08-19T00:48:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.804+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v123'374 uv374 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589a7cc0 2024-08-19T00:48:11.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.804+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b66b0 con 0x563f589ab120 2024-08-19T00:48:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.806+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v123'162 uv160 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.806+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589ab120 2024-08-19T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.808+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v123'163 uv163 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.808+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589ab120 2024-08-19T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:48:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.809+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v123'164 uv164 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.809+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589ab120 2024-08-19T00:48:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.810+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v123'165 uv165 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.810+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589ab120 2024-08-19T00:48:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.812+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v123'219 uv218 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.812+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589ab120 2024-08-19T00:48:11.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.813+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v123'220 uv220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.813+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589ab120 2024-08-19T00:48:11.926 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:48:11.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.815+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v123'221 uv221 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.815+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b7a60 con 0x563f589ab120 2024-08-19T00:48:11.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.816+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v123'222 uv222 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.816+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b7a60 con 0x563f589ab120 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.818+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v123'223 uv223 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.818+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589ab120 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.819+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v123'224 uv224 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcde0022070 con 0x563f589ab120 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.820+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.821+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v123'186 uv185 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.821+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.822+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v123'187 uv187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.822+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.928 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.823+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v123'188 uv188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.824+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.825+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v123'189 uv189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.825+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.826+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v123'190 uv190 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.826+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.828+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v123'455 uv446 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.828+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.829+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v123'456 uv456 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.829+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.931 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:48:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.830+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v123'457 uv457 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.831+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.832+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v123'458 uv458 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.832+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.833+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v123'459 uv459 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.833+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.834+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v123'460 uv453 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.835+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.836+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v123'461 uv461 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.836+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.933 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.837+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v123'462 uv462 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.837+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.839+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v123'463 uv463 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.839+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.840+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v123'464 uv464 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.840+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b6a50 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.841+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v123'465 uv465 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.841+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x563f589b72c0 con 0x563f589b3340 2024-08-19T00:48:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.842+0000 7fcde7600640 1 -- 172.21.15.7:0/511808995 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v123'466 uv466 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fcdd4057030 con 0x563f589b3340 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.842+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563f589a33b0 msgr2=0x563f589a57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.842+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x563f589a33b0 0x563f589a57a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.842+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563f589af5f0 msgr2=0x563f589b2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.842+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x563f589af5f0 0x563f589b2450 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563f589b3340 msgr2=0x563f589b5730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x563f589b3340 0x563f589b5730 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563f589a7cc0 msgr2=0x563f589aa0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x563f589a7cc0 0x563f589aa0b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 reap_dead start 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563f5886d4f0 msgr2=0x563f588fdb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x563f5886d4f0 0x563f588fdb50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcde8a00640 1 -- 172.21.15.7:0/511808995 reap_dead start 2024-08-19T00:48:11.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563f589ab120 msgr2=0x563f589ad510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563f589ab120 0x563f589ad510 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcdc806a810 msgr2=0x7fcdc806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcdc806a810 0x7fcdc806ccd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8005fd0 tx=0x7fcdd800b040 comp rx=0 tx=0).stop 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f588728d0 msgr2=0x563f588fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f588728d0 0x563f588fd100 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fcde000b4b0 tx=0x7fcde000b970 comp rx=0 tx=0).stop 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 shutdown_connections 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcdc806a810 0x7fcdc806ccd0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f588728d0 0x563f588fd100 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 --2- 172.21.15.7:0/511808995 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x563f589ab120 0x563f589ad510 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 >> 172.21.15.7:0/511808995 conn(0x563f588574e0 msgr2=0x563f58901b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:11.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 shutdown_connections 2024-08-19T00:48:11.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:11.843+0000 7fcdeb91bf40 1 -- 172.21.15.7:0/511808995 wait complete. 2024-08-19T00:48:11.940 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 100.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:48:12.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.052+0000 7f4ab805cf40 1 Processor -- start 2024-08-19T00:48:12.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.052+0000 7f4ab805cf40 1 -- start start 2024-08-19T00:48:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab805cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c0f40 0x55f9283be690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab805cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92838f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab805cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c2990 0x55f92838fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab805cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f9283c18f0 con 0x55f9283c0f40 2024-08-19T00:48:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab805cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f928336d00 con 0x55f9283c2990 2024-08-19T00:48:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab805cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f928467dc0 con 0x55f9283c25b0 2024-08-19T00:48:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c0f40 0x55f9283be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4aafe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92838f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c0f40 0x55f9283be690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46760/0 (socket says 172.21.15.7:46760) 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab5200640 1 -- 172.21.15.7:0/622092043 learned_addr learned my addr 172.21.15.7:0/622092043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4ab5c00640 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c2990 0x55f92838fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4aafe00640 1 -- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c2990 msgr2=0x55f92838fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4aafe00640 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c2990 0x55f92838fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4aafe00640 1 -- 172.21.15.7:0/622092043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c0f40 msgr2=0x55f9283be690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4aafe00640 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c0f40 0x55f9283be690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.053+0000 7f4aafe00640 1 -- 172.21.15.7:0/622092043 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9282bbb30 con 0x55f9283c25b0 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.054+0000 7f4aafe00640 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92838f640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001e50 tx=0x7f4aa000b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4bc1edf223063c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.054+0000 7f4aaea00640 1 -- 172.21.15.7:0/622092043 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0008070 con 0x55f9283c25b0 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.054+0000 7f4aaea00640 1 -- 172.21.15.7:0/622092043 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa000d500 con 0x55f9283c25b0 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.054+0000 7f4aaea00640 1 -- 172.21.15.7:0/622092043 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000d8f0 con 0x55f9283c25b0 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.054+0000 7f4ab805cf40 1 -- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 msgr2=0x55f92838f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.054+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92838f640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001e50 tx=0x7f4aa000b6a0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 -- 172.21.15.7:0/622092043 shutdown_connections 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c2990 0x55f92838fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92838f640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/622092043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c0f40 0x55f9283be690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 -- 172.21.15.7:0/622092043 >> 172.21.15.7:0/622092043 conn(0x55f9283bf4e0 msgr2=0x55f9283bf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 -- 172.21.15.7:0/622092043 shutdown_connections 2024-08-19T00:48:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 -- 172.21.15.7:0/622092043 wait complete. 2024-08-19T00:48:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 Processor -- start 2024-08-19T00:48:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.055+0000 7f4ab805cf40 1 -- start start 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.056+0000 7f4ab805cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c0f40 0x55f92844a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.056+0000 7f4ab805cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92845fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.056+0000 7f4ab805cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c2990 0x55f928460100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.056+0000 7f4ab805cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f928469af0 con 0x55f9283c2990 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.056+0000 7f4ab805cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f928469810 con 0x55f9283c0f40 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.056+0000 7f4ab805cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55f9283dc370 con 0x55f9283c25b0 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c2990 0x55f928460100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c2990 0x55f928460100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46772/0 (socket says 172.21.15.7:46772) 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 -- 172.21.15.7:0/64270413 learned_addr learned my addr 172.21.15.7:0/64270413 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5200640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c0f40 0x55f92844a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4aafe00640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92845fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 -- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 msgr2=0x55f92845fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f9283c25b0 0x55f92845fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 -- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c0f40 msgr2=0x55f92844a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9283c0f40 0x55f92844a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 -- 172.21.15.7:0/64270413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9282f8080 con 0x55f9283c2990 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.057+0000 7f4ab5c00640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c2990 0x55f928460100 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00108b0 tx=0x7f4ab0010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.058+0000 7f4aad600640 1 -- 172.21.15.7:0/64270413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0019070 con 0x55f9283c2990 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.058+0000 7f4aad600640 1 -- 172.21.15.7:0/64270413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab000e9b0 con 0x55f9283c2990 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.058+0000 7f4aad600640 1 -- 172.21.15.7:0/64270413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000ed80 con 0x55f9283c2990 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.058+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f92844a710 con 0x55f9283c2990 2024-08-19T00:48:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.058+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92845efe0 con 0x55f9283c2990 2024-08-19T00:48:12.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.060+0000 7f4aad600640 1 -- 172.21.15.7:0/64270413 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ab0011040 con 0x55f9283c2990 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.060+0000 7f4aad600640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a9406a810 0x7f4a9406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.061+0000 7f4aad600640 1 -- 172.21.15.7:0/64270413 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8891+0+0 (secure 0 0 0) 0x7f4ab008ace0 con 0x55f9283c2990 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.061+0000 7f4ab5200640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a9406a810 0x7f4a9406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.061+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f928464c50 0x55f928465030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.061+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) -- 0x55f928465570 con 0x55f928464c50 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.061+0000 7f4aafe00640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f928464c50 0x55f928465030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.062+0000 7f4ab5200640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a9406a810 0x7f4a9406ccd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa8056040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.062+0000 7f4aafe00640 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f928464c50 0x55f928465030 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4aafe00640 1 -- 172.21.15.7:0/64270413 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 100.00000000 [omap-set-header] v123'375 uv375 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f4aa000d6b0 con 0x55f928464c50 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f928464c50 msgr2=0x55f928465030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55f928464c50 0x55f928465030 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a9406a810 msgr2=0x7f4a9406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a9406a810 0x7f4a9406ccd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa8056040 comp rx=0 tx=0).stop 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c2990 msgr2=0x55f928460100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 --2- 172.21.15.7:0/64270413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f9283c2990 0x55f928460100 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00108b0 tx=0x7f4ab0010d70 comp rx=0 tx=0).stop 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab5c00640 1 -- 172.21.15.7:0/64270413 reap_dead start 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 shutdown_connections 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 >> 172.21.15.7:0/64270413 conn(0x55f9283bf4e0 msgr2=0x55f9283db940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 shutdown_connections 2024-08-19T00:48:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.064+0000 7f4ab805cf40 1 -- 172.21.15.7:0/64270413 wait complete. 2024-08-19T00:48:12.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:48:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.228+0000 7ff92d400640 1 Processor -- start 2024-08-19T00:48:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.228+0000 7ff92d400640 1 -- start start 2024-08-19T00:48:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.229+0000 7ff92d400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff928161c90 0x7ff9280cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.229+0000 7ff92d400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9280d2c10 0x7ff92806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.229+0000 7ff92d400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92806e750 con 0x7ff92806e330 2024-08-19T00:48:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.229+0000 7ff92d400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff9280d0110 con 0x7ff9280d2c10 2024-08-19T00:48:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.229+0000 7ff92d400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9280cf500 con 0x7ff928161c90 2024-08-19T00:48:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff927200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9280d2c10 0x7ff92806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff925e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff92806e330 0x7ff9280d2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36104/0 (socket says 172.21.15.7:36104) 2024-08-19T00:48:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff925e00640 1 -- 172.21.15.7:0/14978712 learned_addr learned my addr 172.21.15.7:0/14978712 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff926800640 1 --2- 172.21.15.7:0/14978712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff928161c90 0x7ff9280cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff927200640 1 -- 172.21.15.7:0/14978712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff928161c90 msgr2=0x7ff9280cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff927200640 1 --2- 172.21.15.7:0/14978712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff928161c90 0x7ff9280cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff927200640 1 -- 172.21.15.7:0/14978712 >> v1:172.21.15.7:6789/0 conn(0x7ff92806e330 legacy=0x7ff9280d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff927200640 1 -- 172.21.15.7:0/14978712 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9280cf7e0 con 0x7ff9280d2c10 2024-08-19T00:48:12.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.230+0000 7ff925400640 1 -- 172.21.15.7:0/14978712 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677452701 0 0) 0x7ff92806e750 con 0x7ff92806e330 2024-08-19T00:48:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.231+0000 7ff927200640 1 --2- 172.21.15.7:0/14978712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9280d2c10 0x7ff92806ca10 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7ff920009d90 tx=0x7ff92002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b099264e6ae20087 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.231+0000 7ff925400640 1 -- 172.21.15.7:0/14978712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920007740 con 0x7ff9280d2c10 2024-08-19T00:48:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.231+0000 7ff925400640 1 -- 172.21.15.7:0/14978712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9200078e0 con 0x7ff9280d2c10 2024-08-19T00:48:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.231+0000 7ff925400640 1 -- 172.21.15.7:0/14978712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920007cb0 con 0x7ff9280d2c10 2024-08-19T00:48:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 -- 172.21.15.7:0/14978712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9280d2c10 msgr2=0x7ff92806ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 --2- 172.21.15.7:0/14978712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9280d2c10 0x7ff92806ca10 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7ff920009d90 tx=0x7ff92002a660 comp rx=0 tx=0).stop 2024-08-19T00:48:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 -- 172.21.15.7:0/14978712 shutdown_connections 2024-08-19T00:48:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 --2- 172.21.15.7:0/14978712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9280d2c10 0x7ff92806ca10 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 --2- 172.21.15.7:0/14978712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff928161c90 0x7ff9280cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 -- 172.21.15.7:0/14978712 >> 172.21.15.7:0/14978712 conn(0x7ff92808c000 msgr2=0x7ff9280d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 -- 172.21.15.7:0/14978712 shutdown_connections 2024-08-19T00:48:12.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.232+0000 7ff92d400640 1 -- 172.21.15.7:0/14978712 wait complete. 2024-08-19T00:48:12.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.234+0000 7ff92d400640 1 Processor -- start 2024-08-19T00:48:12.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.234+0000 7ff92d400640 1 -- start start 2024-08-19T00:48:12.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff92d400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff92806e330 0x7ff92815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff92d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9280d2c10 0x7ff9280b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff92d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff928161c90 0x7ff9280cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff92d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff928162070 con 0x7ff928161c90 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff92d400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff9280cfda0 con 0x7ff9280d2c10 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff92d400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9281621f0 con 0x7ff92806e330 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff928161c90 0x7ff9280cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff928161c90 0x7ff9280cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46788/0 (socket says 172.21.15.7:46788) 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 -- 172.21.15.7:0/3664420391 learned_addr learned my addr 172.21.15.7:0/3664420391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff926800640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff92806e330 0x7ff92815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff925e00640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9280d2c10 0x7ff9280b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 -- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff92806e330 msgr2=0x7ff92815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff92806e330 0x7ff92815b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 -- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9280d2c10 msgr2=0x7ff9280b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9280d2c10 0x7ff9280b9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.235+0000 7ff927200640 1 -- 172.21.15.7:0/3664420391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9280cc600 con 0x7ff928161c90 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.236+0000 7ff927200640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff928161c90 0x7ff9280cbe80 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7ff920009d90 tx=0x7ff920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.236+0000 7ff91ea00640 1 -- 172.21.15.7:0/3664420391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920040070 con 0x7ff928161c90 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.236+0000 7ff91ea00640 1 -- 172.21.15.7:0/3664420391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff920031c40 con 0x7ff928161c90 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.236+0000 7ff91ea00640 1 -- 172.21.15.7:0/3664420391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920009450 con 0x7ff928161c90 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.236+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9280b73c0 con 0x7ff928161c90 2024-08-19T00:48:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.236+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9280b7980 con 0x7ff928161c90 2024-08-19T00:48:12.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.237+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9280d3300 con 0x7ff928161c90 2024-08-19T00:48:12.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.238+0000 7ff91ea00640 1 -- 172.21.15.7:0/3664420391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff920039040 con 0x7ff928161c90 2024-08-19T00:48:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.239+0000 7ff91ea00640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90806be30 0x7ff90806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.239+0000 7ff91ea00640 1 -- 172.21.15.7:0/3664420391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8891+0+0 (secure 0 0 0) 0x7ff9200acc70 con 0x7ff928161c90 2024-08-19T00:48:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.239+0000 7ff926800640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90806be30 0x7ff90806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.240+0000 7ff926800640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90806be30 0x7ff90806e2f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff918009aa0 tx=0x7ff918009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.244+0000 7ff91ea00640 1 -- 172.21.15.7:0/3664420391 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff92007a340 con 0x7ff928161c90 2024-08-19T00:48:12.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.464+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7ff9280b63e0 con 0x7ff928161c90 2024-08-19T00:48:13.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:12.998+0000 7ff91ea00640 1 -- 172.21.15.7:0/3664420391 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v318) ==== 162+0+0 (secure 0 0 0) 0x7ff92007e640 con 0x7ff928161c90 2024-08-19T00:48:13.002 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:48:13.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90806be30 msgr2=0x7ff90806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90806be30 0x7ff90806e2f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff918009aa0 tx=0x7ff918009190 comp rx=0 tx=0).stop 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff928161c90 msgr2=0x7ff9280cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff928161c90 0x7ff9280cbe80 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7ff920009d90 tx=0x7ff920004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 shutdown_connections 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff90806be30 0x7ff90806e2f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff928161c90 0x7ff9280cbe80 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9280d2c10 0x7ff9280b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 --2- 172.21.15.7:0/3664420391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff92806e330 0x7ff92815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.001+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 >> 172.21.15.7:0/3664420391 conn(0x7ff92808c000 msgr2=0x7ff9280b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.002+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 shutdown_connections 2024-08-19T00:48:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.002+0000 7ff92d400640 1 -- 172.21.15.7:0/3664420391 wait complete. 2024-08-19T00:48:13.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:13.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.182+0000 7f0cb3400640 1 Processor -- start 2024-08-19T00:48:13.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.182+0000 7f0cb3400640 1 -- start start 2024-08-19T00:48:13.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.183+0000 7f0cb3400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0cac06e710 0x7f0cac071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cb3400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac0cdfb0 con 0x7f0cac0d03c0 2024-08-19T00:48:13.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cb3400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac0ce290 con 0x7f0cac0b3750 2024-08-19T00:48:13.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cb3400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0cac0cebc0 con 0x7f0cac06e710 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cb0a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0cac0d03c0 0x7f0cac0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36116/0 (socket says 172.21.15.7:36116) 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cb0a00640 1 -- 172.21.15.7:0/2397337613 learned_addr learned my addr 172.21.15.7:0/2397337613 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cabe00640 1 --2- 172.21.15.7:0/2397337613 >> v2:172.21.15.162:3300/0 conn(0x7f0cac06e710 0x7f0cac071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530536855 0 0) 0x7f0cac0cdfb0 con 0x7f0cac0d03c0 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.184+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c94003520 con 0x7f0cac0d03c0 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1346116761 0 0) 0x7f0c94003520 con 0x7f0cac0d03c0 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 >> v2:172.21.15.162:3300/0 conn(0x7f0cac06e710 msgr2=0x7f0cac071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 --2- 172.21.15.7:0/2397337613 >> v2:172.21.15.162:3300/0 conn(0x7f0cac06e710 0x7f0cac071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 >> v1:172.21.15.162:6789/0 conn(0x7f0cac0b3750 legacy=0x7f0cac0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac0ce570 con 0x7f0cac0d03c0 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f0ca0001670 con 0x7f0cac0d03c0 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 >> v1:172.21.15.7:6789/0 conn(0x7f0cac0d03c0 legacy=0x7f0cac0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c94003a30 0x7f0c94003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0c94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c940051c0 0x7f0c9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac0cebc0 con 0x7f0c940051c0 2024-08-19T00:48:13.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9400c0f0 con 0x7f0c94004800 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9400c2f0 con 0x7f0c94003a30 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cb1400640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c940051c0 0x7f0c9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cabe00640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0c94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.185+0000 7f0cb0a00640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c94003a30 0x7f0c94003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.186+0000 7f0cabe00640 1 -- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c94003a30 msgr2=0x7f0c94003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.186+0000 7f0cabe00640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c94003a30 0x7f0c94003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.186+0000 7f0cabe00640 1 -- 172.21.15.7:0/2397337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c940051c0 msgr2=0x7f0c9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.186+0000 7f0cabe00640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c940051c0 0x7f0c9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.186+0000 7f0cabe00640 1 -- 172.21.15.7:0/2397337613 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c94003520 con 0x7f0c94004800 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.186+0000 7f0cb1400640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c940051c0 0x7f0c9400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.186+0000 7f0cb1400640 1 -- 172.21.15.7:0/2397337613 reap_dead start 2024-08-19T00:48:13.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.187+0000 7f0cabe00640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0c94004c80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009ac0 tx=0x7f0c94005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7c33e5fe75ee79e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.187+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98036070 con 0x7f0c94004800 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.187+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c98031400 con 0x7f0c94004800 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.187+0000 7f0cab400640 1 -- 172.21.15.7:0/2397337613 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98009690 con 0x7f0c94004800 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.187+0000 7f0cb3400640 1 -- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 msgr2=0x7f0c94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.187+0000 7f0cb3400640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0c94004c80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009ac0 tx=0x7f0c94005830 comp rx=0 tx=0).stop 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.188+0000 7f0cb3400640 1 -- 172.21.15.7:0/2397337613 shutdown_connections 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.188+0000 7f0cb3400640 1 --2- 172.21.15.7:0/2397337613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0c94004c80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.188+0000 7f0cb3400640 1 -- 172.21.15.7:0/2397337613 >> 172.21.15.7:0/2397337613 conn(0x7f0cac06bc70 msgr2=0x7f0cac06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.188+0000 7f0cb3400640 1 -- 172.21.15.7:0/2397337613 shutdown_connections 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.188+0000 7f0cb3400640 1 -- 172.21.15.7:0/2397337613 wait complete. 2024-08-19T00:48:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.189+0000 7f0cb3400640 1 Processor -- start 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.189+0000 7f0cb3400640 1 -- start start 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.190+0000 7f0cb3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0cac159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.190+0000 7f0cb3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cac0b2320 0x7f0cac09dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.190+0000 7f0cb3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cac1543f0 0x7f0cac154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.190+0000 7f0cb3400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac073c60 con 0x7f0cac1543f0 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.190+0000 7f0cb3400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac073ae0 con 0x7f0c94004800 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.190+0000 7f0cb3400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cac0b3be0 con 0x7f0cac0b2320 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cac1543f0 0x7f0cac154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cac1543f0 0x7f0cac154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46808/0 (socket says 172.21.15.7:46808) 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 -- 172.21.15.7:0/1986602036 learned_addr learned my addr 172.21.15.7:0/1986602036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb0a00640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0cac159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cabe00640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cac0b2320 0x7f0cac09dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 -- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cac0b2320 msgr2=0x7f0cac09dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cac0b2320 0x7f0cac09dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 -- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 msgr2=0x7f0cac159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0cac159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 -- 172.21.15.7:0/1986602036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac09e140 con 0x7f0cac1543f0 2024-08-19T00:48:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.191+0000 7f0cb1400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cac1543f0 0x7f0cac154870 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0b34d0 tx=0x7f0ca40019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.192+0000 7f0ca8c00640 1 -- 172.21.15.7:0/1986602036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca401a070 con 0x7f0cac1543f0 2024-08-19T00:48:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.192+0000 7f0ca8c00640 1 -- 172.21.15.7:0/1986602036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca4006d60 con 0x7f0cac1543f0 2024-08-19T00:48:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.192+0000 7f0ca8c00640 1 -- 172.21.15.7:0/1986602036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4001a70 con 0x7f0cac1543f0 2024-08-19T00:48:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.192+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac157330 con 0x7f0cac1543f0 2024-08-19T00:48:13.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.192+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac15c720 con 0x7f0cac1543f0 2024-08-19T00:48:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.193+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac0cdfb0 con 0x7f0cac1543f0 2024-08-19T00:48:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.194+0000 7f0ca8c00640 1 -- 172.21.15.7:0/1986602036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ca4003b90 con 0x7f0cac1543f0 2024-08-19T00:48:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.194+0000 7f0ca8c00640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.195+0000 7f0ca8c00640 1 -- 172.21.15.7:0/1986602036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 8891+0+0 (secure 0 0 0) 0x7f0ca408b250 con 0x7f0cac1543f0 2024-08-19T00:48:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.195+0000 7f0cb0a00640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:13.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.195+0000 7f0cb0a00640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000c00 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:13.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.199+0000 7f0ca8c00640 1 -- 172.21.15.7:0/1986602036 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0ca4058f70 con 0x7f0cac1543f0 2024-08-19T00:48:13.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.421+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cac0ade80 con 0x7f0cac1543f0 2024-08-19T00:48:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.421+0000 7f0ca8c00640 1 -- 172.21.15.7:0/1986602036 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 319 v319) ==== 95+0+5228 (secure 0 0 0) 0x7f0ca4058870 con 0x7f0cac1543f0 2024-08-19T00:48:13.424 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:13.424 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":319,"btime":"2024-08-19T00:48:13:002824+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":319,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:13.002808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10125":{"gid":10125,"name":"a","rank":0,"incarnation":319,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/2039068272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2039068272},{"type":"v1","addr":"172.21.15.7:6837","nonce":2039068272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:13.424 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 319 2024-08-19T00:48:13.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c8c06be30 msgr2=0x7f0c8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000c00 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cac1543f0 msgr2=0x7f0cac154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cac1543f0 0x7f0cac154870 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0b34d0 tx=0x7f0ca40019f0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 shutdown_connections 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cac1543f0 0x7f0cac154870 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cac0b2320 0x7f0cac09dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 --2- 172.21.15.7:0/1986602036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c94004800 0x7f0cac159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 >> 172.21.15.7:0/1986602036 conn(0x7f0cac06bc70 msgr2=0x7f0cac0ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 shutdown_connections 2024-08-19T00:48:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:13.424+0000 7f0cb3400640 1 -- 172.21.15.7:0/1986602036 wait complete. 2024-08-19T00:48:13.443 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:48:16.033 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:48:16.030+0000 7f99f3a00640 -1 mds.0.cache.dir(0x100) Corrupt fnode in dirfrag 0x100: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:48:16.034 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:16.031+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:48:16.034 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:16.031+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:48:16.505 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:48:16.502+0000 7f99f8a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:18.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:18.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.610+0000 7f26e2400640 1 Processor -- start 2024-08-19T00:48:18.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.610+0000 7f26e2400640 1 -- start start 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.611+0000 7f26e2400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f26dc159bf0 0x7f26dc073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.611+0000 7f26e2400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f26dc0739a0 0x7f26dc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.611+0000 7f26e2400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc06f7f0 con 0x7f26dc0cea40 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26e2400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f26dc0cee80 con 0x7f26dc159bf0 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26e2400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f26dc06f510 con 0x7f26dc0739a0 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26db400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f26dc159bf0 0x7f26dc073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26db400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f26dc159bf0 0x7f26dc073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59064/0 (socket says 172.21.15.7:59064) 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26db400640 1 -- 172.21.15.7:0/719544920 learned_addr learned my addr 172.21.15.7:0/719544920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26d3e00640 1 --2- 172.21.15.7:0/719544920 >> v2:172.21.15.162:3300/0 conn(0x7f26dc0739a0 0x7f26dc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:18.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26db400640 1 -- 172.21.15.7:0/719544920 >> v2:172.21.15.162:3300/0 conn(0x7f26dc0739a0 msgr2=0x7f26dc0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26db400640 1 --2- 172.21.15.7:0/719544920 >> v2:172.21.15.162:3300/0 conn(0x7f26dc0739a0 0x7f26dc0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26db400640 1 -- 172.21.15.7:0/719544920 >> v1:172.21.15.162:6789/0 conn(0x7f26dc0cea40 legacy=0x7f26dc0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26db400640 1 -- 172.21.15.7:0/719544920 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc072980 con 0x7f26dc159bf0 2024-08-19T00:48:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.612+0000 7f26d3e00640 1 --2- 172.21.15.7:0/719544920 >> v2:172.21.15.162:3300/0 conn(0x7f26dc0739a0 0x7f26dc0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.613+0000 7f26db400640 1 --2- 172.21.15.7:0/719544920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc073460 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0b1cc0 tx=0x7f26cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa719eeb6932914 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.613+0000 7f26daa00640 1 -- 172.21.15.7:0/719544920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc037070 con 0x7f26dc159bf0 2024-08-19T00:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26daa00640 1 -- 172.21.15.7:0/719544920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26cc032440 con 0x7f26dc159bf0 2024-08-19T00:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26daa00640 1 -- 172.21.15.7:0/719544920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc032810 con 0x7f26dc159bf0 2024-08-19T00:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 -- 172.21.15.7:0/719544920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 msgr2=0x7f26dc073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 --2- 172.21.15.7:0/719544920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc073460 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0b1cc0 tx=0x7f26cc02a1a0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 -- 172.21.15.7:0/719544920 shutdown_connections 2024-08-19T00:48:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 --2- 172.21.15.7:0/719544920 >> v2:172.21.15.162:3300/0 conn(0x7f26dc0739a0 0x7f26dc0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 --2- 172.21.15.7:0/719544920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc073460 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 -- 172.21.15.7:0/719544920 >> 172.21.15.7:0/719544920 conn(0x7f26dc06bc70 msgr2=0x7f26dc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 -- 172.21.15.7:0/719544920 shutdown_connections 2024-08-19T00:48:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.614+0000 7f26e2400640 1 -- 172.21.15.7:0/719544920 wait complete. 2024-08-19T00:48:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.616+0000 7f26e2400640 1 Processor -- start 2024-08-19T00:48:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.616+0000 7f26e2400640 1 -- start start 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26e2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26dc0739a0 0x7f26dc1f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26e2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26dc0cea40 0x7f26dc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26e2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26e2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc159fd0 con 0x7f26dc159bf0 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26e2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc072f40 con 0x7f26dc0739a0 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26e2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26dc15a150 con 0x7f26dc0cea40 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26db400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26dc0739a0 0x7f26dc1f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26db400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26dc0739a0 0x7f26dc1f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:57300/0 (socket says 172.21.15.7:57300) 2024-08-19T00:48:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26db400640 1 -- 172.21.15.7:0/2909398156 learned_addr learned my addr 172.21.15.7:0/2909398156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:18.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.617+0000 7f26d3e00640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26dc0cea40 0x7f26dc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:18.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26dbe00640 1 -- 172.21.15.7:0/2909398156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26dc0cea40 msgr2=0x7f26dc150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26dbe00640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26dc0cea40 0x7f26dc150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26dbe00640 1 -- 172.21.15.7:0/2909398156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26dc0739a0 msgr2=0x7f26dc1f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26dbe00640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26dc0739a0 0x7f26dc1f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26dbe00640 1 -- 172.21.15.7:0/2909398156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc1535d0 con 0x7f26dc159bf0 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26dbe00640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc1501a0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f26d400c780 tx=0x7f26d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26d3400640 1 -- 172.21.15.7:0/2909398156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4016020 con 0x7f26dc159bf0 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26d3400640 1 -- 172.21.15.7:0/2909398156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d400aa50 con 0x7f26dc159bf0 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26d3400640 1 -- 172.21.15.7:0/2909398156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d400ce30 con 0x7f26dc159bf0 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc1557d0 con 0x7f26dc159bf0 2024-08-19T00:48:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.618+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc151230 con 0x7f26dc159bf0 2024-08-19T00:48:18.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.620+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26dc0ce500 con 0x7f26dc159bf0 2024-08-19T00:48:18.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.620+0000 7f26d3400640 1 -- 172.21.15.7:0/2909398156 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26d4019020 con 0x7f26dc159bf0 2024-08-19T00:48:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.621+0000 7f26d3400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f26b806be30 0x7f26b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.621+0000 7f26d3400640 1 -- 172.21.15.7:0/2909398156 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7f26d408b670 con 0x7f26dc159bf0 2024-08-19T00:48:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.622+0000 7f26db400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f26b806be30 0x7f26b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:18.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.622+0000 7f26db400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f26b806be30 0x7f26b806e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0090b0 tx=0x7f26cc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:18.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.626+0000 7f26d3400640 1 -- 172.21.15.7:0/2909398156 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f26d4020070 con 0x7f26dc159bf0 2024-08-19T00:48:18.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.845+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26dc15d660 con 0x7f26dc159bf0 2024-08-19T00:48:18.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.846+0000 7f26d3400640 1 -- 172.21.15.7:0/2909398156 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4393 (secure 0 0 0) 0x7f26d4058c50 con 0x7f26dc159bf0 2024-08-19T00:48:18.848 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:18.849 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":323,"btime":"2024-08-19T00:48:16:033233+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:16.033230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 323 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f26b806be30 msgr2=0x7f26b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f26b806be30 0x7f26b806e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0090b0 tx=0x7f26cc02e000 comp rx=0 tx=0).stop 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 msgr2=0x7f26dc1501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc1501a0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f26d400c780 tx=0x7f26d400cc40 comp rx=0 tx=0).stop 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 shutdown_connections 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f26b806be30 0x7f26b806e2f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26dc159bf0 0x7f26dc1501a0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26dc0cea40 0x7f26dc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 --2- 172.21.15.7:0/2909398156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26dc0739a0 0x7f26dc1f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 >> 172.21.15.7:0/2909398156 conn(0x7f26dc06bc70 msgr2=0x7f26dc15a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 shutdown_connections 2024-08-19T00:48:18.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:18.848+0000 7f26e2400640 1 -- 172.21.15.7:0/2909398156 wait complete. 2024-08-19T00:48:18.867 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:48:18.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:19.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.021+0000 7f4378e00640 1 Processor -- start 2024-08-19T00:48:19.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.021+0000 7f4378e00640 1 -- start start 2024-08-19T00:48:19.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.022+0000 7f4378e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 0x7f437415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.022+0000 7f4378e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43740b3ab0 con 0x7f437415e360 2024-08-19T00:48:19.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.022+0000 7f4378e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f437415f460 con 0x7f43740d3200 2024-08-19T00:48:19.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.022+0000 7f4378e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f437415f740 con 0x7f437415ee50 2024-08-19T00:48:19.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.022+0000 7f4373400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f437415e360 0x7f43740d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48122/0 (socket says 172.21.15.7:48122) 2024-08-19T00:48:19.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.022+0000 7f4373400640 1 -- 172.21.15.7:0/4200111316 learned_addr learned my addr 172.21.15.7:0/4200111316 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4373e00640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 0x7f437415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886654975 0 0) 0x7f43740b3ab0 con 0x7f437415e360 2024-08-19T00:48:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4358003520 con 0x7f437415e360 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2729948971 0 0) 0x7f4358003520 con 0x7f437415e360 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 msgr2=0x7f437415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 0x7f437415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 >> v1:172.21.15.162:6789/0 conn(0x7f43740d3200 legacy=0x7f437415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43740b3d60 con 0x7f437415e360 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f4364001670 con 0x7f437415e360 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.023+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 >> v1:172.21.15.7:6789/0 conn(0x7f437415e360 legacy=0x7f43740d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372000640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f4358003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372000640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 0x7f4358004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372000640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4358004d40 0x7f43580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f437415f740 con 0x7f43580039e0 2024-08-19T00:48:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f435800bad0 con 0x7f4358004d40 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f435800bcd0 con 0x7f437415ee50 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4373400640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f4358003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4373e00640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4358004d40 0x7f43580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372a00640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 0x7f4358004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4373400640 1 -- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 msgr2=0x7f4358004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4373400640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 0x7f4358004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4373400640 1 -- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4358004d40 msgr2=0x7f43580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:19.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4373400640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4358004d40 0x7f43580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4373400640 1 -- 172.21.15.7:0/4200111316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4358003520 con 0x7f43580039e0 2024-08-19T00:48:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.024+0000 7f4372a00640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f437415ee50 0x7f4358004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.026+0000 7f4373400640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f4358003e00 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f436400c0e0 tx=0x7f4358005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb54ece6bbc9cf2f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.027+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364007c40 con 0x7f43580039e0 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.027+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364005af0 con 0x7f43580039e0 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.027+0000 7f4372000640 1 -- 172.21.15.7:0/4200111316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364007070 con 0x7f43580039e0 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.027+0000 7f4378e00640 1 -- 172.21.15.7:0/4200111316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 msgr2=0x7f4358003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.027+0000 7f4378e00640 1 --2- 172.21.15.7:0/4200111316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f4358003e00 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f436400c0e0 tx=0x7f4358005830 comp rx=0 tx=0).stop 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.028+0000 7f4373e00640 1 -- 172.21.15.7:0/4200111316 reap_dead start 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.028+0000 7f4378e00640 1 -- 172.21.15.7:0/4200111316 shutdown_connections 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.028+0000 7f4378e00640 1 -- 172.21.15.7:0/4200111316 >> 172.21.15.7:0/4200111316 conn(0x7f437408dbf0 msgr2=0x7f437409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.028+0000 7f4378e00640 1 -- 172.21.15.7:0/4200111316 shutdown_connections 2024-08-19T00:48:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.028+0000 7f4378e00640 1 -- 172.21.15.7:0/4200111316 wait complete. 2024-08-19T00:48:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.029+0000 7f4378e00640 1 Processor -- start 2024-08-19T00:48:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.029+0000 7f4378e00640 1 -- start start 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.030+0000 7f4378e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f437415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.030+0000 7f4378e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43741f5ad0 0x7f43740ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.030+0000 7f4378e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43740ca890 0x7f43740b8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.030+0000 7f4378e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f437415fab0 con 0x7f43580039e0 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.030+0000 7f4378e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43740d2300 con 0x7f43740ca890 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.030+0000 7f4378e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f437415fc30 con 0x7f43741f5ad0 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f437415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f437415c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59088/0 (socket says 172.21.15.7:59088) 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 -- 172.21.15.7:0/4122180426 learned_addr learned my addr 172.21.15.7:0/4122180426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4372a00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43741f5ad0 0x7f43740ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373e00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43740ca890 0x7f43740b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 -- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43741f5ad0 msgr2=0x7f43740ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43741f5ad0 0x7f43740ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 -- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43740ca890 msgr2=0x7f43740b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43740ca890 0x7f43740b8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 -- 172.21.15.7:0/4122180426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43740b73a0 con 0x7f43580039e0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.031+0000 7f4373400640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f437415c900 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f436400c200 tx=0x7f437415fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.032+0000 7f436b400640 1 -- 172.21.15.7:0/4122180426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364043070 con 0x7f43580039e0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.032+0000 7f436b400640 1 -- 172.21.15.7:0/4122180426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364038040 con 0x7f43580039e0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.032+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43740b7680 con 0x7f43580039e0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.032+0000 7f436b400640 1 -- 172.21.15.7:0/4122180426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364007070 con 0x7f43580039e0 2024-08-19T00:48:19.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.032+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43740b7c40 con 0x7f43580039e0 2024-08-19T00:48:19.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.033+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437415e740 con 0x7f43580039e0 2024-08-19T00:48:19.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.034+0000 7f436b400640 1 -- 172.21.15.7:0/4122180426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4364007210 con 0x7f43580039e0 2024-08-19T00:48:19.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.035+0000 7f436b400640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f435406be30 0x7f435406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.035+0000 7f436b400640 1 -- 172.21.15.7:0/4122180426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7f43640ab700 con 0x7f43580039e0 2024-08-19T00:48:19.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.035+0000 7f4372a00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f435406be30 0x7f435406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.036+0000 7f4372a00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f435406be30 0x7f435406e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f43740ba290 tx=0x7f4360009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.039+0000 7f436b400640 1 -- 172.21.15.7:0/4122180426 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4364078d70 con 0x7f43580039e0 2024-08-19T00:48:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.257+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43740d2e50 con 0x7f43580039e0 2024-08-19T00:48:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.257+0000 7f436b400640 1 -- 172.21.15.7:0/4122180426 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4393 (secure 0 0 0) 0x7f43640ab4e0 con 0x7f43580039e0 2024-08-19T00:48:19.260 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:19.260 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":323,"btime":"2024-08-19T00:48:16:033233+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:16.033230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 323 2024-08-19T00:48:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f435406be30 msgr2=0x7f435406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f435406be30 0x7f435406e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f43740ba290 tx=0x7f4360009040 comp rx=0 tx=0).stop 2024-08-19T00:48:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 msgr2=0x7f437415c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f437415c900 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f436400c200 tx=0x7f437415fa20 comp rx=0 tx=0).stop 2024-08-19T00:48:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 shutdown_connections 2024-08-19T00:48:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f435406be30 0x7f435406e2f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43740ca890 0x7f43740b8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43741f5ad0 0x7f43740ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 --2- 172.21.15.7:0/4122180426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580039e0 0x7f437415c900 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 >> 172.21.15.7:0/4122180426 conn(0x7f437408dbf0 msgr2=0x7f4374160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.259+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 shutdown_connections 2024-08-19T00:48:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.260+0000 7f4378e00640 1 -- 172.21.15.7:0/4122180426 wait complete. 2024-08-19T00:48:19.278 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:48:19.278 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.432+0000 7f081dc00640 1 Processor -- start 2024-08-19T00:48:19.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.432+0000 7f081dc00640 1 -- start start 2024-08-19T00:48:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.433+0000 7f081dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f081815e360 0x7f081815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.433+0000 7f081dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08180b3ab0 con 0x7f08180d2af0 2024-08-19T00:48:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.433+0000 7f081dc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f081815f460 con 0x7f081815ee50 2024-08-19T00:48:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.433+0000 7f081dc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f081815f740 con 0x7f081815e360 2024-08-19T00:48:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.434+0000 7f0817e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f081815e360 0x7f081815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.434+0000 7f0817400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f08180d2af0 0x7f081815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48134/0 (socket says 172.21.15.7:48134) 2024-08-19T00:48:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.434+0000 7f0817400640 1 -- 172.21.15.7:0/4162582052 learned_addr learned my addr 172.21.15.7:0/4162582052 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.434+0000 7f0817e00640 1 -- 172.21.15.7:0/4162582052 >> v1:172.21.15.162:6789/0 conn(0x7f081815ee50 legacy=0x7f08180b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.434+0000 7f0817e00640 1 -- 172.21.15.7:0/4162582052 >> v1:172.21.15.7:6789/0 conn(0x7f08180d2af0 legacy=0x7f081815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.434+0000 7f0816a00640 1 -- 172.21.15.7:0/4162582052 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737328967 0 0) 0x7f08180b3ab0 con 0x7f08180d2af0 2024-08-19T00:48:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.434+0000 7f0817e00640 1 -- 172.21.15.7:0/4162582052 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08180b3d60 con 0x7f081815e360 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.435+0000 7f0817e00640 1 --2- 172.21.15.7:0/4162582052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f081815e360 0x7f081815fab0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f08080097a0 tx=0x7f080802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc3644422ca77d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.435+0000 7f0816a00640 1 -- 172.21.15.7:0/4162582052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808037070 con 0x7f081815e360 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.435+0000 7f0816a00640 1 -- 172.21.15.7:0/4162582052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808032440 con 0x7f081815e360 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.435+0000 7f0816a00640 1 -- 172.21.15.7:0/4162582052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808032810 con 0x7f081815e360 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.436+0000 7f081dc00640 1 -- 172.21.15.7:0/4162582052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f081815e360 msgr2=0x7f081815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.436+0000 7f081dc00640 1 --2- 172.21.15.7:0/4162582052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f081815e360 0x7f081815fab0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f08080097a0 tx=0x7f080802a230 comp rx=0 tx=0).stop 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.436+0000 7f081dc00640 1 -- 172.21.15.7:0/4162582052 shutdown_connections 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.436+0000 7f081dc00640 1 --2- 172.21.15.7:0/4162582052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f081815e360 0x7f081815fab0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.436+0000 7f081dc00640 1 -- 172.21.15.7:0/4162582052 >> 172.21.15.7:0/4162582052 conn(0x7f081808dbf0 msgr2=0x7f081809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.436+0000 7f081dc00640 1 -- 172.21.15.7:0/4162582052 shutdown_connections 2024-08-19T00:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.436+0000 7f081dc00640 1 -- 172.21.15.7:0/4162582052 wait complete. 2024-08-19T00:48:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.438+0000 7f081dc00640 1 Processor -- start 2024-08-19T00:48:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.438+0000 7f081dc00640 1 -- start start 2024-08-19T00:48:19.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08180d2af0 0x7f081806d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081815e360 0x7f08180b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f081815ee50 0x7f08180b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08180d2f80 con 0x7f08180d2af0 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08180d2300 con 0x7f081815e360 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08180d3100 con 0x7f081815ee50 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08180d2af0 0x7f081806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08180d2af0 0x7f081806d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59108/0 (socket says 172.21.15.7:59108) 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 -- 172.21.15.7:0/591600178 learned_addr learned my addr 172.21.15.7:0/591600178 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817400640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081815e360 0x7f08180b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081d200640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f081815ee50 0x7f08180b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 -- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f081815ee50 msgr2=0x7f08180b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f081815ee50 0x7f08180b90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 -- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081815e360 msgr2=0x7f08180b8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081815e360 0x7f08180b8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817e00640 1 -- 172.21.15.7:0/591600178 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08180b70d0 con 0x7f08180d2af0 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f0817400640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081815e360 0x7f08180b8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.439+0000 7f081d200640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f081815ee50 0x7f08180b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.440+0000 7f0817e00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08180d2af0 0x7f081806d860 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f08080098c0 tx=0x7f08080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.440+0000 7f080fe00640 1 -- 172.21.15.7:0/591600178 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808037040 con 0x7f08180d2af0 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.440+0000 7f080fe00640 1 -- 172.21.15.7:0/591600178 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808042070 con 0x7f08180d2af0 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.440+0000 7f080fe00640 1 -- 172.21.15.7:0/591600178 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808030a70 con 0x7f08180d2af0 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.440+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08180b73b0 con 0x7f08180d2af0 2024-08-19T00:48:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.440+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08180b9720 con 0x7f08180d2af0 2024-08-19T00:48:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.441+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f081815fab0 con 0x7f08180d2af0 2024-08-19T00:48:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.442+0000 7f080fe00640 1 -- 172.21.15.7:0/591600178 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0808030c10 con 0x7f08180d2af0 2024-08-19T00:48:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.443+0000 7f080fe00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07f806be30 0x7f07f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.443+0000 7f080fe00640 1 -- 172.21.15.7:0/591600178 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7f08080ac6a0 con 0x7f08180d2af0 2024-08-19T00:48:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.443+0000 7f0817400640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07f806be30 0x7f07f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.444+0000 7f0817400640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07f806be30 0x7f07f806e2f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f08180b3850 tx=0x7f0804009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.448+0000 7f080fe00640 1 -- 172.21.15.7:0/591600178 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0808045360 con 0x7f08180d2af0 2024-08-19T00:48:19.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.667+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08180d50d0 con 0x7f08180d2af0 2024-08-19T00:48:19.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.668+0000 7f080fe00640 1 -- 172.21.15.7:0/591600178 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 323 v323) ==== 95+0+4393 (secure 0 0 0) 0x7f080807a2d0 con 0x7f08180d2af0 2024-08-19T00:48:19.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:19.671 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":323,"btime":"2024-08-19T00:48:16:033233+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":323,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:16.033230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:19.671 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 323 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07f806be30 msgr2=0x7f07f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07f806be30 0x7f07f806e2f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f08180b3850 tx=0x7f0804009040 comp rx=0 tx=0).stop 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08180d2af0 msgr2=0x7f081806d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08180d2af0 0x7f081806d860 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f08080098c0 tx=0x7f08080046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 shutdown_connections 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f07f806be30 0x7f07f806e2f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f081815ee50 0x7f08180b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081815e360 0x7f08180b8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 --2- 172.21.15.7:0/591600178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08180d2af0 0x7f081806d860 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 >> 172.21.15.7:0/591600178 conn(0x7f081808dbf0 msgr2=0x7f081806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 shutdown_connections 2024-08-19T00:48:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.670+0000 7f081dc00640 1 -- 172.21.15.7:0/591600178 wait complete. 2024-08-19T00:48:19.690 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 100.00000000' led to DAMAGED state 2024-08-19T00:48:19.690 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on mds0_sessionmap' 2024-08-19T00:48:19.690 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:19.690 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:19.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:48:19.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:48:19.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:19.726 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:48:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:48:19.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:48:19.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:48:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.998+0000 7f46f0c00640 1 Processor -- start 2024-08-19T00:48:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.998+0000 7f46f0c00640 1 -- start start 2024-08-19T00:48:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.999+0000 7f46f0c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46ec0d03c0 0x7f46ec071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.999+0000 7f46f0c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec0cdfb0 con 0x7f46ec06e710 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.999+0000 7f46f0c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec0ce290 con 0x7f46ec0b3750 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.999+0000 7f46f0c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec0cebc0 con 0x7f46ec0d03c0 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.999+0000 7f46e1400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f46ec06e710 0x7f46ec0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48142/0 (socket says 172.21.15.7:48142) 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.999+0000 7f46e1400640 1 -- 172.21.15.7:0/134579859 learned_addr learned my addr 172.21.15.7:0/134579859 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:19.999+0000 7f46e9e00640 1 --2- 172.21.15.7:0/134579859 >> v2:172.21.15.162:3300/0 conn(0x7f46ec0d03c0 0x7f46ec071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946046207 0 0) 0x7f46ec0cdfb0 con 0x7f46ec06e710 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d0003520 con 0x7f46ec06e710 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932838661 0 0) 0x7f46ec0ce290 con 0x7f46ec0b3750 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46ec0cdfb0 con 0x7f46ec0b3750 2024-08-19T00:48:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2839012892 0 0) 0x7f46d0003520 con 0x7f46ec06e710 2024-08-19T00:48:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 >> v2:172.21.15.162:3300/0 conn(0x7f46ec0d03c0 msgr2=0x7f46ec071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 --2- 172.21.15.7:0/134579859 >> v2:172.21.15.162:3300/0 conn(0x7f46ec0d03c0 0x7f46ec071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 >> v1:172.21.15.162:6789/0 conn(0x7f46ec0b3750 legacy=0x7f46ec0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec0ce570 con 0x7f46ec06e710 2024-08-19T00:48:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f46d4001670 con 0x7f46ec06e710 2024-08-19T00:48:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 >> v1:172.21.15.7:6789/0 conn(0x7f46ec06e710 legacy=0x7f46ec0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0003b90 0x7f46d0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46d0004800 0x7f46d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46d00051c0 0x7f46d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec0cebc0 con 0x7f46d0004800 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46d000c090 con 0x7f46d00051c0 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46d000c290 con 0x7f46d0003b90 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e1400640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46d0004800 0x7f46d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.000+0000 7f46e9e00640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0003b90 0x7f46d0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.001+0000 7f46ea800640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46d00051c0 0x7f46d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.001+0000 7f46e1400640 1 -- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0003b90 msgr2=0x7f46d0003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.001+0000 7f46e1400640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0003b90 0x7f46d0003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.001+0000 7f46e1400640 1 -- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46d00051c0 msgr2=0x7f46d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.001+0000 7f46e1400640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46d00051c0 0x7f46d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.001+0000 7f46e1400640 1 -- 172.21.15.7:0/134579859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d0003520 con 0x7f46d0004800 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.001+0000 7f46ea800640 1 -- 172.21.15.7:0/134579859 reap_dead start 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.002+0000 7f46e1400640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46d0004800 0x7f46d0004c80 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c0e0 tx=0x7f46d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b131bc2eabaef3e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.002+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4007c40 con 0x7f46d0004800 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.002+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d4005ad0 con 0x7f46d0004800 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.002+0000 7f46e9400640 1 -- 172.21.15.7:0/134579859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4007070 con 0x7f46d0004800 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.002+0000 7f46f0c00640 1 -- 172.21.15.7:0/134579859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46d0004800 msgr2=0x7f46d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.002+0000 7f46f0c00640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46d0004800 0x7f46d0004c80 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c0e0 tx=0x7f46d0005830 comp rx=0 tx=0).stop 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.003+0000 7f46f0c00640 1 -- 172.21.15.7:0/134579859 shutdown_connections 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.003+0000 7f46f0c00640 1 --2- 172.21.15.7:0/134579859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46d0004800 0x7f46d0004c80 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.003+0000 7f46f0c00640 1 -- 172.21.15.7:0/134579859 >> 172.21.15.7:0/134579859 conn(0x7f46ec06bc70 msgr2=0x7f46ec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.003+0000 7f46f0c00640 1 -- 172.21.15.7:0/134579859 shutdown_connections 2024-08-19T00:48:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.003+0000 7f46f0c00640 1 -- 172.21.15.7:0/134579859 wait complete. 2024-08-19T00:48:20.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.004+0000 7f46f0c00640 1 Processor -- start 2024-08-19T00:48:20.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.004+0000 7f46f0c00640 1 -- start start 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.005+0000 7f46f0c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0004800 0x7f46ec1f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.005+0000 7f46f0c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ec15d460 0x7f46ec0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.005+0000 7f46f0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46ec15d8e0 0x7f46ec0b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.005+0000 7f46f0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec073c60 con 0x7f46ec15d8e0 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.005+0000 7f46f0c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec073ae0 con 0x7f46ec15d460 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.005+0000 7f46f0c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec0b3be0 con 0x7f46d0004800 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46ec15d8e0 0x7f46ec0b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46ec15d8e0 0x7f46ec0b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59132/0 (socket says 172.21.15.7:59132) 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 -- 172.21.15.7:0/449782935 learned_addr learned my addr 172.21.15.7:0/449782935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46e1400640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ec15d460 0x7f46ec0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46e9e00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0004800 0x7f46ec1f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 -- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0004800 msgr2=0x7f46ec1f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0004800 0x7f46ec1f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 -- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ec15d460 msgr2=0x7f46ec0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ec15d460 0x7f46ec0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 -- 172.21.15.7:0/449782935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec0b0d70 con 0x7f46ec15d8e0 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46ea800640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46ec15d8e0 0x7f46ec0b2070 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e780 tx=0x7f46e400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46e2a00640 1 -- 172.21.15.7:0/449782935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4019070 con 0x7f46ec15d8e0 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46e2a00640 1 -- 172.21.15.7:0/449782935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e4006b50 con 0x7f46ec15d8e0 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.006+0000 7f46e2a00640 1 -- 172.21.15.7:0/449782935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4003970 con 0x7f46ec15d8e0 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.007+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec0b1050 con 0x7f46ec15d8e0 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.007+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec0b25b0 con 0x7f46ec15d8e0 2024-08-19T00:48:20.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.008+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec0ce290 con 0x7f46ec15d8e0 2024-08-19T00:48:20.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.009+0000 7f46e2a00640 1 -- 172.21.15.7:0/449782935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46e401c070 con 0x7f46ec15d8e0 2024-08-19T00:48:20.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.009+0000 7f46e2a00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c806be60 0x7f46c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:20.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.010+0000 7f46e2a00640 1 -- 172.21.15.7:0/449782935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7f46e408b310 con 0x7f46ec15d8e0 2024-08-19T00:48:20.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.010+0000 7f46e9e00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c806be60 0x7f46c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:20.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.010+0000 7f46e9e00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c806be60 0x7f46c806e320 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f46ec072c80 tx=0x7f46dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:20.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.014+0000 7f46e2a00640 1 -- 172.21.15.7:0/449782935 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f46e4058f40 con 0x7f46ec15d8e0 2024-08-19T00:48:20.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:20.236+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f46ec0c9640 con 0x7f46ec15d8e0 2024-08-19T00:48:20.786 INFO:tasks.ceph.mds.a.smithi007.stderr: -53> 2024-08-19T00:48:16.030+0000 7f99f3a00640 -1 mds.0.cache.dir(0x100) Corrupt fnode in dirfrag 0x100: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:48:20.786 INFO:tasks.ceph.mds.a.smithi007.stderr: -33> 2024-08-19T00:48:16.502+0000 7f99f8a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:20.828 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:48:21.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.036+0000 7f46e2a00640 1 -- 172.21.15.7:0/449782935 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v324) ==== 161+0+0 (secure 0 0 0) 0x7f46e4058840 con 0x7f46ec15d8e0 2024-08-19T00:48:21.039 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c806be60 msgr2=0x7f46c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c806be60 0x7f46c806e320 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f46ec072c80 tx=0x7f46dc008040 comp rx=0 tx=0).stop 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46ec15d8e0 msgr2=0x7f46ec0b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46ec15d8e0 0x7f46ec0b2070 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e780 tx=0x7f46e400eb80 comp rx=0 tx=0).stop 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 shutdown_connections 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c806be60 0x7f46c806e320 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46ec15d8e0 0x7f46ec0b2070 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ec15d460 0x7f46ec0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 --2- 172.21.15.7:0/449782935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46d0004800 0x7f46ec1f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 >> 172.21.15.7:0/449782935 conn(0x7f46ec06bc70 msgr2=0x7f46ec06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:21.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 shutdown_connections 2024-08-19T00:48:21.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.039+0000 7f46f0c00640 1 -- 172.21.15.7:0/449782935 wait complete. 2024-08-19T00:48:21.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:48:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.218+0000 7fe480400640 1 Processor -- start 2024-08-19T00:48:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.219+0000 7fe480400640 1 -- start start 2024-08-19T00:48:21.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe480400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 0x7fe4780ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe480400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe4780d03c0 0x7fe4780d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe480400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47806f7f0 con 0x7fe478159bf0 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe480400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe4780cee80 con 0x7fe4780d03c0 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe480400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4780d0d70 con 0x7fe4780ce500 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe47da00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe478159bf0 0x7fe478073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48154/0 (socket says 172.21.15.7:48154) 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe47da00640 1 -- 172.21.15.7:0/474032000 learned_addr learned my addr 172.21.15.7:0/474032000 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe47d000640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 0x7fe4780ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe47e400640 1 --2- 172.21.15.7:0/474032000 >> v2:172.21.15.162:3300/0 conn(0x7fe4780d03c0 0x7fe4780d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.220+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365498897 0 0) 0x7fe47806f7f0 con 0x7fe478159bf0 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe460003520 con 0x7fe478159bf0 2024-08-19T00:48:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4145243093 0 0) 0x7fe460003520 con 0x7fe478159bf0 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 msgr2=0x7fe4780ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 0x7fe4780ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 >> v2:172.21.15.162:3300/0 conn(0x7fe4780d03c0 msgr2=0x7fe4780d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 --2- 172.21.15.7:0/474032000 >> v2:172.21.15.162:3300/0 conn(0x7fe4780d03c0 0x7fe4780d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47806f510 con 0x7fe478159bf0 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fe46c001670 con 0x7fe478159bf0 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 >> v1:172.21.15.7:6789/0 conn(0x7fe478159bf0 legacy=0x7fe478073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 0x7fe4600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe460003f30 0x7fe460004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460004d40 0x7fe4600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780cee80 con 0x7fe460003f30 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780d0d70 con 0x7fe460004d40 2024-08-19T00:48:21.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe46000ba10 con 0x7fe4780ce500 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.221+0000 7fe47d000640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe460003f30 0x7fe460004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.222+0000 7fe47da00640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 0x7fe4600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.222+0000 7fe47e400640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460004d40 0x7fe4600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.222+0000 7fe47d000640 1 -- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 msgr2=0x7fe4600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.222+0000 7fe47d000640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780ce500 0x7fe4600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.222+0000 7fe47d000640 1 -- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460004d40 msgr2=0x7fe4600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.222+0000 7fe47d000640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460004d40 0x7fe4600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.222+0000 7fe47d000640 1 -- 172.21.15.7:0/474032000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe460003520 con 0x7fe460003f30 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.223+0000 7fe47d000640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe460003f30 0x7fe460004800 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fe464009ac0 tx=0x7fe460005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2f71970ad82068 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.223+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464036070 con 0x7fe460003f30 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.223+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe464031400 con 0x7fe460003f30 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.223+0000 7fe477e00640 1 -- 172.21.15.7:0/474032000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464009690 con 0x7fe460003f30 2024-08-19T00:48:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.224+0000 7fe480400640 1 -- 172.21.15.7:0/474032000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe460003f30 msgr2=0x7fe460004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.224+0000 7fe480400640 1 --2- 172.21.15.7:0/474032000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe460003f30 0x7fe460004800 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fe464009ac0 tx=0x7fe460005830 comp rx=0 tx=0).stop 2024-08-19T00:48:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.224+0000 7fe47e400640 1 -- 172.21.15.7:0/474032000 reap_dead start 2024-08-19T00:48:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.224+0000 7fe480400640 1 -- 172.21.15.7:0/474032000 shutdown_connections 2024-08-19T00:48:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.224+0000 7fe480400640 1 -- 172.21.15.7:0/474032000 >> 172.21.15.7:0/474032000 conn(0x7fe47806bc70 msgr2=0x7fe47806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.224+0000 7fe480400640 1 -- 172.21.15.7:0/474032000 shutdown_connections 2024-08-19T00:48:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.224+0000 7fe480400640 1 -- 172.21.15.7:0/474032000 wait complete. 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.225+0000 7fe480400640 1 Processor -- start 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.226+0000 7fe480400640 1 -- start start 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.226+0000 7fe480400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460003f30 0x7fe47814c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.226+0000 7fe480400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780c7320 0x7fe4780c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.226+0000 7fe480400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4780c77a0 0x7fe4780ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.226+0000 7fe480400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe478072f40 con 0x7fe4780c77a0 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.226+0000 7fe480400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe478072c60 con 0x7fe460003f30 2024-08-19T00:48:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.226+0000 7fe480400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe478073b70 con 0x7fe4780c7320 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4780c77a0 0x7fe4780ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4780c77a0 0x7fe4780ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59162/0 (socket says 172.21.15.7:59162) 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 -- 172.21.15.7:0/1100116102 learned_addr learned my addr 172.21.15.7:0/1100116102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47d000640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780c7320 0x7fe4780c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47da00640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460003f30 0x7fe47814c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 -- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780c7320 msgr2=0x7fe4780c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780c7320 0x7fe4780c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 -- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460003f30 msgr2=0x7fe47814c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460003f30 0x7fe47814c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.227+0000 7fe47e400640 1 -- 172.21.15.7:0/1100116102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4780c4f80 con 0x7fe4780c77a0 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.228+0000 7fe47e400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4780c77a0 0x7fe4780ca190 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fe4780cfa80 tx=0x7fe47000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:21.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.228+0000 7fe475600640 1 -- 172.21.15.7:0/1100116102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47000fd10 con 0x7fe4780c77a0 2024-08-19T00:48:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.228+0000 7fe475600640 1 -- 172.21.15.7:0/1100116102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47001d070 con 0x7fe4780c77a0 2024-08-19T00:48:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.228+0000 7fe475600640 1 -- 172.21.15.7:0/1100116102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470015670 con 0x7fe4780c77a0 2024-08-19T00:48:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.228+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4780c5260 con 0x7fe4780c77a0 2024-08-19T00:48:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.228+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4780c5820 con 0x7fe4780c77a0 2024-08-19T00:48:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.229+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe478159fd0 con 0x7fe4780c77a0 2024-08-19T00:48:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.230+0000 7fe475600640 1 -- 172.21.15.7:0/1100116102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe470015810 con 0x7fe4780c77a0 2024-08-19T00:48:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.232+0000 7fe475600640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45806be30 0x7fe45806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.232+0000 7fe475600640 1 -- 172.21.15.7:0/1100116102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7fe47008c430 con 0x7fe4780c77a0 2024-08-19T00:48:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.232+0000 7fe47da00640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45806be30 0x7fe45806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.232+0000 7fe47da00640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45806be30 0x7fe45806e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001630 tx=0x7fe46c0078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:21.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.236+0000 7fe475600640 1 -- 172.21.15.7:0/1100116102 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe470010040 con 0x7fe4780c77a0 2024-08-19T00:48:21.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:21.489+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7fe4780b4c90 con 0x7fe4780c77a0 2024-08-19T00:48:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.041+0000 7fe475600640 1 -- 172.21.15.7:0/1100116102 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v325) ==== 101+0+0 (secure 0 0 0) 0x7fe47005a060 con 0x7fe4780c77a0 2024-08-19T00:48:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:48:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45806be30 msgr2=0x7fe45806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45806be30 0x7fe45806e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001630 tx=0x7fe46c0078f0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4780c77a0 msgr2=0x7fe4780ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4780c77a0 0x7fe4780ca190 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fe4780cfa80 tx=0x7fe47000f1b0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 shutdown_connections 2024-08-19T00:48:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe45806be30 0x7fe45806e2f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4780c77a0 0x7fe4780ca190 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4780c7320 0x7fe4780c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 --2- 172.21.15.7:0/1100116102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe460003f30 0x7fe47814c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 >> 172.21.15.7:0/1100116102 conn(0x7fe47806bc70 msgr2=0x7fe4780b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 shutdown_connections 2024-08-19T00:48:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.044+0000 7fe480400640 1 -- 172.21.15.7:0/1100116102 wait complete. 2024-08-19T00:48:22.065 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:48:22.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.141+0000 7fb62673cf40 1 Processor -- start 2024-08-19T00:48:22.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.142+0000 7fb62673cf40 1 -- start start 2024-08-19T00:48:22.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.142+0000 7fb62673cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec740960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.142+0000 7fb62673cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a35b0 0x55c5ec73a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.142+0000 7fb62673cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a3990 0x55c5ec749790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.142+0000 7fb62673cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c5ec617d00 con 0x55c5ec6a1f40 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.142+0000 7fb62673cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c5ec61bd40 con 0x55c5ec6a35b0 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.142+0000 7fb62673cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c5ec748dc0 con 0x55c5ec6a3990 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec740960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec740960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59192/0 (socket says 172.21.15.7:59192) 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 -- 172.21.15.7:0/4099702148 learned_addr learned my addr 172.21.15.7:0/4099702148 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623000640 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a35b0 0x55c5ec73a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 -- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a3990 msgr2=0x55c5ec749790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb624400640 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a3990 0x55c5ec749790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a3990 0x55c5ec749790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 -- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a35b0 msgr2=0x55c5ec73a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:22.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a35b0 0x55c5ec73a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 -- 172.21.15.7:0/4099702148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5ec5d9080 con 0x55c5ec6a1f40 2024-08-19T00:48:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb624400640 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a3990 0x55c5ec749790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.143+0000 7fb623a00640 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec740960 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fb61400b310 tx=0x7fb61400b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec50ae3f9c727d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb621c00640 1 -- 172.21.15.7:0/4099702148 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61400e5c0 con 0x55c5ec6a1f40 2024-08-19T00:48:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb621c00640 1 -- 172.21.15.7:0/4099702148 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb614006070 con 0x55c5ec6a1f40 2024-08-19T00:48:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb621c00640 1 -- 172.21.15.7:0/4099702148 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61400e960 con 0x55c5ec6a1f40 2024-08-19T00:48:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 -- 172.21.15.7:0/4099702148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 msgr2=0x55c5ec740960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec740960 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fb61400b310 tx=0x7fb61400b7d0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 -- 172.21.15.7:0/4099702148 shutdown_connections 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a3990 0x55c5ec749790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a35b0 0x55c5ec73a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 --2- 172.21.15.7:0/4099702148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec740960 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 -- 172.21.15.7:0/4099702148 >> 172.21.15.7:0/4099702148 conn(0x55c5ec6a04e0 msgr2=0x55c5ec6bda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 -- 172.21.15.7:0/4099702148 shutdown_connections 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.144+0000 7fb62673cf40 1 -- 172.21.15.7:0/4099702148 wait complete. 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.145+0000 7fb62673cf40 1 Processor -- start 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.145+0000 7fb62673cf40 1 -- start start 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb62673cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec73f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb62673cf40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a35b0 0x55c5ec731090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb62673cf40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a3990 0x55c5ec73a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb62673cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c5ec73fba0 con 0x55c5ec6a1f40 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb62673cf40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c5ec73f8c0 con 0x55c5ec6a3990 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb62673cf40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c5ec73fe80 con 0x55c5ec6a35b0 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb623a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec73f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb623a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec73f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59204/0 (socket says 172.21.15.7:59204) 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 learned_addr learned my addr 172.21.15.7:0/903636441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.146+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a35b0 0x55c5ec731090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb624400640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a3990 0x55c5ec73a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a35b0 msgr2=0x55c5ec731090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb623a00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a35b0 0x55c5ec731090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a3990 msgr2=0x55c5ec73a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb623a00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5ec6a3990 0x55c5ec73a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5ec732220 con 0x55c5ec6a1f40 2024-08-19T00:48:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c5ec6a35b0 0x55c5ec731090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb623a00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec73f0f0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fb614001ed0 tx=0x7fb614000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb61be00640 1 -- 172.21.15.7:0/903636441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61400f660 con 0x55c5ec6a1f40 2024-08-19T00:48:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb61be00640 1 -- 172.21.15.7:0/903636441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb614021020 con 0x55c5ec6a1f40 2024-08-19T00:48:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb61be00640 1 -- 172.21.15.7:0/903636441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61400f860 con 0x55c5ec6a1f40 2024-08-19T00:48:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.147+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5ec732500 con 0x55c5ec6a1f40 2024-08-19T00:48:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.148+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5ec7315d0 con 0x55c5ec6a1f40 2024-08-19T00:48:22.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.149+0000 7fb61be00640 1 -- 172.21.15.7:0/903636441 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb614017070 con 0x55c5ec6a1f40 2024-08-19T00:48:22.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.150+0000 7fb61be00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb60406a840 0x7fb60406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.150+0000 7fb61be00640 1 -- 172.21.15.7:0/903636441 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7fb61408c3f0 con 0x55c5ec6a1f40 2024-08-19T00:48:22.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.151+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb60406a840 0x7fb60406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.154 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:48:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.151+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c5ec73aa20 0x55c5ec734920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.151+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec734e60 con 0x55c5ec73aa20 2024-08-19T00:48:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.151+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb60406a840 0x7fb60406cd00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb610057000 tx=0x7fb61005e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.151+0000 7fb624400640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c5ec73aa20 0x55c5ec734920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.152+0000 7fb624400640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c5ec73aa20 0x55c5ec734920 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.155+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v124'1159 uv1133 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.155+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec735250 con 0x55c5ec73aa20 2024-08-19T00:48:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.156+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v124'1160 uv1160 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.157+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ea9e0 con 0x55c5ec73aa20 2024-08-19T00:48:22.160 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:48:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.158+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v124'1161 uv1161 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.158+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ebd90 con 0x55c5ec73aa20 2024-08-19T00:48:22.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.160+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v124'1162 uv1162 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.160+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec130 con 0x55c5ec73aa20 2024-08-19T00:48:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.161+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v124'1163 uv1163 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.161+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ead80 con 0x55c5ec73aa20 2024-08-19T00:48:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.163+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v124'1164 uv1164 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.163+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb120 con 0x55c5ec73aa20 2024-08-19T00:48:22.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.165+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v124'1165 uv1139 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.165+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.166+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v124'1166 uv1166 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.166+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.168+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v124'1167 uv1167 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.171 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:48:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.168+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.170+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v124'1168 uv1168 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.170+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.171+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v124'1169 uv1169 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.171+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.172+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v124'1170 uv1170 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.173+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.174+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v124'1171 uv1146 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.174+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.176+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v124'1172 uv1172 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.176+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.180 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:48:22.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.178+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v124'1173 uv1173 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.178+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.179+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v124'1174 uv1174 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.179+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.181+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v124'1175 uv1175 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.181+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7eb4c0 con 0x55c5ec73aa20 2024-08-19T00:48:22.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.182+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v124'1176 uv1176 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.182+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.184+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v124'1177 uv1177 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.184+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.186+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v124'1178 uv1152 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.186+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.187+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v124'1179 uv1179 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.187+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.188+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v124'1180 uv1180 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.191 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:48:22.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.189+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ed4e0 con 0x55c5ec73aa20 2024-08-19T00:48:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.190+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v124'1181 uv1181 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.190+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ed4e0 con 0x55c5ec73aa20 2024-08-19T00:48:22.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.191+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v124'1182 uv1182 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.191+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.193+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v124'1183 uv1183 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.193+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.195+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v124'1184 uv1158 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.195+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.197+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v124'1185 uv1185 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.197+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.200 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:48:22.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.198+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v124'1186 uv1186 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.198+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ed4e0 con 0x55c5ec73aa20 2024-08-19T00:48:22.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.199+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v124'1187 uv1187 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.199+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ed4e0 con 0x55c5ec73aa20 2024-08-19T00:48:22.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.201+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v124'1188 uv1188 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.201+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ec4d0 con 0x55c5ec73aa20 2024-08-19T00:48:22.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.202+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v124'1189 uv1189 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.202+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c5ec7ec9e0 0x55c5ec7eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.202+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ef310 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.203+0000 7fb623a00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c5ec7ec9e0 0x55c5ec7eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.203+0000 7fb623a00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c5ec7ec9e0 0x55c5ec7eedd0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.205+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v124'846 uv828 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.205+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ef6b0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.207+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v124'847 uv847 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.207+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7efa50 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.208+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v124'848 uv848 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.211 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:48:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.208+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7efdf0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.210+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v124'849 uv849 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.210+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0190 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.212+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v124'850 uv850 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.212+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0530 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.213+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v124'851 uv833 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.213+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f08d0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.215+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v124'852 uv852 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.215+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.219 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:48:22.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.216+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v124'853 uv853 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.216+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.218+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v124'854 uv854 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.218+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.220+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v124'855 uv855 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.220+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.221+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v124'856 uv838 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.221+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.223+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v124'857 uv857 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.223+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.224+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v124'858 uv858 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.227 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:48:22.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.224+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f5360 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.226+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v124'859 uv859 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.226+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f5360 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.228+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v124'860 uv860 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.228+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.229+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v124'861 uv844 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.229+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.231+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v124'862 uv862 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.231+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.234 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:48:22.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.232+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v124'863 uv863 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.232+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f1c80 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.234+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v124'864 uv864 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.234+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f1c80 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.235+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v124'865 uv865 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.235+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f0c70 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.237+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v124'866 uv866 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7ec9e0 2024-08-19T00:48:22.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.237+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c5ec7f1180 0x55c5ec7f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.237+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f3ab0 con 0x55c5ec7f1180 2024-08-19T00:48:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.237+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c5ec7f1180 0x55c5ec7f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.238+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c5ec7f1180 0x55c5ec7f3570 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.239+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v124'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.239+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f3e50 con 0x55c5ec7f1180 2024-08-19T00:48:22.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.240+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v124'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.240+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f42c0 con 0x55c5ec7f1180 2024-08-19T00:48:22.244 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:48:22.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.241+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v124'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.242+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f5b70 con 0x55c5ec7f1180 2024-08-19T00:48:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.243+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v124'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.243+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f5f10 con 0x55c5ec7f1180 2024-08-19T00:48:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.244+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v124'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.244+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f4b60 con 0x55c5ec7f1180 2024-08-19T00:48:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.245+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v124'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.245+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f4f50 con 0x55c5ec73aa20 2024-08-19T00:48:22.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.247+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v124'171 uv170 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.247+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f4f50 con 0x55c5ec73aa20 2024-08-19T00:48:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.249+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v124'172 uv172 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.249+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f4f50 con 0x55c5ec73aa20 2024-08-19T00:48:22.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.250+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v124'173 uv173 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.253 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:48:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.250+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f4f50 con 0x55c5ec73aa20 2024-08-19T00:48:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.251+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v124'174 uv174 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.251+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c5ec7f4f50 0x55c5ec7f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.251+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f8800 con 0x55c5ec7f4f50 2024-08-19T00:48:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.252+0000 7fb624400640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c5ec7f4f50 0x55c5ec7f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.253+0000 7fb624400640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c5ec7f4f50 0x55c5ec7f82c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.254+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v124'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.254+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f8800 con 0x55c5ec7f4f50 2024-08-19T00:48:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.255+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v124'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.255+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f8800 con 0x55c5ec7f4f50 2024-08-19T00:48:22.259 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:48:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.257+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v124'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.257+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f9c00 con 0x55c5ec7f4f50 2024-08-19T00:48:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.258+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v124'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.258+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f9c00 con 0x55c5ec7f4f50 2024-08-19T00:48:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.259+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v124'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.259+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7f8bf0 con 0x55c5ec7f4f50 2024-08-19T00:48:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.260+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v124'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.260+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c5ec7f9100 0x55c5ec7fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.260+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbac0 con 0x55c5ec7f9100 2024-08-19T00:48:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.261+0000 7fb623a00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c5ec7f9100 0x55c5ec7fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.261+0000 7fb623a00640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c5ec7f9100 0x55c5ec7fb4f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.263+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v124'415 uv409 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.263+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.264+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v124'416 uv416 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.264+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.268 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:48:22.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.266+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v124'417 uv417 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.266+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fcea0 con 0x55c5ec7f9100 2024-08-19T00:48:22.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.267+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v124'418 uv418 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.267+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fcea0 con 0x55c5ec7f9100 2024-08-19T00:48:22.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.269+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v124'419 uv419 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.269+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.270+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v124'420 uv420 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.270+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.271+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v124'421 uv414 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.271+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.273+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v124'422 uv422 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.273+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.277 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:48:22.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.274+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v124'423 uv423 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.274+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.276+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v124'424 uv424 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.276+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7fbe90 con 0x55c5ec7f9100 2024-08-19T00:48:22.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.278+0000 7fb623a00640 1 -- 172.21.15.7:0/903636441 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v124'425 uv425 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61408c0e0 con 0x55c5ec7f9100 2024-08-19T00:48:22.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.278+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c5ec7fc510 0x55c5ec7fe900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.278+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff000 con 0x55c5ec7fc510 2024-08-19T00:48:22.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.278+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c5ec7fc510 0x55c5ec7fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.278+0000 7fb623000640 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c5ec7fc510 0x55c5ec7fe900 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.280+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v124'188 uv187 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.280+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff3d0 con 0x55c5ec7fc510 2024-08-19T00:48:22.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.281+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v124'189 uv189 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.281+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec7fc510 2024-08-19T00:48:22.285 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:48:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.283+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v124'190 uv190 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.283+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec7fc510 2024-08-19T00:48:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.284+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v124'191 uv191 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.284+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec7fc510 2024-08-19T00:48:22.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.286+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v124'192 uv192 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.286+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec73aa20 2024-08-19T00:48:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.287+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v124'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.287+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec73aa20 2024-08-19T00:48:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.288+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v124'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.288+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec73aa20 2024-08-19T00:48:22.292 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:48:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.289+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v124'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.290+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec800840 con 0x55c5ec73aa20 2024-08-19T00:48:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.291+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v124'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.291+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec800800 con 0x55c5ec73aa20 2024-08-19T00:48:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.292+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v124'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.292+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec73aa20 2024-08-19T00:48:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.293+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v124'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec73aa20 2024-08-19T00:48:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.293+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec7f1180 2024-08-19T00:48:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.295+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v124'376 uv369 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.295+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec7f1180 2024-08-19T00:48:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.296+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v124'377 uv377 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.296+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff7f0 con 0x55c5ec7f1180 2024-08-19T00:48:22.300 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:48:22.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.297+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v124'378 uv378 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.297+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff890 con 0x55c5ec7f1180 2024-08-19T00:48:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.300+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v124'379 uv379 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.300+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffc50 con 0x55c5ec7f1180 2024-08-19T00:48:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.301+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v124'380 uv380 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.301+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffc50 con 0x55c5ec7f1180 2024-08-19T00:48:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.302+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v124'381 uv375 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.302+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff910 con 0x55c5ec7f1180 2024-08-19T00:48:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.304+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v124'382 uv382 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.304+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff910 con 0x55c5ec7f1180 2024-08-19T00:48:22.307 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:48:22.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.305+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v124'383 uv383 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.305+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff910 con 0x55c5ec7f1180 2024-08-19T00:48:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.306+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v124'384 uv384 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.306+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffdc0 con 0x55c5ec7f1180 2024-08-19T00:48:22.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.309+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v124'385 uv385 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7f1180 2024-08-19T00:48:22.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.309+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff910 con 0x55c5ec7f4f50 2024-08-19T00:48:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.310+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v124'167 uv165 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.310+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff910 con 0x55c5ec7f4f50 2024-08-19T00:48:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.312+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v124'168 uv168 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.312+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ff890 con 0x55c5ec7f4f50 2024-08-19T00:48:22.314 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:48:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.313+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v124'169 uv169 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.313+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7f4f50 2024-08-19T00:48:22.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.314+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v124'170 uv170 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.314+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7f4f50 2024-08-19T00:48:22.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.315+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v124'225 uv224 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.315+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7f4f50 2024-08-19T00:48:22.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.317+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v124'226 uv226 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.317+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7f4f50 2024-08-19T00:48:22.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.318+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v124'227 uv227 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.321 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:48:22.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.318+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7f4f50 2024-08-19T00:48:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.319+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v124'228 uv228 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.320+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7f4f50 2024-08-19T00:48:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.321+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v124'229 uv229 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.321+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7f4f50 2024-08-19T00:48:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.322+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v124'230 uv230 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb61c002660 con 0x55c5ec7f4f50 2024-08-19T00:48:22.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.322+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.324+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v124'191 uv190 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.324+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.325+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v124'192 uv192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.325+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.328 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:48:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.326+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v124'193 uv193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.326+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.327+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v124'194 uv194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.327+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.328+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v124'195 uv195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.328+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.330+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v124'468 uv459 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.330+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.332+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v124'469 uv469 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.332+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.336 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:48:22.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.333+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v124'470 uv470 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.333+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.335+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v124'471 uv471 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.335+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.336+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v124'472 uv472 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.336+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.338+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v124'473 uv466 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.338+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.339+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v124'474 uv474 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.339+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.340+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v124'475 uv475 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.343 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:48:22.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.340+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.342+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v124'476 uv476 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.342+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.343+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v124'477 uv477 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.343+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec7ffd40 con 0x55c5ec7fc510 2024-08-19T00:48:22.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.344+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v124'478 uv478 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.344+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55c5ec8005f0 con 0x55c5ec7fc510 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb623000640 1 -- 172.21.15.7:0/903636441 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v124'479 uv479 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fb610057030 con 0x55c5ec7fc510 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c5ec7ec9e0 msgr2=0x55c5ec7eedd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x55c5ec7ec9e0 0x55c5ec7eedd0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c5ec7f9100 msgr2=0x55c5ec7fb4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x55c5ec7f9100 0x55c5ec7fb4f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c5ec7fc510 msgr2=0x55c5ec7fe900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x55c5ec7fc510 0x55c5ec7fe900 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c5ec7f1180 msgr2=0x55c5ec7f3570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 reap_dead start 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x55c5ec7f1180 0x55c5ec7f3570 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c5ec73aa20 msgr2=0x55c5ec734920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x55c5ec73aa20 0x55c5ec734920 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c5ec7f4f50 msgr2=0x55c5ec7f82c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.346+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55c5ec7f4f50 0x55c5ec7f82c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb60406a840 msgr2=0x7fb60406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb60406a840 0x7fb60406cd00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb610057000 tx=0x7fb61005e040 comp rx=0 tx=0).stop 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 msgr2=0x55c5ec73f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 --2- 172.21.15.7:0/903636441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c5ec6a1f40 0x55c5ec73f0f0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fb614001ed0 tx=0x7fb614000ed0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb624400640 1 -- 172.21.15.7:0/903636441 reap_dead start 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 shutdown_connections 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 >> 172.21.15.7:0/903636441 conn(0x55c5ec6a04e0 msgr2=0x55c5ec7408d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 shutdown_connections 2024-08-19T00:48:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.347+0000 7fb62673cf40 1 -- 172.21.15.7:0/903636441 wait complete. 2024-08-19T00:48:22.354 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader mds0_sessionmap deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:48:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.470+0000 7f9028d21f40 1 Processor -- start 2024-08-19T00:48:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.470+0000 7f9028d21f40 1 -- start start 2024-08-19T00:48:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9028d21f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 0x55993b48b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9028d21f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b4823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9028d21f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 0x55993b481a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9028d21f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55993b3e38f0 con 0x55993b3e45b0 2024-08-19T00:48:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9028d21f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55993b358d00 con 0x55993b3e2f40 2024-08-19T00:48:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9028d21f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55993b489dc0 con 0x55993b3e4990 2024-08-19T00:48:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9024a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b4823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9024a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b4823d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59216/0 (socket says 172.21.15.7:59216) 2024-08-19T00:48:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9024a00640 1 -- 172.21.15.7:0/311685773 learned_addr learned my addr 172.21.15.7:0/311685773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9025400640 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 0x55993b48b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.471+0000 7f9025e00640 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 0x55993b481a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f9024a00640 1 -- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 msgr2=0x55993b481a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f9024a00640 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 0x55993b481a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f9024a00640 1 -- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 msgr2=0x55993b48b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f9024a00640 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 0x55993b48b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f9024a00640 1 -- 172.21.15.7:0/311685773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993b2ddb30 con 0x55993b3e45b0 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f9024a00640 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b4823d0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f901400b230 tx=0x7f901400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83a56b51b3f8013 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f901f400640 1 -- 172.21.15.7:0/311685773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901400e5c0 con 0x55993b3e45b0 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f901f400640 1 -- 172.21.15.7:0/311685773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9014006070 con 0x55993b3e45b0 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.472+0000 7f901f400640 1 -- 172.21.15.7:0/311685773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901400e9c0 con 0x55993b3e45b0 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 -- 172.21.15.7:0/311685773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 msgr2=0x55993b4823d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b4823d0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f901400b230 tx=0x7f901400b6f0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 -- 172.21.15.7:0/311685773 shutdown_connections 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 0x55993b481a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b4823d0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 --2- 172.21.15.7:0/311685773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 0x55993b48b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 -- 172.21.15.7:0/311685773 >> 172.21.15.7:0/311685773 conn(0x55993b3e14e0 msgr2=0x55993b3e0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 -- 172.21.15.7:0/311685773 shutdown_connections 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 -- 172.21.15.7:0/311685773 wait complete. 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.473+0000 7f9028d21f40 1 Processor -- start 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.474+0000 7f9028d21f40 1 -- start start 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.474+0000 7f9028d21f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 0x55993b3b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9028d21f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b3b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9028d21f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 0x55993b484c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9028d21f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55993b47ec80 con 0x55993b3e45b0 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9028d21f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55993b47d480 con 0x55993b3e2f40 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9028d21f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55993b3e02e0 con 0x55993b3e4990 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b3b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b3b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59226/0 (socket says 172.21.15.7:59226) 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 -- 172.21.15.7:0/377243454 learned_addr learned my addr 172.21.15.7:0/377243454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9025400640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 0x55993b3b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9025e00640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 0x55993b484c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 -- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 msgr2=0x55993b484c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55993b3e4990 0x55993b484c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 -- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 msgr2=0x55993b3b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55993b3e2f40 0x55993b3b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.475+0000 7f9024a00640 1 -- 172.21.15.7:0/377243454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993b31a080 con 0x55993b3e45b0 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.476+0000 7f9024a00640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b3b29e0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f9014001e90 tx=0x7f9014000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.476+0000 7f901e000640 1 -- 172.21.15.7:0/377243454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014020020 con 0x55993b3e45b0 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.476+0000 7f901e000640 1 -- 172.21.15.7:0/377243454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901400f450 con 0x55993b3e45b0 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.476+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55993b486f00 con 0x55993b3e45b0 2024-08-19T00:48:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.476+0000 7f901e000640 1 -- 172.21.15.7:0/377243454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901400f820 con 0x55993b3e45b0 2024-08-19T00:48:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.476+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55993b486c60 con 0x55993b3e45b0 2024-08-19T00:48:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.478+0000 7f901e000640 1 -- 172.21.15.7:0/377243454 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9014023020 con 0x55993b3e45b0 2024-08-19T00:48:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.479+0000 7f901e000640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f900806a840 0x7f900806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.479+0000 7f901e000640 1 -- 172.21.15.7:0/377243454 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7f901408c110 con 0x55993b3e45b0 2024-08-19T00:48:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.479+0000 7f9025400640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f900806a840 0x7f900806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.479+0000 7f9028d21f40 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55993b479df0 0x55993b485190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.479+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:1 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) -- 0x55993b4856d0 con 0x55993b479df0 2024-08-19T00:48:22.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.479+0000 7f9025e00640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55993b479df0 0x55993b485190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.480+0000 7f9025400640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f900806a840 0x7f900806cd00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9018057000 tx=0x7f9018061040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.480+0000 7f9025e00640 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55993b479df0 0x55993b485190 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.481+0000 7f9025e00640 1 -- 172.21.15.7:0/377243454 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(1 mds0_sessionmap [omap-set-header] v124'171 uv171 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f902000ab70 con 0x55993b479df0 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.481+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55993b479df0 msgr2=0x55993b485190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.481+0000 7f9028d21f40 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x55993b479df0 0x55993b485190 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f900806a840 msgr2=0x7f900806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f900806a840 0x7f900806cd00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9018057000 tx=0x7f9018061040 comp rx=0 tx=0).stop 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 msgr2=0x55993b3b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 --2- 172.21.15.7:0/377243454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55993b3e45b0 0x55993b3b29e0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f9014001e90 tx=0x7f9014000bc0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9025e00640 1 -- 172.21.15.7:0/377243454 reap_dead start 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 shutdown_connections 2024-08-19T00:48:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 >> 172.21.15.7:0/377243454 conn(0x55993b3e14e0 msgr2=0x55993b48c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:22.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 shutdown_connections 2024-08-19T00:48:22.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.482+0000 7f9028d21f40 1 -- 172.21.15.7:0/377243454 wait complete. 2024-08-19T00:48:22.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:48:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.646+0000 7f3553e00640 1 Processor -- start 2024-08-19T00:48:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.646+0000 7f3553e00640 1 -- start start 2024-08-19T00:48:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.647+0000 7f3553e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35540d27b0 0x7f35540d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.647+0000 7f3553e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f35540b4150 0x7f35540b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.647+0000 7f3553e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35540d3110 con 0x7f355415e3e0 2024-08-19T00:48:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.647+0000 7f3553e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f35540b4b20 con 0x7f35540b4150 2024-08-19T00:48:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.647+0000 7f3553e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35540b4df0 con 0x7f35540d27b0 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.647+0000 7f3553400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f35540b4150 0x7f35540b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.648+0000 7f3553400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f35540b4150 0x7f35540b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59228/0 (socket says 172.21.15.7:59228) 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.648+0000 7f3553400640 1 -- 172.21.15.7:0/1894544528 learned_addr learned my addr 172.21.15.7:0/1894544528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.648+0000 7f3552000640 1 --2- 172.21.15.7:0/1894544528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35540d27b0 0x7f35540d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.648+0000 7f3553400640 1 -- 172.21.15.7:0/1894544528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35540d27b0 msgr2=0x7f35540d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.648+0000 7f3553400640 1 --2- 172.21.15.7:0/1894544528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35540d27b0 0x7f35540d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.648+0000 7f3553400640 1 -- 172.21.15.7:0/1894544528 >> v1:172.21.15.162:6789/0 conn(0x7f355415e3e0 legacy=0x7f35540b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.648+0000 7f3553400640 1 -- 172.21.15.7:0/1894544528 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35540b50d0 con 0x7f35540b4150 2024-08-19T00:48:22.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.649+0000 7f3553400640 1 --2- 172.21.15.7:0/1894544528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f35540b45e0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f354c009e50 tx=0x7f354c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92165617a8854aaf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.649+0000 7f3551600640 1 -- 172.21.15.7:0/1894544528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c036070 con 0x7f35540b4150 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.649+0000 7f3551600640 1 -- 172.21.15.7:0/1894544528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c031600 con 0x7f35540b4150 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.649+0000 7f3551600640 1 -- 172.21.15.7:0/1894544528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0319d0 con 0x7f35540b4150 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 -- 172.21.15.7:0/1894544528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 msgr2=0x7f35540b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 --2- 172.21.15.7:0/1894544528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f35540b45e0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f354c009e50 tx=0x7f354c02a710 comp rx=0 tx=0).stop 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 -- 172.21.15.7:0/1894544528 shutdown_connections 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 --2- 172.21.15.7:0/1894544528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f35540b45e0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 --2- 172.21.15.7:0/1894544528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35540d27b0 0x7f35540d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 -- 172.21.15.7:0/1894544528 >> 172.21.15.7:0/1894544528 conn(0x7f355408dbe0 msgr2=0x7f355409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 -- 172.21.15.7:0/1894544528 shutdown_connections 2024-08-19T00:48:22.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.650+0000 7f3553e00640 1 -- 172.21.15.7:0/1894544528 wait complete. 2024-08-19T00:48:22.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.651+0000 7f3553e00640 1 Processor -- start 2024-08-19T00:48:22.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.652+0000 7f3553e00640 1 -- start start 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.652+0000 7f3553e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f3554157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.652+0000 7f3553e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35540d27b0 0x7f35540b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3553e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355415e3e0 0x7f35540b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3553e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35540cee90 con 0x7f35540b4150 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3553e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35540cf4c0 con 0x7f35540d27b0 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3553e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35540cf9e0 con 0x7f355415e3e0 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f3554157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f3554157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59244/0 (socket says 172.21.15.7:59244) 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 -- 172.21.15.7:0/2889210582 learned_addr learned my addr 172.21.15.7:0/2889210582 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:22.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552000640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35540d27b0 0x7f35540b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3553400640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355415e3e0 0x7f35540b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 -- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355415e3e0 msgr2=0x7f35540b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355415e3e0 0x7f35540b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 -- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35540d27b0 msgr2=0x7f35540b9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35540d27b0 0x7f35540b9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.653+0000 7f3552a00640 1 -- 172.21.15.7:0/2889210582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3554160bb0 con 0x7f35540b4150 2024-08-19T00:48:22.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.654+0000 7f3552a00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f3554157020 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f354400c3c0 tx=0x7f354400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.654+0000 7f354aa00640 1 -- 172.21.15.7:0/2889210582 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440052d0 con 0x7f35540b4150 2024-08-19T00:48:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.654+0000 7f354aa00640 1 -- 172.21.15.7:0/2889210582 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3544005490 con 0x7f35540b4150 2024-08-19T00:48:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.654+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3554160e90 con 0x7f35540b4150 2024-08-19T00:48:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.654+0000 7f354aa00640 1 -- 172.21.15.7:0/2889210582 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544007260 con 0x7f35540b4150 2024-08-19T00:48:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.654+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3554161450 con 0x7f35540b4150 2024-08-19T00:48:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.655+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35540b45e0 con 0x7f35540b4150 2024-08-19T00:48:22.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.656+0000 7f354aa00640 1 -- 172.21.15.7:0/2889210582 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3544007400 con 0x7f35540b4150 2024-08-19T00:48:22.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.657+0000 7f354aa00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f353406be30 0x7f353406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:22.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.657+0000 7f354aa00640 1 -- 172.21.15.7:0/2889210582 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 8977+0+0 (secure 0 0 0) 0x7f354408af80 con 0x7f35540b4150 2024-08-19T00:48:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.657+0000 7f3552000640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f353406be30 0x7f353406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.658+0000 7f3552000640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f353406be30 0x7f353406e2f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f35540cb3b0 tx=0x7f3540009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.661+0000 7f354aa00640 1 -- 172.21.15.7:0/2889210582 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f35440585f0 con 0x7f35540b4150 2024-08-19T00:48:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:22.881+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f3554157c30 con 0x7f35540b4150 2024-08-19T00:48:23.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.043+0000 7f354aa00640 1 -- 172.21.15.7:0/2889210582 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v326) ==== 162+0+0 (secure 0 0 0) 0x7f354405c8f0 con 0x7f35540b4150 2024-08-19T00:48:23.046 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:48:23.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.045+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f353406be30 msgr2=0x7f353406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.045+0000 7f3553e00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f353406be30 0x7f353406e2f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f35540cb3b0 tx=0x7f3540009190 comp rx=0 tx=0).stop 2024-08-19T00:48:23.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.045+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 msgr2=0x7f3554157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.045+0000 7f3553e00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f3554157020 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f354400c3c0 tx=0x7f354400c880 comp rx=0 tx=0).stop 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 shutdown_connections 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f353406be30 0x7f353406e2f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355415e3e0 0x7f35540b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35540d27b0 0x7f35540b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 --2- 172.21.15.7:0/2889210582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35540b4150 0x7f3554157020 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 >> 172.21.15.7:0/2889210582 conn(0x7f355408dbe0 msgr2=0x7f3554074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 shutdown_connections 2024-08-19T00:48:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.046+0000 7f3553e00640 1 -- 172.21.15.7:0/2889210582 wait complete. 2024-08-19T00:48:23.055 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-08-19T00:48:23.053+0000 7f29a8400640 -1 log_channel(cluster) log [ERR] : corrupt sessionmap header: Decoder at 'virtual void SessionMapStore::decode_header(ceph::bufferlist&)' v=1 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:48:23.056 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:23.054+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:48:23.056 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:23.054+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:48:23.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.225+0000 7f9828a00640 1 Processor -- start 2024-08-19T00:48:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.225+0000 7f9828a00640 1 -- start start 2024-08-19T00:48:23.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9828a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f982415e360 0x7f982415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9828a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f982415ee50 0x7f98240d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9828a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98240b3ab0 con 0x7f98240d2af0 2024-08-19T00:48:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9828a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f982415f460 con 0x7f982415ee50 2024-08-19T00:48:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9828a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f982415f740 con 0x7f982415e360 2024-08-19T00:48:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9823e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f982415ee50 0x7f98240d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9823e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f982415ee50 0x7f98240d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59254/0 (socket says 172.21.15.7:59254) 2024-08-19T00:48:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9823e00640 1 -- 172.21.15.7:0/3763278375 learned_addr learned my addr 172.21.15.7:0/3763278375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9823e00640 1 -- 172.21.15.7:0/3763278375 >> v2:172.21.15.162:3300/0 conn(0x7f982415e360 msgr2=0x7f982415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9823e00640 1 --2- 172.21.15.7:0/3763278375 >> v2:172.21.15.162:3300/0 conn(0x7f982415e360 0x7f982415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.226+0000 7f9823e00640 1 -- 172.21.15.7:0/3763278375 >> v1:172.21.15.162:6789/0 conn(0x7f98240d2af0 legacy=0x7f982415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.227+0000 7f9823e00640 1 -- 172.21.15.7:0/3763278375 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98240b3d60 con 0x7f982415ee50 2024-08-19T00:48:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.227+0000 7f9823e00640 1 --2- 172.21.15.7:0/3763278375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240d2f80 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f982408e8a0 tx=0x7f981c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1231c05c37d1448e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9822a00640 1 -- 172.21.15.7:0/3763278375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c036070 con 0x7f982415ee50 2024-08-19T00:48:23.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9822a00640 1 -- 172.21.15.7:0/3763278375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981c031600 con 0x7f982415ee50 2024-08-19T00:48:23.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9822a00640 1 -- 172.21.15.7:0/3763278375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c0319d0 con 0x7f982415ee50 2024-08-19T00:48:23.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9828a00640 1 -- 172.21.15.7:0/3763278375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 msgr2=0x7f98240d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9828a00640 1 --2- 172.21.15.7:0/3763278375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240d2f80 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f982408e8a0 tx=0x7f981c02a6f0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9828a00640 1 -- 172.21.15.7:0/3763278375 shutdown_connections 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9828a00640 1 --2- 172.21.15.7:0/3763278375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240d2f80 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9828a00640 1 --2- 172.21.15.7:0/3763278375 >> v2:172.21.15.162:3300/0 conn(0x7f982415e360 0x7f982415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.228+0000 7f9828a00640 1 -- 172.21.15.7:0/3763278375 >> 172.21.15.7:0/3763278375 conn(0x7f982408dbf0 msgr2=0x7f982409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.229+0000 7f9828a00640 1 -- 172.21.15.7:0/3763278375 shutdown_connections 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.229+0000 7f9828a00640 1 -- 172.21.15.7:0/3763278375 wait complete. 2024-08-19T00:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.230+0000 7f9828a00640 1 Processor -- start 2024-08-19T00:48:23.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.230+0000 7f9828a00640 1 -- start start 2024-08-19T00:48:23.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9828a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98240d2af0 0x7f98241621d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9828a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982415e360 0x7f98240cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9828a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9828a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98240b4560 con 0x7f982415ee50 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9828a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98240d2300 con 0x7f98240d2af0 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9828a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f98240b46e0 con 0x7f982415e360 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9823e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9823e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59264/0 (socket says 172.21.15.7:59264) 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9823e00640 1 -- 172.21.15.7:0/3163246781 learned_addr learned my addr 172.21.15.7:0/3163246781 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.231+0000 7f9823400640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98240d2af0 0x7f98241621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f981be00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982415e360 0x7f98240cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f9823e00640 1 -- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982415e360 msgr2=0x7f98240cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f9823e00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982415e360 0x7f98240cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f9823e00640 1 -- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98240d2af0 msgr2=0x7f98241621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f9823e00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98240d2af0 0x7f98241621d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f9823e00640 1 -- 172.21.15.7:0/3163246781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98240cfe50 con 0x7f982415ee50 2024-08-19T00:48:23.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f981be00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982415e360 0x7f98240cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:23.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f9823e00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240cbe50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f981c034040 tx=0x7f981c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f981b400640 1 -- 172.21.15.7:0/3163246781 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c041020 con 0x7f982415ee50 2024-08-19T00:48:23.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f981b400640 1 -- 172.21.15.7:0/3163246781 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981c007780 con 0x7f982415ee50 2024-08-19T00:48:23.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f981b400640 1 -- 172.21.15.7:0/3163246781 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c036040 con 0x7f982415ee50 2024-08-19T00:48:23.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.232+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98240ccd90 con 0x7f982415ee50 2024-08-19T00:48:23.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.233+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98240cc7d0 con 0x7f982415ee50 2024-08-19T00:48:23.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.235+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98240d0020 con 0x7f982415ee50 2024-08-19T00:48:23.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.236+0000 7f981b400640 1 -- 172.21.15.7:0/3163246781 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f981c044020 con 0x7f982415ee50 2024-08-19T00:48:23.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.237+0000 7f981b400640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f980006be30 0x7f980006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.237+0000 7f981b400640 1 -- 172.21.15.7:0/3163246781 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f981c0ac910 con 0x7f982415ee50 2024-08-19T00:48:23.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.237+0000 7f9823400640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f980006be30 0x7f980006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.237+0000 7f9823400640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f980006be30 0x7f980006e2f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9814009990 tx=0x7f9814009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.240+0000 7f981b400640 1 -- 172.21.15.7:0/3163246781 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f981c04b030 con 0x7f982415ee50 2024-08-19T00:48:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.466+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f982415fab0 con 0x7f982415ee50 2024-08-19T00:48:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.467+0000 7f981b400640 1 -- 172.21.15.7:0/3163246781 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 328 v328) ==== 95+0+4393 (secure 0 0 0) 0x7f981c07a550 con 0x7f982415ee50 2024-08-19T00:48:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:23.470 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":328,"btime":"2024-08-19T00:48:23:055601+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":328,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:23.055522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 328 2024-08-19T00:48:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f980006be30 msgr2=0x7f980006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f980006be30 0x7f980006e2f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9814009990 tx=0x7f9814009110 comp rx=0 tx=0).stop 2024-08-19T00:48:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 msgr2=0x7f98240cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240cbe50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f981c034040 tx=0x7f981c004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 shutdown_connections 2024-08-19T00:48:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f980006be30 0x7f980006e2f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982415ee50 0x7f98240cbe50 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982415e360 0x7f98240cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 --2- 172.21.15.7:0/3163246781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98240d2af0 0x7f98241621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 >> 172.21.15.7:0/3163246781 conn(0x7f982408dbf0 msgr2=0x7f9824160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.469+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 shutdown_connections 2024-08-19T00:48:23.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.470+0000 7f9828a00640 1 -- 172.21.15.7:0/3163246781 wait complete. 2024-08-19T00:48:23.488 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:48:23.488 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:23.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.645+0000 7f7f8fa00640 1 Processor -- start 2024-08-19T00:48:23.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.645+0000 7f7f8fa00640 1 -- start start 2024-08-19T00:48:23.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880d0ad0 0x7f7f8816d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8fa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8806e660 con 0x7f7f880aeb10 2024-08-19T00:48:23.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8fa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8806e940 con 0x7f7f880ce460 2024-08-19T00:48:23.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f880ae000 con 0x7f7f880d0ad0 2024-08-19T00:48:23.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8d000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7f880aeb10 0x7f7f880cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48164/0 (socket says 172.21.15.7:48164) 2024-08-19T00:48:23.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8d000640 1 -- 172.21.15.7:0/3461655556 learned_addr learned my addr 172.21.15.7:0/3461655556 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:23.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8da00640 1 --2- 172.21.15.7:0/3461655556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880d0ad0 0x7f7f8816d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f87400640 1 -- 172.21.15.7:0/3461655556 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768419874 0 0) 0x7f7f8806e660 con 0x7f7f880aeb10 2024-08-19T00:48:23.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f87400640 1 -- 172.21.15.7:0/3461655556 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f70003520 con 0x7f7f880aeb10 2024-08-19T00:48:23.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f87400640 1 -- 172.21.15.7:0/3461655556 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101167119 0 0) 0x7f7f8806e940 con 0x7f7f880ce460 2024-08-19T00:48:23.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f87400640 1 -- 172.21.15.7:0/3461655556 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f8806e660 con 0x7f7f880ce460 2024-08-19T00:48:23.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8da00640 1 -- 172.21.15.7:0/3461655556 >> v1:172.21.15.162:6789/0 conn(0x7f7f880ce460 legacy=0x7f7f880d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8da00640 1 -- 172.21.15.7:0/3461655556 >> v1:172.21.15.7:6789/0 conn(0x7f7f880aeb10 legacy=0x7f7f880cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.646+0000 7f7f8da00640 1 -- 172.21.15.7:0/3461655556 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8806ec20 con 0x7f7f880d0ad0 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.647+0000 7f7f8da00640 1 --2- 172.21.15.7:0/3461655556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880d0ad0 0x7f7f8816d4f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009dc0 tx=0x7f7f8002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d72bece9b0ba7b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f87400640 1 -- 172.21.15.7:0/3461655556 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80007740 con 0x7f7f880d0ad0 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f87400640 1 -- 172.21.15.7:0/3461655556 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f800078e0 con 0x7f7f880d0ad0 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f87400640 1 -- 172.21.15.7:0/3461655556 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80007cb0 con 0x7f7f880d0ad0 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f8fa00640 1 -- 172.21.15.7:0/3461655556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880d0ad0 msgr2=0x7f7f8816d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/3461655556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880d0ad0 0x7f7f8816d4f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009dc0 tx=0x7f7f8002a6d0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f8fa00640 1 -- 172.21.15.7:0/3461655556 shutdown_connections 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/3461655556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880d0ad0 0x7f7f8816d4f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f8fa00640 1 -- 172.21.15.7:0/3461655556 >> 172.21.15.7:0/3461655556 conn(0x7f7f8806bc70 msgr2=0x7f7f8806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:23.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f8fa00640 1 -- 172.21.15.7:0/3461655556 shutdown_connections 2024-08-19T00:48:23.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.648+0000 7f7f8fa00640 1 -- 172.21.15.7:0/3461655556 wait complete. 2024-08-19T00:48:23.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.651+0000 7f7f8fa00640 1 Processor -- start 2024-08-19T00:48:23.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.651+0000 7f7f8fa00640 1 -- start start 2024-08-19T00:48:23.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880aeb10 0x7f7f8815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f880ce460 0x7f7f8815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f880d0ad0 0x7f7f8815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8fa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8806f700 con 0x7f7f880ce460 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8806f1e0 con 0x7f7f880d0ad0 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f881ebab0 con 0x7f7f880aeb10 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f87e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f880ce460 0x7f7f8815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8d000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880aeb10 0x7f7f8815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f87e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f880ce460 0x7f7f8815a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59268/0 (socket says 172.21.15.7:59268) 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f87e00640 1 -- 172.21.15.7:0/1497194675 learned_addr learned my addr 172.21.15.7:0/1497194675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8da00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f880d0ad0 0x7f7f8815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8d000640 1 -- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f880d0ad0 msgr2=0x7f7f8815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8d000640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f880d0ad0 0x7f7f8815ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8d000640 1 -- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f880ce460 msgr2=0x7f7f8815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8d000640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f880ce460 0x7f7f8815a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8d000640 1 -- 172.21.15.7:0/1497194675 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f881ebd90 con 0x7f7f880aeb10 2024-08-19T00:48:23.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f87e00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f880ce460 0x7f7f8815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:23.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8d000640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880aeb10 0x7f7f8815a360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c390 tx=0x7f7f7c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f84c00640 1 -- 172.21.15.7:0/1497194675 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c017070 con 0x7f7f880aeb10 2024-08-19T00:48:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f84c00640 1 -- 172.21.15.7:0/1497194675 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7c005ce0 con 0x7f7f880aeb10 2024-08-19T00:48:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.652+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f881ec070 con 0x7f7f880aeb10 2024-08-19T00:48:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.653+0000 7f7f84c00640 1 -- 172.21.15.7:0/1497194675 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0072d0 con 0x7f7f880aeb10 2024-08-19T00:48:23.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.653+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8815b520 con 0x7f7f880aeb10 2024-08-19T00:48:23.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.654+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8806df50 con 0x7f7f880aeb10 2024-08-19T00:48:23.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.655+0000 7f7f84c00640 1 -- 172.21.15.7:0/1497194675 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f7c01a070 con 0x7f7f880aeb10 2024-08-19T00:48:23.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.656+0000 7f7f84c00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f6806be30 0x7f7f6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.656+0000 7f7f84c00640 1 -- 172.21.15.7:0/1497194675 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f7f7c08aec0 con 0x7f7f880aeb10 2024-08-19T00:48:23.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.656+0000 7f7f87e00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f6806be30 0x7f7f6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.656+0000 7f7f87e00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f6806be30 0x7f7f6806e2f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7f881ec800 tx=0x7f7f74009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.661+0000 7f7f84c00640 1 -- 172.21.15.7:0/1497194675 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7f8806df50 con 0x7f7f880aeb10 2024-08-19T00:48:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.880+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f880cf3c0 con 0x7f7f880aeb10 2024-08-19T00:48:23.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.882+0000 7f7f84c00640 1 -- 172.21.15.7:0/1497194675 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 328 v328) ==== 95+0+4393 (secure 0 0 0) 0x7f7f7c058450 con 0x7f7f880aeb10 2024-08-19T00:48:23.884 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:23.884 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":328,"btime":"2024-08-19T00:48:23:055601+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":328,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:23.055522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:23.884 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 328 2024-08-19T00:48:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f6806be30 msgr2=0x7f7f6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f6806be30 0x7f7f6806e2f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7f881ec800 tx=0x7f7f74009040 comp rx=0 tx=0).stop 2024-08-19T00:48:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880aeb10 msgr2=0x7f7f8815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880aeb10 0x7f7f8815a360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c390 tx=0x7f7f7c00c850 comp rx=0 tx=0).stop 2024-08-19T00:48:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 shutdown_connections 2024-08-19T00:48:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f7f6806be30 0x7f7f6806e2f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f880d0ad0 0x7f7f8815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f880ce460 0x7f7f8815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 --2- 172.21.15.7:0/1497194675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f880aeb10 0x7f7f8815a360 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 >> 172.21.15.7:0/1497194675 conn(0x7f7f8806bc70 msgr2=0x7f7f880aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 shutdown_connections 2024-08-19T00:48:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:23.884+0000 7f7f8fa00640 1 -- 172.21.15.7:0/1497194675 wait complete. 2024-08-19T00:48:23.902 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:48:23.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:24.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.059+0000 7f6c85e00640 1 Processor -- start 2024-08-19T00:48:24.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.060+0000 7f6c85e00640 1 -- start start 2024-08-19T00:48:24.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.061+0000 7f6c85e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c800cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.061+0000 7f6c85e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c800cdfb0 con 0x7f6c8006e710 2024-08-19T00:48:24.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.061+0000 7f6c85e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c800ce290 con 0x7f6c800d03c0 2024-08-19T00:48:24.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.061+0000 7f6c85e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c800cebc0 con 0x7f6c80071980 2024-08-19T00:48:24.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.061+0000 7f6c77e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6c8006e710 0x7f6c800b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40966/0 (socket says 172.21.15.7:40966) 2024-08-19T00:48:24.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.061+0000 7f6c77e00640 1 -- 172.21.15.7:0/2512150397 learned_addr learned my addr 172.21.15.7:0/2512150397 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:24.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.061+0000 7f6c7f400640 1 --2- 172.21.15.7:0/2512150397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c800cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.062+0000 7f6c7e000640 1 -- 172.21.15.7:0/2512150397 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537884569 0 0) 0x7f6c800cdfb0 con 0x7f6c8006e710 2024-08-19T00:48:24.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.062+0000 7f6c7e000640 1 -- 172.21.15.7:0/2512150397 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c64003520 con 0x7f6c8006e710 2024-08-19T00:48:24.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.062+0000 7f6c7e000640 1 -- 172.21.15.7:0/2512150397 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184281599 0 0) 0x7f6c800ce290 con 0x7f6c800d03c0 2024-08-19T00:48:24.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.062+0000 7f6c7f400640 1 -- 172.21.15.7:0/2512150397 >> v1:172.21.15.162:6789/0 conn(0x7f6c800d03c0 legacy=0x7f6c800d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.062+0000 7f6c7f400640 1 -- 172.21.15.7:0/2512150397 >> v1:172.21.15.7:6789/0 conn(0x7f6c8006e710 legacy=0x7f6c800b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.062+0000 7f6c7f400640 1 -- 172.21.15.7:0/2512150397 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c800ce570 con 0x7f6c80071980 2024-08-19T00:48:24.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.063+0000 7f6c7f400640 1 --2- 172.21.15.7:0/2512150397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c800cf050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009df0 tx=0x7f6c7802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3934d1ac90ca53 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:24.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.063+0000 7f6c7e000640 1 -- 172.21.15.7:0/2512150397 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78007740 con 0x7f6c80071980 2024-08-19T00:48:24.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.063+0000 7f6c7e000640 1 -- 172.21.15.7:0/2512150397 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c780078e0 con 0x7f6c80071980 2024-08-19T00:48:24.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.063+0000 7f6c7e000640 1 -- 172.21.15.7:0/2512150397 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78007cb0 con 0x7f6c80071980 2024-08-19T00:48:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.064+0000 7f6c85e00640 1 -- 172.21.15.7:0/2512150397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 msgr2=0x7f6c800cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.064+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2512150397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c800cf050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009df0 tx=0x7f6c7802a710 comp rx=0 tx=0).stop 2024-08-19T00:48:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.064+0000 7f6c85e00640 1 -- 172.21.15.7:0/2512150397 shutdown_connections 2024-08-19T00:48:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.064+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2512150397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c800cf050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.064+0000 7f6c85e00640 1 -- 172.21.15.7:0/2512150397 >> 172.21.15.7:0/2512150397 conn(0x7f6c8006bc70 msgr2=0x7f6c8006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.064+0000 7f6c85e00640 1 -- 172.21.15.7:0/2512150397 shutdown_connections 2024-08-19T00:48:24.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.064+0000 7f6c85e00640 1 -- 172.21.15.7:0/2512150397 wait complete. 2024-08-19T00:48:24.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.066+0000 7f6c85e00640 1 Processor -- start 2024-08-19T00:48:24.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.066+0000 7f6c85e00640 1 -- start start 2024-08-19T00:48:24.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c85e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c8006e710 0x7f6c801f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c85e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c8009bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c85e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c800d03c0 0x7f6c8009c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c85e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80073c60 con 0x7f6c800d03c0 2024-08-19T00:48:24.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c85e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80073ae0 con 0x7f6c8006e710 2024-08-19T00:48:24.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c85e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c800cf590 con 0x7f6c80071980 2024-08-19T00:48:24.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c800d03c0 0x7f6c8009c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c800d03c0 0x7f6c8009c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44158/0 (socket says 172.21.15.7:44158) 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 -- 172.21.15.7:0/2108969816 learned_addr learned my addr 172.21.15.7:0/2108969816 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7ea00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c8006e710 0x7f6c801f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c77e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c8009bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 -- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 msgr2=0x7f6c8009bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c8009bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 -- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c8006e710 msgr2=0x7f6c801f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c8006e710 0x7f6c801f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c7f400640 1 -- 172.21.15.7:0/2108969816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c80155e10 con 0x7f6c800d03c0 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.067+0000 7f6c77e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c8009bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.068+0000 7f6c7f400640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c800d03c0 0x7f6c8009c490 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009df0 tx=0x7f6c78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.068+0000 7f6c77400640 1 -- 172.21.15.7:0/2108969816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78040070 con 0x7f6c800d03c0 2024-08-19T00:48:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.068+0000 7f6c77400640 1 -- 172.21.15.7:0/2108969816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c78031b40 con 0x7f6c800d03c0 2024-08-19T00:48:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.068+0000 7f6c77400640 1 -- 172.21.15.7:0/2108969816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78009450 con 0x7f6c800d03c0 2024-08-19T00:48:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.068+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8009adc0 con 0x7f6c800d03c0 2024-08-19T00:48:24.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.068+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8009b380 con 0x7f6c800d03c0 2024-08-19T00:48:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.069+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c800b0220 con 0x7f6c800d03c0 2024-08-19T00:48:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.070+0000 7f6c77400640 1 -- 172.21.15.7:0/2108969816 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c78039040 con 0x7f6c800d03c0 2024-08-19T00:48:24.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.071+0000 7f6c77400640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c5c06be60 0x7f6c5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.071+0000 7f6c77400640 1 -- 172.21.15.7:0/2108969816 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f6c780acff0 con 0x7f6c800d03c0 2024-08-19T00:48:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.071+0000 7f6c7ea00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c5c06be60 0x7f6c5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.072+0000 7f6c7ea00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c5c06be60 0x7f6c5c06e320 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6c70000f60 tx=0x7f6c70009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:24.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.076+0000 7f6c77400640 1 -- 172.21.15.7:0/2108969816 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6c800b0220 con 0x7f6c800d03c0 2024-08-19T00:48:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.300+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c800b15f0 con 0x7f6c800d03c0 2024-08-19T00:48:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.301+0000 7f6c77400640 1 -- 172.21.15.7:0/2108969816 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 328 v328) ==== 95+0+4393 (secure 0 0 0) 0x7f6c800b15f0 con 0x7f6c800d03c0 2024-08-19T00:48:24.302 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:24.303 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":328,"btime":"2024-08-19T00:48:23:055601+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":9591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":274}],"filesystems":[{"mdsmap":{"epoch":328,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:23.055522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 328 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c5c06be60 msgr2=0x7f6c5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c5c06be60 0x7f6c5c06e320 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6c70000f60 tx=0x7f6c70009040 comp rx=0 tx=0).stop 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c800d03c0 msgr2=0x7f6c8009c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c800d03c0 0x7f6c8009c490 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009df0 tx=0x7f6c78004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 shutdown_connections 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6c5c06be60 0x7f6c5c06e320 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c800d03c0 0x7f6c8009c490 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c80071980 0x7f6c8009bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 --2- 172.21.15.7:0/2108969816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c8006e710 0x7f6c801f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 >> 172.21.15.7:0/2108969816 conn(0x7f6c8006bc70 msgr2=0x7f6c800af200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 shutdown_connections 2024-08-19T00:48:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.303+0000 7f6c85e00640 1 -- 172.21.15.7:0/2108969816 wait complete. 2024-08-19T00:48:24.320 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on mds0_sessionmap' led to DAMAGED state 2024-08-19T00:48:24.320 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 1.00000000' 2024-08-19T00:48:24.321 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:24.321 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:24.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:48:24.357 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:48:24.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:24.357 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:48:24.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:48:24.434 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-19T00:48:24.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:48:24.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.630+0000 7f3975200640 1 Processor -- start 2024-08-19T00:48:24.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.630+0000 7f3975200640 1 -- start start 2024-08-19T00:48:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.631+0000 7f3975200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f397006fc10 0x7f397006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.631+0000 7f3975200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f397006fff0 0x7f39700b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.631+0000 7f3975200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39700b5450 0x7f397015e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.631+0000 7f3975200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3970162d90 con 0x7f397006fff0 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.631+0000 7f3975200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f397006d850 con 0x7f397006fc10 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.631+0000 7f3975200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39700b58e0 con 0x7f39700b5450 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f397006fff0 0x7f39700b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f397006fff0 0x7f39700b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44168/0 (socket says 172.21.15.7:44168) 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 -- 172.21.15.7:0/758880257 learned_addr learned my addr 172.21.15.7:0/758880257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f396fe00640 1 --2- 172.21.15.7:0/758880257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39700b5450 0x7f397015e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f396f400640 1 --2- 172.21.15.7:0/758880257 >> v2:172.21.15.162:3300/0 conn(0x7f397006fc10 0x7f397006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 -- 172.21.15.7:0/758880257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39700b5450 msgr2=0x7f397015e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 --2- 172.21.15.7:0/758880257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39700b5450 0x7f397015e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 -- 172.21.15.7:0/758880257 >> v2:172.21.15.162:3300/0 conn(0x7f397006fc10 msgr2=0x7f397006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 --2- 172.21.15.7:0/758880257 >> v2:172.21.15.162:3300/0 conn(0x7f397006fc10 0x7f397006dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f3967e00640 1 -- 172.21.15.7:0/758880257 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397006cf60 con 0x7f397006fff0 2024-08-19T00:48:24.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.632+0000 7f396f400640 1 --2- 172.21.15.7:0/758880257 >> v2:172.21.15.162:3300/0 conn(0x7f397006fc10 0x7f397006dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.633+0000 7f3967e00640 1 --2- 172.21.15.7:0/758880257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fff0 0x7f39700b4f10 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f3970068f20 tx=0x7f395802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9207ca6432d44ff server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.633+0000 7f396ea00640 1 -- 172.21.15.7:0/758880257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958037070 con 0x7f397006fff0 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f396ea00640 1 -- 172.21.15.7:0/758880257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3958032440 con 0x7f397006fff0 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f396ea00640 1 -- 172.21.15.7:0/758880257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958032810 con 0x7f397006fff0 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 -- 172.21.15.7:0/758880257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fff0 msgr2=0x7f39700b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 --2- 172.21.15.7:0/758880257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fff0 0x7f39700b4f10 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f3970068f20 tx=0x7f395802a140 comp rx=0 tx=0).stop 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 -- 172.21.15.7:0/758880257 shutdown_connections 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 --2- 172.21.15.7:0/758880257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39700b5450 0x7f397015e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 --2- 172.21.15.7:0/758880257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fff0 0x7f39700b4f10 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 --2- 172.21.15.7:0/758880257 >> v2:172.21.15.162:3300/0 conn(0x7f397006fc10 0x7f397006dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 -- 172.21.15.7:0/758880257 >> 172.21.15.7:0/758880257 conn(0x7f39700d1fa0 msgr2=0x7f39700d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 -- 172.21.15.7:0/758880257 shutdown_connections 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.634+0000 7f3975200640 1 -- 172.21.15.7:0/758880257 wait complete. 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.636+0000 7f3975200640 1 Processor -- start 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.636+0000 7f3975200640 1 -- start start 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f3975200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fc10 0x7f397015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f3975200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397006fff0 0x7f39700cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f3975200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39700b5450 0x7f39700cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f3975200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39700b5b60 con 0x7f397006fc10 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f3975200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f397006d4e0 con 0x7f39700b5450 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f3975200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3970147ee0 con 0x7f397006fff0 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f396f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fc10 0x7f397015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f396f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fc10 0x7f397015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44182/0 (socket says 172.21.15.7:44182) 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f396f400640 1 -- 172.21.15.7:0/3932297374 learned_addr learned my addr 172.21.15.7:0/3932297374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f3967e00640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397006fff0 0x7f39700cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f396fe00640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39700b5450 0x7f39700cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f396f400640 1 -- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397006fff0 msgr2=0x7f39700cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.637+0000 7f396f400640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397006fff0 0x7f39700cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f396f400640 1 -- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39700b5450 msgr2=0x7f39700cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f396f400640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39700b5450 0x7f39700cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f396f400640 1 -- 172.21.15.7:0/3932297374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397013d680 con 0x7f397006fc10 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f3967e00640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397006fff0 0x7f39700cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f396f400640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fc10 0x7f397015db90 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f396000c7c0 tx=0x7f396000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f3967400640 1 -- 172.21.15.7:0/3932297374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960015070 con 0x7f397006fc10 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f3967400640 1 -- 172.21.15.7:0/3932297374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960007a30 con 0x7f397006fc10 2024-08-19T00:48:24.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f3967400640 1 -- 172.21.15.7:0/3932297374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960007e00 con 0x7f397006fc10 2024-08-19T00:48:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397013d960 con 0x7f397006fc10 2024-08-19T00:48:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.638+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397015e0d0 con 0x7f397006fc10 2024-08-19T00:48:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.639+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397013db30 con 0x7f397006fc10 2024-08-19T00:48:24.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.640+0000 7f3967400640 1 -- 172.21.15.7:0/3932297374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3960018070 con 0x7f397006fc10 2024-08-19T00:48:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.641+0000 7f3967400640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.642+0000 7f3967400640 1 -- 172.21.15.7:0/3932297374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f396008bb10 con 0x7f397006fc10 2024-08-19T00:48:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.642+0000 7f3967e00640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:24.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.643+0000 7f3967e00640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3958034000 tx=0x7f395802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:24.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.646+0000 7f3967400640 1 -- 172.21.15.7:0/3932297374 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3960059780 con 0x7f397006fc10 2024-08-19T00:48:24.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:24.866+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3970070430 con 0x7f397006fc10 2024-08-19T00:48:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.060+0000 7f3967400640 1 -- 172.21.15.7:0/3932297374 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v329) ==== 161+0+0 (secure 0 0 0) 0x7f3960059080 con 0x7f397006fc10 2024-08-19T00:48:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:48:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 msgr2=0x7f394c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3958034000 tx=0x7f395802e000 comp rx=0 tx=0).stop 2024-08-19T00:48:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fc10 msgr2=0x7f397015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fc10 0x7f397015db90 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f396000c7c0 tx=0x7f396000cc80 comp rx=0 tx=0).stop 2024-08-19T00:48:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 shutdown_connections 2024-08-19T00:48:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39700b5450 0x7f39700cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397006fff0 0x7f39700cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 --2- 172.21.15.7:0/3932297374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f397006fc10 0x7f397015db90 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 >> 172.21.15.7:0/3932297374 conn(0x7f39700d1fa0 msgr2=0x7f39701e7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 shutdown_connections 2024-08-19T00:48:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.063+0000 7f3975200640 1 -- 172.21.15.7:0/3932297374 wait complete. 2024-08-19T00:48:25.082 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2024-08-19T00:48:25.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.238+0000 7f3397200640 1 Processor -- start 2024-08-19T00:48:25.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.238+0000 7f3397200640 1 -- start start 2024-08-19T00:48:25.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.239+0000 7f3397200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 0x7f33900cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.239+0000 7f3397200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f339015f800 con 0x7f33900d08f0 2024-08-19T00:48:25.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.239+0000 7f3397200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33900d22a0 con 0x7f33900d4b70 2024-08-19T00:48:25.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.239+0000 7f3397200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33900d2560 con 0x7f33900d1e10 2024-08-19T00:48:25.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.239+0000 7f3395e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f33900d08f0 0x7f33900d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40968/0 (socket says 172.21.15.7:40968) 2024-08-19T00:48:25.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.239+0000 7f3395e00640 1 -- 172.21.15.7:0/3472182895 learned_addr learned my addr 172.21.15.7:0/3472182895 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.239+0000 7f3396800640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 0x7f33900cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153772504 0 0) 0x7f339015f800 con 0x7f33900d08f0 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3378003520 con 0x7f33900d08f0 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614861283 0 0) 0x7f33900d22a0 con 0x7f33900d4b70 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f339015f800 con 0x7f33900d4b70 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1047380664 0 0) 0x7f3378003520 con 0x7f33900d08f0 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 msgr2=0x7f33900cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 0x7f33900cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 >> v1:172.21.15.162:6789/0 conn(0x7f33900d4b70 legacy=0x7f33900ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339015ea40 con 0x7f33900d08f0 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f3384001670 con 0x7f33900d08f0 2024-08-19T00:48:25.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 >> v1:172.21.15.7:6789/0 conn(0x7f33900d08f0 legacy=0x7f33900d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 0x7f3378003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004120 0x7f3378004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378004d40 0x7f33780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33900d2560 con 0x7f3378004d40 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f337800bb80 con 0x7f3378004120 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f337800bd80 con 0x7f33900d1e10 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3396800640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378004d40 0x7f33780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3395400640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004120 0x7f3378004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.240+0000 7f3395e00640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 0x7f3378003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.241+0000 7f3396800640 1 -- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 msgr2=0x7f3378003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.241+0000 7f3396800640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33900d1e10 0x7f3378003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.241+0000 7f3396800640 1 -- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004120 msgr2=0x7f3378004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:25.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.241+0000 7f3396800640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004120 0x7f3378004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.241+0000 7f3396800640 1 -- 172.21.15.7:0/3472182895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3378003520 con 0x7f3378004d40 2024-08-19T00:48:25.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.242+0000 7f3396800640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378004d40 0x7f33780051c0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f338c009fc0 tx=0x7f3378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75617b7f5061b201 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:25.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.242+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c009c10 con 0x7f3378004d40 2024-08-19T00:48:25.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.242+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c036070 con 0x7f3378004d40 2024-08-19T00:48:25.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.242+0000 7f3394a00640 1 -- 172.21.15.7:0/3472182895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c031880 con 0x7f3378004d40 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.243+0000 7f3397200640 1 -- 172.21.15.7:0/3472182895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378004d40 msgr2=0x7f33780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.243+0000 7f3397200640 1 --2- 172.21.15.7:0/3472182895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378004d40 0x7f33780051c0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f338c009fc0 tx=0x7f3378005830 comp rx=0 tx=0).stop 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.243+0000 7f3396800640 1 -- 172.21.15.7:0/3472182895 reap_dead start 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.243+0000 7f3397200640 1 -- 172.21.15.7:0/3472182895 shutdown_connections 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.243+0000 7f3397200640 1 -- 172.21.15.7:0/3472182895 >> 172.21.15.7:0/3472182895 conn(0x7f339009d510 msgr2=0x7f33900d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.243+0000 7f3397200640 1 -- 172.21.15.7:0/3472182895 shutdown_connections 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.243+0000 7f3397200640 1 -- 172.21.15.7:0/3472182895 wait complete. 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.244+0000 7f3397200640 1 Processor -- start 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.245+0000 7f3397200640 1 -- start start 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.245+0000 7f3397200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004d40 0x7f3390155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.245+0000 7f3397200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3390160410 0x7f339006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.245+0000 7f3397200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339006e000 0x7f33901f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3397200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f339015e650 con 0x7f339006e000 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3397200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f339015f000 con 0x7f3378004d40 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3397200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f339015e7d0 con 0x7f3390160410 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339006e000 0x7f33901f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339006e000 0x7f33901f7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44200/0 (socket says 172.21.15.7:44200) 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 -- 172.21.15.7:0/1207604384 learned_addr learned my addr 172.21.15.7:0/1207604384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 -- 172.21.15.7:0/1207604384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3390160410 msgr2=0x7f339006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3390160410 0x7f339006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 -- 172.21.15.7:0/1207604384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004d40 msgr2=0x7f3390155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3395e00640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004d40 0x7f3390155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004d40 0x7f3390155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:25.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.246+0000 7f3396800640 1 -- 172.21.15.7:0/1207604384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3390161650 con 0x7f339006e000 2024-08-19T00:48:25.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.247+0000 7f3396800640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339006e000 0x7f33901f7940 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f338c02aee0 tx=0x7f338c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:25.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.247+0000 7f338a000640 1 -- 172.21.15.7:0/1207604384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c009c10 con 0x7f339006e000 2024-08-19T00:48:25.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.247+0000 7f338a000640 1 -- 172.21.15.7:0/1207604384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c040030 con 0x7f339006e000 2024-08-19T00:48:25.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.247+0000 7f338a000640 1 -- 172.21.15.7:0/1207604384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c003bd0 con 0x7f339006e000 2024-08-19T00:48:25.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.247+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3390161930 con 0x7f339006e000 2024-08-19T00:48:25.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.247+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3390161ef0 con 0x7f339006e000 2024-08-19T00:48:25.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.248+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33900d0cd0 con 0x7f339006e000 2024-08-19T00:48:25.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.249+0000 7f338a000640 1 -- 172.21.15.7:0/1207604384 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f338c005d10 con 0x7f339006e000 2024-08-19T00:48:25.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.250+0000 7f338a000640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337406be30 0x7f337406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:25.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.250+0000 7f338a000640 1 -- 172.21.15.7:0/1207604384 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f338c0acff0 con 0x7f339006e000 2024-08-19T00:48:25.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.250+0000 7f3395e00640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337406be30 0x7f337406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:25.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.251+0000 7f3395e00640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337406be30 0x7f337406e2f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3384001eb0 tx=0x7f3384009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.254+0000 7f338a000640 1 -- 172.21.15.7:0/1207604384 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f338c04a020 con 0x7f339006e000 2024-08-19T00:48:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:25.509+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) -- 0x7f33900d4950 con 0x7f339006e000 2024-08-19T00:48:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.073+0000 7f338a000640 1 -- 172.21.15.7:0/1207604384 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v330) ==== 101+0+0 (secure 0 0 0) 0x7f338c07ab80 con 0x7f339006e000 2024-08-19T00:48:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:repaired: restoring rank 6:0 2024-08-19T00:48:26.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337406be30 msgr2=0x7f337406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337406be30 0x7f337406e2f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3384001eb0 tx=0x7f3384009040 comp rx=0 tx=0).stop 2024-08-19T00:48:26.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339006e000 msgr2=0x7f33901f7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339006e000 0x7f33901f7940 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f338c02aee0 tx=0x7f338c009750 comp rx=0 tx=0).stop 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 shutdown_connections 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f337406be30 0x7f337406e2f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339006e000 0x7f33901f7940 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3390160410 0x7f339006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 --2- 172.21.15.7:0/1207604384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3378004d40 0x7f3390155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.075+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 >> 172.21.15.7:0/1207604384 conn(0x7f339009d510 msgr2=0x7f33900d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.076+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 shutdown_connections 2024-08-19T00:48:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.076+0000 7f3397200640 1 -- 172.21.15.7:0/1207604384 wait complete. 2024-08-19T00:48:26.095 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2024-08-19T00:48:26.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.171+0000 7f6e5d91ff40 1 Processor -- start 2024-08-19T00:48:26.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.171+0000 7f6e5d91ff40 1 -- start start 2024-08-19T00:48:26.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5d91ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8014f40 0x564ef80add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5d91ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 0x564ef80b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5d91ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8016990 0x564ef802e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5d91ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564ef80158f0 con 0x564ef8014f40 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5d91ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564ef7f8ad00 con 0x564ef8016990 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5d91ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564ef80bbdc0 con 0x564ef80165b0 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8014f40 0x564ef80add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8014f40 0x564ef80add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44214/0 (socket says 172.21.15.7:44214) 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5a200640 1 -- 172.21.15.7:0/1062892352 learned_addr learned my addr 172.21.15.7:0/1062892352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e59800640 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 0x564ef80b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.172+0000 7f6e5ac00640 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8016990 0x564ef802e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e5a200640 1 -- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 msgr2=0x564ef80b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 0x564ef80b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e5a200640 1 -- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8016990 msgr2=0x564ef802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8016990 0x564ef802e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e5a200640 1 -- 172.21.15.7:0/1062892352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef7f0fb30 con 0x564ef8014f40 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8014f40 0x564ef80add10 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c001db0 tx=0x7f6e4c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f944853e1e86ab server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e53e00640 1 -- 172.21.15.7:0/1062892352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00bde0 con 0x564ef8014f40 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e53e00640 1 -- 172.21.15.7:0/1062892352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00f400 con 0x564ef8014f40 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.173+0000 7f6e53e00640 1 -- 172.21.15.7:0/1062892352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00f7f0 con 0x564ef8014f40 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1062892352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8014f40 msgr2=0x564ef80add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8014f40 0x564ef80add10 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c001db0 tx=0x7f6e4c00b5b0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1062892352 shutdown_connections 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8016990 0x564ef802e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 0x564ef80b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1062892352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8014f40 0x564ef80add10 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1062892352 >> 172.21.15.7:0/1062892352 conn(0x564ef80134e0 msgr2=0x564ef80138c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1062892352 shutdown_connections 2024-08-19T00:48:26.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.174+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1062892352 wait complete. 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.175+0000 7f6e5d91ff40 1 Processor -- start 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.175+0000 7f6e5d91ff40 1 -- start start 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.175+0000 7f6e5d91ff40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8014f40 0x564ef80a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.175+0000 7f6e5d91ff40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 0x564ef814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5d91ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8016990 0x564ef802f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5d91ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564ef80bd070 con 0x564ef8016990 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5d91ff40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564ef80bcd20 con 0x564ef8014f40 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5d91ff40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564ef80bca40 con 0x564ef80165b0 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8016990 0x564ef802f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8016990 0x564ef802f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44222/0 (socket says 172.21.15.7:44222) 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 learned_addr learned my addr 172.21.15.7:0/1198220156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:26.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e59800640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 0x564ef814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8014f40 0x564ef80a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 msgr2=0x564ef814ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564ef80165b0 0x564ef814ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8014f40 msgr2=0x564ef80a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ef8014f40 0x564ef80a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.176+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef7f4c080 con 0x564ef8016990 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.177+0000 7f6e5ac00640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8016990 0x564ef802f940 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f6e540108e0 tx=0x7f6e54010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.177+0000 7f6e52a00640 1 -- 172.21.15.7:0/1198220156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54018070 con 0x564ef8016990 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.177+0000 7f6e52a00640 1 -- 172.21.15.7:0/1198220156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5400e9b0 con 0x564ef8016990 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.177+0000 7f6e52a00640 1 -- 172.21.15.7:0/1198220156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400ed80 con 0x564ef8016990 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.177+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef80b1fc0 con 0x564ef8016990 2024-08-19T00:48:26.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.177+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef80b1ce0 con 0x564ef8016990 2024-08-19T00:48:26.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.179+0000 7f6e52a00640 1 -- 172.21.15.7:0/1198220156 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e5401b070 con 0x564ef8016990 2024-08-19T00:48:26.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.180+0000 7f6e52a00640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6e3c06a810 0x7f6e3c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.180+0000 7f6e52a00640 1 -- 172.21.15.7:0/1198220156 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f6e5408af50 con 0x564ef8016990 2024-08-19T00:48:26.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.180+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6e3c06a810 0x7f6e3c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.183 INFO:teuthology.orchestra.run.smithi007.stdout:Importing pool 2024-08-19T00:48:26.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.180+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564ef80b54c0 0x564ef80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.180+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:1 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef80b4c30 con 0x564ef80b54c0 2024-08-19T00:48:26.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.181+0000 7f6e59800640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564ef80b54c0 0x564ef80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.181+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6e3c06a810 0x7f6e3c06ccd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b5f0 tx=0x7f6e4c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.181+0000 7f6e59800640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564ef80b54c0 0x564ef80b1130 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.184+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(1 601.00000000 [create] v125'1190 uv1164 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.184+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:2 12.10 12:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8013010 con 0x564ef80b54c0 2024-08-19T00:48:26.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.185+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(2 601.00000000 [delete] v125'1191 uv1191 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.185+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:3 12.10 12:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815db30 con 0x564ef80b54c0 2024-08-19T00:48:26.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.187+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(3 601.00000000 [create] v125'1192 uv1192 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.189 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2024-08-19T00:48:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.187+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 12.10 12:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815eee0 con 0x564ef80b54c0 2024-08-19T00:48:26.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.189+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v125'1193 uv1193 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.189+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:5 12.10 12:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815f280 con 0x564ef80b54c0 2024-08-19T00:48:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.190+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v125'1194 uv1194 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.190+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 12.10 12:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815ded0 con 0x564ef80b54c0 2024-08-19T00:48:26.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.192+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v125'1195 uv1195 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.192+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.194+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 7 ==== osd_op_reply(7 602.00000000 [create] v125'1196 uv1170 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.194+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:8 12.10 12:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.195+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 8 ==== osd_op_reply(8 602.00000000 [delete] v125'1197 uv1197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.195+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:9 12.10 12:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.197+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 9 ==== osd_op_reply(9 602.00000000 [create] v125'1198 uv1198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.199 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2024-08-19T00:48:26.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.197+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:10 12.10 12:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.199+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v125'1199 uv1199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.199+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:11 12.10 12:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.200+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v125'1200 uv1200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.200+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 12.10 12:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.202+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v125'1201 uv1201 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.202+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:13 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.204+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 13 ==== osd_op_reply(13 10000000000.00000000 [create] v125'1202 uv1177 ondisk = -17 ((17) File exists)) ==== 164+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.204+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:14 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.205+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v125'1203 uv1203 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.205+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:15 12.10 12:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.207+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 15 ==== osd_op_reply(15 10000000000.00000000 [create] v125'1204 uv1204 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.209 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2024-08-19T00:48:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.207+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:16 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.208+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v125'1205 uv1205 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.208+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:17 12.10 12:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.210+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v125'1206 uv1206 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.210+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:18 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e2c0 con 0x564ef80b54c0 2024-08-19T00:48:26.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.211+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v125'1207 uv1207 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.212+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:19 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=593b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e710 con 0x564ef80b54c0 2024-08-19T00:48:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.213+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v125'1208 uv1208 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.213+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:20 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e6a0 con 0x564ef80b54c0 2024-08-19T00:48:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.215+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 20 ==== osd_op_reply(20 600.00000000 [create] v125'1209 uv1183 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.215+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:21 12.10 12:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.217+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 21 ==== osd_op_reply(21 600.00000000 [delete] v125'1210 uv1210 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.217+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:22 12.10 12:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.220 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2024-08-19T00:48:26.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.218+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 22 ==== osd_op_reply(22 600.00000000 [create] v125'1211 uv1211 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.218+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:23 12.10 12:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.220+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v125'1212 uv1212 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.220+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:24 12.10 12:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.221+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v125'1213 uv1213 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.221+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:25 12.10 12:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.223+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v125'1214 uv1214 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.223+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:26 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.225+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 26 ==== osd_op_reply(26 603.00000000 [create] v125'1215 uv1189 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.225+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:27 12.10 12:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.226+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 27 ==== osd_op_reply(27 603.00000000 [delete] v125'1216 uv1216 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.226+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:28 12.10 12:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.229 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2024-08-19T00:48:26.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.228+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 28 ==== osd_op_reply(28 603.00000000 [create] v125'1217 uv1217 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.228+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:29 12.10 12:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.229+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v125'1218 uv1218 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.229+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:30 12.10 12:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.231+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v125'1219 uv1219 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.231+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:31 12.10 12:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef80b54c0 2024-08-19T00:48:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.232+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v125'1220 uv1220 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.232+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564ef815f620 0x564ef8161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.232+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:32 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e580 con 0x564ef815f620 2024-08-19T00:48:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.233+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564ef815f620 0x564ef8161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.233+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564ef815f620 0x564ef8161a10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.236+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== osd_op_reply(32 1.00000000.inode [create] v125'867 uv850 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.236+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:33 12.14 12:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8161f50 con 0x564ef815f620 2024-08-19T00:48:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.238+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== osd_op_reply(33 1.00000000.inode [delete] v125'868 uv868 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.238+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:34 12.14 12:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef81622f0 con 0x564ef815f620 2024-08-19T00:48:26.241 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2024-08-19T00:48:26.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.239+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 3 ==== osd_op_reply(34 1.00000000.inode [create] v125'869 uv869 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.239+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:35 12.14 12:287034c4:::1.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8162690 con 0x564ef815f620 2024-08-19T00:48:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.241+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 4 ==== osd_op_reply(35 1.00000000.inode [write 0~582] v125'870 uv870 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.241+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:36 12.14 12:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8162a30 con 0x564ef815f620 2024-08-19T00:48:26.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.243+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v125'871 uv871 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.243+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:37 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8162dd0 con 0x564ef815f620 2024-08-19T00:48:26.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.244+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 6 ==== osd_op_reply(37 200.00000000 [create] v125'872 uv855 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.244+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:38 12.14 12:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163170 con 0x564ef815f620 2024-08-19T00:48:26.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.246+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 7 ==== osd_op_reply(38 200.00000000 [delete] v125'873 uv873 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.246+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:39 12.14 12:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.249 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2024-08-19T00:48:26.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.248+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 8 ==== osd_op_reply(39 200.00000000 [create] v125'874 uv874 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.248+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:40 12.14 12:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.249+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v125'875 uv875 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.249+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:41 12.14 12:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.251+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v125'876 uv876 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.251+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:42 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.253+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 11 ==== osd_op_reply(42 200.00000001 [create] v125'877 uv860 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.253+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:43 12.14 12:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.254+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 12 ==== osd_op_reply(43 200.00000001 [delete] v125'878 uv878 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.254+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:44 12.14 12:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.257 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2024-08-19T00:48:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.255+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 13 ==== osd_op_reply(44 200.00000001 [create] v125'879 uv879 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.256+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:45 12.14 12:2e2fa760:::200.00000001:head [write 0~18118 in=18118b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8167c00 con 0x564ef815f620 2024-08-19T00:48:26.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.257+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 14 ==== osd_op_reply(45 200.00000001 [write 0~18118] v125'880 uv880 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.258+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:46 12.14 12:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8167c00 con 0x564ef815f620 2024-08-19T00:48:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.259+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v125'881 uv881 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.259+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:47 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.260+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 16 ==== osd_op_reply(47 606.00000000 [create] v125'882 uv866 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.260+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:48 12.14 12:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.262+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 17 ==== osd_op_reply(48 606.00000000 [delete] v125'883 uv883 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.262+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:49 12.14 12:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.265 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2024-08-19T00:48:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.263+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 18 ==== osd_op_reply(49 606.00000000 [create] v125'884 uv884 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.264+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:50 12.14 12:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8164520 con 0x564ef815f620 2024-08-19T00:48:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.265+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v125'885 uv885 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.265+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:51 12.14 12:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8164520 con 0x564ef815f620 2024-08-19T00:48:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.266+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v125'886 uv886 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.266+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- osd_op(unknown.0.0:52 12.14 12:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8163510 con 0x564ef815f620 2024-08-19T00:48:26.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.268+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.0 v2:172.21.15.7:6802/2395155056 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v125'887 uv887 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef815f620 2024-08-19T00:48:26.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.268+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564ef8163de0 0x564ef81641c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.268+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:53 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef8163de0 2024-08-19T00:48:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.268+0000 7f6e59800640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564ef8163de0 0x564ef81641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.269+0000 7f6e59800640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564ef8163de0 0x564ef81641c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.270+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(53 607.00000000 [create] v125'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.270+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:54 12.1c 12:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef8163de0 2024-08-19T00:48:26.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.271+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== osd_op_reply(54 607.00000000 [delete] v125'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.272+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:55 12.1c 12:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef8163de0 2024-08-19T00:48:26.274 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2024-08-19T00:48:26.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.273+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 3 ==== osd_op_reply(55 607.00000000 [create] v125'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.273+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:56 12.1c 12:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8167930 con 0x564ef8163de0 2024-08-19T00:48:26.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.274+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v125'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.274+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:57 12.1c 12:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8167930 con 0x564ef8163de0 2024-08-19T00:48:26.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.275+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v125'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.275+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:58 12.1c 12:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef8163de0 2024-08-19T00:48:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.276+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v125'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.276+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:59 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef80b54c0 2024-08-19T00:48:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.278+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 32 ==== osd_op_reply(59 mds0_openfiles.0 [create] v125'175 uv174 ondisk = -17 ((17) File exists)) ==== 160+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.278+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:60 12.6 12:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef80b54c0 2024-08-19T00:48:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.280+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 33 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v125'176 uv176 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.280+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:61 12.6 12:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef80b54c0 2024-08-19T00:48:26.282 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2024-08-19T00:48:26.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.281+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 34 ==== osd_op_reply(61 mds0_openfiles.0 [create] v125'177 uv177 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.281+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:62 12.6 12:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8166920 con 0x564ef80b54c0 2024-08-19T00:48:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.282+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 35 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v125'178 uv178 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.282+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564ef81672b0 0x564ef81696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.282+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:63 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8169be0 con 0x564ef81672b0 2024-08-19T00:48:26.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.283+0000 7f6e5ac00640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564ef81672b0 0x564ef81696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.283+0000 7f6e5ac00640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564ef81672b0 0x564ef81696a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.285+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(63 608.00000000 [create] v125'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.285+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:64 12.e 12:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8169f80 con 0x564ef81672b0 2024-08-19T00:48:26.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.286+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== osd_op_reply(64 608.00000000 [delete] v125'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.286+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:65 12.e 12:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816a430 con 0x564ef81672b0 2024-08-19T00:48:26.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.287+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 3 ==== osd_op_reply(65 608.00000000 [create] v125'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.289 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2024-08-19T00:48:26.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.287+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:66 12.e 12:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef815e9e0 con 0x564ef81672b0 2024-08-19T00:48:26.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.288+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 4 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v125'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.288+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:67 12.e 12:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816bd80 con 0x564ef81672b0 2024-08-19T00:48:26.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.289+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 5 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v125'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.289+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:68 12.e 12:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816acd0 con 0x564ef81672b0 2024-08-19T00:48:26.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.291+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 6 ==== osd_op_reply(68 608.00000000 [omap-set-header] v125'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.291+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564ef816b760 0x564ef816e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.291+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:69 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816e720 con 0x564ef816b760 2024-08-19T00:48:26.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.291+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564ef816b760 0x564ef816e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.292+0000 7f6e5a200640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564ef816b760 0x564ef816e1a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.293+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(69 604.00000000 [create] v125'426 uv420 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.293+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:70 12.15 12:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.295+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(70 604.00000000 [delete] v125'427 uv427 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.295+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:71 12.15 12:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.297 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2024-08-19T00:48:26.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.296+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(71 604.00000000 [create] v125'428 uv428 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.296+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:72 12.15 12:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816fb00 con 0x564ef816b760 2024-08-19T00:48:26.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.297+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v125'429 uv429 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.297+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:73 12.15 12:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816fb00 con 0x564ef816b760 2024-08-19T00:48:26.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.299+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v125'430 uv430 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.299+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:74 12.15 12:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.300+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v125'431 uv431 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.300+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:75 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.301+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 7 ==== osd_op_reply(75 500.00000000 [create] v125'432 uv425 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.301+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:76 12.15 12:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.303+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 8 ==== osd_op_reply(76 500.00000000 [delete] v125'433 uv433 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.303+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:77 12.15 12:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.306 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2024-08-19T00:48:26.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.304+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 9 ==== osd_op_reply(77 500.00000000 [create] v125'434 uv434 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.304+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:78 12.15 12:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.306+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v125'435 uv435 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.306+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:79 12.15 12:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816eaf0 con 0x564ef816b760 2024-08-19T00:48:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.307+0000 7f6e5a200640 1 -- 172.21.15.7:0/1198220156 <== osd.1 v2:172.21.15.7:6800/3345827885 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v125'436 uv436 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4c00f8d0 con 0x564ef816b760 2024-08-19T00:48:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.307+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564ef816f3f0 0x564ef81717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.307+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:80 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8171d20 con 0x564ef816f3f0 2024-08-19T00:48:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.307+0000 7f6e59800640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564ef816f3f0 0x564ef81717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.308+0000 7f6e59800640 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564ef816f3f0 0x564ef81717e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.309+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(80 mds_snaptable [create] v125'193 uv192 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.309+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:81 12.d 12:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8171d20 con 0x564ef816f3f0 2024-08-19T00:48:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.310+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== osd_op_reply(81 mds_snaptable [delete] v125'194 uv194 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.311+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:82 12.d 12:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef816f3f0 2024-08-19T00:48:26.313 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2024-08-19T00:48:26.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.312+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 3 ==== osd_op_reply(82 mds_snaptable [create] v125'195 uv195 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.312+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:83 12.d 12:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef816f3f0 2024-08-19T00:48:26.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.313+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v125'196 uv196 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.313+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:84 12.d 12:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef816f3f0 2024-08-19T00:48:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.315+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v125'197 uv197 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.315+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:85 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef80b54c0 2024-08-19T00:48:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.316+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 36 ==== osd_op_reply(85 605.00000000 [create] v125'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.316+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:86 12.1d 12:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef80b54c0 2024-08-19T00:48:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.317+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 37 ==== osd_op_reply(86 605.00000000 [delete] v125'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.318+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:87 12.1d 12:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef80b54c0 2024-08-19T00:48:26.320 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2024-08-19T00:48:26.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.319+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 38 ==== osd_op_reply(87 605.00000000 [create] v125'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.319+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:88 12.1d 12:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8173120 con 0x564ef80b54c0 2024-08-19T00:48:26.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.320+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 39 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v125'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.320+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8173120 con 0x564ef80b54c0 2024-08-19T00:48:26.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.322+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 40 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v125'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.322+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:90 12.1d 12:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef80b54c0 2024-08-19T00:48:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.324+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.6 v2:172.21.15.162:6816/3414725774 41 ==== osd_op_reply(90 605.00000000 [omap-set-header] v125'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef80b54c0 2024-08-19T00:48:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.324+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:91 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef8163de0 2024-08-19T00:48:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.325+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 7 ==== osd_op_reply(91 mds0_inotable [create] v125'386 uv380 ondisk = -17 ((17) File exists)) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.325+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:92 12.13 12:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef8163de0 2024-08-19T00:48:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.327+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 8 ==== osd_op_reply(92 mds0_inotable [delete] v125'387 uv387 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.327+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:93 12.13 12:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172110 con 0x564ef8163de0 2024-08-19T00:48:26.330 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2024-08-19T00:48:26.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.328+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 9 ==== osd_op_reply(93 mds0_inotable [create] v125'388 uv388 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.328+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:94 12.13 12:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816a8c0 con 0x564ef8163de0 2024-08-19T00:48:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.330+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 10 ==== osd_op_reply(94 mds0_inotable [write 0~34] v125'389 uv389 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.330+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:95 12.13 12:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816a8c0 con 0x564ef8163de0 2024-08-19T00:48:26.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.332+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 11 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v125'390 uv390 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.332+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:96 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816a8c0 con 0x564ef8163de0 2024-08-19T00:48:26.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.333+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 12 ==== osd_op_reply(96 100.00000000 [create] v125'391 uv385 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.333+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:97 12.13 12:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef816a8c0 con 0x564ef8163de0 2024-08-19T00:48:26.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.335+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 13 ==== osd_op_reply(97 100.00000000 [delete] v125'392 uv392 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.335+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:98 12.13 12:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816a8c0 con 0x564ef8163de0 2024-08-19T00:48:26.337 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2024-08-19T00:48:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.336+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 14 ==== osd_op_reply(98 100.00000000 [create] v125'393 uv393 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.336+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:99 12.13 12:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef816a8c0 con 0x564ef8163de0 2024-08-19T00:48:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.337+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 15 ==== osd_op_reply(99 100.00000000 [omap-set-header] v125'394 uv394 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.337+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:100 12.13 12:cd5a64a3:::100.00000000:head [omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8174f20 con 0x564ef8163de0 2024-08-19T00:48:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.339+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.5 v2:172.21.15.162:6800/3267745349 16 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v125'395 uv395 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef8163de0 2024-08-19T00:48:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.339+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:101 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef81725c0 con 0x564ef81672b0 2024-08-19T00:48:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.341+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 7 ==== osd_op_reply(101 mds0_sessionmap [create] v125'172 uv171 ondisk = -17 ((17) File exists)) ==== 159+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.341+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:102 12.b 12:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef81729b0 con 0x564ef81672b0 2024-08-19T00:48:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.342+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 8 ==== osd_op_reply(102 mds0_sessionmap [delete] v125'173 uv173 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.342+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:103 12.b 12:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef81729b0 con 0x564ef81672b0 2024-08-19T00:48:26.345 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2024-08-19T00:48:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.344+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 9 ==== osd_op_reply(103 mds0_sessionmap [create] v125'174 uv174 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.344+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:104 12.b 12:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef81672b0 2024-08-19T00:48:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.345+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 10 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v125'175 uv175 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.345+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:105 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef81672b0 2024-08-19T00:48:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.347+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 11 ==== osd_op_reply(105 609.00000000 [create] v125'231 uv230 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.347+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:106 12.7 12:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef81672b0 2024-08-19T00:48:26.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.349+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 12 ==== osd_op_reply(106 609.00000000 [delete] v125'232 uv232 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.349+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:107 12.7 12:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef81672b0 2024-08-19T00:48:26.352 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2024-08-19T00:48:26.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.350+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 13 ==== osd_op_reply(107 609.00000000 [create] v125'233 uv233 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.350+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:108 12.7 12:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef81672b0 2024-08-19T00:48:26.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.352+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 14 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v125'234 uv234 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.352+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:109 12.7 12:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef81672b0 2024-08-19T00:48:26.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.353+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 15 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v125'235 uv235 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.353+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:110 12.7 12:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef81672b0 2024-08-19T00:48:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.355+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 <== osd.7 v2:172.21.15.162:6824/4238399288 16 ==== osd_op_reply(110 609.00000000 [omap-set-header] v125'236 uv236 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e54024070 con 0x564ef81672b0 2024-08-19T00:48:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.355+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:111 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.356+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 6 ==== osd_op_reply(111 400.00000000 [create] v125'196 uv195 ondisk = -17 ((17) File exists)) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.356+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:112 12.f 12:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.358+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 7 ==== osd_op_reply(112 400.00000000 [delete] v125'197 uv197 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.358+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:113 12.f 12:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.359+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 8 ==== osd_op_reply(113 400.00000000 [create] v125'198 uv198 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.361 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2024-08-19T00:48:26.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.359+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:114 12.f 12:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.360+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 9 ==== osd_op_reply(114 400.00000000 [write 0~22] v125'199 uv199 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.360+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:115 12.f 12:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.361+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 10 ==== osd_op_reply(115 400.00000000 [omap-set-header] v125'200 uv200 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.361+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:116 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.363+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 11 ==== osd_op_reply(116 100.00000000.inode [create] v125'480 uv472 ondisk = -17 ((17) File exists)) ==== 162+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.363+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:117 12.1f 12:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.364+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 12 ==== osd_op_reply(117 100.00000000.inode [delete] v125'481 uv481 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.365+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:118 12.1f 12:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.370 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2024-08-19T00:48:26.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.366+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 13 ==== osd_op_reply(118 100.00000000.inode [create] v125'482 uv482 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.366+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:119 12.1f 12:fe07bba1:::100.00000000.inode:head [write 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.367+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 14 ==== osd_op_reply(119 100.00000000.inode [write 0~582] v125'483 uv483 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.367+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:120 12.1f 12:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.369+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 15 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v125'484 uv484 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.369+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:121 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.370+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 16 ==== osd_op_reply(121 1.00000000 [create] v125'485 uv479 ondisk = -17 ((17) File exists)) ==== 154+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.370+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:122 12.1f 12:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.371+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 17 ==== osd_op_reply(122 1.00000000 [delete] v125'486 uv486 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.371+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:123 12.1f 12:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.374 INFO:teuthology.orchestra.run.smithi007.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2024-08-19T00:48:26.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.373+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 18 ==== osd_op_reply(123 1.00000000 [create] v125'487 uv487 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.373+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:124 12.1f 12:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.374+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 19 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v125'488 uv488 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.374+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:125 12.1f 12:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.375+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 20 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v125'489 uv489 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.375+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:126 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8172960 con 0x564ef816f3f0 2024-08-19T00:48:26.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.376+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 21 ==== osd_op_reply(126 1.00000000 [omap-set-header] v125'490 uv490 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.377+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:127 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x564ef8173220 con 0x564ef816f3f0 2024-08-19T00:48:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e59800640 1 -- 172.21.15.7:0/1198220156 <== osd.3 v2:172.21.15.7:6818/3221924005 22 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v125'491 uv491 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f6e4805f650 con 0x564ef816f3f0 2024-08-19T00:48:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564ef815f620 msgr2=0x564ef8161a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x564ef815f620 0x564ef8161a10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564ef816b760 msgr2=0x564ef816e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x564ef816b760 0x564ef816e1a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564ef816f3f0 msgr2=0x564ef81717e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x564ef816f3f0 0x564ef81717e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564ef8163de0 msgr2=0x564ef81641c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x564ef8163de0 0x564ef81641c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564ef80b54c0 msgr2=0x564ef80b1130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x564ef80b54c0 0x564ef80b1130 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564ef81672b0 msgr2=0x564ef81696a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564ef81672b0 0x564ef81696a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 reap_dead start 2024-08-19T00:48:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5ac00640 1 -- 172.21.15.7:0/1198220156 reap_dead start 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6e3c06a810 msgr2=0x7f6e3c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6e3c06a810 0x7f6e3c06ccd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b5f0 tx=0x7f6e4c009000 comp rx=0 tx=0).stop 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8016990 msgr2=0x564ef802f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8016990 0x564ef802f940 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f6e540108e0 tx=0x7f6e54010da0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 shutdown_connections 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6e3c06a810 0x7f6e3c06ccd0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 --2- 172.21.15.7:0/1198220156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ef8016990 0x564ef802f940 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 >> 172.21.15.7:0/1198220156 conn(0x564ef80134e0 msgr2=0x564ef80138c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 shutdown_connections 2024-08-19T00:48:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.378+0000 7f6e5d91ff40 1 -- 172.21.15.7:0/1198220156 wait complete. 2024-08-19T00:48:26.384 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 1.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-08-19T00:48:26.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.500+0000 7fed07b93f40 1 Processor -- start 2024-08-19T00:48:26.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.500+0000 7fed07b93f40 1 -- start start 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed07b93f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a734f40 0x562c4a7cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed07b93f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a7365b0 0x562c4a7dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed07b93f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a736990 0x562c4a7dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed07b93f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c4a7358f0 con 0x562c4a736990 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed07b93f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c4a6aad00 con 0x562c4a7365b0 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed07b93f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c4a7dbdc0 con 0x562c4a734f40 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed05800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a736990 0x562c4a7dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed05800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a736990 0x562c4a7dcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44250/0 (socket says 172.21.15.7:44250) 2024-08-19T00:48:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed05800640 1 -- 172.21.15.7:0/2661298994 learned_addr learned my addr 172.21.15.7:0/2661298994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fed04e00640 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a734f40 0x562c4a7cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.501+0000 7fecffe00640 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a7365b0 0x562c4a7dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fed05800640 1 -- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a734f40 msgr2=0x562c4a7cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fed05800640 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a734f40 0x562c4a7cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fed05800640 1 -- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a7365b0 msgr2=0x562c4a7dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fed05800640 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a7365b0 0x562c4a7dc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fed05800640 1 -- 172.21.15.7:0/2661298994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c4a62fb30 con 0x562c4a736990 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fecffe00640 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a7365b0 0x562c4a7dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fed05800640 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a736990 0x562c4a7dcdd0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fed00002850 tx=0x7fed00002d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cca68244600609 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fecfea00640 1 -- 172.21.15.7:0/2661298994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00016020 con 0x562c4a736990 2024-08-19T00:48:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fecfea00640 1 -- 172.21.15.7:0/2661298994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0000d9c0 con 0x562c4a736990 2024-08-19T00:48:26.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.502+0000 7fecfea00640 1 -- 172.21.15.7:0/2661298994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0000ddb0 con 0x562c4a736990 2024-08-19T00:48:26.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 -- 172.21.15.7:0/2661298994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a736990 msgr2=0x562c4a7dcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a736990 0x562c4a7dcdd0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fed00002850 tx=0x7fed00002d10 comp rx=0 tx=0).stop 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 -- 172.21.15.7:0/2661298994 shutdown_connections 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a736990 0x562c4a7dcdd0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a7365b0 0x562c4a7dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2661298994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a734f40 0x562c4a7cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 -- 172.21.15.7:0/2661298994 >> 172.21.15.7:0/2661298994 conn(0x562c4a7334e0 msgr2=0x562c4a732800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 -- 172.21.15.7:0/2661298994 shutdown_connections 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.503+0000 7fed07b93f40 1 -- 172.21.15.7:0/2661298994 wait complete. 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.504+0000 7fed07b93f40 1 Processor -- start 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.504+0000 7fed07b93f40 1 -- start start 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed07b93f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a734f40 0x562c4a7ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed07b93f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a7365b0 0x562c4a7d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed07b93f40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a736990 0x562c4a7cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed07b93f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c4a7dda20 con 0x562c4a7365b0 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed07b93f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c4a7de350 con 0x562c4a734f40 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed07b93f40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c4a7ddd00 con 0x562c4a736990 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a7365b0 0x562c4a7d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a7365b0 0x562c4a7d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44256/0 (socket says 172.21.15.7:44256) 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 -- 172.21.15.7:0/2711487109 learned_addr learned my addr 172.21.15.7:0/2711487109 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed05800640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a736990 0x562c4a7cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fed04e00640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a734f40 0x562c4a7ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 -- 172.21.15.7:0/2711487109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a736990 msgr2=0x562c4a7cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c4a736990 0x562c4a7cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 -- 172.21.15.7:0/2711487109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a734f40 msgr2=0x562c4a7ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c4a734f40 0x562c4a7ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.505+0000 7fecffe00640 1 -- 172.21.15.7:0/2711487109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c4a66c080 con 0x562c4a7365b0 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.506+0000 7fecffe00640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a7365b0 0x562c4a7d21a0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fecf000df70 tx=0x7fecf000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.506+0000 7fecfd600640 1 -- 172.21.15.7:0/2711487109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf00032d0 con 0x562c4a7365b0 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.506+0000 7fecfd600640 1 -- 172.21.15.7:0/2711487109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf0016070 con 0x562c4a7365b0 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.506+0000 7fecfd600640 1 -- 172.21.15.7:0/2711487109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf00017b0 con 0x562c4a7365b0 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.506+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c4a7ca760 con 0x562c4a7365b0 2024-08-19T00:48:26.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.506+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c4a7d2dd0 con 0x562c4a7365b0 2024-08-19T00:48:26.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.508+0000 7fecfd600640 1 -- 172.21.15.7:0/2711487109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecf0001950 con 0x562c4a7365b0 2024-08-19T00:48:26.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.509+0000 7fecfd600640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece406a840 0x7fece406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.509+0000 7fecfd600640 1 -- 172.21.15.7:0/2711487109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7fecf008a6f0 con 0x562c4a7365b0 2024-08-19T00:48:26.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.509+0000 7fed04e00640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece406a840 0x7fece406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.509+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562c4a7cf000 0x562c4a7cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.509+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:1 12.1f 12:ff5b34d6:::1.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) -- 0x562c4a7cf940 con 0x562c4a7cf000 2024-08-19T00:48:26.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.510+0000 7fed05800640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562c4a7cf000 0x562c4a7cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.510+0000 7fed04e00640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece406a840 0x7fece406cd00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fecf8057000 tx=0x7fecf8061040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.510+0000 7fed05800640 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562c4a7cf000 0x562c4a7cf400 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed05800640 1 -- 172.21.15.7:0/2711487109 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(1 1.00000000 [omap-set-header] v125'492 uv492 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7fed00012470 con 0x562c4a7cf000 2024-08-19T00:48:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562c4a7cf000 msgr2=0x562c4a7cf400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x562c4a7cf000 0x562c4a7cf400 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece406a840 msgr2=0x7fece406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece406a840 0x7fece406cd00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fecf8057000 tx=0x7fecf8061040 comp rx=0 tx=0).stop 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a7365b0 msgr2=0x562c4a7d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 --2- 172.21.15.7:0/2711487109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c4a7365b0 0x562c4a7d21a0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fecf000df70 tx=0x7fecf000b5b0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed05800640 1 -- 172.21.15.7:0/2711487109 reap_dead start 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 shutdown_connections 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 >> 172.21.15.7:0/2711487109 conn(0x562c4a7334e0 msgr2=0x562c4a7dc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 shutdown_connections 2024-08-19T00:48:26.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.512+0000 7fed07b93f40 1 -- 172.21.15.7:0/2711487109 wait complete. 2024-08-19T00:48:26.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:48:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.676+0000 7f54cbe00640 1 Processor -- start 2024-08-19T00:48:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.676+0000 7f54cbe00640 1 -- start start 2024-08-19T00:48:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.677+0000 7f54cbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f54c406d770 0x7f54c406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.677+0000 7f54cbe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c406e090 con 0x7f54c40ccc40 2024-08-19T00:48:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.677+0000 7f54cbe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c40b6f70 con 0x7f54c40b5da0 2024-08-19T00:48:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.677+0000 7f54cbe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f54c40b7250 con 0x7f54c406d770 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.678+0000 7f54c9e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f54c40ccc40 0x7f54c4168d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40972/0 (socket says 172.21.15.7:40972) 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.678+0000 7f54c9e00640 1 -- 172.21.15.7:0/4196079842 learned_addr learned my addr 172.21.15.7:0/4196079842 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.678+0000 7f54c9400640 1 --2- 172.21.15.7:0/4196079842 >> v2:172.21.15.162:3300/0 conn(0x7f54c406d770 0x7f54c406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.678+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239169184 0 0) 0x7f54c406e090 con 0x7f54c40ccc40 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.678+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54ac003520 con 0x7f54c40ccc40 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.678+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824140989 0 0) 0x7f54c40b6f70 con 0x7f54c40b5da0 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.678+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c406e090 con 0x7f54c40b5da0 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.679+0000 7f54c9400640 1 -- 172.21.15.7:0/4196079842 >> v1:172.21.15.162:6789/0 conn(0x7f54c40b5da0 legacy=0x7f54c40b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.679+0000 7f54c9400640 1 -- 172.21.15.7:0/4196079842 >> v1:172.21.15.7:6789/0 conn(0x7f54c40ccc40 legacy=0x7f54c4168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.679+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1139420891 0 0) 0x7f54ac003520 con 0x7f54c40ccc40 2024-08-19T00:48:26.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.679+0000 7f54c9400640 1 -- 172.21.15.7:0/4196079842 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c40cb430 con 0x7f54c406d770 2024-08-19T00:48:26.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.680+0000 7f54c9400640 1 --2- 172.21.15.7:0/4196079842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 0x7f54c406db50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097d0 tx=0x7f54b802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3890ff3e8c8780e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.680+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8037070 con 0x7f54c406d770 2024-08-19T00:48:26.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.680+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b802ac90 con 0x7f54c406d770 2024-08-19T00:48:26.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.680+0000 7f54c3e00640 1 -- 172.21.15.7:0/4196079842 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0019f0 con 0x7f54c406d770 2024-08-19T00:48:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.680+0000 7f54cbe00640 1 -- 172.21.15.7:0/4196079842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 msgr2=0x7f54c406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.680+0000 7f54cbe00640 1 --2- 172.21.15.7:0/4196079842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 0x7f54c406db50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097d0 tx=0x7f54b802a200 comp rx=0 tx=0).stop 2024-08-19T00:48:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.681+0000 7f54cbe00640 1 -- 172.21.15.7:0/4196079842 shutdown_connections 2024-08-19T00:48:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.681+0000 7f54cbe00640 1 --2- 172.21.15.7:0/4196079842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 0x7f54c406db50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.681+0000 7f54cbe00640 1 -- 172.21.15.7:0/4196079842 >> 172.21.15.7:0/4196079842 conn(0x7f54c40d2180 msgr2=0x7f54c40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.681+0000 7f54cbe00640 1 -- 172.21.15.7:0/4196079842 shutdown_connections 2024-08-19T00:48:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.681+0000 7f54cbe00640 1 -- 172.21.15.7:0/4196079842 wait complete. 2024-08-19T00:48:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.682+0000 7f54cbe00640 1 Processor -- start 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.682+0000 7f54cbe00640 1 -- start start 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.683+0000 7f54cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 0x7f54c4155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.683+0000 7f54cbe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54c40b5da0 0x7f54c41e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.683+0000 7f54cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c40ccc40 0x7f54c41e4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.683+0000 7f54cbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f54c415ea10 con 0x7f54c40ccc40 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.683+0000 7f54cbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54c406f9a0 con 0x7f54c406d770 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.683+0000 7f54cbe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54c406d370 con 0x7f54c40b5da0 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.683+0000 7f54c9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c40ccc40 0x7f54c41e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c40ccc40 0x7f54c41e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44258/0 (socket says 172.21.15.7:44258) 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 -- 172.21.15.7:0/3562322273 learned_addr learned my addr 172.21.15.7:0/3562322273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c8a00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54c40b5da0 0x7f54c41e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9400640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 0x7f54c4155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 -- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54c40b5da0 msgr2=0x7f54c41e6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54c40b5da0 0x7f54c41e6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 -- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 msgr2=0x7f54c4155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 0x7f54c4155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 -- 172.21.15.7:0/3562322273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c41e51c0 con 0x7f54c40ccc40 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c9e00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c40ccc40 0x7f54c41e4460 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005c00 tx=0x7f54bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c1600640 1 -- 172.21.15.7:0/3562322273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc017070 con 0x7f54c40ccc40 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c1600640 1 -- 172.21.15.7:0/3562322273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54bc00ace0 con 0x7f54c40ccc40 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.684+0000 7f54c1600640 1 -- 172.21.15.7:0/3562322273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc012640 con 0x7f54c40ccc40 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.685+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c41e54a0 con 0x7f54c40ccc40 2024-08-19T00:48:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.685+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c41e5a60 con 0x7f54c40ccc40 2024-08-19T00:48:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.686+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c40d2ca0 con 0x7f54c40ccc40 2024-08-19T00:48:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.687+0000 7f54c1600640 1 -- 172.21.15.7:0/3562322273 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54bc01a070 con 0x7f54c40ccc40 2024-08-19T00:48:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.687+0000 7f54c1600640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f54a406be30 0x7f54a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.688+0000 7f54c1600640 1 -- 172.21.15.7:0/3562322273 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f54bc08ba30 con 0x7f54c40ccc40 2024-08-19T00:48:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.688+0000 7f54c9400640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f54a406be30 0x7f54a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.688+0000 7f54c9400640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f54a406be30 0x7f54a406e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f54b8034000 tx=0x7f54b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.692+0000 7f54c1600640 1 -- 172.21.15.7:0/3562322273 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f54bc058fd0 con 0x7f54c40ccc40 2024-08-19T00:48:26.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:26.912+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f54c40d2840 con 0x7f54c40ccc40 2024-08-19T00:48:27.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.074+0000 7f54c1600640 1 -- 172.21.15.7:0/3562322273 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v331) ==== 162+0+0 (secure 0 0 0) 0x7f54bc05d2d0 con 0x7f54c40ccc40 2024-08-19T00:48:27.076 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f54a406be30 msgr2=0x7f54a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f54a406be30 0x7f54a406e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f54b8034000 tx=0x7f54b802e000 comp rx=0 tx=0).stop 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c40ccc40 msgr2=0x7f54c41e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c40ccc40 0x7f54c41e4460 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005c00 tx=0x7f54bc00a430 comp rx=0 tx=0).stop 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 shutdown_connections 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f54a406be30 0x7f54a406e2f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c40ccc40 0x7f54c41e4460 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54c40b5da0 0x7f54c41e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 --2- 172.21.15.7:0/3562322273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54c406d770 0x7f54c4155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.076+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 >> 172.21.15.7:0/3562322273 conn(0x7f54c40d2180 msgr2=0x7f54c4070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.077+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 shutdown_connections 2024-08-19T00:48:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.077+0000 7f54cbe00640 1 -- 172.21.15.7:0/3562322273 wait complete. 2024-08-19T00:48:27.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.251+0000 7f423f400640 1 Processor -- start 2024-08-19T00:48:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.251+0000 7f423f400640 1 -- start start 2024-08-19T00:48:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.252+0000 7f423f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f42380d0ad0 0x7f42380ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.252+0000 7f423f400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f423806f7f0 con 0x7f4238159bf0 2024-08-19T00:48:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.252+0000 7f423f400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f423806f510 con 0x7f42380ce500 2024-08-19T00:48:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.252+0000 7f423f400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4238072980 con 0x7f42380d0ad0 2024-08-19T00:48:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.252+0000 7f423ca00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4238159bf0 0x7f4238073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40982/0 (socket says 172.21.15.7:40982) 2024-08-19T00:48:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.252+0000 7f423ca00640 1 -- 172.21.15.7:0/2666686134 learned_addr learned my addr 172.21.15.7:0/2666686134 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f423d400640 1 --2- 172.21.15.7:0/2666686134 >> v2:172.21.15.162:3300/0 conn(0x7f42380d0ad0 0x7f42380ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f4237400640 1 -- 172.21.15.7:0/2666686134 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988345650 0 0) 0x7f423806f7f0 con 0x7f4238159bf0 2024-08-19T00:48:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f4237400640 1 -- 172.21.15.7:0/2666686134 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4220003520 con 0x7f4238159bf0 2024-08-19T00:48:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f4237400640 1 -- 172.21.15.7:0/2666686134 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314702022 0 0) 0x7f423806f510 con 0x7f42380ce500 2024-08-19T00:48:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f4237400640 1 -- 172.21.15.7:0/2666686134 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f423806f7f0 con 0x7f42380ce500 2024-08-19T00:48:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f423d400640 1 -- 172.21.15.7:0/2666686134 >> v1:172.21.15.162:6789/0 conn(0x7f42380ce500 legacy=0x7f42380d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f423d400640 1 -- 172.21.15.7:0/2666686134 >> v1:172.21.15.7:6789/0 conn(0x7f4238159bf0 legacy=0x7f4238073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.253+0000 7f423d400640 1 -- 172.21.15.7:0/2666686134 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4238072c60 con 0x7f42380d0ad0 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.254+0000 7f423d400640 1 --2- 172.21.15.7:0/2666686134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d0ad0 0x7f42380ce970 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4230009d90 tx=0x7f423002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8918f90b68d2b5e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f4237400640 1 -- 172.21.15.7:0/2666686134 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230007740 con 0x7f42380d0ad0 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f4237400640 1 -- 172.21.15.7:0/2666686134 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300078e0 con 0x7f42380d0ad0 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f4237400640 1 -- 172.21.15.7:0/2666686134 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230007cb0 con 0x7f42380d0ad0 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f423f400640 1 -- 172.21.15.7:0/2666686134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d0ad0 msgr2=0x7f42380ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f423f400640 1 --2- 172.21.15.7:0/2666686134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d0ad0 0x7f42380ce970 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4230009d90 tx=0x7f423002a660 comp rx=0 tx=0).stop 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f423f400640 1 -- 172.21.15.7:0/2666686134 shutdown_connections 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f423f400640 1 --2- 172.21.15.7:0/2666686134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380d0ad0 0x7f42380ce970 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f423f400640 1 -- 172.21.15.7:0/2666686134 >> 172.21.15.7:0/2666686134 conn(0x7f423806bc70 msgr2=0x7f423806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f423f400640 1 -- 172.21.15.7:0/2666686134 shutdown_connections 2024-08-19T00:48:27.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.255+0000 7f423f400640 1 -- 172.21.15.7:0/2666686134 wait complete. 2024-08-19T00:48:27.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.257+0000 7f423f400640 1 Processor -- start 2024-08-19T00:48:27.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.257+0000 7f423f400640 1 -- start start 2024-08-19T00:48:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380ce500 0x7f423809a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380d0ad0 0x7f42381554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4238159bf0 0x7f42380b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423f400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4238159fd0 con 0x7f42380d0ad0 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423f400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4238073b70 con 0x7f42380ce500 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423f400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f423815a150 con 0x7f4238159bf0 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f4237e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380d0ad0 0x7f42381554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f4237e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380d0ad0 0x7f42381554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44268/0 (socket says 172.21.15.7:44268) 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380ce500 0x7f423809a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f4237e00640 1 -- 172.21.15.7:0/4215267548 learned_addr learned my addr 172.21.15.7:0/4215267548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.258+0000 7f423d400640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4238159bf0 0x7f42380b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4237e00640 1 -- 172.21.15.7:0/4215267548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4238159bf0 msgr2=0x7f42380b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4237e00640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4238159bf0 0x7f42380b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4237e00640 1 -- 172.21.15.7:0/4215267548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380ce500 msgr2=0x7f423809a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4237e00640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380ce500 0x7f423809a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4237e00640 1 -- 172.21.15.7:0/4215267548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42381f4360 con 0x7f42380d0ad0 2024-08-19T00:48:27.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4237e00640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380d0ad0 0x7f42381554d0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f422400c430 tx=0x7f422400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:27.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4234c00640 1 -- 172.21.15.7:0/4215267548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224017070 con 0x7f42380d0ad0 2024-08-19T00:48:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4234c00640 1 -- 172.21.15.7:0/4215267548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42240052f0 con 0x7f42380d0ad0 2024-08-19T00:48:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f4234c00640 1 -- 172.21.15.7:0/4215267548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224003830 con 0x7f42380d0ad0 2024-08-19T00:48:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.259+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42381f4640 con 0x7f42380d0ad0 2024-08-19T00:48:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.260+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42381f4920 con 0x7f42380d0ad0 2024-08-19T00:48:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.260+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4238154de0 con 0x7f42380d0ad0 2024-08-19T00:48:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.261+0000 7f4234c00640 1 -- 172.21.15.7:0/4215267548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f422401a070 con 0x7f42380d0ad0 2024-08-19T00:48:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.262+0000 7f4234c00640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421806be30 0x7f421806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.262+0000 7f4234c00640 1 -- 172.21.15.7:0/4215267548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9063+0+0 (secure 0 0 0) 0x7f422408aed0 con 0x7f42380d0ad0 2024-08-19T00:48:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.263+0000 7f423ca00640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421806be30 0x7f421806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.263+0000 7f423ca00640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421806be30 0x7f421806e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f422c000f60 tx=0x7f422c007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.267+0000 7f4234c00640 1 -- 172.21.15.7:0/4215267548 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f42240584f0 con 0x7f42380d0ad0 2024-08-19T00:48:27.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.488+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42380ce970 con 0x7f42380d0ad0 2024-08-19T00:48:27.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.489+0000 7f4234c00640 1 -- 172.21.15.7:0/4215267548 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 332 v332) ==== 95+0+4402 (secure 0 0 0) 0x7f422405c7f0 con 0x7f42380d0ad0 2024-08-19T00:48:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:27.491 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":332,"btime":"2024-08-19T00:48:27:076789+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":332,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:27.076777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9591},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9591":{"gid":9591,"name":"c","rank":0,"incarnation":332,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/3808845958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3808845958},{"type":"v1","addr":"172.21.15.7:6836","nonce":3808845958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:27.491 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 332 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421806be30 msgr2=0x7f421806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421806be30 0x7f421806e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f422c000f60 tx=0x7f422c007d30 comp rx=0 tx=0).stop 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380d0ad0 msgr2=0x7f42381554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380d0ad0 0x7f42381554d0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f422400c430 tx=0x7f422400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 shutdown_connections 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f421806be30 0x7f421806e2f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4238159bf0 0x7f42380b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42380d0ad0 0x7f42381554d0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 --2- 172.21.15.7:0/4215267548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380ce500 0x7f423809a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:27.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 >> 172.21.15.7:0/4215267548 conn(0x7f423806bc70 msgr2=0x7f423815a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:27.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 shutdown_connections 2024-08-19T00:48:27.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:27.491+0000 7f423f400640 1 -- 172.21.15.7:0/4215267548 wait complete. 2024-08-19T00:48:27.509 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-08-19T00:48:27.807 INFO:tasks.ceph.mds.a.smithi007.stderr: -45> 2024-08-19T00:48:23.053+0000 7f29a8400640 -1 log_channel(cluster) log [ERR] : corrupt sessionmap header: Decoder at 'virtual void SessionMapStore::decode_header(ceph::bufferlist&)' v=1 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:48:27.847 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:48:30.103 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:48:30.101+0000 7fa04f200640 -1 mds.0.cache.dir(0x1) Corrupt fnode in dirfrag 0x1: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:48:30.103 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:48:30.101+0000 7fa04f200640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-08-19T00:48:30.103 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:30.102+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:48:30.103 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:30.102+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-08-19T00:48:32.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:32.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.677+0000 7f961dc00640 1 Processor -- start 2024-08-19T00:48:32.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.677+0000 7f961dc00640 1 -- start start 2024-08-19T00:48:32.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.678+0000 7f961dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96180d03c0 0x7f9618071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:32.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.678+0000 7f961dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96180b3750 0x7f96180cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.678+0000 7f961dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96180cdfb0 con 0x7f961806e710 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.678+0000 7f961dc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f96180cebc0 con 0x7f96180b3750 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.678+0000 7f961dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f96180ce290 con 0x7f96180d03c0 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9617400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96180b3750 0x7f96180cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9617400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f96180b3750 0x7f96180cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44288/0 (socket says 172.21.15.7:44288) 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9617400640 1 -- 172.21.15.7:0/1435901622 learned_addr learned my addr 172.21.15.7:0/1435901622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9616a00640 1 --2- 172.21.15.7:0/1435901622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96180d03c0 0x7f9618071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9617400640 1 -- 172.21.15.7:0/1435901622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96180d03c0 msgr2=0x7f9618071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9617400640 1 --2- 172.21.15.7:0/1435901622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96180d03c0 0x7f9618071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9617400640 1 -- 172.21.15.7:0/1435901622 >> v1:172.21.15.7:6789/0 conn(0x7f961806e710 legacy=0x7f96180d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9615600640 1 -- 172.21.15.7:0/1435901622 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574052061 0 0) 0x7f96180cdfb0 con 0x7f961806e710 2024-08-19T00:48:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.679+0000 7f9617400640 1 -- 172.21.15.7:0/1435901622 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96180ce570 con 0x7f96180b3750 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.680+0000 7f9617400640 1 --2- 172.21.15.7:0/1435901622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180b3750 0x7f96180cf050 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f961002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40155974f2f3c181 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.680+0000 7f9615600640 1 -- 172.21.15.7:0/1435901622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610036070 con 0x7f96180b3750 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.680+0000 7f9615600640 1 -- 172.21.15.7:0/1435901622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9610031600 con 0x7f96180b3750 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.680+0000 7f9615600640 1 -- 172.21.15.7:0/1435901622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96100319d0 con 0x7f96180b3750 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 -- 172.21.15.7:0/1435901622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180b3750 msgr2=0x7f96180cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 --2- 172.21.15.7:0/1435901622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180b3750 0x7f96180cf050 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f961002a710 comp rx=0 tx=0).stop 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 -- 172.21.15.7:0/1435901622 shutdown_connections 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 --2- 172.21.15.7:0/1435901622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180b3750 0x7f96180cf050 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 --2- 172.21.15.7:0/1435901622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96180d03c0 0x7f9618071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 -- 172.21.15.7:0/1435901622 >> 172.21.15.7:0/1435901622 conn(0x7f961806bc70 msgr2=0x7f961806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 -- 172.21.15.7:0/1435901622 shutdown_connections 2024-08-19T00:48:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.681+0000 7f961dc00640 1 -- 172.21.15.7:0/1435901622 wait complete. 2024-08-19T00:48:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.683+0000 7f961dc00640 1 Processor -- start 2024-08-19T00:48:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.683+0000 7f961dc00640 1 -- start start 2024-08-19T00:48:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f961dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f961806e710 0x7f9618140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f961dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96180b3750 0x7f961815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f961dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180d03c0 0x7f961809b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f961dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9618073c60 con 0x7f96180d03c0 2024-08-19T00:48:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f961dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9618073ae0 con 0x7f96180b3750 2024-08-19T00:48:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f961dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f96180b3be0 con 0x7f961806e710 2024-08-19T00:48:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180d03c0 0x7f961809b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180d03c0 0x7f961809b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44290/0 (socket says 172.21.15.7:44290) 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 -- 172.21.15.7:0/950140315 learned_addr learned my addr 172.21.15.7:0/950140315 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9616a00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f961806e710 0x7f9618140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9616000640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96180b3750 0x7f961815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 -- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f961806e710 msgr2=0x7f9618140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f961806e710 0x7f9618140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 -- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96180b3750 msgr2=0x7f961815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96180b3750 0x7f961815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.684+0000 7f9617400640 1 -- 172.21.15.7:0/950140315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9618140750 con 0x7f96180d03c0 2024-08-19T00:48:32.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.685+0000 7f9617400640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180d03c0 0x7f961809b600 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f9610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.685+0000 7f960ea00640 1 -- 172.21.15.7:0/950140315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610041070 con 0x7f96180d03c0 2024-08-19T00:48:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.685+0000 7f960ea00640 1 -- 172.21.15.7:0/950140315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9610003990 con 0x7f96180d03c0 2024-08-19T00:48:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.685+0000 7f960ea00640 1 -- 172.21.15.7:0/950140315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610036040 con 0x7f96180d03c0 2024-08-19T00:48:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.685+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96181501e0 con 0x7f96180d03c0 2024-08-19T00:48:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.685+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96181507a0 con 0x7f96180d03c0 2024-08-19T00:48:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.686+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9618071980 con 0x7f96180d03c0 2024-08-19T00:48:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.687+0000 7f960ea00640 1 -- 172.21.15.7:0/950140315 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9610007820 con 0x7f96180d03c0 2024-08-19T00:48:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.688+0000 7f960ea00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f95f806be30 0x7f95f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.688+0000 7f960ea00640 1 -- 172.21.15.7:0/950140315 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f96100ac620 con 0x7f96180d03c0 2024-08-19T00:48:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.688+0000 7f9616a00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f95f806be30 0x7f95f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.689+0000 7f9616a00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f95f806be30 0x7f95f806e2f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9608006fd0 tx=0x7f9608008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.693+0000 7f960ea00640 1 -- 172.21.15.7:0/950140315 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f961004b020 con 0x7f96180d03c0 2024-08-19T00:48:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.913+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96181557b0 con 0x7f96180d03c0 2024-08-19T00:48:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.913+0000 7f960ea00640 1 -- 172.21.15.7:0/950140315 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+4394 (secure 0 0 0) 0x7f9610079bf0 con 0x7f96180d03c0 2024-08-19T00:48:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:32.916 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":336,"btime":"2024-08-19T00:48:30:102811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:30.102809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 336 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f95f806be30 msgr2=0x7f95f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f95f806be30 0x7f95f806e2f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9608006fd0 tx=0x7f9608008040 comp rx=0 tx=0).stop 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180d03c0 msgr2=0x7f961809b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180d03c0 0x7f961809b600 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f9610004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 shutdown_connections 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f95f806be30 0x7f95f806e2f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96180d03c0 0x7f961809b600 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96180b3750 0x7f961815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 --2- 172.21.15.7:0/950140315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f961806e710 0x7f9618140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 >> 172.21.15.7:0/950140315 conn(0x7f961806bc70 msgr2=0x7f961806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 shutdown_connections 2024-08-19T00:48:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:32.916+0000 7f961dc00640 1 -- 172.21.15.7:0/950140315 wait complete. 2024-08-19T00:48:32.934 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-19T00:48:32.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.090+0000 7f32e8c00640 1 Processor -- start 2024-08-19T00:48:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.090+0000 7f32e8c00640 1 -- start start 2024-08-19T00:48:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.091+0000 7f32e8c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32e40d12a0 0x7f32e4169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.091+0000 7f32e8c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e415ec30 con 0x7f32e409b730 2024-08-19T00:48:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.091+0000 7f32e8c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e415ef10 con 0x7f32e409aa70 2024-08-19T00:48:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.091+0000 7f32e8c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f32e415f1f0 con 0x7f32e40d12a0 2024-08-19T00:48:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.091+0000 7f32e2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32e40d12a0 0x7f32e4169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.092+0000 7f32e2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32e40d12a0 0x7f32e4169290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44294/0 (socket says 172.21.15.7:44294) 2024-08-19T00:48:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.092+0000 7f32e2800640 1 -- 172.21.15.7:0/4190733325 learned_addr learned my addr 172.21.15.7:0/4190733325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.092+0000 7f32e1400640 1 --1- 172.21.15.7:0/4190733325 >> v1:172.21.15.7:6789/0 conn(0x7f32e409b730 0x7f32e406fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41010/0 (socket says 172.21.15.7:41010) 2024-08-19T00:48:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.092+0000 7f32e2800640 1 -- 172.21.15.7:0/4190733325 >> v1:172.21.15.162:6789/0 conn(0x7f32e409aa70 legacy=0x7f32e409ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.092+0000 7f32e2800640 1 -- 172.21.15.7:0/4190733325 >> v1:172.21.15.7:6789/0 conn(0x7f32e409b730 legacy=0x7f32e406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.092+0000 7f32e2800640 1 -- 172.21.15.7:0/4190733325 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e415f4d0 con 0x7f32e40d12a0 2024-08-19T00:48:33.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.093+0000 7f32e2800640 1 --2- 172.21.15.7:0/4190733325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e40d12a0 0x7f32e4169290 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009e50 tx=0x7f32dc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c733b6df8b8a97ed server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:33.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.093+0000 7f32e0a00640 1 -- 172.21.15.7:0/4190733325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc036070 con 0x7f32e40d12a0 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.093+0000 7f32e0a00640 1 -- 172.21.15.7:0/4190733325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc031600 con 0x7f32e40d12a0 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.093+0000 7f32e0a00640 1 -- 172.21.15.7:0/4190733325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0319f0 con 0x7f32e40d12a0 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.094+0000 7f32e8c00640 1 -- 172.21.15.7:0/4190733325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e40d12a0 msgr2=0x7f32e4169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.094+0000 7f32e8c00640 1 --2- 172.21.15.7:0/4190733325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e40d12a0 0x7f32e4169290 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009e50 tx=0x7f32dc02a7c0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.094+0000 7f32e8c00640 1 -- 172.21.15.7:0/4190733325 shutdown_connections 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.094+0000 7f32e8c00640 1 --2- 172.21.15.7:0/4190733325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e40d12a0 0x7f32e4169290 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.094+0000 7f32e8c00640 1 -- 172.21.15.7:0/4190733325 >> 172.21.15.7:0/4190733325 conn(0x7f32e40d2190 msgr2=0x7f32e40d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.094+0000 7f32e8c00640 1 -- 172.21.15.7:0/4190733325 shutdown_connections 2024-08-19T00:48:33.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.094+0000 7f32e8c00640 1 -- 172.21.15.7:0/4190733325 wait complete. 2024-08-19T00:48:33.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.095+0000 7f32e8c00640 1 Processor -- start 2024-08-19T00:48:33.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.096+0000 7f32e8c00640 1 -- start start 2024-08-19T00:48:33.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.096+0000 7f32e8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e409aa70 0x7f32e41581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.096+0000 7f32e8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32e409b730 0x7f32e414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.096+0000 7f32e8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e40d12a0 0x7f32e4150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.096+0000 7f32e8c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32e4169950 con 0x7f32e409aa70 2024-08-19T00:48:33.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.096+0000 7f32e8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32e41697d0 con 0x7f32e40d12a0 2024-08-19T00:48:33.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.096+0000 7f32e8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32e4169ad0 con 0x7f32e409b730 2024-08-19T00:48:33.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e409aa70 0x7f32e41581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e409aa70 0x7f32e41581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44296/0 (socket says 172.21.15.7:44296) 2024-08-19T00:48:33.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 -- 172.21.15.7:0/1647310052 learned_addr learned my addr 172.21.15.7:0/1647310052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:33.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1400640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32e409b730 0x7f32e414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e2800640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e40d12a0 0x7f32e4150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 -- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32e409b730 msgr2=0x7f32e414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32e409b730 0x7f32e414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 -- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e40d12a0 msgr2=0x7f32e4150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e40d12a0 0x7f32e4150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.097+0000 7f32e1e00640 1 -- 172.21.15.7:0/1647310052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e40ce9a0 con 0x7f32e409aa70 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.098+0000 7f32e1e00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e409aa70 0x7f32e41581e0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f32d400c430 tx=0x7f32d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.098+0000 7f32da000640 1 -- 172.21.15.7:0/1647310052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4017070 con 0x7f32e409aa70 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.098+0000 7f32da000640 1 -- 172.21.15.7:0/1647310052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d40052d0 con 0x7f32e409aa70 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.098+0000 7f32da000640 1 -- 172.21.15.7:0/1647310052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4003830 con 0x7f32e409aa70 2024-08-19T00:48:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.098+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e414f880 con 0x7f32e409aa70 2024-08-19T00:48:33.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.098+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e414c300 con 0x7f32e409aa70 2024-08-19T00:48:33.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.100+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e409ae50 con 0x7f32e409aa70 2024-08-19T00:48:33.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.101+0000 7f32da000640 1 -- 172.21.15.7:0/1647310052 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32d401a070 con 0x7f32e409aa70 2024-08-19T00:48:33.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.101+0000 7f32da000640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f32c406be30 0x7f32c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.101+0000 7f32da000640 1 -- 172.21.15.7:0/1647310052 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f32d408aed0 con 0x7f32e409aa70 2024-08-19T00:48:33.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.102+0000 7f32e1400640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f32c406be30 0x7f32c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.102+0000 7f32e1400640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f32c406be30 0x7f32c406e2f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f32e414daf0 tx=0x7f32d0000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:33.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.107+0000 7f32da000640 1 -- 172.21.15.7:0/1647310052 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f32d40584a0 con 0x7f32e409aa70 2024-08-19T00:48:33.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:48:33.228 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:48:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.329+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32e4071780 con 0x7f32e409aa70 2024-08-19T00:48:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.329+0000 7f32da000640 1 -- 172.21.15.7:0/1647310052 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+4394 (secure 0 0 0) 0x7f32d405c7a0 con 0x7f32e409aa70 2024-08-19T00:48:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:33.331 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":336,"btime":"2024-08-19T00:48:30:102811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:30.102809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 336 2024-08-19T00:48:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.331+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f32c406be30 msgr2=0x7f32c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.331+0000 7f32e8c00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f32c406be30 0x7f32c406e2f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f32e414daf0 tx=0x7f32d0000ed0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.331+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e409aa70 msgr2=0x7f32e41581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.331+0000 7f32e8c00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e409aa70 0x7f32e41581e0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f32d400c430 tx=0x7f32d400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 shutdown_connections 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f32c406be30 0x7f32c406e2f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e40d12a0 0x7f32e4150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32e409b730 0x7f32e414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 --2- 172.21.15.7:0/1647310052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32e409aa70 0x7f32e41581e0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 >> 172.21.15.7:0/1647310052 conn(0x7f32e40d2190 msgr2=0x7f32e40b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 shutdown_connections 2024-08-19T00:48:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.332+0000 7f32e8c00640 1 -- 172.21.15.7:0/1647310052 wait complete. 2024-08-19T00:48:33.350 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-08-19T00:48:33.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:33.462 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:48:33.461+0000 7fa054200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:33.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.546+0000 7fd0bfe00640 1 Processor -- start 2024-08-19T00:48:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.547+0000 7fd0bfe00640 1 -- start start 2024-08-19T00:48:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd0c015bd70 0x7fd0c0072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bfe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0c006dd10 0x7fd0c015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bfe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c00733f0 con 0x7fd0c0072f70 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bfe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c00736d0 con 0x7fd0c006dd10 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c00739b0 con 0x7fd0c015bd70 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0c006dd10 0x7fd0c015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0c006dd10 0x7fd0c015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44298/0 (socket says 172.21.15.7:44298) 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0b6000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd0c0072f70 0x7fd0c006d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41024/0 (socket says 172.21.15.7:41024) 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bf400640 1 -- 172.21.15.7:0/3453658805 learned_addr learned my addr 172.21.15.7:0/3453658805 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bea00640 1 --2- 172.21.15.7:0/3453658805 >> v2:172.21.15.162:3300/0 conn(0x7fd0c015bd70 0x7fd0c0072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bf400640 1 -- 172.21.15.7:0/3453658805 >> v2:172.21.15.162:3300/0 conn(0x7fd0c015bd70 msgr2=0x7fd0c0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bf400640 1 --2- 172.21.15.7:0/3453658805 >> v2:172.21.15.162:3300/0 conn(0x7fd0c015bd70 0x7fd0c0072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bf400640 1 -- 172.21.15.7:0/3453658805 >> v1:172.21.15.7:6789/0 conn(0x7fd0c0072f70 legacy=0x7fd0c006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.548+0000 7fd0bf400640 1 -- 172.21.15.7:0/3453658805 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c015c4a0 con 0x7fd0c006dd10 2024-08-19T00:48:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.549+0000 7fd0bf400640 1 --2- 172.21.15.7:0/3453658805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c006dd10 0x7fd0c015cca0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00694a0 tx=0x7fd0b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c847c668a2cf11 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0be000640 1 -- 172.21.15.7:0/3453658805 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8036070 con 0x7fd0c006dd10 2024-08-19T00:48:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0be000640 1 -- 172.21.15.7:0/3453658805 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b8031600 con 0x7fd0c006dd10 2024-08-19T00:48:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0be000640 1 -- 172.21.15.7:0/3453658805 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80319d0 con 0x7fd0c006dd10 2024-08-19T00:48:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3453658805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c006dd10 msgr2=0x7fd0c015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3453658805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c006dd10 0x7fd0c015cca0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00694a0 tx=0x7fd0b802a6a0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3453658805 shutdown_connections 2024-08-19T00:48:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3453658805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c006dd10 0x7fd0c015cca0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3453658805 >> v2:172.21.15.162:3300/0 conn(0x7fd0c015bd70 0x7fd0c0072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3453658805 >> 172.21.15.7:0/3453658805 conn(0x7fd0c006b850 msgr2=0x7fd0c006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3453658805 shutdown_connections 2024-08-19T00:48:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.550+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3453658805 wait complete. 2024-08-19T00:48:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.552+0000 7fd0bfe00640 1 Processor -- start 2024-08-19T00:48:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.552+0000 7fd0bfe00640 1 -- start start 2024-08-19T00:48:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.553+0000 7fd0bfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0c006dd10 0x7fd0c014c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.553+0000 7fd0bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0c0072f70 0x7fd0c0149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.553+0000 7fd0bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c015bd70 0x7fd0c01e6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.553+0000 7fd0bfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c006e3a0 con 0x7fd0c015bd70 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.553+0000 7fd0bfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c015c150 con 0x7fd0c0072f70 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.553+0000 7fd0bfe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c006e520 con 0x7fd0c006dd10 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c015bd70 0x7fd0c01e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c015bd70 0x7fd0c01e6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44300/0 (socket says 172.21.15.7:44300) 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 -- 172.21.15.7:0/3800312911 learned_addr learned my addr 172.21.15.7:0/3800312911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0b6000640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0c0072f70 0x7fd0c0149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bea00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0c006dd10 0x7fd0c014c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 -- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0c006dd10 msgr2=0x7fd0c014c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0c006dd10 0x7fd0c014c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 -- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0c0072f70 msgr2=0x7fd0c0149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0c0072f70 0x7fd0c0149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 -- 172.21.15.7:0/3800312911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c014d100 con 0x7fd0c015bd70 2024-08-19T00:48:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.554+0000 7fd0bf400640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c015bd70 0x7fd0c01e6250 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009f40 tx=0x7fd0b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.555+0000 7fd0b7400640 1 -- 172.21.15.7:0/3800312911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8036050 con 0x7fd0c015bd70 2024-08-19T00:48:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.555+0000 7fd0b7400640 1 -- 172.21.15.7:0/3800312911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b8042070 con 0x7fd0c015bd70 2024-08-19T00:48:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.555+0000 7fd0b7400640 1 -- 172.21.15.7:0/3800312911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8009510 con 0x7fd0c015bd70 2024-08-19T00:48:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.555+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c01528d0 con 0x7fd0c015bd70 2024-08-19T00:48:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.555+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c0152e90 con 0x7fd0c015bd70 2024-08-19T00:48:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.556+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c015cca0 con 0x7fd0c015bd70 2024-08-19T00:48:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.557+0000 7fd0b7400640 1 -- 172.21.15.7:0/3800312911 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0b8007bd0 con 0x7fd0c015bd70 2024-08-19T00:48:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.558+0000 7fd0b7400640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd09c070240 0x7fd09c072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.558+0000 7fd0b7400640 1 -- 172.21.15.7:0/3800312911 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7fd0b80ac960 con 0x7fd0c015bd70 2024-08-19T00:48:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.558+0000 7fd0bea00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd09c070240 0x7fd09c072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.559+0000 7fd0bea00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd09c070240 0x7fd09c072700 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006fd0 tx=0x7fd0b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:33.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.563+0000 7fd0b7400640 1 -- 172.21.15.7:0/3800312911 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd0b8079f30 con 0x7fd0c015bd70 2024-08-19T00:48:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.783+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0c015a010 con 0x7fd0c015bd70 2024-08-19T00:48:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.784+0000 7fd0b7400640 1 -- 172.21.15.7:0/3800312911 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+4394 (secure 0 0 0) 0x7fd0b807e230 con 0x7fd0c015bd70 2024-08-19T00:48:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:33.786 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":336,"btime":"2024-08-19T00:48:30:102811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:30.102809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 336 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd09c070240 msgr2=0x7fd09c072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd09c070240 0x7fd09c072700 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006fd0 tx=0x7fd0b0008040 comp rx=0 tx=0).stop 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c015bd70 msgr2=0x7fd0c01e6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c015bd70 0x7fd0c01e6250 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009f40 tx=0x7fd0b8004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 shutdown_connections 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd09c070240 0x7fd09c072700 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0c015bd70 0x7fd0c01e6250 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0c0072f70 0x7fd0c0149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 --2- 172.21.15.7:0/3800312911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0c006dd10 0x7fd0c014c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 >> 172.21.15.7:0/3800312911 conn(0x7fd0c006b850 msgr2=0x7fd0c00cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 shutdown_connections 2024-08-19T00:48:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:33.786+0000 7fd0bfe00640 1 -- 172.21.15.7:0/3800312911 wait complete. 2024-08-19T00:48:33.804 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 1.00000000' led to DAMAGED state 2024-08-19T00:48:33.804 INFO:tasks.cephfs.test_damage:All 39 mutations had expected outcomes 2024-08-19T00:48:33.804 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:48:33.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:48:33.901 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:48:33.994 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:48:33.995 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:48:33.995 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:33.995 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:34.030 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:48:34.031 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:48:34.031 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:48:34.031 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:34.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:48:34.069 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:48:34.069 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:34.069 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:34.106 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:48:34.106 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:48:34.106 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:48:34.106 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:34.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:48:34.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:34.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.301+0000 7ff0e5400640 1 Processor -- start 2024-08-19T00:48:34.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.301+0000 7ff0e5400640 1 -- start start 2024-08-19T00:48:34.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0e5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e00d03c0 0x7ff0e0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0e5400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0e00b3750 0x7ff0e00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0e5400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e00cdfb0 con 0x7ff0e006e710 2024-08-19T00:48:34.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0e5400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e00cebc0 con 0x7ff0e00b3750 2024-08-19T00:48:34.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0e5400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e00ce290 con 0x7ff0e00d03c0 2024-08-19T00:48:34.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0d7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0e006e710 0x7ff0e00d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35462/0 (socket says 172.21.15.7:35462) 2024-08-19T00:48:34.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0d7e00640 1 -- 172.21.15.7:0/2514223117 learned_addr learned my addr 172.21.15.7:0/2514223117 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:34.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0de800640 1 --2- 172.21.15.7:0/2514223117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e00d03c0 0x7ff0e0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0df200640 1 --2- 172.21.15.7:0/2514223117 >> v2:172.21.15.162:3300/0 conn(0x7ff0e00b3750 0x7ff0e00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.302+0000 7ff0dde00640 1 -- 172.21.15.7:0/2514223117 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675588513 0 0) 0x7ff0e00cdfb0 con 0x7ff0e006e710 2024-08-19T00:48:34.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.303+0000 7ff0dde00640 1 -- 172.21.15.7:0/2514223117 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0c4003520 con 0x7ff0e006e710 2024-08-19T00:48:34.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.303+0000 7ff0dde00640 1 -- 172.21.15.7:0/2514223117 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1886245239 0 0) 0x7ff0c4003520 con 0x7ff0e006e710 2024-08-19T00:48:34.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.303+0000 7ff0de800640 1 -- 172.21.15.7:0/2514223117 >> v2:172.21.15.162:3300/0 conn(0x7ff0e00b3750 msgr2=0x7ff0e00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:34.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.303+0000 7ff0de800640 1 --2- 172.21.15.7:0/2514223117 >> v2:172.21.15.162:3300/0 conn(0x7ff0e00b3750 0x7ff0e00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.303+0000 7ff0de800640 1 -- 172.21.15.7:0/2514223117 >> v1:172.21.15.7:6789/0 conn(0x7ff0e006e710 legacy=0x7ff0e00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.303+0000 7ff0de800640 1 -- 172.21.15.7:0/2514223117 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e00ce570 con 0x7ff0e00d03c0 2024-08-19T00:48:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.304+0000 7ff0de800640 1 --2- 172.21.15.7:0/2514223117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e00d03c0 0x7ff0e0071980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00097a0 tx=0x7ff0d002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e21d8612783e840 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.304+0000 7ff0dde00640 1 -- 172.21.15.7:0/2514223117 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0037070 con 0x7ff0e00d03c0 2024-08-19T00:48:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.304+0000 7ff0dde00640 1 -- 172.21.15.7:0/2514223117 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d002aba0 con 0x7ff0e00d03c0 2024-08-19T00:48:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.304+0000 7ff0dde00640 1 -- 172.21.15.7:0/2514223117 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8001670 con 0x7ff0e00d03c0 2024-08-19T00:48:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 -- 172.21.15.7:0/2514223117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e00d03c0 msgr2=0x7ff0e0071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 --2- 172.21.15.7:0/2514223117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e00d03c0 0x7ff0e0071980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00097a0 tx=0x7ff0d002a110 comp rx=0 tx=0).stop 2024-08-19T00:48:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 -- 172.21.15.7:0/2514223117 shutdown_connections 2024-08-19T00:48:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 --2- 172.21.15.7:0/2514223117 >> v2:172.21.15.162:3300/0 conn(0x7ff0e00b3750 0x7ff0e00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 --2- 172.21.15.7:0/2514223117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e00d03c0 0x7ff0e0071980 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 -- 172.21.15.7:0/2514223117 >> 172.21.15.7:0/2514223117 conn(0x7ff0e006bc70 msgr2=0x7ff0e006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 -- 172.21.15.7:0/2514223117 shutdown_connections 2024-08-19T00:48:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.305+0000 7ff0e5400640 1 -- 172.21.15.7:0/2514223117 wait complete. 2024-08-19T00:48:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.307+0000 7ff0e5400640 1 Processor -- start 2024-08-19T00:48:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.307+0000 7ff0e5400640 1 -- start start 2024-08-19T00:48:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0e5400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e006e710 0x7ff0e0156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0e5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e00b3750 0x7ff0e01f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0e5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0e00d03c0 0x7ff0e01f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0e5400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0073c60 con 0x7ff0e00d03c0 2024-08-19T00:48:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0e5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0073ae0 con 0x7ff0e00b3750 2024-08-19T00:48:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0e5400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e00b3be0 con 0x7ff0e006e710 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0e00d03c0 0x7ff0e01f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0e00d03c0 0x7ff0e01f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57578/0 (socket says 172.21.15.7:57578) 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 -- 172.21.15.7:0/218503174 learned_addr learned my addr 172.21.15.7:0/218503174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 -- 172.21.15.7:0/218503174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e006e710 msgr2=0x7ff0e0156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e006e710 0x7ff0e0156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 -- 172.21.15.7:0/218503174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e00b3750 msgr2=0x7ff0e01f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e00b3750 0x7ff0e01f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.308+0000 7ff0df200640 1 -- 172.21.15.7:0/218503174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e015c480 con 0x7ff0e00d03c0 2024-08-19T00:48:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.309+0000 7ff0df200640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0e00d03c0 0x7ff0e01f7ca0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800bde0 tx=0x7ff0d800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:34.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.309+0000 7ff0d6a00640 1 -- 172.21.15.7:0/218503174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d801a070 con 0x7ff0e00d03c0 2024-08-19T00:48:34.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.309+0000 7ff0d6a00640 1 -- 172.21.15.7:0/218503174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d800ed20 con 0x7ff0e00d03c0 2024-08-19T00:48:34.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.309+0000 7ff0d6a00640 1 -- 172.21.15.7:0/218503174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800b3e0 con 0x7ff0e00d03c0 2024-08-19T00:48:34.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.309+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e015c760 con 0x7ff0e00d03c0 2024-08-19T00:48:34.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.309+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e015cd20 con 0x7ff0e00d03c0 2024-08-19T00:48:34.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.310+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e00cdfb0 con 0x7ff0e00d03c0 2024-08-19T00:48:34.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.311+0000 7ff0d6a00640 1 -- 172.21.15.7:0/218503174 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0d801d070 con 0x7ff0e00d03c0 2024-08-19T00:48:34.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.312+0000 7ff0d6a00640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.312+0000 7ff0d6a00640 1 -- 172.21.15.7:0/218503174 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7ff0d808be70 con 0x7ff0e00d03c0 2024-08-19T00:48:34.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.312+0000 7ff0de800640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.313+0000 7ff0de800640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0034000 tx=0x7ff0d002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.316+0000 7ff0d6a00640 1 -- 172.21.15.7:0/218503174 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff0d8059a00 con 0x7ff0e00d03c0 2024-08-19T00:48:34.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.536+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0e0071980 con 0x7ff0e00d03c0 2024-08-19T00:48:34.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.536+0000 7ff0d6a00640 1 -- 172.21.15.7:0/218503174 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+4394 (secure 0 0 0) 0x7ff0d8059300 con 0x7ff0e00d03c0 2024-08-19T00:48:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:34.539 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":336,"btime":"2024-08-19T00:48:30:102811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:30.102809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:34.539 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 336 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0bc06be30 msgr2=0x7ff0bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0034000 tx=0x7ff0d002c000 comp rx=0 tx=0).stop 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0e00d03c0 msgr2=0x7ff0e01f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0e00d03c0 0x7ff0e01f7ca0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800bde0 tx=0x7ff0d800e490 comp rx=0 tx=0).stop 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 shutdown_connections 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0e00d03c0 0x7ff0e01f7ca0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e00b3750 0x7ff0e01f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 --2- 172.21.15.7:0/218503174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e006e710 0x7ff0e0156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.538+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 >> 172.21.15.7:0/218503174 conn(0x7ff0e006bc70 msgr2=0x7ff0e0159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.539+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 shutdown_connections 2024-08-19T00:48:34.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.539+0000 7ff0e5400640 1 -- 172.21.15.7:0/218503174 wait complete. 2024-08-19T00:48:34.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:34.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.711+0000 7fc586600640 1 Processor -- start 2024-08-19T00:48:34.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.711+0000 7fc586600640 1 -- start start 2024-08-19T00:48:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.712+0000 7fc586600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc580071980 0x7fc5800cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.712+0000 7fc586600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5800cdfb0 con 0x7fc5800d03c0 2024-08-19T00:48:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.712+0000 7fc586600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5800ce290 con 0x7fc58006e710 2024-08-19T00:48:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.712+0000 7fc586600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5800cebc0 con 0x7fc580071980 2024-08-19T00:48:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc5800d03c0 0x7fc5800d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35470/0 (socket says 172.21.15.7:35470) 2024-08-19T00:48:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57f400640 1 -- 172.21.15.7:0/2323290002 learned_addr learned my addr 172.21.15.7:0/2323290002 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:34.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57fe00640 1 --2- 172.21.15.7:0/2323290002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc580071980 0x7fc5800cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57ea00640 1 -- 172.21.15.7:0/2323290002 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662911362 0 0) 0x7fc5800cdfb0 con 0x7fc5800d03c0 2024-08-19T00:48:34.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57ea00640 1 -- 172.21.15.7:0/2323290002 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc564003520 con 0x7fc5800d03c0 2024-08-19T00:48:34.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57fe00640 1 -- 172.21.15.7:0/2323290002 >> v1:172.21.15.162:6789/0 conn(0x7fc58006e710 legacy=0x7fc5800b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57ea00640 1 -- 172.21.15.7:0/2323290002 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163943553 0 0) 0x7fc5800ce290 con 0x7fc58006e710 2024-08-19T00:48:34.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57fe00640 1 -- 172.21.15.7:0/2323290002 >> v1:172.21.15.7:6789/0 conn(0x7fc5800d03c0 legacy=0x7fc5800d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.713+0000 7fc57fe00640 1 -- 172.21.15.7:0/2323290002 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5800ce570 con 0x7fc580071980 2024-08-19T00:48:34.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.715+0000 7fc57fe00640 1 --2- 172.21.15.7:0/2323290002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc580071980 0x7fc5800cf050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc578009df0 tx=0x7fc57802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f20ff28a227048 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:34.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.715+0000 7fc57ea00640 1 -- 172.21.15.7:0/2323290002 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578007740 con 0x7fc580071980 2024-08-19T00:48:34.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.715+0000 7fc57ea00640 1 -- 172.21.15.7:0/2323290002 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5780078e0 con 0x7fc580071980 2024-08-19T00:48:34.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.715+0000 7fc57ea00640 1 -- 172.21.15.7:0/2323290002 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578007cb0 con 0x7fc580071980 2024-08-19T00:48:34.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.715+0000 7fc586600640 1 -- 172.21.15.7:0/2323290002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc580071980 msgr2=0x7fc5800cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.715+0000 7fc586600640 1 --2- 172.21.15.7:0/2323290002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc580071980 0x7fc5800cf050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc578009df0 tx=0x7fc57802a710 comp rx=0 tx=0).stop 2024-08-19T00:48:34.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.716+0000 7fc586600640 1 -- 172.21.15.7:0/2323290002 shutdown_connections 2024-08-19T00:48:34.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.716+0000 7fc586600640 1 --2- 172.21.15.7:0/2323290002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc580071980 0x7fc5800cf050 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.716+0000 7fc586600640 1 -- 172.21.15.7:0/2323290002 >> 172.21.15.7:0/2323290002 conn(0x7fc58006bc70 msgr2=0x7fc58006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:34.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.716+0000 7fc586600640 1 -- 172.21.15.7:0/2323290002 shutdown_connections 2024-08-19T00:48:34.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.716+0000 7fc586600640 1 -- 172.21.15.7:0/2323290002 wait complete. 2024-08-19T00:48:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.717+0000 7fc586600640 1 Processor -- start 2024-08-19T00:48:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.717+0000 7fc586600640 1 -- start start 2024-08-19T00:48:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.718+0000 7fc586600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58006e710 0x7fc5801f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.718+0000 7fc586600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc580071980 0x7fc5801592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.718+0000 7fc586600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5800d03c0 0x7fc580159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.718+0000 7fc586600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc580073c60 con 0x7fc580071980 2024-08-19T00:48:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.718+0000 7fc586600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc580073ae0 con 0x7fc58006e710 2024-08-19T00:48:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.718+0000 7fc586600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5800cf590 con 0x7fc5800d03c0 2024-08-19T00:48:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc577e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc580071980 0x7fc5801592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc57f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58006e710 0x7fc5801f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc577e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc580071980 0x7fc5801592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57594/0 (socket says 172.21.15.7:57594) 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc577e00640 1 -- 172.21.15.7:0/385751539 learned_addr learned my addr 172.21.15.7:0/385751539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc57fe00640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5800d03c0 0x7fc580159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc57f400640 1 -- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5800d03c0 msgr2=0x7fc580159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc57f400640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5800d03c0 0x7fc580159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc57f400640 1 -- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc580071980 msgr2=0x7fc5801592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc57f400640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc580071980 0x7fc5801592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc57f400640 1 -- 172.21.15.7:0/385751539 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5801f3f00 con 0x7fc58006e710 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.719+0000 7fc577e00640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc580071980 0x7fc5801592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.720+0000 7fc57f400640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58006e710 0x7fc5801f39c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c400 tx=0x7fc57000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.720+0000 7fc577400640 1 -- 172.21.15.7:0/385751539 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570017070 con 0x7fc58006e710 2024-08-19T00:48:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.720+0000 7fc577400640 1 -- 172.21.15.7:0/385751539 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570005ce0 con 0x7fc58006e710 2024-08-19T00:48:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.720+0000 7fc577400640 1 -- 172.21.15.7:0/385751539 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5700072f0 con 0x7fc58006e710 2024-08-19T00:48:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.720+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc580156250 con 0x7fc58006e710 2024-08-19T00:48:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.720+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc580153480 con 0x7fc58006e710 2024-08-19T00:48:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.721+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5800ce290 con 0x7fc58006e710 2024-08-19T00:48:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.722+0000 7fc577400640 1 -- 172.21.15.7:0/385751539 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc57001a070 con 0x7fc58006e710 2024-08-19T00:48:34.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.723+0000 7fc577400640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55c06be30 0x7fc55c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:34.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.723+0000 7fc577400640 1 -- 172.21.15.7:0/385751539 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7fc57008aea0 con 0x7fc58006e710 2024-08-19T00:48:34.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.723+0000 7fc577e00640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55c06be30 0x7fc55c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:34.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.724+0000 7fc577e00640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55c06be30 0x7fc55c06e2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc5801f7610 tx=0x7fc568009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:34.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.729+0000 7fc577400640 1 -- 172.21.15.7:0/385751539 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc5700584d0 con 0x7fc58006e710 2024-08-19T00:48:34.862 INFO:tasks.ceph.mds.c.smithi007.stderr: -51> 2024-08-19T00:48:30.101+0000 7fa04f200640 -1 mds.0.cache.dir(0x1) Corrupt fnode in dirfrag 0x1: Decoder at 'void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)' v=3 cannot decode v=100 minimal_decoder=101: Malformed input [buffer:3] 2024-08-19T00:48:34.863 INFO:tasks.ceph.mds.c.smithi007.stderr: -48> 2024-08-19T00:48:30.101+0000 7fa04f200640 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2024-08-19T00:48:34.863 INFO:tasks.ceph.mds.c.smithi007.stderr: -17> 2024-08-19T00:48:33.461+0000 7fa054200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:34.903 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:48:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.959+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5800adaa0 con 0x7fc58006e710 2024-08-19T00:48:34.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.959+0000 7fc577400640 1 -- 172.21.15.7:0/385751539 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+4394 (secure 0 0 0) 0x7fc57005c7d0 con 0x7fc58006e710 2024-08-19T00:48:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":336,"btime":"2024-08-19T00:48:30:102811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:30.102809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:34.962 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 336 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55c06be30 msgr2=0x7fc55c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55c06be30 0x7fc55c06e2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc5801f7610 tx=0x7fc568009040 comp rx=0 tx=0).stop 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58006e710 msgr2=0x7fc5801f39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58006e710 0x7fc5801f39c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c400 tx=0x7fc57000c8c0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 shutdown_connections 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc55c06be30 0x7fc55c06e2f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5800d03c0 0x7fc580159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc580071980 0x7fc5801592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 --2- 172.21.15.7:0/385751539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58006e710 0x7fc5801f39c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 >> 172.21.15.7:0/385751539 conn(0x7fc58006bc70 msgr2=0x7fc5800acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 shutdown_connections 2024-08-19T00:48:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:34.962+0000 7fc586600640 1 -- 172.21.15.7:0/385751539 wait complete. 2024-08-19T00:48:34.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:48:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.138+0000 7f9bd2600640 1 Processor -- start 2024-08-19T00:48:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.138+0000 7f9bd2600640 1 -- start start 2024-08-19T00:48:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.139+0000 7f9bd2600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bcc06cad0 0x7f9bcc0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.139+0000 7f9bd2600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9bcc06ceb0 0x7f9bcc0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.139+0000 7f9bd2600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0b5c00 0x7f9bcc15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.139+0000 7f9bd2600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9bcc0ae780 con 0x7f9bcc06ceb0 2024-08-19T00:48:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.139+0000 7f9bd2600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9bcc0aea00 con 0x7f9bcc06cad0 2024-08-19T00:48:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.139+0000 7f9bd2600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9bcc0aece0 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.139+0000 7f9bcaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9bcc06ceb0 0x7f9bcc0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9bcc06ceb0 0x7f9bcc0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57636/0 (socket says 172.21.15.7:57636) 2024-08-19T00:48:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcaa00640 1 -- 172.21.15.7:0/1122768939 learned_addr learned my addr 172.21.15.7:0/1122768939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcb400640 1 --2- 172.21.15.7:0/1122768939 >> v2:172.21.15.162:3300/0 conn(0x7f9bcc06cad0 0x7f9bcc0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcbe00640 1 --2- 172.21.15.7:0/1122768939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0b5c00 0x7f9bcc15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcaa00640 1 -- 172.21.15.7:0/1122768939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0b5c00 msgr2=0x7f9bcc15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcaa00640 1 --2- 172.21.15.7:0/1122768939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0b5c00 0x7f9bcc15dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcaa00640 1 -- 172.21.15.7:0/1122768939 >> v2:172.21.15.162:3300/0 conn(0x7f9bcc06cad0 msgr2=0x7f9bcc0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcaa00640 1 --2- 172.21.15.7:0/1122768939 >> v2:172.21.15.162:3300/0 conn(0x7f9bcc06cad0 0x7f9bcc0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.140+0000 7f9bcaa00640 1 -- 172.21.15.7:0/1122768939 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc0aefc0 con 0x7f9bcc06ceb0 2024-08-19T00:48:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.141+0000 7f9bcaa00640 1 --2- 172.21.15.7:0/1122768939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc06ceb0 0x7f9bcc0b56c0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009870 tx=0x7f9bb802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97a459f8efb79a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.141+0000 7f9bca000640 1 -- 172.21.15.7:0/1122768939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8037070 con 0x7f9bcc06ceb0 2024-08-19T00:48:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.141+0000 7f9bca000640 1 -- 172.21.15.7:0/1122768939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8032440 con 0x7f9bcc06ceb0 2024-08-19T00:48:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.141+0000 7f9bca000640 1 -- 172.21.15.7:0/1122768939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8032810 con 0x7f9bcc06ceb0 2024-08-19T00:48:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 -- 172.21.15.7:0/1122768939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc06ceb0 msgr2=0x7f9bcc0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 --2- 172.21.15.7:0/1122768939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc06ceb0 0x7f9bcc0b56c0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009870 tx=0x7f9bb802a180 comp rx=0 tx=0).stop 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 -- 172.21.15.7:0/1122768939 shutdown_connections 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 --2- 172.21.15.7:0/1122768939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0b5c00 0x7f9bcc15dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 --2- 172.21.15.7:0/1122768939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc06ceb0 0x7f9bcc0b56c0 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 --2- 172.21.15.7:0/1122768939 >> v2:172.21.15.162:3300/0 conn(0x7f9bcc06cad0 0x7f9bcc0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 -- 172.21.15.7:0/1122768939 >> 172.21.15.7:0/1122768939 conn(0x7f9bcc0721b0 msgr2=0x7f9bcc0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 -- 172.21.15.7:0/1122768939 shutdown_connections 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.142+0000 7f9bd2600640 1 -- 172.21.15.7:0/1122768939 wait complete. 2024-08-19T00:48:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.144+0000 7f9bd2600640 1 Processor -- start 2024-08-19T00:48:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.144+0000 7f9bd2600640 1 -- start start 2024-08-19T00:48:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bd2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc06cad0 0x7f9bcc143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bd2600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc06ceb0 0x7f9bcc15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bd2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc0b5c00 0x7f9bcc143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bd2600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc0b4a00 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bd2600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc0afd00 con 0x7f9bcc06cad0 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bd2600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9bcc0b4b80 con 0x7f9bcc06ceb0 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc0b5c00 0x7f9bcc143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc0b5c00 0x7f9bcc143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57648/0 (socket says 172.21.15.7:57648) 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 -- 172.21.15.7:0/3621986559 learned_addr learned my addr 172.21.15.7:0/3621986559 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcaa00640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc06ceb0 0x7f9bcc15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcb400640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc06cad0 0x7f9bcc143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 -- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc06ceb0 msgr2=0x7f9bcc15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc06ceb0 0x7f9bcc15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 -- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc06cad0 msgr2=0x7f9bcc143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc06cad0 0x7f9bcc143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.145+0000 7f9bcbe00640 1 -- 172.21.15.7:0/3621986559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc15b7d0 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.146+0000 7f9bcbe00640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc0b5c00 0x7f9bcc143c20 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400efc0 tx=0x7f9bc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.146+0000 7f9bc3400640 1 -- 172.21.15.7:0/3621986559 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4018020 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.146+0000 7f9bc3400640 1 -- 172.21.15.7:0/3621986559 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc4014480 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.146+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc15bab0 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.146+0000 7f9bc3400640 1 -- 172.21.15.7:0/3621986559 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4014870 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.146+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc15c070 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.147+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bcc0af7c0 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.148+0000 7f9bc3400640 1 -- 172.21.15.7:0/3621986559 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bc4005d10 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.149+0000 7f9bc3400640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bac06be30 0x7f9bac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.149+0000 7f9bc3400640 1 -- 172.21.15.7:0/3621986559 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f9bc408c5e0 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.149+0000 7f9bcb400640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bac06be30 0x7f9bac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.150+0000 7f9bcb400640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bac06be30 0x7f9bac06e2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009ad0 tx=0x7f9bbc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.153+0000 7f9bc3400640 1 -- 172.21.15.7:0/3621986559 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9bc4022070 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.339+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bcc15b170 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.341+0000 7f9bc3400640 1 -- 172.21.15.7:0/3621986559 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+21742 (secure 0 0 0) 0x7f9bc4010040 con 0x7f9bcc0b5c00 2024-08-19T00:48:35.343 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:35.343 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":126,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:30.102517+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:43:24.450864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-08-19T00:43:25.656952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3833663519":"2024-08-20T00:48:23.055248+0000","172.21.15.7:6835/3833663519":"2024-08-20T00:48:23.055248+0000","172.21.15.7:6837/2039068272":"2024-08-20T00:48:16.032983+0000","172.21.15.7:6837/2241506175":"2024-08-20T00:48:10.491906+0000","172.21.15.7:6837/767746356":"2024-08-20T00:47:36.848235+0000","172.21.15.7:6837/2697833470":"2024-08-20T00:47:13.631762+0000","172.21.15.7:6835/2697833470":"2024-08-20T00:47:13.631762+0000","172.21.15.7:6837/564246395":"2024-08-20T00:47:08.596064+0000","172.21.15.7:6835/564246395":"2024-08-20T00:47:08.596064+0000","172.21.15.7:6836/23553373":"2024-08-20T00:46:48.423172+0000","172.21.15.7:6834/23553373":"2024-08-20T00:46:48.423172+0000","172.21.15.7:6837/300508336":"2024-08-20T00:46:44.396111+0000","172.21.15.7:6835/2764430344":"2024-08-20T00:45:15.874510+0000","172.21.15.7:6834/3808845958":"2024-08-20T00:48:30.102500+0000","172.21.15.7:6835/2555026980":"2024-08-20T00:46:00.124037+0000","172.21.15.7:6837/1092992076":"2024-08-20T00:45:13.853614+0000","172.21.15.7:6837/2764430344":"2024-08-20T00:45:15.874510+0000","172.21.15.162:6834/3169517259":"2024-08-20T00:43:59.140007+0000","172.21.15.7:6836/3307283757":"2024-08-20T00:46:04.155541+0000","172.21.15.7:6836/1524598451":"2024-08-20T00:45:00.316452+0000","172.21.15.7:6834/3804092925":"2024-08-20T00:46:12.208398+0000","172.21.15.7:6835/877185885":"2024-08-20T00:44:46.224779+0000","172.21.15.7:6834/3482025847":"2024-08-20T00:44:53.272372+0000","172.21.15.7:6837/3471482572":"2024-08-20T00:46:36.346761+0000","172.21.15.7:6836/918472079":"2024-08-20T00:44:39.648889+0000","172.21.15.7:6835/3239344481":"2024-08-20T00:47:53.939814+0000","172.21.15.7:6837/2555026980":"2024-08-20T00:46:00.124037+0000","172.21.15.7:6834/918472079":"2024-08-20T00:44:39.648889+0000","172.21.15.7:6835/3619862411":"2024-08-20T00:45:39.018072+0000","172.21.15.7:6836/95446058":"2024-08-20T00:46:20.274334+0000","172.21.15.7:6837/3239344481":"2024-08-20T00:47:53.939814+0000","172.21.15.7:6837/978981940":"2024-08-20T00:47:48.474571+0000","172.21.15.7:6836/3784682490":"2024-08-20T00:44:27.595559+0000","172.21.15.162:6832/2295549448":"2024-08-20T00:43:37.028725+0000","172.21.15.7:6835/1092992076":"2024-08-20T00:45:13.853614+0000","172.21.15.7:6837/232072615":"2024-08-20T00:45:30.946343+0000","172.21.15.7:6836/1582667547":"2024-08-20T00:44:10.208810+0000","172.21.15.7:6835/2458713155":"2024-08-20T00:44:06.188927+0000","172.21.15.7:6837/4018426566":"2024-08-20T00:46:08.138498+0000","172.21.15.7:6837/2458713155":"2024-08-20T00:44:06.188927+0000","172.21.15.7:6834/1582667547":"2024-08-20T00:44:10.208810+0000","172.21.15.7:6837/2121313657":"2024-08-20T00:45:23.908167+0000","172.21.15.7:6836/3482025847":"2024-08-20T00:44:53.272372+0000","172.21.15.7:6834/1524598451":"2024-08-20T00:45:00.316452+0000","172.21.15.7:6835/978981940":"2024-08-20T00:47:48.474571+0000","172.21.15.7:6836/3804092925":"2024-08-20T00:46:12.208398+0000","172.21.15.162:6834/3482189423":"2024-08-20T00:43:53.541123+0000","172.21.15.162:6833/3482189423":"2024-08-20T00:43:53.541123+0000","172.21.15.7:6835/2121313657":"2024-08-20T00:45:23.908167+0000","172.21.15.7:6834/95446058":"2024-08-20T00:46:20.274334+0000","172.21.15.7:6834/3427152926":"2024-08-20T00:44:42.202799+0000","172.21.15.7:6835/232072615":"2024-08-20T00:45:30.946343+0000","172.21.15.7:6835/3471482572":"2024-08-20T00:46:36.346761+0000","172.21.15.7:6837/1850770580":"2024-08-20T00:44:14.242517+0000","172.21.15.7:6834/3784682490":"2024-08-20T00:44:27.595559+0000","172.21.15.7:6834/835453535":"2024-08-20T00:45:34.977428+0000","172.21.15.7:6836/835453535":"2024-08-20T00:45:34.977428+0000","172.21.15.7:6837/877185885":"2024-08-20T00:44:46.224779+0000","172.21.15.7:6837/3619862411":"2024-08-20T00:45:39.018072+0000","172.21.15.7:6834/3399848835":"2024-08-20T00:45:53.817587+0000","172.21.15.7:6836/3808845958":"2024-08-20T00:48:30.102500+0000","172.21.15.7:6835/2241506175":"2024-08-20T00:48:10.491906+0000","172.21.15.7:6835/767746356":"2024-08-20T00:47:36.848235+0000","172.21.15.7:6835/1850770580":"2024-08-20T00:44:14.242517+0000","172.21.15.7:6834/1067237290":"2024-08-20T00:45:56.104621+0000","172.21.15.7:6836/1067237290":"2024-08-20T00:45:56.104621+0000","172.21.15.7:6834/3307283757":"2024-08-20T00:46:04.155541+0000","172.21.15.7:6836/3427152926":"2024-08-20T00:44:42.202799+0000","172.21.15.7:6835/4018426566":"2024-08-20T00:46:08.138498+0000","172.21.15.7:6835/613323192":"2024-08-20T00:46:16.237393+0000","172.21.15.7:6837/613323192":"2024-08-20T00:46:16.237393+0000","172.21.15.7:6835/1141791797":"2024-08-20T00:46:33.788770+0000","172.21.15.7:6835/2039068272":"2024-08-20T00:48:16.032983+0000","172.21.15.7:6837/1141791797":"2024-08-20T00:46:33.788770+0000","172.21.15.7:6834/4168746347":"2024-08-20T00:46:40.368064+0000","172.21.15.162:6833/3169517259":"2024-08-20T00:43:59.140007+0000","172.21.15.162:6835/2295549448":"2024-08-20T00:43:37.028725+0000","172.21.15.7:6836/4168746347":"2024-08-20T00:46:40.368064+0000","172.21.15.7:6836/3399848835":"2024-08-20T00:45:53.817587+0000","172.21.15.7:6835/300508336":"2024-08-20T00:46:44.396111+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bac06be30 msgr2=0x7f9bac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bac06be30 0x7f9bac06e2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009ad0 tx=0x7f9bbc008040 comp rx=0 tx=0).stop 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc0b5c00 msgr2=0x7f9bcc143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc0b5c00 0x7f9bcc143c20 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400efc0 tx=0x7f9bc400c490 comp rx=0 tx=0).stop 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 shutdown_connections 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9bac06be30 0x7f9bac06e2f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc0b5c00 0x7f9bcc143c20 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc06ceb0 0x7f9bcc15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 --2- 172.21.15.7:0/3621986559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc06cad0 0x7f9bcc143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 >> 172.21.15.7:0/3621986559 conn(0x7f9bcc0721b0 msgr2=0x7f9bcc06ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:35.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 shutdown_connections 2024-08-19T00:48:35.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.343+0000 7f9bd2600640 1 -- 172.21.15.7:0/3621986559 wait complete. 2024-08-19T00:48:35.361 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:48:35.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.517+0000 7fde3fe00640 1 Processor -- start 2024-08-19T00:48:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.517+0000 7fde3fe00640 1 -- start start 2024-08-19T00:48:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.518+0000 7fde3fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde380aeb10 0x7fde380cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.518+0000 7fde3fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380d0ad0 0x7fde380acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.518+0000 7fde3fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde3806e660 con 0x7fde380ce460 2024-08-19T00:48:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.519+0000 7fde3fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fde3806e940 con 0x7fde380aeb10 2024-08-19T00:48:35.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.519+0000 7fde3fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde3806ec20 con 0x7fde380d0ad0 2024-08-19T00:48:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.519+0000 7fde3de00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380d0ad0 0x7fde380acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.519+0000 7fde3de00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380d0ad0 0x7fde380acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:47474/0 (socket says 172.21.15.7:47474) 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.519+0000 7fde3de00640 1 -- 172.21.15.7:0/1331005286 learned_addr learned my addr 172.21.15.7:0/1331005286 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.519+0000 7fde3d400640 1 --2- 172.21.15.7:0/1331005286 >> v2:172.21.15.162:3300/0 conn(0x7fde380aeb10 0x7fde380cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.519+0000 7fde37e00640 1 -- 172.21.15.7:0/1331005286 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283583877 0 0) 0x7fde3806e660 con 0x7fde380ce460 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.520+0000 7fde3de00640 1 -- 172.21.15.7:0/1331005286 >> v2:172.21.15.162:3300/0 conn(0x7fde380aeb10 msgr2=0x7fde380cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.520+0000 7fde3de00640 1 --2- 172.21.15.7:0/1331005286 >> v2:172.21.15.162:3300/0 conn(0x7fde380aeb10 0x7fde380cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.520+0000 7fde3de00640 1 -- 172.21.15.7:0/1331005286 >> v1:172.21.15.162:6789/0 conn(0x7fde380ce460 legacy=0x7fde380d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.520+0000 7fde3de00640 1 -- 172.21.15.7:0/1331005286 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3806ef00 con 0x7fde380d0ad0 2024-08-19T00:48:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.521+0000 7fde3de00640 1 --2- 172.21.15.7:0/1331005286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380d0ad0 0x7fde380acff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde30009e50 tx=0x7fde3002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd7768581ef4569 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.521+0000 7fde37e00640 1 -- 172.21.15.7:0/1331005286 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30036070 con 0x7fde380d0ad0 2024-08-19T00:48:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.521+0000 7fde37e00640 1 -- 172.21.15.7:0/1331005286 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde30031600 con 0x7fde380d0ad0 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.521+0000 7fde37e00640 1 -- 172.21.15.7:0/1331005286 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde300319d0 con 0x7fde380d0ad0 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.521+0000 7fde3fe00640 1 -- 172.21.15.7:0/1331005286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380d0ad0 msgr2=0x7fde380acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.521+0000 7fde3fe00640 1 --2- 172.21.15.7:0/1331005286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380d0ad0 0x7fde380acff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde30009e50 tx=0x7fde3002a710 comp rx=0 tx=0).stop 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.522+0000 7fde3fe00640 1 -- 172.21.15.7:0/1331005286 shutdown_connections 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.522+0000 7fde3fe00640 1 --2- 172.21.15.7:0/1331005286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380d0ad0 0x7fde380acff0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.522+0000 7fde3fe00640 1 --2- 172.21.15.7:0/1331005286 >> v2:172.21.15.162:3300/0 conn(0x7fde380aeb10 0x7fde380cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.522+0000 7fde3fe00640 1 -- 172.21.15.7:0/1331005286 >> 172.21.15.7:0/1331005286 conn(0x7fde3806bc70 msgr2=0x7fde3806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.522+0000 7fde3fe00640 1 -- 172.21.15.7:0/1331005286 shutdown_connections 2024-08-19T00:48:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.522+0000 7fde3fe00640 1 -- 172.21.15.7:0/1331005286 wait complete. 2024-08-19T00:48:35.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.523+0000 7fde3fe00640 1 Processor -- start 2024-08-19T00:48:35.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.523+0000 7fde3fe00640 1 -- start start 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.524+0000 7fde3fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde380aeb10 0x7fde38153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.524+0000 7fde3fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380ce460 0x7fde380c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.524+0000 7fde3fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380d0ad0 0x7fde38164a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.524+0000 7fde3fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fde3806f700 con 0x7fde380d0ad0 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.524+0000 7fde3fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde380cf900 con 0x7fde380aeb10 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.524+0000 7fde3fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde381f8510 con 0x7fde380ce460 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380d0ad0 0x7fde38164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380d0ad0 0x7fde38164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57660/0 (socket says 172.21.15.7:57660) 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 -- 172.21.15.7:0/3087416667 learned_addr learned my addr 172.21.15.7:0/3087416667 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3ca00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380ce460 0x7fde380c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3d400640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde380aeb10 0x7fde38153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 -- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380ce460 msgr2=0x7fde380c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380ce460 0x7fde380c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 -- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde380aeb10 msgr2=0x7fde38153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde380aeb10 0x7fde38153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.525+0000 7fde3de00640 1 -- 172.21.15.7:0/3087416667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde38165fd0 con 0x7fde380d0ad0 2024-08-19T00:48:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.526+0000 7fde3de00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380d0ad0 0x7fde38164a40 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fde30034040 tx=0x7fde30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.526+0000 7fde35600640 1 -- 172.21.15.7:0/3087416667 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30041070 con 0x7fde380d0ad0 2024-08-19T00:48:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.526+0000 7fde35600640 1 -- 172.21.15.7:0/3087416667 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde30003990 con 0x7fde380d0ad0 2024-08-19T00:48:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.526+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde38165cf0 con 0x7fde380d0ad0 2024-08-19T00:48:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.526+0000 7fde35600640 1 -- 172.21.15.7:0/3087416667 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30036040 con 0x7fde380d0ad0 2024-08-19T00:48:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.526+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3815f180 con 0x7fde380d0ad0 2024-08-19T00:48:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.527+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde380cf3c0 con 0x7fde380d0ad0 2024-08-19T00:48:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.528+0000 7fde35600640 1 -- 172.21.15.7:0/3087416667 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde30007820 con 0x7fde380d0ad0 2024-08-19T00:48:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.529+0000 7fde35600640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde1806be30 0x7fde1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.529+0000 7fde35600640 1 -- 172.21.15.7:0/3087416667 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7fde300ac6d0 con 0x7fde380d0ad0 2024-08-19T00:48:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.529+0000 7fde3d400640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde1806be30 0x7fde1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.530+0000 7fde3d400640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde1806be30 0x7fde1806e2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009ad0 tx=0x7fde2c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.533+0000 7fde35600640 1 -- 172.21.15.7:0/3087416667 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fde3004b020 con 0x7fde380d0ad0 2024-08-19T00:48:35.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.752+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde3806c050 con 0x7fde380d0ad0 2024-08-19T00:48:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.753+0000 7fde35600640 1 -- 172.21.15.7:0/3087416667 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 337 v337) ==== 95+0+5218 (secure 0 0 0) 0x7fde3007a260 con 0x7fde380d0ad0 2024-08-19T00:48:35.755 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:35.755 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":337,"btime":"2024-08-19T00:48:35:105684+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333},{"gid":10338,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1489488565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1489488565},{"type":"v1","addr":"172.21.15.7:6836","nonce":1489488565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":337}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:30.102809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:35.755 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 337 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde1806be30 msgr2=0x7fde1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde1806be30 0x7fde1806e2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009ad0 tx=0x7fde2c008040 comp rx=0 tx=0).stop 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380d0ad0 msgr2=0x7fde38164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380d0ad0 0x7fde38164a40 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fde30034040 tx=0x7fde30004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 shutdown_connections 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fde1806be30 0x7fde1806e2f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde380d0ad0 0x7fde38164a40 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde380ce460 0x7fde380c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 --2- 172.21.15.7:0/3087416667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde380aeb10 0x7fde38153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 >> 172.21.15.7:0/3087416667 conn(0x7fde3806bc70 msgr2=0x7fde38072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 shutdown_connections 2024-08-19T00:48:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.755+0000 7fde3fe00640 1 -- 172.21.15.7:0/3087416667 wait complete. 2024-08-19T00:48:35.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:35.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.928+0000 7f7461000640 1 Processor -- start 2024-08-19T00:48:35.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.928+0000 7f7461000640 1 -- start start 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f7461000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f745c15bd70 0x7f745c072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f7461000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745c0733f0 con 0x7f745c06dd10 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f7461000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745c0736d0 con 0x7f745c072f70 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f7461000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f745c0739b0 con 0x7f745c15bd70 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f745b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f745c15bd70 0x7f745c072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f745b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f745c15bd70 0x7f745c072a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57668/0 (socket says 172.21.15.7:57668) 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f745b400640 1 -- 172.21.15.7:0/2408893934 learned_addr learned my addr 172.21.15.7:0/2408893934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:35.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.929+0000 7f745be00640 1 --1- 172.21.15.7:0/2408893934 >> v1:172.21.15.7:6789/0 conn(0x7f745c06dd10 0x7f745c15cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35486/0 (socket says 172.21.15.7:35486) 2024-08-19T00:48:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.930+0000 7f745b400640 1 -- 172.21.15.7:0/2408893934 >> v1:172.21.15.162:6789/0 conn(0x7f745c072f70 legacy=0x7f745c06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.930+0000 7f745b400640 1 -- 172.21.15.7:0/2408893934 >> v1:172.21.15.7:6789/0 conn(0x7f745c06dd10 legacy=0x7f745c15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.930+0000 7f745b400640 1 -- 172.21.15.7:0/2408893934 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c15c4a0 con 0x7f745c15bd70 2024-08-19T00:48:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.931+0000 7f745b400640 1 --2- 172.21.15.7:0/2408893934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c15bd70 0x7f745c072a30 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f744c009870 tx=0x7f744c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3917f0f3c1722e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.931+0000 7f745aa00640 1 -- 172.21.15.7:0/2408893934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c037070 con 0x7f745c15bd70 2024-08-19T00:48:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.931+0000 7f745aa00640 1 -- 172.21.15.7:0/2408893934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c032440 con 0x7f745c15bd70 2024-08-19T00:48:35.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.931+0000 7f745aa00640 1 -- 172.21.15.7:0/2408893934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c032810 con 0x7f745c15bd70 2024-08-19T00:48:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.932+0000 7f7461000640 1 -- 172.21.15.7:0/2408893934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c15bd70 msgr2=0x7f745c072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.932+0000 7f7461000640 1 --2- 172.21.15.7:0/2408893934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c15bd70 0x7f745c072a30 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f744c009870 tx=0x7f744c02a270 comp rx=0 tx=0).stop 2024-08-19T00:48:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.932+0000 7f7461000640 1 -- 172.21.15.7:0/2408893934 shutdown_connections 2024-08-19T00:48:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.932+0000 7f7461000640 1 --2- 172.21.15.7:0/2408893934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c15bd70 0x7f745c072a30 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.932+0000 7f7461000640 1 -- 172.21.15.7:0/2408893934 >> 172.21.15.7:0/2408893934 conn(0x7f745c06b850 msgr2=0x7f745c06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.932+0000 7f7461000640 1 -- 172.21.15.7:0/2408893934 shutdown_connections 2024-08-19T00:48:35.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.932+0000 7f7461000640 1 -- 172.21.15.7:0/2408893934 wait complete. 2024-08-19T00:48:35.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.933+0000 7f7461000640 1 Processor -- start 2024-08-19T00:48:35.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.934+0000 7f7461000640 1 -- start start 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.934+0000 7f7461000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c06dd10 0x7f745c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.934+0000 7f7461000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c072f70 0x7f745c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.934+0000 7f7461000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f745c15bd70 0x7f745c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.934+0000 7f7461000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f745c06e3a0 con 0x7f745c06dd10 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.934+0000 7f7461000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f745c15c150 con 0x7f745c072f70 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.934+0000 7f7461000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f745c06e520 con 0x7f745c15bd70 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c06dd10 0x7f745c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c06dd10 0x7f745c157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57684/0 (socket says 172.21.15.7:57684) 2024-08-19T00:48:35.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 -- 172.21.15.7:0/1765387386 learned_addr learned my addr 172.21.15.7:0/1765387386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f7452a00640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c072f70 0x7f745c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745be00640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f745c15bd70 0x7f745c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 -- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f745c15bd70 msgr2=0x7f745c154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f745c15bd70 0x7f745c154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 -- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c072f70 msgr2=0x7f745c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c072f70 0x7f745c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 -- 172.21.15.7:0/1765387386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c158320 con 0x7f745c06dd10 2024-08-19T00:48:35.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.935+0000 7f745b400640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c06dd10 0x7f745c157de0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f744c000c00 tx=0x7f744c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.936+0000 7f7453e00640 1 -- 172.21.15.7:0/1765387386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c037040 con 0x7f745c06dd10 2024-08-19T00:48:35.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.936+0000 7f7453e00640 1 -- 172.21.15.7:0/1765387386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c042070 con 0x7f745c06dd10 2024-08-19T00:48:35.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.936+0000 7f7453e00640 1 -- 172.21.15.7:0/1765387386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c030bd0 con 0x7f745c06dd10 2024-08-19T00:48:35.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.936+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c1585f0 con 0x7f745c06dd10 2024-08-19T00:48:35.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.936+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c158bb0 con 0x7f745c06dd10 2024-08-19T00:48:35.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.937+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745c072a30 con 0x7f745c06dd10 2024-08-19T00:48:35.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.938+0000 7f7453e00640 1 -- 172.21.15.7:0/1765387386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f744c047460 con 0x7f745c06dd10 2024-08-19T00:48:35.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.939+0000 7f7453e00640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f743806be30 0x7f743806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:35.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.939+0000 7f7453e00640 1 -- 172.21.15.7:0/1765387386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f744c0ac8c0 con 0x7f745c06dd10 2024-08-19T00:48:35.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.939+0000 7f7452a00640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f743806be30 0x7f743806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:35.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.940+0000 7f7452a00640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f743806be30 0x7f743806e2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7444007fd0 tx=0x7f7444009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:35.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:35.943+0000 7f7453e00640 1 -- 172.21.15.7:0/1765387386 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f744c045360 con 0x7f745c06dd10 2024-08-19T00:48:36.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.164+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f745c0b43d0 con 0x7f745c06dd10 2024-08-19T00:48:36.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.164+0000 7f7453e00640 1 -- 172.21.15.7:0/1765387386 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 337 v337) ==== 95+0+5218 (secure 0 0 0) 0x7f744c07a450 con 0x7f745c06dd10 2024-08-19T00:48:36.166 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:36.166 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":337,"btime":"2024-08-19T00:48:35:105684+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333},{"gid":10338,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1489488565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1489488565},{"type":"v1","addr":"172.21.15.7:6836","nonce":1489488565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":337}],"filesystems":[{"mdsmap":{"epoch":336,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:43:26.670581+0000","modified":"2024-08-19T00:48:30.102809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-19T00:48:36.166 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 337 2024-08-19T00:48:36.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f743806be30 msgr2=0x7f743806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f743806be30 0x7f743806e2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7444007fd0 tx=0x7f7444009040 comp rx=0 tx=0).stop 2024-08-19T00:48:36.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c06dd10 msgr2=0x7f745c157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c06dd10 0x7f745c157de0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f744c000c00 tx=0x7f744c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 shutdown_connections 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f743806be30 0x7f743806e2f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f745c15bd70 0x7f745c154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c072f70 0x7f745c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 --2- 172.21.15.7:0/1765387386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745c06dd10 0x7f745c157de0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.166+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 >> 172.21.15.7:0/1765387386 conn(0x7f745c06b850 msgr2=0x7f745c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.167+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 shutdown_connections 2024-08-19T00:48:36.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.167+0000 7f7461000640 1 -- 172.21.15.7:0/1765387386 wait complete. 2024-08-19T00:48:36.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:48:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.342+0000 7f4a7f200640 1 Processor -- start 2024-08-19T00:48:36.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.342+0000 7f4a7f200640 1 -- start start 2024-08-19T00:48:36.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a8015e360 0x7f4a8015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a8015ee50 0x7f4a800d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a800b3ab0 con 0x7f4a800d2af0 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8015f460 con 0x7f4a8015e360 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8015f740 con 0x7f4a8015ee50 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a8015e360 0x7f4a8015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a8015e360 0x7f4a8015fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57694/0 (socket says 172.21.15.7:57694) 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.343+0000 7f4a7de00640 1 -- 172.21.15.7:0/3972778339 learned_addr learned my addr 172.21.15.7:0/3972778339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.344+0000 7f4a7e800640 1 --2- 172.21.15.7:0/3972778339 >> v2:172.21.15.162:3300/0 conn(0x7f4a8015ee50 0x7f4a800d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.344+0000 7f4a7de00640 1 -- 172.21.15.7:0/3972778339 >> v2:172.21.15.162:3300/0 conn(0x7f4a8015ee50 msgr2=0x7f4a800d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.344+0000 7f4a7de00640 1 --2- 172.21.15.7:0/3972778339 >> v2:172.21.15.162:3300/0 conn(0x7f4a8015ee50 0x7f4a800d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.344+0000 7f4a7de00640 1 -- 172.21.15.7:0/3972778339 >> v1:172.21.15.7:6789/0 conn(0x7f4a800d2af0 legacy=0x7f4a8015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.344+0000 7f4a7de00640 1 -- 172.21.15.7:0/3972778339 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a800b3d60 con 0x7f4a8015e360 2024-08-19T00:48:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.345+0000 7f4a7de00640 1 --2- 172.21.15.7:0/3972778339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015e360 0x7f4a8015fab0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f4a800d1c20 tx=0x7f4a7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cf3c0879a05e0a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.345+0000 7f4a7ca00640 1 -- 172.21.15.7:0/3972778339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70037070 con 0x7f4a8015e360 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.345+0000 7f4a7ca00640 1 -- 172.21.15.7:0/3972778339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a70032440 con 0x7f4a8015e360 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.345+0000 7f4a7ca00640 1 -- 172.21.15.7:0/3972778339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70032810 con 0x7f4a8015e360 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.345+0000 7f4a7f200640 1 -- 172.21.15.7:0/3972778339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015e360 msgr2=0x7f4a8015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.345+0000 7f4a7f200640 1 --2- 172.21.15.7:0/3972778339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015e360 0x7f4a8015fab0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f4a800d1c20 tx=0x7f4a7002a270 comp rx=0 tx=0).stop 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.346+0000 7f4a7f200640 1 -- 172.21.15.7:0/3972778339 shutdown_connections 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.346+0000 7f4a7f200640 1 --2- 172.21.15.7:0/3972778339 >> v2:172.21.15.162:3300/0 conn(0x7f4a8015ee50 0x7f4a800d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.346+0000 7f4a7f200640 1 --2- 172.21.15.7:0/3972778339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015e360 0x7f4a8015fab0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.346+0000 7f4a7f200640 1 -- 172.21.15.7:0/3972778339 >> 172.21.15.7:0/3972778339 conn(0x7f4a8008dbf0 msgr2=0x7f4a8009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.346+0000 7f4a7f200640 1 -- 172.21.15.7:0/3972778339 shutdown_connections 2024-08-19T00:48:36.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.346+0000 7f4a7f200640 1 -- 172.21.15.7:0/3972778339 wait complete. 2024-08-19T00:48:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.347+0000 7f4a7f200640 1 Processor -- start 2024-08-19T00:48:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.347+0000 7f4a7f200640 1 -- start start 2024-08-19T00:48:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.348+0000 7f4a7f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a800d2af0 0x7f4a800c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.348+0000 7f4a7f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a8015e360 0x7f4a800c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.348+0000 7f4a7f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015ee50 0x7f4a80155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.348+0000 7f4a7f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a800b4560 con 0x7f4a8015ee50 2024-08-19T00:48:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.348+0000 7f4a7f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a800d2300 con 0x7f4a8015e360 2024-08-19T00:48:36.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.348+0000 7f4a7f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a800b46e0 con 0x7f4a800d2af0 2024-08-19T00:48:36.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015ee50 0x7f4a80155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015ee50 0x7f4a80155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57700/0 (socket says 172.21.15.7:57700) 2024-08-19T00:48:36.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 -- 172.21.15.7:0/1155100090 learned_addr learned my addr 172.21.15.7:0/1155100090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:36.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7de00640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a800d2af0 0x7f4a800c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7d400640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a8015e360 0x7f4a800c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 -- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a800d2af0 msgr2=0x7f4a800c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a800d2af0 0x7f4a800c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 -- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a8015e360 msgr2=0x7f4a800c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a8015e360 0x7f4a800c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 -- 172.21.15.7:0/1155100090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a801598a0 con 0x7f4a8015ee50 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7de00640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a800d2af0 0x7f4a800c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7d400640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a8015e360 0x7f4a800c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.349+0000 7f4a7e800640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015ee50 0x7f4a80155b70 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f4a78007e60 tx=0x7f4a7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.350+0000 7f4a76000640 1 -- 172.21.15.7:0/1155100090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78014420 con 0x7f4a8015ee50 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.350+0000 7f4a76000640 1 -- 172.21.15.7:0/1155100090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a78019070 con 0x7f4a8015ee50 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.350+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a80159b40 con 0x7f4a8015ee50 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.350+0000 7f4a76000640 1 -- 172.21.15.7:0/1155100090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78014820 con 0x7f4a8015ee50 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.350+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8015a100 con 0x7f4a8015ee50 2024-08-19T00:48:36.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.351+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8015a340 con 0x7f4a8015ee50 2024-08-19T00:48:36.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.352+0000 7f4a76000640 1 -- 172.21.15.7:0/1155100090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a780149c0 con 0x7f4a8015ee50 2024-08-19T00:48:36.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.352+0000 7f4a76000640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a6006be30 0x7f4a6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.353+0000 7f4a76000640 1 -- 172.21.15.7:0/1155100090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f4a7808c3d0 con 0x7f4a8015ee50 2024-08-19T00:48:36.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.353+0000 7f4a7de00640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a6006be30 0x7f4a6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.353+0000 7f4a7de00640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a6006be30 0x7f4a6006e2f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4a70034000 tx=0x7f4a7002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:36.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.357+0000 7f4a76000640 1 -- 172.21.15.7:0/1155100090 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4a8015a340 con 0x7f4a8015ee50 2024-08-19T00:48:36.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.543+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a800d50d0 con 0x7f4a8015ee50 2024-08-19T00:48:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.544+0000 7f4a76000640 1 -- 172.21.15.7:0/1155100090 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+21742 (secure 0 0 0) 0x7f4a7805a050 con 0x7f4a8015ee50 2024-08-19T00:48:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:36.546 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":126,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:30.102517+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:43:24.450864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-08-19T00:43:25.656952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3833663519":"2024-08-20T00:48:23.055248+0000","172.21.15.7:6835/3833663519":"2024-08-20T00:48:23.055248+0000","172.21.15.7:6837/2039068272":"2024-08-20T00:48:16.032983+0000","172.21.15.7:6837/2241506175":"2024-08-20T00:48:10.491906+0000","172.21.15.7:6837/767746356":"2024-08-20T00:47:36.848235+0000","172.21.15.7:6837/2697833470":"2024-08-20T00:47:13.631762+0000","172.21.15.7:6835/2697833470":"2024-08-20T00:47:13.631762+0000","172.21.15.7:6837/564246395":"2024-08-20T00:47:08.596064+0000","172.21.15.7:6835/564246395":"2024-08-20T00:47:08.596064+0000","172.21.15.7:6836/23553373":"2024-08-20T00:46:48.423172+0000","172.21.15.7:6834/23553373":"2024-08-20T00:46:48.423172+0000","172.21.15.7:6837/300508336":"2024-08-20T00:46:44.396111+0000","172.21.15.7:6835/2764430344":"2024-08-20T00:45:15.874510+0000","172.21.15.7:6834/3808845958":"2024-08-20T00:48:30.102500+0000","172.21.15.7:6835/2555026980":"2024-08-20T00:46:00.124037+0000","172.21.15.7:6837/1092992076":"2024-08-20T00:45:13.853614+0000","172.21.15.7:6837/2764430344":"2024-08-20T00:45:15.874510+0000","172.21.15.162:6834/3169517259":"2024-08-20T00:43:59.140007+0000","172.21.15.7:6836/3307283757":"2024-08-20T00:46:04.155541+0000","172.21.15.7:6836/1524598451":"2024-08-20T00:45:00.316452+0000","172.21.15.7:6834/3804092925":"2024-08-20T00:46:12.208398+0000","172.21.15.7:6835/877185885":"2024-08-20T00:44:46.224779+0000","172.21.15.7:6834/3482025847":"2024-08-20T00:44:53.272372+0000","172.21.15.7:6837/3471482572":"2024-08-20T00:46:36.346761+0000","172.21.15.7:6836/918472079":"2024-08-20T00:44:39.648889+0000","172.21.15.7:6835/3239344481":"2024-08-20T00:47:53.939814+0000","172.21.15.7:6837/2555026980":"2024-08-20T00:46:00.124037+0000","172.21.15.7:6834/918472079":"2024-08-20T00:44:39.648889+0000","172.21.15.7:6835/3619862411":"2024-08-20T00:45:39.018072+0000","172.21.15.7:6836/95446058":"2024-08-20T00:46:20.274334+0000","172.21.15.7:6837/3239344481":"2024-08-20T00:47:53.939814+0000","172.21.15.7:6837/978981940":"2024-08-20T00:47:48.474571+0000","172.21.15.7:6836/3784682490":"2024-08-20T00:44:27.595559+0000","172.21.15.162:6832/2295549448":"2024-08-20T00:43:37.028725+0000","172.21.15.7:6835/1092992076":"2024-08-20T00:45:13.853614+0000","172.21.15.7:6837/232072615":"2024-08-20T00:45:30.946343+0000","172.21.15.7:6836/1582667547":"2024-08-20T00:44:10.208810+0000","172.21.15.7:6835/2458713155":"2024-08-20T00:44:06.188927+0000","172.21.15.7:6837/4018426566":"2024-08-20T00:46:08.138498+0000","172.21.15.7:6837/2458713155":"2024-08-20T00:44:06.188927+0000","172.21.15.7:6834/1582667547":"2024-08-20T00:44:10.208810+0000","172.21.15.7:6837/2121313657":"2024-08-20T00:45:23.908167+0000","172.21.15.7:6836/3482025847":"2024-08-20T00:44:53.272372+0000","172.21.15.7:6834/1524598451":"2024-08-20T00:45:00.316452+0000","172.21.15.7:6835/978981940":"2024-08-20T00:47:48.474571+0000","172.21.15.7:6836/3804092925":"2024-08-20T00:46:12.208398+0000","172.21.15.162:6834/3482189423":"2024-08-20T00:43:53.541123+0000","172.21.15.162:6833/3482189423":"2024-08-20T00:43:53.541123+0000","172.21.15.7:6835/2121313657":"2024-08-20T00:45:23.908167+0000","172.21.15.7:6834/95446058":"2024-08-20T00:46:20.274334+0000","172.21.15.7:6834/3427152926":"2024-08-20T00:44:42.202799+0000","172.21.15.7:6835/232072615":"2024-08-20T00:45:30.946343+0000","172.21.15.7:6835/3471482572":"2024-08-20T00:46:36.346761+0000","172.21.15.7:6837/1850770580":"2024-08-20T00:44:14.242517+0000","172.21.15.7:6834/3784682490":"2024-08-20T00:44:27.595559+0000","172.21.15.7:6834/835453535":"2024-08-20T00:45:34.977428+0000","172.21.15.7:6836/835453535":"2024-08-20T00:45:34.977428+0000","172.21.15.7:6837/877185885":"2024-08-20T00:44:46.224779+0000","172.21.15.7:6837/3619862411":"2024-08-20T00:45:39.018072+0000","172.21.15.7:6834/3399848835":"2024-08-20T00:45:53.817587+0000","172.21.15.7:6836/3808845958":"2024-08-20T00:48:30.102500+0000","172.21.15.7:6835/2241506175":"2024-08-20T00:48:10.491906+0000","172.21.15.7:6835/767746356":"2024-08-20T00:47:36.848235+0000","172.21.15.7:6835/1850770580":"2024-08-20T00:44:14.242517+0000","172.21.15.7:6834/1067237290":"2024-08-20T00:45:56.104621+0000","172.21.15.7:6836/1067237290":"2024-08-20T00:45:56.104621+0000","172.21.15.7:6834/3307283757":"2024-08-20T00:46:04.155541+0000","172.21.15.7:6836/3427152926":"2024-08-20T00:44:42.202799+0000","172.21.15.7:6835/4018426566":"2024-08-20T00:46:08.138498+0000","172.21.15.7:6835/613323192":"2024-08-20T00:46:16.237393+0000","172.21.15.7:6837/613323192":"2024-08-20T00:46:16.237393+0000","172.21.15.7:6835/1141791797":"2024-08-20T00:46:33.788770+0000","172.21.15.7:6835/2039068272":"2024-08-20T00:48:16.032983+0000","172.21.15.7:6837/1141791797":"2024-08-20T00:46:33.788770+0000","172.21.15.7:6834/4168746347":"2024-08-20T00:46:40.368064+0000","172.21.15.162:6833/3169517259":"2024-08-20T00:43:59.140007+0000","172.21.15.162:6835/2295549448":"2024-08-20T00:43:37.028725+0000","172.21.15.7:6836/4168746347":"2024-08-20T00:46:40.368064+0000","172.21.15.7:6836/3399848835":"2024-08-20T00:45:53.817587+0000","172.21.15.7:6835/300508336":"2024-08-20T00:46:44.396111+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:48:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a6006be30 msgr2=0x7f4a6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a6006be30 0x7f4a6006e2f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4a70034000 tx=0x7f4a7002e000 comp rx=0 tx=0).stop 2024-08-19T00:48:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015ee50 msgr2=0x7f4a80155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015ee50 0x7f4a80155b70 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f4a78007e60 tx=0x7f4a7800e4b0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 shutdown_connections 2024-08-19T00:48:36.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a6006be30 0x7f4a6006e2f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8015ee50 0x7f4a80155b70 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a8015e360 0x7f4a800c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 --2- 172.21.15.7:0/1155100090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a800d2af0 0x7f4a800c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.546+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 >> 172.21.15.7:0/1155100090 conn(0x7f4a8008dbf0 msgr2=0x7f4a80160980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.547+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 shutdown_connections 2024-08-19T00:48:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.547+0000 7f4a7f200640 1 -- 172.21.15.7:0/1155100090 wait complete. 2024-08-19T00:48:36.564 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:48:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.720+0000 7f3d7dc00640 1 Processor -- start 2024-08-19T00:48:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.720+0000 7f3d7dc00640 1 -- start start 2024-08-19T00:48:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.721+0000 7f3d7dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d780d03c0 0x7f3d78071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.721+0000 7f3d7dc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3d7806e710 0x7f3d780d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.721+0000 7f3d7dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d780d0ce0 con 0x7f3d780b3750 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.721+0000 7f3d7dc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3d780cebc0 con 0x7f3d780d03c0 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.721+0000 7f3d7dc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3d780cdfb0 con 0x7f3d7806e710 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d76a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d780d03c0 0x7f3d78071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d76a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d780d03c0 0x7f3d78071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57708/0 (socket says 172.21.15.7:57708) 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d76a00640 1 -- 172.21.15.7:0/3097261456 learned_addr learned my addr 172.21.15.7:0/3097261456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d6e000640 1 --2- 172.21.15.7:0/3097261456 >> v2:172.21.15.162:3300/0 conn(0x7f3d7806e710 0x7f3d780d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d76a00640 1 -- 172.21.15.7:0/3097261456 >> v2:172.21.15.162:3300/0 conn(0x7f3d7806e710 msgr2=0x7f3d780d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d76a00640 1 --2- 172.21.15.7:0/3097261456 >> v2:172.21.15.162:3300/0 conn(0x7f3d7806e710 0x7f3d780d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d76a00640 1 -- 172.21.15.7:0/3097261456 >> v1:172.21.15.7:6789/0 conn(0x7f3d780b3750 legacy=0x7f3d780cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.722+0000 7f3d76a00640 1 -- 172.21.15.7:0/3097261456 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d780ce290 con 0x7f3d780d03c0 2024-08-19T00:48:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.723+0000 7f3d76a00640 1 --2- 172.21.15.7:0/3097261456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d78071980 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009870 tx=0x7f3d6802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a085bca55633a88a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.723+0000 7f3d76000640 1 -- 172.21.15.7:0/3097261456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68037070 con 0x7f3d780d03c0 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.723+0000 7f3d76000640 1 -- 172.21.15.7:0/3097261456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d68032440 con 0x7f3d780d03c0 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.723+0000 7f3d76000640 1 -- 172.21.15.7:0/3097261456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68032810 con 0x7f3d780d03c0 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3097261456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 msgr2=0x7f3d78071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3097261456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d78071980 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009870 tx=0x7f3d6802a2a0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3097261456 shutdown_connections 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3097261456 >> v2:172.21.15.162:3300/0 conn(0x7f3d7806e710 0x7f3d780d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3097261456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d78071980 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3097261456 >> 172.21.15.7:0/3097261456 conn(0x7f3d7806bc70 msgr2=0x7f3d7806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3097261456 shutdown_connections 2024-08-19T00:48:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.724+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3097261456 wait complete. 2024-08-19T00:48:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.726+0000 7f3d7dc00640 1 Processor -- start 2024-08-19T00:48:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.726+0000 7f3d7dc00640 1 -- start start 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d7dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7806e710 0x7f3d7815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d7dc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d780b3750 0x7f3d7815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d7dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d7815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d7dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78073ae0 con 0x7f3d780d03c0 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d7dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d780ce850 con 0x7f3d7806e710 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d7dc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d78073c60 con 0x7f3d780b3750 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d7815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d7815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57714/0 (socket says 172.21.15.7:57714) 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d77400640 1 -- 172.21.15.7:0/3923634116 learned_addr learned my addr 172.21.15.7:0/3923634116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d76a00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7806e710 0x7f3d7815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.727+0000 7f3d6e000640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d780b3750 0x7f3d7815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d77400640 1 -- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d780b3750 msgr2=0x7f3d7815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d77400640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d780b3750 0x7f3d7815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d77400640 1 -- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7806e710 msgr2=0x7f3d7815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d77400640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7806e710 0x7f3d7815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d77400640 1 -- 172.21.15.7:0/3923634116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7815e9d0 con 0x7f3d780d03c0 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d76a00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7806e710 0x7f3d7815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d77400640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d7815a4f0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c7d0 tx=0x7f3d7000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d6f400640 1 -- 172.21.15.7:0/3923634116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70003b70 con 0x7f3d780d03c0 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d6f400640 1 -- 172.21.15.7:0/3923634116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d70003d30 con 0x7f3d780d03c0 2024-08-19T00:48:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d6f400640 1 -- 172.21.15.7:0/3923634116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000aa30 con 0x7f3d780d03c0 2024-08-19T00:48:36.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7815cba0 con 0x7f3d780d03c0 2024-08-19T00:48:36.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.728+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781f4320 con 0x7f3d780d03c0 2024-08-19T00:48:36.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.729+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d781f4130 con 0x7f3d780d03c0 2024-08-19T00:48:36.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.730+0000 7f3d6f400640 1 -- 172.21.15.7:0/3923634116 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d7000abd0 con 0x7f3d780d03c0 2024-08-19T00:48:36.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.731+0000 7f3d6f400640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be30 0x7f3d5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:36.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.731+0000 7f3d6f400640 1 -- 172.21.15.7:0/3923634116 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f3d7008ba80 con 0x7f3d780d03c0 2024-08-19T00:48:36.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.732+0000 7f3d76a00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be30 0x7f3d5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:36.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.732+0000 7f3d76a00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be30 0x7f3d5406e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3d68034000 tx=0x7f3d6802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:36.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.736+0000 7f3d6f400640 1 -- 172.21.15.7:0/3923634116 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3d7008de20 con 0x7f3d780d03c0 2024-08-19T00:48:36.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:36.955+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3d780b02b0 con 0x7f3d780d03c0 2024-08-19T00:48:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.124+0000 7f3d6f400640 1 -- 172.21.15.7:0/3923634116 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v338) ==== 161+0+0 (secure 0 0 0) 0x7f3d700596a0 con 0x7f3d780d03c0 2024-08-19T00:48:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be30 msgr2=0x7f3d5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be30 0x7f3d5406e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3d68034000 tx=0x7f3d6802e000 comp rx=0 tx=0).stop 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 msgr2=0x7f3d7815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d7815a4f0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c7d0 tx=0x7f3d7000cc90 comp rx=0 tx=0).stop 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 shutdown_connections 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d5406be30 0x7f3d5406e2f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d780d03c0 0x7f3d7815a4f0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d780b3750 0x7f3d7815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 --2- 172.21.15.7:0/3923634116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d7806e710 0x7f3d7815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 >> 172.21.15.7:0/3923634116 conn(0x7f3d7806bc70 msgr2=0x7f3d780cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 shutdown_connections 2024-08-19T00:48:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.127+0000 7f3d7dc00640 1 -- 172.21.15.7:0/3923634116 wait complete. 2024-08-19T00:48:37.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:48:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.303+0000 7f5fce800640 1 Processor -- start 2024-08-19T00:48:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.303+0000 7f5fce800640 1 -- start start 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fce800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc8161c90 0x7f5fc80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fce800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5fc80d2c10 0x7f5fc806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fce800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc806e750 con 0x7f5fc806e330 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fce800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc80d0110 con 0x7f5fc80d2c10 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fce800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc80cf500 con 0x7f5fc8161c90 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fbfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5fc806e330 0x7f5fc80d2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35514/0 (socket says 172.21.15.7:35514) 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fbfe00640 1 -- 172.21.15.7:0/3538535106 learned_addr learned my addr 172.21.15.7:0/3538535106 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fc7e00640 1 --2- 172.21.15.7:0/3538535106 >> v2:172.21.15.162:3300/0 conn(0x7f5fc80d2c10 0x7f5fc806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.304+0000 7f5fc7400640 1 --2- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc8161c90 0x7f5fc80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.305+0000 7f5fc6a00640 1 -- 172.21.15.7:0/3538535106 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071925058 0 0) 0x7f5fc806e750 con 0x7f5fc806e330 2024-08-19T00:48:37.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.305+0000 7f5fc6a00640 1 -- 172.21.15.7:0/3538535106 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fac003520 con 0x7f5fc806e330 2024-08-19T00:48:37.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.305+0000 7f5fc7e00640 1 -- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc8161c90 msgr2=0x7f5fc80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:37.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.305+0000 7f5fc7e00640 1 --2- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc8161c90 0x7f5fc80cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.305+0000 7f5fc7e00640 1 -- 172.21.15.7:0/3538535106 >> v1:172.21.15.7:6789/0 conn(0x7f5fc806e330 legacy=0x7f5fc80d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.305+0000 7f5fc7e00640 1 -- 172.21.15.7:0/3538535106 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc80cf7e0 con 0x7f5fc80d2c10 2024-08-19T00:48:37.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.306+0000 7f5fc7e00640 1 --2- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc80d2c10 0x7f5fc806ca10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009d90 tx=0x7f5fc002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfff8089dea52bbc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.306+0000 7f5fc6a00640 1 -- 172.21.15.7:0/3538535106 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0007740 con 0x7f5fc80d2c10 2024-08-19T00:48:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.306+0000 7f5fc6a00640 1 -- 172.21.15.7:0/3538535106 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc00078e0 con 0x7f5fc80d2c10 2024-08-19T00:48:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.306+0000 7f5fc6a00640 1 -- 172.21.15.7:0/3538535106 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0007cb0 con 0x7f5fc80d2c10 2024-08-19T00:48:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 -- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc80d2c10 msgr2=0x7f5fc806ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 --2- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc80d2c10 0x7f5fc806ca10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009d90 tx=0x7f5fc002a660 comp rx=0 tx=0).stop 2024-08-19T00:48:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 -- 172.21.15.7:0/3538535106 shutdown_connections 2024-08-19T00:48:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 --2- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc80d2c10 0x7f5fc806ca10 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 --2- 172.21.15.7:0/3538535106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc8161c90 0x7f5fc80cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 -- 172.21.15.7:0/3538535106 >> 172.21.15.7:0/3538535106 conn(0x7f5fc808c000 msgr2=0x7f5fc80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 -- 172.21.15.7:0/3538535106 shutdown_connections 2024-08-19T00:48:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.307+0000 7f5fce800640 1 -- 172.21.15.7:0/3538535106 wait complete. 2024-08-19T00:48:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.308+0000 7f5fce800640 1 Processor -- start 2024-08-19T00:48:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.309+0000 7f5fce800640 1 -- start start 2024-08-19T00:48:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.309+0000 7f5fce800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc806e330 0x7f5fc814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.309+0000 7f5fce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fc80d2c10 0x7f5fc80b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.309+0000 7f5fce800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc8161c90 0x7f5fc80b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.309+0000 7f5fce800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc8162070 con 0x7f5fc80d2c10 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.309+0000 7f5fce800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc80cfda0 con 0x7f5fc8161c90 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.309+0000 7f5fce800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc81621f0 con 0x7f5fc806e330 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fc80d2c10 0x7f5fc80b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fc80d2c10 0x7f5fc80b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57718/0 (socket says 172.21.15.7:57718) 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 -- 172.21.15.7:0/1290100997 learned_addr learned my addr 172.21.15.7:0/1290100997 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fc7e00640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc8161c90 0x7f5fc80b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fc7400640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc806e330 0x7f5fc814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 -- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc806e330 msgr2=0x7f5fc814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc806e330 0x7f5fc814dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 -- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc8161c90 msgr2=0x7f5fc80b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc8161c90 0x7f5fc80b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 -- 172.21.15.7:0/1290100997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc814e640 con 0x7f5fc80d2c10 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fc7400640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc806e330 0x7f5fc814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fc7e00640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc8161c90 0x7f5fc80b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.310+0000 7f5fbfe00640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fc80d2c10 0x7f5fc80b28a0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c400 tx=0x7f5fb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.311+0000 7f5fbf400640 1 -- 172.21.15.7:0/1290100997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0017070 con 0x7f5fc80d2c10 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.311+0000 7f5fbf400640 1 -- 172.21.15.7:0/1290100997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb0005d00 con 0x7f5fc80d2c10 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.311+0000 7f5fbf400640 1 -- 172.21.15.7:0/1290100997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0007310 con 0x7f5fc80d2c10 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.311+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc814e920 con 0x7f5fc80d2c10 2024-08-19T00:48:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.311+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc814eee0 con 0x7f5fc80d2c10 2024-08-19T00:48:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.312+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc814f0e0 con 0x7f5fc80d2c10 2024-08-19T00:48:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.313+0000 7f5fbf400640 1 -- 172.21.15.7:0/1290100997 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fb001a070 con 0x7f5fc80d2c10 2024-08-19T00:48:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.314+0000 7f5fbf400640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fa406be30 0x7f5fa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.314+0000 7f5fbf400640 1 -- 172.21.15.7:0/1290100997 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f5fb008b0a0 con 0x7f5fc80d2c10 2024-08-19T00:48:37.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.314+0000 7f5fc7400640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fa406be30 0x7f5fa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.315+0000 7f5fc7400640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fa406be30 0x7f5fa406e2f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5fc815e320 tx=0x7f5fb8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:37.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.318+0000 7f5fbf400640 1 -- 172.21.15.7:0/1290100997 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5fc814f0e0 con 0x7f5fc80d2c10 2024-08-19T00:48:37.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:37.541+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5fc80d3270 con 0x7f5fc80d2c10 2024-08-19T00:48:38.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.130+0000 7f5fbf400640 1 -- 172.21.15.7:0/1290100997 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v339) ==== 104+0+0 (secure 0 0 0) 0x7f5fb0058cc0 con 0x7f5fc80d2c10 2024-08-19T00:48:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fa406be30 msgr2=0x7f5fa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fa406be30 0x7f5fa406e2f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5fc815e320 tx=0x7f5fb8008040 comp rx=0 tx=0).stop 2024-08-19T00:48:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fc80d2c10 msgr2=0x7f5fc80b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fc80d2c10 0x7f5fc80b28a0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c400 tx=0x7f5fb000c8c0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 shutdown_connections 2024-08-19T00:48:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5fa406be30 0x7f5fa406e2f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fc8161c90 0x7f5fc80b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fc80d2c10 0x7f5fc80b28a0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 --2- 172.21.15.7:0/1290100997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fc806e330 0x7f5fc814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 >> 172.21.15.7:0/1290100997 conn(0x7f5fc808c000 msgr2=0x7f5fc80b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 shutdown_connections 2024-08-19T00:48:38.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.133+0000 7f5fce800640 1 -- 172.21.15.7:0/1290100997 wait complete. 2024-08-19T00:48:38.154 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:48:38.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.318+0000 7f2ccc400640 1 Processor -- start 2024-08-19T00:48:38.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.318+0000 7f2ccc400640 1 -- start start 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.319+0000 7f2ccc400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2cc415c060 0x7f2cc409b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.319+0000 7f2ccc400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc409ba30 0x7f2cc4161f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.319+0000 7f2ccc400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2cc40b5c30 0x7f2cc4162460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.319+0000 7f2ccc400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc40b6110 con 0x7f2cc415c060 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.319+0000 7f2ccc400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc40b63f0 con 0x7f2cc40b5c30 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.319+0000 7f2ccc400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc40b66d0 con 0x7f2cc409ba30 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.319+0000 7f2cc9a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2cc415c060 0x7f2cc409b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2cc415c060 0x7f2cc409b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57722/0 (socket says 172.21.15.7:57722) 2024-08-19T00:48:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9a00640 1 -- 172.21.15.7:0/4238397912 learned_addr learned my addr 172.21.15.7:0/4238397912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cca400640 1 --2- 172.21.15.7:0/4238397912 >> v2:172.21.15.162:3300/0 conn(0x7f2cc40b5c30 0x7f2cc4162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9000640 1 --2- 172.21.15.7:0/4238397912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc409ba30 0x7f2cc4161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9a00640 1 -- 172.21.15.7:0/4238397912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc409ba30 msgr2=0x7f2cc4161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9a00640 1 --2- 172.21.15.7:0/4238397912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc409ba30 0x7f2cc4161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9a00640 1 -- 172.21.15.7:0/4238397912 >> v2:172.21.15.162:3300/0 conn(0x7f2cc40b5c30 msgr2=0x7f2cc4162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9a00640 1 --2- 172.21.15.7:0/4238397912 >> v2:172.21.15.162:3300/0 conn(0x7f2cc40b5c30 0x7f2cc4162460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9a00640 1 -- 172.21.15.7:0/4238397912 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc40b69b0 con 0x7f2cc415c060 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cca400640 1 --2- 172.21.15.7:0/4238397912 >> v2:172.21.15.162:3300/0 conn(0x7f2cc40b5c30 0x7f2cc4162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.320+0000 7f2cc9000640 1 --2- 172.21.15.7:0/4238397912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc409ba30 0x7f2cc4161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.321+0000 7f2cc9a00640 1 --2- 172.21.15.7:0/4238397912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc415c060 0x7f2cc409b4f0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4072e90 tx=0x7f2cb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b97e2a1f305936 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.321+0000 7f2cc3e00640 1 -- 172.21.15.7:0/4238397912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8037070 con 0x7f2cc415c060 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.321+0000 7f2cc3e00640 1 -- 172.21.15.7:0/4238397912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb8032440 con 0x7f2cc415c060 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.321+0000 7f2cc3e00640 1 -- 172.21.15.7:0/4238397912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8032810 con 0x7f2cc415c060 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 -- 172.21.15.7:0/4238397912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc415c060 msgr2=0x7f2cc409b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 --2- 172.21.15.7:0/4238397912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc415c060 0x7f2cc409b4f0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4072e90 tx=0x7f2cb802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 -- 172.21.15.7:0/4238397912 shutdown_connections 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 --2- 172.21.15.7:0/4238397912 >> v2:172.21.15.162:3300/0 conn(0x7f2cc40b5c30 0x7f2cc4162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 --2- 172.21.15.7:0/4238397912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc409ba30 0x7f2cc4161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 --2- 172.21.15.7:0/4238397912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc415c060 0x7f2cc409b4f0 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 -- 172.21.15.7:0/4238397912 >> 172.21.15.7:0/4238397912 conn(0x7f2cc40b3db0 msgr2=0x7f2cc40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 -- 172.21.15.7:0/4238397912 shutdown_connections 2024-08-19T00:48:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.322+0000 7f2ccc400640 1 -- 172.21.15.7:0/4238397912 wait complete. 2024-08-19T00:48:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.324+0000 7f2ccc400640 1 Processor -- start 2024-08-19T00:48:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.324+0000 7f2ccc400640 1 -- start start 2024-08-19T00:48:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2ccc400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc409ba30 0x7f2cc40afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2ccc400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc40b5c30 0x7f2cc40b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2ccc400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc415c060 0x7f2cc415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2ccc400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc40b7330 con 0x7f2cc409ba30 2024-08-19T00:48:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2ccc400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc40b71b0 con 0x7f2cc40b5c30 2024-08-19T00:48:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2ccc400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc415e8e0 con 0x7f2cc415c060 2024-08-19T00:48:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc409ba30 0x7f2cc40afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc409ba30 0x7f2cc40afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57730/0 (socket says 172.21.15.7:57730) 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 -- 172.21.15.7:0/1809627587 learned_addr learned my addr 172.21.15.7:0/1809627587 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cca400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc415c060 0x7f2cc415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 -- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc415c060 msgr2=0x7f2cc415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9000640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc40b5c30 0x7f2cc40b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc415c060 0x7f2cc415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 -- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc40b5c30 msgr2=0x7f2cc40b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc40b5c30 0x7f2cc40b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9a00640 1 -- 172.21.15.7:0/1809627587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc40b1040 con 0x7f2cc409ba30 2024-08-19T00:48:38.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cca400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc415c060 0x7f2cc415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.325+0000 7f2cc9000640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc40b5c30 0x7f2cc40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.326+0000 7f2cc9a00640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc409ba30 0x7f2cc40afae0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f2cb802a220 tx=0x7f2cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.326+0000 7f2cc1600640 1 -- 172.21.15.7:0/1809627587 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8037040 con 0x7f2cc409ba30 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.326+0000 7f2cc1600640 1 -- 172.21.15.7:0/1809627587 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb8042070 con 0x7f2cc409ba30 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.326+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc40b12c0 con 0x7f2cc409ba30 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.326+0000 7f2cc1600640 1 -- 172.21.15.7:0/1809627587 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8030bb0 con 0x7f2cc409ba30 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.326+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc40af2e0 con 0x7f2cc409ba30 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.327+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc409b4f0 con 0x7f2cc409ba30 2024-08-19T00:48:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.328+0000 7f2cc1600640 1 -- 172.21.15.7:0/1809627587 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cb8047460 con 0x7f2cc409ba30 2024-08-19T00:48:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.329+0000 7f2cc1600640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.329+0000 7f2cc1600640 1 -- 172.21.15.7:0/1809627587 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9149+0+0 (secure 0 0 0) 0x7f2cb80ac820 con 0x7f2cc409ba30 2024-08-19T00:48:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.329+0000 7f2cc9000640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.330+0000 7f2cc9000640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ca406be30 0x7f2ca406e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0006fd0 tx=0x7f2cb0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.334+0000 7f2cc1600640 1 -- 172.21.15.7:0/1809627587 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2cc40b1040 con 0x7f2cc409ba30 2024-08-19T00:48:38.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:38.519+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2cc4073eb0 con 0x7f2cc409ba30 2024-08-19T00:48:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.137+0000 7f2cc1600640 1 -- 172.21.15.7:0/1809627587 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) ==== 181+0+0 (secure 0 0 0) 0x7f2cb8045360 con 0x7f2cc409ba30 2024-08-19T00:48:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:48:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ca406be30 msgr2=0x7f2ca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ca406be30 0x7f2ca406e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0006fd0 tx=0x7f2cb0008040 comp rx=0 tx=0).stop 2024-08-19T00:48:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc409ba30 msgr2=0x7f2cc40afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:39.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc409ba30 0x7f2cc40afae0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f2cb802a220 tx=0x7f2cb80046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 shutdown_connections 2024-08-19T00:48:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cc415c060 0x7f2cc415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc40b5c30 0x7f2cc40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 --2- 172.21.15.7:0/1809627587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc409ba30 0x7f2cc40afae0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.143+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 >> 172.21.15.7:0/1809627587 conn(0x7f2cc40b3db0 msgr2=0x7f2cc4156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.144+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 shutdown_connections 2024-08-19T00:48:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.144+0000 7f2ccc400640 1 -- 172.21.15.7:0/1809627587 wait complete. 2024-08-19T00:48:39.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:48:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.334+0000 7fcacde00640 1 Processor -- start 2024-08-19T00:48:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.334+0000 7fcacde00640 1 -- start start 2024-08-19T00:48:39.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcacde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcac815c0e0 0x7fcac80719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcacde00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac806fa10 con 0x7fcac815bd00 2024-08-19T00:48:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcacde00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac80ce6f0 con 0x7fcac8071ee0 2024-08-19T00:48:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcacde00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcac815c570 con 0x7fcac815c0e0 2024-08-19T00:48:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcac6a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcac815bd00 0x7fcac80cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35518/0 (socket says 172.21.15.7:35518) 2024-08-19T00:48:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcac6a00640 1 -- 172.21.15.7:0/1176727357 learned_addr learned my addr 172.21.15.7:0/1176727357 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcac6000640 1 --2- 172.21.15.7:0/1176727357 >> v2:172.21.15.162:3300/0 conn(0x7fcac815c0e0 0x7fcac80719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920050030 0 0) 0x7fcac806fa10 con 0x7fcac815bd00 2024-08-19T00:48:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.336+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaac003520 con 0x7fcac815bd00 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274415482 0 0) 0x7fcac80ce6f0 con 0x7fcac8071ee0 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcac806fa10 con 0x7fcac8071ee0 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281609315 0 0) 0x7fcaac003520 con 0x7fcac815bd00 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 >> v2:172.21.15.162:3300/0 conn(0x7fcac815c0e0 msgr2=0x7fcac80719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 --2- 172.21.15.7:0/1176727357 >> v2:172.21.15.162:3300/0 conn(0x7fcac815c0e0 0x7fcac80719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 >> v1:172.21.15.162:6789/0 conn(0x7fcac8071ee0 legacy=0x7fcac8164d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac80ce9d0 con 0x7fcac815bd00 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fcab8001670 con 0x7fcac815bd00 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 >> v1:172.21.15.7:6789/0 conn(0x7fcac815bd00 legacy=0x7fcac80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac003b90 0x7fcaac003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac004800 0x7fcaac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaac0051c0 0x7fcaac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac00c090 con 0x7fcaac0051c0 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac00c210 con 0x7fcaac003b90 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcaac00c410 con 0x7fcaac004800 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac7400640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaac0051c0 0x7fcaac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac6a00640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac003b90 0x7fcaac003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.337+0000 7fcac6000640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac004800 0x7fcaac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.338+0000 7fcac7400640 1 -- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac004800 msgr2=0x7fcaac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.338+0000 7fcac7400640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac004800 0x7fcaac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.338+0000 7fcac7400640 1 -- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac003b90 msgr2=0x7fcaac003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.338+0000 7fcac7400640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac003b90 0x7fcaac003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.338+0000 7fcac7400640 1 -- 172.21.15.7:0/1176727357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac003520 con 0x7fcaac0051c0 2024-08-19T00:48:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.338+0000 7fcac7400640 1 -- 172.21.15.7:0/1176727357 reap_dead start 2024-08-19T00:48:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.339+0000 7fcac7400640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaac0051c0 0x7fcaac00b9c0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fcac0001fd0 tx=0x7fcaac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29c8c08dcec2c11 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.339+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0001bf0 con 0x7fcaac0051c0 2024-08-19T00:48:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.339+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac0003b70 con 0x7fcaac0051c0 2024-08-19T00:48:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.339+0000 7fcac5600640 1 -- 172.21.15.7:0/1176727357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac00050d0 con 0x7fcaac0051c0 2024-08-19T00:48:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.339+0000 7fcacde00640 1 -- 172.21.15.7:0/1176727357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaac0051c0 msgr2=0x7fcaac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.339+0000 7fcacde00640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaac0051c0 0x7fcaac00b9c0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fcac0001fd0 tx=0x7fcaac005830 comp rx=0 tx=0).stop 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.340+0000 7fcacde00640 1 -- 172.21.15.7:0/1176727357 shutdown_connections 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.340+0000 7fcacde00640 1 --2- 172.21.15.7:0/1176727357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaac0051c0 0x7fcaac00b9c0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.340+0000 7fcacde00640 1 -- 172.21.15.7:0/1176727357 >> 172.21.15.7:0/1176727357 conn(0x7fcac806be80 msgr2=0x7fcac80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.340+0000 7fcacde00640 1 -- 172.21.15.7:0/1176727357 shutdown_connections 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.340+0000 7fcacde00640 1 -- 172.21.15.7:0/1176727357 wait complete. 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.341+0000 7fcacde00640 1 Processor -- start 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.341+0000 7fcacde00640 1 -- start start 2024-08-19T00:48:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.342+0000 7fcacde00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0051c0 0x7fcac80b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.342+0000 7fcacde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac8155be0 0x7fcac80b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.342+0000 7fcacde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcac80b3530 0x7fcac80b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.342+0000 7fcacde00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80cef90 con 0x7fcac80b3530 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.342+0000 7fcacde00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80cecb0 con 0x7fcac8155be0 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.342+0000 7fcacde00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcac80cf270 con 0x7fcaac0051c0 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.342+0000 7fcac7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcac80b3530 0x7fcac80b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcac80b3530 0x7fcac80b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57750/0 (socket says 172.21.15.7:57750) 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 -- 172.21.15.7:0/2385164857 learned_addr learned my addr 172.21.15.7:0/2385164857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac6a00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0051c0 0x7fcac80b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac6000640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac8155be0 0x7fcac80b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 -- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0051c0 msgr2=0x7fcac80b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0051c0 0x7fcac80b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 -- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac8155be0 msgr2=0x7fcac80b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac8155be0 0x7fcac80b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 -- 172.21.15.7:0/2385164857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac8156080 con 0x7fcac80b3530 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac6000640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac8155be0 0x7fcac80b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.343+0000 7fcac7400640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcac80b3530 0x7fcac80b39c0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fcac00020c0 tx=0x7fcac0001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.344+0000 7fcabf400640 1 -- 172.21.15.7:0/2385164857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0001bf0 con 0x7fcac80b3530 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.344+0000 7fcabf400640 1 -- 172.21.15.7:0/2385164857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac0003970 con 0x7fcac80b3530 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.344+0000 7fcabf400640 1 -- 172.21.15.7:0/2385164857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac00052e0 con 0x7fcac80b3530 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.344+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac813d8b0 con 0x7fcac80b3530 2024-08-19T00:48:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.344+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac813de70 con 0x7fcac80b3530 2024-08-19T00:48:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.345+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac80cf790 con 0x7fcac80b3530 2024-08-19T00:48:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.346+0000 7fcabf400640 1 -- 172.21.15.7:0/2385164857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcac0042020 con 0x7fcac80b3530 2024-08-19T00:48:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.347+0000 7fcabf400640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.347+0000 7fcabf400640 1 -- 172.21.15.7:0/2385164857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 8711+0+0 (secure 0 0 0) 0x7fcac00ab3a0 con 0x7fcac80b3530 2024-08-19T00:48:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.347+0000 7fcac6a00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:39.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.348+0000 7fcac6a00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaa806be30 0x7fcaa806e2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcab80011e0 tx=0x7fcab8000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.351+0000 7fcabf400640 1 -- 172.21.15.7:0/2385164857 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcac0003b40 con 0x7fcac80b3530 2024-08-19T00:48:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:39.540+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcac809e130 con 0x7fcac80b3530 2024-08-19T00:48:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.143+0000 7fcabf400640 1 -- 172.21.15.7:0/2385164857 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) ==== 169+0+0 (secure 0 0 0) 0x7fcac00790b0 con 0x7fcac80b3530 2024-08-19T00:48:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-08-19T00:48:40.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.146+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaa806be30 msgr2=0x7fcaa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.146+0000 7fcacde00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaa806be30 0x7fcaa806e2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcab80011e0 tx=0x7fcab8000ed0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcac80b3530 msgr2=0x7fcac80b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcac80b3530 0x7fcac80b39c0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fcac00020c0 tx=0x7fcac0001650 comp rx=0 tx=0).stop 2024-08-19T00:48:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 shutdown_connections 2024-08-19T00:48:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcac80b3530 0x7fcac80b39c0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac8155be0 0x7fcac80b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 --2- 172.21.15.7:0/2385164857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0051c0 0x7fcac80b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.147+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 >> 172.21.15.7:0/2385164857 conn(0x7fcac806be80 msgr2=0x7fcac80ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.148+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 shutdown_connections 2024-08-19T00:48:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.148+0000 7fcacde00640 1 -- 172.21.15.7:0/2385164857 wait complete. 2024-08-19T00:48:40.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-19T00:48:40.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.336+0000 7f60cf200640 1 Processor -- start 2024-08-19T00:48:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.336+0000 7f60cf200640 1 -- start start 2024-08-19T00:48:40.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cf200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f60c815bfb0 0x7f60c80b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cf200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60c815c390 0x7f60c8072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cf200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c80acef0 con 0x7f60c80b5130 2024-08-19T00:48:40.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cf200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f60c80ad790 con 0x7f60c815c390 2024-08-19T00:48:40.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cf200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f60c80ad1d0 con 0x7f60c815bfb0 2024-08-19T00:48:40.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60c815c390 0x7f60c8072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f60c815c390 0x7f60c8072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57764/0 (socket says 172.21.15.7:57764) 2024-08-19T00:48:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60cd200640 1 -- 172.21.15.7:0/2783340951 learned_addr learned my addr 172.21.15.7:0/2783340951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.337+0000 7f60c7e00640 1 --2- 172.21.15.7:0/2783340951 >> v2:172.21.15.162:3300/0 conn(0x7f60c815bfb0 0x7f60c80b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.338+0000 7f60cd200640 1 -- 172.21.15.7:0/2783340951 >> v2:172.21.15.162:3300/0 conn(0x7f60c815bfb0 msgr2=0x7f60c80b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.338+0000 7f60cd200640 1 --2- 172.21.15.7:0/2783340951 >> v2:172.21.15.162:3300/0 conn(0x7f60c815bfb0 0x7f60c80b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.338+0000 7f60cd200640 1 -- 172.21.15.7:0/2783340951 >> v1:172.21.15.162:6789/0 conn(0x7f60c80b5130 legacy=0x7f60c80aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.338+0000 7f60cd200640 1 -- 172.21.15.7:0/2783340951 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c80ad4b0 con 0x7f60c815c390 2024-08-19T00:48:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.339+0000 7f60cd200640 1 --2- 172.21.15.7:0/2783340951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c815c390 0x7f60c8072040 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f60c80b2ca0 tx=0x7f60c002a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f4dfb567444c34 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.339+0000 7f60c7400640 1 -- 172.21.15.7:0/2783340951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0036070 con 0x7f60c815c390 2024-08-19T00:48:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.339+0000 7f60c7400640 1 -- 172.21.15.7:0/2783340951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c0031600 con 0x7f60c815c390 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.339+0000 7f60c7400640 1 -- 172.21.15.7:0/2783340951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c00319d0 con 0x7f60c815c390 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.339+0000 7f60cf200640 1 -- 172.21.15.7:0/2783340951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c815c390 msgr2=0x7f60c8072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.339+0000 7f60cf200640 1 --2- 172.21.15.7:0/2783340951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c815c390 0x7f60c8072040 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f60c80b2ca0 tx=0x7f60c002a740 comp rx=0 tx=0).stop 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.340+0000 7f60cf200640 1 -- 172.21.15.7:0/2783340951 shutdown_connections 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.340+0000 7f60cf200640 1 --2- 172.21.15.7:0/2783340951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c815c390 0x7f60c8072040 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.340+0000 7f60cf200640 1 --2- 172.21.15.7:0/2783340951 >> v2:172.21.15.162:3300/0 conn(0x7f60c815bfb0 0x7f60c80b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.340+0000 7f60cf200640 1 -- 172.21.15.7:0/2783340951 >> 172.21.15.7:0/2783340951 conn(0x7f60c80b2300 msgr2=0x7f60c806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.340+0000 7f60cf200640 1 -- 172.21.15.7:0/2783340951 shutdown_connections 2024-08-19T00:48:40.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.340+0000 7f60cf200640 1 -- 172.21.15.7:0/2783340951 wait complete. 2024-08-19T00:48:40.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.341+0000 7f60cf200640 1 Processor -- start 2024-08-19T00:48:40.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.341+0000 7f60cf200640 1 -- start start 2024-08-19T00:48:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.342+0000 7f60cf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c80b5130 0x7f60c81f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.342+0000 7f60cf200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c815bfb0 0x7f60c8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.342+0000 7f60cf200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c815c390 0x7f60c815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.342+0000 7f60cf200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60c80b44c0 con 0x7f60c80b5130 2024-08-19T00:48:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.342+0000 7f60cf200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60c80b4340 con 0x7f60c815bfb0 2024-08-19T00:48:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.342+0000 7f60cf200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f60c80af2e0 con 0x7f60c815c390 2024-08-19T00:48:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.342+0000 7f60c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c80b5130 0x7f60c81f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c80b5130 0x7f60c81f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57778/0 (socket says 172.21.15.7:57778) 2024-08-19T00:48:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 -- 172.21.15.7:0/1604871752 learned_addr learned my addr 172.21.15.7:0/1604871752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60bf400640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c815bfb0 0x7f60c8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 -- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c815c390 msgr2=0x7f60c815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c815c390 0x7f60c815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 -- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c815bfb0 msgr2=0x7f60c8151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c815bfb0 0x7f60c8151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 -- 172.21.15.7:0/1604871752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c815ca10 con 0x7f60c80b5130 2024-08-19T00:48:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60bf400640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c815bfb0 0x7f60c8151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c7e00640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c80b5130 0x7f60c81f2c50 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f60b800d800 tx=0x7f60b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.343+0000 7f60c4c00640 1 -- 172.21.15.7:0/1604871752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b800b6c0 con 0x7f60c80b5130 2024-08-19T00:48:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.344+0000 7f60c4c00640 1 -- 172.21.15.7:0/1604871752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b8019070 con 0x7f60c80b5130 2024-08-19T00:48:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.344+0000 7f60c4c00640 1 -- 172.21.15.7:0/1604871752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b800ba80 con 0x7f60c80b5130 2024-08-19T00:48:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.344+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c815ccf0 con 0x7f60c80b5130 2024-08-19T00:48:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.344+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c815f6b0 con 0x7f60c80b5130 2024-08-19T00:48:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.345+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c80b3e00 con 0x7f60c80b5130 2024-08-19T00:48:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.346+0000 7f60c4c00640 1 -- 172.21.15.7:0/1604871752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60b800bc20 con 0x7f60c80b5130 2024-08-19T00:48:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.347+0000 7f60c4c00640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60a406be60 0x7f60a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.347+0000 7f60c4c00640 1 -- 172.21.15.7:0/1604871752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7f60b808bd60 con 0x7f60c80b5130 2024-08-19T00:48:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.347+0000 7f60bf400640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60a406be60 0x7f60a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.348+0000 7f60bf400640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60a406be60 0x7f60a406e320 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f60c80d0af0 tx=0x7f60b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.351+0000 7f60c4c00640 1 -- 172.21.15.7:0/1604871752 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f60b801c360 con 0x7f60c80b5130 2024-08-19T00:48:40.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.537+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f60c80b4ef0 con 0x7f60c80b5130 2024-08-19T00:48:40.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.541+0000 7f60c4c00640 1 -- 172.21.15.7:0/1604871752 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f60b8059cd0 con 0x7f60c80b5130 2024-08-19T00:48:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.543+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60a406be60 msgr2=0x7f60a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.543+0000 7f60cf200640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60a406be60 0x7f60a406e320 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f60c80d0af0 tx=0x7f60b0009040 comp rx=0 tx=0).stop 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c80b5130 msgr2=0x7f60c81f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c80b5130 0x7f60c81f2c50 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f60b800d800 tx=0x7f60b800dcc0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 shutdown_connections 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f60a406be60 0x7f60a406e320 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c815c390 0x7f60c815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c815bfb0 0x7f60c8151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 --2- 172.21.15.7:0/1604871752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c80b5130 0x7f60c81f2c50 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 >> 172.21.15.7:0/1604871752 conn(0x7f60c80b2300 msgr2=0x7f60c8156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:40.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 shutdown_connections 2024-08-19T00:48:40.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.544+0000 7f60cf200640 1 -- 172.21.15.7:0/1604871752 wait complete. 2024-08-19T00:48:40.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion' 2024-08-19T00:48:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.715+0000 7f4470c00640 1 Processor -- start 2024-08-19T00:48:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.715+0000 7f4470c00640 1 -- start start 2024-08-19T00:48:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4470c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f446c0b4a90 0x7f446c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4470c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446c0b50b0 con 0x7f446c0d03c0 2024-08-19T00:48:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4470c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446c0cead0 con 0x7f446c15f5b0 2024-08-19T00:48:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4470c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f446c15f990 con 0x7f446c0b4a90 2024-08-19T00:48:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4463e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f446c0d03c0 0x7f446c0b4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35522/0 (socket says 172.21.15.7:35522) 2024-08-19T00:48:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4463e00640 1 -- 172.21.15.7:0/192137075 learned_addr learned my addr 172.21.15.7:0/192137075 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f446a800640 1 --2- 172.21.15.7:0/192137075 >> v2:172.21.15.7:3300/0 conn(0x7f446c0b4a90 0x7f446c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4469400640 1 -- 172.21.15.7:0/192137075 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417711455 0 0) 0x7f446c0b50b0 con 0x7f446c0d03c0 2024-08-19T00:48:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f4469400640 1 -- 172.21.15.7:0/192137075 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4450003520 con 0x7f446c0d03c0 2024-08-19T00:48:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f446a800640 1 -- 172.21.15.7:0/192137075 >> v1:172.21.15.162:6789/0 conn(0x7f446c15f5b0 legacy=0x7f446c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f446a800640 1 -- 172.21.15.7:0/192137075 >> v1:172.21.15.7:6789/0 conn(0x7f446c0d03c0 legacy=0x7f446c0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.717+0000 7f446a800640 1 -- 172.21.15.7:0/192137075 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c0cedb0 con 0x7f446c0b4a90 2024-08-19T00:48:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.718+0000 7f446a800640 1 --2- 172.21.15.7:0/192137075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0b4a90 0x7f446c0d0800 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f4464009d90 tx=0x7f446402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2615a3ea1522ca01 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4469400640 1 -- 172.21.15.7:0/192137075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464007740 con 0x7f446c0b4a90 2024-08-19T00:48:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4469400640 1 -- 172.21.15.7:0/192137075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44640078e0 con 0x7f446c0b4a90 2024-08-19T00:48:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4469400640 1 -- 172.21.15.7:0/192137075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464007cb0 con 0x7f446c0b4a90 2024-08-19T00:48:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4470c00640 1 -- 172.21.15.7:0/192137075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0b4a90 msgr2=0x7f446c0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4470c00640 1 --2- 172.21.15.7:0/192137075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0b4a90 0x7f446c0d0800 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f4464009d90 tx=0x7f446402a660 comp rx=0 tx=0).stop 2024-08-19T00:48:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4470c00640 1 -- 172.21.15.7:0/192137075 shutdown_connections 2024-08-19T00:48:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4470c00640 1 --2- 172.21.15.7:0/192137075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0b4a90 0x7f446c0d0800 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4470c00640 1 -- 172.21.15.7:0/192137075 >> 172.21.15.7:0/192137075 conn(0x7f446c06bc70 msgr2=0x7f446c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4470c00640 1 -- 172.21.15.7:0/192137075 shutdown_connections 2024-08-19T00:48:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.719+0000 7f4470c00640 1 -- 172.21.15.7:0/192137075 wait complete. 2024-08-19T00:48:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.721+0000 7f4470c00640 1 Processor -- start 2024-08-19T00:48:40.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.721+0000 7f4470c00640 1 -- start start 2024-08-19T00:48:40.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4470c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f446c0b4a90 0x7f446c09ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4470c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0d03c0 0x7f446c160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4470c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f446c15f5b0 0x7f446c1f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4470c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f446c06ea30 con 0x7f446c0d03c0 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4470c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f446c06e8b0 con 0x7f446c0b4a90 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4470c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f446c06ebb0 con 0x7f446c15f5b0 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4463e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0d03c0 0x7f446c160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4463e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0d03c0 0x7f446c160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57800/0 (socket says 172.21.15.7:57800) 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4463e00640 1 -- 172.21.15.7:0/4129254801 learned_addr learned my addr 172.21.15.7:0/4129254801 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f446a800640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f446c15f5b0 0x7f446c1f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.722+0000 7f4469e00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f446c0b4a90 0x7f446c09ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4463e00640 1 -- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f446c15f5b0 msgr2=0x7f446c1f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4463e00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f446c15f5b0 0x7f446c1f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4463e00640 1 -- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f446c0b4a90 msgr2=0x7f446c09ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:40.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4463e00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f446c0b4a90 0x7f446c09ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:40.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4463e00640 1 -- 172.21.15.7:0/4129254801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c09b0c0 con 0x7f446c0d03c0 2024-08-19T00:48:40.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f446a800640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f446c15f5b0 0x7f446c1f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:40.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4463e00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0d03c0 0x7f446c160720 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f445400c500 tx=0x7f445400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4462000640 1 -- 172.21.15.7:0/4129254801 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454017070 con 0x7f446c0d03c0 2024-08-19T00:48:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4462000640 1 -- 172.21.15.7:0/4129254801 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4454005ce0 con 0x7f446c0d03c0 2024-08-19T00:48:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4462000640 1 -- 172.21.15.7:0/4129254801 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454007330 con 0x7f446c0d03c0 2024-08-19T00:48:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c1f4d80 con 0x7f446c0d03c0 2024-08-19T00:48:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.723+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c09a380 con 0x7f446c0d03c0 2024-08-19T00:48:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.724+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c1f52a0 con 0x7f446c0d03c0 2024-08-19T00:48:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.725+0000 7f4462000640 1 -- 172.21.15.7:0/4129254801 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f445401a070 con 0x7f446c0d03c0 2024-08-19T00:48:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.727+0000 7f4462000640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444806be30 0x7f444806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.727+0000 7f4462000640 1 -- 172.21.15.7:0/4129254801 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7f445408ad00 con 0x7f446c0d03c0 2024-08-19T00:48:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.727+0000 7f4469e00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444806be30 0x7f444806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.728+0000 7f4469e00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444806be30 0x7f444806e2f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f445c000f60 tx=0x7f445c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:40.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.731+0000 7f4462000640 1 -- 172.21.15.7:0/4129254801 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f446c1f52a0 con 0x7f446c0d03c0 2024-08-19T00:48:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:40.983+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]} v 0) -- 0x7f446c06efa0 con 0x7f446c0d03c0 2024-08-19T00:48:41.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.145+0000 7f4462000640 1 -- 172.21.15.7:0/4129254801 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]}]=0 v610) ==== 135+0+0 (secure 0 0 0) 0x7f4454058d30 con 0x7f446c0d03c0 2024-08-19T00:48:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444806be30 msgr2=0x7f444806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444806be30 0x7f444806e2f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f445c000f60 tx=0x7f445c009040 comp rx=0 tx=0).stop 2024-08-19T00:48:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0d03c0 msgr2=0x7f446c160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0d03c0 0x7f446c160720 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f445400c500 tx=0x7f445400c9c0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 shutdown_connections 2024-08-19T00:48:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f444806be30 0x7f444806e2f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f446c15f5b0 0x7f446c1f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c0d03c0 0x7f446c160720 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 --2- 172.21.15.7:0/4129254801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f446c0b4a90 0x7f446c09ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 >> 172.21.15.7:0/4129254801 conn(0x7f446c06bc70 msgr2=0x7f446c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 shutdown_connections 2024-08-19T00:48:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.147+0000 7f4470c00640 1 -- 172.21.15.7:0/4129254801 wait complete. 2024-08-19T00:48:41.165 INFO:tasks.cephfs_test_runner:That the MDS has a clean 'damaged' response to loss of any single metadata object ... ok 2024-08-19T00:48:41.165 INFO:tasks.cephfs_test_runner:Starting test: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) That errors encountered during opening inos are properly propagated 2024-08-19T00:48:41.166 INFO:tasks.cephfs_test_runner:test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:48:41.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:48:41.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.322+0000 7fc797000640 1 Processor -- start 2024-08-19T00:48:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.322+0000 7fc797000640 1 -- start start 2024-08-19T00:48:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc797000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc79006e710 0x7fc790071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc797000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7900cdfb0 con 0x7fc7900b3750 2024-08-19T00:48:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc797000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7900ce290 con 0x7fc7900d03c0 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc797000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc7900cebc0 con 0x7fc79006e710 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc787400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc79006e710 0x7fc790071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc795000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc7900b3750 0x7fc7900cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35528/0 (socket says 172.21.15.7:35528) 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc787400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc79006e710 0x7fc790071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57812/0 (socket says 172.21.15.7:57812) 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.323+0000 7fc795000640 1 -- 172.21.15.7:0/939451175 learned_addr learned my addr 172.21.15.7:0/939451175 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.324+0000 7fc787400640 1 -- 172.21.15.7:0/939451175 >> v1:172.21.15.162:6789/0 conn(0x7fc7900d03c0 legacy=0x7fc7900d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.324+0000 7fc787400640 1 -- 172.21.15.7:0/939451175 >> v1:172.21.15.7:6789/0 conn(0x7fc7900b3750 legacy=0x7fc7900cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.324+0000 7fc787400640 1 -- 172.21.15.7:0/939451175 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7900ce570 con 0x7fc79006e710 2024-08-19T00:48:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.324+0000 7fc78f400640 1 -- 172.21.15.7:0/939451175 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168550952 0 0) 0x7fc7900cdfb0 con 0x7fc7900b3750 2024-08-19T00:48:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.325+0000 7fc787400640 1 --2- 172.21.15.7:0/939451175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79006e710 0x7fc790071980 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fc7780097d0 tx=0x7fc77802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c130748023a283a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.325+0000 7fc78f400640 1 -- 172.21.15.7:0/939451175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778037070 con 0x7fc79006e710 2024-08-19T00:48:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.325+0000 7fc78f400640 1 -- 172.21.15.7:0/939451175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc778032440 con 0x7fc79006e710 2024-08-19T00:48:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.325+0000 7fc78f400640 1 -- 172.21.15.7:0/939451175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778032810 con 0x7fc79006e710 2024-08-19T00:48:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.326+0000 7fc797000640 1 -- 172.21.15.7:0/939451175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79006e710 msgr2=0x7fc790071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.326+0000 7fc797000640 1 --2- 172.21.15.7:0/939451175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79006e710 0x7fc790071980 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fc7780097d0 tx=0x7fc77802a250 comp rx=0 tx=0).stop 2024-08-19T00:48:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.326+0000 7fc797000640 1 -- 172.21.15.7:0/939451175 shutdown_connections 2024-08-19T00:48:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.326+0000 7fc797000640 1 --2- 172.21.15.7:0/939451175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79006e710 0x7fc790071980 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.326+0000 7fc797000640 1 -- 172.21.15.7:0/939451175 >> 172.21.15.7:0/939451175 conn(0x7fc79006bc70 msgr2=0x7fc79006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.326+0000 7fc797000640 1 -- 172.21.15.7:0/939451175 shutdown_connections 2024-08-19T00:48:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.326+0000 7fc797000640 1 -- 172.21.15.7:0/939451175 wait complete. 2024-08-19T00:48:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.327+0000 7fc797000640 1 Processor -- start 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.327+0000 7fc797000640 1 -- start start 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.328+0000 7fc797000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc79006e710 0x7fc790159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.328+0000 7fc797000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7900b3750 0x7fc790099ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.328+0000 7fc797000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7900d03c0 0x7fc7900ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.328+0000 7fc797000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc790073c60 con 0x7fc7900b3750 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.328+0000 7fc797000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc790073ae0 con 0x7fc7900d03c0 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.328+0000 7fc797000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7900b3be0 con 0x7fc79006e710 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7900b3750 0x7fc790099ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7900b3750 0x7fc790099ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57822/0 (socket says 172.21.15.7:57822) 2024-08-19T00:48:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 -- 172.21.15.7:0/3133169357 learned_addr learned my addr 172.21.15.7:0/3133169357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc78fe00640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc79006e710 0x7fc790159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc795000640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7900d03c0 0x7fc7900ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 -- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc79006e710 msgr2=0x7fc790159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc79006e710 0x7fc790159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 -- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7900d03c0 msgr2=0x7fc7900ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7900d03c0 0x7fc7900ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 -- 172.21.15.7:0/3133169357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79009d400 con 0x7fc7900b3750 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc787400640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7900b3750 0x7fc790099ac0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fc778035040 tx=0x7fc7780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.329+0000 7fc78cc00640 1 -- 172.21.15.7:0/3133169357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778037040 con 0x7fc7900b3750 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.330+0000 7fc78cc00640 1 -- 172.21.15.7:0/3133169357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc778042070 con 0x7fc7900b3750 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.330+0000 7fc78cc00640 1 -- 172.21.15.7:0/3133169357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778030bf0 con 0x7fc7900b3750 2024-08-19T00:48:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.330+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79009d6e0 con 0x7fc7900b3750 2024-08-19T00:48:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.330+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7900aea20 con 0x7fc7900b3750 2024-08-19T00:48:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.331+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc790071980 con 0x7fc7900b3750 2024-08-19T00:48:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.332+0000 7fc78cc00640 1 -- 172.21.15.7:0/3133169357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc778047460 con 0x7fc7900b3750 2024-08-19T00:48:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.333+0000 7fc78cc00640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc76c06be30 0x7fc76c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.333+0000 7fc78cc00640 1 -- 172.21.15.7:0/3133169357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7fc7780ac540 con 0x7fc7900b3750 2024-08-19T00:48:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.333+0000 7fc78fe00640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc76c06be30 0x7fc76c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.333+0000 7fc78fe00640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc76c06be30 0x7fc76c06e2f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc79006c4a0 tx=0x7fc780009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.337+0000 7fc78cc00640 1 -- 172.21.15.7:0/3133169357 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc778032e20 con 0x7fc7900b3750 2024-08-19T00:48:41.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.522+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc79006c1f0 con 0x7fc7900b3750 2024-08-19T00:48:41.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.523+0000 7fc78cc00640 1 -- 172.21.15.7:0/3133169357 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+17962 (secure 0 0 0) 0x7fc77807a480 con 0x7fc7900b3750 2024-08-19T00:48:41.525 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:41.526 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":128,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:40.138746+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3833663519":"2024-08-20T00:48:23.055248+0000","172.21.15.7:6835/3833663519":"2024-08-20T00:48:23.055248+0000","172.21.15.7:6837/2039068272":"2024-08-20T00:48:16.032983+0000","172.21.15.7:6837/2241506175":"2024-08-20T00:48:10.491906+0000","172.21.15.7:6837/767746356":"2024-08-20T00:47:36.848235+0000","172.21.15.7:6837/2697833470":"2024-08-20T00:47:13.631762+0000","172.21.15.7:6835/2697833470":"2024-08-20T00:47:13.631762+0000","172.21.15.7:6837/564246395":"2024-08-20T00:47:08.596064+0000","172.21.15.7:6835/564246395":"2024-08-20T00:47:08.596064+0000","172.21.15.7:6836/23553373":"2024-08-20T00:46:48.423172+0000","172.21.15.7:6834/23553373":"2024-08-20T00:46:48.423172+0000","172.21.15.7:6837/300508336":"2024-08-20T00:46:44.396111+0000","172.21.15.7:6835/2764430344":"2024-08-20T00:45:15.874510+0000","172.21.15.7:6834/3808845958":"2024-08-20T00:48:30.102500+0000","172.21.15.7:6835/2555026980":"2024-08-20T00:46:00.124037+0000","172.21.15.7:6837/1092992076":"2024-08-20T00:45:13.853614+0000","172.21.15.7:6837/2764430344":"2024-08-20T00:45:15.874510+0000","172.21.15.162:6834/3169517259":"2024-08-20T00:43:59.140007+0000","172.21.15.7:6836/3307283757":"2024-08-20T00:46:04.155541+0000","172.21.15.7:6836/1524598451":"2024-08-20T00:45:00.316452+0000","172.21.15.7:6834/3804092925":"2024-08-20T00:46:12.208398+0000","172.21.15.7:6835/877185885":"2024-08-20T00:44:46.224779+0000","172.21.15.7:6834/3482025847":"2024-08-20T00:44:53.272372+0000","172.21.15.7:6837/3471482572":"2024-08-20T00:46:36.346761+0000","172.21.15.7:6836/918472079":"2024-08-20T00:44:39.648889+0000","172.21.15.7:6835/3239344481":"2024-08-20T00:47:53.939814+0000","172.21.15.7:6837/2555026980":"2024-08-20T00:46:00.124037+0000","172.21.15.7:6834/918472079":"2024-08-20T00:44:39.648889+0000","172.21.15.7:6835/3619862411":"2024-08-20T00:45:39.018072+0000","172.21.15.7:6836/95446058":"2024-08-20T00:46:20.274334+0000","172.21.15.7:6837/3239344481":"2024-08-20T00:47:53.939814+0000","172.21.15.7:6837/978981940":"2024-08-20T00:47:48.474571+0000","172.21.15.7:6836/3784682490":"2024-08-20T00:44:27.595559+0000","172.21.15.162:6832/2295549448":"2024-08-20T00:43:37.028725+0000","172.21.15.7:6835/1092992076":"2024-08-20T00:45:13.853614+0000","172.21.15.7:6837/232072615":"2024-08-20T00:45:30.946343+0000","172.21.15.7:6836/1582667547":"2024-08-20T00:44:10.208810+0000","172.21.15.7:6835/2458713155":"2024-08-20T00:44:06.188927+0000","172.21.15.7:6837/4018426566":"2024-08-20T00:46:08.138498+0000","172.21.15.7:6837/2458713155":"2024-08-20T00:44:06.188927+0000","172.21.15.7:6834/1582667547":"2024-08-20T00:44:10.208810+0000","172.21.15.7:6837/2121313657":"2024-08-20T00:45:23.908167+0000","172.21.15.7:6836/3482025847":"2024-08-20T00:44:53.272372+0000","172.21.15.7:6834/1524598451":"2024-08-20T00:45:00.316452+0000","172.21.15.7:6835/978981940":"2024-08-20T00:47:48.474571+0000","172.21.15.7:6836/3804092925":"2024-08-20T00:46:12.208398+0000","172.21.15.162:6834/3482189423":"2024-08-20T00:43:53.541123+0000","172.21.15.162:6833/3482189423":"2024-08-20T00:43:53.541123+0000","172.21.15.7:6835/2121313657":"2024-08-20T00:45:23.908167+0000","172.21.15.7:6834/95446058":"2024-08-20T00:46:20.274334+0000","172.21.15.7:6834/3427152926":"2024-08-20T00:44:42.202799+0000","172.21.15.7:6835/232072615":"2024-08-20T00:45:30.946343+0000","172.21.15.7:6835/3471482572":"2024-08-20T00:46:36.346761+0000","172.21.15.7:6837/1850770580":"2024-08-20T00:44:14.242517+0000","172.21.15.7:6834/3784682490":"2024-08-20T00:44:27.595559+0000","172.21.15.7:6834/835453535":"2024-08-20T00:45:34.977428+0000","172.21.15.7:6836/835453535":"2024-08-20T00:45:34.977428+0000","172.21.15.7:6837/877185885":"2024-08-20T00:44:46.224779+0000","172.21.15.7:6837/3619862411":"2024-08-20T00:45:39.018072+0000","172.21.15.7:6834/3399848835":"2024-08-20T00:45:53.817587+0000","172.21.15.7:6836/3808845958":"2024-08-20T00:48:30.102500+0000","172.21.15.7:6835/2241506175":"2024-08-20T00:48:10.491906+0000","172.21.15.7:6835/767746356":"2024-08-20T00:47:36.848235+0000","172.21.15.7:6835/1850770580":"2024-08-20T00:44:14.242517+0000","172.21.15.7:6834/1067237290":"2024-08-20T00:45:56.104621+0000","172.21.15.7:6836/1067237290":"2024-08-20T00:45:56.104621+0000","172.21.15.7:6834/3307283757":"2024-08-20T00:46:04.155541+0000","172.21.15.7:6836/3427152926":"2024-08-20T00:44:42.202799+0000","172.21.15.7:6835/4018426566":"2024-08-20T00:46:08.138498+0000","172.21.15.7:6835/613323192":"2024-08-20T00:46:16.237393+0000","172.21.15.7:6837/613323192":"2024-08-20T00:46:16.237393+0000","172.21.15.7:6835/1141791797":"2024-08-20T00:46:33.788770+0000","172.21.15.7:6835/2039068272":"2024-08-20T00:48:16.032983+0000","172.21.15.7:6837/1141791797":"2024-08-20T00:46:33.788770+0000","172.21.15.7:6834/4168746347":"2024-08-20T00:46:40.368064+0000","172.21.15.162:6833/3169517259":"2024-08-20T00:43:59.140007+0000","172.21.15.162:6835/2295549448":"2024-08-20T00:43:37.028725+0000","172.21.15.7:6836/4168746347":"2024-08-20T00:46:40.368064+0000","172.21.15.7:6836/3399848835":"2024-08-20T00:45:53.817587+0000","172.21.15.7:6835/300508336":"2024-08-20T00:46:44.396111+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc76c06be30 msgr2=0x7fc76c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc76c06be30 0x7fc76c06e2f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc79006c4a0 tx=0x7fc780009040 comp rx=0 tx=0).stop 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7900b3750 msgr2=0x7fc790099ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7900b3750 0x7fc790099ac0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fc778035040 tx=0x7fc7780046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 shutdown_connections 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc76c06be30 0x7fc76c06e2f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7900d03c0 0x7fc7900ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7900b3750 0x7fc790099ac0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 --2- 172.21.15.7:0/3133169357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc79006e710 0x7fc790159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 >> 172.21.15.7:0/3133169357 conn(0x7fc79006bc70 msgr2=0x7fc7900cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 shutdown_connections 2024-08-19T00:48:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.526+0000 7fc797000640 1 -- 172.21.15.7:0/3133169357 wait complete. 2024-08-19T00:48:41.543 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:36:51.315746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:48:41.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T00:48:41.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.702+0000 7fa6d1a00640 1 Processor -- start 2024-08-19T00:48:41.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.702+0000 7fa6d1a00640 1 -- start start 2024-08-19T00:48:41.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.703+0000 7fa6d1a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa6cc147d40 0x7fa6cc06d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6d1a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc070320 0x7fa6cc15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6d1a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6cc06d8b0 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6d1a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa6cc06e150 con 0x7fa6cc147d40 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6d1a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc06db90 con 0x7fa6cc070320 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6c3400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa6cc0b55e0 0x7fa6cc06fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35532/0 (socket says 172.21.15.7:35532) 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6c3400640 1 -- 172.21.15.7:0/2564940807 learned_addr learned my addr 172.21.15.7:0/2564940807 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6cbe00640 1 --2- 172.21.15.7:0/2564940807 >> v2:172.21.15.162:3300/0 conn(0x7fa6cc147d40 0x7fa6cc06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6d1000640 1 --2- 172.21.15.7:0/2564940807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc070320 0x7fa6cc15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6cb400640 1 -- 172.21.15.7:0/2564940807 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122212146 0 0) 0x7fa6cc06d8b0 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.704+0000 7fa6cb400640 1 -- 172.21.15.7:0/2564940807 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b0003520 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.705+0000 7fa6d1000640 1 -- 172.21.15.7:0/2564940807 >> v2:172.21.15.162:3300/0 conn(0x7fa6cc147d40 msgr2=0x7fa6cc06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.705+0000 7fa6d1000640 1 --2- 172.21.15.7:0/2564940807 >> v2:172.21.15.162:3300/0 conn(0x7fa6cc147d40 0x7fa6cc06d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.705+0000 7fa6d1000640 1 -- 172.21.15.7:0/2564940807 >> v1:172.21.15.7:6789/0 conn(0x7fa6cc0b55e0 legacy=0x7fa6cc06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.705+0000 7fa6d1000640 1 -- 172.21.15.7:0/2564940807 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc06de70 con 0x7fa6cc070320 2024-08-19T00:48:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.705+0000 7fa6cbe00640 1 --2- 172.21.15.7:0/2564940807 >> v2:172.21.15.162:3300/0 conn(0x7fa6cc147d40 0x7fa6cc06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.706+0000 7fa6d1000640 1 --2- 172.21.15.7:0/2564940807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc070320 0x7fa6cc15ef60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009d90 tx=0x7fa6c402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e703d435bcb67710 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.706+0000 7fa6cb400640 1 -- 172.21.15.7:0/2564940807 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4031600 con 0x7fa6cc070320 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.706+0000 7fa6cb400640 1 -- 172.21.15.7:0/2564940807 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c40317a0 con 0x7fa6cc070320 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.706+0000 7fa6cb400640 1 -- 172.21.15.7:0/2564940807 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4031b50 con 0x7fa6cc070320 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.706+0000 7fa6d1a00640 1 -- 172.21.15.7:0/2564940807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc070320 msgr2=0x7fa6cc15ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.706+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/2564940807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc070320 0x7fa6cc15ef60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009d90 tx=0x7fa6c402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.707+0000 7fa6d1a00640 1 -- 172.21.15.7:0/2564940807 shutdown_connections 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.707+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/2564940807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc070320 0x7fa6cc15ef60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.707+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/2564940807 >> v2:172.21.15.162:3300/0 conn(0x7fa6cc147d40 0x7fa6cc06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.707+0000 7fa6d1a00640 1 -- 172.21.15.7:0/2564940807 >> 172.21.15.7:0/2564940807 conn(0x7fa6cc0d1fa0 msgr2=0x7fa6cc0d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.707+0000 7fa6d1a00640 1 -- 172.21.15.7:0/2564940807 shutdown_connections 2024-08-19T00:48:41.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.707+0000 7fa6d1a00640 1 -- 172.21.15.7:0/2564940807 wait complete. 2024-08-19T00:48:41.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.708+0000 7fa6d1a00640 1 Processor -- start 2024-08-19T00:48:41.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.708+0000 7fa6d1a00640 1 -- start start 2024-08-19T00:48:41.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.709+0000 7fa6d1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6cc070320 0x7fa6cc1413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.709+0000 7fa6d1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc0b55e0 0x7fa6cc140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.709+0000 7fa6d1a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc147d40 0x7fa6cc153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.709+0000 7fa6d1a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0b5b80 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.709+0000 7fa6d1a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0b5a00 con 0x7fa6cc070320 2024-08-19T00:48:41.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.709+0000 7fa6d1a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc15f4a0 con 0x7fa6cc147d40 2024-08-19T00:48:41.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.709+0000 7fa6c3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc0b55e0 0x7fa6cc140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc0b55e0 0x7fa6cc140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57838/0 (socket says 172.21.15.7:57838) 2024-08-19T00:48:41.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 -- 172.21.15.7:0/1278152810 learned_addr learned my addr 172.21.15.7:0/1278152810 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:41.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6d1000640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc147d40 0x7fa6cc153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6cbe00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6cc070320 0x7fa6cc1413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 -- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc147d40 msgr2=0x7fa6cc153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc147d40 0x7fa6cc153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 -- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6cc070320 msgr2=0x7fa6cc1413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6cc070320 0x7fa6cc1413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 -- 172.21.15.7:0/1278152810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc1419d0 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6cbe00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6cc070320 0x7fa6cc1413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:41.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c3400640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc0b55e0 0x7fa6cc140e70 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400c460 tx=0x7fa6b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c8c00640 1 -- 172.21.15.7:0/1278152810 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4017070 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.710+0000 7fa6c8c00640 1 -- 172.21.15.7:0/1278152810 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4005ce0 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.711+0000 7fa6c8c00640 1 -- 172.21.15.7:0/1278152810 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4007290 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.711+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc141cb0 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.711+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc142270 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.712+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6cc15ef60 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.713+0000 7fa6c8c00640 1 -- 172.21.15.7:0/1278152810 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6b401a070 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.714+0000 7fa6c8c00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6a806be60 0x7fa6a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.714+0000 7fa6c8c00640 1 -- 172.21.15.7:0/1278152810 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7fa6b408ac00 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.714+0000 7fa6cbe00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6a806be60 0x7fa6a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.715+0000 7fa6cbe00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6a806be60 0x7fa6a806e320 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009af0 tx=0x7fa6bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.718+0000 7fa6c8c00640 1 -- 172.21.15.7:0/1278152810 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa6b4091080 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.901+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa6cc06d560 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.902+0000 7fa6c8c00640 1 -- 172.21.15.7:0/1278152810 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) ==== 93+0+10 (secure 0 0 0) 0x7fa6b4058b40 con 0x7fa6cc0b55e0 2024-08-19T00:48:41.907 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-08-19T00:48:41.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6a806be60 msgr2=0x7fa6a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6a806be60 0x7fa6a806e320 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009af0 tx=0x7fa6bc008040 comp rx=0 tx=0).stop 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc0b55e0 msgr2=0x7fa6cc140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc0b55e0 0x7fa6cc140e70 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400c460 tx=0x7fa6b400c920 comp rx=0 tx=0).stop 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 shutdown_connections 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fa6a806be60 0x7fa6a806e320 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6cc147d40 0x7fa6cc153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6cc0b55e0 0x7fa6cc140e70 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 --2- 172.21.15.7:0/1278152810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6cc070320 0x7fa6cc1413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 >> 172.21.15.7:0/1278152810 conn(0x7fa6cc0d1fa0 msgr2=0x7fa6cc06fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 shutdown_connections 2024-08-19T00:48:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:41.904+0000 7fa6d1a00640 1 -- 172.21.15.7:0/1278152810 wait complete. 2024-08-19T00:48:41.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors' 2024-08-19T00:48:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.077+0000 7fb0aea00640 1 Processor -- start 2024-08-19T00:48:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.077+0000 7fb0aea00640 1 -- start start 2024-08-19T00:48:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.078+0000 7fb0aea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb0a80d0ad0 0x7fb0a80ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.078+0000 7fb0aea00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a806f7f0 con 0x7fb0a8159bf0 2024-08-19T00:48:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.078+0000 7fb0aea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a806f510 con 0x7fb0a80ce500 2024-08-19T00:48:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.078+0000 7fb0aea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a8072980 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.078+0000 7fb0a7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb0a8159bf0 0x7fb0a8073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35534/0 (socket says 172.21.15.7:35534) 2024-08-19T00:48:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.078+0000 7fb0a7e00640 1 -- 172.21.15.7:0/886107755 learned_addr learned my addr 172.21.15.7:0/886107755 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.078+0000 7fb0aca00640 1 --2- 172.21.15.7:0/886107755 >> v2:172.21.15.162:3300/0 conn(0x7fb0a80d0ad0 0x7fb0a80ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.079+0000 7fb0a7400640 1 -- 172.21.15.7:0/886107755 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329434772 0 0) 0x7fb0a806f7f0 con 0x7fb0a8159bf0 2024-08-19T00:48:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.079+0000 7fb0a7400640 1 -- 172.21.15.7:0/886107755 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb08c003520 con 0x7fb0a8159bf0 2024-08-19T00:48:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.079+0000 7fb0aca00640 1 -- 172.21.15.7:0/886107755 >> v1:172.21.15.162:6789/0 conn(0x7fb0a80ce500 legacy=0x7fb0a80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.079+0000 7fb0a7400640 1 -- 172.21.15.7:0/886107755 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101661757 0 0) 0x7fb0a806f510 con 0x7fb0a80ce500 2024-08-19T00:48:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.079+0000 7fb0aca00640 1 -- 172.21.15.7:0/886107755 >> v1:172.21.15.7:6789/0 conn(0x7fb0a8159bf0 legacy=0x7fb0a8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.079+0000 7fb0aca00640 1 -- 172.21.15.7:0/886107755 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a8072c60 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.080+0000 7fb0aca00640 1 --2- 172.21.15.7:0/886107755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80ce970 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009d90 tx=0x7fb0a002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75638ccddfd5de34 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:42.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.080+0000 7fb0a7400640 1 -- 172.21.15.7:0/886107755 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0007740 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.080+0000 7fb0a7400640 1 -- 172.21.15.7:0/886107755 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a00078e0 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.080+0000 7fb0a7400640 1 -- 172.21.15.7:0/886107755 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0007cb0 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.081+0000 7fb0aea00640 1 -- 172.21.15.7:0/886107755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a80d0ad0 msgr2=0x7fb0a80ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.081+0000 7fb0aea00640 1 --2- 172.21.15.7:0/886107755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80ce970 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009d90 tx=0x7fb0a002a660 comp rx=0 tx=0).stop 2024-08-19T00:48:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.081+0000 7fb0aea00640 1 -- 172.21.15.7:0/886107755 shutdown_connections 2024-08-19T00:48:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.081+0000 7fb0aea00640 1 --2- 172.21.15.7:0/886107755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80ce970 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.081+0000 7fb0aea00640 1 -- 172.21.15.7:0/886107755 >> 172.21.15.7:0/886107755 conn(0x7fb0a806bc70 msgr2=0x7fb0a806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.081+0000 7fb0aea00640 1 -- 172.21.15.7:0/886107755 shutdown_connections 2024-08-19T00:48:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.081+0000 7fb0aea00640 1 -- 172.21.15.7:0/886107755 wait complete. 2024-08-19T00:48:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.083+0000 7fb0aea00640 1 Processor -- start 2024-08-19T00:48:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.083+0000 7fb0aea00640 1 -- start start 2024-08-19T00:48:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0aea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0a80ce500 0x7fb0a81556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0aea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0aea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a8159bf0 0x7fb0a80cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0aea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a8159fd0 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0aea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a8073b70 con 0x7fb0a8159bf0 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0aea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a815a150 con 0x7fb0a80ce500 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57854/0 (socket says 172.21.15.7:57854) 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 -- 172.21.15.7:0/1321378483 learned_addr learned my addr 172.21.15.7:0/1321378483 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0aca00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a8159bf0 0x7fb0a80cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb0a7e00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0a80ce500 0x7fb0a81556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 -- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0a80ce500 msgr2=0x7fb0a81556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0a80ce500 0x7fb0a81556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 -- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a8159bf0 msgr2=0x7fb0a80cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a8159bf0 0x7fb0a80cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.084+0000 7fb09f400640 1 -- 172.21.15.7:0/1321378483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a8149380 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.085+0000 7fb09f400640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80b25e0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fb09000c3c0 tx=0x7fb09000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.085+0000 7fb0a4c00640 1 -- 172.21.15.7:0/1321378483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090017070 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.085+0000 7fb0a4c00640 1 -- 172.21.15.7:0/1321378483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900035f0 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.085+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a8149660 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.085+0000 7fb0a4c00640 1 -- 172.21.15.7:0/1321378483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900039e0 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.085+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a8149c20 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.086+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a80ce970 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.087+0000 7fb0a4c00640 1 -- 172.21.15.7:0/1321378483 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb09001a070 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.088+0000 7fb0a4c00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb08406be30 0x7fb08406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.088+0000 7fb0a4c00640 1 -- 172.21.15.7:0/1321378483 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7fb09008ac40 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.088+0000 7fb0a7e00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb08406be30 0x7fb08406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.089+0000 7fb0a7e00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb08406be30 0x7fb08406e2f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb098005880 tx=0x7fb098009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.092+0000 7fb0a4c00640 1 -- 172.21.15.7:0/1321378483 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb0900584d0 con 0x7fb0a80d0ad0 2024-08-19T00:48:42.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:42.342+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]} v 0) -- 0x7fb0a806c360 con 0x7fb0a80d0ad0 2024-08-19T00:48:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.152+0000 7fb0a4c00640 1 -- 172.21.15.7:0/1321378483 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]}]=0 v612) ==== 138+0+0 (secure 0 0 0) 0x7fb09005c7d0 con 0x7fb0a80d0ad0 2024-08-19T00:48:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.154+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb08406be30 msgr2=0x7fb08406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.154+0000 7fb0aea00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb08406be30 0x7fb08406e2f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb098005880 tx=0x7fb098009040 comp rx=0 tx=0).stop 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.154+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a80d0ad0 msgr2=0x7fb0a80b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.154+0000 7fb0aea00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80b25e0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fb09000c3c0 tx=0x7fb09000c880 comp rx=0 tx=0).stop 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 shutdown_connections 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb08406be30 0x7fb08406e2f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a8159bf0 0x7fb0a80cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0a80d0ad0 0x7fb0a80b25e0 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 --2- 172.21.15.7:0/1321378483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0a80ce500 0x7fb0a81556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 >> 172.21.15.7:0/1321378483 conn(0x7fb0a806bc70 msgr2=0x7fb0a815bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 shutdown_connections 2024-08-19T00:48:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.155+0000 7fb0aea00640 1 -- 172.21.15.7:0/1321378483 wait complete. 2024-08-19T00:48:43.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-19T00:48:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.339+0000 7f7163e00640 1 Processor -- start 2024-08-19T00:48:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.339+0000 7f7163e00640 1 -- start start 2024-08-19T00:48:43.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.340+0000 7f7163e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 0x7f71640b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.340+0000 7f7163e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f71640b4150 0x7f71640b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.340+0000 7f7163e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71640b4b20 con 0x7f71640d27b0 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.340+0000 7f7163e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f71640b4df0 con 0x7f71640b4150 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.340+0000 7f7163e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f71640b50d0 con 0x7f716415e3e0 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.340+0000 7f7162000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f71640d27b0 0x7f71640d2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35550/0 (socket says 172.21.15.7:35550) 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.340+0000 7f7162000640 1 -- 172.21.15.7:0/1665484053 learned_addr learned my addr 172.21.15.7:0/1665484053 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7163400640 1 --2- 172.21.15.7:0/1665484053 >> v2:172.21.15.162:3300/0 conn(0x7f71640b4150 0x7f71640b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7162a00640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 0x7f71640b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979662595 0 0) 0x7f71640b4b20 con 0x7f71640d27b0 2024-08-19T00:48:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7148003520 con 0x7f71640d27b0 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4113743497 0 0) 0x7f7148003520 con 0x7f71640d27b0 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 msgr2=0x7f71640b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 0x7f71640b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 >> v2:172.21.15.162:3300/0 conn(0x7f71640b4150 msgr2=0x7f71640b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 --2- 172.21.15.7:0/1665484053 >> v2:172.21.15.162:3300/0 conn(0x7f71640b4150 0x7f71640b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71640cf1e0 con 0x7f71640d27b0 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f7150001670 con 0x7f71640d27b0 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 >> v1:172.21.15.7:6789/0 conn(0x7f71640d27b0 legacy=0x7f71640d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71480039b0 0x7f7148003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004800 0x7f7148004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 0x7f71480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71640b4df0 con 0x7f71480039b0 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71640b50d0 con 0x7f7148004800 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.341+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f714800b9c0 con 0x7f716415e3e0 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7162a00640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71480039b0 0x7f7148003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7163400640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 0x7f71480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7162000640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004800 0x7f7148004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7162a00640 1 -- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 msgr2=0x7f71480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7162a00640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415e3e0 0x7f71480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7162a00640 1 -- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004800 msgr2=0x7f7148004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7162a00640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004800 0x7f7148004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.342+0000 7f7162a00640 1 -- 172.21.15.7:0/1665484053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7148003520 con 0x7f71480039b0 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.343+0000 7f7162a00640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71480039b0 0x7f7148003dd0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f7154009ac0 tx=0x7f7148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f750360388e1fc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.343+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154036070 con 0x7f71480039b0 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.343+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7154031400 con 0x7f71480039b0 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.343+0000 7f7161600640 1 -- 172.21.15.7:0/1665484053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154009690 con 0x7f71480039b0 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.344+0000 7f7163e00640 1 -- 172.21.15.7:0/1665484053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71480039b0 msgr2=0x7f7148003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.344+0000 7f7163e00640 1 --2- 172.21.15.7:0/1665484053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71480039b0 0x7f7148003dd0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f7154009ac0 tx=0x7f7148005830 comp rx=0 tx=0).stop 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.344+0000 7f7163400640 1 -- 172.21.15.7:0/1665484053 reap_dead start 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.344+0000 7f7163e00640 1 -- 172.21.15.7:0/1665484053 shutdown_connections 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.344+0000 7f7163e00640 1 -- 172.21.15.7:0/1665484053 >> 172.21.15.7:0/1665484053 conn(0x7f716408dbe0 msgr2=0x7f716409d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.344+0000 7f7163e00640 1 -- 172.21.15.7:0/1665484053 shutdown_connections 2024-08-19T00:48:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.344+0000 7f7163e00640 1 -- 172.21.15.7:0/1665484053 wait complete. 2024-08-19T00:48:43.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.346+0000 7f7163e00640 1 Processor -- start 2024-08-19T00:48:43.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.346+0000 7f7163e00640 1 -- start start 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71480039b0 0x7f716415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415a660 0x7f7164160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7164161190 0x7f71640d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71640b0e60 con 0x7f7164161190 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71640cee90 con 0x7f71480039b0 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f71640b0fe0 con 0x7f716415a660 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7164161190 0x7f71640d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7164161190 0x7f71640d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57870/0 (socket says 172.21.15.7:57870) 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7163400640 1 -- 172.21.15.7:0/3553839786 learned_addr learned my addr 172.21.15.7:0/3553839786 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7162000640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415a660 0x7f7164160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.347+0000 7f7162a00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71480039b0 0x7f716415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163400640 1 -- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415a660 msgr2=0x7f7164160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163400640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415a660 0x7f7164160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163400640 1 -- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71480039b0 msgr2=0x7f716415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163400640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71480039b0 0x7f716415f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163400640 1 -- 172.21.15.7:0/3553839786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7164161680 con 0x7f7164161190 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163400640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7164161190 0x7f71640d01a0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f71640d1cf0 tx=0x7f715c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f715aa00640 1 -- 172.21.15.7:0/3553839786 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c015430 con 0x7f7164161190 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f715aa00640 1 -- 172.21.15.7:0/3553839786 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f715c01d070 con 0x7f7164161190 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f715aa00640 1 -- 172.21.15.7:0/3553839786 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c015830 con 0x7f7164161190 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7164161960 con 0x7f7164161190 2024-08-19T00:48:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.348+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71640b8150 con 0x7f7164161190 2024-08-19T00:48:43.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.349+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71640b8350 con 0x7f7164161190 2024-08-19T00:48:43.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.350+0000 7f715aa00640 1 -- 172.21.15.7:0/3553839786 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f715c0159d0 con 0x7f7164161190 2024-08-19T00:48:43.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.351+0000 7f715aa00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f714406be60 0x7f714406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:43.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.351+0000 7f715aa00640 1 -- 172.21.15.7:0/3553839786 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7f715c08c150 con 0x7f7164161190 2024-08-19T00:48:43.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.351+0000 7f7162a00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f714406be60 0x7f714406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:43.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.352+0000 7f7162a00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f714406be60 0x7f714406e320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7154033000 tx=0x7f7154008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:43.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.356+0000 7f715aa00640 1 -- 172.21.15.7:0/3553839786 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f71640b8350 con 0x7f7164161190 2024-08-19T00:48:43.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.541+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f71640b13c0 con 0x7f7164161190 2024-08-19T00:48:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.544+0000 7f715aa00640 1 -- 172.21.15.7:0/3553839786 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f715c010040 con 0x7f7164161190 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f714406be60 msgr2=0x7f714406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f714406be60 0x7f714406e320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7154033000 tx=0x7f7154008030 comp rx=0 tx=0).stop 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7164161190 msgr2=0x7f71640d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7164161190 0x7f71640d01a0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f71640d1cf0 tx=0x7f715c00f580 comp rx=0 tx=0).stop 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 shutdown_connections 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f714406be60 0x7f714406e320 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7164161190 0x7f71640d01a0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f716415a660 0x7f7164160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 --2- 172.21.15.7:0/3553839786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71480039b0 0x7f716415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:43.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 >> 172.21.15.7:0/3553839786 conn(0x7f716408dbe0 msgr2=0x7f716406d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:43.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 shutdown_connections 2024-08-19T00:48:43.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:43.547+0000 7f7163e00640 1 -- 172.21.15.7:0/3553839786 wait complete. 2024-08-19T00:48:43.575 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:48:43.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:48:43.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:48:43.772 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:48:43.772 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:43.773 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:43.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:48:43.822 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:48:43.822 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:43.879 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:48:43.879 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:43.879 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:43.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:48:43.920 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:48:43.920 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:43.963 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:48:43.963 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-19T00:48:43.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:44.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.120+0000 7ff0cbe00640 1 Processor -- start 2024-08-19T00:48:44.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.120+0000 7ff0cbe00640 1 -- start start 2024-08-19T00:48:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.121+0000 7ff0cbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0cc140640 0x7ff0cc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.121+0000 7ff0cbe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc15e930 con 0x7ff0cc06db40 2024-08-19T00:48:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.121+0000 7ff0cbe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc15ec10 con 0x7ff0cc13dc30 2024-08-19T00:48:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.121+0000 7ff0cbe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff0cc1413f0 con 0x7ff0cc140640 2024-08-19T00:48:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.121+0000 7ff0c2000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0cc140640 0x7ff0cc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.121+0000 7ff0cb400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0cc06db40 0x7ff0cc0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48756/0 (socket says 172.21.15.7:48756) 2024-08-19T00:48:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.121+0000 7ff0cb400640 1 -- 172.21.15.7:0/2781477190 learned_addr learned my addr 172.21.15.7:0/2781477190 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:44.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.122+0000 7ff0c2000640 1 -- 172.21.15.7:0/2781477190 >> v1:172.21.15.162:6789/0 conn(0x7ff0cc13dc30 legacy=0x7ff0cc140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.122+0000 7ff0c2000640 1 -- 172.21.15.7:0/2781477190 >> v1:172.21.15.7:6789/0 conn(0x7ff0cc06db40 legacy=0x7ff0cc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.122+0000 7ff0ca000640 1 -- 172.21.15.7:0/2781477190 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304625453 0 0) 0x7ff0cc15ec10 con 0x7ff0cc13dc30 2024-08-19T00:48:44.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.122+0000 7ff0c2000640 1 -- 172.21.15.7:0/2781477190 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc15eef0 con 0x7ff0cc140640 2024-08-19T00:48:44.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.123+0000 7ff0c2000640 1 --2- 172.21.15.7:0/2781477190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc140640 0x7ff0cc06d600 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40097a0 tx=0x7ff0b402c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdd9fc540d29eda server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.123+0000 7ff0ca000640 1 -- 172.21.15.7:0/2781477190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4039070 con 0x7ff0cc140640 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.123+0000 7ff0ca000640 1 -- 172.21.15.7:0/2781477190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b4034440 con 0x7ff0cc140640 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.123+0000 7ff0ca000640 1 -- 172.21.15.7:0/2781477190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4034810 con 0x7ff0cc140640 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.124+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2781477190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc140640 msgr2=0x7ff0cc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.124+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2781477190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc140640 0x7ff0cc06d600 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40097a0 tx=0x7ff0b402c340 comp rx=0 tx=0).stop 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.124+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2781477190 shutdown_connections 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.124+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2781477190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc140640 0x7ff0cc06d600 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.124+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2781477190 >> 172.21.15.7:0/2781477190 conn(0x7ff0cc06b850 msgr2=0x7ff0cc06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:44.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.124+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2781477190 shutdown_connections 2024-08-19T00:48:44.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.124+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2781477190 wait complete. 2024-08-19T00:48:44.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.125+0000 7ff0cbe00640 1 Processor -- start 2024-08-19T00:48:44.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.125+0000 7ff0cbe00640 1 -- start start 2024-08-19T00:48:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.126+0000 7ff0cbe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0cc06db40 0x7ff0cc13a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.126+0000 7ff0cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc13dc30 0x7ff0cc13f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.126+0000 7ff0cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc140640 0x7ff0cc154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.126+0000 7ff0cbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc13e010 con 0x7ff0cc13dc30 2024-08-19T00:48:44.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.126+0000 7ff0cbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc15f4b0 con 0x7ff0cc140640 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.126+0000 7ff0cbe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc13e190 con 0x7ff0cc06db40 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.126+0000 7ff0c2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc13dc30 0x7ff0cc13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc13dc30 0x7ff0cc13f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57460/0 (socket says 172.21.15.7:57460) 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 -- 172.21.15.7:0/2279059298 learned_addr learned my addr 172.21.15.7:0/2279059298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0caa00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0cc06db40 0x7ff0cc13a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0cb400640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc140640 0x7ff0cc154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 -- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0cc06db40 msgr2=0x7ff0cc13a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0cc06db40 0x7ff0cc13a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 -- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc140640 msgr2=0x7ff0cc154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc140640 0x7ff0cc154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 -- 172.21.15.7:0/2279059298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc13e8e0 con 0x7ff0cc13dc30 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.127+0000 7ff0c2000640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc13dc30 0x7ff0cc13f960 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000c00 tx=0x7ff0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:44.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.128+0000 7ff0c3e00640 1 -- 172.21.15.7:0/2279059298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4039040 con 0x7ff0cc13dc30 2024-08-19T00:48:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.128+0000 7ff0c3e00640 1 -- 172.21.15.7:0/2279059298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b4004230 con 0x7ff0cc13dc30 2024-08-19T00:48:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.128+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc13ebc0 con 0x7ff0cc13dc30 2024-08-19T00:48:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.128+0000 7ff0c3e00640 1 -- 172.21.15.7:0/2279059298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b403e670 con 0x7ff0cc13dc30 2024-08-19T00:48:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.128+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc13f180 con 0x7ff0cc13dc30 2024-08-19T00:48:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.129+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0cc06d600 con 0x7ff0cc13dc30 2024-08-19T00:48:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.130+0000 7ff0c3e00640 1 -- 172.21.15.7:0/2279059298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0b403c070 con 0x7ff0cc13dc30 2024-08-19T00:48:44.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.131+0000 7ff0c3e00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0a806be30 0x7ff0a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.131+0000 7ff0c3e00640 1 -- 172.21.15.7:0/2279059298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7ff0b40ae180 con 0x7ff0cc13dc30 2024-08-19T00:48:44.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.131+0000 7ff0caa00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0a806be30 0x7ff0a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.132+0000 7ff0caa00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0a806be30 0x7ff0a806e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc000f60 tx=0x7ff0bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:44.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.135+0000 7ff0c3e00640 1 -- 172.21.15.7:0/2279059298 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff0b4043020 con 0x7ff0cc13dc30 2024-08-19T00:48:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.358+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0cc13aff0 con 0x7ff0cc13dc30 2024-08-19T00:48:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.358+0000 7ff0c3e00640 1 -- 172.21.15.7:0/2279059298 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 339 v339) ==== 95+0+3917 (secure 0 0 0) 0x7ff0b407baa0 con 0x7ff0cc13dc30 2024-08-19T00:48:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:44.360 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":339,"btime":"2024-08-19T00:48:38:125709+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3513886745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3513886745},{"type":"v1","addr":"172.21.15.162:6835","nonce":3513886745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/1263154569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":1263154569},{"type":"v1","addr":"172.21.15.162:6834","nonce":1263154569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":10290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2957647231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2957647231},{"type":"v1","addr":"172.21.15.7:6837","nonce":2957647231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":333},{"gid":10338,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1489488565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1489488565},{"type":"v1","addr":"172.21.15.7:6836","nonce":1489488565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":337}],"filesystems":[]} 2024-08-19T00:48:44.361 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 339 2024-08-19T00:48:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0a806be30 msgr2=0x7ff0a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0a806be30 0x7ff0a806e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc000f60 tx=0x7ff0bc009040 comp rx=0 tx=0).stop 2024-08-19T00:48:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc13dc30 msgr2=0x7ff0cc13f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc13dc30 0x7ff0cc13f960 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000c00 tx=0x7ff0b40046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 shutdown_connections 2024-08-19T00:48:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7ff0a806be30 0x7ff0a806e2f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc140640 0x7ff0cc154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0cc13dc30 0x7ff0cc13f960 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 --2- 172.21.15.7:0/2279059298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0cc06db40 0x7ff0cc13a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 >> 172.21.15.7:0/2279059298 conn(0x7ff0cc06b850 msgr2=0x7ff0cc0b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 shutdown_connections 2024-08-19T00:48:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.360+0000 7ff0cbe00640 1 -- 172.21.15.7:0/2279059298 wait complete. 2024-08-19T00:48:44.379 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-19T00:48:44.379 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-19T00:48:44.380 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:48:44.380 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:48:44.380 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-19T00:48:44.380 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-19T00:48:44.381 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:48:44.381 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:48:44.381 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-19T00:48:44.381 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-19T00:48:44.381 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-19T00:48:44.381 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:48:44.382 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-19T00:48:44.382 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-19T00:48:44.382 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-19T00:48:44.382 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:48:44.395 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:48:44.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-19T00:48:44.397 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:48:44.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-19T00:48:44.398 INFO:tasks.ceph.mds.b:Stopped 2024-08-19T00:48:44.398 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-19T00:48:44.399 INFO:tasks.ceph.mds.d:Stopped 2024-08-19T00:48:44.399 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-19T00:48:44.441 INFO:tasks.ceph.mds.a:Started 2024-08-19T00:48:44.442 DEBUG:teuthology.parallel:result is None 2024-08-19T00:48:44.443 INFO:tasks.ceph.mds.b:Started 2024-08-19T00:48:44.444 DEBUG:teuthology.parallel:result is None 2024-08-19T00:48:44.444 INFO:tasks.ceph.mds.c:Started 2024-08-19T00:48:44.444 DEBUG:teuthology.parallel:result is None 2024-08-19T00:48:44.446 INFO:tasks.ceph.mds.d:Started 2024-08-19T00:48:44.446 DEBUG:teuthology.parallel:result is None 2024-08-19T00:48:44.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-19T00:48:44.576 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-19T00:48:44.576 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-19T00:48:44.577 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-08-19T00:48:44.578 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:48:44.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.612+0000 7f32bd600640 1 Processor -- start 2024-08-19T00:48:44.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.612+0000 7f32bd600640 1 -- start start 2024-08-19T00:48:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.613+0000 7f32bd600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32b8159bf0 0x7f32b8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.613+0000 7f32bd600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80cec10 0x7f32b80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.613+0000 7f32bd600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b806f7f0 con 0x7f32b80739a0 2024-08-19T00:48:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.613+0000 7f32bd600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f32b806f510 con 0x7f32b8159bf0 2024-08-19T00:48:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.613+0000 7f32bd600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b8072980 con 0x7f32b80cec10 2024-08-19T00:48:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32b8159bf0 0x7f32b8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32afe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f32b80739a0 0x7f32b80ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:48362/0 (socket says 172.21.15.7:48362) 2024-08-19T00:48:44.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32b8159bf0 0x7f32b8073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57514/0 (socket says 172.21.15.7:57514) 2024-08-19T00:48:44.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32afe00640 1 -- 172.21.15.7:0/1574996641 learned_addr learned my addr 172.21.15.7:0/1574996641 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b7400640 1 --2- 172.21.15.7:0/1574996641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80cec10 0x7f32b80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6000640 1 -- 172.21.15.7:0/1574996641 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 534252573 0 0) 0x7f32b806f7f0 con 0x7f32b80739a0 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6000640 1 -- 172.21.15.7:0/1574996641 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f329c003520 con 0x7f32b80739a0 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6a00640 1 -- 172.21.15.7:0/1574996641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80cec10 msgr2=0x7f32b80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6a00640 1 --2- 172.21.15.7:0/1574996641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80cec10 0x7f32b80d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6a00640 1 -- 172.21.15.7:0/1574996641 >> v1:172.21.15.162:6789/0 conn(0x7f32b80739a0 legacy=0x7f32b80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b6a00640 1 -- 172.21.15.7:0/1574996641 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b8072c60 con 0x7f32b8159bf0 2024-08-19T00:48:44.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.614+0000 7f32b7400640 1 --2- 172.21.15.7:0/1574996641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80cec10 0x7f32b80d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:44.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.615+0000 7f32b6a00640 1 --2- 172.21.15.7:0/1574996641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b8159bf0 0x7f32b8073460 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f32a80097a0 tx=0x7f32a802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c154d1f84a0cea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:44.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.615+0000 7f32b6000640 1 -- 172.21.15.7:0/1574996641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8037070 con 0x7f32b8159bf0 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32b6000640 1 -- 172.21.15.7:0/1574996641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a802ae40 con 0x7f32b8159bf0 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32b6000640 1 -- 172.21.15.7:0/1574996641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8032660 con 0x7f32b8159bf0 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 -- 172.21.15.7:0/1574996641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b8159bf0 msgr2=0x7f32b8073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 --2- 172.21.15.7:0/1574996641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b8159bf0 0x7f32b8073460 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f32a80097a0 tx=0x7f32a802a0f0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 -- 172.21.15.7:0/1574996641 shutdown_connections 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 --2- 172.21.15.7:0/1574996641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80cec10 0x7f32b80d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 --2- 172.21.15.7:0/1574996641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b8159bf0 0x7f32b8073460 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 -- 172.21.15.7:0/1574996641 >> 172.21.15.7:0/1574996641 conn(0x7f32b806bc70 msgr2=0x7f32b806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 -- 172.21.15.7:0/1574996641 shutdown_connections 2024-08-19T00:48:44.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.616+0000 7f32bd600640 1 -- 172.21.15.7:0/1574996641 wait complete. 2024-08-19T00:48:44.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.618+0000 7f32bd600640 1 Processor -- start 2024-08-19T00:48:44.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.618+0000 7f32bd600640 1 -- start start 2024-08-19T00:48:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32bd600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80739a0 0x7f32b8157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32bd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b8159bf0 0x7f32b809a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32bd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b809ba20 0x7f32b81493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32bd600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32b815a150 con 0x7f32b809ba20 2024-08-19T00:48:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32bd600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8159fd0 con 0x7f32b8159bf0 2024-08-19T00:48:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32bd600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b80d0900 con 0x7f32b80739a0 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b809ba20 0x7f32b81493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b809ba20 0x7f32b81493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57526/0 (socket says 172.21.15.7:57526) 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32b7400640 1 -- 172.21.15.7:0/499680982 learned_addr learned my addr 172.21.15.7:0/499680982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32b6a00640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80739a0 0x7f32b8157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.619+0000 7f32afe00640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b8159bf0 0x7f32b809a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32b7400640 1 -- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80739a0 msgr2=0x7f32b8157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32b7400640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80739a0 0x7f32b8157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32b7400640 1 -- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b8159bf0 msgr2=0x7f32b809a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32b7400640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b8159bf0 0x7f32b809a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32b7400640 1 -- 172.21.15.7:0/499680982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b8149910 con 0x7f32b809ba20 2024-08-19T00:48:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32b7400640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b809ba20 0x7f32b81493d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f32b000efc0 tx=0x7f32b0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32aea00640 1 -- 172.21.15.7:0/499680982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0018030 con 0x7f32b809ba20 2024-08-19T00:48:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32aea00640 1 -- 172.21.15.7:0/499680982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b000cde0 con 0x7f32b809ba20 2024-08-19T00:48:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32aea00640 1 -- 172.21.15.7:0/499680982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0003bb0 con 0x7f32b809ba20 2024-08-19T00:48:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b809a980 con 0x7f32b809ba20 2024-08-19T00:48:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.620+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b809af40 con 0x7f32b809ba20 2024-08-19T00:48:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.622+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b8068c00 con 0x7f32b809ba20 2024-08-19T00:48:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.622+0000 7f32aea00640 1 -- 172.21.15.7:0/499680982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32b0005d10 con 0x7f32b809ba20 2024-08-19T00:48:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.623+0000 7f32aea00640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329406be30 0x7f329406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.623+0000 7f32aea00640 1 -- 172.21.15.7:0/499680982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 8297+0+0 (secure 0 0 0) 0x7f32b008c2d0 con 0x7f32b809ba20 2024-08-19T00:48:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.623+0000 7f32b6a00640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329406be30 0x7f329406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.624+0000 7f32b6a00640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329406be30 0x7f329406e2f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f32a8034000 tx=0x7f32a802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:44.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.627+0000 7f32aea00640 1 -- 172.21.15.7:0/499680982 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f32b0022070 con 0x7f32b809ba20 2024-08-19T00:48:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:44.822+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f32b80d0cd0 con 0x7f32b809ba20 2024-08-19T00:48:45.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.171+0000 7f32aea00640 1 -- 172.21.15.7:0/499680982 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v130) ==== 97+0+0 (secure 0 0 0) 0x7f32b8149910 con 0x7f32b809ba20 2024-08-19T00:48:45.173 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-08-19T00:48:45.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329406be30 msgr2=0x7f329406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329406be30 0x7f329406e2f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f32a8034000 tx=0x7f32a802e000 comp rx=0 tx=0).stop 2024-08-19T00:48:45.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b809ba20 msgr2=0x7f32b81493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b809ba20 0x7f32b81493d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f32b000efc0 tx=0x7f32b0009f90 comp rx=0 tx=0).stop 2024-08-19T00:48:45.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 shutdown_connections 2024-08-19T00:48:45.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f329406be30 0x7f329406e2f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32b809ba20 0x7f32b81493d0 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b8159bf0 0x7f32b809a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 --2- 172.21.15.7:0/499680982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b80739a0 0x7f32b8157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 >> 172.21.15.7:0/499680982 conn(0x7f32b806bc70 msgr2=0x7f32b80b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:45.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 shutdown_connections 2024-08-19T00:48:45.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.174+0000 7f32bd600640 1 -- 172.21.15.7:0/499680982 wait complete. 2024-08-19T00:48:45.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-19T00:48:45.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.352+0000 7fb603e00640 1 Processor -- start 2024-08-19T00:48:45.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.352+0000 7fb603e00640 1 -- start start 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb603e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb60415e360 0x7fb60415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb603e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb6040d2af0 0x7fb6040d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb603e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e740 0x7fb60415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb603e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb6040b3ab0 con 0x7fb60415e360 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb603e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb60415f460 con 0x7fb6040d2af0 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb603e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb60415f740 con 0x7fb60415e740 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb602a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb60415e360 0x7fb60415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb602a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb60415e360 0x7fb60415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57532/0 (socket says 172.21.15.7:57532) 2024-08-19T00:48:45.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb602a00640 1 -- 172.21.15.7:0/1933015858 learned_addr learned my addr 172.21.15.7:0/1933015858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:45.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb602000640 1 --2- 172.21.15.7:0/1933015858 >> v2:172.21.15.162:3300/0 conn(0x7fb6040d2af0 0x7fb6040d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.353+0000 7fb603400640 1 --2- 172.21.15.7:0/1933015858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e740 0x7fb60415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.354+0000 7fb602a00640 1 -- 172.21.15.7:0/1933015858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e740 msgr2=0x7fb60415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.354+0000 7fb602a00640 1 --2- 172.21.15.7:0/1933015858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e740 0x7fb60415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.354+0000 7fb602a00640 1 -- 172.21.15.7:0/1933015858 >> v2:172.21.15.162:3300/0 conn(0x7fb6040d2af0 msgr2=0x7fb6040d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.354+0000 7fb602a00640 1 --2- 172.21.15.7:0/1933015858 >> v2:172.21.15.162:3300/0 conn(0x7fb6040d2af0 0x7fb6040d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.354+0000 7fb602a00640 1 -- 172.21.15.7:0/1933015858 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040b3d60 con 0x7fb60415e360 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.354+0000 7fb603400640 1 --2- 172.21.15.7:0/1933015858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e740 0x7fb60415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.355+0000 7fb602a00640 1 --2- 172.21.15.7:0/1933015858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb60415e360 0x7fb60415fab0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fb60408db80 tx=0x7fb5f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d2b975afd16482 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.355+0000 7fb601600640 1 -- 172.21.15.7:0/1933015858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4037070 con 0x7fb60415e360 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.355+0000 7fb601600640 1 -- 172.21.15.7:0/1933015858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f4032440 con 0x7fb60415e360 2024-08-19T00:48:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.355+0000 7fb601600640 1 -- 172.21.15.7:0/1933015858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4032810 con 0x7fb60415e360 2024-08-19T00:48:45.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 -- 172.21.15.7:0/1933015858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb60415e360 msgr2=0x7fb60415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 --2- 172.21.15.7:0/1933015858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb60415e360 0x7fb60415fab0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fb60408db80 tx=0x7fb5f402a1e0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 -- 172.21.15.7:0/1933015858 shutdown_connections 2024-08-19T00:48:45.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 --2- 172.21.15.7:0/1933015858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e740 0x7fb60415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 --2- 172.21.15.7:0/1933015858 >> v2:172.21.15.162:3300/0 conn(0x7fb6040d2af0 0x7fb6040d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 --2- 172.21.15.7:0/1933015858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb60415e360 0x7fb60415fab0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 -- 172.21.15.7:0/1933015858 >> 172.21.15.7:0/1933015858 conn(0x7fb60408dbf0 msgr2=0x7fb60409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 -- 172.21.15.7:0/1933015858 shutdown_connections 2024-08-19T00:48:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.356+0000 7fb603e00640 1 -- 172.21.15.7:0/1933015858 wait complete. 2024-08-19T00:48:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.357+0000 7fb603e00640 1 Processor -- start 2024-08-19T00:48:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.358+0000 7fb603e00640 1 -- start start 2024-08-19T00:48:45.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.358+0000 7fb603e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6040d2af0 0x7fb6040cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.358+0000 7fb603e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e360 0x7fb60406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.358+0000 7fb603e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60415e740 0x7fb60406db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.358+0000 7fb603e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb60415f0f0 con 0x7fb6040d2af0 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.358+0000 7fb603e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040d2300 con 0x7fb60415e740 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.358+0000 7fb603e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb6040b4560 con 0x7fb60415e360 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6040d2af0 0x7fb6040cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6040d2af0 0x7fb6040cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57542/0 (socket says 172.21.15.7:57542) 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 -- 172.21.15.7:0/1414261154 learned_addr learned my addr 172.21.15.7:0/1414261154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb603400640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60415e740 0x7fb60406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602000640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e360 0x7fb60406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 -- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e360 msgr2=0x7fb60406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e360 0x7fb60406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 -- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60415e740 msgr2=0x7fb60406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60415e740 0x7fb60406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 -- 172.21.15.7:0/1414261154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040b7190 con 0x7fb6040d2af0 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb603400640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60415e740 0x7fb60406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.359+0000 7fb602a00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6040d2af0 0x7fb6040cb360 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fb5f402a220 tx=0x7fb5f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.360+0000 7fb5fb400640 1 -- 172.21.15.7:0/1414261154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4037040 con 0x7fb6040d2af0 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.360+0000 7fb5fb400640 1 -- 172.21.15.7:0/1414261154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f4042070 con 0x7fb6040d2af0 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.360+0000 7fb5fb400640 1 -- 172.21.15.7:0/1414261154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4030880 con 0x7fb6040d2af0 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.360+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6040b7470 con 0x7fb6040d2af0 2024-08-19T00:48:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.360+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6040b7a30 con 0x7fb6040d2af0 2024-08-19T00:48:45.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.361+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6040d3c20 con 0x7fb6040d2af0 2024-08-19T00:48:45.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.362+0000 7fb5fb400640 1 -- 172.21.15.7:0/1414261154 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5f4030a20 con 0x7fb6040d2af0 2024-08-19T00:48:45.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.363+0000 7fb5fb400640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5e406be80 0x7fb5e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.363+0000 7fb5fb400640 1 -- 172.21.15.7:0/1414261154 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4857+0+0 (secure 0 0 0) 0x7fb5f40ab380 con 0x7fb6040d2af0 2024-08-19T00:48:45.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.363+0000 7fb602000640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5e406be80 0x7fb5e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.364+0000 7fb602000640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5e406be80 0x7fb5e406e340 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb6040d0bc0 tx=0x7fb5f0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.367+0000 7fb5fb400640 1 -- 172.21.15.7:0/1414261154 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb5f407a060 con 0x7fb6040d2af0 2024-08-19T00:48:45.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.618+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb60415ebb0 con 0x7fb6040d2af0 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.619+0000 7fb5fb400640 1 -- 172.21.15.7:0/1414261154 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fb5f4079960 con 0x7fb6040d2af0 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm6dCXBhAApP0wymGxossV3ZnWs/iF9g==", 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:48:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlzdrGhAAx/MmD+Nc6VoWbBoot16MpA==", 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmFOlyEBAAwv8ACyiE5sJhqTVfCPCeGQ==", 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8JmlD1JJBAA1JwOLPYdKCKOW60/cEzuTA==", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB2k8Jmg1lIFxAAQi8bHS7VI+rJf3CC1T4JGA==", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB5k8JmOU+MGxAAD+d3rEYeqZH4mhvt8BEOeQ==", 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB8k8Jmu+g2IBAAiCOhUs5RhrkPQN1aJaUTgQ==", 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB/k8Jm9CswJRAAyXwcoY2wWSVIPb4UgoN73w==", 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCFk8JmMuzNHRAAQjNSBF8s1+avy66duHkAqg==", 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCIk8JmRrIoIxAAFg4kF9ItGarTLVGWfaZ9DQ==", 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCLk8JmyIYnKBAAn99ESJpS9rmDFbMSYilBeA==", 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQCOk8JmgiS2LBAAahqvrQm7m7as6G5ZfN44IA==", 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA==", 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm9MYCOhAAFov4jKwLzP//unLViA7UqA==", 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB0k8Jm5L11MxAAOFQO6uWaxmu6WDFbeyrjuQ==", 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQB1k8JmAvHoBBAArL0ADWbfnEtOLrOzeMWfhg==", 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-08-19T00:48:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8Jmuq0sEBAA7n5q8IKlS3tRogqIwCSCeQ==", 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmqxuAOxAAhA3lGjO4kpHGHOvaL+7DnQ==", 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-08-19T00:48:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQBzk8JmFQSnMhAA2aEv+OtmIrUBR88jbbXklg==", 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-08-19T00:48:45.635 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:48:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5e406be80 msgr2=0x7fb5e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5e406be80 0x7fb5e406e340 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb6040d0bc0 tx=0x7fb5f0008040 comp rx=0 tx=0).stop 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6040d2af0 msgr2=0x7fb6040cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6040d2af0 0x7fb6040cb360 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fb5f402a220 tx=0x7fb5f40046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 shutdown_connections 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb5e406be80 0x7fb5e406e340 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60415e740 0x7fb60406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb60415e360 0x7fb60406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 --2- 172.21.15.7:0/1414261154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6040d2af0 0x7fb6040cb360 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 >> 172.21.15.7:0/1414261154 conn(0x7fb60408dbf0 msgr2=0x7fb6040b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 shutdown_connections 2024-08-19T00:48:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.621+0000 7fb603e00640 1 -- 172.21.15.7:0/1414261154 wait complete. 2024-08-19T00:48:45.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-19T00:48:45.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.793+0000 7f61df600640 1 Processor -- start 2024-08-19T00:48:45.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.794+0000 7f61df600640 1 -- start start 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61df600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61d80d03c0 0x7f61d8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61df600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61df600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80cdfb0 con 0x7f61d806e710 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61df600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f61d80cebc0 con 0x7f61d80d03c0 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61df600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61d80ce290 con 0x7f61d80b3750 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dcc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61d80d03c0 0x7f61d8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dcc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f61d80d03c0 0x7f61d8071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57546/0 (socket says 172.21.15.7:57546) 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dcc00640 1 -- 172.21.15.7:0/1304043289 learned_addr learned my addr 172.21.15.7:0/1304043289 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dd600640 1 --2- 172.21.15.7:0/1304043289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dcc00640 1 -- 172.21.15.7:0/1304043289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 msgr2=0x7f61d80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dcc00640 1 --2- 172.21.15.7:0/1304043289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d80cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dcc00640 1 -- 172.21.15.7:0/1304043289 >> v1:172.21.15.162:6789/0 conn(0x7f61d806e710 legacy=0x7f61d80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.795+0000 7f61dcc00640 1 -- 172.21.15.7:0/1304043289 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80ce570 con 0x7f61d80d03c0 2024-08-19T00:48:45.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.796+0000 7f61dcc00640 1 --2- 172.21.15.7:0/1304043289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d80d03c0 0x7f61d8071980 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0098a0 tx=0x7f61cc02c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67d3e5e572231ca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61d7400640 1 -- 172.21.15.7:0/1304043289 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc038070 con 0x7f61d80d03c0 2024-08-19T00:48:45.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61d7400640 1 -- 172.21.15.7:0/1304043289 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc031710 con 0x7f61d80d03c0 2024-08-19T00:48:45.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61d7400640 1 -- 172.21.15.7:0/1304043289 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc031ae0 con 0x7f61d80d03c0 2024-08-19T00:48:45.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61df600640 1 -- 172.21.15.7:0/1304043289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d80d03c0 msgr2=0x7f61d8071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61df600640 1 --2- 172.21.15.7:0/1304043289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d80d03c0 0x7f61d8071980 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0098a0 tx=0x7f61cc02c460 comp rx=0 tx=0).stop 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61df600640 1 -- 172.21.15.7:0/1304043289 shutdown_connections 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61df600640 1 --2- 172.21.15.7:0/1304043289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d80cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61df600640 1 --2- 172.21.15.7:0/1304043289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d80d03c0 0x7f61d8071980 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61df600640 1 -- 172.21.15.7:0/1304043289 >> 172.21.15.7:0/1304043289 conn(0x7f61d806bc70 msgr2=0x7f61d806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.797+0000 7f61df600640 1 -- 172.21.15.7:0/1304043289 shutdown_connections 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.798+0000 7f61df600640 1 -- 172.21.15.7:0/1304043289 wait complete. 2024-08-19T00:48:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.799+0000 7f61df600640 1 Processor -- start 2024-08-19T00:48:45.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.799+0000 7f61df600640 1 -- start start 2024-08-19T00:48:45.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61df600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d806e710 0x7f61d80ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61df600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d8154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61df600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d80d03c0 0x7f61d80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61df600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8073c60 con 0x7f61d806e710 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61df600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8073ae0 con 0x7f61d80d03c0 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61df600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61d80b3be0 con 0x7f61d80b3750 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61dcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d806e710 0x7f61d80ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61dcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d806e710 0x7f61d80ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57552/0 (socket says 172.21.15.7:57552) 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.800+0000 7f61dcc00640 1 -- 172.21.15.7:0/2640239425 learned_addr learned my addr 172.21.15.7:0/2640239425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61d7e00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d8154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dd600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d80d03c0 0x7f61d80ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dcc00640 1 -- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 msgr2=0x7f61d8154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dcc00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d8154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dcc00640 1 -- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d80d03c0 msgr2=0x7f61d80ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dcc00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d80d03c0 0x7f61d80ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dcc00640 1 -- 172.21.15.7:0/2640239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d81e5d10 con 0x7f61d806e710 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dd600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d80d03c0 0x7f61d80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61d7e00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d8154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61dcc00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d806e710 0x7f61d80ae830 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f61cc000c00 tx=0x7f61cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61d4c00640 1 -- 172.21.15.7:0/2640239425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc038040 con 0x7f61d806e710 2024-08-19T00:48:45.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61d4c00640 1 -- 172.21.15.7:0/2640239425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc004030 con 0x7f61d806e710 2024-08-19T00:48:45.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d81e5ff0 con 0x7f61d806e710 2024-08-19T00:48:45.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.801+0000 7f61d4c00640 1 -- 172.21.15.7:0/2640239425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc004400 con 0x7f61d806e710 2024-08-19T00:48:45.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.802+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d815dbc0 con 0x7f61d806e710 2024-08-19T00:48:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.802+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d8071980 con 0x7f61d806e710 2024-08-19T00:48:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.803+0000 7f61d4c00640 1 -- 172.21.15.7:0/2640239425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61cc0337b0 con 0x7f61d806e710 2024-08-19T00:48:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.804+0000 7f61d4c00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be30 0x7f61b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.804+0000 7f61d4c00640 1 -- 172.21.15.7:0/2640239425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4857+0+0 (secure 0 0 0) 0x7f61cc0ab5f0 con 0x7f61d806e710 2024-08-19T00:48:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.805+0000 7f61d7e00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be30 0x7f61b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.805+0000 7f61d7e00640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be30 0x7f61b806e2f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f61d8158ed0 tx=0x7f61c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.808+0000 7f61d4c00640 1 -- 172.21.15.7:0/2640239425 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f61cc07a250 con 0x7f61d806e710 2024-08-19T00:48:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.995+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f61d815de00 con 0x7f61d806e710 2024-08-19T00:48:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.996+0000 7f61d4c00640 1 -- 172.21.15.7:0/2640239425 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) ==== 84+0+65 (secure 0 0 0) 0x7f61cc079b50 con 0x7f61d806e710 2024-08-19T00:48:45.998 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:45.998 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-08-19T00:48:45.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-08-19T00:48:45.998 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-08-19T00:48:45.998 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-08-19T00:48:45.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-19T00:48:45.999 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-08-19T00:48:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be30 msgr2=0x7f61b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be30 0x7f61b806e2f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f61d8158ed0 tx=0x7f61c4008040 comp rx=0 tx=0).stop 2024-08-19T00:48:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d806e710 msgr2=0x7f61d80ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d806e710 0x7f61d80ae830 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f61cc000c00 tx=0x7f61cc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 shutdown_connections 2024-08-19T00:48:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f61b806be30 0x7f61b806e2f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d80d03c0 0x7f61d80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d80b3750 0x7f61d8154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 --2- 172.21.15.7:0/2640239425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61d806e710 0x7f61d80ae830 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 >> 172.21.15.7:0/2640239425 conn(0x7f61d806bc70 msgr2=0x7f61d80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 shutdown_connections 2024-08-19T00:48:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:45.998+0000 7f61df600640 1 -- 172.21.15.7:0/2640239425 wait complete. 2024-08-19T00:48:46.015 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:48:46.015 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:48:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.179+0000 7efd0f200640 1 Processor -- start 2024-08-19T00:48:46.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.179+0000 7efd0f200640 1 -- start start 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd1015de20 0x7efd100d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efd10161cb0 0x7efd100b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd100b5180 con 0x7efd100b4d30 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7efd100b4360 con 0x7efd1015de20 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efd10162b80 con 0x7efd10161cb0 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd1015de20 0x7efd100d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0e800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efd100b4d30 0x7efd100d3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48770/0 (socket says 172.21.15.7:48770) 2024-08-19T00:48:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.180+0000 7efd0e800640 1 -- 172.21.15.7:0/1961400311 learned_addr learned my addr 172.21.15.7:0/1961400311 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.181+0000 7efd0de00640 1 -- 172.21.15.7:0/1961400311 >> v2:172.21.15.162:3300/0 conn(0x7efd10161cb0 msgr2=0x7efd100b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.181+0000 7efd07e00640 1 --2- 172.21.15.7:0/1961400311 >> v2:172.21.15.162:3300/0 conn(0x7efd10161cb0 0x7efd100b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.181+0000 7efd0de00640 1 --2- 172.21.15.7:0/1961400311 >> v2:172.21.15.162:3300/0 conn(0x7efd10161cb0 0x7efd100b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.181+0000 7efd0de00640 1 -- 172.21.15.7:0/1961400311 >> v1:172.21.15.7:6789/0 conn(0x7efd100b4d30 legacy=0x7efd100d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.181+0000 7efd0de00640 1 -- 172.21.15.7:0/1961400311 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd100b4010 con 0x7efd1015de20 2024-08-19T00:48:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.181+0000 7efd0d400640 1 -- 172.21.15.7:0/1961400311 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200651905 0 0) 0x7efd08001490 con 0x7efd100b4d30 2024-08-19T00:48:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.181+0000 7efd07e00640 1 --2- 172.21.15.7:0/1961400311 >> v2:172.21.15.162:3300/0 conn(0x7efd10161cb0 0x7efd100b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.182+0000 7efd0de00640 1 --2- 172.21.15.7:0/1961400311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1015de20 0x7efd100d0b50 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7efd100d08d0 tx=0x7efd0002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294228aec7f1bb8f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:46.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.183+0000 7efd0d400640 1 -- 172.21.15.7:0/1961400311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00037070 con 0x7efd1015de20 2024-08-19T00:48:46.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.183+0000 7efd0d400640 1 -- 172.21.15.7:0/1961400311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00032440 con 0x7efd1015de20 2024-08-19T00:48:46.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.183+0000 7efd0d400640 1 -- 172.21.15.7:0/1961400311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00032810 con 0x7efd1015de20 2024-08-19T00:48:46.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 -- 172.21.15.7:0/1961400311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1015de20 msgr2=0x7efd100d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:46.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 --2- 172.21.15.7:0/1961400311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1015de20 0x7efd100d0b50 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7efd100d08d0 tx=0x7efd0002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 -- 172.21.15.7:0/1961400311 shutdown_connections 2024-08-19T00:48:46.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 --2- 172.21.15.7:0/1961400311 >> v2:172.21.15.162:3300/0 conn(0x7efd10161cb0 0x7efd100b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 --2- 172.21.15.7:0/1961400311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1015de20 0x7efd100d0b50 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 -- 172.21.15.7:0/1961400311 >> 172.21.15.7:0/1961400311 conn(0x7efd1008dbe0 msgr2=0x7efd1009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:46.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 -- 172.21.15.7:0/1961400311 shutdown_connections 2024-08-19T00:48:46.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.184+0000 7efd0f200640 1 -- 172.21.15.7:0/1961400311 wait complete. 2024-08-19T00:48:46.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.186+0000 7efd0f200640 1 Processor -- start 2024-08-19T00:48:46.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.186+0000 7efd0f200640 1 -- start start 2024-08-19T00:48:46.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd100b4d30 0x7efd100cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:46.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd1015de20 0x7efd100b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:46.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd10161cb0 0x7efd1015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:46.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd100d1960 con 0x7efd100b4d30 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd100d1680 con 0x7efd10161cb0 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd100d1090 con 0x7efd1015de20 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd100b4d30 0x7efd100cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd100b4d30 0x7efd100cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57572/0 (socket says 172.21.15.7:57572) 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 -- 172.21.15.7:0/1363512179 learned_addr learned my addr 172.21.15.7:0/1363512179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd07e00640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd1015de20 0x7efd100b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0e800640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd10161cb0 0x7efd1015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 -- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd1015de20 msgr2=0x7efd100b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd1015de20 0x7efd100b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 -- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd10161cb0 msgr2=0x7efd1015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd10161cb0 0x7efd1015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0de00640 1 -- 172.21.15.7:0/1363512179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd100b1690 con 0x7efd100b4d30 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.187+0000 7efd0e800640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd10161cb0 0x7efd1015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.188+0000 7efd0de00640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd100b4d30 0x7efd100cb2a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7efd00000c00 tx=0x7efd000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.188+0000 7efd06000640 1 -- 172.21.15.7:0/1363512179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00037040 con 0x7efd100b4d30 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.188+0000 7efd06000640 1 -- 172.21.15.7:0/1363512179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00042070 con 0x7efd100b4d30 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.188+0000 7efd06000640 1 -- 172.21.15.7:0/1363512179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00030a50 con 0x7efd100b4d30 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.188+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd100b1970 con 0x7efd100b4d30 2024-08-19T00:48:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.188+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd100b2240 con 0x7efd100b4d30 2024-08-19T00:48:46.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.189+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd100d0b50 con 0x7efd100b4d30 2024-08-19T00:48:46.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.190+0000 7efd06000640 1 -- 172.21.15.7:0/1363512179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd00030bf0 con 0x7efd100b4d30 2024-08-19T00:48:46.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.191+0000 7efd06000640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcec06be30 0x7efcec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.191+0000 7efd06000640 1 -- 172.21.15.7:0/1363512179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4857+0+0 (secure 0 0 0) 0x7efd000ab500 con 0x7efd100b4d30 2024-08-19T00:48:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.191+0000 7efd07e00640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcec06be30 0x7efcec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.192+0000 7efd07e00640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcec06be30 0x7efcec06e2f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efd100d0330 tx=0x7efcf8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.195+0000 7efd06000640 1 -- 172.21.15.7:0/1363512179 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efd0007a1f0 con 0x7efd100b4d30 2024-08-19T00:48:46.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:46.382+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efd1006d1b0 con 0x7efd100b4d30 2024-08-19T00:48:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.184+0000 7efd06000640 1 -- 172.21.15.7:0/1363512179 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) ==== 138+0+0 (secure 0 0 0) 0x7efd00079af0 con 0x7efd100b4d30 2024-08-19T00:48:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-08-19T00:48:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcec06be30 msgr2=0x7efcec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcec06be30 0x7efcec06e2f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efd100d0330 tx=0x7efcf8008040 comp rx=0 tx=0).stop 2024-08-19T00:48:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd100b4d30 msgr2=0x7efd100cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd100b4d30 0x7efd100cb2a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7efd00000c00 tx=0x7efd000046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 shutdown_connections 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efcec06be30 0x7efcec06e2f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd10161cb0 0x7efd1015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd1015de20 0x7efd100b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 --2- 172.21.15.7:0/1363512179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd100b4d30 0x7efd100cb2a0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 >> 172.21.15.7:0/1363512179 conn(0x7efd1008dbe0 msgr2=0x7efd100ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.187+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 shutdown_connections 2024-08-19T00:48:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.188+0000 7efd0f200640 1 -- 172.21.15.7:0/1363512179 wait complete. 2024-08-19T00:48:47.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:48:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.379+0000 7f9757c00640 1 Processor -- start 2024-08-19T00:48:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.379+0000 7f9757c00640 1 -- start start 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.380+0000 7f9757c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9750158cd0 0x7f9750072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.380+0000 7f9757c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9750072ff0 0x7f97500add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.380+0000 7f9757c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97500ae2b0 0x7f975015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.380+0000 7f9757c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9750073460 con 0x7f9750158cd0 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.380+0000 7f9757c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f97500aeae0 con 0x7f9750072ff0 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.380+0000 7f9757c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97500aedc0 con 0x7f97500ae2b0 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9750158cd0 0x7f9750072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9750158cd0 0x7f9750072ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57582/0 (socket says 172.21.15.7:57582) 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 -- 172.21.15.7:0/440919033 learned_addr learned my addr 172.21.15.7:0/440919033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9747e00640 1 --2- 172.21.15.7:0/440919033 >> v2:172.21.15.162:3300/0 conn(0x7f9750072ff0 0x7f97500add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755c00640 1 --2- 172.21.15.7:0/440919033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97500ae2b0 0x7f975015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 -- 172.21.15.7:0/440919033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97500ae2b0 msgr2=0x7f975015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 --2- 172.21.15.7:0/440919033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97500ae2b0 0x7f975015ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 -- 172.21.15.7:0/440919033 >> v2:172.21.15.162:3300/0 conn(0x7f9750072ff0 msgr2=0x7f97500add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 --2- 172.21.15.7:0/440919033 >> v2:172.21.15.162:3300/0 conn(0x7f9750072ff0 0x7f97500add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.381+0000 7f9755200640 1 -- 172.21.15.7:0/440919033 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97500af0a0 con 0x7f9750158cd0 2024-08-19T00:48:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.382+0000 7f9755200640 1 --2- 172.21.15.7:0/440919033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9750158cd0 0x7f9750072ab0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f97500cfa40 tx=0x7f974002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4621880c6e5107a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.382+0000 7f974fe00640 1 -- 172.21.15.7:0/440919033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740037070 con 0x7f9750158cd0 2024-08-19T00:48:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.382+0000 7f974fe00640 1 -- 172.21.15.7:0/440919033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9740032440 con 0x7f9750158cd0 2024-08-19T00:48:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.382+0000 7f974fe00640 1 -- 172.21.15.7:0/440919033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740032810 con 0x7f9750158cd0 2024-08-19T00:48:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 -- 172.21.15.7:0/440919033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9750158cd0 msgr2=0x7f9750072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 --2- 172.21.15.7:0/440919033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9750158cd0 0x7f9750072ab0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f97500cfa40 tx=0x7f974002a140 comp rx=0 tx=0).stop 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 -- 172.21.15.7:0/440919033 shutdown_connections 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 --2- 172.21.15.7:0/440919033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97500ae2b0 0x7f975015ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 --2- 172.21.15.7:0/440919033 >> v2:172.21.15.162:3300/0 conn(0x7f9750072ff0 0x7f97500add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 --2- 172.21.15.7:0/440919033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9750158cd0 0x7f9750072ab0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 -- 172.21.15.7:0/440919033 >> 172.21.15.7:0/440919033 conn(0x7f97500b2300 msgr2=0x7f975006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 -- 172.21.15.7:0/440919033 shutdown_connections 2024-08-19T00:48:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.383+0000 7f9757c00640 1 -- 172.21.15.7:0/440919033 wait complete. 2024-08-19T00:48:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.385+0000 7f9757c00640 1 Processor -- start 2024-08-19T00:48:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.385+0000 7f9757c00640 1 -- start start 2024-08-19T00:48:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9757c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9750072ff0 0x7f975006f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9757c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500ae2b0 0x7f975009c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9757c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975009c880 0x7f975014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9757c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97500ae740 con 0x7f975009c880 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9757c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97500af660 con 0x7f97500ae2b0 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9757c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97500ae8c0 con 0x7f9750072ff0 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975009c880 0x7f975014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975009c880 0x7f975014e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57594/0 (socket says 172.21.15.7:57594) 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 -- 172.21.15.7:0/459262746 learned_addr learned my addr 172.21.15.7:0/459262746 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9747e00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500ae2b0 0x7f975009c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755200640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9750072ff0 0x7f975006f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 -- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9750072ff0 msgr2=0x7f975006f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9750072ff0 0x7f975006f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 -- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500ae2b0 msgr2=0x7f975009c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500ae2b0 0x7f975009c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9755c00640 1 -- 172.21.15.7:0/459262746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97501f3a90 con 0x7f975009c880 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.386+0000 7f9747e00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500ae2b0 0x7f975009c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.387+0000 7f9755c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975009c880 0x7f975014e1d0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f9748007e40 tx=0x7f974800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.387+0000 7f974d600640 1 -- 172.21.15.7:0/459262746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748014620 con 0x7f975009c880 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.387+0000 7f974d600640 1 -- 172.21.15.7:0/459262746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9748019070 con 0x7f975009c880 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.387+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97501f3d70 con 0x7f975009c880 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.387+0000 7f974d600640 1 -- 172.21.15.7:0/459262746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748014a20 con 0x7f975009c880 2024-08-19T00:48:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.387+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97501f4330 con 0x7f975009c880 2024-08-19T00:48:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.388+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97500add70 con 0x7f975009c880 2024-08-19T00:48:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.389+0000 7f974d600640 1 -- 172.21.15.7:0/459262746 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9748014bc0 con 0x7f975009c880 2024-08-19T00:48:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.390+0000 7f974d600640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f972c06be60 0x7f972c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.390+0000 7f974d600640 1 -- 172.21.15.7:0/459262746 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5227+0+0 (secure 0 0 0) 0x7f974808c2e0 con 0x7f975009c880 2024-08-19T00:48:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.391+0000 7f9755200640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f972c06be60 0x7f972c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.391+0000 7f9755200640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f972c06be60 0x7f972c06e320 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9740034000 tx=0x7f974002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.394+0000 7f974d600640 1 -- 172.21.15.7:0/459262746 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f974805aee0 con 0x7f975009c880 2024-08-19T00:48:47.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:47.579+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f97500cfd30 con 0x7f975009c880 2024-08-19T00:48:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.190+0000 7f974d600640 1 -- 172.21.15.7:0/459262746 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) ==== 170+0+0 (secure 0 0 0) 0x7f974805a7e0 con 0x7f975009c880 2024-08-19T00:48:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-08-19T00:48:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f972c06be60 msgr2=0x7f972c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f972c06be60 0x7f972c06e320 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9740034000 tx=0x7f974002e000 comp rx=0 tx=0).stop 2024-08-19T00:48:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975009c880 msgr2=0x7f975014e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975009c880 0x7f975014e1d0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f9748007e40 tx=0x7f974800e4b0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 shutdown_connections 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f972c06be60 0x7f972c06e320 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975009c880 0x7f975014e1d0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500ae2b0 0x7f975009c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 --2- 172.21.15.7:0/459262746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9750072ff0 0x7f975006f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 >> 172.21.15.7:0/459262746 conn(0x7f97500b2300 msgr2=0x7f97500b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 shutdown_connections 2024-08-19T00:48:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.194+0000 7f9757c00640 1 -- 172.21.15.7:0/459262746 wait complete. 2024-08-19T00:48:48.223 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:48:48.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.383+0000 7f89faa00640 1 Processor -- start 2024-08-19T00:48:48.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.383+0000 7f89faa00640 1 -- start start 2024-08-19T00:48:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.384+0000 7f89faa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f89f40cbc30 0x7f89f40cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.384+0000 7f89faa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f40b6f70 con 0x7f89f406d770 2024-08-19T00:48:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.384+0000 7f89faa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f40b7250 con 0x7f89f40cc570 2024-08-19T00:48:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.384+0000 7f89faa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f89f40cb430 con 0x7f89f40cbc30 2024-08-19T00:48:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f3e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f89f406d770 0x7f89f406db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48784/0 (socket says 172.21.15.7:48784) 2024-08-19T00:48:48.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f3e00640 1 -- 172.21.15.7:0/2493726800 learned_addr learned my addr 172.21.15.7:0/2493726800 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:48.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f3400640 1 --2- 172.21.15.7:0/2493726800 >> v2:172.21.15.7:3300/0 conn(0x7f89f40cbc30 0x7f89f40cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:48.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f2a00640 1 -- 172.21.15.7:0/2493726800 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949731473 0 0) 0x7f89f40b6f70 con 0x7f89f406d770 2024-08-19T00:48:48.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f2a00640 1 -- 172.21.15.7:0/2493726800 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d8003520 con 0x7f89f406d770 2024-08-19T00:48:48.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f3400640 1 -- 172.21.15.7:0/2493726800 >> v1:172.21.15.162:6789/0 conn(0x7f89f40cc570 legacy=0x7f89f4168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:48.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f3400640 1 -- 172.21.15.7:0/2493726800 >> v1:172.21.15.7:6789/0 conn(0x7f89f406d770 legacy=0x7f89f406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:48.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.385+0000 7f89f3400640 1 -- 172.21.15.7:0/2493726800 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f40cb710 con 0x7f89f40cbc30 2024-08-19T00:48:48.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.386+0000 7f89f3400640 1 --2- 172.21.15.7:0/2493726800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cbc30 0x7f89f40cc030 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f89e00097d0 tx=0x7f89e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1273d0f9196a278e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.386+0000 7f89f2a00640 1 -- 172.21.15.7:0/2493726800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0037070 con 0x7f89f40cbc30 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.386+0000 7f89f2a00640 1 -- 172.21.15.7:0/2493726800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e0032440 con 0x7f89f40cbc30 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.386+0000 7f89f2a00640 1 -- 172.21.15.7:0/2493726800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0032810 con 0x7f89f40cbc30 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.387+0000 7f89faa00640 1 -- 172.21.15.7:0/2493726800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cbc30 msgr2=0x7f89f40cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.387+0000 7f89faa00640 1 --2- 172.21.15.7:0/2493726800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cbc30 0x7f89f40cc030 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f89e00097d0 tx=0x7f89e002a270 comp rx=0 tx=0).stop 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.387+0000 7f89faa00640 1 -- 172.21.15.7:0/2493726800 shutdown_connections 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.387+0000 7f89faa00640 1 --2- 172.21.15.7:0/2493726800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cbc30 0x7f89f40cc030 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.387+0000 7f89faa00640 1 -- 172.21.15.7:0/2493726800 >> 172.21.15.7:0/2493726800 conn(0x7f89f40d2180 msgr2=0x7f89f40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.387+0000 7f89faa00640 1 -- 172.21.15.7:0/2493726800 shutdown_connections 2024-08-19T00:48:48.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.387+0000 7f89faa00640 1 -- 172.21.15.7:0/2493726800 wait complete. 2024-08-19T00:48:48.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.389+0000 7f89faa00640 1 Processor -- start 2024-08-19T00:48:48.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.389+0000 7f89faa00640 1 -- start start 2024-08-19T00:48:48.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89faa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89f406d770 0x7f89f41f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:48.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89faa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89f40cbc30 0x7f89f415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:48.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89faa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cc570 0x7f89f4155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:48.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89faa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89f406d370 con 0x7f89f40cc570 2024-08-19T00:48:48.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89faa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89f415ea10 con 0x7f89f406d770 2024-08-19T00:48:48.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89faa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89f40d2ca0 con 0x7f89f40cbc30 2024-08-19T00:48:48.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cc570 0x7f89f4155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cc570 0x7f89f4155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57618/0 (socket says 172.21.15.7:57618) 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 -- 172.21.15.7:0/4013068496 learned_addr learned my addr 172.21.15.7:0/4013068496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f3e00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89f406d770 0x7f89f41f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f3400640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89f40cbc30 0x7f89f415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 -- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89f40cbc30 msgr2=0x7f89f415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89f40cbc30 0x7f89f415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 -- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89f406d770 msgr2=0x7f89f41f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:48.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89f406d770 0x7f89f41f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:48.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.390+0000 7f89f8a00640 1 -- 172.21.15.7:0/4013068496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f41f4ca0 con 0x7f89f40cc570 2024-08-19T00:48:48.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.391+0000 7f89f8a00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cc570 0x7f89f4155c60 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c6b0 tx=0x7f89ec00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:48.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.391+0000 7f89ebe00640 1 -- 172.21.15.7:0/4013068496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec003b70 con 0x7f89f40cc570 2024-08-19T00:48:48.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.391+0000 7f89ebe00640 1 -- 172.21.15.7:0/4013068496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec003d30 con 0x7f89f40cc570 2024-08-19T00:48:48.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.391+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f41f4f80 con 0x7f89f40cc570 2024-08-19T00:48:48.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.391+0000 7f89ebe00640 1 -- 172.21.15.7:0/4013068496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec005310 con 0x7f89f40cc570 2024-08-19T00:48:48.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.391+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f41f5540 con 0x7f89f40cc570 2024-08-19T00:48:48.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.392+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f409ba80 con 0x7f89f40cc570 2024-08-19T00:48:48.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.393+0000 7f89ebe00640 1 -- 172.21.15.7:0/4013068496 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89ec0054b0 con 0x7f89f40cc570 2024-08-19T00:48:48.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.394+0000 7f89ebe00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89d406be30 0x7f89d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:48.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.394+0000 7f89ebe00640 1 -- 172.21.15.7:0/4013068496 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5609+0+0 (secure 0 0 0) 0x7f89ec08acc0 con 0x7f89f40cc570 2024-08-19T00:48:48.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.394+0000 7f89f3e00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89d406be30 0x7f89d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:48.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.395+0000 7f89f3e00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89d406be30 0x7f89d406e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f89e40011e0 tx=0x7f89e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:48.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.399+0000 7f89ebe00640 1 -- 172.21.15.7:0/4013068496 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f89ec091080 con 0x7f89f40cc570 2024-08-19T00:48:48.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:48.619+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f89f40b3b90 con 0x7f89f40cc570 2024-08-19T00:48:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.193+0000 7f89ebe00640 1 -- 172.21.15.7:0/4013068496 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v342) ==== 174+0+0 (secure 0 0 0) 0x7f89ec0596c0 con 0x7f89f40cc570 2024-08-19T00:48:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 14 and data pool 15 2024-08-19T00:48:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.196+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89d406be30 msgr2=0x7f89d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.196+0000 7f89faa00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89d406be30 0x7f89d406e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f89e40011e0 tx=0x7f89e4009040 comp rx=0 tx=0).stop 2024-08-19T00:48:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.196+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cc570 msgr2=0x7f89f4155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.196+0000 7f89faa00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cc570 0x7f89f4155c60 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c6b0 tx=0x7f89ec00cb70 comp rx=0 tx=0).stop 2024-08-19T00:48:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.197+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 shutdown_connections 2024-08-19T00:48:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.197+0000 7f89faa00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f89d406be30 0x7f89d406e2f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.197+0000 7f89faa00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f40cc570 0x7f89f4155c60 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.197+0000 7f89faa00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89f40cbc30 0x7f89f415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.197+0000 7f89faa00640 1 --2- 172.21.15.7:0/4013068496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89f406d770 0x7f89f41f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.197+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 >> 172.21.15.7:0/4013068496 conn(0x7f89f40d2180 msgr2=0x7f89f406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.197+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 shutdown_connections 2024-08-19T00:48:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.198+0000 7f89faa00640 1 -- 172.21.15.7:0/4013068496 wait complete. 2024-08-19T00:48:49.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:48:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.396+0000 7efe28c00640 1 Processor -- start 2024-08-19T00:48:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.396+0000 7efe28c00640 1 -- start start 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.397+0000 7efe28c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe24159bf0 0x7efe24073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.397+0000 7efe28c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe240739a0 0x7efe240ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.397+0000 7efe28c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe2406f7f0 con 0x7efe240cea40 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.397+0000 7efe28c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7efe2406f510 con 0x7efe24159bf0 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.397+0000 7efe28c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe24072980 con 0x7efe240739a0 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe21e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe24159bf0 0x7efe24073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe21e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe24159bf0 0x7efe24073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57630/0 (socket says 172.21.15.7:57630) 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe21e00640 1 -- 172.21.15.7:0/3921784674 learned_addr learned my addr 172.21.15.7:0/3921784674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe19400640 1 --2- 172.21.15.7:0/3921784674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe240739a0 0x7efe240ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe21e00640 1 -- 172.21.15.7:0/3921784674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe240739a0 msgr2=0x7efe240ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe21e00640 1 --2- 172.21.15.7:0/3921784674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe240739a0 0x7efe240ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe21e00640 1 -- 172.21.15.7:0/3921784674 >> v1:172.21.15.162:6789/0 conn(0x7efe240cea40 legacy=0x7efe240d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.398+0000 7efe21e00640 1 -- 172.21.15.7:0/3921784674 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe24072c60 con 0x7efe24159bf0 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.399+0000 7efe21e00640 1 --2- 172.21.15.7:0/3921784674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24159bf0 0x7efe24073460 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7efe14009e50 tx=0x7efe1402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb966764d08be78 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.399+0000 7efe21400640 1 -- 172.21.15.7:0/3921784674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14036070 con 0x7efe24159bf0 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe21400640 1 -- 172.21.15.7:0/3921784674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe14031600 con 0x7efe24159bf0 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe21400640 1 -- 172.21.15.7:0/3921784674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140319d0 con 0x7efe24159bf0 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 -- 172.21.15.7:0/3921784674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24159bf0 msgr2=0x7efe24073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 --2- 172.21.15.7:0/3921784674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24159bf0 0x7efe24073460 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7efe14009e50 tx=0x7efe1402a630 comp rx=0 tx=0).stop 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 -- 172.21.15.7:0/3921784674 shutdown_connections 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 --2- 172.21.15.7:0/3921784674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe240739a0 0x7efe240ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 --2- 172.21.15.7:0/3921784674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24159bf0 0x7efe24073460 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 -- 172.21.15.7:0/3921784674 >> 172.21.15.7:0/3921784674 conn(0x7efe2406bc70 msgr2=0x7efe2406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 -- 172.21.15.7:0/3921784674 shutdown_connections 2024-08-19T00:48:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.400+0000 7efe28c00640 1 -- 172.21.15.7:0/3921784674 wait complete. 2024-08-19T00:48:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.402+0000 7efe28c00640 1 Processor -- start 2024-08-19T00:48:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.402+0000 7efe28c00640 1 -- start start 2024-08-19T00:48:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe28c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe240739a0 0x7efe2414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe28c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe240cea40 0x7efe240b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe28c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe24159bf0 0x7efe2414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe28c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe2415a150 con 0x7efe240739a0 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe28c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe24159fd0 con 0x7efe240cea40 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe28c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe240d0ad0 con 0x7efe24159bf0 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe21e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe240739a0 0x7efe2414c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe21e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe240739a0 0x7efe2414c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57644/0 (socket says 172.21.15.7:57644) 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.403+0000 7efe21e00640 1 -- 172.21.15.7:0/2641891884 learned_addr learned my addr 172.21.15.7:0/2641891884 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe19400640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe240cea40 0x7efe240b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe22800640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe24159bf0 0x7efe2414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe21e00640 1 -- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe24159bf0 msgr2=0x7efe2414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe21e00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe24159bf0 0x7efe2414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe21e00640 1 -- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe240cea40 msgr2=0x7efe240b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe21e00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe240cea40 0x7efe240b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe21e00640 1 -- 172.21.15.7:0/2641891884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe240b3a60 con 0x7efe240739a0 2024-08-19T00:48:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe21e00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe240739a0 0x7efe2414c620 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7efe14009e50 tx=0x7efe14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe1aa00640 1 -- 172.21.15.7:0/2641891884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14036050 con 0x7efe240739a0 2024-08-19T00:48:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe1aa00640 1 -- 172.21.15.7:0/2641891884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe14042070 con 0x7efe240739a0 2024-08-19T00:48:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe1aa00640 1 -- 172.21.15.7:0/2641891884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14009510 con 0x7efe240739a0 2024-08-19T00:48:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.404+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe240b3d40 con 0x7efe240739a0 2024-08-19T00:48:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.405+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe240b4300 con 0x7efe240739a0 2024-08-19T00:48:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.405+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe240ce500 con 0x7efe240739a0 2024-08-19T00:48:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.407+0000 7efe1aa00640 1 -- 172.21.15.7:0/2641891884 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe14007c50 con 0x7efe240739a0 2024-08-19T00:48:49.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.407+0000 7efe1aa00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe0006be30 0x7efe0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.407+0000 7efe1aa00640 1 -- 172.21.15.7:0/2641891884 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7efe140abd70 con 0x7efe240739a0 2024-08-19T00:48:49.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.408+0000 7efe19400640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe0006be30 0x7efe0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.408+0000 7efe19400640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe0006be30 0x7efe0006e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efe0c006fd0 tx=0x7efe0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.412+0000 7efe1aa00640 1 -- 172.21.15.7:0/2641891884 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efe1407a0c0 con 0x7efe240739a0 2024-08-19T00:48:49.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.597+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe24160750 con 0x7efe240739a0 2024-08-19T00:48:49.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.598+0000 7efe1aa00640 1 -- 172.21.15.7:0/2641891884 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16596 (secure 0 0 0) 0x7efe1407e3c0 con 0x7efe240739a0 2024-08-19T00:48:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:49.600 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":135,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:48.620838+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:48:46.426846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-08-19T00:48:47.623461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe0006be30 msgr2=0x7efe0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe0006be30 0x7efe0006e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efe0c006fd0 tx=0x7efe0c008040 comp rx=0 tx=0).stop 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe240739a0 msgr2=0x7efe2414c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe240739a0 0x7efe2414c620 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7efe14009e50 tx=0x7efe14004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 shutdown_connections 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efe0006be30 0x7efe0006e2f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe24159bf0 0x7efe2414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe240cea40 0x7efe240b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 --2- 172.21.15.7:0/2641891884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe240739a0 0x7efe2414c620 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 >> 172.21.15.7:0/2641891884 conn(0x7efe2406bc70 msgr2=0x7efe24156270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 shutdown_connections 2024-08-19T00:48:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.600+0000 7efe28c00640 1 -- 172.21.15.7:0/2641891884 wait complete. 2024-08-19T00:48:49.619 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:48:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.774+0000 7fd02c200640 1 Processor -- start 2024-08-19T00:48:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.774+0000 7fd02c200640 1 -- start start 2024-08-19T00:48:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.775+0000 7fd02c200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd02406e710 0x7fd024071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.775+0000 7fd02c200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0240b3750 0x7fd0240cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.775+0000 7fd02c200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0240cdfb0 con 0x7fd0240d03c0 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.775+0000 7fd02c200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd0240cebc0 con 0x7fd0240b3750 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.775+0000 7fd02c200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd0240ce290 con 0x7fd02406e710 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.775+0000 7fd029800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd0240d03c0 0x7fd0240d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48794/0 (socket says 172.21.15.7:48794) 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.775+0000 7fd029800640 1 -- 172.21.15.7:0/3919203622 learned_addr learned my addr 172.21.15.7:0/3919203622 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.776+0000 7fd02a200640 1 --2- 172.21.15.7:0/3919203622 >> v2:172.21.15.7:3300/0 conn(0x7fd0240b3750 0x7fd0240cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.776+0000 7fd028e00640 1 --2- 172.21.15.7:0/3919203622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd02406e710 0x7fd024071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.776+0000 7fd02a200640 1 -- 172.21.15.7:0/3919203622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd02406e710 msgr2=0x7fd024071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.776+0000 7fd02a200640 1 --2- 172.21.15.7:0/3919203622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd02406e710 0x7fd024071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.776+0000 7fd02a200640 1 -- 172.21.15.7:0/3919203622 >> v1:172.21.15.7:6789/0 conn(0x7fd0240d03c0 legacy=0x7fd0240d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.776+0000 7fd02a200640 1 -- 172.21.15.7:0/3919203622 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0240ce570 con 0x7fd0240b3750 2024-08-19T00:48:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.776+0000 7fd028e00640 1 --2- 172.21.15.7:0/3919203622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd02406e710 0x7fd024071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.777+0000 7fd02a200640 1 --2- 172.21.15.7:0/3919203622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240b3750 0x7fd0240cf050 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009d90 tx=0x7fd01c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c800acf02aca14 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.777+0000 7fd023e00640 1 -- 172.21.15.7:0/3919203622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c007740 con 0x7fd0240b3750 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.777+0000 7fd023e00640 1 -- 172.21.15.7:0/3919203622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01c0078e0 con 0x7fd0240b3750 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.777+0000 7fd023e00640 1 -- 172.21.15.7:0/3919203622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c007cb0 con 0x7fd0240b3750 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 -- 172.21.15.7:0/3919203622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240b3750 msgr2=0x7fd0240cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 --2- 172.21.15.7:0/3919203622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240b3750 0x7fd0240cf050 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009d90 tx=0x7fd01c02a660 comp rx=0 tx=0).stop 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 -- 172.21.15.7:0/3919203622 shutdown_connections 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 --2- 172.21.15.7:0/3919203622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240b3750 0x7fd0240cf050 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 --2- 172.21.15.7:0/3919203622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd02406e710 0x7fd024071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 -- 172.21.15.7:0/3919203622 >> 172.21.15.7:0/3919203622 conn(0x7fd02406bc70 msgr2=0x7fd02406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 -- 172.21.15.7:0/3919203622 shutdown_connections 2024-08-19T00:48:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.778+0000 7fd02c200640 1 -- 172.21.15.7:0/3919203622 wait complete. 2024-08-19T00:48:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.780+0000 7fd02c200640 1 Processor -- start 2024-08-19T00:48:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.780+0000 7fd02c200640 1 -- start start 2024-08-19T00:48:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd02406e710 0x7fd02409a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02c200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0240b3750 0x7fd02415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02c200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240d03c0 0x7fd0241571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02c200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd024073c60 con 0x7fd0240d03c0 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd024073ae0 con 0x7fd02406e710 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02c200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd0240b3be0 con 0x7fd0240b3750 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240d03c0 0x7fd0241571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240d03c0 0x7fd0241571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57658/0 (socket says 172.21.15.7:57658) 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 -- 172.21.15.7:0/3344059297 learned_addr learned my addr 172.21.15.7:0/3344059297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd028e00640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0240b3750 0x7fd02415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd029800640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd02406e710 0x7fd02409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 -- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0240b3750 msgr2=0x7fd02415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0240b3750 0x7fd02415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 -- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd02406e710 msgr2=0x7fd02409a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd02406e710 0x7fd02409a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd02a200640 1 -- 172.21.15.7:0/3344059297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0241f29e0 con 0x7fd0240d03c0 2024-08-19T00:48:49.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.781+0000 7fd029800640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd02406e710 0x7fd02409a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:49.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.782+0000 7fd02a200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240d03c0 0x7fd0241571d0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009eb0 tx=0x7fd01c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.782+0000 7fd021600640 1 -- 172.21.15.7:0/3344059297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c040070 con 0x7fd0240d03c0 2024-08-19T00:48:49.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.782+0000 7fd021600640 1 -- 172.21.15.7:0/3344059297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01c031bc0 con 0x7fd0240d03c0 2024-08-19T00:48:49.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.782+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0241f2cc0 con 0x7fd0240d03c0 2024-08-19T00:48:49.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.782+0000 7fd021600640 1 -- 172.21.15.7:0/3344059297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c045460 con 0x7fd0240d03c0 2024-08-19T00:48:49.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.782+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02415d3a0 con 0x7fd0240d03c0 2024-08-19T00:48:49.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.783+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd024071980 con 0x7fd0240d03c0 2024-08-19T00:48:49.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.784+0000 7fd021600640 1 -- 172.21.15.7:0/3344059297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd01c039040 con 0x7fd0240d03c0 2024-08-19T00:48:49.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.785+0000 7fd021600640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd00406be30 0x7fd00406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.785+0000 7fd021600640 1 -- 172.21.15.7:0/3344059297 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fd01c0ac830 con 0x7fd0240d03c0 2024-08-19T00:48:49.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.785+0000 7fd029800640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd00406be30 0x7fd00406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.786+0000 7fd029800640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd00406be30 0x7fd00406e2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd0240b4e70 tx=0x7fd018009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.789+0000 7fd021600640 1 -- 172.21.15.7:0/3344059297 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd01c07b1d0 con 0x7fd0240d03c0 2024-08-19T00:48:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.975+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd02409ce50 con 0x7fd0240d03c0 2024-08-19T00:48:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.976+0000 7fd021600640 1 -- 172.21.15.7:0/3344059297 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16596 (secure 0 0 0) 0x7fd01c07aad0 con 0x7fd0240d03c0 2024-08-19T00:48:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:49.978 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":135,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:48.620838+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:48:46.426846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-08-19T00:48:47.623461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:48:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.978+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd00406be30 msgr2=0x7fd00406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.978+0000 7fd02c200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd00406be30 0x7fd00406e2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd0240b4e70 tx=0x7fd018009040 comp rx=0 tx=0).stop 2024-08-19T00:48:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.978+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240d03c0 msgr2=0x7fd0241571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.978+0000 7fd02c200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240d03c0 0x7fd0241571d0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009eb0 tx=0x7fd01c004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 shutdown_connections 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd00406be30 0x7fd00406e2f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0240d03c0 0x7fd0241571d0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0240b3750 0x7fd02415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 --2- 172.21.15.7:0/3344059297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd02406e710 0x7fd02409a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 >> 172.21.15.7:0/3344059297 conn(0x7fd02406bc70 msgr2=0x7fd0240afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 shutdown_connections 2024-08-19T00:48:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:49.979+0000 7fd02c200640 1 -- 172.21.15.7:0/3344059297 wait complete. 2024-08-19T00:48:49.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:48:50.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.154+0000 7f3a3ca00640 1 Processor -- start 2024-08-19T00:48:50.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.154+0000 7f3a3ca00640 1 -- start start 2024-08-19T00:48:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a3ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a3813dc30 0x7f3a38140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a3ca00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3815e930 con 0x7f3a38140640 2024-08-19T00:48:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a3ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3815ec10 con 0x7f3a3806dd10 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a3ca00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3815eef0 con 0x7f3a3813dc30 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a36800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a3813dc30 0x7f3a38140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a2fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3a38140640 0x7f3a3806d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48804/0 (socket says 172.21.15.7:48804) 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a36800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a3813dc30 0x7f3a38140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57670/0 (socket says 172.21.15.7:57670) 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a2fe00640 1 -- 172.21.15.7:0/1232472871 learned_addr learned my addr 172.21.15.7:0/1232472871 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a36800640 1 -- 172.21.15.7:0/1232472871 >> v1:172.21.15.162:6789/0 conn(0x7f3a3806dd10 legacy=0x7f3a380ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a36800640 1 -- 172.21.15.7:0/1232472871 >> v1:172.21.15.7:6789/0 conn(0x7f3a38140640 legacy=0x7f3a3806d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.156+0000 7f3a36800640 1 -- 172.21.15.7:0/1232472871 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3815f1d0 con 0x7f3a3813dc30 2024-08-19T00:48:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.157+0000 7f3a36800640 1 --2- 172.21.15.7:0/1232472871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3813dc30 0x7f3a38140ce0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f3a280097a0 tx=0x7f3a2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4bf719976b9179 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a35e00640 1 -- 172.21.15.7:0/1232472871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28037070 con 0x7f3a3813dc30 2024-08-19T00:48:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a35e00640 1 -- 172.21.15.7:0/1232472871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a28032440 con 0x7f3a3813dc30 2024-08-19T00:48:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a35e00640 1 -- 172.21.15.7:0/1232472871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28032810 con 0x7f3a3813dc30 2024-08-19T00:48:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a3ca00640 1 -- 172.21.15.7:0/1232472871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3813dc30 msgr2=0x7f3a38140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/1232472871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3813dc30 0x7f3a38140ce0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f3a280097a0 tx=0x7f3a2802a230 comp rx=0 tx=0).stop 2024-08-19T00:48:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a3ca00640 1 -- 172.21.15.7:0/1232472871 shutdown_connections 2024-08-19T00:48:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/1232472871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3813dc30 0x7f3a38140ce0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a3ca00640 1 -- 172.21.15.7:0/1232472871 >> 172.21.15.7:0/1232472871 conn(0x7f3a3806b850 msgr2=0x7f3a3806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:50.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a3ca00640 1 -- 172.21.15.7:0/1232472871 shutdown_connections 2024-08-19T00:48:50.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.158+0000 7f3a3ca00640 1 -- 172.21.15.7:0/1232472871 wait complete. 2024-08-19T00:48:50.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.160+0000 7f3a3ca00640 1 Processor -- start 2024-08-19T00:48:50.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.160+0000 7f3a3ca00640 1 -- start start 2024-08-19T00:48:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a3ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3806dd10 0x7f3a381395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a3ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a3813dc30 0x7f3a3813cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a3ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a38140640 0x7f3a38141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a3ca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a381413a0 con 0x7f3a3806dd10 2024-08-19T00:48:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a3ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a38141220 con 0x7f3a38140640 2024-08-19T00:48:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a3ca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3813e010 con 0x7f3a3813dc30 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a36800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3806dd10 0x7f3a381395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a36800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3806dd10 0x7f3a381395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57674/0 (socket says 172.21.15.7:57674) 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a36800640 1 -- 172.21.15.7:0/3881952942 learned_addr learned my addr 172.21.15.7:0/3881952942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.161+0000 7f3a2fe00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a3813dc30 0x7f3a3813cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a37200640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a38140640 0x7f3a38141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a36800640 1 -- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a3813dc30 msgr2=0x7f3a3813cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a36800640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a3813dc30 0x7f3a3813cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a36800640 1 -- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a38140640 msgr2=0x7f3a38141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a36800640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a38140640 0x7f3a38141650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a36800640 1 -- 172.21.15.7:0/3881952942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a380b33d0 con 0x7f3a3806dd10 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a37200640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a38140640 0x7f3a38141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a2fe00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a3813dc30 0x7f3a3813cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a36800640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3806dd10 0x7f3a381395f0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f3a28000c00 tx=0x7f3a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a2ea00640 1 -- 172.21.15.7:0/3881952942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28037040 con 0x7f3a3806dd10 2024-08-19T00:48:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a2ea00640 1 -- 172.21.15.7:0/3881952942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a28042070 con 0x7f3a3806dd10 2024-08-19T00:48:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a2ea00640 1 -- 172.21.15.7:0/3881952942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28030a70 con 0x7f3a3806dd10 2024-08-19T00:48:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.162+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a380b36b0 con 0x7f3a3806dd10 2024-08-19T00:48:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.163+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a380b3c70 con 0x7f3a3806dd10 2024-08-19T00:48:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.164+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a38140ce0 con 0x7f3a3806dd10 2024-08-19T00:48:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.164+0000 7f3a2ea00640 1 -- 172.21.15.7:0/3881952942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a28030c10 con 0x7f3a3806dd10 2024-08-19T00:48:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.165+0000 7f3a2ea00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3a1406be30 0x7f3a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.165+0000 7f3a2ea00640 1 -- 172.21.15.7:0/3881952942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f3a280ab9b0 con 0x7f3a3806dd10 2024-08-19T00:48:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.166+0000 7f3a2fe00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3a1406be30 0x7f3a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.166+0000 7f3a2fe00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3a1406be30 0x7f3a1406e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3a38150f10 tx=0x7f3a20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:50.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.170+0000 7f3a2ea00640 1 -- 172.21.15.7:0/3881952942 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3a2807a360 con 0x7f3a3806dd10 2024-08-19T00:48:50.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:50.398+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3a3806e520 con 0x7f3a3806dd10 2024-08-19T00:48:51.178 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:48:51.176+0000 7f69f9000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:51.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.214+0000 7f3a2ea00640 1 -- 172.21.15.7:0/3881952942 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v345) ==== 118+0+0 (secure 0 0 0) 0x7f3a28079c60 con 0x7f3a3806dd10 2024-08-19T00:48:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3a1406be30 msgr2=0x7f3a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3a1406be30 0x7f3a1406e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3a38150f10 tx=0x7f3a20009040 comp rx=0 tx=0).stop 2024-08-19T00:48:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3806dd10 msgr2=0x7f3a381395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3806dd10 0x7f3a381395f0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f3a28000c00 tx=0x7f3a280046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 shutdown_connections 2024-08-19T00:48:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3a1406be30 0x7f3a1406e2f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a38140640 0x7f3a38141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a3813dc30 0x7f3a3813cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 --2- 172.21.15.7:0/3881952942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a3806dd10 0x7f3a381395f0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 >> 172.21.15.7:0/3881952942 conn(0x7f3a3806b850 msgr2=0x7f3a38159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 shutdown_connections 2024-08-19T00:48:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.218+0000 7f3a3ca00640 1 -- 172.21.15.7:0/3881952942 wait complete. 2024-08-19T00:48:51.239 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-19T00:48:51.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-19T00:48:51.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.402+0000 7f8163800640 1 Processor -- start 2024-08-19T00:48:51.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.402+0000 7f8163800640 1 -- start start 2024-08-19T00:48:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.403+0000 7f8163800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f815c158cd0 0x7f815c072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.403+0000 7f8163800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815c0aeae0 con 0x7f815c072ff0 2024-08-19T00:48:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.403+0000 7f8163800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815c0aedc0 con 0x7f815c0ae480 2024-08-19T00:48:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.403+0000 7f8163800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f815c073460 con 0x7f815c158cd0 2024-08-19T00:48:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f815c072ff0 0x7f815c0add70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48808/0 (socket says 172.21.15.7:48808) 2024-08-19T00:48:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815be00640 1 -- 172.21.15.7:0/972687266 learned_addr learned my addr 172.21.15.7:0/972687266 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:51.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f8160e00640 1 --2- 172.21.15.7:0/972687266 >> v2:172.21.15.162:3300/0 conn(0x7f815c158cd0 0x7f815c072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446373796 0 0) 0x7f815c0aeae0 con 0x7f815c072ff0 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8144003520 con 0x7f815c072ff0 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529393696 0 0) 0x7f815c0aedc0 con 0x7f815c0ae480 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f815c0aeae0 con 0x7f815c0ae480 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3670409000 0 0) 0x7f8144003520 con 0x7f815c072ff0 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 >> v2:172.21.15.162:3300/0 conn(0x7f815c158cd0 msgr2=0x7f815c072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 --2- 172.21.15.7:0/972687266 >> v2:172.21.15.162:3300/0 conn(0x7f815c158cd0 0x7f815c072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 >> v1:172.21.15.162:6789/0 conn(0x7f815c0ae480 legacy=0x7f815c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.404+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c0af0a0 con 0x7f815c072ff0 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f8148001670 con 0x7f815c072ff0 2024-08-19T00:48:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 >> v1:172.21.15.7:6789/0 conn(0x7f815c072ff0 legacy=0x7f815c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8144003b90 0x7f8144003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8144004800 0x7f8144004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f814400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f815c073460 con 0x7f8144005280 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f814400e3d0 con 0x7f8144003b90 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f814400e5d0 con 0x7f8144004800 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8160e00640 1 --2- 172.21.15.7:0/972687266 >> v2:172.21.15.162:3300/0 conn(0x7f815c158cd0 0x7f815c072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8161800640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f814400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f815be00640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8144004800 0x7f8144004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8160e00640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8144003b90 0x7f8144003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8161800640 1 -- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8144004800 msgr2=0x7f8144004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8161800640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8144004800 0x7f8144004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8161800640 1 -- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8144003b90 msgr2=0x7f8144003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8161800640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8144003b90 0x7f8144003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.405+0000 7f8161800640 1 -- 172.21.15.7:0/972687266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8144003520 con 0x7f8144005280 2024-08-19T00:48:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.406+0000 7f8161800640 1 -- 172.21.15.7:0/972687266 reap_dead start 2024-08-19T00:48:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.406+0000 7f8161800640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f814400dbd0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f8154001fd0 tx=0x7f8144005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1b0731f28064aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154001bf0 con 0x7f8144005280 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8154003b70 con 0x7f8144005280 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f815b400640 1 -- 172.21.15.7:0/972687266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81540050d0 con 0x7f8144005280 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f8163800640 1 -- 172.21.15.7:0/972687266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 msgr2=0x7f814400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f8163800640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f814400dbd0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f8154001fd0 tx=0x7f8144005830 comp rx=0 tx=0).stop 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f8163800640 1 -- 172.21.15.7:0/972687266 shutdown_connections 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f8163800640 1 --2- 172.21.15.7:0/972687266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f814400dbd0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f8163800640 1 -- 172.21.15.7:0/972687266 >> 172.21.15.7:0/972687266 conn(0x7f815c0b2300 msgr2=0x7f815c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f8163800640 1 -- 172.21.15.7:0/972687266 shutdown_connections 2024-08-19T00:48:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.407+0000 7f8163800640 1 -- 172.21.15.7:0/972687266 wait complete. 2024-08-19T00:48:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.409+0000 7f8163800640 1 Processor -- start 2024-08-19T00:48:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.409+0000 7f8163800640 1 -- start start 2024-08-19T00:48:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8163800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f815c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8163800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815c0b1110 0x7f815c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8163800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f815c06de10 0x7f815c06e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8163800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0add70 con 0x7f8144005280 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8163800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0af660 con 0x7f815c0b1110 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8163800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f815c0adef0 con 0x7f815c06de10 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8160e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f815c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8160e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f815c0b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57688/0 (socket says 172.21.15.7:57688) 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f8160e00640 1 -- 172.21.15.7:0/3145811794 learned_addr learned my addr 172.21.15.7:0/3145811794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.410+0000 7f815be00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815c0b1110 0x7f815c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8161800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f815c06de10 0x7f815c06e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8160e00640 1 -- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f815c06de10 msgr2=0x7f815c06e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8160e00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f815c06de10 0x7f815c06e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8160e00640 1 -- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815c0b1110 msgr2=0x7f815c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8160e00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815c0b1110 0x7f815c06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8160e00640 1 -- 172.21.15.7:0/3145811794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c15def0 con 0x7f8144005280 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f815be00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815c0b1110 0x7f815c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8161800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f815c06de10 0x7f815c06e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8160e00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f815c0b0bd0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f81500116f0 tx=0x7f8150011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8158c00640 1 -- 172.21.15.7:0/3145811794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815000f9c0 con 0x7f8144005280 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8158c00640 1 -- 172.21.15.7:0/3145811794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815000fb60 con 0x7f8144005280 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8158c00640 1 -- 172.21.15.7:0/3145811794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150015460 con 0x7f8144005280 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815c1f44a0 con 0x7f8144005280 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.411+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815c157b00 con 0x7f8144005280 2024-08-19T00:48:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.413+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815c15ea90 con 0x7f8144005280 2024-08-19T00:48:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.414+0000 7f8158c00640 1 -- 172.21.15.7:0/3145811794 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8150015600 con 0x7f8144005280 2024-08-19T00:48:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.414+0000 7f8158c00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f813c06be60 0x7f813c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.414+0000 7f8158c00640 1 -- 172.21.15.7:0/3145811794 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f815008b590 con 0x7f8144005280 2024-08-19T00:48:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.415+0000 7f815be00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f813c06be60 0x7f813c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.415+0000 7f815be00640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f813c06be60 0x7f813c06e320 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f81480010e0 tx=0x7f8148000ef0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:51.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.419+0000 7f8158c00640 1 -- 172.21.15.7:0/3145811794 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8150019030 con 0x7f8144005280 2024-08-19T00:48:51.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:51.637+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f815c0b14f0 con 0x7f8144005280 2024-08-19T00:48:52.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.220+0000 7f8158c00640 1 -- 172.21.15.7:0/3145811794 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v346) ==== 122+0+0 (secure 0 0 0) 0x7f8150059f30 con 0x7f8144005280 2024-08-19T00:48:52.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f813c06be60 msgr2=0x7f813c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f813c06be60 0x7f813c06e320 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f81480010e0 tx=0x7f8148000ef0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 msgr2=0x7f815c0b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f815c0b0bd0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f81500116f0 tx=0x7f8150011bb0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 shutdown_connections 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f813c06be60 0x7f813c06e320 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f815c06de10 0x7f815c06e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815c0b1110 0x7f815c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 --2- 172.21.15.7:0/3145811794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8144005280 0x7f815c0b0bd0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 >> 172.21.15.7:0/3145811794 conn(0x7f815c0b2300 msgr2=0x7f815c153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.224+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 shutdown_connections 2024-08-19T00:48:52.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.225+0000 7f8163800640 1 -- 172.21.15.7:0/3145811794 wait complete. 2024-08-19T00:48:52.244 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-19T00:48:52.244 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.402+0000 7f0cbfe00640 1 Processor -- start 2024-08-19T00:48:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.402+0000 7f0cbfe00640 1 -- start start 2024-08-19T00:48:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.403+0000 7f0cbfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0cc015e360 0x7f0cc015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.403+0000 7f0cbfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc015ee50 0x7f0cc00d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.403+0000 7f0cbfe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00b3ab0 con 0x7f0cc00d2af0 2024-08-19T00:48:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.403+0000 7f0cbfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc015f460 con 0x7f0cc015e360 2024-08-19T00:48:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.403+0000 7f0cbfe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc015f740 con 0x7f0cc015ee50 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc015ee50 0x7f0cc00d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc015ee50 0x7f0cc00d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:36986/0 (socket says 172.21.15.7:36986) 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbf400640 1 -- 172.21.15.7:0/88355542 learned_addr learned my addr 172.21.15.7:0/88355542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbea00640 1 --2- 172.21.15.7:0/88355542 >> v2:172.21.15.162:3300/0 conn(0x7f0cc015e360 0x7f0cc015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbf400640 1 -- 172.21.15.7:0/88355542 >> v2:172.21.15.162:3300/0 conn(0x7f0cc015e360 msgr2=0x7f0cc015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbf400640 1 --2- 172.21.15.7:0/88355542 >> v2:172.21.15.162:3300/0 conn(0x7f0cc015e360 0x7f0cc015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbf400640 1 -- 172.21.15.7:0/88355542 >> v1:172.21.15.162:6789/0 conn(0x7f0cc00d2af0 legacy=0x7f0cc015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbf400640 1 -- 172.21.15.7:0/88355542 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00b3d60 con 0x7f0cc015ee50 2024-08-19T00:48:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.404+0000 7f0cbd600640 1 -- 172.21.15.7:0/88355542 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606452123 0 0) 0x7f0cc00b3ab0 con 0x7f0cc00d2af0 2024-08-19T00:48:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.405+0000 7f0cbf400640 1 --2- 172.21.15.7:0/88355542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc015ee50 0x7f0cc00d2f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531949e5f6216a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbd600640 1 -- 172.21.15.7:0/88355542 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8036070 con 0x7f0cc015ee50 2024-08-19T00:48:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbd600640 1 -- 172.21.15.7:0/88355542 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb8031600 con 0x7f0cc015ee50 2024-08-19T00:48:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbd600640 1 -- 172.21.15.7:0/88355542 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80319d0 con 0x7f0cc015ee50 2024-08-19T00:48:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 -- 172.21.15.7:0/88355542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc015ee50 msgr2=0x7f0cc00d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/88355542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc015ee50 0x7f0cc00d2f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb802a710 comp rx=0 tx=0).stop 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 -- 172.21.15.7:0/88355542 shutdown_connections 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/88355542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc015ee50 0x7f0cc00d2f80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/88355542 >> v2:172.21.15.162:3300/0 conn(0x7f0cc015e360 0x7f0cc015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 -- 172.21.15.7:0/88355542 >> 172.21.15.7:0/88355542 conn(0x7f0cc008dbf0 msgr2=0x7f0cc009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 -- 172.21.15.7:0/88355542 shutdown_connections 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.406+0000 7f0cbfe00640 1 -- 172.21.15.7:0/88355542 wait complete. 2024-08-19T00:48:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.408+0000 7f0cbfe00640 1 Processor -- start 2024-08-19T00:48:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.408+0000 7f0cbfe00640 1 -- start start 2024-08-19T00:48:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc00d2af0 0x7f0cc0155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc015e360 0x7f0cc006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cc015ee50 0x7f0cc006de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00b4560 con 0x7f0cc015e360 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00d2300 con 0x7f0cc015ee50 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbfe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00b46e0 con 0x7f0cc00d2af0 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc015e360 0x7f0cc006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc015e360 0x7f0cc006d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57702/0 (socket says 172.21.15.7:57702) 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbe000640 1 -- 172.21.15.7:0/530417430 learned_addr learned my addr 172.21.15.7:0/530417430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbea00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc00d2af0 0x7f0cc0155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.409+0000 7f0cbf400640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cc015ee50 0x7f0cc006de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cbe000640 1 -- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc00d2af0 msgr2=0x7f0cc0155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cbe000640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc00d2af0 0x7f0cc0155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cbe000640 1 -- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cc015ee50 msgr2=0x7f0cc006de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cbe000640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cc015ee50 0x7f0cc006de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cbe000640 1 -- 172.21.15.7:0/530417430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc0156090 con 0x7f0cc015e360 2024-08-19T00:48:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cbe000640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc015e360 0x7f0cc006d8f0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00c4b0 tx=0x7f0cac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cb6a00640 1 -- 172.21.15.7:0/530417430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac017070 con 0x7f0cc015e360 2024-08-19T00:48:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cb6a00640 1 -- 172.21.15.7:0/530417430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac005480 con 0x7f0cc015e360 2024-08-19T00:48:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc00c7db0 con 0x7f0cc015e360 2024-08-19T00:48:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.410+0000 7f0cb6a00640 1 -- 172.21.15.7:0/530417430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac003830 con 0x7f0cc015e360 2024-08-19T00:48:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.411+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc00c8050 con 0x7f0cc015e360 2024-08-19T00:48:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.411+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc015fab0 con 0x7f0cc015e360 2024-08-19T00:48:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.413+0000 7f0cb6a00640 1 -- 172.21.15.7:0/530417430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0cac01a070 con 0x7f0cc015e360 2024-08-19T00:48:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.413+0000 7f0cb6a00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ca006be30 0x7f0ca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.413+0000 7f0cb6a00640 1 -- 172.21.15.7:0/530417430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f0cac08a240 con 0x7f0cc015e360 2024-08-19T00:48:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.414+0000 7f0cbea00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ca006be30 0x7f0ca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.414+0000 7f0cbea00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ca006be30 0x7f0ca006e2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009b40 tx=0x7f0cb0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:52.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.418+0000 7f0cb6a00640 1 -- 172.21.15.7:0/530417430 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0cc0156090 con 0x7f0cc015e360 2024-08-19T00:48:52.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.636+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cc00d50d0 con 0x7f0cc015e360 2024-08-19T00:48:52.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.637+0000 7f0cb6a00640 1 -- 172.21.15.7:0/530417430 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 346 v346) ==== 95+0+5237 (secure 0 0 0) 0x7f0cac058500 con 0x7f0cc015e360 2024-08-19T00:48:52.639 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:52.639 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":346,"btime":"2024-08-19T00:48:52:215999+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":346,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:48:51.638229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10464":{"gid":10464,"name":"c","rank":0,"incarnation":342,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2760644218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2760644218},{"type":"v1","addr":"172.21.15.7:6837","nonce":2760644218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10464,"qdb_cluster":[10464]},"id":7}]} 2024-08-19T00:48:52.639 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 346 2024-08-19T00:48:52.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ca006be30 msgr2=0x7f0ca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ca006be30 0x7f0ca006e2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009b40 tx=0x7f0cb0009190 comp rx=0 tx=0).stop 2024-08-19T00:48:52.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc015e360 msgr2=0x7f0cc006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc015e360 0x7f0cc006d8f0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00c4b0 tx=0x7f0cac00c970 comp rx=0 tx=0).stop 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 shutdown_connections 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f0ca006be30 0x7f0ca006e2f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cc015ee50 0x7f0cc006de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc015e360 0x7f0cc006d8f0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 --2- 172.21.15.7:0/530417430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cc00d2af0 0x7f0cc0155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 >> 172.21.15.7:0/530417430 conn(0x7f0cc008dbf0 msgr2=0x7f0cc006ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 shutdown_connections 2024-08-19T00:48:52.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.639+0000 7f0cbfe00640 1 -- 172.21.15.7:0/530417430 wait complete. 2024-08-19T00:48:52.657 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:48:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.811+0000 7fdd73600640 1 Processor -- start 2024-08-19T00:48:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.812+0000 7fdd73600640 1 -- start start 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd73600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdd6c159bf0 0x7fdd6c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd73600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c06f7f0 con 0x7fdd6c0739a0 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd73600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c06f510 con 0x7fdd6c0cec10 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd73600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdd6c072980 con 0x7fdd6c159bf0 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd6be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdd6c0739a0 0x7fdd6c0ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48820/0 (socket says 172.21.15.7:48820) 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd6be00640 1 -- 172.21.15.7:0/4018881562 learned_addr learned my addr 172.21.15.7:0/4018881562 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd70c00640 1 --2- 172.21.15.7:0/4018881562 >> v2:172.21.15.162:3300/0 conn(0x7fdd6c159bf0 0x7fdd6c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.813+0000 7fdd6b400640 1 -- 172.21.15.7:0/4018881562 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440904056 0 0) 0x7fdd6c06f7f0 con 0x7fdd6c0739a0 2024-08-19T00:48:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.814+0000 7fdd6b400640 1 -- 172.21.15.7:0/4018881562 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd54003520 con 0x7fdd6c0739a0 2024-08-19T00:48:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.814+0000 7fdd6b400640 1 -- 172.21.15.7:0/4018881562 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682823857 0 0) 0x7fdd6c06f510 con 0x7fdd6c0cec10 2024-08-19T00:48:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.814+0000 7fdd6b400640 1 -- 172.21.15.7:0/4018881562 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd6c06f7f0 con 0x7fdd6c0cec10 2024-08-19T00:48:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.814+0000 7fdd70c00640 1 -- 172.21.15.7:0/4018881562 >> v1:172.21.15.162:6789/0 conn(0x7fdd6c0cec10 legacy=0x7fdd6c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.814+0000 7fdd70c00640 1 -- 172.21.15.7:0/4018881562 >> v1:172.21.15.7:6789/0 conn(0x7fdd6c0739a0 legacy=0x7fdd6c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.814+0000 7fdd70c00640 1 -- 172.21.15.7:0/4018881562 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c072c60 con 0x7fdd6c159bf0 2024-08-19T00:48:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.815+0000 7fdd70c00640 1 --2- 172.21.15.7:0/4018881562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c073460 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdd600097a0 tx=0x7fdd6002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cabe1f7d6515b33b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.815+0000 7fdd6b400640 1 -- 172.21.15.7:0/4018881562 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60037070 con 0x7fdd6c159bf0 2024-08-19T00:48:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.815+0000 7fdd6b400640 1 -- 172.21.15.7:0/4018881562 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd60032440 con 0x7fdd6c159bf0 2024-08-19T00:48:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.815+0000 7fdd6b400640 1 -- 172.21.15.7:0/4018881562 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60032810 con 0x7fdd6c159bf0 2024-08-19T00:48:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.816+0000 7fdd73600640 1 -- 172.21.15.7:0/4018881562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 msgr2=0x7fdd6c073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.816+0000 7fdd73600640 1 --2- 172.21.15.7:0/4018881562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c073460 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdd600097a0 tx=0x7fdd6002a1a0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.816+0000 7fdd73600640 1 -- 172.21.15.7:0/4018881562 shutdown_connections 2024-08-19T00:48:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.816+0000 7fdd73600640 1 --2- 172.21.15.7:0/4018881562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c073460 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.816+0000 7fdd73600640 1 -- 172.21.15.7:0/4018881562 >> 172.21.15.7:0/4018881562 conn(0x7fdd6c06bc70 msgr2=0x7fdd6c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.816+0000 7fdd73600640 1 -- 172.21.15.7:0/4018881562 shutdown_connections 2024-08-19T00:48:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.816+0000 7fdd73600640 1 -- 172.21.15.7:0/4018881562 wait complete. 2024-08-19T00:48:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.818+0000 7fdd73600640 1 Processor -- start 2024-08-19T00:48:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.818+0000 7fdd73600640 1 -- start start 2024-08-19T00:48:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd73600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd6c0739a0 0x7fdd6c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd73600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd73600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c1485c0 0x7fdd6c075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd73600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c15a150 con 0x7fdd6c1485c0 2024-08-19T00:48:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd73600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c159fd0 con 0x7fdd6c159bf0 2024-08-19T00:48:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd73600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6c0d0ad0 con 0x7fdd6c0739a0 2024-08-19T00:48:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd71600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c1485c0 0x7fdd6c075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd71600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c1485c0 0x7fdd6c075320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57712/0 (socket says 172.21.15.7:57712) 2024-08-19T00:48:52.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd71600640 1 -- 172.21.15.7:0/3068761113 learned_addr learned my addr 172.21.15.7:0/3068761113 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:52.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd6be00640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd70c00640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd6c0739a0 0x7fdd6c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd71600640 1 -- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd6c0739a0 msgr2=0x7fdd6c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd71600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd6c0739a0 0x7fdd6c155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.819+0000 7fdd71600640 1 -- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 msgr2=0x7fdd6c074de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd71600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c074de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd71600640 1 -- 172.21.15.7:0/3068761113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c1561c0 con 0x7fdd6c1485c0 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd70c00640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd6c0739a0 0x7fdd6c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd6be00640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c074de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd71600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c1485c0 0x7fdd6c075320 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c7a0 tx=0x7fdd6400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd68c00640 1 -- 172.21.15.7:0/3068761113 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64003b70 con 0x7fdd6c1485c0 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd68c00640 1 -- 172.21.15.7:0/3068761113 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd64003d10 con 0x7fdd6c1485c0 2024-08-19T00:48:52.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd68c00640 1 -- 172.21.15.7:0/3068761113 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400aa90 con 0x7fdd6c1485c0 2024-08-19T00:48:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6c09a310 con 0x7fdd6c1485c0 2024-08-19T00:48:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.820+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6c09a8d0 con 0x7fdd6c1485c0 2024-08-19T00:48:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.821+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6c073460 con 0x7fdd6c1485c0 2024-08-19T00:48:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.822+0000 7fdd68c00640 1 -- 172.21.15.7:0/3068761113 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd6400ac30 con 0x7fdd6c1485c0 2024-08-19T00:48:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.823+0000 7fdd68c00640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd4c06be30 0x7fdd4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.823+0000 7fdd68c00640 1 -- 172.21.15.7:0/3068761113 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fdd6408ae20 con 0x7fdd6c1485c0 2024-08-19T00:48:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.823+0000 7fdd70c00640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd4c06be30 0x7fdd4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.824+0000 7fdd70c00640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd4c06be30 0x7fdd4c06e2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdd60034000 tx=0x7fdd6002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:52.827+0000 7fdd68c00640 1 -- 172.21.15.7:0/3068761113 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdd640597c0 con 0x7fdd6c1485c0 2024-08-19T00:48:53.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.012+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd6c158cf0 con 0x7fdd6c1485c0 2024-08-19T00:48:53.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.013+0000 7fdd68c00640 1 -- 172.21.15.7:0/3068761113 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16583 (secure 0 0 0) 0x7fdd640590c0 con 0x7fdd6c1485c0 2024-08-19T00:48:53.015 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:53.015 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":136,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:50.201792+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:48:46.426846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-08-19T00:48:47.623461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:48:53.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd4c06be30 msgr2=0x7fdd4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd4c06be30 0x7fdd4c06e2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdd60034000 tx=0x7fdd6002e000 comp rx=0 tx=0).stop 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c1485c0 msgr2=0x7fdd6c075320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c1485c0 0x7fdd6c075320 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c7a0 tx=0x7fdd6400cc60 comp rx=0 tx=0).stop 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 shutdown_connections 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd4c06be30 0x7fdd4c06e2f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c1485c0 0x7fdd6c075320 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd6c159bf0 0x7fdd6c074de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 --2- 172.21.15.7:0/3068761113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd6c0739a0 0x7fdd6c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 >> 172.21.15.7:0/3068761113 conn(0x7fdd6c06bc70 msgr2=0x7fdd6c0cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:53.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 shutdown_connections 2024-08-19T00:48:53.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.015+0000 7fdd73600640 1 -- 172.21.15.7:0/3068761113 wait complete. 2024-08-19T00:48:53.033 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:48:53.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:48:53.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.188+0000 7f46e8600640 1 Processor -- start 2024-08-19T00:48:53.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.189+0000 7f46e8600640 1 -- start start 2024-08-19T00:48:53.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e8600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46e00d03c0 0x7f46e0071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e8600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00b3750 0x7f46e00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e8600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e00cdfb0 con 0x7f46e006e710 2024-08-19T00:48:53.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e8600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f46e00cebc0 con 0x7f46e00d03c0 2024-08-19T00:48:53.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e8600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46e00ce290 con 0x7f46e00b3750 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e5200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f46e006e710 0x7f46e00d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:48454/0 (socket says 172.21.15.7:48454) 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e5200640 1 -- 172.21.15.7:0/2328519274 learned_addr learned my addr 172.21.15.7:0/2328519274 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e6600640 1 --2- 172.21.15.7:0/2328519274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00b3750 0x7f46e00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.190+0000 7f46e5c00640 1 --2- 172.21.15.7:0/2328519274 >> v2:172.21.15.162:3300/0 conn(0x7f46e00d03c0 0x7f46e0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.191+0000 7f46dfe00640 1 -- 172.21.15.7:0/2328519274 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692144451 0 0) 0x7f46e00cdfb0 con 0x7f46e006e710 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.191+0000 7f46e6600640 1 -- 172.21.15.7:0/2328519274 >> v2:172.21.15.162:3300/0 conn(0x7f46e00d03c0 msgr2=0x7f46e0071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.191+0000 7f46e6600640 1 --2- 172.21.15.7:0/2328519274 >> v2:172.21.15.162:3300/0 conn(0x7f46e00d03c0 0x7f46e0071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.191+0000 7f46e6600640 1 -- 172.21.15.7:0/2328519274 >> v1:172.21.15.162:6789/0 conn(0x7f46e006e710 legacy=0x7f46e00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.191+0000 7f46e6600640 1 -- 172.21.15.7:0/2328519274 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e00ce570 con 0x7f46e00b3750 2024-08-19T00:48:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.192+0000 7f46e6600640 1 --2- 172.21.15.7:0/2328519274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00b3750 0x7f46e00cf050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009dc0 tx=0x7f46d802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53fa50ef5df2a71 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46dfe00640 1 -- 172.21.15.7:0/2328519274 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d802ae60 con 0x7f46e00b3750 2024-08-19T00:48:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46dfe00640 1 -- 172.21.15.7:0/2328519274 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d8007740 con 0x7f46e00b3750 2024-08-19T00:48:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46dfe00640 1 -- 172.21.15.7:0/2328519274 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8007b10 con 0x7f46e00b3750 2024-08-19T00:48:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46e8600640 1 -- 172.21.15.7:0/2328519274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00b3750 msgr2=0x7f46e00cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46e8600640 1 --2- 172.21.15.7:0/2328519274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00b3750 0x7f46e00cf050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009dc0 tx=0x7f46d802a680 comp rx=0 tx=0).stop 2024-08-19T00:48:53.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46e8600640 1 -- 172.21.15.7:0/2328519274 shutdown_connections 2024-08-19T00:48:53.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46e8600640 1 --2- 172.21.15.7:0/2328519274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00b3750 0x7f46e00cf050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46e8600640 1 --2- 172.21.15.7:0/2328519274 >> v2:172.21.15.162:3300/0 conn(0x7f46e00d03c0 0x7f46e0071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.193+0000 7f46e8600640 1 -- 172.21.15.7:0/2328519274 >> 172.21.15.7:0/2328519274 conn(0x7f46e006bc70 msgr2=0x7f46e006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:53.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.194+0000 7f46e8600640 1 -- 172.21.15.7:0/2328519274 shutdown_connections 2024-08-19T00:48:53.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.194+0000 7f46e8600640 1 -- 172.21.15.7:0/2328519274 wait complete. 2024-08-19T00:48:53.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.195+0000 7f46e8600640 1 Processor -- start 2024-08-19T00:48:53.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.195+0000 7f46e8600640 1 -- start start 2024-08-19T00:48:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e8600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006e710 0x7f46e0163000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e8600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e00b3750 0x7f46e0155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e8600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00d03c0 0x7f46e0155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e8600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46e0073c60 con 0x7f46e006e710 2024-08-19T00:48:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e8600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46e0073ae0 con 0x7f46e00b3750 2024-08-19T00:48:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e8600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46e00b3be0 con 0x7f46e00d03c0 2024-08-19T00:48:53.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006e710 0x7f46e0163000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006e710 0x7f46e0163000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57724/0 (socket says 172.21.15.7:57724) 2024-08-19T00:48:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.196+0000 7f46e5c00640 1 -- 172.21.15.7:0/2150272998 learned_addr learned my addr 172.21.15.7:0/2150272998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e5200640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e00b3750 0x7f46e0155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e6600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00d03c0 0x7f46e0155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e5c00640 1 -- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00d03c0 msgr2=0x7f46e0155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e5c00640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00d03c0 0x7f46e0155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e5c00640 1 -- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e00b3750 msgr2=0x7f46e0155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e5c00640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e00b3750 0x7f46e0155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e5c00640 1 -- 172.21.15.7:0/2150272998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e0163540 con 0x7f46e006e710 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.197+0000 7f46e5c00640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006e710 0x7f46e0163000 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f46d400e9e0 tx=0x7f46d400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.198+0000 7f46dd600640 1 -- 172.21.15.7:0/2150272998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4017070 con 0x7f46e006e710 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.198+0000 7f46dd600640 1 -- 172.21.15.7:0/2150272998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d400c9d0 con 0x7f46e006e710 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.198+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e0158b40 con 0x7f46e006e710 2024-08-19T00:48:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.198+0000 7f46dd600640 1 -- 172.21.15.7:0/2150272998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d400cdc0 con 0x7f46e006e710 2024-08-19T00:48:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.198+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e015c260 con 0x7f46e006e710 2024-08-19T00:48:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.199+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e0071980 con 0x7f46e006e710 2024-08-19T00:48:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.200+0000 7f46dd600640 1 -- 172.21.15.7:0/2150272998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46d401a070 con 0x7f46e006e710 2024-08-19T00:48:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.201+0000 7f46dd600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c006be30 0x7f46c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.201+0000 7f46dd600640 1 -- 172.21.15.7:0/2150272998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f46d408aeb0 con 0x7f46e006e710 2024-08-19T00:48:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.201+0000 7f46e5200640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c006be30 0x7f46c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.202+0000 7f46e5200640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c006be30 0x7f46c006e2f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f46cc007fd0 tx=0x7f46cc007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.206+0000 7f46dd600640 1 -- 172.21.15.7:0/2150272998 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f46d4059180 con 0x7f46e006e710 2024-08-19T00:48:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.389+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46e0159060 con 0x7f46c006be30 2024-08-19T00:48:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.396+0000 7f46dd600640 1 -- 172.21.15.7:0/2150272998 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7f46cc004c70 con 0x7f46c006be30 2024-08-19T00:48:53.401 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:53.402 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:48:53.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c006be30 msgr2=0x7f46c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c006be30 0x7f46c006e2f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f46cc007fd0 tx=0x7f46cc007de0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006e710 msgr2=0x7f46e0163000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006e710 0x7f46e0163000 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f46d400e9e0 tx=0x7f46d400eea0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 shutdown_connections 2024-08-19T00:48:53.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f46c006be30 0x7f46c006e2f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46e00d03c0 0x7f46e0155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e00b3750 0x7f46e0155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 --2- 172.21.15.7:0/2150272998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006e710 0x7f46e0163000 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 >> 172.21.15.7:0/2150272998 conn(0x7f46e006bc70 msgr2=0x7f46e00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:53.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 shutdown_connections 2024-08-19T00:48:53.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.400+0000 7f46e8600640 1 -- 172.21.15.7:0/2150272998 wait complete. 2024-08-19T00:48:53.418 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2024-08-19T00:48:51.416878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284972,"kb_used_data":14696,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754689748,"statfs":{"total":773094113280,"available":772802301952,"internally_reserved":0,"allocated":15048704,"data_stored":7817996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.231319"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359222+0000","last_change":"2024-08-19T00:48:49.229508+0000","last_active":"2024-08-19T00:48:50.359222+0000","last_peered":"2024-08-19T00:48:50.359222+0000","last_clean":"2024-08-19T00:48:50.359222+0000","last_became_active":"2024-08-19T00:48:49.229166+0000","last_became_peered":"2024-08-19T00:48:49.229166+0000","last_unstale":"2024-08-19T00:48:50.359222+0000","last_undegraded":"2024-08-19T00:48:50.359222+0000","last_fullsized":"2024-08-19T00:48:50.359222+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:55.810248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357840+0000","last_change":"2024-08-19T00:48:49.223677+0000","last_active":"2024-08-19T00:48:50.357840+0000","last_peered":"2024-08-19T00:48:50.357840+0000","last_clean":"2024-08-19T00:48:50.357840+0000","last_became_active":"2024-08-19T00:48:49.223409+0000","last_became_peered":"2024-08-19T00:48:49.223409+0000","last_unstale":"2024-08-19T00:48:50.357840+0000","last_undegraded":"2024-08-19T00:48:50.357840+0000","last_fullsized":"2024-08-19T00:48:50.357840+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:25:32.893063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358135+0000","last_change":"2024-08-19T00:48:49.224940+0000","last_active":"2024-08-19T00:48:50.358135+0000","last_peered":"2024-08-19T00:48:50.358135+0000","last_clean":"2024-08-19T00:48:50.358135+0000","last_became_active":"2024-08-19T00:48:49.224300+0000","last_became_peered":"2024-08-19T00:48:49.224300+0000","last_unstale":"2024-08-19T00:48:50.358135+0000","last_undegraded":"2024-08-19T00:48:50.358135+0000","last_fullsized":"2024-08-19T00:48:50.358135+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:47:18.757688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358189+0000","last_change":"2024-08-19T00:48:49.222567+0000","last_active":"2024-08-19T00:48:50.358189+0000","last_peered":"2024-08-19T00:48:50.358189+0000","last_clean":"2024-08-19T00:48:50.358189+0000","last_became_active":"2024-08-19T00:48:49.221639+0000","last_became_peered":"2024-08-19T00:48:49.221639+0000","last_unstale":"2024-08-19T00:48:50.358189+0000","last_undegraded":"2024-08-19T00:48:50.358189+0000","last_fullsized":"2024-08-19T00:48:50.358189+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:58.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210573+0000","last_change":"2024-08-19T00:48:49.214127+0000","last_active":"2024-08-19T00:48:50.210573+0000","last_peered":"2024-08-19T00:48:50.210573+0000","last_clean":"2024-08-19T00:48:50.210573+0000","last_became_active":"2024-08-19T00:48:49.213578+0000","last_became_peered":"2024-08-19T00:48:49.213578+0000","last_unstale":"2024-08-19T00:48:50.210573+0000","last_undegraded":"2024-08-19T00:48:50.210573+0000","last_fullsized":"2024-08-19T00:48:50.210573+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:52.597976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210717+0000","last_change":"2024-08-19T00:48:49.215609+0000","last_active":"2024-08-19T00:48:50.210717+0000","last_peered":"2024-08-19T00:48:50.210717+0000","last_clean":"2024-08-19T00:48:50.210717+0000","last_became_active":"2024-08-19T00:48:49.215345+0000","last_became_peered":"2024-08-19T00:48:49.215345+0000","last_unstale":"2024-08-19T00:48:50.210717+0000","last_undegraded":"2024-08-19T00:48:50.210717+0000","last_fullsized":"2024-08-19T00:48:50.210717+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:41:10.253771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210848+0000","last_change":"2024-08-19T00:48:49.211818+0000","last_active":"2024-08-19T00:48:50.210848+0000","last_peered":"2024-08-19T00:48:50.210848+0000","last_clean":"2024-08-19T00:48:50.210848+0000","last_became_active":"2024-08-19T00:48:49.211543+0000","last_became_peered":"2024-08-19T00:48:49.211543+0000","last_unstale":"2024-08-19T00:48:50.210848+0000","last_undegraded":"2024-08-19T00:48:50.210848+0000","last_fullsized":"2024-08-19T00:48:50.210848+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:18:00.870270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357936+0000","last_change":"2024-08-19T00:48:49.227685+0000","last_active":"2024-08-19T00:48:50.357936+0000","last_peered":"2024-08-19T00:48:50.357936+0000","last_clean":"2024-08-19T00:48:50.357936+0000","last_became_active":"2024-08-19T00:48:49.227307+0000","last_became_peered":"2024-08-19T00:48:49.227307+0000","last_unstale":"2024-08-19T00:48:50.357936+0000","last_undegraded":"2024-08-19T00:48:50.357936+0000","last_fullsized":"2024-08-19T00:48:50.357936+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:04.748375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211182+0000","last_change":"2024-08-19T00:48:49.207293+0000","last_active":"2024-08-19T00:48:50.211182+0000","last_peered":"2024-08-19T00:48:50.211182+0000","last_clean":"2024-08-19T00:48:50.211182+0000","last_became_active":"2024-08-19T00:48:49.206980+0000","last_became_peered":"2024-08-19T00:48:49.206980+0000","last_unstale":"2024-08-19T00:48:50.211182+0000","last_undegraded":"2024-08-19T00:48:50.211182+0000","last_fullsized":"2024-08-19T00:48:50.211182+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:31.337854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356760+0000","last_change":"2024-08-19T00:48:49.219549+0000","last_active":"2024-08-19T00:48:50.356760+0000","last_peered":"2024-08-19T00:48:50.356760+0000","last_clean":"2024-08-19T00:48:50.356760+0000","last_became_active":"2024-08-19T00:48:49.219080+0000","last_became_peered":"2024-08-19T00:48:49.219080+0000","last_unstale":"2024-08-19T00:48:50.356760+0000","last_undegraded":"2024-08-19T00:48:50.356760+0000","last_fullsized":"2024-08-19T00:48:50.356760+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:47:18.757688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211215+0000","last_change":"2024-08-19T00:48:49.225451+0000","last_active":"2024-08-19T00:48:50.211215+0000","last_peered":"2024-08-19T00:48:50.211215+0000","last_clean":"2024-08-19T00:48:50.211215+0000","last_became_active":"2024-08-19T00:48:49.225118+0000","last_became_peered":"2024-08-19T00:48:49.225118+0000","last_unstale":"2024-08-19T00:48:50.211215+0000","last_undegraded":"2024-08-19T00:48:50.211215+0000","last_fullsized":"2024-08-19T00:48:50.211215+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:41:24.144258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212645+0000","last_change":"2024-08-19T00:48:49.232332+0000","last_active":"2024-08-19T00:48:50.212645+0000","last_peered":"2024-08-19T00:48:50.212645+0000","last_clean":"2024-08-19T00:48:50.212645+0000","last_became_active":"2024-08-19T00:48:49.231951+0000","last_became_peered":"2024-08-19T00:48:49.231951+0000","last_unstale":"2024-08-19T00:48:50.212645+0000","last_undegraded":"2024-08-19T00:48:50.212645+0000","last_fullsized":"2024-08-19T00:48:50.212645+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:51.216860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359232+0000","last_change":"2024-08-19T00:48:49.210842+0000","last_active":"2024-08-19T00:48:50.359232+0000","last_peered":"2024-08-19T00:48:50.359232+0000","last_clean":"2024-08-19T00:48:50.359232+0000","last_became_active":"2024-08-19T00:48:49.210516+0000","last_became_peered":"2024-08-19T00:48:49.210516+0000","last_unstale":"2024-08-19T00:48:50.359232+0000","last_undegraded":"2024-08-19T00:48:50.359232+0000","last_fullsized":"2024-08-19T00:48:50.359232+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:54:18.803851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357918+0000","last_change":"2024-08-19T00:48:49.223503+0000","last_active":"2024-08-19T00:48:50.357918+0000","last_peered":"2024-08-19T00:48:50.357918+0000","last_clean":"2024-08-19T00:48:50.357918+0000","last_became_active":"2024-08-19T00:48:49.223183+0000","last_became_peered":"2024-08-19T00:48:49.223183+0000","last_unstale":"2024-08-19T00:48:50.357918+0000","last_undegraded":"2024-08-19T00:48:50.357918+0000","last_fullsized":"2024-08-19T00:48:50.357918+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:39:36.806933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357680+0000","last_change":"2024-08-19T00:48:49.226419+0000","last_active":"2024-08-19T00:48:50.357680+0000","last_peered":"2024-08-19T00:48:50.357680+0000","last_clean":"2024-08-19T00:48:50.357680+0000","last_became_active":"2024-08-19T00:48:49.226111+0000","last_became_peered":"2024-08-19T00:48:49.226111+0000","last_unstale":"2024-08-19T00:48:50.357680+0000","last_undegraded":"2024-08-19T00:48:50.357680+0000","last_fullsized":"2024-08-19T00:48:50.357680+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:35:59.670605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210316+0000","last_change":"2024-08-19T00:48:49.220798+0000","last_active":"2024-08-19T00:48:50.210316+0000","last_peered":"2024-08-19T00:48:50.210316+0000","last_clean":"2024-08-19T00:48:50.210316+0000","last_became_active":"2024-08-19T00:48:49.218893+0000","last_became_peered":"2024-08-19T00:48:49.218893+0000","last_unstale":"2024-08-19T00:48:50.210316+0000","last_undegraded":"2024-08-19T00:48:50.210316+0000","last_fullsized":"2024-08-19T00:48:50.210316+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:16.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212030+0000","last_change":"2024-08-19T00:48:49.208959+0000","last_active":"2024-08-19T00:48:50.212030+0000","last_peered":"2024-08-19T00:48:50.212030+0000","last_clean":"2024-08-19T00:48:50.212030+0000","last_became_active":"2024-08-19T00:48:49.208644+0000","last_became_peered":"2024-08-19T00:48:49.208644+0000","last_unstale":"2024-08-19T00:48:50.212030+0000","last_undegraded":"2024-08-19T00:48:50.212030+0000","last_fullsized":"2024-08-19T00:48:50.212030+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:42.348077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358005+0000","last_change":"2024-08-19T00:48:49.227606+0000","last_active":"2024-08-19T00:48:50.358005+0000","last_peered":"2024-08-19T00:48:50.358005+0000","last_clean":"2024-08-19T00:48:50.358005+0000","last_became_active":"2024-08-19T00:48:49.227217+0000","last_became_peered":"2024-08-19T00:48:49.227217+0000","last_unstale":"2024-08-19T00:48:50.358005+0000","last_undegraded":"2024-08-19T00:48:50.358005+0000","last_fullsized":"2024-08-19T00:48:50.358005+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:23.857492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211925+0000","last_change":"2024-08-19T00:48:49.217249+0000","last_active":"2024-08-19T00:48:50.211925+0000","last_peered":"2024-08-19T00:48:50.211925+0000","last_clean":"2024-08-19T00:48:50.211925+0000","last_became_active":"2024-08-19T00:48:49.216976+0000","last_became_peered":"2024-08-19T00:48:49.216976+0000","last_unstale":"2024-08-19T00:48:50.211925+0000","last_undegraded":"2024-08-19T00:48:50.211925+0000","last_fullsized":"2024-08-19T00:48:50.211925+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:12:20.784123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212694+0000","last_change":"2024-08-19T00:48:49.229258+0000","last_active":"2024-08-19T00:48:50.212694+0000","last_peered":"2024-08-19T00:48:50.212694+0000","last_clean":"2024-08-19T00:48:50.212694+0000","last_became_active":"2024-08-19T00:48:49.228982+0000","last_became_peered":"2024-08-19T00:48:49.228982+0000","last_unstale":"2024-08-19T00:48:50.212694+0000","last_undegraded":"2024-08-19T00:48:50.212694+0000","last_fullsized":"2024-08-19T00:48:50.212694+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:39.953171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358122+0000","last_change":"2024-08-19T00:48:49.217957+0000","last_active":"2024-08-19T00:48:50.358122+0000","last_peered":"2024-08-19T00:48:50.358122+0000","last_clean":"2024-08-19T00:48:50.358122+0000","last_became_active":"2024-08-19T00:48:49.217615+0000","last_became_peered":"2024-08-19T00:48:49.217615+0000","last_unstale":"2024-08-19T00:48:50.358122+0000","last_undegraded":"2024-08-19T00:48:50.358122+0000","last_fullsized":"2024-08-19T00:48:50.358122+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:51.089719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359443+0000","last_change":"2024-08-19T00:48:49.211721+0000","last_active":"2024-08-19T00:48:50.359443+0000","last_peered":"2024-08-19T00:48:50.359443+0000","last_clean":"2024-08-19T00:48:50.359443+0000","last_became_active":"2024-08-19T00:48:49.211192+0000","last_became_peered":"2024-08-19T00:48:49.211192+0000","last_unstale":"2024-08-19T00:48:50.359443+0000","last_undegraded":"2024-08-19T00:48:50.359443+0000","last_fullsized":"2024-08-19T00:48:50.359443+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:19:23.984961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357964+0000","last_change":"2024-08-19T00:48:49.226394+0000","last_active":"2024-08-19T00:48:50.357964+0000","last_peered":"2024-08-19T00:48:50.357964+0000","last_clean":"2024-08-19T00:48:50.357964+0000","last_became_active":"2024-08-19T00:48:49.225507+0000","last_became_peered":"2024-08-19T00:48:49.225507+0000","last_unstale":"2024-08-19T00:48:50.357964+0000","last_undegraded":"2024-08-19T00:48:50.357964+0000","last_fullsized":"2024-08-19T00:48:50.357964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:51.438542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322815+0000","last_change":"2024-08-19T00:48:49.228727+0000","last_active":"2024-08-19T00:48:50.322815+0000","last_peered":"2024-08-19T00:48:50.322815+0000","last_clean":"2024-08-19T00:48:50.322815+0000","last_became_active":"2024-08-19T00:48:49.228369+0000","last_became_peered":"2024-08-19T00:48:49.228369+0000","last_unstale":"2024-08-19T00:48:50.322815+0000","last_undegraded":"2024-08-19T00:48:50.322815+0000","last_fullsized":"2024-08-19T00:48:50.322815+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:11:13.470064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356791+0000","last_change":"2024-08-19T00:48:49.223877+0000","last_active":"2024-08-19T00:48:50.356791+0000","last_peered":"2024-08-19T00:48:50.356791+0000","last_clean":"2024-08-19T00:48:50.356791+0000","last_became_active":"2024-08-19T00:48:49.222463+0000","last_became_peered":"2024-08-19T00:48:49.222463+0000","last_unstale":"2024-08-19T00:48:50.356791+0000","last_undegraded":"2024-08-19T00:48:50.356791+0000","last_fullsized":"2024-08-19T00:48:50.356791+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:40.751275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359240+0000","last_change":"2024-08-19T00:48:49.212913+0000","last_active":"2024-08-19T00:48:50.359240+0000","last_peered":"2024-08-19T00:48:50.359240+0000","last_clean":"2024-08-19T00:48:50.359240+0000","last_became_active":"2024-08-19T00:48:49.212508+0000","last_became_peered":"2024-08-19T00:48:49.212508+0000","last_unstale":"2024-08-19T00:48:50.359240+0000","last_undegraded":"2024-08-19T00:48:50.359240+0000","last_fullsized":"2024-08-19T00:48:50.359240+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:31.755269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323108+0000","last_change":"2024-08-19T00:48:49.222745+0000","last_active":"2024-08-19T00:48:50.323108+0000","last_peered":"2024-08-19T00:48:50.323108+0000","last_clean":"2024-08-19T00:48:50.323108+0000","last_became_active":"2024-08-19T00:48:49.222445+0000","last_became_peered":"2024-08-19T00:48:49.222445+0000","last_unstale":"2024-08-19T00:48:50.323108+0000","last_undegraded":"2024-08-19T00:48:50.323108+0000","last_fullsized":"2024-08-19T00:48:50.323108+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:34:24.315885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323090+0000","last_change":"2024-08-19T00:48:49.229752+0000","last_active":"2024-08-19T00:48:50.323090+0000","last_peered":"2024-08-19T00:48:50.323090+0000","last_clean":"2024-08-19T00:48:50.323090+0000","last_became_active":"2024-08-19T00:48:49.228061+0000","last_became_peered":"2024-08-19T00:48:49.228061+0000","last_unstale":"2024-08-19T00:48:50.323090+0000","last_undegraded":"2024-08-19T00:48:50.323090+0000","last_fullsized":"2024-08-19T00:48:50.323090+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:55.810248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359434+0000","last_change":"2024-08-19T00:48:49.212934+0000","last_active":"2024-08-19T00:48:50.359434+0000","last_peered":"2024-08-19T00:48:50.359434+0000","last_clean":"2024-08-19T00:48:50.359434+0000","last_became_active":"2024-08-19T00:48:49.212586+0000","last_became_peered":"2024-08-19T00:48:49.212586+0000","last_unstale":"2024-08-19T00:48:50.359434+0000","last_undegraded":"2024-08-19T00:48:50.359434+0000","last_fullsized":"2024-08-19T00:48:50.359434+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:58:38.734621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359441+0000","last_change":"2024-08-19T00:48:49.209357+0000","last_active":"2024-08-19T00:48:50.359441+0000","last_peered":"2024-08-19T00:48:50.359441+0000","last_clean":"2024-08-19T00:48:50.359441+0000","last_became_active":"2024-08-19T00:48:49.209045+0000","last_became_peered":"2024-08-19T00:48:49.209045+0000","last_unstale":"2024-08-19T00:48:50.359441+0000","last_undegraded":"2024-08-19T00:48:50.359441+0000","last_fullsized":"2024-08-19T00:48:50.359441+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:41.958566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357965+0000","last_change":"2024-08-19T00:48:49.219296+0000","last_active":"2024-08-19T00:48:50.357965+0000","last_peered":"2024-08-19T00:48:50.357965+0000","last_clean":"2024-08-19T00:48:50.357965+0000","last_became_active":"2024-08-19T00:48:49.218345+0000","last_became_peered":"2024-08-19T00:48:49.218345+0000","last_unstale":"2024-08-19T00:48:50.357965+0000","last_undegraded":"2024-08-19T00:48:50.357965+0000","last_fullsized":"2024-08-19T00:48:50.357965+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:21.352800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357455+0000","last_change":"2024-08-19T00:48:49.226498+0000","last_active":"2024-08-19T00:48:50.357455+0000","last_peered":"2024-08-19T00:48:50.357455+0000","last_clean":"2024-08-19T00:48:50.357455+0000","last_became_active":"2024-08-19T00:48:49.226146+0000","last_became_peered":"2024-08-19T00:48:49.226146+0000","last_unstale":"2024-08-19T00:48:50.357455+0000","last_undegraded":"2024-08-19T00:48:50.357455+0000","last_fullsized":"2024-08-19T00:48:50.357455+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:16.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212005+0000","last_change":"2024-08-19T00:48:49.217149+0000","last_active":"2024-08-19T00:48:50.212005+0000","last_peered":"2024-08-19T00:48:50.212005+0000","last_clean":"2024-08-19T00:48:50.212005+0000","last_became_active":"2024-08-19T00:48:49.214606+0000","last_became_peered":"2024-08-19T00:48:49.214606+0000","last_unstale":"2024-08-19T00:48:50.212005+0000","last_undegraded":"2024-08-19T00:48:50.212005+0000","last_fullsized":"2024-08-19T00:48:50.212005+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:50.049492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"135'4","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359611+0000","last_change":"2024-08-19T00:48:48.216595+0000","last_active":"2024-08-19T00:48:50.359611+0000","last_peered":"2024-08-19T00:48:50.359611+0000","last_clean":"2024-08-19T00:48:50.359611+0000","last_became_active":"2024-08-19T00:48:48.216316+0000","last_became_peered":"2024-08-19T00:48:48.216316+0000","last_unstale":"2024-08-19T00:48:50.359611+0000","last_undegraded":"2024-08-19T00:48:50.359611+0000","last_fullsized":"2024-08-19T00:48:50.359611+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:06.580902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359609+0000","last_change":"2024-08-19T00:48:49.216462+0000","last_active":"2024-08-19T00:48:50.359609+0000","last_peered":"2024-08-19T00:48:50.359609+0000","last_clean":"2024-08-19T00:48:50.359609+0000","last_became_active":"2024-08-19T00:48:49.215847+0000","last_became_peered":"2024-08-19T00:48:49.215847+0000","last_unstale":"2024-08-19T00:48:50.359609+0000","last_undegraded":"2024-08-19T00:48:50.359609+0000","last_fullsized":"2024-08-19T00:48:50.359609+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:17:41.323414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210951+0000","last_change":"2024-08-19T00:48:48.201682+0000","last_active":"2024-08-19T00:48:50.210951+0000","last_peered":"2024-08-19T00:48:50.210951+0000","last_clean":"2024-08-19T00:48:50.210951+0000","last_became_active":"2024-08-19T00:48:48.200686+0000","last_became_peered":"2024-08-19T00:48:48.200686+0000","last_unstale":"2024-08-19T00:48:50.210951+0000","last_undegraded":"2024-08-19T00:48:50.210951+0000","last_fullsized":"2024-08-19T00:48:50.210951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:08.922540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358048+0000","last_change":"2024-08-19T00:48:49.220197+0000","last_active":"2024-08-19T00:48:50.358048+0000","last_peered":"2024-08-19T00:48:50.358048+0000","last_clean":"2024-08-19T00:48:50.358048+0000","last_became_active":"2024-08-19T00:48:49.219052+0000","last_became_peered":"2024-08-19T00:48:49.219052+0000","last_unstale":"2024-08-19T00:48:50.358048+0000","last_undegraded":"2024-08-19T00:48:50.358048+0000","last_fullsized":"2024-08-19T00:48:50.358048+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:46:49.241338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358247+0000","last_change":"2024-08-19T00:48:48.216073+0000","last_active":"2024-08-19T00:48:50.358247+0000","last_peered":"2024-08-19T00:48:50.358247+0000","last_clean":"2024-08-19T00:48:50.358247+0000","last_became_active":"2024-08-19T00:48:48.215245+0000","last_became_peered":"2024-08-19T00:48:48.215245+0000","last_unstale":"2024-08-19T00:48:50.358247+0000","last_undegraded":"2024-08-19T00:48:50.358247+0000","last_fullsized":"2024-08-19T00:48:50.358247+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:50.144148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356760+0000","last_change":"2024-08-19T00:48:49.211845+0000","last_active":"2024-08-19T00:48:50.356760+0000","last_peered":"2024-08-19T00:48:50.356760+0000","last_clean":"2024-08-19T00:48:50.356760+0000","last_became_active":"2024-08-19T00:48:49.211503+0000","last_became_peered":"2024-08-19T00:48:49.211503+0000","last_unstale":"2024-08-19T00:48:50.356760+0000","last_undegraded":"2024-08-19T00:48:50.356760+0000","last_fullsized":"2024-08-19T00:48:50.356760+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:51.089719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358425+0000","last_change":"2024-08-19T00:48:48.220148+0000","last_active":"2024-08-19T00:48:50.358425+0000","last_peered":"2024-08-19T00:48:50.358425+0000","last_clean":"2024-08-19T00:48:50.358425+0000","last_became_active":"2024-08-19T00:48:48.219905+0000","last_became_peered":"2024-08-19T00:48:48.219905+0000","last_unstale":"2024-08-19T00:48:50.358425+0000","last_undegraded":"2024-08-19T00:48:50.358425+0000","last_fullsized":"2024-08-19T00:48:50.358425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:06.218094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212496+0000","last_change":"2024-08-19T00:48:49.225249+0000","last_active":"2024-08-19T00:48:50.212496+0000","last_peered":"2024-08-19T00:48:50.212496+0000","last_clean":"2024-08-19T00:48:50.212496+0000","last_became_active":"2024-08-19T00:48:49.224980+0000","last_became_peered":"2024-08-19T00:48:49.224980+0000","last_unstale":"2024-08-19T00:48:50.212496+0000","last_undegraded":"2024-08-19T00:48:50.212496+0000","last_fullsized":"2024-08-19T00:48:50.212496+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:04.078821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358446+0000","last_change":"2024-08-19T00:48:48.220443+0000","last_active":"2024-08-19T00:48:50.358446+0000","last_peered":"2024-08-19T00:48:50.358446+0000","last_clean":"2024-08-19T00:48:50.358446+0000","last_became_active":"2024-08-19T00:48:48.219869+0000","last_became_peered":"2024-08-19T00:48:48.219869+0000","last_unstale":"2024-08-19T00:48:50.358446+0000","last_undegraded":"2024-08-19T00:48:50.358446+0000","last_fullsized":"2024-08-19T00:48:50.358446+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:20.350013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210732+0000","last_change":"2024-08-19T00:48:49.215496+0000","last_active":"2024-08-19T00:48:50.210732+0000","last_peered":"2024-08-19T00:48:50.210732+0000","last_clean":"2024-08-19T00:48:50.210732+0000","last_became_active":"2024-08-19T00:48:49.215196+0000","last_became_peered":"2024-08-19T00:48:49.215196+0000","last_unstale":"2024-08-19T00:48:50.210732+0000","last_undegraded":"2024-08-19T00:48:50.210732+0000","last_fullsized":"2024-08-19T00:48:50.210732+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:51:46.693211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358416+0000","last_change":"2024-08-19T00:48:48.213395+0000","last_active":"2024-08-19T00:48:50.358416+0000","last_peered":"2024-08-19T00:48:50.358416+0000","last_clean":"2024-08-19T00:48:50.358416+0000","last_became_active":"2024-08-19T00:48:48.213061+0000","last_became_peered":"2024-08-19T00:48:48.213061+0000","last_unstale":"2024-08-19T00:48:50.358416+0000","last_undegraded":"2024-08-19T00:48:50.358416+0000","last_fullsized":"2024-08-19T00:48:50.358416+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:34:48.127858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358819+0000","last_change":"2024-08-19T00:48:49.214845+0000","last_active":"2024-08-19T00:48:50.358819+0000","last_peered":"2024-08-19T00:48:50.358819+0000","last_clean":"2024-08-19T00:48:50.358819+0000","last_became_active":"2024-08-19T00:48:49.208388+0000","last_became_peered":"2024-08-19T00:48:49.208388+0000","last_unstale":"2024-08-19T00:48:50.358819+0000","last_undegraded":"2024-08-19T00:48:50.358819+0000","last_fullsized":"2024-08-19T00:48:50.358819+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:28.008127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210949+0000","last_change":"2024-08-19T00:48:48.205355+0000","last_active":"2024-08-19T00:48:50.210949+0000","last_peered":"2024-08-19T00:48:50.210949+0000","last_clean":"2024-08-19T00:48:50.210949+0000","last_became_active":"2024-08-19T00:48:48.204985+0000","last_became_peered":"2024-08-19T00:48:48.204985+0000","last_unstale":"2024-08-19T00:48:50.210949+0000","last_undegraded":"2024-08-19T00:48:50.210949+0000","last_fullsized":"2024-08-19T00:48:50.210949+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:22.854705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212118+0000","last_change":"2024-08-19T00:48:49.226387+0000","last_active":"2024-08-19T00:48:50.212118+0000","last_peered":"2024-08-19T00:48:50.212118+0000","last_clean":"2024-08-19T00:48:50.212118+0000","last_became_active":"2024-08-19T00:48:49.224454+0000","last_became_peered":"2024-08-19T00:48:49.224454+0000","last_unstale":"2024-08-19T00:48:50.212118+0000","last_undegraded":"2024-08-19T00:48:50.212118+0000","last_fullsized":"2024-08-19T00:48:50.212118+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:34:49.130645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211310+0000","last_change":"2024-08-19T00:48:48.218710+0000","last_active":"2024-08-19T00:48:50.211310+0000","last_peered":"2024-08-19T00:48:50.211310+0000","last_clean":"2024-08-19T00:48:50.211310+0000","last_became_active":"2024-08-19T00:48:48.218435+0000","last_became_peered":"2024-08-19T00:48:48.218435+0000","last_unstale":"2024-08-19T00:48:50.211310+0000","last_undegraded":"2024-08-19T00:48:50.211310+0000","last_fullsized":"2024-08-19T00:48:50.211310+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:22.858469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358159+0000","last_change":"2024-08-19T00:48:49.224296+0000","last_active":"2024-08-19T00:48:50.358159+0000","last_peered":"2024-08-19T00:48:50.358159+0000","last_clean":"2024-08-19T00:48:50.358159+0000","last_became_active":"2024-08-19T00:48:49.223997+0000","last_became_peered":"2024-08-19T00:48:49.223997+0000","last_unstale":"2024-08-19T00:48:50.358159+0000","last_undegraded":"2024-08-19T00:48:50.358159+0000","last_fullsized":"2024-08-19T00:48:50.358159+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:09.925327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358918+0000","last_change":"2024-08-19T00:48:48.216769+0000","last_active":"2024-08-19T00:48:50.358918+0000","last_peered":"2024-08-19T00:48:50.358918+0000","last_clean":"2024-08-19T00:48:50.358918+0000","last_became_active":"2024-08-19T00:48:48.216515+0000","last_became_peered":"2024-08-19T00:48:48.216515+0000","last_unstale":"2024-08-19T00:48:50.358918+0000","last_undegraded":"2024-08-19T00:48:50.358918+0000","last_fullsized":"2024-08-19T00:48:50.358918+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:03.076034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323276+0000","last_change":"2024-08-19T00:48:49.219930+0000","last_active":"2024-08-19T00:48:50.323276+0000","last_peered":"2024-08-19T00:48:50.323276+0000","last_clean":"2024-08-19T00:48:50.323276+0000","last_became_active":"2024-08-19T00:48:49.219399+0000","last_became_peered":"2024-08-19T00:48:49.219399+0000","last_unstale":"2024-08-19T00:48:50.323276+0000","last_undegraded":"2024-08-19T00:48:50.323276+0000","last_fullsized":"2024-08-19T00:48:50.323276+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:12.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358993+0000","last_change":"2024-08-19T00:48:48.221556+0000","last_active":"2024-08-19T00:48:50.358993+0000","last_peered":"2024-08-19T00:48:50.358993+0000","last_clean":"2024-08-19T00:48:50.358993+0000","last_became_active":"2024-08-19T00:48:48.221242+0000","last_became_peered":"2024-08-19T00:48:48.221242+0000","last_unstale":"2024-08-19T00:48:50.358993+0000","last_undegraded":"2024-08-19T00:48:50.358993+0000","last_fullsized":"2024-08-19T00:48:50.358993+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:47:17.754901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210968+0000","last_change":"2024-08-19T00:48:49.216841+0000","last_active":"2024-08-19T00:48:50.210968+0000","last_peered":"2024-08-19T00:48:50.210968+0000","last_clean":"2024-08-19T00:48:50.210968+0000","last_became_active":"2024-08-19T00:48:49.216397+0000","last_became_peered":"2024-08-19T00:48:49.216397+0000","last_unstale":"2024-08-19T00:48:50.210968+0000","last_undegraded":"2024-08-19T00:48:50.210968+0000","last_fullsized":"2024-08-19T00:48:50.210968+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:05:45.929793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"135'3","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211317+0000","last_change":"2024-08-19T00:48:48.209462+0000","last_active":"2024-08-19T00:48:50.211317+0000","last_peered":"2024-08-19T00:48:50.211317+0000","last_clean":"2024-08-19T00:48:50.211317+0000","last_became_active":"2024-08-19T00:48:48.208111+0000","last_became_peered":"2024-08-19T00:48:48.208111+0000","last_unstale":"2024-08-19T00:48:50.211317+0000","last_undegraded":"2024-08-19T00:48:50.211317+0000","last_fullsized":"2024-08-19T00:48:50.211317+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:46:48.238550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323122+0000","last_change":"2024-08-19T00:48:49.223213+0000","last_active":"2024-08-19T00:48:50.323122+0000","last_peered":"2024-08-19T00:48:50.323122+0000","last_clean":"2024-08-19T00:48:50.323122+0000","last_became_active":"2024-08-19T00:48:49.222884+0000","last_became_peered":"2024-08-19T00:48:49.222884+0000","last_unstale":"2024-08-19T00:48:50.323122+0000","last_undegraded":"2024-08-19T00:48:50.323122+0000","last_fullsized":"2024-08-19T00:48:50.323122+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:53:17.879597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"135'6","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212767+0000","last_change":"2024-08-19T00:48:48.212384+0000","last_active":"2024-08-19T00:48:50.212767+0000","last_peered":"2024-08-19T00:48:50.212767+0000","last_clean":"2024-08-19T00:48:50.212767+0000","last_became_active":"2024-08-19T00:48:48.211415+0000","last_became_peered":"2024-08-19T00:48:48.211415+0000","last_unstale":"2024-08-19T00:48:50.212767+0000","last_undegraded":"2024-08-19T00:48:50.212767+0000","last_fullsized":"2024-08-19T00:48:50.212767+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:07:03.488668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358134+0000","last_change":"2024-08-19T00:48:49.229278+0000","last_active":"2024-08-19T00:48:50.358134+0000","last_peered":"2024-08-19T00:48:50.358134+0000","last_clean":"2024-08-19T00:48:50.358134+0000","last_became_active":"2024-08-19T00:48:49.228972+0000","last_became_peered":"2024-08-19T00:48:49.228972+0000","last_unstale":"2024-08-19T00:48:50.358134+0000","last_undegraded":"2024-08-19T00:48:50.358134+0000","last_fullsized":"2024-08-19T00:48:50.358134+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:11:13.470064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211555+0000","last_change":"2024-08-19T00:48:48.207398+0000","last_active":"2024-08-19T00:48:50.211555+0000","last_peered":"2024-08-19T00:48:50.211555+0000","last_clean":"2024-08-19T00:48:50.211555+0000","last_became_active":"2024-08-19T00:48:48.207089+0000","last_became_peered":"2024-08-19T00:48:48.207089+0000","last_unstale":"2024-08-19T00:48:50.211555+0000","last_undegraded":"2024-08-19T00:48:50.211555+0000","last_fullsized":"2024-08-19T00:48:50.211555+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:06:55.706096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358306+0000","last_change":"2024-08-19T00:48:49.222097+0000","last_active":"2024-08-19T00:48:50.358306+0000","last_peered":"2024-08-19T00:48:50.358306+0000","last_clean":"2024-08-19T00:48:50.358306+0000","last_became_active":"2024-08-19T00:48:49.220010+0000","last_became_peered":"2024-08-19T00:48:49.220010+0000","last_unstale":"2024-08-19T00:48:50.358306+0000","last_undegraded":"2024-08-19T00:48:50.358306+0000","last_fullsized":"2024-08-19T00:48:50.358306+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:09.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358250+0000","last_change":"2024-08-19T00:48:48.219012+0000","last_active":"2024-08-19T00:48:50.358250+0000","last_peered":"2024-08-19T00:48:50.358250+0000","last_clean":"2024-08-19T00:48:50.358250+0000","last_became_active":"2024-08-19T00:48:48.218757+0000","last_became_peered":"2024-08-19T00:48:48.218757+0000","last_unstale":"2024-08-19T00:48:50.358250+0000","last_undegraded":"2024-08-19T00:48:50.358250+0000","last_fullsized":"2024-08-19T00:48:50.358250+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:03.745588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210364+0000","last_change":"2024-08-19T00:48:49.215334+0000","last_active":"2024-08-19T00:48:50.210364+0000","last_peered":"2024-08-19T00:48:50.210364+0000","last_clean":"2024-08-19T00:48:50.210364+0000","last_became_active":"2024-08-19T00:48:49.215045+0000","last_became_peered":"2024-08-19T00:48:49.215045+0000","last_unstale":"2024-08-19T00:48:50.210364+0000","last_undegraded":"2024-08-19T00:48:50.210364+0000","last_fullsized":"2024-08-19T00:48:50.210364+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:18.147803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212417+0000","last_change":"2024-08-19T00:48:48.215675+0000","last_active":"2024-08-19T00:48:50.212417+0000","last_peered":"2024-08-19T00:48:50.212417+0000","last_clean":"2024-08-19T00:48:50.212417+0000","last_became_active":"2024-08-19T00:48:48.214176+0000","last_became_peered":"2024-08-19T00:48:48.214176+0000","last_unstale":"2024-08-19T00:48:50.212417+0000","last_undegraded":"2024-08-19T00:48:50.212417+0000","last_fullsized":"2024-08-19T00:48:50.212417+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:06.075019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358139+0000","last_change":"2024-08-19T00:48:49.229077+0000","last_active":"2024-08-19T00:48:50.358139+0000","last_peered":"2024-08-19T00:48:50.358139+0000","last_clean":"2024-08-19T00:48:50.358139+0000","last_became_active":"2024-08-19T00:48:49.228668+0000","last_became_peered":"2024-08-19T00:48:49.228668+0000","last_unstale":"2024-08-19T00:48:50.358139+0000","last_undegraded":"2024-08-19T00:48:50.358139+0000","last_fullsized":"2024-08-19T00:48:50.358139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:40.751275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"135'8","reported_seq":22,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357648+0000","last_change":"2024-08-19T00:48:48.218303+0000","last_active":"2024-08-19T00:48:50.357648+0000","last_peered":"2024-08-19T00:48:50.357648+0000","last_clean":"2024-08-19T00:48:50.357648+0000","last_became_active":"2024-08-19T00:48:48.215818+0000","last_became_peered":"2024-08-19T00:48:48.215818+0000","last_unstale":"2024-08-19T00:48:50.357648+0000","last_undegraded":"2024-08-19T00:48:50.357648+0000","last_fullsized":"2024-08-19T00:48:50.357648+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:01.572985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323290+0000","last_change":"2024-08-19T00:48:49.234475+0000","last_active":"2024-08-19T00:48:50.323290+0000","last_peered":"2024-08-19T00:48:50.323290+0000","last_clean":"2024-08-19T00:48:50.323290+0000","last_became_active":"2024-08-19T00:48:49.234156+0000","last_became_peered":"2024-08-19T00:48:49.234156+0000","last_unstale":"2024-08-19T00:48:50.323290+0000","last_undegraded":"2024-08-19T00:48:50.323290+0000","last_fullsized":"2024-08-19T00:48:50.323290+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:57.483451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212897+0000","last_change":"2024-08-19T00:48:48.212321+0000","last_active":"2024-08-19T00:48:50.212897+0000","last_peered":"2024-08-19T00:48:50.212897+0000","last_clean":"2024-08-19T00:48:50.212897+0000","last_became_active":"2024-08-19T00:48:48.211407+0000","last_became_peered":"2024-08-19T00:48:48.211407+0000","last_unstale":"2024-08-19T00:48:50.212897+0000","last_undegraded":"2024-08-19T00:48:50.212897+0000","last_fullsized":"2024-08-19T00:48:50.212897+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:38:04.625051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323043+0000","last_change":"2024-08-19T00:48:49.232952+0000","last_active":"2024-08-19T00:48:50.323043+0000","last_peered":"2024-08-19T00:48:50.323043+0000","last_clean":"2024-08-19T00:48:50.323043+0000","last_became_active":"2024-08-19T00:48:49.232132+0000","last_became_peered":"2024-08-19T00:48:49.232132+0000","last_unstale":"2024-08-19T00:48:50.323043+0000","last_undegraded":"2024-08-19T00:48:50.323043+0000","last_fullsized":"2024-08-19T00:48:50.323043+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:58.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211330+0000","last_change":"2024-08-19T00:48:48.215129+0000","last_active":"2024-08-19T00:48:50.211330+0000","last_peered":"2024-08-19T00:48:50.211330+0000","last_clean":"2024-08-19T00:48:50.211330+0000","last_became_active":"2024-08-19T00:48:48.214770+0000","last_became_peered":"2024-08-19T00:48:48.214770+0000","last_unstale":"2024-08-19T00:48:50.211330+0000","last_undegraded":"2024-08-19T00:48:50.211330+0000","last_fullsized":"2024-08-19T00:48:50.211330+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:11:12.467277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212783+0000","last_change":"2024-08-19T00:48:49.225080+0000","last_active":"2024-08-19T00:48:50.212783+0000","last_peered":"2024-08-19T00:48:50.212783+0000","last_clean":"2024-08-19T00:48:50.212783+0000","last_became_active":"2024-08-19T00:48:49.224813+0000","last_became_peered":"2024-08-19T00:48:49.224813+0000","last_unstale":"2024-08-19T00:48:50.212783+0000","last_undegraded":"2024-08-19T00:48:50.212783+0000","last_fullsized":"2024-08-19T00:48:50.212783+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:39.149663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211581+0000","last_change":"2024-08-19T00:48:48.205722+0000","last_active":"2024-08-19T00:48:50.211581+0000","last_peered":"2024-08-19T00:48:50.211581+0000","last_clean":"2024-08-19T00:48:50.211581+0000","last_became_active":"2024-08-19T00:48:48.205301+0000","last_became_peered":"2024-08-19T00:48:48.205301+0000","last_unstale":"2024-08-19T00:48:50.211581+0000","last_undegraded":"2024-08-19T00:48:50.211581+0000","last_fullsized":"2024-08-19T00:48:50.211581+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:15.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211400+0000","last_change":"2024-08-19T00:48:49.208831+0000","last_active":"2024-08-19T00:48:50.211400+0000","last_peered":"2024-08-19T00:48:50.211400+0000","last_clean":"2024-08-19T00:48:50.211400+0000","last_became_active":"2024-08-19T00:48:49.208425+0000","last_became_peered":"2024-08-19T00:48:49.208425+0000","last_unstale":"2024-08-19T00:48:50.211400+0000","last_undegraded":"2024-08-19T00:48:50.211400+0000","last_fullsized":"2024-08-19T00:48:50.211400+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:34:24.315885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358549+0000","last_change":"2024-08-19T00:48:48.221268+0000","last_active":"2024-08-19T00:48:50.358549+0000","last_peered":"2024-08-19T00:48:50.358549+0000","last_clean":"2024-08-19T00:48:50.358549+0000","last_became_active":"2024-08-19T00:48:48.220254+0000","last_became_peered":"2024-08-19T00:48:48.220254+0000","last_unstale":"2024-08-19T00:48:50.358549+0000","last_undegraded":"2024-08-19T00:48:50.358549+0000","last_fullsized":"2024-08-19T00:48:50.358549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:50.086932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211503+0000","last_change":"2024-08-19T00:48:49.211878+0000","last_active":"2024-08-19T00:48:50.211503+0000","last_peered":"2024-08-19T00:48:50.211503+0000","last_clean":"2024-08-19T00:48:50.211503+0000","last_became_active":"2024-08-19T00:48:49.211600+0000","last_became_peered":"2024-08-19T00:48:49.211600+0000","last_unstale":"2024-08-19T00:48:50.211503+0000","last_undegraded":"2024-08-19T00:48:50.211503+0000","last_fullsized":"2024-08-19T00:48:50.211503+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:12.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322798+0000","last_change":"2024-08-19T00:48:48.216016+0000","last_active":"2024-08-19T00:48:50.322798+0000","last_peered":"2024-08-19T00:48:50.322798+0000","last_clean":"2024-08-19T00:48:50.322798+0000","last_became_active":"2024-08-19T00:48:48.214933+0000","last_became_peered":"2024-08-19T00:48:48.214933+0000","last_unstale":"2024-08-19T00:48:50.322798+0000","last_undegraded":"2024-08-19T00:48:50.322798+0000","last_fullsized":"2024-08-19T00:48:50.322798+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:41.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357523+0000","last_change":"2024-08-19T00:48:49.226468+0000","last_active":"2024-08-19T00:48:50.357523+0000","last_peered":"2024-08-19T00:48:50.357523+0000","last_clean":"2024-08-19T00:48:50.357523+0000","last_became_active":"2024-08-19T00:48:49.226134+0000","last_became_peered":"2024-08-19T00:48:49.226134+0000","last_unstale":"2024-08-19T00:48:50.357523+0000","last_undegraded":"2024-08-19T00:48:50.357523+0000","last_fullsized":"2024-08-19T00:48:50.357523+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:33.775288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356671+0000","last_change":"2024-08-19T00:48:48.205845+0000","last_active":"2024-08-19T00:48:50.356671+0000","last_peered":"2024-08-19T00:48:50.356671+0000","last_clean":"2024-08-19T00:48:50.356671+0000","last_became_active":"2024-08-19T00:48:48.205314+0000","last_became_peered":"2024-08-19T00:48:48.205314+0000","last_unstale":"2024-08-19T00:48:50.356671+0000","last_undegraded":"2024-08-19T00:48:50.356671+0000","last_fullsized":"2024-08-19T00:48:50.356671+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:01.572985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322901+0000","last_change":"2024-08-19T00:48:49.231724+0000","last_active":"2024-08-19T00:48:50.322901+0000","last_peered":"2024-08-19T00:48:50.322901+0000","last_clean":"2024-08-19T00:48:50.322901+0000","last_became_active":"2024-08-19T00:48:49.230075+0000","last_became_peered":"2024-08-19T00:48:49.230075+0000","last_unstale":"2024-08-19T00:48:50.322901+0000","last_undegraded":"2024-08-19T00:48:50.322901+0000","last_fullsized":"2024-08-19T00:48:50.322901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:09.925327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358055+0000","last_change":"2024-08-19T00:48:48.214177+0000","last_active":"2024-08-19T00:48:50.358055+0000","last_peered":"2024-08-19T00:48:50.358055+0000","last_clean":"2024-08-19T00:48:50.358055+0000","last_became_active":"2024-08-19T00:48:48.211573+0000","last_became_peered":"2024-08-19T00:48:48.211573+0000","last_unstale":"2024-08-19T00:48:50.358055+0000","last_undegraded":"2024-08-19T00:48:50.358055+0000","last_fullsized":"2024-08-19T00:48:50.358055+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:40.955778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212151+0000","last_change":"2024-08-19T00:48:49.213176+0000","last_active":"2024-08-19T00:48:50.212151+0000","last_peered":"2024-08-19T00:48:50.212151+0000","last_clean":"2024-08-19T00:48:50.212151+0000","last_became_active":"2024-08-19T00:48:49.212861+0000","last_became_peered":"2024-08-19T00:48:49.212861+0000","last_unstale":"2024-08-19T00:48:50.212151+0000","last_undegraded":"2024-08-19T00:48:50.212151+0000","last_fullsized":"2024-08-19T00:48:50.212151+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:38.325653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212800+0000","last_change":"2024-08-19T00:48:48.216298+0000","last_active":"2024-08-19T00:48:50.212800+0000","last_peered":"2024-08-19T00:48:50.212800+0000","last_clean":"2024-08-19T00:48:50.212800+0000","last_became_active":"2024-08-19T00:48:48.215138+0000","last_became_peered":"2024-08-19T00:48:48.215138+0000","last_unstale":"2024-08-19T00:48:50.212800+0000","last_undegraded":"2024-08-19T00:48:50.212800+0000","last_fullsized":"2024-08-19T00:48:50.212800+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:21.305464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211993+0000","last_change":"2024-08-19T00:48:49.218503+0000","last_active":"2024-08-19T00:48:50.211993+0000","last_peered":"2024-08-19T00:48:50.211993+0000","last_clean":"2024-08-19T00:48:50.211993+0000","last_became_active":"2024-08-19T00:48:49.218060+0000","last_became_peered":"2024-08-19T00:48:49.218060+0000","last_unstale":"2024-08-19T00:48:50.211993+0000","last_undegraded":"2024-08-19T00:48:50.211993+0000","last_fullsized":"2024-08-19T00:48:50.211993+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:42.945883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212293+0000","last_change":"2024-08-19T00:48:48.218366+0000","last_active":"2024-08-19T00:48:50.212293+0000","last_peered":"2024-08-19T00:48:50.212293+0000","last_clean":"2024-08-19T00:48:50.212293+0000","last_became_active":"2024-08-19T00:48:48.217451+0000","last_became_peered":"2024-08-19T00:48:48.217451+0000","last_unstale":"2024-08-19T00:48:50.212293+0000","last_undegraded":"2024-08-19T00:48:50.212293+0000","last_fullsized":"2024-08-19T00:48:50.212293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:32.772501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358614+0000","last_change":"2024-08-19T00:48:49.227812+0000","last_active":"2024-08-19T00:48:50.358614+0000","last_peered":"2024-08-19T00:48:50.358614+0000","last_clean":"2024-08-19T00:48:50.358614+0000","last_became_active":"2024-08-19T00:48:49.227495+0000","last_became_peered":"2024-08-19T00:48:49.227495+0000","last_unstale":"2024-08-19T00:48:50.358614+0000","last_undegraded":"2024-08-19T00:48:50.358614+0000","last_fullsized":"2024-08-19T00:48:50.358614+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:43.564965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211875+0000","last_change":"2024-08-19T00:48:48.214983+0000","last_active":"2024-08-19T00:48:50.211875+0000","last_peered":"2024-08-19T00:48:50.211875+0000","last_clean":"2024-08-19T00:48:50.211875+0000","last_became_active":"2024-08-19T00:48:48.214669+0000","last_became_peered":"2024-08-19T00:48:48.214669+0000","last_unstale":"2024-08-19T00:48:50.211875+0000","last_undegraded":"2024-08-19T00:48:50.211875+0000","last_fullsized":"2024-08-19T00:48:50.211875+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:18:31.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211235+0000","last_change":"2024-08-19T00:48:49.213810+0000","last_active":"2024-08-19T00:48:50.211235+0000","last_peered":"2024-08-19T00:48:50.211235+0000","last_clean":"2024-08-19T00:48:50.211235+0000","last_became_active":"2024-08-19T00:48:49.213472+0000","last_became_peered":"2024-08-19T00:48:49.213472+0000","last_unstale":"2024-08-19T00:48:50.211235+0000","last_undegraded":"2024-08-19T00:48:50.211235+0000","last_fullsized":"2024-08-19T00:48:50.211235+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:14.744035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323139+0000","last_change":"2024-08-19T00:48:48.213672+0000","last_active":"2024-08-19T00:48:50.323139+0000","last_peered":"2024-08-19T00:48:50.323139+0000","last_clean":"2024-08-19T00:48:50.323139+0000","last_became_active":"2024-08-19T00:48:48.213137+0000","last_became_peered":"2024-08-19T00:48:48.213137+0000","last_unstale":"2024-08-19T00:48:50.323139+0000","last_undegraded":"2024-08-19T00:48:50.323139+0000","last_fullsized":"2024-08-19T00:48:50.323139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:22.858469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211417+0000","last_change":"2024-08-19T00:48:49.215289+0000","last_active":"2024-08-19T00:48:50.211417+0000","last_peered":"2024-08-19T00:48:50.211417+0000","last_clean":"2024-08-19T00:48:50.211417+0000","last_became_active":"2024-08-19T00:48:49.215019+0000","last_became_peered":"2024-08-19T00:48:49.215019+0000","last_unstale":"2024-08-19T00:48:50.211417+0000","last_undegraded":"2024-08-19T00:48:50.211417+0000","last_fullsized":"2024-08-19T00:48:50.211417+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:53:17.879597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358425+0000","last_change":"2024-08-19T00:48:48.220655+0000","last_active":"2024-08-19T00:48:50.358425+0000","last_peered":"2024-08-19T00:48:50.358425+0000","last_clean":"2024-08-19T00:48:50.358425+0000","last_became_active":"2024-08-19T00:48:48.220402+0000","last_became_peered":"2024-08-19T00:48:48.220402+0000","last_unstale":"2024-08-19T00:48:50.358425+0000","last_undegraded":"2024-08-19T00:48:50.358425+0000","last_fullsized":"2024-08-19T00:48:50.358425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:50.214072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210744+0000","last_change":"2024-08-19T00:48:49.213835+0000","last_active":"2024-08-19T00:48:50.210744+0000","last_peered":"2024-08-19T00:48:50.210744+0000","last_clean":"2024-08-19T00:48:50.210744+0000","last_became_active":"2024-08-19T00:48:49.213208+0000","last_became_peered":"2024-08-19T00:48:49.213208+0000","last_unstale":"2024-08-19T00:48:50.210744+0000","last_undegraded":"2024-08-19T00:48:50.210744+0000","last_fullsized":"2024-08-19T00:48:50.210744+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:23:15.620588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322861+0000","last_change":"2024-08-19T00:48:48.212463+0000","last_active":"2024-08-19T00:48:50.322861+0000","last_peered":"2024-08-19T00:48:50.322861+0000","last_clean":"2024-08-19T00:48:50.322861+0000","last_became_active":"2024-08-19T00:48:48.212189+0000","last_became_peered":"2024-08-19T00:48:48.212189+0000","last_unstale":"2024-08-19T00:48:50.322861+0000","last_undegraded":"2024-08-19T00:48:50.322861+0000","last_fullsized":"2024-08-19T00:48:50.322861+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:54:01.932765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211713+0000","last_change":"2024-08-19T00:48:49.208609+0000","last_active":"2024-08-19T00:48:50.211713+0000","last_peered":"2024-08-19T00:48:50.211713+0000","last_clean":"2024-08-19T00:48:50.211713+0000","last_became_active":"2024-08-19T00:48:49.208316+0000","last_became_peered":"2024-08-19T00:48:49.208316+0000","last_unstale":"2024-08-19T00:48:50.211713+0000","last_undegraded":"2024-08-19T00:48:50.211713+0000","last_fullsized":"2024-08-19T00:48:50.211713+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:57.483451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358953+0000","last_change":"2024-08-19T00:48:48.218780+0000","last_active":"2024-08-19T00:48:50.358953+0000","last_peered":"2024-08-19T00:48:50.358953+0000","last_clean":"2024-08-19T00:48:50.358953+0000","last_became_active":"2024-08-19T00:48:48.218142+0000","last_became_peered":"2024-08-19T00:48:48.218142+0000","last_unstale":"2024-08-19T00:48:50.358953+0000","last_undegraded":"2024-08-19T00:48:50.358953+0000","last_fullsized":"2024-08-19T00:48:50.358953+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:39:05.841876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212322+0000","last_change":"2024-08-19T00:48:49.222225+0000","last_active":"2024-08-19T00:48:50.212322+0000","last_peered":"2024-08-19T00:48:50.212322+0000","last_clean":"2024-08-19T00:48:50.212322+0000","last_became_active":"2024-08-19T00:48:49.221863+0000","last_became_peered":"2024-08-19T00:48:49.221863+0000","last_unstale":"2024-08-19T00:48:50.212322+0000","last_undegraded":"2024-08-19T00:48:50.212322+0000","last_fullsized":"2024-08-19T00:48:50.212322+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:51.146936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358189+0000","last_change":"2024-08-19T00:48:48.212777+0000","last_active":"2024-08-19T00:48:50.358189+0000","last_peered":"2024-08-19T00:48:50.358189+0000","last_clean":"2024-08-19T00:48:50.358189+0000","last_became_active":"2024-08-19T00:48:48.212502+0000","last_became_peered":"2024-08-19T00:48:48.212502+0000","last_unstale":"2024-08-19T00:48:50.358189+0000","last_undegraded":"2024-08-19T00:48:50.358189+0000","last_fullsized":"2024-08-19T00:48:50.358189+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:17:40.320627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358737+0000","last_change":"2024-08-19T00:48:49.220314+0000","last_active":"2024-08-19T00:48:50.358737+0000","last_peered":"2024-08-19T00:48:50.358737+0000","last_clean":"2024-08-19T00:48:50.358737+0000","last_became_active":"2024-08-19T00:48:49.219824+0000","last_became_peered":"2024-08-19T00:48:49.219824+0000","last_unstale":"2024-08-19T00:48:50.358737+0000","last_undegraded":"2024-08-19T00:48:50.358737+0000","last_fullsized":"2024-08-19T00:48:50.358737+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:14.874292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212912+0000","last_change":"2024-08-19T00:48:48.212548+0000","last_active":"2024-08-19T00:48:50.212912+0000","last_peered":"2024-08-19T00:48:50.212912+0000","last_clean":"2024-08-19T00:48:50.212912+0000","last_became_active":"2024-08-19T00:48:48.211959+0000","last_became_peered":"2024-08-19T00:48:48.211959+0000","last_unstale":"2024-08-19T00:48:50.212912+0000","last_undegraded":"2024-08-19T00:48:50.212912+0000","last_fullsized":"2024-08-19T00:48:50.212912+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:01.418219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":395,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212027+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:48:50.212027+0000","last_peered":"2024-08-19T00:48:50.212027+0000","last_clean":"2024-08-19T00:48:50.212027+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:48:50.212027+0000","last_undegraded":"2024-08-19T00:48:50.212027+0000","last_fullsized":"2024-08-19T00:48:50.212027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1728512,"data_stored":829637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330652,"statfs":{"total":96636764160,"available":96594587648,"internally_reserved":0,"allocated":1724416,"data_stored":829055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2338816,"data_stored":1421091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1728512,"data_stored":829637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1736704,"data_stored":829249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1728512,"data_stored":829125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2338816,"data_stored":1421147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37032,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334808,"statfs":{"total":96636764160,"available":96598843392,"internally_reserved":0,"allocated":1724416,"data_stored":829055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:48:53.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:48:53.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.615+0000 7fc648e00640 1 Processor -- start 2024-08-19T00:48:53.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.615+0000 7fc648e00640 1 -- start start 2024-08-19T00:48:53.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.616+0000 7fc648e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc644140640 0x7fc64406d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.616+0000 7fc648e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64415e930 con 0x7fc64413dc30 2024-08-19T00:48:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.616+0000 7fc648e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64415ec10 con 0x7fc64406db40 2024-08-19T00:48:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.616+0000 7fc648e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc6441413f0 con 0x7fc644140640 2024-08-19T00:48:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.616+0000 7fc643400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc64413dc30 0x7fc644140ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48822/0 (socket says 172.21.15.7:48822) 2024-08-19T00:48:53.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.616+0000 7fc643400640 1 -- 172.21.15.7:0/2606436693 learned_addr learned my addr 172.21.15.7:0/2606436693 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:53.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc63be00640 1 --2- 172.21.15.7:0/2606436693 >> v2:172.21.15.162:3300/0 conn(0x7fc644140640 0x7fc64406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613272843 0 0) 0x7fc64415e930 con 0x7fc64413dc30 2024-08-19T00:48:53.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc628003520 con 0x7fc64413dc30 2024-08-19T00:48:53.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 167441133 0 0) 0x7fc628003520 con 0x7fc64413dc30 2024-08-19T00:48:53.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 >> v2:172.21.15.162:3300/0 conn(0x7fc644140640 msgr2=0x7fc64406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:53.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 --2- 172.21.15.7:0/2606436693 >> v2:172.21.15.162:3300/0 conn(0x7fc644140640 0x7fc64406d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 >> v1:172.21.15.162:6789/0 conn(0x7fc64406db40 legacy=0x7fc6440ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64415eef0 con 0x7fc64413dc30 2024-08-19T00:48:53.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fc634001670 con 0x7fc64413dc30 2024-08-19T00:48:53.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 >> v1:172.21.15.7:6789/0 conn(0x7fc64413dc30 legacy=0x7fc644140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6280039b0 0x7fc628003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc628004800 0x7fc628004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc62800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441413f0 con 0x7fc6280051c0 2024-08-19T00:48:53.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc62800e270 con 0x7fc6280039b0 2024-08-19T00:48:53.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc62800e470 con 0x7fc628004800 2024-08-19T00:48:53.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.617+0000 7fc643e00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc62800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.618+0000 7fc643400640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6280039b0 0x7fc628003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.618+0000 7fc63be00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc628004800 0x7fc628004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.618+0000 7fc643e00640 1 -- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc628004800 msgr2=0x7fc628004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:53.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.618+0000 7fc643e00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc628004800 0x7fc628004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.618+0000 7fc643e00640 1 -- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6280039b0 msgr2=0x7fc628003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:53.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.618+0000 7fc643e00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6280039b0 0x7fc628003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.618+0000 7fc643e00640 1 -- 172.21.15.7:0/2606436693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628003520 con 0x7fc6280051c0 2024-08-19T00:48:53.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.619+0000 7fc643e00640 1 -- 172.21.15.7:0/2606436693 reap_dead start 2024-08-19T00:48:53.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.619+0000 7fc643e00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc62800dbd0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fc63c001e50 tx=0x7fc628005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2622c44ed0b312d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.619+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c001a70 con 0x7fc6280051c0 2024-08-19T00:48:53.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.619+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c003970 con 0x7fc6280051c0 2024-08-19T00:48:53.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.619+0000 7fc642a00640 1 -- 172.21.15.7:0/2606436693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c003d60 con 0x7fc6280051c0 2024-08-19T00:48:53.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.620+0000 7fc648e00640 1 -- 172.21.15.7:0/2606436693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 msgr2=0x7fc62800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.620+0000 7fc648e00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc62800dbd0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fc63c001e50 tx=0x7fc628005830 comp rx=0 tx=0).stop 2024-08-19T00:48:53.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.620+0000 7fc648e00640 1 -- 172.21.15.7:0/2606436693 shutdown_connections 2024-08-19T00:48:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.620+0000 7fc648e00640 1 --2- 172.21.15.7:0/2606436693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc62800dbd0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.620+0000 7fc648e00640 1 -- 172.21.15.7:0/2606436693 >> 172.21.15.7:0/2606436693 conn(0x7fc64406b850 msgr2=0x7fc64406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.620+0000 7fc648e00640 1 -- 172.21.15.7:0/2606436693 shutdown_connections 2024-08-19T00:48:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.620+0000 7fc648e00640 1 -- 172.21.15.7:0/2606436693 wait complete. 2024-08-19T00:48:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.622+0000 7fc648e00640 1 Processor -- start 2024-08-19T00:48:53.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.622+0000 7fc648e00640 1 -- start start 2024-08-19T00:48:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc648e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc644139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc648e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6441399c0 0x7fc64413cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc648e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc644072c10 0x7fc644073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc648e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc64413e010 con 0x7fc6280051c0 2024-08-19T00:48:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc648e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc64415f4b0 con 0x7fc6441399c0 2024-08-19T00:48:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc648e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc64413e190 con 0x7fc644072c10 2024-08-19T00:48:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc644139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc644139fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57742/0 (socket says 172.21.15.7:57742) 2024-08-19T00:48:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 -- 172.21.15.7:0/3471938606 learned_addr learned my addr 172.21.15.7:0/3471938606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc644072c10 0x7fc644073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc63be00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6441399c0 0x7fc64413cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 -- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc644072c10 msgr2=0x7fc644073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc644072c10 0x7fc644073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 -- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6441399c0 msgr2=0x7fc64413cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6441399c0 0x7fc64413cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643400640 1 -- 172.21.15.7:0/3471938606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64413d470 con 0x7fc6280051c0 2024-08-19T00:48:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc643e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc644072c10 0x7fc644073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.623+0000 7fc63be00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6441399c0 0x7fc64413cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.624+0000 7fc643400640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc644139fe0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fc6340072c0 tx=0x7fc634007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.624+0000 7fc63b400640 1 -- 172.21.15.7:0/3471938606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400f8e0 con 0x7fc6280051c0 2024-08-19T00:48:53.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.624+0000 7fc63b400640 1 -- 172.21.15.7:0/3471938606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634018070 con 0x7fc6280051c0 2024-08-19T00:48:53.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.624+0000 7fc63b400640 1 -- 172.21.15.7:0/3471938606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400fce0 con 0x7fc6280051c0 2024-08-19T00:48:53.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.624+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64413a650 con 0x7fc6280051c0 2024-08-19T00:48:53.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.624+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc644153110 con 0x7fc6280051c0 2024-08-19T00:48:53.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.625+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64406d690 con 0x7fc6280051c0 2024-08-19T00:48:53.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.626+0000 7fc63b400640 1 -- 172.21.15.7:0/3471938606 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc63401d460 con 0x7fc6280051c0 2024-08-19T00:48:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.627+0000 7fc63b400640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc62006be60 0x7fc62006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.627+0000 7fc63b400640 1 -- 172.21.15.7:0/3471938606 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fc63408af60 con 0x7fc6280051c0 2024-08-19T00:48:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.627+0000 7fc63be00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc62006be60 0x7fc62006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.628+0000 7fc63be00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc62006be60 0x7fc62006e320 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc62c006b10 tx=0x7fc62c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.632+0000 7fc63b400640 1 -- 172.21.15.7:0/3471938606 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc634059900 con 0x7fc6280051c0 2024-08-19T00:48:53.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.811+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc64406e520 con 0x7fc62006be60 2024-08-19T00:48:53.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.817+0000 7fc63b400640 1 -- 172.21.15.7:0/3471938606 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7fc64406e520 con 0x7fc62006be60 2024-08-19T00:48:53.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:53.823 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:48:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc62006be60 msgr2=0x7fc62006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc62006be60 0x7fc62006e320 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc62c006b10 tx=0x7fc62c008040 comp rx=0 tx=0).stop 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 msgr2=0x7fc644139fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc644139fe0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fc6340072c0 tx=0x7fc634007780 comp rx=0 tx=0).stop 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 shutdown_connections 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc62006be60 0x7fc62006e320 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc644072c10 0x7fc644073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6441399c0 0x7fc64413cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 --2- 172.21.15.7:0/3471938606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6280051c0 0x7fc644139fe0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 >> 172.21.15.7:0/3471938606 conn(0x7fc64406b850 msgr2=0x7fc6440b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 shutdown_connections 2024-08-19T00:48:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:53.821+0000 7fc648e00640 1 -- 172.21.15.7:0/3471938606 wait complete. 2024-08-19T00:48:53.840 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":491,"stamp":"2024-08-19T00:48:53.417286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284972,"kb_used_data":14696,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754689748,"statfs":{"total":773094113280,"available":772802301952,"internally_reserved":0,"allocated":15048704,"data_stored":7817996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001026"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359222+0000","last_change":"2024-08-19T00:48:49.229508+0000","last_active":"2024-08-19T00:48:50.359222+0000","last_peered":"2024-08-19T00:48:50.359222+0000","last_clean":"2024-08-19T00:48:50.359222+0000","last_became_active":"2024-08-19T00:48:49.229166+0000","last_became_peered":"2024-08-19T00:48:49.229166+0000","last_unstale":"2024-08-19T00:48:50.359222+0000","last_undegraded":"2024-08-19T00:48:50.359222+0000","last_fullsized":"2024-08-19T00:48:50.359222+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:55.810248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357840+0000","last_change":"2024-08-19T00:48:49.223677+0000","last_active":"2024-08-19T00:48:50.357840+0000","last_peered":"2024-08-19T00:48:50.357840+0000","last_clean":"2024-08-19T00:48:50.357840+0000","last_became_active":"2024-08-19T00:48:49.223409+0000","last_became_peered":"2024-08-19T00:48:49.223409+0000","last_unstale":"2024-08-19T00:48:50.357840+0000","last_undegraded":"2024-08-19T00:48:50.357840+0000","last_fullsized":"2024-08-19T00:48:50.357840+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:25:32.893063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358135+0000","last_change":"2024-08-19T00:48:49.224940+0000","last_active":"2024-08-19T00:48:50.358135+0000","last_peered":"2024-08-19T00:48:50.358135+0000","last_clean":"2024-08-19T00:48:50.358135+0000","last_became_active":"2024-08-19T00:48:49.224300+0000","last_became_peered":"2024-08-19T00:48:49.224300+0000","last_unstale":"2024-08-19T00:48:50.358135+0000","last_undegraded":"2024-08-19T00:48:50.358135+0000","last_fullsized":"2024-08-19T00:48:50.358135+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:47:18.757688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358189+0000","last_change":"2024-08-19T00:48:49.222567+0000","last_active":"2024-08-19T00:48:50.358189+0000","last_peered":"2024-08-19T00:48:50.358189+0000","last_clean":"2024-08-19T00:48:50.358189+0000","last_became_active":"2024-08-19T00:48:49.221639+0000","last_became_peered":"2024-08-19T00:48:49.221639+0000","last_unstale":"2024-08-19T00:48:50.358189+0000","last_undegraded":"2024-08-19T00:48:50.358189+0000","last_fullsized":"2024-08-19T00:48:50.358189+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:58.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210573+0000","last_change":"2024-08-19T00:48:49.214127+0000","last_active":"2024-08-19T00:48:50.210573+0000","last_peered":"2024-08-19T00:48:50.210573+0000","last_clean":"2024-08-19T00:48:50.210573+0000","last_became_active":"2024-08-19T00:48:49.213578+0000","last_became_peered":"2024-08-19T00:48:49.213578+0000","last_unstale":"2024-08-19T00:48:50.210573+0000","last_undegraded":"2024-08-19T00:48:50.210573+0000","last_fullsized":"2024-08-19T00:48:50.210573+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:52.597976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210717+0000","last_change":"2024-08-19T00:48:49.215609+0000","last_active":"2024-08-19T00:48:50.210717+0000","last_peered":"2024-08-19T00:48:50.210717+0000","last_clean":"2024-08-19T00:48:50.210717+0000","last_became_active":"2024-08-19T00:48:49.215345+0000","last_became_peered":"2024-08-19T00:48:49.215345+0000","last_unstale":"2024-08-19T00:48:50.210717+0000","last_undegraded":"2024-08-19T00:48:50.210717+0000","last_fullsized":"2024-08-19T00:48:50.210717+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:41:10.253771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210848+0000","last_change":"2024-08-19T00:48:49.211818+0000","last_active":"2024-08-19T00:48:50.210848+0000","last_peered":"2024-08-19T00:48:50.210848+0000","last_clean":"2024-08-19T00:48:50.210848+0000","last_became_active":"2024-08-19T00:48:49.211543+0000","last_became_peered":"2024-08-19T00:48:49.211543+0000","last_unstale":"2024-08-19T00:48:50.210848+0000","last_undegraded":"2024-08-19T00:48:50.210848+0000","last_fullsized":"2024-08-19T00:48:50.210848+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:18:00.870270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357936+0000","last_change":"2024-08-19T00:48:49.227685+0000","last_active":"2024-08-19T00:48:50.357936+0000","last_peered":"2024-08-19T00:48:50.357936+0000","last_clean":"2024-08-19T00:48:50.357936+0000","last_became_active":"2024-08-19T00:48:49.227307+0000","last_became_peered":"2024-08-19T00:48:49.227307+0000","last_unstale":"2024-08-19T00:48:50.357936+0000","last_undegraded":"2024-08-19T00:48:50.357936+0000","last_fullsized":"2024-08-19T00:48:50.357936+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:04.748375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211182+0000","last_change":"2024-08-19T00:48:49.207293+0000","last_active":"2024-08-19T00:48:50.211182+0000","last_peered":"2024-08-19T00:48:50.211182+0000","last_clean":"2024-08-19T00:48:50.211182+0000","last_became_active":"2024-08-19T00:48:49.206980+0000","last_became_peered":"2024-08-19T00:48:49.206980+0000","last_unstale":"2024-08-19T00:48:50.211182+0000","last_undegraded":"2024-08-19T00:48:50.211182+0000","last_fullsized":"2024-08-19T00:48:50.211182+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:31.337854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356760+0000","last_change":"2024-08-19T00:48:49.219549+0000","last_active":"2024-08-19T00:48:50.356760+0000","last_peered":"2024-08-19T00:48:50.356760+0000","last_clean":"2024-08-19T00:48:50.356760+0000","last_became_active":"2024-08-19T00:48:49.219080+0000","last_became_peered":"2024-08-19T00:48:49.219080+0000","last_unstale":"2024-08-19T00:48:50.356760+0000","last_undegraded":"2024-08-19T00:48:50.356760+0000","last_fullsized":"2024-08-19T00:48:50.356760+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:47:18.757688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211215+0000","last_change":"2024-08-19T00:48:49.225451+0000","last_active":"2024-08-19T00:48:50.211215+0000","last_peered":"2024-08-19T00:48:50.211215+0000","last_clean":"2024-08-19T00:48:50.211215+0000","last_became_active":"2024-08-19T00:48:49.225118+0000","last_became_peered":"2024-08-19T00:48:49.225118+0000","last_unstale":"2024-08-19T00:48:50.211215+0000","last_undegraded":"2024-08-19T00:48:50.211215+0000","last_fullsized":"2024-08-19T00:48:50.211215+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:41:24.144258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212645+0000","last_change":"2024-08-19T00:48:49.232332+0000","last_active":"2024-08-19T00:48:50.212645+0000","last_peered":"2024-08-19T00:48:50.212645+0000","last_clean":"2024-08-19T00:48:50.212645+0000","last_became_active":"2024-08-19T00:48:49.231951+0000","last_became_peered":"2024-08-19T00:48:49.231951+0000","last_unstale":"2024-08-19T00:48:50.212645+0000","last_undegraded":"2024-08-19T00:48:50.212645+0000","last_fullsized":"2024-08-19T00:48:50.212645+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:51.216860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359232+0000","last_change":"2024-08-19T00:48:49.210842+0000","last_active":"2024-08-19T00:48:50.359232+0000","last_peered":"2024-08-19T00:48:50.359232+0000","last_clean":"2024-08-19T00:48:50.359232+0000","last_became_active":"2024-08-19T00:48:49.210516+0000","last_became_peered":"2024-08-19T00:48:49.210516+0000","last_unstale":"2024-08-19T00:48:50.359232+0000","last_undegraded":"2024-08-19T00:48:50.359232+0000","last_fullsized":"2024-08-19T00:48:50.359232+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:54:18.803851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357918+0000","last_change":"2024-08-19T00:48:49.223503+0000","last_active":"2024-08-19T00:48:50.357918+0000","last_peered":"2024-08-19T00:48:50.357918+0000","last_clean":"2024-08-19T00:48:50.357918+0000","last_became_active":"2024-08-19T00:48:49.223183+0000","last_became_peered":"2024-08-19T00:48:49.223183+0000","last_unstale":"2024-08-19T00:48:50.357918+0000","last_undegraded":"2024-08-19T00:48:50.357918+0000","last_fullsized":"2024-08-19T00:48:50.357918+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:39:36.806933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357680+0000","last_change":"2024-08-19T00:48:49.226419+0000","last_active":"2024-08-19T00:48:50.357680+0000","last_peered":"2024-08-19T00:48:50.357680+0000","last_clean":"2024-08-19T00:48:50.357680+0000","last_became_active":"2024-08-19T00:48:49.226111+0000","last_became_peered":"2024-08-19T00:48:49.226111+0000","last_unstale":"2024-08-19T00:48:50.357680+0000","last_undegraded":"2024-08-19T00:48:50.357680+0000","last_fullsized":"2024-08-19T00:48:50.357680+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:35:59.670605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210316+0000","last_change":"2024-08-19T00:48:49.220798+0000","last_active":"2024-08-19T00:48:50.210316+0000","last_peered":"2024-08-19T00:48:50.210316+0000","last_clean":"2024-08-19T00:48:50.210316+0000","last_became_active":"2024-08-19T00:48:49.218893+0000","last_became_peered":"2024-08-19T00:48:49.218893+0000","last_unstale":"2024-08-19T00:48:50.210316+0000","last_undegraded":"2024-08-19T00:48:50.210316+0000","last_fullsized":"2024-08-19T00:48:50.210316+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:16.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212030+0000","last_change":"2024-08-19T00:48:49.208959+0000","last_active":"2024-08-19T00:48:50.212030+0000","last_peered":"2024-08-19T00:48:50.212030+0000","last_clean":"2024-08-19T00:48:50.212030+0000","last_became_active":"2024-08-19T00:48:49.208644+0000","last_became_peered":"2024-08-19T00:48:49.208644+0000","last_unstale":"2024-08-19T00:48:50.212030+0000","last_undegraded":"2024-08-19T00:48:50.212030+0000","last_fullsized":"2024-08-19T00:48:50.212030+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:42.348077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358005+0000","last_change":"2024-08-19T00:48:49.227606+0000","last_active":"2024-08-19T00:48:50.358005+0000","last_peered":"2024-08-19T00:48:50.358005+0000","last_clean":"2024-08-19T00:48:50.358005+0000","last_became_active":"2024-08-19T00:48:49.227217+0000","last_became_peered":"2024-08-19T00:48:49.227217+0000","last_unstale":"2024-08-19T00:48:50.358005+0000","last_undegraded":"2024-08-19T00:48:50.358005+0000","last_fullsized":"2024-08-19T00:48:50.358005+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:23.857492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211925+0000","last_change":"2024-08-19T00:48:49.217249+0000","last_active":"2024-08-19T00:48:50.211925+0000","last_peered":"2024-08-19T00:48:50.211925+0000","last_clean":"2024-08-19T00:48:50.211925+0000","last_became_active":"2024-08-19T00:48:49.216976+0000","last_became_peered":"2024-08-19T00:48:49.216976+0000","last_unstale":"2024-08-19T00:48:50.211925+0000","last_undegraded":"2024-08-19T00:48:50.211925+0000","last_fullsized":"2024-08-19T00:48:50.211925+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:12:20.784123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212694+0000","last_change":"2024-08-19T00:48:49.229258+0000","last_active":"2024-08-19T00:48:50.212694+0000","last_peered":"2024-08-19T00:48:50.212694+0000","last_clean":"2024-08-19T00:48:50.212694+0000","last_became_active":"2024-08-19T00:48:49.228982+0000","last_became_peered":"2024-08-19T00:48:49.228982+0000","last_unstale":"2024-08-19T00:48:50.212694+0000","last_undegraded":"2024-08-19T00:48:50.212694+0000","last_fullsized":"2024-08-19T00:48:50.212694+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:39.953171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358122+0000","last_change":"2024-08-19T00:48:49.217957+0000","last_active":"2024-08-19T00:48:50.358122+0000","last_peered":"2024-08-19T00:48:50.358122+0000","last_clean":"2024-08-19T00:48:50.358122+0000","last_became_active":"2024-08-19T00:48:49.217615+0000","last_became_peered":"2024-08-19T00:48:49.217615+0000","last_unstale":"2024-08-19T00:48:50.358122+0000","last_undegraded":"2024-08-19T00:48:50.358122+0000","last_fullsized":"2024-08-19T00:48:50.358122+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:51.089719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359443+0000","last_change":"2024-08-19T00:48:49.211721+0000","last_active":"2024-08-19T00:48:50.359443+0000","last_peered":"2024-08-19T00:48:50.359443+0000","last_clean":"2024-08-19T00:48:50.359443+0000","last_became_active":"2024-08-19T00:48:49.211192+0000","last_became_peered":"2024-08-19T00:48:49.211192+0000","last_unstale":"2024-08-19T00:48:50.359443+0000","last_undegraded":"2024-08-19T00:48:50.359443+0000","last_fullsized":"2024-08-19T00:48:50.359443+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:19:23.984961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357964+0000","last_change":"2024-08-19T00:48:49.226394+0000","last_active":"2024-08-19T00:48:50.357964+0000","last_peered":"2024-08-19T00:48:50.357964+0000","last_clean":"2024-08-19T00:48:50.357964+0000","last_became_active":"2024-08-19T00:48:49.225507+0000","last_became_peered":"2024-08-19T00:48:49.225507+0000","last_unstale":"2024-08-19T00:48:50.357964+0000","last_undegraded":"2024-08-19T00:48:50.357964+0000","last_fullsized":"2024-08-19T00:48:50.357964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:51.438542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322815+0000","last_change":"2024-08-19T00:48:49.228727+0000","last_active":"2024-08-19T00:48:50.322815+0000","last_peered":"2024-08-19T00:48:50.322815+0000","last_clean":"2024-08-19T00:48:50.322815+0000","last_became_active":"2024-08-19T00:48:49.228369+0000","last_became_peered":"2024-08-19T00:48:49.228369+0000","last_unstale":"2024-08-19T00:48:50.322815+0000","last_undegraded":"2024-08-19T00:48:50.322815+0000","last_fullsized":"2024-08-19T00:48:50.322815+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:11:13.470064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356791+0000","last_change":"2024-08-19T00:48:49.223877+0000","last_active":"2024-08-19T00:48:50.356791+0000","last_peered":"2024-08-19T00:48:50.356791+0000","last_clean":"2024-08-19T00:48:50.356791+0000","last_became_active":"2024-08-19T00:48:49.222463+0000","last_became_peered":"2024-08-19T00:48:49.222463+0000","last_unstale":"2024-08-19T00:48:50.356791+0000","last_undegraded":"2024-08-19T00:48:50.356791+0000","last_fullsized":"2024-08-19T00:48:50.356791+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:40.751275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359240+0000","last_change":"2024-08-19T00:48:49.212913+0000","last_active":"2024-08-19T00:48:50.359240+0000","last_peered":"2024-08-19T00:48:50.359240+0000","last_clean":"2024-08-19T00:48:50.359240+0000","last_became_active":"2024-08-19T00:48:49.212508+0000","last_became_peered":"2024-08-19T00:48:49.212508+0000","last_unstale":"2024-08-19T00:48:50.359240+0000","last_undegraded":"2024-08-19T00:48:50.359240+0000","last_fullsized":"2024-08-19T00:48:50.359240+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:31.755269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323108+0000","last_change":"2024-08-19T00:48:49.222745+0000","last_active":"2024-08-19T00:48:50.323108+0000","last_peered":"2024-08-19T00:48:50.323108+0000","last_clean":"2024-08-19T00:48:50.323108+0000","last_became_active":"2024-08-19T00:48:49.222445+0000","last_became_peered":"2024-08-19T00:48:49.222445+0000","last_unstale":"2024-08-19T00:48:50.323108+0000","last_undegraded":"2024-08-19T00:48:50.323108+0000","last_fullsized":"2024-08-19T00:48:50.323108+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:34:24.315885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323090+0000","last_change":"2024-08-19T00:48:49.229752+0000","last_active":"2024-08-19T00:48:50.323090+0000","last_peered":"2024-08-19T00:48:50.323090+0000","last_clean":"2024-08-19T00:48:50.323090+0000","last_became_active":"2024-08-19T00:48:49.228061+0000","last_became_peered":"2024-08-19T00:48:49.228061+0000","last_unstale":"2024-08-19T00:48:50.323090+0000","last_undegraded":"2024-08-19T00:48:50.323090+0000","last_fullsized":"2024-08-19T00:48:50.323090+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:55.810248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359434+0000","last_change":"2024-08-19T00:48:49.212934+0000","last_active":"2024-08-19T00:48:50.359434+0000","last_peered":"2024-08-19T00:48:50.359434+0000","last_clean":"2024-08-19T00:48:50.359434+0000","last_became_active":"2024-08-19T00:48:49.212586+0000","last_became_peered":"2024-08-19T00:48:49.212586+0000","last_unstale":"2024-08-19T00:48:50.359434+0000","last_undegraded":"2024-08-19T00:48:50.359434+0000","last_fullsized":"2024-08-19T00:48:50.359434+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:58:38.734621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359441+0000","last_change":"2024-08-19T00:48:49.209357+0000","last_active":"2024-08-19T00:48:50.359441+0000","last_peered":"2024-08-19T00:48:50.359441+0000","last_clean":"2024-08-19T00:48:50.359441+0000","last_became_active":"2024-08-19T00:48:49.209045+0000","last_became_peered":"2024-08-19T00:48:49.209045+0000","last_unstale":"2024-08-19T00:48:50.359441+0000","last_undegraded":"2024-08-19T00:48:50.359441+0000","last_fullsized":"2024-08-19T00:48:50.359441+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:41.958566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357965+0000","last_change":"2024-08-19T00:48:49.219296+0000","last_active":"2024-08-19T00:48:50.357965+0000","last_peered":"2024-08-19T00:48:50.357965+0000","last_clean":"2024-08-19T00:48:50.357965+0000","last_became_active":"2024-08-19T00:48:49.218345+0000","last_became_peered":"2024-08-19T00:48:49.218345+0000","last_unstale":"2024-08-19T00:48:50.357965+0000","last_undegraded":"2024-08-19T00:48:50.357965+0000","last_fullsized":"2024-08-19T00:48:50.357965+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:21.352800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357455+0000","last_change":"2024-08-19T00:48:49.226498+0000","last_active":"2024-08-19T00:48:50.357455+0000","last_peered":"2024-08-19T00:48:50.357455+0000","last_clean":"2024-08-19T00:48:50.357455+0000","last_became_active":"2024-08-19T00:48:49.226146+0000","last_became_peered":"2024-08-19T00:48:49.226146+0000","last_unstale":"2024-08-19T00:48:50.357455+0000","last_undegraded":"2024-08-19T00:48:50.357455+0000","last_fullsized":"2024-08-19T00:48:50.357455+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:16.999436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212005+0000","last_change":"2024-08-19T00:48:49.217149+0000","last_active":"2024-08-19T00:48:50.212005+0000","last_peered":"2024-08-19T00:48:50.212005+0000","last_clean":"2024-08-19T00:48:50.212005+0000","last_became_active":"2024-08-19T00:48:49.214606+0000","last_became_peered":"2024-08-19T00:48:49.214606+0000","last_unstale":"2024-08-19T00:48:50.212005+0000","last_undegraded":"2024-08-19T00:48:50.212005+0000","last_fullsized":"2024-08-19T00:48:50.212005+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:50.049492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"135'4","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359611+0000","last_change":"2024-08-19T00:48:48.216595+0000","last_active":"2024-08-19T00:48:50.359611+0000","last_peered":"2024-08-19T00:48:50.359611+0000","last_clean":"2024-08-19T00:48:50.359611+0000","last_became_active":"2024-08-19T00:48:48.216316+0000","last_became_peered":"2024-08-19T00:48:48.216316+0000","last_unstale":"2024-08-19T00:48:50.359611+0000","last_undegraded":"2024-08-19T00:48:50.359611+0000","last_fullsized":"2024-08-19T00:48:50.359611+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:06.580902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.359609+0000","last_change":"2024-08-19T00:48:49.216462+0000","last_active":"2024-08-19T00:48:50.359609+0000","last_peered":"2024-08-19T00:48:50.359609+0000","last_clean":"2024-08-19T00:48:50.359609+0000","last_became_active":"2024-08-19T00:48:49.215847+0000","last_became_peered":"2024-08-19T00:48:49.215847+0000","last_unstale":"2024-08-19T00:48:50.359609+0000","last_undegraded":"2024-08-19T00:48:50.359609+0000","last_fullsized":"2024-08-19T00:48:50.359609+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:17:41.323414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210951+0000","last_change":"2024-08-19T00:48:48.201682+0000","last_active":"2024-08-19T00:48:50.210951+0000","last_peered":"2024-08-19T00:48:50.210951+0000","last_clean":"2024-08-19T00:48:50.210951+0000","last_became_active":"2024-08-19T00:48:48.200686+0000","last_became_peered":"2024-08-19T00:48:48.200686+0000","last_unstale":"2024-08-19T00:48:50.210951+0000","last_undegraded":"2024-08-19T00:48:50.210951+0000","last_fullsized":"2024-08-19T00:48:50.210951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:08.922540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358048+0000","last_change":"2024-08-19T00:48:49.220197+0000","last_active":"2024-08-19T00:48:50.358048+0000","last_peered":"2024-08-19T00:48:50.358048+0000","last_clean":"2024-08-19T00:48:50.358048+0000","last_became_active":"2024-08-19T00:48:49.219052+0000","last_became_peered":"2024-08-19T00:48:49.219052+0000","last_unstale":"2024-08-19T00:48:50.358048+0000","last_undegraded":"2024-08-19T00:48:50.358048+0000","last_fullsized":"2024-08-19T00:48:50.358048+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:46:49.241338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358247+0000","last_change":"2024-08-19T00:48:48.216073+0000","last_active":"2024-08-19T00:48:50.358247+0000","last_peered":"2024-08-19T00:48:50.358247+0000","last_clean":"2024-08-19T00:48:50.358247+0000","last_became_active":"2024-08-19T00:48:48.215245+0000","last_became_peered":"2024-08-19T00:48:48.215245+0000","last_unstale":"2024-08-19T00:48:50.358247+0000","last_undegraded":"2024-08-19T00:48:50.358247+0000","last_fullsized":"2024-08-19T00:48:50.358247+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:50.144148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356760+0000","last_change":"2024-08-19T00:48:49.211845+0000","last_active":"2024-08-19T00:48:50.356760+0000","last_peered":"2024-08-19T00:48:50.356760+0000","last_clean":"2024-08-19T00:48:50.356760+0000","last_became_active":"2024-08-19T00:48:49.211503+0000","last_became_peered":"2024-08-19T00:48:49.211503+0000","last_unstale":"2024-08-19T00:48:50.356760+0000","last_undegraded":"2024-08-19T00:48:50.356760+0000","last_fullsized":"2024-08-19T00:48:50.356760+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:51.089719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358425+0000","last_change":"2024-08-19T00:48:48.220148+0000","last_active":"2024-08-19T00:48:50.358425+0000","last_peered":"2024-08-19T00:48:50.358425+0000","last_clean":"2024-08-19T00:48:50.358425+0000","last_became_active":"2024-08-19T00:48:48.219905+0000","last_became_peered":"2024-08-19T00:48:48.219905+0000","last_unstale":"2024-08-19T00:48:50.358425+0000","last_undegraded":"2024-08-19T00:48:50.358425+0000","last_fullsized":"2024-08-19T00:48:50.358425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:06.218094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212496+0000","last_change":"2024-08-19T00:48:49.225249+0000","last_active":"2024-08-19T00:48:50.212496+0000","last_peered":"2024-08-19T00:48:50.212496+0000","last_clean":"2024-08-19T00:48:50.212496+0000","last_became_active":"2024-08-19T00:48:49.224980+0000","last_became_peered":"2024-08-19T00:48:49.224980+0000","last_unstale":"2024-08-19T00:48:50.212496+0000","last_undegraded":"2024-08-19T00:48:50.212496+0000","last_fullsized":"2024-08-19T00:48:50.212496+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:04.078821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358446+0000","last_change":"2024-08-19T00:48:48.220443+0000","last_active":"2024-08-19T00:48:50.358446+0000","last_peered":"2024-08-19T00:48:50.358446+0000","last_clean":"2024-08-19T00:48:50.358446+0000","last_became_active":"2024-08-19T00:48:48.219869+0000","last_became_peered":"2024-08-19T00:48:48.219869+0000","last_unstale":"2024-08-19T00:48:50.358446+0000","last_undegraded":"2024-08-19T00:48:50.358446+0000","last_fullsized":"2024-08-19T00:48:50.358446+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:00:20.350013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210732+0000","last_change":"2024-08-19T00:48:49.215496+0000","last_active":"2024-08-19T00:48:50.210732+0000","last_peered":"2024-08-19T00:48:50.210732+0000","last_clean":"2024-08-19T00:48:50.210732+0000","last_became_active":"2024-08-19T00:48:49.215196+0000","last_became_peered":"2024-08-19T00:48:49.215196+0000","last_unstale":"2024-08-19T00:48:50.210732+0000","last_undegraded":"2024-08-19T00:48:50.210732+0000","last_fullsized":"2024-08-19T00:48:50.210732+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:51:46.693211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358416+0000","last_change":"2024-08-19T00:48:48.213395+0000","last_active":"2024-08-19T00:48:50.358416+0000","last_peered":"2024-08-19T00:48:50.358416+0000","last_clean":"2024-08-19T00:48:50.358416+0000","last_became_active":"2024-08-19T00:48:48.213061+0000","last_became_peered":"2024-08-19T00:48:48.213061+0000","last_unstale":"2024-08-19T00:48:50.358416+0000","last_undegraded":"2024-08-19T00:48:50.358416+0000","last_fullsized":"2024-08-19T00:48:50.358416+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:34:48.127858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358819+0000","last_change":"2024-08-19T00:48:49.214845+0000","last_active":"2024-08-19T00:48:50.358819+0000","last_peered":"2024-08-19T00:48:50.358819+0000","last_clean":"2024-08-19T00:48:50.358819+0000","last_became_active":"2024-08-19T00:48:49.208388+0000","last_became_peered":"2024-08-19T00:48:49.208388+0000","last_unstale":"2024-08-19T00:48:50.358819+0000","last_undegraded":"2024-08-19T00:48:50.358819+0000","last_fullsized":"2024-08-19T00:48:50.358819+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:28.008127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210949+0000","last_change":"2024-08-19T00:48:48.205355+0000","last_active":"2024-08-19T00:48:50.210949+0000","last_peered":"2024-08-19T00:48:50.210949+0000","last_clean":"2024-08-19T00:48:50.210949+0000","last_became_active":"2024-08-19T00:48:48.204985+0000","last_became_peered":"2024-08-19T00:48:48.204985+0000","last_unstale":"2024-08-19T00:48:50.210949+0000","last_undegraded":"2024-08-19T00:48:50.210949+0000","last_fullsized":"2024-08-19T00:48:50.210949+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:22.854705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212118+0000","last_change":"2024-08-19T00:48:49.226387+0000","last_active":"2024-08-19T00:48:50.212118+0000","last_peered":"2024-08-19T00:48:50.212118+0000","last_clean":"2024-08-19T00:48:50.212118+0000","last_became_active":"2024-08-19T00:48:49.224454+0000","last_became_peered":"2024-08-19T00:48:49.224454+0000","last_unstale":"2024-08-19T00:48:50.212118+0000","last_undegraded":"2024-08-19T00:48:50.212118+0000","last_fullsized":"2024-08-19T00:48:50.212118+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:34:49.130645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211310+0000","last_change":"2024-08-19T00:48:48.218710+0000","last_active":"2024-08-19T00:48:50.211310+0000","last_peered":"2024-08-19T00:48:50.211310+0000","last_clean":"2024-08-19T00:48:50.211310+0000","last_became_active":"2024-08-19T00:48:48.218435+0000","last_became_peered":"2024-08-19T00:48:48.218435+0000","last_unstale":"2024-08-19T00:48:50.211310+0000","last_undegraded":"2024-08-19T00:48:50.211310+0000","last_fullsized":"2024-08-19T00:48:50.211310+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:22.858469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358159+0000","last_change":"2024-08-19T00:48:49.224296+0000","last_active":"2024-08-19T00:48:50.358159+0000","last_peered":"2024-08-19T00:48:50.358159+0000","last_clean":"2024-08-19T00:48:50.358159+0000","last_became_active":"2024-08-19T00:48:49.223997+0000","last_became_peered":"2024-08-19T00:48:49.223997+0000","last_unstale":"2024-08-19T00:48:50.358159+0000","last_undegraded":"2024-08-19T00:48:50.358159+0000","last_fullsized":"2024-08-19T00:48:50.358159+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:09.925327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358918+0000","last_change":"2024-08-19T00:48:48.216769+0000","last_active":"2024-08-19T00:48:50.358918+0000","last_peered":"2024-08-19T00:48:50.358918+0000","last_clean":"2024-08-19T00:48:50.358918+0000","last_became_active":"2024-08-19T00:48:48.216515+0000","last_became_peered":"2024-08-19T00:48:48.216515+0000","last_unstale":"2024-08-19T00:48:50.358918+0000","last_undegraded":"2024-08-19T00:48:50.358918+0000","last_fullsized":"2024-08-19T00:48:50.358918+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:03.076034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323276+0000","last_change":"2024-08-19T00:48:49.219930+0000","last_active":"2024-08-19T00:48:50.323276+0000","last_peered":"2024-08-19T00:48:50.323276+0000","last_clean":"2024-08-19T00:48:50.323276+0000","last_became_active":"2024-08-19T00:48:49.219399+0000","last_became_peered":"2024-08-19T00:48:49.219399+0000","last_unstale":"2024-08-19T00:48:50.323276+0000","last_undegraded":"2024-08-19T00:48:50.323276+0000","last_fullsized":"2024-08-19T00:48:50.323276+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:12.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358993+0000","last_change":"2024-08-19T00:48:48.221556+0000","last_active":"2024-08-19T00:48:50.358993+0000","last_peered":"2024-08-19T00:48:50.358993+0000","last_clean":"2024-08-19T00:48:50.358993+0000","last_became_active":"2024-08-19T00:48:48.221242+0000","last_became_peered":"2024-08-19T00:48:48.221242+0000","last_unstale":"2024-08-19T00:48:50.358993+0000","last_undegraded":"2024-08-19T00:48:50.358993+0000","last_fullsized":"2024-08-19T00:48:50.358993+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:47:17.754901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210968+0000","last_change":"2024-08-19T00:48:49.216841+0000","last_active":"2024-08-19T00:48:50.210968+0000","last_peered":"2024-08-19T00:48:50.210968+0000","last_clean":"2024-08-19T00:48:50.210968+0000","last_became_active":"2024-08-19T00:48:49.216397+0000","last_became_peered":"2024-08-19T00:48:49.216397+0000","last_unstale":"2024-08-19T00:48:50.210968+0000","last_undegraded":"2024-08-19T00:48:50.210968+0000","last_fullsized":"2024-08-19T00:48:50.210968+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:05:45.929793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"135'3","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211317+0000","last_change":"2024-08-19T00:48:48.209462+0000","last_active":"2024-08-19T00:48:50.211317+0000","last_peered":"2024-08-19T00:48:50.211317+0000","last_clean":"2024-08-19T00:48:50.211317+0000","last_became_active":"2024-08-19T00:48:48.208111+0000","last_became_peered":"2024-08-19T00:48:48.208111+0000","last_unstale":"2024-08-19T00:48:50.211317+0000","last_undegraded":"2024-08-19T00:48:50.211317+0000","last_fullsized":"2024-08-19T00:48:50.211317+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:46:48.238550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323122+0000","last_change":"2024-08-19T00:48:49.223213+0000","last_active":"2024-08-19T00:48:50.323122+0000","last_peered":"2024-08-19T00:48:50.323122+0000","last_clean":"2024-08-19T00:48:50.323122+0000","last_became_active":"2024-08-19T00:48:49.222884+0000","last_became_peered":"2024-08-19T00:48:49.222884+0000","last_unstale":"2024-08-19T00:48:50.323122+0000","last_undegraded":"2024-08-19T00:48:50.323122+0000","last_fullsized":"2024-08-19T00:48:50.323122+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:53:17.879597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"135'6","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212767+0000","last_change":"2024-08-19T00:48:48.212384+0000","last_active":"2024-08-19T00:48:50.212767+0000","last_peered":"2024-08-19T00:48:50.212767+0000","last_clean":"2024-08-19T00:48:50.212767+0000","last_became_active":"2024-08-19T00:48:48.211415+0000","last_became_peered":"2024-08-19T00:48:48.211415+0000","last_unstale":"2024-08-19T00:48:50.212767+0000","last_undegraded":"2024-08-19T00:48:50.212767+0000","last_fullsized":"2024-08-19T00:48:50.212767+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:07:03.488668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358134+0000","last_change":"2024-08-19T00:48:49.229278+0000","last_active":"2024-08-19T00:48:50.358134+0000","last_peered":"2024-08-19T00:48:50.358134+0000","last_clean":"2024-08-19T00:48:50.358134+0000","last_became_active":"2024-08-19T00:48:49.228972+0000","last_became_peered":"2024-08-19T00:48:49.228972+0000","last_unstale":"2024-08-19T00:48:50.358134+0000","last_undegraded":"2024-08-19T00:48:50.358134+0000","last_fullsized":"2024-08-19T00:48:50.358134+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:11:13.470064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211555+0000","last_change":"2024-08-19T00:48:48.207398+0000","last_active":"2024-08-19T00:48:50.211555+0000","last_peered":"2024-08-19T00:48:50.211555+0000","last_clean":"2024-08-19T00:48:50.211555+0000","last_became_active":"2024-08-19T00:48:48.207089+0000","last_became_peered":"2024-08-19T00:48:48.207089+0000","last_unstale":"2024-08-19T00:48:50.211555+0000","last_undegraded":"2024-08-19T00:48:50.211555+0000","last_fullsized":"2024-08-19T00:48:50.211555+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:06:55.706096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358306+0000","last_change":"2024-08-19T00:48:49.222097+0000","last_active":"2024-08-19T00:48:50.358306+0000","last_peered":"2024-08-19T00:48:50.358306+0000","last_clean":"2024-08-19T00:48:50.358306+0000","last_became_active":"2024-08-19T00:48:49.220010+0000","last_became_peered":"2024-08-19T00:48:49.220010+0000","last_unstale":"2024-08-19T00:48:50.358306+0000","last_undegraded":"2024-08-19T00:48:50.358306+0000","last_fullsized":"2024-08-19T00:48:50.358306+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:09.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358250+0000","last_change":"2024-08-19T00:48:48.219012+0000","last_active":"2024-08-19T00:48:50.358250+0000","last_peered":"2024-08-19T00:48:50.358250+0000","last_clean":"2024-08-19T00:48:50.358250+0000","last_became_active":"2024-08-19T00:48:48.218757+0000","last_became_peered":"2024-08-19T00:48:48.218757+0000","last_unstale":"2024-08-19T00:48:50.358250+0000","last_undegraded":"2024-08-19T00:48:50.358250+0000","last_fullsized":"2024-08-19T00:48:50.358250+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:03.745588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210364+0000","last_change":"2024-08-19T00:48:49.215334+0000","last_active":"2024-08-19T00:48:50.210364+0000","last_peered":"2024-08-19T00:48:50.210364+0000","last_clean":"2024-08-19T00:48:50.210364+0000","last_became_active":"2024-08-19T00:48:49.215045+0000","last_became_peered":"2024-08-19T00:48:49.215045+0000","last_unstale":"2024-08-19T00:48:50.210364+0000","last_undegraded":"2024-08-19T00:48:50.210364+0000","last_fullsized":"2024-08-19T00:48:50.210364+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:18.147803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212417+0000","last_change":"2024-08-19T00:48:48.215675+0000","last_active":"2024-08-19T00:48:50.212417+0000","last_peered":"2024-08-19T00:48:50.212417+0000","last_clean":"2024-08-19T00:48:50.212417+0000","last_became_active":"2024-08-19T00:48:48.214176+0000","last_became_peered":"2024-08-19T00:48:48.214176+0000","last_unstale":"2024-08-19T00:48:50.212417+0000","last_undegraded":"2024-08-19T00:48:50.212417+0000","last_fullsized":"2024-08-19T00:48:50.212417+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:06.075019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358139+0000","last_change":"2024-08-19T00:48:49.229077+0000","last_active":"2024-08-19T00:48:50.358139+0000","last_peered":"2024-08-19T00:48:50.358139+0000","last_clean":"2024-08-19T00:48:50.358139+0000","last_became_active":"2024-08-19T00:48:49.228668+0000","last_became_peered":"2024-08-19T00:48:49.228668+0000","last_unstale":"2024-08-19T00:48:50.358139+0000","last_undegraded":"2024-08-19T00:48:50.358139+0000","last_fullsized":"2024-08-19T00:48:50.358139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:40.751275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"135'8","reported_seq":22,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357648+0000","last_change":"2024-08-19T00:48:48.218303+0000","last_active":"2024-08-19T00:48:50.357648+0000","last_peered":"2024-08-19T00:48:50.357648+0000","last_clean":"2024-08-19T00:48:50.357648+0000","last_became_active":"2024-08-19T00:48:48.215818+0000","last_became_peered":"2024-08-19T00:48:48.215818+0000","last_unstale":"2024-08-19T00:48:50.357648+0000","last_undegraded":"2024-08-19T00:48:50.357648+0000","last_fullsized":"2024-08-19T00:48:50.357648+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:01.572985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323290+0000","last_change":"2024-08-19T00:48:49.234475+0000","last_active":"2024-08-19T00:48:50.323290+0000","last_peered":"2024-08-19T00:48:50.323290+0000","last_clean":"2024-08-19T00:48:50.323290+0000","last_became_active":"2024-08-19T00:48:49.234156+0000","last_became_peered":"2024-08-19T00:48:49.234156+0000","last_unstale":"2024-08-19T00:48:50.323290+0000","last_undegraded":"2024-08-19T00:48:50.323290+0000","last_fullsized":"2024-08-19T00:48:50.323290+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:57.483451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212897+0000","last_change":"2024-08-19T00:48:48.212321+0000","last_active":"2024-08-19T00:48:50.212897+0000","last_peered":"2024-08-19T00:48:50.212897+0000","last_clean":"2024-08-19T00:48:50.212897+0000","last_became_active":"2024-08-19T00:48:48.211407+0000","last_became_peered":"2024-08-19T00:48:48.211407+0000","last_unstale":"2024-08-19T00:48:50.212897+0000","last_undegraded":"2024-08-19T00:48:50.212897+0000","last_fullsized":"2024-08-19T00:48:50.212897+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:38:04.625051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323043+0000","last_change":"2024-08-19T00:48:49.232952+0000","last_active":"2024-08-19T00:48:50.323043+0000","last_peered":"2024-08-19T00:48:50.323043+0000","last_clean":"2024-08-19T00:48:50.323043+0000","last_became_active":"2024-08-19T00:48:49.232132+0000","last_became_peered":"2024-08-19T00:48:49.232132+0000","last_unstale":"2024-08-19T00:48:50.323043+0000","last_undegraded":"2024-08-19T00:48:50.323043+0000","last_fullsized":"2024-08-19T00:48:50.323043+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:58:58.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211330+0000","last_change":"2024-08-19T00:48:48.215129+0000","last_active":"2024-08-19T00:48:50.211330+0000","last_peered":"2024-08-19T00:48:50.211330+0000","last_clean":"2024-08-19T00:48:50.211330+0000","last_became_active":"2024-08-19T00:48:48.214770+0000","last_became_peered":"2024-08-19T00:48:48.214770+0000","last_unstale":"2024-08-19T00:48:50.211330+0000","last_undegraded":"2024-08-19T00:48:50.211330+0000","last_fullsized":"2024-08-19T00:48:50.211330+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:11:12.467277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212783+0000","last_change":"2024-08-19T00:48:49.225080+0000","last_active":"2024-08-19T00:48:50.212783+0000","last_peered":"2024-08-19T00:48:50.212783+0000","last_clean":"2024-08-19T00:48:50.212783+0000","last_became_active":"2024-08-19T00:48:49.224813+0000","last_became_peered":"2024-08-19T00:48:49.224813+0000","last_unstale":"2024-08-19T00:48:50.212783+0000","last_undegraded":"2024-08-19T00:48:50.212783+0000","last_fullsized":"2024-08-19T00:48:50.212783+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:39.149663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211581+0000","last_change":"2024-08-19T00:48:48.205722+0000","last_active":"2024-08-19T00:48:50.211581+0000","last_peered":"2024-08-19T00:48:50.211581+0000","last_clean":"2024-08-19T00:48:50.211581+0000","last_became_active":"2024-08-19T00:48:48.205301+0000","last_became_peered":"2024-08-19T00:48:48.205301+0000","last_unstale":"2024-08-19T00:48:50.211581+0000","last_undegraded":"2024-08-19T00:48:50.211581+0000","last_fullsized":"2024-08-19T00:48:50.211581+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:42:15.996649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211400+0000","last_change":"2024-08-19T00:48:49.208831+0000","last_active":"2024-08-19T00:48:50.211400+0000","last_peered":"2024-08-19T00:48:50.211400+0000","last_clean":"2024-08-19T00:48:50.211400+0000","last_became_active":"2024-08-19T00:48:49.208425+0000","last_became_peered":"2024-08-19T00:48:49.208425+0000","last_unstale":"2024-08-19T00:48:50.211400+0000","last_undegraded":"2024-08-19T00:48:50.211400+0000","last_fullsized":"2024-08-19T00:48:50.211400+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:34:24.315885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358549+0000","last_change":"2024-08-19T00:48:48.221268+0000","last_active":"2024-08-19T00:48:50.358549+0000","last_peered":"2024-08-19T00:48:50.358549+0000","last_clean":"2024-08-19T00:48:50.358549+0000","last_became_active":"2024-08-19T00:48:48.220254+0000","last_became_peered":"2024-08-19T00:48:48.220254+0000","last_unstale":"2024-08-19T00:48:50.358549+0000","last_undegraded":"2024-08-19T00:48:50.358549+0000","last_fullsized":"2024-08-19T00:48:50.358549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:50.086932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211503+0000","last_change":"2024-08-19T00:48:49.211878+0000","last_active":"2024-08-19T00:48:50.211503+0000","last_peered":"2024-08-19T00:48:50.211503+0000","last_clean":"2024-08-19T00:48:50.211503+0000","last_became_active":"2024-08-19T00:48:49.211600+0000","last_became_peered":"2024-08-19T00:48:49.211600+0000","last_unstale":"2024-08-19T00:48:50.211503+0000","last_undegraded":"2024-08-19T00:48:50.211503+0000","last_fullsized":"2024-08-19T00:48:50.211503+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:12.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322798+0000","last_change":"2024-08-19T00:48:48.216016+0000","last_active":"2024-08-19T00:48:50.322798+0000","last_peered":"2024-08-19T00:48:50.322798+0000","last_clean":"2024-08-19T00:48:50.322798+0000","last_became_active":"2024-08-19T00:48:48.214933+0000","last_became_peered":"2024-08-19T00:48:48.214933+0000","last_unstale":"2024-08-19T00:48:50.322798+0000","last_undegraded":"2024-08-19T00:48:50.322798+0000","last_fullsized":"2024-08-19T00:48:50.322798+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:41.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.357523+0000","last_change":"2024-08-19T00:48:49.226468+0000","last_active":"2024-08-19T00:48:50.357523+0000","last_peered":"2024-08-19T00:48:50.357523+0000","last_clean":"2024-08-19T00:48:50.357523+0000","last_became_active":"2024-08-19T00:48:49.226134+0000","last_became_peered":"2024-08-19T00:48:49.226134+0000","last_unstale":"2024-08-19T00:48:50.357523+0000","last_undegraded":"2024-08-19T00:48:50.357523+0000","last_fullsized":"2024-08-19T00:48:50.357523+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:33.775288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.356671+0000","last_change":"2024-08-19T00:48:48.205845+0000","last_active":"2024-08-19T00:48:50.356671+0000","last_peered":"2024-08-19T00:48:50.356671+0000","last_clean":"2024-08-19T00:48:50.356671+0000","last_became_active":"2024-08-19T00:48:48.205314+0000","last_became_peered":"2024-08-19T00:48:48.205314+0000","last_unstale":"2024-08-19T00:48:50.356671+0000","last_undegraded":"2024-08-19T00:48:50.356671+0000","last_fullsized":"2024-08-19T00:48:50.356671+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:01.572985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322901+0000","last_change":"2024-08-19T00:48:49.231724+0000","last_active":"2024-08-19T00:48:50.322901+0000","last_peered":"2024-08-19T00:48:50.322901+0000","last_clean":"2024-08-19T00:48:50.322901+0000","last_became_active":"2024-08-19T00:48:49.230075+0000","last_became_peered":"2024-08-19T00:48:49.230075+0000","last_unstale":"2024-08-19T00:48:50.322901+0000","last_undegraded":"2024-08-19T00:48:50.322901+0000","last_fullsized":"2024-08-19T00:48:50.322901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:09.925327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358055+0000","last_change":"2024-08-19T00:48:48.214177+0000","last_active":"2024-08-19T00:48:50.358055+0000","last_peered":"2024-08-19T00:48:50.358055+0000","last_clean":"2024-08-19T00:48:50.358055+0000","last_became_active":"2024-08-19T00:48:48.211573+0000","last_became_peered":"2024-08-19T00:48:48.211573+0000","last_unstale":"2024-08-19T00:48:50.358055+0000","last_undegraded":"2024-08-19T00:48:50.358055+0000","last_fullsized":"2024-08-19T00:48:50.358055+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:40.955778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212151+0000","last_change":"2024-08-19T00:48:49.213176+0000","last_active":"2024-08-19T00:48:50.212151+0000","last_peered":"2024-08-19T00:48:50.212151+0000","last_clean":"2024-08-19T00:48:50.212151+0000","last_became_active":"2024-08-19T00:48:49.212861+0000","last_became_peered":"2024-08-19T00:48:49.212861+0000","last_unstale":"2024-08-19T00:48:50.212151+0000","last_undegraded":"2024-08-19T00:48:50.212151+0000","last_fullsized":"2024-08-19T00:48:50.212151+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:38.325653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"135'2","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212800+0000","last_change":"2024-08-19T00:48:48.216298+0000","last_active":"2024-08-19T00:48:50.212800+0000","last_peered":"2024-08-19T00:48:50.212800+0000","last_clean":"2024-08-19T00:48:50.212800+0000","last_became_active":"2024-08-19T00:48:48.215138+0000","last_became_peered":"2024-08-19T00:48:48.215138+0000","last_unstale":"2024-08-19T00:48:50.212800+0000","last_undegraded":"2024-08-19T00:48:50.212800+0000","last_fullsized":"2024-08-19T00:48:50.212800+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:21.305464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211993+0000","last_change":"2024-08-19T00:48:49.218503+0000","last_active":"2024-08-19T00:48:50.211993+0000","last_peered":"2024-08-19T00:48:50.211993+0000","last_clean":"2024-08-19T00:48:50.211993+0000","last_became_active":"2024-08-19T00:48:49.218060+0000","last_became_peered":"2024-08-19T00:48:49.218060+0000","last_unstale":"2024-08-19T00:48:50.211993+0000","last_undegraded":"2024-08-19T00:48:50.211993+0000","last_fullsized":"2024-08-19T00:48:50.211993+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:42.945883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212293+0000","last_change":"2024-08-19T00:48:48.218366+0000","last_active":"2024-08-19T00:48:50.212293+0000","last_peered":"2024-08-19T00:48:50.212293+0000","last_clean":"2024-08-19T00:48:50.212293+0000","last_became_active":"2024-08-19T00:48:48.217451+0000","last_became_peered":"2024-08-19T00:48:48.217451+0000","last_unstale":"2024-08-19T00:48:50.212293+0000","last_undegraded":"2024-08-19T00:48:50.212293+0000","last_fullsized":"2024-08-19T00:48:50.212293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:32.772501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358614+0000","last_change":"2024-08-19T00:48:49.227812+0000","last_active":"2024-08-19T00:48:50.358614+0000","last_peered":"2024-08-19T00:48:50.358614+0000","last_clean":"2024-08-19T00:48:50.358614+0000","last_became_active":"2024-08-19T00:48:49.227495+0000","last_became_peered":"2024-08-19T00:48:49.227495+0000","last_unstale":"2024-08-19T00:48:50.358614+0000","last_undegraded":"2024-08-19T00:48:50.358614+0000","last_fullsized":"2024-08-19T00:48:50.358614+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:43.564965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211875+0000","last_change":"2024-08-19T00:48:48.214983+0000","last_active":"2024-08-19T00:48:50.211875+0000","last_peered":"2024-08-19T00:48:50.211875+0000","last_clean":"2024-08-19T00:48:50.211875+0000","last_became_active":"2024-08-19T00:48:48.214669+0000","last_became_peered":"2024-08-19T00:48:48.214669+0000","last_unstale":"2024-08-19T00:48:50.211875+0000","last_undegraded":"2024-08-19T00:48:50.211875+0000","last_fullsized":"2024-08-19T00:48:50.211875+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:18:31.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211235+0000","last_change":"2024-08-19T00:48:49.213810+0000","last_active":"2024-08-19T00:48:50.211235+0000","last_peered":"2024-08-19T00:48:50.211235+0000","last_clean":"2024-08-19T00:48:50.211235+0000","last_became_active":"2024-08-19T00:48:49.213472+0000","last_became_peered":"2024-08-19T00:48:49.213472+0000","last_unstale":"2024-08-19T00:48:50.211235+0000","last_undegraded":"2024-08-19T00:48:50.211235+0000","last_fullsized":"2024-08-19T00:48:50.211235+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:14.744035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.323139+0000","last_change":"2024-08-19T00:48:48.213672+0000","last_active":"2024-08-19T00:48:50.323139+0000","last_peered":"2024-08-19T00:48:50.323139+0000","last_clean":"2024-08-19T00:48:50.323139+0000","last_became_active":"2024-08-19T00:48:48.213137+0000","last_became_peered":"2024-08-19T00:48:48.213137+0000","last_unstale":"2024-08-19T00:48:50.323139+0000","last_undegraded":"2024-08-19T00:48:50.323139+0000","last_fullsized":"2024-08-19T00:48:50.323139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:22.858469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211417+0000","last_change":"2024-08-19T00:48:49.215289+0000","last_active":"2024-08-19T00:48:50.211417+0000","last_peered":"2024-08-19T00:48:50.211417+0000","last_clean":"2024-08-19T00:48:50.211417+0000","last_became_active":"2024-08-19T00:48:49.215019+0000","last_became_peered":"2024-08-19T00:48:49.215019+0000","last_unstale":"2024-08-19T00:48:50.211417+0000","last_undegraded":"2024-08-19T00:48:50.211417+0000","last_fullsized":"2024-08-19T00:48:50.211417+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:53:17.879597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358425+0000","last_change":"2024-08-19T00:48:48.220655+0000","last_active":"2024-08-19T00:48:50.358425+0000","last_peered":"2024-08-19T00:48:50.358425+0000","last_clean":"2024-08-19T00:48:50.358425+0000","last_became_active":"2024-08-19T00:48:48.220402+0000","last_became_peered":"2024-08-19T00:48:48.220402+0000","last_unstale":"2024-08-19T00:48:50.358425+0000","last_undegraded":"2024-08-19T00:48:50.358425+0000","last_fullsized":"2024-08-19T00:48:50.358425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:50.214072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.210744+0000","last_change":"2024-08-19T00:48:49.213835+0000","last_active":"2024-08-19T00:48:50.210744+0000","last_peered":"2024-08-19T00:48:50.210744+0000","last_clean":"2024-08-19T00:48:50.210744+0000","last_became_active":"2024-08-19T00:48:49.213208+0000","last_became_peered":"2024-08-19T00:48:49.213208+0000","last_unstale":"2024-08-19T00:48:50.210744+0000","last_undegraded":"2024-08-19T00:48:50.210744+0000","last_fullsized":"2024-08-19T00:48:50.210744+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:23:15.620588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.322861+0000","last_change":"2024-08-19T00:48:48.212463+0000","last_active":"2024-08-19T00:48:50.322861+0000","last_peered":"2024-08-19T00:48:50.322861+0000","last_clean":"2024-08-19T00:48:50.322861+0000","last_became_active":"2024-08-19T00:48:48.212189+0000","last_became_peered":"2024-08-19T00:48:48.212189+0000","last_unstale":"2024-08-19T00:48:50.322861+0000","last_undegraded":"2024-08-19T00:48:50.322861+0000","last_fullsized":"2024-08-19T00:48:50.322861+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:54:01.932765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.211713+0000","last_change":"2024-08-19T00:48:49.208609+0000","last_active":"2024-08-19T00:48:50.211713+0000","last_peered":"2024-08-19T00:48:50.211713+0000","last_clean":"2024-08-19T00:48:50.211713+0000","last_became_active":"2024-08-19T00:48:49.208316+0000","last_became_peered":"2024-08-19T00:48:49.208316+0000","last_unstale":"2024-08-19T00:48:50.211713+0000","last_undegraded":"2024-08-19T00:48:50.211713+0000","last_fullsized":"2024-08-19T00:48:50.211713+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:57.483451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358953+0000","last_change":"2024-08-19T00:48:48.218780+0000","last_active":"2024-08-19T00:48:50.358953+0000","last_peered":"2024-08-19T00:48:50.358953+0000","last_clean":"2024-08-19T00:48:50.358953+0000","last_became_active":"2024-08-19T00:48:48.218142+0000","last_became_peered":"2024-08-19T00:48:48.218142+0000","last_unstale":"2024-08-19T00:48:50.358953+0000","last_undegraded":"2024-08-19T00:48:50.358953+0000","last_fullsized":"2024-08-19T00:48:50.358953+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:39:05.841876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212322+0000","last_change":"2024-08-19T00:48:49.222225+0000","last_active":"2024-08-19T00:48:50.212322+0000","last_peered":"2024-08-19T00:48:50.212322+0000","last_clean":"2024-08-19T00:48:50.212322+0000","last_became_active":"2024-08-19T00:48:49.221863+0000","last_became_peered":"2024-08-19T00:48:49.221863+0000","last_unstale":"2024-08-19T00:48:50.212322+0000","last_undegraded":"2024-08-19T00:48:50.212322+0000","last_fullsized":"2024-08-19T00:48:50.212322+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:51.146936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358189+0000","last_change":"2024-08-19T00:48:48.212777+0000","last_active":"2024-08-19T00:48:50.358189+0000","last_peered":"2024-08-19T00:48:50.358189+0000","last_clean":"2024-08-19T00:48:50.358189+0000","last_became_active":"2024-08-19T00:48:48.212502+0000","last_became_peered":"2024-08-19T00:48:48.212502+0000","last_unstale":"2024-08-19T00:48:50.358189+0000","last_undegraded":"2024-08-19T00:48:50.358189+0000","last_fullsized":"2024-08-19T00:48:50.358189+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:17:40.320627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.358737+0000","last_change":"2024-08-19T00:48:49.220314+0000","last_active":"2024-08-19T00:48:50.358737+0000","last_peered":"2024-08-19T00:48:50.358737+0000","last_clean":"2024-08-19T00:48:50.358737+0000","last_became_active":"2024-08-19T00:48:49.219824+0000","last_became_peered":"2024-08-19T00:48:49.219824+0000","last_unstale":"2024-08-19T00:48:50.358737+0000","last_undegraded":"2024-08-19T00:48:50.358737+0000","last_fullsized":"2024-08-19T00:48:50.358737+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:48.185214+0000","last_clean_scrub_stamp":"2024-08-19T00:48:48.185214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:14.874292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"135'1","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212912+0000","last_change":"2024-08-19T00:48:48.212548+0000","last_active":"2024-08-19T00:48:50.212912+0000","last_peered":"2024-08-19T00:48:50.212912+0000","last_clean":"2024-08-19T00:48:50.212912+0000","last_became_active":"2024-08-19T00:48:48.211959+0000","last_became_peered":"2024-08-19T00:48:48.211959+0000","last_unstale":"2024-08-19T00:48:50.212912+0000","last_undegraded":"2024-08-19T00:48:50.212912+0000","last_fullsized":"2024-08-19T00:48:50.212912+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:48:47.182427+0000","last_clean_scrub_stamp":"2024-08-19T00:48:47.182427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:01.418219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":395,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-08-19T00:48:50.212027+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:48:50.212027+0000","last_peered":"2024-08-19T00:48:50.212027+0000","last_clean":"2024-08-19T00:48:50.212027+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:48:50.212027+0000","last_undegraded":"2024-08-19T00:48:50.212027+0000","last_fullsized":"2024-08-19T00:48:50.212027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1728512,"data_stored":829637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330652,"statfs":{"total":96636764160,"available":96594587648,"internally_reserved":0,"allocated":1724416,"data_stored":829055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2338816,"data_stored":1421091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1728512,"data_stored":829637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1736704,"data_stored":829249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1728512,"data_stored":829125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2338816,"data_stored":1421147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37032,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334808,"statfs":{"total":96636764160,"available":96598843392,"internally_reserved":0,"allocated":1724416,"data_stored":829055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:48:53.844 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:48:53.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-19T00:48:54.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.043+0000 7f5764a00640 1 Processor -- start 2024-08-19T00:48:54.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.044+0000 7f5764a00640 1 -- start start 2024-08-19T00:48:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f5764a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f576015bfb0 0x7f57600b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f5764a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015c390 0x7f5760072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f5764a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57600acef0 con 0x7f57600b5130 2024-08-19T00:48:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f5764a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f57600ad790 con 0x7f576015bfb0 2024-08-19T00:48:54.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f5764a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f57600ad1d0 con 0x7f576015c390 2024-08-19T00:48:54.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f576015bfb0 0x7f57600b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f576015bfb0 0x7f57600b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49856/0 (socket says 172.21.15.7:49856) 2024-08-19T00:48:54.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575de00640 1 -- 172.21.15.7:0/1841004994 learned_addr learned my addr 172.21.15.7:0/1841004994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:54.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575e800640 1 --2- 172.21.15.7:0/1841004994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015c390 0x7f5760072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575de00640 1 -- 172.21.15.7:0/1841004994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015c390 msgr2=0x7f5760072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:54.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575de00640 1 --2- 172.21.15.7:0/1841004994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015c390 0x7f5760072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575de00640 1 -- 172.21.15.7:0/1841004994 >> v1:172.21.15.162:6789/0 conn(0x7f57600b5130 legacy=0x7f57600aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.045+0000 7f575de00640 1 -- 172.21.15.7:0/1841004994 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57600ad4b0 con 0x7f576015bfb0 2024-08-19T00:48:54.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.046+0000 7f575de00640 1 --2- 172.21.15.7:0/1841004994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f57600b3e00 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f5750009870 tx=0x7f575002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fc8f775870f77 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:54.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f575d400640 1 -- 172.21.15.7:0/1841004994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750037070 con 0x7f576015bfb0 2024-08-19T00:48:54.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f575d400640 1 -- 172.21.15.7:0/1841004994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5750032440 con 0x7f576015bfb0 2024-08-19T00:48:54.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f575d400640 1 -- 172.21.15.7:0/1841004994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750032810 con 0x7f576015bfb0 2024-08-19T00:48:54.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f5764a00640 1 -- 172.21.15.7:0/1841004994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 msgr2=0x7f57600b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f5764a00640 1 --2- 172.21.15.7:0/1841004994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f57600b3e00 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f5750009870 tx=0x7f575002a250 comp rx=0 tx=0).stop 2024-08-19T00:48:54.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f5764a00640 1 -- 172.21.15.7:0/1841004994 shutdown_connections 2024-08-19T00:48:54.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f5764a00640 1 --2- 172.21.15.7:0/1841004994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f576015c390 0x7f5760072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f5764a00640 1 --2- 172.21.15.7:0/1841004994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f57600b3e00 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f5764a00640 1 -- 172.21.15.7:0/1841004994 >> 172.21.15.7:0/1841004994 conn(0x7f57600b2300 msgr2=0x7f576006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:54.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.047+0000 7f5764a00640 1 -- 172.21.15.7:0/1841004994 shutdown_connections 2024-08-19T00:48:54.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.048+0000 7f5764a00640 1 -- 172.21.15.7:0/1841004994 wait complete. 2024-08-19T00:48:54.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.049+0000 7f5764a00640 1 Processor -- start 2024-08-19T00:48:54.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.049+0000 7f5764a00640 1 -- start start 2024-08-19T00:48:54.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.050+0000 7f5764a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57600b5130 0x7f57601547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.050+0000 7f5764a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f5760154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.050+0000 7f5764a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f576015c390 0x7f57601f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.050+0000 7f5764a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f57600b44c0 con 0x7f576015bfb0 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.050+0000 7f5764a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f57600b4340 con 0x7f576015c390 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.050+0000 7f5764a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f57600af2e0 con 0x7f57600b5130 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.050+0000 7f5755400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f5760154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f5760154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49862/0 (socket says 172.21.15.7:49862) 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 -- 172.21.15.7:0/306713441 learned_addr learned my addr 172.21.15.7:0/306713441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f575e800640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f576015c390 0x7f57601f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f575de00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57600b5130 0x7f57601547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 -- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57600b5130 msgr2=0x7f57601547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57600b5130 0x7f57601547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 -- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f576015c390 msgr2=0x7f57601f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f576015c390 0x7f57601f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 -- 172.21.15.7:0/306713441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576015b210 con 0x7f576015bfb0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.051+0000 7f5755400640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f5760154d20 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f574800c400 tx=0x7f574800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.052+0000 7f5756a00640 1 -- 172.21.15.7:0/306713441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57480052d0 con 0x7f576015bfb0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.052+0000 7f5756a00640 1 -- 172.21.15.7:0/306713441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5748005490 con 0x7f576015bfb0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.052+0000 7f5756a00640 1 -- 172.21.15.7:0/306713441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5748007260 con 0x7f576015bfb0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.052+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57601554a0 con 0x7f576015bfb0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.052+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5760155a60 con 0x7f576015bfb0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.053+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57600b3e00 con 0x7f576015bfb0 2024-08-19T00:48:54.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.054+0000 7f5756a00640 1 -- 172.21.15.7:0/306713441 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5748007400 con 0x7f576015bfb0 2024-08-19T00:48:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.055+0000 7f5756a00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f573c06be30 0x7f573c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.055+0000 7f5756a00640 1 -- 172.21.15.7:0/306713441 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f574808a400 con 0x7f576015bfb0 2024-08-19T00:48:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.055+0000 7f575de00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f573c06be30 0x7f573c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.056+0000 7f575de00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f573c06be30 0x7f573c06e2f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5750034000 tx=0x7f575002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.059+0000 7f5756a00640 1 -- 172.21.15.7:0/306713441 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5748058da0 con 0x7f576015bfb0 2024-08-19T00:48:54.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.309+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f57600b4ef0 con 0x7f576015bfb0 2024-08-19T00:48:54.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.312+0000 7f5756a00640 1 -- 172.21.15.7:0/306713441 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f57480586a0 con 0x7f576015bfb0 2024-08-19T00:48:54.314 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-08-19T00:48:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0k8Jm0JLnLBAAf2eMXstfbZRc3o7RQ4CIWA== 2024-08-19T00:48:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-08-19T00:48:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-08-19T00:48:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-19T00:48:54.314 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-08-19T00:48:54.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f573c06be30 msgr2=0x7f573c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f573c06be30 0x7f573c06e2f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5750034000 tx=0x7f575002e000 comp rx=0 tx=0).stop 2024-08-19T00:48:54.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 msgr2=0x7f5760154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f5760154d20 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f574800c400 tx=0x7f574800c8c0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 shutdown_connections 2024-08-19T00:48:54.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f573c06be30 0x7f573c06e2f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f576015c390 0x7f57601f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576015bfb0 0x7f5760154d20 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 --2- 172.21.15.7:0/306713441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57600b5130 0x7f57601547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 >> 172.21.15.7:0/306713441 conn(0x7f57600b2300 msgr2=0x7f57600b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:54.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 shutdown_connections 2024-08-19T00:48:54.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.314+0000 7f5764a00640 1 -- 172.21.15.7:0/306713441 wait complete. 2024-08-19T00:48:54.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:54.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.487+0000 7facb2000640 1 Processor -- start 2024-08-19T00:48:54.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.487+0000 7facb2000640 1 -- start start 2024-08-19T00:48:54.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.488+0000 7facb2000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7facac0ce500 0x7facac0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.488+0000 7facb2000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facac06f7f0 con 0x7facac0d03c0 2024-08-19T00:48:54.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.488+0000 7facb2000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facac06f510 con 0x7facac159bf0 2024-08-19T00:48:54.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.488+0000 7facb2000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7facac072980 con 0x7facac0ce500 2024-08-19T00:48:54.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.488+0000 7facaaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7facac0ce500 0x7facac0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.488+0000 7facaaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7facac0ce500 0x7facac0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49870/0 (socket says 172.21.15.7:49870) 2024-08-19T00:48:54.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.489+0000 7facaaa00640 1 -- 172.21.15.7:0/858588235 learned_addr learned my addr 172.21.15.7:0/858588235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:54.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.489+0000 7facaaa00640 1 -- 172.21.15.7:0/858588235 >> v1:172.21.15.162:6789/0 conn(0x7facac159bf0 legacy=0x7facac073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:54.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.489+0000 7facaaa00640 1 -- 172.21.15.7:0/858588235 >> v1:172.21.15.7:6789/0 conn(0x7facac0d03c0 legacy=0x7facac06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.489+0000 7facaaa00640 1 -- 172.21.15.7:0/858588235 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac072c60 con 0x7facac0ce500 2024-08-19T00:48:54.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.489+0000 7facaa000640 1 -- 172.21.15.7:0/858588235 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614411614 0 0) 0x7facac06f7f0 con 0x7facac0d03c0 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.490+0000 7facaaa00640 1 --2- 172.21.15.7:0/858588235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac0ce500 0x7facac0ce970 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fac98009870 tx=0x7fac9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2070a91b0759f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.490+0000 7facaa000640 1 -- 172.21.15.7:0/858588235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98037070 con 0x7facac0ce500 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.490+0000 7facaa000640 1 -- 172.21.15.7:0/858588235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac98032440 con 0x7facac0ce500 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.490+0000 7facaa000640 1 -- 172.21.15.7:0/858588235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98032810 con 0x7facac0ce500 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.491+0000 7facb2000640 1 -- 172.21.15.7:0/858588235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac0ce500 msgr2=0x7facac0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.491+0000 7facb2000640 1 --2- 172.21.15.7:0/858588235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac0ce500 0x7facac0ce970 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fac98009870 tx=0x7fac9802a270 comp rx=0 tx=0).stop 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.491+0000 7facb2000640 1 -- 172.21.15.7:0/858588235 shutdown_connections 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.491+0000 7facb2000640 1 --2- 172.21.15.7:0/858588235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac0ce500 0x7facac0ce970 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.491+0000 7facb2000640 1 -- 172.21.15.7:0/858588235 >> 172.21.15.7:0/858588235 conn(0x7facac06bc70 msgr2=0x7facac06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.491+0000 7facb2000640 1 -- 172.21.15.7:0/858588235 shutdown_connections 2024-08-19T00:48:54.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.491+0000 7facb2000640 1 -- 172.21.15.7:0/858588235 wait complete. 2024-08-19T00:48:54.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.493+0000 7facb2000640 1 Processor -- start 2024-08-19T00:48:54.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.493+0000 7facb2000640 1 -- start start 2024-08-19T00:48:54.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facb2000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac0ce500 0x7facac1f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facb2000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac0d03c0 0x7facac1e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facb2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac159bf0 0x7facac1f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facb2000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7facac159fd0 con 0x7facac159bf0 2024-08-19T00:48:54.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facb2000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7facac073b70 con 0x7facac0ce500 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facb2000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7facac15a150 con 0x7facac0d03c0 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facabe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac159bf0 0x7facac1f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facabe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac159bf0 0x7facac1f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49882/0 (socket says 172.21.15.7:49882) 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facabe00640 1 -- 172.21.15.7:0/396070263 learned_addr learned my addr 172.21.15.7:0/396070263 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facaaa00640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac0d03c0 0x7facac1e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facab400640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac0ce500 0x7facac1f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facabe00640 1 -- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac0d03c0 msgr2=0x7facac1e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facabe00640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac0d03c0 0x7facac1e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facabe00640 1 -- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac0ce500 msgr2=0x7facac1f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.494+0000 7facabe00640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac0ce500 0x7facac1f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7facabe00640 1 -- 172.21.15.7:0/396070263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac145d00 con 0x7facac159bf0 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7facab400640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac0ce500 0x7facac1f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7facaaa00640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac0d03c0 0x7facac1e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7facabe00640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac159bf0 0x7facac1f71c0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7faca400c760 tx=0x7faca400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7faca3400640 1 -- 172.21.15.7:0/396070263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4003da0 con 0x7facac159bf0 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7faca3400640 1 -- 172.21.15.7:0/396070263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca4005070 con 0x7facac159bf0 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7faca3400640 1 -- 172.21.15.7:0/396070263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4005460 con 0x7facac159bf0 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facac145fe0 con 0x7facac159bf0 2024-08-19T00:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.495+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facac1465a0 con 0x7facac159bf0 2024-08-19T00:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.496+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facac0ce970 con 0x7facac159bf0 2024-08-19T00:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.497+0000 7faca3400640 1 -- 172.21.15.7:0/396070263 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faca4005600 con 0x7facac159bf0 2024-08-19T00:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.498+0000 7faca3400640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.498+0000 7faca3400640 1 -- 172.21.15.7:0/396070263 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7faca408ae10 con 0x7facac159bf0 2024-08-19T00:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.498+0000 7facab400640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.499+0000 7facab400640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fac9c000f60 tx=0x7fac9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:54.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.502+0000 7faca3400640 1 -- 172.21.15.7:0/396070263 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faca408e030 con 0x7facac159bf0 2024-08-19T00:48:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.722+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facac1469e0 con 0x7facac159bf0 2024-08-19T00:48:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.723+0000 7faca3400640 1 -- 172.21.15.7:0/396070263 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 346 v346) ==== 95+0+5237 (secure 0 0 0) 0x7faca40597b0 con 0x7facac159bf0 2024-08-19T00:48:54.724 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:54.725 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":346,"btime":"2024-08-19T00:48:52:215999+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":346,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:48:51.638229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10464":{"gid":10464,"name":"c","rank":0,"incarnation":342,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2760644218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2760644218},{"type":"v1","addr":"172.21.15.7:6837","nonce":2760644218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10464,"qdb_cluster":[10464]},"id":7}]} 2024-08-19T00:48:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 346 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 msgr2=0x7fac8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fac9c000f60 tx=0x7fac9c009040 comp rx=0 tx=0).stop 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac159bf0 msgr2=0x7facac1f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac159bf0 0x7facac1f71c0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7faca400c760 tx=0x7faca400cc20 comp rx=0 tx=0).stop 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 shutdown_connections 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fac8c06be30 0x7fac8c06e2f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facac159bf0 0x7facac1f71c0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facac0d03c0 0x7facac1e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 --2- 172.21.15.7:0/396070263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facac0ce500 0x7facac1f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 >> 172.21.15.7:0/396070263 conn(0x7facac06bc70 msgr2=0x7facac15a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 shutdown_connections 2024-08-19T00:48:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:54.725+0000 7facb2000640 1 -- 172.21.15.7:0/396070263 wait complete. 2024-08-19T00:48:55.146 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 346, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:48:48.621186+0000', 'modified': '2024-08-19T00:48:51.638229+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10464': {'gid': 10464, 'name': 'c', 'rank': 0, 'incarnation': 342, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6837/2760644218', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 2760644218}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 2760644218}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10464, 'qdb_cluster': [10464]} 2024-08-19T00:48:55.146 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:48:55.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:48:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.307+0000 7fa01ca00640 1 Processor -- start 2024-08-19T00:48:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.307+0000 7fa01ca00640 1 -- start start 2024-08-19T00:48:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.308+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180d03c0 0x7fa018071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.308+0000 7fa01ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0180b3750 0x7fa0180cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa01ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0180cdfb0 con 0x7fa01806e710 2024-08-19T00:48:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa01ca00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa0180cebc0 con 0x7fa0180b3750 2024-08-19T00:48:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa01ca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0180ce290 con 0x7fa0180d03c0 2024-08-19T00:48:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa016800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0180b3750 0x7fa0180cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa016800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0180b3750 0x7fa0180cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49886/0 (socket says 172.21.15.7:49886) 2024-08-19T00:48:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa016800640 1 -- 172.21.15.7:0/4023149895 learned_addr learned my addr 172.21.15.7:0/4023149895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa015e00640 1 --2- 172.21.15.7:0/4023149895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180d03c0 0x7fa018071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa016800640 1 -- 172.21.15.7:0/4023149895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180d03c0 msgr2=0x7fa018071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa016800640 1 --2- 172.21.15.7:0/4023149895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180d03c0 0x7fa018071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa016800640 1 -- 172.21.15.7:0/4023149895 >> v1:172.21.15.162:6789/0 conn(0x7fa01806e710 legacy=0x7fa0180d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.309+0000 7fa016800640 1 -- 172.21.15.7:0/4023149895 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0180ce570 con 0x7fa0180b3750 2024-08-19T00:48:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.310+0000 7fa016800640 1 --2- 172.21.15.7:0/4023149895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0180b3750 0x7fa0180cf050 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fa010009e50 tx=0x7fa01002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dea1ab7b159aa97 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.310+0000 7fa015400640 1 -- 172.21.15.7:0/4023149895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa010036070 con 0x7fa0180b3750 2024-08-19T00:48:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa015400640 1 -- 172.21.15.7:0/4023149895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa010031600 con 0x7fa0180b3750 2024-08-19T00:48:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa015400640 1 -- 172.21.15.7:0/4023149895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0100319d0 con 0x7fa0180b3750 2024-08-19T00:48:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 -- 172.21.15.7:0/4023149895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0180b3750 msgr2=0x7fa0180cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 --2- 172.21.15.7:0/4023149895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0180b3750 0x7fa0180cf050 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fa010009e50 tx=0x7fa01002a710 comp rx=0 tx=0).stop 2024-08-19T00:48:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 -- 172.21.15.7:0/4023149895 shutdown_connections 2024-08-19T00:48:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 --2- 172.21.15.7:0/4023149895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0180b3750 0x7fa0180cf050 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 --2- 172.21.15.7:0/4023149895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180d03c0 0x7fa018071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 -- 172.21.15.7:0/4023149895 >> 172.21.15.7:0/4023149895 conn(0x7fa01806bc70 msgr2=0x7fa01806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 -- 172.21.15.7:0/4023149895 shutdown_connections 2024-08-19T00:48:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.311+0000 7fa01ca00640 1 -- 172.21.15.7:0/4023149895 wait complete. 2024-08-19T00:48:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.313+0000 7fa01ca00640 1 Processor -- start 2024-08-19T00:48:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.313+0000 7fa01ca00640 1 -- start start 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa01806e710 0x7fa018152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180b3750 0x7fa01815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0180d03c0 0x7fa018159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa01ca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa018073c60 con 0x7fa01806e710 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa01ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa018073ae0 con 0x7fa0180d03c0 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa01ca00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0180b3be0 con 0x7fa0180b3750 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa015e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa01806e710 0x7fa018152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa015e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa01806e710 0x7fa018152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49896/0 (socket says 172.21.15.7:49896) 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa015e00640 1 -- 172.21.15.7:0/1348550601 learned_addr learned my addr 172.21.15.7:0/1348550601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.314+0000 7fa00d400640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180b3750 0x7fa01815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa016800640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0180d03c0 0x7fa018159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa015e00640 1 -- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180b3750 msgr2=0x7fa01815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa015e00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180b3750 0x7fa01815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa015e00640 1 -- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0180d03c0 msgr2=0x7fa018159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa015e00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0180d03c0 0x7fa018159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa015e00640 1 -- 172.21.15.7:0/1348550601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01815c5b0 con 0x7fa01806e710 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa016800640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0180d03c0 0x7fa018159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa00d400640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180b3750 0x7fa01815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa015e00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa01806e710 0x7fa018152860 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7fa00800e9e0 tx=0x7fa00800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa00ea00640 1 -- 172.21.15.7:0/1348550601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008017070 con 0x7fa01806e710 2024-08-19T00:48:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa00ea00640 1 -- 172.21.15.7:0/1348550601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00800c9d0 con 0x7fa01806e710 2024-08-19T00:48:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa00ea00640 1 -- 172.21.15.7:0/1348550601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00800cdc0 con 0x7fa01806e710 2024-08-19T00:48:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.315+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01815c850 con 0x7fa01806e710 2024-08-19T00:48:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.316+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0180ca8b0 con 0x7fa01806e710 2024-08-19T00:48:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.317+0000 7fa00ea00640 1 -- 172.21.15.7:0/1348550601 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa00801a070 con 0x7fa01806e710 2024-08-19T00:48:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.318+0000 7fa00ea00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9ff406be30 0x7f9ff406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.318+0000 7fa00ea00640 1 -- 172.21.15.7:0/1348550601 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fa00808ae60 con 0x7fa01806e710 2024-08-19T00:48:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.318+0000 7fa00d400640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9ff406be30 0x7f9ff406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.319+0000 7fa01f881740 1 Processor -- start 2024-08-19T00:48:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.319+0000 7fa00d400640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9ff406be30 0x7f9ff406e2f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa01809e320 tx=0x7fa000009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.319+0000 7fa01f881740 1 -- start start 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22d8df50 0x558b22d8e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa01f881740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22db1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22da6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa01f881740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b22cc6ba0 con 0x558b22db1470 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558b22c5f230 con 0x558b22d8df50 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558b22cc2b60 con 0x558b22db1dd0 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa00d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22db1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa00d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22db1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49904/0 (socket says 172.21.15.7:49904) 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.320+0000 7fa00d400640 1 -- 172.21.15.7:0/1556444983 learned_addr learned my addr 172.21.15.7:0/1556444983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa015e00640 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22d8df50 0x558b22d8e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa016800640 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22da6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa00d400640 1 -- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 msgr2=0x558b22da6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa00d400640 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22da6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa00d400640 1 -- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22d8df50 msgr2=0x558b22d8e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa00d400640 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22d8df50 0x558b22d8e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa00d400640 1 -- 172.21.15.7:0/1556444983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b22c90bb0 con 0x558b22db1470 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa00d400640 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22db1890 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fa000005300 tx=0x7fa000011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eea8ff7777bb298 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa006600640 1 -- 172.21.15.7:0/1556444983 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0000054b0 con 0x558b22db1470 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa006600640 1 -- 172.21.15.7:0/1556444983 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00000e710 con 0x558b22db1470 2024-08-19T00:48:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.321+0000 7fa006600640 1 -- 172.21.15.7:0/1556444983 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00000eac0 con 0x558b22db1470 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 -- 172.21.15.7:0/1556444983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 msgr2=0x558b22db1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22db1890 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fa000005300 tx=0x7fa000011000 comp rx=0 tx=0).stop 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 -- 172.21.15.7:0/1556444983 shutdown_connections 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22da6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22db1890 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 --2- 172.21.15.7:0/1556444983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22d8df50 0x558b22d8e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 -- 172.21.15.7:0/1556444983 >> 172.21.15.7:0/1556444983 conn(0x558b22d2b110 msgr2=0x558b22da8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 -- 172.21.15.7:0/1556444983 shutdown_connections 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.322+0000 7fa01f881740 1 -- 172.21.15.7:0/1556444983 wait complete. 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.323+0000 7fa01f881740 1 -- start start 2024-08-19T00:48:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.323+0000 7fa01f881740 1 Processor -- start 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa01f881740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22d5f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d830c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d5e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa01f881740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b22daaea0 con 0x558b22d8df50 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558b22c82250 con 0x558b22db1470 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558b22daa5b0 con 0x558b22db1dd0 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa01f881740 10 client.0 _ll_register_callbacks cb 0x558b22c86740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa015e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22d5f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa015e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22d5f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49908/0 (socket says 172.21.15.7:49908) 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa015e00640 1 -- 172.21.15.7:0/524358495 learned_addr learned my addr 172.21.15.7:0/524358495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa00d400640 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.324+0000 7fa016800640 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d5e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa015e00640 1 -- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 msgr2=0x558b22d5e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa015e00640 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d5e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa015e00640 1 -- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 msgr2=0x558b22d830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa015e00640 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d830c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa015e00640 1 -- 172.21.15.7:0/524358495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b229da2d0 con 0x558b22d8df50 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa015e00640 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22d5f1b0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fa0080097a0 tx=0x7fa008059940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65245f7dd96282c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7f9ffaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7f9ffaa00640 1 -- 172.21.15.7:0/524358495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008087060 con 0x558b22d8df50 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7f9ffaa00640 1 -- 172.21.15.7:0/524358495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fa008058550 con 0x558b22d8df50 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa00000e710 con 0x558b22d8df50 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7f9ffaa00640 1 -- 172.21.15.7:0/524358495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (secure 0 0 0) 0x7fa008071070 con 0x558b22d8df50 2024-08-19T00:48:55.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.325+0000 7fa01f881740 10 client.10581 fetch_fsmap learned FSMap version 346 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=346,monmap=2+}) -- 0x558b22aa46b0 con 0x558b22d8df50 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7f9ffaa00640 1 -- 172.21.15.7:0/524358495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00000e710 con 0x558b22d8df50 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7f9ffaa00640 1 -- 172.21.15.7:0/524358495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 346) ==== 3502+0+0 (secure 0 0 0) 0x7fa008082ce0 con 0x558b22d8df50 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa01f881740 10 client.10581 fetch_fsmap finished waiting for FSMap version 346 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa01f881740 10 client.10581 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa01f881740 20 client.10581 populate_metadata read hostname 'smithi007' 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa01f881740 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22d85e00 0x558b22d861e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa01f881740 4 client.10581 mds_command: new command op to 10464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 --> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b22cd42d0 con 0x558b22d85e00 2024-08-19T00:48:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.326+0000 7fa00d400640 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22d85e00 0x558b22d861e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.327+0000 7fa00d400640 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22d85e00 0x558b22d861e0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8a0c2ee427054b server_cookie=ae5cc546dfc71b91 in_seq=0 out_seq=0 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.327+0000 7f9ffaa00640 10 client.10581 ms_handle_connect on v2:172.21.15.7:6835/2760644218 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7f9ffaa00640 1 -- 172.21.15.7:0/524358495 <== mds.0 v2:172.21.15.7:6835/2760644218 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b22cd42d0 con 0x558b22d85e00 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7f9ffaa00640 10 client.10581 handle_command_reply: tid=0 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 client.10581 shutdown 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 msgr2=0x558b22d5f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22d5f1b0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fa0080097a0 tx=0x7fa008059940 comp rx=0 tx=0).stop 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 shutdown_connections 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22d85e00 0x558b22d861e0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d5e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d830c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 --2- 172.21.15.7:0/524358495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22d5f1b0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 >> 172.21.15.7:0/524358495 conn(0x558b22d2b110 msgr2=0x558b22da8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7f9ffaa00640 0 client.10581 ms_handle_reset on v2:172.21.15.7:6835/2760644218 2024-08-19T00:48:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 shutdown_connections 2024-08-19T00:48:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 1 -- 172.21.15.7:0/524358495 wait complete. 2024-08-19T00:48:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.328+0000 7fa01f881740 20 client.10581 trim_cache size 0 max 16384 2024-08-19T00:48:55.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.347+0000 7fa01f881740 1 Processor -- start 2024-08-19T00:48:55.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.347+0000 7fa01f881740 1 -- start start 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22d8df50 0x558b22dcbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa01f881740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22d82c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1dd0 0x558b22dcb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa01f881740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0180cc200 con 0x558b22db1470 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0180c9f30 con 0x558b22db1dd0 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0180cbbb0 con 0x558b22d8df50 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa00d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22d82c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa00d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22d82c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49912/0 (socket says 172.21.15.7:49912) 2024-08-19T00:48:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.348+0000 7fa00d400640 1 -- 172.21.15.7:0/2204490300 learned_addr learned my addr 172.21.15.7:0/2204490300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa015e00640 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22d8df50 0x558b22dcbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa016800640 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1dd0 0x558b22dcb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa00d400640 1 -- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22d8df50 msgr2=0x558b22dcbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa00d400640 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22d8df50 0x558b22dcbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa00d400640 1 -- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1dd0 msgr2=0x558b22dcb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa00d400640 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1dd0 0x558b22dcb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa00d400640 1 -- 172.21.15.7:0/2204490300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b22d65d20 con 0x558b22db1470 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa016800640 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1dd0 0x558b22dcb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa00d400640 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22d82c40 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fa000003e50 tx=0x7fa000017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295e6524430b5623 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa005c00640 1 -- 172.21.15.7:0/2204490300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00000ebc0 con 0x558b22db1470 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa005c00640 1 -- 172.21.15.7:0/2204490300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00000ed60 con 0x558b22db1470 2024-08-19T00:48:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.349+0000 7fa005c00640 1 -- 172.21.15.7:0/2204490300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00002d5d0 con 0x558b22db1470 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 -- 172.21.15.7:0/2204490300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 msgr2=0x558b22d82c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22d82c40 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fa000003e50 tx=0x7fa000017070 comp rx=0 tx=0).stop 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 -- 172.21.15.7:0/2204490300 shutdown_connections 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1dd0 0x558b22dcb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22db1470 0x558b22d82c40 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 --2- 172.21.15.7:0/2204490300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22d8df50 0x558b22dcbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 -- 172.21.15.7:0/2204490300 >> 172.21.15.7:0/2204490300 conn(0x558b22d2b110 msgr2=0x558b22d864c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 -- 172.21.15.7:0/2204490300 shutdown_connections 2024-08-19T00:48:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.350+0000 7fa01f881740 1 -- 172.21.15.7:0/2204490300 wait complete. 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.351+0000 7fa01f881740 1 -- start start 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.351+0000 7fa01f881740 1 Processor -- start 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa01f881740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22dcccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa01f881740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d88a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa01f881740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b22d86f20 con 0x558b22d8df50 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558b22d8a860 con 0x558b22db1470 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa01f881740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x558b22d836a0 con 0x558b22db1dd0 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa01f881740 10 client.0 _ll_register_callbacks cb 0x7fa008058af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22dcccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22dcccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49918/0 (socket says 172.21.15.7:49918) 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 -- 172.21.15.7:0/205443146 learned_addr learned my addr 172.21.15.7:0/205443146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 -- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 msgr2=0x558b22d88a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa016800640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d88a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa00d400640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d88a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 -- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 msgr2=0x558b22d884c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d884c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa015e00640 1 -- 172.21.15.7:0/205443146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b22dac0c0 con 0x558b22d8df50 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa00d400640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d884c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.352+0000 7fa016800640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d88a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:48:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7fa015e00640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22dcccd0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fa00800e9b0 tx=0x7fa008089250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5142170d4ee7ec5a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7f9ffaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7f9ffaa00640 1 -- 172.21.15.7:0/205443146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008021040 con 0x558b22d8df50 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7f9ffaa00640 1 -- 172.21.15.7:0/205443146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fa008055050 con 0x558b22d8df50 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa00000ed60 con 0x558b22d8df50 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7f9ffaa00640 1 -- 172.21.15.7:0/205443146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (secure 0 0 0) 0x7fa00807c050 con 0x558b22d8df50 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7fa01f881740 10 client.10587 fetch_fsmap learned FSMap version 346 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=346,monmap=2+}) -- 0x558b22d87c40 con 0x558b22d8df50 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7f9ffaa00640 1 -- 172.21.15.7:0/205443146 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00000ed60 con 0x558b22d8df50 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7f9ffaa00640 1 -- 172.21.15.7:0/205443146 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 346) ==== 3502+0+0 (secure 0 0 0) 0x7fa00807f080 con 0x558b22d8df50 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7fa01f881740 10 client.10587 fetch_fsmap finished waiting for FSMap version 346 2024-08-19T00:48:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7fa01f881740 10 client.10587 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.353+0000 7fa01f881740 20 client.10587 populate_metadata read hostname 'smithi007' 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7fa01f881740 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22da5fa0 0x558b22d81780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7fa01f881740 4 client.10587 mds_command: new command op to 10464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 --> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] -- command(tid 0: {"prefix": "status"}) -- 0x558b22cce620 con 0x558b22da5fa0 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7fa00d400640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22da5fa0 0x558b22d81780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7fa00d400640 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22da5fa0 0x558b22d81780 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c25c06f1462aac84 server_cookie=8d8e689dcab5746b in_seq=0 out_seq=0 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7f9ffaa00640 10 client.10587 ms_handle_connect on v2:172.21.15.7:6835/2760644218 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7f9ffaa00640 1 -- 172.21.15.7:0/205443146 <== mds.0 v2:172.21.15.7:6835/2760644218 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x558b22cce620 con 0x558b22da5fa0 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7f9ffaa00640 10 client.10587 handle_command_reply: tid=0 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.354+0000 7fa01f881740 1 client.10587 shutdown 2024-08-19T00:48:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 msgr2=0x558b22dcccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22dcccd0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fa00800e9b0 tx=0x7fa008089250 comp rx=0 tx=0).stop 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 shutdown_connections 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:6835/2760644218,v1:172.21.15.7:6837/2760644218] conn(0x558b22da5fa0 0x558b22d81780 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558b22db1dd0 0x558b22d88a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b22db1470 0x558b22d884c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 --2- 172.21.15.7:0/205443146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b22d8df50 0x558b22dcccd0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7f9ffaa00640 0 client.10587 ms_handle_reset on v2:172.21.15.7:6835/2760644218 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 >> 172.21.15.7:0/205443146 conn(0x558b22d2b110 msgr2=0x558b22d8e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 shutdown_connections 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 1 -- 172.21.15.7:0/205443146 wait complete. 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.355+0000 7fa01f881740 20 client.10587 trim_cache size 0 max 16384 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 10464, 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:48:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 6.1607288660000004, 2024-08-19T00:48:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 346, 2024-08-19T00:48:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 136, 2024-08-19T00:48:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 136, 2024-08-19T00:48:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 10.773539983999999 2024-08-19T00:48:55.364 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9ff406be30 msgr2=0x7f9ff406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9ff406be30 0x7f9ff406e2f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa01809e320 tx=0x7fa000009040 comp rx=0 tx=0).stop 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa01806e710 msgr2=0x7fa018152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa01806e710 0x7fa018152860 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7fa00800e9e0 tx=0x7fa00800eea0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 shutdown_connections 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9ff406be30 0x7f9ff406e2f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0180d03c0 0x7fa018159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0180b3750 0x7fa01815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 --2- 172.21.15.7:0/1348550601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa01806e710 0x7fa018152860 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 >> 172.21.15.7:0/1348550601 conn(0x7fa01806bc70 msgr2=0x7fa0180afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 shutdown_connections 2024-08-19T00:48:55.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.356+0000 7fa01ca00640 1 -- 172.21.15.7:0/1348550601 wait complete. 2024-08-19T00:48:55.373 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:48:55.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.529+0000 7f799aa00640 1 Processor -- start 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.530+0000 7f799aa00640 1 -- start start 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f799aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7994159bf0 0x7f7994073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f799aa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799406f7f0 con 0x7f79940cec10 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f799aa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799406f510 con 0x7f79940739a0 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f799aa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7994072980 con 0x7f7994159bf0 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f7993e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7994159bf0 0x7f7994073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f7993e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7994159bf0 0x7f7994073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49926/0 (socket says 172.21.15.7:49926) 2024-08-19T00:48:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f7993e00640 1 -- 172.21.15.7:0/3261552791 learned_addr learned my addr 172.21.15.7:0/3261552791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f7993e00640 1 -- 172.21.15.7:0/3261552791 >> v1:172.21.15.162:6789/0 conn(0x7f79940739a0 legacy=0x7f79940ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f7993e00640 1 -- 172.21.15.7:0/3261552791 >> v1:172.21.15.7:6789/0 conn(0x7f79940cec10 legacy=0x7f79940d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f7992a00640 1 -- 172.21.15.7:0/3261552791 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230412778 0 0) 0x7f799406f7f0 con 0x7f79940cec10 2024-08-19T00:48:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.531+0000 7f7993e00640 1 -- 172.21.15.7:0/3261552791 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7994072c60 con 0x7f7994159bf0 2024-08-19T00:48:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f7993e00640 1 --2- 172.21.15.7:0/3261552791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7994159bf0 0x7f7994073460 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f7984009870 tx=0x7f798402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfb57b4548a6eaf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f7992a00640 1 -- 172.21.15.7:0/3261552791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984037070 con 0x7f7994159bf0 2024-08-19T00:48:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f7992a00640 1 -- 172.21.15.7:0/3261552791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7984032440 con 0x7f7994159bf0 2024-08-19T00:48:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f7992a00640 1 -- 172.21.15.7:0/3261552791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984032810 con 0x7f7994159bf0 2024-08-19T00:48:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f799aa00640 1 -- 172.21.15.7:0/3261552791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7994159bf0 msgr2=0x7f7994073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f799aa00640 1 --2- 172.21.15.7:0/3261552791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7994159bf0 0x7f7994073460 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f7984009870 tx=0x7f798402a270 comp rx=0 tx=0).stop 2024-08-19T00:48:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f799aa00640 1 -- 172.21.15.7:0/3261552791 shutdown_connections 2024-08-19T00:48:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f799aa00640 1 --2- 172.21.15.7:0/3261552791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7994159bf0 0x7f7994073460 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.533+0000 7f799aa00640 1 -- 172.21.15.7:0/3261552791 >> 172.21.15.7:0/3261552791 conn(0x7f799406bc70 msgr2=0x7f799406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.534+0000 7f799aa00640 1 -- 172.21.15.7:0/3261552791 shutdown_connections 2024-08-19T00:48:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.534+0000 7f799aa00640 1 -- 172.21.15.7:0/3261552791 wait complete. 2024-08-19T00:48:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.535+0000 7f799aa00640 1 Processor -- start 2024-08-19T00:48:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.535+0000 7f799aa00640 1 -- start start 2024-08-19T00:48:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f799aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940739a0 0x7f79940ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f799aa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7994159bf0 0x7f79940b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f799aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79940ae710 0x7f79941f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f799aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f799415a150 con 0x7f79940ae710 2024-08-19T00:48:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f799aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7994159fd0 con 0x7f79940739a0 2024-08-19T00:48:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f799aa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79940d0ad0 con 0x7f7994159bf0 2024-08-19T00:48:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f7998a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79940ae710 0x7f79941f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.536+0000 7f7993400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7994159bf0 0x7f79940b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79940ae710 0x7f79941f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49932/0 (socket says 172.21.15.7:49932) 2024-08-19T00:48:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 -- 172.21.15.7:0/880424731 learned_addr learned my addr 172.21.15.7:0/880424731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7993e00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940739a0 0x7f79940ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 -- 172.21.15.7:0/880424731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7994159bf0 msgr2=0x7f79940b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7994159bf0 0x7f79940b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 -- 172.21.15.7:0/880424731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940739a0 msgr2=0x7f79940ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940739a0 0x7f79940ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 -- 172.21.15.7:0/880424731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79940b0320 con 0x7f79940ae710 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.537+0000 7f7998a00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79940ae710 0x7f79941f2ac0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c730 tx=0x7f798c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.538+0000 7f798be00640 1 -- 172.21.15.7:0/880424731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c003da0 con 0x7f79940ae710 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.538+0000 7f798be00640 1 -- 172.21.15.7:0/880424731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c00ce40 con 0x7f79940ae710 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.538+0000 7f798be00640 1 -- 172.21.15.7:0/880424731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c0052b0 con 0x7f79940ae710 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.538+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79940b0660 con 0x7f79940ae710 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.538+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79940b0ea0 con 0x7f79940ae710 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.539+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79940b10a0 con 0x7f79940ae710 2024-08-19T00:48:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.540+0000 7f798be00640 1 -- 172.21.15.7:0/880424731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f798c005450 con 0x7f79940ae710 2024-08-19T00:48:55.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.541+0000 7f798be00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f797406be30 0x7f797406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:55.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.541+0000 7f798be00640 1 -- 172.21.15.7:0/880424731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f798c08aca0 con 0x7f79940ae710 2024-08-19T00:48:55.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.541+0000 7f7993e00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f797406be30 0x7f797406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:55.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.542+0000 7f7993e00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f797406be30 0x7f797406e2f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7984034000 tx=0x7f798402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.545+0000 7f798be00640 1 -- 172.21.15.7:0/880424731 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f79940b10a0 con 0x7f79940ae710 2024-08-19T00:48:55.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.765+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7994073460 con 0x7f79940ae710 2024-08-19T00:48:55.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.765+0000 7f798be00640 1 -- 172.21.15.7:0/880424731 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v346) ==== 53+0+73 (secure 0 0 0) 0x7f79940b0660 con 0x7f79940ae710 2024-08-19T00:48:55.767 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f797406be30 msgr2=0x7f797406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f797406be30 0x7f797406e2f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7984034000 tx=0x7f798402e000 comp rx=0 tx=0).stop 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79940ae710 msgr2=0x7f79941f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79940ae710 0x7f79941f2ac0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c730 tx=0x7f798c00cbf0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 shutdown_connections 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f797406be30 0x7f797406e2f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79940ae710 0x7f79941f2ac0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7994159bf0 0x7f79940b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 --2- 172.21.15.7:0/880424731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940739a0 0x7f79940ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 >> 172.21.15.7:0/880424731 conn(0x7f799406bc70 msgr2=0x7f7994160490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:55.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 shutdown_connections 2024-08-19T00:48:55.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:55.768+0000 7f799aa00640 1 -- 172.21.15.7:0/880424731 wait complete. 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:48:55.786 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:48:55.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:55.787 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:48:55.823 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:48:55.823 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:48:55.824 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42126sec preferred_lft 42126sec 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:48:55.825 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:48:55.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:55.827 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:48:55.917 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:48:55.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:55.920 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:48:55.956 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:48:55.956 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:48:55.956 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:48:55.957 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:48:55.957 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:48:55.957 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:48:55.957 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:48:55.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:48:55.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:48:55.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:48:55.957 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:48:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:48:56.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:48:56.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:56.156 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:48:56.192 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:48:56.192 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:48:56.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:48:56.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:56.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:48:56.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:48:56.291 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:56.326 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:48:56.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:48:56.327 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:56.403 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:48:56.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:56.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:56.531 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:56.532 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:48:56.532 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:48:56.547 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:56.547 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:48:56.547 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:48:56.547 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:48:56.547 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:48:56.569 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:48:56.569 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:48:56.569 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:48:56.569 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:48:56.569 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:48:56.569 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:48:56.570 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:48:56.570 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:48:56.571 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:48:56.571 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:48:56.571 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:48:56.571 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:48:56.571 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:48:56.574 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:48:56.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:56.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:56.630 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:48:56.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:48:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:48:56.726 INFO:teuthology.orchestra.run.smithi007.stdout:client9721 2024-08-19T00:48:56.726 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:56.726 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:56.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:56.762 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir1) 2024-08-19T00:48:56.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:56.844 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir1/file1) 2024-08-19T00:48:56.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:56.923 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir2) 2024-08-19T00:48:57.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:57.000 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir2/file2) 2024-08-19T00:48:57.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:57.081 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-08-19T00:48:57.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:57.159 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir1/file1 testdir/hardlink1) 2024-08-19T00:48:57.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:57.244 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir2/file2 testdir/hardlink2) 2024-08-19T00:48:57.321 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:48:57.321 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:48:57.321 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:48:57.321 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:48:57.321 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir1/file1").st_ino) 2024-08-19T00:48:57.321 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:48:57.461 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-08-19T00:48:57.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:48:57.473 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:48:57.473 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:48:57.473 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:48:57.473 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:48:57.473 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir2/file2").st_ino) 2024-08-19T00:48:57.473 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:48:57.613 INFO:teuthology.orchestra.run.smithi007.stdout:1099511628279 2024-08-19T00:48:57.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:48:57.625 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-08-19T00:48:57.625 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-08-19T00:48:57.625 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-08-19T00:48:57.625 DEBUG:teuthology.orchestra.run.smithi007:> 2024-08-19T00:48:57.625 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir2").st_ino) 2024-08-19T00:48:57.625 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-08-19T00:48:57.766 INFO:teuthology.orchestra.run.smithi007.stdout:1099511628278 2024-08-19T00:48:57.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:48:57.777 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:57.777 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:57.854 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:48:57.854 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:48:57.931 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:48:58.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.126+0000 7f4362600640 1 Processor -- start 2024-08-19T00:48:58.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.126+0000 7f4362600640 1 -- start start 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.127+0000 7f4362600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 0x7f435c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.127+0000 7f4362600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f435c0b4380 0x7f435c0b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f4362600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f435c0b50b0 con 0x7f435c15f5b0 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f4362600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f435c15f990 con 0x7f435c0b4380 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f4362600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0cf120 con 0x7f435c0d03c0 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f435be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f435c0b4380 0x7f435c0b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f435be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f435c0b4380 0x7f435c0b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49938/0 (socket says 172.21.15.7:49938) 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f435be00640 1 -- 172.21.15.7:0/650302406 learned_addr learned my addr 172.21.15.7:0/650302406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f435be00640 1 -- 172.21.15.7:0/650302406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 msgr2=0x7f435c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f435be00640 1 --2- 172.21.15.7:0/650302406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 0x7f435c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f435be00640 1 -- 172.21.15.7:0/650302406 >> v1:172.21.15.162:6789/0 conn(0x7f435c15f5b0 legacy=0x7f435c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:58.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.128+0000 7f435be00640 1 -- 172.21.15.7:0/650302406 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c0cead0 con 0x7f435c0b4380 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.129+0000 7f435be00640 1 --2- 172.21.15.7:0/650302406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c0b4380 0x7f435c0b4830 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e50 tx=0x7f435402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c2b7f00e69a568 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.129+0000 7f435aa00640 1 -- 172.21.15.7:0/650302406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354036070 con 0x7f435c0b4380 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.129+0000 7f435aa00640 1 -- 172.21.15.7:0/650302406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4354031600 con 0x7f435c0b4380 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f435aa00640 1 -- 172.21.15.7:0/650302406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43540319d0 con 0x7f435c0b4380 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 -- 172.21.15.7:0/650302406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c0b4380 msgr2=0x7f435c0b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 --2- 172.21.15.7:0/650302406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c0b4380 0x7f435c0b4830 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e50 tx=0x7f435402a640 comp rx=0 tx=0).stop 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 -- 172.21.15.7:0/650302406 shutdown_connections 2024-08-19T00:48:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 --2- 172.21.15.7:0/650302406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c0b4380 0x7f435c0b4830 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 --2- 172.21.15.7:0/650302406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 0x7f435c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 -- 172.21.15.7:0/650302406 >> 172.21.15.7:0/650302406 conn(0x7f435c06bc70 msgr2=0x7f435c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 -- 172.21.15.7:0/650302406 shutdown_connections 2024-08-19T00:48:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.130+0000 7f4362600640 1 -- 172.21.15.7:0/650302406 wait complete. 2024-08-19T00:48:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.132+0000 7f4362600640 1 Processor -- start 2024-08-19T00:48:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.132+0000 7f4362600640 1 -- start start 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f4362600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0b4380 0x7f435c072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f4362600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 0x7f435c1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f4362600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c15f5b0 0x7f435c0ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f4362600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f435c0b4d70 con 0x7f435c15f5b0 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f4362600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f435c0d0d40 con 0x7f435c0b4380 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f4362600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f435c06e660 con 0x7f435c0d03c0 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c15f5b0 0x7f435c0ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c15f5b0 0x7f435c0ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49944/0 (socket says 172.21.15.7:49944) 2024-08-19T00:48:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 -- 172.21.15.7:0/497805393 learned_addr learned my addr 172.21.15.7:0/497805393 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435b400640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0b4380 0x7f435c072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f4353e00640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 0x7f435c1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 -- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 msgr2=0x7f435c1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 0x7f435c1515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 -- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0b4380 msgr2=0x7f435c072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0b4380 0x7f435c072390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435be00640 1 -- 172.21.15.7:0/497805393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c0728d0 con 0x7f435c15f5b0 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.133+0000 7f435b400640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0b4380 0x7f435c072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.134+0000 7f435be00640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c15f5b0 0x7f435c0ae040 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f4354034040 tx=0x7f4354004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.134+0000 7f4353400640 1 -- 172.21.15.7:0/497805393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354041020 con 0x7f435c15f5b0 2024-08-19T00:48:58.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.134+0000 7f4353400640 1 -- 172.21.15.7:0/497805393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43540077a0 con 0x7f435c15f5b0 2024-08-19T00:48:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.134+0000 7f4353400640 1 -- 172.21.15.7:0/497805393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354036040 con 0x7f435c15f5b0 2024-08-19T00:48:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.134+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c1567d0 con 0x7f435c15f5b0 2024-08-19T00:48:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.134+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c156d90 con 0x7f435c15f5b0 2024-08-19T00:48:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.135+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435c0b4830 con 0x7f435c15f5b0 2024-08-19T00:48:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.136+0000 7f4353400640 1 -- 172.21.15.7:0/497805393 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4354044020 con 0x7f435c15f5b0 2024-08-19T00:48:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.137+0000 7f4353400640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f433806be30 0x7f433806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.137+0000 7f4353400640 1 -- 172.21.15.7:0/497805393 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f43540abcf0 con 0x7f435c15f5b0 2024-08-19T00:48:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.137+0000 7f435b400640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f433806be30 0x7f433806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.138+0000 7f435b400640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f433806be30 0x7f433806e2f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f434c006fd0 tx=0x7f434c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.141+0000 7f4353400640 1 -- 172.21.15.7:0/497805393 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f435404b030 con 0x7f435c15f5b0 2024-08-19T00:48:58.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.339+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f435c162360 con 0x7f435c15f5b0 2024-08-19T00:48:58.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.340+0000 7f4353400640 1 -- 172.21.15.7:0/497805393 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v136) ==== 80+0+0 (secure 0 0 0) 0x7f435c0728d0 con 0x7f435c15f5b0 2024-08-19T00:48:58.342 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f433806be30 msgr2=0x7f433806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f433806be30 0x7f433806e2f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f434c006fd0 tx=0x7f434c008040 comp rx=0 tx=0).stop 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c15f5b0 msgr2=0x7f435c0ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c15f5b0 0x7f435c0ae040 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f4354034040 tx=0x7f4354004a40 comp rx=0 tx=0).stop 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 shutdown_connections 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f433806be30 0x7f433806e2f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f435c15f5b0 0x7f435c0ae040 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c0d03c0 0x7f435c1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 --2- 172.21.15.7:0/497805393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0b4380 0x7f435c072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 >> 172.21.15.7:0/497805393 conn(0x7f435c06bc70 msgr2=0x7f435c15fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:58.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 shutdown_connections 2024-08-19T00:48:58.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.342+0000 7f4362600640 1 -- 172.21.15.7:0/497805393 wait complete. 2024-08-19T00:48:58.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:48:58.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:58.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:48:58.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:48:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:48:58.465 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:48:58.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:48:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.701+0000 7fb8ff800640 1 Processor -- start 2024-08-19T00:48:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.701+0000 7fb8ff800640 1 -- start start 2024-08-19T00:48:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.702+0000 7fb8ff800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 0x7fb8f8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.702+0000 7fb8ff800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f806f7f0 con 0x7fb8f80cec10 2024-08-19T00:48:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.702+0000 7fb8ff800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f806f510 con 0x7fb8f80739a0 2024-08-19T00:48:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.702+0000 7fb8ff800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f8072980 con 0x7fb8f8159bf0 2024-08-19T00:48:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.703+0000 7fb8fd800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb8f80cec10 0x7fb8f80d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:43690/0 (socket says 172.21.15.7:43690) 2024-08-19T00:48:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.703+0000 7fb8fd800640 1 -- 172.21.15.7:0/1207864811 learned_addr learned my addr 172.21.15.7:0/1207864811 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:48:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.703+0000 7fb8fce00640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 0x7fb8f8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.703+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485836039 0 0) 0x7fb8f806f7f0 con 0x7fb8f80cec10 2024-08-19T00:48:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.703+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e0003520 con 0x7fb8f80cec10 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.703+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1134727182 0 0) 0x7fb8e0003520 con 0x7fb8f80cec10 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 msgr2=0x7fb8f8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 0x7fb8f8073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 >> v1:172.21.15.162:6789/0 conn(0x7fb8f80739a0 legacy=0x7fb8f80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f8072c60 con 0x7fb8f80cec10 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fb8f00019f0 con 0x7fb8f80cec10 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 >> v1:172.21.15.7:6789/0 conn(0x7fb8f80cec10 legacy=0x7fb8f80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8e00039e0 0x7fb8e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e0004390 0x7fb8e0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 0x7fb8e0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f8072980 con 0x7fb8e00039e0 2024-08-19T00:48:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e000ba70 con 0x7fb8e0004390 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e000bc70 con 0x7fb8f8159bf0 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8fce00640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8e00039e0 0x7fb8e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8f7e00640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e0004390 0x7fb8e0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8fd800640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 0x7fb8e0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8fce00640 1 -- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 msgr2=0x7fb8e0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8fce00640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f8159bf0 0x7fb8e0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8fce00640 1 -- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e0004390 msgr2=0x7fb8e0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8fce00640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e0004390 0x7fb8e0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.704+0000 7fb8fce00640 1 -- 172.21.15.7:0/1207864811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e0003520 con 0x7fb8e00039e0 2024-08-19T00:48:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.705+0000 7fb8fce00640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8e00039e0 0x7fb8e0003dc0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009ac0 tx=0x7fb8e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c19673f1f38fde server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec036070 con 0x7fb8e00039e0 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec031400 con 0x7fb8e00039e0 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8f7400640 1 -- 172.21.15.7:0/1207864811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec009690 con 0x7fb8e00039e0 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8ff800640 1 -- 172.21.15.7:0/1207864811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8e00039e0 msgr2=0x7fb8e0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8ff800640 1 --2- 172.21.15.7:0/1207864811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8e00039e0 0x7fb8e0003dc0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009ac0 tx=0x7fb8e0005830 comp rx=0 tx=0).stop 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8fd800640 1 -- 172.21.15.7:0/1207864811 reap_dead start 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8ff800640 1 -- 172.21.15.7:0/1207864811 shutdown_connections 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8ff800640 1 -- 172.21.15.7:0/1207864811 >> 172.21.15.7:0/1207864811 conn(0x7fb8f806bc70 msgr2=0x7fb8f806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8ff800640 1 -- 172.21.15.7:0/1207864811 shutdown_connections 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.706+0000 7fb8ff800640 1 -- 172.21.15.7:0/1207864811 wait complete. 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.708+0000 7fb8ff800640 1 Processor -- start 2024-08-19T00:48:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.708+0000 7fb8ff800640 1 -- start start 2024-08-19T00:48:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8ff800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e00039e0 0x7fb8f8155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8ff800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f815e860 0x7fb8f814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8ff800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f80cc670 0x7fb8f815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8ff800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f815a150 con 0x7fb8f815e860 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8ff800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f8159fd0 con 0x7fb8e00039e0 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8ff800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f80d0ad0 con 0x7fb8f80cc670 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f815e860 0x7fb8f814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f815e860 0x7fb8f814e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49970/0 (socket says 172.21.15.7:49970) 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8f7e00640 1 -- 172.21.15.7:0/3996099273 learned_addr learned my addr 172.21.15.7:0/3996099273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8fd800640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f80cc670 0x7fb8f815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.709+0000 7fb8fce00640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e00039e0 0x7fb8f8155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f7e00640 1 -- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f80cc670 msgr2=0x7fb8f815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f7e00640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f80cc670 0x7fb8f815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f7e00640 1 -- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e00039e0 msgr2=0x7fb8f8155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f7e00640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e00039e0 0x7fb8f8155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f7e00640 1 -- 172.21.15.7:0/3996099273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f815ece0 con 0x7fb8f815e860 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f7e00640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f815e860 0x7fb8f814e620 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400f770 tx=0x7fb8e400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f4c00640 1 -- 172.21.15.7:0/3996099273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400fe80 con 0x7fb8f815e860 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f4c00640 1 -- 172.21.15.7:0/3996099273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4018070 con 0x7fb8f815e860 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8f4c00640 1 -- 172.21.15.7:0/3996099273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400d730 con 0x7fb8f815e860 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f815daa0 con 0x7fb8f815e860 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.710+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f815e060 con 0x7fb8f815e860 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.712+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f8073460 con 0x7fb8f815e860 2024-08-19T00:48:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.713+0000 7fb8f4c00640 1 -- 172.21.15.7:0/3996099273 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8e400d8d0 con 0x7fb8f815e860 2024-08-19T00:48:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.713+0000 7fb8f4c00640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.713+0000 7fb8f4c00640 1 -- 172.21.15.7:0/3996099273 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fb8e408ac90 con 0x7fb8f815e860 2024-08-19T00:48:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.714+0000 7fb8fce00640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:58.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.714+0000 7fb8fce00640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8d806be30 0x7fb8d806e2f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec033000 tx=0x7fb8ec008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:58.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.718+0000 7fb8f4c00640 1 -- 172.21.15.7:0/3996099273 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb8e4058ff0 con 0x7fb8f815e860 2024-08-19T00:48:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.939+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8f8158d90 con 0x7fb8f815e860 2024-08-19T00:48:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.939+0000 7fb8f4c00640 1 -- 172.21.15.7:0/3996099273 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 346 v346) ==== 95+0+5237 (secure 0 0 0) 0x7fb8e405d2f0 con 0x7fb8f815e860 2024-08-19T00:48:58.941 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:48:58.941 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":346,"btime":"2024-08-19T00:48:52:215999+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":346,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:48:51.638229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10464":{"gid":10464,"name":"c","rank":0,"incarnation":342,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2760644218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2760644218},{"type":"v1","addr":"172.21.15.7:6837","nonce":2760644218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10464,"qdb_cluster":[10464]},"id":7}]} 2024-08-19T00:48:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 346 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8d806be30 msgr2=0x7fb8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8d806be30 0x7fb8d806e2f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec033000 tx=0x7fb8ec008030 comp rx=0 tx=0).stop 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f815e860 msgr2=0x7fb8f814e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f815e860 0x7fb8f814e620 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400f770 tx=0x7fb8e400fc30 comp rx=0 tx=0).stop 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 shutdown_connections 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f80cc670 0x7fb8f815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f815e860 0x7fb8f814e620 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 --2- 172.21.15.7:0/3996099273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e00039e0 0x7fb8f8155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 >> 172.21.15.7:0/3996099273 conn(0x7fb8f806bc70 msgr2=0x7fb8f815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 shutdown_connections 2024-08-19T00:48:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:58.942+0000 7fb8ff800640 1 -- 172.21.15.7:0/3996099273 wait complete. 2024-08-19T00:48:58.960 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-08-19T00:48:59.145 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-08-19T00:48:59.146 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-19T00:48:59.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:48:59.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.302+0000 7f48af000640 1 Processor -- start 2024-08-19T00:48:59.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.302+0000 7f48af000640 1 -- start start 2024-08-19T00:48:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48af000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48a815e050 0x7f48a80b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48af000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48a815e430 0x7f48a80cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48af000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a80cf220 0x7f48a80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48af000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f48a815e8a0 con 0x7f48a815e050 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48af000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f48a80d00d0 con 0x7f48a815e430 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48af000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48a80cf830 con 0x7f48a80cf220 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48adc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48a815e050 0x7f48a80b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48adc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48a815e050 0x7f48a80b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49984/0 (socket says 172.21.15.7:49984) 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.303+0000 7f48adc00640 1 -- 172.21.15.7:0/3368186146 learned_addr learned my addr 172.21.15.7:0/3368186146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48ae600640 1 --2- 172.21.15.7:0/3368186146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a80cf220 0x7f48a80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48ad200640 1 --2- 172.21.15.7:0/3368186146 >> v2:172.21.15.162:3300/0 conn(0x7f48a815e430 0x7f48a80cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48adc00640 1 -- 172.21.15.7:0/3368186146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a80cf220 msgr2=0x7f48a80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48adc00640 1 --2- 172.21.15.7:0/3368186146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a80cf220 0x7f48a80d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48adc00640 1 -- 172.21.15.7:0/3368186146 >> v2:172.21.15.162:3300/0 conn(0x7f48a815e430 msgr2=0x7f48a80cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48adc00640 1 --2- 172.21.15.7:0/3368186146 >> v2:172.21.15.162:3300/0 conn(0x7f48a815e430 0x7f48a80cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48adc00640 1 -- 172.21.15.7:0/3368186146 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a80cfb10 con 0x7f48a815e050 2024-08-19T00:48:59.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.304+0000 7f48ad200640 1 --2- 172.21.15.7:0/3368186146 >> v2:172.21.15.162:3300/0 conn(0x7f48a815e430 0x7f48a80cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.305+0000 7f48adc00640 1 --2- 172.21.15.7:0/3368186146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a815e050 0x7f48a80b0e00 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f48a808e480 tx=0x7f489c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c269373689ae3129 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.305+0000 7f48a7e00640 1 -- 172.21.15.7:0/3368186146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c037070 con 0x7f48a815e050 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.305+0000 7f48a7e00640 1 -- 172.21.15.7:0/3368186146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c02ae00 con 0x7f48a815e050 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.305+0000 7f48a7e00640 1 -- 172.21.15.7:0/3368186146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c032660 con 0x7f48a815e050 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 -- 172.21.15.7:0/3368186146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a815e050 msgr2=0x7f48a80b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 --2- 172.21.15.7:0/3368186146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a815e050 0x7f48a80b0e00 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f48a808e480 tx=0x7f489c02a0b0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 -- 172.21.15.7:0/3368186146 shutdown_connections 2024-08-19T00:48:59.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 --2- 172.21.15.7:0/3368186146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a80cf220 0x7f48a80d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 --2- 172.21.15.7:0/3368186146 >> v2:172.21.15.162:3300/0 conn(0x7f48a815e430 0x7f48a80cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 --2- 172.21.15.7:0/3368186146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a815e050 0x7f48a80b0e00 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 -- 172.21.15.7:0/3368186146 >> 172.21.15.7:0/3368186146 conn(0x7f48a809d510 msgr2=0x7f48a80d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 -- 172.21.15.7:0/3368186146 shutdown_connections 2024-08-19T00:48:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.306+0000 7f48af000640 1 -- 172.21.15.7:0/3368186146 wait complete. 2024-08-19T00:48:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.308+0000 7f48af000640 1 Processor -- start 2024-08-19T00:48:59.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.308+0000 7f48af000640 1 -- start start 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48af000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a80cf220 0x7f48a8157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48af000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48a815e050 0x7f48a815f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48af000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a815e430 0x7f48a8161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48af000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48a80d4bf0 con 0x7f48a80cf220 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48af000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48a80d4a70 con 0x7f48a815e050 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48af000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48a80d0f50 con 0x7f48a815e430 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a80cf220 0x7f48a8157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a80cf220 0x7f48a8157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49994/0 (socket says 172.21.15.7:49994) 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 -- 172.21.15.7:0/3030949464 learned_addr learned my addr 172.21.15.7:0/3030949464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48ae600640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a815e430 0x7f48a8161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48ad200640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48a815e050 0x7f48a815f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 -- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a815e430 msgr2=0x7f48a8161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a815e430 0x7f48a8161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 -- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48a815e050 msgr2=0x7f48a815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48a815e050 0x7f48a815f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.309+0000 7f48adc00640 1 -- 172.21.15.7:0/3030949464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a8157560 con 0x7f48a80cf220 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.310+0000 7f48adc00640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a80cf220 0x7f48a8157020 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f489c02a0f0 tx=0x7f489c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.310+0000 7f48a5600640 1 -- 172.21.15.7:0/3030949464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c041070 con 0x7f48a80cf220 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.310+0000 7f48a5600640 1 -- 172.21.15.7:0/3030949464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c03c460 con 0x7f48a80cf220 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.310+0000 7f48a5600640 1 -- 172.21.15.7:0/3030949464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c037040 con 0x7f48a80cf220 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.310+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a81579f0 con 0x7f48a80cf220 2024-08-19T00:48:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.310+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a8159c90 con 0x7f48a80cf220 2024-08-19T00:48:59.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.311+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a80d0a10 con 0x7f48a80cf220 2024-08-19T00:48:59.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.312+0000 7f48a5600640 1 -- 172.21.15.7:0/3030949464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f489c03a070 con 0x7f48a80cf220 2024-08-19T00:48:59.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.313+0000 7f48a5600640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f488806be30 0x7f488806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.313+0000 7f48a5600640 1 -- 172.21.15.7:0/3030949464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f489c0ab1b0 con 0x7f48a80cf220 2024-08-19T00:48:59.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.313+0000 7f48ad200640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f488806be30 0x7f488806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.314+0000 7f48ad200640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f488806be30 0x7f488806e2f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f48a815ad50 tx=0x7f4894008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.318+0000 7f48a5600640 1 -- 172.21.15.7:0/3030949464 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f489c079ac0 con 0x7f48a80cf220 2024-08-19T00:48:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.538+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f48a80b4d10 con 0x7f48a80cf220 2024-08-19T00:48:59.540 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:48:59.538+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:48:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.540+0000 7f48a5600640 1 -- 172.21.15.7:0/3030949464 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v347) ==== 161+0+0 (secure 0 0 0) 0x7f489c0793c0 con 0x7f48a80cf220 2024-08-19T00:48:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f488806be30 msgr2=0x7f488806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f488806be30 0x7f488806e2f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f48a815ad50 tx=0x7f4894008040 comp rx=0 tx=0).stop 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a80cf220 msgr2=0x7f48a8157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a80cf220 0x7f48a8157020 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f489c02a0f0 tx=0x7f489c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 shutdown_connections 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f488806be30 0x7f488806e2f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48a815e430 0x7f48a8161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48a815e050 0x7f48a815f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 --2- 172.21.15.7:0/3030949464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48a80cf220 0x7f48a8157020 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.543+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 >> 172.21.15.7:0/3030949464 conn(0x7f48a809d510 msgr2=0x7f48a80b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:59.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.544+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 shutdown_connections 2024-08-19T00:48:59.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.544+0000 7f48af000640 1 -- 172.21.15.7:0/3030949464 wait complete. 2024-08-19T00:48:59.555 INFO:tasks.ceph.mds.c.smithi007.stderr: -6439> 2024-08-19T00:48:51.176+0000 7f69f9000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:48:59.563 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --yes-i-really-really-mean-it 2024-08-19T00:48:59.607 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:48:59.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.638+0000 7f78ce414280 1 -- start start 2024-08-19T00:48:59.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.639+0000 7f78ce414280 1 Processor -- start 2024-08-19T00:48:59.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.639+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564217212c00 0x56421728e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.639+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564217213800 0x56421728eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.639+0000 7f78ce414280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564217213c00 0x56421728f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.639+0000 7f78ce414280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564217f8e600 con 0x564217213c00 2024-08-19T00:48:59.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.639+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564217f8e480 con 0x564217213800 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.639+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564217f8e300 con 0x564217212c00 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564217213c00 0x56421728f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564217213c00 0x56421728f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50012/0 (socket says 172.21.15.7:50012) 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 -- 172.21.15.7:0/3911529101 learned_addr learned my addr 172.21.15.7:0/3911529101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cb800640 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564217212c00 0x56421728e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cae00640 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564217213800 0x56421728eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 -- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564217212c00 msgr2=0x56421728e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564217212c00 0x56421728e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 -- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564217213800 msgr2=0x56421728eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564217213800 0x56421728eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 -- 172.21.15.7:0/3911529101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564217248780 con 0x564217213c00 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.640+0000 7f78cc200640 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564217213c00 0x56421728f080 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x5642180352f0 tx=0x564217fb37a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b314c71365fa1dc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78c8600640 1 -- 172.21.15.7:0/3911529101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564217238680 con 0x564217213c00 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78c8600640 1 -- 172.21.15.7:0/3911529101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56421723ea80 con 0x564217213c00 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78c8600640 1 -- 172.21.15.7:0/3911529101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564217238b60 con 0x564217213c00 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78ce414280 1 -- 172.21.15.7:0/3911529101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642172494a0 con 0x564217213c00 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78ce414280 1 -- 172.21.15.7:0/3911529101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564217248000 con 0x564217213c00 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78ce414280 4 waiting for MDS map... 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78c8600640 1 -- 172.21.15.7:0/3911529101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x5642180f4600 con 0x564217213c00 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78c8600640 1 -- 172.21.15.7:0/3911529101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 347) ==== 2893+0+0 (secure 0 0 0) 0x56421726d180 con 0x564217213c00 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78ce414280 4 Got MDS map 347 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78ce414280 10 main: JournalTool::main 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.641+0000 7f78ce414280 4 main: JournalTool: connecting to RADOS... 2024-08-19T00:48:59.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.642+0000 7f78ce414280 1 Processor -- start 2024-08-19T00:48:59.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.642+0000 7f78ce414280 1 -- start start 2024-08-19T00:48:59.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1400 0x56421728f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1800 0x56421728fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78ce414280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1c00 0x564217290100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78ce414280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564217f8e180 con 0x5642180e1c00 2024-08-19T00:48:59.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564217f8e900 con 0x5642180e1400 2024-08-19T00:48:59.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564217274900 con 0x5642180e1800 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1c00 0x564217290100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1c00 0x564217290100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50024/0 (socket says 172.21.15.7:50024) 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 -- 172.21.15.7:0/1173961701 learned_addr learned my addr 172.21.15.7:0/1173961701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1400 0x56421728f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cb800640 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1800 0x56421728fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 -- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1800 msgr2=0x56421728fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1800 0x56421728fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 -- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1400 msgr2=0x56421728f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1400 0x56421728f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.643+0000 7f78cae00640 1 -- 172.21.15.7:0/1173961701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642172483c0 con 0x5642180e1c00 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78cae00640 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1c00 0x564217290100 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x56421814e690 tx=0x564217fb3620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2b41d44531789c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78c5e00640 1 -- 172.21.15.7:0/1173961701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5642172389c0 con 0x5642180e1c00 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78c5e00640 1 -- 172.21.15.7:0/1173961701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56421723efc0 con 0x5642180e1c00 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78c5e00640 1 -- 172.21.15.7:0/1173961701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564217238680 con 0x5642180e1c00 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 -- 172.21.15.7:0/1173961701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1c00 msgr2=0x564217290100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1c00 0x564217290100 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x56421814e690 tx=0x564217fb3620 comp rx=0 tx=0).stop 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 -- 172.21.15.7:0/1173961701 shutdown_connections 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1c00 0x564217290100 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1800 0x56421728fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 --2- 172.21.15.7:0/1173961701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1400 0x56421728f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 -- 172.21.15.7:0/1173961701 >> 172.21.15.7:0/1173961701 conn(0x5642180e1000 msgr2=0x5642172fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 -- 172.21.15.7:0/1173961701 shutdown_connections 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.644+0000 7f78ce414280 1 -- 172.21.15.7:0/1173961701 wait complete. 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.645+0000 7f78ce414280 1 Processor -- start 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.645+0000 7f78ce414280 1 -- start start 2024-08-19T00:48:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1400 0x564217291180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78ce414280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1800 0x564217290c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1c00 0x564217290680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78ce414280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564217f8e180 con 0x5642180e1800 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564217f8e900 con 0x5642180e1c00 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564217f8f200 con 0x5642180e1400 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78cb800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1800 0x564217290c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78cb800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1800 0x564217290c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50028/0 (socket says 172.21.15.7:50028) 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78cb800640 1 -- 172.21.15.7:0/1611170556 learned_addr learned my addr 172.21.15.7:0/1611170556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78cae00640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1400 0x564217291180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.646+0000 7f78cae00640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1c00 0x564217290680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78cb800640 1 -- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1400 msgr2=0x564217291180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78cb800640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1400 0x564217291180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78cb800640 1 -- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1c00 msgr2=0x564217290680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78cb800640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1c00 0x564217290680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78cb800640 1 -- 172.21.15.7:0/1611170556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564217248780 con 0x5642180e1800 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78cb800640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1800 0x564217290c00 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x56421814f440 tx=0x564218014c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78c4000640 1 -- 172.21.15.7:0/1611170556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5642172389c0 con 0x5642180e1800 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78c4000640 1 -- 172.21.15.7:0/1611170556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56421723efc0 con 0x5642180e1800 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78c4000640 1 -- 172.21.15.7:0/1611170556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564217238680 con 0x5642180e1800 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642172494a0 con 0x5642180e1800 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564217248960 con 0x5642180e1800 2024-08-19T00:48:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.647+0000 7f78ce414280 4 main: JournalTool: resolving pool 14 2024-08-19T00:48:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.649+0000 7f78c4000640 1 -- 172.21.15.7:0/1611170556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x564218166c00 con 0x5642180e1800 2024-08-19T00:48:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.649+0000 7f78c4000640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x564218172c00 0x564217291700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.650+0000 7f78c4000640 1 -- 172.21.15.7:0/1611170556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x564218174800 con 0x5642180e1800 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.650+0000 7f78ce414280 4 main: JournalTool: creating IoCtx.. 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.650+0000 7f78ce414280 4 main: Executing for rank 0 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.650+0000 7f78cae00640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x564218172c00 0x564217291700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.650+0000 7f78cae00640 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x564218172c00 0x564217291700 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x5642172554a0 tx=0x564217fb35c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.650+0000 7f78ce414280 1 -- start start 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.651+0000 7f78ce414280 1 Processor -- start 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.651+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564218173400 0x564217290100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.651+0000 7f78ce414280 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564218173800 0x56421728fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.651+0000 7f78ce414280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564218173c00 0x56421728f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.651+0000 7f78ce414280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564217f8f500 con 0x564218173c00 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.651+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564217f8f680 con 0x564218173800 2024-08-19T00:48:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.651+0000 7f78ce414280 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564217f8f800 con 0x564218173400 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564218173c00 0x56421728f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564218173c00 0x56421728f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50042/0 (socket says 172.21.15.7:50042) 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 -- 172.21.15.7:0/2030680840 learned_addr learned my addr 172.21.15.7:0/2030680840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cc200640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564218173400 0x564217290100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cb800640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564218173800 0x56421728fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564218173400 msgr2=0x564217290100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564218173400 0x564217290100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564218173800 msgr2=0x56421728fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564218173800 0x56421728fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.652+0000 7f78cae00640 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564217249680 con 0x564218173c00 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78cae00640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564218173c00 0x56421728f600 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x5642175611d0 tx=0x564217fb3620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b4fbf84f415533 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78c0400640 1 -- 172.21.15.7:0/2030680840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564217238b60 con 0x564218173c00 2024-08-19T00:48:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78c0400640 1 -- 172.21.15.7:0/2030680840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56421723ee00 con 0x564218173c00 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78c0400640 1 -- 172.21.15.7:0/2030680840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5642172384e0 con 0x564218173c00 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564217248780 con 0x564218173c00 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5642172494a0 con 0x564218173c00 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78ce414280 4 waiting for MDS map... 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78c0400640 1 -- 172.21.15.7:0/2030680840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x564217608200 con 0x564218173c00 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78c0400640 1 -- 172.21.15.7:0/2030680840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 347) ==== 2893+0+0 (secure 0 0 0) 0x56421726d500 con 0x564218173c00 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78ce414280 4 Got MDS map 347 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56421760b800 0x56421761a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.653+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137) -- 0x56421760bc00 con 0x56421760b800 2024-08-19T00:48:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.654+0000 7f78cc200640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56421760b800 0x56421761a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.654+0000 7f78cc200640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56421760b800 0x56421761a000 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=fb0580746059a6a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.657+0000 7f78cc200640 1 -- 172.21.15.7:0/2030680840 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x564217fa0000 con 0x56421760b800 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.657+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137) -- 0x564217622000 con 0x56421760b800 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.657+0000 7f78cc200640 1 -- 172.21.15.7:0/2030680840 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x564217fa0000 con 0x56421760b800 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.657+0000 7f78be600640 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e137) -- 0x564217623c00 con 0x56421760b800 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.657+0000 7f78be600640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56421762a000 0x56421761c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.657+0000 7f78be600640 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e137) -- 0x56421762a400 con 0x56421762a000 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.658+0000 7f78cc200640 1 -- 172.21.15.7:0/2030680840 <== osd.1 v2:172.21.15.7:6800/3345827885 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv19 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x564217fa0000 con 0x56421760b800 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.658+0000 7f78cb800640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56421762a000 0x56421761c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.658+0000 7f78cb800640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56421762a000 0x56421761c680 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=5b271ec7de10a1e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.661+0000 7f78cb800640 1 -- 172.21.15.7:0/2030680840 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564217fa0500 con 0x56421762a000 2024-08-19T00:48:59.663 INFO:teuthology.orchestra.run.smithi007.stdout:old journal was 4226108~2030 2024-08-19T00:48:59.663 INFO:teuthology.orchestra.run.smithi007.stdout:new journal start will be 8388608 (4160470 bytes past old end) 2024-08-19T00:48:59.663 INFO:teuthology.orchestra.run.smithi007.stdout:writing journal head 2024-08-19T00:48:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.661+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- osd_op(unknown.0.0:5 14.14 14:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x564217622400 con 0x56421760b800 2024-08-19T00:48:59.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78cc200640 1 -- 172.21.15.7:0/2030680840 <== osd.1 v2:172.21.15.7:6800/3345827885 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v137'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564217fa0000 con 0x56421760b800 2024-08-19T00:48:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:writing EResetJournal entry 2024-08-19T00:48:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:6 14.1b 14:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x564217622800 con 0x56421762a000 2024-08-19T00:48:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:7 14.b 14:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x564217622c00 con 0x56421762a000 2024-08-19T00:48:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564217623000 0x56421761a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- osd_op(unknown.0.0:8 14.1f 14:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x564217623400 con 0x564217623000 2024-08-19T00:48:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x564217623800 0x56421761ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:9 14.1a 14:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x56421762a800 con 0x564217623800 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56421762ac00 0x56421761b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- osd_op(unknown.0.0:10 14.1e 14:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x56421762b000 con 0x56421762ac00 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.663+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- osd_op(unknown.0.0:11 14.1d 14:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x564217622000 con 0x564217623800 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.664+0000 7f78cae00640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56421762ac00 0x56421761b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.664+0000 7f78cc200640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564217623000 0x56421761a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.664+0000 7f78cb800640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x564217623800 0x56421761ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.664+0000 7f78cae00640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56421762ac00 0x56421761b080 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=1b97e667b4d03005 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.665+0000 7f78cc200640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564217623000 0x56421761a580 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=4132c4195306c3b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.665+0000 7f78cb800640 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x564217623800 0x56421761ab00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=541ef554a87e84cf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.665+0000 7f78cb800640 1 -- 172.21.15.7:0/2030680840 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== osd_op_reply(7 200.00000003 [delete] v137'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564217fa0500 con 0x56421762a000 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.665+0000 7f78cb800640 1 -- 172.21.15.7:0/2030680840 <== osd.6 v2:172.21.15.162:6816/3414725774 3 ==== osd_op_reply(6 200.00000002 [delete] v137'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564217fa0500 con 0x56421762a000 2024-08-19T00:48:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.665+0000 7f78be600640 1 -- 172.21.15.7:0/2030680840 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- osd_op(unknown.0.0:12 14.1b 14:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137) -- 0x56421762a400 con 0x56421762a000 2024-08-19T00:48:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.666+0000 7f78cae00640 1 -- 172.21.15.7:0/2030680840 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== osd_op_reply(10 200.00000006 [delete] v137'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564217fa0780 con 0x56421762ac00 2024-08-19T00:48:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.667+0000 7f78cc200640 1 -- 172.21.15.7:0/2030680840 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== osd_op_reply(8 200.00000004 [delete] v137'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564217fa0000 con 0x564217623000 2024-08-19T00:48:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.667+0000 7f78cb800640 1 -- 172.21.15.7:0/2030680840 <== osd.6 v2:172.21.15.162:6816/3414725774 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v137'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564217fa0500 con 0x56421762a000 2024-08-19T00:48:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78cb800640 1 -- 172.21.15.7:0/2030680840 <== osd.4 v2:172.21.15.162:6806/2900813997 1 ==== osd_op_reply(9 200.00000005 [delete] v137'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564217fa0500 con 0x564217623800 2024-08-19T00:48:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78cb800640 1 -- 172.21.15.7:0/2030680840 <== osd.4 v2:172.21.15.162:6806/2900813997 2 ==== osd_op_reply(11 200.00000007 [delete] v137'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564217fa0500 con 0x564217623800 2024-08-19T00:48:59.670 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-08-19T00:48:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56421760b800 msgr2=0x56421761a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x56421760b800 0x56421761a000 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56421762ac00 msgr2=0x56421761b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x56421762ac00 0x56421761b080 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x564217623800 msgr2=0x56421761ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x564217623800 0x56421761ab00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56421762a000 msgr2=0x56421761c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x56421762a000 0x56421761c680 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564217623000 msgr2=0x56421761a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.668+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x564217623000 0x56421761a580 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78cae00640 1 -- 172.21.15.7:0/2030680840 reap_dead start 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564218173c00 msgr2=0x56421728f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 --2- 172.21.15.7:0/2030680840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564218173c00 0x56421728f600 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x5642175611d0 tx=0x564217fb3620 comp rx=0 tx=0).stop 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78cae00640 1 -- 172.21.15.7:0/2030680840 reap_dead start 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 shutdown_connections 2024-08-19T00:48:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 >> 172.21.15.7:0/2030680840 conn(0x564218173000 msgr2=0x5642172fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 shutdown_connections 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/2030680840 wait complete. 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x564218172c00 msgr2=0x564217291700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x564218172c00 0x564217291700 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x5642172554a0 tx=0x564217fb35c0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1800 msgr2=0x564217290c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1800 0x564217290c00 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x56421814f440 tx=0x564218014c00 comp rx=0 tx=0).stop 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 shutdown_connections 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x564218172c00 0x564217291700 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642180e1c00 0x564217290680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642180e1800 0x564217290c00 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 --2- 172.21.15.7:0/1611170556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642180e1400 0x564217291180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 >> 172.21.15.7:0/1611170556 conn(0x5642180e1000 msgr2=0x5642172fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 shutdown_connections 2024-08-19T00:48:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.669+0000 7f78ce414280 1 -- 172.21.15.7:0/1611170556 wait complete. 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 -- 172.21.15.7:0/3911529101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564217213c00 msgr2=0x56421728f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564217213c00 0x56421728f080 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x5642180352f0 tx=0x564217fb37a0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 -- 172.21.15.7:0/3911529101 shutdown_connections 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564217213c00 0x56421728f080 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564217213800 0x56421728eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 --2- 172.21.15.7:0/3911529101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564217212c00 0x56421728e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 -- 172.21.15.7:0/3911529101 >> 172.21.15.7:0/3911529101 conn(0x564217213000 msgr2=0x5642172fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 -- 172.21.15.7:0/3911529101 shutdown_connections 2024-08-19T00:48:59.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.670+0000 7f78ce414280 1 -- 172.21.15.7:0/3911529101 wait complete. 2024-08-19T00:48:59.677 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--yes-i-really-really-mean-it'] in time 0:00:00.113646, result: old journal was 4226108~2030 new journal start will be 8388608 (4160470 bytes past old end) writing journal head writing EResetJournal entry done 2024-08-19T00:48:59.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-08-19T00:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.876+0000 7f6574a00640 1 Processor -- start 2024-08-19T00:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.876+0000 7f6574a00640 1 -- start start 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f6574a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f657016e6c0 0x7f6570071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f6574a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6570072800 con 0x7f65700722c0 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f6574a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6570072ae0 con 0x7f65700d0af0 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f6574a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6570073410 con 0x7f657016e6c0 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f656de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f657016e6c0 0x7f6570071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f656de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f657016e6c0 0x7f6570071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50056/0 (socket says 172.21.15.7:50056) 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f656de00640 1 -- 172.21.15.7:0/921864221 learned_addr learned my addr 172.21.15.7:0/921864221 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.878+0000 7f656d400640 1 -- 172.21.15.7:0/921864221 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470575893 0 0) 0x7f6570072ae0 con 0x7f65700d0af0 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.886+0000 7f656d400640 1 -- 172.21.15.7:0/921864221 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6554003500 con 0x7f65700d0af0 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.877+0000 7f6567e00640 1 --1- 172.21.15.7:0/921864221 >> v1:172.21.15.7:6789/0 conn(0x7f65700722c0 0x7f65700d03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:43702/0 (socket says 172.21.15.7:43702) 2024-08-19T00:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.886+0000 7f656de00640 1 -- 172.21.15.7:0/921864221 >> v1:172.21.15.162:6789/0 conn(0x7f65700d0af0 legacy=0x7f65700acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.886+0000 7f656de00640 1 -- 172.21.15.7:0/921864221 >> v1:172.21.15.7:6789/0 conn(0x7f65700722c0 legacy=0x7f65700d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.886+0000 7f656de00640 1 -- 172.21.15.7:0/921864221 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6570072dc0 con 0x7f657016e6c0 2024-08-19T00:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.887+0000 7f656de00640 1 --2- 172.21.15.7:0/921864221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657016e6c0 0x7f6570071d80 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f6560009890 tx=0x7f656002a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f4de68f09b7255 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f656d400640 1 -- 172.21.15.7:0/921864221 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656002acb0 con 0x7f657016e6c0 2024-08-19T00:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f656d400640 1 -- 172.21.15.7:0/921864221 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656002ae50 con 0x7f657016e6c0 2024-08-19T00:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f656d400640 1 -- 172.21.15.7:0/921864221 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560004250 con 0x7f657016e6c0 2024-08-19T00:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f6574a00640 1 -- 172.21.15.7:0/921864221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657016e6c0 msgr2=0x7f6570071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f6574a00640 1 --2- 172.21.15.7:0/921864221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657016e6c0 0x7f6570071d80 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f6560009890 tx=0x7f656002a170 comp rx=0 tx=0).stop 2024-08-19T00:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f6574a00640 1 -- 172.21.15.7:0/921864221 shutdown_connections 2024-08-19T00:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f6574a00640 1 --2- 172.21.15.7:0/921864221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f657016e6c0 0x7f6570071d80 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.888+0000 7f6574a00640 1 -- 172.21.15.7:0/921864221 >> 172.21.15.7:0/921864221 conn(0x7f65700b2030 msgr2=0x7f65700b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.889+0000 7f6574a00640 1 -- 172.21.15.7:0/921864221 shutdown_connections 2024-08-19T00:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.889+0000 7f6574a00640 1 -- 172.21.15.7:0/921864221 wait complete. 2024-08-19T00:48:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.890+0000 7f6574a00640 1 Processor -- start 2024-08-19T00:48:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.890+0000 7f6574a00640 1 -- start start 2024-08-19T00:48:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.891+0000 7f6574a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65700722c0 0x7f657009c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.891+0000 7f6574a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65700d0af0 0x7f6570160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.891+0000 7f6574a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657016e6c0 0x7f6570161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.891+0000 7f6574a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65700ad600 con 0x7f65700722c0 2024-08-19T00:48:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.891+0000 7f6574a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65700b3130 con 0x7f65700d0af0 2024-08-19T00:48:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.891+0000 7f6574a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65700ad780 con 0x7f657016e6c0 2024-08-19T00:48:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.891+0000 7f656de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65700722c0 0x7f657009c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65700722c0 0x7f657009c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50064/0 (socket says 172.21.15.7:50064) 2024-08-19T00:48:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 -- 172.21.15.7:0/943907243 learned_addr learned my addr 172.21.15.7:0/943907243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:48:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f6567e00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65700d0af0 0x7f6570160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656e800640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657016e6c0 0x7f6570161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 -- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657016e6c0 msgr2=0x7f6570161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657016e6c0 0x7f6570161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 -- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65700d0af0 msgr2=0x7f6570160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65700d0af0 0x7f6570160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 -- 172.21.15.7:0/943907243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657009d3e0 con 0x7f65700722c0 2024-08-19T00:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656e800640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657016e6c0 0x7f6570161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.892+0000 7f656de00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65700722c0 0x7f657009c920 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f6560000c00 tx=0x7f65600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.893+0000 7f6566000640 1 -- 172.21.15.7:0/943907243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656003f030 con 0x7f65700722c0 2024-08-19T00:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.893+0000 7f6566000640 1 -- 172.21.15.7:0/943907243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65600093a0 con 0x7f65700722c0 2024-08-19T00:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.893+0000 7f6566000640 1 -- 172.21.15.7:0/943907243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560003820 con 0x7f65700722c0 2024-08-19T00:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.893+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657009d6c0 con 0x7f65700722c0 2024-08-19T00:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.893+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657009ce60 con 0x7f65700722c0 2024-08-19T00:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.894+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6570071d80 con 0x7f65700722c0 2024-08-19T00:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.895+0000 7f6566000640 1 -- 172.21.15.7:0/943907243 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6560042070 con 0x7f65700722c0 2024-08-19T00:48:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.896+0000 7f6566000640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f654c06be60 0x7f654c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.896+0000 7f6566000640 1 -- 172.21.15.7:0/943907243 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f65600aac10 con 0x7f65700722c0 2024-08-19T00:48:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.896+0000 7f6567e00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f654c06be60 0x7f654c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.897+0000 7f6567e00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f654c06be60 0x7f654c06e320 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f65700b05d0 tx=0x7f6558007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:59.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:48:59.900+0000 7f6566000640 1 -- 172.21.15.7:0/943907243 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6560079550 con 0x7f65700722c0 2024-08-19T00:49:00.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.120+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f65700ae7a0 con 0x7f65700722c0 2024-08-19T00:49:00.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.542+0000 7f6566000640 1 -- 172.21.15.7:0/943907243 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v348) ==== 162+0+0 (secure 0 0 0) 0x7f6560078e50 con 0x7f65700722c0 2024-08-19T00:49:00.544 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-08-19T00:49:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f654c06be60 msgr2=0x7f654c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f654c06be60 0x7f654c06e320 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f65700b05d0 tx=0x7f6558007e80 comp rx=0 tx=0).stop 2024-08-19T00:49:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65700722c0 msgr2=0x7f657009c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65700722c0 0x7f657009c920 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f6560000c00 tx=0x7f65600046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 shutdown_connections 2024-08-19T00:49:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f654c06be60 0x7f654c06e320 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f657016e6c0 0x7f6570161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65700d0af0 0x7f6570160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 --2- 172.21.15.7:0/943907243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65700722c0 0x7f657009c920 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.545+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 >> 172.21.15.7:0/943907243 conn(0x7f65700b2030 msgr2=0x7f65700afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.546+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 shutdown_connections 2024-08-19T00:49:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.546+0000 7f6574a00640 1 -- 172.21.15.7:0/943907243 wait complete. 2024-08-19T00:49:00.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:00.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.728+0000 7f2a39600640 1 Processor -- start 2024-08-19T00:49:00.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.728+0000 7f2a39600640 1 -- start start 2024-08-19T00:49:00.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a39600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a34159bf0 0x7f2a34073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:00.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a39600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2a340739a0 0x7f2a340ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a39600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340cea40 0x7f2a340d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a39600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3406f7f0 con 0x7f2a34159bf0 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a39600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3406f510 con 0x7f2a340739a0 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a39600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a34072980 con 0x7f2a340cea40 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a32a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a34159bf0 0x7f2a34073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a32a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a34159bf0 0x7f2a34073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50074/0 (socket says 172.21.15.7:50074) 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a32a00640 1 -- 172.21.15.7:0/3859447098 learned_addr learned my addr 172.21.15.7:0/3859447098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a33400640 1 --2- 172.21.15.7:0/3859447098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340cea40 0x7f2a340d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.729+0000 7f2a2be00640 1 --2- 172.21.15.7:0/3859447098 >> v2:172.21.15.162:3300/0 conn(0x7f2a340739a0 0x7f2a340ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.730+0000 7f2a32a00640 1 -- 172.21.15.7:0/3859447098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340cea40 msgr2=0x7f2a340d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:00.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.730+0000 7f2a32a00640 1 --2- 172.21.15.7:0/3859447098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340cea40 0x7f2a340d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.730+0000 7f2a32a00640 1 -- 172.21.15.7:0/3859447098 >> v2:172.21.15.162:3300/0 conn(0x7f2a340739a0 msgr2=0x7f2a340ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:00.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.730+0000 7f2a32a00640 1 --2- 172.21.15.7:0/3859447098 >> v2:172.21.15.162:3300/0 conn(0x7f2a340739a0 0x7f2a340ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.730+0000 7f2a32a00640 1 -- 172.21.15.7:0/3859447098 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a34072c60 con 0x7f2a34159bf0 2024-08-19T00:49:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a32a00640 1 --2- 172.21.15.7:0/3859447098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a34159bf0 0x7f2a34073460 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f2a340b1cc0 tx=0x7f2a2402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d190001343b246f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a32000640 1 -- 172.21.15.7:0/3859447098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24037070 con 0x7f2a34159bf0 2024-08-19T00:49:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a32000640 1 -- 172.21.15.7:0/3859447098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a24032440 con 0x7f2a34159bf0 2024-08-19T00:49:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a32000640 1 -- 172.21.15.7:0/3859447098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24032810 con 0x7f2a34159bf0 2024-08-19T00:49:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a39600640 1 -- 172.21.15.7:0/3859447098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a34159bf0 msgr2=0x7f2a34073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a39600640 1 --2- 172.21.15.7:0/3859447098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a34159bf0 0x7f2a34073460 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f2a340b1cc0 tx=0x7f2a2402a140 comp rx=0 tx=0).stop 2024-08-19T00:49:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a39600640 1 -- 172.21.15.7:0/3859447098 shutdown_connections 2024-08-19T00:49:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a39600640 1 --2- 172.21.15.7:0/3859447098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340cea40 0x7f2a340d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a39600640 1 --2- 172.21.15.7:0/3859447098 >> v2:172.21.15.162:3300/0 conn(0x7f2a340739a0 0x7f2a340ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a39600640 1 --2- 172.21.15.7:0/3859447098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a34159bf0 0x7f2a34073460 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.731+0000 7f2a39600640 1 -- 172.21.15.7:0/3859447098 >> 172.21.15.7:0/3859447098 conn(0x7f2a3406bc70 msgr2=0x7f2a3406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.732+0000 7f2a39600640 1 -- 172.21.15.7:0/3859447098 shutdown_connections 2024-08-19T00:49:00.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.732+0000 7f2a39600640 1 -- 172.21.15.7:0/3859447098 wait complete. 2024-08-19T00:49:00.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.733+0000 7f2a39600640 1 Processor -- start 2024-08-19T00:49:00.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.733+0000 7f2a39600640 1 -- start start 2024-08-19T00:49:00.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.734+0000 7f2a39600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340739a0 0x7f2a340b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.734+0000 7f2a39600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a340cea40 0x7f2a341f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.734+0000 7f2a39600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a34159bf0 0x7f2a341f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.734+0000 7f2a39600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3415a150 con 0x7f2a340cea40 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.734+0000 7f2a39600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a34159fd0 con 0x7f2a34159bf0 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.734+0000 7f2a39600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a340d0900 con 0x7f2a340739a0 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.734+0000 7f2a2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a340cea40 0x7f2a341f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a340cea40 0x7f2a341f6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50088/0 (socket says 172.21.15.7:50088) 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 -- 172.21.15.7:0/1481202640 learned_addr learned my addr 172.21.15.7:0/1481202640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a32a00640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340739a0 0x7f2a340b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a33400640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a34159bf0 0x7f2a341f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 -- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340739a0 msgr2=0x7f2a340b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:00.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340739a0 0x7f2a340b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 -- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a34159bf0 msgr2=0x7f2a341f6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:00.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a34159bf0 0x7f2a341f6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 -- 172.21.15.7:0/1481202640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a34155af0 con 0x7f2a340cea40 2024-08-19T00:49:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2be00640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a340cea40 0x7f2a341f6720 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00d620 tx=0x7f2a1c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.735+0000 7f2a2aa00640 1 -- 172.21.15.7:0/1481202640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00b620 con 0x7f2a340cea40 2024-08-19T00:49:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.736+0000 7f2a2aa00640 1 -- 172.21.15.7:0/1481202640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1c019070 con 0x7f2a340cea40 2024-08-19T00:49:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.736+0000 7f2a2aa00640 1 -- 172.21.15.7:0/1481202640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00ba00 con 0x7f2a340cea40 2024-08-19T00:49:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.736+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a34155dd0 con 0x7f2a340cea40 2024-08-19T00:49:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.736+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a34156390 con 0x7f2a340cea40 2024-08-19T00:49:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.737+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a340d03c0 con 0x7f2a340cea40 2024-08-19T00:49:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.738+0000 7f2a2aa00640 1 -- 172.21.15.7:0/1481202640 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a1c00bba0 con 0x7f2a340cea40 2024-08-19T00:49:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.738+0000 7f2a2aa00640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a1006be30 0x7f2a1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.739+0000 7f2a2aa00640 1 -- 172.21.15.7:0/1481202640 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f2a1c08b210 con 0x7f2a340cea40 2024-08-19T00:49:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.739+0000 7f2a32a00640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a1006be30 0x7f2a1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.740+0000 7f2a32a00640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a1006be30 0x7f2a1006e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2a24034000 tx=0x7f2a2402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:00.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.743+0000 7f2a2aa00640 1 -- 172.21.15.7:0/1481202640 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2a1c059470 con 0x7f2a340cea40 2024-08-19T00:49:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.966+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a3406c980 con 0x7f2a340cea40 2024-08-19T00:49:00.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.966+0000 7f2a2aa00640 1 -- 172.21.15.7:0/1481202640 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 349 v349) ==== 95+0+5230 (secure 0 0 0) 0x7f2a1c05d770 con 0x7f2a340cea40 2024-08-19T00:49:00.968 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:00.968 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":349,"btime":"2024-08-19T00:49:00:546102+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":349,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:49:00.546082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10623},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10623":{"gid":10623,"name":"c","rank":0,"incarnation":349,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/3771894460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3771894460},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771894460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-08-19T00:49:00.969 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 349 2024-08-19T00:49:00.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a1006be30 msgr2=0x7f2a1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a1006be30 0x7f2a1006e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2a24034000 tx=0x7f2a2402e000 comp rx=0 tx=0).stop 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a340cea40 msgr2=0x7f2a341f6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a340cea40 0x7f2a341f6720 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00d620 tx=0x7f2a1c00dae0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 shutdown_connections 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2a1006be30 0x7f2a1006e2f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a34159bf0 0x7f2a341f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a340cea40 0x7f2a341f6720 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 --2- 172.21.15.7:0/1481202640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a340739a0 0x7f2a340b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.968+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 >> 172.21.15.7:0/1481202640 conn(0x7f2a3406bc70 msgr2=0x7f2a3415ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.969+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 shutdown_connections 2024-08-19T00:49:00.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:00.969+0000 7f2a39600640 1 -- 172.21.15.7:0/1481202640 wait complete. 2024-08-19T00:49:01.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 349, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:48:48.621186+0000', 'modified': '2024-08-19T00:49:00.546082+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 137, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10623}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10623': {'gid': 10623, 'name': 'c', 'rank': 0, 'incarnation': 349, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/3771894460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 3771894460}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3771894460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:49:01.389 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10623:up:replay 2024-08-19T00:49:02.390 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:02.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.558+0000 7f81fac00640 1 Processor -- start 2024-08-19T00:49:02.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.558+0000 7f81fac00640 1 -- start start 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81fac00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f81f40d2ba0 0x7f81f40b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81fac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f40d5240 con 0x7f81f406d960 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81fac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f40b39c0 con 0x7f81f4161ba0 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81fac00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f81f40b36e0 con 0x7f81f40d2ba0 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81f8c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f81f40d2ba0 0x7f81f40b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81f8c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f81f40d2ba0 0x7f81f40b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50090/0 (socket says 172.21.15.7:50090) 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81f8c00640 1 -- 172.21.15.7:0/521590000 learned_addr learned my addr 172.21.15.7:0/521590000 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.559+0000 7f81f3400640 1 --1- 172.21.15.7:0/521590000 >> v1:172.21.15.7:6789/0 conn(0x7f81f406d960 0x7f81f40b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:43706/0 (socket says 172.21.15.7:43706) 2024-08-19T00:49:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.560+0000 7f81f8c00640 1 -- 172.21.15.7:0/521590000 >> v1:172.21.15.162:6789/0 conn(0x7f81f4161ba0 legacy=0x7f81f40d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.560+0000 7f81f8c00640 1 -- 172.21.15.7:0/521590000 >> v1:172.21.15.7:6789/0 conn(0x7f81f406d960 legacy=0x7f81f40b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.560+0000 7f81f8c00640 1 -- 172.21.15.7:0/521590000 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f406e3a0 con 0x7f81f40d2ba0 2024-08-19T00:49:02.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.561+0000 7f81f8c00640 1 --2- 172.21.15.7:0/521590000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f40b2810 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009e50 tx=0x7f81ec02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f5c6219b7124af server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:02.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.561+0000 7f81f2a00640 1 -- 172.21.15.7:0/521590000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec036070 con 0x7f81f40d2ba0 2024-08-19T00:49:02.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.561+0000 7f81f2a00640 1 -- 172.21.15.7:0/521590000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec031600 con 0x7f81f40d2ba0 2024-08-19T00:49:02.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.561+0000 7f81f2a00640 1 -- 172.21.15.7:0/521590000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0319f0 con 0x7f81f40d2ba0 2024-08-19T00:49:02.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.562+0000 7f81fac00640 1 -- 172.21.15.7:0/521590000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 msgr2=0x7f81f40b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.562+0000 7f81fac00640 1 --2- 172.21.15.7:0/521590000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f40b2810 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009e50 tx=0x7f81ec02a7c0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.562+0000 7f81fac00640 1 -- 172.21.15.7:0/521590000 shutdown_connections 2024-08-19T00:49:02.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.562+0000 7f81fac00640 1 --2- 172.21.15.7:0/521590000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f40b2810 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.562+0000 7f81fac00640 1 -- 172.21.15.7:0/521590000 >> 172.21.15.7:0/521590000 conn(0x7f81f408c000 msgr2=0x7f81f40d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:02.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.562+0000 7f81fac00640 1 -- 172.21.15.7:0/521590000 shutdown_connections 2024-08-19T00:49:02.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.562+0000 7f81fac00640 1 -- 172.21.15.7:0/521590000 wait complete. 2024-08-19T00:49:02.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.563+0000 7f81fac00640 1 Processor -- start 2024-08-19T00:49:02.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.564+0000 7f81fac00640 1 -- start start 2024-08-19T00:49:02.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.564+0000 7f81fac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81f406d960 0x7f81f41f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:02.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.564+0000 7f81fac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:02.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.564+0000 7f81fac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81f4161ba0 0x7f81f40b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.564+0000 7f81fac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4161f80 con 0x7f81f40d2ba0 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.564+0000 7f81fac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81f40b1be0 con 0x7f81f4161ba0 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81fac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f81f4162100 con 0x7f81f406d960 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50102/0 (socket says 172.21.15.7:50102) 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 -- 172.21.15.7:0/436496414 learned_addr learned my addr 172.21.15.7:0/436496414 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f8c00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81f4161ba0 0x7f81f40b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3e00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81f406d960 0x7f81f41f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 -- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81f406d960 msgr2=0x7f81f41f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81f406d960 0x7f81f41f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 -- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81f4161ba0 msgr2=0x7f81f40b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81f4161ba0 0x7f81f40b9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3400640 1 -- 172.21.15.7:0/436496414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f415af10 con 0x7f81f40d2ba0 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.565+0000 7f81f3e00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81f406d960 0x7f81f41f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.566+0000 7f81f3400640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f415a6c0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c450 tx=0x7f81e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.566+0000 7f81ebe00640 1 -- 172.21.15.7:0/436496414 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0018070 con 0x7f81f40d2ba0 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.566+0000 7f81ebe00640 1 -- 172.21.15.7:0/436496414 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e00074a0 con 0x7f81f40d2ba0 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.566+0000 7f81ebe00640 1 -- 172.21.15.7:0/436496414 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0004a20 con 0x7f81f40d2ba0 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.566+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f40cc670 con 0x7f81f40d2ba0 2024-08-19T00:49:02.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.566+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f415ac00 con 0x7f81f40d2ba0 2024-08-19T00:49:02.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.567+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f40b1050 con 0x7f81f40d2ba0 2024-08-19T00:49:02.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.568+0000 7f81ebe00640 1 -- 172.21.15.7:0/436496414 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81e001b070 con 0x7f81f40d2ba0 2024-08-19T00:49:02.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.569+0000 7f81ebe00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:02.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.569+0000 7f81ebe00640 1 -- 172.21.15.7:0/436496414 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f81e008a050 con 0x7f81f40d2ba0 2024-08-19T00:49:02.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.569+0000 7f81f3e00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:02.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.570+0000 7f81f3e00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81d406be30 0x7f81d406e2f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f81e4001660 tx=0x7f81e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:02.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.573+0000 7f81ebe00640 1 -- 172.21.15.7:0/436496414 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f81f40b1050 con 0x7f81f40d2ba0 2024-08-19T00:49:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.792+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81f40d4b30 con 0x7f81f40d2ba0 2024-08-19T00:49:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.792+0000 7f81ebe00640 1 -- 172.21.15.7:0/436496414 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) ==== 95+0+5230 (secure 0 0 0) 0x7f81e0007650 con 0x7f81f40d2ba0 2024-08-19T00:49:02.794 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:02.795 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":351,"btime":"2024-08-19T00:49:02:550786+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":351,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:49:01.553096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10623},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10623":{"gid":10623,"name":"c","rank":0,"incarnation":349,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.7:6837/3771894460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3771894460},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771894460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-08-19T00:49:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 351 2024-08-19T00:49:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81d406be30 msgr2=0x7f81d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81d406be30 0x7f81d406e2f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f81e4001660 tx=0x7f81e4009040 comp rx=0 tx=0).stop 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 msgr2=0x7f81f415a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f415a6c0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c450 tx=0x7f81e000c910 comp rx=0 tx=0).stop 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 shutdown_connections 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81f4161ba0 0x7f81f40b9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81f40d2ba0 0x7f81f415a6c0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 --2- 172.21.15.7:0/436496414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81f406d960 0x7f81f41f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 >> 172.21.15.7:0/436496414 conn(0x7f81f408c000 msgr2=0x7f81f40b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 shutdown_connections 2024-08-19T00:49:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:02.795+0000 7f81fac00640 1 -- 172.21.15.7:0/436496414 wait complete. 2024-08-19T00:49:03.215 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 351, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:48:48.621186+0000', 'modified': '2024-08-19T00:49:01.553096+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 137, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10623}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10623': {'gid': 10623, 'name': 'c', 'rank': 0, 'incarnation': 349, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.7:6837/3771894460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 3771894460}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3771894460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-19T00:49:03.215 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10623:up:rejoin 2024-08-19T00:49:03.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:49:03.324 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:49:04.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.382+0000 7f8273400640 1 Processor -- start 2024-08-19T00:49:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.382+0000 7f8273400640 1 -- start start 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.383+0000 7f8273400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f826c159bf0 0x7f826c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.383+0000 7f8273400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0739a0 0x7f826c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.383+0000 7f8273400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826c06f7f0 con 0x7f826c0cea40 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.383+0000 7f8273400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f826c06f510 con 0x7f826c159bf0 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.383+0000 7f8273400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f826c072980 con 0x7f826c0739a0 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f8270a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f826c159bf0 0x7f826c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f8270a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f826c159bf0 0x7f826c073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60292/0 (socket says 172.21.15.7:60292) 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f8270a00640 1 -- 172.21.15.7:0/971237290 learned_addr learned my addr 172.21.15.7:0/971237290 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f826be00640 1 --2- 172.21.15.7:0/971237290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0739a0 0x7f826c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f8270a00640 1 -- 172.21.15.7:0/971237290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0739a0 msgr2=0x7f826c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f8270a00640 1 --2- 172.21.15.7:0/971237290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0739a0 0x7f826c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f8270a00640 1 -- 172.21.15.7:0/971237290 >> v1:172.21.15.162:6789/0 conn(0x7f826c0cea40 legacy=0x7f826c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.384+0000 7f8270a00640 1 -- 172.21.15.7:0/971237290 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c072c60 con 0x7f826c159bf0 2024-08-19T00:49:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.385+0000 7f8270a00640 1 --2- 172.21.15.7:0/971237290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c159bf0 0x7f826c073460 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f8260009870 tx=0x7f826002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84da6168272503e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f826b400640 1 -- 172.21.15.7:0/971237290 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260037070 con 0x7f826c159bf0 2024-08-19T00:49:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f826b400640 1 -- 172.21.15.7:0/971237290 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8260032440 con 0x7f826c159bf0 2024-08-19T00:49:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f826b400640 1 -- 172.21.15.7:0/971237290 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260032810 con 0x7f826c159bf0 2024-08-19T00:49:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 -- 172.21.15.7:0/971237290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c159bf0 msgr2=0x7f826c073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 --2- 172.21.15.7:0/971237290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c159bf0 0x7f826c073460 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f8260009870 tx=0x7f826002a1c0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 -- 172.21.15.7:0/971237290 shutdown_connections 2024-08-19T00:49:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 --2- 172.21.15.7:0/971237290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0739a0 0x7f826c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 --2- 172.21.15.7:0/971237290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c159bf0 0x7f826c073460 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 -- 172.21.15.7:0/971237290 >> 172.21.15.7:0/971237290 conn(0x7f826c06bc70 msgr2=0x7f826c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 -- 172.21.15.7:0/971237290 shutdown_connections 2024-08-19T00:49:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.386+0000 7f8273400640 1 -- 172.21.15.7:0/971237290 wait complete. 2024-08-19T00:49:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.388+0000 7f8273400640 1 Processor -- start 2024-08-19T00:49:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.388+0000 7f8273400640 1 -- start start 2024-08-19T00:49:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8273400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c0739a0 0x7f826c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8273400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0cea40 0x7f826c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8273400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f826c159bf0 0x7f826c1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8273400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f826c15a150 con 0x7f826c0739a0 2024-08-19T00:49:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8273400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f826c159fd0 con 0x7f826c159bf0 2024-08-19T00:49:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8273400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f826c0d0ad0 con 0x7f826c0cea40 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8270a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c0739a0 0x7f826c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8270a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c0739a0 0x7f826c14c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60302/0 (socket says 172.21.15.7:60302) 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8270a00640 1 -- 172.21.15.7:0/271919497 learned_addr learned my addr 172.21.15.7:0/271919497 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f826be00640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0cea40 0x7f826c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.389+0000 7f8271400640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f826c159bf0 0x7f826c1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8270a00640 1 -- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0cea40 msgr2=0x7f826c153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8270a00640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0cea40 0x7f826c153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8270a00640 1 -- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f826c159bf0 msgr2=0x7f826c1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8270a00640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f826c159bf0 0x7f826c1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8270a00640 1 -- 172.21.15.7:0/271919497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c151470 con 0x7f826c0739a0 2024-08-19T00:49:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8270a00640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c0739a0 0x7f826c14c2d0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f8260000c00 tx=0x7f82600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8268c00640 1 -- 172.21.15.7:0/271919497 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260041020 con 0x7f826c0739a0 2024-08-19T00:49:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8268c00640 1 -- 172.21.15.7:0/271919497 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82600306c0 con 0x7f826c0739a0 2024-08-19T00:49:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c150f10 con 0x7f826c0739a0 2024-08-19T00:49:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.390+0000 7f8268c00640 1 -- 172.21.15.7:0/271919497 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260037040 con 0x7f826c0739a0 2024-08-19T00:49:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.391+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c1f0210 con 0x7f826c0739a0 2024-08-19T00:49:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.392+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c0ce500 con 0x7f826c0739a0 2024-08-19T00:49:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.393+0000 7f8268c00640 1 -- 172.21.15.7:0/271919497 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8260044020 con 0x7f826c0739a0 2024-08-19T00:49:04.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.394+0000 7f8268c00640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f824c06be30 0x7f824c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:04.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.394+0000 7f8268c00640 1 -- 172.21.15.7:0/271919497 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f82600ab180 con 0x7f826c0739a0 2024-08-19T00:49:04.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.394+0000 7f826be00640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f824c06be30 0x7f824c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:04.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.394+0000 7f826be00640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f824c06be30 0x7f824c06e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f826c09e550 tx=0x7f8258008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:04.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.398+0000 7f8268c00640 1 -- 172.21.15.7:0/271919497 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f826004b070 con 0x7f826c0739a0 2024-08-19T00:49:04.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.619+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f826c15c240 con 0x7f826c0739a0 2024-08-19T00:49:04.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.619+0000 7f8268c00640 1 -- 172.21.15.7:0/271919497 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 352 v352) ==== 95+0+5239 (secure 0 0 0) 0x7f826c150f10 con 0x7f826c0739a0 2024-08-19T00:49:04.629 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:04.629 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":352,"btime":"2024-08-19T00:49:03:557470+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":352,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:49:03.557465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10623},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10623":{"gid":10623,"name":"c","rank":0,"incarnation":349,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/3771894460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3771894460},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771894460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10623,"qdb_cluster":[10623]},"id":7}]} 2024-08-19T00:49:04.630 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 352 2024-08-19T00:49:04.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f824c06be30 msgr2=0x7f824c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:04.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f824c06be30 0x7f824c06e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f826c09e550 tx=0x7f8258008040 comp rx=0 tx=0).stop 2024-08-19T00:49:04.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c0739a0 msgr2=0x7f826c14c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:04.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c0739a0 0x7f826c14c2d0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f8260000c00 tx=0x7f82600046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 shutdown_connections 2024-08-19T00:49:04.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f824c06be30 0x7f824c06e2f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f826c159bf0 0x7f826c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f826c0cea40 0x7f826c153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 --2- 172.21.15.7:0/271919497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f826c0739a0 0x7f826c14c2d0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:04.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 >> 172.21.15.7:0/271919497 conn(0x7f826c06bc70 msgr2=0x7f826c15b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:04.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.621+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 shutdown_connections 2024-08-19T00:49:04.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:04.622+0000 7f8273400640 1 -- 172.21.15.7:0/271919497 wait complete. 2024-08-19T00:49:05.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 352, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:48:48.621186+0000', 'modified': '2024-08-19T00:49:03.557465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 137, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10623}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10623': {'gid': 10623, 'name': 'c', 'rank': 0, 'incarnation': 349, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/3771894460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 3771894460}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3771894460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10623, 'qdb_cluster': [10623]} 2024-08-19T00:49:05.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:49:05.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-19T00:49:05.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.208+0000 7fe168400640 1 Processor -- start 2024-08-19T00:49:05.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.208+0000 7fe168400640 1 -- start start 2024-08-19T00:49:05.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.209+0000 7fe168400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe16006c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.209+0000 7fe168400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe1600d2090 0x7fe1600d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.209+0000 7fe168400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1600d0fa0 con 0x7fe1600d2490 2024-08-19T00:49:05.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.209+0000 7fe168400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe1600d1280 con 0x7fe1600d2090 2024-08-19T00:49:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.209+0000 7fe168400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1600d1560 con 0x7fe16015e590 2024-08-19T00:49:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe1600d2090 0x7fe1600d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe1600d2090 0x7fe1600d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60310/0 (socket says 172.21.15.7:60310) 2024-08-19T00:49:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165000640 1 -- 172.21.15.7:0/1972060931 learned_addr learned my addr 172.21.15.7:0/1972060931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165a00640 1 --2- 172.21.15.7:0/1972060931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe16006c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165000640 1 -- 172.21.15.7:0/1972060931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 msgr2=0x7fe16006c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165000640 1 --2- 172.21.15.7:0/1972060931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe16006c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165000640 1 -- 172.21.15.7:0/1972060931 >> v1:172.21.15.7:6789/0 conn(0x7fe1600d2490 legacy=0x7fe1600cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe15fe00640 1 -- 172.21.15.7:0/1972060931 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865835036 0 0) 0x7fe1600d0fa0 con 0x7fe1600d2490 2024-08-19T00:49:05.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.210+0000 7fe165000640 1 -- 172.21.15.7:0/1972060931 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1600d1840 con 0x7fe1600d2090 2024-08-19T00:49:05.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.212+0000 7fe165000640 1 --2- 172.21.15.7:0/1972060931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe1600d2aa0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009870 tx=0x7fe14c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f201ae3ad4423f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.212+0000 7fe15fe00640 1 -- 172.21.15.7:0/1972060931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c037070 con 0x7fe1600d2090 2024-08-19T00:49:05.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.212+0000 7fe15fe00640 1 -- 172.21.15.7:0/1972060931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c032440 con 0x7fe1600d2090 2024-08-19T00:49:05.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.212+0000 7fe15fe00640 1 -- 172.21.15.7:0/1972060931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c032810 con 0x7fe1600d2090 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 -- 172.21.15.7:0/1972060931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 msgr2=0x7fe1600d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 --2- 172.21.15.7:0/1972060931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe1600d2aa0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009870 tx=0x7fe14c02a250 comp rx=0 tx=0).stop 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 -- 172.21.15.7:0/1972060931 shutdown_connections 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 --2- 172.21.15.7:0/1972060931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe1600d2aa0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 --2- 172.21.15.7:0/1972060931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe16006c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 -- 172.21.15.7:0/1972060931 >> 172.21.15.7:0/1972060931 conn(0x7fe16009d710 msgr2=0x7fe1600d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 -- 172.21.15.7:0/1972060931 shutdown_connections 2024-08-19T00:49:05.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.213+0000 7fe168400640 1 -- 172.21.15.7:0/1972060931 wait complete. 2024-08-19T00:49:05.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.215+0000 7fe168400640 1 Processor -- start 2024-08-19T00:49:05.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.215+0000 7fe168400640 1 -- start start 2024-08-19T00:49:05.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe168400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe160145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe168400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1600d2490 0x7fe1601e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe168400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe1601e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe168400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe16015eaf0 con 0x7fe1600d2090 2024-08-19T00:49:05.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe168400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe16015e970 con 0x7fe1600d2490 2024-08-19T00:49:05.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe168400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1600d0b70 con 0x7fe16015e590 2024-08-19T00:49:05.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe165a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe160145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe165a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe160145550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60326/0 (socket says 172.21.15.7:60326) 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe165a00640 1 -- 172.21.15.7:0/3485065872 learned_addr learned my addr 172.21.15.7:0/3485065872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe165000640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1600d2490 0x7fe1601e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.216+0000 7fe166400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe1601e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe165a00640 1 -- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 msgr2=0x7fe1601e9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe165a00640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe1601e9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe165a00640 1 -- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1600d2490 msgr2=0x7fe1601e8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe165a00640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1600d2490 0x7fe1601e8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe165a00640 1 -- 172.21.15.7:0/3485065872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1601e8630 con 0x7fe1600d2090 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe165a00640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe160145550 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fe15400e8a0 tx=0x7fe15400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe15d600640 1 -- 172.21.15.7:0/3485065872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154017070 con 0x7fe1600d2090 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe15d600640 1 -- 172.21.15.7:0/3485065872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15400c940 con 0x7fe1600d2090 2024-08-19T00:49:05.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1601484d0 con 0x7fe1600d2090 2024-08-19T00:49:05.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.217+0000 7fe15d600640 1 -- 172.21.15.7:0/3485065872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15400cd30 con 0x7fe1600d2090 2024-08-19T00:49:05.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.218+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1600b7970 con 0x7fe1600d2090 2024-08-19T00:49:05.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.220+0000 7fe15d600640 1 -- 172.21.15.7:0/3485065872 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe15401a070 con 0x7fe1600d2090 2024-08-19T00:49:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.221+0000 7fe16b445740 1 Processor -- start 2024-08-19T00:49:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.221+0000 7fe15d600640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe14006be30 0x7fe14006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.221+0000 7fe16b445740 1 -- start start 2024-08-19T00:49:05.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe15d600640 1 -- 172.21.15.7:0/3485065872 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7fe15408b100 con 0x7fe1600d2090 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe166400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe14006be30 0x7fe14006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b39330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5c470 0x55b7e1b5c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe166400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe14006be30 0x7fe14006e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe158007fd0 tx=0x7fe158009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe16b445740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b51df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe16b445740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7e1a71ba0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b7e1a0a230 con 0x55b7e1b5c470 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.222+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b7e1a6db60 con 0x55b7e1b38f50 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b51df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe165000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5c470 0x55b7e1b5c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b51df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60330/0 (socket says 172.21.15.7:60330) 2024-08-19T00:49:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 -- 172.21.15.7:0/3038258542 learned_addr learned my addr 172.21.15.7:0/3038258542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe165a00640 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b39330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 -- 172.21.15.7:0/3038258542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 msgr2=0x55b7e1b39330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b39330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 -- 172.21.15.7:0/3038258542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5c470 msgr2=0x55b7e1b5c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5c470 0x55b7e1b5c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.223+0000 7fe166400640 1 -- 172.21.15.7:0/3038258542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7e1a3bbb0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.224+0000 7fe166400640 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b51df0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fe158003b00 tx=0x7fe158011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fb246aca3eb1dc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.224+0000 7fe152000640 1 -- 172.21.15.7:0/3038258542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1580052e0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.224+0000 7fe152000640 1 -- 172.21.15.7:0/3038258542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1580054a0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.224+0000 7fe152000640 1 -- 172.21.15.7:0/3038258542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158022420 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 -- 172.21.15.7:0/3038258542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 msgr2=0x55b7e1b51df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b51df0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fe158003b00 tx=0x7fe158011000 comp rx=0 tx=0).stop 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 -- 172.21.15.7:0/3038258542 shutdown_connections 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b51df0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5c470 0x55b7e1b5c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 --2- 172.21.15.7:0/3038258542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b39330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 -- 172.21.15.7:0/3038258542 >> 172.21.15.7:0/3038258542 conn(0x55b7e1ad6110 msgr2=0x55b7e1b53d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 -- 172.21.15.7:0/3038258542 shutdown_connections 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.225+0000 7fe16b445740 1 -- 172.21.15.7:0/3038258542 wait complete. 2024-08-19T00:49:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.226+0000 7fe16b445740 1 -- start start 2024-08-19T00:49:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.226+0000 7fe16b445740 1 Processor -- start 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b38f50 0x55b7e1b4d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b0f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe16b445740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b53050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe16b445740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7e1b55ea0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b7e1a2d250 con 0x55b7e1b38f50 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b7e1b555b0 con 0x55b7e1b5c470 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe16b445740 10 client.0 _ll_register_callbacks cb 0x55b7e1a31740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe166400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b53050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe166400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b53050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60340/0 (socket says 172.21.15.7:60340) 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe166400640 1 -- 172.21.15.7:0/61227448 learned_addr learned my addr 172.21.15.7:0/61227448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe165a00640 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b38f50 0x55b7e1b4d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.227+0000 7fe165000640 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b0f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe166400640 1 -- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 msgr2=0x55b7e1b0f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe166400640 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b0f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe166400640 1 -- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b38f50 msgr2=0x55b7e1b4d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe166400640 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b38f50 0x55b7e1b4d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe166400640 1 -- 172.21.15.7:0/61227448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7e17852d0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe166400640 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b53050 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fe158005900 tx=0x7fe158013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4246218f0b732aea server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe146a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe146a00640 1 -- 172.21.15.7:0/61227448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158006d40 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe146a00640 1 -- 172.21.15.7:0/61227448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7fe158007050 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.228+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1580054a0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe146a00640 1 -- 172.21.15.7:0/61227448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (secure 0 0 0) 0x7fe158032050 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 10 client.10677 fetch_fsmap learned FSMap version 352 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=352,monmap=2+}) -- 0x55b7e184f6b0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe146a00640 1 -- 172.21.15.7:0/61227448 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1580054a0 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe146a00640 1 -- 172.21.15.7:0/61227448 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 352) ==== 3502+0+0 (secure 0 0 0) 0x7fe158035020 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 10 client.10677 fetch_fsmap finished waiting for FSMap version 352 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 10 client.10677 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 20 client.10677 populate_metadata read hostname 'smithi007' 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1b35310 0x55b7e1b4ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 4 client.10677 mds_command: new command op to 10623 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 --> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7e1a7f2d0 con 0x55b7e1b35310 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.229+0000 7fe165a00640 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1b35310 0x55b7e1b4ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.230+0000 7fe165a00640 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1b35310 0x55b7e1b4ff10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee696cdcdd45914 server_cookie=809006e8dd2d481f in_seq=0 out_seq=0 2024-08-19T00:49:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.230+0000 7fe146a00640 10 client.10677 ms_handle_connect on v2:172.21.15.7:6835/3771894460 2024-08-19T00:49:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe146a00640 1 -- 172.21.15.7:0/61227448 <== mds.0 v2:172.21.15.7:6835/3771894460 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7e1a7f2d0 con 0x55b7e1b35310 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe146a00640 10 client.10677 handle_command_reply: tid=0 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 client.10677 shutdown 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 msgr2=0x55b7e1b53050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b53050 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fe158005900 tx=0x7fe158013000 comp rx=0 tx=0).stop 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 shutdown_connections 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1b35310 0x55b7e1b4ff10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b53050 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b0f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 --2- 172.21.15.7:0/61227448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b38f50 0x55b7e1b4d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe146a00640 0 client.10677 ms_handle_reset on v2:172.21.15.7:6835/3771894460 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.231+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 >> 172.21.15.7:0/61227448 conn(0x55b7e1ad6110 msgr2=0x55b7e1b53c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.232+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 shutdown_connections 2024-08-19T00:49:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.232+0000 7fe16b445740 1 -- 172.21.15.7:0/61227448 wait complete. 2024-08-19T00:49:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.232+0000 7fe16b445740 20 client.10677 trim_cache size 0 max 16384 2024-08-19T00:49:05.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.251+0000 7fe16b445740 1 Processor -- start 2024-08-19T00:49:05.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.251+0000 7fe16b445740 1 -- start start 2024-08-19T00:49:05.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe16b445740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5c470 0x55b7e1b50610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b773a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe16b445740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe1601ffbd0 con 0x55b7e1b5c470 2024-08-19T00:49:05.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1600ba170 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1601e6700 con 0x55b7e1b38f50 2024-08-19T00:49:05.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5c470 0x55b7e1b50610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5c470 0x55b7e1b50610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60356/0 (socket says 172.21.15.7:60356) 2024-08-19T00:49:05.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 -- 172.21.15.7:0/3806998335 learned_addr learned my addr 172.21.15.7:0/3806998335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:05.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe166400640 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165a00640 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 -- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 msgr2=0x55b7e1b500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 -- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 msgr2=0x55b7e1b773a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b773a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165000640 1 -- 172.21.15.7:0/3806998335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7e1b0f660 con 0x55b7e1b5c470 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe165a00640 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.252+0000 7fe166400640 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.253+0000 7fe165000640 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5c470 0x55b7e1b50610 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fe14c02a290 tx=0x7fe14c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcee8ba2ee6c393a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.253+0000 7fe151600640 1 -- 172.21.15.7:0/3806998335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c037040 con 0x55b7e1b5c470 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.253+0000 7fe151600640 1 -- 172.21.15.7:0/3806998335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c04c070 con 0x55b7e1b5c470 2024-08-19T00:49:05.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.253+0000 7fe151600640 1 -- 172.21.15.7:0/3806998335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c032a20 con 0x55b7e1b5c470 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 -- 172.21.15.7:0/3806998335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5c470 msgr2=0x55b7e1b50610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5c470 0x55b7e1b50610 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fe14c02a290 tx=0x7fe14c02c000 comp rx=0 tx=0).stop 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 -- 172.21.15.7:0/3806998335 shutdown_connections 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b5c470 0x55b7e1b50610 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 --2- 172.21.15.7:0/3806998335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b38f50 0x55b7e1b500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 -- 172.21.15.7:0/3806998335 >> 172.21.15.7:0/3806998335 conn(0x55b7e1ad6110 msgr2=0x55b7e1b4a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 -- 172.21.15.7:0/3806998335 shutdown_connections 2024-08-19T00:49:05.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 -- 172.21.15.7:0/3806998335 wait complete. 2024-08-19T00:49:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.254+0000 7fe16b445740 1 -- start start 2024-08-19T00:49:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.255+0000 7fe16b445740 1 Processor -- start 2024-08-19T00:49:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.255+0000 7fe16b445740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b38f50 0x55b7e1bd10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.255+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b53d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe16b445740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b54240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe16b445740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7e1b50f60 con 0x55b7e1b38f50 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b7e1b4f720 con 0x55b7e1b5cdd0 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe16b445740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55b7e1b35710 con 0x55b7e1b5c470 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe16b445740 10 client.0 _ll_register_callbacks cb 0x7fe154009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b38f50 0x55b7e1bd10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b38f50 0x55b7e1bd10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60372/0 (socket says 172.21.15.7:60372) 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 -- 172.21.15.7:0/481879852 learned_addr learned my addr 172.21.15.7:0/481879852 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165000640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b53d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe166400640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b54240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 -- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 msgr2=0x55b7e1b53d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b53d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 -- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 msgr2=0x55b7e1b54240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b54240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 -- 172.21.15.7:0/481879852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7e1bd2860 con 0x55b7e1b38f50 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe166400640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b54240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe165a00640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b38f50 0x55b7e1bd10f0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe1540557c0 tx=0x7fe15408b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab99d21b51342ad server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.256+0000 7fe146a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe146a00640 1 -- 172.21.15.7:0/481879852 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154021040 con 0x55b7e1b38f50 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe146a00640 1 -- 172.21.15.7:0/481879852 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7fe1540559d0 con 0x55b7e1b38f50 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14c04c070 con 0x55b7e1b38f50 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe146a00640 1 -- 172.21.15.7:0/481879852 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (secure 0 0 0) 0x7fe154078300 con 0x55b7e1b38f50 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 10 client.10683 fetch_fsmap learned FSMap version 352 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=352,monmap=2+}) -- 0x55b7e1b507a0 con 0x55b7e1b38f50 2024-08-19T00:49:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe146a00640 1 -- 172.21.15.7:0/481879852 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c04c070 con 0x55b7e1b38f50 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe146a00640 1 -- 172.21.15.7:0/481879852 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 352) ==== 3502+0+0 (secure 0 0 0) 0x7fe154071130 con 0x55b7e1b38f50 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 10 client.10683 fetch_fsmap finished waiting for FSMap version 352 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 10 client.10683 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 20 client.10683 populate_metadata read hostname 'smithi007' 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1bd17e0 0x55b7e1bd1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 4 client.10683 mds_command: new command op to 10623 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.257+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 --> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] -- command(tid 0: {"prefix": "status"}) -- 0x55b7e1a79620 con 0x55b7e1bd17e0 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.258+0000 7fe165000640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1bd17e0 0x55b7e1bd1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.258+0000 7fe165000640 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1bd17e0 0x55b7e1bd1bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139a2e9a906addeb server_cookie=1294eec2953ae06f in_seq=0 out_seq=0 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.258+0000 7fe146a00640 10 client.10683 ms_handle_connect on v2:172.21.15.7:6835/3771894460 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.258+0000 7fe146a00640 1 -- 172.21.15.7:0/481879852 <== mds.0 v2:172.21.15.7:6835/3771894460 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55b7e1a79620 con 0x55b7e1bd17e0 2024-08-19T00:49:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.258+0000 7fe146a00640 10 client.10683 handle_command_reply: tid=0 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.258+0000 7fe16b445740 1 client.10683 shutdown 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b38f50 msgr2=0x55b7e1bd10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b38f50 0x55b7e1bd10f0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe1540557c0 tx=0x7fe15408b040 comp rx=0 tx=0).stop 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 shutdown_connections 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:6835/3771894460,v1:172.21.15.7:6837/3771894460] conn(0x55b7e1bd17e0 0x55b7e1bd1bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7e1b5cdd0 0x55b7e1b54240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55b7e1b5c470 0x55b7e1b53d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe146a00640 0 client.10683 ms_handle_reset on v2:172.21.15.7:6835/3771894460 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 --2- 172.21.15.7:0/481879852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7e1b38f50 0x55b7e1bd10f0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 >> 172.21.15.7:0/481879852 conn(0x55b7e1ad6110 msgr2=0x55b7e1b340e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 shutdown_connections 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 1 -- 172.21.15.7:0/481879852 wait complete. 2024-08-19T00:49:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.259+0000 7fe16b445740 20 client.10683 trim_cache size 0 max 16384 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "bd35d026-e259-45a6-99d5-e8ea5afa8a60", 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 10623, 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.7052873379999998, 2024-08-19T00:49:05.266 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 352, 2024-08-19T00:49:05.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 137, 2024-08-19T00:49:05.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 137, 2024-08-19T00:49:05.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 5.6492031100000002 2024-08-19T00:49:05.267 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe14006be30 msgr2=0x7fe14006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe14006be30 0x7fe14006e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe158007fd0 tx=0x7fe158009040 comp rx=0 tx=0).stop 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 msgr2=0x7fe160145550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe160145550 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fe15400e8a0 tx=0x7fe15400ed60 comp rx=0 tx=0).stop 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 shutdown_connections 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe14006be30 0x7fe14006e2f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16015e590 0x7fe1601e9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1600d2490 0x7fe1601e8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 --2- 172.21.15.7:0/3485065872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1600d2090 0x7fe160145550 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 >> 172.21.15.7:0/3485065872 conn(0x7fe16009d710 msgr2=0x7fe1600b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 shutdown_connections 2024-08-19T00:49:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.260+0000 7fe168400640 1 -- 172.21.15.7:0/3485065872 wait complete. 2024-08-19T00:49:05.277 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-19T00:49:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.433+0000 7fc56f800640 1 Processor -- start 2024-08-19T00:49:05.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.433+0000 7fc56f800640 1 -- start start 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.434+0000 7fc56f800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cce30 0x7fc56806e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.434+0000 7fc56f800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56815b290 con 0x7fc5680cc9f0 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.434+0000 7fc56f800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56815b570 con 0x7fc5681585c0 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.434+0000 7fc56f800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc56815b850 con 0x7fc5680cce30 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.434+0000 7fc567e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc5680cc9f0 0x7fc56806dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60654/0 (socket says 172.21.15.7:60654) 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.434+0000 7fc567e00640 1 -- 172.21.15.7:0/282395196 learned_addr learned my addr 172.21.15.7:0/282395196 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc56d800640 1 --2- 172.21.15.7:0/282395196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cce30 0x7fc56806e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc567400640 1 -- 172.21.15.7:0/282395196 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279958217 0 0) 0x7fc56815b290 con 0x7fc5680cc9f0 2024-08-19T00:49:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc567400640 1 -- 172.21.15.7:0/282395196 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc550003520 con 0x7fc5680cc9f0 2024-08-19T00:49:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc567400640 1 -- 172.21.15.7:0/282395196 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843275431 0 0) 0x7fc56815b570 con 0x7fc5681585c0 2024-08-19T00:49:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc567400640 1 -- 172.21.15.7:0/282395196 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc56815b290 con 0x7fc5681585c0 2024-08-19T00:49:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc56d800640 1 -- 172.21.15.7:0/282395196 >> v1:172.21.15.162:6789/0 conn(0x7fc5681585c0 legacy=0x7fc56806f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc56d800640 1 -- 172.21.15.7:0/282395196 >> v1:172.21.15.7:6789/0 conn(0x7fc5680cc9f0 legacy=0x7fc56806dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.435+0000 7fc56d800640 1 -- 172.21.15.7:0/282395196 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56815bb30 con 0x7fc5680cce30 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.436+0000 7fc56d800640 1 --2- 172.21.15.7:0/282395196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cce30 0x7fc56806e3d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc560009dc0 tx=0x7fc56002b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fadb9724e1d57326 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc567400640 1 -- 172.21.15.7:0/282395196 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560007740 con 0x7fc5680cce30 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc567400640 1 -- 172.21.15.7:0/282395196 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5600078e0 con 0x7fc5680cce30 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc567400640 1 -- 172.21.15.7:0/282395196 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560007cb0 con 0x7fc5680cce30 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc56f800640 1 -- 172.21.15.7:0/282395196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cce30 msgr2=0x7fc56806e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc56f800640 1 --2- 172.21.15.7:0/282395196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cce30 0x7fc56806e3d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc560009dc0 tx=0x7fc56002b7e0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc56f800640 1 -- 172.21.15.7:0/282395196 shutdown_connections 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc56f800640 1 --2- 172.21.15.7:0/282395196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cce30 0x7fc56806e3d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc56f800640 1 -- 172.21.15.7:0/282395196 >> 172.21.15.7:0/282395196 conn(0x7fc56806bc70 msgr2=0x7fc56806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc56f800640 1 -- 172.21.15.7:0/282395196 shutdown_connections 2024-08-19T00:49:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.437+0000 7fc56f800640 1 -- 172.21.15.7:0/282395196 wait complete. 2024-08-19T00:49:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.439+0000 7fc56f800640 1 Processor -- start 2024-08-19T00:49:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.439+0000 7fc56f800640 1 -- start start 2024-08-19T00:49:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc56f800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cc9f0 0x7fc568155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc56f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cce30 0x7fc5680ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc56f800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5681585c0 0x7fc5680caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc56f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5680cd280 con 0x7fc5680cce30 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc56f800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc56806f7b0 con 0x7fc5681585c0 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc56f800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc568071980 con 0x7fc5680cc9f0 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc567e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cce30 0x7fc5680ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc567e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cce30 0x7fc5680ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60374/0 (socket says 172.21.15.7:60374) 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc567e00640 1 -- 172.21.15.7:0/557189683 learned_addr learned my addr 172.21.15.7:0/557189683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc56d800640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5681585c0 0x7fc5680caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.440+0000 7fc56ce00640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cc9f0 0x7fc568155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc567e00640 1 -- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cc9f0 msgr2=0x7fc568155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc567e00640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cc9f0 0x7fc568155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc567e00640 1 -- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5681585c0 msgr2=0x7fc5680caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc567e00640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5681585c0 0x7fc5680caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc567e00640 1 -- 172.21.15.7:0/557189683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc568159a60 con 0x7fc5680cce30 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc567e00640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cce30 0x7fc5680ca990 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c530 tx=0x7fc55400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc564c00640 1 -- 172.21.15.7:0/557189683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554017070 con 0x7fc5680cce30 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.441+0000 7fc564c00640 1 -- 172.21.15.7:0/557189683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc554005d00 con 0x7fc5680cce30 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.442+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc568159d40 con 0x7fc5680cce30 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.442+0000 7fc564c00640 1 -- 172.21.15.7:0/557189683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5540072b0 con 0x7fc5680cce30 2024-08-19T00:49:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.442+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56815a300 con 0x7fc5680cce30 2024-08-19T00:49:05.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.443+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56815ae60 con 0x7fc5680cce30 2024-08-19T00:49:05.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.444+0000 7fc564c00640 1 -- 172.21.15.7:0/557189683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc55401a070 con 0x7fc5680cce30 2024-08-19T00:49:05.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.444+0000 7fc564c00640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc54806be30 0x7fc54806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:05.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.445+0000 7fc564c00640 1 -- 172.21.15.7:0/557189683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7fc55408a220 con 0x7fc5680cce30 2024-08-19T00:49:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.445+0000 7fc56ce00640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc54806be30 0x7fc54806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.445+0000 7fc56ce00640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc54806be30 0x7fc54806e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0011e0 tx=0x7fc55c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.449+0000 7fc564c00640 1 -- 172.21.15.7:0/557189683 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc5540585d0 con 0x7fc5680cce30 2024-08-19T00:49:05.557 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-08-19T00:49:05.556+0000 7f825a000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:49:05.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.673+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc5680cc7d0 con 0x7fc5680cce30 2024-08-19T00:49:05.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.673+0000 7fc564c00640 1 -- 172.21.15.7:0/557189683 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v352) ==== 53+0+73 (secure 0 0 0) 0x7fc55405c8d0 con 0x7fc5680cce30 2024-08-19T00:49:05.675 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-19T00:49:05.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.675+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc54806be30 msgr2=0x7fc54806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.675+0000 7fc56f800640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc54806be30 0x7fc54806e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0011e0 tx=0x7fc55c009040 comp rx=0 tx=0).stop 2024-08-19T00:49:05.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.675+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cce30 msgr2=0x7fc5680ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.675+0000 7fc56f800640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cce30 0x7fc5680ca990 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c530 tx=0x7fc55400c9f0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 shutdown_connections 2024-08-19T00:49:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc54806be30 0x7fc54806e2f0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5681585c0 0x7fc5680caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5680cce30 0x7fc5680ca990 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 --2- 172.21.15.7:0/557189683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5680cc9f0 0x7fc568155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 >> 172.21.15.7:0/557189683 conn(0x7fc56806bc70 msgr2=0x7fc56806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:05.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 shutdown_connections 2024-08-19T00:49:05.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05.676+0000 7fc56f800640 1 -- 172.21.15.7:0/557189683 wait complete. 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-19T00:49:05.693 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:49:05.694 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:49:05.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:05.694 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-08-19T00:49:05.730 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:49:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:49:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:49:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:49:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-08-19T00:49:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42116sec preferred_lft 42116sec 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:49:05.731 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6039:2bff:fe8e:b6d9/64 scope link 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 7a:db:d7:a7:2b:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::78db:d7ff:fea7:2b87/64 scope link 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:49:05.732 INFO:teuthology.orchestra.run.smithi007.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-19T00:49:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 36:06:62:00:bb:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:49:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::3406:62ff:fe00:bbd4/64 scope link 2024-08-19T00:49:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:49:05.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:05.733 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:49:05.824 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-08-19T00:49:05.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:05.831 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-08-19T00:49:05.868 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-08-19T00:49:05.868 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:49:05.868 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:49:05.868 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:49:05.868 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:49:05.868 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:49:05.869 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-08-19T00:49:05.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:49:05.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:49:05.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:49:05.869 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-08-19T00:49:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:49:06.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:49:06.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:06.067 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:49:06.102 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:49:06.102 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:49:06.103 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:49:06.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:06.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-08-19T00:49:06.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:49:06.199 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:49:06.235 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:49:06.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:49:06.235 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:49:06.310 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-19T00:49:06.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:06.311 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:49:06.440 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:49:06.440 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:49:06.440 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:49:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:49:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:49:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:49:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:49:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:49:06.478 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-19T00:49:06.478 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-19T00:49:06.478 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-08-19T00:49:06.478 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-19T00:49:06.478 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-19T00:49:06.478 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-08-19T00:49:06.478 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-08-19T00:49:06.479 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd35d026-e259-45a6-99d5-e8ea5afa8a60" will pass to kernel 2024-08-19T00:49:06.479 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:49:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:49:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:49:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:49:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:49:06.483 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:49:06.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:06.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:49:06.539 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:49:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:49:06.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:49:06.630 INFO:teuthology.orchestra.run.smithi007.stdout:client9799 2024-08-19T00:49:06.630 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:49:06.630 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:06.667 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-08-19T00:49:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.782+0000 7f6a643fef40 1 Processor -- start 2024-08-19T00:49:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.782+0000 7f6a643fef40 1 -- start start 2024-08-19T00:49:06.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a643fef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a643fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e72415b0 0x5618e72d96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a643fef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e7241990 0x5618e72d9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a643fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618e71b5d00 con 0x5618e72415b0 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a643fef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5618e71b9d40 con 0x5618e7241990 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a643fef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5618e72e6dc0 con 0x5618e723ff40 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a60c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e72415b0 0x5618e72d96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a60c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e72415b0 0x5618e72d96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60394/0 (socket says 172.21.15.7:60394) 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a60c00640 1 -- 172.21.15.7:0/3867935590 learned_addr learned my addr 172.21.15.7:0/3867935590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a61600640 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.783+0000 7f6a62000640 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e7241990 0x5618e72d9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a60c00640 1 -- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 msgr2=0x5618e72d8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a60c00640 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72d8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a60c00640 1 -- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e7241990 msgr2=0x5618e72d9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a60c00640 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e7241990 0x5618e72d9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a60c00640 1 -- 172.21.15.7:0/3867935590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e7177080 con 0x5618e72415b0 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a61600640 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72d8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a62000640 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e7241990 0x5618e72d9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a60c00640 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e72415b0 0x5618e72d96a0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f6a50025d00 tx=0x7f6a50051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23fbf4585508e35 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a5b400640 1 -- 172.21.15.7:0/3867935590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50052af0 con 0x5618e72415b0 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a5b400640 1 -- 172.21.15.7:0/3867935590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a50052c90 con 0x5618e72415b0 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.784+0000 7f6a5b400640 1 -- 172.21.15.7:0/3867935590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a500676c0 con 0x5618e72415b0 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 -- 172.21.15.7:0/3867935590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e72415b0 msgr2=0x5618e72d96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e72415b0 0x5618e72d96a0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f6a50025d00 tx=0x7f6a50051000 comp rx=0 tx=0).stop 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 -- 172.21.15.7:0/3867935590 shutdown_connections 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e7241990 0x5618e72d9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e72415b0 0x5618e72d96a0 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3867935590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72d8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 -- 172.21.15.7:0/3867935590 >> 172.21.15.7:0/3867935590 conn(0x5618e723e4e0 msgr2=0x5618e720e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:06.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 -- 172.21.15.7:0/3867935590 shutdown_connections 2024-08-19T00:49:06.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 -- 172.21.15.7:0/3867935590 wait complete. 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.785+0000 7f6a643fef40 1 Processor -- start 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.786+0000 7f6a643fef40 1 -- start start 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.786+0000 7f6a643fef40 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.786+0000 7f6a643fef40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e72415b0 0x5618e72e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.786+0000 7f6a643fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e7241990 0x5618e72e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.786+0000 7f6a643fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618e72dfd80 con 0x5618e7241990 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.786+0000 7f6a643fef40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5618e72dc210 con 0x5618e72415b0 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.786+0000 7f6a643fef40 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5618e723ee10 con 0x5618e723ff40 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e7241990 0x5618e72e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e7241990 0x5618e72e7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60406/0 (socket says 172.21.15.7:60406) 2024-08-19T00:49:06.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 -- 172.21.15.7:0/3102762668 learned_addr learned my addr 172.21.15.7:0/3102762668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a61600640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72dd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a60c00640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e72415b0 0x5618e72e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 -- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 msgr2=0x5618e72dd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5618e723ff40 0x5618e72dd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 -- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e72415b0 msgr2=0x5618e72e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618e72415b0 0x5618e72e75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 -- 172.21.15.7:0/3102762668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e72dc670 con 0x5618e7241990 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.787+0000 7f6a62000640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e7241990 0x5618e72e7b00 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0065b0 tx=0x7f6a5c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.788+0000 7f6a5a000640 1 -- 172.21.15.7:0/3102762668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c018070 con 0x5618e7241990 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.788+0000 7f6a5a000640 1 -- 172.21.15.7:0/3102762668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c0104f0 con 0x5618e7241990 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.788+0000 7f6a5a000640 1 -- 172.21.15.7:0/3102762668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0108a0 con 0x5618e7241990 2024-08-19T00:49:06.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.788+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618e72dc390 con 0x5618e7241990 2024-08-19T00:49:06.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.788+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e72dcef0 con 0x5618e7241990 2024-08-19T00:49:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.790+0000 7f6a5a000640 1 -- 172.21.15.7:0/3102762668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a5c01b070 con 0x5618e7241990 2024-08-19T00:49:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.790+0000 7f6a5a000640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a4406a810 0x7f6a4406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.791+0000 7f6a5a000640 1 -- 172.21.15.7:0/3102762668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f6a5c089350 con 0x5618e7241990 2024-08-19T00:49:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.791+0000 7f6a61600640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a4406a810 0x7f6a4406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.791+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5618e7259e00 0x5618e72d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.791+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- osd_op(unknown.0.0:1 15.7 15:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137) -- 0x5618e72d7630 con 0x5618e7259e00 2024-08-19T00:49:06.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.791+0000 7f6a60c00640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5618e7259e00 0x5618e72d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.791+0000 7f6a61600640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a4406a810 0x7f6a4406ccd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400f4d0 tx=0x7f6a54003630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a60c00640 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5618e7259e00 0x5618e72d49d0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:06.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a60c00640 1 -- 172.21.15.7:0/3102762668 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (91) out=91b] v0'0 uv6 ondisk = 0) ==== 164+0+91 (crc 0 0 0) 0x7f6a500528f0 con 0x5618e7259e00 2024-08-19T00:49:06.795 INFO:teuthology.orchestra.run.smithi007.stdout:Ufile1dir1 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5618e7259e00 msgr2=0x5618e72d49d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x5618e7259e00 0x5618e72d49d0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a4406a810 msgr2=0x7f6a4406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6a4406a810 0x7f6a4406ccd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400f4d0 tx=0x7f6a54003630 comp rx=0 tx=0).stop 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e7241990 msgr2=0x5618e72e7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a643fef40 1 --2- 172.21.15.7:0/3102762668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618e7241990 0x5618e72e7b00 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0065b0 tx=0x7f6a5c001a00 comp rx=0 tx=0).stop 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.792+0000 7f6a62000640 1 -- 172.21.15.7:0/3102762668 reap_dead start 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.793+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 shutdown_connections 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.793+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 >> 172.21.15.7:0/3102762668 conn(0x5618e723e4e0 msgr2=0x5618e720e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:06.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.793+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 shutdown_connections 2024-08-19T00:49:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:06.793+0000 7f6a643fef40 1 -- 172.21.15.7:0/3102762668 wait complete. 2024-08-19T00:49:06.799 DEBUG:teuthology.orchestra.run.smithi007:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-08-19T00:49:06.930 INFO:teuthology.orchestra.run.smithi007.stderr:error: stray data at end of buffer, offset 91 2024-08-19T00:49:06.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:49:06.938 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-19T00:49:06.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:49:07.027 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-19T00:49:07.137 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-19T00:49:07.137 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:49:07.137 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:49:07.138 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:07.173 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:49:07.173 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:07.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-19T00:49:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.447+0000 7fc400a00640 1 Processor -- start 2024-08-19T00:49:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.447+0000 7fc400a00640 1 -- start start 2024-08-19T00:49:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.448+0000 7fc400a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc159bf0 0x7fc3fc073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.448+0000 7fc400a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3fc0739a0 0x7fc3fc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.448+0000 7fc400a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc06f7f0 con 0x7fc3fc0cea40 2024-08-19T00:49:07.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.448+0000 7fc400a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc3fc06f510 con 0x7fc3fc0739a0 2024-08-19T00:49:07.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.448+0000 7fc400a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc072980 con 0x7fc3fc159bf0 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.448+0000 7fc3f3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3fc0739a0 0x7fc3fc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.448+0000 7fc3f9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc159bf0 0x7fc3fc073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.449+0000 7fc3f3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3fc0739a0 0x7fc3fc0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.7:49764/0 (socket says 172.21.15.7:49764) 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.449+0000 7fc3f3e00640 1 -- 172.21.15.7:0/2227109772 learned_addr learned my addr 172.21.15.7:0/2227109772 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.449+0000 7fc3f3e00640 1 -- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc159bf0 msgr2=0x7fc3fc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.449+0000 7fc3f3e00640 1 --2- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc159bf0 0x7fc3fc073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.449+0000 7fc3f3e00640 1 -- 172.21.15.7:0/2227109772 >> v1:172.21.15.162:6789/0 conn(0x7fc3fc0cea40 legacy=0x7fc3fc0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.449+0000 7fc3f3e00640 1 -- 172.21.15.7:0/2227109772 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc072c60 con 0x7fc3fc0739a0 2024-08-19T00:49:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.449+0000 7fc3f9e00640 1 --2- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc159bf0 0x7fc3fc073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:49:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.450+0000 7fc3f3e00640 1 --2- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 0x7fc3fc0ce500 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009870 tx=0x7fc3e402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85de1ded5b87425d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.450+0000 7fc3f9400640 1 -- 172.21.15.7:0/2227109772 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4037070 con 0x7fc3fc0739a0 2024-08-19T00:49:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.450+0000 7fc3f9400640 1 -- 172.21.15.7:0/2227109772 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e4032440 con 0x7fc3fc0739a0 2024-08-19T00:49:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.450+0000 7fc3f9400640 1 -- 172.21.15.7:0/2227109772 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4032810 con 0x7fc3fc0739a0 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 -- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 msgr2=0x7fc3fc0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 --2- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 0x7fc3fc0ce500 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009870 tx=0x7fc3e402a1c0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 -- 172.21.15.7:0/2227109772 shutdown_connections 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 --2- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 0x7fc3fc0ce500 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 --2- 172.21.15.7:0/2227109772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc159bf0 0x7fc3fc073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 -- 172.21.15.7:0/2227109772 >> 172.21.15.7:0/2227109772 conn(0x7fc3fc06bc70 msgr2=0x7fc3fc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 -- 172.21.15.7:0/2227109772 shutdown_connections 2024-08-19T00:49:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.451+0000 7fc400a00640 1 -- 172.21.15.7:0/2227109772 wait complete. 2024-08-19T00:49:07.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.452+0000 7fc400a00640 1 Processor -- start 2024-08-19T00:49:07.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.452+0000 7fc400a00640 1 -- start start 2024-08-19T00:49:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc400a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 0x7fc3fc153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc400a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc0cea40 0x7fc3fc1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc400a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc159bf0 0x7fc3fc09d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc400a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc15a150 con 0x7fc3fc159bf0 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc400a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc159fd0 con 0x7fc3fc0739a0 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc400a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc0d0ad0 con 0x7fc3fc0cea40 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc3fa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc159bf0 0x7fc3fc09d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc3fa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc159bf0 0x7fc3fc09d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60420/0 (socket says 172.21.15.7:60420) 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc3fa800640 1 -- 172.21.15.7:0/2796313755 learned_addr learned my addr 172.21.15.7:0/2796313755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc3f9e00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 0x7fc3fc153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.453+0000 7fc3f3e00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc0cea40 0x7fc3fc1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3fa800640 1 -- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc0cea40 msgr2=0x7fc3fc1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3fa800640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc0cea40 0x7fc3fc1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3fa800640 1 -- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 msgr2=0x7fc3fc153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3fa800640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 0x7fc3fc153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3fa800640 1 -- 172.21.15.7:0/2796313755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc15f900 con 0x7fc3fc159bf0 2024-08-19T00:49:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3fa800640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc159bf0 0x7fc3fc09d6b0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c7a0 tx=0x7fc3f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3f2000640 1 -- 172.21.15.7:0/2796313755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4003b70 con 0x7fc3fc159bf0 2024-08-19T00:49:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3f2000640 1 -- 172.21.15.7:0/2796313755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f4003d30 con 0x7fc3fc159bf0 2024-08-19T00:49:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc15fbe0 con 0x7fc3fc159bf0 2024-08-19T00:49:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc3f2000640 1 -- 172.21.15.7:0/2796313755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400aa90 con 0x7fc3fc159bf0 2024-08-19T00:49:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.454+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1601a0 con 0x7fc3fc159bf0 2024-08-19T00:49:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.456+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc0ce500 con 0x7fc3fc159bf0 2024-08-19T00:49:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.456+0000 7fc3f2000640 1 -- 172.21.15.7:0/2796313755 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3f400ac30 con 0x7fc3fc159bf0 2024-08-19T00:49:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.457+0000 7fc3f2000640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3d806be30 0x7fc3d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.457+0000 7fc3f2000640 1 -- 172.21.15.7:0/2796313755 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7fc3f408ace0 con 0x7fc3fc159bf0 2024-08-19T00:49:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.458+0000 7fc3f9e00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3d806be30 0x7fc3d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.458+0000 7fc3f9e00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3d806be30 0x7fc3d806e2f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00da00 tx=0x7fc3ec00f040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:07.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.461+0000 7fc3f2000640 1 -- 172.21.15.7:0/2796313755 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc3f4058fd0 con 0x7fc3fc159bf0 2024-08-19T00:49:07.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.663+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3fc153990 con 0x7fc3fc159bf0 2024-08-19T00:49:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.663+0000 7fc3f2000640 1 -- 172.21.15.7:0/2796313755 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v137) ==== 80+0+120 (secure 0 0 0) 0x7fc3f405d2d0 con 0x7fc3fc159bf0 2024-08-19T00:49:07.666 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2760644218 2024-08-20T00:48:59.539071+0000 2024-08-19T00:49:07.666 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/2760644218 2024-08-20T00:48:59.539071+0000 2024-08-19T00:49:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-08-19T00:49:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.665+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3d806be30 msgr2=0x7fc3d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.665+0000 7fc400a00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3d806be30 0x7fc3d806e2f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00da00 tx=0x7fc3ec00f040 comp rx=0 tx=0).stop 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.665+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc159bf0 msgr2=0x7fc3fc09d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.665+0000 7fc400a00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc159bf0 0x7fc3fc09d6b0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c7a0 tx=0x7fc3f400cc60 comp rx=0 tx=0).stop 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 shutdown_connections 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fc3d806be30 0x7fc3d806e2f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc159bf0 0x7fc3fc09d6b0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3fc0cea40 0x7fc3fc1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 --2- 172.21.15.7:0/2796313755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc0739a0 0x7fc3fc153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 >> 172.21.15.7:0/2796313755 conn(0x7fc3fc06bc70 msgr2=0x7fc3fc0b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 shutdown_connections 2024-08-19T00:49:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:07.666+0000 7fc400a00640 1 -- 172.21.15.7:0/2796313755 wait complete. 2024-08-19T00:49:07.684 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:49:07.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:07.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:49:07.746 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:49:07.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:07.747 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:49:07.783 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:49:07.784 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:49:07.784 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:07.824 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:49:07.824 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:49:07.824 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:49:07.824 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:07.860 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:49:07.860 INFO:tasks.cephfs.mount:Terminating background process 2024-08-19T00:49:07.860 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:49:07.860 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:07.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:49:07.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.055+0000 7f4a9c000640 1 Processor -- start 2024-08-19T00:49:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.055+0000 7f4a9c000640 1 -- start start 2024-08-19T00:49:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.056+0000 7f4a9c000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9406e710 0x7f4a94071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a9c000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a940b3750 0x7f4a940cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a9c000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a940cdfb0 con 0x7f4a940d03c0 2024-08-19T00:49:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a9c000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4a940cebc0 con 0x7f4a940b3750 2024-08-19T00:49:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a9c000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a940ce290 con 0x7f4a9406e710 2024-08-19T00:49:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a99600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4a940d03c0 0x7f4a940d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:43548/0 (socket says 172.21.15.7:43548) 2024-08-19T00:49:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a99600640 1 -- 172.21.15.7:0/283409468 learned_addr learned my addr 172.21.15.7:0/283409468 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a98c00640 1 --2- 172.21.15.7:0/283409468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9406e710 0x7f4a94071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a9a000640 1 --2- 172.21.15.7:0/283409468 >> v2:172.21.15.162:3300/0 conn(0x7f4a940b3750 0x7f4a940cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.057+0000 7f4a93e00640 1 -- 172.21.15.7:0/283409468 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235344146 0 0) 0x7f4a940cdfb0 con 0x7f4a940d03c0 2024-08-19T00:49:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.058+0000 7f4a98c00640 1 -- 172.21.15.7:0/283409468 >> v2:172.21.15.162:3300/0 conn(0x7f4a940b3750 msgr2=0x7f4a940cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.058+0000 7f4a98c00640 1 --2- 172.21.15.7:0/283409468 >> v2:172.21.15.162:3300/0 conn(0x7f4a940b3750 0x7f4a940cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.058+0000 7f4a98c00640 1 -- 172.21.15.7:0/283409468 >> v1:172.21.15.162:6789/0 conn(0x7f4a940d03c0 legacy=0x7f4a940d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.058+0000 7f4a98c00640 1 -- 172.21.15.7:0/283409468 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a940ce570 con 0x7f4a9406e710 2024-08-19T00:49:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.058+0000 7f4a9a000640 1 --2- 172.21.15.7:0/283409468 >> v2:172.21.15.162:3300/0 conn(0x7f4a940b3750 0x7f4a940cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:49:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a98c00640 1 --2- 172.21.15.7:0/283409468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9406e710 0x7f4a94071980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a800097a0 tx=0x7f4a8002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71db06fc7de4f785 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a93e00640 1 -- 172.21.15.7:0/283409468 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80037070 con 0x7f4a9406e710 2024-08-19T00:49:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a93e00640 1 -- 172.21.15.7:0/283409468 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a80032440 con 0x7f4a9406e710 2024-08-19T00:49:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a93e00640 1 -- 172.21.15.7:0/283409468 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80032810 con 0x7f4a9406e710 2024-08-19T00:49:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a9c000640 1 -- 172.21.15.7:0/283409468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9406e710 msgr2=0x7f4a94071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a9c000640 1 --2- 172.21.15.7:0/283409468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9406e710 0x7f4a94071980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a800097a0 tx=0x7f4a8002a180 comp rx=0 tx=0).stop 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a9c000640 1 -- 172.21.15.7:0/283409468 shutdown_connections 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a9c000640 1 --2- 172.21.15.7:0/283409468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9406e710 0x7f4a94071980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a9c000640 1 --2- 172.21.15.7:0/283409468 >> v2:172.21.15.162:3300/0 conn(0x7f4a940b3750 0x7f4a940cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.059+0000 7f4a9c000640 1 -- 172.21.15.7:0/283409468 >> 172.21.15.7:0/283409468 conn(0x7f4a9406bc70 msgr2=0x7f4a9406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.060+0000 7f4a9c000640 1 -- 172.21.15.7:0/283409468 shutdown_connections 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.060+0000 7f4a9c000640 1 -- 172.21.15.7:0/283409468 wait complete. 2024-08-19T00:49:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.061+0000 7f4a9c000640 1 Processor -- start 2024-08-19T00:49:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.061+0000 7f4a9c000640 1 -- start start 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a9c000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9406e710 0x7f4a941582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a9c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a940b3750 0x7f4a940999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a9c000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a940d03c0 0x7f4a941f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a9c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a94073c60 con 0x7f4a940b3750 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a9c000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a94073ae0 con 0x7f4a9406e710 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a9c000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a940b3be0 con 0x7f4a940d03c0 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a98c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a940b3750 0x7f4a940999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a98c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a940b3750 0x7f4a940999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60422/0 (socket says 172.21.15.7:60422) 2024-08-19T00:49:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a98c00640 1 -- 172.21.15.7:0/1723975079 learned_addr learned my addr 172.21.15.7:0/1723975079 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.062+0000 7f4a99600640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9406e710 0x7f4a941582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a9a000640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a940d03c0 0x7f4a941f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a98c00640 1 -- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a940d03c0 msgr2=0x7f4a941f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a98c00640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a940d03c0 0x7f4a941f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a98c00640 1 -- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9406e710 msgr2=0x7f4a941582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a98c00640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9406e710 0x7f4a941582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a98c00640 1 -- 172.21.15.7:0/1723975079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a94099ee0 con 0x7f4a940b3750 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a98c00640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a940b3750 0x7f4a940999a0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f4a800097a0 tx=0x7f4a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.063+0000 7f4a91600640 1 -- 172.21.15.7:0/1723975079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80041070 con 0x7f4a940b3750 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.064+0000 7f4a91600640 1 -- 172.21.15.7:0/1723975079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8003c870 con 0x7f4a940b3750 2024-08-19T00:49:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.064+0000 7f4a91600640 1 -- 172.21.15.7:0/1723975079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80037040 con 0x7f4a940b3750 2024-08-19T00:49:08.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.064+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9409a550 con 0x7f4a940b3750 2024-08-19T00:49:08.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.064+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a94155f00 con 0x7f4a940b3750 2024-08-19T00:49:08.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.065+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a940cdfb0 con 0x7f4a940b3750 2024-08-19T00:49:08.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.066+0000 7f4a91600640 1 -- 172.21.15.7:0/1723975079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a80044070 con 0x7f4a940b3750 2024-08-19T00:49:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.066+0000 7f4a91600640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a7406be30 0x7f4a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.067+0000 7f4a91600640 1 -- 172.21.15.7:0/1723975079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f4a800ab850 con 0x7f4a940b3750 2024-08-19T00:49:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.067+0000 7f4a99600640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a7406be30 0x7f4a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.067+0000 7f4a99600640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a7406be30 0x7f4a7406e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f4a88007f70 tx=0x7f4a88007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.071+0000 7f4a91600640 1 -- 172.21.15.7:0/1723975079 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4a80079bd0 con 0x7f4a940b3750 2024-08-19T00:49:08.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.291+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a940cd3a0 con 0x7f4a940b3750 2024-08-19T00:49:08.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.293+0000 7f4a91600640 1 -- 172.21.15.7:0/1723975079 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 352 v352) ==== 95+0+5239 (secure 0 0 0) 0x7f4a8007ded0 con 0x7f4a940b3750 2024-08-19T00:49:08.296 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":352,"btime":"2024-08-19T00:49:03:557470+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":352,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:49:03.557465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10623},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10623":{"gid":10623,"name":"c","rank":0,"incarnation":349,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/3771894460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3771894460},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771894460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10623,"qdb_cluster":[10623]},"id":7}]} 2024-08-19T00:49:08.296 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 352 2024-08-19T00:49:08.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a7406be30 msgr2=0x7f4a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a7406be30 0x7f4a7406e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f4a88007f70 tx=0x7f4a88007f00 comp rx=0 tx=0).stop 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a940b3750 msgr2=0x7f4a940999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a940b3750 0x7f4a940999a0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f4a800097a0 tx=0x7f4a800046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 shutdown_connections 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f4a7406be30 0x7f4a7406e2f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a940d03c0 0x7f4a941f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a940b3750 0x7f4a940999a0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 --2- 172.21.15.7:0/1723975079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9406e710 0x7f4a941582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 >> 172.21.15.7:0/1723975079 conn(0x7f4a9406bc70 msgr2=0x7f4a940b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:08.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 shutdown_connections 2024-08-19T00:49:08.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.295+0000 7f4a9c000640 1 -- 172.21.15.7:0/1723975079 wait complete. 2024-08-19T00:49:08.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.468+0000 7fab3c600640 1 Processor -- start 2024-08-19T00:49:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.469+0000 7fab3c600640 1 -- start start 2024-08-19T00:49:08.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab3c600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab340d0ad0 0x7fab340ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab3c600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab3406f7f0 con 0x7fab34159bf0 2024-08-19T00:49:08.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab3c600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab3406f510 con 0x7fab340ce500 2024-08-19T00:49:08.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab3c600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fab34072980 con 0x7fab340d0ad0 2024-08-19T00:49:08.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab39c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fab34159bf0 0x7fab34073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60672/0 (socket says 172.21.15.7:60672) 2024-08-19T00:49:08.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab39c00640 1 -- 172.21.15.7:0/3246739537 learned_addr learned my addr 172.21.15.7:0/3246739537 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab3a600640 1 --2- 172.21.15.7:0/3246739537 >> v2:172.21.15.162:3300/0 conn(0x7fab340d0ad0 0x7fab340ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.470+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782249327 0 0) 0x7fab3406f7f0 con 0x7fab34159bf0 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab1c003520 con 0x7fab34159bf0 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274169722 0 0) 0x7fab1c003520 con 0x7fab34159bf0 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 >> v2:172.21.15.162:3300/0 conn(0x7fab340d0ad0 msgr2=0x7fab340ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 --2- 172.21.15.7:0/3246739537 >> v2:172.21.15.162:3300/0 conn(0x7fab340d0ad0 0x7fab340ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 >> v1:172.21.15.162:6789/0 conn(0x7fab340ce500 legacy=0x7fab340d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab34072c60 con 0x7fab34159bf0 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7fab28001670 con 0x7fab34159bf0 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 >> v1:172.21.15.7:6789/0 conn(0x7fab34159bf0 legacy=0x7fab34073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0039b0 0x7fab1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab1c004800 0x7fab1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab34072980 con 0x7fab1c0051c0 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c00c0c0 con 0x7fab1c0039b0 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c00c2c0 con 0x7fab1c004800 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab3a600640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab39c00640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0039b0 0x7fab1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.471+0000 7fab39200640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab1c004800 0x7fab1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.472+0000 7fab3a600640 1 -- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab1c004800 msgr2=0x7fab1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.472+0000 7fab3a600640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab1c004800 0x7fab1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.472+0000 7fab3a600640 1 -- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0039b0 msgr2=0x7fab1c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.472+0000 7fab3a600640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0039b0 0x7fab1c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.472+0000 7fab3a600640 1 -- 172.21.15.7:0/3246739537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c003520 con 0x7fab1c0051c0 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.473+0000 7fab3a600640 1 -- 172.21.15.7:0/3246739537 reap_dead start 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.473+0000 7fab3a600640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009f90 tx=0x7fab1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340dd0751daad983 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.473+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c009c10 con 0x7fab1c0051c0 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.473+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c031440 con 0x7fab1c0051c0 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.473+0000 7fab33e00640 1 -- 172.21.15.7:0/3246739537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c031810 con 0x7fab1c0051c0 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.474+0000 7fab3c600640 1 -- 172.21.15.7:0/3246739537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab1c0051c0 msgr2=0x7fab1c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.474+0000 7fab3c600640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009f90 tx=0x7fab1c005830 comp rx=0 tx=0).stop 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.474+0000 7fab3c600640 1 -- 172.21.15.7:0/3246739537 shutdown_connections 2024-08-19T00:49:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.474+0000 7fab3c600640 1 --2- 172.21.15.7:0/3246739537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.474+0000 7fab3c600640 1 -- 172.21.15.7:0/3246739537 >> 172.21.15.7:0/3246739537 conn(0x7fab3406bc70 msgr2=0x7fab3406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.474+0000 7fab3c600640 1 -- 172.21.15.7:0/3246739537 shutdown_connections 2024-08-19T00:49:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.474+0000 7fab3c600640 1 -- 172.21.15.7:0/3246739537 wait complete. 2024-08-19T00:49:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.475+0000 7fab3c600640 1 Processor -- start 2024-08-19T00:49:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.476+0000 7fab3c600640 1 -- start start 2024-08-19T00:49:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.476+0000 7fab3c600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0051c0 0x7fab3414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.476+0000 7fab3c600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3414ba60 0x7fab3409ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.476+0000 7fab3c600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab3414d070 0x7fab3414d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.476+0000 7fab3c600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab3415a150 con 0x7fab3414ba60 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.476+0000 7fab3c600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab34159fd0 con 0x7fab1c0051c0 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.476+0000 7fab3c600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab340ce970 con 0x7fab3414d070 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3414ba60 0x7fab3409ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3414ba60 0x7fab3409ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60446/0 (socket says 172.21.15.7:60446) 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 -- 172.21.15.7:0/1822253371 learned_addr learned my addr 172.21.15.7:0/1822253371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab3a600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab3414d070 0x7fab3414d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39c00640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0051c0 0x7fab3414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 -- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab3414d070 msgr2=0x7fab3414d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab3414d070 0x7fab3414d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 -- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0051c0 msgr2=0x7fab3414b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0051c0 0x7fab3414b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.477+0000 7fab39200640 1 -- 172.21.15.7:0/1822253371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3414bfd0 con 0x7fab3414ba60 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.478+0000 7fab39200640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3414ba60 0x7fab3409ac60 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7fab2000f7f0 tx=0x7fab2000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.478+0000 7fab31600640 1 -- 172.21.15.7:0/1822253371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2000fea0 con 0x7fab3414ba60 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.478+0000 7fab31600640 1 -- 172.21.15.7:0/1822253371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab20018070 con 0x7fab3414ba60 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.478+0000 7fab31600640 1 -- 172.21.15.7:0/1822253371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2000d6d0 con 0x7fab3414ba60 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.478+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3414c2b0 con 0x7fab3414ba60 2024-08-19T00:49:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.478+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3414c870 con 0x7fab3414ba60 2024-08-19T00:49:08.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.479+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab340cf460 con 0x7fab3414ba60 2024-08-19T00:49:08.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.480+0000 7fab31600640 1 -- 172.21.15.7:0/1822253371 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab2000d870 con 0x7fab3414ba60 2024-08-19T00:49:08.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.481+0000 7fab31600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab1406be60 0x7fab1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.481+0000 7fab31600640 1 -- 172.21.15.7:0/1822253371 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7fab2008aca0 con 0x7fab3414ba60 2024-08-19T00:49:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.481+0000 7fab39c00640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab1406be60 0x7fab1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.482+0000 7fab39c00640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab1406be60 0x7fab1406e320 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fab28007bc0 tx=0x7fab28000f80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.485+0000 7fab31600640 1 -- 172.21.15.7:0/1822253371 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fab20058f00 con 0x7fab3414ba60 2024-08-19T00:49:08.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.708+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab340cd240 con 0x7fab3414ba60 2024-08-19T00:49:08.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.709+0000 7fab31600640 1 -- 172.21.15.7:0/1822253371 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 352 v352) ==== 95+0+5239 (secure 0 0 0) 0x7fab2005d200 con 0x7fab3414ba60 2024-08-19T00:49:08.711 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:08.712 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":352,"btime":"2024-08-19T00:49:03:557470+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":352,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:49:03.557465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10623},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10623":{"gid":10623,"name":"c","rank":0,"incarnation":349,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/3771894460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3771894460},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771894460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10623,"qdb_cluster":[10623]},"id":7}]} 2024-08-19T00:49:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 352 2024-08-19T00:49:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab1406be60 msgr2=0x7fab1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab1406be60 0x7fab1406e320 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fab28007bc0 tx=0x7fab28000f80 comp rx=0 tx=0).stop 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3414ba60 msgr2=0x7fab3409ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3414ba60 0x7fab3409ac60 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7fab2000f7f0 tx=0x7fab2000fcb0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 shutdown_connections 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fab1406be60 0x7fab1406e320 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab3414d070 0x7fab3414d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3414ba60 0x7fab3409ac60 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 --2- 172.21.15.7:0/1822253371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1c0051c0 0x7fab3414b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 >> 172.21.15.7:0/1822253371 conn(0x7fab3406bc70 msgr2=0x7fab340b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 shutdown_connections 2024-08-19T00:49:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.711+0000 7fab3c600640 1 -- 172.21.15.7:0/1822253371 wait complete. 2024-08-19T00:49:08.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:49:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.883+0000 7f2e7a800640 1 Processor -- start 2024-08-19T00:49:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.883+0000 7f2e7a800640 1 -- start start 2024-08-19T00:49:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.884+0000 7f2e7a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 0x7f2e74071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e7a800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e740cdfb0 con 0x7f2e740d03c0 2024-08-19T00:49:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e7a800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e740ce290 con 0x7f2e740b3750 2024-08-19T00:49:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e7a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2e740cebc0 con 0x7f2e7406e710 2024-08-19T00:49:08.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e73400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2e740d03c0 0x7f2e740d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60684/0 (socket says 172.21.15.7:60684) 2024-08-19T00:49:08.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e73400640 1 -- 172.21.15.7:0/624891763 learned_addr learned my addr 172.21.15.7:0/624891763 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e6be00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 0x7f2e74071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103860719 0 0) 0x7f2e740cdfb0 con 0x7f2e740d03c0 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.885+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e58003520 con 0x7f2e740d03c0 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121745402 0 0) 0x7f2e740ce290 con 0x7f2e740b3750 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e740cdfb0 con 0x7f2e740b3750 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3248127370 0 0) 0x7f2e58003520 con 0x7f2e740d03c0 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 msgr2=0x7f2e74071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 0x7f2e74071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 >> v1:172.21.15.162:6789/0 conn(0x7f2e740b3750 legacy=0x7f2e740cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e740ce570 con 0x7f2e740d03c0 2024-08-19T00:49:08.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f2e64001670 con 0x7f2e740d03c0 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 >> v1:172.21.15.7:6789/0 conn(0x7f2e740d03c0 legacy=0x7f2e740d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e58003b70 0x7f2e58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e58004800 0x7f2e58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 0x7f2e580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e740cebc0 con 0x7f2e58004800 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5800baa0 con 0x7f2e58003b70 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5800bca0 con 0x7f2e7406e710 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e6be00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e58004800 0x7f2e58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e73400640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e58003b70 0x7f2e58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.886+0000 7f2e73e00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 0x7f2e580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.887+0000 7f2e6be00640 1 -- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 msgr2=0x7f2e580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.887+0000 7f2e6be00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e7406e710 0x7f2e580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.887+0000 7f2e6be00640 1 -- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e58003b70 msgr2=0x7f2e58003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:08.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.887+0000 7f2e6be00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e58003b70 0x7f2e58003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.887+0000 7f2e6be00640 1 -- 172.21.15.7:0/624891763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e58003520 con 0x7f2e58004800 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.888+0000 7f2e6be00640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e58004800 0x7f2e58004c80 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009ac0 tx=0x7f2e58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cbe5460346739d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.888+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c036070 con 0x7f2e58004800 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.888+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c031400 con 0x7f2e58004800 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.888+0000 7f2e72a00640 1 -- 172.21.15.7:0/624891763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c009690 con 0x7f2e58004800 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.888+0000 7f2e7a800640 1 -- 172.21.15.7:0/624891763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e58004800 msgr2=0x7f2e58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.888+0000 7f2e7a800640 1 --2- 172.21.15.7:0/624891763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e58004800 0x7f2e58004c80 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009ac0 tx=0x7f2e58005830 comp rx=0 tx=0).stop 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.888+0000 7f2e73e00640 1 -- 172.21.15.7:0/624891763 reap_dead start 2024-08-19T00:49:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.889+0000 7f2e7a800640 1 -- 172.21.15.7:0/624891763 shutdown_connections 2024-08-19T00:49:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.889+0000 7f2e7a800640 1 -- 172.21.15.7:0/624891763 >> 172.21.15.7:0/624891763 conn(0x7f2e7406bc70 msgr2=0x7f2e7406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.889+0000 7f2e7a800640 1 -- 172.21.15.7:0/624891763 shutdown_connections 2024-08-19T00:49:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.889+0000 7f2e7a800640 1 -- 172.21.15.7:0/624891763 wait complete. 2024-08-19T00:49:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.890+0000 7f2e7a800640 1 Processor -- start 2024-08-19T00:49:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.890+0000 7f2e7a800640 1 -- start start 2024-08-19T00:49:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.891+0000 7f2e7a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e58004800 0x7f2e741565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.891+0000 7f2e7a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e74099ac0 0x7f2e740cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.891+0000 7f2e7a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e740cc1b0 0x7f2e741f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.891+0000 7f2e7a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e74073c60 con 0x7f2e740cc1b0 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.891+0000 7f2e7a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e74073ae0 con 0x7f2e74099ac0 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.891+0000 7f2e7a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2e740b3be0 con 0x7f2e58004800 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e740cc1b0 0x7f2e741f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e740cc1b0 0x7f2e741f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60474/0 (socket says 172.21.15.7:60474) 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 -- 172.21.15.7:0/988325343 learned_addr learned my addr 172.21.15.7:0/988325343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73400640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e58004800 0x7f2e741565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e6be00640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e74099ac0 0x7f2e740cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 -- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e58004800 msgr2=0x7f2e741565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e58004800 0x7f2e741565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 -- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e74099ac0 msgr2=0x7f2e740cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e74099ac0 0x7f2e740cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 -- 172.21.15.7:0/988325343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e741f5730 con 0x7f2e740cc1b0 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e6be00640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e74099ac0 0x7f2e740cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.892+0000 7f2e73e00640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e740cc1b0 0x7f2e741f49c0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b34d0 tx=0x7f2e6c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.893+0000 7f2e6b400640 1 -- 172.21.15.7:0/988325343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c019070 con 0x7f2e740cc1b0 2024-08-19T00:49:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.893+0000 7f2e6b400640 1 -- 172.21.15.7:0/988325343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6c006d60 con 0x7f2e740cc1b0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.893+0000 7f2e6b400640 1 -- 172.21.15.7:0/988325343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c003bb0 con 0x7f2e740cc1b0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.893+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7415baf0 con 0x7f2e740cc1b0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.893+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e741f4f00 con 0x7f2e740cc1b0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.894+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e740ce290 con 0x7f2e740cc1b0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.895+0000 7f2e6b400640 1 -- 172.21.15.7:0/988325343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e6c01c070 con 0x7f2e740cc1b0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.896+0000 7f2e6b400640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be60 0x7f2e5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.896+0000 7f2e6b400640 1 -- 172.21.15.7:0/988325343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f2e6c08a420 con 0x7f2e740cc1b0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.896+0000 7f2e73400640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be60 0x7f2e5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.896+0000 7f2e73400640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be60 0x7f2e5006e320 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2e64001eb0 tx=0x7f2e64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:08.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:08.900+0000 7f2e6b400640 1 -- 172.21.15.7:0/988325343 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2e6c058d60 con 0x7f2e740cc1b0 2024-08-19T00:49:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.083+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e7415aab0 con 0x7f2e740cc1b0 2024-08-19T00:49:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.084+0000 7f2e6b400640 1 -- 172.21.15.7:0/988325343 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16710 (secure 0 0 0) 0x7f2e6c058660 con 0x7f2e740cc1b0 2024-08-19T00:49:09.087 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:09.087 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":137,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:59.539094+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:48:46.426846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-08-19T00:48:47.623461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/2760644218":"2024-08-20T00:48:59.539071+0000","172.21.15.7:6835/2760644218":"2024-08-20T00:48:59.539071+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:49:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be60 msgr2=0x7f2e5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be60 0x7f2e5006e320 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2e64001eb0 tx=0x7f2e64009040 comp rx=0 tx=0).stop 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e740cc1b0 msgr2=0x7f2e741f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e740cc1b0 0x7f2e741f49c0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b34d0 tx=0x7f2e6c00ff70 comp rx=0 tx=0).stop 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 shutdown_connections 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f2e5006be60 0x7f2e5006e320 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e740cc1b0 0x7f2e741f49c0 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e74099ac0 0x7f2e740cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 --2- 172.21.15.7:0/988325343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e58004800 0x7f2e741565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 >> 172.21.15.7:0/988325343 conn(0x7f2e7406bc70 msgr2=0x7f2e740ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 shutdown_connections 2024-08-19T00:49:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.087+0000 7f2e7a800640 1 -- 172.21.15.7:0/988325343 wait complete. 2024-08-19T00:49:09.106 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:49:09.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.261+0000 7f6251200640 1 Processor -- start 2024-08-19T00:49:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.261+0000 7f6251200640 1 -- start start 2024-08-19T00:49:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f6251200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f624c0d03c0 0x7f624c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f6251200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 0x7f624c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f6251200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c0d0ce0 con 0x7f624c0b3750 2024-08-19T00:49:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f6251200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f624c0cebc0 con 0x7f624c0d03c0 2024-08-19T00:49:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f6251200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f624c0cdfb0 con 0x7f624c06e710 2024-08-19T00:49:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f624a800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f624c0b3750 0x7f624c0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60690/0 (socket says 172.21.15.7:60690) 2024-08-19T00:49:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f624a800640 1 -- 172.21.15.7:0/725269174 learned_addr learned my addr 172.21.15.7:0/725269174 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f6249e00640 1 --2- 172.21.15.7:0/725269174 >> v2:172.21.15.162:3300/0 conn(0x7f624c0d03c0 0x7f624c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.262+0000 7f6243e00640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 0x7f624c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197488741 0 0) 0x7f624c0d0ce0 con 0x7f624c0b3750 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6230003520 con 0x7f624c0b3750 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2419656869 0 0) 0x7f6230003520 con 0x7f624c0b3750 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 msgr2=0x7f624c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 0x7f624c0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 >> v2:172.21.15.162:3300/0 conn(0x7f624c0d03c0 msgr2=0x7f624c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 --2- 172.21.15.7:0/725269174 >> v2:172.21.15.162:3300/0 conn(0x7f624c0d03c0 0x7f624c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c0ce290 con 0x7f624c0b3750 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f62440019f0 con 0x7f624c0b3750 2024-08-19T00:49:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 >> v1:172.21.15.7:6789/0 conn(0x7f624c0b3750 legacy=0x7f624c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 0x7f62300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6230003f30 0x7f6230004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230004d40 0x7f62300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0cebc0 con 0x7f6230003f30 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0cdfb0 con 0x7f6230004d40 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f623000b9c0 con 0x7f624c06e710 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.263+0000 7f6243e00640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6230003f30 0x7f6230004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.264+0000 7f624a800640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230004d40 0x7f62300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.264+0000 7f6249e00640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 0x7f62300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.264+0000 7f6243e00640 1 -- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 msgr2=0x7f62300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.264+0000 7f6243e00640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c06e710 0x7f62300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.264+0000 7f6243e00640 1 -- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230004d40 msgr2=0x7f62300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:09.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.264+0000 7f6243e00640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230004d40 0x7f62300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.264+0000 7f6243e00640 1 -- 172.21.15.7:0/725269174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6230003520 con 0x7f6230003f30 2024-08-19T00:49:09.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.265+0000 7f6243e00640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6230003f30 0x7f6230004800 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f6234009ac0 tx=0x7f6230005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b461b65c249290cf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:09.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.265+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234036070 con 0x7f6230003f30 2024-08-19T00:49:09.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.265+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6234031400 con 0x7f6230003f30 2024-08-19T00:49:09.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.265+0000 7f6249400640 1 -- 172.21.15.7:0/725269174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234009690 con 0x7f6230003f30 2024-08-19T00:49:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.266+0000 7f6251200640 1 -- 172.21.15.7:0/725269174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6230003f30 msgr2=0x7f6230004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.266+0000 7f6251200640 1 --2- 172.21.15.7:0/725269174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6230003f30 0x7f6230004800 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f6234009ac0 tx=0x7f6230005830 comp rx=0 tx=0).stop 2024-08-19T00:49:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.266+0000 7f624a800640 1 -- 172.21.15.7:0/725269174 reap_dead start 2024-08-19T00:49:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.266+0000 7f6251200640 1 -- 172.21.15.7:0/725269174 shutdown_connections 2024-08-19T00:49:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.266+0000 7f6251200640 1 -- 172.21.15.7:0/725269174 >> 172.21.15.7:0/725269174 conn(0x7f624c06bc70 msgr2=0x7f624c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.266+0000 7f6251200640 1 -- 172.21.15.7:0/725269174 shutdown_connections 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.266+0000 7f6251200640 1 -- 172.21.15.7:0/725269174 wait complete. 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.268+0000 7f6251200640 1 Processor -- start 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.268+0000 7f6251200640 1 -- start start 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.268+0000 7f6251200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230003f30 0x7f624c072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.268+0000 7f6251200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c0cc5e0 0x7f624c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f6251200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f624c1566c0 0x7f624c156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f6251200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f624c073ae0 con 0x7f624c1566c0 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f6251200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0ce850 con 0x7f6230003f30 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f6251200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f624c073c60 con 0x7f624c0cc5e0 2024-08-19T00:49:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f624c1566c0 0x7f624c156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f624c1566c0 0x7f624c156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60488/0 (socket says 172.21.15.7:60488) 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 -- 172.21.15.7:0/735174705 learned_addr learned my addr 172.21.15.7:0/735174705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f6249e00640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230003f30 0x7f624c072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f6243e00640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c0cc5e0 0x7f624c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 -- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c0cc5e0 msgr2=0x7f624c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c0cc5e0 0x7f624c156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 -- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230003f30 msgr2=0x7f624c072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230003f30 0x7f624c072c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 -- 172.21.15.7:0/735174705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c0996b0 con 0x7f624c1566c0 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f6249e00640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230003f30 0x7f624c072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.269+0000 7f624a800640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f624c1566c0 0x7f624c156b40 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f624c06fe00 tx=0x7f6244007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.270+0000 7f6242000640 1 -- 172.21.15.7:0/735174705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244017020 con 0x7f624c1566c0 2024-08-19T00:49:09.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.270+0000 7f6242000640 1 -- 172.21.15.7:0/735174705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624400aca0 con 0x7f624c1566c0 2024-08-19T00:49:09.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.270+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c098ec0 con 0x7f624c1566c0 2024-08-19T00:49:09.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.270+0000 7f6242000640 1 -- 172.21.15.7:0/735174705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244013610 con 0x7f624c1566c0 2024-08-19T00:49:09.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.270+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c1593f0 con 0x7f624c1566c0 2024-08-19T00:49:09.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.271+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c0ad1d0 con 0x7f624c1566c0 2024-08-19T00:49:09.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.272+0000 7f6242000640 1 -- 172.21.15.7:0/735174705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f624401a020 con 0x7f624c1566c0 2024-08-19T00:49:09.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.273+0000 7f6242000640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f622806be30 0x7f622806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.273+0000 7f6242000640 1 -- 172.21.15.7:0/735174705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f624408b710 con 0x7f624c1566c0 2024-08-19T00:49:09.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.273+0000 7f6249e00640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f622806be30 0x7f622806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.274+0000 7f6249e00640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f622806be30 0x7f622806e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f624c073530 tx=0x7f623c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:09.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.277+0000 7f6242000640 1 -- 172.21.15.7:0/735174705 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f624c0ad1d0 con 0x7f624c1566c0 2024-08-19T00:49:09.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.499+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f624c0b3be0 con 0x7f624c1566c0 2024-08-19T00:49:09.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.499+0000 7f6242000640 1 -- 172.21.15.7:0/735174705 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 352 v352) ==== 95+0+5239 (secure 0 0 0) 0x7f6244021020 con 0x7f624c1566c0 2024-08-19T00:49:09.502 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:09.503 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":352,"btime":"2024-08-19T00:49:03:557470+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":352,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:49:03.557465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10623},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10623":{"gid":10623,"name":"c","rank":0,"incarnation":349,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/3771894460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3771894460},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771894460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10623,"qdb_cluster":[10623]},"id":7}]} 2024-08-19T00:49:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 352 2024-08-19T00:49:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f622806be30 msgr2=0x7f622806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f622806be30 0x7f622806e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f624c073530 tx=0x7f623c008040 comp rx=0 tx=0).stop 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f624c1566c0 msgr2=0x7f624c156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f624c1566c0 0x7f624c156b40 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f624c06fe00 tx=0x7f6244007b20 comp rx=0 tx=0).stop 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 shutdown_connections 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f622806be30 0x7f622806e2f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f624c1566c0 0x7f624c156b40 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f624c0cc5e0 0x7f624c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 --2- 172.21.15.7:0/735174705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6230003f30 0x7f624c072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 >> 172.21.15.7:0/735174705 conn(0x7f624c06bc70 msgr2=0x7f624c0ad920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 shutdown_connections 2024-08-19T00:49:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.502+0000 7f6251200640 1 -- 172.21.15.7:0/735174705 wait complete. 2024-08-19T00:49:09.520 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.676+0000 7f46bd400640 1 Processor -- start 2024-08-19T00:49:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.676+0000 7f46bd400640 1 -- start start 2024-08-19T00:49:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.677+0000 7f46bd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 0x7f46b815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.677+0000 7f46bd400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b80b3ab0 con 0x7f46b815e740 2024-08-19T00:49:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.677+0000 7f46bd400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b815f460 con 0x7f46b815e360 2024-08-19T00:49:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.677+0000 7f46bd400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46b815f740 con 0x7f46b80d3200 2024-08-19T00:49:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46bca00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f46b815e740 0x7f46b815ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60702/0 (socket says 172.21.15.7:60702) 2024-08-19T00:49:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46bca00640 1 -- 172.21.15.7:0/601695433 learned_addr learned my addr 172.21.15.7:0/601695433 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b7400640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 0x7f46b815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794699838 0 0) 0x7f46b80b3ab0 con 0x7f46b815e740 2024-08-19T00:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f469c003520 con 0x7f46b815e740 2024-08-19T00:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288611839 0 0) 0x7f46b815f460 con 0x7f46b815e360 2024-08-19T00:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b80b3ab0 con 0x7f46b815e360 2024-08-19T00:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3751529839 0 0) 0x7f469c003520 con 0x7f46b815e740 2024-08-19T00:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 msgr2=0x7f46b815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 0x7f46b815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 >> v1:172.21.15.162:6789/0 conn(0x7f46b815e360 legacy=0x7f46b80d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.678+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80b3d60 con 0x7f46b815e740 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2380112028 0 0) 0x7f46b00019f0 con 0x7f46b815e740 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 >> v1:172.21.15.7:6789/0 conn(0x7f46b815e740 legacy=0x7f46b815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 0x7f469c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f469c0040d0 0x7f469c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c004d40 0x7f469c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46b815f740 con 0x7f469c0040d0 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f469c00baa0 con 0x7f469c004d40 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f469c00bca0 con 0x7f46b80d3200 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b7400640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f469c0040d0 0x7f469c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b7e00640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 0x7f469c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46bca00640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c004d40 0x7f469c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b7400640 1 -- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 msgr2=0x7f469c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b7400640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80d3200 0x7f469c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b7400640 1 -- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c004d40 msgr2=0x7f469c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b7400640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c004d40 0x7f469c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46b7400640 1 -- 172.21.15.7:0/601695433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c003520 con 0x7f469c0040d0 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.679+0000 7f46bca00640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c004d40 0x7f469c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.680+0000 7f46b7400640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f469c0040d0 0x7f469c004800 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009a90 tx=0x7f469c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efbfb8be68fbbe7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4036070 con 0x7f469c0040d0 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a4031400 con 0x7f469c0040d0 2024-08-19T00:49:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46b6a00640 1 -- 172.21.15.7:0/601695433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4009690 con 0x7f469c0040d0 2024-08-19T00:49:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46bd400640 1 -- 172.21.15.7:0/601695433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f469c0040d0 msgr2=0x7f469c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46bd400640 1 --2- 172.21.15.7:0/601695433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f469c0040d0 0x7f469c004800 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009a90 tx=0x7f469c005830 comp rx=0 tx=0).stop 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46bca00640 1 -- 172.21.15.7:0/601695433 reap_dead start 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46bd400640 1 -- 172.21.15.7:0/601695433 shutdown_connections 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46bd400640 1 -- 172.21.15.7:0/601695433 >> 172.21.15.7:0/601695433 conn(0x7f46b808dbf0 msgr2=0x7f46b809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46bd400640 1 -- 172.21.15.7:0/601695433 shutdown_connections 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.681+0000 7f46bd400640 1 -- 172.21.15.7:0/601695433 wait complete. 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.683+0000 7f46bd400640 1 Processor -- start 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.683+0000 7f46bd400640 1 -- start start 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46bd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c0040d0 0x7f46b815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46bd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b80b97b0 0x7f46b80b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46bd400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80b1ec0 0x7f46b80b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46bd400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46b815fab0 con 0x7f46b80b97b0 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46bd400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46b80d2300 con 0x7f469c0040d0 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46bd400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46b815fc30 con 0x7f46b80b1ec0 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b80b97b0 0x7f46b80b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b80b97b0 0x7f46b80b9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60504/0 (socket says 172.21.15.7:60504) 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46b7400640 1 -- 172.21.15.7:0/2738592671 learned_addr learned my addr 172.21.15.7:0/2738592671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.684+0000 7f46b7e00640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c0040d0 0x7f46b815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46bca00640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80b1ec0 0x7f46b80b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46b7400640 1 -- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80b1ec0 msgr2=0x7f46b80b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46b7400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80b1ec0 0x7f46b80b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46b7400640 1 -- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c0040d0 msgr2=0x7f46b815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46b7400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c0040d0 0x7f46b815bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46b7400640 1 -- 172.21.15.7:0/2738592671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80c8080 con 0x7f46b80b97b0 2024-08-19T00:49:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46bca00640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80b1ec0 0x7f46b80b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46b7400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b80b97b0 0x7f46b80b9c30 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f46a4034040 tx=0x7f46a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:09.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46afe00640 1 -- 172.21.15.7:0/2738592671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4040020 con 0x7f46b80b97b0 2024-08-19T00:49:09.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.685+0000 7f46afe00640 1 -- 172.21.15.7:0/2738592671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a4003c60 con 0x7f46b80b97b0 2024-08-19T00:49:09.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.686+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b80c8360 con 0x7f46b80b97b0 2024-08-19T00:49:09.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.686+0000 7f46afe00640 1 -- 172.21.15.7:0/2738592671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4036040 con 0x7f46b80b97b0 2024-08-19T00:49:09.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.686+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b80c8920 con 0x7f46b80b97b0 2024-08-19T00:49:09.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.687+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b80d50d0 con 0x7f46b80b97b0 2024-08-19T00:49:09.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.688+0000 7f46afe00640 1 -- 172.21.15.7:0/2738592671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46a4043020 con 0x7f46b80b97b0 2024-08-19T00:49:09.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.689+0000 7f46afe00640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f469806be30 0x7f469806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:09.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.689+0000 7f46afe00640 1 -- 172.21.15.7:0/2738592671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f46a40aaee0 con 0x7f46b80b97b0 2024-08-19T00:49:09.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.689+0000 7f46b7e00640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f469806be30 0x7f469806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:09.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.690+0000 7f46b7e00640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f469806be30 0x7f469806e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f46b80b3300 tx=0x7f46a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:09.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.693+0000 7f46afe00640 1 -- 172.21.15.7:0/2738592671 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f46a404a070 con 0x7f46b80b97b0 2024-08-19T00:49:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.915+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46b815d3f0 con 0x7f46b80b97b0 2024-08-19T00:49:09.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.915+0000 7f46afe00640 1 -- 172.21.15.7:0/2738592671 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 352 v352) ==== 95+0+5239 (secure 0 0 0) 0x7f46a40044e0 con 0x7f46b80b97b0 2024-08-19T00:49:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:09.918 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":352,"btime":"2024-08-19T00:49:03:557470+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341}],"filesystems":[{"mdsmap":{"epoch":352,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:48:48.621186+0000","modified":"2024-08-19T00:49:03.557465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10623},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10623":{"gid":10623,"name":"c","rank":0,"incarnation":349,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/3771894460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3771894460},{"type":"v1","addr":"172.21.15.7:6837","nonce":3771894460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10623,"qdb_cluster":[10623]},"id":7}]} 2024-08-19T00:49:09.919 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 352 2024-08-19T00:49:09.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f469806be30 msgr2=0x7f469806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f469806be30 0x7f469806e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f46b80b3300 tx=0x7f46a8009040 comp rx=0 tx=0).stop 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b80b97b0 msgr2=0x7f46b80b9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b80b97b0 0x7f46b80b9c30 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f46a4034040 tx=0x7f46a4004730 comp rx=0 tx=0).stop 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 shutdown_connections 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f469806be30 0x7f469806e2f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46b80b1ec0 0x7f46b80b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b80b97b0 0x7f46b80b9c30 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 --2- 172.21.15.7:0/2738592671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c0040d0 0x7f46b815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 >> 172.21.15.7:0/2738592671 conn(0x7f46b808dbf0 msgr2=0x7f46b80d48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 shutdown_connections 2024-08-19T00:49:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:09.918+0000 7f46bd400640 1 -- 172.21.15.7:0/2738592671 wait complete. 2024-08-19T00:49:09.936 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:49:10.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.091+0000 7f8491e00640 1 Processor -- start 2024-08-19T00:49:10.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.091+0000 7f8491e00640 1 -- start start 2024-08-19T00:49:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f8491e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f848c15e360 0x7f848c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f8491e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f848c0d2af0 0x7f848c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f8491e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848c0b3ab0 con 0x7f848c15e740 2024-08-19T00:49:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f8491e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f848c15f460 con 0x7f848c0d2af0 2024-08-19T00:49:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f8491e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f848c15f740 con 0x7f848c15e360 2024-08-19T00:49:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f848be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f848c0d2af0 0x7f848c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f848be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f848c0d2af0 0x7f848c0d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60508/0 (socket says 172.21.15.7:60508) 2024-08-19T00:49:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f848be00640 1 -- 172.21.15.7:0/3173639341 learned_addr learned my addr 172.21.15.7:0/3173639341 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f8491400640 1 --1- 172.21.15.7:0/3173639341 >> v1:172.21.15.7:6789/0 conn(0x7f848c15e740 0x7f848c15eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60714/0 (socket says 172.21.15.7:60714) 2024-08-19T00:49:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.092+0000 7f8490a00640 1 --2- 172.21.15.7:0/3173639341 >> v2:172.21.15.162:3300/0 conn(0x7f848c15e360 0x7f848c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.093+0000 7f848be00640 1 -- 172.21.15.7:0/3173639341 >> v2:172.21.15.162:3300/0 conn(0x7f848c15e360 msgr2=0x7f848c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.093+0000 7f848be00640 1 --2- 172.21.15.7:0/3173639341 >> v2:172.21.15.162:3300/0 conn(0x7f848c15e360 0x7f848c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.093+0000 7f848be00640 1 -- 172.21.15.7:0/3173639341 >> v1:172.21.15.7:6789/0 conn(0x7f848c15e740 legacy=0x7f848c15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.093+0000 7f848be00640 1 -- 172.21.15.7:0/3173639341 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848c0b3d60 con 0x7f848c0d2af0 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.093+0000 7f848b400640 1 -- 172.21.15.7:0/3173639341 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470814995 0 0) 0x7f848c0b3ab0 con 0x7f848c15e740 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.094+0000 7f848be00640 1 --2- 172.21.15.7:0/3173639341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c0d2af0 0x7f848c0d2f80 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f848c08e8a0 tx=0x7f847802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fddd48f59e59461 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.094+0000 7f848b400640 1 -- 172.21.15.7:0/3173639341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478037070 con 0x7f848c0d2af0 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.094+0000 7f848b400640 1 -- 172.21.15.7:0/3173639341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8478032440 con 0x7f848c0d2af0 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.094+0000 7f848b400640 1 -- 172.21.15.7:0/3173639341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478032810 con 0x7f848c0d2af0 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 -- 172.21.15.7:0/3173639341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c0d2af0 msgr2=0x7f848c0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 --2- 172.21.15.7:0/3173639341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c0d2af0 0x7f848c0d2f80 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f848c08e8a0 tx=0x7f847802a270 comp rx=0 tx=0).stop 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 -- 172.21.15.7:0/3173639341 shutdown_connections 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 --2- 172.21.15.7:0/3173639341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c0d2af0 0x7f848c0d2f80 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 --2- 172.21.15.7:0/3173639341 >> v2:172.21.15.162:3300/0 conn(0x7f848c15e360 0x7f848c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 -- 172.21.15.7:0/3173639341 >> 172.21.15.7:0/3173639341 conn(0x7f848c08dbf0 msgr2=0x7f848c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 -- 172.21.15.7:0/3173639341 shutdown_connections 2024-08-19T00:49:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.095+0000 7f8491e00640 1 -- 172.21.15.7:0/3173639341 wait complete. 2024-08-19T00:49:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.096+0000 7f8491e00640 1 Processor -- start 2024-08-19T00:49:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.097+0000 7f8491e00640 1 -- start start 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.097+0000 7f8491e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f848c0d2af0 0x7f848c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.097+0000 7f8491e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c15e360 0x7f848c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.097+0000 7f8491e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c15e740 0x7f848c06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.097+0000 7f8491e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f848c0b4560 con 0x7f848c15e740 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.097+0000 7f8491e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f848c0d2300 con 0x7f848c15e360 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.097+0000 7f8491e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f848c0b46e0 con 0x7f848c0d2af0 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c15e740 0x7f848c06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c15e740 0x7f848c06d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60514/0 (socket says 172.21.15.7:60514) 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 -- 172.21.15.7:0/1021084200 learned_addr learned my addr 172.21.15.7:0/1021084200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f848be00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c15e360 0x7f848c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8490a00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f848c0d2af0 0x7f848c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 -- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f848c0d2af0 msgr2=0x7f848c14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f848c0d2af0 0x7f848c14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 -- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c15e360 msgr2=0x7f848c0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c15e360 0x7f848c0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 -- 172.21.15.7:0/1021084200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848c0cb670 con 0x7f848c15e740 2024-08-19T00:49:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.098+0000 7f8491400640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c15e740 0x7f848c06d5f0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f848400c700 tx=0x7f848400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.099+0000 7f8488c00640 1 -- 172.21.15.7:0/1021084200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484018070 con 0x7f848c15e740 2024-08-19T00:49:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.099+0000 7f8488c00640 1 -- 172.21.15.7:0/1021084200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848400ce10 con 0x7f848c15e740 2024-08-19T00:49:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.099+0000 7f8488c00640 1 -- 172.21.15.7:0/1021084200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848400a860 con 0x7f848c15e740 2024-08-19T00:49:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.099+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848c0cb950 con 0x7f848c15e740 2024-08-19T00:49:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.099+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f848c0cbf10 con 0x7f848c15e740 2024-08-19T00:49:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.100+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848c0d2f80 con 0x7f848c15e740 2024-08-19T00:49:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.101+0000 7f8488c00640 1 -- 172.21.15.7:0/1021084200 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f848401b070 con 0x7f848c15e740 2024-08-19T00:49:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.102+0000 7f8488c00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f846c06be30 0x7f846c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.102+0000 7f8488c00640 1 -- 172.21.15.7:0/1021084200 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f848408a3a0 con 0x7f848c15e740 2024-08-19T00:49:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.102+0000 7f8490a00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f846c06be30 0x7f846c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.103+0000 7f8490a00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f846c06be30 0x7f846c06e2f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8480009b40 tx=0x7f8480009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.106+0000 7f8488c00640 1 -- 172.21.15.7:0/1021084200 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8484058730 con 0x7f848c15e740 2024-08-19T00:49:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.290+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f848c0d50d0 con 0x7f848c15e740 2024-08-19T00:49:10.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.292+0000 7f8488c00640 1 -- 172.21.15.7:0/1021084200 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16710 (secure 0 0 0) 0x7f848405ca30 con 0x7f848c15e740 2024-08-19T00:49:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:10.297 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":137,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:48:59.539094+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:48:46.426846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-08-19T00:48:47.623461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/2760644218":"2024-08-20T00:48:59.539071+0000","172.21.15.7:6835/2760644218":"2024-08-20T00:48:59.539071+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:49:10.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f846c06be30 msgr2=0x7f846c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f846c06be30 0x7f846c06e2f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8480009b40 tx=0x7f8480009190 comp rx=0 tx=0).stop 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c15e740 msgr2=0x7f848c06d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c15e740 0x7f848c06d5f0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f848400c700 tx=0x7f848400cbc0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 shutdown_connections 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f846c06be30 0x7f846c06e2f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f848c15e740 0x7f848c06d5f0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c15e360 0x7f848c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 --2- 172.21.15.7:0/1021084200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f848c0d2af0 0x7f848c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 >> 172.21.15.7:0/1021084200 conn(0x7f848c08dbf0 msgr2=0x7f848c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 shutdown_connections 2024-08-19T00:49:10.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.294+0000 7f8491e00640 1 -- 172.21.15.7:0/1021084200 wait complete. 2024-08-19T00:49:10.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-19T00:49:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.469+0000 7fd292400640 1 Processor -- start 2024-08-19T00:49:10.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.469+0000 7fd292400640 1 -- start start 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd292400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd28c15f5b0 0x7fd28c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd292400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd28c0d03c0 0x7fd28c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd292400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28c0cfaf0 con 0x7fd28c0b4380 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd292400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c0d0d60 con 0x7fd28c15f5b0 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd292400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c15f990 con 0x7fd28c0d03c0 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd28c15f5b0 0x7fd28c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd28c15f5b0 0x7fd28c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60526/0 (socket says 172.21.15.7:60526) 2024-08-19T00:49:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd28c0b4380 0x7fd28c0b47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60728/0 (socket says 172.21.15.7:60728) 2024-08-19T00:49:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28b400640 1 -- 172.21.15.7:0/3267641748 learned_addr learned my addr 172.21.15.7:0/3267641748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28aa00640 1 --2- 172.21.15.7:0/3267641748 >> v2:172.21.15.162:3300/0 conn(0x7fd28c0d03c0 0x7fd28c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28b400640 1 -- 172.21.15.7:0/3267641748 >> v2:172.21.15.162:3300/0 conn(0x7fd28c0d03c0 msgr2=0x7fd28c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28b400640 1 --2- 172.21.15.7:0/3267641748 >> v2:172.21.15.162:3300/0 conn(0x7fd28c0d03c0 0x7fd28c0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28b400640 1 -- 172.21.15.7:0/3267641748 >> v1:172.21.15.7:6789/0 conn(0x7fd28c0b4380 legacy=0x7fd28c0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.471+0000 7fd28b400640 1 -- 172.21.15.7:0/3267641748 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0b50b0 con 0x7fd28c15f5b0 2024-08-19T00:49:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.472+0000 7fd28b400640 1 --2- 172.21.15.7:0/3267641748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c0cf5b0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0b3340 tx=0x7fd27c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10095687e9faed6a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd28a000640 1 -- 172.21.15.7:0/3267641748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c037070 con 0x7fd28c15f5b0 2024-08-19T00:49:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd28a000640 1 -- 172.21.15.7:0/3267641748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c032440 con 0x7fd28c15f5b0 2024-08-19T00:49:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd28a000640 1 -- 172.21.15.7:0/3267641748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c032810 con 0x7fd28c15f5b0 2024-08-19T00:49:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 -- 172.21.15.7:0/3267641748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 msgr2=0x7fd28c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 --2- 172.21.15.7:0/3267641748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c0cf5b0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0b3340 tx=0x7fd27c02a230 comp rx=0 tx=0).stop 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 -- 172.21.15.7:0/3267641748 shutdown_connections 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 --2- 172.21.15.7:0/3267641748 >> v2:172.21.15.162:3300/0 conn(0x7fd28c0d03c0 0x7fd28c0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 --2- 172.21.15.7:0/3267641748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c0cf5b0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 -- 172.21.15.7:0/3267641748 >> 172.21.15.7:0/3267641748 conn(0x7fd28c06bc70 msgr2=0x7fd28c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 -- 172.21.15.7:0/3267641748 shutdown_connections 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.473+0000 7fd292400640 1 -- 172.21.15.7:0/3267641748 wait complete. 2024-08-19T00:49:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.475+0000 7fd292400640 1 Processor -- start 2024-08-19T00:49:10.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.475+0000 7fd292400640 1 -- start start 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd292400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd28c0b4380 0x7fd28c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd292400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c0d03c0 0x7fd28c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd292400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd292400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c0cedb0 con 0x7fd28c15f5b0 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd292400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c0cf120 con 0x7fd28c0d03c0 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd292400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c06e660 con 0x7fd28c0b4380 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd28be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd28be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60528/0 (socket says 172.21.15.7:60528) 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd28be00640 1 -- 172.21.15.7:0/3754268944 learned_addr learned my addr 172.21.15.7:0/3754268944 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd28b400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd28c0b4380 0x7fd28c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.476+0000 7fd28aa00640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c0d03c0 0x7fd28c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd28be00640 1 -- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd28c0b4380 msgr2=0x7fd28c0ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd28be00640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd28c0b4380 0x7fd28c0ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd28be00640 1 -- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c0d03c0 msgr2=0x7fd28c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd28be00640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c0d03c0 0x7fd28c1563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd28be00640 1 -- 172.21.15.7:0/3754268944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c151a90 con 0x7fd28c15f5b0 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd28be00640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c151550 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c780 tx=0x7fd28400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd283400640 1 -- 172.21.15.7:0/3754268944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284017070 con 0x7fd28c15f5b0 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd283400640 1 -- 172.21.15.7:0/3754268944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28400a640 con 0x7fd28c15f5b0 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c0ae100 con 0x7fd28c15f5b0 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd283400640 1 -- 172.21.15.7:0/3754268944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28400a9f0 con 0x7fd28c15f5b0 2024-08-19T00:49:10.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.477+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c0ae6c0 con 0x7fd28c15f5b0 2024-08-19T00:49:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.479+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c0d0820 con 0x7fd28c15f5b0 2024-08-19T00:49:10.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.479+0000 7fd283400640 1 -- 172.21.15.7:0/3754268944 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd28401a070 con 0x7fd28c15f5b0 2024-08-19T00:49:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.481+0000 7fd283400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd26c06be30 0x7fd26c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.481+0000 7fd283400640 1 -- 172.21.15.7:0/3754268944 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7fd28408a430 con 0x7fd28c15f5b0 2024-08-19T00:49:10.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.481+0000 7fd28b400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd26c06be30 0x7fd26c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.482+0000 7fd28b400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd26c06be30 0x7fd26c06e2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd27c034000 tx=0x7fd27c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.485+0000 7fd283400640 1 -- 172.21.15.7:0/3754268944 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd28c151a90 con 0x7fd28c15f5b0 2024-08-19T00:49:10.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.709+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd28c06c980 con 0x7fd28c15f5b0 2024-08-19T00:49:10.712 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-08-19T00:49:10.709+0000 7fcb3d200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:49:10.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.711+0000 7fd283400640 1 -- 172.21.15.7:0/3754268944 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v353) ==== 161+0+0 (secure 0 0 0) 0x7fd284058690 con 0x7fd28c15f5b0 2024-08-19T00:49:10.714 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd26c06be30 msgr2=0x7fd26c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd26c06be30 0x7fd26c06e2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd27c034000 tx=0x7fd27c02e000 comp rx=0 tx=0).stop 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 msgr2=0x7fd28c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c151550 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c780 tx=0x7fd28400cc40 comp rx=0 tx=0).stop 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 shutdown_connections 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fd26c06be30 0x7fd26c06e2f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd28c15f5b0 0x7fd28c151550 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c0d03c0 0x7fd28c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 --2- 172.21.15.7:0/3754268944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd28c0b4380 0x7fd28c0ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 >> 172.21.15.7:0/3754268944 conn(0x7fd28c06bc70 msgr2=0x7fd28c15de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:10.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 shutdown_connections 2024-08-19T00:49:10.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.715+0000 7fd292400640 1 -- 172.21.15.7:0/3754268944 wait complete. 2024-08-19T00:49:10.722 INFO:tasks.ceph.mds.c.smithi007.stderr: -430> 2024-08-19T00:49:05.556+0000 7f825a000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:49:10.735 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:49:10.764 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-08-19T00:49:10.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.892+0000 7f16fd800640 1 Processor -- start 2024-08-19T00:49:10.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.892+0000 7f16fd800640 1 -- start start 2024-08-19T00:49:10.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.893+0000 7f16fd800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f80b5130 0x7f16f80aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16fd800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16f815c390 0x7f16f80af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16fd800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f80acef0 con 0x7f16f815bfb0 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16fd800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f16f80af650 con 0x7f16f815c390 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16fd800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16f80ad790 con 0x7f16f80b5130 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16f7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16f815c390 0x7f16f80af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16f7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16f815c390 0x7f16f80af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60554/0 (socket says 172.21.15.7:60554) 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16f7400640 1 -- 172.21.15.7:0/1118749527 learned_addr learned my addr 172.21.15.7:0/1118749527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:10.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16efe00640 1 --2- 172.21.15.7:0/1118749527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f80b5130 0x7f16f80aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16f7400640 1 -- 172.21.15.7:0/1118749527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f80b5130 msgr2=0x7f16f80aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16f7400640 1 --2- 172.21.15.7:0/1118749527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f80b5130 0x7f16f80aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16f7400640 1 -- 172.21.15.7:0/1118749527 >> v1:172.21.15.162:6789/0 conn(0x7f16f815bfb0 legacy=0x7f16f80b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.894+0000 7f16f7400640 1 -- 172.21.15.7:0/1118749527 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f80ad1d0 con 0x7f16f815c390 2024-08-19T00:49:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.895+0000 7f16f7400640 1 --2- 172.21.15.7:0/1118749527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f80af110 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009e50 tx=0x7f16f002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c961e243cd175111 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16f6000640 1 -- 172.21.15.7:0/1118749527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0036070 con 0x7f16f815c390 2024-08-19T00:49:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16f6000640 1 -- 172.21.15.7:0/1118749527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0031600 con 0x7f16f815c390 2024-08-19T00:49:10.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16f6000640 1 -- 172.21.15.7:0/1118749527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f00319d0 con 0x7f16f815c390 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 -- 172.21.15.7:0/1118749527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 msgr2=0x7f16f80af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 --2- 172.21.15.7:0/1118749527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f80af110 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009e50 tx=0x7f16f002a730 comp rx=0 tx=0).stop 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 -- 172.21.15.7:0/1118749527 shutdown_connections 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 --2- 172.21.15.7:0/1118749527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f80af110 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 --2- 172.21.15.7:0/1118749527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f80b5130 0x7f16f80aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 -- 172.21.15.7:0/1118749527 >> 172.21.15.7:0/1118749527 conn(0x7f16f80b2300 msgr2=0x7f16f806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 -- 172.21.15.7:0/1118749527 shutdown_connections 2024-08-19T00:49:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.896+0000 7f16fd800640 1 -- 172.21.15.7:0/1118749527 wait complete. 2024-08-19T00:49:10.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.898+0000 7f16fd800640 1 Processor -- start 2024-08-19T00:49:10.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.898+0000 7f16fd800640 1 -- start start 2024-08-19T00:49:10.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16fd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16f80b5130 0x7f16f815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16fd800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f815bfb0 0x7f16f8150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16fd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16fd800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8072040 con 0x7f16f815c390 2024-08-19T00:49:10.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16fd800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8071b20 con 0x7f16f80b5130 2024-08-19T00:49:10.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16fd800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16f80721c0 con 0x7f16f815bfb0 2024-08-19T00:49:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16f6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16f80b5130 0x7f16f815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f815adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60558/0 (socket says 172.21.15.7:60558) 2024-08-19T00:49:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16efe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f815bfb0 0x7f16f8150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.899+0000 7f16f7400640 1 -- 172.21.15.7:0/1009953390 learned_addr learned my addr 172.21.15.7:0/1009953390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:10.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.900+0000 7f16f7400640 1 -- 172.21.15.7:0/1009953390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f815bfb0 msgr2=0x7f16f8150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.900+0000 7f16f7400640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f815bfb0 0x7f16f8150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.900+0000 7f16f7400640 1 -- 172.21.15.7:0/1009953390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16f80b5130 msgr2=0x7f16f815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:10.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.900+0000 7f16f7400640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16f80b5130 0x7f16f815cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:10.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.900+0000 7f16f7400640 1 -- 172.21.15.7:0/1009953390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f815a060 con 0x7f16f815c390 2024-08-19T00:49:10.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.900+0000 7f16f7400640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f815adb0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f16f0034040 tx=0x7f16f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.901+0000 7f16eea00640 1 -- 172.21.15.7:0/1009953390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0036050 con 0x7f16f815c390 2024-08-19T00:49:10.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.901+0000 7f16eea00640 1 -- 172.21.15.7:0/1009953390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0042070 con 0x7f16f815c390 2024-08-19T00:49:10.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.901+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f815d710 con 0x7f16f815c390 2024-08-19T00:49:10.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.901+0000 7f16eea00640 1 -- 172.21.15.7:0/1009953390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0009510 con 0x7f16f815c390 2024-08-19T00:49:10.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.901+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f815a5b0 con 0x7f16f815c390 2024-08-19T00:49:10.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.902+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f80b3e00 con 0x7f16f815c390 2024-08-19T00:49:10.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.903+0000 7f16eea00640 1 -- 172.21.15.7:0/1009953390 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16f0007bf0 con 0x7f16f815c390 2024-08-19T00:49:10.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.903+0000 7f16eea00640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16d406be30 0x7f16d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:10.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.904+0000 7f16eea00640 1 -- 172.21.15.7:0/1009953390 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5881+0+0 (secure 0 0 0) 0x7f16f00abcd0 con 0x7f16f815c390 2024-08-19T00:49:10.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.904+0000 7f16f6a00640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16d406be30 0x7f16d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:10.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.904+0000 7f16f6a00640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16d406be30 0x7f16d406e2f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f16f81f5160 tx=0x7f16e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:10.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:10.907+0000 7f16eea00640 1 -- 172.21.15.7:0/1009953390 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f16f007a090 con 0x7f16f815c390 2024-08-19T00:49:11.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.130+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f16f815c960 con 0x7f16f815c390 2024-08-19T00:49:11.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.717+0000 7f16eea00640 1 -- 172.21.15.7:0/1009953390 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v354) ==== 104+0+0 (secure 0 0 0) 0x7f16f007e390 con 0x7f16f815c390 2024-08-19T00:49:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16d406be30 msgr2=0x7f16d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16d406be30 0x7f16d406e2f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f16f81f5160 tx=0x7f16e8009040 comp rx=0 tx=0).stop 2024-08-19T00:49:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 msgr2=0x7f16f815adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f815adb0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f16f0034040 tx=0x7f16f0004a40 comp rx=0 tx=0).stop 2024-08-19T00:49:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 shutdown_connections 2024-08-19T00:49:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f16d406be30 0x7f16d406e2f0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f815c390 0x7f16f815adb0 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16f815bfb0 0x7f16f8150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 --2- 172.21.15.7:0/1009953390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16f80b5130 0x7f16f815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.720+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 >> 172.21.15.7:0/1009953390 conn(0x7f16f80b2300 msgr2=0x7f16f815e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.721+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 shutdown_connections 2024-08-19T00:49:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.721+0000 7f16fd800640 1 -- 172.21.15.7:0/1009953390 wait complete. 2024-08-19T00:49:11.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:49:11.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.940+0000 7f1208c00640 1 Processor -- start 2024-08-19T00:49:11.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.940+0000 7f1208c00640 1 -- start start 2024-08-19T00:49:11.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f1208c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f120415c0e0 0x7f12040719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:11.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f1208c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120406fa10 con 0x7f1204071ee0 2024-08-19T00:49:11.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f1208c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12040ce6f0 con 0x7f120415bd00 2024-08-19T00:49:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f1208c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f120415c570 con 0x7f120415c0e0 2024-08-19T00:49:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f1202800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1204071ee0 0x7f1204164d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60742/0 (socket says 172.21.15.7:60742) 2024-08-19T00:49:11.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f1202800640 1 -- 172.21.15.7:0/3435114998 learned_addr learned my addr 172.21.15.7:0/3435114998 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f11f9400640 1 --2- 172.21.15.7:0/3435114998 >> v2:172.21.15.162:3300/0 conn(0x7f120415c0e0 0x7f12040719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.942+0000 7f1201400640 1 -- 172.21.15.7:0/3435114998 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990189403 0 0) 0x7f120406fa10 con 0x7f1204071ee0 2024-08-19T00:49:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.943+0000 7f1201400640 1 -- 172.21.15.7:0/3435114998 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11e8005730 con 0x7f1204071ee0 2024-08-19T00:49:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.943+0000 7f1201400640 1 -- 172.21.15.7:0/3435114998 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375744179 0 0) 0x7f12040ce6f0 con 0x7f120415bd00 2024-08-19T00:49:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.943+0000 7f1201400640 1 -- 172.21.15.7:0/3435114998 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f120406fa10 con 0x7f120415bd00 2024-08-19T00:49:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.943+0000 7f11f9400640 1 -- 172.21.15.7:0/3435114998 >> v1:172.21.15.162:6789/0 conn(0x7f120415bd00 legacy=0x7f12040cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.943+0000 7f11f9400640 1 -- 172.21.15.7:0/3435114998 >> v1:172.21.15.7:6789/0 conn(0x7f1204071ee0 legacy=0x7f1204164d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:11.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.943+0000 7f11f9400640 1 -- 172.21.15.7:0/3435114998 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12040ce9d0 con 0x7f120415c0e0 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.944+0000 7f11f9400640 1 --2- 172.21.15.7:0/3435114998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415c0e0 0x7f12040719a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0097a0 tx=0x7f11ec02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f779f96d73e8f223 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.944+0000 7f1201400640 1 -- 172.21.15.7:0/3435114998 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec037070 con 0x7f120415c0e0 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.944+0000 7f1201400640 1 -- 172.21.15.7:0/3435114998 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec032440 con 0x7f120415c0e0 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.944+0000 7f1201400640 1 -- 172.21.15.7:0/3435114998 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec032810 con 0x7f120415c0e0 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.945+0000 7f1208c00640 1 -- 172.21.15.7:0/3435114998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415c0e0 msgr2=0x7f12040719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.945+0000 7f1208c00640 1 --2- 172.21.15.7:0/3435114998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415c0e0 0x7f12040719a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0097a0 tx=0x7f11ec02a230 comp rx=0 tx=0).stop 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.945+0000 7f1208c00640 1 -- 172.21.15.7:0/3435114998 shutdown_connections 2024-08-19T00:49:11.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.945+0000 7f1208c00640 1 --2- 172.21.15.7:0/3435114998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415c0e0 0x7f12040719a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.945+0000 7f1208c00640 1 -- 172.21.15.7:0/3435114998 >> 172.21.15.7:0/3435114998 conn(0x7f120406be80 msgr2=0x7f12040b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.945+0000 7f1208c00640 1 -- 172.21.15.7:0/3435114998 shutdown_connections 2024-08-19T00:49:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.945+0000 7f1208c00640 1 -- 172.21.15.7:0/3435114998 wait complete. 2024-08-19T00:49:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.947+0000 7f1208c00640 1 Processor -- start 2024-08-19T00:49:11.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.947+0000 7f1208c00640 1 -- start start 2024-08-19T00:49:11.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.947+0000 7f1208c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1204071ee0 0x7f12040b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:11.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.947+0000 7f1208c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415bd00 0x7f12040b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:11.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1208c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f120415c0e0 0x7f12040b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:11.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1208c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f12040cef90 con 0x7f1204071ee0 2024-08-19T00:49:11.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1208c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1204072320 con 0x7f120415bd00 2024-08-19T00:49:11.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1208c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f12040cf270 con 0x7f120415c0e0 2024-08-19T00:49:11.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1204071ee0 0x7f12040b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1204071ee0 0x7f12040b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60562/0 (socket says 172.21.15.7:60562) 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 -- 172.21.15.7:0/1088132311 learned_addr learned my addr 172.21.15.7:0/1088132311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f11f9400640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415bd00 0x7f12040b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1202800640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f120415c0e0 0x7f12040b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 -- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f120415c0e0 msgr2=0x7f12040b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f120415c0e0 0x7f12040b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 -- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415bd00 msgr2=0x7f12040b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415bd00 0x7f12040b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.948+0000 7f1201e00640 1 -- 172.21.15.7:0/1088132311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12040b36b0 con 0x7f1204071ee0 2024-08-19T00:49:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.949+0000 7f1201e00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1204071ee0 0x7f12040b2ff0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c430 tx=0x7f11f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.949+0000 7f11faa00640 1 -- 172.21.15.7:0/1088132311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4017070 con 0x7f1204071ee0 2024-08-19T00:49:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.949+0000 7f11faa00640 1 -- 172.21.15.7:0/1088132311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f40052f0 con 0x7f1204071ee0 2024-08-19T00:49:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.949+0000 7f11faa00640 1 -- 172.21.15.7:0/1088132311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4003830 con 0x7f1204071ee0 2024-08-19T00:49:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.949+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12040b3990 con 0x7f1204071ee0 2024-08-19T00:49:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.949+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12040b3f50 con 0x7f1204071ee0 2024-08-19T00:49:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.950+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12040cf790 con 0x7f1204071ee0 2024-08-19T00:49:11.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.951+0000 7f11faa00640 1 -- 172.21.15.7:0/1088132311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11f401a070 con 0x7f1204071ee0 2024-08-19T00:49:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.952+0000 7f11faa00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11e006be60 0x7f11e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.953+0000 7f11faa00640 1 -- 172.21.15.7:0/1088132311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5881+0+0 (secure 0 0 0) 0x7f11f408a230 con 0x7f1204071ee0 2024-08-19T00:49:11.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.953+0000 7f11f9400640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11e006be60 0x7f11e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:11.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.953+0000 7f11f9400640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11e006be60 0x7f11e006e320 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f11ec034000 tx=0x7f11ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:11.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:11.957+0000 7f11faa00640 1 -- 172.21.15.7:0/1088132311 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f11f40584d0 con 0x7f1204071ee0 2024-08-19T00:49:12.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.142+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f12040af650 con 0x7f1204071ee0 2024-08-19T00:49:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.720+0000 7f11faa00640 1 -- 172.21.15.7:0/1088132311 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v139) ==== 181+0+0 (secure 0 0 0) 0x7f11f405c7d0 con 0x7f1204071ee0 2024-08-19T00:49:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:49:12.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11e006be60 msgr2=0x7f11e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:12.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11e006be60 0x7f11e006e320 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f11ec034000 tx=0x7f11ec02e000 comp rx=0 tx=0).stop 2024-08-19T00:49:12.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1204071ee0 msgr2=0x7f12040b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:12.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1204071ee0 0x7f12040b2ff0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c430 tx=0x7f11f400c8f0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 shutdown_connections 2024-08-19T00:49:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f11e006be60 0x7f11e006e320 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f120415c0e0 0x7f12040b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f120415bd00 0x7f12040b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 --2- 172.21.15.7:0/1088132311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1204071ee0 0x7f12040b2ff0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 >> 172.21.15.7:0/1088132311 conn(0x7f120406be80 msgr2=0x7f120406e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 shutdown_connections 2024-08-19T00:49:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.723+0000 7f1208c00640 1 -- 172.21.15.7:0/1088132311 wait complete. 2024-08-19T00:49:12.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:49:12.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.906+0000 7f48fa000640 1 Processor -- start 2024-08-19T00:49:12.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.907+0000 7f48fa000640 1 -- start start 2024-08-19T00:49:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.908+0000 7f48fa000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48f4072c20 0x7f48f415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.908+0000 7f48fa000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f40b2c10 con 0x7f48f406f270 2024-08-19T00:49:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.908+0000 7f48fa000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f406e100 con 0x7f48f406f650 2024-08-19T00:49:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.908+0000 7f48fa000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f48f4073050 con 0x7f48f4072c20 2024-08-19T00:49:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.908+0000 7f48f3e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48f4072c20 0x7f48f415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.908+0000 7f48f3400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f48f406f270 0x7f48f40ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60746/0 (socket says 172.21.15.7:60746) 2024-08-19T00:49:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.908+0000 7f48f3400640 1 -- 172.21.15.7:0/3364582443 learned_addr learned my addr 172.21.15.7:0/3364582443 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.909+0000 7f48f3e00640 1 -- 172.21.15.7:0/3364582443 >> v1:172.21.15.162:6789/0 conn(0x7f48f406f650 legacy=0x7f48f415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.909+0000 7f48f3e00640 1 -- 172.21.15.7:0/3364582443 >> v1:172.21.15.7:6789/0 conn(0x7f48f406f270 legacy=0x7f48f40ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.909+0000 7f48f3e00640 1 -- 172.21.15.7:0/3364582443 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f406e3e0 con 0x7f48f4072c20 2024-08-19T00:49:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.909+0000 7f48f2a00640 1 -- 172.21.15.7:0/3364582443 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613920112 0 0) 0x7f48f40b2c10 con 0x7f48f406f270 2024-08-19T00:49:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.910+0000 7f48f3e00640 1 --2- 172.21.15.7:0/3364582443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f415fb00 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5362df81b32ff59 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.910+0000 7f48f2a00640 1 -- 172.21.15.7:0/3364582443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007740 con 0x7f48f4072c20 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.910+0000 7f48f2a00640 1 -- 172.21.15.7:0/3364582443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec0078e0 con 0x7f48f4072c20 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.910+0000 7f48f2a00640 1 -- 172.21.15.7:0/3364582443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007cb0 con 0x7f48f4072c20 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.910+0000 7f48fa000640 1 -- 172.21.15.7:0/3364582443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 msgr2=0x7f48f415fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.910+0000 7f48fa000640 1 --2- 172.21.15.7:0/3364582443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f415fb00 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec02a6f0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.911+0000 7f48fa000640 1 -- 172.21.15.7:0/3364582443 shutdown_connections 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.911+0000 7f48fa000640 1 --2- 172.21.15.7:0/3364582443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f415fb00 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.911+0000 7f48fa000640 1 -- 172.21.15.7:0/3364582443 >> 172.21.15.7:0/3364582443 conn(0x7f48f406be80 msgr2=0x7f48f40b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.911+0000 7f48fa000640 1 -- 172.21.15.7:0/3364582443 shutdown_connections 2024-08-19T00:49:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.911+0000 7f48fa000640 1 -- 172.21.15.7:0/3364582443 wait complete. 2024-08-19T00:49:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.912+0000 7f48fa000640 1 Processor -- start 2024-08-19T00:49:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.912+0000 7f48fa000640 1 -- start start 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.913+0000 7f48fa000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48f406f270 0x7f48f415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.913+0000 7f48fa000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f406f650 0x7f48f41f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.913+0000 7f48fa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.913+0000 7f48fa000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48f40cdf40 con 0x7f48f4072c20 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.913+0000 7f48fa000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48f406e9a0 con 0x7f48f406f650 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.913+0000 7f48fa000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48f406da00 con 0x7f48f406f270 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f414c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60586/0 (socket says 172.21.15.7:60586) 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 -- 172.21.15.7:0/1738152794 learned_addr learned my addr 172.21.15.7:0/1738152794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:12.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48eaa00640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f406f650 0x7f48f41f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3400640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48f406f270 0x7f48f415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 -- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48f406f270 msgr2=0x7f48f415cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48f406f270 0x7f48f415cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 -- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f406f650 msgr2=0x7f48f41f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f406f650 0x7f48f41f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 -- 172.21.15.7:0/1738152794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f41f45d0 con 0x7f48f4072c20 2024-08-19T00:49:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.914+0000 7f48f3e00640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f414c7c0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.915+0000 7f48ebe00640 1 -- 172.21.15.7:0/1738152794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec03f070 con 0x7f48f4072c20 2024-08-19T00:49:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.915+0000 7f48ebe00640 1 -- 172.21.15.7:0/1738152794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec031c40 con 0x7f48f4072c20 2024-08-19T00:49:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.915+0000 7f48ebe00640 1 -- 172.21.15.7:0/1738152794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec003990 con 0x7f48f4072c20 2024-08-19T00:49:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.915+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f4156060 con 0x7f48f4072c20 2024-08-19T00:49:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.915+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f4158500 con 0x7f48f4072c20 2024-08-19T00:49:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.916+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f406ddc0 con 0x7f48f4072c20 2024-08-19T00:49:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.917+0000 7f48ebe00640 1 -- 172.21.15.7:0/1738152794 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48ec003b30 con 0x7f48f4072c20 2024-08-19T00:49:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.918+0000 7f48ebe00640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48d006be30 0x7f48d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.918+0000 7f48ebe00640 1 -- 172.21.15.7:0/1738152794 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5443+0+0 (secure 0 0 0) 0x7f48ec0ac090 con 0x7f48f4072c20 2024-08-19T00:49:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.918+0000 7f48f3400640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48d006be30 0x7f48d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.919+0000 7f48f3400640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48d006be30 0x7f48d006e2f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f48e4007f70 tx=0x7f48e4007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:12.922+0000 7f48ebe00640 1 -- 172.21.15.7:0/1738152794 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f48ec07a3c0 con 0x7f48f4072c20 2024-08-19T00:49:13.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.113+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f48f40af450 con 0x7f48f4072c20 2024-08-19T00:49:13.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.726+0000 7f48ebe00640 1 -- 172.21.15.7:0/1738152794 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v140) ==== 169+0+0 (secure 0 0 0) 0x7f48ec07e6c0 con 0x7f48f4072c20 2024-08-19T00:49:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-08-19T00:49:13.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.729+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48d006be30 msgr2=0x7f48d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:13.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.729+0000 7f48fa000640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48d006be30 0x7f48d006e2f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f48e4007f70 tx=0x7f48e4007f00 comp rx=0 tx=0).stop 2024-08-19T00:49:13.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.729+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 msgr2=0x7f48f414c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:13.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.729+0000 7f48fa000640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f414c7c0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec004a40 comp rx=0 tx=0).stop 2024-08-19T00:49:13.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 shutdown_connections 2024-08-19T00:49:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f48d006be30 0x7f48d006e2f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f4072c20 0x7f48f414c7c0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f406f650 0x7f48f41f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 --2- 172.21.15.7:0/1738152794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48f406f270 0x7f48f415cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 >> 172.21.15.7:0/1738152794 conn(0x7f48f406be80 msgr2=0x7f48f40b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 shutdown_connections 2024-08-19T00:49:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.730+0000 7f48fa000640 1 -- 172.21.15.7:0/1738152794 wait complete. 2024-08-19T00:49:13.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-19T00:49:13.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.911+0000 7fdda7200640 1 Processor -- start 2024-08-19T00:49:13.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.911+0000 7fdda7200640 1 -- start start 2024-08-19T00:49:13.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda006f740 0x7fdda0162c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda7200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdda00719a0 0x7fdda00b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda7200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdda00b3450 0x7fdda0166290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda7200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fdda00b38a0 con 0x7fdda00719a0 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda7200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdda00b3cd0 con 0x7fdda00b3450 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00720f0 con 0x7fdda006f740 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdda00719a0 0x7fdda00b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdda00719a0 0x7fdda00b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45650/0 (socket says 172.21.15.7:45650) 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 -- 172.21.15.7:0/2082581564 learned_addr learned my addr 172.21.15.7:0/2082581564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda5200640 1 --2- 172.21.15.7:0/2082581564 >> v2:172.21.15.162:3300/0 conn(0x7fdda00b3450 0x7fdda0166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd9fe00640 1 --2- 172.21.15.7:0/2082581564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda006f740 0x7fdda0162c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 -- 172.21.15.7:0/2082581564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda006f740 msgr2=0x7fdda0162c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 --2- 172.21.15.7:0/2082581564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda006f740 0x7fdda0162c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 -- 172.21.15.7:0/2082581564 >> v2:172.21.15.162:3300/0 conn(0x7fdda00b3450 msgr2=0x7fdda0166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:13.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 --2- 172.21.15.7:0/2082581564 >> v2:172.21.15.162:3300/0 conn(0x7fdda00b3450 0x7fdda0166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd97e00640 1 -- 172.21.15.7:0/2082581564 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda00723d0 con 0x7fdda00719a0 2024-08-19T00:49:13.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdd9fe00640 1 --2- 172.21.15.7:0/2082581564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda006f740 0x7fdda0162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:13.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.913+0000 7fdda5200640 1 --2- 172.21.15.7:0/2082581564 >> v2:172.21.15.162:3300/0 conn(0x7fdda00b3450 0x7fdda0166290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdd97e00640 1 --2- 172.21.15.7:0/2082581564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda00719a0 0x7fdda00b2f10 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fdda00736e0 tx=0x7fdd8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1643701a71dc4fa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdd9f400640 1 -- 172.21.15.7:0/2082581564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88037070 con 0x7fdda00719a0 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdd9f400640 1 -- 172.21.15.7:0/2082581564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd88032440 con 0x7fdda00719a0 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdd9f400640 1 -- 172.21.15.7:0/2082581564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88032810 con 0x7fdda00719a0 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdda7200640 1 -- 172.21.15.7:0/2082581564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda00719a0 msgr2=0x7fdda00b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdda7200640 1 --2- 172.21.15.7:0/2082581564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda00719a0 0x7fdda00b2f10 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fdda00736e0 tx=0x7fdd8802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdda7200640 1 -- 172.21.15.7:0/2082581564 shutdown_connections 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdda7200640 1 --2- 172.21.15.7:0/2082581564 >> v2:172.21.15.162:3300/0 conn(0x7fdda00b3450 0x7fdda0166290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdda7200640 1 --2- 172.21.15.7:0/2082581564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda00719a0 0x7fdda00b2f10 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdda7200640 1 --2- 172.21.15.7:0/2082581564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda006f740 0x7fdda0162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.915+0000 7fdda7200640 1 -- 172.21.15.7:0/2082581564 >> 172.21.15.7:0/2082581564 conn(0x7fdda00b2300 msgr2=0x7fdda006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:13.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.916+0000 7fdda7200640 1 -- 172.21.15.7:0/2082581564 shutdown_connections 2024-08-19T00:49:13.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.916+0000 7fdda7200640 1 -- 172.21.15.7:0/2082581564 wait complete. 2024-08-19T00:49:13.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.917+0000 7fdda7200640 1 Processor -- start 2024-08-19T00:49:13.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.917+0000 7fdda7200640 1 -- start start 2024-08-19T00:49:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.918+0000 7fdda7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda006f740 0x7fdda009c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.918+0000 7fdda7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda00719a0 0x7fdda015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.918+0000 7fdda7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdda00b3450 0x7fdda00c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.918+0000 7fdda7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0072c70 con 0x7fdda006f740 2024-08-19T00:49:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.918+0000 7fdda7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0072990 con 0x7fdda00b3450 2024-08-19T00:49:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.918+0000 7fdda7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdda0071e00 con 0x7fdda00719a0 2024-08-19T00:49:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.918+0000 7fdd9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda006f740 0x7fdda009c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda006f740 0x7fdda009c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45664/0 (socket says 172.21.15.7:45664) 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 -- 172.21.15.7:0/2855243536 learned_addr learned my addr 172.21.15.7:0/2855243536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdda5200640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdda00b3450 0x7fdda00c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd97e00640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda00719a0 0x7fdda015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 -- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda00719a0 msgr2=0x7fdda015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda00719a0 0x7fdda015e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 -- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdda00b3450 msgr2=0x7fdda00c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdda00b3450 0x7fdda00c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 -- 172.21.15.7:0/2855243536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda015e730 con 0x7fdda006f740 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.919+0000 7fdd9fe00640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda006f740 0x7fdda009c730 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c7c0 tx=0x7fdd9000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:13.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.920+0000 7fdd9cc00640 1 -- 172.21.15.7:0/2855243536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90015070 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.920+0000 7fdd9cc00640 1 -- 172.21.15.7:0/2855243536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd90007a30 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.920+0000 7fdd9cc00640 1 -- 172.21.15.7:0/2855243536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90007e00 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.920+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda01f8420 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.920+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda01f89e0 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.921+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda006fb20 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.922+0000 7fdd9cc00640 1 -- 172.21.15.7:0/2855243536 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd90018070 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.923+0000 7fdd9cc00640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd7c06be30 0x7fdd7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.923+0000 7fdd9cc00640 1 -- 172.21.15.7:0/2855243536 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fdd9008aaa0 con 0x7fdda006f740 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.923+0000 7fdd97e00640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd7c06be30 0x7fdd7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.924+0000 7fdd97e00640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd7c06be30 0x7fdd7c06e2f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fdd88034000 tx=0x7fdd8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:13.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:13.927+0000 7fdd9cc00640 1 -- 172.21.15.7:0/2855243536 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdd90059090 con 0x7fdda006f740 2024-08-19T00:49:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.111+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fdda01671a0 con 0x7fdda006f740 2024-08-19T00:49:14.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.115+0000 7fdd9cc00640 1 -- 172.21.15.7:0/2855243536 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7fdd9005d390 con 0x7fdda006f740 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.117+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd7c06be30 msgr2=0x7fdd7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.117+0000 7fdda7200640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd7c06be30 0x7fdd7c06e2f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fdd88034000 tx=0x7fdd8802e000 comp rx=0 tx=0).stop 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.117+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda006f740 msgr2=0x7fdda009c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda006f740 0x7fdda009c730 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c7c0 tx=0x7fdd9000cc80 comp rx=0 tx=0).stop 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 shutdown_connections 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fdd7c06be30 0x7fdd7c06e2f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdda00b3450 0x7fdda00c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdda00719a0 0x7fdda015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 --2- 172.21.15.7:0/2855243536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdda006f740 0x7fdda009c730 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 >> 172.21.15.7:0/2855243536 conn(0x7fdda00b2300 msgr2=0x7fdda00afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:14.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 shutdown_connections 2024-08-19T00:49:14.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.118+0000 7fdda7200640 1 -- 172.21.15.7:0/2855243536 wait complete. 2024-08-19T00:49:14.136 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors' 2024-08-19T00:49:14.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.289+0000 7fb90e600640 1 Processor -- start 2024-08-19T00:49:14.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.290+0000 7fb90e600640 1 -- start start 2024-08-19T00:49:14.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb90e600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb9080d03c0 0x7fb908071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:14.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb90e600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb90806e710 0x7fb9080d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:14.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb90e600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9080d0ce0 con 0x7fb9080b3750 2024-08-19T00:49:14.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb90e600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb9080cebc0 con 0x7fb9080d03c0 2024-08-19T00:49:14.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb90e600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb9080cdfb0 con 0x7fb90806e710 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb907400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb9080d03c0 0x7fb908071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb907400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb9080d03c0 0x7fb908071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45678/0 (socket says 172.21.15.7:45678) 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb907400640 1 -- 172.21.15.7:0/3525556396 learned_addr learned my addr 172.21.15.7:0/3525556396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb906a00640 1 --2- 172.21.15.7:0/3525556396 >> v2:172.21.15.162:3300/0 conn(0x7fb90806e710 0x7fb9080d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb907400640 1 -- 172.21.15.7:0/3525556396 >> v2:172.21.15.162:3300/0 conn(0x7fb90806e710 msgr2=0x7fb9080d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb907400640 1 --2- 172.21.15.7:0/3525556396 >> v2:172.21.15.162:3300/0 conn(0x7fb90806e710 0x7fb9080d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb907400640 1 -- 172.21.15.7:0/3525556396 >> v1:172.21.15.162:6789/0 conn(0x7fb9080b3750 legacy=0x7fb9080cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.291+0000 7fb907400640 1 -- 172.21.15.7:0/3525556396 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9080ce290 con 0x7fb9080d03c0 2024-08-19T00:49:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.292+0000 7fb906a00640 1 --2- 172.21.15.7:0/3525556396 >> v2:172.21.15.162:3300/0 conn(0x7fb90806e710 0x7fb9080d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.292+0000 7fb907400640 1 --2- 172.21.15.7:0/3525556396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb908071980 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009870 tx=0x7fb8f802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1101aedac72b816 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb906000640 1 -- 172.21.15.7:0/3525556396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8037070 con 0x7fb9080d03c0 2024-08-19T00:49:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb906000640 1 -- 172.21.15.7:0/3525556396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f8032440 con 0x7fb9080d03c0 2024-08-19T00:49:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb906000640 1 -- 172.21.15.7:0/3525556396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8032810 con 0x7fb9080d03c0 2024-08-19T00:49:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb90e600640 1 -- 172.21.15.7:0/3525556396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 msgr2=0x7fb908071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb90e600640 1 --2- 172.21.15.7:0/3525556396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb908071980 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009870 tx=0x7fb8f802a250 comp rx=0 tx=0).stop 2024-08-19T00:49:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb90e600640 1 -- 172.21.15.7:0/3525556396 shutdown_connections 2024-08-19T00:49:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb90e600640 1 --2- 172.21.15.7:0/3525556396 >> v2:172.21.15.162:3300/0 conn(0x7fb90806e710 0x7fb9080d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb90e600640 1 --2- 172.21.15.7:0/3525556396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb908071980 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.293+0000 7fb90e600640 1 -- 172.21.15.7:0/3525556396 >> 172.21.15.7:0/3525556396 conn(0x7fb90806bc70 msgr2=0x7fb90806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.294+0000 7fb90e600640 1 -- 172.21.15.7:0/3525556396 shutdown_connections 2024-08-19T00:49:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.294+0000 7fb90e600640 1 -- 172.21.15.7:0/3525556396 wait complete. 2024-08-19T00:49:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.295+0000 7fb90e600640 1 Processor -- start 2024-08-19T00:49:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.295+0000 7fb90e600640 1 -- start start 2024-08-19T00:49:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb90e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb90806e710 0x7fb908159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb90e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9080b3750 0x7fb9080adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb90e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb9080afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb90e600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb908073ae0 con 0x7fb9080d03c0 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb90e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb9080ce850 con 0x7fb9080b3750 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb90e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb908073c60 con 0x7fb90806e710 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb907e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb9080afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb907e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb9080afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45680/0 (socket says 172.21.15.7:45680) 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb907e00640 1 -- 172.21.15.7:0/4249832268 learned_addr learned my addr 172.21.15.7:0/4249832268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb907400640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb90806e710 0x7fb908159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.296+0000 7fb906a00640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9080b3750 0x7fb9080adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb907e00640 1 -- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb90806e710 msgr2=0x7fb908159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb907e00640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb90806e710 0x7fb908159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb907e00640 1 -- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9080b3750 msgr2=0x7fb9080adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb907e00640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9080b3750 0x7fb9080adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb907e00640 1 -- 172.21.15.7:0/4249832268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9080b03d0 con 0x7fb9080d03c0 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb906a00640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9080b3750 0x7fb9080adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb907e00640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb9080afc80 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c780 tx=0x7fb90000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb8ff400640 1 -- 172.21.15.7:0/4249832268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900004b60 con 0x7fb9080d03c0 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb8ff400640 1 -- 172.21.15.7:0/4249832268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb900004d00 con 0x7fb9080d03c0 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb8ff400640 1 -- 172.21.15.7:0/4249832268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90000aa90 con 0x7fb9080d03c0 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.297+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9080b06b0 con 0x7fb9080d03c0 2024-08-19T00:49:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.298+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9080adad0 con 0x7fb9080d03c0 2024-08-19T00:49:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.299+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9080b3bc0 con 0x7fb9080d03c0 2024-08-19T00:49:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.300+0000 7fb8ff400640 1 -- 172.21.15.7:0/4249832268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb90000ac30 con 0x7fb9080d03c0 2024-08-19T00:49:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.300+0000 7fb8ff400640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8e806be30 0x7fb8e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.301+0000 7fb8ff400640 1 -- 172.21.15.7:0/4249832268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fb90008ad80 con 0x7fb9080d03c0 2024-08-19T00:49:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.301+0000 7fb907400640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8e806be30 0x7fb8e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.301+0000 7fb907400640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8e806be30 0x7fb8e806e2f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8034000 tx=0x7fb8f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.305+0000 7fb8ff400640 1 -- 172.21.15.7:0/4249832268 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb900020070 con 0x7fb9080d03c0 2024-08-19T00:49:14.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.562+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]} v 0) -- 0x7fb908071980 con 0x7fb9080d03c0 2024-08-19T00:49:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.728+0000 7fb8ff400640 1 -- 172.21.15.7:0/4249832268 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]}]=0 v640) ==== 135+0+0 (secure 0 0 0) 0x7fb900059a60 con 0x7fb9080d03c0 2024-08-19T00:49:14.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8e806be30 msgr2=0x7fb8e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8e806be30 0x7fb8e806e2f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8034000 tx=0x7fb8f802e000 comp rx=0 tx=0).stop 2024-08-19T00:49:14.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 msgr2=0x7fb9080afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb9080afc80 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c780 tx=0x7fb90000cc40 comp rx=0 tx=0).stop 2024-08-19T00:49:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 shutdown_connections 2024-08-19T00:49:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb8e806be30 0x7fb8e806e2f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9080d03c0 0x7fb9080afc80 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9080b3750 0x7fb9080adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 --2- 172.21.15.7:0/4249832268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb90806e710 0x7fb908159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 >> 172.21.15.7:0/4249832268 conn(0x7fb90806bc70 msgr2=0x7fb9080cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 shutdown_connections 2024-08-19T00:49:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:14.730+0000 7fb90e600640 1 -- 172.21.15.7:0/4249832268 wait complete. 2024-08-19T00:49:14.755 INFO:tasks.cephfs_test_runner:That errors encountered during opening inos are properly propagated ... ERROR 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner: 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner:ERROR: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner:That errors encountered during opening inos are properly propagated 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_damage.py", line 510, in test_open_ino_errors 2024-08-19T00:49:14.756 INFO:tasks.cephfs_test_runner: self.fs.read_backtrace(file1_ino) 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-08-19T00:49:14.757 INFO:tasks.cephfs_test_runner: 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:Ran 6 tests in 705.955s 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner: 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner: 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:ERROR: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:That errors encountered during opening inos are properly propagated 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_damage.py", line 510, in test_open_ino_errors 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner: self.fs.read_backtrace(file1_ino) 2024-08-19T00:49:14.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi007 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-08-19T00:49:14.759 INFO:tasks.cephfs_test_runner: 2024-08-19T00:49:14.760 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:49:15.137 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cca8421f11eb450193b808a08c9c768e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2024-08-19T00:49:15.413 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-19T00:49:15.961 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-19T00:49:16.469 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-19T00:49:16.469 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:49:16.469 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:16.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:49:16.518 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-19T00:49:16.518 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:16.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-19T00:49:16.596 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:49:16.596 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:16.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:49:16.637 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-19T00:49:16.637 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:49:16.717 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052637,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-19T00:49:16.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:16.718 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:49:16.755 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:49:16.757 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-19T00:49:16.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:16.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:49:16.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:16.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-19T00:49:17.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:17.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-08-19T00:49:17.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:17.458 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-08-19T00:49:17.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:17.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-08-19T00:49:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-08-19T00:49:17.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:49:17.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:17.598 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-19T00:49:17.639 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-19T00:49:17.639 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-19T00:49:17.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:17.640 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:49:17.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:17.741 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-19T00:49:17.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:17.969 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-19T00:49:18.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:18.237 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-19T00:49:18.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:49:18.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-19T00:49:18.374 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-08-19T00:49:18.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:49:18.377 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-19T00:49:18.386 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T00:49:18.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:49:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.550+0000 7f6594e00640 1 Processor -- start 2024-08-19T00:49:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.551+0000 7f6594e00640 1 -- start start 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f6594e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590159bf0 0x7f6590073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f6594e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f65900cec10 0x7f65900d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f6594e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659006f7f0 con 0x7f65900739a0 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f6594e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f659006f510 con 0x7f65900cec10 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f6594e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6590072980 con 0x7f6590159bf0 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f6587e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f65900739a0 0x7f65900ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36276/0 (socket says 172.21.15.7:36276) 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f6587e00640 1 -- 172.21.15.7:0/2662950080 learned_addr learned my addr 172.21.15.7:0/2662950080 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f658e800640 1 --2- 172.21.15.7:0/2662950080 >> v2:172.21.15.162:3300/0 conn(0x7f65900cec10 0x7f65900d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f658de00640 1 --2- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590159bf0 0x7f6590073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.552+0000 7f658d400640 1 -- 172.21.15.7:0/2662950080 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357804254 0 0) 0x7f659006f7f0 con 0x7f65900739a0 2024-08-19T00:49:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.553+0000 7f658e800640 1 -- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590159bf0 msgr2=0x7f6590073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.553+0000 7f658e800640 1 --2- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590159bf0 0x7f6590073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.553+0000 7f658e800640 1 -- 172.21.15.7:0/2662950080 >> v1:172.21.15.7:6789/0 conn(0x7f65900739a0 legacy=0x7f65900ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.553+0000 7f658e800640 1 -- 172.21.15.7:0/2662950080 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6590072c60 con 0x7f65900cec10 2024-08-19T00:49:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.553+0000 7f658de00640 1 --2- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590159bf0 0x7f6590073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:49:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.554+0000 7f658e800640 1 --2- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900cec10 0x7f65900d03c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6588009d90 tx=0x7f658802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb1c0e197155ecfd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.554+0000 7f658d400640 1 -- 172.21.15.7:0/2662950080 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588031600 con 0x7f65900cec10 2024-08-19T00:49:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.554+0000 7f658d400640 1 -- 172.21.15.7:0/2662950080 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65880317a0 con 0x7f65900cec10 2024-08-19T00:49:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.554+0000 7f658d400640 1 -- 172.21.15.7:0/2662950080 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588031b70 con 0x7f65900cec10 2024-08-19T00:49:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 -- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900cec10 msgr2=0x7f65900d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 --2- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900cec10 0x7f65900d03c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6588009d90 tx=0x7f658802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 -- 172.21.15.7:0/2662950080 shutdown_connections 2024-08-19T00:49:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 --2- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900cec10 0x7f65900d03c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 --2- 172.21.15.7:0/2662950080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590159bf0 0x7f6590073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 -- 172.21.15.7:0/2662950080 >> 172.21.15.7:0/2662950080 conn(0x7f659006bc70 msgr2=0x7f659006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 -- 172.21.15.7:0/2662950080 shutdown_connections 2024-08-19T00:49:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.555+0000 7f6594e00640 1 -- 172.21.15.7:0/2662950080 wait complete. 2024-08-19T00:49:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.557+0000 7f6594e00640 1 Processor -- start 2024-08-19T00:49:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.557+0000 7f6594e00640 1 -- start start 2024-08-19T00:49:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6594e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900739a0 0x7f65901f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6594e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6590159bf0 0x7f6590153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6594e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590154480 0x7f659015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6594e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f659015a150 con 0x7f6590159bf0 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6594e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6590159fd0 con 0x7f65900739a0 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6594e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65900d0900 con 0x7f6590154480 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6587e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6590159bf0 0x7f6590153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6587e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6590159bf0 0x7f6590153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45696/0 (socket says 172.21.15.7:45696) 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6587e00640 1 -- 172.21.15.7:0/1977560873 learned_addr learned my addr 172.21.15.7:0/1977560873 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f658e800640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590154480 0x7f659015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f658de00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900739a0 0x7f65901f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6587e00640 1 -- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590154480 msgr2=0x7f659015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6587e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590154480 0x7f659015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.558+0000 7f6587e00640 1 -- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900739a0 msgr2=0x7f65901f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6587e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900739a0 0x7f65901f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6587e00640 1 -- 172.21.15.7:0/1977560873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6590154990 con 0x7f6590159bf0 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f658e800640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590154480 0x7f659015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f658de00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900739a0 0x7f65901f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6587e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6590159bf0 0x7f6590153f40 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f657800c440 tx=0x7f657800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6586000640 1 -- 172.21.15.7:0/1977560873 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578018070 con 0x7f6590159bf0 2024-08-19T00:49:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6586000640 1 -- 172.21.15.7:0/1977560873 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780074e0 con 0x7f6590159bf0 2024-08-19T00:49:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6586000640 1 -- 172.21.15.7:0/1977560873 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578004a20 con 0x7f6590159bf0 2024-08-19T00:49:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6590154c70 con 0x7f6590159bf0 2024-08-19T00:49:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.559+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6590155230 con 0x7f6590159bf0 2024-08-19T00:49:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.560+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65900d0c80 con 0x7f6590159bf0 2024-08-19T00:49:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.561+0000 7f6586000640 1 -- 172.21.15.7:0/1977560873 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6578004bc0 con 0x7f6590159bf0 2024-08-19T00:49:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.563+0000 7f6586000640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be60 0x7f656c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.563+0000 7f6586000640 1 -- 172.21.15.7:0/1977560873 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f6578089ea0 con 0x7f6590159bf0 2024-08-19T00:49:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.563+0000 7f658de00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be60 0x7f656c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.563+0000 7f658de00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be60 0x7f656c06e320 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6580009ac0 tx=0x7f6580008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.567+0000 7f6586000640 1 -- 172.21.15.7:0/1977560873 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6578058a50 con 0x7f6590159bf0 2024-08-19T00:49:18.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.750+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f659006c390 con 0x7f656c06be60 2024-08-19T00:49:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.751+0000 7f6586000640 1 -- 172.21.15.7:0/1977560873 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7f659006c390 con 0x7f656c06be60 2024-08-19T00:49:18.754 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:49:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be60 msgr2=0x7f656c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be60 0x7f656c06e320 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6580009ac0 tx=0x7f6580008040 comp rx=0 tx=0).stop 2024-08-19T00:49:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6590159bf0 msgr2=0x7f6590153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6590159bf0 0x7f6590153f40 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f657800c440 tx=0x7f657800c900 comp rx=0 tx=0).stop 2024-08-19T00:49:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 shutdown_connections 2024-08-19T00:49:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f656c06be60 0x7f656c06e320 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6590154480 0x7f659015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6590159bf0 0x7f6590153f40 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 --2- 172.21.15.7:0/1977560873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65900739a0 0x7f65901f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 >> 172.21.15.7:0/1977560873 conn(0x7f659006bc70 msgr2=0x7f659015aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 shutdown_connections 2024-08-19T00:49:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.753+0000 7f6594e00640 1 -- 172.21.15.7:0/1977560873 wait complete. 2024-08-19T00:49:18.771 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":507,"stamp":"2024-08-19T00:49:17.422106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":285384,"kb_used_data":15128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754689336,"statfs":{"total":773094113280,"available":772801880064,"internally_reserved":0,"allocated":15491072,"data_stored":8038527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-35768,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-84,"num_read_kb":-86,"num_write":-96,"num_write_kb":-71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.708064"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":404,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-08-19T00:49:14.494058+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:49:14.494058+0000","last_peered":"2024-08-19T00:49:14.494058+0000","last_clean":"2024-08-19T00:49:14.494058+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:49:14.494058+0000","last_undegraded":"2024-08-19T00:49:14.494058+0000","last_fullsized":"2024-08-19T00:49:14.494058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41252,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37656,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334184,"statfs":{"total":96636764160,"available":96598204416,"internally_reserved":0,"allocated":2371584,"data_stored":1444060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343080,"statfs":{"total":96636764160,"available":96607313920,"internally_reserved":0,"allocated":1777664,"data_stored":853692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37676,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334164,"statfs":{"total":96636764160,"available":96598183936,"internally_reserved":0,"allocated":2387968,"data_stored":1449711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":1777664,"data_stored":853692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:49:18.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:49:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.926+0000 7f9a82400640 1 Processor -- start 2024-08-19T00:49:18.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.926+0000 7f9a82400640 1 -- start start 2024-08-19T00:49:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.927+0000 7f9a82400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0d03c0 0x7f9a7c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.927+0000 7f9a82400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9a7c0b3750 0x7f9a7c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.927+0000 7f9a82400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c0cdfb0 con 0x7f9a7c06e710 2024-08-19T00:49:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.927+0000 7f9a82400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7c0cebc0 con 0x7f9a7c0b3750 2024-08-19T00:49:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.927+0000 7f9a82400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c0ce290 con 0x7f9a7c0d03c0 2024-08-19T00:49:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a72a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9a7c06e710 0x7f9a7c0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36278/0 (socket says 172.21.15.7:36278) 2024-08-19T00:49:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a72a00640 1 -- 172.21.15.7:0/2899954901 learned_addr learned my addr 172.21.15.7:0/2899954901 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7b400640 1 --2- 172.21.15.7:0/2899954901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0d03c0 0x7f9a7c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7be00640 1 --2- 172.21.15.7:0/2899954901 >> v2:172.21.15.162:3300/0 conn(0x7f9a7c0b3750 0x7f9a7c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7aa00640 1 -- 172.21.15.7:0/2899954901 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054760433 0 0) 0x7f9a7c0cdfb0 con 0x7f9a7c06e710 2024-08-19T00:49:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7aa00640 1 -- 172.21.15.7:0/2899954901 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a60003520 con 0x7f9a7c06e710 2024-08-19T00:49:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7b400640 1 -- 172.21.15.7:0/2899954901 >> v2:172.21.15.162:3300/0 conn(0x7f9a7c0b3750 msgr2=0x7f9a7c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7b400640 1 --2- 172.21.15.7:0/2899954901 >> v2:172.21.15.162:3300/0 conn(0x7f9a7c0b3750 0x7f9a7c0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7b400640 1 -- 172.21.15.7:0/2899954901 >> v1:172.21.15.7:6789/0 conn(0x7f9a7c06e710 legacy=0x7f9a7c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.928+0000 7f9a7b400640 1 -- 172.21.15.7:0/2899954901 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c0ce570 con 0x7f9a7c0d03c0 2024-08-19T00:49:18.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.929+0000 7f9a7b400640 1 --2- 172.21.15.7:0/2899954901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0d03c0 0x7f9a7c071980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0097a0 tx=0x7f9a6c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7243a0cda2d7615a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a7aa00640 1 -- 172.21.15.7:0/2899954901 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c037070 con 0x7f9a7c0d03c0 2024-08-19T00:49:18.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a7aa00640 1 -- 172.21.15.7:0/2899954901 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c032440 con 0x7f9a7c0d03c0 2024-08-19T00:49:18.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a7aa00640 1 -- 172.21.15.7:0/2899954901 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c032810 con 0x7f9a7c0d03c0 2024-08-19T00:49:18.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 -- 172.21.15.7:0/2899954901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0d03c0 msgr2=0x7f9a7c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 --2- 172.21.15.7:0/2899954901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0d03c0 0x7f9a7c071980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0097a0 tx=0x7f9a6c02a180 comp rx=0 tx=0).stop 2024-08-19T00:49:18.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 -- 172.21.15.7:0/2899954901 shutdown_connections 2024-08-19T00:49:18.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 --2- 172.21.15.7:0/2899954901 >> v2:172.21.15.162:3300/0 conn(0x7f9a7c0b3750 0x7f9a7c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 --2- 172.21.15.7:0/2899954901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0d03c0 0x7f9a7c071980 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 -- 172.21.15.7:0/2899954901 >> 172.21.15.7:0/2899954901 conn(0x7f9a7c06bc70 msgr2=0x7f9a7c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:18.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 -- 172.21.15.7:0/2899954901 shutdown_connections 2024-08-19T00:49:18.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.930+0000 7f9a82400640 1 -- 172.21.15.7:0/2899954901 wait complete. 2024-08-19T00:49:18.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.932+0000 7f9a82400640 1 Processor -- start 2024-08-19T00:49:18.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.932+0000 7f9a82400640 1 -- start start 2024-08-19T00:49:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a82400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a7c06e710 0x7f9a7c0cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a82400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0b3750 0x7f9a7c0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a82400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7c0d03c0 0x7f9a7c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a82400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c073c60 con 0x7f9a7c06e710 2024-08-19T00:49:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a82400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c073ae0 con 0x7f9a7c0d03c0 2024-08-19T00:49:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a82400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c0b3be0 con 0x7f9a7c0b3750 2024-08-19T00:49:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a7c06e710 0x7f9a7c0cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a7c06e710 0x7f9a7c0cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45698/0 (socket says 172.21.15.7:45698) 2024-08-19T00:49:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a7b400640 1 -- 172.21.15.7:0/2216060180 learned_addr learned my addr 172.21.15.7:0/2216060180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a7be00640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7c0d03c0 0x7f9a7c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.933+0000 7f9a72a00640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0b3750 0x7f9a7c0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a7b400640 1 -- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0b3750 msgr2=0x7f9a7c0c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a7b400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0b3750 0x7f9a7c0c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a7b400640 1 -- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7c0d03c0 msgr2=0x7f9a7c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a7b400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7c0d03c0 0x7f9a7c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a7b400640 1 -- 172.21.15.7:0/2216060180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c0c9ae0 con 0x7f9a7c06e710 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a7b400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a7c06e710 0x7f9a7c0cc050 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c035040 tx=0x7f9a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a73e00640 1 -- 172.21.15.7:0/2216060180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c042020 con 0x7f9a7c06e710 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a73e00640 1 -- 172.21.15.7:0/2216060180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c03d750 con 0x7f9a7c06e710 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a73e00640 1 -- 172.21.15.7:0/2216060180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c037040 con 0x7f9a7c06e710 2024-08-19T00:49:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.934+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c0b11f0 con 0x7f9a7c06e710 2024-08-19T00:49:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.935+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c0b1790 con 0x7f9a7c06e710 2024-08-19T00:49:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.935+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c0cdfb0 con 0x7f9a7c06e710 2024-08-19T00:49:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.936+0000 7f9a73e00640 1 -- 172.21.15.7:0/2216060180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a6c045020 con 0x7f9a7c06e710 2024-08-19T00:49:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.937+0000 7f9a73e00640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9a5806be30 0x7f9a5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.937+0000 7f9a73e00640 1 -- 172.21.15.7:0/2216060180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f9a6c0ab670 con 0x7f9a7c06e710 2024-08-19T00:49:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.938+0000 7f9a72a00640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9a5806be30 0x7f9a5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.938+0000 7f9a72a00640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9a5806be30 0x7f9a5806e2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c144ce0 tx=0x7f9a64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:18.941+0000 7f9a73e00640 1 -- 172.21.15.7:0/2216060180 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9a6c04c030 con 0x7f9a7c06e710 2024-08-19T00:49:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.125+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a7c0b20c0 con 0x7f9a5806be30 2024-08-19T00:49:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.125+0000 7f9a73e00640 1 -- 172.21.15.7:0/2216060180 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7f9a7c0b20c0 con 0x7f9a5806be30 2024-08-19T00:49:19.128 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:19.129 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:49:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9a5806be30 msgr2=0x7f9a5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9a5806be30 0x7f9a5806e2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c144ce0 tx=0x7f9a64009040 comp rx=0 tx=0).stop 2024-08-19T00:49:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a7c06e710 msgr2=0x7f9a7c0cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a7c06e710 0x7f9a7c0cc050 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c035040 tx=0x7f9a6c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 shutdown_connections 2024-08-19T00:49:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f9a5806be30 0x7f9a5806e2f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7c0d03c0 0x7f9a7c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7c0b3750 0x7f9a7c0c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 --2- 172.21.15.7:0/2216060180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a7c06e710 0x7f9a7c0cc050 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 >> 172.21.15.7:0/2216060180 conn(0x7f9a7c06bc70 msgr2=0x7f9a7c0ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 shutdown_connections 2024-08-19T00:49:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.128+0000 7f9a82400640 1 -- 172.21.15.7:0/2216060180 wait complete. 2024-08-19T00:49:19.147 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":507,"stamp":"2024-08-19T00:49:17.422106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":285384,"kb_used_data":15128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754689336,"statfs":{"total":773094113280,"available":772801880064,"internally_reserved":0,"allocated":15491072,"data_stored":8038527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-35768,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-84,"num_read_kb":-86,"num_write":-96,"num_write_kb":-71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.708064"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":404,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-08-19T00:49:14.494058+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:49:14.494058+0000","last_peered":"2024-08-19T00:49:14.494058+0000","last_clean":"2024-08-19T00:49:14.494058+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:49:14.494058+0000","last_undegraded":"2024-08-19T00:49:14.494058+0000","last_fullsized":"2024-08-19T00:49:14.494058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41252,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37656,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334184,"statfs":{"total":96636764160,"available":96598204416,"internally_reserved":0,"allocated":2371584,"data_stored":1444060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343080,"statfs":{"total":96636764160,"available":96607313920,"internally_reserved":0,"allocated":1777664,"data_stored":853692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37676,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334164,"statfs":{"total":96636764160,"available":96598183936,"internally_reserved":0,"allocated":2387968,"data_stored":1449711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":1777664,"data_stored":853692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:49:19.148 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T00:49:19.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:49:19.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.301+0000 7f1ec9e00640 1 Processor -- start 2024-08-19T00:49:19.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.301+0000 7f1ec9e00640 1 -- start start 2024-08-19T00:49:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.302+0000 7f1ec9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1ec4159bf0 0x7f1ec4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.302+0000 7f1ec9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40cec10 0x7f1ec40d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.302+0000 7f1ec9e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec406f7f0 con 0x7f1ec40739a0 2024-08-19T00:49:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.302+0000 7f1ec9e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec406f510 con 0x7f1ec4159bf0 2024-08-19T00:49:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.302+0000 7f1ec9e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec4072980 con 0x7f1ec40cec10 2024-08-19T00:49:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1ec2a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1ec4159bf0 0x7f1ec4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1eba000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1ec40739a0 0x7f1ec40ce500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36294/0 (socket says 172.21.15.7:36294) 2024-08-19T00:49:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1eba000640 1 -- 172.21.15.7:0/2383948187 learned_addr learned my addr 172.21.15.7:0/2383948187 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1ec3400640 1 --2- 172.21.15.7:0/2383948187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40cec10 0x7f1ec40d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1ec2a00640 1 -- 172.21.15.7:0/2383948187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40cec10 msgr2=0x7f1ec40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1ec2a00640 1 --2- 172.21.15.7:0/2383948187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40cec10 0x7f1ec40d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1ec2a00640 1 -- 172.21.15.7:0/2383948187 >> v1:172.21.15.7:6789/0 conn(0x7f1ec40739a0 legacy=0x7f1ec40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1ec2000640 1 -- 172.21.15.7:0/2383948187 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178571806 0 0) 0x7f1ec406f7f0 con 0x7f1ec40739a0 2024-08-19T00:49:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.303+0000 7f1ec2a00640 1 -- 172.21.15.7:0/2383948187 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec4072c60 con 0x7f1ec4159bf0 2024-08-19T00:49:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.304+0000 7f1ec2a00640 1 --2- 172.21.15.7:0/2383948187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec4073460 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40097a0 tx=0x7f1eb402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdeddc561eaed2e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:19.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec2000640 1 -- 172.21.15.7:0/2383948187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4037070 con 0x7f1ec4159bf0 2024-08-19T00:49:19.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec2000640 1 -- 172.21.15.7:0/2383948187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb402ae50 con 0x7f1ec4159bf0 2024-08-19T00:49:19.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec2000640 1 -- 172.21.15.7:0/2383948187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4032660 con 0x7f1ec4159bf0 2024-08-19T00:49:19.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 -- 172.21.15.7:0/2383948187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 msgr2=0x7f1ec4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/2383948187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec4073460 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40097a0 tx=0x7f1eb402a100 comp rx=0 tx=0).stop 2024-08-19T00:49:19.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 -- 172.21.15.7:0/2383948187 shutdown_connections 2024-08-19T00:49:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/2383948187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40cec10 0x7f1ec40d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/2383948187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec4073460 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 -- 172.21.15.7:0/2383948187 >> 172.21.15.7:0/2383948187 conn(0x7f1ec406bc70 msgr2=0x7f1ec406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 -- 172.21.15.7:0/2383948187 shutdown_connections 2024-08-19T00:49:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.305+0000 7f1ec9e00640 1 -- 172.21.15.7:0/2383948187 wait complete. 2024-08-19T00:49:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.307+0000 7f1ec9e00640 1 Processor -- start 2024-08-19T00:49:19.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.307+0000 7f1ec9e00640 1 -- start start 2024-08-19T00:49:19.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40739a0 0x7f1ec409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec40af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec414c190 0x7f1ec414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec9e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec415a150 con 0x7f1ec4159bf0 2024-08-19T00:49:19.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec9e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec4159fd0 con 0x7f1ec40739a0 2024-08-19T00:49:19.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec9e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec40d0900 con 0x7f1ec414c190 2024-08-19T00:49:19.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1eba000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec40af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1eba000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec40af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45720/0 (socket says 172.21.15.7:45720) 2024-08-19T00:49:19.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1eba000640 1 -- 172.21.15.7:0/764344865 learned_addr learned my addr 172.21.15.7:0/764344865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:19.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec2a00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40739a0 0x7f1ec409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.308+0000 7f1ec3400640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec414c190 0x7f1ec414c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1eba000640 1 -- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec414c190 msgr2=0x7f1ec414c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1eba000640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec414c190 0x7f1ec414c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1eba000640 1 -- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40739a0 msgr2=0x7f1ec409dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1eba000640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40739a0 0x7f1ec409dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1eba000640 1 -- 172.21.15.7:0/764344865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec409bfb0 con 0x7f1ec4159bf0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1eba000640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec40af670 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c430 tx=0x7f1eac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1ebbe00640 1 -- 172.21.15.7:0/764344865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0074e0 con 0x7f1ec4159bf0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1ebbe00640 1 -- 172.21.15.7:0/764344865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eac0047e0 con 0x7f1ec4159bf0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1ebbe00640 1 -- 172.21.15.7:0/764344865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac004bd0 con 0x7f1ec4159bf0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec409c290 con 0x7f1ec4159bf0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.309+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec409c850 con 0x7f1ec4159bf0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.310+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec4068c00 con 0x7f1ec4159bf0 2024-08-19T00:49:19.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.311+0000 7f1ebbe00640 1 -- 172.21.15.7:0/764344865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1eac011070 con 0x7f1ec4159bf0 2024-08-19T00:49:19.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.313+0000 7f1ebbe00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ea006be30 0x7f1ea006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.313+0000 7f1ebbe00640 1 -- 172.21.15.7:0/764344865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f1eac08a780 con 0x7f1ec4159bf0 2024-08-19T00:49:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.313+0000 7f1ec2a00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ea006be30 0x7f1ea006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.313+0000 7f1ec2a00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ea006be30 0x7f1ea006e2f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4034000 tx=0x7f1eb402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.317+0000 7f1ebbe00640 1 -- 172.21.15.7:0/764344865 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1eac058ce0 con 0x7f1ec4159bf0 2024-08-19T00:49:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.498+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ec40d0cd0 con 0x7f1ea006be30 2024-08-19T00:49:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.499+0000 7f1ebbe00640 1 -- 172.21.15.7:0/764344865 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7f1ec40d0cd0 con 0x7f1ea006be30 2024-08-19T00:49:19.502 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:49:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ea006be30 msgr2=0x7f1ea006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ea006be30 0x7f1ea006e2f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4034000 tx=0x7f1eb402e000 comp rx=0 tx=0).stop 2024-08-19T00:49:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 msgr2=0x7f1ec40af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec40af670 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c430 tx=0x7f1eac00c8f0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 shutdown_connections 2024-08-19T00:49:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f1ea006be30 0x7f1ea006e2f0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec414c190 0x7f1ec414c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4159bf0 0x7f1ec40af670 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 --2- 172.21.15.7:0/764344865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40739a0 0x7f1ec409dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 >> 172.21.15.7:0/764344865 conn(0x7f1ec406bc70 msgr2=0x7f1ec415fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 shutdown_connections 2024-08-19T00:49:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.502+0000 7f1ec9e00640 1 -- 172.21.15.7:0/764344865 wait complete. 2024-08-19T00:49:19.520 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":508,"stamp":"2024-08-19T00:49:19.422388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":285384,"kb_used_data":15128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754689336,"statfs":{"total":773094113280,"available":772801880064,"internally_reserved":0,"allocated":15491072,"data_stored":8038527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-35768,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-84,"num_read_kb":-86,"num_write":-96,"num_write_kb":-71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001405"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":404,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-08-19T00:49:14.494058+0000","last_change":"2024-08-19T00:36:53.266057+0000","last_active":"2024-08-19T00:49:14.494058+0000","last_peered":"2024-08-19T00:49:14.494058+0000","last_clean":"2024-08-19T00:49:14.494058+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:49:14.494058+0000","last_undegraded":"2024-08-19T00:49:14.494058+0000","last_fullsized":"2024-08-19T00:49:14.494058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:36:52.005962+0000","last_clean_scrub_stamp":"2024-08-19T00:36:52.005962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:29.328397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41252,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37656,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334184,"statfs":{"total":96636764160,"available":96598204416,"internally_reserved":0,"allocated":2371584,"data_stored":1444060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343080,"statfs":{"total":96636764160,"available":96607313920,"internally_reserved":0,"allocated":1777664,"data_stored":853692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37676,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334164,"statfs":{"total":96636764160,"available":96598183936,"internally_reserved":0,"allocated":2387968,"data_stored":1449711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":1777664,"data_stored":853692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:49:19.521 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:49:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.675+0000 7fcc0e200640 1 Processor -- start 2024-08-19T00:49:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.675+0000 7fcc0e200640 1 -- start start 2024-08-19T00:49:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0e200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc0815e360 0x7fcc0815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0e200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc080d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0e200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc080b3ab0 con 0x7fcc080d2af0 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0e200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcc0815f460 con 0x7fcc0815e360 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0e200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0815f740 con 0x7fcc0815ee50 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc0815e360 0x7fcc0815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc0815e360 0x7fcc0815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45730/0 (socket says 172.21.15.7:45730) 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc0ce00640 1 -- 172.21.15.7:0/3080535441 learned_addr learned my addr 172.21.15.7:0/3080535441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.676+0000 7fcc07e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcc080d2af0 0x7fcc0815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36296/0 (socket says 172.21.15.7:36296) 2024-08-19T00:49:19.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.677+0000 7fcc0d800640 1 --2- 172.21.15.7:0/3080535441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc080d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.677+0000 7fcc0ce00640 1 -- 172.21.15.7:0/3080535441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 msgr2=0x7fcc080d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:19.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.677+0000 7fcc0ce00640 1 --2- 172.21.15.7:0/3080535441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc080d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.677+0000 7fcc0ce00640 1 -- 172.21.15.7:0/3080535441 >> v1:172.21.15.7:6789/0 conn(0x7fcc080d2af0 legacy=0x7fcc0815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.677+0000 7fcc0ce00640 1 -- 172.21.15.7:0/3080535441 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc080b3d60 con 0x7fcc0815e360 2024-08-19T00:49:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.677+0000 7fcc07400640 1 -- 172.21.15.7:0/3080535441 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176444138 0 0) 0x7fcc080b3ab0 con 0x7fcc080d2af0 2024-08-19T00:49:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.678+0000 7fcc0ce00640 1 --2- 172.21.15.7:0/3080535441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc0815fab0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009870 tx=0x7fcbfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4cc4d676eb082f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.678+0000 7fcc07400640 1 -- 172.21.15.7:0/3080535441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc037070 con 0x7fcc0815e360 2024-08-19T00:49:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.678+0000 7fcc07400640 1 -- 172.21.15.7:0/3080535441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbfc032440 con 0x7fcc0815e360 2024-08-19T00:49:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.678+0000 7fcc07400640 1 -- 172.21.15.7:0/3080535441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc032810 con 0x7fcc0815e360 2024-08-19T00:49:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 -- 172.21.15.7:0/3080535441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 msgr2=0x7fcc0815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 --2- 172.21.15.7:0/3080535441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc0815fab0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009870 tx=0x7fcbfc02a270 comp rx=0 tx=0).stop 2024-08-19T00:49:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 -- 172.21.15.7:0/3080535441 shutdown_connections 2024-08-19T00:49:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 --2- 172.21.15.7:0/3080535441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc080d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 --2- 172.21.15.7:0/3080535441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc0815fab0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 -- 172.21.15.7:0/3080535441 >> 172.21.15.7:0/3080535441 conn(0x7fcc0808dbf0 msgr2=0x7fcc0809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:19.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 -- 172.21.15.7:0/3080535441 shutdown_connections 2024-08-19T00:49:19.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.679+0000 7fcc0e200640 1 -- 172.21.15.7:0/3080535441 wait complete. 2024-08-19T00:49:19.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.681+0000 7fcc0e200640 1 Processor -- start 2024-08-19T00:49:19.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.681+0000 7fcc0e200640 1 -- start start 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc080d2af0 0x7fcc080b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc08153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0e200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc0815b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc080b4560 con 0x7fcc0815e360 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc080d2300 con 0x7fcc080d2af0 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0e200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc080b46e0 con 0x7fcc0815ee50 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc08153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc08153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45738/0 (socket says 172.21.15.7:45738) 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 -- 172.21.15.7:0/2401671046 learned_addr learned my addr 172.21.15.7:0/2401671046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0ce00640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc080d2af0 0x7fcc080b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc0d800640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc0815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 -- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 msgr2=0x7fcc0815b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc0815b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 -- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc080d2af0 msgr2=0x7fcc080b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc080d2af0 0x7fcc080b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.682+0000 7fcc07e00640 1 -- 172.21.15.7:0/2401671046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc081f8690 con 0x7fcc0815e360 2024-08-19T00:49:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.683+0000 7fcc07e00640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc08153d90 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c4d0 tx=0x7fcbf400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.683+0000 7fcc04c00640 1 -- 172.21.15.7:0/2401671046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4018070 con 0x7fcc0815e360 2024-08-19T00:49:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.683+0000 7fcc04c00640 1 -- 172.21.15.7:0/2401671046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf4007500 con 0x7fcc0815e360 2024-08-19T00:49:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.683+0000 7fcc04c00640 1 -- 172.21.15.7:0/2401671046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4004a20 con 0x7fcc0815e360 2024-08-19T00:49:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.683+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc081f8970 con 0x7fcc0815e360 2024-08-19T00:49:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.683+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc081f8f30 con 0x7fcc0815e360 2024-08-19T00:49:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.684+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc080b4c00 con 0x7fcc0815e360 2024-08-19T00:49:19.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.685+0000 7fcc04c00640 1 -- 172.21.15.7:0/2401671046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbf401b070 con 0x7fcc0815e360 2024-08-19T00:49:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.686+0000 7fcc04c00640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbe806be30 0x7fcbe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.686+0000 7fcc04c00640 1 -- 172.21.15.7:0/2401671046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fcbf4089e30 con 0x7fcc0815e360 2024-08-19T00:49:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.686+0000 7fcc0ce00640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbe806be30 0x7fcbe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.687+0000 7fcc0ce00640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbe806be30 0x7fcbe806e2f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc034000 tx=0x7fcbfc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.690+0000 7fcc04c00640 1 -- 172.21.15.7:0/2401671046 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcc080b4c00 con 0x7fcc0815e360 2024-08-19T00:49:19.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.879+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc08160c30 con 0x7fcc0815e360 2024-08-19T00:49:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.880+0000 7fcc04c00640 1 -- 172.21.15.7:0/2401671046 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+13120 (secure 0 0 0) 0x7fcbf4058420 con 0x7fcc0815e360 2024-08-19T00:49:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:19.883 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":140,"fsid":"bd35d026-e259-45a6-99d5-e8ea5afa8a60","created":"2024-08-19T00:36:38.238957+0000","modified":"2024-08-19T00:49:13.722114+0000","last_up_change":"2024-08-19T00:36:50.001052+0000","last_in_change":"2024-08-19T00:36:41.060811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:36:51.315746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef43c4a9-3ef1-4e3d-9b3d-64d917524ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6804","nonce":2395155056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6808","nonce":2395155056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6815","nonce":2395155056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2395155056},{"type":"v1","addr":"172.21.15.7:6812","nonce":2395155056}]},"public_addr":"172.21.15.7:6804/2395155056","cluster_addr":"172.21.15.7:6808/2395155056","heartbeat_back_addr":"172.21.15.7:6815/2395155056","heartbeat_front_addr":"172.21.15.7:6812/2395155056","state":["exists","up"]},{"osd":1,"uuid":"37a20e1a-8471-471a-986e-1d0baa51e986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6801","nonce":3345827885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6803","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6805","nonce":3345827885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6811","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6813","nonce":3345827885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6807","nonce":3345827885},{"type":"v1","addr":"172.21.15.7:6809","nonce":3345827885}]},"public_addr":"172.21.15.7:6801/3345827885","cluster_addr":"172.21.15.7:6805/3345827885","heartbeat_back_addr":"172.21.15.7:6813/3345827885","heartbeat_front_addr":"172.21.15.7:6809/3345827885","state":["exists","up"]},{"osd":2,"uuid":"ff5da9bd-3c2b-4158-8eb1-30991bc3337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6817","nonce":3897722247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6821","nonce":3897722247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6828","nonce":3897722247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":3897722247},{"type":"v1","addr":"172.21.15.7:6825","nonce":3897722247}]},"public_addr":"172.21.15.7:6817/3897722247","cluster_addr":"172.21.15.7:6821/3897722247","heartbeat_back_addr":"172.21.15.7:6828/3897722247","heartbeat_front_addr":"172.21.15.7:6825/3897722247","state":["exists","up"]},{"osd":3,"uuid":"e9997f2b-63c5-4954-ae2f-487458ffe118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6820","nonce":3221924005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6824","nonce":3221924005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6831","nonce":3221924005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6827","nonce":3221924005},{"type":"v1","addr":"172.21.15.7:6829","nonce":3221924005}]},"public_addr":"172.21.15.7:6820/3221924005","cluster_addr":"172.21.15.7:6824/3221924005","heartbeat_back_addr":"172.21.15.7:6831/3221924005","heartbeat_front_addr":"172.21.15.7:6829/3221924005","state":["exists","up"]},{"osd":4,"uuid":"a2f296b5-5e28-4a5d-8cb0-baa5a74c56da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6808","nonce":2900813997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6811","nonce":2900813997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6815","nonce":2900813997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2900813997},{"type":"v1","addr":"172.21.15.162:6813","nonce":2900813997}]},"public_addr":"172.21.15.162:6808/2900813997","cluster_addr":"172.21.15.162:6811/2900813997","heartbeat_back_addr":"172.21.15.162:6815/2900813997","heartbeat_front_addr":"172.21.15.162:6813/2900813997","state":["exists","up"]},{"osd":5,"uuid":"359ca72a-0433-4537-9118-0cdd55860290","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6801","nonce":3267745349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6803","nonce":3267745349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6809","nonce":3267745349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3267745349},{"type":"v1","addr":"172.21.15.162:6805","nonce":3267745349}]},"public_addr":"172.21.15.162:6801/3267745349","cluster_addr":"172.21.15.162:6803/3267745349","heartbeat_back_addr":"172.21.15.162:6809/3267745349","heartbeat_front_addr":"172.21.15.162:6805/3267745349","state":["exists","up"]},{"osd":6,"uuid":"0fa7fe5a-94ec-4a8b-89ec-727c03ed7f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6817","nonce":3414725774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6819","nonce":3414725774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6823","nonce":3414725774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3414725774},{"type":"v1","addr":"172.21.15.162:6821","nonce":3414725774}]},"public_addr":"172.21.15.162:6817/3414725774","cluster_addr":"172.21.15.162:6819/3414725774","heartbeat_back_addr":"172.21.15.162:6823/3414725774","heartbeat_front_addr":"172.21.15.162:6821/3414725774","state":["exists","up"]},{"osd":7,"uuid":"0cab8784-a187-4554-839b-cafdd13963f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6825","nonce":4238399288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6827","nonce":4238399288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6831","nonce":4238399288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4238399288},{"type":"v1","addr":"172.21.15.162:6829","nonce":4238399288}]},"public_addr":"172.21.15.162:6825/4238399288","cluster_addr":"172.21.15.162:6827/4238399288","heartbeat_back_addr":"172.21.15.162:6831/4238399288","heartbeat_front_addr":"172.21.15.162:6829/4238399288","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.422840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.368174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.583737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.656943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.367301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.425819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.443639+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:36:46.450950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3771894460":"2024-08-20T00:49:10.711130+0000","172.21.15.7:6835/3771894460":"2024-08-20T00:49:10.711130+0000","172.21.15.7:6837/2760644218":"2024-08-20T00:48:59.539071+0000","172.21.15.7:6835/2760644218":"2024-08-20T00:48:59.539071+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:49:19.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbe806be30 msgr2=0x7fcbe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbe806be30 0x7fcbe806e2f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc034000 tx=0x7fcbfc02e000 comp rx=0 tx=0).stop 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 msgr2=0x7fcc08153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc08153d90 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c4d0 tx=0x7fcbf400c990 comp rx=0 tx=0).stop 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 shutdown_connections 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fcbe806be30 0x7fcbe806e2f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc0815ee50 0x7fcc0815b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc0815e360 0x7fcc08153d90 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 --2- 172.21.15.7:0/2401671046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc080d2af0 0x7fcc080b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.882+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 >> 172.21.15.7:0/2401671046 conn(0x7fcc0808dbf0 msgr2=0x7fcc0806c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:19.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.883+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 shutdown_connections 2024-08-19T00:49:19.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:19.883+0000 7fcc0e200640 1 -- 172.21.15.7:0/2401671046 wait complete. 2024-08-19T00:49:20.903 INFO:tasks.ceph:Scrubbing osd.0 2024-08-19T00:49:20.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:21.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.073+0000 7fafe8400640 1 Processor -- start 2024-08-19T00:49:21.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.074+0000 7fafe8400640 1 -- start start 2024-08-19T00:49:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe8400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fafe0073540 0x7fafe00cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe8400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fafe015ce50 0x7fafe00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe8400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe015d390 con 0x7fafe0160940 2024-08-19T00:49:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe8400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fafe0072f10 con 0x7fafe015ce50 2024-08-19T00:49:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe8400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fafe015d670 con 0x7fafe0073540 2024-08-19T00:49:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe6400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fafe015ce50 0x7fafe00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe5000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fafe0160940 0x7fafe015c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36300/0 (socket says 172.21.15.7:36300) 2024-08-19T00:49:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe5000640 1 -- 172.21.15.7:0/2729612305 learned_addr learned my addr 172.21.15.7:0/2729612305 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:21.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.075+0000 7fafe5a00640 1 --2- 172.21.15.7:0/2729612305 >> v2:172.21.15.162:3300/0 conn(0x7fafe0073540 0x7fafe00cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.076+0000 7fafe6400640 1 -- 172.21.15.7:0/2729612305 >> v2:172.21.15.162:3300/0 conn(0x7fafe0073540 msgr2=0x7fafe00cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.076+0000 7fafe6400640 1 --2- 172.21.15.7:0/2729612305 >> v2:172.21.15.162:3300/0 conn(0x7fafe0073540 0x7fafe00cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.076+0000 7fafe6400640 1 -- 172.21.15.7:0/2729612305 >> v1:172.21.15.7:6789/0 conn(0x7fafe0160940 legacy=0x7fafe015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.076+0000 7fafe6400640 1 -- 172.21.15.7:0/2729612305 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe015fe60 con 0x7fafe015ce50 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.076+0000 7fafdfe00640 1 -- 172.21.15.7:0/2729612305 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960066387 0 0) 0x7fafe015d390 con 0x7fafe0160940 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.077+0000 7fafe6400640 1 --2- 172.21.15.7:0/2729612305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe00cceb0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fafe006c740 tx=0x7fafd802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68782237ac3dfdf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.077+0000 7fafdfe00640 1 -- 172.21.15.7:0/2729612305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8007740 con 0x7fafe015ce50 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.077+0000 7fafdfe00640 1 -- 172.21.15.7:0/2729612305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd80078e0 con 0x7fafe015ce50 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.077+0000 7fafdfe00640 1 -- 172.21.15.7:0/2729612305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8007cb0 con 0x7fafe015ce50 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.077+0000 7fafe8400640 1 -- 172.21.15.7:0/2729612305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 msgr2=0x7fafe00cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.077+0000 7fafe8400640 1 --2- 172.21.15.7:0/2729612305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe00cceb0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fafe006c740 tx=0x7fafd802a5f0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.078+0000 7fafe8400640 1 -- 172.21.15.7:0/2729612305 shutdown_connections 2024-08-19T00:49:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.078+0000 7fafe8400640 1 --2- 172.21.15.7:0/2729612305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe00cceb0 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.078+0000 7fafe8400640 1 --2- 172.21.15.7:0/2729612305 >> v2:172.21.15.162:3300/0 conn(0x7fafe0073540 0x7fafe00cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.078+0000 7fafe8400640 1 -- 172.21.15.7:0/2729612305 >> 172.21.15.7:0/2729612305 conn(0x7fafe006be80 msgr2=0x7fafe00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.078+0000 7fafe8400640 1 -- 172.21.15.7:0/2729612305 shutdown_connections 2024-08-19T00:49:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.078+0000 7fafe8400640 1 -- 172.21.15.7:0/2729612305 wait complete. 2024-08-19T00:49:21.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.079+0000 7fafe8400640 1 Processor -- start 2024-08-19T00:49:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.079+0000 7fafe8400640 1 -- start start 2024-08-19T00:49:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.080+0000 7fafe8400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafe0073540 0x7fafe014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.080+0000 7fafe8400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe01f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.080+0000 7fafe8400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe0160940 0x7fafe01f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.080+0000 7fafe8400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafe0073920 con 0x7fafe015ce50 2024-08-19T00:49:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.080+0000 7fafe8400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafe0160420 con 0x7fafe0160940 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.080+0000 7fafe8400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fafe00b4130 con 0x7fafe0073540 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe01f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe01f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45762/0 (socket says 172.21.15.7:45762) 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 -- 172.21.15.7:0/3979228089 learned_addr learned my addr 172.21.15.7:0/3979228089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5a00640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafe0073540 0x7fafe014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe6400640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe0160940 0x7fafe01f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 -- 172.21.15.7:0/3979228089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafe0073540 msgr2=0x7fafe014b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafe0073540 0x7fafe014b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 -- 172.21.15.7:0/3979228089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe0160940 msgr2=0x7fafe01f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe0160940 0x7fafe01f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 -- 172.21.15.7:0/3979228089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe01577e0 con 0x7fafe015ce50 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.081+0000 7fafe5000640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe01f5750 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c460 tx=0x7fafcc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.082+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc018070 con 0x7fafe015ce50 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.082+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc007500 con 0x7fafe015ce50 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.082+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc004a20 con 0x7fafe015ce50 2024-08-19T00:49:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.082+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe0157a80 con 0x7fafe015ce50 2024-08-19T00:49:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.082+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe0159cb0 con 0x7fafe015ce50 2024-08-19T00:49:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.083+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fafe01535c0 con 0x7fafe015ce50 2024-08-19T00:49:21.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.084+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafcc01b070 con 0x7fafe015ce50 2024-08-19T00:49:21.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.085+0000 7fafdd600640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fafc006be60 0x7fafc006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.085+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fafcc089e10 con 0x7fafe015ce50 2024-08-19T00:49:21.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.085+0000 7fafe5a00640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fafc006be60 0x7fafc006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.085+0000 7fafdd600640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7fafc0071dc0 0x7fafc00741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.085+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafc0074890 con 0x7fafc0071dc0 2024-08-19T00:49:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.085+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7fafcc08c430 con 0x7fafe015ce50 2024-08-19T00:49:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.085+0000 7fafe6400640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7fafc0071dc0 0x7fafc00741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.086+0000 7fafe5a00640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fafc006be60 0x7fafc006e320 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009b40 tx=0x7fafd4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.086+0000 7fafe6400640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7fafc0071dc0 0x7fafc00741e0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.087+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== osd.0 v2:172.21.15.7:6802/2395155056 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafc0074890 con 0x7fafc0071dc0 2024-08-19T00:49:21.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.100+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 --> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fafe015c740 con 0x7fafc0071dc0 2024-08-19T00:49:21.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafdd600640 1 -- 172.21.15.7:0/3979228089 <== osd.0 v2:172.21.15.7:6802/2395155056 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fafe015c740 con 0x7fafc0071dc0 2024-08-19T00:49:21.103 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:21.104 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:21.104 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:21.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7fafc0071dc0 msgr2=0x7fafc00741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6802/2395155056,v1:172.21.15.7:6804/2395155056] conn(0x7fafc0071dc0 0x7fafc00741e0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fafc006be60 msgr2=0x7fafc006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fafc006be60 0x7fafc006e320 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009b40 tx=0x7fafd4009190 comp rx=0 tx=0).stop 2024-08-19T00:49:21.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 msgr2=0x7fafe01f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 --2- 172.21.15.7:0/3979228089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafe015ce50 0x7fafe01f5750 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c460 tx=0x7fafcc00c920 comp rx=0 tx=0).stop 2024-08-19T00:49:21.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe6400640 1 -- 172.21.15.7:0/3979228089 reap_dead start 2024-08-19T00:49:21.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 shutdown_connections 2024-08-19T00:49:21.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 >> 172.21.15.7:0/3979228089 conn(0x7fafe006be80 msgr2=0x7fafe0152eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:21.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 shutdown_connections 2024-08-19T00:49:21.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.101+0000 7fafe8400640 1 -- 172.21.15.7:0/3979228089 wait complete. 2024-08-19T00:49:21.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-19T00:49:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.273+0000 7f035e800640 1 Processor -- start 2024-08-19T00:49:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.273+0000 7f035e800640 1 -- start start 2024-08-19T00:49:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.274+0000 7f035e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f035806c870 0x7f03580d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.274+0000 7f035e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03580d2fe0 0x7f03580cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.274+0000 7f035e800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03580d27a0 con 0x7f035815e590 2024-08-19T00:49:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.274+0000 7f035e800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f03580d33f0 con 0x7f035806c870 2024-08-19T00:49:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.274+0000 7f035e800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f03580d0fa0 con 0x7f03580d2fe0 2024-08-19T00:49:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f034fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f035806c870 0x7f03580d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f034fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f035806c870 0x7f03580d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45770/0 (socket says 172.21.15.7:45770) 2024-08-19T00:49:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f034fe00640 1 -- 172.21.15.7:0/2313015028 learned_addr learned my addr 172.21.15.7:0/2313015028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f0357e00640 1 --2- 172.21.15.7:0/2313015028 >> v2:172.21.15.162:3300/0 conn(0x7f03580d2fe0 0x7f03580cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f034fe00640 1 -- 172.21.15.7:0/2313015028 >> v2:172.21.15.162:3300/0 conn(0x7f03580d2fe0 msgr2=0x7f03580cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f034fe00640 1 --2- 172.21.15.7:0/2313015028 >> v2:172.21.15.162:3300/0 conn(0x7f03580d2fe0 0x7f03580cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f034fe00640 1 -- 172.21.15.7:0/2313015028 >> v1:172.21.15.162:6789/0 conn(0x7f035815e590 legacy=0x7f03580d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f034fe00640 1 -- 172.21.15.7:0/2313015028 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03580d1280 con 0x7f035806c870 2024-08-19T00:49:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.275+0000 7f0357e00640 1 --2- 172.21.15.7:0/2313015028 >> v2:172.21.15.162:3300/0 conn(0x7f03580d2fe0 0x7f03580cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.276+0000 7f034fe00640 1 --2- 172.21.15.7:0/2313015028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580d2aa0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f03580cb520 tx=0x7f034002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16efdc83df2da356 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.276+0000 7f0356a00640 1 -- 172.21.15.7:0/2313015028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340037070 con 0x7f035806c870 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.276+0000 7f0356a00640 1 -- 172.21.15.7:0/2313015028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0340032440 con 0x7f035806c870 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.276+0000 7f0356a00640 1 -- 172.21.15.7:0/2313015028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340032810 con 0x7f035806c870 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 -- 172.21.15.7:0/2313015028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 msgr2=0x7f03580d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 --2- 172.21.15.7:0/2313015028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580d2aa0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f03580cb520 tx=0x7f034002a230 comp rx=0 tx=0).stop 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 -- 172.21.15.7:0/2313015028 shutdown_connections 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 --2- 172.21.15.7:0/2313015028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580d2aa0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 --2- 172.21.15.7:0/2313015028 >> v2:172.21.15.162:3300/0 conn(0x7f03580d2fe0 0x7f03580cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 -- 172.21.15.7:0/2313015028 >> 172.21.15.7:0/2313015028 conn(0x7f035809d710 msgr2=0x7f03580d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 -- 172.21.15.7:0/2313015028 shutdown_connections 2024-08-19T00:49:21.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.277+0000 7f035e800640 1 -- 172.21.15.7:0/2313015028 wait complete. 2024-08-19T00:49:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.279+0000 7f035e800640 1 Processor -- start 2024-08-19T00:49:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.279+0000 7f035e800640 1 -- start start 2024-08-19T00:49:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f035e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f035e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03580d2fe0 0x7f03581f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f035e800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035815e590 0x7f03580c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f035e800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03580cefd0 con 0x7f035806c870 2024-08-19T00:49:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f035e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03580d1840 con 0x7f03580d2fe0 2024-08-19T00:49:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f035e800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03580cf150 con 0x7f035815e590 2024-08-19T00:49:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45784/0 (socket says 172.21.15.7:45784) 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 -- 172.21.15.7:0/444696274 learned_addr learned my addr 172.21.15.7:0/444696274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f034fe00640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03580d2fe0 0x7f03581f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357e00640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035815e590 0x7f03580c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 -- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035815e590 msgr2=0x7f03580c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035815e590 0x7f03580c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 -- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03580d2fe0 msgr2=0x7f03581f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03580d2fe0 0x7f03581f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f0357400640 1 -- 172.21.15.7:0/444696274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03580c9550 con 0x7f035806c870 2024-08-19T00:49:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.280+0000 7f034fe00640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03580d2fe0 0x7f03581f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.281+0000 7f0357400640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580ce470 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f034800c460 tx=0x7f034800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.281+0000 7f034f400640 1 -- 172.21.15.7:0/444696274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348016020 con 0x7f035806c870 2024-08-19T00:49:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.281+0000 7f034f400640 1 -- 172.21.15.7:0/444696274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0348012870 con 0x7f035806c870 2024-08-19T00:49:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.281+0000 7f034f400640 1 -- 172.21.15.7:0/444696274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348012c60 con 0x7f035806c870 2024-08-19T00:49:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.281+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03580c9830 con 0x7f035806c870 2024-08-19T00:49:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.281+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03580c9df0 con 0x7f035806c870 2024-08-19T00:49:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.282+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035815e970 con 0x7f035806c870 2024-08-19T00:49:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.283+0000 7f034f400640 1 -- 172.21.15.7:0/444696274 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0348019020 con 0x7f035806c870 2024-08-19T00:49:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.284+0000 7f034f400640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f033406be30 0x7f033406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.284+0000 7f034f400640 1 -- 172.21.15.7:0/444696274 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f034808a9f0 con 0x7f035806c870 2024-08-19T00:49:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.284+0000 7f034fe00640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f033406be30 0x7f033406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.285+0000 7f034fe00640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f033406be30 0x7f033406e2f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0340034000 tx=0x7f034002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.289+0000 7f034f400640 1 -- 172.21.15.7:0/444696274 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0348020030 con 0x7f035806c870 2024-08-19T00:49:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.473+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f03580d53d0 con 0x7f033406be30 2024-08-19T00:49:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.473+0000 7f034f400640 1 -- 172.21.15.7:0/444696274 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f03580d53d0 con 0x7f033406be30 2024-08-19T00:49:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2024-08-19T00:49:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.475+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f033406be30 msgr2=0x7f033406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.475+0000 7f035e800640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f033406be30 0x7f033406e2f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0340034000 tx=0x7f034002e000 comp rx=0 tx=0).stop 2024-08-19T00:49:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.475+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 msgr2=0x7f03580ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.475+0000 7f035e800640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580ce470 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f034800c460 tx=0x7f034800c920 comp rx=0 tx=0).stop 2024-08-19T00:49:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 shutdown_connections 2024-08-19T00:49:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f033406be30 0x7f033406e2f0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035815e590 0x7f03580c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03580d2fe0 0x7f03581f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 --2- 172.21.15.7:0/444696274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f035806c870 0x7f03580ce470 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 >> 172.21.15.7:0/444696274 conn(0x7f035809d710 msgr2=0x7f03580b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 shutdown_connections 2024-08-19T00:49:21.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.476+0000 7f035e800640 1 -- 172.21.15.7:0/444696274 wait complete. 2024-08-19T00:49:21.495 INFO:tasks.ceph:Scrubbing osd.1 2024-08-19T00:49:21.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:21.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.653+0000 7f042a800640 1 Processor -- start 2024-08-19T00:49:21.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.653+0000 7f042a800640 1 -- start start 2024-08-19T00:49:21.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f042a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f042415bd70 0x7f0424072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f042a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0424072f70 0x7f042406d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f042a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f042406db40 0x7f0424071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f042a800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f042406dfb0 con 0x7f042406db40 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f042a800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f04240733f0 con 0x7f042415bd70 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f042a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04240736d0 con 0x7f0424072f70 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f0429e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f042406db40 0x7f0424071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f0429e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f042406db40 0x7f0424071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45794/0 (socket says 172.21.15.7:45794) 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f0429e00640 1 -- 172.21.15.7:0/370976556 learned_addr learned my addr 172.21.15.7:0/370976556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:21.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.654+0000 7f0429400640 1 --2- 172.21.15.7:0/370976556 >> v2:172.21.15.162:3300/0 conn(0x7f042415bd70 0x7f0424072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.655+0000 7f0428a00640 1 --2- 172.21.15.7:0/370976556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0424072f70 0x7f042406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.655+0000 7f0429e00640 1 -- 172.21.15.7:0/370976556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0424072f70 msgr2=0x7f042406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:21.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.655+0000 7f0429e00640 1 --2- 172.21.15.7:0/370976556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0424072f70 0x7f042406d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.655+0000 7f0429e00640 1 -- 172.21.15.7:0/370976556 >> v2:172.21.15.162:3300/0 conn(0x7f042415bd70 msgr2=0x7f0424072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:21.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.655+0000 7f0429e00640 1 --2- 172.21.15.7:0/370976556 >> v2:172.21.15.162:3300/0 conn(0x7f042415bd70 0x7f0424072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.655+0000 7f0429e00640 1 -- 172.21.15.7:0/370976556 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240739b0 con 0x7f042406db40 2024-08-19T00:49:21.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.655+0000 7f0429400640 1 --2- 172.21.15.7:0/370976556 >> v2:172.21.15.162:3300/0 conn(0x7f042415bd70 0x7f0424072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.656+0000 7f0429e00640 1 --2- 172.21.15.7:0/370976556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f0424071810 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f04240694a0 tx=0x7f041c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c394ff89c7d8935a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.656+0000 7f0423e00640 1 -- 172.21.15.7:0/370976556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c036070 con 0x7f042406db40 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.656+0000 7f0423e00640 1 -- 172.21.15.7:0/370976556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c031600 con 0x7f042406db40 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.656+0000 7f0423e00640 1 -- 172.21.15.7:0/370976556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c0319d0 con 0x7f042406db40 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 -- 172.21.15.7:0/370976556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 msgr2=0x7f0424071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 --2- 172.21.15.7:0/370976556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f0424071810 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f04240694a0 tx=0x7f041c02a6a0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 -- 172.21.15.7:0/370976556 shutdown_connections 2024-08-19T00:49:21.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 --2- 172.21.15.7:0/370976556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f0424071810 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 --2- 172.21.15.7:0/370976556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0424072f70 0x7f042406d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 --2- 172.21.15.7:0/370976556 >> v2:172.21.15.162:3300/0 conn(0x7f042415bd70 0x7f0424072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 -- 172.21.15.7:0/370976556 >> 172.21.15.7:0/370976556 conn(0x7f042406b850 msgr2=0x7f042406bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:21.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 -- 172.21.15.7:0/370976556 shutdown_connections 2024-08-19T00:49:21.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.657+0000 7f042a800640 1 -- 172.21.15.7:0/370976556 wait complete. 2024-08-19T00:49:21.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.658+0000 7f042a800640 1 Processor -- start 2024-08-19T00:49:21.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.659+0000 7f042a800640 1 -- start start 2024-08-19T00:49:21.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.659+0000 7f042a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f04240ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f042a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0424072f70 0x7f0424154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f042a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f042415bd70 0x7f04240cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f042a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f042415c150 con 0x7f042406db40 2024-08-19T00:49:21.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f042a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f042415c780 con 0x7f0424072f70 2024-08-19T00:49:21.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f042a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f042406e3a0 con 0x7f042415bd70 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f04240ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f04240ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45802/0 (socket says 172.21.15.7:45802) 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 -- 172.21.15.7:0/193049669 learned_addr learned my addr 172.21.15.7:0/193049669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0428a00640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0424072f70 0x7f0424154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429e00640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f042415bd70 0x7f04240cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 -- 172.21.15.7:0/193049669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f042415bd70 msgr2=0x7f04240cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f042415bd70 0x7f04240cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 -- 172.21.15.7:0/193049669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0424072f70 msgr2=0x7f0424154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0424072f70 0x7f0424154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.660+0000 7f0429400640 1 -- 172.21.15.7:0/193049669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240aee10 con 0x7f042406db40 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.661+0000 7f0429400640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f04240ae270 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f041800d7d0 tx=0x7f041800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.661+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418004030 con 0x7f042406db40 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.661+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04180041d0 con 0x7f042406db40 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.661+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041800b6c0 con 0x7f042406db40 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.661+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04240aeb30 con 0x7f042406db40 2024-08-19T00:49:21.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.661+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04241f1ce0 con 0x7f042406db40 2024-08-19T00:49:21.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.662+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f042406d600 con 0x7f042406db40 2024-08-19T00:49:21.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.663+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f041800b860 con 0x7f042406db40 2024-08-19T00:49:21.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.664+0000 7f0421600640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.664+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f041808ac80 con 0x7f042406db40 2024-08-19T00:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.664+0000 7f0428a00640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.664+0000 7f0421600640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f0404071d90 0x7f04040741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.665+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0418009e50 con 0x7f0404071d90 2024-08-19T00:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.665+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7f0418091020 con 0x7f042406db40 2024-08-19T00:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.665+0000 7f0429e00640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f0404071d90 0x7f04040741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.665+0000 7f0428a00640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f040406be30 0x7f040406e2f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f04241ef100 tx=0x7f0410009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.665+0000 7f0429e00640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f0404071d90 0x7f04040741b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.666+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== osd.1 v2:172.21.15.7:6800/3345827885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0418009e50 con 0x7f0404071d90 2024-08-19T00:49:21.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 --> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0424155360 con 0x7f0404071d90 2024-08-19T00:49:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f0421600640 1 -- 172.21.15.7:0/193049669 <== osd.1 v2:172.21.15.7:6800/3345827885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0424155360 con 0x7f0404071d90 2024-08-19T00:49:21.683 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:21.683 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:21.683 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f0404071d90 msgr2=0x7f04040741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f042a800640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6800/3345827885,v1:172.21.15.7:6801/3345827885] conn(0x7f0404071d90 0x7f04040741b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f040406be30 msgr2=0x7f040406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f042a800640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f040406be30 0x7f040406e2f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f04241ef100 tx=0x7f0410009190 comp rx=0 tx=0).stop 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 msgr2=0x7f04240ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.680+0000 7f042a800640 1 --2- 172.21.15.7:0/193049669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f042406db40 0x7f04240ae270 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f041800d7d0 tx=0x7f041800dc90 comp rx=0 tx=0).stop 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.681+0000 7f0429e00640 1 -- 172.21.15.7:0/193049669 reap_dead start 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.681+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 shutdown_connections 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.681+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 >> 172.21.15.7:0/193049669 conn(0x7f042406b850 msgr2=0x7f04240b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.681+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 shutdown_connections 2024-08-19T00:49:21.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.681+0000 7f042a800640 1 -- 172.21.15.7:0/193049669 wait complete. 2024-08-19T00:49:21.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-19T00:49:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.853+0000 7fbfade00640 1 Processor -- start 2024-08-19T00:49:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.854+0000 7fbfade00640 1 -- start start 2024-08-19T00:49:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfade00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa8071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfade00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfa806e710 0x7fbfa80d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfade00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa80d0ce0 con 0x7fbfa80b3750 2024-08-19T00:49:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfade00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa80cebc0 con 0x7fbfa806e710 2024-08-19T00:49:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfade00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa80cdfb0 con 0x7fbfa80d03c0 2024-08-19T00:49:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbf9fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfa806e710 0x7fbfa80d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbf9fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfa806e710 0x7fbfa80d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45814/0 (socket says 172.21.15.7:45814) 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbf9fe00640 1 -- 172.21.15.7:0/581578756 learned_addr learned my addr 172.21.15.7:0/581578756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfa7400640 1 --1- 172.21.15.7:0/581578756 >> v1:172.21.15.7:6789/0 conn(0x7fbfa80b3750 0x7fbfa80cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36312/0 (socket says 172.21.15.7:36312) 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfa6a00640 1 --2- 172.21.15.7:0/581578756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbf9fe00640 1 -- 172.21.15.7:0/581578756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 msgr2=0x7fbfa8071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbf9fe00640 1 --2- 172.21.15.7:0/581578756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa8071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbf9fe00640 1 -- 172.21.15.7:0/581578756 >> v1:172.21.15.7:6789/0 conn(0x7fbfa80b3750 legacy=0x7fbfa80cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbf9fe00640 1 -- 172.21.15.7:0/581578756 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa80ce290 con 0x7fbfa806e710 2024-08-19T00:49:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.855+0000 7fbfa6a00640 1 --2- 172.21.15.7:0/581578756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa8071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:21.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.856+0000 7fbf9fe00640 1 --2- 172.21.15.7:0/581578756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa806e710 0x7fbfa80d07a0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8435fabf56ec8b5e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfa6000640 1 -- 172.21.15.7:0/581578756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90037070 con 0x7fbfa806e710 2024-08-19T00:49:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfa6000640 1 -- 172.21.15.7:0/581578756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf90032440 con 0x7fbfa806e710 2024-08-19T00:49:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfa6000640 1 -- 172.21.15.7:0/581578756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90032810 con 0x7fbfa806e710 2024-08-19T00:49:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 -- 172.21.15.7:0/581578756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa806e710 msgr2=0x7fbfa80d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 --2- 172.21.15.7:0/581578756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa806e710 0x7fbfa80d07a0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf9002a270 comp rx=0 tx=0).stop 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 -- 172.21.15.7:0/581578756 shutdown_connections 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 --2- 172.21.15.7:0/581578756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa806e710 0x7fbfa80d07a0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 --2- 172.21.15.7:0/581578756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa8071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 -- 172.21.15.7:0/581578756 >> 172.21.15.7:0/581578756 conn(0x7fbfa806bc70 msgr2=0x7fbfa806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 -- 172.21.15.7:0/581578756 shutdown_connections 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.857+0000 7fbfade00640 1 -- 172.21.15.7:0/581578756 wait complete. 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.859+0000 7fbfade00640 1 Processor -- start 2024-08-19T00:49:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.859+0000 7fbfade00640 1 -- start start 2024-08-19T00:49:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbfade00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa806e710 0x7fbfa8158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbfade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa80b3750 0x7fbfa8158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbfade00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa81f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbfade00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa8073ae0 con 0x7fbfa80b3750 2024-08-19T00:49:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbfade00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa80ce850 con 0x7fbfa806e710 2024-08-19T00:49:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbfade00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa8073c60 con 0x7fbfa80d03c0 2024-08-19T00:49:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbf9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa80b3750 0x7fbfa8158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbf9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa80b3750 0x7fbfa8158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45816/0 (socket says 172.21.15.7:45816) 2024-08-19T00:49:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.860+0000 7fbf9fe00640 1 -- 172.21.15.7:0/1044315773 learned_addr learned my addr 172.21.15.7:0/1044315773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbfa6a00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa806e710 0x7fbfa8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbfa7400640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa81f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9fe00640 1 -- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 msgr2=0x7fbfa81f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9fe00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa81f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9fe00640 1 -- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa806e710 msgr2=0x7fbfa8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9fe00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa806e710 0x7fbfa8158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9fe00640 1 -- 172.21.15.7:0/1044315773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa8159310 con 0x7fbfa80b3750 2024-08-19T00:49:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbfa6a00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa806e710 0x7fbfa8158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbfa7400640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa81f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9fe00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa80b3750 0x7fbfa8158dd0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9f400640 1 -- 172.21.15.7:0/1044315773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90041070 con 0x7fbfa80b3750 2024-08-19T00:49:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9f400640 1 -- 172.21.15.7:0/1044315773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9003c870 con 0x7fbfa80b3750 2024-08-19T00:49:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbf9f400640 1 -- 172.21.15.7:0/1044315773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90037040 con 0x7fbfa80b3750 2024-08-19T00:49:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.861+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa80cc530 con 0x7fbfa80b3750 2024-08-19T00:49:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.862+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa80ad400 con 0x7fbfa80b3750 2024-08-19T00:49:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.862+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa80b3be0 con 0x7fbfa80b3750 2024-08-19T00:49:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.863+0000 7fbf9f400640 1 -- 172.21.15.7:0/1044315773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf90044070 con 0x7fbfa80b3750 2024-08-19T00:49:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.864+0000 7fbf9f400640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.864+0000 7fbf9f400640 1 -- 172.21.15.7:0/1044315773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fbf900ab950 con 0x7fbfa80b3750 2024-08-19T00:49:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.865+0000 7fbfa6a00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.865+0000 7fbfa6a00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbf98006fd0 tx=0x7fbf98008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:21.869+0000 7fbf9f400640 1 -- 172.21.15.7:0/1044315773 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbf9007a6b0 con 0x7fbfa80b3750 2024-08-19T00:49:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.052+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fbfa80af960 con 0x7fbf8406be30 2024-08-19T00:49:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.053+0000 7fbf9f400640 1 -- 172.21.15.7:0/1044315773 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbfa80af960 con 0x7fbf8406be30 2024-08-19T00:49:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2024-08-19T00:49:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 msgr2=0x7fbf8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbf98006fd0 tx=0x7fbf98008040 comp rx=0 tx=0).stop 2024-08-19T00:49:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa80b3750 msgr2=0x7fbfa8158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa80b3750 0x7fbfa8158dd0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf900046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 shutdown_connections 2024-08-19T00:49:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfa80d03c0 0x7fbfa81f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfa80b3750 0x7fbfa8158dd0 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 --2- 172.21.15.7:0/1044315773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfa806e710 0x7fbfa8158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.055+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 >> 172.21.15.7:0/1044315773 conn(0x7fbfa806bc70 msgr2=0x7fbfa80b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.056+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 shutdown_connections 2024-08-19T00:49:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.056+0000 7fbfade00640 1 -- 172.21.15.7:0/1044315773 wait complete. 2024-08-19T00:49:22.074 INFO:tasks.ceph:Scrubbing osd.2 2024-08-19T00:49:22.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:22.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.233+0000 7f32a8e00640 1 Processor -- start 2024-08-19T00:49:22.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.233+0000 7f32a8e00640 1 -- start start 2024-08-19T00:49:22.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a8e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32a4162d40 0x7f32a40d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d1120 0x7f32a40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a8e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a4163120 con 0x7f32a40d4ff0 2024-08-19T00:49:22.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a8e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f32a40d1700 con 0x7f32a4162d40 2024-08-19T00:49:22.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32a40d25d0 con 0x7f32a40d1120 2024-08-19T00:49:22.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f32a4162d40 0x7f32a40d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a1400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f32a40d4ff0 0x7f32a40d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36314/0 (socket says 172.21.15.7:36314) 2024-08-19T00:49:22.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a1400640 1 -- 172.21.15.7:0/2557035853 learned_addr learned my addr 172.21.15.7:0/2557035853 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:22.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.234+0000 7f32a2800640 1 --2- 172.21.15.7:0/2557035853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d1120 0x7f32a40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.235+0000 7f32a1e00640 1 -- 172.21.15.7:0/2557035853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d1120 msgr2=0x7f32a40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.235+0000 7f32a0a00640 1 -- 172.21.15.7:0/2557035853 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052311306 0 0) 0x7f32a4163120 con 0x7f32a40d4ff0 2024-08-19T00:49:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.235+0000 7f32a1e00640 1 --2- 172.21.15.7:0/2557035853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d1120 0x7f32a40ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.235+0000 7f32a1e00640 1 -- 172.21.15.7:0/2557035853 >> v1:172.21.15.7:6789/0 conn(0x7f32a40d4ff0 legacy=0x7f32a40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.235+0000 7f32a1e00640 1 -- 172.21.15.7:0/2557035853 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a40b4fa0 con 0x7f32a4162d40 2024-08-19T00:49:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.236+0000 7f32a1e00640 1 --2- 172.21.15.7:0/2557035853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40d1f60 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f32940097a0 tx=0x7f329402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc88f3b4344ef052 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.236+0000 7f32a0a00640 1 -- 172.21.15.7:0/2557035853 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294037070 con 0x7f32a4162d40 2024-08-19T00:49:22.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.236+0000 7f32a0a00640 1 -- 172.21.15.7:0/2557035853 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329402ae50 con 0x7f32a4162d40 2024-08-19T00:49:22.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.236+0000 7f32a0a00640 1 -- 172.21.15.7:0/2557035853 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294032660 con 0x7f32a4162d40 2024-08-19T00:49:22.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 -- 172.21.15.7:0/2557035853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 msgr2=0x7f32a40d1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 --2- 172.21.15.7:0/2557035853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40d1f60 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f32940097a0 tx=0x7f329402a100 comp rx=0 tx=0).stop 2024-08-19T00:49:22.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 -- 172.21.15.7:0/2557035853 shutdown_connections 2024-08-19T00:49:22.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 --2- 172.21.15.7:0/2557035853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d1120 0x7f32a40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 --2- 172.21.15.7:0/2557035853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40d1f60 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 -- 172.21.15.7:0/2557035853 >> 172.21.15.7:0/2557035853 conn(0x7f32a409d6f0 msgr2=0x7f32a40d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:22.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 -- 172.21.15.7:0/2557035853 shutdown_connections 2024-08-19T00:49:22.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.237+0000 7f32a8e00640 1 -- 172.21.15.7:0/2557035853 wait complete. 2024-08-19T00:49:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.239+0000 7f32a8e00640 1 Processor -- start 2024-08-19T00:49:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.239+0000 7f32a8e00640 1 -- start start 2024-08-19T00:49:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32a40d1120 0x7f32a40ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d4ff0 0x7f32a40cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a8e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40b56e0 con 0x7f32a4162d40 2024-08-19T00:49:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40b5560 con 0x7f32a40d1120 2024-08-19T00:49:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a8e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32a40cf3e0 con 0x7f32a40d4ff0 2024-08-19T00:49:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45830/0 (socket says 172.21.15.7:45830) 2024-08-19T00:49:22.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 -- 172.21.15.7:0/2799246353 learned_addr learned my addr 172.21.15.7:0/2799246353 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a1400640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d4ff0 0x7f32a40cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a1e00640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32a40d1120 0x7f32a40ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 -- 172.21.15.7:0/2799246353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d4ff0 msgr2=0x7f32a40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32a40d4ff0 0x7f32a40cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 -- 172.21.15.7:0/2799246353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32a40d1120 msgr2=0x7f32a40ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32a40d1120 0x7f32a40ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.240+0000 7f32a2800640 1 -- 172.21.15.7:0/2799246353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a40ce2f0 con 0x7f32a4162d40 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.241+0000 7f32a1e00640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32a40d1120 0x7f32a40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.241+0000 7f32a2800640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40cc050 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f329c00ef90 tx=0x7f329c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.241+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c018020 con 0x7f32a4162d40 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.241+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c014480 con 0x7f32a4162d40 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.241+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c014870 con 0x7f32a4162d40 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.241+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a40ce5d0 con 0x7f32a4162d40 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.241+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a40ca480 con 0x7f32a4162d40 2024-08-19T00:49:22.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.242+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32a4154680 con 0x7f32a4162d40 2024-08-19T00:49:22.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.243+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f329c005d10 con 0x7f32a4162d40 2024-08-19T00:49:22.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.244+0000 7f329a000640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f328406be30 0x7f328406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.244+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f329c08bb40 con 0x7f32a4162d40 2024-08-19T00:49:22.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.244+0000 7f329a000640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f3284071d90 0x7f32840741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.244+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f329c00be50 con 0x7f3284071d90 2024-08-19T00:49:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.244+0000 7f32a1e00640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f328406be30 0x7f328406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.244+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7f329c0902a0 con 0x7f32a4162d40 2024-08-19T00:49:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.245+0000 7f32a1400640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f3284071d90 0x7f32840741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.245+0000 7f32a1e00640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f328406be30 0x7f328406e2f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3294034000 tx=0x7f329402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.245+0000 7f32a1400640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f3284071d90 0x7f32840741b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.246+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== osd.2 v2:172.21.15.7:6816/3897722247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f329c00be50 con 0x7f3284071d90 2024-08-19T00:49:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.259+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 --> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f32a40ceea0 con 0x7f3284071d90 2024-08-19T00:49:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.259+0000 7f329a000640 1 -- 172.21.15.7:0/2799246353 <== osd.2 v2:172.21.15.7:6816/3897722247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f32a40ceea0 con 0x7f3284071d90 2024-08-19T00:49:22.263 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:22.263 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f3284071d90 msgr2=0x7f32840741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6816/3897722247,v1:172.21.15.7:6817/3897722247] conn(0x7f3284071d90 0x7f32840741b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f328406be30 msgr2=0x7f328406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f328406be30 0x7f328406e2f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3294034000 tx=0x7f329402e000 comp rx=0 tx=0).stop 2024-08-19T00:49:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 msgr2=0x7f32a40cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 --2- 172.21.15.7:0/2799246353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32a4162d40 0x7f32a40cc050 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f329c00ef90 tx=0x7f329c00c490 comp rx=0 tx=0).stop 2024-08-19T00:49:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a2800640 1 -- 172.21.15.7:0/2799246353 reap_dead start 2024-08-19T00:49:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 shutdown_connections 2024-08-19T00:49:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 >> 172.21.15.7:0/2799246353 conn(0x7f32a409d6f0 msgr2=0x7f32a40b93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 shutdown_connections 2024-08-19T00:49:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.260+0000 7f32a8e00640 1 -- 172.21.15.7:0/2799246353 wait complete. 2024-08-19T00:49:22.278 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-19T00:49:22.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.433+0000 7f5a4da00640 1 Processor -- start 2024-08-19T00:49:22.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.434+0000 7f5a4da00640 1 -- start start 2024-08-19T00:49:22.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a4da00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a480d03c0 0x7f5a48071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a4da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480b3750 0x7f5a480cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a4da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a480cdfb0 con 0x7f5a4806e710 2024-08-19T00:49:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a4da00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5a480cebc0 con 0x7f5a480d03c0 2024-08-19T00:49:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a4da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a480ce290 con 0x7f5a480b3750 2024-08-19T00:49:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a46a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a480d03c0 0x7f5a48071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a46a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a480d03c0 0x7f5a48071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45840/0 (socket says 172.21.15.7:45840) 2024-08-19T00:49:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a3e000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5a4806e710 0x7f5a480d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36326/0 (socket says 172.21.15.7:36326) 2024-08-19T00:49:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a46a00640 1 -- 172.21.15.7:0/1115524959 learned_addr learned my addr 172.21.15.7:0/1115524959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a46a00640 1 -- 172.21.15.7:0/1115524959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480b3750 msgr2=0x7f5a480cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a47400640 1 --2- 172.21.15.7:0/1115524959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480b3750 0x7f5a480cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a46a00640 1 --2- 172.21.15.7:0/1115524959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480b3750 0x7f5a480cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.435+0000 7f5a46a00640 1 -- 172.21.15.7:0/1115524959 >> v1:172.21.15.7:6789/0 conn(0x7f5a4806e710 legacy=0x7f5a480d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.436+0000 7f5a46a00640 1 -- 172.21.15.7:0/1115524959 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a480ce570 con 0x7f5a480d03c0 2024-08-19T00:49:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.436+0000 7f5a47400640 1 --2- 172.21.15.7:0/1115524959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480b3750 0x7f5a480cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.436+0000 7f5a46a00640 1 --2- 172.21.15.7:0/1115524959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a480d03c0 0x7f5a48071980 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f5a380098a0 tx=0x7f5a3802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4787b1ef9d484db3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a46000640 1 -- 172.21.15.7:0/1115524959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38037070 con 0x7f5a480d03c0 2024-08-19T00:49:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a46000640 1 -- 172.21.15.7:0/1115524959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a38032440 con 0x7f5a480d03c0 2024-08-19T00:49:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a46000640 1 -- 172.21.15.7:0/1115524959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38032810 con 0x7f5a480d03c0 2024-08-19T00:49:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a4da00640 1 -- 172.21.15.7:0/1115524959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a480d03c0 msgr2=0x7f5a48071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a4da00640 1 --2- 172.21.15.7:0/1115524959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a480d03c0 0x7f5a48071980 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f5a380098a0 tx=0x7f5a3802a2a0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a4da00640 1 -- 172.21.15.7:0/1115524959 shutdown_connections 2024-08-19T00:49:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a4da00640 1 --2- 172.21.15.7:0/1115524959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480b3750 0x7f5a480cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a4da00640 1 --2- 172.21.15.7:0/1115524959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a480d03c0 0x7f5a48071980 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a4da00640 1 -- 172.21.15.7:0/1115524959 >> 172.21.15.7:0/1115524959 conn(0x7f5a4806bc70 msgr2=0x7f5a4806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.437+0000 7f5a4da00640 1 -- 172.21.15.7:0/1115524959 shutdown_connections 2024-08-19T00:49:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.438+0000 7f5a4da00640 1 -- 172.21.15.7:0/1115524959 wait complete. 2024-08-19T00:49:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.439+0000 7f5a4da00640 1 Processor -- start 2024-08-19T00:49:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.439+0000 7f5a4da00640 1 -- start start 2024-08-19T00:49:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a4da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a4806e710 0x7f5a481f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a4da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a480b3750 0x7f5a4815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a4da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480d03c0 0x7f5a480720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a4da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48073c60 con 0x7f5a4806e710 2024-08-19T00:49:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a4da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48073ae0 con 0x7f5a480b3750 2024-08-19T00:49:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a4da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a480b3be0 con 0x7f5a480d03c0 2024-08-19T00:49:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a46a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a4806e710 0x7f5a481f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a46a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a4806e710 0x7f5a481f39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45846/0 (socket says 172.21.15.7:45846) 2024-08-19T00:49:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.440+0000 7f5a46a00640 1 -- 172.21.15.7:0/3329857194 learned_addr learned my addr 172.21.15.7:0/3329857194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a3e000640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a480b3750 0x7f5a4815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a47400640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480d03c0 0x7f5a480720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a46a00640 1 -- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480d03c0 msgr2=0x7f5a480720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a46a00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480d03c0 0x7f5a480720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a46a00640 1 -- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a480b3750 msgr2=0x7f5a4815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a46a00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a480b3750 0x7f5a4815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a46a00640 1 -- 172.21.15.7:0/3329857194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a480b2180 con 0x7f5a4806e710 2024-08-19T00:49:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a3e000640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a480b3750 0x7f5a4815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a46a00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a4806e710 0x7f5a481f39c0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000c00 tx=0x7f5a380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a3f400640 1 -- 172.21.15.7:0/3329857194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38037040 con 0x7f5a4806e710 2024-08-19T00:49:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a3f400640 1 -- 172.21.15.7:0/3329857194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a38042070 con 0x7f5a4806e710 2024-08-19T00:49:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.441+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a480b2460 con 0x7f5a4806e710 2024-08-19T00:49:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.442+0000 7f5a3f400640 1 -- 172.21.15.7:0/3329857194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38030bd0 con 0x7f5a4806e710 2024-08-19T00:49:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.442+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a480ca560 con 0x7f5a4806e710 2024-08-19T00:49:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.443+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48071980 con 0x7f5a4806e710 2024-08-19T00:49:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.444+0000 7f5a3f400640 1 -- 172.21.15.7:0/3329857194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a38047460 con 0x7f5a4806e710 2024-08-19T00:49:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.444+0000 7f5a3f400640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5a2406be30 0x7f5a2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.444+0000 7f5a3f400640 1 -- 172.21.15.7:0/3329857194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f5a380ab820 con 0x7f5a4806e710 2024-08-19T00:49:22.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.445+0000 7f5a3e000640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5a2406be30 0x7f5a2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.445+0000 7f5a3e000640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5a2406be30 0x7f5a2406e2f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5a30007fd0 tx=0x7f5a30007d60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.449+0000 7f5a3f400640 1 -- 172.21.15.7:0/3329857194 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5a38045360 con 0x7f5a4806e710 2024-08-19T00:49:22.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.636+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5a481f3f00 con 0x7f5a2406be30 2024-08-19T00:49:22.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.637+0000 7f5a3f400640 1 -- 172.21.15.7:0/3329857194 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5a481f3f00 con 0x7f5a2406be30 2024-08-19T00:49:22.640 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2024-08-19T00:49:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5a2406be30 msgr2=0x7f5a2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5a2406be30 0x7f5a2406e2f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5a30007fd0 tx=0x7f5a30007d60 comp rx=0 tx=0).stop 2024-08-19T00:49:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a4806e710 msgr2=0x7f5a481f39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a4806e710 0x7f5a481f39c0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000c00 tx=0x7f5a380046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 shutdown_connections 2024-08-19T00:49:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f5a2406be30 0x7f5a2406e2f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a480d03c0 0x7f5a480720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a480b3750 0x7f5a4815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 --2- 172.21.15.7:0/3329857194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a4806e710 0x7f5a481f39c0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 >> 172.21.15.7:0/3329857194 conn(0x7f5a4806bc70 msgr2=0x7f5a480b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 shutdown_connections 2024-08-19T00:49:22.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.639+0000 7f5a4da00640 1 -- 172.21.15.7:0/3329857194 wait complete. 2024-08-19T00:49:22.658 INFO:tasks.ceph:Scrubbing osd.3 2024-08-19T00:49:22.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:22.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.817+0000 7feacea00640 1 Processor -- start 2024-08-19T00:49:22.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.818+0000 7feacea00640 1 -- start start 2024-08-19T00:49:22.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac815c0e0 0x7feac80719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feac8071ee0 0x7feac8164d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac806fa10 con 0x7feac815bd00 2024-08-19T00:49:22.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacea00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7feac8072350 con 0x7feac8071ee0 2024-08-19T00:49:22.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feac815c540 con 0x7feac815c0e0 2024-08-19T00:49:22.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feac8071ee0 0x7feac8164d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feac8071ee0 0x7feac8164d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45850/0 (socket says 172.21.15.7:45850) 2024-08-19T00:49:22.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.819+0000 7feacca00640 1 -- 172.21.15.7:0/804581159 learned_addr learned my addr 172.21.15.7:0/804581159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:22.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.820+0000 7feabf400640 1 --2- 172.21.15.7:0/804581159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac815c0e0 0x7feac80719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.820+0000 7feacca00640 1 -- 172.21.15.7:0/804581159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac815c0e0 msgr2=0x7feac80719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.820+0000 7feacca00640 1 --2- 172.21.15.7:0/804581159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac815c0e0 0x7feac80719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.820+0000 7feacca00640 1 -- 172.21.15.7:0/804581159 >> v1:172.21.15.162:6789/0 conn(0x7feac815bd00 legacy=0x7feac80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.820+0000 7feacca00640 1 -- 172.21.15.7:0/804581159 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac80ce6f0 con 0x7feac8071ee0 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.821+0000 7feacca00640 1 --2- 172.21.15.7:0/804581159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac8071ee0 0x7feac8164d20 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7feac0009e80 tx=0x7feac002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74c72d2fadde2ca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.821+0000 7feac7400640 1 -- 172.21.15.7:0/804581159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac0036070 con 0x7feac8071ee0 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.821+0000 7feac7400640 1 -- 172.21.15.7:0/804581159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac0031600 con 0x7feac8071ee0 2024-08-19T00:49:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.821+0000 7feac7400640 1 -- 172.21.15.7:0/804581159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac00319d0 con 0x7feac8071ee0 2024-08-19T00:49:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 -- 172.21.15.7:0/804581159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac8071ee0 msgr2=0x7feac8164d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 --2- 172.21.15.7:0/804581159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac8071ee0 0x7feac8164d20 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7feac0009e80 tx=0x7feac002a750 comp rx=0 tx=0).stop 2024-08-19T00:49:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 -- 172.21.15.7:0/804581159 shutdown_connections 2024-08-19T00:49:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 --2- 172.21.15.7:0/804581159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac8071ee0 0x7feac8164d20 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 --2- 172.21.15.7:0/804581159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac815c0e0 0x7feac80719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 -- 172.21.15.7:0/804581159 >> 172.21.15.7:0/804581159 conn(0x7feac806be80 msgr2=0x7feac80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 -- 172.21.15.7:0/804581159 shutdown_connections 2024-08-19T00:49:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.822+0000 7feacea00640 1 -- 172.21.15.7:0/804581159 wait complete. 2024-08-19T00:49:22.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.823+0000 7feacea00640 1 Processor -- start 2024-08-19T00:49:22.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.824+0000 7feacea00640 1 -- start start 2024-08-19T00:49:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.824+0000 7feacea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac8071ee0 0x7feac815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.824+0000 7feacea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac815bd00 0x7feac80b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.824+0000 7feacea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac815c0e0 0x7feac814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feacea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feac80cef90 con 0x7feac815bd00 2024-08-19T00:49:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feacea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feac80cecb0 con 0x7feac815c0e0 2024-08-19T00:49:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feacea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feac80cf270 con 0x7feac8071ee0 2024-08-19T00:49:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac815bd00 0x7feac80b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac815bd00 0x7feac80b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45862/0 (socket says 172.21.15.7:45862) 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 -- 172.21.15.7:0/1168592800 learned_addr learned my addr 172.21.15.7:0/1168592800 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feac7e00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac8071ee0 0x7feac815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 -- 172.21.15.7:0/1168592800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac8071ee0 msgr2=0x7feac815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feac8071ee0 0x7feac815a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 -- 172.21.15.7:0/1168592800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac815c0e0 msgr2=0x7feac814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feacca00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac815c0e0 0x7feac814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac815c0e0 0x7feac814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feabf400640 1 -- 172.21.15.7:0/1168592800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac80afde0 con 0x7feac815bd00 2024-08-19T00:49:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.825+0000 7feacca00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac815c0e0 0x7feac814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.826+0000 7feabf400640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac815bd00 0x7feac80b4df0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7feab000e9b0 tx=0x7feab000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.826+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0017070 con 0x7feac815bd00 2024-08-19T00:49:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.826+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab000c9a0 con 0x7feac815bd00 2024-08-19T00:49:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.826+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab000cd90 con 0x7feac815bd00 2024-08-19T00:49:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.826+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac80b00c0 con 0x7feac815bd00 2024-08-19T00:49:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.826+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac80b0960 con 0x7feac815bd00 2024-08-19T00:49:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.827+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feac80cf790 con 0x7feac815bd00 2024-08-19T00:49:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.828+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feab001a070 con 0x7feac815bd00 2024-08-19T00:49:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.829+0000 7feac4c00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feaa406be30 0x7feaa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.829+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7feab008b060 con 0x7feac815bd00 2024-08-19T00:49:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.829+0000 7feac4c00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7feaa4071d90 0x7feaa40741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.829+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feab001fe50 con 0x7feaa4071d90 2024-08-19T00:49:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.829+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7feab0092050 con 0x7feac815bd00 2024-08-19T00:49:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.829+0000 7feac7e00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feaa406be30 0x7feaa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.829+0000 7feacca00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7feaa4071d90 0x7feaa40741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.830+0000 7feac7e00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feaa406be30 0x7feaa406e2f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7feac815ad20 tx=0x7feab8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.830+0000 7feacca00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7feaa4071d90 0x7feaa40741b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:22.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.831+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== osd.3 v2:172.21.15.7:6818/3221924005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feab001fe50 con 0x7feaa4071d90 2024-08-19T00:49:22.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.844+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 --> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feac809e130 con 0x7feaa4071d90 2024-08-19T00:49:22.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.844+0000 7feac4c00640 1 -- 172.21.15.7:0/1168592800 <== osd.3 v2:172.21.15.7:6818/3221924005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feac809e130 con 0x7feaa4071d90 2024-08-19T00:49:22.847 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:22.848 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:22.848 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:22.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7feaa4071d90 msgr2=0x7feaa40741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6818/3221924005,v1:172.21.15.7:6820/3221924005] conn(0x7feaa4071d90 0x7feaa40741b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:22.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feaa406be30 msgr2=0x7feaa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7feaa406be30 0x7feaa406e2f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7feac815ad20 tx=0x7feab8009040 comp rx=0 tx=0).stop 2024-08-19T00:49:22.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac815bd00 msgr2=0x7feac80b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:22.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 --2- 172.21.15.7:0/1168592800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac815bd00 0x7feac80b4df0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7feab000e9b0 tx=0x7feab000ee70 comp rx=0 tx=0).stop 2024-08-19T00:49:22.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacca00640 1 -- 172.21.15.7:0/1168592800 reap_dead start 2024-08-19T00:49:22.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 shutdown_connections 2024-08-19T00:49:22.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 >> 172.21.15.7:0/1168592800 conn(0x7feac806be80 msgr2=0x7feac815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:22.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 shutdown_connections 2024-08-19T00:49:22.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:22.845+0000 7feacea00640 1 -- 172.21.15.7:0/1168592800 wait complete. 2024-08-19T00:49:22.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-19T00:49:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.019+0000 7fb534800640 1 Processor -- start 2024-08-19T00:49:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.019+0000 7fb534800640 1 -- start start 2024-08-19T00:49:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb534800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb52c0d03c0 0x7fb52c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb534800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb52c06e710 0x7fb52c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb534800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c0d0ce0 con 0x7fb52c0b3750 2024-08-19T00:49:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb534800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb52c0cebc0 con 0x7fb52c06e710 2024-08-19T00:49:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb534800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb52c0cdfb0 con 0x7fb52c0d03c0 2024-08-19T00:49:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb531400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb52c06e710 0x7fb52c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb531400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb52c06e710 0x7fb52c0d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45870/0 (socket says 172.21.15.7:45870) 2024-08-19T00:49:23.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb531400640 1 -- 172.21.15.7:0/3594473684 learned_addr learned my addr 172.21.15.7:0/3594473684 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:23.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb532800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb52c0b3750 0x7fb52c0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36336/0 (socket says 172.21.15.7:36336) 2024-08-19T00:49:23.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.020+0000 7fb531e00640 1 --2- 172.21.15.7:0/3594473684 >> v2:172.21.15.162:3300/0 conn(0x7fb52c0d03c0 0x7fb52c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.021+0000 7fb531400640 1 -- 172.21.15.7:0/3594473684 >> v2:172.21.15.162:3300/0 conn(0x7fb52c0d03c0 msgr2=0x7fb52c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:23.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.021+0000 7fb531400640 1 --2- 172.21.15.7:0/3594473684 >> v2:172.21.15.162:3300/0 conn(0x7fb52c0d03c0 0x7fb52c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.021+0000 7fb531400640 1 -- 172.21.15.7:0/3594473684 >> v1:172.21.15.7:6789/0 conn(0x7fb52c0b3750 legacy=0x7fb52c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.021+0000 7fb531400640 1 -- 172.21.15.7:0/3594473684 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c0ce290 con 0x7fb52c06e710 2024-08-19T00:49:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.022+0000 7fb531400640 1 --2- 172.21.15.7:0/3594473684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c06e710 0x7fb52c0d07a0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009870 tx=0x7fb51c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c6c181407af4fd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.022+0000 7fb530a00640 1 -- 172.21.15.7:0/3594473684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c037070 con 0x7fb52c06e710 2024-08-19T00:49:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.022+0000 7fb530a00640 1 -- 172.21.15.7:0/3594473684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c032440 con 0x7fb52c06e710 2024-08-19T00:49:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.022+0000 7fb530a00640 1 -- 172.21.15.7:0/3594473684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c032810 con 0x7fb52c06e710 2024-08-19T00:49:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 -- 172.21.15.7:0/3594473684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c06e710 msgr2=0x7fb52c0d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 --2- 172.21.15.7:0/3594473684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c06e710 0x7fb52c0d07a0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009870 tx=0x7fb51c02a2a0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 -- 172.21.15.7:0/3594473684 shutdown_connections 2024-08-19T00:49:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 --2- 172.21.15.7:0/3594473684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c06e710 0x7fb52c0d07a0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 --2- 172.21.15.7:0/3594473684 >> v2:172.21.15.162:3300/0 conn(0x7fb52c0d03c0 0x7fb52c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 -- 172.21.15.7:0/3594473684 >> 172.21.15.7:0/3594473684 conn(0x7fb52c06bc70 msgr2=0x7fb52c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 -- 172.21.15.7:0/3594473684 shutdown_connections 2024-08-19T00:49:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.023+0000 7fb534800640 1 -- 172.21.15.7:0/3594473684 wait complete. 2024-08-19T00:49:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.024+0000 7fb534800640 1 Processor -- start 2024-08-19T00:49:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.024+0000 7fb534800640 1 -- start start 2024-08-19T00:49:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.025+0000 7fb534800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb52c06e710 0x7fb52c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.025+0000 7fb534800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c0b3750 0x7fb52c14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.025+0000 7fb534800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52c0d03c0 0x7fb52c09cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.025+0000 7fb534800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c073ae0 con 0x7fb52c0b3750 2024-08-19T00:49:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.025+0000 7fb534800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c0ce850 con 0x7fb52c0d03c0 2024-08-19T00:49:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.025+0000 7fb534800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb52c073c60 con 0x7fb52c06e710 2024-08-19T00:49:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c0b3750 0x7fb52c14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c0b3750 0x7fb52c14f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45876/0 (socket says 172.21.15.7:45876) 2024-08-19T00:49:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 -- 172.21.15.7:0/3682897772 learned_addr learned my addr 172.21.15.7:0/3682897772 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 -- 172.21.15.7:0/3682897772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb52c06e710 msgr2=0x7fb52c159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb52c06e710 0x7fb52c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 -- 172.21.15.7:0/3682897772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52c0d03c0 msgr2=0x7fb52c09cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52c0d03c0 0x7fb52c09cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 -- 172.21.15.7:0/3682897772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c0c5480 con 0x7fb52c0b3750 2024-08-19T00:49:23.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.026+0000 7fb531400640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c0b3750 0x7fb52c14f7b0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fb51c02a2e0 tx=0x7fb51c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.027+0000 7fb526000640 1 -- 172.21.15.7:0/3682897772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c037040 con 0x7fb52c0b3750 2024-08-19T00:49:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.027+0000 7fb526000640 1 -- 172.21.15.7:0/3682897772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c042070 con 0x7fb52c0b3750 2024-08-19T00:49:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.027+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c09c0d0 con 0x7fb52c0b3750 2024-08-19T00:49:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.027+0000 7fb526000640 1 -- 172.21.15.7:0/3682897772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c030880 con 0x7fb52c0b3750 2024-08-19T00:49:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.027+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52c14fcf0 con 0x7fb52c0b3750 2024-08-19T00:49:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.028+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52c0b3bc0 con 0x7fb52c0b3750 2024-08-19T00:49:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.029+0000 7fb526000640 1 -- 172.21.15.7:0/3682897772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb51c030a20 con 0x7fb52c0b3750 2024-08-19T00:49:23.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.031+0000 7fb526000640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb51006be60 0x7fb51006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.031+0000 7fb526000640 1 -- 172.21.15.7:0/3682897772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fb51c0ab4a0 con 0x7fb52c0b3750 2024-08-19T00:49:23.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.031+0000 7fb531e00640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb51006be60 0x7fb51006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.032+0000 7fb531e00640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb51006be60 0x7fb51006e320 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb520006a90 tx=0x7fb520006a20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.035+0000 7fb526000640 1 -- 172.21.15.7:0/3682897772 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb51c07a050 con 0x7fb52c0b3750 2024-08-19T00:49:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.217+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb52c09bea0 con 0x7fb51006be60 2024-08-19T00:49:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.218+0000 7fb526000640 1 -- 172.21.15.7:0/3682897772 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb52c09bea0 con 0x7fb51006be60 2024-08-19T00:49:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 3 to deep-scrub 2024-08-19T00:49:23.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb51006be60 msgr2=0x7fb51006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb51006be60 0x7fb51006e320 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb520006a90 tx=0x7fb520006a20 comp rx=0 tx=0).stop 2024-08-19T00:49:23.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c0b3750 msgr2=0x7fb52c14f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c0b3750 0x7fb52c14f7b0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fb51c02a2e0 tx=0x7fb51c0046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 shutdown_connections 2024-08-19T00:49:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fb51006be60 0x7fb51006e320 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52c0d03c0 0x7fb52c09cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c0b3750 0x7fb52c14f7b0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 --2- 172.21.15.7:0/3682897772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb52c06e710 0x7fb52c159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 >> 172.21.15.7:0/3682897772 conn(0x7fb52c06bc70 msgr2=0x7fb52c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 shutdown_connections 2024-08-19T00:49:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.220+0000 7fb534800640 1 -- 172.21.15.7:0/3682897772 wait complete. 2024-08-19T00:49:23.238 INFO:tasks.ceph:Scrubbing osd.4 2024-08-19T00:49:23.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.397+0000 7f3d33400640 1 Processor -- start 2024-08-19T00:49:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.397+0000 7f3d33400640 1 -- start start 2024-08-19T00:49:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.398+0000 7f3d33400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d2c0b6190 0x7f3d2c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.398+0000 7f3d33400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c0b55a0 0x7f3d2c0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.398+0000 7f3d33400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d2c0b3620 con 0x7f3d2c15c300 2024-08-19T00:49:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.398+0000 7f3d33400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2c0b3900 con 0x7f3d2c0b6190 2024-08-19T00:49:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.398+0000 7f3d33400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c0b0430 con 0x7f3d2c0b55a0 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d2be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d2c0b6190 0x7f3d2c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d2be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d2c0b6190 0x7f3d2c09aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45892/0 (socket says 172.21.15.7:45892) 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d2be00640 1 -- 172.21.15.7:0/2720294993 learned_addr learned my addr 172.21.15.7:0/2720294993 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d31400640 1 --2- 172.21.15.7:0/2720294993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c0b55a0 0x7f3d2c0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d2be00640 1 -- 172.21.15.7:0/2720294993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c0b55a0 msgr2=0x7f3d2c0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d2be00640 1 --2- 172.21.15.7:0/2720294993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c0b55a0 0x7f3d2c0b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d2be00640 1 -- 172.21.15.7:0/2720294993 >> v1:172.21.15.162:6789/0 conn(0x7f3d2c15c300 legacy=0x7f3d2c0b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.399+0000 7f3d2be00640 1 -- 172.21.15.7:0/2720294993 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c0b0710 con 0x7f3d2c0b6190 2024-08-19T00:49:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.400+0000 7f3d2be00640 1 --2- 172.21.15.7:0/2720294993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c09aa70 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009870 tx=0x7f3d1802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5e4117e48fdfba server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.400+0000 7f3d2b400640 1 -- 172.21.15.7:0/2720294993 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18037070 con 0x7f3d2c0b6190 2024-08-19T00:49:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.400+0000 7f3d2b400640 1 -- 172.21.15.7:0/2720294993 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d18032440 con 0x7f3d2c0b6190 2024-08-19T00:49:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.400+0000 7f3d2b400640 1 -- 172.21.15.7:0/2720294993 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18032810 con 0x7f3d2c0b6190 2024-08-19T00:49:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 -- 172.21.15.7:0/2720294993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 msgr2=0x7f3d2c09aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 --2- 172.21.15.7:0/2720294993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c09aa70 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009870 tx=0x7f3d1802a1c0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 -- 172.21.15.7:0/2720294993 shutdown_connections 2024-08-19T00:49:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 --2- 172.21.15.7:0/2720294993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c0b55a0 0x7f3d2c0b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 --2- 172.21.15.7:0/2720294993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c09aa70 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 -- 172.21.15.7:0/2720294993 >> 172.21.15.7:0/2720294993 conn(0x7f3d2c072ff0 msgr2=0x7f3d2c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 -- 172.21.15.7:0/2720294993 shutdown_connections 2024-08-19T00:49:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.401+0000 7f3d33400640 1 -- 172.21.15.7:0/2720294993 wait complete. 2024-08-19T00:49:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.403+0000 7f3d33400640 1 Processor -- start 2024-08-19T00:49:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.403+0000 7f3d33400640 1 -- start start 2024-08-19T00:49:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.403+0000 7f3d33400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2c0b55a0 0x7f3d2c14f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d33400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d33400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c15c300 0x7f3d2c15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d33400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c15c860 con 0x7f3d2c0b6190 2024-08-19T00:49:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d33400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c15c6e0 con 0x7f3d2c0b55a0 2024-08-19T00:49:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d33400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c0b4810 con 0x7f3d2c15c300 2024-08-19T00:49:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c15f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45908/0 (socket says 172.21.15.7:45908) 2024-08-19T00:49:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 -- 172.21.15.7:0/1350508171 learned_addr learned my addr 172.21.15.7:0/1350508171 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 -- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c15c300 msgr2=0x7f3d2c15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d2c15c300 0x7f3d2c15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d30a00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2c0b55a0 0x7f3d2c14f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 -- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2c0b55a0 msgr2=0x7f3d2c14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2c0b55a0 0x7f3d2c14f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d2be00640 1 -- 172.21.15.7:0/1350508171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c156720 con 0x7f3d2c0b6190 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.404+0000 7f3d30a00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2c0b55a0 0x7f3d2c14f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.405+0000 7f3d2be00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c15f1c0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f3d18000c00 tx=0x7f3d180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.405+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18041020 con 0x7f3d2c0b6190 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.405+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d180306c0 con 0x7f3d2c0b6190 2024-08-19T00:49:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.405+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18037040 con 0x7f3d2c0b6190 2024-08-19T00:49:23.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.405+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2c156a00 con 0x7f3d2c0b6190 2024-08-19T00:49:23.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.405+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2c156fc0 con 0x7f3d2c0b6190 2024-08-19T00:49:23.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.406+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d2c154f10 con 0x7f3d2c0b6190 2024-08-19T00:49:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.407+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d18044020 con 0x7f3d2c0b6190 2024-08-19T00:49:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.408+0000 7f3d28c00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d0c06be60 0x7f3d0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.408+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f3d180ab3a0 con 0x7f3d2c0b6190 2024-08-19T00:49:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.408+0000 7f3d30a00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d0c06be60 0x7f3d0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.408+0000 7f3d28c00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f3d0c071dc0 0x7f3d0c0741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.408+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d18033e50 con 0x7f3d0c071dc0 2024-08-19T00:49:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.408+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7f3d180b2050 con 0x7f3d2c0b6190 2024-08-19T00:49:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.409+0000 7f3d31400640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f3d0c071dc0 0x7f3d0c0741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.409+0000 7f3d30a00640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d0c06be60 0x7f3d0c06e320 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3d20000f60 tx=0x7f3d20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.409+0000 7f3d31400640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f3d0c071dc0 0x7f3d0c0741e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.410+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== osd.4 v2:172.21.15.162:6806/2900813997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d18033e50 con 0x7f3d0c071dc0 2024-08-19T00:49:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.424+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 --> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d2c0b42d0 con 0x7f3d0c071dc0 2024-08-19T00:49:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.424+0000 7f3d28c00640 1 -- 172.21.15.7:0/1350508171 <== osd.4 v2:172.21.15.162:6806/2900813997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d2c0b42d0 con 0x7f3d0c071dc0 2024-08-19T00:49:23.427 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:23.427 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:23.428 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:23.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f3d0c071dc0 msgr2=0x7f3d0c0741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.162:6806/2900813997,v1:172.21.15.162:6808/2900813997] conn(0x7f3d0c071dc0 0x7f3d0c0741e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d0c06be60 msgr2=0x7f3d0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f3d0c06be60 0x7f3d0c06e320 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3d20000f60 tx=0x7f3d20009040 comp rx=0 tx=0).stop 2024-08-19T00:49:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 msgr2=0x7f3d2c15f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 --2- 172.21.15.7:0/1350508171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d2c0b6190 0x7f3d2c15f1c0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f3d18000c00 tx=0x7f3d180046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d31400640 1 -- 172.21.15.7:0/1350508171 reap_dead start 2024-08-19T00:49:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 shutdown_connections 2024-08-19T00:49:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 >> 172.21.15.7:0/1350508171 conn(0x7f3d2c072ff0 msgr2=0x7f3d2c0af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 shutdown_connections 2024-08-19T00:49:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.425+0000 7f3d33400640 1 -- 172.21.15.7:0/1350508171 wait complete. 2024-08-19T00:49:23.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-19T00:49:23.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.599+0000 7f6623600640 1 Processor -- start 2024-08-19T00:49:23.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.599+0000 7f6623600640 1 -- start start 2024-08-19T00:49:23.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.600+0000 7f6623600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f661c159bf0 0x7f661c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.600+0000 7f6623600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0739a0 0x7f661c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.601+0000 7f6623600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f661c06f7f0 con 0x7f661c0cea40 2024-08-19T00:49:23.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.601+0000 7f6623600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f661c06f510 con 0x7f661c159bf0 2024-08-19T00:49:23.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.601+0000 7f6623600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f661c072980 con 0x7f661c0739a0 2024-08-19T00:49:23.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.601+0000 7f661be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0739a0 0x7f661c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.601+0000 7f661be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0739a0 0x7f661c0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.7:47874/0 (socket says 172.21.15.7:47874) 2024-08-19T00:49:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.601+0000 7f661be00640 1 -- 172.21.15.7:0/3448616171 learned_addr learned my addr 172.21.15.7:0/3448616171 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.601+0000 7f6620c00640 1 --2- 172.21.15.7:0/3448616171 >> v2:172.21.15.162:3300/0 conn(0x7f661c159bf0 0x7f661c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.602+0000 7f661be00640 1 -- 172.21.15.7:0/3448616171 >> v2:172.21.15.162:3300/0 conn(0x7f661c159bf0 msgr2=0x7f661c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.602+0000 7f661be00640 1 --2- 172.21.15.7:0/3448616171 >> v2:172.21.15.162:3300/0 conn(0x7f661c159bf0 0x7f661c073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.602+0000 7f661be00640 1 -- 172.21.15.7:0/3448616171 >> v1:172.21.15.162:6789/0 conn(0x7f661c0cea40 legacy=0x7f661c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.602+0000 7f661be00640 1 -- 172.21.15.7:0/3448616171 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661c072c60 con 0x7f661c0739a0 2024-08-19T00:49:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.603+0000 7f661be00640 1 --2- 172.21.15.7:0/3448616171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0739a0 0x7f661c0ce500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6608009870 tx=0x7f660802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c034affc054c287d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.603+0000 7f661b400640 1 -- 172.21.15.7:0/3448616171 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608037070 con 0x7f661c0739a0 2024-08-19T00:49:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.603+0000 7f661b400640 1 -- 172.21.15.7:0/3448616171 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6608032440 con 0x7f661c0739a0 2024-08-19T00:49:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.603+0000 7f661b400640 1 -- 172.21.15.7:0/3448616171 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608032810 con 0x7f661c0739a0 2024-08-19T00:49:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.603+0000 7f6623600640 1 -- 172.21.15.7:0/3448616171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0739a0 msgr2=0x7f661c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.603+0000 7f6623600640 1 --2- 172.21.15.7:0/3448616171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0739a0 0x7f661c0ce500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6608009870 tx=0x7f660802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.604+0000 7f6623600640 1 -- 172.21.15.7:0/3448616171 shutdown_connections 2024-08-19T00:49:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.604+0000 7f6623600640 1 --2- 172.21.15.7:0/3448616171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0739a0 0x7f661c0ce500 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.604+0000 7f6623600640 1 --2- 172.21.15.7:0/3448616171 >> v2:172.21.15.162:3300/0 conn(0x7f661c159bf0 0x7f661c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.604+0000 7f6623600640 1 -- 172.21.15.7:0/3448616171 >> 172.21.15.7:0/3448616171 conn(0x7f661c06bc70 msgr2=0x7f661c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.604+0000 7f6623600640 1 -- 172.21.15.7:0/3448616171 shutdown_connections 2024-08-19T00:49:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.604+0000 7f6623600640 1 -- 172.21.15.7:0/3448616171 wait complete. 2024-08-19T00:49:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.605+0000 7f6623600640 1 Processor -- start 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.605+0000 7f6623600640 1 -- start start 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.606+0000 7f6623600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661c0739a0 0x7f661c1f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.606+0000 7f6623600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0cea40 0x7f661c0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.606+0000 7f6623600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661c159bf0 0x7f661c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.606+0000 7f6623600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f661c15a150 con 0x7f661c0739a0 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.606+0000 7f6623600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f661c159fd0 con 0x7f661c159bf0 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.606+0000 7f6623600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f661c0d0ad0 con 0x7f661c0cea40 2024-08-19T00:49:23.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.606+0000 7f6620c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661c0739a0 0x7f661c1f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661c0739a0 0x7f661c1f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45914/0 (socket says 172.21.15.7:45914) 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 -- 172.21.15.7:0/1511395258 learned_addr learned my addr 172.21.15.7:0/1511395258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f661be00640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0cea40 0x7f661c0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6621600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661c159bf0 0x7f661c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 -- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0cea40 msgr2=0x7f661c0b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0cea40 0x7f661c0b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 -- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661c159bf0 msgr2=0x7f661c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661c159bf0 0x7f661c0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 -- 172.21.15.7:0/1511395258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661c14bf10 con 0x7f661c0739a0 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6621600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661c159bf0 0x7f661c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6620c00640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661c0739a0 0x7f661c1f34b0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f661000e9e0 tx=0x7f661000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.607+0000 7f6618c00640 1 -- 172.21.15.7:0/1511395258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610017070 con 0x7f661c0739a0 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.608+0000 7f6618c00640 1 -- 172.21.15.7:0/1511395258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661000c9d0 con 0x7f661c0739a0 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.608+0000 7f6618c00640 1 -- 172.21.15.7:0/1511395258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661000cdc0 con 0x7f661c0739a0 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.608+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661c1f3e20 con 0x7f661c0739a0 2024-08-19T00:49:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.608+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661c1f43e0 con 0x7f661c0739a0 2024-08-19T00:49:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.609+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f661c0ce500 con 0x7f661c0739a0 2024-08-19T00:49:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.610+0000 7f6618c00640 1 -- 172.21.15.7:0/1511395258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f661001a070 con 0x7f661c0739a0 2024-08-19T00:49:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.610+0000 7f6618c00640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65fc06be30 0x7f65fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.611+0000 7f6618c00640 1 -- 172.21.15.7:0/1511395258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f661008aff0 con 0x7f661c0739a0 2024-08-19T00:49:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.611+0000 7f661be00640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65fc06be30 0x7f65fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.611+0000 7f661be00640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65fc06be30 0x7f65fc06e2f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6608034000 tx=0x7f660802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.615+0000 7f6618c00640 1 -- 172.21.15.7:0/1511395258 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6610059be0 con 0x7f661c0739a0 2024-08-19T00:49:23.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.802+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f661c06c980 con 0x7f65fc06be30 2024-08-19T00:49:23.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.802+0000 7f6618c00640 1 -- 172.21.15.7:0/1511395258 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f661c06c980 con 0x7f65fc06be30 2024-08-19T00:49:23.805 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 4 to deep-scrub 2024-08-19T00:49:23.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65fc06be30 msgr2=0x7f65fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65fc06be30 0x7f65fc06e2f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6608034000 tx=0x7f660802e000 comp rx=0 tx=0).stop 2024-08-19T00:49:23.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661c0739a0 msgr2=0x7f661c1f34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661c0739a0 0x7f661c1f34b0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f661000e9e0 tx=0x7f661000eea0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 shutdown_connections 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f65fc06be30 0x7f65fc06e2f0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661c159bf0 0x7f661c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661c0cea40 0x7f661c0b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 --2- 172.21.15.7:0/1511395258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f661c0739a0 0x7f661c1f34b0 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 >> 172.21.15.7:0/1511395258 conn(0x7f661c06bc70 msgr2=0x7f661c15e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 shutdown_connections 2024-08-19T00:49:23.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.804+0000 7f6623600640 1 -- 172.21.15.7:0/1511395258 wait complete. 2024-08-19T00:49:23.822 INFO:tasks.ceph:Scrubbing osd.5 2024-08-19T00:49:23.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:23.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.981+0000 7f743f000640 1 Processor -- start 2024-08-19T00:49:23.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.981+0000 7f743f000640 1 -- start start 2024-08-19T00:49:23.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f743f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438073540 0x7f74380cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f743f000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7438160940 0x7f74380cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f743f000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743815d390 con 0x7f743815c740 2024-08-19T00:49:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f743f000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7438072f10 con 0x7f7438160940 2024-08-19T00:49:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f743f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f743815d670 con 0x7f7438073540 2024-08-19T00:49:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f742f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7438160940 0x7f74380cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f7437e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438073540 0x7f74380cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.982+0000 7f743d000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f743815c740 0x7f74380719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.7:52586/0 (socket says 172.21.15.7:52586) 2024-08-19T00:49:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.983+0000 7f743d000640 1 -- 172.21.15.7:0/1896376473 learned_addr learned my addr 172.21.15.7:0/1896376473 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.983+0000 7f7437e00640 1 -- 172.21.15.7:0/1896376473 >> v2:172.21.15.162:3300/0 conn(0x7f7438160940 msgr2=0x7f74380cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.983+0000 7f7437e00640 1 --2- 172.21.15.7:0/1896376473 >> v2:172.21.15.162:3300/0 conn(0x7f7438160940 0x7f74380cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.983+0000 7f7437e00640 1 -- 172.21.15.7:0/1896376473 >> v1:172.21.15.162:6789/0 conn(0x7f743815c740 legacy=0x7f74380719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.983+0000 7f7437e00640 1 -- 172.21.15.7:0/1896376473 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743815fe60 con 0x7f7438073540 2024-08-19T00:49:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.984+0000 7f7437e00640 1 --2- 172.21.15.7:0/1896376473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438073540 0x7f74380cc970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74280097a0 tx=0x7f742802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cabeb96234021cc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.984+0000 7f7437400640 1 -- 172.21.15.7:0/1896376473 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428037070 con 0x7f7438073540 2024-08-19T00:49:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.984+0000 7f7437400640 1 -- 172.21.15.7:0/1896376473 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742802ae50 con 0x7f7438073540 2024-08-19T00:49:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.984+0000 7f7437400640 1 -- 172.21.15.7:0/1896376473 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428032660 con 0x7f7438073540 2024-08-19T00:49:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 -- 172.21.15.7:0/1896376473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438073540 msgr2=0x7f74380cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 --2- 172.21.15.7:0/1896376473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438073540 0x7f74380cc970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74280097a0 tx=0x7f742802a100 comp rx=0 tx=0).stop 2024-08-19T00:49:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 -- 172.21.15.7:0/1896376473 shutdown_connections 2024-08-19T00:49:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 --2- 172.21.15.7:0/1896376473 >> v2:172.21.15.162:3300/0 conn(0x7f7438160940 0x7f74380cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 --2- 172.21.15.7:0/1896376473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438073540 0x7f74380cc970 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 -- 172.21.15.7:0/1896376473 >> 172.21.15.7:0/1896376473 conn(0x7f743806be80 msgr2=0x7f74380b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 -- 172.21.15.7:0/1896376473 shutdown_connections 2024-08-19T00:49:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.985+0000 7f743f000640 1 -- 172.21.15.7:0/1896376473 wait complete. 2024-08-19T00:49:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.987+0000 7f743f000640 1 Processor -- start 2024-08-19T00:49:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.987+0000 7f743f000640 1 -- start start 2024-08-19T00:49:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7438073540 0x7f743814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743815c740 0x7f74381f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743f000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438160940 0x7f7438155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7438073920 con 0x7f743815c740 2024-08-19T00:49:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7438160420 con 0x7f7438073540 2024-08-19T00:49:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743f000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f743815cbf0 con 0x7f7438160940 2024-08-19T00:49:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743815c740 0x7f74381f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743815c740 0x7f74381f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48172/0 (socket says 172.21.15.7:48172) 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 -- 172.21.15.7:0/4046444281 learned_addr learned my addr 172.21.15.7:0/4046444281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743d000640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438160940 0x7f7438155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f7437e00640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7438073540 0x7f743814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 -- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438160940 msgr2=0x7f7438155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438160940 0x7f7438155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 -- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7438073540 msgr2=0x7f743814bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7438073540 0x7f743814bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f742f400640 1 -- 172.21.15.7:0/4046444281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438155be0 con 0x7f743815c740 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f7437e00640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7438073540 0x7f743814bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.988+0000 7f743d000640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7438160940 0x7f7438155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.989+0000 7f742f400640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743815c740 0x7f74381f3040 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f742000e870 tx=0x7f742000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.989+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420017070 con 0x7f743815c740 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.989+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742000c940 con 0x7f743815c740 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.989+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742000cd10 con 0x7f743815c740 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.989+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7438155ec0 con 0x7f743815c740 2024-08-19T00:49:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.989+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74380ce3d0 con 0x7f743815c740 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.990+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7438156100 con 0x7f743815c740 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.991+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f742001a070 con 0x7f743815c740 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.992+0000 7f7434c00640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f741406be30 0x7f741406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.992+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f742008aea0 con 0x7f743815c740 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.992+0000 7f7434c00640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7414071d90 0x7f74140741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.992+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7414074860 con 0x7f7414071d90 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.992+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7f742008d4c0 con 0x7f743815c740 2024-08-19T00:49:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.992+0000 7f7437e00640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f741406be30 0x7f741406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.993+0000 7f743d000640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7414071d90 0x7f74140741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:23.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.993+0000 7f7437e00640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f741406be30 0x7f741406e2f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7428034000 tx=0x7f742802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.993+0000 7f743d000640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7414071d90 0x7f74140741b0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:23.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:23.994+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== osd.5 v2:172.21.15.162:6800/3267745349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7414074860 con 0x7f7414071d90 2024-08-19T00:49:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.008+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 --> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f743815d020 con 0x7f7414071d90 2024-08-19T00:49:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.008+0000 7f7434c00640 1 -- 172.21.15.7:0/4046444281 <== osd.5 v2:172.21.15.162:6800/3267745349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f743815d020 con 0x7f7414071d90 2024-08-19T00:49:24.011 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:24.011 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:24.011 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7414071d90 msgr2=0x7f74140741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.162:6800/3267745349,v1:172.21.15.162:6801/3267745349] conn(0x7f7414071d90 0x7f74140741b0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f741406be30 msgr2=0x7f741406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f741406be30 0x7f741406e2f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7428034000 tx=0x7f742802e000 comp rx=0 tx=0).stop 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743815c740 msgr2=0x7f74381f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 --2- 172.21.15.7:0/4046444281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743815c740 0x7f74381f3040 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f742000e870 tx=0x7f742000ed30 comp rx=0 tx=0).stop 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743d000640 1 -- 172.21.15.7:0/4046444281 reap_dead start 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 shutdown_connections 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 >> 172.21.15.7:0/4046444281 conn(0x7f743806be80 msgr2=0x7f74380cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 shutdown_connections 2024-08-19T00:49:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.009+0000 7f743f000640 1 -- 172.21.15.7:0/4046444281 wait complete. 2024-08-19T00:49:24.026 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-19T00:49:24.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.181+0000 7f2347e00640 1 Processor -- start 2024-08-19T00:49:24.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.181+0000 7f2347e00640 1 -- start start 2024-08-19T00:49:24.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.182+0000 7f2347e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23400ce500 0x7f23400ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.182+0000 7f2347e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f23400d03c0 0x7f23400d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.182+0000 7f2347e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234006f7f0 con 0x7f2340159bf0 2024-08-19T00:49:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2347e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f23400d0d50 con 0x7f23400ce500 2024-08-19T00:49:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2347e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f234006f510 con 0x7f23400d03c0 2024-08-19T00:49:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2344a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23400ce500 0x7f23400ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2345400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2340159bf0 0x7f2340073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35990/0 (socket says 172.21.15.7:35990) 2024-08-19T00:49:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2344a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23400ce500 0x7f23400ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48186/0 (socket says 172.21.15.7:48186) 2024-08-19T00:49:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2345400640 1 -- 172.21.15.7:0/2901337684 learned_addr learned my addr 172.21.15.7:0/2901337684 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2344a00640 1 -- 172.21.15.7:0/2901337684 >> v2:172.21.15.162:3300/0 conn(0x7f23400d03c0 msgr2=0x7f23400d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2344a00640 1 --2- 172.21.15.7:0/2901337684 >> v2:172.21.15.162:3300/0 conn(0x7f23400d03c0 0x7f23400d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2344a00640 1 -- 172.21.15.7:0/2901337684 >> v1:172.21.15.7:6789/0 conn(0x7f2340159bf0 legacy=0x7f2340073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f2344a00640 1 -- 172.21.15.7:0/2901337684 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2340072980 con 0x7f23400ce500 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.183+0000 7f233fe00640 1 -- 172.21.15.7:0/2901337684 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044101499 0 0) 0x7f234006f7f0 con 0x7f2340159bf0 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.184+0000 7f2344a00640 1 --2- 172.21.15.7:0/2901337684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400ce970 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f23400d0fb0 tx=0x7f232c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976e3d062f1a5e41 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.184+0000 7f233fe00640 1 -- 172.21.15.7:0/2901337684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c037070 con 0x7f23400ce500 2024-08-19T00:49:24.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f233fe00640 1 -- 172.21.15.7:0/2901337684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c032440 con 0x7f23400ce500 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f233fe00640 1 -- 172.21.15.7:0/2901337684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c02ae60 con 0x7f23400ce500 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 -- 172.21.15.7:0/2901337684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 msgr2=0x7f23400ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 --2- 172.21.15.7:0/2901337684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400ce970 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f23400d0fb0 tx=0x7f232c02a110 comp rx=0 tx=0).stop 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 -- 172.21.15.7:0/2901337684 shutdown_connections 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 --2- 172.21.15.7:0/2901337684 >> v2:172.21.15.162:3300/0 conn(0x7f23400d03c0 0x7f23400d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 --2- 172.21.15.7:0/2901337684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400ce970 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 -- 172.21.15.7:0/2901337684 >> 172.21.15.7:0/2901337684 conn(0x7f234006bc70 msgr2=0x7f234006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 -- 172.21.15.7:0/2901337684 shutdown_connections 2024-08-19T00:49:24.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.185+0000 7f2347e00640 1 -- 172.21.15.7:0/2901337684 wait complete. 2024-08-19T00:49:24.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.187+0000 7f2347e00640 1 Processor -- start 2024-08-19T00:49:24.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.187+0000 7f2347e00640 1 -- start start 2024-08-19T00:49:24.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2347e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2347e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400d03c0 0x7f234009c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2347e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340159bf0 0x7f23400b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2347e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2340073b70 con 0x7f23400ce500 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2347e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2340072f40 con 0x7f23400d03c0 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2347e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2340159fd0 con 0x7f2340159bf0 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2345400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2345400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48198/0 (socket says 172.21.15.7:48198) 2024-08-19T00:49:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2345400640 1 -- 172.21.15.7:0/2681338497 learned_addr learned my addr 172.21.15.7:0/2681338497 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2344a00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400d03c0 0x7f234009c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2345400640 1 -- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340159bf0 msgr2=0x7f23400b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.188+0000 7f2345e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340159bf0 0x7f23400b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2345400640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340159bf0 0x7f23400b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2345400640 1 -- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400d03c0 msgr2=0x7f234009c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2345400640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400d03c0 0x7f234009c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2345400640 1 -- 172.21.15.7:0/2681338497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400b28f0 con 0x7f23400ce500 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2344a00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400d03c0 0x7f234009c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2345e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340159bf0 0x7f23400b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2345400640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400b4250 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f233400c500 tx=0x7f233400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f233d600640 1 -- 172.21.15.7:0/2681338497 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334018070 con 0x7f23400ce500 2024-08-19T00:49:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f233d600640 1 -- 172.21.15.7:0/2681338497 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2334007580 con 0x7f23400ce500 2024-08-19T00:49:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f233d600640 1 -- 172.21.15.7:0/2681338497 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334004a20 con 0x7f23400ce500 2024-08-19T00:49:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234009bf30 con 0x7f23400ce500 2024-08-19T00:49:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.189+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23400b3490 con 0x7f23400ce500 2024-08-19T00:49:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.190+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23400d0810 con 0x7f23400ce500 2024-08-19T00:49:24.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.191+0000 7f233d600640 1 -- 172.21.15.7:0/2681338497 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2334004bc0 con 0x7f23400ce500 2024-08-19T00:49:24.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.192+0000 7f233d600640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.192+0000 7f233d600640 1 -- 172.21.15.7:0/2681338497 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f2334089eb0 con 0x7f23400ce500 2024-08-19T00:49:24.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.193+0000 7f2344a00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.193+0000 7f2344a00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006be30 0x7f232006e2f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f232c034000 tx=0x7f232c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.196+0000 7f233d600640 1 -- 172.21.15.7:0/2681338497 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2334058a60 con 0x7f23400ce500 2024-08-19T00:49:24.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.382+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f23400008d0 con 0x7f232006be30 2024-08-19T00:49:24.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.383+0000 7f233d600640 1 -- 172.21.15.7:0/2681338497 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23400008d0 con 0x7f232006be30 2024-08-19T00:49:24.385 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 5 to deep-scrub 2024-08-19T00:49:24.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006be30 msgr2=0x7f232006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006be30 0x7f232006e2f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f232c034000 tx=0x7f232c02e000 comp rx=0 tx=0).stop 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 msgr2=0x7f23400b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400b4250 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f233400c500 tx=0x7f233400c9c0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 shutdown_connections 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340159bf0 0x7f23400b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400d03c0 0x7f234009c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 --2- 172.21.15.7:0/2681338497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23400ce500 0x7f23400b4250 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 >> 172.21.15.7:0/2681338497 conn(0x7f234006bc70 msgr2=0x7f234015a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 shutdown_connections 2024-08-19T00:49:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.385+0000 7f2347e00640 1 -- 172.21.15.7:0/2681338497 wait complete. 2024-08-19T00:49:24.404 INFO:tasks.ceph:Scrubbing osd.6 2024-08-19T00:49:24.404 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.561+0000 7f6fb5e00640 1 Processor -- start 2024-08-19T00:49:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.561+0000 7f6fb5e00640 1 -- start start 2024-08-19T00:49:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6fb5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb0073540 0x7f6fb00cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6fb5e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fb015ce50 0x7f6fb00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6fb5e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb015d390 con 0x7f6fb0160940 2024-08-19T00:49:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6fb5e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb0072f10 con 0x7f6fb015ce50 2024-08-19T00:49:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6fb5e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb015d670 con 0x7f6fb0073540 2024-08-19T00:49:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fb015ce50 0x7f6fb00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fb015ce50 0x7f6fb00cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48208/0 (socket says 172.21.15.7:48208) 2024-08-19T00:49:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faf400640 1 -- 172.21.15.7:0/933615763 learned_addr learned my addr 172.21.15.7:0/933615763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faea00640 1 --2- 172.21.15.7:0/933615763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb0073540 0x7f6fb00cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faf400640 1 -- 172.21.15.7:0/933615763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb0073540 msgr2=0x7f6fb00cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faf400640 1 --2- 172.21.15.7:0/933615763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb0073540 0x7f6fb00cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faf400640 1 -- 172.21.15.7:0/933615763 >> v1:172.21.15.162:6789/0 conn(0x7f6fb0160940 legacy=0x7f6fb015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:24.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.563+0000 7f6faf400640 1 -- 172.21.15.7:0/933615763 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb015fe60 con 0x7f6fb015ce50 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.564+0000 7f6faf400640 1 --2- 172.21.15.7:0/933615763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb015ce50 0x7f6fb00cceb0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ac94319dbbf9f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fae000640 1 -- 172.21.15.7:0/933615763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8036070 con 0x7f6fb015ce50 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fae000640 1 -- 172.21.15.7:0/933615763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8031600 con 0x7f6fb015ce50 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fae000640 1 -- 172.21.15.7:0/933615763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80319d0 con 0x7f6fb015ce50 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 -- 172.21.15.7:0/933615763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb015ce50 msgr2=0x7f6fb00cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 --2- 172.21.15.7:0/933615763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb015ce50 0x7f6fb00cceb0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa802a630 comp rx=0 tx=0).stop 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 -- 172.21.15.7:0/933615763 shutdown_connections 2024-08-19T00:49:24.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 --2- 172.21.15.7:0/933615763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb015ce50 0x7f6fb00cceb0 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 --2- 172.21.15.7:0/933615763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb0073540 0x7f6fb00cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 -- 172.21.15.7:0/933615763 >> 172.21.15.7:0/933615763 conn(0x7f6fb006be80 msgr2=0x7f6fb00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 -- 172.21.15.7:0/933615763 shutdown_connections 2024-08-19T00:49:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.565+0000 7f6fb5e00640 1 -- 172.21.15.7:0/933615763 wait complete. 2024-08-19T00:49:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.567+0000 7f6fb5e00640 1 Processor -- start 2024-08-19T00:49:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.567+0000 7f6fb5e00640 1 -- start start 2024-08-19T00:49:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6fb5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fb0073540 0x7f6fb006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6fb5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb015ce50 0x7f6fb006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6fb5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb0160940 0x7f6fb014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6fb5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0073920 con 0x7f6fb0160940 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6fb5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0160420 con 0x7f6fb0073540 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6fb5e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb00b4130 con 0x7f6fb015ce50 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6faf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb0160940 0x7f6fb014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6faf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb0160940 0x7f6fb014b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48214/0 (socket says 172.21.15.7:48214) 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6faf400640 1 -- 172.21.15.7:0/3548440698 learned_addr learned my addr 172.21.15.7:0/3548440698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.568+0000 7f6faea00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fb0073540 0x7f6fb006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6fa6000640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb015ce50 0x7f6fb006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6faf400640 1 -- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb015ce50 msgr2=0x7f6fb006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6faf400640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb015ce50 0x7f6fb006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6faf400640 1 -- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fb0073540 msgr2=0x7f6fb006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6faf400640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fb0073540 0x7f6fb006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6faf400640 1 -- 172.21.15.7:0/3548440698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb009bfe0 con 0x7f6fb0160940 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6fa6000640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fb015ce50 0x7f6fb006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6faf400640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb0160940 0x7f6fb014b3b0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8036050 con 0x7f6fb0160940 2024-08-19T00:49:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8042070 con 0x7f6fb0160940 2024-08-19T00:49:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb006dde0 con 0x7f6fb0160940 2024-08-19T00:49:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.569+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8009510 con 0x7f6fb0160940 2024-08-19T00:49:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.570+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb006e3a0 con 0x7f6fb0160940 2024-08-19T00:49:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.570+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fb015c740 con 0x7f6fb0160940 2024-08-19T00:49:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.571+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fa8007bd0 con 0x7f6fb0160940 2024-08-19T00:49:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.572+0000 7f6fa7e00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f8c06be30 0x7f6f8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.572+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f6fa80abab0 con 0x7f6fb0160940 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.573+0000 7f6fa7e00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f6f8c071d90 0x7f6f8c0741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.573+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f8c074860 con 0x7f6f8c071d90 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.573+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7f6fa80b02a0 con 0x7f6fb0160940 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.573+0000 7f6faea00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f8c06be30 0x7f6f8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.573+0000 7f6fa6000640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f6f8c071d90 0x7f6f8c0741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.573+0000 7f6faea00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f8c06be30 0x7f6f8c06e2f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0006fd0 tx=0x7f6fa0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.574+0000 7f6fa6000640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f6f8c071d90 0x7f6f8c0741b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.575+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== osd.6 v2:172.21.15.162:6816/3414725774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f8c074860 con 0x7f6f8c071d90 2024-08-19T00:49:24.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.589+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 --> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fb00b29c0 con 0x7f6f8c071d90 2024-08-19T00:49:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.589+0000 7f6fa7e00640 1 -- 172.21.15.7:0/3548440698 <== osd.6 v2:172.21.15.162:6816/3414725774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6fb00b29c0 con 0x7f6f8c071d90 2024-08-19T00:49:24.592 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:24.592 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:24.592 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f6f8c071d90 msgr2=0x7f6f8c0741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.162:6816/3414725774,v1:172.21.15.162:6817/3414725774] conn(0x7f6f8c071d90 0x7f6f8c0741b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f8c06be30 msgr2=0x7f6f8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f6f8c06be30 0x7f6f8c06e2f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0006fd0 tx=0x7f6fa0008040 comp rx=0 tx=0).stop 2024-08-19T00:49:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb0160940 msgr2=0x7f6fb014b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 --2- 172.21.15.7:0/3548440698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fb0160940 0x7f6fb014b3b0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa8004a40 comp rx=0 tx=0).stop 2024-08-19T00:49:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6faf400640 1 -- 172.21.15.7:0/3548440698 reap_dead start 2024-08-19T00:49:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 shutdown_connections 2024-08-19T00:49:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 >> 172.21.15.7:0/3548440698 conn(0x7f6fb006be80 msgr2=0x7f6fb00b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 shutdown_connections 2024-08-19T00:49:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.590+0000 7f6fb5e00640 1 -- 172.21.15.7:0/3548440698 wait complete. 2024-08-19T00:49:24.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-19T00:49:24.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.762+0000 7fed10c00640 1 Processor -- start 2024-08-19T00:49:24.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.763+0000 7fed10c00640 1 -- start start 2024-08-19T00:49:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed10c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fed0c15e560 0x7fed0c0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed10c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed0c0cf580 0x7fed0c0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed10c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0c0d53b0 con 0x7fed0c1621b0 2024-08-19T00:49:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed10c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fed0c0d3910 con 0x7fed0c0cf580 2024-08-19T00:49:24.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed10c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fed0c0b6ef0 con 0x7fed0c15e560 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed03e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed0c0cf580 0x7fed0c0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed03e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed0c0cf580 0x7fed0c0cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48216/0 (socket says 172.21.15.7:48216) 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed03e00640 1 -- 172.21.15.7:0/3807007726 learned_addr learned my addr 172.21.15.7:0/3807007726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed09e00640 1 --2- 172.21.15.7:0/3807007726 >> v2:172.21.15.162:3300/0 conn(0x7fed0c15e560 0x7fed0c0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed03e00640 1 -- 172.21.15.7:0/3807007726 >> v2:172.21.15.162:3300/0 conn(0x7fed0c15e560 msgr2=0x7fed0c0b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.764+0000 7fed03e00640 1 --2- 172.21.15.7:0/3807007726 >> v2:172.21.15.162:3300/0 conn(0x7fed0c15e560 0x7fed0c0b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.765+0000 7fed03e00640 1 -- 172.21.15.7:0/3807007726 >> v1:172.21.15.162:6789/0 conn(0x7fed0c1621b0 legacy=0x7fed0c162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.765+0000 7fed03e00640 1 -- 172.21.15.7:0/3807007726 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c0b3710 con 0x7fed0c0cf580 2024-08-19T00:49:24.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.765+0000 7fed09e00640 1 --2- 172.21.15.7:0/3807007726 >> v2:172.21.15.162:3300/0 conn(0x7fed0c15e560 0x7fed0c0b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed03e00640 1 --2- 172.21.15.7:0/3807007726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c0cf580 0x7fed0c0cf9d0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0d1ff0 tx=0x7fecf402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfe477d1617fc46 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed09400640 1 -- 172.21.15.7:0/3807007726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4037070 con 0x7fed0c0cf580 2024-08-19T00:49:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed09400640 1 -- 172.21.15.7:0/3807007726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4032440 con 0x7fed0c0cf580 2024-08-19T00:49:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed09400640 1 -- 172.21.15.7:0/3807007726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4032810 con 0x7fed0c0cf580 2024-08-19T00:49:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed10c00640 1 -- 172.21.15.7:0/3807007726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c0cf580 msgr2=0x7fed0c0cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed10c00640 1 --2- 172.21.15.7:0/3807007726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c0cf580 0x7fed0c0cf9d0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0d1ff0 tx=0x7fecf402a200 comp rx=0 tx=0).stop 2024-08-19T00:49:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed10c00640 1 -- 172.21.15.7:0/3807007726 shutdown_connections 2024-08-19T00:49:24.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed10c00640 1 --2- 172.21.15.7:0/3807007726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c0cf580 0x7fed0c0cf9d0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed10c00640 1 --2- 172.21.15.7:0/3807007726 >> v2:172.21.15.162:3300/0 conn(0x7fed0c15e560 0x7fed0c0b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed10c00640 1 -- 172.21.15.7:0/3807007726 >> 172.21.15.7:0/3807007726 conn(0x7fed0c09d710 msgr2=0x7fed0c0d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:24.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.766+0000 7fed10c00640 1 -- 172.21.15.7:0/3807007726 shutdown_connections 2024-08-19T00:49:24.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.767+0000 7fed10c00640 1 -- 172.21.15.7:0/3807007726 wait complete. 2024-08-19T00:49:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.768+0000 7fed10c00640 1 Processor -- start 2024-08-19T00:49:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.768+0000 7fed10c00640 1 -- start start 2024-08-19T00:49:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed10c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed0c0cf580 0x7fed0c0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed10c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c15e560 0x7fed0c1f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed10c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed0c1621b0 0x7fed0c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed10c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c0cf2c0 con 0x7fed0c15e560 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed10c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c0cff10 con 0x7fed0c1621b0 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed10c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed0c0d4d60 con 0x7fed0c0cf580 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c15e560 0x7fed0c1f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c15e560 0x7fed0c1f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48230/0 (socket says 172.21.15.7:48230) 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.769+0000 7fed03e00640 1 -- 172.21.15.7:0/1867406343 learned_addr learned my addr 172.21.15.7:0/1867406343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:24.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed0a800640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed0c1621b0 0x7fed0c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed09e00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed0c0cf580 0x7fed0c0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed03e00640 1 -- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed0c0cf580 msgr2=0x7fed0c0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed03e00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed0c0cf580 0x7fed0c0c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed03e00640 1 -- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed0c1621b0 msgr2=0x7fed0c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed03e00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed0c1621b0 0x7fed0c0cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed03e00640 1 -- 172.21.15.7:0/1867406343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c1f53e0 con 0x7fed0c15e560 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed0a800640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed0c1621b0 0x7fed0c0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:24.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed03e00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c15e560 0x7fed0c1f4ea0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fecf402a240 tx=0x7fecf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed02000640 1 -- 172.21.15.7:0/1867406343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4041020 con 0x7fed0c15e560 2024-08-19T00:49:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed02000640 1 -- 172.21.15.7:0/1867406343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40306c0 con 0x7fed0c15e560 2024-08-19T00:49:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0c0cb990 con 0x7fed0c15e560 2024-08-19T00:49:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.770+0000 7fed02000640 1 -- 172.21.15.7:0/1867406343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4037040 con 0x7fed0c15e560 2024-08-19T00:49:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.771+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0c0cbf50 con 0x7fed0c15e560 2024-08-19T00:49:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.772+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed0c06d030 con 0x7fed0c15e560 2024-08-19T00:49:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.773+0000 7fed02000640 1 -- 172.21.15.7:0/1867406343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecf4044020 con 0x7fed0c15e560 2024-08-19T00:49:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.773+0000 7fed02000640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece806be30 0x7fece806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.774+0000 7fed02000640 1 -- 172.21.15.7:0/1867406343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fecf40ab400 con 0x7fed0c15e560 2024-08-19T00:49:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.774+0000 7fed09e00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece806be30 0x7fece806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.774+0000 7fed09e00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece806be30 0x7fece806e2f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0b9df0 tx=0x7fecfc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.778+0000 7fed02000640 1 -- 172.21.15.7:0/1867406343 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fecf404b030 con 0x7fed0c15e560 2024-08-19T00:49:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.967+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fed0c0ba4a0 con 0x7fece806be30 2024-08-19T00:49:24.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.968+0000 7fed02000640 1 -- 172.21.15.7:0/1867406343 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fed0c0ba4a0 con 0x7fece806be30 2024-08-19T00:49:24.971 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 6 to deep-scrub 2024-08-19T00:49:24.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece806be30 msgr2=0x7fece806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece806be30 0x7fece806e2f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0b9df0 tx=0x7fecfc008040 comp rx=0 tx=0).stop 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c15e560 msgr2=0x7fed0c1f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c15e560 0x7fed0c1f4ea0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fecf402a240 tx=0x7fecf40046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 shutdown_connections 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fece806be30 0x7fece806e2f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed0c1621b0 0x7fed0c0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed0c15e560 0x7fed0c1f4ea0 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 --2- 172.21.15.7:0/1867406343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed0c0cf580 0x7fed0c0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 >> 172.21.15.7:0/1867406343 conn(0x7fed0c09d710 msgr2=0x7fed0c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.970+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 shutdown_connections 2024-08-19T00:49:24.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:24.971+0000 7fed10c00640 1 -- 172.21.15.7:0/1867406343 wait complete. 2024-08-19T00:49:24.988 INFO:tasks.ceph:Scrubbing osd.7 2024-08-19T00:49:24.989 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-19T00:49:25.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.146+0000 7f73c0800640 1 Processor -- start 2024-08-19T00:49:25.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.146+0000 7f73c0800640 1 -- start start 2024-08-19T00:49:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.147+0000 7f73c0800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f73b8073540 0x7f73b80cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.147+0000 7f73c0800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73b8160940 0x7f73b80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.147+0000 7f73c0800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b815d390 con 0x7f73b815c740 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73c0800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f73b8072f10 con 0x7f73b8160940 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73c0800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f73b815d670 con 0x7f73b8073540 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bd400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73b8160940 0x7f73b80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bd400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73b8160940 0x7f73b80cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48242/0 (socket says 172.21.15.7:48242) 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bd400640 1 -- 172.21.15.7:0/1701730806 learned_addr learned my addr 172.21.15.7:0/1701730806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bde00640 1 --2- 172.21.15.7:0/1701730806 >> v2:172.21.15.162:3300/0 conn(0x7f73b8073540 0x7f73b80cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bd400640 1 -- 172.21.15.7:0/1701730806 >> v2:172.21.15.162:3300/0 conn(0x7f73b8073540 msgr2=0x7f73b80cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bd400640 1 --2- 172.21.15.7:0/1701730806 >> v2:172.21.15.162:3300/0 conn(0x7f73b8073540 0x7f73b80cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bd400640 1 -- 172.21.15.7:0/1701730806 >> v1:172.21.15.162:6789/0 conn(0x7f73b815c740 legacy=0x7f73b815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bd400640 1 -- 172.21.15.7:0/1701730806 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b815fe60 con 0x7f73b8160940 2024-08-19T00:49:25.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.148+0000 7f73bde00640 1 --2- 172.21.15.7:0/1701730806 >> v2:172.21.15.162:3300/0 conn(0x7f73b8073540 0x7f73b80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:25.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.149+0000 7f73bd400640 1 --2- 172.21.15.7:0/1701730806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8160940 0x7f73b80cceb0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f73b806c740 tx=0x7f73a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281d06c9f2de00d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73bca00640 1 -- 172.21.15.7:0/1701730806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8037070 con 0x7f73b8160940 2024-08-19T00:49:25.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73bca00640 1 -- 172.21.15.7:0/1701730806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a8032440 con 0x7f73b8160940 2024-08-19T00:49:25.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73bca00640 1 -- 172.21.15.7:0/1701730806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8032810 con 0x7f73b8160940 2024-08-19T00:49:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 -- 172.21.15.7:0/1701730806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8160940 msgr2=0x7f73b80cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 --2- 172.21.15.7:0/1701730806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8160940 0x7f73b80cceb0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f73b806c740 tx=0x7f73a802a1e0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 -- 172.21.15.7:0/1701730806 shutdown_connections 2024-08-19T00:49:25.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 --2- 172.21.15.7:0/1701730806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8160940 0x7f73b80cceb0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 --2- 172.21.15.7:0/1701730806 >> v2:172.21.15.162:3300/0 conn(0x7f73b8073540 0x7f73b80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 -- 172.21.15.7:0/1701730806 >> 172.21.15.7:0/1701730806 conn(0x7f73b806be80 msgr2=0x7f73b80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:25.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 -- 172.21.15.7:0/1701730806 shutdown_connections 2024-08-19T00:49:25.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.150+0000 7f73c0800640 1 -- 172.21.15.7:0/1701730806 wait complete. 2024-08-19T00:49:25.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.152+0000 7f73c0800640 1 Processor -- start 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.152+0000 7f73c0800640 1 -- start start 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73c0800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73b8073540 0x7f73b809d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73c0800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b815c740 0x7f73b814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73c0800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b8160940 0x7f73b815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73c0800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73b8073920 con 0x7f73b815c740 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73c0800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73b8160420 con 0x7f73b8160940 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73c0800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73b80b4130 con 0x7f73b8073540 2024-08-19T00:49:25.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73bd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b815c740 0x7f73b814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73bd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b815c740 0x7f73b814d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48256/0 (socket says 172.21.15.7:48256) 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73bd400640 1 -- 172.21.15.7:0/3581157329 learned_addr learned my addr 172.21.15.7:0/3581157329 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73bde00640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73b8073540 0x7f73b809d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.153+0000 7f73be800640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b8160940 0x7f73b815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.154+0000 7f73bd400640 1 -- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73b8073540 msgr2=0x7f73b809d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.154+0000 7f73bd400640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73b8073540 0x7f73b809d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.154+0000 7f73bd400640 1 -- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b8160940 msgr2=0x7f73b815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.154+0000 7f73bd400640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b8160940 0x7f73b815e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.154+0000 7f73bd400640 1 -- 172.21.15.7:0/3581157329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b814d6a0 con 0x7f73b815c740 2024-08-19T00:49:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.154+0000 7f73be800640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b8160940 0x7f73b815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.154+0000 7f73bd400640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b815c740 0x7f73b814d160 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f73a802a220 tx=0x7f73a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.155+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8041020 con 0x7f73b815c740 2024-08-19T00:49:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.155+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a80306c0 con 0x7f73b815c740 2024-08-19T00:49:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.155+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8037040 con 0x7f73b815c740 2024-08-19T00:49:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.155+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b809d960 con 0x7f73b815c740 2024-08-19T00:49:25.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.155+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b80cec30 con 0x7f73b815c740 2024-08-19T00:49:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.156+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73b80cf2f0 con 0x7f73b815c740 2024-08-19T00:49:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.157+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73a8044020 con 0x7f73b815c740 2024-08-19T00:49:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73b2000640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f739c06be60 0x7f739c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f73a80ab340 con 0x7f73b815c740 2024-08-19T00:49:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73bde00640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f739c06be60 0x7f739c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73b2000640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f739c071dc0 0x7f739c0741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73a8032440 con 0x7f739c071dc0 2024-08-19T00:49:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=140) ==== 24+0+0 (secure 0 0 0) 0x7f73a80b2050 con 0x7f73b815c740 2024-08-19T00:49:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73be800640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f739c071dc0 0x7f739c0741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.158+0000 7f73bde00640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f739c06be60 0x7f739c06e320 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f73ac006e80 tx=0x7f73ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.159+0000 7f73be800640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f739c071dc0 0x7f739c0741e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.160+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== osd.7 v2:172.21.15.162:6824/4238399288 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73a8032440 con 0x7f739c071dc0 2024-08-19T00:49:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.173+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 --> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f73b815cbb0 con 0x7f739c071dc0 2024-08-19T00:49:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73b2000640 1 -- 172.21.15.7:0/3581157329 <== osd.7 v2:172.21.15.162:6824/4238399288 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f73b815cbb0 con 0x7f739c071dc0 2024-08-19T00:49:25.177 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-19T00:49:25.177 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T00:49:25.177 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-19T00:49:25.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f739c071dc0 msgr2=0x7f739c0741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73c0800640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.162:6824/4238399288,v1:172.21.15.162:6825/4238399288] conn(0x7f739c071dc0 0x7f739c0741e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f739c06be60 msgr2=0x7f739c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73c0800640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f739c06be60 0x7f739c06e320 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f73ac006e80 tx=0x7f73ac008040 comp rx=0 tx=0).stop 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b815c740 msgr2=0x7f73b814d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73c0800640 1 --2- 172.21.15.7:0/3581157329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b815c740 0x7f73b814d160 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f73a802a220 tx=0x7f73a80046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.174+0000 7f73be800640 1 -- 172.21.15.7:0/3581157329 reap_dead start 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.175+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 shutdown_connections 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.175+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 >> 172.21.15.7:0/3581157329 conn(0x7f73b806be80 msgr2=0x7f73b80ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.175+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 shutdown_connections 2024-08-19T00:49:25.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.175+0000 7f73c0800640 1 -- 172.21.15.7:0/3581157329 wait complete. 2024-08-19T00:49:25.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-19T00:49:25.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.346+0000 7f7766800640 1 Processor -- start 2024-08-19T00:49:25.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.346+0000 7f7766800640 1 -- start start 2024-08-19T00:49:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7766800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f77600b0e00 0x7f776015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7766800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77600d0a10 0x7f77600d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7766800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77600cf830 con 0x7f776015e050 2024-08-19T00:49:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7766800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7f77600b1270 con 0x7f77600b0e00 2024-08-19T00:49:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7766800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77600d00d0 con 0x7f77600d0a10 2024-08-19T00:49:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7764a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f77600b0e00 0x7f776015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7764a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f77600b0e00 0x7f776015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48264/0 (socket says 172.21.15.7:48264) 2024-08-19T00:49:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.347+0000 7f7764a00640 1 -- 172.21.15.7:0/3071850962 learned_addr learned my addr 172.21.15.7:0/3071850962 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.348+0000 7f7765e00640 1 --2- 172.21.15.7:0/3071850962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77600d0a10 0x7f77600d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.348+0000 7f7764a00640 1 -- 172.21.15.7:0/3071850962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77600d0a10 msgr2=0x7f77600d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.348+0000 7f7764a00640 1 --2- 172.21.15.7:0/3071850962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77600d0a10 0x7f77600d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.348+0000 7f7764a00640 1 -- 172.21.15.7:0/3071850962 >> v1:172.21.15.162:6789/0 conn(0x7f776015e050 legacy=0x7f77600cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.348+0000 7f7764a00640 1 -- 172.21.15.7:0/3071850962 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77600cfb10 con 0x7f77600b0e00 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.349+0000 7f7764a00640 1 --2- 172.21.15.7:0/3071850962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f776015e430 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f77600d0250 tx=0x7f774c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9955eb134a5516d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.349+0000 7f775fe00640 1 -- 172.21.15.7:0/3071850962 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c037070 con 0x7f77600b0e00 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.349+0000 7f775fe00640 1 -- 172.21.15.7:0/3071850962 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c032440 con 0x7f77600b0e00 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.349+0000 7f775fe00640 1 -- 172.21.15.7:0/3071850962 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c032810 con 0x7f77600b0e00 2024-08-19T00:49:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 -- 172.21.15.7:0/3071850962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 msgr2=0x7f776015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 --2- 172.21.15.7:0/3071850962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f776015e430 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f77600d0250 tx=0x7f774c02a130 comp rx=0 tx=0).stop 2024-08-19T00:49:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 -- 172.21.15.7:0/3071850962 shutdown_connections 2024-08-19T00:49:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 --2- 172.21.15.7:0/3071850962 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77600d0a10 0x7f77600d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 --2- 172.21.15.7:0/3071850962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f776015e430 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 -- 172.21.15.7:0/3071850962 >> 172.21.15.7:0/3071850962 conn(0x7f776009d510 msgr2=0x7f77600d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 -- 172.21.15.7:0/3071850962 shutdown_connections 2024-08-19T00:49:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.350+0000 7f7766800640 1 -- 172.21.15.7:0/3071850962 wait complete. 2024-08-19T00:49:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.351+0000 7f7766800640 1 Processor -- start 2024-08-19T00:49:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.352+0000 7f7766800640 1 -- start start 2024-08-19T00:49:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.352+0000 7f7766800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f77600cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.352+0000 7f7766800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77600d0a10 0x7f776015fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.352+0000 7f7766800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776015e050 0x7f776015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.352+0000 7f7766800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77600d4bf0 con 0x7f77600b0e00 2024-08-19T00:49:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.352+0000 7f7766800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77600d4a70 con 0x7f77600d0a10 2024-08-19T00:49:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.352+0000 7f7766800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77600cf3f0 con 0x7f776015e050 2024-08-19T00:49:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f77600cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f77600cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48274/0 (socket says 172.21.15.7:48274) 2024-08-19T00:49:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 -- 172.21.15.7:0/737662440 learned_addr learned my addr 172.21.15.7:0/737662440 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765e00640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776015e050 0x7f776015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 -- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776015e050 msgr2=0x7f776015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7764a00640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77600d0a10 0x7f776015fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776015e050 0x7f776015ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 -- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77600d0a10 msgr2=0x7f776015fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77600d0a10 0x7f776015fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 -- 172.21.15.7:0/737662440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77600ce090 con 0x7f77600b0e00 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765e00640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776015e050 0x7f776015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:49:25.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.353+0000 7f7765400640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f77600cdb50 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f775400c400 tx=0x7f775400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.354+0000 7f775d600640 1 -- 172.21.15.7:0/737662440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77540052d0 con 0x7f77600b0e00 2024-08-19T00:49:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.354+0000 7f775d600640 1 -- 172.21.15.7:0/737662440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754005490 con 0x7f77600b0e00 2024-08-19T00:49:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.354+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776015cdd0 con 0x7f77600b0e00 2024-08-19T00:49:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.354+0000 7f775d600640 1 -- 172.21.15.7:0/737662440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754007260 con 0x7f77600b0e00 2024-08-19T00:49:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.354+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77600cc550 con 0x7f77600b0e00 2024-08-19T00:49:25.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.355+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f776015e430 con 0x7f77600b0e00 2024-08-19T00:49:25.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.356+0000 7f775d600640 1 -- 172.21.15.7:0/737662440 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7754007400 con 0x7f77600b0e00 2024-08-19T00:49:25.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.357+0000 7f775d600640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f774006be30 0x7f774006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.357+0000 7f775d600640 1 -- 172.21.15.7:0/737662440 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f775408a110 con 0x7f77600b0e00 2024-08-19T00:49:25.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.357+0000 7f7764a00640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f774006be30 0x7f774006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.357+0000 7f7764a00640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f774006be30 0x7f774006e2f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f774c034000 tx=0x7f774c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.361+0000 7f775d600640 1 -- 172.21.15.7:0/737662440 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7754058d50 con 0x7f77600b0e00 2024-08-19T00:49:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.546+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f77600b4ee0 con 0x7f774006be30 2024-08-19T00:49:25.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.546+0000 7f775d600640 1 -- 172.21.15.7:0/737662440 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77600b4ee0 con 0x7f774006be30 2024-08-19T00:49:25.549 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 7 to deep-scrub 2024-08-19T00:49:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f774006be30 msgr2=0x7f774006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f774006be30 0x7f774006e2f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f774c034000 tx=0x7f774c02e000 comp rx=0 tx=0).stop 2024-08-19T00:49:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 msgr2=0x7f77600cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f77600cdb50 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f775400c400 tx=0x7f775400c8c0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 shutdown_connections 2024-08-19T00:49:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f774006be30 0x7f774006e2f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776015e050 0x7f776015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77600d0a10 0x7f776015fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 --2- 172.21.15.7:0/737662440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77600b0e00 0x7f77600cdb50 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 >> 172.21.15.7:0/737662440 conn(0x7f776009d510 msgr2=0x7f77600ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 shutdown_connections 2024-08-19T00:49:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.548+0000 7f7766800640 1 -- 172.21.15.7:0/737662440 wait complete. 2024-08-19T00:49:25.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T00:49:25.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.721+0000 7fe6f1e00640 1 Processor -- start 2024-08-19T00:49:25.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.722+0000 7fe6f1e00640 1 -- start start 2024-08-19T00:49:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6f1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe6ec0d03c0 0x7fe6ec071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6f1e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6f1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6ec0b3750 0x7fe6ec0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6f1e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec0cebc0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6f1e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec0d0ce0 con 0x7fe6ec0d03c0 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6f1e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec0cdfb0 con 0x7fe6ec06e710 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6eb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6ec0b3750 0x7fe6ec0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6eb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6ec0b3750 0x7fe6ec0cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48290/0 (socket says 172.21.15.7:48290) 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6eb400640 1 -- 172.21.15.7:0/3153447073 learned_addr learned my addr 172.21.15.7:0/3153447073 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6e3e00640 1 --2- 172.21.15.7:0/3153447073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.723+0000 7fe6eaa00640 1 --2- 172.21.15.7:0/3153447073 >> v2:172.21.15.162:3300/0 conn(0x7fe6ec0d03c0 0x7fe6ec071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.724+0000 7fe6eb400640 1 -- 172.21.15.7:0/3153447073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 msgr2=0x7fe6ec0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.724+0000 7fe6eb400640 1 --2- 172.21.15.7:0/3153447073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.724+0000 7fe6eb400640 1 -- 172.21.15.7:0/3153447073 >> v2:172.21.15.162:3300/0 conn(0x7fe6ec0d03c0 msgr2=0x7fe6ec071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:49:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.724+0000 7fe6eb400640 1 --2- 172.21.15.7:0/3153447073 >> v2:172.21.15.162:3300/0 conn(0x7fe6ec0d03c0 0x7fe6ec071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.724+0000 7fe6eb400640 1 -- 172.21.15.7:0/3153447073 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec0ce290 con 0x7fe6ec0b3750 2024-08-19T00:49:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.724+0000 7fe6eaa00640 1 --2- 172.21.15.7:0/3153447073 >> v2:172.21.15.162:3300/0 conn(0x7fe6ec0d03c0 0x7fe6ec071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:49:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.725+0000 7fe6eb400640 1 --2- 172.21.15.7:0/3153447073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0cf050 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06f030 tx=0x7fe6e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ab854128c88582 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.725+0000 7fe6ea000640 1 -- 172.21.15.7:0/3153447073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4036070 con 0x7fe6ec0b3750 2024-08-19T00:49:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.725+0000 7fe6ea000640 1 -- 172.21.15.7:0/3153447073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e4031600 con 0x7fe6ec0b3750 2024-08-19T00:49:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.725+0000 7fe6ea000640 1 -- 172.21.15.7:0/3153447073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40319d0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.725+0000 7fe6f1e00640 1 -- 172.21.15.7:0/3153447073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 msgr2=0x7fe6ec0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.725+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/3153447073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0cf050 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06f030 tx=0x7fe6e402a6a0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.725+0000 7fe6f1e00640 1 -- 172.21.15.7:0/3153447073 shutdown_connections 2024-08-19T00:49:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.726+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/3153447073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0cf050 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.726+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/3153447073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.726+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/3153447073 >> v2:172.21.15.162:3300/0 conn(0x7fe6ec0d03c0 0x7fe6ec071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.726+0000 7fe6f1e00640 1 -- 172.21.15.7:0/3153447073 >> 172.21.15.7:0/3153447073 conn(0x7fe6ec06bc70 msgr2=0x7fe6ec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:25.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.726+0000 7fe6f1e00640 1 -- 172.21.15.7:0/3153447073 shutdown_connections 2024-08-19T00:49:25.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.726+0000 7fe6f1e00640 1 -- 172.21.15.7:0/3153447073 wait complete. 2024-08-19T00:49:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.727+0000 7fe6f1e00640 1 Processor -- start 2024-08-19T00:49:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.727+0000 7fe6f1e00640 1 -- start start 2024-08-19T00:49:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.728+0000 7fe6f1e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.728+0000 7fe6f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.728+0000 7fe6f1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6ec0d03c0 0x7fe6ec0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.728+0000 7fe6f1e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec073ae0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.728+0000 7fe6f1e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0ce850 con 0x7fe6ec0d03c0 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.728+0000 7fe6f1e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec073c60 con 0x7fe6ec06e710 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.728+0000 7fe6e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48304/0 (socket says 172.21.15.7:48304) 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 -- 172.21.15.7:0/612182388 learned_addr learned my addr 172.21.15.7:0/612182388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6eaa00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6eb400640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6ec0d03c0 0x7fe6ec0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 -- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 msgr2=0x7fe6ec0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 -- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6ec0d03c0 msgr2=0x7fe6ec0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6ec0d03c0 0x7fe6ec0c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 -- 172.21.15.7:0/612182388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec1f50e0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0caea0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400d800 tx=0x7fe6d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.729+0000 7fe6e3400640 1 -- 172.21.15.7:0/612182388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4018030 con 0x7fe6ec0b3750 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.730+0000 7fe6e3400640 1 -- 172.21.15.7:0/612182388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d40096a0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.730+0000 7fe6e3400640 1 -- 172.21.15.7:0/612182388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4009870 con 0x7fe6ec0b3750 2024-08-19T00:49:25.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.730+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec1f53c0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.730+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec15e720 con 0x7fe6ec0b3750 2024-08-19T00:49:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.731+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec0b3be0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.732+0000 7fe6e3400640 1 -- 172.21.15.7:0/612182388 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6d401b070 con 0x7fe6ec0b3750 2024-08-19T00:49:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.733+0000 7fe6e3400640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6c806be30 0x7fe6c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.733+0000 7fe6e3400640 1 -- 172.21.15.7:0/612182388 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7fe6d408ade0 con 0x7fe6ec0b3750 2024-08-19T00:49:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.733+0000 7fe6eaa00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6c806be30 0x7fe6c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.733+0000 7fe6eaa00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6c806be30 0x7fe6c806e2f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06e2b0 tx=0x7fe6dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:25.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.737+0000 7fe6e3400640 1 -- 172.21.15.7:0/612182388 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe6d4059340 con 0x7fe6ec0b3750 2024-08-19T00:49:25.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.919+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 --> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6ec15c720 con 0x7fe6c806be30 2024-08-19T00:49:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.920+0000 7fe6e3400640 1 -- 172.21.15.7:0/612182388 <== mgr.4113 v2:172.21.15.7:6832/502797190 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7fe6ec15c720 con 0x7fe6c806be30 2024-08-19T00:49:26.087 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-08-19T00:49:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6c806be30 msgr2=0x7fe6c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6c806be30 0x7fe6c806e2f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06e2b0 tx=0x7fe6dc008040 comp rx=0 tx=0).stop 2024-08-19T00:49:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 msgr2=0x7fe6ec0caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0caea0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400d800 tx=0x7fe6d400dcc0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 shutdown_connections 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7fe6c806be30 0x7fe6c806e2f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6ec0d03c0 0x7fe6ec0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0b3750 0x7fe6ec0caea0 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 --2- 172.21.15.7:0/612182388 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6ec06e710 0x7fe6ec0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 >> 172.21.15.7:0/612182388 conn(0x7fe6ec06bc70 msgr2=0x7fe6ec0ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 shutdown_connections 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:25.922+0000 7fe6f1e00640 1 -- 172.21.15.7:0/612182388 wait complete. 2024-08-19T00:49:26.090 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2024-08-19T00:49:25.423352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":285416,"kb_used_data":15176,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754689304,"statfs":{"total":773094113280,"available":772801847296,"internally_reserved":0,"allocated":15540224,"data_stored":8055480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.695199"},"pg_stats":[{"pgid":"1.0","version":"140'119","reported_seq":415,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-08-19T00:49:22.485631+0000","last_change":"2024-08-19T00:49:22.485672+0000","last_active":"2024-08-19T00:49:22.485631+0000","last_peered":"2024-08-19T00:49:22.485631+0000","last_clean":"2024-08-19T00:49:22.485631+0000","last_became_active":"2024-08-19T00:36:53.264918+0000","last_became_peered":"2024-08-19T00:36:53.264918+0000","last_unstale":"2024-08-19T00:49:22.485631+0000","last_undegraded":"2024-08-19T00:49:22.485631+0000","last_fullsized":"2024-08-19T00:49:22.485631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"140'119","last_scrub_stamp":"2024-08-19T00:49:22.485563+0000","last_deep_scrub":"140'119","last_deep_scrub_stamp":"2024-08-19T00:49:22.485563+0000","last_clean_scrub_stamp":"2024-08-19T00:49:22.485563+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:47:53.058037+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41252,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330588,"statfs":{"total":96636764160,"available":96594522112,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37668,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334172,"statfs":{"total":96636764160,"available":96598192128,"internally_reserved":0,"allocated":2387968,"data_stored":1449711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28772,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37668,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334172,"statfs":{"total":96636764160,"available":96598192128,"internally_reserved":0,"allocated":2387968,"data_stored":1449711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1794048,"data_stored":859343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:49:26.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-19T00:49:26.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.243+0000 7f76b7600640 1 Processor -- start 2024-08-19T00:49:26.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.243+0000 7f76b7600640 1 -- start start 2024-08-19T00:49:26.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76b7600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f76b015c390 0x7f76b0166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76b7600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b00acef0 con 0x7f76b015bfb0 2024-08-19T00:49:26.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76b7600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b00ad1d0 con 0x7f76b00b5130 2024-08-19T00:49:26.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76b7600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f76b00ad790 con 0x7f76b015c390 2024-08-19T00:49:26.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76b4c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f76b015bfb0 0x7f76b00b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35992/0 (socket says 172.21.15.7:35992) 2024-08-19T00:49:26.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76b4c00640 1 -- 172.21.15.7:0/1588176200 learned_addr learned my addr 172.21.15.7:0/1588176200 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:26.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76b5600640 1 --2- 172.21.15.7:0/1588176200 >> v2:172.21.15.162:3300/0 conn(0x7f76b015c390 0x7f76b0166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.245+0000 7f76af400640 1 -- 172.21.15.7:0/1588176200 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767374746 0 0) 0x7f76b00acef0 con 0x7f76b015bfb0 2024-08-19T00:49:26.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.246+0000 7f76af400640 1 -- 172.21.15.7:0/1588176200 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7698003520 con 0x7f76b015bfb0 2024-08-19T00:49:26.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.246+0000 7f76b5600640 1 -- 172.21.15.7:0/1588176200 >> v1:172.21.15.162:6789/0 conn(0x7f76b00b5130 legacy=0x7f76b00aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.246+0000 7f76b5600640 1 -- 172.21.15.7:0/1588176200 >> v1:172.21.15.7:6789/0 conn(0x7f76b015bfb0 legacy=0x7f76b00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.246+0000 7f76b5600640 1 -- 172.21.15.7:0/1588176200 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b00ad4b0 con 0x7f76b015c390 2024-08-19T00:49:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.247+0000 7f76b5600640 1 --2- 172.21.15.7:0/1588176200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b015c390 0x7f76b0166dd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ee49218e4efd16 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.247+0000 7f76af400640 1 -- 172.21.15.7:0/1588176200 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8007740 con 0x7f76b015c390 2024-08-19T00:49:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.247+0000 7f76af400640 1 -- 172.21.15.7:0/1588176200 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a80078e0 con 0x7f76b015c390 2024-08-19T00:49:26.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.247+0000 7f76af400640 1 -- 172.21.15.7:0/1588176200 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8007cb0 con 0x7f76b015c390 2024-08-19T00:49:26.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.248+0000 7f76b7600640 1 -- 172.21.15.7:0/1588176200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b015c390 msgr2=0x7f76b0166dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.248+0000 7f76b7600640 1 --2- 172.21.15.7:0/1588176200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b015c390 0x7f76b0166dd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a802a6f0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.248+0000 7f76b7600640 1 -- 172.21.15.7:0/1588176200 shutdown_connections 2024-08-19T00:49:26.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.248+0000 7f76b7600640 1 --2- 172.21.15.7:0/1588176200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b015c390 0x7f76b0166dd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.248+0000 7f76b7600640 1 -- 172.21.15.7:0/1588176200 >> 172.21.15.7:0/1588176200 conn(0x7f76b00b2300 msgr2=0x7f76b006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:26.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.248+0000 7f76b7600640 1 -- 172.21.15.7:0/1588176200 shutdown_connections 2024-08-19T00:49:26.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.248+0000 7f76b7600640 1 -- 172.21.15.7:0/1588176200 wait complete. 2024-08-19T00:49:26.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.250+0000 7f76b7600640 1 Processor -- start 2024-08-19T00:49:26.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.250+0000 7f76b7600640 1 -- start start 2024-08-19T00:49:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b00b5130 0x7f76b0153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b015bfb0 0x7f76b0158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b7600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b015c390 0x7f76b015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b7600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f76b00731d0 con 0x7f76b015bfb0 2024-08-19T00:49:26.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76b0073050 con 0x7f76b00b5130 2024-08-19T00:49:26.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b7600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f76b00af2e0 con 0x7f76b015c390 2024-08-19T00:49:26.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b015bfb0 0x7f76b0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b015bfb0 0x7f76b0158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48306/0 (socket says 172.21.15.7:48306) 2024-08-19T00:49:26.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 -- 172.21.15.7:0/3800727373 learned_addr learned my addr 172.21.15.7:0/3800727373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b4c00640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b00b5130 0x7f76b0153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76b5600640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b015c390 0x7f76b015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 -- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b015c390 msgr2=0x7f76b015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b015c390 0x7f76b015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 -- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b00b5130 msgr2=0x7f76b0153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b00b5130 0x7f76b0153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.251+0000 7f76afe00640 1 -- 172.21.15.7:0/3800727373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b01f4070 con 0x7f76b015bfb0 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.252+0000 7f76afe00640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b015bfb0 0x7f76b0158680 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f769c00c450 tx=0x7f769c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.252+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c0052d0 con 0x7f76b015bfb0 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.252+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c005470 con 0x7f76b015bfb0 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.252+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c012870 con 0x7f76b015bfb0 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.252+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b01f4350 con 0x7f76b015bfb0 2024-08-19T00:49:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.252+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b01f4910 con 0x7f76b015bfb0 2024-08-19T00:49:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.253+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b00aebd0 con 0x7f76b015bfb0 2024-08-19T00:49:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.254+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f769c012a10 con 0x7f76b015bfb0 2024-08-19T00:49:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.255+0000 7f76acc00640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f769006be80 0x7f769006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.255+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7f769c08a780 con 0x7f76b015bfb0 2024-08-19T00:49:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.255+0000 7f76b4c00640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f769006be80 0x7f769006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.256+0000 7f76b4c00640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f769006be80 0x7f769006e340 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f76a40011e0 tx=0x7f76a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.260+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f769c059440 con 0x7f76b015bfb0 2024-08-19T00:49:26.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.443+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f76b015b760 con 0x7f76b015bfb0 2024-08-19T00:49:26.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.446+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7f769c058d40 con 0x7f76b015bfb0 2024-08-19T00:49:26.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.447+0000 7f76acc00640 1 -- 172.21.15.7:0/3800727373 <== mon.0 v2:172.21.15.7:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f769c05d0f0 con 0x7f76b015bfb0 2024-08-19T00:49:26.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f769006be80 msgr2=0x7f769006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f769006be80 0x7f769006e340 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f76a40011e0 tx=0x7f76a4009040 comp rx=0 tx=0).stop 2024-08-19T00:49:26.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b015bfb0 msgr2=0x7f76b0158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b015bfb0 0x7f76b0158680 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f769c00c450 tx=0x7f769c00c910 comp rx=0 tx=0).stop 2024-08-19T00:49:26.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 shutdown_connections 2024-08-19T00:49:26.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7f769006be80 0x7f769006e340 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b015c390 0x7f76b015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b015bfb0 0x7f76b0158680 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 --2- 172.21.15.7:0/3800727373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b00b5130 0x7f76b0153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.449+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 >> 172.21.15.7:0/3800727373 conn(0x7f76b00b2300 msgr2=0x7f76b00b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:26.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.450+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 shutdown_connections 2024-08-19T00:49:26.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.450+0000 7f76b7600640 1 -- 172.21.15.7:0/3800727373 wait complete. 2024-08-19T00:49:26.468 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:49:26.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-19T00:49:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.660+0000 7efd9da00640 1 Processor -- start 2024-08-19T00:49:26.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.660+0000 7efd9da00640 1 -- start start 2024-08-19T00:49:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.661+0000 7efd9da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd9806e710 0x7efd98071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.661+0000 7efd9da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980cdfb0 con 0x7efd980b3750 2024-08-19T00:49:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.661+0000 7efd9da00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980ce290 con 0x7efd980d03c0 2024-08-19T00:49:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.661+0000 7efd9da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd980cebc0 con 0x7efd9806e710 2024-08-19T00:49:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd97400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efd980b3750 0x7efd980cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35994/0 (socket says 172.21.15.7:35994) 2024-08-19T00:49:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd97400640 1 -- 172.21.15.7:0/3016909751 learned_addr learned my addr 172.21.15.7:0/3016909751 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-08-19T00:49:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd8fe00640 1 --2- 172.21.15.7:0/3016909751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd9806e710 0x7efd98071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd96000640 1 -- 172.21.15.7:0/3016909751 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589082971 0 0) 0x7efd980cdfb0 con 0x7efd980b3750 2024-08-19T00:49:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd96000640 1 -- 172.21.15.7:0/3016909751 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd7c005730 con 0x7efd980b3750 2024-08-19T00:49:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd8fe00640 1 -- 172.21.15.7:0/3016909751 >> v1:172.21.15.162:6789/0 conn(0x7efd980d03c0 legacy=0x7efd980d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd96000640 1 -- 172.21.15.7:0/3016909751 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748317051 0 0) 0x7efd980ce290 con 0x7efd980d03c0 2024-08-19T00:49:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd8fe00640 1 -- 172.21.15.7:0/3016909751 >> v1:172.21.15.7:6789/0 conn(0x7efd980b3750 legacy=0x7efd980cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.662+0000 7efd8fe00640 1 -- 172.21.15.7:0/3016909751 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980ce570 con 0x7efd9806e710 2024-08-19T00:49:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd8fe00640 1 --2- 172.21.15.7:0/3016909751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd9806e710 0x7efd98071980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd800097d0 tx=0x7efd8002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea12ebdb582d4230 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd96000640 1 -- 172.21.15.7:0/3016909751 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80037070 con 0x7efd9806e710 2024-08-19T00:49:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd96000640 1 -- 172.21.15.7:0/3016909751 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efd80032440 con 0x7efd9806e710 2024-08-19T00:49:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd96000640 1 -- 172.21.15.7:0/3016909751 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80032830 con 0x7efd9806e710 2024-08-19T00:49:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd9da00640 1 -- 172.21.15.7:0/3016909751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd9806e710 msgr2=0x7efd98071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd9da00640 1 --2- 172.21.15.7:0/3016909751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd9806e710 0x7efd98071980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd800097d0 tx=0x7efd8002a200 comp rx=0 tx=0).stop 2024-08-19T00:49:26.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd9da00640 1 -- 172.21.15.7:0/3016909751 shutdown_connections 2024-08-19T00:49:26.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd9da00640 1 --2- 172.21.15.7:0/3016909751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd9806e710 0x7efd98071980 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd9da00640 1 -- 172.21.15.7:0/3016909751 >> 172.21.15.7:0/3016909751 conn(0x7efd9806bc70 msgr2=0x7efd9806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:26.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.664+0000 7efd9da00640 1 -- 172.21.15.7:0/3016909751 shutdown_connections 2024-08-19T00:49:26.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.665+0000 7efd9da00640 1 -- 172.21.15.7:0/3016909751 wait complete. 2024-08-19T00:49:26.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.666+0000 7efd9da00640 1 Processor -- start 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.666+0000 7efd9da00640 1 -- start start 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd9da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd9806e710 0x7efd9815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd9da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd980b3750 0x7efd98157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd9da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd980d03c0 0x7efd981f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd9da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd98073c60 con 0x7efd980b3750 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd9da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd98073ae0 con 0x7efd9806e710 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd9da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd980b3be0 con 0x7efd980d03c0 2024-08-19T00:49:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd8fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd980b3750 0x7efd98157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd8fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd980b3750 0x7efd98157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48318/0 (socket says 172.21.15.7:48318) 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd8fe00640 1 -- 172.21.15.7:0/1845156524 learned_addr learned my addr 172.21.15.7:0/1845156524 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.667+0000 7efd96a00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd9806e710 0x7efd9815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd97400640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd980d03c0 0x7efd981f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd8fe00640 1 -- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd980d03c0 msgr2=0x7efd981f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd8fe00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd980d03c0 0x7efd981f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd8fe00640 1 -- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd9806e710 msgr2=0x7efd9815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd8fe00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd9806e710 0x7efd9815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd8fe00640 1 -- 172.21.15.7:0/1845156524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9815d6c0 con 0x7efd980b3750 2024-08-19T00:49:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd8fe00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd980b3750 0x7efd98157550 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7efd800097d0 tx=0x7efd800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.668+0000 7efd8ea00640 1 -- 172.21.15.7:0/1845156524 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80037040 con 0x7efd980b3750 2024-08-19T00:49:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.669+0000 7efd8ea00640 1 -- 172.21.15.7:0/1845156524 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efd80004250 con 0x7efd980b3750 2024-08-19T00:49:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.669+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9815d100 con 0x7efd980b3750 2024-08-19T00:49:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.669+0000 7efd8ea00640 1 -- 172.21.15.7:0/1845156524 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80003610 con 0x7efd980b3750 2024-08-19T00:49:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.669+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd981f3e30 con 0x7efd980b3750 2024-08-19T00:49:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.670+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd98071980 con 0x7efd980b3750 2024-08-19T00:49:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.671+0000 7efd8ea00640 1 -- 172.21.15.7:0/1845156524 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd800037b0 con 0x7efd980b3750 2024-08-19T00:49:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.672+0000 7efd8ea00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd7406be30 0x7efd7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.672+0000 7efd8ea00640 1 -- 172.21.15.7:0/1845156524 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5029+0+0 (secure 0 0 0) 0x7efd800ab310 con 0x7efd980b3750 2024-08-19T00:49:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.672+0000 7efd96a00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd7406be30 0x7efd7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.672+0000 7efd96a00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd7406be30 0x7efd7406e2f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7efd88000f60 tx=0x7efd88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.676+0000 7efd8ea00640 1 -- 172.21.15.7:0/1845156524 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efd80041020 con 0x7efd980b3750 2024-08-19T00:49:26.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.896+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd981593a0 con 0x7efd980b3750 2024-08-19T00:49:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.897+0000 7efd8ea00640 1 -- 172.21.15.7:0/1845156524 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 354 v354) ==== 95+0+3918 (secure 0 0 0) 0x7efd800797f0 con 0x7efd980b3750 2024-08-19T00:49:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-19T00:49:26.901 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":354,"btime":"2024-08-19T00:49:11:713644+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/3277534565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3277534565},{"type":"v1","addr":"172.21.15.162:6834","nonce":3277534565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":8342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2355096489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":2355096489},{"type":"v1","addr":"172.21.15.162:6835","nonce":2355096489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":340},{"gid":10461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1880873139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1880873139},{"type":"v1","addr":"172.21.15.7:6836","nonce":1880873139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":341},{"gid":10752,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3086991623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3086991623},{"type":"v1","addr":"172.21.15.7:6837","nonce":3086991623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":354}],"filesystems":[]} 2024-08-19T00:49:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 354 2024-08-19T00:49:26.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd7406be30 msgr2=0x7efd7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd7406be30 0x7efd7406e2f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7efd88000f60 tx=0x7efd88009040 comp rx=0 tx=0).stop 2024-08-19T00:49:26.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd980b3750 msgr2=0x7efd98157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:26.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd980b3750 0x7efd98157550 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7efd800097d0 tx=0x7efd800046c0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 shutdown_connections 2024-08-19T00:49:26.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:6832/502797190,v1:172.21.15.7:6833/502797190] conn(0x7efd7406be30 0x7efd7406e2f0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd980d03c0 0x7efd981f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd980b3750 0x7efd98157550 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 --2- 172.21.15.7:0/1845156524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd9806e710 0x7efd9815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:26.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 >> 172.21.15.7:0/1845156524 conn(0x7efd9806bc70 msgr2=0x7efd980ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:26.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 shutdown_connections 2024-08-19T00:49:26.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-19T00:49:26.899+0000 7efd9da00640 1 -- 172.21.15.7:0/1845156524 wait complete. 2024-08-19T00:49:26.918 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-19T00:49:26.919 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-19T00:49:26.919 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-19T00:49:26.919 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:26.933 INFO:tasks.ceph.mds.a:Stopped 2024-08-19T00:49:26.933 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-19T00:49:26.933 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:26.988 INFO:tasks.ceph.mds.c:Stopped 2024-08-19T00:49:26.988 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-19T00:49:26.988 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.005 INFO:tasks.ceph.mds.b:Stopped 2024-08-19T00:49:27.098 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-19T00:49:27.098 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.115 INFO:tasks.ceph.mds.d:Stopped 2024-08-19T00:49:27.116 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-19T00:49:27.116 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-19T00:49:27.116 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.159 INFO:tasks.ceph.osd.0:Stopped 2024-08-19T00:49:27.159 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-19T00:49:27.159 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.218 INFO:tasks.ceph.osd.1:Stopped 2024-08-19T00:49:27.219 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-19T00:49:27.219 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.267 INFO:tasks.ceph.osd.2:Stopped 2024-08-19T00:49:27.268 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-19T00:49:27.268 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.328 INFO:tasks.ceph.osd.3:Stopped 2024-08-19T00:49:27.329 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-19T00:49:27.329 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.369 INFO:tasks.ceph.osd.4:Stopped 2024-08-19T00:49:27.370 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-19T00:49:27.370 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.420 INFO:tasks.ceph.osd.5:Stopped 2024-08-19T00:49:27.421 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-19T00:49:27.421 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.474 INFO:tasks.ceph.osd.6:Stopped 2024-08-19T00:49:27.549 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-19T00:49:27.549 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.597 INFO:tasks.ceph.osd.7:Stopped 2024-08-19T00:49:27.597 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-19T00:49:27.598 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-19T00:49:27.598 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.667 INFO:tasks.ceph.mgr.y:Stopped 2024-08-19T00:49:27.668 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-19T00:49:27.668 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.731 INFO:tasks.ceph.mgr.x:Stopped 2024-08-19T00:49:27.732 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-19T00:49:27.732 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-19T00:49:27.732 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.754 INFO:tasks.ceph.mon.a:Stopped 2024-08-19T00:49:27.755 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-19T00:49:27.755 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.774 INFO:tasks.ceph.mon.b:Stopped 2024-08-19T00:49:27.774 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-19T00:49:27.774 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:49:27.835 INFO:tasks.ceph.mon.c:Stopped 2024-08-19T00:49:27.835 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-19T00:49:27.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'Error loading MDS rank' | egrep -v 'missing journal object' | egrep -v 'Error recovering journal' | egrep -v 'error decoding table object' | egrep -v 'failed to read JournalPointer' | egrep -v 'Corrupt directory entry' | egrep -v 'Corrupt fnode header' | egrep -v 'corrupt sessionmap header' | egrep -v 'Corrupt dentry' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_READ_ONLY | egrep -v 'force file system read-only' | egrep -v 'with standby daemon mds' | egrep -v 'MDS abort because newly corrupt dentry' | head -n 1 2024-08-19T00:49:27.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:49:27.935 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-19T00:49:28.111 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:49:28.112 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-19T00:49:28.223 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:49:28.223 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-19T00:49:28.333 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:49:28.369 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-19T00:49:28.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:49:28.486 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-19T00:49:28.691 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:49:28.729 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-19T00:49:28.843 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:49:28.843 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-19T00:49:28.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:49:28.951 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-19T00:49:29.125 INFO:tasks.ceph:Archiving mon data... 2024-08-19T00:49:29.127 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/data/mon.a.tgz 2024-08-19T00:49:29.127 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-08-19T00:49:29.166 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.Qq6v53mxRA 2024-08-19T00:49:29.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Qq6v53mxRA 2024-08-19T00:49:29.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.Qq6v53mxRA 2024-08-19T00:49:29.494 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.Qq6v53mxRA is 604KB 2024-08-19T00:49:29.591 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.Qq6v53mxRA 2024-08-19T00:49:29.627 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/data/mon.b.tgz 2024-08-19T00:49:29.628 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-08-19T00:49:29.663 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.lbSO9K4VSX 2024-08-19T00:49:29.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lbSO9K4VSX 2024-08-19T00:49:29.893 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.lbSO9K4VSX 2024-08-19T00:49:30.075 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.lbSO9K4VSX is 622KB 2024-08-19T00:49:30.167 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.lbSO9K4VSX 2024-08-19T00:49:30.202 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/data/mon.c.tgz 2024-08-19T00:49:30.203 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-08-19T00:49:30.279 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.3zsMfP0Kk1 2024-08-19T00:49:30.279 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3zsMfP0Kk1 2024-08-19T00:49:30.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.3zsMfP0Kk1 2024-08-19T00:49:30.590 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.3zsMfP0Kk1 is 622KB 2024-08-19T00:49:30.684 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.3zsMfP0Kk1 2024-08-19T00:49:30.719 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-19T00:49:30.719 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-19T00:49:30.724 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-19T00:49:30.853 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-19T00:49:30.889 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-19T00:49:30.889 INFO:tasks.ceph:Archiving crash dumps... 2024-08-19T00:49:30.905 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/remote/smithi007/crash 2024-08-19T00:49:30.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-19T00:49:33.218 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/remote/smithi162/crash 2024-08-19T00:49:33.700 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-19T00:49:33.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:49:33.706 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-19T00:49:33.761 INFO:tasks.ceph:Shutting down logrotate 2024-08-19T00:49:33.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-19T00:49:33.912 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-19T00:49:33.971 INFO:tasks.ceph:Compressing logs... 2024-08-19T00:49:33.972 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T00:49:33.976 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T00:49:34.029 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65366.log 2024-08-19T00:49:34.030 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30095.log 2024-08-19T00:49:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.65366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65366.log.gz 2024-08-19T00:49:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59979.log 2024-08-19T00:49:34.032 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.28815.log 2024-08-19T00:49:34.032 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73560.log 2024-08-19T00:49:34.033 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30095.log.gz 2024-08-19T00:49:34.033 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46577.log 2024-08-19T00:49:34.033 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59979.log.gz 2024-08-19T00:49:34.035 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67637.log 2024-08-19T00:49:34.035 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73560.log.gz 2024-08-19T00:49:34.035 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64971.log 2024-08-19T00:49:34.035 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46577.log.gz 2024-08-19T00:49:34.036 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.28795.log 2024-08-19T00:49:34.036 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.28815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.28815.log.gz 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22580.log 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.28795.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.28795.log.gz 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22700.log 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22580.log.gz 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22700.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-19T00:49:34.037 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.22700.log.gz 2024-08-19T00:49:34.039 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-19T00:49:34.039 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22620.log 2024-08-19T00:49:34.041 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38222.log 2024-08-19T00:49:34.041 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67637.log.gz 2024-08-19T00:49:34.041 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64589.log 2024-08-19T00:49:34.042 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64971.log.gz 2024-08-19T00:49:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54756.log 2024-08-19T00:49:34.042 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38222.log.gz 2024-08-19T00:49:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41901.log 2024-08-19T00:49:34.042 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64589.log.gz 2024-08-19T00:49:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51383.log 2024-08-19T00:49:34.042 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54756.log.gz 2024-08-19T00:49:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31399.log 2024-08-19T00:49:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51383.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.41901.log.gz 2024-08-19T00:49:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27138.log 2024-08-19T00:49:34.043 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51383.log.gz 2024-08-19T00:49:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65785.log 2024-08-19T00:49:34.043 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31399.log.gz 2024-08-19T00:49:34.047 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-19T00:49:34.047 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22620.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-19T00:49:34.047 INFO:teuthology.orchestra.run.smithi162.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.22620.log.gz 2024-08-19T00:49:34.047 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-19T00:49:34.048 INFO:teuthology.orchestra.run.smithi162.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-19T00:49:34.048 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-19T00:49:34.048 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22780.log 2024-08-19T00:49:34.049 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32630.log 2024-08-19T00:49:34.049 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27138.log.gz 2024-08-19T00:49:34.049 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65024.log 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61984.log 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32630.log.gz 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.65785.log.gz 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65024.log.gz 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69661.log 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48170.log: 89.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2024-08-19T00:49:34.050 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45980.log 2024-08-19T00:49:34.051 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.61984.log.gz 2024-08-19T00:49:34.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-08-19T00:49:34.051 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69661.log.gz 2024-08-19T00:49:34.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47541.log 2024-08-19T00:49:34.051 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45980.log.gz 2024-08-19T00:49:34.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2024-08-19T00:49:34.051 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-08-19T00:49:34.063 INFO:teuthology.orchestra.run.smithi162.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-19T00:49:34.063 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22660.log 2024-08-19T00:49:34.063 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22740.log 2024-08-19T00:49:34.063 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7%/var/log/ceph/ceph-client.admin.22660.log: /var/log/ceph/ceph-client.admin.22740.log: -- replaced with /var/log/ceph/ceph-client.admin.22780.log.gz 2024-08-19T00:49:34.063 INFO:teuthology.orchestra.run.smithi162.stderr:gzip 88.2% -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-19T00:49:34.063 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.5.log: -- replaced with /var/log/ceph/ceph-client.admin.22660.log.gz 2024-08-19T00:49:34.063 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22740.log.gz 2024-08-19T00:49:34.064 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-19T00:49:34.064 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.29210.log 2024-08-19T00:49:34.064 INFO:teuthology.orchestra.run.smithi162.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-19T00:49:34.067 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.3.29210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.29210.log.gz 2024-08-19T00:49:34.067 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22500.log 2024-08-19T00:49:34.068 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-19T00:49:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49689.log 2024-08-19T00:49:34.070 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47541.log.gz 2024-08-19T00:49:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71511.log 2024-08-19T00:49:34.070 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2024-08-19T00:49:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.49689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49689.log.gz 2024-08-19T00:49:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63376.log 2024-08-19T00:49:34.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27698.log 2024-08-19T00:49:34.070 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71511.log.gz 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63376.log.gz 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27306.log 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27698.log.gz 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55231.log 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50564.log 2024-08-19T00:49:34.071 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27306.log.gz 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.55231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55231.log.gz 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52360.log 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50564.log.gz 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45415.log 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31949.log 2024-08-19T00:49:34.072 INFO:teuthology.orchestra.run.smithi007.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.52360.log.gz 2024-08-19T00:49:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50994.log 2024-08-19T00:49:34.073 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45415.log.gz 2024-08-19T00:49:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34470.log 2024-08-19T00:49:34.073 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31949.log.gz 2024-08-19T00:49:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49431.log 2024-08-19T00:49:34.073 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50994.log.gz 2024-08-19T00:49:34.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73392.log 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34470.log.gz 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50746.log 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73392.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49431.log.gz 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73392.log.gz 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68421.log 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46535.log 2024-08-19T00:49:34.074 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.50746.log.gz 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31781.log 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68421.log.gz 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39707.log 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46535.log.gz 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31781.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31781.log.gz 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53097.log 2024-08-19T00:49:34.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.39707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38991.log 2024-08-19T00:49:34.076 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39707.log.gz 2024-08-19T00:49:34.080 INFO:teuthology.orchestra.run.smithi162.stderr: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-19T00:49:34.081 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22500.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.22500.log.gz 2024-08-19T00:49:34.081 INFO:teuthology.orchestra.run.smithi162.stderr: -- /var/log/ceph/ceph-client.admin.22540.log/var/log/ceph/ceph-mon.c.log: 2024-08-19T00:49:34.081 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.29214.log 2024-08-19T00:49:34.081 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22540.log.gz 2024-08-19T00:49:34.083 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.29214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.29214.log.gz 2024-08-19T00:49:34.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70355.log 2024-08-19T00:49:34.086 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53097.log.gz 2024-08-19T00:49:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34017.log 2024-08-19T00:49:34.087 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38991.log.gz 2024-08-19T00:49:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40665.log 2024-08-19T00:49:34.087 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70355.log.gz 2024-08-19T00:49:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42552.log 2024-08-19T00:49:34.087 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34017.log.gz 2024-08-19T00:49:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59067.log 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40665.log.gz 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42552.log.gz 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48725.log 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59067.log.gz 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2024-08-19T00:49:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40577.log 2024-08-19T00:49:34.089 INFO:teuthology.orchestra.run.smithi007.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.48725.log.gz 2024-08-19T00:49:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35314.log 2024-08-19T00:49:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40577.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2024-08-19T00:49:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52829.log 2024-08-19T00:49:34.089 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40577.log.gz 2024-08-19T00:49:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56099.log 2024-08-19T00:49:34.089 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35314.log.gz 2024-08-19T00:49:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.52829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52829.log.gz 2024-08-19T00:49:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38739.log 2024-08-19T00:49:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71266.log 2024-08-19T00:49:34.090 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56099.log.gz 2024-08-19T00:49:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56976.log 2024-08-19T00:49:34.090 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38739.log.gz 2024-08-19T00:49:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60637.log 2024-08-19T00:49:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56976.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.71266.log.gz 2024-08-19T00:49:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69283.log 2024-08-19T00:49:34.091 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56976.log.gz 2024-08-19T00:49:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2024-08-19T00:49:34.091 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60637.log.gz 2024-08-19T00:49:34.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60966.log 2024-08-19T00:49:34.091 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69283.log.gz 2024-08-19T00:49:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65178.log 2024-08-19T00:49:34.096 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2024-08-19T00:49:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26894.log 2024-08-19T00:49:34.096 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60966.log.gz 2024-08-19T00:49:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67991.log 2024-08-19T00:49:34.096 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65178.log.gz 2024-08-19T00:49:34.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30053.log 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26894.log.gz 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37175.log 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67991.log.gz 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59143.log 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30053.log.gz 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55925.log 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37175.log.gz 2024-08-19T00:49:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 2024-08-19T00:49:34.098 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59143.log.gz 2024-08-19T00:49:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28031.log 2024-08-19T00:49:34.098 INFO:teuthology.orchestra.run.smithi007.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.55925.log.gz 2024-08-19T00:49:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62288.log 2024-08-19T00:49:34.098 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2024-08-19T00:49:34.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50051.log 2024-08-19T00:49:34.098 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28031.log.gz 2024-08-19T00:49:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54089.log 2024-08-19T00:49:34.102 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62288.log.gz 2024-08-19T00:49:34.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59319.log 2024-08-19T00:49:34.102 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50051.log.gz 2024-08-19T00:49:34.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42678.log 2024-08-19T00:49:34.102 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54089.log.gz 2024-08-19T00:49:34.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33941.log 2024-08-19T00:49:34.102 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59319.log.gz 2024-08-19T00:49:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54477.log 2024-08-19T00:49:34.103 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42678.log.gz 2024-08-19T00:49:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.33941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33941.log.gz 2024-08-19T00:49:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63770.log 2024-08-19T00:49:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58544.log 2024-08-19T00:49:34.103 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54477.log.gz 2024-08-19T00:49:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33265.log 2024-08-19T00:49:34.106 INFO:teuthology.orchestra.run.smithi007.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.63770.log.gz 2024-08-19T00:49:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36603.log 2024-08-19T00:49:34.106 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58544.log.gz 2024-08-19T00:49:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62129.log 2024-08-19T00:49:34.106 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33265.log.gz 2024-08-19T00:49:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54719.log 2024-08-19T00:49:34.106 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36603.log.gz 2024-08-19T00:49:34.107 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39519.log 2024-08-19T00:49:34.107 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62129.log.gz 2024-08-19T00:49:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60924.log 2024-08-19T00:49:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70000.log 2024-08-19T00:49:34.109 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39519.log.gz 2024-08-19T00:49:34.109 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.54719.log.gz 2024-08-19T00:49:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63452.log 2024-08-19T00:49:34.109 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60924.log.gz 2024-08-19T00:49:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48466.log 2024-08-19T00:49:34.109 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70000.log.gz 2024-08-19T00:49:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35710.log 2024-08-19T00:49:34.111 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63452.log.gz 2024-08-19T00:49:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61378.log 2024-08-19T00:49:34.111 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48466.log.gz 2024-08-19T00:49:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31823.log 2024-08-19T00:49:34.113 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35710.log.gz 2024-08-19T00:49:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35752.log 2024-08-19T00:49:34.113 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61378.log.gz 2024-08-19T00:49:34.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62928.log 2024-08-19T00:49:34.113 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31823.log.gz 2024-08-19T00:49:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65370.log 2024-08-19T00:49:34.115 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35752.log.gz 2024-08-19T00:49:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26770.log 2024-08-19T00:49:34.116 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62928.log.gz 2024-08-19T00:49:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.65370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65370.log.gz 2024-08-19T00:49:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2024-08-19T00:49:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53737.log 2024-08-19T00:49:34.117 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.26770.log.gz 2024-08-19T00:49:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66799.log 2024-08-19T00:49:34.118 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2024-08-19T00:49:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49021.log 2024-08-19T00:49:34.118 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53737.log.gz 2024-08-19T00:49:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68075.log 2024-08-19T00:49:34.119 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66799.log.gz 2024-08-19T00:49:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49021.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.49021.log.gz 2024-08-19T00:49:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67799.log 2024-08-19T00:49:34.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67252.log 2024-08-19T00:49:34.121 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68075.log.gz 2024-08-19T00:49:34.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28034.log 2024-08-19T00:49:34.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63494.log 2024-08-19T00:49:34.123 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.67799.log.gz 2024-08-19T00:49:34.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28034.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.67252.log.gz 2024-08-19T00:49:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54812.log 88.5% 2024-08-19T00:49:34.124 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28034.log.gz 2024-08-19T00:49:34.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67892.log 2024-08-19T00:49:34.124 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63494.log.gz 2024-08-19T00:49:34.125 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57846.log 2024-08-19T00:49:34.125 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54812.log.gz 2024-08-19T00:49:34.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64359.log 2024-08-19T00:49:34.127 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67892.log.gz 2024-08-19T00:49:34.127 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60039.log 2024-08-19T00:49:34.127 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57846.log.gz 2024-08-19T00:49:34.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54369.log 2024-08-19T00:49:34.128 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64359.log.gz 2024-08-19T00:49:34.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34073.log 2024-08-19T00:49:34.129 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.60039.log.gz 2024-08-19T00:49:34.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2024-08-19T00:49:34.130 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54369.log.gz 2024-08-19T00:49:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34073.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34073.log.gz 2024-08-19T00:49:34.131 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30985.log 2024-08-19T00:49:34.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.29790.log 2024-08-19T00:49:34.132 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2024-08-19T00:49:34.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62676.log 2024-08-19T00:49:34.133 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30985.log.gz 2024-08-19T00:49:34.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.2.29790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50934.log 2024-08-19T00:49:34.133 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.29790.log.gz 2024-08-19T00:49:34.134 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47652.log 2024-08-19T00:49:34.134 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62676.log.gz 2024-08-19T00:49:34.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64915.log 2024-08-19T00:49:34.135 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50934.log.gz 2024-08-19T00:49:34.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69493.log 2024-08-19T00:49:34.137 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47652.log.gz 2024-08-19T00:49:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35149.log 2024-08-19T00:49:34.137 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64915.log.gz 2024-08-19T00:49:34.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48022.log 2024-08-19T00:49:34.138 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69493.log.gz 2024-08-19T00:49:34.138 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50354.log 2024-08-19T00:49:34.139 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35149.log.gz 2024-08-19T00:49:34.139 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27096.log 2024-08-19T00:49:34.139 INFO:teuthology.orchestra.run.smithi007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48022.log.gz 2024-08-19T00:49:34.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55706.log 2024-08-19T00:49:34.140 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50354.log.gz 2024-08-19T00:49:34.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-08-19T00:49:34.141 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27096.log.gz 2024-08-19T00:49:34.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-08-19T00:49:34.142 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55706.log.gz 2024-08-19T00:49:34.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49497.log 2024-08-19T00:49:34.143 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28030.log 2024-08-19T00:49:34.144 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-08-19T00:49:34.144 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-08-19T00:49:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61026.log 2024-08-19T00:49:34.144 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49497.log.gz 2024-08-19T00:49:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49893.log 2024-08-19T00:49:34.145 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28030.log.gz 2024-08-19T00:49:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61026.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61026.log.gz 2024-08-19T00:49:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49958.log 2024-08-19T00:49:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62886.log 2024-08-19T00:49:34.147 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49893.log.gz 2024-08-19T00:49:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73476.log 2024-08-19T00:49:34.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2024-08-19T00:49:34.149 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62886.log.gz 2024-08-19T00:49:34.149 INFO:teuthology.orchestra.run.smithi007.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.49958.log.gz 2024-08-19T00:49:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-08-19T00:49:34.150 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73476.log.gz 2024-08-19T00:49:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59651.log 2024-08-19T00:49:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43855.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2024-08-19T00:49:34.151 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-08-19T00:49:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60713.log 2024-08-19T00:49:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2024-08-19T00:49:34.152 INFO:teuthology.orchestra.run.smithi007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.59651.log.gz 2024-08-19T00:49:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37943.log 2024-08-19T00:49:34.153 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60713.log.gz 2024-08-19T00:49:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38567.log 2024-08-19T00:49:34.154 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2024-08-19T00:49:34.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45812.log 2024-08-19T00:49:34.155 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37943.log.gz 2024-08-19T00:49:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32793.log 2024-08-19T00:49:34.155 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38567.log.gz 2024-08-19T00:49:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55519.log 2024-08-19T00:49:34.157 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45812.log.gz 2024-08-19T00:49:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70631.log 2024-08-19T00:49:34.157 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32793.log.gz 2024-08-19T00:49:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64536.log 2024-08-19T00:49:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2024-08-19T00:49:34.158 INFO:teuthology.orchestra.run.smithi007.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.55519.log.gz 2024-08-19T00:49:34.159 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70631.log.gz 2024-08-19T00:49:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46365.log 2024-08-19T00:49:34.160 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64536.log.gz 2024-08-19T00:49:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60325.log 2024-08-19T00:49:34.161 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2024-08-19T00:49:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46365.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46365.log.gz 2024-08-19T00:49:34.161 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46703.log 2024-08-19T00:49:34.162 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62540.log 2024-08-19T00:49:34.162 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60325.log.gz 2024-08-19T00:49:34.163 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66757.log 2024-08-19T00:49:34.163 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46703.log.gz 2024-08-19T00:49:34.164 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58680.log 2024-08-19T00:49:34.164 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62540.log.gz 2024-08-19T00:49:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48244.log 2024-08-19T00:49:34.165 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66757.log.gz 2024-08-19T00:49:34.165 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38609.log 2024-08-19T00:49:34.166 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58680.log.gz 2024-08-19T00:49:34.166 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67774.log 2024-08-19T00:49:34.166 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48244.log.gz 2024-08-19T00:49:34.167 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-08-19T00:49:34.167 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38609.log.gz 2024-08-19T00:49:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32329.log 2024-08-19T00:49:34.168 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67774.log.gz 2024-08-19T00:49:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34554.log 2024-08-19T00:49:34.169 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-08-19T00:49:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.32329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.32329.log.gz 2024-08-19T00:49:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28818.log 2024-08-19T00:49:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65761.log 2024-08-19T00:49:34.171 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34554.log.gz 2024-08-19T00:49:34.171 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40941.log 2024-08-19T00:49:34.171 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28818.log.gz 2024-08-19T00:49:34.172 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55495.log 2024-08-19T00:49:34.172 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65761.log.gz 2024-08-19T00:49:34.173 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60535.log 2024-08-19T00:49:34.173 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40941.log.gz 2024-08-19T00:49:34.174 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64719.log 2024-08-19T00:49:34.174 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55495.log.gz 2024-08-19T00:49:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34386.log 2024-08-19T00:49:34.175 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60535.log.gz 2024-08-19T00:49:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59263.log 2024-08-19T00:49:34.176 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64719.log.gz 2024-08-19T00:49:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72131.log 2024-08-19T00:49:34.176 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34386.log.gz 2024-08-19T00:49:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31865.log 2024-08-19T00:49:34.177 INFO:teuthology.orchestra.run.smithi007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.59263.log.gz 2024-08-19T00:49:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49249.log 2024-08-19T00:49:34.179 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72131.log.gz 2024-08-19T00:49:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56435.log 2024-08-19T00:49:34.179 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31865.log.gz 2024-08-19T00:49:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43145.log 2024-08-19T00:49:34.180 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49249.log.gz 2024-08-19T00:49:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42980.log 2024-08-19T00:49:34.181 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56435.log.gz 2024-08-19T00:49:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35794.log 2024-08-19T00:49:34.182 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43145.log.gz 2024-08-19T00:49:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40773.log 2024-08-19T00:49:34.183 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42980.log.gz 2024-08-19T00:49:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31272.log 2024-08-19T00:49:34.183 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35794.log.gz 2024-08-19T00:49:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2024-08-19T00:49:34.184 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40773.log.gz 2024-08-19T00:49:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48540.log 2024-08-19T00:49:34.185 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31272.log.gz 2024-08-19T00:49:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28033.log 2024-08-19T00:49:34.186 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2024-08-19T00:49:34.186 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61420.log 2024-08-19T00:49:34.187 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48540.log.gz 2024-08-19T00:49:34.188 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51735.log 2024-08-19T00:49:34.188 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28033.log.gz 2024-08-19T00:49:34.188 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49995.log 2024-08-19T00:49:34.189 INFO:teuthology.orchestra.run.smithi007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.61420.log.gz 2024-08-19T00:49:34.189 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53971.log 2024-08-19T00:49:34.189 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51735.log.gz 2024-08-19T00:49:34.190 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55664.log 2024-08-19T00:49:34.190 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49995.log.gz 2024-08-19T00:49:34.190 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30359.log 2024-08-19T00:49:34.191 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53971.log.gz 2024-08-19T00:49:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48910.log 2024-08-19T00:49:34.192 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55664.log.gz 2024-08-19T00:49:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54636.log 2024-08-19T00:49:34.192 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30359.log.gz 2024-08-19T00:49:34.193 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58142.log 2024-08-19T00:49:34.193 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48910.log.gz 2024-08-19T00:49:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49189.log 2024-08-19T00:49:34.195 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54636.log.gz 2024-08-19T00:49:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.58142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58142.log.gz 2024-08-19T00:49:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28361.log 2024-08-19T00:49:34.196 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72804.log 2024-08-19T00:49:34.196 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49189.log.gz 2024-08-19T00:49:34.197 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66481.log 2024-08-19T00:49:34.197 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28361.log.gz 2024-08-19T00:49:34.197 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66273.log 2024-08-19T00:49:34.198 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72804.log.gz 2024-08-19T00:49:34.198 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2024-08-19T00:49:34.198 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66481.log.gz 2024-08-19T00:49:34.199 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.66273.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.69199.log -- replaced with /var/log/ceph/ceph-client.0.66273.log.gz 2024-08-19T00:49:34.200 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-08-19T00:49:34.200 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42468.log 2024-08-19T00:49:34.200 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2024-08-19T00:49:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39824.log 2024-08-19T00:49:34.201 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69199.log.gz 2024-08-19T00:49:34.201 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42365.log 2024-08-19T00:49:34.202 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42468.log.gz 2024-08-19T00:49:34.202 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27691.log 2024-08-19T00:49:34.203 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39824.log.gz 2024-08-19T00:49:34.204 INFO:teuthology.orchestra.run.smithi162.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-19T00:49:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30137.log 2024-08-19T00:49:34.205 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42365.log.gz 2024-08-19T00:49:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28360.log 2024-08-19T00:49:34.205 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27691.log.gz 2024-08-19T00:49:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40482.log 2024-08-19T00:49:34.205 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30137.log.gz 2024-08-19T00:49:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28360.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-19T00:49:34.207 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28360.log.gz 2024-08-19T00:49:34.207 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47911.log 2024-08-19T00:49:34.207 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40482.log.gz 2024-08-19T00:49:34.208 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34428.log 2024-08-19T00:49:34.208 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60577.log 2024-08-19T00:49:34.208 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47911.log.gz 2024-08-19T00:49:34.209 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34428.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.16302.log 2024-08-19T00:49:34.209 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34428.log.gz 2024-08-19T00:49:34.210 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60577.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-19T00:49:34.210 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60577.log.gz 2024-08-19T00:49:34.211 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.tmp-client.admin.16302.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.16302.log.gz 2024-08-19T00:49:34.211 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61204.log 2024-08-19T00:49:34.211 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72257.log 2024-08-19T00:49:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37775.log 2024-08-19T00:49:34.213 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61204.log.gz 2024-08-19T00:49:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46320.log 2024-08-19T00:49:34.214 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72257.log.gz 2024-08-19T00:49:34.214 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54131.log 2024-08-19T00:49:34.215 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37775.log.gz 2024-08-19T00:49:34.215 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60871.log 2024-08-19T00:49:34.216 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46320.log.gz 2024-08-19T00:49:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30530.log 2024-08-19T00:49:34.217 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54131.log.gz 2024-08-19T00:49:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-08-19T00:49:34.218 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60871.log.gz 2024-08-19T00:49:34.218 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30530.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.30530.log.gz 2024-08-19T00:49:34.218 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66404.log 2024-08-19T00:49:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52162.log 2024-08-19T00:49:34.219 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-08-19T00:49:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66404.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66404.log.gz 2024-08-19T00:49:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31315.log 2024-08-19T00:49:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62446.log 2024-08-19T00:49:34.222 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52162.log.gz 2024-08-19T00:49:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31315.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.31315.log.gz --verbose 2024-08-19T00:49:34.222 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.60483.log 2024-08-19T00:49:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26582.log 2024-08-19T00:49:34.223 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62446.log.gz 2024-08-19T00:49:34.224 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60483.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60483.log.gz 2024-08-19T00:49:34.224 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66841.log 2024-08-19T00:49:34.225 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31739.log 2024-08-19T00:49:34.225 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.26582.log.gz 2024-08-19T00:49:34.226 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66841.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66841.log.gz 2024-08-19T00:49:34.226 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37504.log 2024-08-19T00:49:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31739.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.31739.log.gz -5 2024-08-19T00:49:34.227 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58488.log 2024-08-19T00:49:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37504.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37504.log.gz 2024-08-19T00:49:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41800.log 2024-08-19T00:49:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2024-08-19T00:49:34.230 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58488.log.gz 2024-08-19T00:49:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.41800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41800.log.gz 2024-08-19T00:49:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2024-08-19T00:49:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55358.log 2024-08-19T00:49:34.232 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2024-08-19T00:49:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42239.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2024-08-19T00:49:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38384.log 2024-08-19T00:49:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-08-19T00:49:34.233 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55358.log.gz 2024-08-19T00:49:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58367.log 2024-08-19T00:49:34.234 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38384.log.gz 2024-08-19T00:49:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47800.log 2024-08-19T00:49:34.235 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-08-19T00:49:34.236 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58367.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58367.log.gz 2024-08-19T00:49:34.236 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48577.log 2024-08-19T00:49:34.237 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55612.log 2024-08-19T00:49:34.237 INFO:teuthology.orchestra.run.smithi007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47800.log.gz 2024-08-19T00:49:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62600.log 2024-08-19T00:49:34.238 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48577.log.gz 2024-08-19T00:49:34.239 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-08-19T00:49:34.239 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55612.log.gz 2024-08-19T00:49:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71619.log 2024-08-19T00:49:34.240 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62600.log.gz 2024-08-19T00:49:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32653.log 2024-08-19T00:49:34.241 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2024-08-19T00:49:34.242 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71619.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71619.log.gz 2024-08-19T00:49:34.242 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46155.log 2024-08-19T00:49:34.243 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40535.log 2024-08-19T00:49:34.243 INFO:teuthology.orchestra.run.smithi007.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32653.log.gz 2024-08-19T00:49:34.244 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38300.log 2024-08-19T00:49:34.244 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2024-08-19T00:49:34.245 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73014.log 2024-08-19T00:49:34.245 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40535.log.gz 2024-08-19T00:49:34.246 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2024-08-19T00:49:34.246 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38300.log.gz 2024-08-19T00:49:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48096.log 2024-08-19T00:49:34.247 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73014.log.gz 2024-08-19T00:49:34.248 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46236.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2024-08-19T00:49:34.248 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30775.log 2024-08-19T00:49:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68814.log 2024-08-19T00:49:34.249 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48096.log.gz 2024-08-19T00:49:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54519.log 2024-08-19T00:49:34.250 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30775.log.gz 2024-08-19T00:49:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58820.log 2024-08-19T00:49:34.251 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68814.log.gz 2024-08-19T00:49:34.251 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54519.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54519.log.gz 2024-08-19T00:49:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48947.log 2024-08-19T00:49:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65112.log 2024-08-19T00:49:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48947.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.58820.log.gz 2024-08-19T00:49:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63836.log 2024-08-19T00:49:34.254 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48947.log.gz 2024-08-19T00:49:34.255 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48355.log 2024-08-19T00:49:34.255 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.65112.log.gz 2024-08-19T00:49:34.256 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47948.log 2024-08-19T00:49:34.256 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63836.log.gz 2024-08-19T00:49:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-08-19T00:49:34.257 INFO:teuthology.orchestra.run.smithi007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48355.log.gz 2024-08-19T00:49:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73684.log 2024-08-19T00:49:34.258 INFO:teuthology.orchestra.run.smithi007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.47948.log.gz 2024-08-19T00:49:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62834.log 2024-08-19T00:49:34.259 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-08-19T00:49:34.260 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71871.log 2024-08-19T00:49:34.260 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73684.log.gz 2024-08-19T00:49:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62834.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62834.log.gz 2024-08-19T00:49:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33149.log 2024-08-19T00:49:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46955.log 2024-08-19T00:49:34.262 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71871.log.gz 2024-08-19T00:49:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.33149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33149.log.gz 2024-08-19T00:49:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39117.log 2024-08-19T00:49:34.264 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60427.log 2024-08-19T00:49:34.264 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46955.log.gz 2024-08-19T00:49:34.264 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39117.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.39117.log.gz /var/log/ceph/ceph-client.admin.65822.log 2024-08-19T00:49:34.265 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-08-19T00:49:34.265 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30240.log 2024-08-19T00:49:34.266 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.60427.log.gz 2024-08-19T00:49:34.266 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62330.log 2024-08-19T00:49:34.267 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65822.log.gz 2024-08-19T00:49:34.267 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43771.log 2024-08-19T00:49:34.267 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30240.log.gz 2024-08-19T00:49:34.268 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72846.log 2024-08-19T00:49:34.268 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62330.log.gz 2024-08-19T00:49:34.269 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43387.log 2024-08-19T00:49:34.269 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43771.log.gz 2024-08-19T00:49:34.270 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72846.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72846.log.gz 2024-08-19T00:49:34.270 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38697.log 2024-08-19T00:49:34.271 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43387.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43387.log.gz 2024-08-19T00:49:34.271 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67318.log 2024-08-19T00:49:34.272 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38697.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38697.log.gzgzip 2024-08-19T00:49:34.272 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52323.log 2024-08-19T00:49:34.273 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39453.log 2024-08-19T00:49:34.273 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67318.log.gz 2024-08-19T00:49:34.274 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58913.log 2024-08-19T00:49:34.275 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39453.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.52323.log.gz 2024-08-19T00:49:34.275 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-08-19T00:49:34.276 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39453.log.gz 2024-08-19T00:49:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49347.log 2024-08-19T00:49:34.277 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58913.log.gz 2024-08-19T00:49:34.277 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72888.log 2024-08-19T00:49:34.278 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-08-19T00:49:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30859.log 2024-08-19T00:49:34.279 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49347.log.gz 2024-08-19T00:49:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72888.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72888.log.gz 2024-08-19T00:49:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51561.log 2024-08-19T00:49:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68856.log 88.7% 2024-08-19T00:49:34.281 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30859.log.gz 2024-08-19T00:49:34.281 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39243.log 2024-08-19T00:49:34.282 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51561.log.gz 2024-08-19T00:49:34.282 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71996.log 2024-08-19T00:49:34.283 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68856.log.gz 2024-08-19T00:49:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39243.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39243.log.gz 2024-08-19T00:49:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40841.log 2024-08-19T00:49:34.284 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71996.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71996.log.gz 2024-08-19T00:49:34.284 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46493.log 2024-08-19T00:49:34.285 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27516.log 2024-08-19T00:49:34.285 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.40841.log.gz 2024-08-19T00:49:34.286 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41404.log 2024-08-19T00:49:34.287 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46493.log.gz 2024-08-19T00:49:34.287 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27516.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.27516.log.gz 2024-08-19T00:49:34.287 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56379.log 2024-08-19T00:49:34.288 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28860.log 2024-08-19T00:49:34.288 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41404.log.gz 2024-08-19T00:49:34.289 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36318.log 2024-08-19T00:49:34.289 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56379.log.gz 2024-08-19T00:49:34.290 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63274.log 2024-08-19T00:49:34.291 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.28860.log.gz 2024-08-19T00:49:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.36318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36318.log.gz 2024-08-19T00:49:34.292 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60147.log 2024-08-19T00:49:34.292 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34251.log 2024-08-19T00:49:34.292 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63274.log.gz 2024-08-19T00:49:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69367.log 2024-08-19T00:49:34.293 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60147.log.gz 2024-08-19T00:49:34.294 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32853.log 2024-08-19T00:49:34.294 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34251.log.gz 2024-08-19T00:49:34.295 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69367.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69367.log.gz 2024-08-19T00:49:34.295 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64024.log 2024-08-19T00:49:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53121.log 2024-08-19T00:49:34.296 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32853.log.gz 2024-08-19T00:49:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.64024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64024.log.gz 2024-08-19T00:49:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67037.log 2024-08-19T00:49:34.298 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72444.log 2024-08-19T00:49:34.299 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67037.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.53121.log.gz 2024-08-19T00:49:34.299 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31525.log 2024-08-19T00:49:34.299 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67037.log.gz 2024-08-19T00:49:34.300 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70183.log 2024-08-19T00:49:34.300 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72444.log.gz 2024-08-19T00:49:34.301 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31525.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31525.log.gz 2024-08-19T00:49:34.301 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40155.log 2024-08-19T00:49:34.302 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45686.log 2024-08-19T00:49:34.302 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70183.log.gz 2024-08-19T00:49:34.303 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.40155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40155.log.gz 2024-08-19T00:49:34.303 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-08-19T00:49:34.304 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49305.log 87.9% 2024-08-19T00:49:34.304 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45686.log.gz 2024-08-19T00:49:34.305 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2024-08-19T00:49:34.305 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-08-19T00:49:34.306 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49305.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.46409.log -- replaced with /var/log/ceph/ceph-client.admin.49305.log.gz 2024-08-19T00:49:34.306 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-08-19T00:49:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53583.log 2024-08-19T00:49:34.307 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46409.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2024-08-19T00:49:34.308 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.70271.log 2024-08-19T00:49:34.308 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46409.log.gz 2024-08-19T00:49:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28367.log 2024-08-19T00:49:34.309 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53583.log.gz 2024-08-19T00:49:34.310 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43289.log 2024-08-19T00:49:34.310 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70271.log.gz 2024-08-19T00:49:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28367.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28367.log.gz 2024-08-19T00:49:34.311 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35230.log 2024-08-19T00:49:34.312 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68580.log 2024-08-19T00:49:34.312 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43289.log.gz 2024-08-19T00:49:34.313 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73434.log 2024-08-19T00:49:34.313 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35230.log.gz 2024-08-19T00:49:34.314 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39285.log 2024-08-19T00:49:34.314 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68580.log.gz 2024-08-19T00:49:34.315 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-08-19T00:49:34.315 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73434.log.gz 2024-08-19T00:49:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32141.log 2024-08-19T00:49:34.316 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2024-08-19T00:49:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37133.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-08-19T00:49:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52533.log 2024-08-19T00:49:34.317 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37546.log 2024-08-19T00:49:34.318 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32141.log.gz 2024-08-19T00:49:34.318 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52533.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52533.log.gz 2024-08-19T00:49:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43433.log 2024-08-19T00:49:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54425.log 2024-08-19T00:49:34.320 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37546.log.gz 2024-08-19T00:49:34.320 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41612.log 2024-08-19T00:49:34.321 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43433.log.gz 2024-08-19T00:49:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67000.log 2024-08-19T00:49:34.322 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54425.log.gz 2024-08-19T00:49:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41612.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41612.log.gz 2024-08-19T00:49:34.323 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28018.log 2024-08-19T00:49:34.323 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66019.log 2024-08-19T00:49:34.324 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28018.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.67000.log.gz 2024-08-19T00:49:34.325 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-08-19T00:49:34.325 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28018.log.gz 2024-08-19T00:49:34.325 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44151.log 2024-08-19T00:49:34.326 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.66019.log.gz 2024-08-19T00:49:34.327 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54973.log 2024-08-19T00:49:34.327 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-08-19T00:49:34.328 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.44151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44151.log.gz 2024-08-19T00:49:34.328 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52239.log 2024-08-19T00:49:34.328 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47444.log 2024-08-19T00:49:34.329 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54973.log.gz 2024-08-19T00:49:34.330 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51617.log 2024-08-19T00:49:34.330 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52239.log.gz 2024-08-19T00:49:34.331 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64419.log 2024-08-19T00:49:34.331 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47444.log.gz 2024-08-19T00:49:34.331 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62718.log 2024-08-19T00:49:34.332 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51617.log.gz 2024-08-19T00:49:34.332 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64419.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.64419.log.gz 2024-08-19T00:49:34.333 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69577.log 2024-08-19T00:49:34.333 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62718.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62718.log.gz 2024-08-19T00:49:34.334 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42323.log 2024-08-19T00:49:34.334 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67093.log 2024-08-19T00:49:34.335 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69577.log.gz 2024-08-19T00:49:34.335 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38823.log 88.6% 2024-08-19T00:49:34.335 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42323.log.gz 2024-08-19T00:49:34.336 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48133.log 2024-08-19T00:49:34.336 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67093.log.gz 2024-08-19T00:49:34.337 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38823.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38823.log.gz 2024-08-19T00:49:34.337 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59413.log 2024-08-19T00:49:34.338 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51135.log 2024-08-19T00:49:34.338 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48133.log.gz 2024-08-19T00:49:34.339 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59413.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-19T00:49:34.339 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59413.log.gz 2024-08-19T00:49:34.340 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28650.log 2024-08-19T00:49:34.341 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.audit.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.51135.log.gz 2024-08-19T00:49:34.341 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30649.log 2024-08-19T00:49:34.342 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65525.log 2024-08-19T00:49:34.343 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28650.log.gz 2024-08-19T00:49:34.344 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57602.log 2024-08-19T00:49:34.344 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30649.log.gz 2024-08-19T00:49:34.344 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65525.log: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-19T00:49:34.345 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69325.log 2024-08-19T00:49:34.345 INFO:teuthology.orchestra.run.smithi007.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.65525.log.gz 2024-08-19T00:49:34.346 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57602.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57602.log.gz 2024-08-19T00:49:34.346 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71447.log 2024-08-19T00:49:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63663.log 2024-08-19T00:49:34.347 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69325.log.gz 2024-08-19T00:49:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71447.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71447.log.gz 2024-08-19T00:49:34.348 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64635.log 2024-08-19T00:49:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38474.log 2024-08-19T00:49:34.349 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63663.log.gz 2024-08-19T00:49:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64635.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64635.log.gz 2024-08-19T00:49:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69958.log 2024-08-19T00:49:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43897.log 2024-08-19T00:49:34.351 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38474.log.gz 2024-08-19T00:49:34.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69958.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69958.log.gz 2024-08-19T00:49:34.352 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61167.log 2024-08-19T00:49:34.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50839.log 2024-08-19T00:49:34.353 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43897.log.gz 2024-08-19T00:49:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33683.log 2024-08-19T00:49:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50839.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.61167.log.gz 2024-08-19T00:49:34.355 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50839.log.gz 2024-08-19T00:49:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68916.log 2024-08-19T00:49:34.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30607.log 2024-08-19T00:49:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68916.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33683.log.gz 2024-08-19T00:49:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68916.log.gz -5 2024-08-19T00:49:34.358 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36022.log 2024-08-19T00:49:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31697.log 2024-08-19T00:49:34.359 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30607.log.gz 2024-08-19T00:49:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73266.log 2024-08-19T00:49:34.360 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36022.log.gz 2024-08-19T00:49:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31697.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31697.log.gz 2024-08-19T00:49:34.361 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2024-08-19T00:49:34.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26936.log 2024-08-19T00:49:34.362 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73266.log.gz 2024-08-19T00:49:34.362 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42899.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gzgzip 2024-08-19T00:49:34.363 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62353.log 2024-08-19T00:49:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44233.log 2024-08-19T00:49:34.363 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26936.log.gz 2024-08-19T00:49:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35496.log 2024-08-19T00:49:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44233.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.62353.log.gz 2024-08-19T00:49:34.365 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44233.log.gz 2024-08-19T00:49:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62077.log 2024-08-19T00:49:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35496.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.35496.log.gz 2024-08-19T00:49:34.367 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73224.log 2024-08-19T00:49:34.367 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2024-08-19T00:49:34.368 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62077.log.gz 2024-08-19T00:49:34.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51281.log 87.8% 2024-08-19T00:49:34.368 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73224.log.gz 2024-08-19T00:49:34.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27180.log 2024-08-19T00:49:34.369 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2024-08-19T00:49:34.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51281.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51281.log.gz 2024-08-19T00:49:34.370 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72341.log 2024-08-19T00:49:34.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27180.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27180.log.gz 2024-08-19T00:49:34.372 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57954.log 2024-08-19T00:49:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72341.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-19T00:49:34.373 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72341.log.gz 2024-08-19T00:49:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59591.log 2024-08-19T00:49:34.374 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57954.log.gz 2024-08-19T00:49:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31107.log 2024-08-19T00:49:34.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2024-08-19T00:49:34.376 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59591.log.gz 2024-08-19T00:49:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56141.log 2024-08-19T00:49:34.377 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31107.log.gz 2024-08-19T00:49:34.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65701.log 2024-08-19T00:49:34.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56141.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2024-08-19T00:49:34.379 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32075.log 2024-08-19T00:49:34.380 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56141.log.gz 2024-08-19T00:49:34.380 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65701.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65701.log.gz 2024-08-19T00:49:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43475.log 2024-08-19T00:49:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61260.log 2024-08-19T00:49:34.383 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43475.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.32075.log.gz 2024-08-19T00:49:34.383 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53915.log 2024-08-19T00:49:34.383 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43475.log.gz 2024-08-19T00:49:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61260.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61260.log.gz 2024-08-19T00:49:34.384 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69535.log 2024-08-19T00:49:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63129.log 2024-08-19T00:49:34.385 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69535.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53915.log.gz 2024-08-19T00:49:34.386 INFO:teuthology.orchestra.run.smithi007.stderr:gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.69535.log.gz --verbose 2024-08-19T00:49:34.386 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.43234.log 2024-08-19T00:49:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27390.log 2024-08-19T00:49:34.389 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36130.log 2024-08-19T00:49:34.389 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.63129.log.gz 2024-08-19T00:49:34.389 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43234.log.gz 2024-08-19T00:49:34.390 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36785.log 2024-08-19T00:49:34.390 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27390.log.gz 2024-08-19T00:49:34.391 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2024-08-19T00:49:34.391 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36130.log.gz 2024-08-19T00:49:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36785.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36785.log.gz 2024-08-19T00:49:34.392 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34974.log 2024-08-19T00:49:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35069.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-19T00:49:34.394 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2024-08-19T00:49:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28364.log 2024-08-19T00:49:34.395 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34974.log.gz 2024-08-19T00:49:34.396 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37901.log 2024-08-19T00:49:34.397 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2024-08-19T00:49:34.397 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28364.log.gz 2024-08-19T00:49:34.398 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58638.log 2024-08-19T00:49:34.398 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37901.log.gz 2024-08-19T00:49:34.400 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2024-08-19T00:49:34.401 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27686.log 2024-08-19T00:49:34.401 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58638.log.gz 2024-08-19T00:49:34.401 INFO:teuthology.orchestra.run.smithi007.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2024-08-19T00:49:34.402 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56053.log 2024-08-19T00:49:34.402 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2024-08-19T00:49:34.403 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38655.log 2024-08-19T00:49:34.403 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27686.log.gz 2024-08-19T00:49:34.405 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63610.log 2024-08-19T00:49:34.405 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56053.log.gz 2024-08-19T00:49:34.406 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71243.log 2024-08-19T00:49:34.406 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38655.log.gz 2024-08-19T00:49:34.407 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70225.log 2024-08-19T00:49:34.407 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63610.log.gz 2024-08-19T00:49:34.408 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39901.log 2024-08-19T00:49:34.409 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71243.log.gz 2024-08-19T00:49:34.409 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55981.log 2024-08-19T00:49:34.410 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70225.log.gz 2024-08-19T00:49:34.410 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59861.log 2024-08-19T00:49:34.411 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9%/var/log/ceph/ceph-client.admin.55981.log: -- replaced with /var/log/ceph/ceph-client.admin.39901.log.gz 2024-08-19T00:49:34.412 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53467.log 2024-08-19T00:49:34.412 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55981.log.gz 2024-08-19T00:49:34.413 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59549.log 2024-08-19T00:49:34.414 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59861.log.gz 2024-08-19T00:49:34.414 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64878.log 2024-08-19T00:49:34.414 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53467.log.gz 2024-08-19T00:49:34.415 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38781.log 2024-08-19T00:49:34.416 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59549.log.gz 2024-08-19T00:49:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34638.log 2024-08-19T00:49:34.418 INFO:teuthology.orchestra.run.smithi162.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-19T00:49:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72528.log 2024-08-19T00:49:34.419 INFO:teuthology.orchestra.run.smithi007.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.64878.log.gz 2024-08-19T00:49:34.419 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38781.log.gz 2024-08-19T00:49:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68150.log 2024-08-19T00:49:34.420 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34638.log.gz 2024-08-19T00:49:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2024-08-19T00:49:34.421 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72528.log.gz 2024-08-19T00:49:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22620.log 2024-08-19T00:49:34.422 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68150.log.gz 2024-08-19T00:49:34.423 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2024-08-19T00:49:34.423 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2024-08-19T00:49:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.22620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40731.log 2024-08-19T00:49:34.425 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.22620.log.gz 2024-08-19T00:49:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2024-08-19T00:49:34.426 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2024-08-19T00:49:34.427 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69836.log 2024-08-19T00:49:34.427 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40731.log.gz 2024-08-19T00:49:34.428 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35272.log 2024-08-19T00:49:34.429 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2024-08-19T00:49:34.429 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36322.log 2024-08-19T00:49:34.430 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69836.log.gz 2024-08-19T00:49:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32333.log 2024-08-19T00:49:34.431 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35272.log.gz 2024-08-19T00:49:34.432 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.36322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36322.log.gz 2024-08-19T00:49:34.432 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56766.log 2024-08-19T00:49:34.433 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.32333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.32333.log.gz 2024-08-19T00:49:34.433 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43643.log 2024-08-19T00:49:34.435 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57484.log 2024-08-19T00:49:34.435 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56766.log.gz 2024-08-19T00:49:34.436 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47402.log 2024-08-19T00:49:34.436 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43643.log.gz 2024-08-19T00:49:34.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57117.log 2024-08-19T00:49:34.437 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57484.log.gz 2024-08-19T00:49:34.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-08-19T00:49:34.438 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47402.log.gz 2024-08-19T00:49:34.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53158.log 2024-08-19T00:49:34.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38907.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.57117.log.gz 2024-08-19T00:49:34.441 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-08-19T00:49:34.441 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28998.log 2024-08-19T00:49:34.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53158.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63222.log 2024-08-19T00:49:34.443 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53158.log.gz 2024-08-19T00:49:34.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49212.log 2024-08-19T00:49:34.444 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28998.log.gz 2024-08-19T00:49:34.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30179.log 2024-08-19T00:49:34.445 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63222.log.gz 2024-08-19T00:49:34.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27695.log 2024-08-19T00:49:34.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33937.log 2024-08-19T00:49:34.448 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30179.log.gz 2024-08-19T00:49:34.448 INFO:teuthology.orchestra.run.smithi007.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.49212.log.gz 2024-08-19T00:49:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73098.log 2024-08-19T00:49:34.449 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27695.log.gz 2024-08-19T00:49:34.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.33937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33937.log.gz 2024-08-19T00:49:34.450 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37290.log 2024-08-19T00:49:34.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56529.log 2024-08-19T00:49:34.451 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73098.log.gz 2024-08-19T00:49:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54248.log 2024-08-19T00:49:34.453 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37290.log.gz 2024-08-19T00:49:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62988.log 2024-08-19T00:49:34.454 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56529.log.gz 2024-08-19T00:49:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44991.log 2024-08-19T00:49:34.455 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54248.log.gz 2024-08-19T00:49:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56183.log 2024-08-19T00:49:34.456 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62988.log.gz 2024-08-19T00:49:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64443.log 2024-08-19T00:49:34.458 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44991.log.gz 2024-08-19T00:49:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38865.log 2024-08-19T00:49:34.459 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56183.log.gz 2024-08-19T00:49:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51459.log 2024-08-19T00:49:34.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47578.log 2024-08-19T00:49:34.462 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38865.log.gz 2024-08-19T00:49:34.462 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.64443.log.gz 2024-08-19T00:49:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51459.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51459.log.gz 2024-08-19T00:49:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68271.log 2024-08-19T00:49:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47578.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47578.log.gz 2024-08-19T00:49:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66658.log 2024-08-19T00:49:34.466 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35538.log 2024-08-19T00:49:34.466 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.68271.log.gz 2024-08-19T00:49:34.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62390.log 2024-08-19T00:49:34.468 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66658.log.gz 2024-08-19T00:49:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48207.log 2024-08-19T00:49:34.469 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35538.log.gz 2024-08-19T00:49:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68696.log 2024-08-19T00:49:34.470 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62390.log.gz 2024-08-19T00:49:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2024-08-19T00:49:34.471 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48207.log.gz 2024-08-19T00:49:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56729.log 2024-08-19T00:49:34.472 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68696.log.gz 2024-08-19T00:49:34.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27053.log 2024-08-19T00:49:34.474 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2024-08-19T00:49:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61102.log 2024-08-19T00:49:34.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49389.log 2024-08-19T00:49:34.476 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.56729.log.gz 2024-08-19T00:49:34.476 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27053.log.gz 2024-08-19T00:49:34.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52035.log 2024-08-19T00:49:34.478 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61102.log.gz 2024-08-19T00:49:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53635.log 2024-08-19T00:49:34.479 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49389.log.gz 2024-08-19T00:49:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.52035.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2024-08-19T00:49:34.480 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.0.52035.log.gz 2024-08-19T00:49:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-08-19T00:49:34.481 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53635.log.gz 2024-08-19T00:49:34.482 INFO:teuthology.orchestra.run.smithi162.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-19T00:49:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46075.log 2024-08-19T00:49:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32961.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2024-08-19T00:49:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50135.log 2024-08-19T00:49:34.484 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-08-19T00:49:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48651.log 2024-08-19T00:49:34.485 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46075.log.gz 2024-08-19T00:49:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41492.log 2024-08-19T00:49:34.486 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50135.log.gz 2024-08-19T00:49:34.487 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52416.log 2024-08-19T00:49:34.487 INFO:teuthology.orchestra.run.smithi007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48651.log.gz 2024-08-19T00:49:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47689.log 2024-08-19T00:49:34.489 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41492.log.gz 2024-08-19T00:49:34.490 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33153.log 2024-08-19T00:49:34.490 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52416.log.gz 2024-08-19T00:49:34.491 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72972.log 2024-08-19T00:49:34.491 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47689.log.gz 2024-08-19T00:49:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.33153.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.33153.log.gz -5 2024-08-19T00:49:34.493 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30817.log 2024-08-19T00:49:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39967.log 2024-08-19T00:49:34.494 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72972.log.gz 2024-08-19T00:49:34.495 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58146.log 2024-08-19T00:49:34.495 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30817.log.gz 2024-08-19T00:49:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-08-19T00:49:34.496 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39967.log.gz 2024-08-19T00:49:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.58146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58146.log.gz 2024-08-19T00:49:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72762.log 2024-08-19T00:49:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32588.log 2024-08-19T00:49:34.499 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz 2024-08-19T00:49:34.500 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37606.log 2024-08-19T00:49:34.500 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72762.log.gz 2024-08-19T00:49:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67945.log 2024-08-19T00:49:34.501 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32588.log.gz 2024-08-19T00:49:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37420.log 2024-08-19T00:49:34.503 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37606.log.gz 2024-08-19T00:49:34.504 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53037.log 2024-08-19T00:49:34.504 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67945.log.gz 2024-08-19T00:49:34.505 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-08-19T00:49:34.505 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37420.log.gz 2024-08-19T00:49:34.506 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68640.log 2024-08-19T00:49:34.506 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53037.log.gz 2024-08-19T00:49:34.507 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70046.log 2024-08-19T00:49:34.508 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-08-19T00:49:34.509 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27696.log 2024-08-19T00:49:34.509 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.68640.log.gz 2024-08-19T00:49:34.510 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66277.log 2024-08-19T00:49:34.510 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70046.log.gz 2024-08-19T00:49:34.511 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66085.log 2024-08-19T00:49:34.511 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27696.log.gz 2024-08-19T00:49:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.66277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66277.log.gz 2024-08-19T00:49:34.512 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27687.log 2024-08-19T00:49:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28265.log 2024-08-19T00:49:34.514 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66085.log.gz 2024-08-19T00:49:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61960.log 2024-08-19T00:49:34.515 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27687.log.gz 2024-08-19T00:49:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2024-08-19T00:49:34.516 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28265.log.gz 2024-08-19T00:49:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53878.log 2024-08-19T00:49:34.518 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61960.log.gz 2024-08-19T00:49:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69916.log 2024-08-19T00:49:34.519 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2024-08-19T00:49:34.520 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2024-08-19T00:49:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67146.log 2024-08-19T00:49:34.521 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69916.log.gz 2024-08-19T00:49:34.521 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.53878.log.gz 2024-08-19T00:49:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45854.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2024-08-19T00:49:34.523 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58755.log 2024-08-19T00:49:34.523 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67146.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67146.log.gz 2024-08-19T00:49:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64855.log 2024-08-19T00:49:34.526 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56916.log 2024-08-19T00:49:34.526 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58755.log.gz 2024-08-19T00:49:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64281.log 2024-08-19T00:49:34.527 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64855.log.gz 2024-08-19T00:49:34.528 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57441.log 2024-08-19T00:49:34.528 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56916.log.gz 2024-08-19T00:49:34.529 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54309.log 2024-08-19T00:49:34.529 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64281.log.gz 2024-08-19T00:49:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2024-08-19T00:49:34.531 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57441.log.gz 2024-08-19T00:49:34.531 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59371.log 2024-08-19T00:49:34.532 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54309.log.gz 2024-08-19T00:49:34.533 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48614.log 2024-08-19T00:49:34.533 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2024-08-19T00:49:34.534 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51228.log 2024-08-19T00:49:34.534 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59371.log.gz 2024-08-19T00:49:34.535 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66977.log 2024-08-19T00:49:34.535 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48614.log.gz 2024-08-19T00:49:34.537 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2024-08-19T00:49:34.537 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51228.log.gz 2024-08-19T00:49:34.538 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72930.log 2024-08-19T00:49:34.538 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66977.log.gz 2024-08-19T00:49:34.539 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28365.log 2024-08-19T00:49:34.539 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 2024-08-19T00:49:34.540 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26999.log 2024-08-19T00:49:34.541 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72930.log.gz 2024-08-19T00:49:34.542 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48281.log 2024-08-19T00:49:34.542 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28365.log.gz 2024-08-19T00:49:34.543 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43517.log 2024-08-19T00:49:34.543 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.26999.log.gz 2024-08-19T00:49:34.544 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47147.log 2024-08-19T00:49:34.544 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48281.log.gz 2024-08-19T00:49:34.545 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46619.log 2024-08-19T00:49:34.545 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43517.log.gz 2024-08-19T00:49:34.546 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.47147.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34722.log 2024-08-19T00:49:34.547 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.0.47147.log.gz 2024-08-19T00:49:34.547 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37649.log 2024-08-19T00:49:34.548 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46619.log.gz 2024-08-19T00:49:34.549 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34722.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34722.log.gz 2024-08-19T00:49:34.549 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32895.log 2024-08-19T00:49:34.550 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36723.log 2024-08-19T00:49:34.550 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37649.log.gz 2024-08-19T00:49:34.551 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37733.log 2024-08-19T00:49:34.553 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.32895.log.gz 2024-08-19T00:49:34.553 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68538.log 2024-08-19T00:49:34.553 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36723.log.gz 2024-08-19T00:49:34.554 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30011.log 2024-08-19T00:49:34.554 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37733.log.gz 2024-08-19T00:49:34.555 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55865.log 2024-08-19T00:49:34.555 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68538.log.gz 2024-08-19T00:49:34.557 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41067.log 2024-08-19T00:49:34.557 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30011.log.gz 2024-08-19T00:49:34.558 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39159.log 2024-08-19T00:49:34.558 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55865.log.gz 2024-08-19T00:49:34.559 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41804.log 2024-08-19T00:49:34.559 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41067.log.gz 2024-08-19T00:49:34.560 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33456.log 2024-08-19T00:49:34.561 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39159.log.gz 2024-08-19T00:49:34.561 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.41804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41804.log.gz 2024-08-19T00:49:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52641.log 2024-08-19T00:49:34.563 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35980.log 2024-08-19T00:49:34.563 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33456.log.gz 2024-08-19T00:49:34.564 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70090.log 2024-08-19T00:49:34.564 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52641.log.gz 2024-08-19T00:49:34.565 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57509.log 2024-08-19T00:49:34.566 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-08-19T00:49:34.566 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70090.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-19T00:49:34.567 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70090.log.gz 2024-08-19T00:49:34.568 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50093.log 2024-08-19T00:49:34.569 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50470.log 2024-08-19T00:49:34.569 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.57509.log.gz 2024-08-19T00:49:34.570 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50093.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50093.log.gz 2024-08-19T00:49:34.571 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59707.log 2024-08-19T00:49:34.572 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50470.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50470.log.gz 2024-08-19T00:49:34.572 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-08-19T00:49:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72401.log 2024-08-19T00:49:34.574 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59707.log.gz 2024-08-19T00:49:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31569.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz 2024-08-19T00:49:34.576 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55823.log 2024-08-19T00:49:34.576 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72401.log.gz 2024-08-19T00:49:34.576 INFO:teuthology.orchestra.run.smithi007.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-19T00:49:34.577 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67506.log 2024-08-19T00:49:34.577 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.55823.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55748.log 2024-08-19T00:49:34.578 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1%/var/log/ceph/ceph-client.0.67506.log: -- replaced with /var/log/ceph/ceph-client.admin.55823.log.gz 2024-08-19T00:49:34.578 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67506.log.gz 2024-08-19T00:49:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57094.log 2024-08-19T00:49:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39711.log 2024-08-19T00:49:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55748.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55748.log.gz 2024-08-19T00:49:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57094.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57094.log.gz 2024-08-19T00:49:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-19T00:49:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.39711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45541.log 2024-08-19T00:49:34.582 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39711.log.gz 2024-08-19T00:49:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58290.log 2024-08-19T00:49:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40983.log 2024-08-19T00:49:34.585 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45541.log.gz 2024-08-19T00:49:34.586 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44667.log 2024-08-19T00:49:34.586 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58290.log.gz 2024-08-19T00:49:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71807.log 2024-08-19T00:49:34.587 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40983.log.gz 2024-08-19T00:49:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44667.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44667.log.gz 2024-08-19T00:49:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73140.log 2024-08-19T00:49:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.71807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71807.log.gz 2024-08-19T00:49:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73642.log 2024-08-19T00:49:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57365.log 2024-08-19T00:49:34.591 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73140.log.gz 2024-08-19T00:49:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73642.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73642.log.gz 2024-08-19T00:49:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44523.log 2024-08-19T00:49:34.594 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57365.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57365.log.gz 2024-08-19T00:49:34.594 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2024-08-19T00:49:34.596 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46745.log 2024-08-19T00:49:34.596 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44523.log.gz 2024-08-19T00:49:34.597 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42762.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2024-08-19T00:49:34.598 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.46745.log: --verbose -- /var/log/ceph/ceph-client.admin.53855.log 2024-08-19T00:49:34.598 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46745.log.gz 2024-08-19T00:49:34.599 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51323.log 2024-08-19T00:49:34.600 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56487.log 2024-08-19T00:49:34.601 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53855.log.gz 2024-08-19T00:49:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51323.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51323.log.gz 2024-08-19T00:49:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.56487.log: --verbose -- /var/log/ceph/ceph-client.admin.30440.log 2024-08-19T00:49:34.603 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56487.log.gz 2024-08-19T00:49:34.604 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-19T00:49:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68379.log 2024-08-19T00:49:34.606 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30440.log.gz 2024-08-19T00:49:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68327.log 2024-08-19T00:49:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68379.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68379.log.gz 2024-08-19T00:49:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.68327.log: --verbose -- /var/log/ceph/ceph-client.admin.35626.log 2024-08-19T00:49:34.610 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68327.log.gz 2024-08-19T00:49:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61144.log 2024-08-19T00:49:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35626.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35626.log.gz 2024-08-19T00:49:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 2024-08-19T00:49:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61144.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61144.log.gz 2024-08-19T00:49:34.615 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40623.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2024-08-19T00:49:34.616 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30733.log 2024-08-19T00:49:34.617 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37462.log 2024-08-19T00:49:34.618 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30733.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30733.log.gz 2024-08-19T00:49:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2024-08-19T00:49:34.620 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37462.log.gz 2024-08-19T00:49:34.620 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57263.log 2024-08-19T00:49:34.622 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51070.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2024-08-19T00:49:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.57263.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61900.log 2024-08-19T00:49:34.623 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57263.log.gz 2024-08-19T00:49:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34764.log 2024-08-19T00:49:34.626 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61900.log: 87.5%gzip -5/var/log/ceph/ceph-client.admin.34764.log: --verbose -- /var/log/ceph/ceph-client.admin.57052.log 2024-08-19T00:49:34.627 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34764.log.gz 2024-08-19T00:49:34.627 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61900.log.gz 2024-08-19T00:49:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57762.log 2024-08-19T00:49:34.631 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57052.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57052.log.gz 2024-08-19T00:49:34.631 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29353.log 2024-08-19T00:49:34.631 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57762.log.gz 2024-08-19T00:49:34.632 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.29353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.29353.log.gz 2024-08-19T00:49:34.633 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-08-19T00:49:34.634 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38027.log 2024-08-19T00:49:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32751.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-08-19T00:49:34.636 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70565.log 2024-08-19T00:49:34.637 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38027.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38027.log.gz 2024-08-19T00:49:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49058.log 2024-08-19T00:49:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70565.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.70565.log.gz 2024-08-19T00:49:34.640 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49058.log: -- /var/log/ceph/ceph-client.admin.45601.log 2024-08-19T00:49:34.641 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49058.log.gz 2024-08-19T00:49:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28026.log 2024-08-19T00:49:34.643 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45601.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45601.log.gz 2024-08-19T00:49:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72570.log 2024-08-19T00:49:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28026.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28026.log.gz 2024-08-19T00:49:34.646 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72570.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72570.log.gz 2024-08-19T00:49:34.647 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34848.log 2024-08-19T00:49:34.648 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54931.log 2024-08-19T00:49:34.650 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34848.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34848.log.gz 2024-08-19T00:49:34.650 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27432.log 2024-08-19T00:49:34.651 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54931.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54931.log.gz 2024-08-19T00:49:34.652 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73350.log 2024-08-19T00:49:34.653 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27432.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27432.log.gz 2024-08-19T00:49:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45770.log 2024-08-19T00:49:34.655 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73350.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73350.log.gz 2024-08-19T00:49:34.656 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72173.log 2024-08-19T00:49:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45770.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45770.log.gz 2024-08-19T00:49:34.658 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28366.log/var/log/ceph/ceph-client.admin.72173.log: 2024-08-19T00:49:34.658 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72173.log.gz 2024-08-19T00:49:34.660 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28366.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28366.log.gz 2024-08-19T00:49:34.661 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26852.log 2024-08-19T00:49:34.662 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36484.log 2024-08-19T00:49:34.664 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26852.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.26852.log.gz 2024-08-19T00:49:34.664 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60189.log 2024-08-19T00:49:34.665 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36484.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2024-08-19T00:49:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35403.log 2024-08-19T00:49:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60189.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60189.log.gz 2024-08-19T00:49:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2024-08-19T00:49:34.669 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35403.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35403.log.gz 2024-08-19T00:49:34.670 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58797.log/var/log/ceph/ceph-client.admin.43559.log: 2024-08-19T00:49:34.671 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2024-08-19T00:49:34.671 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57210.log 2024-08-19T00:49:34.673 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58797.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58797.log.gz 2024-08-19T00:49:34.674 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70313.log/var/log/ceph/ceph-client.admin.57210.log: 2024-08-19T00:49:34.675 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57210.log.gz 2024-08-19T00:49:34.675 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28734.log 2024-08-19T00:49:34.676 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70313.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70313.log.gz 2024-08-19T00:49:34.677 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.28734.log: /var/log/ceph/ceph-client.0.67510.log 2024-08-19T00:49:34.678 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28734.log.gz 2024-08-19T00:49:34.679 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72299.log 2024-08-19T00:49:34.680 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.67510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67510.log.gz 2024-08-19T00:49:34.680 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60390.log 2024-08-19T00:49:34.682 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72299.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72299.log.gz 2024-08-19T00:49:34.682 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60390.log: -- /var/log/ceph/ceph-client.admin.27264.log 2024-08-19T00:49:34.684 INFO:teuthology.orchestra.run.smithi007.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.60390.log.gz 2024-08-19T00:49:34.685 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50377.log 2024-08-19T00:49:34.686 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27264.log.gz 2024-08-19T00:49:34.687 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37985.log 2024-08-19T00:49:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50377.log: /var/log/ceph/ceph-client.admin.37985.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.50377.log.gz 2024-08-19T00:49:34.690 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37985.log.gz 2024-08-19T00:49:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50522.log 2024-08-19T00:49:34.692 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53425.log 2024-08-19T00:49:34.693 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50522.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50522.log.gz 2024-08-19T00:49:34.694 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45373.log 2024-08-19T00:49:34.695 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53425.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53425.log.gz 2024-08-19T00:49:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45373.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45373.log.gz 2024-08-19T00:49:34.696 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50312.log 2024-08-19T00:49:34.698 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37332.log 2024-08-19T00:49:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50312.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50312.log.gz 2024-08-19T00:49:34.700 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47874.log 2024-08-19T00:49:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37332.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37332.log.gz 2024-08-19T00:49:34.702 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27348.log 2024-08-19T00:49:34.703 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47874.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47874.log.gz 2024-08-19T00:49:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27348.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27348.log.gz 2024-08-19T00:49:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42636.log 2024-08-19T00:49:34.706 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62741.log 2024-08-19T00:49:34.707 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42636.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42636.log.gz 2024-08-19T00:49:34.708 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31357.log 2024-08-19T00:49:34.710 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62741.log: /var/log/ceph/ceph-client.admin.31357.log: gzip -5 92.4% -- replaced with /var/log/ceph/ceph-client.admin.62741.log.gz 2024-08-19T00:49:34.711 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2024-08-19T00:49:34.711 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31357.log.gz 2024-08-19T00:49:34.713 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40272.log 2024-08-19T00:49:34.713 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43601.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2024-08-19T00:49:34.715 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40272.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40272.log.gz 2024-08-19T00:49:34.716 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59801.log 2024-08-19T00:49:34.717 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48836.log 2024-08-19T00:49:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59801.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59801.log.gz 2024-08-19T00:49:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46451.log 2024-08-19T00:49:34.720 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48836.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.48836.log.gz 2024-08-19T00:49:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54865.log 2024-08-19T00:49:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46451.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46451.log.gz 2024-08-19T00:49:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56571.log 2024-08-19T00:49:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54865.log.gz 2024-08-19T00:49:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61678.log 2024-08-19T00:49:34.726 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56571.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56571.log.gz 2024-08-19T00:49:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.61678.log: -- /var/log/ceph/ceph-client.admin.30943.log 2024-08-19T00:49:34.727 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61678.log.gz 2024-08-19T00:49:34.728 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2024-08-19T00:49:34.729 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30943.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30943.log.gz 2024-08-19T00:49:34.730 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45195.log: /var/log/ceph/ceph-client.admin.50783.log 2024-08-19T00:49:34.731 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2024-08-19T00:49:34.732 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65623.log 2024-08-19T00:49:34.733 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50783.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50783.log.gz 2024-08-19T00:49:34.734 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log/var/log/ceph/ceph-client.admin.65623.log: 2024-08-19T00:49:34.735 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65623.log.gz 2024-08-19T00:49:34.735 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2024-08-19T00:49:34.737 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28608.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-08-19T00:49:34.738 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70481.log 2024-08-19T00:49:34.738 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52299.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2024-08-19T00:49:34.739 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59185.log 2024-08-19T00:49:34.740 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70481.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70481.log.gz 2024-08-19T00:49:34.741 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52960.log 2024-08-19T00:49:34.743 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59185.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59185.log.gz 2024-08-19T00:49:34.743 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2024-08-19T00:49:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52960.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52960.log.gz 2024-08-19T00:49:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.29794.log/var/log/ceph/ceph-client.admin.44840.log: 2024-08-19T00:49:34.746 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2024-08-19T00:49:34.747 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52833.log 2024-08-19T00:49:34.747 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.2.29794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.29794.log.gz 2024-08-19T00:49:34.749 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35836.log 2024-08-19T00:49:34.749 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.52833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52833.log.gz 2024-08-19T00:49:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68211.log 2024-08-19T00:49:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35836.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35836.log.gz 2024-08-19T00:49:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71405.log 2024-08-19T00:49:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68211.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68211.log.gz 2024-08-19T00:49:34.754 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30901.log 2024-08-19T00:49:34.755 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71405.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71405.log.gz 2024-08-19T00:49:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22740.log 2024-08-19T00:49:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30901.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30901.log.gz 2024-08-19T00:49:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69451.log 2024-08-19T00:49:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.22740.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.22740.log.gz 2024-08-19T00:49:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73518.log 2024-08-19T00:49:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69451.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69451.log.gz 2024-08-19T00:49:34.762 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73518.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73518.log.gz 2024-08-19T00:49:34.763 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22362.log 2024-08-19T00:49:34.764 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46847.log 2024-08-19T00:49:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.22362.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.22362.log.gz 2024-08-19T00:49:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69157.log 2024-08-19T00:49:34.767 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46847.log.gz 2024-08-19T00:49:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52031.log 2024-08-19T00:49:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69157.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69157.log.gz 2024-08-19T00:49:34.770 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54678.log 2024-08-19T00:49:34.770 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.52031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52031.log.gz 2024-08-19T00:49:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69619.log 2024-08-19T00:49:34.773 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54678.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54678.log.gz 2024-08-19T00:49:34.774 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45644.log 2024-08-19T00:49:34.774 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69619.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69619.log.gz 2024-08-19T00:49:34.775 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64480.log 2024-08-19T00:49:34.776 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45644.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45644.log.gz 2024-08-19T00:49:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68033.log 2024-08-19T00:49:34.779 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64480.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64480.log.gz 2024-08-19T00:49:34.779 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61674.log 2024-08-19T00:49:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68033.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68033.log.gz 2024-08-19T00:49:34.781 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64183.log 2024-08-19T00:49:34.781 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.61674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61674.log.gz 2024-08-19T00:49:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70823.log 2024-08-19T00:49:34.785 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64183.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64183.log.gz 2024-08-19T00:49:34.785 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.70823.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.70823.log.gz 2024-08-19T00:49:34.785 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42113.log 2024-08-19T00:49:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27222.log 2024-08-19T00:49:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42113.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42113.log.gz 2024-08-19T00:49:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2024-08-19T00:49:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27222.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27222.log.gz 2024-08-19T00:49:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37025.log 2024-08-19T00:49:34.792 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36418.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gz 2024-08-19T00:49:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.37025.log: --verbose -- /var/log/ceph/ceph-client.admin.31027.log 2024-08-19T00:49:34.794 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.37025.log.gz 2024-08-19T00:49:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2024-08-19T00:49:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31027.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31027.log.gz 2024-08-19T00:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48059.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2024-08-19T00:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51777.log 2024-08-19T00:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44565.log 2024-08-19T00:49:34.801 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51777.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.51777.log.gz 2024-08-19T00:49:34.802 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59614.log 2024-08-19T00:49:34.802 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44565.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44565.log.gz 2024-08-19T00:49:34.803 INFO:teuthology.orchestra.run.smithi162.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-19T00:49:34.803 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-08-19T00:49:34.804 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-19T00:49:34.805 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59614.log: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-19T00:49:34.805 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67836.log 2024-08-19T00:49:34.806 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.59614.log.gz 2024-08-19T00:49:34.807 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-08-19T00:49:34.807 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-08-19T00:49:34.808 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67836.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67836.log.gz 2024-08-19T00:49:34.808 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40410.log 2024-08-19T00:49:34.810 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49935.log 2024-08-19T00:49:34.810 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-08-19T00:49:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40410.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40410.log.gz 2024-08-19T00:49:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61313.log 2024-08-19T00:49:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49935.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57305.log 2024-08-19T00:49:34.812 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49935.log.gz 2024-08-19T00:49:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69756.log 2024-08-19T00:49:34.814 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61313.log.gz 2024-08-19T00:49:34.815 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57305.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57305.log.gz 2024-08-19T00:49:34.815 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29927.log 2024-08-19T00:49:34.816 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69756.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69756.log.gz 2024-08-19T00:49:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48429.log 2024-08-19T00:49:34.818 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.29927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69113.log 2024-08-19T00:49:34.818 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29927.log.gz 2024-08-19T00:49:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48429.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48429.log.gz 2024-08-19T00:49:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53490.log 2024-08-19T00:49:34.821 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69113.log.gz 2024-08-19T00:49:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66565.log 2024-08-19T00:49:34.823 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27697.log 2024-08-19T00:49:34.825 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66565.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.53490.log.gz 2024-08-19T00:49:34.826 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27697.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27697.log.gz 2024-08-19T00:49:34.826 INFO:teuthology.orchestra.run.smithi007.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.66565.log.gz 2024-08-19T00:49:34.826 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-19T00:49:34.827 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45289.log 2024-08-19T00:49:34.829 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31441.log 2024-08-19T00:49:34.830 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45289.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-19T00:49:34.830 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45289.log.gz 2024-08-19T00:49:34.830 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61486.log 2024-08-19T00:49:34.832 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35878.log 2024-08-19T00:49:34.832 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31441.log.gz 2024-08-19T00:49:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40159.log 2024-08-19T00:49:34.833 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61486.log.gz 2024-08-19T00:49:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37817.log 2024-08-19T00:49:34.834 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35878.log.gz 2024-08-19T00:49:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.40159.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.40159.log.gz 2024-08-19T00:49:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37817.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49816.log 2024-08-19T00:49:34.837 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37817.log.gz 2024-08-19T00:49:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37691.log 2024-08-19T00:49:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59759.log 2024-08-19T00:49:34.839 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49816.log.gz 2024-08-19T00:49:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60095.log 2024-08-19T00:49:34.840 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37691.log.gz 2024-08-19T00:49:34.841 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59759.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59759.log.gz 2024-08-19T00:49:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52575.log 2024-08-19T00:49:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60095.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60095.log.gz 2024-08-19T00:49:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34806.log 2024-08-19T00:49:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34680.log 2024-08-19T00:49:34.845 INFO:teuthology.orchestra.run.smithi007.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.52575.log.gz 2024-08-19T00:49:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34806.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34806.log.gz 2024-08-19T00:49:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56874.log 2024-08-19T00:49:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34680.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34680.log.gz 2024-08-19T00:49:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38525.log 2024-08-19T00:49:34.849 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69409.log 2024-08-19T00:49:34.849 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56874.log.gz 2024-08-19T00:49:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38525.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38525.log.gz 2024-08-19T00:49:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31230.log 2024-08-19T00:49:34.852 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69409.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36983.log 2024-08-19T00:49:34.852 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69409.log.gz 2024-08-19T00:49:34.853 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70523.log 2024-08-19T00:49:34.853 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31230.log.gz 2024-08-19T00:49:34.855 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36983.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36983.log.gz 2024-08-19T00:49:34.855 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.62021.log 2024-08-19T00:49:34.855 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70523.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70523.log.gz 2024-08-19T00:49:34.856 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46278.log 2024-08-19T00:49:34.857 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68234.log 2024-08-19T00:49:34.857 INFO:teuthology.orchestra.run.smithi007.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.62021.log.gz 2024-08-19T00:49:34.859 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46278.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46278.log.gz 2024-08-19T00:49:34.861 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68234.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.68234.log.gz 2024-08-19T00:49:34.861 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30691.log 2024-08-19T00:49:34.862 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60002.log 2024-08-19T00:49:34.864 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.30691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43190.log 2024-08-19T00:49:34.864 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30691.log.gz 2024-08-19T00:49:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60002.log: /var/log/ceph/ceph-client.admin.43190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69241.log 2024-08-19T00:49:34.866 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.60002.log.gz 2024-08-19T00:49:34.867 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43190.log.gz 2024-08-19T00:49:34.868 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35668.log 2024-08-19T00:49:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69241.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-19T00:49:34.869 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69241.log.gz 2024-08-19T00:49:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60778.log 2024-08-19T00:49:34.871 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35668.log.gz 2024-08-19T00:49:34.874 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.60778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48984.log 2024-08-19T00:49:34.879 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.60778.log.gz 2024-08-19T00:49:34.879 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73056.log 2024-08-19T00:49:34.880 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-19T00:49:34.880 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48984.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48984.log.gz 2024-08-19T00:49:34.880 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60755.log 2024-08-19T00:49:34.880 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73056.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73056.log.gz 2024-08-19T00:49:34.880 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57655.log 2024-08-19T00:49:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60755.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60755.log.gz 2024-08-19T00:49:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38430.log 2024-08-19T00:49:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33307.log 2024-08-19T00:49:34.882 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57655.log.gz 2024-08-19T00:49:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34890.log 2024-08-19T00:49:34.883 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38430.log.gz 2024-08-19T00:49:34.885 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33307.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33307.log.gz 2024-08-19T00:49:34.885 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70819.log 2024-08-19T00:49:34.885 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34890.log.gz 2024-08-19T00:49:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72215.log 2024-08-19T00:49:34.888 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.70819.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.35359.log 2024-08-19T00:49:34.888 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.0.70819.log.gz 2024-08-19T00:49:34.889 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60815.log 2024-08-19T00:49:34.889 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72215.log.gz 2024-08-19T00:49:34.890 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48799.log 2024-08-19T00:49:34.890 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35359.log.gz 2024-08-19T00:49:34.892 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28776.log 2024-08-19T00:49:34.892 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60815.log.gz 2024-08-19T00:49:34.893 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56822.log 2024-08-19T00:49:34.893 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48799.log.gz 2024-08-19T00:49:34.894 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2024-08-19T00:49:34.895 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28776.log.gz 2024-08-19T00:49:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53677.log 2024-08-19T00:49:34.896 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56822.log.gz 2024-08-19T00:49:34.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45076.log 2024-08-19T00:49:34.897 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2024-08-19T00:49:34.899 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53677.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53677.log.gz 2024-08-19T00:49:34.899 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.39201.log 2024-08-19T00:49:34.900 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42510.log 2024-08-19T00:49:34.900 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45076.log.gz 2024-08-19T00:49:34.901 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39201.log: gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39201.log.gz 2024-08-19T00:49:34.902 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.70397.log 2024-08-19T00:49:34.903 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42510.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42510.log.gz 2024-08-19T00:49:34.903 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.0.29334.log 2024-08-19T00:49:34.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70397.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70397.log.gz 2024-08-19T00:49:34.905 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41211.log 2024-08-19T00:49:34.905 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.29334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.29334.log.gz 2024-08-19T00:49:34.906 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50892.log 2024-08-19T00:49:34.907 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41211.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41211.log.gz 2024-08-19T00:49:34.908 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-08-19T00:49:34.909 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2024-08-19T00:49:34.909 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50892.log.gz 2024-08-19T00:49:34.911 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36526.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-08-19T00:49:34.911 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.71351.log 2024-08-19T00:49:34.912 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39033.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2024-08-19T00:49:34.912 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73182.log 2024-08-19T00:49:34.913 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31613.log 2024-08-19T00:49:34.914 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71351.log.gz 2024-08-19T00:49:34.915 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73182.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73182.log.gz 2024-08-19T00:49:34.916 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.31613.log: --verbose -- /var/log/ceph/ceph-client.admin.27474.log 2024-08-19T00:49:34.916 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31613.log.gz 2024-08-19T00:49:34.917 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28021.log 2024-08-19T00:49:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48873.log 2024-08-19T00:49:34.918 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27474.log.gz 2024-08-19T00:49:34.920 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28021.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28021.log.gz 2024-08-19T00:49:34.920 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71811.log 2024-08-19T00:49:34.921 INFO:teuthology.orchestra.run.smithi007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48873.log.gz 2024-08-19T00:49:34.921 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29969.log 2024-08-19T00:49:34.922 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.71811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71811.log.gz 2024-08-19T00:49:34.923 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65977.log 2024-08-19T00:49:34.924 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.29969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54024.log 2024-08-19T00:49:34.924 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29969.log.gz 2024-08-19T00:49:34.926 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65977.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65977.log.gz 2024-08-19T00:49:34.927 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54024.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54024.log.gz 2024-08-19T00:49:34.927 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56646.log 2024-08-19T00:49:34.928 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58965.log 2024-08-19T00:49:34.930 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37859.log 2024-08-19T00:49:34.930 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56646.log.gz 2024-08-19T00:49:34.931 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58965.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-19T00:49:34.931 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58965.log.gz 2024-08-19T00:49:34.931 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57546.log 2024-08-19T00:49:34.933 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47726.log 2024-08-19T00:49:34.933 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37859.log.gz 2024-08-19T00:49:34.934 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57912.log 2024-08-19T00:49:34.934 INFO:teuthology.orchestra.run.smithi007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.57546.log.gz 2024-08-19T00:49:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32033.log 2024-08-19T00:49:34.935 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47726.log.gz 2024-08-19T00:49:34.936 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2024-08-19T00:49:34.937 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57912.log.gz 2024-08-19T00:49:34.938 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63166.log 2024-08-19T00:49:34.938 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32033.log.gz 2024-08-19T00:49:34.938 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47837.log 2024-08-19T00:49:34.939 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2024-08-19T00:49:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32511.log 2024-08-19T00:49:34.940 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63166.log.gz 2024-08-19T00:49:34.941 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-08-19T00:49:34.941 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47837.log.gz 2024-08-19T00:49:34.942 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49147.log 2024-08-19T00:49:34.943 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32511.log.gz 2024-08-19T00:49:34.944 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63554.log 2024-08-19T00:49:34.944 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-08-19T00:49:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50414.log 2024-08-19T00:49:34.945 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49147.log.gz 2024-08-19T00:49:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54561.log 2024-08-19T00:49:34.946 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63554.log.gz 2024-08-19T00:49:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68463.log 2024-08-19T00:49:34.948 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50414.log.gz 2024-08-19T00:49:34.949 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2024-08-19T00:49:34.949 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54561.log.gz 2024-08-19T00:49:34.950 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60367.log 2024-08-19T00:49:34.950 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68463.log.gz 2024-08-19T00:49:34.951 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73308.log 2024-08-19T00:49:34.951 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gz 2024-08-19T00:49:34.953 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 2024-08-19T00:49:34.953 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60367.log.gz 2024-08-19T00:49:34.954 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64141.log 2024-08-19T00:49:34.954 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73308.log.gz 2024-08-19T00:49:34.955 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42804.log 2024-08-19T00:49:34.955 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2024-08-19T00:49:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72486.log 2024-08-19T00:49:34.956 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64141.log.gz 2024-08-19T00:49:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61823.log 2024-08-19T00:49:34.958 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42804.log.gz 2024-08-19T00:49:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65931.log 2024-08-19T00:49:34.959 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72486.log.gz 2024-08-19T00:49:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34344.log 2024-08-19T00:49:34.960 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61823.log.gz 2024-08-19T00:49:34.961 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56706.log 2024-08-19T00:49:34.961 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65931.log.gz 2024-08-19T00:49:34.962 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62778.log 2024-08-19T00:49:34.962 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34344.log.gz 2024-08-19T00:49:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42425.log 2024-08-19T00:49:34.964 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56706.log.gz 2024-08-19T00:49:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62778.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.62778.log.gz 2024-08-19T00:49:34.966 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70141.log 2024-08-19T00:49:34.966 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42425.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42425.log.gz 2024-08-19T00:49:34.967 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39369.log 2024-08-19T00:49:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70141.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70141.log.gz 2024-08-19T00:49:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29486.log 2024-08-19T00:49:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53813.log 2024-08-19T00:49:34.970 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39369.log.gz 2024-08-19T00:49:34.971 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.29486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31483.log 2024-08-19T00:49:34.971 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29486.log.gz 2024-08-19T00:49:34.972 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2024-08-19T00:49:34.972 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53813.log.gz 2024-08-19T00:49:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28692.log 2024-08-19T00:49:34.974 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31483.log.gz 2024-08-19T00:49:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63728.log 2024-08-19T00:49:34.975 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz 2024-08-19T00:49:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42020.log 2024-08-19T00:49:34.976 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28692.log.gz 2024-08-19T00:49:34.977 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69053.log 2024-08-19T00:49:34.977 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63728.log.gz 2024-08-19T00:49:34.978 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71181.log 2024-08-19T00:49:34.979 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42020.log.gz 2024-08-19T00:49:34.980 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43685.log 2024-08-19T00:49:34.980 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69053.log.gz 2024-08-19T00:49:34.981 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52469.log 2024-08-19T00:49:34.981 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71181.log.gz 2024-08-19T00:49:34.982 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65878.log 2024-08-19T00:49:34.982 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43685.log.gz 2024-08-19T00:49:34.983 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63316.log 2024-08-19T00:49:34.984 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52469.log.gz 2024-08-19T00:49:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2024-08-19T00:49:34.985 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65878.log.gz 2024-08-19T00:49:34.986 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56319.log 2024-08-19T00:49:34.986 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63316.log.gz 2024-08-19T00:49:34.987 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72089.log 2024-08-19T00:49:34.987 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2024-08-19T00:49:34.989 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62498.log 2024-08-19T00:49:34.989 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56319.log.gz 2024-08-19T00:49:34.989 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44949.log 2024-08-19T00:49:34.990 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72089.log.gz 2024-08-19T00:49:34.990 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2024-08-19T00:49:34.991 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62498.log.gz 2024-08-19T00:49:34.991 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-19T00:49:34.992 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39411.log 2024-08-19T00:49:34.992 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2024-08-19T00:49:34.993 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39075.log 2024-08-19T00:49:34.993 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2024-08-19T00:49:34.994 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51172.log 2024-08-19T00:49:34.994 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39411.log.gz 2024-08-19T00:49:34.996 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41450.log 2024-08-19T00:49:34.996 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39075.log.gz 2024-08-19T00:49:34.997 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2024-08-19T00:49:34.997 INFO:teuthology.orchestra.run.smithi007.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.51172.log.gz 2024-08-19T00:49:34.998 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38949.log 2024-08-19T00:49:34.998 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41450.log.gz 2024-08-19T00:49:34.999 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64028.log 2024-08-19T00:49:35.000 INFO:teuthology.orchestra.run.smithi007.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2024-08-19T00:49:35.001 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51843.log 2024-08-19T00:49:35.001 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38949.log.gz 2024-08-19T00:49:35.002 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.64028.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.64028.log.gz -5 2024-08-19T00:49:35.002 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2024-08-19T00:49:35.003 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73602.log 2024-08-19T00:49:35.003 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51843.log.gz 2024-08-19T00:49:35.004 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56258.log 2024-08-19T00:49:35.005 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2024-08-19T00:49:35.005 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51112.log 2024-08-19T00:49:35.006 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73602.log.gz 2024-08-19T00:49:35.007 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66602.log 2024-08-19T00:49:35.007 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56258.log.gz 2024-08-19T00:49:35.008 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44275.log 2024-08-19T00:49:35.008 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51112.log.gz 2024-08-19T00:49:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67210.log 2024-08-19T00:49:35.009 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66602.log.gz 2024-08-19T00:49:35.011 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log 2024-08-19T00:49:35.011 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44275.log.gz 2024-08-19T00:49:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58451.log 2024-08-19T00:49:35.012 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67210.log.gz 2024-08-19T00:49:35.013 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54173.log 2024-08-19T00:49:35.013 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-08-19T00:49:35.014 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33533.log 2024-08-19T00:49:35.016 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34115.log 2024-08-19T00:49:35.016 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54173.log.gz 2024-08-19T00:49:35.016 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.58451.log.gz 2024-08-19T00:49:35.017 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63106.log 2024-08-19T00:49:35.017 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.33533.log.gz 2024-08-19T00:49:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68749.log 2024-08-19T00:49:35.019 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34115.log.gz/var/log/ceph/ceph-client.admin.63106.log: 2024-08-19T00:49:35.019 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-08-19T00:49:35.020 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63106.log.gz 2024-08-19T00:49:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39327.log 2024-08-19T00:49:35.021 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68749.log.gz 2024-08-19T00:49:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60249.log 2024-08-19T00:49:35.022 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-08-19T00:49:35.023 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47143.log 2024-08-19T00:49:35.024 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39327.log.gz 2024-08-19T00:49:35.025 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53214.log 2024-08-19T00:49:35.025 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60249.log.gz 2024-08-19T00:49:35.025 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.47143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47143.log.gz 2024-08-19T00:49:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28566.log 2024-08-19T00:49:35.027 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57715.log 2024-08-19T00:49:35.027 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53214.log.gz 2024-08-19T00:49:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55888.log 2024-08-19T00:49:35.028 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28566.log.gz 2024-08-19T00:49:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69011.log 2024-08-19T00:49:35.030 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57715.log.gz 2024-08-19T00:49:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47985.log 2024-08-19T00:49:35.032 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55435.log 2024-08-19T00:49:35.032 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69011.log.gz 2024-08-19T00:49:35.032 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.55888.log.gz 2024-08-19T00:49:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71553.log 2024-08-19T00:49:35.034 INFO:teuthology.orchestra.run.smithi007.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.47985.log.gz 2024-08-19T00:49:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70439.log 2024-08-19T00:49:35.035 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55435.log.gz 2024-08-19T00:49:35.035 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58596.log 2024-08-19T00:49:35.036 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70439.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71553.log.gz 2024-08-19T00:49:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63064.log 2024-08-19T00:49:35.037 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70439.log.gz 2024-08-19T00:49:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66711.log 2024-08-19T00:49:35.038 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58596.log.gz 2024-08-19T00:49:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63517.log 2024-08-19T00:49:35.039 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63064.log.gz 2024-08-19T00:49:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40851.log 2024-08-19T00:49:35.041 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66711.log.gz 2024-08-19T00:49:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57804.log 2024-08-19T00:49:35.043 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56342.log 2024-08-19T00:49:35.044 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40851.log.gz 2024-08-19T00:49:35.044 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.63517.log.gz 2024-08-19T00:49:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-08-19T00:49:35.045 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57804.log.gz 2024-08-19T00:49:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33599.log 2024-08-19T00:49:35.047 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65483.log 2024-08-19T00:49:35.047 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-08-19T00:49:35.047 INFO:teuthology.orchestra.run.smithi007.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.56342.log.gz 2024-08-19T00:49:35.048 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59473.log 2024-08-19T00:49:35.049 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.33599.log.gz 2024-08-19T00:49:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38342.log 2024-08-19T00:49:35.049 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65483.log.gz 2024-08-19T00:49:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68603.log 2024-08-19T00:49:35.051 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59473.log.gz 2024-08-19T00:49:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48318.log 2024-08-19T00:49:35.052 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38342.log.gz 2024-08-19T00:49:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64677.log 2024-08-19T00:49:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62171.log 2024-08-19T00:49:35.055 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.68603.log.gz 2024-08-19T00:49:35.055 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48318.log.gz 2024-08-19T00:49:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53308.log 2024-08-19T00:49:35.056 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64677.log.gz 2024-08-19T00:49:35.057 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35454.log 2024-08-19T00:49:35.057 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62171.log.gz 2024-08-19T00:49:35.058 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47763.log 2024-08-19T00:49:35.058 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53308.log.gz 2024-08-19T00:49:35.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59007.log 2024-08-19T00:49:35.059 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35454.log.gz 2024-08-19T00:49:35.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47763.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47763.log.gz 2024-08-19T00:49:35.061 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58427.log 2024-08-19T00:49:35.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59007.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59007.log.gz 2024-08-19T00:49:35.062 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37378.log 2024-08-19T00:49:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55227.log 2024-08-19T00:49:35.064 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58427.log.gz 2024-08-19T00:49:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50606.log 2024-08-19T00:49:35.065 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37378.log.gz 2024-08-19T00:49:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.55227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55227.log.gz 2024-08-19T00:49:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64794.log 2024-08-19T00:49:35.067 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38122.log 2024-08-19T00:49:35.068 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50606.log.gz 2024-08-19T00:49:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59226.log 2024-08-19T00:49:35.069 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64794.log.gz 2024-08-19T00:49:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58857.log 2024-08-19T00:49:35.070 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38122.log.gz 2024-08-19T00:49:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42594.log 2024-08-19T00:49:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59937.log 2024-08-19T00:49:35.073 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.59226.log.gz 2024-08-19T00:49:35.073 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58857.log.gz 2024-08-19T00:49:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62213.log 2024-08-19T00:49:35.074 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42594.log.gz 2024-08-19T00:49:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65070.log 2024-08-19T00:49:35.075 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59937.log.gz 2024-08-19T00:49:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45938.log 2024-08-19T00:49:35.077 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62213.log.gz 2024-08-19T00:49:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27683.log 2024-08-19T00:49:35.077 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65070.log.gz 2024-08-19T00:49:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2024-08-19T00:49:35.079 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45938.log.gz 2024-08-19T00:49:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.27683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57154.log 2024-08-19T00:49:35.080 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27683.log.gz 2024-08-19T00:49:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41025.log 2024-08-19T00:49:35.081 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2024-08-19T00:49:35.083 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67714.log 2024-08-19T00:49:35.083 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57154.log.gz 2024-08-19T00:49:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28370.log 2024-08-19T00:49:35.084 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41025.log.gz 2024-08-19T00:49:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66916.log 2024-08-19T00:49:35.085 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67714.log.gz 2024-08-19T00:49:35.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49685.log 2024-08-19T00:49:35.086 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28370.log.gz 2024-08-19T00:49:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31907.log 2024-08-19T00:49:35.088 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66916.log.gz 2024-08-19T00:49:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.49685.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.49685.log.gz -5 2024-08-19T00:49:35.088 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55556.log 2024-08-19T00:49:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31907.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31907.log.gz 2024-08-19T00:49:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71104.log 2024-08-19T00:49:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66541.log 2024-08-19T00:49:35.092 INFO:teuthology.orchestra.run.smithi007.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.55556.log.gz 2024-08-19T00:49:35.093 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41342.log 2024-08-19T00:49:35.093 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71104.log.gz 2024-08-19T00:49:35.094 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48688.log 2024-08-19T00:49:35.094 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66541.log.gz 2024-08-19T00:49:35.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44155.log 2024-08-19T00:49:35.095 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41342.log.gz 2024-08-19T00:49:35.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51501.log 2024-08-19T00:49:35.097 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48688.log.gz 2024-08-19T00:49:35.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.44155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44155.log.gz 2024-08-19T00:49:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45457.log 2024-08-19T00:49:35.099 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28025.log 2024-08-19T00:49:35.099 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51501.log.gz 2024-08-19T00:49:35.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26674.log 2024-08-19T00:49:35.100 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45457.log.gz 2024-08-19T00:49:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.28025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34512.log 2024-08-19T00:49:35.102 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28025.log.gz 2024-08-19T00:49:35.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41169.log 2024-08-19T00:49:35.103 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.26674.log.gz 2024-08-19T00:49:35.104 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34512.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34512.log.gz 2024-08-19T00:49:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41169.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41169.log.gz 2024-08-19T00:49:35.156 INFO:teuthology.orchestra.run.smithi162.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-19T00:49:35.159 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-08-19T00:49:35.159 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m1.149s 2024-08-19T00:49:35.159 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m4.195s 2024-08-19T00:49:35.159 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.449s 2024-08-19T00:49:35.285 INFO:teuthology.orchestra.run.smithi007.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-19T00:49:35.398 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-19T00:49:35.414 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-19T00:49:35.550 INFO:teuthology.orchestra.run.smithi007.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-19T00:49:35.553 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-08-19T00:49:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m1.547s 2024-08-19T00:49:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m4.956s 2024-08-19T00:49:35.554 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m2.542s 2024-08-19T00:49:35.555 INFO:tasks.ceph:Archiving logs... 2024-08-19T00:49:35.555 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/remote/smithi007/log 2024-08-19T00:49:35.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T00:49:36.826 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/remote/smithi162/log 2024-08-19T00:49:36.827 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T00:49:37.377 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-19T00:49:37.386 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-19T00:49:37.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T00:49:37.391 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T00:49:37.512 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-19T00:49:37.521 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-19T00:49:37.522 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:49:37.526 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:49:37.557 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:49:37.559 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:49:37.564 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:49:37.564 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-08-19T00:49:37.565 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 +301us[ +302us] +/- 39ms 2024-08-19T00:49:37.565 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -332us[ -330us] +/- 60ms 2024-08-19T00:49:37.565 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -90us[ -89us] +/- 78ms 2024-08-19T00:49:37.565 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:49:37.566 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:49:37.566 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-08-19T00:49:37.566 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 +276us[ +277us] +/- 39ms 2024-08-19T00:49:37.566 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -320us[ -320us] +/- 60ms 2024-08-19T00:49:37.567 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -68us[ -68us] +/- 78ms 2024-08-19T00:49:37.567 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:49:37.567 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-19T00:49:37.591 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-19T00:49:37.591 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-19T00:49:37.599 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T00:49:37.735 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T00:49:37.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:49:37.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:49:37.895 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:49:37.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:49:37.954 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-19T00:49:37.963 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-19T00:49:38.076 INFO:teuthology.task.internal:Duration was 1052.535551 seconds 2024-08-19T00:49:38.077 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-19T00:49:38.085 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-19T00:49:38.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T00:49:38.090 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T00:49:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:49:38.176 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:49:38.676 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-19T00:49:38.677 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-08-19T00:49:38.677 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T00:49:38.728 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-08-19T00:49:38.728 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T00:49:38.778 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-19T00:49:38.779 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T00:49:38.783 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T00:49:38.842 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-19T00:49:38.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T00:49:38.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T00:49:38.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-19T00:49:38.991 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-19T00:49:38.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T00:49:39.048 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T00:49:39.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-19T00:49:39.113 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:49:39.118 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:49:39.184 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-08-19T00:49:39.188 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-08-19T00:49:39.218 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:49:39.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:49:39.252 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:49:39.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:49:39.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-19T00:49:39.298 INFO:teuthology.task.internal:Transferring archived files... 2024-08-19T00:49:39.299 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/remote/smithi007 2024-08-19T00:49:39.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T00:49:39.366 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860074/remote/smithi162 2024-08-19T00:49:39.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T00:49:39.428 INFO:teuthology.task.internal:Removing archive directory... 2024-08-19T00:49:39.428 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T00:49:39.433 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T00:49:39.469 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-19T00:49:39.479 INFO:teuthology.task.internal:Not uploading archives. 2024-08-19T00:49:39.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-19T00:49:39.748 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-19T00:49:39.748 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T00:49:39.752 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T00:49:39.784 INFO:teuthology.orchestra.run.smithi007.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 19 00:49 /home/ubuntu/cephtest 2024-08-19T00:49:39.788 INFO:teuthology.orchestra.run.smithi162.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 19 00:49 /home/ubuntu/cephtest 2024-08-19T00:49:39.790 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-19T00:49:39.801 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-19T00:49:39.825 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/damage} duration: 1052.5355505943298 failure_reason: 'Test failure: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cca8421f11eb450193b808a08c9c768e status: fail success: false 2024-08-19T00:49:39.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-19T00:49:39.909 INFO:teuthology.run:FAIL